simpleuserhere

simpleuserhere OP t1_jcuc25e wrote on March 19, 2023 at 5:01 PM

Reply to comment by ninjasaid13 in [Research] Alpaca 7B language model running on my Pixel 7 by simpleuserhere

Yes,

simpleuserhere OP t1_jcubta9 wrote on March 19, 2023 at 5:00 PM

Reply to comment by ninjasaid13 in [Research] Alpaca 7B language model running on my Pixel 7 by simpleuserhere

I haven't tried cygwin for Alpaca.cpp.

simpleuserhere OP t1_jcu9x05 wrote on March 19, 2023 at 4:47 PM

Reply to comment by ninjasaid13 in [Research] Alpaca 7B language model running on my Pixel 7 by simpleuserhere

Are you using cygwin?

simpleuserhere OP t1_jcu2ikl wrote on March 19, 2023 at 3:55 PM

Reply to comment by ninjasaid13 in [Research] Alpaca 7B language model running on my Pixel 7 by simpleuserhere

For Windows you need Visual C++ compiler, so install Visual Studio C++ 2019 build tools, follow the instruction here https://github.com/rupeshs/alpaca.cpp#windows

simpleuserhere OP t1_jct9btk wrote on March 19, 2023 at 11:51 AM

Reply to comment by schorhr in [Research] Alpaca 7B language model running on my Pixel 7 by simpleuserhere

For Android build please use Linux ( tested with Ubuntu 20.04)

simpleuserhere OP t1_jct4k2z wrote on March 19, 2023 at 10:51 AM

Reply to comment by schorhr in [Research] Alpaca 7B language model running on my Pixel 7 by simpleuserhere

I have updated readme with Windows build instructions,please check https://github.com/rupeshs/alpaca.cpp#windows

simpleuserhere OP t1_jcrfjsh wrote on March 18, 2023 at 11:59 PM

Reply to comment by schorhr in [Research] Alpaca 7B language model running on my Pixel 7 by simpleuserhere

Thanks,What error are you getting? With Vs compiler and cmake we can easily build it.

simpleuserhere OP t1_jcreufr wrote on March 18, 2023 at 11:53 PM

Reply to comment by Pale-Dentist330 in [Research] Alpaca 7B language model running on my Pixel 7 by simpleuserhere

Hi, please check this branch https://github.com/rupeshs/alpaca.cpp/tree/linux-android-build-support

simpleuserhere OP t1_jcpttav wrote on March 18, 2023 at 5:02 PM

Reply to comment by Meddhouib10 in [Research] Alpaca 7B language model running on my Pixel 7 by simpleuserhere

This model is 4 bit quantized,so it will take less RAM (model size around 4GB)

simpleuserhere OP t1_jcpo1px wrote on March 18, 2023 at 4:24 PM

Reply to [Research] Alpaca 7B language model running on my Pixel 7 by simpleuserhere

I have tested Alpaca 7B model on Android (Google Pixel 7).

https://github.com/rupeshs/alpaca.cpp