HoleSailor

joined 10 months ago
[–] HoleSailor@feddit.org 1 points 4 months ago

3B to 4B on phone.

[–] HoleSailor@feddit.org 1 points 4 months ago (2 children)

I don't trust DDG, really. I run LLAMA locally. It serves my purpose.

[–] HoleSailor@feddit.org 3 points 4 months ago

I am pretty happy with Markor.

[–] HoleSailor@feddit.org 1 points 4 months ago* (last edited 4 months ago)

I use ChatterUI (available on Github) because I found it faster and smoother than the rest of the clients available for Android.

Yes, the gguf models on Huggingface are totally safe. They will run locally in your phone. You don't need Internet connection to run that model. So, it is safe. No data will ever leave your device.

Edit: There is only one client available on f-droid: Maid But it never worked in my device, unfortunately.

[–] HoleSailor@feddit.org 1 points 5 months ago* (last edited 5 months ago) (2 children)

For Android, there are plenty of local AI clients such as ChatterUI, PocketPal etc. Just download a suitable gguf model from huggingface and use it. If you have 8GB+ RAM, you can easily run 3B models.

Edit: Try to find iMatrix quantized gguf models. They preserve better quality in in smaller size and runs bit faster.

[–] HoleSailor@feddit.org 7 points 5 months ago

Then they will close one day.

[–] HoleSailor@feddit.org 2 points 5 months ago (1 children)

It is not the official one but is better than nothing. The .li mirror is infested with cringy ads. Official ones such as .rs or .is never had any such crap.

[–] HoleSailor@feddit.org 7 points 5 months ago (3 children)

Any hope for original Libgen's comeback? Been waiting for a year.

[–] HoleSailor@feddit.org 5 points 5 months ago (1 children)

I use OpenPGP in Termux for symmetric file encryption.

 

I am looking for an open source alternative to KineMaster for android. Any suggestion out there?

view more: next ›