I'm thinking through it and I don't think you should run a therapist off your phone either. Not even for privacy reasons, that just seems like a recipe for disaster.

[–] can@sh.itjust.works 11 points 9 months ago (1 children)

Therapist is too strong of a word for what I'm looking for.

Sometimes I just need to hear my emotions are valid without burdening anyone :(

[–] FractalsInfinite@sh.itjust.works 3 points 9 months ago* (last edited 9 months ago) (1 children)

EDIT: It seems the app sherpa has what you need. Just use one of the models found here, preferably 7b-chat Q4_K_S

Some people are energised by that kind of thing. However if you don't want to reveal things to humans, you can use (if you are more technical) llama.cpp

[–] can@sh.itjust.works 3 points 9 months ago* (last edited 9 months ago)

Thanks for the links. So I don't need to worry about downloading the model from meta eh?

Edit: oh you mean download this one instead?

I tried and the app crashes after submitting a prompt but this is a good starting point. I'll take a look into it further later.