Self-hosting

3414 readers

29 users here now

Hosting your own services. Preferably at home and on low-power or shared hardware.

Also check out:

founded 3 years ago

MODERATORS

[email protected]

-4

Idea: Selfhosted Interface for LLMs (lemmy.blahaj.zone)

submitted 4 weeks ago by [email protected] to c/[email protected]

2 comments fedilink hide all child comments

Like SearchXNG but for chatbots.

Acts as a trusted inbetween that takes the hit on all the tracking for you and you need no account.

There would be a self-hosted server with a webinterface, where you can choose which of the popular chatbots or hosted open source models you want to ask.

The not free Accounts could be payed with donations maybe?

Basically like duck.ai but without a big company involved.

top 2 comments

sorted by: hot top controversial new old

[–] [email protected] 1 points 14 hours ago

I was looking for something like this. The idea is:

Run an open model like LLAMA or Mistral on my home server
Access it from a client on my phone, saving my poor phone's processor and battery.

Does something like this exist?

[–] [email protected] 6 points 4 weeks ago

https://github.com/open-webui/open-webui