Maybe they don't know about Lemmy, or maybe they want to run LLMs locally for reasons other than idealism?
this post was submitted on 02 Nov 2023
46 points (89.7% liked)
LocalLLaMA
3361 readers
3 users here now
Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.
Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.
As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.
Rules:
Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.
Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.
Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.
Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.
founded 2 years ago
MODERATORS
We only got about 40000 active users here on Lemmy. Guess most people like to see dozens of posts per day even in a niche community. I like it here. But I guess it's going to be difficult to attract users from /r/LocalLLaMA And as far as I know we haven't advertised there yet. I'm still not sure if we should...
Because it's not ideological, they just want to generate porn, which is against OpenAI TOS.
To be fair, I saw /r/LocalLLaMA referenced in a scientific paper ("bloc97" in the paper about Streaming-LLM) talking about NTK-aware RoPE scaling. Which is kind of an awesome achievement.
And to me it's fascinating that Reddit is generally friendly towards porn. I think they have started to restrict adult content with their API change but so far there are lots of corners where you can even post pictures of your member. And that's not really possible on many of the other big commercial online platforms. I wonder where they're headed in the long term.
Personally speaking, the issue isn't I don't want to rely on them, it's that I can't use them for my use case because it'd be a HIPPA violation.
The alternative is a run a local/cloud version that I control. Discussing the set up process can be done on reddit without endangering patients.
For me, I found only one group about LLM here in search. You can make Lemmy better if share another groups for similar topics since search feature doesn't work well yet.
Because reddit is a comfy echo chamber where people are banned for opposing the ruling dogmas in the subs. People love that
as opposed to any other form of communication where non-conformance is sought out
Not sure what you're saying
That everywhere gets you banned for doing exactly what you said. Hell, lemmy is full of powertripping moderators. There is a log full of bullshit one word explanations for banning people.