It's enough to run quantized versions of the distilled r1 model based on Qwen and Llama 3. Don't know how fast it'll run though.
projectmoon
joined 2 years ago
Don't know about "always." In recent years, like the past 10 years, definitely. But I remember a time when Nvidia was the only reasonable recommendation for a graphics card on Linux, because Radeon was so bad. This was before Wayland, and probably even before AMD bought ATI. And it was certainly long before the amdgpu drivers existed.
Please bring back the overflow menu!
Where is this? Somewhere in Europe?
I just need one more. I have two but one is old and has very little VRAM 🫤
Seems like something got messed up when copy and pasting. It's fixed now.
Thanks for catching it!
Yeah, it would be a good idea. Not to auto-update functions, because that would be very very bad, but to at least indicate there's an update available.
For stuff like that, it's best to have an auto formatter like checkstyle or something.
Had a team lead that kept requesting nitpicky changes, going in a FULL CIRCLE about what we should change or not, to the point that changes would take weeks to get merged. Then he had the gall to say that changes were taking too long to be merged and that we couldn't just leave code lying around in PRs.
Jesus fucking Christ.
There's a reason that team imploded....
Yeah, it was something along those lines. I don't remember the exact specifics. I don't really understand why that is. I guess it's because they're copying and pasting nutritional information from the tubs where it's more properly measured by volume. But one would think that regulations would require the same units for serving size and nutritional information. Or at least the same type of unit (mass/volume).
My personal favorite experience relating to this was buying some ice cream with nutritional information by the milliliter, but with serving size by the gram...
Most open/local models require a fraction of the resources of chatgpt. But they are usually not AS good in a general sense. But they often are good enough, and can sometimes surpass ChatGPT in specific domains.