vrighter

joined 2 years ago
[–] [email protected] 9 points 1 month ago

1% slowdown is pretty bad. You'd still do better just not using it. 19% is huge!

[–] [email protected] 9 points 1 month ago (6 children)

no, they aren't processing high quality data from multiple sources. They're giving you a statistical average of that data. They will always be wrong by nature. Hallucinations cannot be eliminated. Anyone saying otherwise (irrelevant of how rich they are) is bullshitting.

[–] [email protected] 7 points 1 month ago (17 children)

python is a language explicitly designed to resist any form of proper optimization. It just can't be made fast

[–] [email protected] 45 points 1 month ago (1 children)

these types of laws usually come from the most technically illiterate people ever

[–] [email protected] 1 points 1 month ago* (last edited 1 month ago) (2 children)

yep. you could of course swap weights in and out, but that would slow things down to a crawl. So they get lots of vram (edit: for example, an H100 has 80gb of vram)

[–] [email protected] 6 points 1 month ago (4 children)

that's why they need huge datacenters and thousands of GPUs. And, pretty soon, dedicated power plants. It is insane just how wasteful this all is.

[–] [email protected] 11 points 1 month ago* (last edited 1 month ago)

yes, but that doesn't help if the software refuses to run on modern java

[–] [email protected] 1 points 1 month ago

i wasn't born yet. I don't even think half of me was in my dad's balls yet

[–] [email protected] 7 points 1 month ago (6 children)

imagine that to type one letter, you need to manually read all unicode code points several thousand times. When you're done, you select one letter to type.

Then you start rereading all unicode code points again for thousands of times again, for the next letter.

That's how llms work. When they say 175 billion parameters, it means at least that many calculations per token it generates

[–] [email protected] 13 points 1 month ago (1 children)

funny how everyone who wants to write a new browser (except the ladybird guys) always skimp on writing the actual browser part

[–] [email protected] 3 points 1 month ago

ai chip demand explodes amongst manufacturers of crap who hope that demand for ai chips amongst consumers somehow explodes too

[–] [email protected] 2 points 1 month ago

in yes/no type questions, 50% success rate is the absolute worst one can do. Any worse and you're just giving an inverted correct answer more than half the time

view more: ‹ prev next ›