TechTakes

1978 readers

100 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago

MODERATORS

657

submitted 1 year ago by [email protected] to c/[email protected]

252 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 6 points 1 year ago* (last edited 1 year ago) (11 children)

It doesn’t read on demand, it reads once when it’s being trained, and it later recalls what it learnt from that training.

Training LLMs takes a very long time and a lot of hardware power.

[–] [email protected] 16 points 1 year ago* (last edited 1 year ago) (3 children)

If it doesn't read it on demand, how does it sometimes spill its training data verbatim then?

The trained model shouldn't have that, right? But it does?

[–] [email protected] 3 points 1 year ago (1 children)

Do you read a song on demand when you are singing the lyrics verbatim?

load more comments (1 replies)

load more comments (8 replies)