Shey should have linked the actual chip somewhere prominently:
https://hailo.ai/products/ai-accelerators/hailo-8-ai-accelerator/
But yeah, I can already run object detecton at 1 FPS. Or more if it's a tiny model. And I'd be interested in the proper specs. Does it have memory on board? Or does the RasPi do all the heavy lifting anyways? What kind of models fit? Voice recognition, ... ?
Hmm, the adventure of surfing the web? That forums and such were filled with nerds and quality advice. And the lack of monetization.
I remember (illegally) downloading lots of music, trying webbrowsers and them being super slow on my machine and of course pictures would load even slower. Alter (I think after the 90s were over) discovering Linux, reading forums and everyone was helping each other out. Or discussing detailed things and niche interests. And it had a distinct culture. A suggested/mandatory way of writing and replying so things would be organized and easy to follow.
I think most of the media coverage is hype. That doesn't directly answer your question... But I take everything I read with a grain of salt.
Currently, for the tech industry, it's main use is to generate hype and drive the speculation bubble. Whether it's useful or not, slapping the word "AI" on things and offering AI services increases the value of your company. And I personally think if they complain about this, it's they want the bubble even bigger, but they already did the most obvious things. But that has nothing to do with "find use" in the traditional sense (for the thing itself.)
And other inventions came with hype. Like smartphones (the iPhone.) Everyone wanted one. Lots of people wanted to make cash with that. But still, if it's super new, it's not always obvious at what tasks it excels and what the main benefits are in the long term. At first everyone wants in just because it's cool and everyone else has one. In the end it turned out not every product is better with an App (or Bluetooth). And neither a phone, nor AI can (currently) do the laundry and the other chores. So there is a limit in "use" anyways.
So I think the answer to your question: what did they have in mind... is: What else can we enhance with AI or just slap the words on to make people buy more. And to be cool in the eyes of our investors.
I think one of the next steps is the combination with robotics. That will make it quite more useful. Like input from sensors so AI can take part in the real world, not just the virtual one. But that's going to take some time. We've already started, but it won't happen over night. And for the close future i think it's gonna be gradual increase. AI just needs to get more intelligent, make less errors, be more affordable to run. That's going to be a gradual increase and provide me with a better translation service on my phone, a smart-home that i can interact with better, an assistant that can clean up the mess with all the files on my computer, organize my picture folder... But the revolution already happened. I think it's going to be constant, but smaller steps/ progress from now on.
To me it always just responds:
»I'm sorry, but I can't comply with that request.«
Right after I send a Jailbreak. Also with 4o.
https://github.com/YellowRoseCx/koboldcpp-rocm
That will be optimized for AMD and as far as I know has the same / a very similar user interface.
(The 8GB of VRAM on your graphics card will be some limitation. So maybe stick with smaller and quantized models.)
And share your success stories on [email protected]
I thought OpenAI cracked down on jailbreaking ChatGPT... Is this possible again? Or do these people just post on TikTok the occasions where ChatGPT engages but hide the constant refusals to engage in role play, which also happen?
Dies anyone use ChatGPT as a companion an can enlighten me? Because I've switched to other models a long time ago.
I'm pretty sure he did this out of this own motivation because he thinks/thought it's a fascinating topic. So, sure this doesn't align with popularity. But it's remarkable anyways, you're right. And I always like to watch the progression. As far as I remember the early videos lacked professional audio and video standards that are nowadays the norm on Youtube. At some point he must have bought better equipment, but his content has been compelling since the start of his Youtube 'career'. 😊
And I quite like the science content on Youtube. There are lots of people making really good videos, both from professional video producers and also from scientists (or hobbyists) who just share their insight and interesting perspective.
And maybe have a look at his Youtube channel and the older videos, too. Lots of them are a bit more philosophical and not too technical for the average person. I think he's quite inspiring and conveys very well what AI safety is about, and what kinds of problems that field of science is concerned with.
Pics or it didn't happen.
(Seriously, I'd like to see the source of this story. Googling "Tim the pencil" doesn't bring up anything related.)
100% agree. Also most IRL people I meet in casual situations are pretty alright. I have mostly nice neighbors, sometimes random people help out each other. And that also happens amongst strangers in the supermarket or on public transportation.
(Some people are stupid though. And/or inconsiderate. But I think that's part of the game. Some people just can't board a train properly or get off of it without bumping into 3 other people. 😉 But that shouldn't make your day worse, they're just a bit stupid.)
Thanks for posting something positive. And not just taking it for granted and only mentioning negative thoughts 😊
What's the memory bandwith if I were to run large language models on them? Does it get close to the Apple chips?
I'd say apply some of their specific skills instead of competing at unskilled (and low-pay) labor. Maybe draw illustrations or pictures. Computer programming. Cut videos for some Youtuber...