Trigger word analysis happens locally. It's when that's triggered that audio gets sent to cloud
theterrasque
I'm sorry, but what is ill informed or opinion about it? Fact is it can do things no other image generator can do, open source or not. It can also effortlessly do things that would require a lot of tinkering with controlnet in comfyui, or even making custom lora's. It's a multimodal model that can do image and text both input and output, and does it well. All other useful image generators are diffusion based, which doesn't read a prompt in the same way, and is more about weighting patterns based on keywords rather than any real understanding of the prompt. That's why they're struggling with relatively simple things like "a full glass of wine" or "a horse riding an astronaut on the moon". If I'm wrong about this, please prove me wrong. Nothing would make me happier than finding an open source model that can do what openai's new image model can do, really. I already run llama.cpp servers and comfyui locally, I have my own AI server in the basement with a P40 and a 3090. Please, please prove me wrong here.
I love open models, and been running them locally since first llama model, but that doesn't mean I willfully ignore and pretend what claude and openai and google develops doesn't exist. Rather I want awareness about it, that it does exist, and I want an open source version of it.
I know them, and used them a bit. I even mentioned them in an earlier comment. The capabilities of OpenAI's new model is on a different level in my experience.
https://www.reddit.com/r/StableDiffusion/comments/1jlj8me/4o_vs_flux/ - read the comments there. That's a community dedicated to running local diffusion models. They're familiar with all the tricks. They're pretty damn impressed too.
I can't help but feel that people here either haven't tried the new openai image model, or have never actually used any of the existing ai image generators before.
No other model on market can do anything like that. The closest is diffusion based where you could train a lora with a person's look or a specific clothing, then generate multiple times and / or use controlnet to sorta control the output. That's fast hours or days of work, plus it's quite technical to set it up and use.
OpenAI's new model is a paradigm shift in both what the model can do and how you use it, and can easily and effortlessly produce things that was extremely difficult or impossible without complicated procedures and post processing in Photoshop.
Edit Some examples. Try to make any of this in any of the existing image generators
- https://www.reddit.com/r/ChatGPT/comments/1jl36h6/gpt_was_also_able_to_help_me_make_a_comic_ive/
- https://www.reddit.com/r/ChatGPT/comments/1jkl5m2/i_work_in_ecommerce_the_new_gpt_image_update_has/
- https://www.reddit.com/r/ChatGPT/comments/1jlewya/by_god_what_have_i_done/
- https://www.reddit.com/r/ChatGPT/comments/1jm8ddg/im_not_the_first_to_figure_this_trick_out_am_i/
- https://www.reddit.com/r/ChatGPT/comments/1jjsfkb/starting_today_gpt4o_is_going_to_be_incredibly/
- https://www.reddit.com/r/ChatGPT/comments/1jn2kpy/i_created_a_character_with_chatgpt_and_send_her/
- https://www.reddit.com/r/ChatGPT/comments/1jkaaxh/gpt4o_image_generation_is_absolutely_insane/
- Autoregressive model
- Multimodal with the LLM
- Can keep consistency between images
- Much better at text rendering
- Can combine images, like you have one image and you upload a picture of a jacket and say "put this on him" and it does it
- Can upload a picture of yourself and say "put me on the beach", and then for example if you don't like it you can tell it to do a different type of beach, and then say "and put me on a white horse and give me some nice beach wear" for example.
It understands what you're telling it, and can generate images from vague descriptions, combine things from different images just by telling it, modify it and understand the context - like knowing that "me" is the person in the image, for example.
Edit: From OpenAI - "4o image generation is an autoregressive model natively embedded within ChatGPT"
unsandboxed software
I wonder how hard it would be to sandbox most games. We have things like https://en.m.wikipedia.org/wiki/Sandboxie and most games would have a fairly simple access list.
Edit: or sandbox steam itself
Since I already use ZFS for my data storage, I just created a private dataset for sensitive data. I also have my services split based on if it's sensitive or not, so the non sensitive stuff comes up automatically and the sensitive stuff waits for me to log in and unlock the dataset.