👋 Hey, I’m Daniil, and welcome to a ✨ subscriber-only edition ✨ of Creators’ AI. Each week, we post AI Tools, Tutorials, News, and practical knowledge aimed at improving your life with AI. To get full access to our content, consider upgrading.
A week ago, Open AI announced that ChatGPT can now see, hear, and speak.
So let’s deep dive into the new superpowers that ChatGPT got upgraded with
ChatGPT’s latest updates
ChatGPT has leveled up, introducing vision, hearing, and speaking abilities. It's more powerful and versatile than ever:
Vision: Now, ChatGPT can understand and respond to images. Ask it questions about pictures, plan a meal by exploring your fridge contents, and more.
Hearing: ChatGPT understands the spoken language. Have conversations, request bedtime stories, and settle debates with ease.
Today you can learn about the possibilities of ChatGPT Vision:
How to analyze a very complex diagram and get it explained in simple terms.
How to develop UI designs with simple photos or screenshots.
How to find the name and details of a movie with just an image of a scene from it.
How to get the entire code written for your website with an image of your whiteboard sketches from your team discussion.
Let’s explore ChatGPT's enhanced capabilities, from decoding diagrams to generating code.
Use cases of new ChatGPT features
People are putting ChatGPT's supercharged capabilities to good use in their daily lives, and I've spotted some fascinating examples worth sharing.
A student from 9th grade asked ChatGPT to explain the diagram to him
ChatGPT responded by explaining each and every label in that diagram. This is actually going to be a game changer for everyone worldwide as you can literally ask it to explain any image for you.
The funnier thing is that I don't think kids will be doing their homework themselves now, look at this example:
Make sure to let your ‘teacher’ friends know about this as soon as possible!
What's more interesting is that ChatGPT can analyze a very complex image like an image with lots of diagrams, flowcharts, or instructions. Even these kinds of images can be analyzed by ChatGPT with ease.
When this was sent to ChatGPT, it literally understood the whole thing in a matter of seconds and was ready to answer anything asked about it
It has actually become a lot easier to work with ChatGPT as you can literally send a screenshot of a SaaS dashboard and it will write the entire code for you.
A person asked ChatGPT after providing a screenshot of a scene from a movie to know more details about the movie and this was the response
Which scene will you ask ChatGPT about? Let us know in the comment section.
ChatGPT even managed to give interior designing advice, right after providing a picture of a room that needed some arrangements, here is how the exciting conversation went
It gave the user an in-depth analysis and suggested covering almost every aspect that needs to be taken care of.
Even the most popular conspiracy meme that made a lot of people discuss, seems to be solved by ChatGPT as it responded like this
Another person seemed to have issues in naming the interior design he generated using Midjourney image generation and asked ChatGPT to come up with a name for this type of desi,gn and this is how ChatGPT responded
The language barrier is a very big issue when it comes to traveling from one country to another and ChatGPT has some solutions to that as well it can understand the image and guide you through the image, take a look at this response that was given to a person that asked about Sasimi.
Share this prompt with your friend who travels a lot.
Some images have meanings hidden behind them, and ChatGPT can also analyze hidden meanings in these images. A person prompted ChatGPT to do so, and this was the response
More use cases with links to the references + Prompts:
Keep reading with a 7-day free trial
Subscribe to Creators' AI to keep reading this post and get 7 days of free access to the full post archives.