Wow just 2 years ago, this was so much harder to achieve... object detection, video intelligence, reasoning and text generation using *multiple* models.
The fact that this can be done using a single multimodal gen AI model is still mind boggling to me.
And the fact it caught the *cooked* leftover quinoa? #impressed
You can try this yourself using the Stream Realtime feature in AI Studio, or you can build a custom app using the #Gemini API and Multimodal Live API. 'Cookbooks' and getting started colabs available!
#googlecloud#google
Hey everyone, welcome to my kitchen. You've probably already seen a demo like this, but I had to try it for myself. If you're like me and you're notorious for and never planning and have to go grocery shopping and needing to figure out what you can make with what you have in your fridge, let's go ahead and test this out with Gemini and see how we can help. We're going to check out its video multimodal input and reasoning capabilities. Check it out. All right, here we are in AI Studio and we're going to go ahead and try out the stream real time feature. This is my fridge and I want you to take a look inside and tell me what you think I can make. I want you to describe three different meals I can make using the ingredients seen in my fridge. One for breakfast, another for lunch and for dinner. I want them to be. Relatively healthy and take less than 20 minutes to make. I see that you would like me to describe 3 meals that could be indeed using the ingredients in your fridge, one each for breakfast, lunch and dinner. They should also be relatively healthy and take less than 20 minutes to prepare. Here are my suggestions. For breakfast, you could make a quick egg scramble with spinach and avocado. You have eggs, spinach and avocado dip in the fridge which can be quickly whipped into a meal. For lunch, you could assemble a protein and veggie bowl using quinoa, hummus and sliced ham. It quinoa is already precooked. Of assembling a bull with other items should take less than 20 minutes. Lastly, for dinner and you could use your package sausages along with the spinach and maybe some dip on top for an easy and quick meal. Would you like any additional suggestions? Yeah, these aren't sausages, these are chicken thighs. So let me know how you can adjust that last meal using that instead. Ah OK, thanks for the correction. I see that those are chicken thighs, not sausages. Even this change for dinner you could make a quick chicken thigh and kale bowl. You have kale and the vegetable drawer and the avocado dip could be used to add a little moisture. Would that work? Yeah. How would I also incorporate these apples? Sure, you could add sliced apples to your breakfast scramble or lunch bowl for some extra sweetness and fiber. If you want to use them for dinner, you could also add them to the bowl of chicken and kale. Would you like to hear any other ideas on how to use them? I love it. Thanks Dem and I.
Wordsmith, SEO Specialist & Tech-Savvy VA with GREEN DIGITAL SKILLS TRAINING 🌱💻 | Book Formatting | Customer Service | Supporting Entrepreneurs, Professionals & Authors
I just tested it, and it's totally amazing!! The english and french are not yet really well managed, the voice "strange", but it can capture the video and provide useful insight.
Totally incredible. I will show this for Xmas to my family!!
Wordsmith, SEO Specialist & Tech-Savvy VA with GREEN DIGITAL SKILLS TRAINING 🌱💻 | Book Formatting | Customer Service | Supporting Entrepreneurs, Professionals & Authors
1dAI is gonna screw us one day, but damn! This is gorgeous to watch, technology working like this.. at this level and accuracy, its astonishing