Md Shahbaz Ahmad’s Post

…one small step for man, one giant leap for AI. DeepMind introduces SIMA (Scalable Instructable Multiworld Agent), a revolutionary AI capable of understanding and executing tasks in various 3D video games using natural language. Developed in collaboration with eight game studios, SIMA shows impressive adaptability across different virtual environments, from mining resources to flying spaceships. Unlike previous AI systems, it doesn't require access to a game's code or specialized APIs, using only on-screen images and user-given instructions. This marks a significant leap towards generalist AI agents that could operate in numerous real-world applications. https://lnkd.in/gKv-G5XA

Inspired by Anthropic's latest model release I set up a Wordware (YC S24) Word App to make simple games on any given topic. Here's the "AI Apocalypse" game it made me! THIS IS 100% AI GENERATED! 🤖😱 Claude 3.5 Sonnet is the most advanced LLM in the world for visual understanding. It's able to generate the SVG code for each of the elements you see here. You can try out the game in the comments and make your own with the Word App share there too. Do please share your creations! #ai #llm #sonnet

Has OpenAI been dethroned??? As always, at Wordware (YC S24) we got the newest models, the same day they are released. Test Anthropic's newest model Claude 3.5 Sonnet in our IDE. By the benchmarks and our opinion it's the smartest model out there 🚨🚨🚨😮😮😮 We had it generate a game and automatically host it on a website. Generate your game automatically (try spacecraft for example): https://lnkd.in/drBg4CtM Claude 3.5 Sonnet costs $3 per million input tokens and $15 per million output tokens GPT4o (worse by benchmarks) is $5 per million input tokens and $15 per million output tokens

Following on from yesterday's post where OpenAI can leverage the Unreal Engine, Google has just published how it can use a similar approach to interact with 3D environments with its #SIMA product. #AI is fast becoming pervasive, and no longer a fringe use-case for the boffins. Thinking about common challenges in #CPG, AI is already taking a similar approach, with products such as Wisdom Analytics Inc. AI platform. We've taken a different approach to #TPO because of our frustration with the tools previously available. If you'd like to chat more about what's making waves in our community, please connect with me! https://lnkd.in/gENSWan4

🤖 Why I Decided to Integrate AI into My "Word Game" Project? When I first started building my "Word Game", I used DynamoDB to store the words and Lambda functions with API Gateway for the game logic. It seemed like a great plan until I realized how slow it was to load thousands of words into DynamoDB. I knew I needed a better way if I wanted the game to grow. I looked into using a dictionary API,  but many of the good ones turned out to be quite expensive. I was feeling stuck until my brother Raymond Tran said, “Why not try AI?” At first, I wasn’t sure if AI would work for a "Word Game", but I decided to give it a try. That’s when I found OpenAI’s API, and it completely changed the game. It was easy to integrate, didn’t cost much, and made the game smarter and much more powerful. AI isn’t perfect—sometimes it doesn’t give me exactly what I want, and weaker models can make mistakes. Plus, there’s a small cost, but it’s not a big deal. Honestly, using AI has saved me a lot of time with managing the game logic. Instead of handling all the complicated rules and word processing myself, AI takes care of it quickly. The best part is how AI automates things, making everything run smoother and with fewer mistakes. It’s made the game smarter and allowed me to focus on making it more engaging for players. Even with a few challenges, the time it saves and how much better it makes the game are why I keep using AI. Play the game here: https://lnkd.in/gPQD9mhi #AIIntegration #TechInnovation #ArtificialIntelligence #OpenAI #ProjectJourney #APIDevelopment #GamingWithAI

There's a world in which AI overtakes game development... ...a world in which will non-technical teams know how to clearly express their technical needs. Suffice to say, I think devs are safe for the 50 years to come. + there's no certainty regarding the objectivity of AI models, as they've been known to replicate the bias in their training data... (By the way, we're already able to express our technical needs to a machine for it to compute a certain way. That's called code.) Thoughts? #GameDev #AIinGames

pub.towardsai.net: Google DeepMind has introduced SIMA, a new agent capable of interpreting language instructions to interact with various 3D virtual environments. This breakthrough in AI research aims to create versatile agents for 3D interactions, enabling them to understand and execute verbal commands in a wide range of gaming worlds. The agent has been trained and tested across diverse 3D settings, including commercial games and research environments, showcasing promising results in its ability to follow complex verbal instructions and perform tasks. The project leverages a dataset of text instructions and employs a sophisticated architecture to translate visual inputs and spoken commands into keyboard and mouse actions. Overall, SIMA represents a significant advancement in developing agents that can navigate and interact with different virtual environments based on language instructions.

Join us for our second talk about AI for indie game devs by experienced Greg Kowal! Find out how AI works and what are the best tools for game developers. 14th of May, 18:00 Lisbon time. Details and links in comments below.

Claude 3.5 Sonnet is the new favorite AI tool! Everyone is creating amazing things with it. 11 incredible examples: _____ 1. Making fun games with Claude 3.5 Sonnet is now very simple. 2. What once took hours to code can now be done in minutes. 3. Claude 3.5 Sonnet is better than GPT-4o, Gemini Pro, and Llama. 4. Claude 3.5 Sonnet now creates fun games to play while you work. 5. Claude 3.5 Sonnet is the best interactive model as compared to other LLM models 6. Claude Sonnet 3.5 is the best reasoning model so far. 7. Claude Sonnet 3.5 can generate a web app in just 25 seconds. 8. 3D solar system with collisions made using Claude Sonnet 3.5 9. Claude Sonnet 3.5 can accurately pick colors in the game. 10. Complex data analysis is now even simpler. 11. Claude 3.5 Sonnet can generate sounds _____ #ai #claude #sonnet

Claude 3.5 Sonnet is the new favorite AI tool! Everyone is creating amazing things with it. 11 incredible examples: _____ 1. Making fun games with Claude 3.5 Sonnet is now very simple. 2. What once took hours to code can now be done in minutes. 3. Claude 3.5 Sonnet is better than GPT-4o, Gemini Pro, and Llama. 4. Claude 3.5 Sonnet now creates fun games to play while you work. 5. Claude 3.5 Sonnet is the best interactive model as compared to other LLM models 6. Claude Sonnet 3.5 is the best reasoning model so far. 7. Claude Sonnet 3.5 can generate a web app in just 25 seconds. 8. 3D solar system with collisions made using Claude Sonnet 3.5 9. Claude Sonnet 3.5 can accurately pick colors in the game. 10. Complex data analysis is now even simpler. 11. Claude 3.5 Sonnet can generate sounds _____ #ai #claude #sonnet