Joseph B.’s Post

Potential disruptor for AI chips: You don’t want to use hashtag #GPUs anymore. Jonathan Ross, co-founder of hashtag #AI chip startup Groq, announced yesterday that developer adoption of its products is on track to hit a record high. The company has attracted 280,000 developers to its platform in just four months, a feat Ross called unprecedented in the hardware industry. “This is pretty much the fastest we’ve ever seen in terms of any developer uptake, any new hardware platform adoption,” Ross said in an interview with VentureBeat’s Matt Marshall. He added, “We actually didn’t expect it to catch on this quickly.” This rapid adoption is driven by Groq’s innovative approach to AI inference chips. Unlike traditional GPUs, Groq’s architecture eliminates external memory, which Ross claims is “the real bottleneck for how you do inference.” Ross elaborated on the technical advantages of hashtag #Groq’s solution. “Imagine if you do a Google search and it takes 10 seconds to get the answer,” he said. “That would just be painful, viscerally.” The comparison highlights the speed improvements Groq aims to bring to AI inference.

Nvidia and Microsoft Release Lightweight Language Models - Nvidia’s Mistral-NeMo-Minitron 8B: A smaller, efficient version of Mistral NeMo 12B, optimized through pruning and distillation techniques. - Microsoft’s Compact Models: Microsoft releases three open-source models, including Phi-3.5-mini-instruct, designed for hardware efficiency. - AI for Limited Devices: Both companies’ models are built to run on devices with limited processing power, broadening AI accessibility. Subscribe to our daily newsletter here for more AI news https://lnkd.in/d7wirv7V #AI #ArtificialIntelligence #Technology #Innovation #BigData #SoftwareEngineering #Startups #Entrepreneurship #CloudComputing #Future

Elon Musk's artificial intelligence (AI) startup, xAI, is collaborating with Dell and Nvidia to build a powerful supercomputer to run its next-generation AI chatbot, Grok. * Dell is building an "AI factory" with Nvidia to provide the necessary computing power for Grok. * This collaboration highlights the increasing demand for powerful AI hardware as companies race to develop advanced AI models. #Supercomputer #Grok #Chatbot #GPU #LLM #GenerativeAI

Groq, a leading #AI chip #startup, has reached an impressive valuation of 2.8 billion, setting its sights on outpacing NVIDIA in specific fields. The innovative Language Processing Units or #LPUs present a game-changing alternative to #GPUs, offering superior speed, cost efficiency, and energy optimization. While GPUs are known for their versatility, LPUs are finely tuned for language tasks, potentially transforming AI and #LLMs. I’m eager to see where this leads and if it really reshapes the AI landscape 🤔

Nebius Group Raises $700M to Expand AI-Optimized Data Centers and Launch New AI Studio place plus… Here’s the TL;DR: 1. Major Funding: Nebius secured $700M in a private placement led by Nvidia, Accel, and Orbis Investments, driving the company’s mission to scale AI data centers and infrastructure globally. 2. Expansion Plans: With a focus on AI workloads, Nebius will triple the capacity of its Finland data center, integrate Nvidia H200 chips, and launch three new facilities across North America and Europe. 3. AI Studio Debut: Nebius's AI Studio provides hosted access to open-source models like Llama 3.1 and plans to expand into generative image and video AI, targeting $750M–$1B in revenue by 2025. Follow Brian Com and Ai101x Newsletter for the latest updates… #ai #ArtificialIntelligence #founder #startup

Hailo-10: Revolutionizing Edge AI, Challenges Nvidia - Hailo Launches Gen AI Accelerator: Introduced the Hailo-10 processor, designed for energy-efficient generative AI applications on edge devices, challenging Nvidia’s dominance. - Significant Funding and Valuation: Hailo raised an additional $120 million in a Series C extension, bringing the company’s valuation to $1.2 billion. - Edge AI Advancements: Hailo-10 promises to bridge the gap in edge computing, offering low power consumption and high performance without relying on cloud data centers. Read more here https://lnkd.in/dH-ksMjp #AI #Technology #Innovation #EdgeComputing #ArtificialIntelligence #Funding #VentureCapital #Engineering #Startups #MarketCompetition

Yesterday at Gitex, we explored some incredible hardware solutions. I’m holding a model of AMD’s Instinct MI300X, a high-performance data center unit built for intensive AI workloads. It’s engineered to handle the demanding tasks of deep learning, machine learning, and large-scale data processing — an impressive piece of technology for modern AI applications! 🔥 While AMD offers some fantastic options, we also discovered NVIDIA’s Inception Program — an exciting opportunity for startups to accelerate growth with cutting-edge technology, expert support, and connections to top VCs. It’s the perfect catalyst for scaling AI, data science, and HPC projects! 🚀 We’re excited for this next chapter and can’t wait to dive deeper into these resources to elevate our work. Stay tuned for what’s next! 🙌 #Gitex2024 #TechInnovation #AMD #NVIDIAInception #AI #Startups

I mean, we aren’t even trying to NOT make these things look like a T-800 anymore… At least it can run a Keurig and make a cup of coffee before it starts hunting John Connor Possibly the only upside is the ♻️ #recycledmaterials industry ♻️ can provide sustainably sourced #titanium for their exoskeletons 👍🏻 From CNBC: - Figure AI raised $675 million from investors including Jeff Bezos, Nvidia, Amazon, Microsoft and OpenAI. - The startup says it will use the money to accelerate development of its humanoid robot, which is intended for commercial use. - Founded in 2022, Figure AI has developed a general-purpose robot, called Figure 01, that looks and moves like a human. Amazon Microsoft NVIDIA Arnold Schwarzenegger #artificialintelligence #machinelearning https://www.figure.ai

Excited to partner with NVIDIA’s Michael Balint to discuss building AI pipelines with NVIDIA NIMs [accelerating deployment into an AI pipeline by 128x] In the session we’ll cover: ↳ How AI Pipelines differ from traditional workflows and getting started ↳ Integrating with NVIDIA products, with a focus on NVIDIA NIMs ↳ Key challenges and solutions unique to AI pipelines ↳ Real-world examples of complex AI pipelines ↳ Insights on how AI pipeline orchestration is expected to evolve Register for the session here: https://lnkd.in/dR2SGv88 NVIDIA AI, NVIDIA for Startups

Etched , a California-based startup founded by Harvard dropouts, is making waves with their innovative Sohu chip. Designed to train and deploy AI models using transformers, Sohu promises to outperform traditional GPUs, running models faster and more cost-effectively. Having secured $120 million in venture funding, Etched is set to challenge industry giants like NVIDIA. Their vision aligns perfectly with our mission at Ostrich AI to revolutionize AI accessibility. We also wanted to share some more exciting news! We’ve just launched our platform and are kicking off with our first few Datathons for enterprises in the healthcare and finance domains. It's a fantastic opportunity to showcase your skills, collaborate with other data enthusiasts, and solve real-world challenges while receiving assured rewards. We'd love for you to join us. You can sign up here: https://lnkd.in/dT2Kpx-X Looking forward to your participation! Feel free to share this with friends who might be interested. Your support is crucial in our early phase. More details at - https://www.ostrich-ai.com #ai #techinnovation #OstrichAI #AIrevolution #etched #SohuChip #transformers https://lnkd.in/dshgnh2g