Allon Cohen, PhD

Last week, I had the privilege of attending the Stanford Accelerator for Learning summit, which brought together 400 thought leaders in education technology—including educators, researchers, funders, and innovators. Kudos to Isabelle Hau and her team for orchestrating such an inspiring event. Few Key Takeaways and Observations: 1. Teacher Empowerment is Paramount: Successful EdTech tools are the ones that have placed Educators in the driver seat. Technology must support, not replace, educators. At Merlyn Mind, we believe teachers are the central force driving student engagement and learning experiences in classroom. 2. Responsible AI - Now a Standard Expectation: AI conversations have evolved beyond mere discussion of safety risks and more towards effective AI. My optimistic belief is that what was a hot topic in 2023 has now become a baseline requirement. At Merlyn Mind, we've proactively integrated responsible AI practices into our product development process. 3. Leverage data to assist: Vast amounts of data are available on Learners. AI presents great opportunities to leverage learner data to provide useful and actionable insights. By understanding interaction patterns and learning styles, we can create personalized experiences that support educators, parents, and students. 4. Evidence-based Research for Rapid Innovation: Traditional peer-reviewed research can't keep pace with new tools that are being developed. We need more dynamic, flexible research methodologies to support fast-evolving educational tools. Iterative, multi-stage evidence needed to understand impact. Involve teachers and schools directly in product development process. 5. Educational Infrastructure: Our education systems must adapt to changing learning landscapes. With technology transforming how students learn outside classrooms, we need new systems that reshape traditional learning and assessment models that can adapt to the new environment. These events also become a great venue for exchanging ideas, reconnecting with peers. Erin Mote Steven Schneider Malvika Bhagwat Chris Agnew Richard Charles, Ph.D., GSP Betsy (Elizabeth) Corcoran #EdTech #AIinEducation #FutureOfLearning #InnovationInEducation

76

3 Comments

Blackwell 26,596 times more powerful than our 8 Intel MOSIPS? At Computex 2024, Jensen Huang unveiled the roadmap for Blackwell, promising a future of accelerated computing architectures that redefine our expectations. These advancements are set to elevate AI capabilities to unprecedented levels. Our A7Technology MOSIPS system, powered by 8 Intel NUC computers, delivers 752 GFLOPS, with each system offering 94 GFLOPS. This impressive setup, however, pales in comparison to the capabilities of the new Blackwell B200 GPU. The B200 not only doubles the transistor count of the current H100 but also delivers an astounding 20 petaflops of AI performance from a single GPU, compared to the H100's 4 petaflops. The B200's 192GB of HBM3e memory and 8 TB/s bandwidth are equally impressive, showcasing how scaling is driving AI capabilities to new heights. This leap in performance is a significant phase shift, surpassing the limits of Moore's law and pushing the boundaries of what we thought possible with CPU architectures. To put this in perspective, a single Blackwell B200 GPU's 20 petaflops make it approximately 26,596 times more powerful than our current system's 752 GFLOPS, which uses eight of the latest Intel CPUs. These breakthroughs in parallel architectures are not just incremental improvements; they represent a monumental leap in AI capability and power, setting the stage for the next era of technological advancement.

1

🎉 The announcement the GenAI industry, customers, ISVs, SIs, partners, and developers have been waiting for at AWS re:Invent! 🎉 We’re proud to share that NVIDIA NIMs are now available on Amazon Bedrock Marketplace, starting with the groundbreaking Nemotron-4. This marks a pivotal milestone in making advanced AI capabilities more accessible and scalable for everyone. 🌟 Why is this such an exciting moment? This is the first NIM available on Bedrock, with more on the way. Nemotron-4, a cutting-edge multilingual language model trained on 8 trillion tokens, unlocks game-changing capabilities for developers: ✅ Synthetic data generation to enhance model training ✅ High-performance inference optimized for GPU-accelerated infrastructure ✅ Cost-efficient scalability through Bedrock's managed endpoints ✅ Seamless integration with AWS services like Bedrock APIs, Knowledge Bases, and Guardrails 💡 What model would you like to see NIMs available for next? This incredible achievement wouldn’t have been possible without the amazing work of our team – a few are missing from this picture, but their impact is clear. The team’s core principle says it all: "Get Things Done!" 🚀 Explore this transformative model on Amazon Bedrock Marketplace today and experience the future of generative AI innovation. Let’s celebrate this milestone together and continue shaping the future of AI. 🌎💡 #GenerativeAI #AWSreInvent #NVIDIA #AmazonBedrock #AIInnovation #NIM 👉 Learn more: https://lnkd.in/eVhNp_Ux

133

1 Comment

AI is driving the next wave of growth for the semiconductor industry (and those of us in the industry can't wait to see the anticipated growth 😉). Recently, I was encouraged to watch a keynote featuring Jensen Huang of NVIDIA. While it's highly informative and I recommend watching it in its entirety, what struck me most had nothing to do with AI. Around 36:05, the facilitator asked Jensen to provide advice on how to achieve success. His response is profound, drawing parallels between expectations, resilience, success, intelligence, and character. His commentary on how he leads his 55 direct reports (yes, 55!) is also thought-provoking. Take a few minutes to watch this keynote and listen to Jensen's insights on success and leadership. #artificialintelligence #NVIDIA #leadership

20

2 Comments

Conversations about gratitude are often abstract, and this can be difficult for people who prefer more concrete explanations and practical tips. Fortunately, the Greater Good Science Center (GGSC) at UC Berkeley has already done the heavy lifting for us. According to Robert Emmons and Michael McCullough, gratitude consists of two parts: 1. Recognizing that you have something good 2. Recognizing that that good thing didn’t come from you Gratitude isn’t just a mushy, feel-good concept. It can improve your physical health. In one study, cardiac patients that were more grateful had better health outcomes, including reduced cellular inflammation. How can you reap these benefits? You may have heard of some already, like keeping a gratitude journal or taking a moment to count your blessings. An interesting gratitude practice is actually doing something for others. Studies show that receiving gratitude – not just expressing it – can be incredibly powerful. I hope you try some of these techniques. And that you have a wonderful Thanksgiving. If you’d like to learn more, you can read this whitepaper from GGSC. #Gratitude #Mindset

36

Cadence has joined the Alliance for OpenUSD (AOUSD) to expand OpenUSD applications across manufacturing, artificial intelligence, and semiconductor industries, and help drive innovation in the OpenUSD ecosystem. “Digital twins for data centers and physical AI are essential to pave the way for the AI revolution without impacting global resources. We’re excited to join AOUSD to help extend digital twinning to the AI infrastructure. The systems that change the world are not creations of one individual or company alone. Cadence brings a long history of leadership in both design automation and contributions to global standards bodies. Open and effective technical standards are the backbone for innovation and will enable us to deliver the benefits of AI to the globe, together.” Ben Gu, Corporate Vice President for Multiphysics System Analysis at Cadence. Read more https://ow.ly/G4EA50UckAX

18

The collaboration between Cadence and NVIDIA is a testament to the transformative impact of technology—optimizing software and hardware, leveraging the power of #accelerated #computing and #generativeAI. Read more to learn how Cadence's collaboration with NVIDIA accelerates #AI and scientific computing. Cadence Design Systems NVIDIA

54

2 Comments

Great article on how San Francisco is leaning in and leveraging its vast wealth of innovative thinkers, tech intensity, and vast learning and funding resources. San Francisco Chamber of Commerce is doing an amazing job embracing the next wave! Rodney Fong Anita LW Huang Katy Brown #Microsoft #AzureAI #Startups #AI

72

1 Comment

If you're at #FMS2024, come join me and an amazing group of co-presenters—Assaf Sella from Kioxia, John Lorenz from Yole Group, Vishwas Saxena Western, and Aadharsh Kannan from Western Digital—at the AIML-203 Generative AI Application Track. Don't miss this interesting session on Generative AI, where we will cover four important topics: ·      The of the importance of Flash for Rag-Based LLMs  ·      Gen AI Foundation to use cases,  ·      Generative AI: Memory Market Impacts ·      LLMs on the Edge Devices This session offers invaluable insights and good set of takeaways for both seasoned professional or just beginning your journey in Gen AI. Mark your calendars Aug 7th: 3 to 4.05 PM PT. #GenerativeAI #AIML #FutureOfMemory #StorageSolutions #TechInnovation #LLMs #EdgeComputing #fms2024 #pliops

42

2 Comments

At 16:00 tomorrow at TPC, don't miss a panel with experts like Tobias Becker, VP of R&D at Groq, to hear how systems can be designed for the training and inference of the largest next generation models. Explore hardware/software approaches designed specifically to tackle the challenge of scaling.

8

This is a great explanation of the advantage nvida has created on there new data center hardware. Its nvida tech powering my pitch deck analysis chatbot decksmart.ai right now in alpha. The ability to see data in new ways is going to be incredible. #ai #startups #investment https://lnkd.in/geF4i9m9

1

Cadence is fully engaged in the AI buildout and we see great opportunity as technology develops and the industry evolves. "Silicon is becoming more pervasive, and AI is a significant driver of that growth. While data centers are currently at the forefront of AI development, I see the next big phase as what I call 'physical AI,' which will integrate AI with cars, robots, and autonomous systems. This is just now beginning with autonomous vehicles, but I believe industrial robots and other automation technologies will soon follow. We’re positioning ourselves to support this wave of innovation through our tools and R&D. Beyond that, I see life sciences as the third horizon for growth. We recently acquired a company that simulates molecules, which requires algorithms similar to those used in chip design. I believe AI will revolutionize the life sciences industry, combining biology with math and computer science to drive advancements in medicine. This transformation will likely take five to 10 years, but we are already preparing for it." Anirudh Devgan, President and CEO, Cadence Read more in this Newsweek article: https://ow.ly/eB8N50TZMCX

67

1 Comment

OpenAI and Broadcom in talks about developing new AI chip OpenAI is in talks with Broadcom and other industry leaders to develop a new chip tailored for AI applications, potentially reducing reliance on NVIDIA #GPUs. Sam Altman has been instrumental in spearheading efforts to secure partnerships with #chipmakers, tech giants like Microsoft, and government bodies to enhance #compute capacity essential for #AI #innovation. This move underscores OpenAI's commitment to advancing artificial general intelligence (#AGI), aiming to push the boundaries of AI capabilities beyond current standards. Despite the formidable challenges and substantial financial requirements, including Microsoft's substantial investment, OpenAI remains focused on expanding access to AI benefits through strategic partnerships. For more information: https://lnkd.in/dYHej2Kc #AI #ArtificialIntelligence #OpenAI #TechInnovation #Semiconductors #Broadcom #Microsoft #AGI #AIHardware #TechPartnerships

4

1 Comment

Growth of Arm in the datacenter starts with availability, then adoption. With some hyperscalers rolling their own designs, everyone else has to look to the open market to see what's for sale. The only real option here is from Ampere, which recently announced a custom 3nm Arm 256-core CPU as part of the AmpereOne family. More cores, more memory channels, and a custom microarchitecture they might disclose later this year. It's a chiplet design too, showcasing where this market is going. https://lnkd.in/e6JMXCum

95

8 Comments

Level up Chip Design Innovation with MATLAB and Silicon Catalyst! #MathWorks News & Stories brings you an exciting collaboration between MathWorks and Silicon Catalyst. This article explores how MATLAB an Simulink empowers chip-based semiconductor startups to develop cutting-edge solutions in medicine and wireless technology. Key Takeaways: >> Richard Curtin, Managing Partner at Silicon Catalyst, highlights the growing demand for "specialized design tools to overcome the complexities of modern chip design." >> Raphael Guimond, Antenna Designer at SPARK Microsystems, emphasizes how MATLAB's capabilities streamline the antenna design process, allowing engineers to "focus on innovation rather than repetitive tasks." ➡️ Dive deeper and discover how MATLAB can: >> Shorten design cycles through its powerful simulation and modeling tools. ⏱️➡️ >> Optimize performance with efficient algorithms and code generation capabilities. >> Facilitate collaboration with a robust platform for data sharing and version control. Don't miss out! Read the full story here: https://lnkd.in/eAv7JhYV #engineering #semiconductor #wireless #innovation #MATLAB #medicine #Simulink #Probius #SPARK #Microsystems #SiliconCatalyst

4