Lior Gazit’s Post

🚀 NVIDIA has launched a suite of enterprise-grade generative AI microservices, enabling businesses to create and deploy custom applications while retaining full control of their IP. 🔍 Built on the NVIDIA CUDA® platform, these cloud-native services include NVIDIA NIM microservices optimized for over two dozen popular AI models; NVIDIA CUDA-X™ microservices are also available for RAG, guardrails, data processing, HPC, and more. 🌐 Access these services via Amazon SageMaker, Google Kubernetes Engine, and Microsoft Azure AI, and integrate with frameworks like Deepset, LangChain, and LlamaIndex. https://lnkd.in/g5__jUcB #NVIDIA #AI #GenerativeAI #MachineLearning

🚀 Major Product Announcement from our CEO Rajiv Ramaswami that my team has been working on: GPT-in-a-Box 2.0! 🚀 🌐 What’s Nutanix GPT-in-a-Box 2.0? 📦 #Secure #EnterpriseAI Platform: Deploy #LLMs, #MLOps, and #GenAI apps seamlessly from core to edge to cloud. 🤝 Key Partnerships: - NVIDIA: Easily deploy NVIDIA #NIM for optimized GenAI #microservices. - Hugging Face: Fast-track LLM deployment with validated models and seamless workflows. 🔧 Four Ways to Get Started with GenAI: 1 .Simplify GenAI Use Cases: Start with impactful solutions in finance, healthcare, and public sector. 2. Manage APIs and LLMs: Integrate with NVIDIA NIM, Hugging Face, or your own LLMs effortlessly. 3. Leverage Standard Hardware: Utilize standard servers, GPUs, and containers without special architecture. 4. Build on Standardized Data Services: From edge to cloud, ensure secure and scalable data management. Key Features: - #PrivateGPT: Control data security with private GenAI chatbots. - GenAI for Code: Boost developer productivity with AI-assisted #CodeGeneration. - GenAI for Content: Enhance marketing and sales productivity. - AI-Assisted Document Understanding: Safeguard IP and sensitive data with advanced document processing. Debojyoti (Debo) Dutta Manosiz Bhattacharyya Johnu George Rajat Ghosh, Ph.D #EnterpriseAI #GPTinaBox #TechNews #CloudComputing Read more: https://lnkd.in/gU9AXMQ9

https://lnkd.in/gQ3VeJ-N Nice blog by Apoorv Agrawal depicting The Economics of Generative AI: Where Value Accrues Today and Tomorrow..The generative AI ecosystem is currently inverted compared to cloud computing, with the semiconductor (semis) layer capturing ~83% of ~$90B in revenues and a staggering ~88% of gross profits.. While semis like Nvidia are reaping huge rewards now in the Gen AI boom, this mirrors early phases of previous platform shifts like mobile and cloud. Value tends to start concentrated in semis/infrastructure before transitioning to the applications layer over time. As ecosystems mature, we should expect a rebalancing towards applications capturing more value, driven by better pricing models, custom silicon reducing costs, and model architecture/efficiency improvements. AWS is very well-positioned to capture more value in this transition to the applications layer. To quote Andy Jassy - “While we’re building a substantial number of GenAI applications ourselves, the vast majority will ultimately be built by other companies. However, what we’re building in AWS is not just a compelling app or foundation model. These AWS services, at all three layers of the stack, comprise a set of primitives that democratize this next seminal phase of AI, and will empower internal and external builders to transform virtually every customer experience that we know (and invent altogether new ones as well).”

🚀 Breaking News: SambaNova Cloud Unleashes AI Superpowers! 🤖💨 Attention AI enthusiasts and developers! SambaNova Systems just dropped a game-changer: The World's Fastest AI Platform Key highlights: • Llama 3.1 405B at 132 tokens/second • Llama 3.1 70B at 461 tokens/second • Full 16-bit precision for unmatched accuracy Why it matters: 1. Lightning-fast inference for real-time AI applications 2. Access to the most powerful open-source models 3. Free API access available now - no waiting list! "Only SambaNova is running 405B — the best open-source model created — at full precision and at 132 tokens per second," says CEO Rodrigo Liang. Ready to supercharge your AI projects? Join the revolution at SambaNova Cloud! 💡🌟 #AIInnovation #TechBreakthrough #DeveloperTools

 In my latest blog, I explore the power of inference-based AI workloads and how solutions like NVIDIA’s Inference Microservices (NIM) are transforming the deployment of large language models (LLMs). 🌐 With LLMs, adopting a microservices approach lets us deploy specific model functions as modular, independent services. This allows for flexible scaling, optimized resource allocation, and the ability to bring high-performance LLM applications to real-time use cases across cloud and edge environments. Curious about how NIM-like solutions can reshape your AI and LLM deployments? Dive into the details and see how you can deliver responsive, high-performance AI experiences for today’s dynamic demands: https://lnkd.in/g_kTNe6x #AI #ProductManagement #LLM #InferenceAI #EdgeComputing #Microservices #NVIDIA #Innovation

Turns out what happens in Vegas DOESN'T stay in Vegas! Just wrapped up a whirlwind week at Google Cloud Next in Vegas There were incredible announcements across the board, Some of my takeaways: 1) The right platform is key: We're not just throwing cutting-edge AI models at you - we're providing a unified platform (built on our years of AI investment) that makes it easy to deploy, manage, and scale these models - securely. This is critical to turn AI from a research project to a real-world advantage. 2) GenAI use cases in production deployment stage: We're seeing media companies already using Google Cloud's Vertex AI to streamline processes, reimagine customer experiences, and even build entirely new business models. 3) Focus on real-world results: We announced a slew of new features specifically designed for the media industry. For example, Vertex AI can now generate stunning images from simple text descriptions. Or reimagining search experience These are just a few of the highlights that will revolutionize the way media companies work. Look forward to discussing more about all of this at NAB! https://lnkd.in/enNytwhb #googlecloud #cloudnext #NAB #AI #mediaindustry

IN THE NEWS: TensorWave Partners With Neuralink Engineers' New Startup, MK1, To Bring Lightning Fast AI Inference to AMD Cloud. The partnership between MK1 and TensorWave is set to disrupt the AI industry, offering a more user-friendly and efficient alternative to existing solutions. With a focus on delivering competitive performance for large language models (LLMs) and other inference tasks, this collaboration promises to bring significant advancements to the field. Read the full article here: https://hubs.ly/Q02y7zkV0

Instantly bootstrap your AI inference with MK1 Flywheel x AMD Instinct MI300X on Tensorwave. You need GPUs? Head straight on over to https://tensorwave.com/

🚀 Integrate Llama 3.2 into your development stack with Viable Lab! 🚀 Llama 3.2 is here, bringing cutting-edge open-source models to developers everywhere! Whether you’re building on edge devices or scaling in the cloud, this release offers powerful, lightweight models optimized for a wide range of applications. Key highlights: Vision LLMs (11B & 90B) for image understanding tasks 🖼️ Text-only models (1B & 3B) for on-device summarization, instruction following, and more 📝 Edge & Mobile Deployment: Fully optimized for Qualcomm, MediaTek, and Arm processors Llama Stack for seamless integration with cloud, on-prem, and edge environments At Viable Lab, we’re here to help you integrate Llama 3.2 into your development stack. Whether you need guidance on fine-tuning models, setting up RAG applications, or deploying on your preferred hardware, we’re ready to assist! Interested in exploring how Llama 3.2 can elevate your AI projects? Let's connect! Drop us a message or reach out directly to learn more and get started. Together, we can bring the future of open-source generative AI to your fingertips. 📩 Contact us today to unlock the full potential of Llama 3.2! #llama3.2 #AI #OpenSource #EdgeAI #ViableLab #GenerativeAI #Innovation

Good information on why NVIDIA NIM + Red Hat OpenShift are better together. The article touches on KServe, which is tied to "Conversational AI at scale with KServe" efforts at Red Hat.