Liran Zvibel

You should take full advantage of modern processors as an engineer. This article helps you do that with .Net https://lnkd.in/dpZ8i6HN

4

ClusterOps: Revolutionizing Callable Execution Across Hardware The Swarm Corporation proudly announces the release of comprehensive documentation for ClusterOps, an innovative solution that empowers developers to fine-tune callable execution across diverse hardware configurations, including CPUs and GPUs. Key Benefits: ⎆ Precision Control: Customize execution down to specific CPU cores or GPU units ⎆ Scalability: Efficiently manage thousands of agents on a single core or deploy massive agents across GPU clusters ⎆ Flexibility: Tailor agent execution to optimize resource utilization and performance Explore the future of customizable agent execution. Visit our GitHub repository to access the ClusterOps documentation and unlock new possibilities in hardware optimization: https://buff.ly/3NzQW32 Like, repost, and share with friends ✨

2

During this hands-on workshop, our experts will guide you through best practices for optimizing your Kubernetes clusters, leveraging the power of PerfectScale. You'll learn how to: - Identify and safely remove wasted resources - Pinpoint and remediate issues causing latency and downtime - Evaluate the efficiency of your autoscalers - Select the most cost-effective node types based on real-time data https://hubs.la/Q02WgM2c0 #k8s #devops #kubernetes #aws #sre

4

It is time for #Tellusim SDK 37, featuring a native Windows ARM64 SDK, improved performance, better compatibility, and more examples. This video shows Tellusim Explorer running natively on the Volterra DevKit (8cx Gen 3).

15

This is simply incredible. Sambanova just launched a cloud inference platform allowing developers access to this blazing fast AI platform that has the best inference speeds on Llama models in the market. What is unique here is that all models are run with 16 bit precision as well as being extremely cost efficient. Start developing #FastAI ➡ http://cloud.sambanova.ai

48

This week Jam hosted 15 DevRel for an off-the-record dinner Here's 7 quick bites about what we learned about The Art of DevRel: 1. The best DevRels work closely with engineering and product. It’s not just about sharing what they're building with devs, it’s also about sharing dev feedback with product. When you get that feedback loop right, that’s how you get magical developer experiences. 2. DevRel should help the entire engineering team do DevRel Like how HR enables any manager to hire, DevRel should enable any engineer to write blogs, create tutorials, give talks, etc. Swyx’s “DevRel as a Service” post was big topic of discussion— will link it in the comments. 3. No 2 companies do devrel the same. No 2 people do devrel the same way There is a lot of art here that’s not science. It’s about finding the right fit person for your exact company Like how there is founder market fit, there is a devrel company fit too 4. Reporting up was a huge point of discussion The best devrels over-communicate internally in the company what is happening on their side Communication creates trust, and trust creates freedom for devrel to do things that don’t scale that builds real community (and results). 5. DevRel is always on; you are always representing the company Community never takes time off, devs around the world are building nights, weekends and holidays You have to love helping people build - truly - to love devrel (and it’s so inspiring to meet people who do) 6. The best DevRel build genuine relationships They become friends with community members and devs The best community and relationships aren’t measurable But can have immeasurable impact on the trajectory of a product/company 7. Last one: Are developers on LinkedIn? Consensus: yes - yes, they are.

20

3 Comments

Give a talk about PerfXLM, a high performance large language model inference engine, at RISC-V Summit Europe 2024

1

Cool day. Llama 3.1 405B released this AM. CentML has it hosted live this afternoon (try it out below 👇). CentML also optimized it for higher throughput and lower latency based on its preferred compute stack. Planning to build with Llama 3.1 and beyond? CentML might save you millions (on top of what Meta is saving you), and help you deliver best-in-class experiences for your users.

33

While PCIe fails hard, when you are trying to get everything through the kernels, the new hardware requirements, will make smaller setups to fail horribly without proper RDMA technology at scale. Current NICs are very inefficient, in the transfer scale needed for AI. This calls for another reason to go beyond modern quantization capabilities. This is a problem that will remain persistent, as these new RoCE devices/SuperNics, will have to wait for their economies of scale till they are commodity hardware. NVidia might be coming from Cisco at this rate.... #AI #funding #angelinvesting #Aistartup https://lnkd.in/gUBsheVa

1

We've set up a number of #Scala bounties for our #OSS projects w/ algora.io This round focuses on #OpenTelemetry integration in Tapir & sttp, resiliency in Ox and a requested Tapir feature: verifying #OpenAPI schemas. Give it a go! :) Full list: https://lnkd.in/dsJwRPZ2 

44

Nvidia has agreed to acquire Israeli startup Run:ai in a deal estimated to be worth around $700 million, though the exact terms were not disclosed. Run:ai, which has been a close collaborator with Nvidia since 2020, specializes in software for managing AI computing resources. ➜ Check the news at: https://lnkd.in/dHsxrhSi ➜ Vendorvise's official Instagram: https://lnkd.in/ebK2KQ2C ➜ Vendorvise's Linktree: https://lnkd.in/dQdbMdth 🤖 If you enjoy reading my posts about AI and tech news, hit that like button and share with your friends to support my content! #ai #artificialintelligence #ainews #aipowered #news #blog #nvidia #runai #700million #generativeai #llms #tokens #aitech #tech #technology #hardware #content #socialmedia #future #new #launch #business #techtrends #innovation #success #markets #people

1

At the core of effective engineering leadership is the ability to stay connected with your team. This is perhaps the most challenging aspect because retaining the respect of your people is difficult unless you remain technically involved yourself. In my journey as an engineering leader, staying true to the individual contributor role that originally earned their respect has kept me close. This approach extends beyond technical expertise; it's about maintaining a deep connection with the core activities that propel product development forward at Gearflow. One of my biggest professional fears is becoming irrelevant or disconnected from my team and our work. This fear motivates me to continually reinvent and retool in response to market demands. Next month, I'll be sharing about my adventures generating synthetic data recently. And while I'm no expert when I start preparing for these talks, the process is incredibly valuable. It's less about delivering a perfect talk and more about how the preparation expands my thinking and exposes me to new capabilities. This helps me connect the dots to opportunities at Gearflow that bring real innovation to our customers. Speaking regularly holds me accountable and pushes me to learn ahead of the curve, ensuring I remain relevant and impactful day-to-day. Every talk is a journey of discovery, helping me to lead with humility, communicate clearly, and inspire a culture of innovation through a deep, technical understanding of our work.

20

ORConf was a fun conference. Here is the recording of my talk and slide deck. video: https://lnkd.in/dhGeT_2p deck: https://lnkd.in/dUXiiqux

30

1 Comment

Can’t be more proud on this amazing achievement in less than a week - BF16 llama3.1 405B on 16 chips running at world record 114 tokens/s! This showcases the huge advantages of reconfigurable dataflow architecture and the power of software/hardware codesign with Sambaflow and SN40 RDU. Team - Keep pushing and let the data flow! Try it out at fast.snova.ai

16

Very interesting webinar just started - How LLMs will impact different industries

1