Software Huddle

Here is a sneak peak into our conversation with Jean Yang. Stay tuned for the full episode! We asked her about - a skill she'd like to master - a company she'd like to invest in - a tool or technology she couldn't live without - more ...

|| Building + Evolving Sentry's Architecture and Funding Open Source with David Cramer || Today, we have David Cramer on the show. David is one of the co-founders of Sentry, an application monitoring tool that's one of the most widely-adopted tools for developers. Sentry does over 300,000 events per second on average, and there's a lot of fancy work to process these application errors, from rate limiting to fingerprinting to counting to source map unminifying. We walk through some of the architectural changes and systems design work here, including some of David's thoughts on shipping. David and Sentry also have a unique approach to developer marketing. They do some cool things -- sponsoring and then buying the amazing SyntaxFM podcast, sending $100k of free gifts to developers, and launching the Open Source Pledge with $500k donated to open source developers. Watch on Youtube: https://lnkd.in/gCX6cEB4 Timestamps 00:45 Start 07:53 Sentry started as a side project 10:09 Thought process behind taking investment 18:12 Sentry's Architecture 28:45 Cloud Choice 37:26 There aren't Pricing Wars anymore 38:50 Maintaining the SDKs 43:24 Open Source Version and the Enterprise balance 48:54 Open Source Pledge 53:30 State Of Open Source 01:02:27 Marketing to Developers David Cramer | Sean Falconer | Alex DeBrie

New Episode Alert! Discover the tech behind companies like Descript, Bland & Robust Intelligence 🚀 || Deep Dive into Inference Optimization for LLMs with Philip Kiely || Today we have Philip Kiely from Baseten on the show. Baseten is a Series B startup focused on providing infrastructure for AI workloads. We go deep on Inference Optimization. We cover choosing a model, discuss the hype around Compound AI, choosing an Inference Engine, Optimization Techniques like Quantization and Speculative Decoding all the way down to your GPU choice. Watch on Youtube: https://lnkd.in/gV_Gc7Eq Timestamps 01:16 Start 05:43 Why focus on Inference? 11:15 Model Selection 16:52 Saving Costs 20:07 Saturating a GPU 21:28 When does it makes sense to fine tune 23:12 Compound AI 29:18 Performance 31:09 Why is inference slow 33:28 Techniques to optimize inference 50:54 Choice of GPUs 58:19 Programming Language Choice 59:48 Quick Fire Philip Kiely | Sean Falconer | Alex DeBrie

Why is Java so back in the age of AI Applications, we dive into it today. || Java and building AI applications with Kevin Dubois || Today on the show, we have Kevin Dubois. Kevin is a Senior Principal Developer Advocate at Red Hat, Java Champion, and well known open source contributor. In our conversation with Kevin, we talk about his history with Java and the evolution of the language and where it now fits within the world of AI. Kevin's been building AI applications with Java using Quarkus and LangChain4j. Kevin's a Java expert. He's not an AI expert. It's amazing to see how much he's building with AI even without having that background. We also talk a lot about the mindset shift you need to successfully build with generative AI models. Watch on Youtube: https://lnkd.in/gbaU4DCr Timestamps 01 : 41 Start 02 : 42 Java and Open Source 06 : 20 Changes in Java 11 : 00 Try Java 13 : 40 Shift Conf 16 : 57 Open Source Models 19 : 15 Adoption 22 : 44 Where does Java fit? 27 : 22 Tooling 50 : 33 Quick Fire Kevin Dubois | Sean Falconer | Alex DeBrie

New episode alert! || SQLite, Turso, and the State of Databases with Glauber Costa || Today we have Glauber Costa on the show, who's the CEO and founder at Turso. They provide a managed SQLite service with some really interesting capabilities that's changing some of the application patterns you can do. He shares a lot of really good technical stuff on X. He worked in the kernel, he worked on high-performance databases at ScyllaDB, and now he's working on Turso. He also has a great and interesting podcast, the Save File, which is about developers and religion.  Glauber had some great thoughts on the future of databases, including what the future of NoSQL is like and whether we'll see vector databases as a separate category or as a feature of general-purpose databases.  We’ve seen arguments both ways, but he was the most effective at changing our mind. Watch on Youtube: https://lnkd.in/ggYXt4sV Glauber Costa | Sean Falconer | Alex DeBrie

We're back with another episode of Software Huddle. Join us for an engaging discussion. || Blocking Bots & Moving from Redis to SQLite with Mike Buckbee || Today, we have Michael Buckbee on the show. Mike is the co-founder of Wafris, and he wrote a really insightful article last week about moving from Redis to SQLite for an aspect of their architecture. The article was nuanced in describing why it worked for their specific needs, and it has some surprising takeaways, including that SQLite was 3x faster than a local Redis instance for their workload. Mike has built a few different WAF (Web Application Firewall) products, so we covered that area as well. He's seen a lot here, so we walked through all the nefarious traffic patterns and the speed in which these bots adapt to new vulnerabilities. Finally, Mike has a wide-ranging skillset that includes marketing. Developers are notoriously tricky to market to, so we talked about his experience in effective marketing to developers without being disingenuous. Watch on Youtube: https://lnkd.in/gFXhHYpe || Timestamps || 01 : 11 Start 03 : 41 Wafris 07 : 22 Redis and SQLite 19 : 09 Flatfile 21 : 50 Knowatoa 28 : 22 Web Application Firewalls 46 : 21 Jumpstart Pro 48 : 11 Marketing to Developers Michael Buckbee | Sean Falconer | Alex DeBrie

Tune in or miss out – your call! 🙂 If you've been putting off AI Engineering for a while, tuning in to this episode is the perfect way to catch up with the rest. || AI Engineer, Web Frameworks, & more with Tejas Kumar || Today we have Tejas Kumar on the show. Tejas is part of the Developer Relations team at DataStax. He's really good at frontend, got a great podcast and he has written a book called Fluent React. He spoke recently at the Infobip Shift Conference in Croatia, where he talked about AI engineering and what that means. So we talked about AI Engineering, we talked about React, content creation, education, and much more. This episode is full of value and we think you'd love this one. Watch on Youtube: https://lnkd.in/gvAb4RAK Timestamps 01:00 Start 06:03 AI Engineer 10:31 Knowledge cutoff 11:43 API availability and uptime 12:52 Preferred Models 14:55 Running Locally? 18:21 Models getting nerfed? 20:33 Training own model 28:38 Using LLMs as a developer 30:20 Copilot and ChatGPT 33:44 What are LLMs good at? 37:29 Datastax - The best job 39:20 DynamoDB and Cassandra 40:23 AstraDB 43:40 React 48:21 Non React frameworks 49:08 Astro framework 54:42 React Server Components 57:38 NextJS 01:00:23 Conference Talks 01:05:59 Keynotes 01:08:02 Educational Space 01:12:06 Video Content 01:14:30 Writing 01:18:01 Consultancy Tejas Kumar | Sean Falconer | Alex DeBrie

New episode alert! Join us for an engaging discussion in our latest release. || The Data Engineering Landscape with Peter Hanssens || Today on the show, we have Peter Hanssens, the CEO and founder of Cloud Shuttle and creator of the DataEngBytes Conference. Peter has helped build an incredible data engineering community in Australia. He runs meetups, user groups, luncheons, and entire conferences. And he's also super knowledgeable. He's been working in the data space for a long time. We picked his brain about the history of data tooling, trends he's seeing in the industry and the relationship between data engineers and other types of engineering. Even if you aren't in the data world, we think you will enjoy the conversation. Watch on Youtube: https://lnkd.in/gk9BaY_g 01:48 Start 10:16 1 person Data Team 13:49 Tool Stack and Data Warehouse 16:10 Decoupling Data Warehouse 19:43 too fascinated with over-complication 22:47 Where to Start 23:52 Unstructured Data and LLMs 25:51 harder problems in the space 32:41 DataEngBytes 38:27 Adoption in Australia 41:44 Startup scene in Australia 47:17 unsolved problems in the data engineering space 51:53 Quick Fire Peter Hanssens | Sean Falconer | Alex DeBrie

GenAI is good at certain things. Is creativity one of them? Is it better than humans? Watch on Youtube: https://lnkd.in/gjCaG3sC Jeremy Daly | Sean Falconer | Alex DeBrie

New episode out now! 🎧 Dive into some fun and engaging Software Huddle 💻 Infrastructure, AWS, AI and Jobs, HTMX & more Today we have a special guest. We have Jeremy Daly, who’s been in the cloud space for a while. Jeremy is the co-founder of Ampt, which is building an abstraction infrastructure layer on top of AWS, just to make it simpler to sift through all the different options and develop on AWS and do best practices there. So we wanted to get his opinions on a lot of different infrastructure stuff that he's seeing and how AI is changing development. We even talk about some front end stuff at the end and HTMX and whether it's real, whether it's a troll. So lots of good stuff in this episode. Watch on Youtube: https://lnkd.in/gyWAG-m7 Timestamps 01 : 56 Start 04 : 28 Jeremy's Background 07 : 26 Hard things about building ampt 11 : 59 Infrastructure from Code 17 : 07 App Runner 20 : 10 Comparing Ampt and PaaS 27 : 22 Managing a lot of AWS accounts 30 : 46 Better than AWS? 35 : 27 Thoughts on AWS deprecating services 47 : 11 Using AI? 57 : 20 ChatGPT Adoption - Non Programmers 01 : 06 : 19 AI affecting the job market? 01 : 18 : 37 HTMX? Jeremy Daly | Sean Falconer | Alex DeBrie