Bytewax

🚀 Level Up Your Data Processing with Bytewax v0.20! Bytewax v0.20 brings critical updates to improve your workflow. The newly added Dataflow Visualizer provides a graphical representation of your data pipelines, making them easier to navigate and optimize. 🐝 We've also restructured our core operators to boost data handling efficiency, ensuring smoother operations within your applications. Ready to upgrade your data streams? ➡️ https://lnkd.in/e-WQPyxk

🌟 2024 in Review: Built by Bytewax, Powered by Community 🌟 The third chapter of our Year in Review is here! This time, we’re focusing on what’s been built with Bytewax, the tools we’ve created, and the conversations we’ve had. 💡 Built with Bytewax - The "Used By" feature on GitHub reveals amazing projects powered by Bytewax this year, like: 🌲 Air Quality Anomaly Detection with Redpanda Data. 📰 Real-Time News Search combining Bytewax, Kafka, Upstash, and LangChain. 💹 Finance Pipelines using Bytewax with Hopsworks to process live trade data. ✨ Shoutout to Spanda AI Inc. for human-centered AI solutions and real-time embeddings! 📚 Bytewax Cheatsheets - We launched three cheatsheets this year: 1️⃣ 𝐁𝐲𝐭𝐞𝐰𝐚𝐱 𝐁𝐚𝐬𝐢𝐜𝐬: Master dataflows, connectors, and Python-powered transformations. 2️⃣ 𝐎𝐩𝐞𝐫𝐚𝐭𝐨𝐫𝐬: From map to stateful_batch, dive into real-world examples. 3️⃣ 𝐖𝐢𝐧𝐝𝐨𝐰𝐢𝐧𝐠: Tumbling, sliding, session windows—streaming made manageable. 🎙️ Podcasts and Events 2024 wasn’t just about tech—it was about people: 💡 OSS4AI Meetup: Laura Funderburk shared Bytewax’s approach to RAG, supported by Oli Dinov during her maternity leave. 🌍 Softlandia Ltd. Workshop: 480+ registrants, 10 countries, deep dives into real-time RAG pipelines. 🎙️ Redis Podcast: Zander Matheson discussed Bytewax’s developer-first approach. 🚀 This year was about building, learning, and collaborating—and it’s all thanks to YOU. 💛 Read more here: https://lnkd.in/d8XtZ6Q7

🛠️ 𝐍𝐞𝐰 𝐂𝐨𝐧𝐧𝐞𝐜𝐭𝐨𝐫𝐬 𝐢𝐧 𝐭𝐡𝐞 𝐁𝐲𝐭𝐞𝐰𝐚𝐱 𝐌𝐨𝐝𝐮𝐥𝐞 𝐇𝐮𝐛: 𝐁𝐮𝐢𝐥𝐭 𝐛𝐲 𝐎𝐮𝐫 𝐂𝐨𝐦𝐦𝐮𝐧𝐢𝐭𝐲 Our stream processor’s flexibility allows developers to build custom sources and sinks tailored to their needs. This adaptability has inspired our community to create tools that benefit everyone. 𝘛𝘩𝘦 𝘭𝘢𝘵𝘦𝘴𝘵 𝘢𝘥𝘥𝘪𝘵𝘪𝘰𝘯𝘴 𝘵𝘰 𝘵𝘩𝘦 𝘔𝘰𝘥𝘶𝘭𝘦 𝘏𝘶𝘣 𝘪𝘯𝘤𝘭𝘶𝘥𝘦: • Webflow: A sink connector for inserting or updating records in a specified Webflow Collection. • Valkey: Source and sink connectors for Valkey, an open-source in-memory datastore.  • Lever: A connector that pulls new job postings from the Lever job platform.  💛 We’re proud to see our ecosystem grow through the ingenuity of developers who contribute back to the community. 𝐇𝐚𝐯𝐞 𝐚 𝐜𝐨𝐧𝐧𝐞𝐜𝐭𝐨𝐫 𝐭𝐨 𝐬𝐡𝐚𝐫𝐞? Let us help you bring it to the broader developer world! (𝘓𝘦𝘢𝘷𝘦 𝘢 𝘤𝘰𝘮𝘮𝘦𝘯𝘵, 𝘰𝘳 𝘫𝘶𝘴𝘵 𝘋𝘔 𝘶𝘴) ➡️ https://bytewax.io/modules

🚛 This isn’t your average trucking story. Range Energy is electrifying trailers, but that’s only half the tale. With Bytewax, they’ve built real-time pipelines that turn GPS data into live experiments. Forget slow-moving legacy systems—this team’s rewriting the rules: ➡️ Python-first solutions, because why overcomplicate things? ➡️ Real-time telematics, from road to cloud in seconds. ➡️ Scalable dataflows that grow with their ambition. 📖 Curious? Jump in here: https://lnkd.in/eswWAfFi

💡 𝙍𝙚𝙖𝙡-𝙏𝙞𝙢𝙚 𝘿𝙖𝙩𝙖 𝙄𝙣𝙨𝙞𝙜𝙝𝙩𝙨 𝙛𝙧𝙤𝙢 𝘿𝙧𝙪𝙞𝙙 𝙎𝙪𝙢𝙢𝙞𝙩—𝙒𝙖𝙩𝙘𝙝 𝙉𝙤𝙬 Back in November, the Druid Summit by Imply hosted a panel featuring our own Zander Matheson alongside Julien Calfayan, Jeremy Ber, Fred P., Eric Sammer. They tackled the big questions: - 𝘏𝘰𝘸 𝘥𝘰𝘦𝘴 𝘈𝘱𝘢𝘤𝘩𝘦 𝘋𝘳𝘶𝘪𝘥 𝘴𝘵𝘢𝘯𝘥 𝘰𝘶𝘵 𝘪𝘯 𝘳𝘦𝘢𝘭-𝘵𝘪𝘮𝘦 𝘢𝘳𝘤𝘩𝘪𝘵𝘦𝘤𝘵𝘶𝘳𝘦𝘴; - 𝘏𝘰𝘸 𝘥𝘰 𝘵𝘰𝘰𝘭𝘴 𝘭𝘪𝘬𝘦 𝘍𝘭𝘪𝘯𝘬, 𝘒𝘢𝘧𝘬𝘢, 𝘢𝘯𝘥 𝘒𝘪𝘯𝘦𝘴𝘪𝘴 𝘱𝘭𝘢𝘺 𝘵𝘰𝘨𝘦𝘵𝘩𝘦; - 𝘈𝘯𝘥 𝘪𝘴 𝘴𝘵𝘳𝘦𝘢𝘮𝘪𝘯𝘨 𝘢𝘯𝘢𝘭𝘺𝘵𝘪𝘤𝘴 𝘵𝘩𝘦 𝘧𝘶𝘵𝘶𝘳𝘦, 𝘰𝘳 𝘫𝘶𝘴𝘵 𝘵𝘩𝘦 𝘤𝘰𝘰𝘭𝘦𝘴𝘵 𝘵𝘩𝘪𝘯𝘨 𝘳𝘪𝘨𝘩𝘵 𝘯𝘰𝘸. 🎙️ If you couldn’t join live, now’s your chance to catch up. 📺 Watch the full panel here: https://lnkd.in/eY96ihCv

𝘓𝘦𝘵’𝘴 𝘊𝘰𝘯𝘵𝘪𝘯𝘶𝘦 𝘖𝘶𝘳 2024 𝘙𝘦𝘧𝘭𝘦𝘤𝘵𝘪𝘰𝘯𝘴!🚀 This year wasn’t just about innovation—it was about 𝙘𝙤𝙢𝙢𝙪𝙣𝙞𝙩𝙮, 𝙘𝙤𝙡𝙡𝙖𝙗𝙤𝙧𝙖𝙩𝙞𝙤𝙣, and building 𝙘𝙤𝙣𝙣𝙚𝙘𝙩𝙞𝙤𝙣𝙨 💛. 🎉 GenAI & Bytewax: Real-Time Meets Real Innovation From bytewax-Redis to real-time RAG with Microsoft Azure , we’ve made huge strides in making real-time workflows scalable and efficient. Special thanks to Paul Iusztin, Alex Razvant, and Alex Vesa for their contributions to the LLM Twin Course, which has empowered so many developers to build production-ready AI replicas. 🌍 Global Connections at PyData Global We were honored to join NumFOCUS as a startup partner this year, participating in PyData London and PyData NYC, where we connected with brilliant minds and showcased Bytewax’s unique strengths as a Python-native stream processor. 🍕 Real-Time Pizza Analytics Workshop Collaborating with StarTree’s Viktor Gamov and Streamlit’s Caroline Frasca, we explored real-time analytics using Bytewax, Apache Pinot, and Streamlit to build a pizza dashboard. Real-time data has never been more fun (or delicious). 🐝 Swag and Stories: From Chonky Bee keychains to lunch boxes, Bytewax swag became a global symbol of our connection with you. 📖 Read the Full Blog Here: https://lnkd.in/e3FSPZsU

Our very own Laura Funderburk is speaking today at the PyladiesCon 🎉 She’ll be joining an esteemed panel of experts for “𝐓𝐡𝐞 𝐅𝐮𝐭𝐮𝐫𝐞 𝐨𝐟 𝐀𝐈: 𝐎𝐩𝐩𝐨𝐫𝐭𝐮𝐧𝐢𝐭𝐢𝐞𝐬 𝐚𝐧𝐝 𝐂𝐡𝐚𝐥𝐥𝐞𝐧𝐠𝐞𝐬 𝐢𝐧 𝐚𝐧 𝐈𝐧𝐭𝐞𝐫𝐜𝐨𝐧𝐧𝐞𝐜𝐭𝐞𝐝 𝐖𝐨𝐫𝐥𝐝.” 🕒 When? Today at 14:45 PST 🌍 Where? Online (𝐲𝐞𝐬, 𝐢𝐧 𝐒𝐩𝐚𝐧𝐢𝐬𝐡!) The panel, featuring Tania Yovanović Catepillán, Mai Giménez Fayos, and Andrea Marcela Huerfano Barbosa, will explore critical topics shaping the future of AI, including: ☑ The role of AI in transforming workplaces and industries. ☑ Why diversity and inclusion are essential in AI development. ☑ Ethical and regulatory considerations for equitable AI. ☑ AI’s potential to enhance human relationships in an interconnected world. moderated by Paula Andrea Pinzon Maldonado 📲 Register here to join:https://lnkd.in/e3_yC3JP

𝙁𝙤𝙧𝙜𝙚𝙩 𝙤𝙪𝙩𝙙𝙖𝙩𝙚𝙙 𝙗𝙖𝙩𝙘𝙝 𝙥𝙧𝙤𝙘𝙚𝙨𝙨𝙞𝙣𝙜—𝙮𝙤𝙪𝙧 𝙍𝘼𝙂 𝙬𝙤𝙧𝙠𝙛𝙡𝙤𝙬𝙨 𝙙𝙚𝙨𝙚𝙧𝙫𝙚 𝙗𝙚𝙩𝙩𝙚𝙧. 🧐 Laura Funderburk, our expert on all things RAG, has written a detailed step-by-step blog on creating real-time APIs using Bytewax, deepset Haystack, and FastAPI. In this post, Laura explains how we: ✔️ Indexed data with Bytewax to handle dynamic, large-scale datasets efficiently. ✔️ Used Haystack to implement embedding-based retrieval for fast and accurate results. ✔️ Leveraged FastAPI to design responsive, queryable endpoints that ensure low latency under heavy workloads. The blog also covers challenges like efficiently indexing large datasets, ensuring low-latency retrieval, and scaling to meet variable workloads. Through a real-world case study, you’ll see how these tools come together in a framework that delivers relevance and performance in real time. 📖 Full blog: https://lnkd.in/edrFTsJf

We just released a new article with our friends at Bytewax that discusses some of our exciting solutions surrounding real-time trailer data. We look forward to continuing our work with the amazing folks at Bytewax!

I've posted before about Range Energy and what an amazing company they are and how cool the technology is that they are developing. It has been great to work with a fast moving, fast growing startup that is ushering a new era of clean transportation. Reducing emissions from tractor trailers can have a HUGE impact and we are so excited to support their mission! Range Energy is the latest company to use Bytewax's platform (https://lnkd.in/eWRezQ52) to scale their real-time data processing. Check out the blog post to understand in detail how Range Energy is innovating and competing with Bytewax.