Mrunmayee Dhapre’s Post

If you missed QuestDB at the Data Council's conference in Austin, check out Adam talking about the inner workings of #QuestDB, its speed, and its efficiency with examples of #SQL queries. #opensource #timeseries #database

Excited to leverage this knowledge to design more efficient workflows and orchestrate data pipelines with precision. Here’s to continuous learning and pushing the boundaries of what data can do! #Airflow #DataEngineering #ContinuousLearning #DataPipelines"

Our very own Adam Cimarosti flew to Austin for a talk about #QuestDB at Data Council's annual conference about #Data and #AI. He delves into the internals of QuestDB and what makes it so fast and efficient with time-series data. Some examples with #SQL queries are briefly explored before the final section that lays out our vision for QuestDB: 💡 On the way in, stream time series data from the source or #Kafka in real-time. On the way out, produce #Parquet files, which can be deposited on object stores such as #AWS S3 for infinite scale. 🔥 After that, querying parquet files directly from QuestDB becomes a reality. Bypassing QuestDB entirely and depositing parquet on S3 will also be possible, with the option to leverage the QuestDB engine to query this data in open format. In short, QuestDB's #database is moving away from proprietary formats and monoliths ⚡ Thank you Pete Soderling for the invite, it was a blast! https://lnkd.in/ebSbSqNV

Curious how you can uncover the hidden social connections between prominent tech figures just from their resumes? With GraphRAG, powered by Snowflake and RelationalAI, you can effortlessly extract, visualize, and analyze their relationships, delivering precise insights. 💡 Explore Snowflake's Architecture Reference below and start building your own social graph today! Key Highlights: ✅ GraphRag Integration: Seamlessly integrates with Snowflake, enabling efficient graph processing and analytics. ✅ RelationalAI's Capabilities: Combines relational and graph databases for advanced data modeling and querying. ✅ Actionable Insights: Identify influential connections and trends within the tech industry. Start building: https://okt.to/SsyY5g #Snowflake #GraphRAG #RelationalAI #SnowflakeCortex #Llama #SocialGraph

𝗗𝗮𝘁𝗮 𝗳𝗼𝗹𝗹𝗼𝘄𝘀 𝘁𝗵𝗲 𝗗𝗮𝘁𝗮𝗯𝗿𝗶𝗰𝗸𝘀 𝗥𝗼𝗮𝗱  The latest Databricks technology move improves data management with acquisitions and open-source contributions, including the integration of Delta Lake and Apache Iceberg. Practical tip:  open-sourcing the Unity Catalog gives you direct access to community-driven AI and data solutions. #DataManagement #OpenSource #UnityCatalog #Databricks

Unfortunately, most data processing and analytics projects today use so-called "#Hairball #Architecture" (well covered in the podcast "Hairball Architecture and Other Nightmares"). #Composability and #microservices solve the service design problem, but we still need to exchange data in an optimized way between various services in our composable architecture. GoodData's in-memory data processing is based on #Apache #Arrow, so it is natural that we are leveraging #Apache #Arrow Flight for optimized inter-service data streaming. You can read more about our usage of Arrow Flight RPC here:

Catch Ryan Blue, the creator of Apache Iceberg™, and Michael Armbrust, the creator of Delta Lake, discuss why interoperability is fundamental to the Open Lakehouse approach. The Open Lakehouse architecture embraces open formats, giving you flexibility without locking you into a single choice. It’s time to think beyond formats. Databricks’ vision is clear: unify your data and AI landscape with seamless connectivity across data sources, no matter the format. Bring together discovery and governance for all your data and ML assets, and let the platform work for you and power intelligent insights for every user—whether data professionals or business stakeholders.

🌟 Unity Catalog breaks barriers with seamless interoperability across data formats and compute engines, opening the door to a more flexible and open data architecture. Our latest blog breaks down its impacts and why there’s never been a better time to embrace a more open approach to your infrastructure. https://lnkd.in/g2q-g9iN #DataAnalytics #DataEngineering #DataLakeAnalytics #DataLake #DataLakeHouse

🌟Unity Catalog breaks barriers with seamless interoperability across data formats and compute engines, opening the door to a more flexible and open data architecture. Our latest blog breaks down its impacts and why there’s never been a better time to embrace a more open approach to your infrastructure. https://lnkd.in/g2q-g9iN #DataAnalytics #DataEngineering #DataLakeAnalytics #DataLake #DataLakeHouse

Sigma Computing x Databricks Week 2024 🚀 Dive into our blog to find out what this week-long series will showcase about Sigma + Databricks pairing potential through a series of insightful sessions and case studies.