👋 Joe Karlsson

New blog post by Alex Monahan: Benchmarking Ourselves over Time at DuckDB The DuckDB team's philosophy is to ensure correctness first, then iterate and optimize to improve performance. This blog explores how this happened over the last three years when DuckDB became approximately 3-25x faster and 10x more scalable. Read more at https://lnkd.in/dnQ7Nya8

197

16 Comments

This week on the blog, Ami Ikanovic discusses the "DIY is better" mentality for #datamasking and how it might seem like a quick win initially, but the long-term costs – time, complexity, and risk – are too high. https://lnkd.in/eUXyXKQf #datasecurity #datasecops #datagovernance #Snowflake

19

We are LIVE at PASS Data Community Summit! Join us for Day 1 of Postgres Conference Seattle for a "Journey through Postgres" w/ Zak Tedder in Rm 420 or "Tips and Tricks for developers moving to PostgreSQL" w/ Eric Lendvai in Rm 422. Check out the full schedule here https://lnkd.in/estNqRHm #Community #Postgres #Data #peoplepostgresdata

1

New features are available in Plan Explorer. Resolve performance bottlenecks efficiently and more. https://lnkd.in/gjMp2AKu #Databaseperformance #Databasebasereporting #freetool 

1

Developers can now store, index, and query vectors in PostgreSQL using pgvector, eliminating the need for a dedicated vector database. This blog from Yugabyte expert Brett Hoyer deep dives into pgvector, and explains how to store text embeddings as vectors, execute similarity search, choose between indexes, and scale with distributed SQL.💡 Find out more!⬇️ https://hubs.la/Q02JyYrM0 #YugabyteDB #pgvector #vector #AI #Postgresql #cloudnative #distributedsql

5

Check out our latest blog by Tobias (Toby) Mao, which made it to the front page of HackerNews! https://lnkd.in/gv3nE3JU #madeit #data #dbt #SQLMesh

12

2 Comments

Today we're taking the powerful data tools we've built for technical practitioners, and opening them up to everyone! We're releasing end-to-end no-code workflows with: ∑ 𝐒𝐩𝐫𝐞𝐚𝐝𝐬𝐡𝐞𝐞𝐭-𝐬𝐭𝐲𝐥𝐞 𝐜𝐚𝐥𝐜𝐮𝐥𝐚𝐭𝐢𝐨𝐧𝐬 🧮 𝐃𝐚𝐭𝐚 𝐛𝐫𝐨𝐰𝐬𝐢𝐧𝐠 🔏𝐔𝐩𝐝𝐚𝐭𝐞𝐝 𝐠𝐨𝐯𝐞𝐫𝐧𝐚𝐧𝐜𝐞 𝐟𝐞𝐚𝐭𝐮𝐫𝐞𝐬 🔮𝐀𝐈 𝐬𝐩𝐞𝐞𝐝 𝐚𝐧𝐝 𝐚𝐜𝐜𝐮𝐫𝐚𝐜𝐲 𝐢𝐦𝐩𝐫𝐨𝐯𝐞𝐦𝐞𝐧𝐭𝐬 These new workflows live right alongside our existing SQL, Python, and AI tools, so everyone— regardless of technical experience— can come together in Hex to ask and answer questions with data. Watch the launch video below, and check out the blog in the comments for all the details! https://lnkd.in/gdpHuAYb

88

9 Comments

📊 From Medallion to Modular: Rethinking Data Architecture What's the most effective way to structure data to match data product thinking? Read it in our latest blog post authored by Portal product lead Kristof Martens. https://lnkd.in/eKNU2rqR Hint: Vanilla medallion architectures might not be the best choice. 🥇 🥈 🥉 We're building the open-source Data Product Portal to help teams structure data effectively and: 1️⃣ Register data outputs independently   2️⃣ Maintain clear ownership 3️⃣ Scale data initiatives across the org 4️⃣ Enable self-service without sacrificing governance 5️⃣ Support both product-aligned and source-aligned data organization Read our vision for effective data structures for self-service governance in Kristof's latest post. Link to article in the comment below 👇 👇 👇 ---🏷️ #dataproductthinking #dataplatform #datateams #dataarchitecture #medallionarchitecture

9

1 Comment

In this week’s #TechnicalTusday, Steve Taylor breaks down how to leverage variables for dynamic data pipelines in the Matillion DPC Designer tool. Learn how to: 🛠️ Create project and pipeline variables 🧩 Use different variable types, including grids ⚡ Dynamically populate variables from query results Read the full blog post (see a real-world example of variables in action) below. https://lnkd.in/gycwX2WS

21

1 Comment

🦙 Jamba-Instruct is now LIVE on LlamaIndex 🦙 Check out latest LlamaIndex blog examining why #RAG without a long context window isn't sufficient for enterprise use cases. The solution: Long Context + RAG. For an in-depth guide on how to leverage Jamba-Instruct's 256K context window on LlamaIndex, read here:👇 https://lnkd.in/dTAkqMix

53

1 Comment

If you're tired of expensive data lakehouse/analytics solutions and are considering open-source technologies, you definitely would like to read this: Dien, Tran Thanh shares his firsthand experience, proven best practices, and insightful suggestions for migrating from BigQuery to Apache Doris. They are saving $4,500 per month. https://lnkd.in/ggVXgRaB #datalakehouse #BigQuery #dataanalytics #dataengineering #dataplatform #opensource

50

2 Comments

Expand your data expertise with the Wisconsin Databricks User Group's session on "Exploring Data Warehousing." We'll cover vital topics like Data Processing & Analytics, Genie AI Assistant, and External BI Tool Integration. 📅 Event Date: September 12, 2024, from 5:30 PM to 7:30 PM. 🔗 Register here: https://lnkd.in/dXrT3KmX Don’t miss this opportunity for professional growth and networking, sponsored by Xorbix Technologies and Databricks. #DataWarehousing #Databricks #AI #DataAnalytics #Networking

7

🚀 New Blog: Navigating High Cardinality in Metrics 🚀 High cardinality data offers precision but can inflate storage and computational costs. Our latest blog dives into how to manage this balance effectively in observability metrics. Key tips include: 🔹 Avoid Improper Instrumentation 🔹 Optimize Histogram Buckets 🔹 Use Consistent Tags ❇ Check out Harold Lim's insightful blog here: https://lnkd.in/ekFhrftu #observability #o11y #metrics #cardinality And stay tuned for our upcoming blog, where we’ll tackle high cardinality in events, logs, and traces!

21

❄️ If you missed even a minute of #SnowflakeBUILD, check out VentureBeat's rundown of Snowflake’s 4 biggest announcements: 1️⃣ #CortexAI: Bolstered with Cortex Chat API and new multimodal input support, managed connectors, and knowledge extensions 2️⃣ #SnowflakeIntelligence: Launched new unified platform enabling users to build “data agents” to answer questions related to structured and #UnstructuredData and take action across 3rd-party platforms 3️⃣ Open Catalog & Document AI: Debuted Snowflake Open Catalog and announced general availability of Document AI to extract #data from unstructured docs on Amazon Web Services (AWS) and Microsoft Azure 4️⃣ Threat Prevention & Security Monitoring: Introduced Leaked Password Protection to automatically detect and notify customers if credentials are exposed on the dark web https://bit.ly/3YS8lte

4

Join Neal Ford and his guest Pramod S. on May 9 at 12 p.m. ET to get an expert perspective on what the future holds for data-driven architecture. Big data is getting bigger all the time, so you know you’ll have to support a data-driven strategy at some point, but what will that entail? https://bit.ly/3Qd6wU8 #softwarearchitecture

6

Doltgres now supports importing tab-formatted data using the COPY FROM STDIN statement. Today's blog by Jason Fulghum explains how PostgreSQL's wire protocol supports fast and efficient data imports with the COPY FROM STDIN statement, and demos our support in Doltgres. https://lnkd.in/eEFMPEdQ

6

💬 See what InfluxData Director of Data Analytics, Mona Sami has to say about creating a single source of truth with RudderStack. Read the case study to find out how InfluxData uses RudderStack to save time by eliminating expensive data wrangling and centralizing their data 👉 https://bit.ly/3SKh25M

10

💬 See what InfluxData Director of Data Analytics, Mona Sami has to say about creating a single source of truth with RudderStack. Read the case study to find out how InfluxData uses RudderStack to save time by eliminating expensive data wrangling and centralizing their data 👉 https://bit.ly/3SKh25M

6