Jason Strautman

Fineweb training dataset just got leaner! We've tackled the ~70% duplication issue in this valuable 93.4TB dataset. Same great data, now more efficient and cost-effective. https://lnkd.in/g9-yQnsy

20

As a Snowflake Alum, I was initially nervous with Snowflake's seemingly late entry into the Generative AI race. But my initial doubts have turned into enthusiasm lately as Snowflake's strategy appears to be taking shape. From its very beginning, everything Snowflake has introduced has been geared toward efficiency and ease of use, and it's clearly no different with their efforts in the Generative AI space. The true promise of Gen AI is not whether or not it can do your child's homework, but how it can be integrated into everyday business activities that drive growth and efficiency. With the launch of Arctic, Snowflake's vision for the future of Generative AI is becoming much clearer. Get your popcorn ready!!! #ITconsulting #technologyconsulting #Snowflake #TheGreenLeafWay https://lnkd.in/ej-Gm3HG

86

3 Comments

👍 Real-time analytics + support for ETL, OLAP workloads, ML, & geospatial analytics. .....or..... 👎 Real-time analytics with higher $$ and compute load-limitations. The data doesn't lie -- read the Ocient vs. Druid benchmark and learn more:

19

Adrienne Murphy discusses an outstanding example of data leadership by the Massachusetts Department of Early Education and Care. Transcript: Adrienne Murphy (Massachusetts Department of Early Education and Care): First, in terms of understanding the pre-K landscape, the CUSP network has really helped us understand, in this three and four-year-old space, who's being served across the mixed delivery system, which has been especially important when our governor, the Healey Administration, announced a new Gateway to Pre-K Initiative, which included a proposal to deliver universal, high-quality preschool access for four-year-olds in all of our Gateway cities, which are our sort of mid-sized urban centers that are sort of the regional economic anchors across the state. And the cost model has been able to help us to benchmark sort of where are we now, who's being served across our licensed and funded early education care providers, across our public K-12 system, across our private school system, to be able to understand sort of the full landscape of who we're currently serving. And, by virtue of who we're currently serving, also, who are we not serving? Sort of what's the delta between where we are now in pre-K access for four-year-olds across the state, but really particularly in these gateway cities? And then sort of, what's the delta between where we are now and the universal access that is proposed in the gateway to Pre-K initiative? So, this is, you know, really one instance in which being able to know who are we currently serving, who are we not serving, and where are we not serving children has become really key for us and for Massachusetts as sort of the policy design process. Click here to learn more: https://team3si.com/ #communityofpractice #dataforgood #earlychildhooddata #acf #ecids

1

This week marked a watershed moment for Snowflake: We launched #SnowflakeArctic, a state-of-the-art large language model uniquely designed to be the most open, enterprise-grade LLM on the market. Arctic not only outperforms many leading open models, but we brought it to market at one-eighth of the cost and in less than three months compared to other models. Arctic will significantly enhance our ability to deliver reliable, efficient AI to our customers. By delivering industry-leading intelligence and efficiency in a truly open way to the AI community, we are furthering the frontiers of what open-source AI can do. https://lnkd.in/eueT5Wcs

78

Databricks disclosed that they are expecting to cross $2.4B in revenue run-rate growing ~65% Y/Y by H1’25 (Jan FYE). This was alongside top-tier metrics, including 80%+ GMs, 140%+ NDR, and a multi-product story where ~50% of customers use 6+ products (incl. their Data Warehouse product which generated $400M in revenue up 4.0x Y/Y). Given their accelerated growth, Databricks is among the few scaled software companies, alongside hyperscalers, capitalizing on the AI boom. Equally noteworthy is their market share gain against competitors. Considering their growth trajectory, we explored various scenarios to determine when Databricks will surpass Snowflake in scale. The question is not if, but when, and we believe it is sooner than most anticipate.

1,010

26 Comments

At a Generative AI thought leadership dinner with other CTOs in NYC today and some interesting trends are emerging: * a consensus that LLMs are converging on a general set of features and basically comparable performance * a consensus that an org's data pipelines will matter more than the LLM chosen * and a group of people who read the TOS that are really scares about what these LLMs will do with access to all your data. Lastly, my prediction: the work of tech is moving from the keyboard to the whiteboard. Ai as microservice means structuring your data, thinking with ai, and chaining ai agents will supercharge your career and your cause -- but only if social change orgs platform their data. In my study of polymaths, Charles Babbage designed the basic idea for a unit of computing being something that takes an input, does something to it and gives an output -- the so called Babbage difference engine. In a real way, GenAI is approaching a world where chaining inputs ala a babbage difference engine is accessible to all. This can be an awesome opportunity if we get Non profits to work together!

11

3 Comments

Learn how #graph #databases and knowledge graphs offer advantages over standard/relational databases. https://lnkd.in/epnz3xid

4

As part of Databricks' LakeFlow Council, I've had the opportunity to see the work that is happening being the scenes on LakeFlow Connect, Pipelines, and Jobs. From what I see, "Pipelines" is what DLTs should have been, and MUCH more. About 80% of what I'd like to see appears to be getting implemented. Future appears bright for this one thus far! PS: Shared this with Bilal Aslam's permission.

90

10 Comments

We are in the early stages, but the momentum we are seeing with our partners building AI apps and commercializing those apps for our customer ecosystem is significant. "Snowflake Massively Expands Types of Applications That Can Be Built, Deployed and Distributed on Snowflake" https://lnkd.in/gZ5bUswA

26

If you are ingesting data from Kafka/Kinesis into Snowflake you should watch this short video by Charles Tan and Shawn Gordon on how you can use DeltaStream to shift left your workloads to reduce cost and latency! #Flink #Kafka #Snowflake #ShiftLeft https://lnkd.in/gnZ45MTa

13

Lately, we have observed a transition from Cloud Databases(Snowflake etc) to Iceberg OpenLakehouse format. Ambaricloud team is working on Snowflake to Iceberg Automation and end-user training. Why: Low-cost computing. SF is still a favored engine for Gold layer data. Less stickiness. More engine options to run on Iceberg tables. Cloud storage Parquet files Iceberg table format Catalog Status: Polaris -- Started Walking. Hopefully, it will Jog or Run soon! UnitCatalog -- Infant Glue -- Safe bet for now. Comments? Snowflake Cloudera Dremio Upsolver Databricks

8

1 Comment

If you're a data person and spend more of your time worrying about how to get value from your data and less about how to make it scale, join us at Small Data SF, Sept 23-24. We've got absolutely badass speakers & sponsors, a who's who in data and AI. We've got one day of workshops, so folks can get hands-on with Small Data technologies and solve real problems, and one day of short-format talks that cover topics ranging from local-first AI models to data visualization at 60 frames per second.

79

Should be a very interesting webinar if you have the time to attend. A look at how to leverage Kumo.AI GNNs to easily enable AI on your data stored in Snowflake.

11

🚨 Databricks Game Changer 🚨 Row and Column Level Security for Unity Catalog -- For the first time on any platform, you can apply fine-grained access controls across Apache Spark, data warehousing, AI, and real-time processing—all within a single platform.

11

Interested in incorporating Snowflake Data Warehouse data into your Fabric Lakehouse solution? Look no further than my latest post on the topic! In it, I walk through the process of ingesting Snowflake data into Fabric using a Pipeline. #MicrosoftFabric #Fabric #Snowflake #DataWarehousing

36

Quick question for the LinkedIn Community: Does anyone have good data on or insight into how many on-prem software companies there are in the US, as well as how many are currently transitioning to private cloud or broader cloud offerings? I’m curious about the trends and challenges involved in this shift.

5