Craig Seyffer’s Post

Snowflake and Microsoft Fabric announce expanded partnership enhancing interoperability! Highlights of this week's announcement include: 🚀 Snowflake will be able to store data in Iceberg format in OneLake (official preview later this year). 🚀 Fabric will be able to store data in Iceberg format in OneLake via Apache XTable translation in OneLake. 🚀 Data written by either platform, Snowflake or Fabric, will be accessible from both the platforms. 🚀 Snowflake will be able to read Fabric data artifacts in OneLake, stored physically or virtually through shortcuts. 🚀 Data from Snowflake and Fabric can be used by a variety of services, such as Microsoft 365, Copilot in Microsoft 365, Snowflake Cortex AI, Azure AI Studio, Snowflake Copilot and more. https://lnkd.in/eM7QPGTT

Amazing partnership built between Microsoft Fabric and Snowflake to improve interoperability through Apache Iceberg. With this integration, the data analytics ecosystem is growing and more flexible for companies: - Snowflake will be able to store data in Iceberg format in OneLake - Fabric will be able to store data in Iceberg format in OneLake via Apache XTable translation in OneLake. - Data written by either platform, Snowflake or Fabric, will be accessible from both the platforms. - Snowflake will be able to read Fabric data artifacts in OneLake, stored physically or virtually through shortcuts. - Data from Snowflake and Fabric can be used by a variety of services, such as Microsoft 365, Copilot in Microsoft 365, Snowflake Cortex AI, Azure AI Studio, Snowflake Copilot and more. Read more 👇 https://lnkd.in/d9-n3T9S

🚀 Exciting News! Snowflake and Microsoft are deepening their partnership with enhanced interoperability through Apache Iceberg. This collaboration will integrate Snowflake with Microsoft Fabric OneLake, set to preview later this year, facilitating bidirectional data access with a single data copy. This streamlined integration means no more redundant data pipelines or multiple data copies across platforms, reducing costs and complexity significantly. 🔗 Key Highlights: - Seamless integration of Snowflake data with Microsoft 365 apps like Teams, Excel, and more via Fabric. - Cross-cloud AI, advanced analytics, and more will be accessible across both Snowflake’s Data Cloud and Fabric OneLake. - Both platforms will support storing and accessing data in Iceberg format, enhancing flexibility and efficiency. 🌐 This integration not only promises cost savings but also enables a broader range of functionalities including cross-platform AI applications and advanced analytics, thanks to shared standards like Apache Iceberg. #Snowflake #Microsoft #DataInteroperability #ApacheIceberg #CloudDataManagement #TechNews https://lnkd.in/ekKcS2T8

The Microsoft Fabric OneLake will now support Apache Iceberg and enable bi-directional data access between Snowflake and Fabric. This integration allows users to work with a single copy of data across Snowflake and Fabric, regardless of whether it's stored using Delta Lake or Iceberg format. In the upcoming months, Microsoft and Snowflake will be introducing new capabilities to enhance data management: - OneLake will support Iceberg in addition to Delta Lake, utilizing the Apache XTable project. - Snowflake can now store data in Iceberg format within OneLake. - Data written by Snowflake or Fabric will be available in Iceberg and Delta Lake formats through X Table translation in OneLake, fostering seamless interoperability. - Snowflake can read any Fabric data artifact in OneLake, stored physically or virtually through shortcuts. - Snowflake data items will enhance experiences in Fabric engines, Microsoft 365, Azure AI Studio, and Copilot for Microsoft 365. Stay tuned for these advancements that will streamline data operations and improve cross-platform functionality. #azure #Microsoft Learn more: [Microsoft Fabric Blog](https://lnkd.in/dQSsjEPC)

At Microsoft Ignite, the highlight announcement for Fabric was Databases, but you may wonder why this is a big deal? Fabric Databases make SQL Server now a SaaS database, which is nice for new users, but don't think existing Azure SQL Database users will switch, as it's a pretty easy solution to manage for a PaaS. What it does add, though, is "Translytical Apps" - Power BI write (!) functionality to the Fabric Database with Fabric functions, which opens up lots of options that were only available with connecting up Power Apps or App Service, plus allows you to see your changes in real time to analytics dashboards in real time, without having to change tabs. OneLake catalog was also announced, catching up with Databricks Unity Catalog and Snowflake's Polaris in giving Fabric a metastore. A common question in Ignite chat was asked: "Does this now supersede Purview?". For the most part no, as OneLake is a metastore for data users, Purview is a catalog for business users. See an excellent post by Kyle Weller in the comments for more on that topic. Other announcements yesterday were: 1️⃣ Co-pilot for Power BI end users. 2️⃣ AI Skills - query any Fabric source with Co-Pilot. 3️⃣ More mirroring sources, including the ability to add custom sources, which is really cool. 4️⃣ More admin tooling with Surge Protection and Workspace Monitoring. Fabric is updating at a breakneck pace that we're having to update our internal docs on it on a weekly basis! If anyone has any questions about how to architect a Fabric deployment or how it stacks up against the competition, feel free to leave a comment or message me.

Interesting read.

Microsoft Fabric unifies data & analytics, building on Azure Synapse Analytics for improved data-level interoperability. Explore its offerings & pros/cons. https://buff.ly/3HStn2u

Microsoft Fabric introduces Fast copy for efficient data ingestion, aiming to transform dataflows at scale. 🚀 - Fast copy supports ingesting terabytes with dataflow ease and Pipeline's scalable backend. - Automatically switches backend for dataflows over 100MB, without authoring changes. - "Force Fast copy" enables debugging sessions, cancelling refreshes for unsuitable queries. - Supported data sources include Azure Data Lake Storage Gen2, Azure Blob Storage, Azure SQL Database, Lakehouse, and PostgreSQL. - Supported transformations: file combination, column selection or removal, data type changes, and column renaming. - Use Fast copy by enabling it in Power Query editor's Scale tab, and choosing supported data sources and transformations. For more info, visit: https://lnkd.in/dSBFSMzU #MicrosoftFabric #DataFlow #FastCopy

Microsoft Fabric made waves last week at the Fabric Community Conference, unveiling new features and enhancements for Data Factory that aim to revolutionize data integration and analytics. 🔹 New Data Pipelines features: - On-premises data access using the On-premises data gateway. - CI/CD support and increased activity limits. - Public APIs and Semantic Model Refresh activity. - Unity Catalog support in Azure Databricks and improved tuning tips. 🔹 Dataflows Gen2 enhancements: - Fast Copy for high-scale data ingestion. - Enhanced support for schema changes. - Cancellation of dataflow refreshes and Privacy Levels support. 🔹 Other updates: - Improved Get Data UX for Azure resources. - Azure SPN support for on-premises data gateways. - Enhanced Manage Connections experience. - Test Framework for Custom Connectors SDK in VS Code. - VNET Data Gateway general availability and data mirroring for Azure SQL DB, Cosmos DB, and Snowflake. For those eager to embrace these new capabilities🚀, more information is available at: https://lnkd.in/dU9ExYTr #MicrosoftFabric #DataFactory #Azure #CloudComputing #DataIntegration

📌 Exciting news from Lumír Hlaváč at Microsoft Ignite keynote!   SQL Database comes to Microsoft Fabric and TARGETTY is now fully migrated to use this solution! This move has allowed TARGETTY to benefit from simplified architecture, predictable costs, and enhanced performance with the new features. With enhanced performance and scalability, we’re poised to offer an even more efficient solution to our customers 🎯 #Microsoft #Targetty #MicrosoftIgnite #sql