Document Database Community’s Post

Time is money, right? You can now save more time by analyzing your financial data from Snowflake, MySQL, or SQLite directly on the Terminal Pro. This means you can combine the power of our functionalities with the value of your data. What native integrations would you like to see next on Terminal Pro? 🤔 You can try our Terminal Pro in a 3-week free trial 🦋 Check out the comments to sign up.

Finally got the OneLake data hub working with powerBI desktop and service tunnelling into an on-premise server. MS certainly does not make it super easy. I've created a .NET library for about 70% of PropertyWare's new REST API. Sometimes I think about the world without Newtonsoft; did I ever tell you about the time where I thought I could hack some JSON and it wound up sucking all of my time without the results I wanted? Wrote a document puller to walk through the WorkOrders collection and pull all documents into a ZIP. https://lnkd.in/gWNR_Xm4

SQL-Server: What are virtual log files and why should you care about them? - get the answers in my recent blog post:

The latest release of PSBlitz: - Comes with multiple quality of life improvements for HTML reports: large tables (Index Usage, Index Diagnosis, Stats Info, Database Info, Storage Stats, Instance Health, Deadlock Details) can now be filtered by object or database name, and most of them are also sort-able. - Index Fragmentation Info now contains partition numbers and forwarded records count, and only skips tables with exclusive locks instead of the whole step. - The Statistics Information page now has explanations (and tool-tips in the HTML report) that clarify what's with the commented options in the stats update commands. - Includes other minor bug fixes and enhancements You can download it from the repository's Releases section. https://lnkd.in/e4p2fKpD #sqlserver #sqldba #powershell #microsoftsqlserver #mssqlserver #mssql #mssqldba #PSBlitz #Azure #AzureSQLDB

See this gif, in which I mount a 32GB Dataset from Kaggle, as a local directory. I then immediately query it using DuckDB. with cloudzip (link to GitHub in comments), I only ever downloaded a handful of MBs to make that work. This is functionally equivalent to downloading the 32GB zip file, extracting it, and then querying the files included in it. But that would take order of magnitude more time to get done. So how does it work? cloudzip leverages 3 simple facts: 1. Kaggle Datasets are distributed via their API as Zip files. 2. Zip files allow random access reads. They have a "central directory" at their footer, describing the files contained inside, complete with offsets for each file. 3. Object stores (and many HTTP servers) allow using `Range` headers to fetch only parts of a remote object. 😎 cloudzip would issue a Range request to fetch the footer, where that directory is stored (typically KBs in size), even for that 32GB archive, and only fetch files according to their offsets as they are read by the user. To accomplish this, the `cz mount` command above actually spins up an NFS server, listening on localhost, and proceeds to mount the data_dir to that NFS server. `cz umount` would unmount, and kill that server. This works with any of the supported remote storage locations (kaggle, but also S3, HTTP and lakeFS) * cloudzip is a pet project, mostly for my own research. See the GitHub link in comments, where you are free to use/contribute/flame me as you please.

Here's a cool #TSQL #script for finding forced usages of an index in the #SQLServer plan cache https://buff.ly/3YOUZ1T #Microsoft #MadeiraData

"Databases underpin almost every user experience on the web, but scaling a database is one of the most fundamental infrastructure challenges in software development. PlanetScale offers a MySQL platform that is managed and highly scaleable. Sam Lambert is the CEO of PlanetScale and he joins the show to talk about why he started the platform, scaling databases, using Vitess for SQL shard orchestration, and more." https://lnkd.in/ep58-GfY

How low can you go!? 👇 A comparison of writeback approaches from within Canvas Apps of #PowerPlatform. I have a personal favorite, in the shape of a stored procedure, and while I have said many times out loud that it is a blazing fast approach, assuming you're using a SQL Database, here's some proof to it. It covers A bad approach to patching, which unfortunately is a logical one to use. 2 good approaches to patching, which unfortunately are less logical and less documented, at least if you haven't heard about them. A stored procedure 🔥. It's no secret that the stored procedure goes the lowest, in this post. Do you know of a faster approach, enlighten me! https://lnkd.in/dY3k7gBV

You don't need a rocket on a bicycle when you have wings! 🦆 It's the weekend! Time to work on the #chsql extension for the DuckDB #OLAP database! Extending DuckDB with 184+ #ClickHouse SQL function macros to do the SQL things you already love embedded in ~1/10th of the size and up to ~2x faster 🚀 as confirmed by ClickHouse benchmarks: tinyurl.com/mr395myz BONUS: Works great in MotherDuck for multiplayer cloud analytics! ☁ #OLAP #Analytics #Embedded #Database #SQL #DuckDB #Data #Warehousing

Today, another shout-out to #DotNetConf and specifically to Drew Skwiers-Koballa’s session titled “Next-gen SQL projects with Microsoft.Build.Sql” 🎉, which is all about managing databases as projects 📊. This approach makes integrating the database into the daily development workflow super easy 🚀, allows for declarative deployment 📦, and ensures everything can be put under source control 📁. Sounds great, right? 😃 It’s no surprise that this is one of the most-watched sessions! 📺 Check it out yourself. (And I haven’t even mentioned the support for .NET Aspire… that’s just the cherry on top! 🍒) #AzureSQL #SQLServer