Clemens Vasters’ Post

🚀 #GreptimeDB Version 0.9.1 Released! This update brings crucial fixes to bugs related to Full-text searching and data ingestion. We highly recommend upgrading to this latest version to ensure that your systems are running smoothly. 🔗 Full release note: https://lnkd.in/gnw47uk2 #Loganalysis #database #dataanalysis #logdata

I've mentioned using JSON generated directly from SQL a few times, a really basic example, using Dapper, can be seen at https://lnkd.in/eqCAf7fi In this instance, the controller endpoint acts as a proxy to your database - no models need creating, no mapping, just a straight write from your data source to the output stream. Fast and lightweight. Your performance is mostly defined by your query (for example, I may have got better performance using a cross apply, but I wanted a simple enough query.) You can even use it to generate complex objects direct from the database by deserialising the string(s) returned. #development #sql

🚀 D̶e̶p̶l̶o̶y̶ Release on Fridays: Data Contract CLI v0.9.7 This release would not have been possible without all the great contributors: Jan Seeger a much improved linting of data contracts Nadejda Ismailova import from avro schema files Dominik Guhr OpenTelemetry integration Torben Keller compare two datacontract.yaml files and determine a changelog as well as check if the changelog contains breaking changes Jochen Christ export the data model to Protobuf files A detailed list of new features available at https://lnkd.in/g56ryyNq And we already have an upcoming PR from Simon Auger for exporting to Great Expectation Suites. So stay tuned for the next release. :-) #datacontracts #opensource  

**pgSimload 1.4.0 is out !** New major feature : "- clients <integer>" Used in "SQL-Loop" mode, it will create as many connections to the database to execute a given script **in parallel**, i.e. the number of clients declared here. Patroni v.4 compatibility added. Tested also against PostgreSQL 17... And underlying modules updated too ! More on https://lnkd.in/eVVcm7uc

It took me more than an hour to release this new version of the flow application in which I modified the structure of the application and inserted the alert information in another table of the Postgresql database. Here is the link: https://lnkd.in/dDefn5Hi

Are your pipelines suffering from slow extraction? Martin Salo has been using dlt's async resources and got 10-15x speed gains. In this gist he shows how to use the dlt async resource to extract data from postgres 15x faster

#100DaysOfCode Day 52 - Result: Today I wrote the server-side code for processing the various requests for data to be stored in the local indexedDB object stores. Additionally, I improved the project's README.md file to be more descriptive/useful (https://lnkd.in/eZADMkfe). With the server-side code written, the next step will be to write the client-side script to request and process the data.

We're excited to announce the release of dynein v0.3.0! dynein is a command line interface for Amazon DynamoDB written in Rust. dynein is designed to make it simple to interact with DynamoDB tables/items from the terminal. This release brings significant improvements to several core dynein commands, making it easier to work with DynamoDB data. It also lays the foundation for future expansion by migrating to the AWS SDK for Rust, providing a more consistent experience with standardized SDK features. Major Enhancements: Query, Put, and Import/Export Commands: - Query Command Improvements: The 'query' command now supports the dynein format, providing a more intuitive way to query your DynamoDB data. (#187) - New Options for 'bwrite': The 'bwrite' command has been enhanced with new options, giving you more control over writing data to DynamoDB. (#170, #190) - Improved 'put' Command Parsing: We've implemented new parsing for the 'put' command, making it easier to insert data into your DynamoDB tables. (#165) - Processed Item Counts: The 'import' and 'export' commands now display the number of processed items, providing better visibility into your data operations. (#141) - Binary Data Support for 'bwrite': The 'bwrite' command now supports binary data types, simplifying the process of working with binary data in DynamoDB. (#170) Improved Resilience with Retry Configuration: - Exponential Backoff Retry: dynein now includes exponential backoff retry, ensuring more resilient DynamoDB interactions. (#196) Consistent Experience with Standardized SDK Features: - Migration to aws-sdk-rust: We've migrated from rusoto to aws-sdk-rust, leveraging the latest AWS SDK for Rust. This migration provides a more consistent experience with standardized SDK features and lays the foundation for future expansion and enhancements. (#126) This release is a collaborative effort between the dynein team and the amazing dynein community. We're grateful for all the contributors who have dedicated their time and effort to make dynein better. For a complete list of changes, please refer to the release page: https://lnkd.in/gdMCjqz6 We welcome feedback, bug reports, and feature requests on our GitHub repository: https://lnkd.in/gYpwvaTM

JSON4u - JSON visualization and processing tool. Do you often work with data in JSON format? There are plenty of tools on the web to help you visualize such data or review it. Hopefully, you don't want to send your company's data somewhere in the world for analysis. You can run this tool locally, on your computer. Especially useful is the function to visualize the structure of JSON, which is very useful to understand how it is structured and, for example, how to process it programmatically later.

Exciting Enhancements Arrive in the Latest replication-manager Release! 🚀🎉 We're thrilled 😊 to announce the availability of replication-manager v2.3.43, packed with a host of improvements and refinements to elevate your database replication experience! Under the hood, we've tackled some key challenges: - Addressed stubborn issues with stalled and reseed states 🛠️ - Strengthened error handling during job refreshes 🔍 - Ensured data safety by properly cancelling pending jobs when the monitor restarts 🔒 On the provisioning and configuration front, we've streamlined the deployment paths for MySQL config files. 📂 When it comes to databases and backups, we've: - Enhanced the wait and limit logic for seamless database flashbacks and reseeding 💾 - Resolved a pesky problem with compressed backup reseeding 🔄 The GUI also received some love, with: - A brand-new interface for adjusting database buffer size 🖥️ - Resolution of missing configurator tags 🔧 And last but not least, we've optimized the load certificate log for better performance and stability. 🔥💪 Ready to unlock the latest and greatest? Explore the GitHub release page: https://lnkd.in/gn8h3-Ej For a deep dive into replication-manager's comprehensive capabilities, visit the main project repository: https://lnkd.in/gRMFYTif or the project website at https://signal18.io. Have questions or feedback? Our team is standing by, eager to discuss open-source database technologies and support your replication needs. 💬🤝 #replicationmanager #database #replication #opensource #mysql #graphite #mariadb #backup #restore #signal18 #github #orchestrator #databasereplication #mysqlreplication #mariadbreplication #opensourcetools #githubreleases