Logicata’s Post

In this post, we explore a pattern for compacting (or combining) large collections of small files into fewer, larger objects using AWS Step Functions. Compaction offers an alternative to archival-based solutions such as compressing and archiving logs stored in Amazon S3 and Amazon S3 Tar. By compacting many small objects together, they become large enough to exceed the 128 KB file size, resulting in lower management costs. Additionally, ad-hoc query performance is improved, and queries are executed in-place without making changes to existing code or tools. #AWS #AmazonWebServices #AWSBlogs #Cloud #CloudComputing https://lnkd.in/d9wwNYZv

How to Setup TTL for Records and Practical Use Cases https://lnkd.in/ddEDJZwJ Amazon Web Services (AWS) #aws #awslambda #businesscompassllc

https://lnkd.in/gchTbc2n In this blog post, we present a more cost-efficient option with serverless data archiving on Amazon Web Services (AWS). In our experience, you can build your own cloud-native solution on Amazon Simple Storage Service (Amazon S3) at one-fifth of the price of third-party alternatives. If you are retiring legacy core business systems, consider serverless data archiving for cost-savings while keeping regulatory compliance. #aws #archival

I'm happy to share that my first AWS external blog is now live. It explores how to identify access patterns on Amazon S3 buckets through Storage Class Analysis, enabling informed decisions on selecting the optimal Storage class and understanding transition costs between classes based on your specific use case. Please do consider giving a read and share to others as needed. https://lnkd.in/gSTCc_G5 Special thanks to Lee Kear for critical inputs ! #aws #blog #storageclassanalysis #awscloudstorage #amazons3 #s3

Explore Object storage service in AWS i.e S3 #aws #s3 #cloud #objectstorage

Enhancing ACID Properties in Aurora Limitless Databases with Amazon Time Sync https://lnkd.in/dHNnmywT Amazon Web Services (AWS) #aws #awslambda #businesscompassllc

Do you use CloudWatch Log Classes? They can help you save big time on your CloudWatch bill. ☁💸 Checkout our latest post: https://lnkd.in/gFzBr848 #AWS #CloudWatch #FinOps #CloudCosts

🚀 Unlocking Superior Performance with Bare-Metal.io: A Comparative Study with AWS by ChistaData with a ClickHouse benchmark on bare metal🚀 In the ever-evolving landscape of big data and real-time analytics, infrastructure choice plays a pivotal role in database management system performance and cost-efficiency. Our recent benchmarking exercise conducted by ChistaData compares the performance of ClickHouse on AWS EC2 and a bare metal server provided by Bare-Metal.io. The comparative analysis offers insightful revelations about the advantages of leveraging bare metal servers for ClickHouse hosting. Check out the full article to explore: -Benchmarking Methodology: ClickBench Comparison Report -Infrastructure Spotlight: Bare-Metal.io vs. Amazon EC2 -Benchmark Results: A Comparative Analysis -Cost-Effective Analytics: A Pricing Comparison between Bare-Metal.io and AWS -Conclusion: The Bare-Metal Advantage Read the full article to discover how Bare-Metal.io offers superior performance at a fraction of the cost compared to AWS, making it the go-to choice for high-performance analytics. https://lnkd.in/g7NPkwGh #BareMetalio #CloudComputing #BigData #Analytics #Performance #AWS #ChistaData

This post demonstrates using AWS DMS to migrate RDS data into compressed S3 archives. It covers partitioning strategies, using S3 Object Lock, and querying the archives through Athena with low latency. #aws #awscloud #cloud #advanced300 #amazonathena #amazonrds #amazonsimplestorageservices3 #awsdatabasemigrationservice #technicalhowto

This is very useful. Especially for log data that you must keep for a long time. With this pattern, you can achieve big performance improvements when querying many small objects, such as months of Cloudtrail logs from a large AWS Organization.