Cut Costs in Real Time with Amazon Managed Streaming for Apache Flink. 💸 Amazon recently announced a new capability to optimize costs for Flink workloads in real time. This uses automatic scaling and Spot Instance usage to reduce costs by up to 90%! 🤯 The key highlights are: 🚀 Continuous cost optimization that scales cluster capacity based on workload needs, reducng waste. 💵 Leverages low-cost Spot Instances for significant savings - up to 90% less than On-Demand! 📈 Supports real-time streaming workloads like fraud detection, recommendation engines etc. 🤖 Fully managed service - no ops overhead for capacity management. The automatic optimization helps companies process streaming data cost-efficiently and focus on core business logic instead. 😀 This looks like a great capability for teams running real-time analytics on Flink! Has your team tried the managed Flink service on AWS? What cost savings have you realized? https://lnkd.in/g5_9gufM #aws #amazon #bigdata #dataanalytics #amazonmanagedserviceforapacheflink #apacheflink
Slava Gorlov’s Post
More Relevant Posts
-
Earlier this week, AWS announced the general availability of Express brokers, a new broker type for Amazon Managed Streaming for Apache Kafka (Amazon MSK). It’s designed to deliver up to three times more throughput per-broker, scale up to 20 times faster, and reduce recovery time by 90 percent as compared to Standard brokers running Apache Kafka. Express brokers come preconfigured with Kafka best practices by default, support Kafka APIs, and provide the same low latency performance that Amazon MSK customers expect, so they can continue using existing client applications without any changes. #AWS #Amazon #MSK #Kafka #Broker #Express
Introducing Express brokers for Amazon MSK to deliver high throughput and faster scaling for your Kafka clusters | Amazon Web Services
aws.amazon.com
To view or add a comment, sign in
-
Check out our latest blog post about how to use Amazon Web Services (AWS)'s S3 Express One Zone storage class with WarpStream to reduce latency by 4x, while still keeping costs and operations burden under control! We're very excited to have this one featured on the AWS Storage blog - go take a look! https://lnkd.in/ewU9kABu
How WarpStream enables cost-effective low-latency streaming with Amazon S3 Express One Zone | Amazon Web Services
aws.amazon.com
To view or add a comment, sign in
-
Safely remove Kafka brokers from Amazon MSK provisioned clusters, by Vidhi Taneja, Anusha Dasarakothapalli, and Masudur Rahaman "Sayem" "Today, we are announcing broker removal capability for Amazon Managed Streaming for Apache Kafka (Amazon MSK) provisioned clusters, which lets you remove multiple brokers from your provisioned clusters. You can now reduce your cluster’s storage and compute capacity by removing sets of brokers, with no availability impact, data durability risk, or disruption to your data streaming applications. Amazon MSK is a fully managed Apache Kafka service that makes it easy for developers to build and run highly available, secure, and scalable streaming applications. Administrators can optimize the costs of their Amazon MSK clusters by reducing broker count and adapting the cluster capacity to the changes in the streaming data demand, without affecting their clusters’ performance, availability, or data durability." #AWS #MSK
Safely remove Kafka brokers from Amazon MSK provisioned clusters | Amazon Web Services
aws.amazon.com
To view or add a comment, sign in
-
I often hear from customers that minimizing risk is the #1 priority for large scale IT migration/modernization projects. This is exactly where Amazon excels with its bold approach at a scale which is unparalleled. Here's an impressive example from Amazon retail where the teams migrated PB scale Oracle BI applications, followed by iteratively improving the infrastructure at exabyte scale migration from Apache Spark to Ray. Read more about this remarkable exabyte-scale migration from Apache Spark to Ray on Amazon EC2: https://lnkd.in/egGX_uzg
Amazon’s Exabyte-Scale Migration from Apache Spark to Ray on Amazon EC2 | Amazon Web Services
aws.amazon.com
To view or add a comment, sign in
-
Organizations must now stay on top of updates not only to access the newest features and security patches but also to avoid substantial surcharges 💸 With Amazon Web Services (AWS) now charging six times more for clusters running #Kubernetes versions in extended support, the financial impact of neglecting updates can be significant. This next blog post by Udi Hofesh aims to guide you through the new pricing policy, illustrate potential cost implications with hypothetical scenarios, and offer strategies to manage and optimize your #K8s clusters effectively. Give it a read 👇
Avoiding Hidden AWS EKS Costs: A Guide to Cluster Management
https://komodor.com
To view or add a comment, sign in
-
Valkey 8.0神速問世!Check it out!! up to 5x faster than Valkey 7.2, with microsecond read latency. With node-based ElastiCache, you can benefit from improved memory efficiency, with 32 bytes less memory per key compared to ElastiCache version 7.2 for Valkey and ElastiCache for Redis OSS. AWS has made significant contributions to open source Valkey in the areas of performance, scalability, and memory optimizations, and we are bringing these benefits into ElastiCache version 8.0 for Valkey. ElastiCache version 8.0 for Valkey is now available in all AWS regions.
Amazon ElastiCache added support for Valkey 8.0, marking another significant pre:invent launch. This update brings a notable enhancement to the Serverless feature, enabling it to scale at an impressive rate. Users can now experience a remarkable scaling capability, with the ability to ramp up from zero to an astounding 5 million transactions per second (TPS) in a matter of minutes. This advancement in ElastiCache's performance and scalability underscores Amazon's commitment to providing cutting-edge, high-performance caching solutions for its customers. https://lnkd.in/guKtUuZQ Checkout more details in the blog authored by Abhay Saxena & Rashim Gupta - https://lnkd.in/gYxGB2GX #AWS #Valkey #InMemoryDB #NoSQL
Amazon ElastiCache version 8.0 for Valkey brings faster scaling and improved memory efficiency - AWS
aws.amazon.com
To view or add a comment, sign in
-
Exciting news! Check out our latest blog post on safely removing Kafka brokers from Amazon MSK provisioned clusters. Make Kafka easy with Amazon MSK!! https://lnkd.in/g73JdD3H #AWS #Kafka #MSK #realtime
Safely remove Kafka brokers from Amazon MSK provisioned clusters | Amazon Web Services
aws.amazon.com
To view or add a comment, sign in
-
AWS announced Apache Flink is now available on Amazon EMR on EKS. Apache Flink is a data processing framework that handles streaming and batch workloads, commonly used for real-time streaming. #aws #awscloud #cloud #amazonelastickubernetesservice #amazonemr #amazonemroneks #analytics #compute #containers #intermediate200 #technicalhowto
Introducing Amazon EMR on EKS with Apache Flink: A scalable, reliable, and efficient data processing platform
aws.amazon.com
To view or add a comment, sign in
-
Running EKS? Good luck with your AWS bill in April 2024 "Amazon EKS clusters running on a Kubernetes version in the extended support window will be charged a total of $0.60 per cluster per hour, effective from the April 2024 billing cycle (starting April 1, 2024). Pricing for clusters running Kubernetes versions in standard support is unchanged — you will continue to pay $0.10 per cluster per hour." https://lnkd.in/eg5i2Z99 Upgrade hell for everyone. Go back to AWS-ECS, 90% of you really don't have a need for Kube. The Logmaster had warned you about using EKS for a few years and NOBODY listened......LoL
Amazon EKS extended support for Kubernetes versions pricing | Amazon Web Services
aws.amazon.com
To view or add a comment, sign in
-
The caching landscape just got better! Amazon #ElastiCache for #Valkey! Highlights: ElastiCache Serverless for Valkey is priced 33% lower and node-based pricing is 20% lower than other supported engines. Valkey is an open-source project stewarded by the Linux Foundation, rapidly adopted by over 40 companies since its inception in March 2024. ElastiCache Serverless for Valkey offers a minimum data storage of 100MB, 90% lower than ElastiCache Serverless for Redis OSS. Existing ElastiCache for Redis OSS customers can upgrade to ElastiCache for Valkey with zero downtime and retain their reserved node discounts. https://lnkd.in/eJ2QGCqs #BuildOn #AWS
Announcing Amazon ElastiCache for Valkey - AWS
aws.amazon.com
To view or add a comment, sign in