Hilliary Lipsig

Well done #AWS for promptly fixing an S3 billing edge-case! Interesting S3 cost issue in this blog: "How an empty S3 bucket can make your AWS bill explode". In brief: external unauthorised (denied) requests to a new empty S3 bucket were being charged - $1,300 within two days. The author had inadvertently chosen the same bucket name that was the placeholder default configuration in a popular open-source tool!    https://lnkd.in/eNEqedR8 That blog was published on 29th April 2024. On 13th May, AWS fixed this problem: "Amazon S3 will no longer charge for several HTTP error codes". https://lnkd.in/eMXuhhu8 To quote that announcement: "bucket owners will never incur request or bandwidth charges for requests that return an HTTP 403 (Access Denied) error response if initiated from outside their individual AWS account or AWS Organization."

6

🚀 Exciting news in the Rust and AWS communities! 🚀 On June 8th, Werner Vogels announced **distill CLI**, an efficient, Rust-powered tool for media summarization. 📜🔧 Check out his blog for more details: [Introducing Distill CLI](https://lnkd.in/dfUT4cmf) Notably, companies like Discord and Figma have achieved remarkable performance improvements by adopting Rust. Discord moved their Read States service from Go to Rust, resulting in a 10x speed increase and nearly 100x reduction in worst tail latencies. Similarly, Figma rewrote performance-sensitive parts of their multiplayer service in Rust, seeing a 6x reduction in peak average CPU usage per machine. 🌟💪 AWS is also embracing Rust with the general availability of Cargo support in CodeArtifact, enabling the storage of Rust libraries (crates) in CodeArtifact. 📦✨ More info: [AWS CodeArtifact and Cargo Support](https://lnkd.in/dYY_fgtU) As more customers leverage Rust for their critical workloads, AWS is providing robust building blocks. AWS Lambda, for instance, can now process HTTP events more efficiently with Rust. 🚀⚡️ Learn more here: [Rust HTTP Events in AWS Lambda](https://lnkd.in/diubf8bM) #RustLang #AWS #Serverless #Performance #CloudComputing #Innovation #TechNews #CodeArtifact #DistillCLI

11

This is a real deal! 50% price cut on DynamoDB. 🥳 DynamoDB is one of the main tools in my toolbox, a DB that I can use to support any kind of persistance needs. More news like this AWS. 💪

3

Managing legacy systems is hard... even for AWS "S3 is showing its age": very nice article by Chris Riccomini on #AWS #S3: https://lnkd.in/e8rPiMdi Object storage is often becoming the primary storage for #data systems such as #WarpStream. AWS S3 once defines the defacto standard API for all object storages and was in the past well in advance in terms of performance/price and features. This is now over and it may become a switching factor in the near future as explained in the article. In the past they managed to overcome the atrocious "4 characters random prefix" to bucketnames that was needed to avoid hotspot scenario and bad performance, but the road ahead is challenging and the competition is real. - No Compare-and-Swap (CAS) Operations: Unlike its competitors, S3 lacks preconditions, forcing developers to use workarounds like DynamoDB. - S3 Express One Zone (S3E1Z): While promising, S3E1Z misses many standard S3 features and comes with high storage costs. - Lack of Multi-Region Buckets: S3 doesn't support dual-region or multi-region buckets, limiting its availability options.

12

ATTN: DevOpsDays Seattle attendees! Kate Goldenring's presentation 🌱 A Greener, Cost-Effective Cloud With Serverless #WebAssembly 🌱 starts in 10 minutes! Learn how Wasm may solve cold-start issues while reducing an app’s software carbon intensity: https://bit.ly/3UTO3yz

3

Want to learn how to enable your team to have more time to spend on #velocity versus frustrating operational tasks - without compromising #customerexperience while reducing the cost of your #operations? Join @ayeletsachto at DASH on June 25th where she'll share learnings from our two-year program, which reduced the cost of Google Kubernetes Engine Operations as our fleet increased without compromising the #reliability of our systems! #SRE

1

Great to see this moving forward. @elastic keeps contributing great stuff to the community. My question to the big "Dog" in observability is where are your contributions? > Elastic Contributes its Continuous Profiling Agent to OpenTelemetry https://buff.ly/4bQG5wd

14

3 Comments

This blog has been living rent free in my head for a bit. Especially as companies start feeling the belt tightening when it comes to cloud resources. Essentially the Fast, Cheap, or Good balance we faced leading up to the adoption of cloud providers. This is a nice treatment of that in terms data in the cloud. https://lnkd.in/g9GBtFJ4

2

45 days until #AWS #reinvent2024 in Las Vegas. Here is my top 10 list of the sessions I'm excited about: 1️⃣ OPN311 | Harnessing Apache ActiveMQ: ActiveMQ 6.x features and roadmap - with JB Onofré and Jules Graybill 2️⃣ ANT327 | What's new: Data streaming on AWS - with Ashish Palekarand Anusha Dasarakothapalli 3️⃣ ANT412 | Ingest streaming data into Apache Iceberg tables with AWS Streaming - with Ravikiran Rao and Amar Surjit 4️⃣ ANT324 | Accelerate value from data: Migrating from batch to steam processing - with Usama Naseem and Sofie Zilberman 5️⃣ ANT342 | Operate and scale managed Apache Kafka and Apache Flink clusters - with Sai Maddali and Ali Alemi 6️⃣ API401 | Multi-tenant Amazon SQS queues: Mitigating noisy neighbors - with Vinodh Kannan Sadayamuthu and Dirk Fröhner 7️⃣ API312 | Best practices to migrate your existing message broker to AWS - with Vinodh Kannan Sadayamuthu and Daniel Fargano 8️⃣ ANT318 | Building serverless streaming data pipelines for real-time analytics - with Mostafa Mansour and Gregory K. 9️⃣ AUT319 | Learnings from BMW's global software development platform on AWS - with Christian Mueller 🔟 FSI310 | BBVA Corporate & Investment Banking: Building a multi-region, multi-country data platform at scale - with Ignacio Fernandez and Federico Esteban What sessions have you marked as favorites? Drop the session ID in the comments. The catalog is available here:

105

3 Comments

Announced at #AWSreinvent: Cribl now supports AWS Private Image Build! 🔐 How do you ensure your telemetry pipelines stay secure and compliant? With Cribl Stream and Cribl Edge, combined with AWS Private Image Build, you can create Amazon Machine Images (AMIs) tailored to your specific requirements. This lets you build “golden” or “hardened” AMIs that meet your organization’s security and compliance standards. 💡 Learn more about the benefits: https://gag.gl/1i9d7h

1

I love to see organizations embracing "secure by design." This fresh whitepaper by Eric Johnson, Bertram Dorn, and Paul Vixie is an excellent example. This excerpt is spot-on: "Another way to think of SbD is to consider the topology of a space, such as a house. An SbD setup should have only closed, finite rooms in the configuration space (house) that do not allow access to an infinite space (outside of the house) except through well-defined and carefully controlled ingress and egress points. This absence of configuration space options facilitates added security. If you don’t make design principles accessible to builders, then they’re creating IT workloads in a secure environment." They correctly call out that SbD simplifies compliance. The only part I disagree with is this: "Some may wonder: Is speed of the essence for the product, or should you invest more in its security? The answer provided by experience is increasingly clear. Organizations that prioritize speed of execution over security are paying a heavy price." I believe this is a false tradeoff. You can make developers faster by giving them building blocks to get their job done quickly and those building blocks have SbD embedded, so you get security as a side effect. https://lnkd.in/gDACTMGm

36

6 Comments

Customers often ask if Amazon Q Developer is only for Amazon Web Services (AWS) workloads. The short answer is no. Our developer platform can add value to your on-premises development and multi-cloud needs, regardless of your platform. Our partners at Heroku have a great use case for this. Check out their blog post on how the Amazon Q Developer / Heroku integration simplifies their customer workflows.

14

Wanted to give a quick shout out to Pump.co - they’ve helped us save ~60% on our monthly AWS bill for free. They also stopped our AWS credits from expiring 😁 It took 5 minutes to onboard and they have no access to our infrastructure so it's super simple to just have it run in the background and know that we're covered. If you spend more than $1000/month on AWS - or have credits that you don't want to lose - you should definitely spend 2 minutes just running an estimate to see how much they can save you: https://lnkd.in/gbw4dwh2 It's literally free money.

32

Optimize Kubernetes Pods’ Startup Time Using VolumeSnapshots In this blog post, you will learn how we used VolumeSnapshots to significantly reduce the startup times of static data sources-based applications, specifically within AWS environments. https://lnkd.in/dkf9pjcv https://lnkd.in/dkf9pjcv

3

We asked Kubernetes expert Eddie Wassef this question: Q: "Why should you consider running your databases on Kubernetes?" A: “Why wouldn’t you run your database on Kubernetes?” Eddie explains that, similar to VMs and bare metal, Kubernetes provides a standard that allows you to focus solely on your applications without worrying about the underlying infrastructure. Whether it's networking, monitoring, resiliency, storage, or other needs, Kubernetes can offer these capabilities and more, right out of the box for your stateful systems. What's your take? Share it with us in the comments. #Kubernetes #VMs #DatabaseManagement

12

You don't need to be an IaC expert to provision your application infrastructure. See how to deliver one-click provisioning for Terraform infrastructure in this short video. #terraform #infrastructureascode #platformengineering #devops

7

Love this Product Innovation article from Amazon CTO, Werner Vogels! At Amazon we use the “Working backwards” process to begin the PRFAQ. This is a set of 5 questions around: Listen, define, invent, refine, and test and iterate.  1. Who is the customer and what insights do we have about them? 2. What is the prevailing customer problem/ opportunity ? What data informed this? 3. What is the solution? Why is it the right solution to address the customer's needs versus other alternatives? 4. How would we describe the end-end customer experience? What is the most important customer benefit?  5. How will we define and measure success? #innovation, #culture, #datadriven, #longtermthinking, #experimentation, #prfaq, #customerobsession

1