Observability Engineering Community’s Post

🎉 Synthesis and Scoped Logging in the AWS CDK! A new video! 🎉 If you're interested in learning how CDK synthesis works, check out this video. I use scoped logging to demonstrate how Synthesis generates CloudFormation templates including: - Aspects! - CfnElement cloudformation generation! - CfnResource property processing! - Token resolution! - Post-resolve tokens! - Integrating Scoped Logging with AWS Lamba! - How logging objects are stored and shared in the construct tree! - Log levels! https://lnkd.in/gG5T6GjD

Solving CloudWatch Metric Issues from Stack Overflow 💡 I came across an interesting question on Stack Overflow recently. Someone was trying to set up CloudWatch alarms for their ECS tasks, specifically to monitor DesiredTaskCount and RunningTaskCount. However, they kept running into “Insufficient Data” issues. Here’s the catch: the AWS/ECS namespace only provides two default metrics: • MemoryUtilization • CPUUtilization If you’re looking for task-level metrics like DesiredTaskCount, RunningTaskCount, or PendingTaskCount, these are actually found in the ECS/ContainerInsights namespace. This namespace is part of Container Insights, which gives much deeper insights into your ECS services. My Advice: Always manually check the CloudWatch console for the correct namespace and metric names before writing your code. It’s a simple step, but it can save you a lot of time and prevent these kinds of headaches. Have you encountered similar issues with CloudWatch metrics? Let’s discuss your experiences or tips in the comments! 👇 #AWS #CloudWatch #ECS #DevOps #CloudComputing #Monitoring #AWSCommunityBuilders #StackOverFlow

🚀 Thrilled to share my latest review on AWS Lambda with PeerSpot! 🚀 In this review, I explore how AWS Lambda has become an essential tool for our real-time data, media, and file processing needs. Its event-driven architecture has been instrumental in allowing us to process user-uploaded content, such as filtering, resizing, and applying effects to media files with minimal latency. Lambda's ability to automatically scale to meet demand has also enabled us to handle spikes in traffic seamlessly and cost-effectively. AWS Lambda has significantly improved our operations, driving cost savings and resource efficiency through its pay-per-use pricing model and eliminating the need for managing servers. This has freed our team to focus on strategic tasks, enhancing agility and scalability in response to changing workloads. While AWS Lambda offers many advantages, such as automatic scaling and event-driven architecture, there are areas for improvement. The 15-minute execution timeout is restrictive for long-running tasks, and cold start latency can impact performance, particularly for infrequent invocations. It would be great to see more flexible execution environments and reduced cold start latency in future updates. Thanks to PeerSpot for the opportunity to share these insights! 👉 Check out my full review here: https://lnkd.in/dZBufEWA #AWS #Lambda #Serverless #CloudComputing #RealTimeProcessing #DevOps #TechReview #PeerSpot #CloudArchitecture #Innovation #MediaProcessing #Scalability

🚀The State of Kubernetes Efficiency: An Insider’s Look is OUT 🚀 This report analyzes the significant data collected, providing insights into cost optimization and performance metrics. In reviewing the trends throughout our user base, and their environments, we have uncovered many interesting, and shocking, statistics. To highlight a few: - Node-Autoscalers solution trends are changing, with Cluster Autoscaler found in only 17% of clusters, while Karpetner is found in 75% of AWS-based clusters - Over 50% of every dollar spent on Kubernetes is waste due to over-provisioning - Yet with all these additional resources, over 25% of workloads are at risk of performance issues caused by under-provisioning or misconfigurations. Download the report now! https://lnkd.in/dvfgqyZg #k8s #kubernetes #sre #aws #devops

We've had buckets of announcements this week, and I'm sure lots of you have eleven 9's of excitement about this one! 🪣✨ AWS has expanded S3 bucket scaling in a big way - here's what you need to know: S3 Bucket Scaling: What's New • Default quota now 10,000 buckets per account • Request increase up to 1 million buckets • Applied to all AWS Regions • No action needed for default increase Practical Benefits for Developers • Create buckets for individual datasets • Implement granular security policies • Enable default encryption per bucket • Use S3 Replication more easily Optimize Your S3 Architecture • Separate concerns with dedicated buckets • Improve data isolation and management • Remove barriers to scaling • Enhance overall storage architecture Cost and Scaling Considerations • First 2,000 buckets at no cost • Small monthly fee for buckets beyond 2,000 • Use Service Quotas for limit increases • New default applies to all AWS accounts Read all about it: https://lnkd.in/e2BPCnpy Could this S3 update solve any challenges in your current projects? Tell me all about it in the comments below 👇 👩🏻💻 Follow me (Brooke Jamieson) for the latest AWS + AI updates. 📍 save + share! #AWS #AmazonS3 #CloudStorage #CloudComputing

Do you know guys about AWS every year Release survey where you can see how many people use which services and which one is trending. isn't it cool? let's see in the video. #aws #survey #2024 #awscommunity #cicd #lambda #etl #devops #ec2 #s3 #glue #redshift #sam #serverless #infrastructure #iam #genai #Dataengineer #Datascientist #cloudenginner

Exciting S3 announcements to scale your storage architecture.

What a great tool Datadog has released for detection engineering - it just works! Try it out: $ export AWS_REGION=us-east-1 $ grimoire shell -c "aws s3 ls" -o /tmp/logs When you see "Found event", press Ctrl+C. $ cat /tmp/logs Profit! #detectionengineering #Grimoire

Optimizing AWS Step Functions: A Case Study on Reducing Latency and Cost Preview: In the world of software engineering, scalability and efficiency are paramount. One of the challenges I faced in my recent project was managing a rapidly growing user base and the associated AWS Step Functions events. This blog post details my journey in optimizing our system, reducing latency, and cutting costs. I'll also explain how I utilized AWS Database Migration Service (DMS) and Kinesis to ensure real-time event processing. Key Highlights: Reduced event count by 3000% Significant cost savings Implementation of a scalable, loosely coupled system To read more about the detailed implementation and lessons learned, read the full post on Medium.

New AWS Tutorial I've just published a quick tutorial attempt on AWS Systems Manager Parameter Store! comment improvements if any. This video covers how to securely manage configuration data and sensitive information, helping you keep deployments safe and efficient. In this tutorial, you’ll learn: - How to create and organize parameters in AWS SSM Parameter Store - Different parameter types: String, StringList, and SecureString - Using AWS KMS for encryption to protect sensitive data - Retrieving parameters with AWS CLI, SDKs, and CloudFormation templates If you're looking to improve configuration management or secure sensitive data on AWS, this video is for you! Watch here: https://lnkd.in/gCVpvnyb #AWS #CloudComputing #AWSTutorial #SystemsManager #ParameterStore #CloudSecurity #InfrastructureAsCode #DevOps #CloudConfiguration #AWSCLI #KMS #SecureString