Bryan Liles

With AWS Machine Learning capabilities now easily accessible, individuals can build cutting-edge models that deliver real value with minimal effort. However, once you’ve proven a small use case, how do you scale and operationalize your models for enterprise use? To take a project from concept to production-ready, organizations need to incorporate enterprise-grade functionality—like tracking code changes, enforcing security standards, and ensuring policy and governance compliance. Using Terraform to build and manage the lifecycle of an ML/AI platform on AWS provides a scalable approach to address these requirements. Terraform can help orchestrate your infrastructure, ensuring your ML models are production-ready and enterprise-compliant. #MachineLearning #AWS #Terraform #AIOps #DevOps #CloudInnovation

5

A really nice read from Sai Maddali on the benefits of Tiered Storage with Amazon MSK. https://lnkd.in/gGNJ5nyt #ApacheKafka #Kafka #AWS #MSK #tieredstorage #streaming #storage

55

2 Comments

Slightly old, but still gold and very relevant from meshIQ Deployments of new, containerized versions of applications and integration technologies such as Messaging and Event Streaming, are increasing yearly. Kubernetes, the leading platform for container orchestration, has become ubiquitous. In this rapidly evolving context, the meshIQ observability platform is needed more than ever to deliver governance, introspection, and actionable intelligence for integration infrastructure deployments in hybrid cloud environments. https://lnkd.in/di4mkNBU

13

The best part about the new Llama 3.1 family of models is that you can fine tune them on AWS Trainium chips. These are more energy and cost efficient chips and with great performance purpose built for the training and fine tuning tasks. #aws #Llama3.1 #sagemakerjumpstart https://lnkd.in/d6S5Gdae

25

1 Comment

Amazon RDS Extended Support APIs are now available After the RDS end of standard support date has passed, you can prevent the creation of a new DB instance or a new Multi-AZ DB cluster and avoid RDS Extended Support charges. In the AWS CLI, specify open-source-rds-extended-support-disabled for the --engine-lifecycle-support option.   https://lnkd.in/gi_uX9xZ #Amazon #RDS #PostgreSQL #MySQL #Aurora

67

Simple way to create an EKS Cluster in AWS cli https://hubs.la/Q02s3Bv-0 #eks #kubernetes #k8s #aws #sre

2

Are you using #Memcached? With Amazon ElastiCache Serverless for Memcached, customers benefit from the simplicity and elasticity of serverless, the highly-availability 99.99% SLA, and AWS's high bar of security and operational excellence. We now also added backup and restore to ElastiCache Serverless for Memcached! Amazon ElastiCache helps hundreds of thousands of customers boost their applications' performance, achieve higher scale, and optimize their cost. Now you can do even more, with the serverless Memcached API. Try it out! https://lnkd.in/gPsR_QCi #aws #awscloud #elasticache #memcached #serverless #inmemory

52

1 Comment

KubeCon 2024 highlights the powerful synergy between Kubernetes and machine learning, showcasing how these technologies are driving innovation in cloud-native environments. From simplifying ML workflows to enhancing scalability and efficiency, Kubernetes is becoming a cornerstone for deploying and managing AI applications. As organizations increasingly adopt machine learning, Kubernetes offers the tools needed to streamline complex processes and accelerate innovation, setting a new standard for AI-driven cloud solutions. Read more from Silicon Angle here => https://tulle.cc/5f6999 #Kubernetes #MachineLearning #AI #CloudNative #KubeCon #TechInnovation #Automation #Scalability #FutureOfTech

6

The #AWS Summit in New York City was the scene for a multitude of AWS announcements -- Amazon Q Developer updates, a plethora of new features for Amazon Bedrock, Amazon Q Apps, AWS App Studio, Vector search for Amazon MemoryDB, and new power for AWS Glue Studio. Read this post to learn more and to access detailed posts for each launch: https://lnkd.in/g-W9a6-R

486

6 Comments

🌟 New AWS Cost Management Feature for DynamoDB Reserved Capacity 🌟 AWS Cost Explorer now provides purchase recommendations for Amazon DynamoDB reserved capacity, helping organizations save up to 77% on provisioned capacity costs! 💰 This new feature enables smart purchasing decisions, allowing you to optimize your DynamoDB costs efficiently. With this update, AWS offers reserved capacity recommendations across 7 services, including EC2, RDS, and DynamoDB. #AWS #DynamoDB #CostManagement #FinOps #CloudOptimization #CloudComputing https://lnkd.in/d3BuhByd

5

Amazon Managed Service for Apache Flink now supports Amazon DynamoDB Streams as a source! The new connector, contributed by #AWS for the #ApacheFlink #opensource project, adds Amazon #DynamoDB Streams as a new source for Apache Flink. You can now process DynamoDB streams events with Apache Flink, a popular framework and engine for processing and analyzing #streamingdata. https://lnkd.in/gDFsiXA2

17

#Amazon #OpenSearch Ingestion now allows you to ingest streaming data from Amazon Managed Streaming for Apache Kafka (#MSK) Serverless, enabling you to seamlessly index the data from Amazon MSK Serverless clusters in Amazon OpenSearch Service managed clusters or #Serverless collections without the need for any third-party data connectors. #ApacheKafka #streamingdata #datastreaming #data https://lnkd.in/gdDJED6V

19

Big news for serverless and event-driven architecture enthusiasts! 🚀 AWS has just announced the general availability of Provisioned Mode for AWS Lambda Event Source Mappings (ESMs) that subscribe to Apache Kafka event sources. This is a game-changer for building high-performance, scalable Kafka applications with Lambda. Key highlights: • Optimize ESM throughput by provisioning event polling resources • Control minimum and maximum number of event pollers (1-2000 range) • Responsive auto-scaling to handle sudden traffic spikes • Simplified networking experience - no need for PrivateLink or NAT Gateway • Improved performance - up to 70% faster message processing in test cases Whether you're working with Amazon MSK, self-managed Kafka, or other Kafka-compatible platforms, this new feature allows you to fine-tune your event processing for performance-sensitive workloads. The blog post provides a detailed walkthrough of activating Provisioned Mode, performance comparisons, and best practices. It's a must-read for anyone looking to enhance their serverless Kafka applications! https://lnkd.in/gDsVSdXJ #AWS #Serverless #ApacheKafka #EventDrivenArchitecture #CloudComputing

19

My newest blog post describes how we still work to improve the performance, security, and internal efficiency of the very first #AWS service: "Optimizing Amazon Simple Queue Service (SQS) for speed and scale" - https://lnkd.in/gjjk76Bn

257

5 Comments

Amazon RDS for PostgreSQL announces Extended Support minor 11.22-RDS.20240418 We recommend that you upgrade to this version to fix known security vulnerabilities and bugs in prior versions of PostgreSQL 11 https://lnkd.in/eF2ixv9f #Amazon #RDS #PostgreSQL

38

When working with Amazon MSK, developers are interested in accessing the service locally. This allows developers to test their application with a Kafka cluster that has the same configuration as production and provides an identical infrastructure to the actual environment without needing to run Kafka locally. This post presents a practical approach to accessing your Amazon MSK environment for development purposes through a bastion host using a Secure Shell (SSH) tunnel (a commonly used secure connection method). Whether you’re working with Amazon MSK Serverless, where public access is unavailable, or with provisioned MSK clusters that are intentionally kept private, this post guides you through the steps to establish a secure connection and seamlessly integrate your local development environment with your MSK resources. https://lnkd.in/g4yiF3yH #MSK #serverless #ApacheKafka #testing

30