Elliott Cordo’s Post

🚀 Excited to share our latest blog on SoAL(Spark on AWS Lambda) building a serverless data quality pipeline using Deequ on AWS Lambda! 🛠️ A big shoutout to our team Vivek Mittal and Uma Ramadoss contribution to SoAL. With request from SoAL customers, the new release has significantly reduced initialization time—now down to ~550 ms! ⚡ This optimization is a game-changer for anyone looking to streamline their data processing and data quality checks with minimal latency. 💰 With this setup, you can run your workloads at just 2 to 10 cents per spark workload, making it not only fast but also incredibly cost-effective. Check out the full blog post here: https://lnkd.in/gScvKfM7 #AWS #DataQuality #Serverless #Lambda #Deequ #BigData #CostEfficiency #Innovation #TeamWork

Our latest blog post unpacks how Data Mesh can transform your organization's data into valuable products owned by individual teams. No more drowning in a data swamp! Discover how we're turning theory into reality with AWS, navigating the practicalities and challenges of building a Data Mesh using AWS Lake Formation. Check out 👉 https://lnkd.in/dfaXqKzC #iolap #datamesh #aws #awslakeformation #datainovation

Hello Connections 🙂, I am excited to share that Inferenz has just published my latest blog on Medium that dives deep into Amazon Web Services (AWS) Serverless Data Lake Framework. Read the full blog here👇🏻: https://lnkd.in/ddfizuVU I invite you to read the blog, hit the like button, share your thoughts in the comments, and don't forget to share it with your friends and colleagues! #aws #dataengineering #serverless #DataLake #MediumBlog #technology #inferenz #datawarehousing

Excited to see the team's work in action! Check out a serverless data quality pipeline example using Deequ on AWS Lambda - scalable, real-time data quality checks with AWS Step Functions! 🚀 #AWS #Serverless #DataQuality #Deequ #Lambda #StepFunctions

🚀 Exciting news! I recently co-authored AWS Blog with John Cherian and Uma Ramadoss on building a serverless data quality pipeline using Deequ on AWS Lambda. Our post showcases a cost-effective💰 and performant⚡ solution for customers to run their data quality pipeline using AWS Lambda and AWS Step Functions. This solution will be particularly helpful for customers who have datasets with several smaller sized files and require faster startup times. I'm thrilled to share this innovative solution and hope it benefits data teams in enhancing the reliability of their data analytics pipelines. Read the full blog post here: https://lnkd.in/djgQuwHk #AWS #DataQuality #Serverless #Lambda #Deequ #BigData #CostEfficiency #Innovation #TeamWork #AWSBlog #Spark #StepFunctions

It’s easy to register Delta tables in the AWS Glue Data Catalog and query them from various data tools in the AWS ecosystem.

How can you implement a data lake approach with minimal effort? Check out this Amazon Web Services (AWS) article by Vishal Singh, Starburst's Head of Data Products, and Antony Prasad Thevaraj, AWS Senior Partner Solutions Architect, about how Starburst Data Products can accelerate time to insight and enhance efficiency within a data lake platform: https://okt.to/GOh9mx #dataproducts #aws #awspartners

Delve into the streamlined process of registering Delta tables in the AWS Glue Data Catalog, enabling seamless queries with Amazon Athena, Amazon Redshift, and Amazon EMR! In this blog, discover the key benefits of integrating Delta tables into #AWS Glue for your data workflows and learn about the advantages of Delta Lake tables. Enhance your data architecture with Delta Lake and AWS 👉 https://lnkd.in/g4MPM2wm #deltalake #opensource #oss #linuxfoundation

How can you implement a data lake approach with minimal effort? Check out this Amazon Web Services (AWS) article by Vishal Singh, Starburst's Head of Data Products, and Antony Prasad Thevaraj, AWS Senior Partner Solutions Architect, about how Starburst Data Products can accelerate time to insight and enhance efficiency within a data lake platform: https://okt.to/X8RBbO #dataproducts #aws #awspartners