Brandan Sheridan’s Post

Amazon announced mw1.micro, a new cost-effective MWAA environment for running lightweight Airflow. The post explores mw1.micros features, benefits, use cases, and how to set up the new environment. #aws #awscloud #cloud #amazonmanagedworkflowsforapacheairflowamazonmwaa #announcements

What an incredible two days at #KafkaSummit London! For those who couldn’t make it, here is a quick summary of Confluent’s announcements: - Fully managed cloud-native #ApacheFlink now available across AWS, Google Cloud, and Microsoft Azure! Easily build high-quality, reusable data streams to power real-time applications and analytics, read more here: https://lnkd.in/dkhS5BWr - Introducing TableFlow, our Tableflow feature helps users easily convert Apache Kafka topics, associated schemas and metadata to #ApacheIceberg tables in one click to feed analytics engines, data warehouses, and data lakes, read more in first comment  - Enhancements to Confluent Cloud like enhanced cost-savings around through-put, our new Enterprise Clusters and enhanced Fully Managed Connectors now available using PrivateLink networking #Kafka #Flink #Iceberg #DataStreaming

The latest update for #Aiven includes "The Coexistence of #OpenSource and Proprietary Software: Striking the Balance" and "Helping Enterprises Make Sense of #Sustainability in an Ocean of Engineering Data". #DevOps #Cloud #Kafka https://lnkd.in/dNPm2fYJ

🎤⬇️ Q2 '24 launch for Confluent Cloud is here, and you can learn all about it on our blog Lots to be excited about

"When to Choose #ApacheKafka vs. Azure #EventHubs vs. #Confluent Cloud for a Microsoft Fabric #Lakehouse" Choosing between Apache #Kafka, #Azure Event Hubs, and Confluent #Cloud for data streaming is critical when building a #MicrosoftFabric Lakehouse. #ApacheKafka offers scalability and flexibility but requires self-management and additional features for security and governance. #Azure #EventHubs provides a fully managed service with tight Azure integration but has limitations in Kafka compatibility, scalability, and advanced features. #ConfluentCloud delivers a complete, managed data streaming platform for analytical and transactional scenarios with enterprise features like multi-cloud support and disaster recovery. Each option caters to different needs, and this blog post will guide you in selecting the right data streaming solution for your use case: https://lnkd.in/epNeNddG

Some really exciting announcements in our Q2 '24 launch for Confluent Cloud. Highlights for me are: - Interactive Tables for Flink SQL Workspaces - Flink Private Networking Support for AWS - Making Enterprise Clusters Even More Elastic - Connect with Confluent: Further extending the data streaming ecosystem with 7 new integrations You can learn all about it on our blog!

Last week, we announced our partnership with Ververica | Original creators of Apache Flink®, the company founded by the original creators of Apache Flink, and introduced Ververica’s VERA engine to StreamNative’s BYOC clusters via the Managed Flink service in StreamNative Cloud. This collaboration is built on a framework we call BYOC², which stands for "Bring Your Own Compute" and "Bring Your Own Cloud". Your data remains in your own bucket, and you bring your own engine to process it—all within your cloud account, with a fully managed experience. 🖥️ Bring Your Own Compute: While data streaming is highly valuable, it can also be extremely expensive to run, especially due to networking costs. Setting up a stream processing engine like #ApacheFlink requires expertise and careful design to keep network configuration and expenses under control. The concept of “Bring Your Own Compute” or “Bring Vendor’s Compute” brings data processing capabilities closer to where the data resides, eliminating inter-account or inter-zone traffic and reducing costs. ☁️ Bring Your Own Cloud: While BYO-Cloud has become increasingly popular, we’ve seen debates about which approach to BYO-Cloud is best. In our view, whether it's BYO-Cloud, Fully Hosted (Dedicated or Serverless), or self-managed in a Private Cloud, what organizations really need is a Portable Data Plane. This allows them to choose the deployment option that best suits their needs (balancing data sovereignty, a fully managed experience, and cost) while maintaining the flexibility to switch between options. A Portable Data Plane is portable across different environments and atomic, meaning it has no external dependencies. The unavailability of any other data plane or centralized control plane should not affect the applications interacting with it. We built our Portable Data Plane using open standards, leveraging Terraform for infrastructure provisioning and Kubernetes for workload management. Everything is self-auditable with no need for closed-source agents, so you don't have to blindly trust the vendor's promises. With BYOC², your Kafka or Pulsar data stays in your cloud, while Flink jobs run in your own VPC. You maintain ownership of your data, avoid high networking costs, and still enjoy a fully managed experience. We believe BYOC² represents a complete approach to data sovereignty throughout the entire data lifecycle, offering a more cost-effective solution. We’re not alone in this vision. Our partnership with Ververica exemplifies the BYOC² model, and we’re excited to collaborate with other stream processing engine vendors to provide the best tools for our customers. The future looks promising under the BYOC² framework, offering a straightforward, portable, and sovereign cloud experience. Check out our blog post to learn more: https://lnkd.in/gbNV8Q5K

Catch up on the latest and greatest in Confluent Cloud! Head to our blog to check out the updates & enhancements we've made and see what’s new in our partner ecosystem!

Catch up on the latest and greatest in Confluent Cloud! Head to our blog to check out the updates & enhancements we've made and see what’s new in our partner ecosystem!

Catch up on the latest and greatest in Confluent Cloud! Head to our blog to check out the updates & enhancements we've made and see what’s new in our partner ecosystem!