Apache Flink®

Stateful Computations over Data Streams

Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and bounded data streams. Flink has been designed to run in all common cluster environments, perform computations at in-memory speed and at any scale.

Flink Capabilities
Correctness guarantees

Exactly-once state consistency

Event-time processing

Sophisticated late data handling

Layered APIs

SQL on Stream & Batch Data

DataStream API & DataSet API

ProcessFunction (Time & State)

Operational focus

Flexible deployment

High-availability setup

Savepoints

Scalability

Scale-out architecture

Support for very large state

Incremental Checkpoints

Performance

Low latency

High throughput

In-Memory computing

Use Cases
Event Driven Applications

An event-driven application is a stateful application that ingests events from one or more event streams and reacts to incoming events by triggering computations, state updates, or external actions.

Stream & Batch Analytics

Analytical jobs extract information and insight from raw data. Apache Flink supports traditional batch queries on bounded data sets and real-time, continuous queries from unbounded, live data streams.

Data Pipelines & ETL

Extract-transform-load (ETL) is a common approach to convert and move data between storage systems.

Recent Flink blogs
Apache Flink CDC 3.2.0 Release Announcement

September 5, 2024 - Xiqian Yu. Qingsheng Ren.

The Apache Flink Community is excited to announce the release of Flink CDC 3.2.0! This release aims to improve usability and stability of existing features, including transform and schema evolution. …

Continue reading
Announcing the Release of Apache Flink 1.20

August 2, 2024 - Weijie Guo. Rui Fan.

The Apache Flink PMC is pleased to announce the release of Apache Flink 1.20.0. As usual, we are looking at a packed release with a wide variety of improvements and new features. Overall, 142 people …

Continue reading
Apache Flink Kubernetes Operator 1.9.0 Release Announcement

July 2, 2024 - Gyula Fora. Mate Czagany.

The Apache Flink community is excited to announce the release of Flink Kubernetes Operator 1.9.0! The release includes many improvements to the autoscaler and standalone autoscaler, as well as memory …

Continue reading