-
Notifications
You must be signed in to change notification settings - Fork 5
Open
Labels
enhancementNew feature or requestNew feature or request
Description
The Goal:
To integrate Apache Fluss, an incubating, real-time streaming storage system, into the factorhouse-local project.
The "Why":
The factorhouse-local project already provides a "Real-Time Stream Analytics" stack with Apache Flink. Adding Apache Fluss will enhance this by:
- Introducing a Modern Storage Layer: Demonstrates a next-generation streaming storage solution designed for Lakehouse architectures.
- Simplifying the Stack: Showcases how Fluss and Flink can create a unified, high-performance pipeline, potentially reducing the need for separate messaging and OLAP systems.
- Enabling New Use Cases: Allows users to easily build and test high-throughput, low-latency streaming data warehouses.
The "How":
- Create a new Docker Compose stack within
factorhouse-local. - This stack will include Apache Fluss, configured to work with the existing Apache Flink service.
- Add a simple example to demonstrate a Flink job reading from and writing to Fluss.
Outcome:
This addition will provide a ready-to-use environment for users to explore the powerful combination of Apache Flink and Apache Fluss for real-time analytics.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request