Skip to content

Add Apache Fluss to Factor House Local #19

@jaehyeon-kim

Description

@jaehyeon-kim

The Goal:

To integrate Apache Fluss, an incubating, real-time streaming storage system, into the factorhouse-local project.

The "Why":

The factorhouse-local project already provides a "Real-Time Stream Analytics" stack with Apache Flink. Adding Apache Fluss will enhance this by:

  • Introducing a Modern Storage Layer: Demonstrates a next-generation streaming storage solution designed for Lakehouse architectures.
  • Simplifying the Stack: Showcases how Fluss and Flink can create a unified, high-performance pipeline, potentially reducing the need for separate messaging and OLAP systems.
  • Enabling New Use Cases: Allows users to easily build and test high-throughput, low-latency streaming data warehouses.

The "How":

  1. Create a new Docker Compose stack within factorhouse-local.
  2. This stack will include Apache Fluss, configured to work with the existing Apache Flink service.
  3. Add a simple example to demonstrate a Flink job reading from and writing to Fluss.

Outcome:

This addition will provide a ready-to-use environment for users to explore the powerful combination of Apache Flink and Apache Fluss for real-time analytics.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions