Building Data Platformsand Analytics Infrastructure

Data flow

1. 01

   Ingestion

   Land reliable batch and API data into durable tables.

   • dlt
2. 02

   Streaming

   Move events continuously for low-latency analytics.

   • RisingWave
   • Apache Fluss
3. 03

   Table Formats & Catalogs

   Organize durable, governed Iceberg tables and catalogs.

   • Apache Iceberg
   • Apache Polaris
4. 04

   Transformation

   Model trusted datasets with checked SQL transformations.

   • dbt
   • SQL
   • rocky
5. 05

   Query Engines

   Execute analytical workloads across warehouses and local engines.

   • DuckDB
   • Apache DataFusion
   • Polars
   • Oxigraph
   • Nemo
6. 06

   Semantic Layer

   Define reusable domain meaning for metrics and entities.

   • SLayer
   • Apache Ossie