CS Knowledge Base

#

streaming-data

Here are 677 public repositories matching this topic...

oxnr / awesome-bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

data-science data awesome database data-stream bigdata series-database data-visualization data-warehouse stream-processing data-analytics awesome-list distributed-database visualize-data streaming-data

Updated Jul 31, 2026

kafka-ui

provectus / kafka-ui

Open-Source Web UI for Apache Kafka Management

opensource kafka big-data web-ui streams kafka-connect apache-kafka kafka-producer kafka-client kafka-streams hacktoberfest streaming-data kafka-manager kafka-cluster event-streaming cluster-management kafka-ui kafka-brokers

Updated Jul 26, 2024
Java

miller

johnkerl / miller

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

Updated Oct 15, 2026
Go

connect

redpanda-data / connect

Fancy stream processing made operationally mundane

go golang kafka cqrs etl rabbitmq amqp logs message-bus event-sourcing nats stream-processing message-queue data-engineering streaming-data stream-processor data-ops

Updated Oct 16, 2026
Go

materialize

MaterializeInc / materialize

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

mysql rust distributed-systems streaming sql sql-server database kafka postgresql data-store stream-processing cdc streaming-data materialized-view data-mesh postgresql-dialect operational-data-store

Updated Oct 16, 2026
Rust

river

online-ml / river

🌊 Online machine learning in Python

python data-science machine-learning streaming stream-processing online-learning streaming-data concept-drift real-time-processing incremental-learning online-machine-learning online-statistics

Updated Oct 16, 2026
Python

readysettech / readyset

Readyset is a MySQL and Postgres wire-compatible caching layer that sits in front of existing databases to speed up queries and horizontally scale read throughput. Under the hood, ReadySet caches the results of cached select statements and incrementally updates these results over time as the underlying data changes.

mysql rust caching postgres sql backend cache postgresql databases rust-lang mysql-database postgresql-database streaming-data caching-proxy

Updated Oct 15, 2026
Rust

fluvio

fluvio-community / fluvio

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

rust distributed-systems streaming real-time serverless webassembly data-flow stream-processing data-analytics data-integration cloud-native data-pipelines stateful streaming-data stream-processing-engine event-driven-architecture streaming-analytics streaming-data-processing streaming-data-pipelines

Updated Oct 13, 2026
Rust

piskvorky / smart_open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

python streaming s3 file hdfs hacktoberfest webhdfs boto gzip-stream bz2 streaming-data

Updated Oct 12, 2026
Python

kafka-ui

kafbat / kafka-ui

Open-Source Web UI for managing Apache Kafka clusters

opensource kafka big-data foss web-ui streams kafka-connect apache-kafka kafka-producer kafka-client kafka-streams hacktoberfest streaming-data kafka-manager kafka-cluster event-streaming cluster-management kafka-ui kafka-brokers

Updated Oct 5, 2026
TypeScript

go-streams

reugn / go-streams

A lightweight stream processing library for Go

Updated Jan 14, 2026
Go

bytewax / bytewax

Python Stream Processing

python rust data-science machine-learning stream-processing data-engineering dataflow data-processing streaming-data

Updated Oct 13, 2026
Python

pravega / pravega

Pravega - Streaming as a new software defined storage primitive

streaming distributed-storage real-time-data streaming-data data-ingestion

Updated Mar 2, 2025
Java

quix-streams

quixio / quix-streams

Python Streaming DataFrames for Kafka

python data-science machine-learning kafka stream-processing data-engineering streaming-data stream-processor event-driven-architecture streaming-data-processing time-series-data data-intensive-applications streaming-data-pipelines real-time-data-processing

Updated Oct 15, 2026
Python

python-streamz / streamz

Real-time stream processing for python

python real-time async streaming-data

Updated Sep 22, 2026
Python

microsoft / Trill

Trill is a single-node query processor for temporal or streaming data.

streaming-data temporal-data

Updated Jan 8, 2024
C#

zpl-c / zpl

📐 Pushing the boundaries of simplicity

Updated Apr 26, 2025
C

OnlineStats.jl

joshday / OnlineStats.jl

⚡ Single-pass algorithms for statistics

statistics big-data julia julia-language streaming-data online-algorithms julialang onlinestats stochastic-approximation

Updated Sep 21, 2026
Julia

scikit-multiflow / scikit-multiflow

A machine learning package for streaming data in Python. The other ancestor of River.

machine-learning stream scikit-learn streaming-data scikit moa meka

Updated Nov 2, 2023
Python

hstreamdb / hstream

HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.

iot distributed-systems haskell streaming real-time sql database kafka scale stream-processing distributed-database realtime-database data-processing financial-analysis streaming-data materialized-view iot-database hstreamdb streaming-database

Updated Dec 26, 2024
Haskell

Add this topic to your repo

To associate your repository with the streaming-data topic, visit your repo's landing page and select "manage topics."