Tutorials
Guides for building, running, and extending Streamling pipelines.
Building a Custom Source Plugin: Extracting Events from AWS CloudTrail
Build a Streamling source plugin from scratch with the SourcePlugin trait, poll the cursor-less CloudTrail LookupEvents API with watermarks and lookback, checkpoint in two phases, and stream your AWS audit events into Postgres with a tiny audit dashboard on top.
Product Analytics With Postgres CDC and ClickHouse
Stream Postgres changes into ClickHouse with the Postgres CDC source, turn every insert, update and delete into signed revenue deltas with the SQL transform, and keep a SummingMergeTree rollup permanently correct without ever rereading the source table.
Getting Slack Notifications From Kafka Events
Create a Streamling pipeline to consume data from Kafka, filter it with the SQL transform, prepare a Slack webhook payload with the TypeScript transform and deliver it to the Slack webhook endpoint with the webhook sink.