Tag: Data Pipelines
All the articles with the tag "Data Pipelines".
-
Composable Processor Architecture for AI Content Pipelines
Processors are decoupled by data, not coupled by flow. A modular architecture for scalable AI content and processing pipelines.
-
Inversion of Control in Data Pipeline Architecture
Don't hardcode how functions are called, where they run, or who calls them. Inject all of these decisions to enable multi-runtime systems.
-
Composable Pipelines: When a Pipeline IS a Capability
The recursive property of workflows — pipelines calling pipelines calling pipelines — is the most underexplored idea in workflow orchestration.
-
Streaming Data Pipelines with Async Generators
Why async generators are the right primitive for data pipelines—backpressure, composition, and natural event flow.
-
Layered Architecture for Distributed Data Systems
How dependency injection separates pure logic from I/O, enabling testable, multi-runtime data systems.
-
Building an Autonomous Data Pipeline on Cloudflare Workers
How to wire Workers, Queues, Durable Objects, D1, R2, and Workflows into a self-driving data pipeline.