Module pipeline

Module pipeline 

Source
Expand description

Pipeline builder and execution engine.

Pipelines are constructed by starting with a Source and chaining transforms via .map() and .filter(). The pipeline is terminated with .sink(), .fold(), or .collect() and executed with .run().

§Inter-stage buffering

The BufferedPipeline variant materializes a FabricQueue at each stage boundary, proving the integration with grafos-collections.

§Placement

.on_node() records a NodeConstraint for the next stage. In the current implementation all stages run locally; the constraint is stored for future remote dispatch.

Structs§

BufferedPipeline
Pipeline variant using FabricQueue inter-stage buffering.
CollectPipeline
Pipeline terminated with collect — returns items as Vec<T>.
FoldPipeline
Pipeline terminated with a fold operation.
Pipeline
Entry point for building a pipeline.
PipelineBuilder
Builder for constructing a stream processing pipeline.
PipelineHandle
A built pipeline ready for execution.
SinkPipeline
Pipeline terminated with a Sink.
StageEntry
One stage entry with its metadata.

Functions§

make_filter_stage
Helper to construct a filter stage entry for BufferedPipeline.
make_map_stage
Helper to construct a map stage entry for BufferedPipeline.