Pipeline Parallelism
Splits model layers across devices and processes micro-batches through a staged pipeline. Compares pipelined vs sequential execution and visualizes the schedule as an ASCII Gantt chart.
CLI Equivalent
N/A
Key Concepts
- Layer partitioning across multiple devices
- Micro-batch scheduling through pipeline stages
- Pipelined vs sequential throughput comparison
Run
cargo run --example distributed_pipeline_parallel