Distributable extends Processor
Unlike a Transformer, receives the whole upstream generator, not one batch.
Methods
- bind() : BoundStep<string|int, Processor>
- breaks() : bool
- True when process() needs every input row before it emits one: the processor ends its pipeline.
- describe() : null|Description
- distribution() : Distribution|null
- null: this instance cannot be split across processes (unbound, or a shape the exchange cannot rebuild).
- fromDescription() : static
- process() : Generator<string|int, Rows>
- Process a stream of Rows and return a new stream.
Methods
bind()
public
bind(Schema $input) : BoundStep<string|int, Processor>
Parameters
- $input : Schema
Tags
Return values
BoundStep<string|int, Processor>breaks()
True when process() needs every input row before it emits one: the processor ends its pipeline.
public
breaks() : bool
Return values
booldescribe()
public
describe() : null|Description
Return values
null|Description —null when this instance cannot cross a process boundary (a live client, a custom collaborator)
distribution()
null: this instance cannot be split across processes (unbound, or a shape the exchange cannot rebuild).
public
distribution() : Distribution|null
Return values
Distribution|nullfromDescription()
public
static fromDescription(array<string|int, mixed> $data, Rebuild $rebuild) : static
Parameters
- $data : array<string|int, mixed>
- $rebuild : Rebuild
Return values
staticprocess()
Process a stream of Rows and return a new stream.
public
process(Generator<string|int, Rows> $rows, Backend $backend) : Generator<string|int, Rows>