DistinctProcessor implements Distributable
Read onlyYes
FinalYes
Interfaces
- Distributable
- Unlike a Transformer, receives the whole upstream generator, not one batch.
Properties
Methods
- __construct() : mixed
- bind() : BoundStep<string|int, Processor>
- breaks() : bool
- True when process() needs every input row before it emits one: the processor ends its pipeline.
- describe() : null|Description
- distribution() : Distribution|null
- Every split drops its own duplicates; the rows of one key meet in one process. null while unbound or when a column is missing from the input.
- fromDescription() : static
- process() : Generator<null|Signal, void>
- Process a stream of Rows and return a new stream.
Properties
$columns
public
array<string|int, mixed>
$columns
$input
public
Schema|null
$input
= null
Methods
__construct()
public
__construct(array<int, Reference|string> $columns[, null|Schema $input = null ]) : mixed
Parameters
Tags
bind()
public
bind(Schema $input) : BoundStep<string|int, Processor>
Parameters
- $input : Schema
Return values
BoundStep<string|int, Processor>breaks()
True when process() needs every input row before it emits one: the processor ends its pipeline.
public
breaks() : bool
Return values
booldescribe()
public
describe() : null|Description
Return values
null|Description —null when this instance cannot cross a process boundary (a live client, a custom collaborator)
distribution()
Every split drops its own duplicates; the rows of one key meet in one process. null while unbound or when a column is missing from the input.
public
distribution() : Distribution|null
Return values
Distribution|nullfromDescription()
public
static fromDescription(array<string|int, mixed> $data, Rebuild $rebuild) : static
Parameters
- $data : array<string|int, mixed>
- $rebuild : Rebuild
Return values
staticprocess()
Process a stream of Rows and return a new stream.
public
process(Generator<string|int, Rows> $rows, Backend $backend) : Generator<null|Signal, void>