Skip to content

Have as many WARCBolt instances as there are workers #64

@jnioche

Description

@jnioche

See #63

All the bolts are set to have as many instances as there are workers, apart from the WARC Bolt. There is no risk of collision in the outputs as the instance number is used in the filename so there is no reason not to use more than 1 instance, especially given that it could save on serialization and sending heavy tuples across the cluster.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions