provenance

module of dascore.workflow source

Two records of where data came from.

A Provenance is the durable one: a pipe, the version of DASCore which ran it, and the machine it ran on, written next to the results and read back later.

A ProvenanceNode is the live one: one immutable node per step, holding the task which ran and the nodes which fed it. A patch carries the node it came out of, so its whole history is reachable from it without a store to look anything up in. This module is the graph; building one as patches are processed comes with the patch ids, in a later release.

Classes

Name Description
Provenance A record of a pipe and the run which produced some data.
ProvenanceNode One step of what was done to some data.
SourceInfo Where a patch was read from.