orcaLog in

Datasets

gharchive.candidates

Written by
gharchive step load_day pipelines/gharchive.mojo:151; gharchive_index step index_day pipelines/gharchive_index.mojo:54
Read by
mojo_repos step find_repos pipelines/mojo_repos.mojo:192
gharchive pipelinegharchivepipelinegharchive.candidates datasetgharchive.candidatesdatasetgharchive.events datasetgharchive.eventsdatasetgharchive.releases datasetgharchive.releasesdatasetgharchive.repo_hour datasetgharchive.repo_hourdatasetgharchive_index pipelinegharchive_indexpipelinemojo_activity pipelinemojo_activitypipelinemojo.activity datasetmojo.activitydatasetmojo.activity_repos datasetmojo.activity_reposdatasetmojo.releases datasetmojo.releasesdatasetmojo.repos datasetmojo.reposdatasetmojo_history pipelinemojo_historypipelinemojo.commits datasetmojo.commitsdatasetmojo.migrations datasetmojo.migrationsdatasetmojo.tags datasetmojo.tagsdatasetmojo_repos pipelinemojo_repospipelinemojo.checked datasetmojo.checkeddatasetmojo_stats pipelinemojo_statspipelinemojo.repo_stats datasetmojo.repo_statsdatasetmojo_versions pipelinemojo_versionspipelinemojo.repo_deps datasetmojo.repo_depsdatasetmojo.repo_versions datasetmojo.repo_versionsdataset

Rebuild docs

Rebuild reruns everything downstream of this dataset for the partitions you give, in dependency order. Use it after this dataset's data was fixed or reloaded, so the tables built from it catch up.

  1. mojo_repos (reads gharchive.candidates)
  2. mojo_activity (reads mojo.repos) and mojo_history (reads mojo.repos) and mojo_stats (reads mojo.repos) and mojo_versions (reads mojo.repo_deps, mojo.repos, mojo.repo_versions)

Plans a run of each pipeline above over those partitions; each level is queued once the one before it has succeeded.

From the command line:

orca login <url> && orca --remote <url> rebuild gharchive.candidates <range>

Snapshots docs

SnapshotA snapshot of a table: the table as one commit left it. Click for its lineage.PipelineA pipeline: a binary of steps, registered with orca, that runs on its schedule or when asked.RunA run: one start of a pipeline over some partitions, with its steps and their attempts. Click for its page.StepA step of the pipeline: a function that runs once per partition (mapped) or once over all of them (gather).PartitionThe partition this row is for; empty for a gather step, which runs once over all of them.CommittedWhen the attempt that wrote it finished.
6167059522126800648gharchive47load_day pipelines/gharchive.mojo:972026-11-022026-11-07T03:24:34Z
3006411438937823261gharchive44load_day pipelines/gharchive.mojo:972026-11-032026-11-07T03:24:09Z
6544808669542050247gharchive41load_day pipelines/gharchive.mojo:972026-11-042026-11-07T03:23:47Z
3361409858930905480gharchive38load_day pipelines/gharchive.mojo:972026-11-052026-11-07T03:23:24Z
5403592934595118961gharchive35load_day pipelines/gharchive.mojo:972023-01-122026-11-07T03:22:50Z
7905076603398935509gharchive32load_day pipelines/gharchive.mojo:972023-01-112026-11-07T03:20:09Z
4608505557650023140gharchive29load_day pipelines/gharchive.mojo:972023-01-102026-11-07T03:17:03Z
7084379045556277037gharchive26load_day pipelines/gharchive.mojo:972023-01-092026-11-07T03:14:11Z
7181969909991997837gharchive23load_day pipelines/gharchive.mojo:972023-01-082026-11-07T03:10:57Z
6129729953077115840gharchive20load_day pipelines/gharchive.mojo:972023-01-072026-11-07T03:09:10Z
9159685160796937045gharchive17load_day pipelines/gharchive.mojo:972023-01-062026-11-07T03:06:30Z
581189119117179309gharchive14load_day pipelines/gharchive.mojo:972026-11-062026-11-07T03:00:32Z
1266809150318417658gharchive11load_day pipelines/gharchive.mojo:972023-01-052026-11-07T03:03:05Z
7292987993981276757gharchive10load_day pipelines/gharchive.mojo:972023-01-042026-11-07T02:59:24Z
2323169641824213828gharchive7load_day pipelines/gharchive.mojo:972023-01-032026-11-07T02:45:18Z
3417207235810743892gharchive2load_day pipelines/gharchive.mojo:972023-01-022026-11-07T02:13:34Z
2876665962282451840gharchive1load_day pipelines/gharchive.mojo:972023-01-012026-11-07T02:06:39Z