orcaLog in

Runs · gharchive · ·

Run 620 cancelled

StatusWhere the run is: queued, running, then succeeded, failed or cancelled. Refreshed every 5 s while it goes on. Docs ↗

DurationHow long the run took, from its start to its end, or to now while it goes on. Hover for the times.
5 h 39 min
CreatedWhen the run was queued: by the schedule, a sensor, a backfill, a fill or a person.
2026-11-07T06:59:31Z
StartedWhen its process started, once its turn in the queue came and its placement had room. Empty while it waits.
2026-11-07T06:59:31Z
EndedWhen it finished, whatever the outcome. Empty while it goes on.
2026-11-07T12:38:51Z
TriesTimes the run's process was started: 1 is normal; more means retries, a lost instance or a resume.
1
what hasn't succeeded

Partitions & triggerWhat this run does, and what made it start. Docs ↗

PartitionsThe partitions this run does (months, days, hours or named keys): each step runs once per partition. Docs ↗
2026-04-25
TriggerWhat started it: the schedule, a sensor (with the snapshots it saw), a rebuild, a backfill, a fill, or manual (a person, or a binary's run command). Docs ↗
fill

CodeThe code this run ran, at the commit its binary was built from. Hover a name to see its source; click it to open the file on its host. Docs ↗

FunctionsThe pipeline, its steps in the order they run, and the dista tasks they fan out to, each linked to its line at the commit this run ran. Docs ↗
gharchive · load_day · index_hour · hour_task · merge_repo_hour
SourceThe commit its binary was built from (-D ORCA_COMMIT), in which repository, and the image it ran in, if any. Docs ↗
47fea9378b0d of https://github.com/magmalake/mojo-census
Driver logWhat the run's process printed: orca's lines and its steps' output, as the scheduler kept it. Each attempt under Steps has its own log too.
driver.log

Code hash 0xe6cdc4870d3f3535A hash of what the binary says about itself: its steps, partitions and schedule. It changes when they do, not on every build. Docs ↗

ResourcesWhat this run's own processes used: its process and the ones it started, dista's local workers too, measured by the scheduler or worker that started it. Not the rest of the machine: the machine's numbers, where they are recorded, are in their own card further down. With a request, what it asked for and was granted too. Docs ↗

Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured

SettingsWhat the run was set up with, orca.toml and the flags applied: as its start recorded them, or else as the pipeline is registered. The pipeline's Config card says where each value came from. Docs ↗

As the pipeline is registered. Where each value came from

PlacedWhere it ran: local (beside the scheduler, on its machine), control (on the control host, within its limits), ec2 (instances of its own), or a remote worker's pool. Docs ↗
local
Max runsThe most runs of this pipeline the scheduler starts at once (max_runs); the others wait in the queue.
1
SpotWhether its EC2 instances are Spot: cheaper, and AWS can take them back.
false
EnvironmentThe variables orca.toml's env and the flags set in the run's environment.
DISTA_WORKER_SLOTS=2
GHARCHIVE_EVENTS=off
GHARCHIVE_PARALLEL=2

StepsEach step of each partition. Table: its status, attempts, times, what its latest attempt used, and its log. Timeline: the attempts on the clock, a row per step. Graph: the steps in the order they run, in this run's colours. Docs ↗cancelled

MachinesSamples of the whole machine, every few seconds while the run ran (ORCA_SAMPLE_SECONDS, 5 by default): its CPU, memory, fullest disk, disk io and network, by a sampler the runner starts beside the run's process. They count everything on that machine, not just this run. What the run's own processes used is in Resources, above. The steps lane lines a busy stretch up with the step it came from. A run on a remote worker has none: the worker measures only its processes. Docs ↗

The whole machine, while this run ran: the scheduler's machine (the local runner). Not this run's own use; that is in Resources.

A shared machine: 1 other run ran on it at the same time, so these numbers are theirs too.

user + system iowait steal memory fullest disk disk io network warning

0s1h0m2h0m3h0m4h0m5h0mload_dayload_day 2026-04-25 failed: 5h39mlocalcpu 82%mem 24% · disk 11%io · net 296 MB/s
InstanceWhere the samples were taken: local (the scheduler's machine), control, an EC2 head or worker, or a pod.SamplesHow many samples the sampler took.CPUCPU used: for a step, its latest attempt's user and system seconds; for a machine, its busiest moment as a share of all cores.Busiest coreThe busiest single core's use at its highest.StealCPU time the hypervisor gave to other machines.MemoryMemory used at its highest, of the machine's total.DiskThe fullest disk the run writes to, at its fullest.Disk ioDisk reads and writes, at their highest rate.NetworkNetwork traffic in and out, at its highest rate.WarningsStretches with memory or a disk over 90%, or CPU steal over 20%: what slows or fails most runs.
local407482%98%0%1.9 GB of 8.1 GB (24%)8.9 GB of 80 GB (11%)296 MB/s36 MB/s

ActionsWho did what to this run, from the UI or the orca command, as the user they logged in as.

AtWhen it happened, in UTC.ByThe user who did it, as they logged in.ActionWhat was done: the path of the action posted.FromWhere it came from.
2026-11-07T12:37:49Zmseritan/runs/620/cancelui
2026-11-07T12:38:51Zorcastop

SnapshotsThe table snapshots each step read, and the ones it wrote (committed). A dataset's snapshot links to its lineage: upstream, what it was written from, and downstream, what was written from it. Docs ↗

StepA step of the pipeline: a function that runs once per partition (mapped) or once over all of them (gather).PartitionThe partition this row is for; empty for a gather step, which runs once over all of them.Read or wroteread: the step read this snapshot. wrote: it committed it, a new snapshot of the table.TableThe table's name in the warehouse.SnapshotA snapshot of a table: the table as one commit left it. Click for its lineage.
load_day2026-04-25wrotegharchive.events8871886039581429456
load_day2026-04-25wrotegharchive.events8899148304979682310
load_day2026-04-25wrotegharchive.events6938283387805841381
load_day2026-04-25wrotegharchive.events3124368202168828527
load_day2026-04-25wrotegharchive.events5217202595386533229
load_day2026-04-25wrotegharchive.events2136020773879928439
load_day2026-04-25wrotegharchive.events7252286008763001890
load_day2026-04-25wrotegharchive.events3390190762870703691
load_day2026-04-25wrotegharchive.events7128355578106672465
load_day2026-04-25wrotegharchive.events1775288882324817939
load_day2026-04-25wrotegharchive.events706408473332552962
load_day2026-04-25wrotegharchive.events4433058907488036087
load_day2026-04-25wrotegharchive.events6593788412001920497
load_day2026-04-25wrotegharchive.events1018192475788343574
load_day2026-04-25wrotegharchive.events1194806127155710298
load_day2026-04-25wrotegharchive.events5073206327964858613
load_day2026-04-25wrotegharchive.events8335240414868014905
load_day2026-04-25wrotegharchive.events2982604450710347153
load_day2026-04-25wrotegharchive.events3901133543652302400
load_day2026-04-25wrotegharchive.events2650640518875980122
load_day2026-04-25wrotegharchive.events7824521979014549883