orcaLog in

Runs · run 2679

load_day 2024-07-05, attempt 1 succeeded

Host
73ccef5e07c2:145752
Started
2026-11-08T06:51:33Z
Ended
2026-11-08T06:53:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
675 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
152.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2679/load_day/2024-07-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:51:33Z [load_day 2024-07-05] attempt 1 started
2026-11-08T06:51:34Z [load_day 2024-07-05] 2024-07-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:51:40Z [load_day 2024-07-05] 2024-07-05 hour 0: 163056 events in 0 files, snapshot none (task 5159 ms: download 3263 ms overlapping gunzip 673 ms, parse 2939 ms, sort 0 ms, write 0 ms, index 581 ms: 10 candidates, 88249 repo-hours, 1358 releases; waiting 541 ms; commit 0 ms)
2026-11-08T06:51:40Z [load_day 2024-07-05] 2024-07-05 hour 1: 175871 events in 0 files, snapshot none (task 5151 ms: download 2518 ms overlapping gunzip 654 ms, parse 3034 ms, sort 0 ms, write 0 ms, index 671 ms: 6 candidates, 101637 repo-hours, 1101 releases; waiting 516 ms; commit 0 ms)
2026-11-08T06:51:45Z [load_day 2024-07-05] 2024-07-05 hour 2: 143940 events in 0 files, snapshot none (task 4228 ms: download 2322 ms overlapping gunzip 571 ms, parse 2458 ms, sort 0 ms, write 0 ms, index 422 ms: 10 candidates, 61227 repo-hours, 1263 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:51:45Z [load_day 2024-07-05] 2024-07-05 hour 3: 168435 events in 0 files, snapshot none (task 4665 ms: download 2779 ms overlapping gunzip 611 ms, parse 2707 ms, sort 0 ms, write 0 ms, index 515 ms: 5 candidates, 70796 repo-hours, 5802 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:51:51Z [load_day 2024-07-05] 2024-07-05 hour 4: 146144 events in 0 files, snapshot none (task 5523 ms: download 2610 ms overlapping gunzip 807 ms, parse 3486 ms, sort 0 ms, write 0 ms, index 436 ms: 4 candidates, 55950 repo-hours, 835 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:51:51Z [load_day 2024-07-05] 2024-07-05 hour 5: 157798 events in 0 files, snapshot none (task 5882 ms: download 3422 ms overlapping gunzip 856 ms, parse 3700 ms, sort 0 ms, write 0 ms, index 508 ms: 8 candidates, 63521 repo-hours, 790 releases; waiting 526 ms; commit 0 ms)
2026-11-08T06:51:59Z [load_day 2024-07-05] 2024-07-05 hour 6: 196401 events in 0 files, snapshot none (task 7792 ms: download 5004 ms overlapping gunzip 1179 ms, parse 4942 ms, sort 0 ms, write 0 ms, index 705 ms: 27 candidates, 90560 repo-hours, 911 releases; waiting 576 ms; commit 0 ms)
2026-11-08T06:52:00Z [load_day 2024-07-05] 2024-07-05 hour 7: 198330 events in 0 files, snapshot none (task 7774 ms: download 5231 ms overlapping gunzip 1162 ms, parse 5132 ms, sort 0 ms, write 0 ms, index 658 ms: 15 candidates, 81411 repo-hours, 979 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:52:08Z [load_day 2024-07-05] 2024-07-05 hour 8: 212614 events in 0 files, snapshot none (task 8527 ms: download 5414 ms overlapping gunzip 1205 ms, parse 5506 ms, sort 0 ms, write 0 ms, index 946 ms: 11 candidates, 89498 repo-hours, 1232 releases; waiting 500 ms; commit 0 ms)
2026-11-08T06:52:08Z [load_day 2024-07-05] 2024-07-05 hour 9: 223737 events in 0 files, snapshot none (task 8196 ms: download 5329 ms overlapping gunzip 1278 ms, parse 5324 ms, sort 0 ms, write 0 ms, index 729 ms: 12 candidates, 101275 repo-hours, 1357 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:52:16Z [load_day 2024-07-05] 2024-07-05 hour 10: 205324 events in 0 files, snapshot none (task 7393 ms: download 4971 ms overlapping gunzip 1137 ms, parse 4952 ms, sort 0 ms, write 0 ms, index 594 ms: 8 candidates, 83203 repo-hours, 1212 releases; waiting 481 ms; commit 0 ms)
2026-11-08T06:52:16Z [load_day 2024-07-05] 2024-07-05 hour 11: 206132 events in 0 files, snapshot none (task 7141 ms: download 4531 ms overlapping gunzip 1085 ms, parse 4934 ms, sort 0 ms, write 0 ms, index 698 ms: 14 candidates, 84530 repo-hours, 1114 releases; waiting 182 ms; commit 0 ms)
2026-11-08T06:52:26Z [load_day 2024-07-05] 2024-07-05 hour 12: 264532 events in 0 files, snapshot none (task 9320 ms: download 5821 ms overlapping gunzip 1376 ms, parse 5909 ms, sort 0 ms, write 0 ms, index 998 ms: 14 candidates, 126583 repo-hours, 1215 releases; waiting 773 ms; commit 0 ms)
2026-11-08T06:52:26Z [load_day 2024-07-05] 2024-07-05 hour 13: 232257 events in 0 files, snapshot none (task 8691 ms: download 5602 ms overlapping gunzip 1299 ms, parse 5801 ms, sort 0 ms, write 0 ms, index 869 ms: 11 candidates, 106842 repo-hours, 1382 releases; waiting 409 ms; commit 0 ms)
2026-11-08T06:52:36Z [load_day 2024-07-05] 2024-07-05 hour 14: 216255 events in 0 files, snapshot none (task 9434 ms: download 6185 ms overlapping gunzip 1532 ms, parse 6174 ms, sort 0 ms, write 0 ms, index 910 ms: 13 candidates, 89868 repo-hours, 1154 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:52:36Z [load_day 2024-07-05] 2024-07-05 hour 15: 220070 events in 0 files, snapshot none (task 9474 ms: download 6215 ms overlapping gunzip 1525 ms, parse 6151 ms, sort 0 ms, write 0 ms, index 968 ms: 13 candidates, 96453 repo-hours, 1238 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:52:43Z [load_day 2024-07-05] 2024-07-05 hour 16: 194971 events in 0 files, snapshot none (task 7144 ms: download 4619 ms overlapping gunzip 1113 ms, parse 4920 ms, sort 0 ms, write 0 ms, index 723 ms: 11 candidates, 80108 repo-hours, 1177 releases; waiting 194 ms; commit 0 ms)
2026-11-08T06:52:43Z [load_day 2024-07-05] 2024-07-05 hour 17: 184298 events in 0 files, snapshot none (task 6344 ms: download 3878 ms overlapping gunzip 961 ms, parse 3987 ms, sort 0 ms, write 0 ms, index 635 ms: 7 candidates, 74120 repo-hours, 883 releases; waiting 533 ms; commit 0 ms)
2026-11-08T06:52:51Z [load_day 2024-07-05] 2024-07-05 hour 18: 188394 events in 0 files, snapshot none (task 7232 ms: download 4172 ms overlapping gunzip 1094 ms, parse 4409 ms, sort 0 ms, write 0 ms, index 995 ms: 15 candidates, 84701 repo-hours, 1128 releases; waiting 504 ms; commit 0 ms)
2026-11-08T06:52:51Z [load_day 2024-07-05] 2024-07-05 hour 19: 166126 events in 0 files, snapshot none (task 6711 ms: download 3467 ms overlapping gunzip 1036 ms, parse 4351 ms, sort 0 ms, write 0 ms, index 589 ms: 15 candidates, 64759 repo-hours, 969 releases; waiting 454 ms; commit 0 ms)
2026-11-08T06:52:59Z [load_day 2024-07-05] 2024-07-05 hour 20: 171954 events in 0 files, snapshot none (task 6815 ms: download 4474 ms overlapping gunzip 1106 ms, parse 4394 ms, sort 0 ms, write 0 ms, index 528 ms: 15 candidates, 66507 repo-hours, 802 releases; waiting 490 ms; commit 0 ms)
2026-11-08T06:52:59Z [load_day 2024-07-05] 2024-07-05 hour 21: 158626 events in 0 files, snapshot none (task 6586 ms: download 4445 ms overlapping gunzip 1052 ms, parse 4409 ms, sort 0 ms, write 0 ms, index 451 ms: 15 candidates, 64443 repo-hours, 988 releases; waiting 454 ms; commit 0 ms)
2026-11-08T06:53:03Z [load_day 2024-07-05] 2024-07-05 hour 22: 138875 events in 0 files, snapshot none (task 4480 ms: download 2387 ms overlapping gunzip 658 ms, parse 2734 ms, sort 0 ms, write 0 ms, index 352 ms: 9 candidates, 51126 repo-hours, 931 releases; waiting 499 ms; commit 0 ms)
2026-11-08T06:53:03Z [load_day 2024-07-05] 2024-07-05 hour 23: 129009 events in 0 files, snapshot none (task 4333 ms: download 2266 ms overlapping gunzip 610 ms, parse 2512 ms, sort 0 ms, write 0 ms, index 403 ms: 8 candidates, 49185 repo-hours, 683 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:53:12Z [load_day 2024-07-05] 2024-07-05: repo_hour merged from 24 files to 1 (1926552 rows, 8174 ms)
2026-11-08T06:53:14Z [load_day 2024-07-05] 2024-07-05: index committed in 10769 ms (24 + 1 + 24 files)
2026-11-08T06:53:14Z [load_day 2024-07-05] 2024-07-05: 4463149 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:53:14Z [load_day 2024-07-05] attempt 1 succeeded