orcaLog in

Runs · run 5048

load_day 2026-03-18, attempt 1 succeeded

Host
73ccef5e07c2:456894
Started
2026-11-08T15:36:34Z
Ended
2026-11-08T15:37:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
725 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
69.3 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5048/load_day/2026-03-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:36:34Z [load_day 2026-03-18] attempt 1 started
2026-11-08T15:36:35Z [load_day 2026-03-18] 2026-03-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:36:39Z [load_day 2026-03-18] 2026-03-18 hour 0: 147109 events in 0 files, snapshot none (task 3601 ms: download 2433 ms overlapping gunzip 517 ms, parse 1627 ms, sort 0 ms, write 0 ms, index 606 ms: 7 candidates, 72759 repo-hours, 861 releases; waiting 566 ms; commit 0 ms)
2026-11-08T15:36:39Z [load_day 2026-03-18] 2026-03-18 hour 1: 157879 events in 0 files, snapshot none (task 3331 ms: download 1839 ms overlapping gunzip 394 ms, parse 1215 ms, sort 0 ms, write 0 ms, index 767 ms: 5 candidates, 91456 repo-hours, 352 releases; waiting 589 ms; commit 0 ms)
2026-11-08T15:36:43Z [load_day 2026-03-18] 2026-03-18 hour 2: 157678 events in 0 files, snapshot none (task 3148 ms: download 1825 ms overlapping gunzip 349 ms, parse 1111 ms, sort 0 ms, write 0 ms, index 751 ms: 5 candidates, 92028 repo-hours, 460 releases; waiting 702 ms; commit 0 ms)
2026-11-08T15:36:43Z [load_day 2026-03-18] 2026-03-18 hour 3: 153073 events in 0 files, snapshot none (task 3526 ms: download 2106 ms overlapping gunzip 452 ms, parse 1389 ms, sort 0 ms, write 0 ms, index 677 ms: 11 candidates, 76311 repo-hours, 892 releases; waiting 685 ms; commit 0 ms)
2026-11-08T15:36:47Z [load_day 2026-03-18] 2026-03-18 hour 4: 148980 events in 0 files, snapshot none (task 4004 ms: download 2644 ms overlapping gunzip 553 ms, parse 1573 ms, sort 0 ms, write 0 ms, index 609 ms: 5 candidates, 71708 repo-hours, 892 releases; waiting 694 ms; commit 0 ms)
2026-11-08T15:36:47Z [load_day 2026-03-18] 2026-03-18 hour 5: 148879 events in 0 files, snapshot none (task 3684 ms: download 2485 ms overlapping gunzip 572 ms, parse 1558 ms, sort 0 ms, write 0 ms, index 665 ms: 12 candidates, 76977 repo-hours, 840 releases; waiting 582 ms; commit 0 ms)
2026-11-08T15:36:51Z [load_day 2026-03-18] 2026-03-18 hour 6: 151729 events in 0 files, snapshot none (task 3437 ms: download 2081 ms overlapping gunzip 462 ms, parse 1458 ms, sort 0 ms, write 0 ms, index 634 ms: 5 candidates, 83248 repo-hours, 723 releases; waiting 513 ms; commit 0 ms)
2026-11-08T15:36:51Z [load_day 2026-03-18] 2026-03-18 hour 7: 156670 events in 0 files, snapshot none (task 3303 ms: download 2072 ms overlapping gunzip 453 ms, parse 1354 ms, sort 0 ms, write 0 ms, index 705 ms: 11 candidates, 85536 repo-hours, 485 releases; waiting 485 ms; commit 0 ms)
2026-11-08T15:36:55Z [load_day 2026-03-18] 2026-03-18 hour 8: 152743 events in 0 files, snapshot none (task 3246 ms: download 2064 ms overlapping gunzip 420 ms, parse 1103 ms, sort 0 ms, write 0 ms, index 720 ms: 8 candidates, 86027 repo-hours, 395 releases; waiting 680 ms; commit 0 ms)
2026-11-08T15:36:56Z [load_day 2026-03-18] 2026-03-18 hour 9: 152286 events in 0 files, snapshot none (task 4085 ms: download 2660 ms overlapping gunzip 369 ms, parse 1118 ms, sort 0 ms, write 0 ms, index 692 ms: 5 candidates, 85807 repo-hours, 413 releases; waiting 1375 ms; commit 0 ms)
2026-11-08T15:36:59Z [load_day 2026-03-18] 2026-03-18 hour 10: 151222 events in 0 files, snapshot none (task 3450 ms: download 2034 ms overlapping gunzip 327 ms, parse 983 ms, sort 0 ms, write 0 ms, index 926 ms: 3 candidates, 82938 repo-hours, 388 releases; waiting 865 ms; commit 0 ms)
2026-11-08T15:37:00Z [load_day 2026-03-18] 2026-03-18 hour 11: 153642 events in 0 files, snapshot none (task 3386 ms: download 2013 ms overlapping gunzip 386 ms, parse 1176 ms, sort 0 ms, write 0 ms, index 705 ms: 7 candidates, 85832 repo-hours, 389 releases; waiting 621 ms; commit 0 ms)
2026-11-08T15:37:03Z [load_day 2026-03-18] 2026-03-18 hour 12: 155948 events in 0 files, snapshot none (task 3257 ms: download 1750 ms overlapping gunzip 331 ms, parse 980 ms, sort 0 ms, write 0 ms, index 795 ms: 7 candidates, 93286 repo-hours, 262 releases; waiting 712 ms; commit 0 ms)
2026-11-08T15:37:04Z [load_day 2026-03-18] 2026-03-18 hour 13: 156175 events in 0 files, snapshot none (task 3647 ms: download 2075 ms overlapping gunzip 227 ms, parse 845 ms, sort 0 ms, write 0 ms, index 762 ms: 8 candidates, 96429 repo-hours, 128 releases; waiting 1359 ms; commit 0 ms)
2026-11-08T15:37:07Z [load_day 2026-03-18] 2026-03-18 hour 14: 153366 events in 0 files, snapshot none (task 3524 ms: download 1909 ms overlapping gunzip 320 ms, parse 1087 ms, sort 0 ms, write 0 ms, index 992 ms: 15 candidates, 91450 repo-hours, 139 releases; waiting 824 ms; commit 0 ms)
2026-11-08T15:37:07Z [load_day 2026-03-18] 2026-03-18 hour 15: 151694 events in 0 files, snapshot none (task 2796 ms: download 1262 ms overlapping gunzip 369 ms, parse 1154 ms, sort 0 ms, write 0 ms, index 761 ms: 14 candidates, 86489 repo-hours, 193 releases; waiting 214 ms; commit 0 ms)
2026-11-08T15:37:11Z [load_day 2026-03-18] 2026-03-18 hour 16: 147229 events in 0 files, snapshot none (task 3501 ms: download 2352 ms overlapping gunzip 329 ms, parse 986 ms, sort 0 ms, write 0 ms, index 678 ms: 16 candidates, 84181 repo-hours, 219 releases; waiting 1195 ms; commit 0 ms)
2026-11-08T15:37:11Z [load_day 2026-03-18] 2026-03-18 hour 17: 153824 events in 0 files, snapshot none (task 2538 ms: download 1334 ms overlapping gunzip 277 ms, parse 856 ms, sort 0 ms, write 0 ms, index 692 ms: 8 candidates, 86084 repo-hours, 158 releases; waiting 382 ms; commit 0 ms)
2026-11-08T15:37:16Z [load_day 2026-03-18] 2026-03-18 hour 18: 156156 events in 0 files, snapshot none (task 4404 ms: download 2773 ms overlapping gunzip 541 ms, parse 1530 ms, sort 0 ms, write 0 ms, index 660 ms: 9 candidates, 86439 repo-hours, 254 releases; waiting 1360 ms; commit 0 ms)
2026-11-08T15:37:16Z [load_day 2026-03-18] 2026-03-18 hour 19: 155978 events in 0 files, snapshot none (task 4390 ms: download 2091 ms overlapping gunzip 406 ms, parse 1374 ms, sort 0 ms, write 0 ms, index 1613 ms: 16 candidates, 84524 repo-hours, 315 releases; waiting 625 ms; commit 0 ms)
2026-11-08T15:37:22Z [load_day 2026-03-18] 2026-03-18 hour 20: 152846 events in 0 files, snapshot none (task 4389 ms: download 1997 ms overlapping gunzip 605 ms, parse 2061 ms, sort 0 ms, write 0 ms, index 877 ms: 10 candidates, 83658 repo-hours, 449 releases; waiting 533 ms; commit 0 ms)
2026-11-08T15:37:22Z [load_day 2026-03-18] 2026-03-18 hour 21: 152158 events in 0 files, snapshot none (task 4306 ms: download 1893 ms overlapping gunzip 643 ms, parse 2048 ms, sort 0 ms, write 0 ms, index 798 ms: 10 candidates, 77716 repo-hours, 486 releases; waiting 520 ms; commit 0 ms)
2026-11-08T15:37:26Z [load_day 2026-03-18] 2026-03-18 hour 22: 157074 events in 0 files, snapshot none (task 4216 ms: download 2628 ms overlapping gunzip 567 ms, parse 1770 ms, sort 0 ms, write 0 ms, index 803 ms: 14 candidates, 76642 repo-hours, 514 releases; waiting 653 ms; commit 0 ms)
2026-11-08T15:37:26Z [load_day 2026-03-18] 2026-03-18 hour 23: 158346 events in 0 files, snapshot none (task 4018 ms: download 1252 ms overlapping gunzip 562 ms, parse 1798 ms, sort 0 ms, write 0 ms, index 977 ms: 9 candidates, 75941 repo-hours, 708 releases; waiting 295 ms; commit 0 ms)
2026-11-08T15:37:36Z [load_day 2026-03-18] 2026-03-18: repo_hour merged from 24 files to 1 (2013466 rows, 9787 ms)
2026-11-08T15:37:39Z [load_day 2026-03-18] 2026-03-18: index committed in 13026 ms (24 + 1 + 24 files)
2026-11-08T15:37:39Z [load_day 2026-03-18] 2026-03-18: 3682684 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:37:39Z [load_day 2026-03-18] attempt 1 succeeded