orcaLog in

Runs · run 3525

load_day 2025-02-06, attempt 1 succeeded

Host
73ccef5e07c2:250106
Started
2026-11-08T10:11:28Z
Ended
2026-11-08T10:13:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
730 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
199.2 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3525/load_day/2025-02-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:11:28Z [load_day 2025-02-06] attempt 1 started
2026-11-08T10:11:29Z [load_day 2025-02-06] 2025-02-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:11:37Z [load_day 2025-02-06] 2025-02-06 hour 0: 203284 events in 0 files, snapshot none (task 7685 ms: download 5098 ms overlapping gunzip 1187 ms, parse 5071 ms, sort 0 ms, write 0 ms, index 686 ms: 10 candidates, 98453 repo-hours, 1396 releases; waiting 486 ms; commit 0 ms)
2026-11-08T10:11:38Z [load_day 2025-02-06] 2025-02-06 hour 1: 220655 events in 0 files, snapshot none (task 8184 ms: download 5300 ms overlapping gunzip 1280 ms, parse 5507 ms, sort 0 ms, write 0 ms, index 891 ms: 8 candidates, 117483 repo-hours, 1262 releases; waiting 215 ms; commit 0 ms)
2026-11-08T10:11:48Z [load_day 2025-02-06] 2025-02-06 hour 2: 194543 events in 0 files, snapshot none (task 9542 ms: download 6194 ms overlapping gunzip 1531 ms, parse 6251 ms, sort 0 ms, write 0 ms, index 1018 ms: 6 candidates, 85736 repo-hours, 1312 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:11:48Z [load_day 2025-02-06] 2025-02-06 hour 3: 209459 events in 0 files, snapshot none (task 9014 ms: download 5275 ms overlapping gunzip 1368 ms, parse 6087 ms, sort 0 ms, write 0 ms, index 765 ms: 4 candidates, 82923 repo-hours, 4071 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:11:56Z [load_day 2025-02-06] 2025-02-06 hour 4: 190885 events in 0 files, snapshot none (task 7827 ms: download 4671 ms overlapping gunzip 1217 ms, parse 5146 ms, sort 0 ms, write 0 ms, index 714 ms: 7 candidates, 70796 repo-hours, 1088 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:11:57Z [load_day 2025-02-06] 2025-02-06 hour 5: 199166 events in 0 files, snapshot none (task 8842 ms: download 5405 ms overlapping gunzip 1380 ms, parse 5845 ms, sort 0 ms, write 0 ms, index 779 ms: 7 candidates, 75746 repo-hours, 1134 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:12:04Z [load_day 2025-02-06] 2025-02-06 hour 6: 222057 events in 0 files, snapshot none (task 7667 ms: download 4466 ms overlapping gunzip 1101 ms, parse 4742 ms, sort 0 ms, write 0 ms, index 867 ms: 4 candidates, 96146 repo-hours, 1268 releases; waiting 739 ms; commit 0 ms)
2026-11-08T10:12:06Z [load_day 2025-02-06] 2025-02-06 hour 7: 220692 events in 0 files, snapshot none (task 8348 ms: download 5011 ms overlapping gunzip 1320 ms, parse 5536 ms, sort 0 ms, write 0 ms, index 800 ms: 9 candidates, 87143 repo-hours, 1228 releases; waiting 361 ms; commit 0 ms)
2026-11-08T10:12:14Z [load_day 2025-02-06] 2025-02-06 hour 8: 219170 events in 0 files, snapshot none (task 8669 ms: download 5923 ms overlapping gunzip 1423 ms, parse 5937 ms, sort 0 ms, write 0 ms, index 656 ms: 9 candidates, 93719 repo-hours, 1199 releases; waiting 341 ms; commit 0 ms)
2026-11-08T10:12:15Z [load_day 2025-02-06] 2025-02-06 hour 9: 195973 events in 0 files, snapshot none (task 8042 ms: download 5197 ms overlapping gunzip 1198 ms, parse 5139 ms, sort 0 ms, write 0 ms, index 698 ms: 7 candidates, 91309 repo-hours, 1031 releases; waiting 467 ms; commit 0 ms)
2026-11-08T10:12:23Z [load_day 2025-02-06] 2025-02-06 hour 10: 214179 events in 0 files, snapshot none (task 9162 ms: download 6303 ms overlapping gunzip 1468 ms, parse 6287 ms, sort 0 ms, write 0 ms, index 687 ms: 6 candidates, 93539 repo-hours, 1181 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:12:25Z [load_day 2025-02-06] 2025-02-06 hour 11: 243790 events in 0 files, snapshot none (task 9472 ms: download 7010 ms overlapping gunzip 1536 ms, parse 6558 ms, sort 0 ms, write 0 ms, index 713 ms: 8 candidates, 95282 repo-hours, 1345 releases; waiting 441 ms; commit 0 ms)
2026-11-08T10:12:34Z [load_day 2025-02-06] 2025-02-06 hour 12: 284170 events in 0 files, snapshot none (task 10381 ms: download 6493 ms overlapping gunzip 1538 ms, parse 6736 ms, sort 0 ms, write 0 ms, index 1293 ms: 13 candidates, 141773 repo-hours, 1495 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:12:36Z [load_day 2025-02-06] 2025-02-06 hour 13: 271252 events in 0 files, snapshot none (task 10711 ms: download 7863 ms overlapping gunzip 1640 ms, parse 7339 ms, sort 0 ms, write 0 ms, index 919 ms: 12 candidates, 122365 repo-hours, 1380 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:12:45Z [load_day 2025-02-06] 2025-02-06 hour 14: 256954 events in 0 files, snapshot none (task 10335 ms: download 7377 ms overlapping gunzip 1614 ms, parse 7419 ms, sort 0 ms, write 0 ms, index 873 ms: 10 candidates, 107350 repo-hours, 1386 releases; waiting 184 ms; commit 0 ms)
2026-11-08T10:12:46Z [load_day 2025-02-06] 2025-02-06 hour 15: 256961 events in 0 files, snapshot none (task 10253 ms: download 7587 ms overlapping gunzip 1692 ms, parse 6960 ms, sort 0 ms, write 0 ms, index 825 ms: 6 candidates, 113315 repo-hours, 1447 releases; waiting 513 ms; commit 0 ms)
2026-11-08T10:12:54Z [load_day 2025-02-06] 2025-02-06 hour 16: 254897 events in 0 files, snapshot none (task 8494 ms: download 5309 ms overlapping gunzip 1366 ms, parse 5618 ms, sort 0 ms, write 0 ms, index 958 ms: 5 candidates, 107545 repo-hours, 1441 releases; waiting 207 ms; commit 0 ms)
2026-11-08T10:12:57Z [load_day 2025-02-06] 2025-02-06 hour 17: 249616 events in 0 files, snapshot none (task 10003 ms: download 7185 ms overlapping gunzip 1328 ms, parse 5613 ms, sort 0 ms, write 0 ms, index 912 ms: 8 candidates, 100619 repo-hours, 1371 releases; waiting 1810 ms; commit 0 ms)
2026-11-08T10:13:03Z [load_day 2025-02-06] 2025-02-06 hour 18: 254934 events in 0 files, snapshot none (task 8909 ms: download 5257 ms overlapping gunzip 1247 ms, parse 5399 ms, sort 0 ms, write 0 ms, index 1703 ms: 5 candidates, 113410 repo-hours, 1473 releases; waiting 264 ms; commit 0 ms)
2026-11-08T10:13:08Z [load_day 2025-02-06] 2025-02-06 hour 19: 230467 events in 0 files, snapshot none (task 10071 ms: download 6209 ms overlapping gunzip 1578 ms, parse 6397 ms, sort 0 ms, write 0 ms, index 1032 ms: 10 candidates, 89805 repo-hours, 1284 releases; waiting 791 ms; commit 0 ms)
2026-11-08T10:13:13Z [load_day 2025-02-06] 2025-02-06 hour 20: 228536 events in 0 files, snapshot none (task 8940 ms: download 5533 ms overlapping gunzip 1403 ms, parse 5731 ms, sort 0 ms, write 0 ms, index 1039 ms: 8 candidates, 90712 repo-hours, 1204 releases; waiting 484 ms; commit 0 ms)
2026-11-08T10:13:18Z [load_day 2025-02-06] 2025-02-06 hour 21: 231095 events in 0 files, snapshot none (task 9647 ms: download 6768 ms overlapping gunzip 1477 ms, parse 6323 ms, sort 0 ms, write 0 ms, index 852 ms: 10 candidates, 90451 repo-hours, 1335 releases; waiting 694 ms; commit 0 ms)
2026-11-08T10:13:22Z [load_day 2025-02-06] 2025-02-06 hour 22: 209240 events in 0 files, snapshot none (task 8719 ms: download 5082 ms overlapping gunzip 1364 ms, parse 5498 ms, sort 0 ms, write 0 ms, index 1058 ms: 15 candidates, 78121 repo-hours, 1345 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:13:25Z [load_day 2025-02-06] 2025-02-06 hour 23: 192479 events in 0 files, snapshot none (task 6905 ms: download 4609 ms overlapping gunzip 1086 ms, parse 4537 ms, sort 0 ms, write 0 ms, index 527 ms: 11 candidates, 71916 repo-hours, 1297 releases; waiting 445 ms; commit 0 ms)
2026-11-08T10:13:36Z [load_day 2025-02-06] 2025-02-06: repo_hour merged from 24 files to 1 (2315657 rows, 10463 ms)
2026-11-08T10:13:39Z [load_day 2025-02-06] 2025-02-06: index committed in 13753 ms (24 + 1 + 24 files)
2026-11-08T10:13:39Z [load_day 2025-02-06] 2025-02-06: 5454454 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:13:39Z [load_day 2025-02-06] attempt 1 succeeded