orcaLog in

Runs · run 4524

load_day 2025-10-20, attempt 1 succeeded

Host
73ccef5e07c2:394974
Started
2026-11-08T14:15:23Z
Ended
2026-11-08T14:16:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
665 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.3 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4524/load_day/2025-10-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:15:23Z [load_day 2025-10-20] attempt 1 started
2026-11-08T14:15:24Z [load_day 2025-10-20] 2025-10-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:15:28Z [load_day 2025-10-20] 2025-10-20 hour 0: 138276 events in 0 files, snapshot none (task 3547 ms: download 2443 ms overlapping gunzip 501 ms, parse 1549 ms, sort 0 ms, write 0 ms, index 522 ms: 5 candidates, 61192 repo-hours, 733 releases; waiting 698 ms; commit 0 ms)
2026-11-08T14:15:28Z [load_day 2025-10-20] 2025-10-20 hour 1: 150143 events in 0 files, snapshot none (task 3097 ms: download 1742 ms overlapping gunzip 432 ms, parse 1397 ms, sort 0 ms, write 0 ms, index 591 ms: 2 candidates, 81286 repo-hours, 527 releases; waiting 376 ms; commit 0 ms)
2026-11-08T14:15:32Z [load_day 2025-10-20] 2025-10-20 hour 2: 144346 events in 0 files, snapshot none (task 3808 ms: download 2326 ms overlapping gunzip 577 ms, parse 1873 ms, sort 0 ms, write 0 ms, index 520 ms: 7 candidates, 65964 repo-hours, 511 releases; waiting 541 ms; commit 0 ms)
2026-11-08T14:15:32Z [load_day 2025-10-20] 2025-10-20 hour 3: 145016 events in 0 files, snapshot none (task 3530 ms: download 2382 ms overlapping gunzip 584 ms, parse 1639 ms, sort 0 ms, write 0 ms, index 497 ms: 1 candidates, 63564 repo-hours, 1420 releases; waiting 518 ms; commit 0 ms)
2026-11-08T14:15:36Z [load_day 2025-10-20] 2025-10-20 hour 4: 144454 events in 0 files, snapshot none (task 3241 ms: download 2347 ms overlapping gunzip 504 ms, parse 1450 ms, sort 0 ms, write 0 ms, index 427 ms: 4 candidates, 56483 repo-hours, 496 releases; waiting 579 ms; commit 0 ms)
2026-11-08T14:15:36Z [load_day 2025-10-20] 2025-10-20 hour 5: 147281 events in 0 files, snapshot none (task 3357 ms: download 2223 ms overlapping gunzip 471 ms, parse 1481 ms, sort 0 ms, write 0 ms, index 415 ms: 7 candidates, 60004 repo-hours, 450 releases; waiting 562 ms; commit 0 ms)
2026-11-08T14:15:40Z [load_day 2025-10-20] 2025-10-20 hour 6: 144090 events in 0 files, snapshot none (task 3526 ms: download 2270 ms overlapping gunzip 467 ms, parse 1523 ms, sort 0 ms, write 0 ms, index 586 ms: 6 candidates, 69330 repo-hours, 489 releases; waiting 556 ms; commit 0 ms)
2026-11-08T14:15:40Z [load_day 2025-10-20] 2025-10-20 hour 7: 144530 events in 0 files, snapshot none (task 3895 ms: download 2842 ms overlapping gunzip 495 ms, parse 1438 ms, sort 0 ms, write 0 ms, index 568 ms: 2 candidates, 66738 repo-hours, 443 releases; waiting 1065 ms; commit 0 ms)
2026-11-08T14:15:44Z [load_day 2025-10-20] 2025-10-20 hour 8: 142490 events in 0 files, snapshot none (task 3283 ms: download 2123 ms overlapping gunzip 500 ms, parse 1569 ms, sort 0 ms, write 0 ms, index 561 ms: 2 candidates, 68062 repo-hours, 474 releases; waiting 298 ms; commit 0 ms)
2026-11-08T14:15:44Z [load_day 2025-10-20] 2025-10-20 hour 9: 143545 events in 0 files, snapshot none (task 3532 ms: download 2101 ms overlapping gunzip 544 ms, parse 1578 ms, sort 0 ms, write 0 ms, index 595 ms: 5 candidates, 69557 repo-hours, 515 releases; waiting 591 ms; commit 0 ms)
2026-11-08T14:15:48Z [load_day 2025-10-20] 2025-10-20 hour 10: 144259 events in 0 files, snapshot none (task 3843 ms: download 2339 ms overlapping gunzip 589 ms, parse 1652 ms, sort 0 ms, write 0 ms, index 569 ms: 2 candidates, 69350 repo-hours, 553 releases; waiting 606 ms; commit 0 ms)
2026-11-08T14:15:48Z [load_day 2025-10-20] 2025-10-20 hour 11: 148331 events in 0 files, snapshot none (task 3365 ms: download 2229 ms overlapping gunzip 481 ms, parse 1453 ms, sort 0 ms, write 0 ms, index 547 ms: 4 candidates, 67924 repo-hours, 475 releases; waiting 571 ms; commit 0 ms)
2026-11-08T14:15:52Z [load_day 2025-10-20] 2025-10-20 hour 12: 155832 events in 0 files, snapshot none (task 3580 ms: download 2285 ms overlapping gunzip 403 ms, parse 1428 ms, sort 0 ms, write 0 ms, index 710 ms: 2 candidates, 92770 repo-hours, 360 releases; waiting 766 ms; commit 0 ms)
2026-11-08T14:15:52Z [load_day 2025-10-20] 2025-10-20 hour 13: 149007 events in 0 files, snapshot none (task 3405 ms: download 2285 ms overlapping gunzip 439 ms, parse 1336 ms, sort 0 ms, write 0 ms, index 656 ms: 3 candidates, 84451 repo-hours, 343 releases; waiting 635 ms; commit 0 ms)
2026-11-08T14:15:56Z [load_day 2025-10-20] 2025-10-20 hour 14: 148248 events in 0 files, snapshot none (task 3639 ms: download 1869 ms overlapping gunzip 447 ms, parse 1418 ms, sort 0 ms, write 0 ms, index 1016 ms: 9 candidates, 77624 repo-hours, 438 releases; waiting 473 ms; commit 0 ms)
2026-11-08T14:15:56Z [load_day 2025-10-20] 2025-10-20 hour 15: 149127 events in 0 files, snapshot none (task 3872 ms: download 2367 ms overlapping gunzip 567 ms, parse 1664 ms, sort 0 ms, write 0 ms, index 711 ms: 4 candidates, 76877 repo-hours, 446 releases; waiting 561 ms; commit 0 ms)
2026-11-08T14:16:01Z [load_day 2025-10-20] 2025-10-20 hour 16: 145854 events in 0 files, snapshot none (task 4549 ms: download 3198 ms overlapping gunzip 754 ms, parse 2300 ms, sort 0 ms, write 0 ms, index 661 ms: 3 candidates, 72983 repo-hours, 513 releases; waiting 582 ms; commit 0 ms)
2026-11-08T14:16:01Z [load_day 2025-10-20] 2025-10-20 hour 17: 147094 events in 0 files, snapshot none (task 4318 ms: download 2416 ms overlapping gunzip 697 ms, parse 2135 ms, sort 0 ms, write 0 ms, index 667 ms: 5 candidates, 70415 repo-hours, 513 releases; waiting 515 ms; commit 0 ms)
2026-11-08T14:16:06Z [load_day 2025-10-20] 2025-10-20 hour 18: 148741 events in 0 files, snapshot none (task 4546 ms: download 2356 ms overlapping gunzip 776 ms, parse 2241 ms, sort 0 ms, write 0 ms, index 746 ms: 3 candidates, 77789 repo-hours, 556 releases; waiting 521 ms; commit 0 ms)
2026-11-08T14:16:06Z [load_day 2025-10-20] 2025-10-20 hour 19: 144125 events in 0 files, snapshot none (task 4170 ms: download 2088 ms overlapping gunzip 748 ms, parse 2245 ms, sort 0 ms, write 0 ms, index 656 ms: 4 candidates, 68555 repo-hours, 555 releases; waiting 181 ms; commit 0 ms)
2026-11-08T14:16:11Z [load_day 2025-10-20] 2025-10-20 hour 20: 145737 events in 0 files, snapshot none (task 3695 ms: download 2007 ms overlapping gunzip 501 ms, parse 1509 ms, sort 0 ms, write 0 ms, index 962 ms: 7 candidates, 68026 repo-hours, 609 releases; waiting 508 ms; commit 0 ms)
2026-11-08T14:16:11Z [load_day 2025-10-20] 2025-10-20 hour 21: 144152 events in 0 files, snapshot none (task 3111 ms: download 2095 ms overlapping gunzip 471 ms, parse 1348 ms, sort 0 ms, write 0 ms, index 444 ms: 4 candidates, 64443 repo-hours, 555 releases; waiting 538 ms; commit 0 ms)
2026-11-08T14:16:14Z [load_day 2025-10-20] 2025-10-20 hour 22: 144855 events in 0 files, snapshot none (task 3254 ms: download 2267 ms overlapping gunzip 423 ms, parse 1360 ms, sort 0 ms, write 0 ms, index 463 ms: 3 candidates, 64503 repo-hours, 683 releases; waiting 736 ms; commit 0 ms)
2026-11-08T14:16:14Z [load_day 2025-10-20] 2025-10-20 hour 23: 143022 events in 0 files, snapshot none (task 3300 ms: download 2319 ms overlapping gunzip 439 ms, parse 1333 ms, sort 0 ms, write 0 ms, index 427 ms: 4 candidates, 61184 repo-hours, 554 releases; waiting 823 ms; commit 0 ms)
2026-11-08T14:16:22Z [load_day 2025-10-20] 2025-10-20: repo_hour merged from 24 files to 1 (1679074 rows, 7429 ms)
2026-11-08T14:16:25Z [load_day 2025-10-20] 2025-10-20: index committed in 10428 ms (24 + 1 + 24 files)
2026-11-08T14:16:25Z [load_day 2025-10-20] 2025-10-20: 3502555 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:16:25Z [load_day 2025-10-20] attempt 1 succeeded