orcaLog in

Runs · run 1866

load_day 2023-12-17, attempt 1 succeeded

Host
73ccef5e07c2:10358
Started
2026-11-08T03:48:01Z
Ended
2026-11-08T03:49:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
581 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
95.5 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1866/load_day/2023-12-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:48:01Z [load_day 2023-12-17] attempt 1 started
2026-11-08T03:48:02Z [load_day 2023-12-17] 2023-12-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:48:06Z [load_day 2023-12-17] 2023-12-17 hour 0: 141657 events in 0 files, snapshot none (task 3940 ms: download 2079 ms overlapping gunzip 489 ms, parse 2193 ms, sort 0 ms, write 0 ms, index 476 ms: 7 candidates, 64905 repo-hours, 928 releases; waiting 477 ms; commit 0 ms)
2026-11-08T03:48:06Z [load_day 2023-12-17] 2023-12-17 hour 1: 136627 events in 0 files, snapshot none (task 3975 ms: download 1756 ms overlapping gunzip 451 ms, parse 2090 ms, sort 0 ms, write 0 ms, index 614 ms: 4 candidates, 74990 repo-hours, 745 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:48:10Z [load_day 2023-12-17] 2023-12-17 hour 2: 100678 events in 0 files, snapshot none (task 3159 ms: download 2287 ms overlapping gunzip 354 ms, parse 1538 ms, sort 0 ms, write 0 ms, index 318 ms: 3 candidates, 41054 repo-hours, 547 releases; waiting 603 ms; commit 0 ms)
2026-11-08T03:48:10Z [load_day 2023-12-17] 2023-12-17 hour 3: 101150 events in 0 files, snapshot none (task 2812 ms: download 1524 ms overlapping gunzip 345 ms, parse 1466 ms, sort 0 ms, write 0 ms, index 316 ms: 6 candidates, 39727 repo-hours, 611 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:48:14Z [load_day 2023-12-17] 2023-12-17 hour 4: 103640 events in 0 files, snapshot none (task 3514 ms: download 1762 ms overlapping gunzip 392 ms, parse 1823 ms, sort 0 ms, write 0 ms, index 454 ms: 4 candidates, 40204 repo-hours, 492 releases; waiting 516 ms; commit 0 ms)
2026-11-08T03:48:14Z [load_day 2023-12-17] 2023-12-17 hour 5: 105718 events in 0 files, snapshot none (task 3360 ms: download 1996 ms overlapping gunzip 424 ms, parse 1743 ms, sort 0 ms, write 0 ms, index 408 ms: 6 candidates, 42979 repo-hours, 463 releases; waiting 432 ms; commit 0 ms)
2026-11-08T03:48:18Z [load_day 2023-12-17] 2023-12-17 hour 6: 119902 events in 0 files, snapshot none (task 3811 ms: download 1771 ms overlapping gunzip 563 ms, parse 2133 ms, sort 0 ms, write 0 ms, index 345 ms: 3 candidates, 50771 repo-hours, 603 releases; waiting 513 ms; commit 0 ms)
2026-11-08T03:48:18Z [load_day 2023-12-17] 2023-12-17 hour 7: 118417 events in 0 files, snapshot none (task 3784 ms: download 2144 ms overlapping gunzip 505 ms, parse 2100 ms, sort 0 ms, write 0 ms, index 351 ms: 3 candidates, 46130 repo-hours, 485 releases; waiting 525 ms; commit 0 ms)
2026-11-08T03:48:23Z [load_day 2023-12-17] 2023-12-17 hour 8: 121798 events in 0 files, snapshot none (task 4595 ms: download 2329 ms overlapping gunzip 621 ms, parse 2685 ms, sort 0 ms, write 0 ms, index 443 ms: 9 candidates, 49437 repo-hours, 616 releases; waiting 519 ms; commit 0 ms)
2026-11-08T03:48:23Z [load_day 2023-12-17] 2023-12-17 hour 9: 127263 events in 0 files, snapshot none (task 4648 ms: download 2746 ms overlapping gunzip 654 ms, parse 2794 ms, sort 0 ms, write 0 ms, index 418 ms: 3 candidates, 51005 repo-hours, 761 releases; waiting 508 ms; commit 0 ms)
2026-11-08T03:48:28Z [load_day 2023-12-17] 2023-12-17 hour 10: 133011 events in 0 files, snapshot none (task 4580 ms: download 2417 ms overlapping gunzip 576 ms, parse 2529 ms, sort 0 ms, write 0 ms, index 590 ms: 5 candidates, 54735 repo-hours, 603 releases; waiting 528 ms; commit 0 ms)
2026-11-08T03:48:28Z [load_day 2023-12-17] 2023-12-17 hour 11: 131880 events in 0 files, snapshot none (task 4166 ms: download 2180 ms overlapping gunzip 499 ms, parse 2349 ms, sort 0 ms, write 0 ms, index 511 ms: 4 candidates, 53092 repo-hours, 645 releases; waiting 527 ms; commit 0 ms)
2026-11-08T03:48:34Z [load_day 2023-12-17] 2023-12-17 hour 12: 207729 events in 0 files, snapshot none (task 5842 ms: download 2401 ms overlapping gunzip 629 ms, parse 3077 ms, sort 0 ms, write 0 ms, index 1130 ms: 6 candidates, 88234 repo-hours, 777 releases; waiting 695 ms; commit 0 ms)
2026-11-08T03:48:34Z [load_day 2023-12-17] 2023-12-17 hour 13: 174381 events in 0 files, snapshot none (task 4697 ms: download 2332 ms overlapping gunzip 574 ms, parse 2566 ms, sort 0 ms, write 0 ms, index 775 ms: 3 candidates, 81281 repo-hours, 743 releases; waiting 512 ms; commit 0 ms)
2026-11-08T03:48:40Z [load_day 2023-12-17] 2023-12-17 hour 14: 155339 events in 0 files, snapshot none (task 4806 ms: download 2395 ms overlapping gunzip 665 ms, parse 2896 ms, sort 0 ms, write 0 ms, index 548 ms: 6 candidates, 65176 repo-hours, 799 releases; waiting 493 ms; commit 0 ms)
2026-11-08T03:48:40Z [load_day 2023-12-17] 2023-12-17 hour 15: 160490 events in 0 files, snapshot none (task 5532 ms: download 3431 ms overlapping gunzip 691 ms, parse 3052 ms, sort 0 ms, write 0 ms, index 657 ms: 8 candidates, 68419 repo-hours, 884 releases; waiting 787 ms; commit 0 ms)
2026-11-08T03:48:47Z [load_day 2023-12-17] 2023-12-17 hour 16: 153997 events in 0 files, snapshot none (task 6588 ms: download 3193 ms overlapping gunzip 885 ms, parse 4214 ms, sort 0 ms, write 0 ms, index 588 ms: 5 candidates, 65393 repo-hours, 901 releases; waiting 626 ms; commit 0 ms)
2026-11-08T03:48:47Z [load_day 2023-12-17] 2023-12-17 hour 17: 149563 events in 0 files, snapshot none (task 6087 ms: download 2761 ms overlapping gunzip 853 ms, parse 3989 ms, sort 0 ms, write 0 ms, index 540 ms: 11 candidates, 60966 repo-hours, 731 releases; waiting 490 ms; commit 0 ms)
2026-11-08T03:48:53Z [load_day 2023-12-17] 2023-12-17 hour 18: 154278 events in 0 files, snapshot none (task 5708 ms: download 2571 ms overlapping gunzip 757 ms, parse 3274 ms, sort 0 ms, write 0 ms, index 792 ms: 2 candidates, 66527 repo-hours, 1222 releases; waiting 516 ms; commit 0 ms)
2026-11-08T03:48:53Z [load_day 2023-12-17] 2023-12-17 hour 19: 143300 events in 0 files, snapshot none (task 5146 ms: download 2555 ms overlapping gunzip 691 ms, parse 2999 ms, sort 0 ms, write 0 ms, index 641 ms: 4 candidates, 55782 repo-hours, 780 releases; waiting 533 ms; commit 0 ms)
2026-11-08T03:48:58Z [load_day 2023-12-17] 2023-12-17 hour 20: 144674 events in 0 files, snapshot none (task 4926 ms: download 2672 ms overlapping gunzip 696 ms, parse 3043 ms, sort 0 ms, write 0 ms, index 404 ms: 5 candidates, 56097 repo-hours, 903 releases; waiting 454 ms; commit 0 ms)
2026-11-08T03:48:58Z [load_day 2023-12-17] 2023-12-17 hour 21: 133781 events in 0 files, snapshot none (task 4661 ms: download 2229 ms overlapping gunzip 666 ms, parse 2841 ms, sort 0 ms, write 0 ms, index 359 ms: 5 candidates, 51470 repo-hours, 942 releases; waiting 507 ms; commit 0 ms)
2026-11-08T03:49:04Z [load_day 2023-12-17] 2023-12-17 hour 22: 127184 events in 0 files, snapshot none (task 5347 ms: download 2776 ms overlapping gunzip 721 ms, parse 3209 ms, sort 0 ms, write 0 ms, index 496 ms: 6 candidates, 49108 repo-hours, 810 releases; waiting 556 ms; commit 0 ms)
2026-11-08T03:49:04Z [load_day 2023-12-17] 2023-12-17 hour 23: 117919 events in 0 files, snapshot none (task 4966 ms: download 2673 ms overlapping gunzip 708 ms, parse 2929 ms, sort 0 ms, write 0 ms, index 504 ms: 3 candidates, 44937 repo-hours, 747 releases; waiting 509 ms; commit 0 ms)
2026-11-08T03:49:10Z [load_day 2023-12-17] 2023-12-17: repo_hour merged from 24 files to 1 (1362419 rows, 6135 ms)
2026-11-08T03:49:12Z [load_day 2023-12-17] 2023-12-17: index committed in 8813 ms (24 + 1 + 24 files)
2026-11-08T03:49:12Z [load_day 2023-12-17] 2023-12-17: 3264376 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:49:12Z [load_day 2023-12-17] attempt 1 succeeded