orcaLog in

Runs · run 2888

load_day 2024-08-25, attempt 1 succeeded

Host
73ccef5e07c2:169195
Started
2026-11-08T07:36:13Z
Ended
2026-11-08T07:37:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
629 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
107.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2888/load_day/2024-08-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:36:13Z [load_day 2024-08-25] attempt 1 started
2026-11-08T07:36:14Z [load_day 2024-08-25] 2024-08-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:36:21Z [load_day 2024-08-25] 2024-08-25 hour 0: 148865 events in 0 files, snapshot none (task 6260 ms: download 4354 ms overlapping gunzip 699 ms, parse 3080 ms, sort 0 ms, write 0 ms, index 635 ms: 6 candidates, 73965 repo-hours, 1031 releases; waiting 1356 ms; commit 0 ms)
2026-11-08T07:36:21Z [load_day 2024-08-25] 2024-08-25 hour 1: 158160 events in 0 files, snapshot none (task 5253 ms: download 3172 ms overlapping gunzip 625 ms, parse 2893 ms, sort 0 ms, write 0 ms, index 768 ms: 2 candidates, 88595 repo-hours, 788 releases; waiting 759 ms; commit 0 ms)
2026-11-08T07:36:26Z [load_day 2024-08-25] 2024-08-25 hour 2: 131491 events in 0 files, snapshot none (task 4610 ms: download 2140 ms overlapping gunzip 621 ms, parse 2618 ms, sort 0 ms, write 0 ms, index 616 ms: 11 candidates, 54316 repo-hours, 808 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:36:26Z [load_day 2024-08-25] 2024-08-25 hour 3: 150508 events in 0 files, snapshot none (task 4972 ms: download 2507 ms overlapping gunzip 649 ms, parse 2982 ms, sort 0 ms, write 0 ms, index 415 ms: 5 candidates, 56565 repo-hours, 4697 releases; waiting 665 ms; commit 0 ms)
2026-11-08T07:36:29Z [load_day 2024-08-25] 2024-08-25 hour 4: 125070 events in 0 files, snapshot none (task 3061 ms: download 1552 ms overlapping gunzip 385 ms, parse 1710 ms, sort 0 ms, write 0 ms, index 409 ms: 2 candidates, 44625 repo-hours, 509 releases; waiting 193 ms; commit 0 ms)
2026-11-08T07:36:30Z [load_day 2024-08-25] 2024-08-25 hour 5: 126812 events in 0 files, snapshot none (task 3341 ms: download 1591 ms overlapping gunzip 395 ms, parse 1696 ms, sort 0 ms, write 0 ms, index 474 ms: 1 candidates, 47103 repo-hours, 643 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:36:34Z [load_day 2024-08-25] 2024-08-25 hour 6: 157525 events in 0 files, snapshot none (task 4373 ms: download 2205 ms overlapping gunzip 555 ms, parse 2525 ms, sort 0 ms, write 0 ms, index 502 ms: 3 candidates, 67865 repo-hours, 826 releases; waiting 449 ms; commit 0 ms)
2026-11-08T07:36:35Z [load_day 2024-08-25] 2024-08-25 hour 7: 143824 events in 0 files, snapshot none (task 4655 ms: download 2253 ms overlapping gunzip 625 ms, parse 2681 ms, sort 0 ms, write 0 ms, index 520 ms: 5 candidates, 53288 repo-hours, 548 releases; waiting 486 ms; commit 0 ms)
2026-11-08T07:36:40Z [load_day 2024-08-25] 2024-08-25 hour 8: 142813 events in 0 files, snapshot none (task 5245 ms: download 2820 ms overlapping gunzip 800 ms, parse 3228 ms, sort 0 ms, write 0 ms, index 412 ms: 4 candidates, 55447 repo-hours, 619 releases; waiting 485 ms; commit 0 ms)
2026-11-08T07:36:41Z [load_day 2024-08-25] 2024-08-25 hour 9: 156863 events in 0 files, snapshot none (task 4836 ms: download 2434 ms overlapping gunzip 701 ms, parse 2902 ms, sort 0 ms, write 0 ms, index 463 ms: 8 candidates, 62944 repo-hours, 885 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:36:46Z [load_day 2024-08-25] 2024-08-25 hour 10: 154818 events in 0 files, snapshot none (task 5283 ms: download 2751 ms overlapping gunzip 849 ms, parse 3213 ms, sort 0 ms, write 0 ms, index 424 ms: 2 candidates, 60311 repo-hours, 733 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:36:46Z [load_day 2024-08-25] 2024-08-25 hour 11: 158471 events in 0 files, snapshot none (task 4714 ms: download 2377 ms overlapping gunzip 702 ms, parse 2990 ms, sort 0 ms, write 0 ms, index 390 ms: 1 candidates, 58005 repo-hours, 735 releases; waiting 324 ms; commit 0 ms)
2026-11-08T07:36:52Z [load_day 2024-08-25] 2024-08-25 hour 12: 231834 events in 0 files, snapshot none (task 5370 ms: download 3018 ms overlapping gunzip 679 ms, parse 3155 ms, sort 0 ms, write 0 ms, index 686 ms: 4 candidates, 107008 repo-hours, 1043 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:36:52Z [load_day 2024-08-25] 2024-08-25 hour 13: 193032 events in 0 files, snapshot none (task 5293 ms: download 2709 ms overlapping gunzip 707 ms, parse 3147 ms, sort 0 ms, write 0 ms, index 623 ms: 7 candidates, 87982 repo-hours, 805 releases; waiting 539 ms; commit 0 ms)
2026-11-08T07:36:57Z [load_day 2024-08-25] 2024-08-25 hour 14: 178813 events in 0 files, snapshot none (task 4820 ms: download 2856 ms overlapping gunzip 649 ms, parse 2867 ms, sort 0 ms, write 0 ms, index 489 ms: 11 candidates, 69954 repo-hours, 874 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:36:57Z [load_day 2024-08-25] 2024-08-25 hour 15: 188100 events in 0 files, snapshot none (task 4986 ms: download 2556 ms overlapping gunzip 684 ms, parse 2952 ms, sort 0 ms, write 0 ms, index 585 ms: 5 candidates, 79454 repo-hours, 1056 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:37:03Z [load_day 2024-08-25] 2024-08-25 hour 16: 177426 events in 0 files, snapshot none (task 5709 ms: download 3294 ms overlapping gunzip 829 ms, parse 3559 ms, sort 0 ms, write 0 ms, index 511 ms: 3 candidates, 69122 repo-hours, 828 releases; waiting 535 ms; commit 0 ms)
2026-11-08T07:37:04Z [load_day 2024-08-25] 2024-08-25 hour 17: 171588 events in 0 files, snapshot none (task 5620 ms: download 3120 ms overlapping gunzip 796 ms, parse 3480 ms, sort 0 ms, write 0 ms, index 530 ms: 5 candidates, 65076 repo-hours, 817 releases; waiting 544 ms; commit 0 ms)
2026-11-08T07:37:10Z [load_day 2024-08-25] 2024-08-25 hour 18: 184854 events in 0 files, snapshot none (task 6789 ms: download 3376 ms overlapping gunzip 971 ms, parse 4130 ms, sort 0 ms, write 0 ms, index 827 ms: 3 candidates, 80743 repo-hours, 1111 releases; waiting 540 ms; commit 0 ms)
2026-11-08T07:37:10Z [load_day 2024-08-25] 2024-08-25 hour 19: 161135 events in 0 files, snapshot none (task 6207 ms: download 3084 ms overlapping gunzip 966 ms, parse 4001 ms, sort 0 ms, write 0 ms, index 434 ms: 3 candidates, 58288 repo-hours, 888 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:37:17Z [load_day 2024-08-25] 2024-08-25 hour 20: 161592 events in 0 files, snapshot none (task 5640 ms: download 2473 ms overlapping gunzip 797 ms, parse 3501 ms, sort 0 ms, write 0 ms, index 612 ms: 6 candidates, 61891 repo-hours, 820 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:37:17Z [load_day 2024-08-25] 2024-08-25 hour 21: 159848 events in 0 files, snapshot none (task 6271 ms: download 2222 ms overlapping gunzip 862 ms, parse 3923 ms, sort 0 ms, write 0 ms, index 718 ms: 10 candidates, 65588 repo-hours, 1131 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:37:22Z [load_day 2024-08-25] 2024-08-25 hour 22: 141769 events in 0 files, snapshot none (task 4396 ms: download 2342 ms overlapping gunzip 553 ms, parse 2531 ms, sort 0 ms, write 0 ms, index 504 ms: 5 candidates, 52003 repo-hours, 959 releases; waiting 542 ms; commit 0 ms)
2026-11-08T07:37:23Z [load_day 2024-08-25] 2024-08-25 hour 23: 138896 events in 0 files, snapshot none (task 5042 ms: download 2108 ms overlapping gunzip 694 ms, parse 2946 ms, sort 0 ms, write 0 ms, index 627 ms: 7 candidates, 51967 repo-hours, 640 releases; waiting 507 ms; commit 0 ms)
2026-11-08T07:37:30Z [load_day 2024-08-25] 2024-08-25: repo_hour merged from 24 files to 1 (1572105 rows, 7313 ms)
2026-11-08T07:37:33Z [load_day 2024-08-25] 2024-08-25: index committed in 10088 ms (24 + 1 + 24 files)
2026-11-08T07:37:33Z [load_day 2024-08-25] 2024-08-25: 3844107 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:37:33Z [load_day 2024-08-25] attempt 1 succeeded