load_day 2024-02-20, attempt 1 succeeded

Rerun from here

Log in to rerun from here

Host

73ccef5e07c2:88884

Started

2026-11-08T04:44:18Z

Ended

2026-11-08T04:46:33Z

Peak memory?The most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗

801 MB

CPU used?The CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗

194.9 s, up to 2.9 cores at once

Log file

s3://census-mlake-dev/logs/gharchive/2105/load_day/2024-02-20/1.log

Code

pipelines/gharchive.mojo:135↗

2026-11-08T04:44:18Z [load_day 2024-02-20] attempt 1 started
2026-11-08T04:44:19Z [load_day 2024-02-20] 2024-02-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:44:28Z [load_day 2024-02-20] 2024-02-20 hour 0: 251891 events in 0 files, snapshot none (task 8791 ms: download 5537 ms overlapping gunzip 1356 ms, parse 5916 ms, sort 0 ms, write 0 ms, index 831 ms: 7 candidates, 95963 repo-hours, 1106 releases; waiting 472 ms; commit 0 ms)
2026-11-08T04:44:28Z [load_day 2024-02-20] 2024-02-20 hour 1: 245581 events in 0 files, snapshot none (task 8335 ms: download 4943 ms overlapping gunzip 1227 ms, parse 5372 ms, sort 0 ms, write 0 ms, index 831 ms: 11 candidates, 95264 repo-hours, 743 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:44:37Z [load_day 2024-02-20] 2024-02-20 hour 2: 215780 events in 0 files, snapshot none (task 8431 ms: download 4357 ms overlapping gunzip 1271 ms, parse 5499 ms, sort 0 ms, write 0 ms, index 864 ms: 7 candidates, 65014 repo-hours, 792 releases; waiting 488 ms; commit 0 ms)
2026-11-08T04:44:37Z [load_day 2024-02-20] 2024-02-20 hour 3: 217703 events in 0 files, snapshot none (task 7823 ms: download 4243 ms overlapping gunzip 1260 ms, parse 5049 ms, sort 0 ms, write 0 ms, index 699 ms: 9 candidates, 64394 repo-hours, 834 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:44:46Z [load_day 2024-02-20] 2024-02-20 hour 4: 211641 events in 0 files, snapshot none (task 8596 ms: download 4618 ms overlapping gunzip 1337 ms, parse 5743 ms, sort 0 ms, write 0 ms, index 708 ms: 2 candidates, 60558 repo-hours, 668 releases; waiting 478 ms; commit 0 ms)
2026-11-08T04:44:46Z [load_day 2024-02-20] 2024-02-20 hour 5: 218527 events in 0 files, snapshot none (task 8133 ms: download 4941 ms overlapping gunzip 1283 ms, parse 5282 ms, sort 0 ms, write 0 ms, index 696 ms: 3 candidates, 65589 repo-hours, 693 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:44:55Z [load_day 2024-02-20] 2024-02-20 hour 6: 241367 events in 0 files, snapshot none (task 8080 ms: download 4780 ms overlapping gunzip 1240 ms, parse 5314 ms, sort 0 ms, write 0 ms, index 723 ms: 5 candidates, 80957 repo-hours, 953 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:44:55Z [load_day 2024-02-20] 2024-02-20 hour 7: 244515 events in 0 files, snapshot none (task 8437 ms: download 5380 ms overlapping gunzip 1371 ms, parse 5497 ms, sort 0 ms, write 0 ms, index 810 ms: 5 candidates, 78274 repo-hours, 805 releases; waiting 483 ms; commit 0 ms)
2026-11-08T04:45:06Z [load_day 2024-02-20] 2024-02-20 hour 8: 249855 events in 0 files, snapshot none (task 10792 ms: download 7311 ms overlapping gunzip 1736 ms, parse 7334 ms, sort 0 ms, write 0 ms, index 784 ms: 9 candidates, 85521 repo-hours, 974 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:45:06Z [load_day 2024-02-20] 2024-02-20 hour 9: 271448 events in 0 files, snapshot none (task 10354 ms: download 7321 ms overlapping gunzip 1703 ms, parse 7161 ms, sort 0 ms, write 0 ms, index 744 ms: 5 candidates, 91731 repo-hours, 1325 releases; waiting 531 ms; commit 0 ms)
2026-11-08T04:45:19Z [load_day 2024-02-20] 2024-02-20 hour 10: 269768 events in 0 files, snapshot none (task 11677 ms: download 8033 ms overlapping gunzip 1931 ms, parse 8358 ms, sort 0 ms, write 0 ms, index 651 ms: 10 candidates, 90033 repo-hours, 1121 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:45:19Z [load_day 2024-02-20] 2024-02-20 hour 11: 276718 events in 0 files, snapshot none (task 10772 ms: download 6881 ms overlapping gunzip 1756 ms, parse 7378 ms, sort 0 ms, write 0 ms, index 900 ms: 4 candidates, 85036 repo-hours, 1040 releases; waiting 523 ms; commit 0 ms)
2026-11-08T04:45:30Z [load_day 2024-02-20] 2024-02-20 hour 12: 315311 events in 0 files, snapshot none (task 10326 ms: download 6710 ms overlapping gunzip 1549 ms, parse 7178 ms, sort 0 ms, write 0 ms, index 812 ms: 10 candidates, 115650 repo-hours, 1238 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:45:30Z [load_day 2024-02-20] 2024-02-20 hour 13: 300794 events in 0 files, snapshot none (task 10406 ms: download 7373 ms overlapping gunzip 1725 ms, parse 7040 ms, sort 0 ms, write 0 ms, index 833 ms: 9 candidates, 109032 repo-hours, 1118 releases; waiting 484 ms; commit 0 ms)
2026-11-08T04:45:41Z [load_day 2024-02-20] 2024-02-20 hour 14: 302041 events in 0 files, snapshot none (task 10923 ms: download 7780 ms overlapping gunzip 1764 ms, parse 7340 ms, sort 0 ms, write 0 ms, index 978 ms: 5 candidates, 103302 repo-hours, 1191 releases; waiting 575 ms; commit 0 ms)
2026-11-08T04:45:43Z [load_day 2024-02-20] 2024-02-20 hour 15: 303380 events in 0 files, snapshot none (task 12747 ms: download 9413 ms overlapping gunzip 1997 ms, parse 8702 ms, sort 0 ms, write 0 ms, index 1199 ms: 12 candidates, 112011 repo-hours, 1291 releases; waiting 560 ms; commit 0 ms)
2026-11-08T04:45:52Z [load_day 2024-02-20] 2024-02-20 hour 16: 302031 events in 0 files, snapshot none (task 10826 ms: download 7939 ms overlapping gunzip 1698 ms, parse 7412 ms, sort 0 ms, write 0 ms, index 918 ms: 14 candidates, 114944 repo-hours, 1061 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:45:53Z [load_day 2024-02-20] 2024-02-20 hour 17: 292475 events in 0 files, snapshot none (task 9561 ms: download 6774 ms overlapping gunzip 1541 ms, parse 6285 ms, sort 0 ms, write 0 ms, index 690 ms: 14 candidates, 93086 repo-hours, 1063 releases; waiting 518 ms; commit 0 ms)
2026-11-08T04:46:01Z [load_day 2024-02-20] 2024-02-20 hour 18: 289463 events in 0 files, snapshot none (task 8151 ms: download 5675 ms overlapping gunzip 1283 ms, parse 5368 ms, sort 0 ms, write 0 ms, index 723 ms: 11 candidates, 97411 repo-hours, 1196 releases; waiting 543 ms; commit 0 ms)
2026-11-08T04:46:01Z [load_day 2024-02-20] 2024-02-20 hour 19: 278677 events in 0 files, snapshot none (task 7842 ms: download 5334 ms overlapping gunzip 1261 ms, parse 5177 ms, sort 0 ms, write 0 ms, index 628 ms: 7 candidates, 86481 repo-hours, 1010 releases; waiting 540 ms; commit 0 ms)
2026-11-08T04:46:12Z [load_day 2024-02-20] 2024-02-20 hour 20: 283975 events in 0 files, snapshot none (task 10850 ms: download 7531 ms overlapping gunzip 1654 ms, parse 7631 ms, sort 0 ms, write 0 ms, index 830 ms: 10 candidates, 130272 repo-hours, 876 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:46:12Z [load_day 2024-02-20] 2024-02-20 hour 21: 266883 events in 0 files, snapshot none (task 10331 ms: download 7519 ms overlapping gunzip 1724 ms, parse 7186 ms, sort 0 ms, write 0 ms, index 676 ms: 9 candidates, 79660 repo-hours, 983 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:46:22Z [load_day 2024-02-20] 2024-02-20 hour 22: 253649 events in 0 files, snapshot none (task 8960 ms: download 6343 ms overlapping gunzip 1446 ms, parse 6253 ms, sort 0 ms, write 0 ms, index 539 ms: 8 candidates, 71844 repo-hours, 1034 releases; waiting 533 ms; commit 0 ms)
2026-11-08T04:46:22Z [load_day 2024-02-20] 2024-02-20 hour 23: 236997 events in 0 files, snapshot none (task 8194 ms: download 5159 ms overlapping gunzip 1262 ms, parse 5361 ms, sort 0 ms, write 0 ms, index 758 ms: 5 candidates, 65594 repo-hours, 721 releases; waiting 535 ms; commit 0 ms)
2026-11-08T04:46:31Z [load_day 2024-02-20] 2024-02-20: repo_hour merged from 24 files to 1 (2137621 rows, 8944 ms)
2026-11-08T04:46:33Z [load_day 2024-02-20] 2024-02-20: index committed in 11596 ms (24 + 1 + 24 files)
2026-11-08T04:46:33Z [load_day 2024-02-20] 2024-02-20: 6340470 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:46:33Z [load_day 2024-02-20] attempt 1 succeeded