orcaLog in

Runs · run 3264

load_day 2024-12-01, attempt 1 succeeded

Host
73ccef5e07c2:215313
Started
2026-11-08T09:08:48Z
Ended
2026-11-08T09:10:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
671 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
189.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3264/load_day/2024-12-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:08:48Z [load_day 2024-12-01] attempt 1 started
2026-11-08T09:08:52Z [load_day 2024-12-01] 2024-12-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:08:58Z [load_day 2024-12-01] 2024-12-01 hour 0: 152289 events in 0 files, snapshot none (task 5410 ms: download 2976 ms overlapping gunzip 819 ms, parse 3260 ms, sort 0 ms, write 0 ms, index 572 ms: 3 candidates, 65747 repo-hours, 1172 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:08:59Z [load_day 2024-12-01] 2024-12-01 hour 1: 184614 events in 0 files, snapshot none (task 6596 ms: download 3975 ms overlapping gunzip 978 ms, parse 3761 ms, sort 0 ms, write 0 ms, index 752 ms: 8 candidates, 98105 repo-hours, 1055 releases; waiting 788 ms; commit 0 ms)
2026-11-08T09:09:05Z [load_day 2024-12-01] 2024-12-01 hour 2: 152423 events in 0 files, snapshot none (task 6559 ms: download 2804 ms overlapping gunzip 995 ms, parse 3808 ms, sort 0 ms, write 0 ms, index 958 ms: 3 candidates, 67712 repo-hours, 1145 releases; waiting 522 ms; commit 0 ms)
2026-11-08T09:09:09Z [load_day 2024-12-01] 2024-12-01 hour 3: 183797 events in 0 files, snapshot none (task 8844 ms: download 6177 ms overlapping gunzip 1544 ms, parse 5677 ms, sort 0 ms, write 0 ms, index 827 ms: 5 candidates, 64110 repo-hours, 3873 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:09:14Z [load_day 2024-12-01] 2024-12-01 hour 4: 180051 events in 0 files, snapshot none (task 8168 ms: download 5071 ms overlapping gunzip 1485 ms, parse 5298 ms, sort 0 ms, write 0 ms, index 501 ms: 2 candidates, 54549 repo-hours, 641 releases; waiting 534 ms; commit 0 ms)
2026-11-08T09:09:18Z [load_day 2024-12-01] 2024-12-01 hour 5: 185138 events in 0 files, snapshot none (task 8297 ms: download 5380 ms overlapping gunzip 1490 ms, parse 5176 ms, sort 0 ms, write 0 ms, index 666 ms: 1 candidates, 56566 repo-hours, 671 releases; waiting 498 ms; commit 0 ms)
2026-11-08T09:09:23Z [load_day 2024-12-01] 2024-12-01 hour 6: 197421 events in 0 files, snapshot none (task 8571 ms: download 6031 ms overlapping gunzip 1422 ms, parse 5607 ms, sort 0 ms, write 0 ms, index 530 ms: 5 candidates, 74053 repo-hours, 747 releases; waiting 751 ms; commit 0 ms)
2026-11-08T09:09:25Z [load_day 2024-12-01] 2024-12-01 hour 7: 189587 events in 0 files, snapshot none (task 7243 ms: download 5077 ms overlapping gunzip 1257 ms, parse 4788 ms, sort 0 ms, write 0 ms, index 421 ms: 2 candidates, 59348 repo-hours, 625 releases; waiting 418 ms; commit 0 ms)
2026-11-08T09:09:30Z [load_day 2024-12-01] 2024-12-01 hour 8: 191624 events in 0 files, snapshot none (task 6523 ms: download 4252 ms overlapping gunzip 1112 ms, parse 4107 ms, sort 0 ms, write 0 ms, index 552 ms: 8 candidates, 62171 repo-hours, 628 releases; waiting 461 ms; commit 0 ms)
2026-11-08T09:09:33Z [load_day 2024-12-01] 2024-12-01 hour 9: 204719 events in 0 files, snapshot none (task 6849 ms: download 4543 ms overlapping gunzip 1148 ms, parse 4307 ms, sort 0 ms, write 0 ms, index 576 ms: 5 candidates, 69739 repo-hours, 884 releases; waiting 531 ms; commit 0 ms)
2026-11-08T09:09:37Z [load_day 2024-12-01] 2024-12-01 hour 10: 201255 events in 0 files, snapshot none (task 6540 ms: download 4275 ms overlapping gunzip 1100 ms, parse 4082 ms, sort 0 ms, write 0 ms, index 507 ms: 3 candidates, 66095 repo-hours, 654 releases; waiting 511 ms; commit 0 ms)
2026-11-08T09:09:40Z [load_day 2024-12-01] 2024-12-01 hour 11: 206623 events in 0 files, snapshot none (task 7551 ms: download 4872 ms overlapping gunzip 1206 ms, parse 4383 ms, sort 0 ms, write 0 ms, index 1125 ms: 2 candidates, 65098 repo-hours, 679 releases; waiting 560 ms; commit 0 ms)
2026-11-08T09:09:46Z [load_day 2024-12-01] 2024-12-01 hour 12: 244757 events in 0 files, snapshot none (task 8770 ms: download 5466 ms overlapping gunzip 1370 ms, parse 5466 ms, sort 0 ms, write 0 ms, index 888 ms: 7 candidates, 118442 repo-hours, 910 releases; waiting 688 ms; commit 0 ms)
2026-11-08T09:09:51Z [load_day 2024-12-01] 2024-12-01 hour 13: 236361 events in 0 files, snapshot none (task 10364 ms: download 6311 ms overlapping gunzip 1724 ms, parse 6489 ms, sort 0 ms, write 0 ms, index 1394 ms: 4 candidates, 90982 repo-hours, 810 releases; waiting 490 ms; commit 0 ms)
2026-11-08T09:09:56Z [load_day 2024-12-01] 2024-12-01 hour 14: 224269 events in 0 files, snapshot none (task 9451 ms: download 6615 ms overlapping gunzip 1580 ms, parse 6007 ms, sort 0 ms, write 0 ms, index 1066 ms: 3 candidates, 76615 repo-hours, 854 releases; waiting 505 ms; commit 0 ms)
2026-11-08T09:10:02Z [load_day 2024-12-01] 2024-12-01 hour 15: 232505 events in 0 files, snapshot none (task 10022 ms: download 6543 ms overlapping gunzip 1644 ms, parse 6201 ms, sort 0 ms, write 0 ms, index 1016 ms: 3 candidates, 85682 repo-hours, 1099 releases; waiting 684 ms; commit 0 ms)
2026-11-08T09:10:08Z [load_day 2024-12-01] 2024-12-01 hour 16: 226466 events in 0 files, snapshot none (task 10721 ms: download 8029 ms overlapping gunzip 1581 ms, parse 5822 ms, sort 0 ms, write 0 ms, index 881 ms: 5 candidates, 78589 repo-hours, 871 releases; waiting 2059 ms; commit 0 ms)
2026-11-08T09:10:13Z [load_day 2024-12-01] 2024-12-01 hour 17: 222818 events in 0 files, snapshot none (task 8551 ms: download 5326 ms overlapping gunzip 1375 ms, parse 5471 ms, sort 0 ms, write 0 ms, index 775 ms: 2 candidates, 73768 repo-hours, 850 releases; waiting 533 ms; commit 0 ms)
2026-11-08T09:10:17Z [load_day 2024-12-01] 2024-12-01 hour 18: 234791 events in 0 files, snapshot none (task 8765 ms: download 6071 ms overlapping gunzip 1446 ms, parse 5713 ms, sort 0 ms, write 0 ms, index 798 ms: 4 candidates, 90006 repo-hours, 955 releases; waiting 468 ms; commit 0 ms)
2026-11-08T09:10:22Z [load_day 2024-12-01] 2024-12-01 hour 19: 218863 events in 0 files, snapshot none (task 8281 ms: download 5276 ms overlapping gunzip 1541 ms, parse 5470 ms, sort 0 ms, write 0 ms, index 691 ms: 2 candidates, 68726 repo-hours, 756 releases; waiting 256 ms; commit 0 ms)
2026-11-08T09:10:27Z [load_day 2024-12-01] 2024-12-01 hour 20: 208674 events in 0 files, snapshot none (task 9355 ms: download 6385 ms overlapping gunzip 1565 ms, parse 6469 ms, sort 0 ms, write 0 ms, index 720 ms: 3 candidates, 69355 repo-hours, 837 releases; waiting 235 ms; commit 0 ms)
2026-11-08T09:10:31Z [load_day 2024-12-01] 2024-12-01 hour 21: 209365 events in 0 files, snapshot none (task 8638 ms: download 5924 ms overlapping gunzip 1472 ms, parse 5559 ms, sort 0 ms, write 0 ms, index 850 ms: 5 candidates, 71031 repo-hours, 1051 releases; waiting 462 ms; commit 0 ms)
2026-11-08T09:10:36Z [load_day 2024-12-01] 2024-12-01 hour 22: 196285 events in 0 files, snapshot none (task 8488 ms: download 5317 ms overlapping gunzip 1382 ms, parse 5164 ms, sort 0 ms, write 0 ms, index 821 ms: 4 candidates, 60836 repo-hours, 983 releases; waiting 751 ms; commit 0 ms)
2026-11-08T09:10:39Z [load_day 2024-12-01] 2024-12-01 hour 23: 188501 events in 0 files, snapshot none (task 7659 ms: download 5577 ms overlapping gunzip 1427 ms, parse 5111 ms, sort 0 ms, write 0 ms, index 449 ms: 6 candidates, 58980 repo-hours, 709 releases; waiting 391 ms; commit 0 ms)
2026-11-08T09:10:47Z [load_day 2024-12-01] 2024-12-01: repo_hour merged from 24 files to 1 (1746305 rows, 7434 ms)
2026-11-08T09:10:49Z [load_day 2024-12-01] 2024-12-01: index committed in 9888 ms (24 + 1 + 24 files)
2026-11-08T09:10:49Z [load_day 2024-12-01] 2024-12-01: 4873196 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:10:49Z [load_day 2024-12-01] attempt 1 succeeded