orcaLog in

Runs · run 2139

load_day 2024-02-28, attempt 1 succeeded

Host
73ccef5e07c2:92716
Started
2026-11-08T04:52:27Z
Ended
2026-11-08T04:54:27Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
701 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
190.8 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2139/load_day/2024-02-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:52:27Z [load_day 2024-02-28] attempt 1 started
2026-11-08T04:52:28Z [load_day 2024-02-28] 2024-02-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:52:38Z [load_day 2024-02-28] 2024-02-28 hour 0: 248560 events in 0 files, snapshot none (task 9469 ms: download 6430 ms overlapping gunzip 1398 ms, parse 6451 ms, sort 0 ms, write 0 ms, index 759 ms: 12 candidates, 100627 repo-hours, 1075 releases; waiting 542 ms; commit 0 ms)
2026-11-08T04:52:38Z [load_day 2024-02-28] 2024-02-28 hour 1: 242228 events in 0 files, snapshot none (task 9022 ms: download 5929 ms overlapping gunzip 1428 ms, parse 5970 ms, sort 0 ms, write 0 ms, index 823 ms: 7 candidates, 99403 repo-hours, 946 releases; waiting 486 ms; commit 0 ms)
2026-11-08T04:52:47Z [load_day 2024-02-28] 2024-02-28 hour 2: 207595 events in 0 files, snapshot none (task 8292 ms: download 4815 ms overlapping gunzip 1317 ms, parse 5514 ms, sort 0 ms, write 0 ms, index 719 ms: 9 candidates, 67047 repo-hours, 737 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:52:47Z [load_day 2024-02-28] 2024-02-28 hour 3: 210173 events in 0 files, snapshot none (task 8002 ms: download 4479 ms overlapping gunzip 1253 ms, parse 4970 ms, sort 0 ms, write 0 ms, index 855 ms: 6 candidates, 66103 repo-hours, 826 releases; waiting 518 ms; commit 0 ms)
2026-11-08T04:52:53Z [load_day 2024-02-28] 2024-02-28 hour 4: 201521 events in 0 files, snapshot none (task 5402 ms: download 2675 ms overlapping gunzip 770 ms, parse 3535 ms, sort 0 ms, write 0 ms, index 620 ms: 3 candidates, 61749 repo-hours, 605 releases; waiting 220 ms; commit 0 ms)
2026-11-08T04:52:54Z [load_day 2024-02-28] 2024-02-28 hour 5: 212244 events in 0 files, snapshot none (task 6911 ms: download 3927 ms overlapping gunzip 1101 ms, parse 4274 ms, sort 0 ms, write 0 ms, index 757 ms: 9 candidates, 66329 repo-hours, 608 releases; waiting 535 ms; commit 0 ms)
2026-11-08T04:53:00Z [load_day 2024-02-28] 2024-02-28 hour 6: 229482 events in 0 files, snapshot none (task 6648 ms: download 4126 ms overlapping gunzip 980 ms, parse 4243 ms, sort 0 ms, write 0 ms, index 610 ms: 2 candidates, 81409 repo-hours, 738 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:53:03Z [load_day 2024-02-28] 2024-02-28 hour 7: 233943 events in 0 files, snapshot none (task 7409 ms: download 4644 ms overlapping gunzip 1085 ms, parse 4716 ms, sort 0 ms, write 0 ms, index 810 ms: 12 candidates, 79368 repo-hours, 822 releases; waiting 492 ms; commit 0 ms)
2026-11-08T04:53:09Z [load_day 2024-02-28] 2024-02-28 hour 8: 242773 events in 0 files, snapshot none (task 8766 ms: download 5749 ms overlapping gunzip 1343 ms, parse 5833 ms, sort 0 ms, write 0 ms, index 758 ms: 5 candidates, 86681 repo-hours, 1169 releases; waiting 522 ms; commit 0 ms)
2026-11-08T04:53:11Z [load_day 2024-02-28] 2024-02-28 hour 9: 258385 events in 0 files, snapshot none (task 8232 ms: download 5590 ms overlapping gunzip 1289 ms, parse 5374 ms, sort 0 ms, write 0 ms, index 783 ms: 12 candidates, 91543 repo-hours, 1259 releases; waiting 504 ms; commit 0 ms)
2026-11-08T04:53:19Z [load_day 2024-02-28] 2024-02-28 hour 10: 259343 events in 0 files, snapshot none (task 8944 ms: download 6024 ms overlapping gunzip 1418 ms, parse 6052 ms, sort 0 ms, write 0 ms, index 778 ms: 6 candidates, 92546 repo-hours, 1128 releases; waiting 457 ms; commit 0 ms)
2026-11-08T04:53:21Z [load_day 2024-02-28] 2024-02-28 hour 11: 256091 events in 0 files, snapshot none (task 8810 ms: download 6238 ms overlapping gunzip 1362 ms, parse 5917 ms, sort 0 ms, write 0 ms, index 680 ms: 5 candidates, 87810 repo-hours, 1053 releases; waiting 551 ms; commit 0 ms)
2026-11-08T04:53:29Z [load_day 2024-02-28] 2024-02-28 hour 12: 307592 events in 0 files, snapshot none (task 9882 ms: download 6621 ms overlapping gunzip 1511 ms, parse 6643 ms, sort 0 ms, write 0 ms, index 986 ms: 10 candidates, 119586 repo-hours, 1129 releases; waiting 492 ms; commit 0 ms)
2026-11-08T04:53:31Z [load_day 2024-02-28] 2024-02-28 hour 13: 284198 events in 0 files, snapshot none (task 9743 ms: download 6795 ms overlapping gunzip 1459 ms, parse 6469 ms, sort 0 ms, write 0 ms, index 1062 ms: 8 candidates, 115422 repo-hours, 1189 releases; waiting 451 ms; commit 0 ms)
2026-11-08T04:53:39Z [load_day 2024-02-28] 2024-02-28 hour 14: 282218 events in 0 files, snapshot none (task 9820 ms: download 7066 ms overlapping gunzip 1531 ms, parse 6605 ms, sort 0 ms, write 0 ms, index 878 ms: 6 candidates, 106167 repo-hours, 1256 releases; waiting 511 ms; commit 0 ms)
2026-11-08T04:53:42Z [load_day 2024-02-28] 2024-02-28 hour 15: 276719 events in 0 files, snapshot none (task 9537 ms: download 6992 ms overlapping gunzip 1515 ms, parse 6193 ms, sort 0 ms, write 0 ms, index 728 ms: 15 candidates, 106215 repo-hours, 1379 releases; waiting 833 ms; commit 0 ms)
2026-11-08T04:53:48Z [load_day 2024-02-28] 2024-02-28 hour 16: 274978 events in 0 files, snapshot none (task 8428 ms: download 5704 ms overlapping gunzip 1310 ms, parse 5588 ms, sort 0 ms, write 0 ms, index 743 ms: 4 candidates, 103686 repo-hours, 1242 releases; waiting 486 ms; commit 0 ms)
2026-11-08T04:53:50Z [load_day 2024-02-28] 2024-02-28 hour 17: 261840 events in 0 files, snapshot none (task 7977 ms: download 5202 ms overlapping gunzip 1178 ms, parse 5047 ms, sort 0 ms, write 0 ms, index 761 ms: 5 candidates, 96028 repo-hours, 1082 releases; waiting 559 ms; commit 0 ms)
2026-11-08T04:53:58Z [load_day 2024-02-28] 2024-02-28 hour 18: 264236 events in 0 files, snapshot none (task 9219 ms: download 6029 ms overlapping gunzip 1477 ms, parse 6181 ms, sort 0 ms, write 0 ms, index 936 ms: 8 candidates, 99780 repo-hours, 1208 releases; waiting 369 ms; commit 0 ms)
2026-11-08T04:53:59Z [load_day 2024-02-28] 2024-02-28 hour 19: 220928 events in 0 files, snapshot none (task 8175 ms: download 5503 ms overlapping gunzip 1273 ms, parse 5576 ms, sort 0 ms, write 0 ms, index 627 ms: 7 candidates, 80655 repo-hours, 928 releases; waiting 485 ms; commit 0 ms)
2026-11-08T04:54:07Z [load_day 2024-02-28] 2024-02-28 hour 20: 242587 events in 0 files, snapshot none (task 8561 ms: download 5741 ms overlapping gunzip 1365 ms, parse 5817 ms, sort 0 ms, write 0 ms, index 593 ms: 10 candidates, 84971 repo-hours, 1058 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:54:08Z [load_day 2024-02-28] 2024-02-28 hour 21: 225080 events in 0 files, snapshot none (task 8577 ms: download 6065 ms overlapping gunzip 1386 ms, parse 5858 ms, sort 0 ms, write 0 ms, index 551 ms: 11 candidates, 76539 repo-hours, 1141 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:54:15Z [load_day 2024-02-28] 2024-02-28 hour 22: 216683 events in 0 files, snapshot none (task 7487 ms: download 5151 ms overlapping gunzip 1216 ms, parse 4961 ms, sort 0 ms, write 0 ms, index 535 ms: 12 candidates, 70584 repo-hours, 1083 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:54:15Z [load_day 2024-02-28] 2024-02-28 hour 23: 198218 events in 0 files, snapshot none (task 6991 ms: download 4630 ms overlapping gunzip 1070 ms, parse 4541 ms, sort 0 ms, write 0 ms, index 521 ms: 8 candidates, 66048 repo-hours, 835 releases; waiting 521 ms; commit 0 ms)
2026-11-08T04:54:25Z [load_day 2024-02-28] 2024-02-28: repo_hour merged from 24 files to 1 (2106296 rows, 9340 ms)
2026-11-08T04:54:27Z [load_day 2024-02-28] 2024-02-28: index committed in 11587 ms (24 + 1 + 24 files)
2026-11-08T04:54:27Z [load_day 2024-02-28] 2024-02-28: 5857615 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:54:27Z [load_day 2024-02-28] attempt 1 succeeded