orcaLog in

Runs · run 1857

load_day 2023-12-14, attempt 1 succeeded

Host
73ccef5e07c2:9525
Started
2026-11-08T03:44:59Z
Ended
2026-11-08T03:46:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
697 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
165.4 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1857/load_day/2023-12-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:44:59Z [load_day 2023-12-14] attempt 1 started
2026-11-08T03:45:01Z [load_day 2023-12-14] 2023-12-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:45:07Z [load_day 2023-12-14] 2023-12-14 hour 0: 167974 events in 0 files, snapshot none (task 6211 ms: download 3210 ms overlapping gunzip 903 ms, parse 3844 ms, sort 0 ms, write 0 ms, index 601 ms: 8 candidates, 86225 repo-hours, 950 releases; waiting 538 ms; commit 0 ms)
2026-11-08T03:45:07Z [load_day 2023-12-14] 2023-12-14 hour 1: 172977 events in 0 files, snapshot none (task 6226 ms: download 3129 ms overlapping gunzip 941 ms, parse 3824 ms, sort 0 ms, write 0 ms, index 659 ms: 7 candidates, 94972 repo-hours, 904 releases; waiting 491 ms; commit 0 ms)
2026-11-08T03:45:14Z [load_day 2023-12-14] 2023-12-14 hour 2: 143218 events in 0 files, snapshot none (task 6470 ms: download 3540 ms overlapping gunzip 916 ms, parse 3526 ms, sort 0 ms, write 0 ms, index 439 ms: 9 candidates, 62443 repo-hours, 875 releases; waiting 698 ms; commit 0 ms)
2026-11-08T03:45:14Z [load_day 2023-12-14] 2023-12-14 hour 3: 139796 events in 0 files, snapshot none (task 5570 ms: download 2165 ms overlapping gunzip 860 ms, parse 3505 ms, sort 0 ms, write 0 ms, index 613 ms: 3 candidates, 60180 repo-hours, 833 releases; waiting 195 ms; commit 0 ms)
2026-11-08T03:45:20Z [load_day 2023-12-14] 2023-12-14 hour 4: 133618 events in 0 files, snapshot none (task 5500 ms: download 3290 ms overlapping gunzip 812 ms, parse 3355 ms, sort 0 ms, write 0 ms, index 529 ms: 11 candidates, 56375 repo-hours, 619 releases; waiting 523 ms; commit 0 ms)
2026-11-08T03:45:21Z [load_day 2023-12-14] 2023-12-14 hour 5: 145439 events in 0 files, snapshot none (task 5960 ms: download 3629 ms overlapping gunzip 934 ms, parse 3585 ms, sort 0 ms, write 0 ms, index 438 ms: 3 candidates, 61449 repo-hours, 880 releases; waiting 780 ms; commit 0 ms)
2026-11-08T03:45:27Z [load_day 2023-12-14] 2023-12-14 hour 6: 166128 events in 0 files, snapshot none (task 5768 ms: download 2880 ms overlapping gunzip 794 ms, parse 3228 ms, sort 0 ms, write 0 ms, index 891 ms: 5 candidates, 74646 repo-hours, 1017 releases; waiting 546 ms; commit 0 ms)
2026-11-08T03:45:27Z [load_day 2023-12-14] 2023-12-14 hour 7: 176561 events in 0 files, snapshot none (task 6216 ms: download 3403 ms overlapping gunzip 979 ms, parse 3811 ms, sort 0 ms, write 0 ms, index 652 ms: 10 candidates, 74567 repo-hours, 852 releases; waiting 496 ms; commit 0 ms)
2026-11-08T03:45:34Z [load_day 2023-12-14] 2023-12-14 hour 8: 193556 events in 0 files, snapshot none (task 7085 ms: download 4365 ms overlapping gunzip 1093 ms, parse 4550 ms, sort 0 ms, write 0 ms, index 612 ms: 9 candidates, 83918 repo-hours, 955 releases; waiting 525 ms; commit 0 ms)
2026-11-08T03:45:36Z [load_day 2023-12-14] 2023-12-14 hour 9: 199912 events in 0 files, snapshot none (task 7573 ms: download 4994 ms overlapping gunzip 1164 ms, parse 4950 ms, sort 0 ms, write 0 ms, index 609 ms: 7 candidates, 88614 repo-hours, 1220 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:45:43Z [load_day 2023-12-14] 2023-12-14 hour 10: 200668 events in 0 files, snapshot none (task 7976 ms: download 5206 ms overlapping gunzip 1225 ms, parse 5212 ms, sort 0 ms, write 0 ms, index 645 ms: 10 candidates, 88138 repo-hours, 1091 releases; waiting 573 ms; commit 0 ms)
2026-11-08T03:45:44Z [load_day 2023-12-14] 2023-12-14 hour 11: 193113 events in 0 files, snapshot none (task 7366 ms: download 4763 ms overlapping gunzip 1136 ms, parse 4800 ms, sort 0 ms, write 0 ms, index 610 ms: 6 candidates, 81757 repo-hours, 1224 releases; waiting 497 ms; commit 0 ms)
2026-11-08T03:45:52Z [load_day 2023-12-14] 2023-12-14 hour 12: 240468 events in 0 files, snapshot none (task 9256 ms: download 5735 ms overlapping gunzip 1300 ms, parse 6175 ms, sort 0 ms, write 0 ms, index 968 ms: 12 candidates, 112491 repo-hours, 1242 releases; waiting 530 ms; commit 0 ms)
2026-11-08T03:45:53Z [load_day 2023-12-14] 2023-12-14 hour 13: 224747 events in 0 files, snapshot none (task 9346 ms: download 6456 ms overlapping gunzip 1482 ms, parse 6375 ms, sort 0 ms, write 0 ms, index 772 ms: 8 candidates, 108122 repo-hours, 1176 releases; waiting 457 ms; commit 0 ms)
2026-11-08T03:46:03Z [load_day 2023-12-14] 2023-12-14 hour 14: 217928 events in 0 files, snapshot none (task 9989 ms: download 6517 ms overlapping gunzip 1624 ms, parse 6779 ms, sort 0 ms, write 0 ms, index 812 ms: 8 candidates, 96142 repo-hours, 1340 releases; waiting 515 ms; commit 0 ms)
2026-11-08T03:46:03Z [load_day 2023-12-14] 2023-12-14 hour 15: 216207 events in 0 files, snapshot none (task 9042 ms: download 6208 ms overlapping gunzip 1490 ms, parse 5988 ms, sort 0 ms, write 0 ms, index 731 ms: 7 candidates, 97228 repo-hours, 1437 releases; waiting 481 ms; commit 0 ms)
2026-11-08T03:46:12Z [load_day 2023-12-14] 2023-12-14 hour 16: 210667 events in 0 files, snapshot none (task 8426 ms: download 5341 ms overlapping gunzip 1353 ms, parse 5819 ms, sort 0 ms, write 0 ms, index 643 ms: 7 candidates, 92494 repo-hours, 1301 releases; waiting 362 ms; commit 0 ms)
2026-11-08T03:46:12Z [load_day 2023-12-14] 2023-12-14 hour 17: 201054 events in 0 files, snapshot none (task 8475 ms: download 5942 ms overlapping gunzip 1396 ms, parse 5612 ms, sort 0 ms, write 0 ms, index 605 ms: 6 candidates, 85032 repo-hours, 1046 releases; waiting 487 ms; commit 0 ms)
2026-11-08T03:46:20Z [load_day 2023-12-14] 2023-12-14 hour 18: 196584 events in 0 files, snapshot none (task 7917 ms: download 5207 ms overlapping gunzip 1259 ms, parse 5172 ms, sort 0 ms, write 0 ms, index 636 ms: 11 candidates, 88150 repo-hours, 1118 releases; waiting 501 ms; commit 0 ms)
2026-11-08T03:46:20Z [load_day 2023-12-14] 2023-12-14 hour 19: 184369 events in 0 files, snapshot none (task 7656 ms: download 5173 ms overlapping gunzip 1220 ms, parse 5122 ms, sort 0 ms, write 0 ms, index 585 ms: 6 candidates, 76437 repo-hours, 1067 releases; waiting 455 ms; commit 0 ms)
2026-11-08T03:46:27Z [load_day 2023-12-14] 2023-12-14 hour 20: 180427 events in 0 files, snapshot none (task 6491 ms: download 4114 ms overlapping gunzip 998 ms, parse 4104 ms, sort 0 ms, write 0 ms, index 631 ms: 7 candidates, 77263 repo-hours, 1065 releases; waiting 484 ms; commit 0 ms)
2026-11-08T03:46:27Z [load_day 2023-12-14] 2023-12-14 hour 21: 174254 events in 0 files, snapshot none (task 6422 ms: download 4194 ms overlapping gunzip 1008 ms, parse 4123 ms, sort 0 ms, write 0 ms, index 512 ms: 5 candidates, 70754 repo-hours, 1077 releases; waiting 526 ms; commit 0 ms)
2026-11-08T03:46:33Z [load_day 2023-12-14] 2023-12-14 hour 22: 157250 events in 0 files, snapshot none (task 5289 ms: download 3139 ms overlapping gunzip 810 ms, parse 3280 ms, sort 0 ms, write 0 ms, index 459 ms: 4 candidates, 63427 repo-hours, 1045 releases; waiting 517 ms; commit 0 ms)
2026-11-08T03:46:33Z [load_day 2023-12-14] 2023-12-14 hour 23: 141873 events in 0 files, snapshot none (task 4917 ms: download 2850 ms overlapping gunzip 737 ms, parse 2998 ms, sort 0 ms, write 0 ms, index 400 ms: 5 candidates, 58884 repo-hours, 848 releases; waiting 469 ms; commit 0 ms)
2026-11-08T03:46:41Z [load_day 2023-12-14] 2023-12-14: repo_hour merged from 24 files to 1 (1939708 rows, 8121 ms)
2026-11-08T03:46:44Z [load_day 2023-12-14] 2023-12-14: index committed in 10952 ms (24 + 1 + 24 files)
2026-11-08T03:46:44Z [load_day 2023-12-14] 2023-12-14: 4378788 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:46:44Z [load_day 2023-12-14] attempt 1 succeeded