orcaLog in

Runs · run 3096

load_day 2024-10-18, attempt 1 succeeded

Host
73ccef5e07c2:193963
Started
2026-11-08T08:23:51Z
Ended
2026-11-08T08:25:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
760 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
160.3 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3096/load_day/2024-10-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:23:51Z [load_day 2024-10-18] attempt 1 started
2026-11-08T08:23:52Z [load_day 2024-10-18] 2024-10-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:23:59Z [load_day 2024-10-18] 2024-10-18 hour 0: 182522 events in 0 files, snapshot none (task 6963 ms: download 3843 ms overlapping gunzip 1201 ms, parse 4228 ms, sort 0 ms, write 0 ms, index 766 ms: 9 candidates, 88574 repo-hours, 1138 releases; waiting 509 ms; commit 0 ms)
2026-11-08T08:23:59Z [load_day 2024-10-18] 2024-10-18 hour 1: 197757 events in 0 files, snapshot none (task 6391 ms: download 3055 ms overlapping gunzip 986 ms, parse 3922 ms, sort 0 ms, write 0 ms, index 1049 ms: 3 candidates, 106441 repo-hours, 835 releases; waiting 190 ms; commit 0 ms)
2026-11-08T08:24:06Z [load_day 2024-10-18] 2024-10-18 hour 2: 178736 events in 0 files, snapshot none (task 6217 ms: download 3073 ms overlapping gunzip 883 ms, parse 3644 ms, sort 0 ms, write 0 ms, index 916 ms: 7 candidates, 79282 repo-hours, 808 releases; waiting 523 ms; commit 0 ms)
2026-11-08T08:24:06Z [load_day 2024-10-18] 2024-10-18 hour 3: 195604 events in 0 files, snapshot none (task 6563 ms: download 3204 ms overlapping gunzip 1028 ms, parse 3928 ms, sort 0 ms, write 0 ms, index 771 ms: 9 candidates, 78449 repo-hours, 4042 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:24:15Z [load_day 2024-10-18] 2024-10-18 hour 4: 177027 events in 0 files, snapshot none (task 7069 ms: download 3184 ms overlapping gunzip 1160 ms, parse 4281 ms, sort 0 ms, write 0 ms, index 821 ms: 10 candidates, 64121 repo-hours, 688 releases; waiting 540 ms; commit 0 ms)
2026-11-08T08:24:16Z [load_day 2024-10-18] 2024-10-18 hour 5: 190887 events in 0 files, snapshot none (task 7663 ms: download 3678 ms overlapping gunzip 1217 ms, parse 4830 ms, sort 0 ms, write 0 ms, index 796 ms: 5 candidates, 70588 repo-hours, 921 releases; waiting 531 ms; commit 0 ms)
2026-11-08T08:24:23Z [load_day 2024-10-18] 2024-10-18 hour 6: 221964 events in 0 files, snapshot none (task 7480 ms: download 4367 ms overlapping gunzip 1167 ms, parse 4503 ms, sort 0 ms, write 0 ms, index 1052 ms: 7 candidates, 95745 repo-hours, 1076 releases; waiting 471 ms; commit 0 ms)
2026-11-08T08:24:24Z [load_day 2024-10-18] 2024-10-18 hour 7: 234850 events in 0 files, snapshot none (task 7981 ms: download 4870 ms overlapping gunzip 1354 ms, parse 5437 ms, sort 0 ms, write 0 ms, index 781 ms: 8 candidates, 87103 repo-hours, 1079 releases; waiting 186 ms; commit 0 ms)
2026-11-08T08:24:32Z [load_day 2024-10-18] 2024-10-18 hour 8: 241156 events in 0 files, snapshot none (task 8127 ms: download 4832 ms overlapping gunzip 1319 ms, parse 4867 ms, sort 0 ms, write 0 ms, index 1059 ms: 3 candidates, 95485 repo-hours, 1176 releases; waiting 496 ms; commit 0 ms)
2026-11-08T08:24:33Z [load_day 2024-10-18] 2024-10-18 hour 9: 241542 events in 0 files, snapshot none (task 8346 ms: download 4977 ms overlapping gunzip 1333 ms, parse 5272 ms, sort 0 ms, write 0 ms, index 939 ms: 5 candidates, 100706 repo-hours, 1356 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:24:40Z [load_day 2024-10-18] 2024-10-18 hour 10: 227833 events in 0 files, snapshot none (task 7170 ms: download 3951 ms overlapping gunzip 1161 ms, parse 4391 ms, sort 0 ms, write 0 ms, index 815 ms: 5 candidates, 92094 repo-hours, 1087 releases; waiting 522 ms; commit 0 ms)
2026-11-08T08:24:41Z [load_day 2024-10-18] 2024-10-18 hour 11: 233556 events in 0 files, snapshot none (task 7549 ms: download 4706 ms overlapping gunzip 1224 ms, parse 4624 ms, sort 0 ms, write 0 ms, index 726 ms: 10 candidates, 86755 repo-hours, 1111 releases; waiting 567 ms; commit 0 ms)
2026-11-08T08:24:47Z [load_day 2024-10-18] 2024-10-18 hour 12: 270407 events in 0 files, snapshot none (task 6414 ms: download 3661 ms overlapping gunzip 924 ms, parse 3723 ms, sort 0 ms, write 0 ms, index 976 ms: 11 candidates, 133428 repo-hours, 1205 releases; waiting 541 ms; commit 0 ms)
2026-11-08T08:24:48Z [load_day 2024-10-18] 2024-10-18 hour 13: 269660 events in 0 files, snapshot none (task 6699 ms: download 4335 ms overlapping gunzip 1068 ms, parse 4065 ms, sort 0 ms, write 0 ms, index 798 ms: 12 candidates, 119035 repo-hours, 1353 releases; waiting 508 ms; commit 0 ms)
2026-11-08T08:24:54Z [load_day 2024-10-18] 2024-10-18 hour 14: 258001 events in 0 files, snapshot none (task 6669 ms: download 4140 ms overlapping gunzip 1049 ms, parse 3918 ms, sort 0 ms, write 0 ms, index 867 ms: 6 candidates, 102313 repo-hours, 1328 releases; waiting 589 ms; commit 0 ms)
2026-11-08T08:24:56Z [load_day 2024-10-18] 2024-10-18 hour 15: 263584 events in 0 files, snapshot none (task 7589 ms: download 5224 ms overlapping gunzip 1125 ms, parse 4255 ms, sort 0 ms, write 0 ms, index 764 ms: 7 candidates, 105528 repo-hours, 1412 releases; waiting 1106 ms; commit 0 ms)
2026-11-08T08:25:02Z [load_day 2024-10-18] 2024-10-18 hour 16: 244207 events in 0 files, snapshot none (task 7535 ms: download 4225 ms overlapping gunzip 1192 ms, parse 4584 ms, sort 0 ms, write 0 ms, index 839 ms: 9 candidates, 95264 repo-hours, 1204 releases; waiting 568 ms; commit 0 ms)
2026-11-08T08:25:04Z [load_day 2024-10-18] 2024-10-18 hour 17: 233752 events in 0 files, snapshot none (task 7329 ms: download 4919 ms overlapping gunzip 1186 ms, parse 4644 ms, sort 0 ms, write 0 ms, index 720 ms: 10 candidates, 87801 repo-hours, 1151 releases; waiting 530 ms; commit 0 ms)
2026-11-08T08:25:10Z [load_day 2024-10-18] 2024-10-18 hour 18: 241972 events in 0 files, snapshot none (task 7179 ms: download 4479 ms overlapping gunzip 1181 ms, parse 4458 ms, sort 0 ms, write 0 ms, index 822 ms: 16 candidates, 100678 repo-hours, 1134 releases; waiting 415 ms; commit 0 ms)
2026-11-08T08:25:12Z [load_day 2024-10-18] 2024-10-18 hour 19: 218966 events in 0 files, snapshot none (task 7449 ms: download 4126 ms overlapping gunzip 1141 ms, parse 4377 ms, sort 0 ms, write 0 ms, index 1140 ms: 9 candidates, 76248 repo-hours, 1056 releases; waiting 491 ms; commit 0 ms)
2026-11-08T08:25:18Z [load_day 2024-10-18] 2024-10-18 hour 20: 210739 events in 0 files, snapshot none (task 8428 ms: download 5001 ms overlapping gunzip 1304 ms, parse 4977 ms, sort 0 ms, write 0 ms, index 1327 ms: 6 candidates, 76835 repo-hours, 1093 releases; waiting 543 ms; commit 0 ms)
2026-11-08T08:25:20Z [load_day 2024-10-18] 2024-10-18 hour 21: 200668 events in 0 files, snapshot none (task 7181 ms: download 4235 ms overlapping gunzip 1222 ms, parse 4492 ms, sort 0 ms, write 0 ms, index 639 ms: 9 candidates, 72897 repo-hours, 1096 releases; waiting 524 ms; commit 0 ms)
2026-11-08T08:25:25Z [load_day 2024-10-18] 2024-10-18 hour 22: 180303 events in 0 files, snapshot none (task 6079 ms: download 2704 ms overlapping gunzip 952 ms, parse 3689 ms, sort 0 ms, write 0 ms, index 639 ms: 9 candidates, 60571 repo-hours, 1162 releases; waiting 403 ms; commit 0 ms)
2026-11-08T08:25:26Z [load_day 2024-10-18] 2024-10-18 hour 23: 175389 events in 0 files, snapshot none (task 5646 ms: download 3119 ms overlapping gunzip 887 ms, parse 3540 ms, sort 0 ms, write 0 ms, index 447 ms: 6 candidates, 57806 repo-hours, 874 releases; waiting 498 ms; commit 0 ms)
2026-11-08T08:25:36Z [load_day 2024-10-18] 2024-10-18: repo_hour merged from 24 files to 1 (2133747 rows, 9977 ms)
2026-11-08T08:25:39Z [load_day 2024-10-18] 2024-10-18: index committed in 12546 ms (24 + 1 + 24 files)
2026-11-08T08:25:39Z [load_day 2024-10-18] 2024-10-18: 5291082 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:25:39Z [load_day 2024-10-18] attempt 1 succeeded