orcaLog in

Runs · run 2198

load_day 2024-03-14, attempt 1 succeeded

Host
73ccef5e07c2:97920
Started
2026-11-08T05:06:35Z
Ended
2026-11-08T05:08:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
697 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
192.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2198/load_day/2024-03-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:06:35Z [load_day 2024-03-14] attempt 1 started
2026-11-08T05:06:36Z [load_day 2024-03-14] 2024-03-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:06:46Z [load_day 2024-03-14] 2024-03-14 hour 0: 280215 events in 0 files, snapshot none (task 8807 ms: download 5795 ms overlapping gunzip 1278 ms, parse 6045 ms, sort 0 ms, write 0 ms, index 757 ms: 7 candidates, 98806 repo-hours, 1052 releases; waiting 438 ms; commit 0 ms)
2026-11-08T05:06:46Z [load_day 2024-03-14] 2024-03-14 hour 1: 279518 events in 0 files, snapshot none (task 8283 ms: download 5393 ms overlapping gunzip 1155 ms, parse 5664 ms, sort 0 ms, write 0 ms, index 711 ms: 9 candidates, 98087 repo-hours, 784 releases; waiting 479 ms; commit 0 ms)
2026-11-08T05:06:54Z [load_day 2024-03-14] 2024-03-14 hour 2: 248342 events in 0 files, snapshot none (task 6818 ms: download 3928 ms overlapping gunzip 1032 ms, parse 4359 ms, sort 0 ms, write 0 ms, index 570 ms: 17 candidates, 66166 repo-hours, 786 releases; waiting 541 ms; commit 0 ms)
2026-11-08T05:06:55Z [load_day 2024-03-14] 2024-03-14 hour 3: 213004 events in 0 files, snapshot none (task 7488 ms: download 4584 ms overlapping gunzip 1204 ms, parse 5000 ms, sort 0 ms, write 0 ms, index 532 ms: 15 candidates, 64595 repo-hours, 801 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:07:01Z [load_day 2024-03-14] 2024-03-14 hour 4: 210749 events in 0 files, snapshot none (task 6551 ms: download 3541 ms overlapping gunzip 917 ms, parse 4090 ms, sort 0 ms, write 0 ms, index 630 ms: 7 candidates, 60130 repo-hours, 538 releases; waiting 630 ms; commit 0 ms)
2026-11-08T05:07:03Z [load_day 2024-03-14] 2024-03-14 hour 5: 264891 events in 0 files, snapshot none (task 8083 ms: download 5440 ms overlapping gunzip 1365 ms, parse 5412 ms, sort 0 ms, write 0 ms, index 477 ms: 6 candidates, 64277 repo-hours, 761 releases; waiting 525 ms; commit 0 ms)
2026-11-08T05:07:08Z [load_day 2024-03-14] 2024-03-14 hour 6: 275437 events in 0 files, snapshot none (task 6032 ms: download 3595 ms overlapping gunzip 887 ms, parse 3823 ms, sort 0 ms, write 0 ms, index 626 ms: 5 candidates, 79812 repo-hours, 732 releases; waiting 469 ms; commit 0 ms)
2026-11-08T05:07:12Z [load_day 2024-03-14] 2024-03-14 hour 7: 279994 events in 0 files, snapshot none (task 7756 ms: download 5379 ms overlapping gunzip 1022 ms, parse 4377 ms, sort 0 ms, write 0 ms, index 677 ms: 8 candidates, 79150 repo-hours, 953 releases; waiting 1360 ms; commit 0 ms)
2026-11-08T05:07:16Z [load_day 2024-03-14] 2024-03-14 hour 8: 295064 events in 0 files, snapshot none (task 7806 ms: download 5212 ms overlapping gunzip 1204 ms, parse 5086 ms, sort 0 ms, write 0 ms, index 652 ms: 4 candidates, 89324 repo-hours, 1055 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:07:20Z [load_day 2024-03-14] 2024-03-14 hour 9: 301243 events in 0 files, snapshot none (task 8269 ms: download 5234 ms overlapping gunzip 1239 ms, parse 5276 ms, sort 0 ms, write 0 ms, index 845 ms: 13 candidates, 93154 repo-hours, 1314 releases; waiting 468 ms; commit 0 ms)
2026-11-08T05:07:26Z [load_day 2024-03-14] 2024-03-14 hour 10: 293879 events in 0 files, snapshot none (task 9123 ms: download 5890 ms overlapping gunzip 1447 ms, parse 6036 ms, sort 0 ms, write 0 ms, index 833 ms: 8 candidates, 90266 repo-hours, 1199 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:07:32Z [load_day 2024-03-14] 2024-03-14 hour 11: 296047 events in 0 files, snapshot none (task 10652 ms: download 6486 ms overlapping gunzip 1653 ms, parse 6906 ms, sort 0 ms, write 0 ms, index 1153 ms: 10 candidates, 86857 repo-hours, 1146 releases; waiting 461 ms; commit 0 ms)
2026-11-08T05:07:35Z [load_day 2024-03-14] 2024-03-14 hour 12: 320560 events in 0 files, snapshot none (task 9196 ms: download 6036 ms overlapping gunzip 1331 ms, parse 6100 ms, sort 0 ms, write 0 ms, index 937 ms: 7 candidates, 115810 repo-hours, 1104 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:07:41Z [load_day 2024-03-14] 2024-03-14 hour 13: 306617 events in 0 files, snapshot none (task 9111 ms: download 6043 ms overlapping gunzip 1472 ms, parse 6062 ms, sort 0 ms, write 0 ms, index 772 ms: 8 candidates, 109800 repo-hours, 1262 releases; waiting 499 ms; commit 0 ms)
2026-11-08T05:07:46Z [load_day 2024-03-14] 2024-03-14 hour 14: 301455 events in 0 files, snapshot none (task 10086 ms: download 6514 ms overlapping gunzip 1564 ms, parse 6611 ms, sort 0 ms, write 0 ms, index 1080 ms: 8 candidates, 101310 repo-hours, 1192 releases; waiting 528 ms; commit 0 ms)
2026-11-08T05:07:52Z [load_day 2024-03-14] 2024-03-14 hour 15: 304768 events in 0 files, snapshot none (task 9787 ms: download 6495 ms overlapping gunzip 1482 ms, parse 6310 ms, sort 0 ms, write 0 ms, index 1163 ms: 10 candidates, 105134 repo-hours, 1399 releases; waiting 501 ms; commit 0 ms)
2026-11-08T05:07:56Z [load_day 2024-03-14] 2024-03-14 hour 16: 295328 events in 0 files, snapshot none (task 9620 ms: download 6561 ms overlapping gunzip 1500 ms, parse 6493 ms, sort 0 ms, write 0 ms, index 846 ms: 7 candidates, 96140 repo-hours, 1248 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:08:01Z [load_day 2024-03-14] 2024-03-14 hour 17: 278505 events in 0 files, snapshot none (task 8991 ms: download 5977 ms overlapping gunzip 1421 ms, parse 5906 ms, sort 0 ms, write 0 ms, index 892 ms: 5 candidates, 92308 repo-hours, 1196 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:08:05Z [load_day 2024-03-14] 2024-03-14 hour 18: 236768 events in 0 files, snapshot none (task 8424 ms: download 5195 ms overlapping gunzip 1233 ms, parse 5065 ms, sort 0 ms, write 0 ms, index 1031 ms: 6 candidates, 96198 repo-hours, 1153 releases; waiting 754 ms; commit 0 ms)
2026-11-08T05:08:09Z [load_day 2024-03-14] 2024-03-14 hour 19: 209968 events in 0 files, snapshot none (task 7407 ms: download 4403 ms overlapping gunzip 1167 ms, parse 4689 ms, sort 0 ms, write 0 ms, index 798 ms: 3 candidates, 80420 repo-hours, 1054 releases; waiting 215 ms; commit 0 ms)
2026-11-08T05:08:13Z [load_day 2024-03-14] 2024-03-14 hour 20: 211360 events in 0 files, snapshot none (task 7128 ms: download 4614 ms overlapping gunzip 1110 ms, parse 4572 ms, sort 0 ms, write 0 ms, index 620 ms: 7 candidates, 81823 repo-hours, 1104 releases; waiting 496 ms; commit 0 ms)
2026-11-08T05:08:18Z [load_day 2024-03-14] 2024-03-14 hour 21: 195327 events in 0 files, snapshot none (task 8670 ms: download 6377 ms overlapping gunzip 1052 ms, parse 4294 ms, sort 0 ms, write 0 ms, index 568 ms: 11 candidates, 71968 repo-hours, 1186 releases; waiting 2492 ms; commit 0 ms)
2026-11-08T05:08:25Z [load_day 2024-03-14] 2024-03-14 hour 22: 179682 events in 0 files, snapshot none (task 11670 ms: download 9272 ms overlapping gunzip 1177 ms, parse 4791 ms, sort 0 ms, write 0 ms, index 570 ms: 10 candidates, 66529 repo-hours, 990 releases; waiting 4408 ms; commit 0 ms)
2026-11-08T05:08:25Z [load_day 2024-03-14] 2024-03-14 hour 23: 168730 events in 0 files, snapshot none (task 5813 ms: download 3145 ms overlapping gunzip 984 ms, parse 3903 ms, sort 0 ms, write 0 ms, index 430 ms: 6 candidates, 63285 repo-hours, 808 releases; waiting 182 ms; commit 0 ms)
2026-11-08T05:08:34Z [load_day 2024-03-14] 2024-03-14: repo_hour merged from 24 files to 1 (2051349 rows, 9038 ms)
2026-11-08T05:08:37Z [load_day 2024-03-14] 2024-03-14: index committed in 11707 ms (24 + 1 + 24 files)
2026-11-08T05:08:37Z [load_day 2024-03-14] 2024-03-14: 6247451 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:08:37Z [load_day 2024-03-14] attempt 1 succeeded