orcaLog in

Runs · run 2307

load_day 2024-04-10, attempt 1 succeeded

Host
73ccef5e07c2:108140
Started
2026-11-08T05:32:22Z
Ended
2026-11-08T05:34:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
706 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
187.1 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2307/load_day/2024-04-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:32:22Z [load_day 2024-04-10] attempt 1 started
2026-11-08T05:32:23Z [load_day 2024-04-10] 2024-04-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:32:32Z [load_day 2024-04-10] 2024-04-10 hour 0: 235696 events in 0 files, snapshot none (task 8376 ms: download 5351 ms overlapping gunzip 1296 ms, parse 5522 ms, sort 0 ms, write 0 ms, index 773 ms: 7 candidates, 96834 repo-hours, 1111 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:32:32Z [load_day 2024-04-10] 2024-04-10 hour 1: 232411 events in 0 files, snapshot none (task 8397 ms: download 4842 ms overlapping gunzip 1162 ms, parse 5420 ms, sort 0 ms, write 0 ms, index 972 ms: 5 candidates, 99304 repo-hours, 959 releases; waiting 538 ms; commit 0 ms)
2026-11-08T05:32:39Z [load_day 2024-04-10] 2024-04-10 hour 2: 210706 events in 0 files, snapshot none (task 6118 ms: download 3161 ms overlapping gunzip 906 ms, parse 3783 ms, sort 0 ms, write 0 ms, index 608 ms: 5 candidates, 65566 repo-hours, 804 releases; waiting 491 ms; commit 0 ms)
2026-11-08T05:32:39Z [load_day 2024-04-10] 2024-04-10 hour 3: 198720 events in 0 files, snapshot none (task 6169 ms: download 3294 ms overlapping gunzip 918 ms, parse 3777 ms, sort 0 ms, write 0 ms, index 664 ms: 7 candidates, 65343 repo-hours, 1048 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:32:46Z [load_day 2024-04-10] 2024-04-10 hour 4: 187239 events in 0 files, snapshot none (task 6681 ms: download 4194 ms overlapping gunzip 1029 ms, parse 4267 ms, sort 0 ms, write 0 ms, index 472 ms: 8 candidates, 61670 repo-hours, 687 releases; waiting 519 ms; commit 0 ms)
2026-11-08T05:32:47Z [load_day 2024-04-10] 2024-04-10 hour 5: 197982 events in 0 files, snapshot none (task 7318 ms: download 4850 ms overlapping gunzip 1151 ms, parse 4861 ms, sort 0 ms, write 0 ms, index 501 ms: 5 candidates, 67345 repo-hours, 787 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:32:54Z [load_day 2024-04-10] 2024-04-10 hour 6: 226984 events in 0 files, snapshot none (task 8088 ms: download 5196 ms overlapping gunzip 1238 ms, parse 5398 ms, sort 0 ms, write 0 ms, index 652 ms: 5 candidates, 82199 repo-hours, 1086 releases; waiting 533 ms; commit 0 ms)
2026-11-08T05:32:56Z [load_day 2024-04-10] 2024-04-10 hour 7: 245352 events in 0 files, snapshot none (task 8494 ms: download 5953 ms overlapping gunzip 1371 ms, parse 5667 ms, sort 0 ms, write 0 ms, index 615 ms: 3 candidates, 82214 repo-hours, 1160 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:33:04Z [load_day 2024-04-10] 2024-04-10 hour 8: 248910 events in 0 files, snapshot none (task 9335 ms: download 6346 ms overlapping gunzip 1527 ms, parse 6208 ms, sort 0 ms, write 0 ms, index 748 ms: 8 candidates, 88471 repo-hours, 1259 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:33:06Z [load_day 2024-04-10] 2024-04-10 hour 9: 248393 events in 0 files, snapshot none (task 9964 ms: download 7006 ms overlapping gunzip 1595 ms, parse 6523 ms, sort 0 ms, write 0 ms, index 785 ms: 15 candidates, 88687 repo-hours, 1296 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:33:14Z [load_day 2024-04-10] 2024-04-10 hour 10: 254099 events in 0 files, snapshot none (task 9389 ms: download 6526 ms overlapping gunzip 1488 ms, parse 6293 ms, sort 0 ms, write 0 ms, index 742 ms: 10 candidates, 88311 repo-hours, 1048 releases; waiting 559 ms; commit 0 ms)
2026-11-08T05:33:15Z [load_day 2024-04-10] 2024-04-10 hour 11: 252120 events in 0 files, snapshot none (task 8485 ms: download 6007 ms overlapping gunzip 1377 ms, parse 5697 ms, sort 0 ms, write 0 ms, index 603 ms: 4 candidates, 82221 repo-hours, 1069 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:33:24Z [load_day 2024-04-10] 2024-04-10 hour 12: 298485 events in 0 files, snapshot none (task 9608 ms: download 6903 ms overlapping gunzip 1490 ms, parse 6606 ms, sort 0 ms, write 0 ms, index 773 ms: 6 candidates, 115142 repo-hours, 1836 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:33:25Z [load_day 2024-04-10] 2024-04-10 hour 13: 289566 events in 0 files, snapshot none (task 9861 ms: download 7261 ms overlapping gunzip 1456 ms, parse 6806 ms, sort 0 ms, write 0 ms, index 762 ms: 10 candidates, 110251 repo-hours, 1240 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:33:33Z [load_day 2024-04-10] 2024-04-10 hour 14: 287516 events in 0 files, snapshot none (task 8637 ms: download 6045 ms overlapping gunzip 1297 ms, parse 5441 ms, sort 0 ms, write 0 ms, index 756 ms: 8 candidates, 100556 repo-hours, 1344 releases; waiting 837 ms; commit 0 ms)
2026-11-08T05:33:34Z [load_day 2024-04-10] 2024-04-10 hour 15: 289712 events in 0 files, snapshot none (task 8224 ms: download 5688 ms overlapping gunzip 1299 ms, parse 5359 ms, sort 0 ms, write 0 ms, index 746 ms: 11 candidates, 101639 repo-hours, 1449 releases; waiting 571 ms; commit 0 ms)
2026-11-08T05:33:41Z [load_day 2024-04-10] 2024-04-10 hour 16: 281931 events in 0 files, snapshot none (task 7777 ms: download 5188 ms overlapping gunzip 1192 ms, parse 5066 ms, sort 0 ms, write 0 ms, index 693 ms: 19 candidates, 96186 repo-hours, 1856 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:33:42Z [load_day 2024-04-10] 2024-04-10 hour 17: 268181 events in 0 files, snapshot none (task 7455 ms: download 4839 ms overlapping gunzip 1143 ms, parse 4726 ms, sort 0 ms, write 0 ms, index 696 ms: 10 candidates, 90203 repo-hours, 1108 releases; waiting 522 ms; commit 0 ms)
2026-11-08T05:33:51Z [load_day 2024-04-10] 2024-04-10 hour 18: 254275 events in 0 files, snapshot none (task 8883 ms: download 6364 ms overlapping gunzip 1525 ms, parse 6220 ms, sort 0 ms, write 0 ms, index 662 ms: 12 candidates, 96961 repo-hours, 1082 releases; waiting 227 ms; commit 0 ms)
2026-11-08T05:33:51Z [load_day 2024-04-10] 2024-04-10 hour 19: 246760 events in 0 files, snapshot none (task 8566 ms: download 6008 ms overlapping gunzip 1344 ms, parse 5623 ms, sort 0 ms, write 0 ms, index 617 ms: 12 candidates, 78602 repo-hours, 1153 releases; waiting 534 ms; commit 0 ms)
2026-11-08T05:34:00Z [load_day 2024-04-10] 2024-04-10 hour 20: 243536 events in 0 files, snapshot none (task 8943 ms: download 6179 ms overlapping gunzip 1374 ms, parse 5828 ms, sort 0 ms, write 0 ms, index 929 ms: 9 candidates, 78056 repo-hours, 1159 releases; waiting 551 ms; commit 0 ms)
2026-11-08T05:34:00Z [load_day 2024-04-10] 2024-04-10 hour 21: 225656 events in 0 files, snapshot none (task 8642 ms: download 5960 ms overlapping gunzip 1376 ms, parse 5538 ms, sort 0 ms, write 0 ms, index 835 ms: 6 candidates, 70047 repo-hours, 1154 releases; waiting 525 ms; commit 0 ms)
2026-11-08T05:34:07Z [load_day 2024-04-10] 2024-04-10 hour 22: 214700 events in 0 files, snapshot none (task 6642 ms: download 4291 ms overlapping gunzip 1047 ms, parse 4263 ms, sort 0 ms, write 0 ms, index 518 ms: 9 candidates, 61744 repo-hours, 946 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:34:07Z [load_day 2024-04-10] 2024-04-10 hour 23: 206377 events in 0 files, snapshot none (task 6514 ms: download 4258 ms overlapping gunzip 945 ms, parse 3914 ms, sort 0 ms, write 0 ms, index 515 ms: 5 candidates, 60147 repo-hours, 820 releases; waiting 796 ms; commit 0 ms)
2026-11-08T05:34:16Z [load_day 2024-04-10] 2024-04-10: repo_hour merged from 24 files to 1 (2027699 rows, 9125 ms)
2026-11-08T05:34:19Z [load_day 2024-04-10] 2024-04-10: index committed in 11409 ms (24 + 1 + 24 files)
2026-11-08T05:34:19Z [load_day 2024-04-10] 2024-04-10: 5845307 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:34:19Z [load_day 2024-04-10] attempt 1 succeeded