orcaLog in

Runs · run 684

load_day 2026-04-04, attempt 1 succeeded

Host
4e84322b8c45:168486
Started
2026-11-07T13:10:12Z
Ended
2026-11-07T13:12:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/684/load_day/2026-04-04/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:10:12Z [load_day 2026-04-04] attempt 1 started
2026-11-07T13:10:22Z [load_day 2026-04-04] 2026-04-04 hour 0: 151068 events in 4 files, snapshot 5312200981764528408 (task 6454 ms: download 1876 ms overlapping gunzip 458 ms, parse 1574 ms, sort 206 ms, write 3246 ms, index 419 ms: 4 candidates, 64779 repo-hours, 793 releases; waiting 201 ms; commit 1308 ms)
2026-11-07T13:10:24Z [load_day 2026-04-04] 2026-04-04 hour 1: 155765 events in 4 files, snapshot 6257584670675053157 (task 6375 ms: download 1832 ms overlapping gunzip 424 ms, parse 1435 ms, sort 190 ms, write 3159 ms, index 575 ms: 11 candidates, 86200 repo-hours, 602 releases; waiting 263 ms; commit 1231 ms)
2026-11-07T13:10:34Z [load_day 2026-04-04] 2026-04-04 hour 2: 158655 events in 4 files, snapshot 7437674484208429102 (task 10151 ms: download 2312 ms overlapping gunzip 638 ms, parse 2221 ms, sort 237 ms, write 5736 ms, index 513 ms: 6 candidates, 81182 repo-hours, 547 releases; waiting 491 ms; commit 1514 ms)
2026-11-07T13:10:36Z [load_day 2026-04-04] 2026-04-04 hour 3: 154177 events in 4 files, snapshot 1413230126505766256 (task 11409 ms: download 2267 ms overlapping gunzip 782 ms, parse 2765 ms, sort 260 ms, write 6581 ms, index 478 ms: 11 candidates, 63638 repo-hours, 702 releases; waiting 182 ms; commit 1353 ms)
2026-11-07T13:10:44Z [load_day 2026-04-04] 2026-04-04 hour 4: 157183 events in 4 files, snapshot 635231719778613732 (task 9768 ms: download 2677 ms overlapping gunzip 660 ms, parse 2096 ms, sort 263 ms, write 5291 ms, index 498 ms: 6 candidates, 68678 repo-hours, 857 releases; waiting 612 ms; commit 1184 ms)
2026-11-07T13:10:46Z [load_day 2026-04-04] 2026-04-04 hour 5: 156343 events in 4 files, snapshot 4867699858063863149 (task 9290 ms: download 2769 ms overlapping gunzip 626 ms, parse 2048 ms, sort 179 ms, write 5056 ms, index 453 ms: 5 candidates, 67619 repo-hours, 720 releases; waiting 546 ms; commit 1080 ms)
2026-11-07T13:10:55Z [load_day 2026-04-04] 2026-04-04 hour 6: 156120 events in 4 files, snapshot 4286365721171775013 (task 9730 ms: download 2753 ms overlapping gunzip 723 ms, parse 2430 ms, sort 234 ms, write 4886 ms, index 574 ms: 6 candidates, 74694 repo-hours, 967 releases; waiting 585 ms; commit 1542 ms)
2026-11-07T13:10:57Z [load_day 2026-04-04] 2026-04-04 hour 7: 159639 events in 4 files, snapshot 5872288814396958960 (task 8978 ms: download 2695 ms overlapping gunzip 670 ms, parse 2227 ms, sort 302 ms, write 4195 ms, index 673 ms: 4 candidates, 76504 repo-hours, 746 releases; waiting 579 ms; commit 2449 ms)
2026-11-07T13:11:04Z [load_day 2026-04-04] 2026-04-04 hour 8: 156927 events in 4 files, snapshot 5361040559634638140 (task 9075 ms: download 2960 ms overlapping gunzip 683 ms, parse 2270 ms, sort 185 ms, write 4473 ms, index 482 ms: 8 candidates, 75454 repo-hours, 783 releases; waiting 655 ms; commit 1225 ms)
2026-11-07T13:11:05Z [load_day 2026-04-04] 2026-04-04 hour 9: 158566 events in 4 files, snapshot 2486130221250594991 (task 6740 ms: download 1990 ms overlapping gunzip 500 ms, parse 1589 ms, sort 152 ms, write 3098 ms, index 532 ms: 6 candidates, 79244 repo-hours, 828 releases; waiting 567 ms; commit 1191 ms)
2026-11-07T13:11:14Z [load_day 2026-04-04] 2026-04-04 hour 10: 156632 events in 4 files, snapshot 2991563717868281027 (task 9121 ms: download 2875 ms overlapping gunzip 594 ms, parse 1985 ms, sort 182 ms, write 4782 ms, index 529 ms: 5 candidates, 74321 repo-hours, 719 releases; waiting 680 ms; commit 1233 ms)
2026-11-07T13:11:15Z [load_day 2026-04-04] 2026-04-04 hour 11: 158531 events in 4 files, snapshot 8354457008168319565 (task 8375 ms: download 2276 ms overlapping gunzip 637 ms, parse 2187 ms, sort 313 ms, write 3917 ms, index 494 ms: 8 candidates, 75415 repo-hours, 683 releases; waiting 555 ms; commit 1104 ms)
2026-11-07T13:11:23Z [load_day 2026-04-04] 2026-04-04 hour 12: 159126 events in 4 files, snapshot 6627057703534044522 (task 7713 ms: download 1998 ms overlapping gunzip 473 ms, parse 1561 ms, sort 188 ms, write 4251 ms, index 534 ms: 14 candidates, 87367 repo-hours, 549 releases; waiting 281 ms; commit 1292 ms)
2026-11-07T13:11:24Z [load_day 2026-04-04] 2026-04-04 hour 13: 159235 events in 4 files, snapshot 8530719174153615636 (task 6652 ms: download 1793 ms overlapping gunzip 474 ms, parse 1540 ms, sort 146 ms, write 3455 ms, index 575 ms: 13 candidates, 90249 repo-hours, 625 releases; waiting 185 ms; commit 1369 ms)
2026-11-07T13:11:30Z [load_day 2026-04-04] 2026-04-04 hour 14: 158501 events in 4 files, snapshot 7107656476871992207 (task 6541 ms: download 2309 ms overlapping gunzip 505 ms, parse 1558 ms, sort 140 ms, write 2832 ms, index 582 ms: 9 candidates, 81550 repo-hours, 726 releases; waiting 641 ms; commit 1446 ms)
2026-11-07T13:11:31Z [load_day 2026-04-04] 2026-04-04 hour 15: 158192 events in 4 files, snapshot 2718708146756935970 (task 6503 ms: download 1892 ms overlapping gunzip 450 ms, parse 1461 ms, sort 159 ms, write 3002 ms, index 554 ms: 13 candidates, 82481 repo-hours, 788 releases; waiting 556 ms; commit 1290 ms)
2026-11-07T13:11:37Z [load_day 2026-04-04] 2026-04-04 hour 16: 154566 events in 4 files, snapshot 7023811959367121357 (task 6020 ms: download 2321 ms overlapping gunzip 387 ms, parse 1248 ms, sort 176 ms, write 2796 ms, index 584 ms: 8 candidates, 80571 repo-hours, 724 releases; waiting 540 ms; commit 1639 ms)
2026-11-07T13:11:39Z [load_day 2026-04-04] 2026-04-04 hour 17: 157649 events in 4 files, snapshot 5036639147704857392 (task 6421 ms: download 2166 ms overlapping gunzip 458 ms, parse 1453 ms, sort 189 ms, write 2877 ms, index 532 ms: 8 candidates, 78673 repo-hours, 702 releases; waiting 590 ms; commit 1451 ms)
2026-11-07T13:11:44Z [load_day 2026-04-04] 2026-04-04 hour 18: 156026 events in 4 files, snapshot 1130919509055015764 (task 6851 ms: download 2541 ms overlapping gunzip 444 ms, parse 1365 ms, sort 164 ms, write 3225 ms, index 554 ms: 8 candidates, 82230 repo-hours, 750 releases; waiting 804 ms; commit 1346 ms)
2026-11-07T13:11:46Z [load_day 2026-04-04] 2026-04-04 hour 19: 155723 events in 4 files, snapshot 802982071724323298 (task 6508 ms: download 2095 ms overlapping gunzip 438 ms, parse 1430 ms, sort 187 ms, write 2988 ms, index 530 ms: 18 candidates, 76832 repo-hours, 815 releases; waiting 607 ms; commit 1129 ms)
2026-11-07T13:11:51Z [load_day 2026-04-04] 2026-04-04 hour 20: 151818 events in 4 files, snapshot 2632039296566279338 (task 5807 ms: download 2272 ms overlapping gunzip 386 ms, parse 1298 ms, sort 145 ms, write 2415 ms, index 521 ms: 3 candidates, 74133 repo-hours, 753 releases; waiting 731 ms; commit 1395 ms)
2026-11-07T13:11:53Z [load_day 2026-04-04] 2026-04-04 hour 21: 153228 events in 4 files, snapshot 6703892821838163159 (task 5965 ms: download 2186 ms overlapping gunzip 399 ms, parse 1300 ms, sort 189 ms, write 2518 ms, index 567 ms: 5 candidates, 73656 repo-hours, 791 releases; waiting 562 ms; commit 1360 ms)
2026-11-07T13:11:57Z [load_day 2026-04-04] 2026-04-04 hour 22: 152536 events in 4 files, snapshot 4609057611314856940 (task 5761 ms: download 1534 ms overlapping gunzip 397 ms, parse 1270 ms, sort 153 ms, write 2732 ms, index 525 ms: 5 candidates, 69806 repo-hours, 819 releases; waiting 389 ms; commit 1146 ms)
2026-11-07T13:11:59Z [load_day 2026-04-04] 2026-04-04 hour 23: 146328 events in 3 files, snapshot 4344652029547914712 (task 5855 ms: download 2243 ms overlapping gunzip 391 ms, parse 1410 ms, sort 142 ms, write 2413 ms, index 475 ms: 3 candidates, 66685 repo-hours, 1028 releases; waiting 688 ms; commit 1380 ms)
2026-11-07T13:12:06Z [load_day 2026-04-04] 2026-04-04: repo_hour merged from 24 files to 1 (1831961 rows, 7565 ms)
2026-11-07T13:12:08Z [load_day 2026-04-04] 2026-04-04: index committed in 9557 ms (24 + 1 + 24 files)
2026-11-07T13:12:08Z [load_day 2026-04-04] 2026-04-04: 3742534 events in 24 hours
2026-11-07T13:12:08Z [load_day 2026-04-04] attempt 1 succeeded