orcaLog in

Runs · run 146

load_day 2026-09-30, attempt 1 succeeded

Host
4e84322b8c45:25115
Started
2026-11-07T03:46:03Z
Ended
2026-11-07T03:47:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/146/load_day/2026-09-30/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:46:03Z [load_day 2026-09-30] attempt 1 started
2026-11-07T03:46:09Z [load_day 2026-09-30] 2026-09-30 hour 0: 46643 events in 1 files, snapshot 7600563755688367746 (task 3824 ms: download 1449 ms overlapping gunzip 238 ms, parse 766 ms, sort 77 ms, write 1634 ms, index 233 ms: 4 candidates, 28179 repo-hours, 510 releases; waiting 555 ms; commit 760 ms)
2026-11-07T03:46:10Z [load_day 2026-09-30] 2026-09-30 hour 1: 53538 events in 2 files, snapshot 3948987530892490862 (task 5248 ms: download 2480 ms overlapping gunzip 352 ms, parse 1098 ms, sort 105 ms, write 1980 ms, index 205 ms: 4 candidates, 31296 repo-hours, 691 releases; waiting 1242 ms; commit 704 ms)
2026-11-07T03:46:14Z [load_day 2026-09-30] 2026-09-30 hour 2: 53890 events in 2 files, snapshot 672688896875927589 (task 4614 ms: download 1553 ms overlapping gunzip 260 ms, parse 739 ms, sort 49 ms, write 2019 ms, index 218 ms: 3 candidates, 32499 repo-hours, 625 releases; waiting 679 ms; commit 556 ms)
2026-11-07T03:46:15Z [load_day 2026-09-30] 2026-09-30 hour 3: 57049 events in 2 files, snapshot 463708791102413370 (task 3764 ms: download 1391 ms overlapping gunzip 271 ms, parse 810 ms, sort 51 ms, write 1614 ms, index 229 ms: 8 candidates, 35031 repo-hours, 479 releases; waiting 543 ms; commit 611 ms)
2026-11-07T03:46:18Z [load_day 2026-09-30] 2026-09-30 hour 4: 54903 events in 2 files, snapshot 7204938540342598938 (task 3840 ms: download 1651 ms overlapping gunzip 200 ms, parse 593 ms, sort 50 ms, write 1544 ms, index 228 ms: 2 candidates, 34541 repo-hours, 521 releases; waiting 920 ms; commit 616 ms)
2026-11-07T03:46:19Z [load_day 2026-09-30] 2026-09-30 hour 5: 55485 events in 2 files, snapshot 7940422525879553932 (task 3512 ms: download 1467 ms overlapping gunzip 239 ms, parse 653 ms, sort 47 ms, write 1407 ms, index 227 ms: 2 candidates, 34847 repo-hours, 426 releases; waiting 592 ms; commit 697 ms)
2026-11-07T03:46:22Z [load_day 2026-09-30] 2026-09-30 hour 6: 55263 events in 2 files, snapshot 5498085432228346372 (task 3664 ms: download 1548 ms overlapping gunzip 192 ms, parse 570 ms, sort 89 ms, write 1478 ms, index 233 ms: 3 candidates, 35303 repo-hours, 414 releases; waiting 855 ms; commit 582 ms)
2026-11-07T03:46:23Z [load_day 2026-09-30] 2026-09-30 hour 7: 48683 events in 1 files, snapshot 269653321756607199 (task 3073 ms: download 1346 ms overlapping gunzip 186 ms, parse 577 ms, sort 39 ms, write 1122 ms, index 210 ms: 2 candidates, 31451 repo-hours, 404 releases; waiting 625 ms; commit 762 ms)
2026-11-07T03:46:26Z [load_day 2026-09-30] 2026-09-30 hour 8: 45470 events in 1 files, snapshot 3924433673365737480 (task 2967 ms: download 978 ms overlapping gunzip 166 ms, parse 530 ms, sort 36 ms, write 1249 ms, index 200 ms: 6 candidates, 31023 repo-hours, 360 releases; waiting 536 ms; commit 857 ms)
2026-11-07T03:46:27Z [load_day 2026-09-30] 2026-09-30 hour 9: 45003 events in 1 files, snapshot 5589364846519225806 (task 2515 ms: download 712 ms overlapping gunzip 121 ms, parse 375 ms, sort 36 ms, write 1125 ms, index 199 ms: 4 candidates, 30579 repo-hours, 263 releases; waiting 329 ms; commit 605 ms)
2026-11-07T03:46:29Z [load_day 2026-09-30] 2026-09-30 hour 10: 46576 events in 1 files, snapshot 5875607723731464993 (task 2448 ms: download 946 ms overlapping gunzip 128 ms, parse 383 ms, sort 33 ms, write 867 ms, index 219 ms: 2 candidates, 32584 repo-hours, 274 releases; waiting 543 ms; commit 649 ms)
2026-11-07T03:46:30Z [load_day 2026-09-30] 2026-09-30 hour 11: 48723 events in 1 files, snapshot 1363840746036186992 (task 2744 ms: download 1056 ms overlapping gunzip 143 ms, parse 468 ms, sort 38 ms, write 1014 ms, index 223 ms: 6 candidates, 35028 repo-hours, 295 releases; waiting 555 ms; commit 731 ms)
2026-11-07T03:46:33Z [load_day 2026-09-30] 2026-09-30 hour 12: 51451 events in 2 files, snapshot 6608846604959218325 (task 2903 ms: download 1149 ms overlapping gunzip 167 ms, parse 512 ms, sort 42 ms, write 1072 ms, index 261 ms: 4 candidates, 37838 repo-hours, 320 releases; waiting 567 ms; commit 707 ms)
2026-11-07T03:46:36Z [load_day 2026-09-30] 2026-09-30 hour 13: 52494 events in 2 files, snapshot 4866799024804209675 (task 4140 ms: download 1893 ms overlapping gunzip 164 ms, parse 486 ms, sort 40 ms, write 1322 ms, index 295 ms: 3 candidates, 39355 repo-hours, 291 releases; waiting 1279 ms; commit 1346 ms)
2026-11-07T03:46:36Z [load_day 2026-09-30] 2026-09-30 hour 14: 52505 events in 2 files, snapshot 2760328971007513528 (task 3099 ms: download 1082 ms overlapping gunzip 182 ms, parse 542 ms, sort 63 ms, write 1365 ms, index 253 ms: 7 candidates, 39547 repo-hours, 509 releases; waiting 413 ms; commit 549 ms)
2026-11-07T03:46:40Z [load_day 2026-09-30] 2026-09-30 hour 15: 56625 events in 2 files, snapshot 2575193516811154053 (task 4442 ms: download 1585 ms overlapping gunzip 275 ms, parse 795 ms, sort 87 ms, write 2013 ms, index 262 ms: 5 candidates, 39324 repo-hours, 662 releases; waiting 725 ms; commit 707 ms)
2026-11-07T03:46:41Z [load_day 2026-09-30] 2026-09-30 hour 16: 56407 events in 2 files, snapshot 503363694693926970 (task 4157 ms: download 1297 ms overlapping gunzip 307 ms, parse 867 ms, sort 79 ms, write 1840 ms, index 249 ms: 6 candidates, 38533 repo-hours, 621 releases; waiting 568 ms; commit 682 ms)
2026-11-07T03:46:44Z [load_day 2026-09-30] 2026-09-30 hour 17: 55966 events in 2 files, snapshot 2022854909721028330 (task 3680 ms: download 936 ms overlapping gunzip 246 ms, parse 696 ms, sort 49 ms, write 1827 ms, index 344 ms: 3 candidates, 38792 repo-hours, 608 releases; waiting 217 ms; commit 611 ms)
2026-11-07T03:46:45Z [load_day 2026-09-30] 2026-09-30 hour 18: 51393 events in 2 files, snapshot 584652959978436189 (task 3730 ms: download 1486 ms overlapping gunzip 238 ms, parse 667 ms, sort 48 ms, write 1624 ms, index 221 ms: 11 candidates, 34924 repo-hours, 441 releases; waiting 670 ms; commit 489 ms)
2026-11-07T03:46:49Z [load_day 2026-09-30] 2026-09-30 hour 19: 51377 events in 2 files, snapshot 1861854094643858520 (task 4153 ms: download 1761 ms overlapping gunzip 216 ms, parse 620 ms, sort 46 ms, write 1782 ms, index 242 ms: 4 candidates, 34536 repo-hours, 431 releases; waiting 951 ms; commit 564 ms)
2026-11-07T03:46:49Z [load_day 2026-09-30] 2026-09-30 hour 20: 52626 events in 2 files, snapshot 4486815356820090606 (task 3445 ms: download 1288 ms overlapping gunzip 217 ms, parse 611 ms, sort 46 ms, write 1479 ms, index 217 ms: 5 candidates, 34021 repo-hours, 399 releases; waiting 549 ms; commit 576 ms)
2026-11-07T03:46:53Z [load_day 2026-09-30] 2026-09-30 hour 21: 52209 events in 2 files, snapshot 1795172574100217469 (task 3647 ms: download 1448 ms overlapping gunzip 209 ms, parse 623 ms, sort 48 ms, write 1525 ms, index 231 ms: 4 candidates, 33048 repo-hours, 436 releases; waiting 671 ms; commit 583 ms)
2026-11-07T03:46:54Z [load_day 2026-09-30] 2026-09-30 hour 22: 56274 events in 2 files, snapshot 3869198691654133051 (task 3829 ms: download 1684 ms overlapping gunzip 238 ms, parse 725 ms, sort 49 ms, write 1477 ms, index 217 ms: 6 candidates, 33582 repo-hours, 408 releases; waiting 808 ms; commit 741 ms)
2026-11-07T03:46:57Z [load_day 2026-09-30] 2026-09-30 hour 23: 55289 events in 2 files, snapshot 2521665598038168883 (task 3530 ms: download 1374 ms overlapping gunzip 213 ms, parse 646 ms, sort 73 ms, write 1455 ms, index 233 ms: 4 candidates, 31862 repo-hours, 381 releases; waiting 583 ms; commit 759 ms)
2026-11-07T03:47:01Z [load_day 2026-09-30] 2026-09-30: repo_hour merged from 24 files to 1 (827723 rows, 4007 ms)
2026-11-07T03:47:03Z [load_day 2026-09-30] 2026-09-30: index committed in 5855 ms (24 + 1 + 24 files)
2026-11-07T03:47:03Z [load_day 2026-09-30] 2026-09-30: 1255842 events in 24 hours
2026-11-07T03:47:03Z [load_day 2026-09-30] attempt 1 succeeded