orcaLog in

Runs · run 296

load_day 2026-08-11, attempt 1 succeeded

Host
4e84322b8c45:51157
Started
2026-11-07T04:37:28Z
Ended
2026-11-07T04:38:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/296/load_day/2026-08-11/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:37:28Z [load_day 2026-08-11] attempt 1 started
2026-11-07T04:37:35Z [load_day 2026-08-11] 2026-08-11 hour 0: 147533 events in 3 files, snapshot 3315053417092504725 (task 3861 ms: download 1632 ms overlapping gunzip 229 ms, parse 829 ms, sort 113 ms, write 1483 ms, index 266 ms: 1 candidates, 41116 repo-hours, 112 releases; waiting 595 ms; commit 955 ms)
2026-11-07T04:37:37Z [load_day 2026-08-11] 2026-08-11 hour 1: 158679 events in 4 files, snapshot 2748762095439631214 (task 3805 ms: download 1155 ms overlapping gunzip 229 ms, parse 854 ms, sort 132 ms, write 1530 ms, index 277 ms: 3 candidates, 43407 repo-hours, 45 releases; waiting 504 ms; commit 1982 ms)
2026-11-07T04:37:39Z [load_day 2026-08-11] 2026-08-11 hour 2: 165119 events in 4 files, snapshot 4247228832205024091 (task 3836 ms: download 1838 ms overlapping gunzip 249 ms, parse 780 ms, sort 114 ms, write 1537 ms, index 285 ms: 2 candidates, 45260 repo-hours, 51 releases; waiting 535 ms; commit 868 ms)
2026-11-07T04:37:40Z [load_day 2026-08-11] 2026-08-11 hour 3: 169474 events in 4 files, snapshot 8095713239026657282 (task 3367 ms: download 1004 ms overlapping gunzip 221 ms, parse 797 ms, sort 128 ms, write 1445 ms, index 267 ms: 3 candidates, 38536 repo-hours, 22 releases; waiting 305 ms; commit 781 ms)
2026-11-07T04:37:44Z [load_day 2026-08-11] 2026-08-11 hour 4: 165481 events in 4 files, snapshot 848018934205545570 (task 3310 ms: download 772 ms overlapping gunzip 199 ms, parse 738 ms, sort 113 ms, write 1444 ms, index 332 ms: 4 candidates, 47736 repo-hours, 11 releases; waiting 200 ms; commit 982 ms)
2026-11-07T04:37:45Z [load_day 2026-08-11] 2026-08-11 hour 5: 166579 events in 4 files, snapshot 5804798962640743967 (task 3650 ms: download 1560 ms overlapping gunzip 202 ms, parse 778 ms, sort 118 ms, write 1452 ms, index 294 ms: 2 candidates, 45140 repo-hours, 10 releases; waiting 526 ms; commit 805 ms)
2026-11-07T04:37:48Z [load_day 2026-08-11] 2026-08-11 hour 6: 166177 events in 4 files, snapshot 7547852076991695843 (task 3829 ms: download 1631 ms overlapping gunzip 207 ms, parse 822 ms, sort 120 ms, write 1536 ms, index 312 ms: 6 candidates, 46876 repo-hours, 17 releases; waiting 533 ms; commit 757 ms)
2026-11-07T04:37:49Z [load_day 2026-08-11] 2026-08-11 hour 7: 164675 events in 4 files, snapshot 504508185612784999 (task 3600 ms: download 1538 ms overlapping gunzip 197 ms, parse 749 ms, sort 108 ms, write 1412 ms, index 313 ms: 1 candidates, 47957 repo-hours, 8 releases; waiting 529 ms; commit 637 ms)
2026-11-07T04:37:53Z [load_day 2026-08-11] 2026-08-11 hour 8: 160774 events in 4 files, snapshot 4674679671709359482 (task 3682 ms: download 1314 ms overlapping gunzip 195 ms, parse 777 ms, sort 111 ms, write 1453 ms, index 323 ms: 0 candidates, 47339 repo-hours, 11 releases; waiting 534 ms; commit 890 ms)
2026-11-07T04:37:53Z [load_day 2026-08-11] 2026-08-11 hour 9: 166879 events in 4 files, snapshot 3991339847611667679 (task 3689 ms: download 1195 ms overlapping gunzip 202 ms, parse 771 ms, sort 115 ms, write 1556 ms, index 294 ms: 2 candidates, 42296 repo-hours, 14 releases; waiting 541 ms; commit 774 ms)
2026-11-07T04:37:57Z [load_day 2026-08-11] 2026-08-11 hour 10: 164806 events in 4 files, snapshot 7776641884324958629 (task 3575 ms: download 1298 ms overlapping gunzip 198 ms, parse 761 ms, sort 117 ms, write 1390 ms, index 272 ms: 2 candidates, 41780 repo-hours, 11 releases; waiting 539 ms; commit 887 ms)
2026-11-07T04:38:12Z [load_day 2026-08-11] 2026-08-11 hour 11: 163495 events in 4 files, snapshot 8353310293735468108 (task 18624 ms: download 17299 ms overlapping gunzip 282 ms, parse 977 ms, sort 114 ms, write 1443 ms, index 359 ms: 4 candidates, 47563 repo-hours, 23 releases; waiting 14674 ms; commit 758 ms)
2026-11-07T04:38:13Z [load_day 2026-08-11] 2026-08-11 hour 12: 160085 events in 4 files, snapshot 3835187623818163487 (task 3707 ms: download 1321 ms overlapping gunzip 200 ms, parse 747 ms, sort 110 ms, write 1437 ms, index 368 ms: 6 candidates, 58813 repo-hours, 23 releases; waiting 525 ms; commit 812 ms)
2026-11-07T04:38:17Z [load_day 2026-08-11] 2026-08-11 hour 13: 160520 events in 4 files, snapshot 6095020596060293290 (task 3608 ms: download 1282 ms overlapping gunzip 190 ms, parse 738 ms, sort 104 ms, write 1446 ms, index 314 ms: 4 candidates, 43025 repo-hours, 10 releases; waiting 512 ms; commit 1017 ms)
2026-11-07T04:38:18Z [load_day 2026-08-11] 2026-08-11 hour 14: 154747 events in 4 files, snapshot 2732229495528383050 (task 3589 ms: download 1312 ms overlapping gunzip 183 ms, parse 732 ms, sort 105 ms, write 1462 ms, index 243 ms: 2 candidates, 35477 repo-hours, 13 releases; waiting 535 ms; commit 861 ms)
2026-11-07T04:38:20Z [load_day 2026-08-11] 2026-08-11 hour 15: 132612 events in 3 files, snapshot 1324123402493929478 (task 3113 ms: download 1178 ms overlapping gunzip 161 ms, parse 616 ms, sort 83 ms, write 1226 ms, index 197 ms: 4 candidates, 30859 repo-hours, 16 releases; waiting 544 ms; commit 761 ms)
2026-11-07T04:38:21Z [load_day 2026-08-11] 2026-08-11 hour 16: 117404 events in 3 files, snapshot 7465789241086718544 (task 3142 ms: download 1284 ms overlapping gunzip 164 ms, parse 575 ms, sort 75 ms, write 1125 ms, index 312 ms: 3 candidates, 46344 repo-hours, 33 releases; waiting 549 ms; commit 765 ms)
2026-11-07T04:38:25Z [load_day 2026-08-11] 2026-08-11 hour 17: 143208 events in 3 files, snapshot 9056488472916836722 (task 3550 ms: download 1672 ms overlapping gunzip 184 ms, parse 677 ms, sort 93 ms, write 1342 ms, index 344 ms: 4 candidates, 52632 repo-hours, 22 releases; waiting 528 ms; commit 930 ms)
2026-11-07T04:38:26Z [load_day 2026-08-11] 2026-08-11 hour 18: 151458 events in 4 files, snapshot 8111963668753798663 (task 3493 ms: download 814 ms overlapping gunzip 182 ms, parse 689 ms, sort 97 ms, write 1428 ms, index 330 ms: 0 candidates, 54795 repo-hours, 25 releases; waiting 241 ms; commit 784 ms)
2026-11-07T04:38:29Z [load_day 2026-08-11] 2026-08-11 hour 19: 155818 events in 4 files, snapshot 5459415761459855527 (task 3624 ms: download 1304 ms overlapping gunzip 182 ms, parse 697 ms, sort 103 ms, write 1472 ms, index 359 ms: 2 candidates, 53557 repo-hours, 20 releases; waiting 512 ms; commit 853 ms)
2026-11-07T04:38:30Z [load_day 2026-08-11] 2026-08-11 hour 20: 159290 events in 4 files, snapshot 8714436385038677231 (task 3772 ms: download 1303 ms overlapping gunzip 192 ms, parse 730 ms, sort 100 ms, write 1549 ms, index 385 ms: 4 candidates, 58513 repo-hours, 15 releases; waiting 525 ms; commit 725 ms)
2026-11-07T04:38:34Z [load_day 2026-08-11] 2026-08-11 hour 21: 158941 events in 4 files, snapshot 2030544184034006341 (task 3785 ms: download 1215 ms overlapping gunzip 197 ms, parse 746 ms, sort 109 ms, write 1532 ms, index 387 ms: 3 candidates, 57576 repo-hours, 18 releases; waiting 524 ms; commit 959 ms)
2026-11-07T04:38:34Z [load_day 2026-08-11] 2026-08-11 hour 22: 163869 events in 4 files, snapshot 3217828994429778869 (task 3767 ms: download 1455 ms overlapping gunzip 200 ms, parse 752 ms, sort 121 ms, write 1481 ms, index 385 ms: 3 candidates, 62027 repo-hours, 18 releases; waiting 535 ms; commit 840 ms)
2026-11-07T04:38:38Z [load_day 2026-08-11] 2026-08-11 hour 23: 169863 events in 4 files, snapshot 3141009599573404665 (task 3928 ms: download 1440 ms overlapping gunzip 217 ms, parse 795 ms, sort 114 ms, write 1462 ms, index 475 ms: 7 candidates, 66779 repo-hours, 28 releases; waiting 539 ms; commit 912 ms)
2026-11-07T04:38:43Z [load_day 2026-08-11] 2026-08-11: repo_hour merged from 24 files to 1 (1155403 rows, 5249 ms)
2026-11-07T04:38:45Z [load_day 2026-08-11] 2026-08-11: index committed in 6820 ms (22 + 1 + 24 files)
2026-11-07T04:38:45Z [load_day 2026-08-11] 2026-08-11: 3787486 events in 24 hours
2026-11-07T04:38:45Z [load_day 2026-08-11] attempt 1 succeeded