orcaLog in

Runs · run 624

load_day 2026-04-23, attempt 1 succeeded

Host
4e84322b8c45:151943
Started
2026-11-07T12:40:18Z
Ended
2026-11-07T12:41:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/624/load_day/2026-04-23/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:40:18Z [load_day 2026-04-23] attempt 1 started
2026-11-07T12:40:26Z [load_day 2026-04-23] 2026-04-23 hour 0: 149957 events in 3 files, snapshot 7941785209931537393 (task 5073 ms: download 1999 ms overlapping gunzip 268 ms, parse 993 ms, sort 153 ms, write 2269 ms, index 517 ms: 8 candidates, 71571 repo-hours, 653 releases; waiting 498 ms; commit 1084 ms)
2026-11-07T12:40:28Z [load_day 2026-04-23] 2026-04-23 hour 1: 154502 events in 4 files, snapshot 1099446075485065307 (task 5182 ms: download 1616 ms overlapping gunzip 264 ms, parse 994 ms, sort 138 ms, write 2386 ms, index 568 ms: 9 candidates, 80021 repo-hours, 529 releases; waiting 502 ms; commit 1154 ms)
2026-11-07T12:40:32Z [load_day 2026-04-23] 2026-04-23 hour 2: 157057 events in 4 files, snapshot 5615278999157921936 (task 4667 ms: download 1597 ms overlapping gunzip 243 ms, parse 885 ms, sort 134 ms, write 1984 ms, index 586 ms: 10 candidates, 89166 repo-hours, 436 releases; waiting 569 ms; commit 1220 ms)
2026-11-07T12:40:34Z [load_day 2026-04-23] 2026-04-23 hour 3: 153207 events in 4 files, snapshot 1791599465067610606 (task 5189 ms: download 1920 ms overlapping gunzip 268 ms, parse 954 ms, sort 164 ms, write 1911 ms, index 547 ms: 8 candidates, 81622 repo-hours, 549 releases; waiting 1031 ms; commit 1195 ms)
2026-11-07T12:40:37Z [load_day 2026-04-23] 2026-04-23 hour 4: 148689 events in 3 files, snapshot 8092113421932566404 (task 4626 ms: download 1591 ms overlapping gunzip 271 ms, parse 977 ms, sort 128 ms, write 1915 ms, index 488 ms: 9 candidates, 70872 repo-hours, 701 releases; waiting 525 ms; commit 1184 ms)
2026-11-07T12:40:39Z [load_day 2026-04-23] 2026-04-23 hour 5: 146508 events in 3 files, snapshot 5776918541590463915 (task 4217 ms: download 1498 ms overlapping gunzip 262 ms, parse 914 ms, sort 112 ms, write 1772 ms, index 517 ms: 9 candidates, 75901 repo-hours, 653 releases; waiting 266 ms; commit 1134 ms)
2026-11-07T12:40:43Z [load_day 2026-04-23] 2026-04-23 hour 6: 155077 events in 4 files, snapshot 6994363128984590612 (task 4574 ms: download 1949 ms overlapping gunzip 251 ms, parse 902 ms, sort 111 ms, write 1817 ms, index 554 ms: 9 candidates, 81606 repo-hours, 434 releases; waiting 619 ms; commit 1203 ms)
2026-11-07T12:40:44Z [load_day 2026-04-23] 2026-04-23 hour 7: 154267 events in 4 files, snapshot 3494412461104830485 (task 4485 ms: download 2160 ms overlapping gunzip 240 ms, parse 906 ms, sort 160 ms, write 1719 ms, index 577 ms: 12 candidates, 80851 repo-hours, 362 releases; waiting 533 ms; commit 1505 ms)
2026-11-07T12:40:48Z [load_day 2026-04-23] 2026-04-23 hour 8: 153197 events in 4 files, snapshot 1221986621793976147 (task 4367 ms: download 1425 ms overlapping gunzip 230 ms, parse 827 ms, sort 131 ms, write 1781 ms, index 580 ms: 11 candidates, 83851 repo-hours, 200 releases; waiting 523 ms; commit 1032 ms)
2026-11-07T12:40:49Z [load_day 2026-04-23] 2026-04-23 hour 9: 159841 events in 4 files, snapshot 5150909451858429559 (task 4322 ms: download 1706 ms overlapping gunzip 249 ms, parse 890 ms, sort 124 ms, write 1594 ms, index 584 ms: 14 candidates, 86536 repo-hours, 147 releases; waiting 539 ms; commit 1121 ms)
2026-11-07T12:40:53Z [load_day 2026-04-23] 2026-04-23 hour 10: 155373 events in 4 files, snapshot 19601084302154595 (task 4477 ms: download 1546 ms overlapping gunzip 246 ms, parse 863 ms, sort 147 ms, write 1771 ms, index 575 ms: 8 candidates, 82489 repo-hours, 220 releases; waiting 525 ms; commit 1185 ms)
2026-11-07T12:40:54Z [load_day 2026-04-23] 2026-04-23 hour 11: 156352 events in 4 files, snapshot 4303388477036541103 (task 4515 ms: download 1828 ms overlapping gunzip 248 ms, parse 866 ms, sort 116 ms, write 1639 ms, index 587 ms: 10 candidates, 86841 repo-hours, 205 releases; waiting 757 ms; commit 1027 ms)
2026-11-07T12:40:58Z [load_day 2026-04-23] 2026-04-23 hour 12: 155565 events in 4 files, snapshot 2269588510967396826 (task 4453 ms: download 2037 ms overlapping gunzip 219 ms, parse 792 ms, sort 107 ms, write 1852 ms, index 586 ms: 7 candidates, 87409 repo-hours, 201 releases; waiting 531 ms; commit 1154 ms)
2026-11-07T12:40:59Z [load_day 2026-04-23] 2026-04-23 hour 13: 154117 events in 4 files, snapshot 1513050516760428504 (task 4249 ms: download 1245 ms overlapping gunzip 207 ms, parse 776 ms, sort 132 ms, write 1800 ms, index 636 ms: 8 candidates, 94226 repo-hours, 70 releases; waiting 377 ms; commit 1005 ms)
2026-11-07T12:41:04Z [load_day 2026-04-23] 2026-04-23 hour 14: 147615 events in 3 files, snapshot 3630961639480052761 (task 4581 ms: download 1852 ms overlapping gunzip 240 ms, parse 846 ms, sort 116 ms, write 1861 ms, index 618 ms: 4 candidates, 83730 repo-hours, 186 releases; waiting 651 ms; commit 1128 ms)
2026-11-07T12:41:05Z [load_day 2026-04-23] 2026-04-23 hour 15: 154390 events in 4 files, snapshot 2962620073525287413 (task 4430 ms: download 1285 ms overlapping gunzip 224 ms, parse 812 ms, sort 114 ms, write 1771 ms, index 612 ms: 9 candidates, 87250 repo-hours, 143 releases; waiting 469 ms; commit 1224 ms)
2026-11-07T12:41:09Z [load_day 2026-04-23] 2026-04-23 hour 16: 149656 events in 3 files, snapshot 7956563891670920048 (task 4855 ms: download 1368 ms overlapping gunzip 266 ms, parse 857 ms, sort 128 ms, write 2108 ms, index 613 ms: 10 candidates, 85262 repo-hours, 242 releases; waiting 300 ms; commit 1223 ms)
2026-11-07T12:41:11Z [load_day 2026-04-23] 2026-04-23 hour 17: 159033 events in 4 files, snapshot 8089865463475639087 (task 4817 ms: download 1787 ms overlapping gunzip 235 ms, parse 849 ms, sort 126 ms, write 2043 ms, index 647 ms: 12 candidates, 89088 repo-hours, 186 releases; waiting 599 ms; commit 1352 ms)
2026-11-07T12:41:15Z [load_day 2026-04-23] 2026-04-23 hour 18: 156359 events in 4 files, snapshot 7129901294996887818 (task 4522 ms: download 1400 ms overlapping gunzip 252 ms, parse 881 ms, sort 129 ms, write 1954 ms, index 615 ms: 11 candidates, 85859 repo-hours, 233 releases; waiting 345 ms; commit 1296 ms)
2026-11-07T12:41:17Z [load_day 2026-04-23] 2026-04-23 hour 19: 156988 events in 4 files, snapshot 1703892224571487446 (task 5091 ms: download 1818 ms overlapping gunzip 270 ms, parse 919 ms, sort 121 ms, write 2270 ms, index 596 ms: 10 candidates, 86946 repo-hours, 295 releases; waiting 541 ms; commit 1221 ms)
2026-11-07T12:41:21Z [load_day 2026-04-23] 2026-04-23 hour 20: 153139 events in 4 files, snapshot 1055481863965738258 (task 4980 ms: download 2067 ms overlapping gunzip 288 ms, parse 1022 ms, sort 141 ms, write 1943 ms, index 561 ms: 8 candidates, 82841 repo-hours, 304 releases; waiting 614 ms; commit 1417 ms)
2026-11-07T12:41:23Z [load_day 2026-04-23] 2026-04-23 hour 21: 152140 events in 4 files, snapshot 5265786875323083580 (task 5186 ms: download 2033 ms overlapping gunzip 318 ms, parse 1043 ms, sort 155 ms, write 2282 ms, index 538 ms: 5 candidates, 75388 repo-hours, 567 releases; waiting 548 ms; commit 1212 ms)
2026-11-07T12:41:27Z [load_day 2026-04-23] 2026-04-23 hour 22: 153262 events in 4 files, snapshot 5111954410165087844 (task 5652 ms: download 2235 ms overlapping gunzip 370 ms, parse 1219 ms, sort 166 ms, write 2480 ms, index 541 ms: 9 candidates, 75128 repo-hours, 553 releases; waiting 542 ms; commit 1255 ms)
2026-11-07T12:41:29Z [load_day 2026-04-23] 2026-04-23 hour 23: 149780 events in 3 files, snapshot 4719676988518869386 (task 5796 ms: download 1842 ms overlapping gunzip 370 ms, parse 1234 ms, sort 148 ms, write 2703 ms, index 482 ms: 12 candidates, 73091 repo-hours, 734 releases; waiting 552 ms; commit 1228 ms)
2026-11-07T12:41:38Z [load_day 2026-04-23] 2026-04-23: repo_hour merged from 24 files to 1 (1977545 rows, 8696 ms)
2026-11-07T12:41:40Z [load_day 2026-04-23] 2026-04-23: index committed in 10680 ms (24 + 1 + 24 files)
2026-11-07T12:41:40Z [load_day 2026-04-23] 2026-04-23: 3686071 events in 24 hours
2026-11-07T12:41:40Z [load_day 2026-04-23] attempt 1 succeeded