orcaLog in

Runs · run 143

load_day 2026-10-01, attempt 1 succeeded

Host
4e84322b8c45:24647
Started
2026-11-07T03:45:11Z
Ended
2026-11-07T03:46:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/143/load_day/2026-10-01/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:45:11Z [load_day 2026-10-01] attempt 1 started
2026-11-07T03:45:18Z [load_day 2026-10-01] 2026-10-01 hour 0: 61854 events in 2 files, snapshot 6087886064939543851 (task 2875 ms: download 304 ms overlapping gunzip 184 ms, parse 568 ms, sort 66 ms, write 1619 ms, index 229 ms: 4 candidates, 34665 repo-hours, 238 releases; waiting 11 ms; commit 632 ms)
2026-11-07T03:45:18Z [load_day 2026-10-01] 2026-10-01 hour 1: 78086 events in 2 files, snapshot 889350166798820245 (task 3054 ms: download 385 ms overlapping gunzip 185 ms, parse 596 ms, sort 80 ms, write 1694 ms, index 276 ms: 5 candidates, 41499 repo-hours, 372 releases; waiting 16 ms; commit 690 ms)
2026-11-07T03:45:21Z [load_day 2026-10-01] 2026-10-01 hour 2: 85345 events in 2 files, snapshot 5877508421018025943 (task 2755 ms: download 388 ms overlapping gunzip 221 ms, parse 644 ms, sort 62 ms, write 1321 ms, index 295 ms: 10 candidates, 46646 repo-hours, 267 releases; waiting 20 ms; commit 726 ms)
2026-11-07T03:45:22Z [load_day 2026-10-01] 2026-10-01 hour 3: 86558 events in 2 files, snapshot 9176371141080946674 (task 2780 ms: download 497 ms overlapping gunzip 228 ms, parse 661 ms, sort 60 ms, write 1318 ms, index 300 ms: 7 candidates, 50419 repo-hours, 280 releases; waiting 25 ms; commit 715 ms)
2026-11-07T03:45:24Z [load_day 2026-10-01] 2026-10-01 hour 4: 83993 events in 2 files, snapshot 769159425469309271 (task 2665 ms: download 321 ms overlapping gunzip 184 ms, parse 556 ms, sort 56 ms, write 1326 ms, index 311 ms: 8 candidates, 50381 repo-hours, 280 releases; waiting 20 ms; commit 794 ms)
2026-11-07T03:45:25Z [load_day 2026-10-01] 2026-10-01 hour 5: 80366 events in 2 files, snapshot 4105184457779819917 (task 2640 ms: download 328 ms overlapping gunzip 171 ms, parse 529 ms, sort 53 ms, write 1394 ms, index 300 ms: 5 candidates, 49486 repo-hours, 303 releases; waiting 15 ms; commit 688 ms)
2026-11-07T03:45:27Z [load_day 2026-10-01] 2026-10-01 hour 6: 84105 events in 2 files, snapshot 7672702154061278 (task 2514 ms: download 264 ms overlapping gunzip 171 ms, parse 518 ms, sort 55 ms, write 1254 ms, index 300 ms: 8 candidates, 50411 repo-hours, 259 releases; waiting 21 ms; commit 650 ms)
2026-11-07T03:45:28Z [load_day 2026-10-01] 2026-10-01 hour 7: 82354 events in 2 files, snapshot 6035997158245939977 (task 2515 ms: download 284 ms overlapping gunzip 172 ms, parse 524 ms, sort 53 ms, write 1230 ms, index 296 ms: 5 candidates, 51250 repo-hours, 255 releases; waiting 15 ms; commit 583 ms)
2026-11-07T03:45:31Z [load_day 2026-10-01] 2026-10-01 hour 8: 85259 events in 2 files, snapshot 1585625954108815042 (task 2498 ms: download 375 ms overlapping gunzip 163 ms, parse 508 ms, sort 55 ms, write 1236 ms, index 321 ms: 4 candidates, 54566 repo-hours, 285 releases; waiting 16 ms; commit 786 ms)
2026-11-07T03:45:31Z [load_day 2026-10-01] 2026-10-01 hour 9: 86772 events in 2 files, snapshot 2842667001614345650 (task 2559 ms: download 305 ms overlapping gunzip 175 ms, parse 534 ms, sort 58 ms, write 1244 ms, index 328 ms: 5 candidates, 53214 repo-hours, 244 releases; waiting 18 ms; commit 475 ms)
2026-11-07T03:45:34Z [load_day 2026-10-01] 2026-10-01 hour 10: 83164 events in 2 files, snapshot 8349951194246689540 (task 2494 ms: download 294 ms overlapping gunzip 161 ms, parse 487 ms, sort 56 ms, write 1275 ms, index 309 ms: 0 candidates, 50946 repo-hours, 258 releases; waiting 18 ms; commit 634 ms)
2026-11-07T03:45:35Z [load_day 2026-10-01] 2026-10-01 hour 11: 84334 events in 2 files, snapshot 5224747396146644554 (task 2540 ms: download 307 ms overlapping gunzip 175 ms, parse 528 ms, sort 55 ms, write 1232 ms, index 324 ms: 9 candidates, 53196 repo-hours, 236 releases; waiting 21 ms; commit 683 ms)
2026-11-07T03:45:37Z [load_day 2026-10-01] 2026-10-01 hour 12: 92323 events in 2 files, snapshot 3097453441274187436 (task 2657 ms: download 277 ms overlapping gunzip 176 ms, parse 561 ms, sort 62 ms, write 1206 ms, index 445 ms: 9 candidates, 55465 repo-hours, 213 releases; waiting 18 ms; commit 612 ms)
2026-11-07T03:45:38Z [load_day 2026-10-01] 2026-10-01 hour 13: 94071 events in 2 files, snapshot 8479347481782727777 (task 2701 ms: download 442 ms overlapping gunzip 166 ms, parse 504 ms, sort 62 ms, write 1395 ms, index 365 ms: 10 candidates, 55787 repo-hours, 206 releases; waiting 18 ms; commit 588 ms)
2026-11-07T03:45:40Z [load_day 2026-10-01] 2026-10-01 hour 14: 92587 events in 2 files, snapshot 1991666059655347318 (task 2681 ms: download 299 ms overlapping gunzip 172 ms, parse 526 ms, sort 70 ms, write 1311 ms, index 378 ms: 6 candidates, 54899 repo-hours, 213 releases; waiting 15 ms; commit 630 ms)
2026-11-07T03:45:41Z [load_day 2026-10-01] 2026-10-01 hour 15: 85569 events in 2 files, snapshot 1293719928372442392 (task 2638 ms: download 324 ms overlapping gunzip 184 ms, parse 554 ms, sort 57 ms, write 1310 ms, index 316 ms: 9 candidates, 51063 repo-hours, 240 releases; waiting 15 ms; commit 647 ms)
2026-11-07T03:45:44Z [load_day 2026-10-01] 2026-10-01 hour 16: 90520 events in 2 files, snapshot 8102138137808505923 (task 2743 ms: download 326 ms overlapping gunzip 185 ms, parse 566 ms, sort 62 ms, write 1369 ms, index 355 ms: 11 candidates, 54277 repo-hours, 249 releases; waiting 15 ms; commit 732 ms)
2026-11-07T03:45:45Z [load_day 2026-10-01] 2026-10-01 hour 17: 93428 events in 2 files, snapshot 8621580380007538318 (task 3057 ms: download 349 ms overlapping gunzip 203 ms, parse 623 ms, sort 72 ms, write 1616 ms, index 330 ms: 12 candidates, 56000 repo-hours, 303 releases; waiting 14 ms; commit 681 ms)
2026-11-07T03:45:47Z [load_day 2026-10-01] 2026-10-01 hour 18: 91028 events in 2 files, snapshot 7691980068818344727 (task 2870 ms: download 312 ms overlapping gunzip 195 ms, parse 595 ms, sort 70 ms, write 1456 ms, index 353 ms: 9 candidates, 55024 repo-hours, 256 releases; waiting 20 ms; commit 777 ms)
2026-11-07T03:45:48Z [load_day 2026-10-01] 2026-10-01 hour 19: 94617 events in 2 files, snapshot 1528142736438707079 (task 2925 ms: download 347 ms overlapping gunzip 193 ms, parse 588 ms, sort 67 ms, write 1561 ms, index 302 ms: 12 candidates, 50836 repo-hours, 228 releases; waiting 15 ms; commit 643 ms)
2026-11-07T03:45:51Z [load_day 2026-10-01] 2026-10-01 hour 20: 92585 events in 2 files, snapshot 1952762512042162818 (task 2986 ms: download 325 ms overlapping gunzip 231 ms, parse 693 ms, sort 65 ms, write 1454 ms, index 325 ms: 12 candidates, 50623 repo-hours, 252 releases; waiting 16 ms; commit 802 ms)
2026-11-07T03:45:52Z [load_day 2026-10-01] 2026-10-01 hour 21: 90394 events in 2 files, snapshot 2969339169578947962 (task 2885 ms: download 390 ms overlapping gunzip 208 ms, parse 616 ms, sort 62 ms, write 1493 ms, index 302 ms: 13 candidates, 48366 repo-hours, 288 releases; waiting 17 ms; commit 586 ms)
2026-11-07T03:45:55Z [load_day 2026-10-01] 2026-10-01 hour 22: 89340 events in 2 files, snapshot 2269448141023781722 (task 2875 ms: download 361 ms overlapping gunzip 195 ms, parse 587 ms, sort 73 ms, write 1530 ms, index 288 ms: 11 candidates, 47024 repo-hours, 276 releases; waiting 15 ms; commit 808 ms)
2026-11-07T03:45:55Z [load_day 2026-10-01] 2026-10-01 hour 23: 85242 events in 2 files, snapshot 8931768494315846442 (task 2970 ms: download 365 ms overlapping gunzip 221 ms, parse 646 ms, sort 63 ms, write 1547 ms, index 270 ms: 8 candidates, 43733 repo-hours, 284 releases; waiting 17 ms; commit 527 ms)
2026-11-07T03:46:01Z [load_day 2026-10-01] 2026-10-01: repo_hour merged from 24 files to 1 (1209776 rows, 5434 ms)
2026-11-07T03:46:02Z [load_day 2026-10-01] 2026-10-01: index committed in 6961 ms (23 + 1 + 24 files)
2026-11-07T03:46:02Z [load_day 2026-10-01] 2026-10-01: 2073894 events in 24 hours
2026-11-07T03:46:02Z [load_day 2026-10-01] attempt 1 succeeded