orcaLog in

Runs · run 140

load_day 2026-10-02, attempt 1 succeeded

Host
4e84322b8c45:24175
Started
2026-11-07T03:44:08Z
Ended
2026-11-07T03:45:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/140/load_day/2026-10-02/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:44:08Z [load_day 2026-10-02] attempt 1 started
2026-11-07T03:44:15Z [load_day 2026-10-02] 2026-10-02 hour 0: 82865 events in 2 files, snapshot 4530408214245563345 (task 4214 ms: download 1460 ms overlapping gunzip 309 ms, parse 921 ms, sort 159 ms, write 1671 ms, index 304 ms: 10 candidates, 44486 repo-hours, 359 releases; waiting 523 ms; commit 622 ms)
2026-11-07T03:44:15Z [load_day 2026-10-02] 2026-10-02 hour 1: 83862 events in 2 files, snapshot 5714500830488047841 (task 3964 ms: download 1431 ms overlapping gunzip 235 ms, parse 759 ms, sort 85 ms, write 1785 ms, index 275 ms: 10 candidates, 41109 repo-hours, 463 releases; waiting 534 ms; commit 646 ms)
2026-11-07T03:44:19Z [load_day 2026-10-02] 2026-10-02 hour 2: 82734 events in 2 files, snapshot 7489927939321035887 (task 3837 ms: download 1133 ms overlapping gunzip 237 ms, parse 724 ms, sort 82 ms, write 1822 ms, index 293 ms: 8 candidates, 48466 repo-hours, 501 releases; waiting 390 ms; commit 947 ms)
2026-11-07T03:44:20Z [load_day 2026-10-02] 2026-10-02 hour 3: 84268 events in 2 files, snapshot 1516973325514722720 (task 4374 ms: download 1460 ms overlapping gunzip 316 ms, parse 868 ms, sort 85 ms, write 1813 ms, index 313 ms: 11 candidates, 51634 repo-hours, 464 releases; waiting 574 ms; commit 564 ms)
2026-11-07T03:44:24Z [load_day 2026-10-02] 2026-10-02 hour 4: 82036 events in 2 files, snapshot 8677051204888934188 (task 3997 ms: download 1803 ms overlapping gunzip 245 ms, parse 728 ms, sort 79 ms, write 1792 ms, index 323 ms: 8 candidates, 50701 repo-hours, 541 releases; waiting 561 ms; commit 907 ms)
2026-11-07T03:44:24Z [load_day 2026-10-02] 2026-10-02 hour 5: 79692 events in 2 files, snapshot 7628599872195558326 (task 3729 ms: download 934 ms overlapping gunzip 280 ms, parse 807 ms, sort 70 ms, write 1822 ms, index 297 ms: 3 candidates, 50842 repo-hours, 519 releases; waiting 187 ms; commit 773 ms)
2026-11-07T03:44:28Z [load_day 2026-10-02] 2026-10-02 hour 6: 83551 events in 2 files, snapshot 1283296556367126091 (task 3855 ms: download 1526 ms overlapping gunzip 266 ms, parse 717 ms, sort 83 ms, write 1601 ms, index 330 ms: 6 candidates, 51365 repo-hours, 414 releases; waiting 568 ms; commit 687 ms)
2026-11-07T03:44:29Z [load_day 2026-10-02] 2026-10-02 hour 7: 87636 events in 2 files, snapshot 5882446728019447914 (task 3734 ms: download 1326 ms overlapping gunzip 230 ms, parse 705 ms, sort 78 ms, write 1617 ms, index 312 ms: 10 candidates, 52242 repo-hours, 376 releases; waiting 567 ms; commit 642 ms)
2026-11-07T03:44:33Z [load_day 2026-10-02] 2026-10-02 hour 8: 87189 events in 2 files, snapshot 1919471500465316431 (task 4116 ms: download 1364 ms overlapping gunzip 282 ms, parse 778 ms, sort 67 ms, write 1679 ms, index 426 ms: 8 candidates, 53422 repo-hours, 441 releases; waiting 564 ms; commit 670 ms)
2026-11-07T03:44:33Z [load_day 2026-10-02] 2026-10-02 hour 9: 83764 events in 2 files, snapshot 7498449781441421768 (task 3733 ms: download 1383 ms overlapping gunzip 205 ms, parse 640 ms, sort 62 ms, write 1562 ms, index 366 ms: 4 candidates, 50644 repo-hours, 426 releases; waiting 577 ms; commit 674 ms)
2026-11-07T03:44:37Z [load_day 2026-10-02] 2026-10-02 hour 10: 84257 events in 2 files, snapshot 3571819880424075347 (task 3696 ms: download 1180 ms overlapping gunzip 239 ms, parse 742 ms, sort 63 ms, write 1484 ms, index 338 ms: 4 candidates, 51419 repo-hours, 352 releases; waiting 566 ms; commit 665 ms)
2026-11-07T03:44:38Z [load_day 2026-10-02] 2026-10-02 hour 11: 93699 events in 2 files, snapshot 5455617065432426988 (task 3840 ms: download 1432 ms overlapping gunzip 217 ms, parse 669 ms, sort 84 ms, write 1607 ms, index 333 ms: 13 candidates, 54576 repo-hours, 313 releases; waiting 588 ms; commit 726 ms)
2026-11-07T03:44:41Z [load_day 2026-10-02] 2026-10-02 hour 12: 92611 events in 2 files, snapshot 5257187200350729797 (task 3709 ms: download 1744 ms overlapping gunzip 208 ms, parse 652 ms, sort 88 ms, write 1542 ms, index 364 ms: 5 candidates, 55675 repo-hours, 285 releases; waiting 526 ms; commit 855 ms)
2026-11-07T03:44:42Z [load_day 2026-10-02] 2026-10-02 hour 13: 90395 events in 2 files, snapshot 6905981052540230070 (task 4053 ms: download 1677 ms overlapping gunzip 241 ms, parse 713 ms, sort 80 ms, write 1833 ms, index 358 ms: 5 candidates, 57520 repo-hours, 349 releases; waiting 585 ms; commit 638 ms)
2026-11-07T03:44:46Z [load_day 2026-10-02] 2026-10-02 hour 14: 88752 events in 2 files, snapshot 2382964489820915128 (task 4058 ms: download 1424 ms overlapping gunzip 224 ms, parse 683 ms, sort 83 ms, write 1828 ms, index 369 ms: 9 candidates, 59073 repo-hours, 331 releases; waiting 565 ms; commit 618 ms)
2026-11-07T03:44:47Z [load_day 2026-10-02] 2026-10-02 hour 15: 84804 events in 2 files, snapshot 8850741274277074861 (task 3694 ms: download 1684 ms overlapping gunzip 196 ms, parse 597 ms, sort 62 ms, write 1577 ms, index 351 ms: 9 candidates, 55683 repo-hours, 265 releases; waiting 589 ms; commit 784 ms)
2026-11-07T03:44:50Z [load_day 2026-10-02] 2026-10-02 hour 16: 81551 events in 2 files, snapshot 7472435381511987509 (task 3374 ms: download 1327 ms overlapping gunzip 193 ms, parse 594 ms, sort 65 ms, write 1340 ms, index 333 ms: 8 candidates, 50832 repo-hours, 253 releases; waiting 555 ms; commit 623 ms)
2026-11-07T03:44:50Z [load_day 2026-10-02] 2026-10-02 hour 17: 88904 events in 2 files, snapshot 932400575625958368 (task 3116 ms: download 871 ms overlapping gunzip 215 ms, parse 612 ms, sort 64 ms, write 1358 ms, index 337 ms: 22 candidates, 56576 repo-hours, 231 releases; waiting 212 ms; commit 527 ms)
2026-11-07T03:44:53Z [load_day 2026-10-02] 2026-10-02 hour 18: 86889 events in 2 files, snapshot 2144941947269431259 (task 3358 ms: download 1294 ms overlapping gunzip 178 ms, parse 570 ms, sort 59 ms, write 1358 ms, index 342 ms: 8 candidates, 52645 repo-hours, 202 releases; waiting 530 ms; commit 532 ms)
2026-11-07T03:44:54Z [load_day 2026-10-02] 2026-10-02 hour 19: 85057 events in 2 files, snapshot 3388861150683259665 (task 2987 ms: download 992 ms overlapping gunzip 207 ms, parse 623 ms, sort 62 ms, write 1167 ms, index 335 ms: 11 candidates, 50258 repo-hours, 191 releases; waiting 247 ms; commit 696 ms)
2026-11-07T03:44:58Z [load_day 2026-10-02] 2026-10-02 hour 20: 82485 events in 2 files, snapshot 7359615850562451662 (task 3495 ms: download 1157 ms overlapping gunzip 191 ms, parse 592 ms, sort 74 ms, write 1336 ms, index 392 ms: 8 candidates, 49949 repo-hours, 205 releases; waiting 549 ms; commit 750 ms)
2026-11-07T03:44:58Z [load_day 2026-10-02] 2026-10-02 hour 21: 85330 events in 2 files, snapshot 3149326269710263244 (task 3225 ms: download 887 ms overlapping gunzip 255 ms, parse 764 ms, sort 88 ms, write 1300 ms, index 314 ms: 16 candidates, 50407 repo-hours, 237 releases; waiting 206 ms; commit 618 ms)
2026-11-07T03:45:02Z [load_day 2026-10-02] 2026-10-02 hour 22: 80371 events in 2 files, snapshot 5175695662234533997 (task 3108 ms: download 826 ms overlapping gunzip 201 ms, parse 611 ms, sort 82 ms, write 1375 ms, index 346 ms: 13 candidates, 47394 repo-hours, 287 releases; waiting 256 ms; commit 1252 ms)
2026-11-07T03:45:04Z [load_day 2026-10-02] 2026-10-02 hour 23: 78294 events in 2 files, snapshot 6285565499707445465 (task 4373 ms: download 2921 ms overlapping gunzip 239 ms, parse 708 ms, sort 75 ms, write 1704 ms, index 273 ms: 8 candidates, 43376 repo-hours, 339 releases; waiting 1083 ms; commit 1031 ms)
2026-11-07T03:45:09Z [load_day 2026-10-02] 2026-10-02: repo_hour merged from 24 files to 1 (1230294 rows, 5426 ms)
2026-11-07T03:45:11Z [load_day 2026-10-02] 2026-10-02: index committed in 6978 ms (24 + 1 + 24 files)
2026-11-07T03:45:11Z [load_day 2026-10-02] 2026-10-02: 2040996 events in 24 hours
2026-11-07T03:45:11Z [load_day 2026-10-02] attempt 1 succeeded