orcaLog in

Runs · run 20

load_day 2023-01-07, attempt 1 succeeded

Host
4e84322b8c45:7659
Started
2026-11-07T03:06:31Z
Ended
2026-11-07T03:09:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/20/load_day/2023-01-07/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:06:31Z [load_day 2023-01-07] attempt 1 started
2026-11-07T03:06:42Z [load_day 2023-01-07] 2023-01-07 hour 0: 133098 events in 3 files, snapshot 5134398365491699760 (task 8699 ms: download 2558 ms overlapping gunzip 591 ms, parse 2902 ms, sort 219 ms, write 3802 ms, index 385 ms: 3 candidates, 65504 repo-hours, 814 releases; waiting 484 ms; commit 651 ms)
2026-11-07T03:06:42Z [load_day 2023-01-07] 2023-01-07 hour 1: 131240 events in 3 files, snapshot 6524163973974799863 (task 9008 ms: download 3210 ms overlapping gunzip 628 ms, parse 3037 ms, sort 279 ms, write 3101 ms, index 394 ms: 1 candidates, 66442 repo-hours, 675 releases; waiting 1236 ms; commit 628 ms)
2026-11-07T03:06:50Z [load_day 2023-01-07] 2023-01-07 hour 2: 118540 events in 3 files, snapshot 3333740082807646561 (task 8242 ms: download 2682 ms overlapping gunzip 557 ms, parse 2642 ms, sort 243 ms, write 3576 ms, index 339 ms: 2 candidates, 52277 repo-hours, 575 releases; waiting 576 ms; commit 548 ms)
2026-11-07T03:06:51Z [load_day 2023-01-07] 2023-01-07 hour 3: 120379 events in 3 files, snapshot 6153169978503498948 (task 7652 ms: download 2102 ms overlapping gunzip 517 ms, parse 2484 ms, sort 325 ms, write 3228 ms, index 358 ms: 3 candidates, 44312 repo-hours, 747 releases; waiting 509 ms; commit 675 ms)
2026-11-07T03:07:02Z [load_day 2023-01-07] 2023-01-07 hour 4: 142091 events in 3 files, snapshot 6617692208530293303 (task 10758 ms: download 2590 ms overlapping gunzip 737 ms, parse 3872 ms, sort 331 ms, write 4717 ms, index 320 ms: 2 candidates, 55430 repo-hours, 492 releases; waiting 501 ms; commit 531 ms)
2026-11-07T03:07:02Z [load_day 2023-01-07] 2023-01-07 hour 5: 141629 events in 3 files, snapshot 5611559535707981978 (task 9779 ms: download 4037 ms overlapping gunzip 670 ms, parse 3413 ms, sort 183 ms, write 4401 ms, index 328 ms: 4 candidates, 54571 repo-hours, 617 releases; waiting 509 ms; commit 490 ms)
2026-11-07T03:07:15Z [load_day 2023-01-07] 2023-01-07 hour 6: 151402 events in 4 files, snapshot 1169788086539049915 (task 12445 ms: download 2672 ms overlapping gunzip 777 ms, parse 4297 ms, sort 396 ms, write 5779 ms, index 366 ms: 4 candidates, 64325 repo-hours, 653 releases; waiting 508 ms; commit 518 ms)
2026-11-07T03:07:15Z [load_day 2023-01-07] 2023-01-07 hour 7: 148845 events in 3 files, snapshot 314358264043427840 (task 11672 ms: download 3845 ms overlapping gunzip 682 ms, parse 3590 ms, sort 358 ms, write 5016 ms, index 356 ms: 3 candidates, 58609 repo-hours, 508 releases; waiting 1400 ms; commit 452 ms)
2026-11-07T03:07:28Z [load_day 2023-01-07] 2023-01-07 hour 8: 167656 events in 4 files, snapshot 3454379451337381615 (task 12310 ms: download 4295 ms overlapping gunzip 865 ms, parse 4528 ms, sort 383 ms, write 5372 ms, index 400 ms: 9 candidates, 68211 repo-hours, 561 releases; waiting 533 ms; commit 828 ms)
2026-11-07T03:07:29Z [load_day 2023-01-07] 2023-01-07 hour 9: 171898 events in 4 files, snapshot 2827071749430134490 (task 12613 ms: download 3450 ms overlapping gunzip 915 ms, parse 4945 ms, sort 475 ms, write 5043 ms, index 412 ms: 3 candidates, 69831 repo-hours, 758 releases; waiting 497 ms; commit 517 ms)
2026-11-07T03:07:41Z [load_day 2023-01-07] 2023-01-07 hour 10: 167583 events in 4 files, snapshot 6929306444379963555 (task 12885 ms: download 3446 ms overlapping gunzip 908 ms, parse 4950 ms, sort 410 ms, write 5366 ms, index 426 ms: 2 candidates, 72541 repo-hours, 643 releases; waiting 499 ms; commit 627 ms)
2026-11-07T03:07:42Z [load_day 2023-01-07] 2023-01-07 hour 11: 167140 events in 4 files, snapshot 8943974085369003296 (task 12865 ms: download 3197 ms overlapping gunzip 974 ms, parse 5208 ms, sort 328 ms, write 5159 ms, index 410 ms: 6 candidates, 71611 repo-hours, 626 releases; waiting 506 ms; commit 592 ms)
2026-11-07T03:07:56Z [load_day 2023-01-07] 2023-01-07 hour 12: 208148 events in 5 files, snapshot 8102644215577803349 (task 14608 ms: download 4165 ms overlapping gunzip 983 ms, parse 5254 ms, sort 382 ms, write 6046 ms, index 641 ms: 11 candidates, 98457 repo-hours, 793 releases; waiting 851 ms; commit 563 ms)
2026-11-07T03:07:57Z [load_day 2023-01-07] 2023-01-07 hour 13: 199114 events in 4 files, snapshot 7981096626909086620 (task 14373 ms: download 4773 ms overlapping gunzip 1035 ms, parse 5289 ms, sort 351 ms, write 5567 ms, index 557 ms: 7 candidates, 94549 repo-hours, 709 releases; waiting 1233 ms; commit 521 ms)
2026-11-07T03:08:11Z [load_day 2023-01-07] 2023-01-07 hour 14: 189889 events in 4 files, snapshot 508677659015284518 (task 13973 ms: download 3404 ms overlapping gunzip 942 ms, parse 4979 ms, sort 443 ms, write 6339 ms, index 498 ms: 10 candidates, 81117 repo-hours, 755 releases; waiting 516 ms; commit 454 ms)
2026-11-07T03:08:11Z [load_day 2023-01-07] 2023-01-07 hour 15: 193795 events in 4 files, snapshot 1226909264403132807 (task 13618 ms: download 3220 ms overlapping gunzip 1028 ms, parse 5204 ms, sort 498 ms, write 5567 ms, index 502 ms: 2 candidates, 82772 repo-hours, 911 releases; waiting 508 ms; commit 388 ms)
2026-11-07T03:08:25Z [load_day 2023-01-07] 2023-01-07 hour 16: 184624 events in 4 files, snapshot 1616824183055248423 (task 13329 ms: download 3699 ms overlapping gunzip 980 ms, parse 4895 ms, sort 331 ms, write 5695 ms, index 621 ms: 4 candidates, 80800 repo-hours, 798 releases; waiting 513 ms; commit 611 ms)
2026-11-07T03:08:26Z [load_day 2023-01-07] 2023-01-07 hour 17: 181100 events in 4 files, snapshot 393582245046103171 (task 13620 ms: download 3277 ms overlapping gunzip 1006 ms, parse 5458 ms, sort 426 ms, write 5482 ms, index 455 ms: 6 candidates, 78443 repo-hours, 721 releases; waiting 512 ms; commit 512 ms)
2026-11-07T03:08:39Z [load_day 2023-01-07] 2023-01-07 hour 18: 181618 events in 4 files, snapshot 719705548870818945 (task 13563 ms: download 3438 ms overlapping gunzip 963 ms, parse 5040 ms, sort 251 ms, write 5916 ms, index 551 ms: 4 candidates, 79877 repo-hours, 824 releases; waiting 506 ms; commit 707 ms)
2026-11-07T03:08:40Z [load_day 2023-01-07] 2023-01-07 hour 19: 175439 events in 4 files, snapshot 5772934915867267403 (task 13069 ms: download 3784 ms overlapping gunzip 972 ms, parse 5146 ms, sort 428 ms, write 5162 ms, index 421 ms: 3 candidates, 71389 repo-hours, 784 releases; waiting 601 ms; commit 544 ms)
2026-11-07T03:08:52Z [load_day 2023-01-07] 2023-01-07 hour 20: 168551 events in 4 files, snapshot 1017957423255755204 (task 12405 ms: download 3750 ms overlapping gunzip 836 ms, parse 4485 ms, sort 267 ms, write 5610 ms, index 402 ms: 2 candidates, 69064 repo-hours, 805 releases; waiting 498 ms; commit 651 ms)
2026-11-07T03:08:53Z [load_day 2023-01-07] 2023-01-07 hour 21: 143067 events in 3 files, snapshot 84642573721323916 (task 9797 ms: download 2890 ms overlapping gunzip 644 ms, parse 3136 ms, sort 259 ms, write 4410 ms, index 518 ms: 4 candidates, 55758 repo-hours, 844 releases; waiting 502 ms; commit 463 ms)
2026-11-07T03:09:01Z [load_day 2023-01-07] 2023-01-07 hour 22: 127120 events in 3 files, snapshot 8125986136191801255 (task 8615 ms: download 2395 ms overlapping gunzip 633 ms, parse 3052 ms, sort 161 ms, write 3701 ms, index 322 ms: 4 candidates, 51608 repo-hours, 711 releases; waiting 515 ms; commit 477 ms)
2026-11-07T03:09:02Z [load_day 2023-01-07] 2023-01-07 hour 23: 111277 events in 3 files, snapshot 458333219368117697 (task 7364 ms: download 2436 ms overlapping gunzip 487 ms, parse 2424 ms, sort 230 ms, write 2987 ms, index 409 ms: 3 candidates, 46596 repo-hours, 621 releases; waiting 528 ms; commit 544 ms)
2026-11-07T03:09:09Z [load_day 2023-01-07] 2023-01-07: repo_hour merged from 24 files to 1 (1634094 rows, 6946 ms)
2026-11-07T03:09:10Z [load_day 2023-01-07] 2023-01-07: index committed in 8533 ms (24 + 1 + 24 files)
2026-11-07T03:09:10Z [load_day 2023-01-07] 2023-01-07: 3825243 events in 24 hours
2026-11-07T03:09:10Z [load_day 2023-01-07] attempt 1 succeeded