orcaLog in

Runs · run 1363

load_day 2023-08-05, attempt 1 succeeded

Host
3c2b29713ce8:198651
Started
2026-11-07T23:37:53Z
Ended
2026-11-07T23:40:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1363/load_day/2023-08-05/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:37:53Z [load_day 2023-08-05] attempt 1 started
2026-11-07T23:37:55Z [load_day 2023-08-05] 2023-08-05: 2 hours in flight, about 1200 MB
2026-11-07T23:38:11Z [load_day 2023-08-05] 2023-08-05 hour 0: 129820 events in 3 files, snapshot 950332602727792958 (task 12089 ms: download 2374 ms overlapping gunzip 687 ms, parse 3508 ms, sort 114 ms, write 6400 ms, index 514 ms: 6 candidates, 68884 repo-hours, 875 releases; waiting 532 ms; commit 2451 ms)
2026-11-07T23:38:13Z [load_day 2023-08-05] 2023-08-05 hour 1: 137549 events in 3 files, snapshot 5329290046207588998 (task 12047 ms: download 4466 ms overlapping gunzip 646 ms, parse 2737 ms, sort 91 ms, write 7254 ms, index 519 ms: 2 candidates, 75285 repo-hours, 707 releases; waiting 509 ms; commit 2518 ms)
2026-11-07T23:38:21Z [load_day 2023-08-05] 2023-08-05 hour 2: 108042 events in 3 files, snapshot 5090183236971405901 (task 8191 ms: download 1737 ms overlapping gunzip 468 ms, parse 2032 ms, sort 120 ms, write 4679 ms, index 300 ms: 2 candidates, 41606 repo-hours, 621 releases; waiting 288 ms; commit 3267 ms)
2026-11-07T23:38:25Z [load_day 2023-08-05] 2023-08-05 hour 3: 100052 events in 3 files, snapshot 2798768816442169578 (task 7855 ms: download 1756 ms overlapping gunzip 406 ms, parse 1828 ms, sort 70 ms, write 4203 ms, index 521 ms: 0 candidates, 40893 repo-hours, 662 releases; waiting 507 ms; commit 4475 ms)
2026-11-07T23:38:29Z [load_day 2023-08-05] 2023-08-05 hour 4: 100143 events in 3 files, snapshot 6292097774292085456 (task 8503 ms: download 1640 ms overlapping gunzip 482 ms, parse 1987 ms, sort 78 ms, write 4898 ms, index 282 ms: 4 candidates, 40950 repo-hours, 477 releases; waiting 515 ms; commit 2548 ms)
2026-11-07T23:38:34Z [load_day 2023-08-05] 2023-08-05 hour 5: 103879 events in 3 files, snapshot 1339300882567735449 (task 8909 ms: download 1982 ms overlapping gunzip 513 ms, parse 2486 ms, sort 68 ms, write 4710 ms, index 334 ms: 1 candidates, 43230 repo-hours, 606 releases; waiting 479 ms; commit 2603 ms)
2026-11-07T23:38:41Z [load_day 2023-08-05] 2023-08-05 hour 6: 114521 events in 3 files, snapshot 131462654741957420 (task 7905 ms: download 1852 ms overlapping gunzip 479 ms, parse 2330 ms, sort 73 ms, write 3987 ms, index 406 ms: 1 candidates, 50834 repo-hours, 680 releases; waiting 344 ms; commit 4857 ms)
2026-11-07T23:38:44Z [load_day 2023-08-05] 2023-08-05 hour 7: 111347 events in 3 files, snapshot 4862965556327152912 (task 9447 ms: download 1893 ms overlapping gunzip 479 ms, parse 2162 ms, sort 65 ms, write 5523 ms, index 363 ms: 1 candidates, 45726 repo-hours, 567 releases; waiting 520 ms; commit 2290 ms)
2026-11-07T23:38:48Z [load_day 2023-08-05] 2023-08-05 hour 8: 116410 events in 3 files, snapshot 1024686438899470384 (task 9623 ms: download 2121 ms overlapping gunzip 586 ms, parse 2628 ms, sort 68 ms, write 5230 ms, index 321 ms: 6 candidates, 49351 repo-hours, 614 releases; waiting 515 ms; commit 2146 ms)
2026-11-07T23:38:53Z [load_day 2023-08-05] 2023-08-05 hour 9: 120115 events in 3 files, snapshot 785800046460882171 (task 8674 ms: download 2229 ms overlapping gunzip 508 ms, parse 2224 ms, sort 77 ms, write 4521 ms, index 535 ms: 4 candidates, 49280 repo-hours, 734 releases; waiting 518 ms; commit 2027 ms)
2026-11-07T23:38:58Z [load_day 2023-08-05] 2023-08-05 hour 10: 121268 events in 3 files, snapshot 1578459795253392432 (task 8642 ms: download 2370 ms overlapping gunzip 481 ms, parse 2078 ms, sort 77 ms, write 4796 ms, index 359 ms: 5 candidates, 52576 repo-hours, 730 releases; waiting 511 ms; commit 2085 ms)
2026-11-07T23:39:02Z [load_day 2023-08-05] 2023-08-05 hour 11: 117478 events in 3 files, snapshot 618685487318979258 (task 8069 ms: download 2255 ms overlapping gunzip 454 ms, parse 2061 ms, sort 72 ms, write 4341 ms, index 339 ms: 1 candidates, 49198 repo-hours, 631 releases; waiting 517 ms; commit 2159 ms)
2026-11-07T23:39:11Z [load_day 2023-08-05] 2023-08-05 hour 12: 198923 events in 4 files, snapshot 7472980104244925472 (task 12051 ms: download 3393 ms overlapping gunzip 577 ms, parse 3119 ms, sort 180 ms, write 6757 ms, index 643 ms: 3 candidates, 84201 repo-hours, 693 releases; waiting 506 ms; commit 2894 ms)
2026-11-07T23:39:21Z [load_day 2023-08-05] 2023-08-05 hour 13: 152527 events in 4 files, snapshot 8426980075409163981 (task 11794 ms: download 3319 ms overlapping gunzip 508 ms, parse 2469 ms, sort 178 ms, write 7222 ms, index 576 ms: 5 candidates, 77418 repo-hours, 787 releases; waiting 511 ms; commit 8063 ms)
2026-11-07T23:39:24Z [load_day 2023-08-05] 2023-08-05 hour 14: 135804 events in 3 files, snapshot 5396638763857547181 (task 11143 ms: download 2244 ms overlapping gunzip 627 ms, parse 2724 ms, sort 103 ms, write 6703 ms, index 418 ms: 6 candidates, 58538 repo-hours, 720 releases; waiting 256 ms; commit 3530 ms)
2026-11-07T23:39:28Z [load_day 2023-08-05] 2023-08-05 hour 15: 140281 events in 3 files, snapshot 4415527414586255535 (task 11053 ms: download 4624 ms overlapping gunzip 568 ms, parse 2559 ms, sort 86 ms, write 6595 ms, index 435 ms: 2 candidates, 60882 repo-hours, 1027 releases; waiting 487 ms; commit 3540 ms)
2026-11-07T23:39:36Z [load_day 2023-08-05] 2023-08-05 hour 16: 135910 events in 3 files, snapshot 3449831395049041633 (task 10006 ms: download 1877 ms overlapping gunzip 569 ms, parse 2510 ms, sort 95 ms, write 5816 ms, index 552 ms: 4 candidates, 58160 repo-hours, 823 releases; waiting 185 ms; commit 4208 ms)
2026-11-07T23:39:40Z [load_day 2023-08-05] 2023-08-05 hour 17: 129197 events in 3 files, snapshot 5648410906051144190 (task 10619 ms: download 2030 ms overlapping gunzip 656 ms, parse 2821 ms, sort 89 ms, write 5900 ms, index 360 ms: 3 candidates, 53855 repo-hours, 683 releases; waiting 486 ms; commit 3934 ms)
2026-11-07T23:39:45Z [load_day 2023-08-05] 2023-08-05 hour 18: 133947 events in 3 files, snapshot 6311466762630828586 (task 10021 ms: download 2405 ms overlapping gunzip 650 ms, parse 2879 ms, sort 98 ms, write 5104 ms, index 420 ms: 4 candidates, 58446 repo-hours, 761 releases; waiting 488 ms; commit 2305 ms)
2026-11-07T23:39:50Z [load_day 2023-08-05] 2023-08-05 hour 19: 115880 events in 3 files, snapshot 4901919339570721511 (task 9889 ms: download 2806 ms overlapping gunzip 535 ms, parse 2388 ms, sort 79 ms, write 5667 ms, index 405 ms: 0 candidates, 47493 repo-hours, 665 releases; waiting 467 ms; commit 2595 ms)
2026-11-07T23:39:56Z [load_day 2023-08-05] 2023-08-05 hour 20: 111984 events in 3 files, snapshot 7664324967695348051 (task 8911 ms: download 2221 ms overlapping gunzip 397 ms, parse 1858 ms, sort 92 ms, write 5390 ms, index 405 ms: 3 candidates, 45857 repo-hours, 609 releases; waiting 503 ms; commit 2714 ms)
2026-11-07T23:40:01Z [load_day 2023-08-05] 2023-08-05 hour 21: 105892 events in 3 files, snapshot 7398860869784565846 (task 9634 ms: download 2242 ms overlapping gunzip 567 ms, parse 2435 ms, sort 74 ms, write 5310 ms, index 418 ms: 2 candidates, 41781 repo-hours, 665 releases; waiting 493 ms; commit 2667 ms)
2026-11-07T23:40:05Z [load_day 2023-08-05] 2023-08-05 hour 22: 95804 events in 2 files, snapshot 6890037910803162591 (task 8479 ms: download 1739 ms overlapping gunzip 436 ms, parse 1919 ms, sort 65 ms, write 5058 ms, index 321 ms: 0 candidates, 38351 repo-hours, 625 releases; waiting 390 ms; commit 2978 ms)
2026-11-07T23:40:09Z [load_day 2023-08-05] 2023-08-05 hour 23: 86808 events in 2 files, snapshot 1537287807335234749 (task 6406 ms: download 1900 ms overlapping gunzip 374 ms, parse 1766 ms, sort 69 ms, write 3222 ms, index 226 ms: 0 candidates, 35362 repo-hours, 539 releases; waiting 526 ms; commit 3124 ms)
2026-11-07T23:40:15Z [load_day 2023-08-05] 2023-08-05: repo_hour merged from 24 files to 1 (1268157 rows, 6052 ms)
2026-11-07T23:40:17Z [load_day 2023-08-05] 2023-08-05: index committed in 8264 ms (20 + 1 + 24 files)
2026-11-07T23:40:17Z [load_day 2023-08-05] 2023-08-05: 2923581 events in 24 hours
2026-11-07T23:40:17Z [load_day 2023-08-05] attempt 1 succeeded