orcaLog in

Runs · run 1435

load_day 2023-08-27, attempt 1 succeeded

Host
3c2b29713ce8:269357
Started
2026-11-08T00:17:00Z
Ended
2026-11-08T00:19:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1435/load_day/2023-08-27/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:17:00Z [load_day 2023-08-27] attempt 1 started
2026-11-08T00:17:01Z [load_day 2023-08-27] 2023-08-27: 2 hours in flight, about 1200 MB
2026-11-08T00:17:14Z [load_day 2023-08-27] 2023-08-27 hour 0: 127992 events in 3 files, snapshot 7618680041282233292 (task 8252 ms: download 2407 ms overlapping gunzip 431 ms, parse 2114 ms, sort 82 ms, write 4245 ms, index 467 ms: 9 candidates, 73226 repo-hours, 867 releases; waiting 498 ms; commit 2695 ms)
2026-11-08T00:17:16Z [load_day 2023-08-27] 2023-08-27 hour 1: 130177 events in 3 files, snapshot 873889817367720919 (task 8075 ms: download 2220 ms overlapping gunzip 417 ms, parse 1948 ms, sort 78 ms, write 4402 ms, index 469 ms: 1 candidates, 73821 repo-hours, 722 releases; waiting 495 ms; commit 2512 ms)
2026-11-08T00:17:22Z [load_day 2023-08-27] 2023-08-27 hour 2: 94322 events in 2 files, snapshot 6509046412794220484 (task 8013 ms: download 1885 ms overlapping gunzip 398 ms, parse 1728 ms, sort 125 ms, write 4696 ms, index 287 ms: 2 candidates, 38393 repo-hours, 517 releases; waiting 540 ms; commit 2633 ms)
2026-11-08T00:17:25Z [load_day 2023-08-27] 2023-08-27 hour 3: 92330 events in 2 files, snapshot 1386285840197109962 (task 7355 ms: download 1855 ms overlapping gunzip 363 ms, parse 1649 ms, sort 63 ms, write 3682 ms, index 732 ms: 4 candidates, 37563 repo-hours, 642 releases; waiting 533 ms; commit 2692 ms)
2026-11-08T00:17:33Z [load_day 2023-08-27] 2023-08-27 hour 4: 94641 events in 2 files, snapshot 967052953268028834 (task 8190 ms: download 1792 ms overlapping gunzip 481 ms, parse 2136 ms, sort 124 ms, write 3999 ms, index 637 ms: 1 candidates, 38024 repo-hours, 483 releases; waiting 526 ms; commit 4051 ms)
2026-11-08T00:17:36Z [load_day 2023-08-27] 2023-08-27 hour 5: 100874 events in 3 files, snapshot 423990724206559253 (task 8420 ms: download 1513 ms overlapping gunzip 407 ms, parse 1873 ms, sort 76 ms, write 4519 ms, index 779 ms: 1 candidates, 41689 repo-hours, 658 releases; waiting 469 ms; commit 2821 ms)
2026-11-08T00:17:41Z [load_day 2023-08-27] 2023-08-27 hour 6: 113330 events in 3 files, snapshot 5024008648452814731 (task 8959 ms: download 1855 ms overlapping gunzip 535 ms, parse 2485 ms, sort 76 ms, write 4609 ms, index 403 ms: 2 candidates, 50143 repo-hours, 617 releases; waiting 498 ms; commit 2513 ms)
2026-11-08T00:17:47Z [load_day 2023-08-27] 2023-08-27 hour 7: 112275 events in 3 files, snapshot 6611603384175865093 (task 8128 ms: download 1357 ms overlapping gunzip 435 ms, parse 1984 ms, sort 61 ms, write 4705 ms, index 533 ms: 5 candidates, 46108 repo-hours, 591 releases; waiting 194 ms; commit 5038 ms)
2026-11-08T00:17:53Z [load_day 2023-08-27] 2023-08-27 hour 8: 121666 events in 3 files, snapshot 2440480271176567873 (task 10258 ms: download 2074 ms overlapping gunzip 609 ms, parse 2608 ms, sort 77 ms, write 5732 ms, index 438 ms: 3 candidates, 50790 repo-hours, 642 releases; waiting 522 ms; commit 2621 ms)
2026-11-08T00:17:57Z [load_day 2023-08-27] 2023-08-27 hour 9: 123842 events in 3 files, snapshot 6841378422183819977 (task 10810 ms: download 1845 ms overlapping gunzip 551 ms, parse 2526 ms, sort 149 ms, write 6761 ms, index 410 ms: 3 candidates, 51564 repo-hours, 766 releases; waiting 204 ms; commit 2548 ms)
2026-11-08T00:18:06Z [load_day 2023-08-27] 2023-08-27 hour 10: 125210 events in 3 files, snapshot 3825600358884470268 (task 10489 ms: download 2687 ms overlapping gunzip 634 ms, parse 2705 ms, sort 78 ms, write 5511 ms, index 753 ms: 1 candidates, 53535 repo-hours, 598 releases; waiting 531 ms; commit 4093 ms)
2026-11-08T00:18:09Z [load_day 2023-08-27] 2023-08-27 hour 11: 123754 events in 3 files, snapshot 2726761087008090828 (task 10579 ms: download 2003 ms overlapping gunzip 549 ms, parse 2430 ms, sort 81 ms, write 5971 ms, index 766 ms: 3 candidates, 51317 repo-hours, 643 releases; waiting 510 ms; commit 2537 ms)
2026-11-08T00:18:19Z [load_day 2023-08-27] 2023-08-27 hour 12: 207886 events in 5 files, snapshot 6123704463847220094 (task 13653 ms: download 4607 ms overlapping gunzip 658 ms, parse 3176 ms, sort 133 ms, write 8301 ms, index 584 ms: 6 candidates, 87331 repo-hours, 809 releases; waiting 467 ms; commit 2116 ms)
2026-11-08T00:18:24Z [load_day 2023-08-27] 2023-08-27 hour 13: 155357 events in 4 files, snapshot 6692474425186641068 (task 11209 ms: download 3985 ms overlapping gunzip 602 ms, parse 2778 ms, sort 95 ms, write 6392 ms, index 529 ms: 5 candidates, 78448 repo-hours, 762 releases; waiting 508 ms; commit 5412 ms)
2026-11-08T00:18:33Z [load_day 2023-08-27] 2023-08-27 hour 14: 143802 events in 3 files, snapshot 8701011789656796657 (task 13063 ms: download 5540 ms overlapping gunzip 696 ms, parse 2924 ms, sort 94 ms, write 8142 ms, index 447 ms: 5 candidates, 63037 repo-hours, 915 releases; waiting 511 ms; commit 2435 ms)
2026-11-08T00:18:36Z [load_day 2023-08-27] 2023-08-27 hour 15: 145012 events in 3 files, snapshot 1828160220976519941 (task 11747 ms: download 4737 ms overlapping gunzip 692 ms, parse 3060 ms, sort 158 ms, write 6631 ms, index 485 ms: 3 candidates, 63796 repo-hours, 939 releases; waiting 427 ms; commit 2607 ms)
2026-11-08T00:18:45Z [load_day 2023-08-27] 2023-08-27 hour 16: 144789 events in 3 files, snapshot 5797464558970744214 (task 11186 ms: download 4156 ms overlapping gunzip 595 ms, parse 2563 ms, sort 123 ms, write 6735 ms, index 461 ms: 4 candidates, 61819 repo-hours, 934 releases; waiting 479 ms; commit 2659 ms)
2026-11-08T00:18:50Z [load_day 2023-08-27] 2023-08-27 hour 17: 137342 events in 3 files, snapshot 6719491403047636358 (task 10795 ms: download 2050 ms overlapping gunzip 486 ms, parse 2283 ms, sort 112 ms, write 6668 ms, index 441 ms: 5 candidates, 57235 repo-hours, 721 releases; waiting 514 ms; commit 4358 ms)
2026-11-08T00:18:57Z [load_day 2023-08-27] 2023-08-27 hour 18: 139362 events in 3 files, snapshot 8431090988590050994 (task 11062 ms: download 2153 ms overlapping gunzip 591 ms, parse 2770 ms, sort 124 ms, write 6287 ms, index 520 ms: 4 candidates, 62578 repo-hours, 808 releases; waiting 509 ms; commit 2551 ms)
2026-11-08T00:19:00Z [load_day 2023-08-27] 2023-08-27 hour 19: 123812 events in 3 files, snapshot 3747101579777571995 (task 10595 ms: download 1867 ms overlapping gunzip 597 ms, parse 2729 ms, sort 89 ms, write 5747 ms, index 663 ms: 6 candidates, 50777 repo-hours, 815 releases; waiting 510 ms; commit 3021 ms)
2026-11-08T00:19:11Z [load_day 2023-08-27] 2023-08-27 hour 20: 122250 events in 3 files, snapshot 1630512719541563655 (task 10563 ms: download 2079 ms overlapping gunzip 546 ms, parse 2517 ms, sort 120 ms, write 6257 ms, index 355 ms: 8 candidates, 50942 repo-hours, 719 releases; waiting 492 ms; commit 4371 ms)
2026-11-08T00:19:13Z [load_day 2023-08-27] 2023-08-27 hour 21: 109458 events in 3 files, snapshot 8563750962461310631 (task 8678 ms: download 1661 ms overlapping gunzip 431 ms, parse 1986 ms, sort 135 ms, write 4976 ms, index 462 ms: 5 candidates, 44293 repo-hours, 723 releases; waiting 473 ms; commit 2121 ms)
2026-11-08T00:19:18Z [load_day 2023-08-27] 2023-08-27 hour 22: 100222 events in 3 files, snapshot 8206802715718488580 (task 8340 ms: download 1446 ms overlapping gunzip 467 ms, parse 2022 ms, sort 78 ms, write 4963 ms, index 336 ms: 6 candidates, 40336 repo-hours, 588 releases; waiting 205 ms; commit 1982 ms)
2026-11-08T00:19:22Z [load_day 2023-08-27] 2023-08-27 hour 23: 98984 events in 2 files, snapshot 1941763761389770200 (task 8275 ms: download 2006 ms overlapping gunzip 468 ms, parse 2261 ms, sort 67 ms, write 4418 ms, index 289 ms: 2 candidates, 41182 repo-hours, 609 releases; waiting 505 ms; commit 2049 ms)
2026-11-08T00:19:28Z [load_day 2023-08-27] 2023-08-27: repo_hour merged from 24 files to 1 (1307947 rows, 6113 ms)
2026-11-08T00:19:30Z [load_day 2023-08-27] 2023-08-27: index committed in 8330 ms (24 + 1 + 24 files)
2026-11-08T00:19:30Z [load_day 2023-08-27] 2023-08-27: 2988689 events in 24 hours
2026-11-08T00:19:30Z [load_day 2023-08-27] attempt 1 succeeded