orcaLog in

Runs · run 1620

load_day 2023-10-13, attempt 1 succeeded

Host
3c2b29713ce8:434180
Started
2026-11-08T01:44:51Z
Ended
2026-11-08T01:48:56Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1620/load_day/2023-10-13/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T01:44:51Z [load_day 2023-10-13] attempt 1 started
2026-11-08T01:44:53Z [load_day 2023-10-13] 2023-10-13: 2 hours in flight, about 1200 MB
2026-11-08T01:45:13Z [load_day 2023-10-13] 2023-10-13 hour 0: 160957 events in 4 files, snapshot 212947539263393959 (task 16290 ms: download 7391 ms overlapping gunzip 1036 ms, parse 4768 ms, sort 178 ms, write 8768 ms, index 602 ms: 9 candidates, 87234 repo-hours, 988 releases; waiting 673 ms; commit 2219 ms)
2026-11-08T01:45:16Z [load_day 2023-10-13] 2023-10-13 hour 1: 164077 events in 4 files, snapshot 3775356417129114007 (task 15314 ms: download 6015 ms overlapping gunzip 791 ms, parse 3699 ms, sort 105 ms, write 9154 ms, index 814 ms: 2 candidates, 91925 repo-hours, 983 releases; waiting 511 ms; commit 3159 ms)
2026-11-08T01:45:27Z [load_day 2023-10-13] 2023-10-13 hour 2: 139182 events in 3 files, snapshot 6212622278871250523 (task 13003 ms: download 5731 ms overlapping gunzip 842 ms, parse 3626 ms, sort 132 ms, write 7229 ms, index 412 ms: 5 candidates, 60014 repo-hours, 704 releases; waiting 513 ms; commit 2425 ms)
2026-11-08T01:45:30Z [load_day 2023-10-13] 2023-10-13 hour 3: 130943 events in 3 files, snapshot 7043327541190886206 (task 12210 ms: download 5161 ms overlapping gunzip 704 ms, parse 3021 ms, sort 76 ms, write 6786 ms, index 396 ms: 5 candidates, 56830 repo-hours, 844 releases; waiting 888 ms; commit 2991 ms)
2026-11-08T01:45:41Z [load_day 2023-10-13] 2023-10-13 hour 4: 135591 events in 3 files, snapshot 9128878442996794220 (task 12080 ms: download 5512 ms overlapping gunzip 664 ms, parse 2879 ms, sort 88 ms, write 7235 ms, index 376 ms: 6 candidates, 55512 repo-hours, 624 releases; waiting 518 ms; commit 3379 ms)
2026-11-08T01:45:47Z [load_day 2023-10-13] 2023-10-13 hour 5: 143225 events in 3 files, snapshot 8499823334396677170 (task 12417 ms: download 5408 ms overlapping gunzip 747 ms, parse 3206 ms, sort 97 ms, write 7056 ms, index 489 ms: 4 candidates, 61348 repo-hours, 710 releases; waiting 523 ms; commit 5727 ms)
2026-11-08T01:45:59Z [load_day 2023-10-13] 2023-10-13 hour 6: 171721 events in 4 files, snapshot 2175844763541467738 (task 17332 ms: download 10392 ms overlapping gunzip 878 ms, parse 3994 ms, sort 127 ms, write 10982 ms, index 569 ms: 9 candidates, 78345 repo-hours, 924 releases; waiting 511 ms; commit 2542 ms)
2026-11-08T01:46:06Z [load_day 2023-10-13] 2023-10-13 hour 7: 179986 events in 4 files, snapshot 9044354637088796593 (task 19016 ms: download 11636 ms overlapping gunzip 1092 ms, parse 4983 ms, sort 124 ms, write 11325 ms, index 697 ms: 6 candidates, 78495 repo-hours, 1084 releases; waiting 515 ms; commit 3978 ms)
2026-11-08T01:46:21Z [load_day 2023-10-13] 2023-10-13 hour 8: 190641 events in 4 files, snapshot 7592619104186033467 (task 20451 ms: download 12179 ms overlapping gunzip 1127 ms, parse 5246 ms, sort 226 ms, write 12450 ms, index 592 ms: 8 candidates, 84308 repo-hours, 1196 releases; waiting 519 ms; commit 3216 ms)
2026-11-08T01:46:25Z [load_day 2023-10-13] 2023-10-13 hour 9: 198024 events in 4 files, snapshot 7343945409025281934 (task 20269 ms: download 12243 ms overlapping gunzip 1258 ms, parse 5722 ms, sort 135 ms, write 11738 ms, index 547 ms: 7 candidates, 85569 repo-hours, 1276 releases; waiting 512 ms; commit 2202 ms)
2026-11-08T01:46:37Z [load_day 2023-10-13] 2023-10-13 hour 10: 184553 events in 4 files, snapshot 2175135600195773307 (task 15781 ms: download 8746 ms overlapping gunzip 893 ms, parse 3953 ms, sort 113 ms, write 9107 ms, index 804 ms: 6 candidates, 79495 repo-hours, 1072 releases; waiting 553 ms; commit 3102 ms)
2026-11-08T01:46:44Z [load_day 2023-10-13] 2023-10-13 hour 11: 179727 events in 4 files, snapshot 3830519860039728906 (task 17153 ms: download 8659 ms overlapping gunzip 954 ms, parse 4243 ms, sort 123 ms, write 10489 ms, index 606 ms: 8 candidates, 74665 repo-hours, 1028 releases; waiting 499 ms; commit 2716 ms)
2026-11-08T01:47:00Z [load_day 2023-10-13] 2023-10-13 hour 12: 234886 events in 5 files, snapshot 1818215447033027444 (task 21468 ms: download 14009 ms overlapping gunzip 1117 ms, parse 5070 ms, sort 146 ms, write 13374 ms, index 822 ms: 4 candidates, 108161 repo-hours, 1043 releases; waiting 608 ms; commit 2367 ms)
2026-11-08T01:47:07Z [load_day 2023-10-13] 2023-10-13 hour 13: 217142 events in 5 files, snapshot 5629799683596065647 (task 22374 ms: download 14294 ms overlapping gunzip 1393 ms, parse 5982 ms, sort 184 ms, write 13472 ms, index 657 ms: 12 candidates, 104650 repo-hours, 1282 releases; waiting 329 ms; commit 3150 ms)
2026-11-08T01:47:26Z [load_day 2023-10-13] 2023-10-13 hour 14: 207835 events in 5 files, snapshot 5639006121163506713 (task 23357 ms: download 12776 ms overlapping gunzip 1209 ms, parse 5500 ms, sort 293 ms, write 14984 ms, index 634 ms: 11 candidates, 89515 repo-hours, 1219 releases; waiting 531 ms; commit 4012 ms)
2026-11-08T01:47:33Z [load_day 2023-10-13] 2023-10-13 hour 15: 193224 events in 4 files, snapshot 6998220077450811812 (task 21935 ms: download 12267 ms overlapping gunzip 1405 ms, parse 5968 ms, sort 308 ms, write 12877 ms, index 593 ms: 11 candidates, 84816 repo-hours, 1149 releases; waiting 498 ms; commit 5701 ms)
2026-11-08T01:47:47Z [load_day 2023-10-13] 2023-10-13 hour 16: 187632 events in 4 files, snapshot 2760289977841840872 (task 21140 ms: download 12439 ms overlapping gunzip 1461 ms, parse 6662 ms, sort 139 ms, write 11508 ms, index 683 ms: 3 candidates, 81101 repo-hours, 1057 releases; waiting 480 ms; commit 2451 ms)
2026-11-08T01:47:52Z [load_day 2023-10-13] 2023-10-13 hour 17: 181178 events in 4 files, snapshot 6344662656460499450 (task 18542 ms: download 11196 ms overlapping gunzip 1050 ms, parse 4840 ms, sort 112 ms, write 11114 ms, index 633 ms: 6 candidates, 75325 repo-hours, 965 releases; waiting 526 ms; commit 5142 ms)
2026-11-08T01:48:06Z [load_day 2023-10-13] 2023-10-13 hour 18: 178325 events in 4 files, snapshot 406615874977673026 (task 18680 ms: download 10554 ms overlapping gunzip 961 ms, parse 4681 ms, sort 161 ms, write 11335 ms, index 692 ms: 3 candidates, 79369 repo-hours, 1073 releases; waiting 525 ms; commit 2262 ms)
2026-11-08T01:48:09Z [load_day 2023-10-13] 2023-10-13 hour 19: 160455 events in 4 files, snapshot 5564257179167824159 (task 16666 ms: download 6915 ms overlapping gunzip 968 ms, parse 4082 ms, sort 108 ms, write 10077 ms, index 582 ms: 7 candidates, 67582 repo-hours, 1071 releases; waiting 517 ms; commit 2487 ms)
2026-11-08T01:48:24Z [load_day 2023-10-13] 2023-10-13 hour 20: 153458 events in 4 files, snapshot 3200621816028175578 (task 16320 ms: download 7007 ms overlapping gunzip 1116 ms, parse 4970 ms, sort 106 ms, write 8728 ms, index 547 ms: 5 candidates, 65665 repo-hours, 1037 releases; waiting 569 ms; commit 2879 ms)
2026-11-08T01:48:28Z [load_day 2023-10-13] 2023-10-13 hour 21: 139800 events in 3 files, snapshot 8680216852191551626 (task 15098 ms: download 6717 ms overlapping gunzip 797 ms, parse 3474 ms, sort 105 ms, write 9287 ms, index 399 ms: 8 candidates, 57869 repo-hours, 1010 releases; waiting 734 ms; commit 3938 ms)
2026-11-08T01:48:44Z [load_day 2023-10-13] 2023-10-13 hour 22: 126978 events in 3 files, snapshot 8292087335118978347 (task 13630 ms: download 6449 ms overlapping gunzip 971 ms, parse 4099 ms, sort 88 ms, write 7343 ms, index 341 ms: 5 candidates, 51837 repo-hours, 894 releases; waiting 492 ms; commit 7858 ms)
2026-11-08T01:48:47Z [load_day 2023-10-13] 2023-10-13 hour 23: 113451 events in 3 files, snapshot 5401113406026712669 (task 10662 ms: download 2438 ms overlapping gunzip 620 ms, parse 2746 ms, sort 100 ms, write 6037 ms, index 348 ms: 4 candidates, 46410 repo-hours, 687 releases; waiting 512 ms; commit 2924 ms)
2026-11-08T01:48:54Z [load_day 2023-10-13] 2023-10-13: repo_hour merged from 24 files to 1 (1806040 rows, 7751 ms)
2026-11-08T01:48:56Z [load_day 2023-10-13] 2023-10-13: index committed in 9757 ms (24 + 1 + 24 files)
2026-11-08T01:48:56Z [load_day 2023-10-13] 2023-10-13: 4072991 events in 24 hours
2026-11-08T01:48:56Z [load_day 2023-10-13] attempt 1 succeeded