orcaLog in

Runs · run 1770

load_day 2023-11-23, attempt 1 succeeded

Host
3c2b29713ce8:589529
Started
2026-11-08T03:06:17Z
Ended
2026-11-08T03:10:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1770/load_day/2023-11-23/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T03:06:17Z [load_day 2023-11-23] attempt 1 started
2026-11-08T03:06:19Z [load_day 2023-11-23] 2023-11-23: 2 hours in flight, about 1200 MB
2026-11-08T03:06:39Z [load_day 2023-11-23] 2023-11-23 hour 0: 178302 events in 4 files, snapshot 8488528450544804666 (task 14599 ms: download 6047 ms overlapping gunzip 863 ms, parse 4272 ms, sort 154 ms, write 8535 ms, index 566 ms: 11 candidates, 84800 repo-hours, 899 releases; waiting 19 ms; commit 4477 ms)
2026-11-08T03:06:42Z [load_day 2023-11-23] 2023-11-23 hour 1: 181910 events in 4 files, snapshot 8522554781948947498 (task 13694 ms: download 4794 ms overlapping gunzip 867 ms, parse 3774 ms, sort 135 ms, write 8013 ms, index 692 ms: 5 candidates, 91049 repo-hours, 808 releases; waiting 24 ms; commit 3043 ms)
2026-11-08T03:06:52Z [load_day 2023-11-23] 2023-11-23 hour 2: 157343 events in 4 files, snapshot 7841947168880525297 (task 13174 ms: download 4606 ms overlapping gunzip 748 ms, parse 3342 ms, sort 142 ms, write 8111 ms, index 614 ms: 6 candidates, 61114 repo-hours, 714 releases; waiting 20 ms; commit 3482 ms)
2026-11-08T03:06:56Z [load_day 2023-11-23] 2023-11-23 hour 3: 153936 events in 4 files, snapshot 6620972795649016394 (task 12255 ms: download 4759 ms overlapping gunzip 808 ms, parse 3504 ms, sort 126 ms, write 7115 ms, index 469 ms: 6 candidates, 59756 repo-hours, 814 releases; waiting 35 ms; commit 3083 ms)
2026-11-08T03:07:06Z [load_day 2023-11-23] 2023-11-23 hour 4: 148185 events in 3 files, snapshot 2723787186340789949 (task 12223 ms: download 3969 ms overlapping gunzip 789 ms, parse 3613 ms, sort 142 ms, write 7093 ms, index 361 ms: 7 candidates, 55081 repo-hours, 610 releases; waiting 30 ms; commit 3185 ms)
2026-11-08T03:07:11Z [load_day 2023-11-23] 2023-11-23 hour 5: 158067 events in 4 files, snapshot 8991183144507156516 (task 13454 ms: download 4243 ms overlapping gunzip 748 ms, parse 3398 ms, sort 116 ms, write 8522 ms, index 459 ms: 6 candidates, 60923 repo-hours, 686 releases; waiting 20 ms; commit 3636 ms)
2026-11-08T03:07:24Z [load_day 2023-11-23] 2023-11-23 hour 6: 171865 events in 4 files, snapshot 8058015591472007153 (task 15176 ms: download 5406 ms overlapping gunzip 815 ms, parse 3897 ms, sort 137 ms, write 9154 ms, index 661 ms: 7 candidates, 73654 repo-hours, 814 releases; waiting 243 ms; commit 4565 ms)
2026-11-08T03:07:29Z [load_day 2023-11-23] 2023-11-23 hour 7: 183999 events in 4 files, snapshot 3319086895020291233 (task 17385 ms: download 9257 ms overlapping gunzip 1063 ms, parse 4832 ms, sort 170 ms, write 10346 ms, index 719 ms: 7 candidates, 73634 repo-hours, 818 releases; waiting 26 ms; commit 3712 ms)
2026-11-08T03:07:43Z [load_day 2023-11-23] 2023-11-23 hour 8: 198057 events in 4 files, snapshot 5351069157363703370 (task 19332 ms: download 10312 ms overlapping gunzip 1160 ms, parse 5538 ms, sort 249 ms, write 11549 ms, index 614 ms: 4 candidates, 82347 repo-hours, 1032 releases; waiting 17 ms; commit 3299 ms)
2026-11-08T03:07:51Z [load_day 2023-11-23] 2023-11-23 hour 9: 206560 events in 5 files, snapshot 4346671955758990276 (task 19786 ms: download 10356 ms overlapping gunzip 1231 ms, parse 5747 ms, sort 142 ms, write 11764 ms, index 665 ms: 7 candidates, 88185 repo-hours, 1193 releases; waiting 28 ms; commit 3834 ms)
2026-11-08T03:08:00Z [load_day 2023-11-23] 2023-11-23 hour 10: 198860 events in 4 files, snapshot 8248782005621475161 (task 16822 ms: download 9458 ms overlapping gunzip 959 ms, parse 4401 ms, sort 121 ms, write 10534 ms, index 606 ms: 10 candidates, 86704 repo-hours, 1205 releases; waiting 19 ms; commit 2697 ms)
2026-11-08T03:08:08Z [load_day 2023-11-23] 2023-11-23 hour 11: 201214 events in 5 files, snapshot 3465282390543737574 (task 16575 ms: download 8288 ms overlapping gunzip 922 ms, parse 4102 ms, sort 133 ms, write 9749 ms, index 1430 ms: 7 candidates, 81443 repo-hours, 1178 releases; waiting 18 ms; commit 3131 ms)
2026-11-08T03:08:21Z [load_day 2023-11-23] 2023-11-23 hour 12: 242383 events in 5 files, snapshot 3038712351757369118 (task 19407 ms: download 10595 ms overlapping gunzip 1091 ms, parse 4899 ms, sort 136 ms, write 11566 ms, index 1521 ms: 9 candidates, 113340 repo-hours, 1120 releases; waiting 15 ms; commit 3361 ms)
2026-11-08T03:08:33Z [load_day 2023-11-23] 2023-11-23 hour 13: 227461 events in 5 files, snapshot 112140749497880181 (task 21895 ms: download 13375 ms overlapping gunzip 1203 ms, parse 5586 ms, sort 177 ms, write 13530 ms, index 1122 ms: 10 candidates, 107577 repo-hours, 1255 releases; waiting 17 ms; commit 4769 ms)
2026-11-08T03:08:47Z [load_day 2023-11-23] 2023-11-23 hour 14: 221131 events in 5 files, snapshot 2181461002450320792 (task 24086 ms: download 15898 ms overlapping gunzip 1499 ms, parse 6800 ms, sort 173 ms, write 14429 ms, index 981 ms: 8 candidates, 94399 repo-hours, 1271 releases; waiting 17 ms; commit 3455 ms)
2026-11-08T03:08:56Z [load_day 2023-11-23] 2023-11-23 hour 15: 217606 events in 5 files, snapshot 2855775386146525922 (task 22322 ms: download 15053 ms overlapping gunzip 1197 ms, parse 5647 ms, sort 182 ms, write 14025 ms, index 1056 ms: 10 candidates, 92887 repo-hours, 1298 releases; waiting 17 ms; commit 3874 ms)
2026-11-08T03:09:21Z [load_day 2023-11-23] 2023-11-23 hour 16: 203630 events in 5 files, snapshot 3258702597885984033 (task 21521 ms: download 11884 ms overlapping gunzip 1613 ms, parse 6793 ms, sort 132 ms, write 11214 ms, index 986 ms: 9 candidates, 85752 repo-hours, 1196 releases; waiting 520 ms; commit 14069 ms)
2026-11-08T03:09:24Z [load_day 2023-11-23] 2023-11-23 hour 17: 187819 events in 4 files, snapshot 3479790301395778719 (task 20205 ms: download 11095 ms overlapping gunzip 1322 ms, parse 5761 ms, sort 223 ms, write 12087 ms, index 591 ms: 9 candidates, 76193 repo-hours, 1008 releases; waiting 16 ms; commit 3186 ms)
2026-11-08T03:09:29Z [load_day 2023-11-23] 2023-11-23 hour 18: 183883 events in 4 files, snapshot 1628763561845602791 (task 16594 ms: download 9871 ms overlapping gunzip 1100 ms, parse 4838 ms, sort 123 ms, write 9488 ms, index 796 ms: 18 candidates, 79092 repo-hours, 954 releases; waiting 26 ms; commit 4453 ms)
2026-11-08T03:09:42Z [load_day 2023-11-23] 2023-11-23 hour 19: 165449 events in 4 files, snapshot 6460580787115259537 (task 15437 ms: download 6576 ms overlapping gunzip 954 ms, parse 4480 ms, sort 147 ms, write 8368 ms, index 653 ms: 11 candidates, 65685 repo-hours, 898 releases; waiting 535 ms; commit 4717 ms)
2026-11-08T03:09:45Z [load_day 2023-11-23] 2023-11-23 hour 20: 157968 events in 4 files, snapshot 7611926785224686548 (task 13540 ms: download 5219 ms overlapping gunzip 775 ms, parse 3498 ms, sort 134 ms, write 8080 ms, index 830 ms: 7 candidates, 63286 repo-hours, 835 releases; waiting 22 ms; commit 3403 ms)
2026-11-08T03:09:54Z [load_day 2023-11-23] 2023-11-23 hour 21: 148454 events in 3 files, snapshot 6511596221962987963 (task 12779 ms: download 4262 ms overlapping gunzip 728 ms, parse 3153 ms, sort 143 ms, write 7949 ms, index 571 ms: 8 candidates, 57814 repo-hours, 893 releases; waiting 24 ms; commit 3416 ms)
2026-11-08T03:09:58Z [load_day 2023-11-23] 2023-11-23 hour 22: 143983 events in 3 files, snapshot 8789889639751899693 (task 12407 ms: download 4880 ms overlapping gunzip 797 ms, parse 3453 ms, sort 197 ms, write 7317 ms, index 433 ms: 6 candidates, 56139 repo-hours, 863 releases; waiting 18 ms; commit 2660 ms)
2026-11-08T03:10:05Z [load_day 2023-11-23] 2023-11-23 hour 23: 135312 events in 3 files, snapshot 5372937503563119702 (task 10218 ms: download 4244 ms overlapping gunzip 728 ms, parse 3077 ms, sort 141 ms, write 5695 ms, index 351 ms: 4 candidates, 49929 repo-hours, 670 releases; waiting 23 ms; commit 2827 ms)
2026-11-08T03:10:13Z [load_day 2023-11-23] 2023-11-23: repo_hour merged from 24 files to 1 (1840783 rows, 8387 ms)
2026-11-08T03:10:16Z [load_day 2023-11-23] 2023-11-23: index committed in 10941 ms (24 + 1 + 24 files)
2026-11-08T03:10:16Z [load_day 2023-11-23] 2023-11-23: 4373377 events in 24 hours
2026-11-08T03:10:16Z [load_day 2023-11-23] attempt 1 succeeded