orcaLog in

Runs · run 599

load_day 2026-05-02, attempt 1 succeeded

Host
4e84322b8c45:134955
Started
2026-11-07T06:49:53Z
Ended
2026-11-07T06:51:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/599/load_day/2026-05-02/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:49:53Z [load_day 2026-05-02] attempt 1 started
2026-11-07T06:50:02Z [load_day 2026-05-02] 2026-05-02 hour 0: 147286 events in 3 files, snapshot 4452096198674279134 (task 6402 ms: download 2247 ms overlapping gunzip 416 ms, parse 1384 ms, sort 233 ms, write 2998 ms, index 407 ms: 7 candidates, 64436 repo-hours, 866 releases; waiting 498 ms; commit 1327 ms)
2026-11-07T06:50:04Z [load_day 2026-05-02] 2026-05-02 hour 1: 153144 events in 4 files, snapshot 2569381745242595138 (task 6141 ms: download 2213 ms overlapping gunzip 381 ms, parse 1314 ms, sort 165 ms, write 2895 ms, index 546 ms: 9 candidates, 76032 repo-hours, 643 releases; waiting 510 ms; commit 1339 ms)
2026-11-07T06:50:08Z [load_day 2026-05-02] 2026-05-02 hour 2: 156344 events in 4 files, snapshot 2254052372832964840 (task 5369 ms: download 2014 ms overlapping gunzip 378 ms, parse 1253 ms, sort 153 ms, write 2290 ms, index 491 ms: 7 candidates, 81969 repo-hours, 516 releases; waiting 457 ms; commit 1182 ms)
2026-11-07T06:50:10Z [load_day 2026-05-02] 2026-05-02 hour 3: 152276 events in 4 files, snapshot 4653300384306199213 (task 6037 ms: download 2600 ms overlapping gunzip 391 ms, parse 1287 ms, sort 145 ms, write 2595 ms, index 492 ms: 11 candidates, 73656 repo-hours, 716 releases; waiting 741 ms; commit 1199 ms)
2026-11-07T06:50:15Z [load_day 2026-05-02] 2026-05-02 hour 4: 148734 events in 3 files, snapshot 2682890312139990480 (task 6083 ms: download 2135 ms overlapping gunzip 407 ms, parse 1348 ms, sort 142 ms, write 2853 ms, index 425 ms: 5 candidates, 66985 repo-hours, 836 releases; waiting 555 ms; commit 1376 ms)
2026-11-07T06:50:17Z [load_day 2026-05-02] 2026-05-02 hour 5: 148481 events in 3 files, snapshot 2444166443380513167 (task 6072 ms: download 2035 ms overlapping gunzip 448 ms, parse 1370 ms, sort 126 ms, write 2822 ms, index 428 ms: 7 candidates, 68997 repo-hours, 889 releases; waiting 546 ms; commit 1225 ms)
2026-11-07T06:50:22Z [load_day 2026-05-02] 2026-05-02 hour 6: 154440 events in 4 files, snapshot 1006248202028858336 (task 6322 ms: download 1959 ms overlapping gunzip 403 ms, parse 1224 ms, sort 144 ms, write 3070 ms, index 503 ms: 7 candidates, 74861 repo-hours, 757 releases; waiting 597 ms; commit 1110 ms)
2026-11-07T06:50:23Z [load_day 2026-05-02] 2026-05-02 hour 7: 150810 events in 4 files, snapshot 183412449055415663 (task 5616 ms: download 1952 ms overlapping gunzip 355 ms, parse 1151 ms, sort 167 ms, write 2733 ms, index 486 ms: 9 candidates, 74896 repo-hours, 693 releases; waiting 417 ms; commit 1022 ms)
2026-11-07T06:50:29Z [load_day 2026-05-02] 2026-05-02 hour 8: 156812 events in 4 files, snapshot 8671585214294949644 (task 5857 ms: download 2513 ms overlapping gunzip 367 ms, parse 1237 ms, sort 157 ms, write 2427 ms, index 499 ms: 7 candidates, 75699 repo-hours, 752 releases; waiting 860 ms; commit 1149 ms)
2026-11-07T06:50:30Z [load_day 2026-05-02] 2026-05-02 hour 9: 162835 events in 4 files, snapshot 5504429492897959830 (task 5073 ms: download 1819 ms overlapping gunzip 284 ms, parse 998 ms, sort 141 ms, write 2100 ms, index 449 ms: 6 candidates, 67195 repo-hours, 403 releases; waiting 752 ms; commit 1477 ms)
2026-11-07T06:50:35Z [load_day 2026-05-02] 2026-05-02 hour 10: 152030 events in 4 files, snapshot 3651190022352219140 (task 5672 ms: download 2076 ms overlapping gunzip 370 ms, parse 1211 ms, sort 131 ms, write 2522 ms, index 498 ms: 5 candidates, 73271 repo-hours, 483 releases; waiting 625 ms; commit 1139 ms)
2026-11-07T06:50:36Z [load_day 2026-05-02] 2026-05-02 hour 11: 155158 events in 4 files, snapshot 450529719777523683 (task 5503 ms: download 1873 ms overlapping gunzip 351 ms, parse 1152 ms, sort 134 ms, write 2560 ms, index 507 ms: 3 candidates, 75729 repo-hours, 593 releases; waiting 536 ms; commit 1184 ms)
2026-11-07T06:50:41Z [load_day 2026-05-02] 2026-05-02 hour 12: 162110 events in 4 files, snapshot 721290122339834124 (task 5003 ms: download 1727 ms overlapping gunzip 311 ms, parse 1032 ms, sort 138 ms, write 2109 ms, index 530 ms: 6 candidates, 84988 repo-hours, 347 releases; waiting 545 ms; commit 1186 ms)
2026-11-07T06:50:42Z [load_day 2026-05-02] 2026-05-02 hour 13: 164822 events in 4 files, snapshot 6443241535357506507 (task 4290 ms: download 1190 ms overlapping gunzip 247 ms, parse 893 ms, sort 111 ms, write 1883 ms, index 574 ms: 9 candidates, 90930 repo-hours, 250 releases; waiting 237 ms; commit 1107 ms)
2026-11-07T06:50:46Z [load_day 2026-05-02] 2026-05-02 hour 14: 162178 events in 4 files, snapshot 5669412029739650282 (task 4811 ms: download 2150 ms overlapping gunzip 300 ms, parse 1004 ms, sort 123 ms, write 1985 ms, index 540 ms: 4 candidates, 82410 repo-hours, 307 releases; waiting 549 ms; commit 1171 ms)
2026-11-07T06:50:47Z [load_day 2026-05-02] 2026-05-02 hour 15: 158548 events in 4 files, snapshot 6777811896979538957 (task 4626 ms: download 1671 ms overlapping gunzip 276 ms, parse 954 ms, sort 113 ms, write 1672 ms, index 511 ms: 4 candidates, 72164 repo-hours, 188 releases; waiting 534 ms; commit 1183 ms)
2026-11-07T06:50:52Z [load_day 2026-05-02] 2026-05-02 hour 16: 161701 events in 4 files, snapshot 8514281253400312004 (task 4801 ms: download 1839 ms overlapping gunzip 278 ms, parse 976 ms, sort 115 ms, write 2020 ms, index 522 ms: 9 candidates, 80259 repo-hours, 244 releases; waiting 573 ms; commit 1142 ms)
2026-11-07T06:50:53Z [load_day 2026-05-02] 2026-05-02 hour 17: 159957 events in 4 files, snapshot 9171849125116215094 (task 4798 ms: download 1766 ms overlapping gunzip 286 ms, parse 960 ms, sort 175 ms, write 2001 ms, index 531 ms: 7 candidates, 77175 repo-hours, 325 releases; waiting 530 ms; commit 1165 ms)
2026-11-07T06:50:58Z [load_day 2026-05-02] 2026-05-02 hour 18: 159213 events in 4 files, snapshot 6429023776634613755 (task 5294 ms: download 1859 ms overlapping gunzip 317 ms, parse 1051 ms, sort 111 ms, write 2261 ms, index 536 ms: 8 candidates, 79856 repo-hours, 417 releases; waiting 666 ms; commit 1111 ms)
2026-11-07T06:50:59Z [load_day 2026-05-02] 2026-05-02 hour 19: 155416 events in 4 files, snapshot 8740196027218829985 (task 5590 ms: download 2002 ms overlapping gunzip 358 ms, parse 1132 ms, sort 144 ms, write 2619 ms, index 483 ms: 15 candidates, 75063 repo-hours, 548 releases; waiting 550 ms; commit 1333 ms)
2026-11-07T06:51:05Z [load_day 2026-05-02] 2026-05-02 hour 20: 154145 events in 4 files, snapshot 5077419899100103024 (task 6714 ms: download 2728 ms overlapping gunzip 431 ms, parse 1355 ms, sort 144 ms, write 3323 ms, index 490 ms: 11 candidates, 71950 repo-hours, 631 releases; waiting 640 ms; commit 1322 ms)
2026-11-07T06:51:06Z [load_day 2026-05-02] 2026-05-02 hour 21: 156161 events in 4 files, snapshot 158940527857668627 (task 6799 ms: download 2339 ms overlapping gunzip 400 ms, parse 1264 ms, sort 128 ms, write 3347 ms, index 459 ms: 5 candidates, 70207 repo-hours, 910 releases; waiting 741 ms; commit 1027 ms)
2026-11-07T06:51:12Z [load_day 2026-05-02] 2026-05-02 hour 22: 151206 events in 4 files, snapshot 935086144155557906 (task 6475 ms: download 2359 ms overlapping gunzip 429 ms, parse 1404 ms, sort 130 ms, write 3013 ms, index 458 ms: 6 candidates, 66417 repo-hours, 927 releases; waiting 753 ms; commit 1059 ms)
2026-11-07T06:51:13Z [load_day 2026-05-02] 2026-05-02 hour 23: 147366 events in 3 files, snapshot 7067481187789116066 (task 6225 ms: download 2167 ms overlapping gunzip 390 ms, parse 1307 ms, sort 127 ms, write 3098 ms, index 426 ms: 4 candidates, 63232 repo-hours, 905 releases; waiting 573 ms; commit 1029 ms)
2026-11-07T06:51:21Z [load_day 2026-05-02] 2026-05-02: repo_hour merged from 24 files to 1 (1788377 rows, 7335 ms)
2026-11-07T06:51:22Z [load_day 2026-05-02] 2026-05-02: index committed in 9005 ms (24 + 1 + 24 files)
2026-11-07T06:51:22Z [load_day 2026-05-02] 2026-05-02: 3731173 events in 24 hours
2026-11-07T06:51:22Z [load_day 2026-05-02] attempt 1 succeeded