orcaLog in

Runs · run 536

load_day 2026-05-23, attempt 1 succeeded

Host
4e84322b8c45:118374
Started
2026-11-07T06:18:05Z
Ended
2026-11-07T06:19:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/536/load_day/2026-05-23/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:18:05Z [load_day 2026-05-23] attempt 1 started
2026-11-07T06:18:14Z [load_day 2026-05-23] 2026-05-23 hour 0: 148654 events in 3 files, snapshot 840407940169310122 (task 5843 ms: download 2372 ms overlapping gunzip 380 ms, parse 1322 ms, sort 155 ms, write 2720 ms, index 435 ms: 4 candidates, 67015 repo-hours, 836 releases; waiting 512 ms; commit 1028 ms)
2026-11-07T06:18:15Z [load_day 2026-05-23] 2026-05-23 hour 1: 145698 events in 3 files, snapshot 1883019300008318351 (task 5747 ms: download 2054 ms overlapping gunzip 369 ms, parse 1243 ms, sort 159 ms, write 2510 ms, index 472 ms: 5 candidates, 69855 repo-hours, 694 releases; waiting 660 ms; commit 1247 ms)
2026-11-07T06:18:19Z [load_day 2026-05-23] 2026-05-23 hour 2: 152214 events in 4 files, snapshot 3548207299471893648 (task 4943 ms: download 1352 ms overlapping gunzip 335 ms, parse 1086 ms, sort 143 ms, write 2330 ms, index 465 ms: 4 candidates, 78288 repo-hours, 497 releases; waiting 330 ms; commit 1218 ms)
2026-11-07T06:18:21Z [load_day 2026-05-23] 2026-05-23 hour 3: 152829 events in 4 files, snapshot 6911680476728823878 (task 4995 ms: download 1577 ms overlapping gunzip 391 ms, parse 1190 ms, sort 115 ms, write 2004 ms, index 503 ms: 9 candidates, 77911 repo-hours, 542 releases; waiting 533 ms; commit 1268 ms)
2026-11-07T06:18:26Z [load_day 2026-05-23] 2026-05-23 hour 4: 147815 events in 3 files, snapshot 3789550554393965831 (task 5727 ms: download 1598 ms overlapping gunzip 363 ms, parse 1196 ms, sort 130 ms, write 2850 ms, index 446 ms: 7 candidates, 67827 repo-hours, 754 releases; waiting 531 ms; commit 1042 ms)
2026-11-07T06:18:27Z [load_day 2026-05-23] 2026-05-23 hour 5: 151217 events in 4 files, snapshot 2620113376524094892 (task 6002 ms: download 1960 ms overlapping gunzip 379 ms, parse 1200 ms, sort 136 ms, write 2895 ms, index 435 ms: 7 candidates, 68377 repo-hours, 785 releases; waiting 566 ms; commit 1091 ms)
2026-11-07T06:18:32Z [load_day 2026-05-23] 2026-05-23 hour 6: 153195 events in 4 files, snapshot 2185930835242239254 (task 5159 ms: download 2224 ms overlapping gunzip 324 ms, parse 1067 ms, sort 135 ms, write 2277 ms, index 476 ms: 7 candidates, 71793 repo-hours, 632 releases; waiting 550 ms; commit 1168 ms)
2026-11-07T06:18:33Z [load_day 2026-05-23] 2026-05-23 hour 7: 151575 events in 4 files, snapshot 6842875688896258942 (task 5035 ms: download 1664 ms overlapping gunzip 338 ms, parse 1076 ms, sort 115 ms, write 2052 ms, index 480 ms: 4 candidates, 73936 repo-hours, 568 releases; waiting 549 ms; commit 1146 ms)
2026-11-07T06:18:37Z [load_day 2026-05-23] 2026-05-23 hour 8: 154218 events in 4 files, snapshot 8435701443439910245 (task 5035 ms: download 1983 ms overlapping gunzip 302 ms, parse 1008 ms, sort 137 ms, write 2169 ms, index 506 ms: 7 candidates, 75596 repo-hours, 478 releases; waiting 541 ms; commit 1178 ms)
2026-11-07T06:18:38Z [load_day 2026-05-23] 2026-05-23 hour 9: 157244 events in 4 files, snapshot 785272208182373691 (task 4967 ms: download 1693 ms overlapping gunzip 308 ms, parse 1062 ms, sort 118 ms, write 2147 ms, index 494 ms: 9 candidates, 74597 repo-hours, 690 releases; waiting 585 ms; commit 947 ms)
2026-11-07T06:18:44Z [load_day 2026-05-23] 2026-05-23 hour 10: 156271 events in 4 files, snapshot 9178427906130907519 (task 5447 ms: download 1725 ms overlapping gunzip 315 ms, parse 1060 ms, sort 137 ms, write 2539 ms, index 560 ms: 8 candidates, 76244 repo-hours, 601 releases; waiting 517 ms; commit 1227 ms)
2026-11-07T06:18:45Z [load_day 2026-05-23] 2026-05-23 hour 11: 156560 events in 4 files, snapshot 2223150330899917991 (task 5042 ms: download 1544 ms overlapping gunzip 286 ms, parse 953 ms, sort 128 ms, write 2368 ms, index 511 ms: 3 candidates, 79514 repo-hours, 452 releases; waiting 535 ms; commit 1062 ms)
2026-11-07T06:18:49Z [load_day 2026-05-23] 2026-05-23 hour 12: 155074 events in 4 files, snapshot 9017987846167471339 (task 4708 ms: download 1775 ms overlapping gunzip 273 ms, parse 924 ms, sort 115 ms, write 1975 ms, index 542 ms: 6 candidates, 80395 repo-hours, 263 releases; waiting 534 ms; commit 1107 ms)
2026-11-07T06:18:50Z [load_day 2026-05-23] 2026-05-23 hour 13: 168384 events in 4 files, snapshot 1038119148835244935 (task 4389 ms: download 1347 ms overlapping gunzip 229 ms, parse 832 ms, sort 110 ms, write 1861 ms, index 573 ms: 9 candidates, 91397 repo-hours, 92 releases; waiting 519 ms; commit 1024 ms)
2026-11-07T06:18:54Z [load_day 2026-05-23] 2026-05-23 hour 14: 163988 events in 4 files, snapshot 9086057448928733212 (task 4398 ms: download 1257 ms overlapping gunzip 271 ms, parse 876 ms, sort 120 ms, write 1801 ms, index 531 ms: 4 candidates, 82594 repo-hours, 157 releases; waiting 534 ms; commit 1088 ms)
2026-11-07T06:18:55Z [load_day 2026-05-23] 2026-05-23 hour 15: 159419 events in 4 files, snapshot 3003212573008001638 (task 4315 ms: download 1322 ms overlapping gunzip 269 ms, parse 949 ms, sort 112 ms, write 1631 ms, index 537 ms: 6 candidates, 79086 repo-hours, 172 releases; waiting 546 ms; commit 1048 ms)
2026-11-07T06:18:58Z [load_day 2026-05-23] 2026-05-23 hour 16: 165264 events in 4 files, snapshot 9209073045281477604 (task 3938 ms: download 1192 ms overlapping gunzip 233 ms, parse 856 ms, sort 166 ms, write 1709 ms, index 550 ms: 10 candidates, 81402 repo-hours, 114 releases; waiting 183 ms; commit 1089 ms)
2026-11-07T06:19:00Z [load_day 2026-05-23] 2026-05-23 hour 17: 157137 events in 4 files, snapshot 5644297154121562827 (task 4086 ms: download 1397 ms overlapping gunzip 235 ms, parse 833 ms, sort 116 ms, write 1669 ms, index 494 ms: 5 candidates, 74258 repo-hours, 200 releases; waiting 532 ms; commit 1021 ms)
2026-11-07T06:19:04Z [load_day 2026-05-23] 2026-05-23 hour 18: 157814 events in 4 files, snapshot 7901634314022793149 (task 4781 ms: download 1394 ms overlapping gunzip 280 ms, parse 939 ms, sort 123 ms, write 2099 ms, index 537 ms: 7 candidates, 72933 repo-hours, 344 releases; waiting 535 ms; commit 1225 ms)
2026-11-07T06:19:05Z [load_day 2026-05-23] 2026-05-23 hour 19: 158729 events in 4 files, snapshot 1661876207643985174 (task 4341 ms: download 1403 ms overlapping gunzip 264 ms, parse 943 ms, sort 130 ms, write 1704 ms, index 512 ms: 7 candidates, 75168 repo-hours, 280 releases; waiting 522 ms; commit 1266 ms)
2026-11-07T06:19:09Z [load_day 2026-05-23] 2026-05-23 hour 20: 160766 events in 4 files, snapshot 7090543614591510463 (task 4640 ms: download 1588 ms overlapping gunzip 294 ms, parse 994 ms, sort 121 ms, write 1841 ms, index 519 ms: 5 candidates, 72205 repo-hours, 307 releases; waiting 519 ms; commit 1207 ms)
2026-11-07T06:19:11Z [load_day 2026-05-23] 2026-05-23 hour 21: 156075 events in 4 files, snapshot 7145598039817037612 (task 4501 ms: download 1515 ms overlapping gunzip 295 ms, parse 1003 ms, sort 120 ms, write 2131 ms, index 450 ms: 12 candidates, 67745 repo-hours, 488 releases; waiting 219 ms; commit 1295 ms)
2026-11-07T06:19:15Z [load_day 2026-05-23] 2026-05-23 hour 22: 150643 events in 4 files, snapshot 7237063450612771330 (task 5373 ms: download 1917 ms overlapping gunzip 349 ms, parse 1205 ms, sort 136 ms, write 2375 ms, index 456 ms: 7 candidates, 68077 repo-hours, 780 releases; waiting 554 ms; commit 1215 ms)
2026-11-07T06:19:17Z [load_day 2026-05-23] 2026-05-23 hour 23: 147295 events in 3 files, snapshot 3217506283611697553 (task 5714 ms: download 1648 ms overlapping gunzip 400 ms, parse 1493 ms, sort 185 ms, write 2313 ms, index 454 ms: 5 candidates, 65555 repo-hours, 963 releases; waiting 605 ms; commit 1166 ms)
2026-11-07T06:19:25Z [load_day 2026-05-23] 2026-05-23: repo_hour merged from 24 files to 1 (1791768 rows, 7607 ms)
2026-11-07T06:19:26Z [load_day 2026-05-23] 2026-05-23: index committed in 9304 ms (24 + 1 + 24 files)
2026-11-07T06:19:26Z [load_day 2026-05-23] 2026-05-23: 3728078 events in 24 hours
2026-11-07T06:19:26Z [load_day 2026-05-23] attempt 1 succeeded