orcaLog in

Runs · run 705

load_day 2026-03-28, attempt 1 succeeded

Host
4e84322b8c45:174578
Started
2026-11-07T13:22:34Z
Ended
2026-11-07T13:24:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/705/load_day/2026-03-28/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:22:34Z [load_day 2026-03-28] attempt 1 started
2026-11-07T13:22:46Z [load_day 2026-03-28] 2026-03-28 hour 0: 151983 events in 4 files, snapshot 8119294973846438181 (task 7727 ms: download 2718 ms overlapping gunzip 582 ms, parse 1856 ms, sort 217 ms, write 3490 ms, index 456 ms: 5 candidates, 66285 repo-hours, 1005 releases; waiting 706 ms; commit 1585 ms)
2026-11-07T13:22:47Z [load_day 2026-03-28] 2026-03-28 hour 1: 159153 events in 4 files, snapshot 8436475011383953184 (task 7002 ms: download 1863 ms overlapping gunzip 517 ms, parse 1711 ms, sort 214 ms, write 3092 ms, index 682 ms: 12 candidates, 87159 repo-hours, 540 releases; waiting 487 ms; commit 1303 ms)
2026-11-07T13:22:52Z [load_day 2026-03-28] 2026-03-28 hour 2: 169981 events in 4 files, snapshot 5307318026601855978 (task 5516 ms: download 1505 ms overlapping gunzip 358 ms, parse 1169 ms, sort 185 ms, write 2675 ms, index 522 ms: 10 candidates, 82438 repo-hours, 377 releases; waiting 278 ms; commit 1338 ms)
2026-11-07T13:22:55Z [load_day 2026-03-28] 2026-03-28 hour 3: 163966 events in 4 files, snapshot 2263455301674224281 (task 6788 ms: download 2250 ms overlapping gunzip 494 ms, parse 1644 ms, sort 255 ms, write 3096 ms, index 421 ms: 7 candidates, 56627 repo-hours, 434 releases; waiting 538 ms; commit 1622 ms)
2026-11-07T13:23:04Z [load_day 2026-03-28] 2026-03-28 hour 4: 163367 events in 4 files, snapshot 1877080559438661824 (task 9703 ms: download 3297 ms overlapping gunzip 762 ms, parse 2395 ms, sort 233 ms, write 4857 ms, index 475 ms: 7 candidates, 64022 repo-hours, 434 releases; waiting 639 ms; commit 3327 ms)
2026-11-07T13:23:06Z [load_day 2026-03-28] 2026-03-28 hour 5: 164039 events in 4 files, snapshot 6031111256671662797 (task 8132 ms: download 2712 ms overlapping gunzip 605 ms, parse 1940 ms, sort 287 ms, write 3859 ms, index 397 ms: 1 candidates, 59867 repo-hours, 303 releases; waiting 717 ms; commit 1187 ms)
2026-11-07T13:23:12Z [load_day 2026-03-28] 2026-03-28 hour 6: 158748 events in 4 files, snapshot 8562897062601143049 (task 8535 ms: download 2199 ms overlapping gunzip 712 ms, parse 2289 ms, sort 297 ms, write 4060 ms, index 522 ms: 7 candidates, 68376 repo-hours, 638 releases; waiting 395 ms; commit 1284 ms)
2026-11-07T13:23:17Z [load_day 2026-03-28] 2026-03-28 hour 7: 162783 events in 4 files, snapshot 7585324793062239220 (task 10921 ms: download 4030 ms overlapping gunzip 762 ms, parse 2233 ms, sort 250 ms, write 5281 ms, index 515 ms: 8 candidates, 75206 repo-hours, 505 releases; waiting 1511 ms; commit 1329 ms)
2026-11-07T13:23:23Z [load_day 2026-03-28] 2026-03-28 hour 8: 163659 events in 4 files, snapshot 2969332645998823321 (task 10154 ms: download 3209 ms overlapping gunzip 856 ms, parse 2363 ms, sort 309 ms, write 5121 ms, index 519 ms: 9 candidates, 74714 repo-hours, 451 releases; waiting 631 ms; commit 1451 ms)
2026-11-07T13:23:27Z [load_day 2026-03-28] 2026-03-28 hour 9: 165564 events in 4 files, snapshot 7073846936798184689 (task 9116 ms: download 3211 ms overlapping gunzip 697 ms, parse 1933 ms, sort 210 ms, write 4735 ms, index 488 ms: 12 candidates, 74893 repo-hours, 301 releases; waiting 718 ms; commit 1309 ms)
2026-11-07T13:23:32Z [load_day 2026-03-28] 2026-03-28 hour 10: 166884 events in 4 files, snapshot 7167487430969900106 (task 8047 ms: download 2590 ms overlapping gunzip 651 ms, parse 2022 ms, sort 176 ms, write 3695 ms, index 559 ms: 12 candidates, 77276 repo-hours, 331 releases; waiting 615 ms; commit 1376 ms)
2026-11-07T13:23:38Z [load_day 2026-03-28] 2026-03-28 hour 11: 163083 events in 4 files, snapshot 8497105219391687131 (task 9623 ms: download 3715 ms overlapping gunzip 708 ms, parse 2090 ms, sort 169 ms, write 5008 ms, index 484 ms: 4 candidates, 74398 repo-hours, 337 releases; waiting 834 ms; commit 1357 ms)
2026-11-07T13:23:39Z [load_day 2026-03-28] 2026-03-28 hour 12: 167769 events in 4 files, snapshot 7482334182656666754 (task 6899 ms: download 2336 ms overlapping gunzip 471 ms, parse 1473 ms, sort 239 ms, write 3246 ms, index 562 ms: 10 candidates, 87907 repo-hours, 245 releases; waiting 586 ms; commit 1114 ms)
2026-11-07T13:23:44Z [load_day 2026-03-28] 2026-03-28 hour 13: 167680 events in 4 files, snapshot 7232762617207660786 (task 5091 ms: download 1604 ms overlapping gunzip 307 ms, parse 1027 ms, sort 145 ms, write 2019 ms, index 691 ms: 11 candidates, 93019 repo-hours, 91 releases; waiting 513 ms; commit 1561 ms)
2026-11-07T13:23:45Z [load_day 2026-03-28] 2026-03-28 hour 14: 163250 events in 4 files, snapshot 321929933714450596 (task 5332 ms: download 1611 ms overlapping gunzip 421 ms, parse 1270 ms, sort 145 ms, write 2244 ms, index 576 ms: 15 candidates, 83825 repo-hours, 212 releases; waiting 391 ms; commit 1394 ms)
2026-11-07T13:23:49Z [load_day 2026-03-28] 2026-03-28 hour 15: 164538 events in 4 files, snapshot 975722563258863201 (task 5130 ms: download 1432 ms overlapping gunzip 374 ms, parse 1195 ms, sort 159 ms, write 2295 ms, index 587 ms: 9 candidates, 84191 repo-hours, 208 releases; waiting 198 ms; commit 1394 ms)
2026-11-07T13:23:52Z [load_day 2026-03-28] 2026-03-28 hour 16: 168367 events in 4 files, snapshot 3322499338943397146 (task 5717 ms: download 2253 ms overlapping gunzip 403 ms, parse 1230 ms, sort 176 ms, write 1970 ms, index 655 ms: 10 candidates, 86540 repo-hours, 156 releases; waiting 623 ms; commit 1334 ms)
2026-11-07T13:23:55Z [load_day 2026-03-28] 2026-03-28 hour 17: 165731 events in 4 files, snapshot 8901794392367445868 (task 5369 ms: download 1736 ms overlapping gunzip 365 ms, parse 1162 ms, sort 142 ms, write 2334 ms, index 610 ms: 13 candidates, 82651 repo-hours, 216 releases; waiting 524 ms; commit 1356 ms)
2026-11-07T13:23:59Z [load_day 2026-03-28] 2026-03-28 hour 18: 163328 events in 4 files, snapshot 5583819516385063488 (task 6123 ms: download 2154 ms overlapping gunzip 444 ms, parse 1343 ms, sort 149 ms, write 2474 ms, index 739 ms: 11 candidates, 82793 repo-hours, 335 releases; waiting 600 ms; commit 1282 ms)
2026-11-07T13:24:03Z [load_day 2026-03-28] 2026-03-28 hour 19: 166039 events in 4 files, snapshot 8006338464816320760 (task 7193 ms: download 2593 ms overlapping gunzip 501 ms, parse 1538 ms, sort 153 ms, write 3336 ms, index 632 ms: 12 candidates, 79604 repo-hours, 432 releases; waiting 575 ms; commit 1182 ms)
2026-11-07T13:24:07Z [load_day 2026-03-28] 2026-03-28 hour 20: 160950 events in 4 files, snapshot 5414458997256121063 (task 8062 ms: download 3167 ms overlapping gunzip 546 ms, parse 1674 ms, sort 194 ms, write 4045 ms, index 527 ms: 10 candidates, 76901 repo-hours, 583 releases; waiting 719 ms; commit 1241 ms)
2026-11-07T13:24:12Z [load_day 2026-03-28] 2026-03-28 hour 21: 155878 events in 4 files, snapshot 5948619547622692174 (task 8003 ms: download 2633 ms overlapping gunzip 556 ms, parse 1812 ms, sort 208 ms, write 3987 ms, index 506 ms: 5 candidates, 72397 repo-hours, 650 releases; waiting 562 ms; commit 1388 ms)
2026-11-07T13:24:15Z [load_day 2026-03-28] 2026-03-28 hour 22: 153505 events in 4 files, snapshot 3798613405192245215 (task 7434 ms: download 2728 ms overlapping gunzip 516 ms, parse 1623 ms, sort 173 ms, write 3231 ms, index 706 ms: 11 candidates, 71834 repo-hours, 904 releases; waiting 746 ms; commit 1362 ms)
2026-11-07T13:24:19Z [load_day 2026-03-28] 2026-03-28 hour 23: 153254 events in 4 files, snapshot 8309121499146437228 (task 6157 ms: download 2119 ms overlapping gunzip 460 ms, parse 1511 ms, sort 157 ms, write 2717 ms, index 485 ms: 8 candidates, 69562 repo-hours, 1072 releases; waiting 558 ms; commit 1466 ms)
2026-11-07T13:24:26Z [load_day 2026-03-28] 2026-03-28: repo_hour merged from 24 files to 1 (1832485 rows, 7364 ms)
2026-11-07T13:24:28Z [load_day 2026-03-28] 2026-03-28: index committed in 8914 ms (24 + 1 + 24 files)
2026-11-07T13:24:28Z [load_day 2026-03-28] 2026-03-28: 3903499 events in 24 hours
2026-11-07T13:24:28Z [load_day 2026-03-28] attempt 1 succeeded