orcaLog in

Runs · run 1891

load_day 2023-12-24, attempt 1 succeeded

Host
73ccef5e07c2:12370
Started
2026-11-08T03:53:14Z
Ended
2026-11-08T03:54:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
555 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
81.3 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1891/load_day/2023-12-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:53:14Z [load_day 2023-12-24] attempt 1 started
2026-11-08T03:53:15Z [load_day 2023-12-24] 2023-12-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:53:19Z [load_day 2023-12-24] 2023-12-24 hour 0: 129200 events in 0 files, snapshot none (task 3612 ms: download 1930 ms overlapping gunzip 450 ms, parse 1933 ms, sort 0 ms, write 0 ms, index 517 ms: 5 candidates, 64352 repo-hours, 859 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:53:19Z [load_day 2023-12-24] 2023-12-24 hour 1: 129352 events in 0 files, snapshot none (task 3882 ms: download 2050 ms overlapping gunzip 426 ms, parse 2038 ms, sort 0 ms, write 0 ms, index 620 ms: 4 candidates, 69670 repo-hours, 715 releases; waiting 472 ms; commit 0 ms)
2026-11-08T03:53:22Z [load_day 2023-12-24] 2023-12-24 hour 2: 96091 events in 0 files, snapshot none (task 3007 ms: download 1544 ms overlapping gunzip 382 ms, parse 1634 ms, sort 0 ms, write 0 ms, index 257 ms: 3 candidates, 34411 repo-hours, 508 releases; waiting 448 ms; commit 0 ms)
2026-11-08T03:53:23Z [load_day 2023-12-24] 2023-12-24 hour 3: 102109 events in 0 files, snapshot none (task 3296 ms: download 1645 ms overlapping gunzip 409 ms, parse 1832 ms, sort 0 ms, write 0 ms, index 326 ms: 3 candidates, 35463 repo-hours, 632 releases; waiting 495 ms; commit 0 ms)
2026-11-08T03:53:27Z [load_day 2023-12-24] 2023-12-24 hour 4: 102628 events in 0 files, snapshot none (task 3670 ms: download 1622 ms overlapping gunzip 490 ms, parse 2224 ms, sort 0 ms, write 0 ms, index 270 ms: 2 candidates, 36440 repo-hours, 442 releases; waiting 493 ms; commit 0 ms)
2026-11-08T03:53:27Z [load_day 2023-12-24] 2023-12-24 hour 5: 108174 events in 0 files, snapshot none (task 3463 ms: download 1742 ms overlapping gunzip 468 ms, parse 1997 ms, sort 0 ms, write 0 ms, index 346 ms: 4 candidates, 39307 repo-hours, 468 releases; waiting 455 ms; commit 0 ms)
2026-11-08T03:53:31Z [load_day 2023-12-24] 2023-12-24 hour 6: 123512 events in 0 files, snapshot none (task 3912 ms: download 2532 ms overlapping gunzip 502 ms, parse 2222 ms, sort 0 ms, write 0 ms, index 361 ms: 3 candidates, 48416 repo-hours, 524 releases; waiting 522 ms; commit 0 ms)
2026-11-08T03:53:31Z [load_day 2023-12-24] 2023-12-24 hour 7: 119784 events in 0 files, snapshot none (task 3654 ms: download 2166 ms overlapping gunzip 468 ms, parse 2114 ms, sort 0 ms, write 0 ms, index 316 ms: 1 candidates, 42595 repo-hours, 645 releases; waiting 511 ms; commit 0 ms)
2026-11-08T03:53:35Z [load_day 2023-12-24] 2023-12-24 hour 8: 123490 events in 0 files, snapshot none (task 3322 ms: download 1536 ms overlapping gunzip 423 ms, parse 1844 ms, sort 0 ms, write 0 ms, index 360 ms: 5 candidates, 44739 repo-hours, 556 releases; waiting 485 ms; commit 0 ms)
2026-11-08T03:53:35Z [load_day 2023-12-24] 2023-12-24 hour 9: 127075 events in 0 files, snapshot none (task 3627 ms: download 1824 ms overlapping gunzip 456 ms, parse 2051 ms, sort 0 ms, write 0 ms, index 326 ms: 4 candidates, 45471 repo-hours, 778 releases; waiting 535 ms; commit 0 ms)
2026-11-08T03:53:39Z [load_day 2023-12-24] 2023-12-24 hour 10: 130202 events in 0 files, snapshot none (task 3622 ms: download 2298 ms overlapping gunzip 454 ms, parse 1978 ms, sort 0 ms, write 0 ms, index 351 ms: 2 candidates, 48719 repo-hours, 577 releases; waiting 527 ms; commit 0 ms)
2026-11-08T03:53:39Z [load_day 2023-12-24] 2023-12-24 hour 11: 129110 events in 0 files, snapshot none (task 3336 ms: download 1781 ms overlapping gunzip 402 ms, parse 1787 ms, sort 0 ms, write 0 ms, index 318 ms: 12 candidates, 47012 repo-hours, 613 releases; waiting 547 ms; commit 0 ms)
2026-11-08T03:53:43Z [load_day 2023-12-24] 2023-12-24 hour 12: 204128 events in 0 files, snapshot none (task 4232 ms: download 1743 ms overlapping gunzip 494 ms, parse 2421 ms, sort 0 ms, write 0 ms, index 592 ms: 5 candidates, 80888 repo-hours, 664 releases; waiting 496 ms; commit 0 ms)
2026-11-08T03:53:43Z [load_day 2023-12-24] 2023-12-24 hour 13: 160351 events in 0 files, snapshot none (task 3927 ms: download 1788 ms overlapping gunzip 491 ms, parse 2151 ms, sort 0 ms, write 0 ms, index 507 ms: 8 candidates, 71996 repo-hours, 1386 releases; waiting 476 ms; commit 0 ms)
2026-11-08T03:53:50Z [load_day 2023-12-24] 2023-12-24 hour 14: 143344 events in 0 files, snapshot none (task 5810 ms: download 2004 ms overlapping gunzip 527 ms, parse 2275 ms, sort 0 ms, write 0 ms, index 2201 ms: 6 candidates, 55370 repo-hours, 703 releases; waiting 513 ms; commit 0 ms)
2026-11-08T03:53:50Z [load_day 2023-12-24] 2023-12-24 hour 15: 146852 events in 0 files, snapshot none (task 4333 ms: download 2435 ms overlapping gunzip 558 ms, parse 2386 ms, sort 0 ms, write 0 ms, index 558 ms: 3 candidates, 57321 repo-hours, 783 releases; waiting 505 ms; commit 0 ms)
2026-11-08T03:53:55Z [load_day 2023-12-24] 2023-12-24 hour 16: 140652 events in 0 files, snapshot none (task 4798 ms: download 2794 ms overlapping gunzip 658 ms, parse 2893 ms, sort 0 ms, write 0 ms, index 430 ms: 3 candidates, 53439 repo-hours, 1302 releases; waiting 521 ms; commit 0 ms)
2026-11-08T03:53:55Z [load_day 2023-12-24] 2023-12-24 hour 17: 135294 events in 0 files, snapshot none (task 4357 ms: download 2804 ms overlapping gunzip 592 ms, parse 2533 ms, sort 0 ms, write 0 ms, index 429 ms: 4 candidates, 48607 repo-hours, 614 releases; waiting 500 ms; commit 0 ms)
2026-11-08T03:54:00Z [load_day 2023-12-24] 2023-12-24 hour 18: 136309 events in 0 files, snapshot none (task 4340 ms: download 2332 ms overlapping gunzip 554 ms, parse 2625 ms, sort 0 ms, write 0 ms, index 436 ms: 3 candidates, 53909 repo-hours, 671 releases; waiting 495 ms; commit 0 ms)
2026-11-08T03:54:00Z [load_day 2023-12-24] 2023-12-24 hour 19: 118394 events in 0 files, snapshot none (task 4027 ms: download 2225 ms overlapping gunzip 529 ms, parse 2384 ms, sort 0 ms, write 0 ms, index 354 ms: 7 candidates, 40725 repo-hours, 507 releases; waiting 508 ms; commit 0 ms)
2026-11-08T03:54:04Z [load_day 2023-12-24] 2023-12-24 hour 20: 116059 events in 0 files, snapshot none (task 3898 ms: download 1737 ms overlapping gunzip 465 ms, parse 2128 ms, sort 0 ms, write 0 ms, index 537 ms: 3 candidates, 40790 repo-hours, 550 releases; waiting 512 ms; commit 0 ms)
2026-11-08T03:54:04Z [load_day 2023-12-24] 2023-12-24 hour 21: 105389 events in 0 files, snapshot none (task 3946 ms: download 2150 ms overlapping gunzip 491 ms, parse 2269 ms, sort 0 ms, write 0 ms, index 340 ms: 7 candidates, 35813 repo-hours, 609 releases; waiting 539 ms; commit 0 ms)
2026-11-08T03:54:08Z [load_day 2023-12-24] 2023-12-24 hour 22: 102555 events in 0 files, snapshot none (task 3328 ms: download 1641 ms overlapping gunzip 430 ms, parse 1831 ms, sort 0 ms, write 0 ms, index 314 ms: 3 candidates, 33315 repo-hours, 562 releases; waiting 502 ms; commit 0 ms)
2026-11-08T03:54:08Z [load_day 2023-12-24] 2023-12-24 hour 23: 93192 events in 0 files, snapshot none (task 3144 ms: download 1747 ms overlapping gunzip 400 ms, parse 1735 ms, sort 0 ms, write 0 ms, index 254 ms: 2 candidates, 32620 repo-hours, 494 releases; waiting 497 ms; commit 0 ms)
2026-11-08T03:54:14Z [load_day 2023-12-24] 2023-12-24: repo_hour merged from 24 files to 1 (1161388 rows, 5649 ms)
2026-11-08T03:54:16Z [load_day 2023-12-24] 2023-12-24: index committed in 7986 ms (24 + 1 + 24 files)
2026-11-08T03:54:16Z [load_day 2023-12-24] 2023-12-24: 3023246 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:54:16Z [load_day 2023-12-24] attempt 1 succeeded