orcaLog in

Runs · run 10

load_day 2023-01-04, attempt 1 succeeded

Host
4e84322b8c45:4513
Started
2026-11-07T02:56:03Z
Ended
2026-11-07T02:59:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/10/load_day/2023-01-04/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T02:56:03Z [load_day 2023-01-04] attempt 1 started
2026-11-07T02:56:20Z [load_day 2023-01-04] 2023-01-04 hour 0: 172298 events in 4 files, snapshot 3894428321258408280 (task 14465 ms: download 4281 ms overlapping gunzip 1099 ms, parse 5132 ms, sort 476 ms, write 6417 ms, index 492 ms: 7 candidates, 82886 repo-hours, 818 releases; waiting 433 ms; commit 565 ms)
2026-11-07T02:56:20Z [load_day 2023-01-04] 2023-01-04 hour 1: 159307 events in 4 files, snapshot 1729557815157709448 (task 12291 ms: download 4060 ms overlapping gunzip 946 ms, parse 4361 ms, sort 370 ms, write 5296 ms, index 478 ms: 6 candidates, 80205 repo-hours, 698 releases; waiting 458 ms; commit 575 ms)
2026-11-07T02:56:30Z [load_day 2023-01-04] 2023-01-04 hour 2: 131690 events in 3 files, snapshot 5114115246355761431 (task 9611 ms: download 3017 ms overlapping gunzip 758 ms, parse 3294 ms, sort 178 ms, write 4144 ms, index 385 ms: 4 candidates, 61864 repo-hours, 631 releases; waiting 533 ms; commit 487 ms)
2026-11-07T02:56:33Z [load_day 2023-01-04] 2023-01-04 hour 3: 155160 events in 4 files, snapshot 4370396822083051462 (task 12274 ms: download 3181 ms overlapping gunzip 994 ms, parse 4496 ms, sort 584 ms, write 5210 ms, index 378 ms: 9 candidates, 65328 repo-hours, 744 releases; waiting 334 ms; commit 468 ms)
2026-11-07T02:56:46Z [load_day 2023-01-04] 2023-01-04 hour 4: 164334 events in 4 files, snapshot 8691842255403090340 (task 15809 ms: download 4998 ms overlapping gunzip 1236 ms, parse 5732 ms, sort 466 ms, write 6148 ms, index 432 ms: 9 candidates, 68123 repo-hours, 586 releases; waiting 1050 ms; commit 494 ms)
2026-11-07T02:56:47Z [load_day 2023-01-04] 2023-01-04 hour 5: 163576 events in 4 files, snapshot 7231255337792629629 (task 13408 ms: download 3895 ms overlapping gunzip 1147 ms, parse 5311 ms, sort 351 ms, write 5413 ms, index 395 ms: 5 candidates, 69119 repo-hours, 668 releases; waiting 490 ms; commit 453 ms)
2026-11-07T02:57:02Z [load_day 2023-01-04] 2023-01-04 hour 6: 180970 events in 4 files, snapshot 5450251839862495594 (task 15300 ms: download 3848 ms overlapping gunzip 1184 ms, parse 5496 ms, sort 483 ms, write 6816 ms, index 534 ms: 7 candidates, 79439 repo-hours, 710 releases; waiting 495 ms; commit 625 ms)
2026-11-07T02:57:04Z [load_day 2023-01-04] 2023-01-04 hour 7: 182470 events in 4 files, snapshot 8390175728017983119 (task 16807 ms: download 7507 ms overlapping gunzip 1327 ms, parse 5985 ms, sort 390 ms, write 6548 ms, index 453 ms: 4 candidates, 78077 repo-hours, 682 releases; waiting 1804 ms; commit 438 ms)
2026-11-07T02:57:18Z [load_day 2023-01-04] 2023-01-04 hour 8: 190725 events in 4 files, snapshot 7741917075797081350 (task 15115 ms: download 3685 ms overlapping gunzip 1311 ms, parse 5710 ms, sort 558 ms, write 6552 ms, index 471 ms: 5 candidates, 83191 repo-hours, 890 releases; waiting 189 ms; commit 428 ms)
2026-11-07T02:57:21Z [load_day 2023-01-04] 2023-01-04 hour 9: 198513 events in 4 files, snapshot 9125638306270018188 (task 16170 ms: download 4371 ms overlapping gunzip 1335 ms, parse 5830 ms, sort 291 ms, write 7297 ms, index 493 ms: 5 candidates, 86345 repo-hours, 1043 releases; waiting 618 ms; commit 508 ms)
2026-11-07T02:57:35Z [load_day 2023-01-04] 2023-01-04 hour 10: 197284 events in 4 files, snapshot 8038424499998648 (task 16789 ms: download 5459 ms overlapping gunzip 1320 ms, parse 5935 ms, sort 513 ms, write 7693 ms, index 494 ms: 9 candidates, 85446 repo-hours, 926 releases; waiting 205 ms; commit 491 ms)
2026-11-07T02:57:39Z [load_day 2023-01-04] 2023-01-04 hour 11: 197896 events in 4 files, snapshot 7428425110678779614 (task 17066 ms: download 4457 ms overlapping gunzip 1296 ms, parse 5701 ms, sort 593 ms, write 8183 ms, index 492 ms: 7 candidates, 83971 repo-hours, 1021 releases; waiting 505 ms; commit 548 ms)
2026-11-07T02:57:52Z [load_day 2023-01-04] 2023-01-04 hour 12: 224476 events in 5 files, snapshot 6391420676818179144 (task 16651 ms: download 5049 ms overlapping gunzip 1386 ms, parse 5973 ms, sort 422 ms, write 7413 ms, index 593 ms: 6 candidates, 107747 repo-hours, 1078 releases; waiting 585 ms; commit 430 ms)
2026-11-07T02:57:56Z [load_day 2023-01-04] 2023-01-04 hour 13: 219783 events in 5 files, snapshot 153373416961818710 (task 16646 ms: download 6860 ms overlapping gunzip 1380 ms, parse 5973 ms, sort 358 ms, write 6797 ms, index 729 ms: 3 candidates, 105155 repo-hours, 1058 releases; waiting 1070 ms; commit 493 ms)
2026-11-07T02:58:11Z [load_day 2023-01-04] 2023-01-04 hour 14: 212400 events in 5 files, snapshot 564123487048898819 (task 18049 ms: download 4763 ms overlapping gunzip 1361 ms, parse 6093 ms, sort 520 ms, write 8655 ms, index 530 ms: 5 candidates, 94391 repo-hours, 1111 releases; waiting 557 ms; commit 417 ms)
2026-11-07T02:58:14Z [load_day 2023-01-04] 2023-01-04 hour 15: 208205 events in 5 files, snapshot 2147015177346686143 (task 17585 ms: download 4617 ms overlapping gunzip 1321 ms, parse 5857 ms, sort 401 ms, write 8551 ms, index 629 ms: 4 candidates, 93169 repo-hours, 1305 releases; waiting 504 ms; commit 456 ms)
2026-11-07T02:58:27Z [load_day 2023-01-04] 2023-01-04 hour 16: 194384 events in 4 files, snapshot 1438851163009062587 (task 15412 ms: download 4443 ms overlapping gunzip 1266 ms, parse 5552 ms, sort 583 ms, write 6585 ms, index 499 ms: 6 candidates, 87336 repo-hours, 998 releases; waiting 564 ms; commit 477 ms)
2026-11-07T02:58:28Z [load_day 2023-01-04] 2023-01-04 hour 17: 187452 events in 4 files, snapshot 7835856981461137833 (task 13795 ms: download 4260 ms overlapping gunzip 1139 ms, parse 4833 ms, sort 305 ms, write 6217 ms, index 495 ms: 4 candidates, 79134 repo-hours, 885 releases; waiting 508 ms; commit 383 ms)
2026-11-07T02:58:42Z [load_day 2023-01-04] 2023-01-04 hour 18: 189066 events in 4 files, snapshot 5755013769718759805 (task 14975 ms: download 4676 ms overlapping gunzip 1171 ms, parse 5002 ms, sort 418 ms, write 6717 ms, index 486 ms: 1 candidates, 80556 repo-hours, 1003 releases; waiting 746 ms; commit 445 ms)
2026-11-07T02:58:43Z [load_day 2023-01-04] 2023-01-04 hour 19: 179628 events in 4 files, snapshot 7328906194472526696 (task 13106 ms: download 3748 ms overlapping gunzip 1061 ms, parse 4704 ms, sort 322 ms, write 5750 ms, index 439 ms: 0 candidates, 70887 repo-hours, 923 releases; waiting 511 ms; commit 614 ms)
2026-11-07T02:58:56Z [load_day 2023-01-04] 2023-01-04 hour 20: 177594 events in 4 files, snapshot 4693955267464258555 (task 13166 ms: download 5444 ms overlapping gunzip 1019 ms, parse 4433 ms, sort 400 ms, write 6083 ms, index 409 ms: 3 candidates, 69463 repo-hours, 879 releases; waiting 527 ms; commit 484 ms)
2026-11-07T02:58:58Z [load_day 2023-01-04] 2023-01-04 hour 21: 181471 events in 4 files, snapshot 5444855420880178657 (task 14689 ms: download 3762 ms overlapping gunzip 1245 ms, parse 5262 ms, sort 566 ms, write 6432 ms, index 410 ms: 5 candidates, 70821 repo-hours, 960 releases; waiting 493 ms; commit 432 ms)
2026-11-07T02:59:14Z [load_day 2023-01-04] 2023-01-04 hour 22: 180975 events in 4 files, snapshot 746073170197484354 (task 16716 ms: download 5064 ms overlapping gunzip 1400 ms, parse 6273 ms, sort 552 ms, write 7109 ms, index 432 ms: 4 candidates, 72811 repo-hours, 875 releases; waiting 526 ms; commit 589 ms)
2026-11-07T02:59:15Z [load_day 2023-01-04] 2023-01-04 hour 23: 174136 events in 4 files, snapshot 8640704340195277253 (task 15875 ms: download 3972 ms overlapping gunzip 1375 ms, parse 6052 ms, sort 534 ms, write 6622 ms, index 433 ms: 6 candidates, 70621 repo-hours, 802 releases; waiting 535 ms; commit 444 ms)
2026-11-07T02:59:23Z [load_day 2023-01-04] 2023-01-04: repo_hour merged from 24 files to 1 (1926085 rows, 7902 ms)
2026-11-07T02:59:24Z [load_day 2023-01-04] 2023-01-04: index committed in 9527 ms (23 + 1 + 24 files)
2026-11-07T02:59:24Z [load_day 2023-01-04] 2023-01-04: 4423793 events in 24 hours
2026-11-07T02:59:24Z [load_day 2023-01-04] attempt 1 succeeded