orcaLog in

Runs · run 2053

load_day 2024-02-06, attempt 1 succeeded

Host
73ccef5e07c2:83562
Started
2026-11-08T04:30:43Z
Ended
2026-11-08T04:32:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
716 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
192.3 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2053/load_day/2024-02-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:30:43Z [load_day 2024-02-06] attempt 1 started
2026-11-08T04:30:44Z [load_day 2024-02-06] 2024-02-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:30:54Z [load_day 2024-02-06] 2024-02-06 hour 0: 237138 events in 0 files, snapshot none (task 9277 ms: download 5733 ms overlapping gunzip 1545 ms, parse 6323 ms, sort 0 ms, write 0 ms, index 876 ms: 9 candidates, 95461 repo-hours, 1116 releases; waiting 292 ms; commit 0 ms)
2026-11-08T04:30:54Z [load_day 2024-02-06] 2024-02-06 hour 1: 232256 events in 0 files, snapshot none (task 8672 ms: download 5428 ms overlapping gunzip 1284 ms, parse 5788 ms, sort 0 ms, write 0 ms, index 853 ms: 9 candidates, 96788 repo-hours, 844 releases; waiting 491 ms; commit 0 ms)
2026-11-08T04:31:02Z [load_day 2024-02-06] 2024-02-06 hour 2: 206237 events in 0 files, snapshot none (task 8187 ms: download 4715 ms overlapping gunzip 1351 ms, parse 5361 ms, sort 0 ms, write 0 ms, index 904 ms: 10 candidates, 64395 repo-hours, 746 releases; waiting 239 ms; commit 0 ms)
2026-11-08T04:31:03Z [load_day 2024-02-06] 2024-02-06 hour 3: 217623 events in 0 files, snapshot none (task 9250 ms: download 6593 ms overlapping gunzip 1634 ms, parse 6307 ms, sort 0 ms, write 0 ms, index 639 ms: 13 candidates, 69844 repo-hours, 802 releases; waiting 458 ms; commit 0 ms)
2026-11-08T04:31:10Z [load_day 2024-02-06] 2024-02-06 hour 4: 201920 events in 0 files, snapshot none (task 7378 ms: download 3675 ms overlapping gunzip 1117 ms, parse 4734 ms, sort 0 ms, write 0 ms, index 662 ms: 6 candidates, 59649 repo-hours, 701 releases; waiting 601 ms; commit 0 ms)
2026-11-08T04:31:12Z [load_day 2024-02-06] 2024-02-06 hour 5: 207974 events in 0 files, snapshot none (task 7775 ms: download 4867 ms overlapping gunzip 1245 ms, parse 5086 ms, sort 0 ms, write 0 ms, index 587 ms: 4 candidates, 63164 repo-hours, 695 releases; waiting 483 ms; commit 0 ms)
2026-11-08T04:31:18Z [load_day 2024-02-06] 2024-02-06 hour 6: 227181 events in 0 files, snapshot none (task 7789 ms: download 4731 ms overlapping gunzip 1192 ms, parse 5012 ms, sort 0 ms, write 0 ms, index 836 ms: 4 candidates, 76549 repo-hours, 825 releases; waiting 511 ms; commit 0 ms)
2026-11-08T04:31:20Z [load_day 2024-02-06] 2024-02-06 hour 7: 226767 events in 0 files, snapshot none (task 8320 ms: download 5436 ms overlapping gunzip 1252 ms, parse 5493 ms, sort 0 ms, write 0 ms, index 821 ms: 5 candidates, 73833 repo-hours, 790 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:31:29Z [load_day 2024-02-06] 2024-02-06 hour 8: 234676 events in 0 files, snapshot none (task 9844 ms: download 6079 ms overlapping gunzip 1406 ms, parse 6429 ms, sort 0 ms, write 0 ms, index 1140 ms: 9 candidates, 82522 repo-hours, 943 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:31:32Z [load_day 2024-02-06] 2024-02-06 hour 9: 257427 events in 0 files, snapshot none (task 11495 ms: download 7983 ms overlapping gunzip 1690 ms, parse 7494 ms, sort 0 ms, write 0 ms, index 1399 ms: 4 candidates, 89942 repo-hours, 1233 releases; waiting 471 ms; commit 0 ms)
2026-11-08T04:31:39Z [load_day 2024-02-06] 2024-02-06 hour 10: 254228 events in 0 files, snapshot none (task 9325 ms: download 6443 ms overlapping gunzip 1523 ms, parse 6276 ms, sort 0 ms, write 0 ms, index 726 ms: 6 candidates, 90317 repo-hours, 1141 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:31:41Z [load_day 2024-02-06] 2024-02-06 hour 11: 243419 events in 0 files, snapshot none (task 8319 ms: download 5356 ms overlapping gunzip 1267 ms, parse 5577 ms, sort 0 ms, write 0 ms, index 681 ms: 9 candidates, 82765 repo-hours, 1093 releases; waiting 489 ms; commit 0 ms)
2026-11-08T04:31:51Z [load_day 2024-02-06] 2024-02-06 hour 12: 298119 events in 0 files, snapshot none (task 11476 ms: download 7938 ms overlapping gunzip 1621 ms, parse 7563 ms, sort 0 ms, write 0 ms, index 1492 ms: 9 candidates, 115936 repo-hours, 1218 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:31:51Z [load_day 2024-02-06] 2024-02-06 hour 13: 271618 events in 0 files, snapshot none (task 9526 ms: download 6000 ms overlapping gunzip 1437 ms, parse 6268 ms, sort 0 ms, write 0 ms, index 1394 ms: 5 candidates, 110766 repo-hours, 1139 releases; waiting 190 ms; commit 0 ms)
2026-11-08T04:32:01Z [load_day 2024-02-06] 2024-02-06 hour 14: 269830 events in 0 files, snapshot none (task 9856 ms: download 6996 ms overlapping gunzip 1577 ms, parse 6678 ms, sort 0 ms, write 0 ms, index 835 ms: 6 candidates, 100058 repo-hours, 1308 releases; waiting 459 ms; commit 0 ms)
2026-11-08T04:32:01Z [load_day 2024-02-06] 2024-02-06 hour 15: 275813 events in 0 files, snapshot none (task 9339 ms: download 6636 ms overlapping gunzip 1469 ms, parse 6205 ms, sort 0 ms, write 0 ms, index 844 ms: 10 candidates, 102406 repo-hours, 1430 releases; waiting 513 ms; commit 0 ms)
2026-11-08T04:32:10Z [load_day 2024-02-06] 2024-02-06 hour 16: 264065 events in 0 files, snapshot none (task 8397 ms: download 5760 ms overlapping gunzip 1302 ms, parse 5539 ms, sort 0 ms, write 0 ms, index 733 ms: 12 candidates, 98590 repo-hours, 1309 releases; waiting 568 ms; commit 0 ms)
2026-11-08T04:32:10Z [load_day 2024-02-06] 2024-02-06 hour 17: 259340 events in 0 files, snapshot none (task 8118 ms: download 5520 ms overlapping gunzip 1267 ms, parse 5241 ms, sort 0 ms, write 0 ms, index 829 ms: 8 candidates, 93025 repo-hours, 1090 releases; waiting 545 ms; commit 0 ms)
2026-11-08T04:32:21Z [load_day 2024-02-06] 2024-02-06 hour 18: 262586 events in 0 files, snapshot none (task 10621 ms: download 7525 ms overlapping gunzip 1650 ms, parse 7369 ms, sort 0 ms, write 0 ms, index 852 ms: 4 candidates, 96675 repo-hours, 1115 releases; waiting 535 ms; commit 0 ms)
2026-11-08T04:32:21Z [load_day 2024-02-06] 2024-02-06 hour 19: 248763 events in 0 files, snapshot none (task 10638 ms: download 7783 ms overlapping gunzip 1781 ms, parse 7240 ms, sort 0 ms, write 0 ms, index 830 ms: 8 candidates, 84380 repo-hours, 1009 releases; waiting 521 ms; commit 0 ms)
2026-11-08T04:32:31Z [load_day 2024-02-06] 2024-02-06 hour 20: 238992 events in 0 files, snapshot none (task 9697 ms: download 7013 ms overlapping gunzip 1537 ms, parse 6788 ms, sort 0 ms, write 0 ms, index 605 ms: 8 candidates, 81698 repo-hours, 956 releases; waiting 214 ms; commit 0 ms)
2026-11-08T04:32:31Z [load_day 2024-02-06] 2024-02-06 hour 21: 225880 events in 0 files, snapshot none (task 9153 ms: download 6574 ms overlapping gunzip 1438 ms, parse 6366 ms, sort 0 ms, write 0 ms, index 593 ms: 7 candidates, 75388 repo-hours, 983 releases; waiting 493 ms; commit 0 ms)
2026-11-08T04:32:40Z [load_day 2024-02-06] 2024-02-06 hour 22: 212855 events in 0 files, snapshot none (task 8899 ms: download 5871 ms overlapping gunzip 1372 ms, parse 5725 ms, sort 0 ms, write 0 ms, index 970 ms: 9 candidates, 68874 repo-hours, 939 releases; waiting 551 ms; commit 0 ms)
2026-11-08T04:32:40Z [load_day 2024-02-06] 2024-02-06 hour 23: 199678 events in 0 files, snapshot none (task 8112 ms: download 5057 ms overlapping gunzip 1150 ms, parse 5265 ms, sort 0 ms, write 0 ms, index 954 ms: 5 candidates, 61783 repo-hours, 855 releases; waiting 463 ms; commit 0 ms)
2026-11-08T04:32:49Z [load_day 2024-02-06] 2024-02-06: repo_hour merged from 24 files to 1 (2034808 rows, 8925 ms)
2026-11-08T04:32:51Z [load_day 2024-02-06] 2024-02-06: index committed in 11148 ms (24 + 1 + 24 files)
2026-11-08T04:32:51Z [load_day 2024-02-06] 2024-02-06: 5774385 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:32:51Z [load_day 2024-02-06] attempt 1 succeeded