orcaLog in

Runs · run 3234

load_day 2024-11-23, attempt 1 succeeded

Host
73ccef5e07c2:211394
Started
2026-11-08T08:59:30Z
Ended
2026-11-08T09:01:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
664 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
172.8 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3234/load_day/2024-11-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:59:30Z [load_day 2024-11-23] attempt 1 started
2026-11-08T08:59:38Z [load_day 2024-11-23] 2024-11-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:59:47Z [load_day 2024-11-23] 2024-11-23 hour 0: 178190 events in 0 files, snapshot none (task 8200 ms: download 4794 ms overlapping gunzip 1283 ms, parse 5313 ms, sort 0 ms, write 0 ms, index 772 ms: 14 candidates, 86179 repo-hours, 1249 releases; waiting 563 ms; commit 0 ms)
2026-11-08T08:59:47Z [load_day 2024-11-23] 2024-11-23 hour 1: 184808 events in 0 files, snapshot none (task 7587 ms: download 4205 ms overlapping gunzip 1081 ms, parse 4879 ms, sort 0 ms, write 0 ms, index 847 ms: 5 candidates, 101274 repo-hours, 793 releases; waiting 479 ms; commit 0 ms)
2026-11-08T08:59:53Z [load_day 2024-11-23] 2024-11-23 hour 2: 152267 events in 0 files, snapshot none (task 6090 ms: download 2805 ms overlapping gunzip 896 ms, parse 3573 ms, sort 0 ms, write 0 ms, index 863 ms: 5 candidates, 66013 repo-hours, 752 releases; waiting 461 ms; commit 0 ms)
2026-11-08T08:59:56Z [load_day 2024-11-23] 2024-11-23 hour 3: 192674 events in 0 files, snapshot none (task 8554 ms: download 5744 ms overlapping gunzip 1378 ms, parse 5485 ms, sort 0 ms, write 0 ms, index 976 ms: 7 candidates, 63787 repo-hours, 3512 releases; waiting 419 ms; commit 0 ms)
2026-11-08T09:00:01Z [load_day 2024-11-23] 2024-11-23 hour 4: 169462 events in 0 files, snapshot none (task 7701 ms: download 4942 ms overlapping gunzip 1255 ms, parse 5029 ms, sort 0 ms, write 0 ms, index 537 ms: 5 candidates, 55829 repo-hours, 532 releases; waiting 560 ms; commit 0 ms)
2026-11-08T09:00:03Z [load_day 2024-11-23] 2024-11-23 hour 5: 176101 events in 0 files, snapshot none (task 7007 ms: download 4777 ms overlapping gunzip 1144 ms, parse 4593 ms, sort 0 ms, write 0 ms, index 453 ms: 4 candidates, 57392 repo-hours, 739 releases; waiting 546 ms; commit 0 ms)
2026-11-08T09:00:12Z [load_day 2024-11-23] 2024-11-23 hour 6: 194870 events in 0 files, snapshot none (task 9926 ms: download 7247 ms overlapping gunzip 1367 ms, parse 5410 ms, sort 0 ms, write 0 ms, index 723 ms: 7 candidates, 76421 repo-hours, 954 releases; waiting 2127 ms; commit 0 ms)
2026-11-08T09:00:12Z [load_day 2024-11-23] 2024-11-23 hour 7: 180086 events in 0 files, snapshot none (task 8275 ms: download 5551 ms overlapping gunzip 1295 ms, parse 5550 ms, sort 0 ms, write 0 ms, index 658 ms: 3 candidates, 59694 repo-hours, 823 releases; waiting 455 ms; commit 0 ms)
2026-11-08T09:00:20Z [load_day 2024-11-23] 2024-11-23 hour 8: 184156 events in 0 files, snapshot none (task 7538 ms: download 4805 ms overlapping gunzip 1319 ms, parse 5088 ms, sort 0 ms, write 0 ms, index 625 ms: 2 candidates, 63343 repo-hours, 781 releases; waiting 230 ms; commit 0 ms)
2026-11-08T09:00:20Z [load_day 2024-11-23] 2024-11-23 hour 9: 194034 events in 0 files, snapshot none (task 7880 ms: download 5117 ms overlapping gunzip 1295 ms, parse 5156 ms, sort 0 ms, write 0 ms, index 657 ms: 9 candidates, 68884 repo-hours, 939 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:00:28Z [load_day 2024-11-23] 2024-11-23 hour 10: 186776 events in 0 files, snapshot none (task 7069 ms: download 4925 ms overlapping gunzip 1122 ms, parse 4859 ms, sort 0 ms, write 0 ms, index 443 ms: 2 candidates, 64302 repo-hours, 715 releases; waiting 393 ms; commit 0 ms)
2026-11-08T09:00:28Z [load_day 2024-11-23] 2024-11-23 hour 11: 192243 events in 0 files, snapshot none (task 7227 ms: download 5082 ms overlapping gunzip 1258 ms, parse 4782 ms, sort 0 ms, write 0 ms, index 415 ms: 4 candidates, 62563 repo-hours, 619 releases; waiting 468 ms; commit 0 ms)
2026-11-08T09:00:37Z [load_day 2024-11-23] 2024-11-23 hour 12: 228806 events in 0 files, snapshot none (task 8606 ms: download 4697 ms overlapping gunzip 1189 ms, parse 5490 ms, sort 0 ms, write 0 ms, index 1104 ms: 2 candidates, 112777 repo-hours, 892 releases; waiting 490 ms; commit 0 ms)
2026-11-08T09:00:38Z [load_day 2024-11-23] 2024-11-23 hour 13: 223347 events in 0 files, snapshot none (task 9892 ms: download 6884 ms overlapping gunzip 1587 ms, parse 6558 ms, sort 0 ms, write 0 ms, index 967 ms: 6 candidates, 90307 repo-hours, 728 releases; waiting 463 ms; commit 0 ms)
2026-11-08T09:00:47Z [load_day 2024-11-23] 2024-11-23 hour 14: 207771 events in 0 files, snapshot none (task 9396 ms: download 6379 ms overlapping gunzip 1642 ms, parse 6213 ms, sort 0 ms, write 0 ms, index 619 ms: 6 candidates, 73688 repo-hours, 760 releases; waiting 532 ms; commit 0 ms)
2026-11-08T09:00:48Z [load_day 2024-11-23] 2024-11-23 hour 15: 217877 events in 0 files, snapshot none (task 9338 ms: download 6830 ms overlapping gunzip 1561 ms, parse 6313 ms, sort 0 ms, write 0 ms, index 624 ms: 7 candidates, 81712 repo-hours, 1071 releases; waiting 471 ms; commit 0 ms)
2026-11-08T09:00:54Z [load_day 2024-11-23] 2024-11-23 hour 16: 210169 events in 0 files, snapshot none (task 6566 ms: download 4374 ms overlapping gunzip 1074 ms, parse 4191 ms, sort 0 ms, write 0 ms, index 527 ms: 0 candidates, 75671 repo-hours, 859 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:00:55Z [load_day 2024-11-23] 2024-11-23 hour 17: 205077 events in 0 files, snapshot none (task 6537 ms: download 4228 ms overlapping gunzip 1053 ms, parse 4086 ms, sort 0 ms, write 0 ms, index 547 ms: 8 candidates, 69558 repo-hours, 801 releases; waiting 545 ms; commit 0 ms)
2026-11-08T09:01:01Z [load_day 2024-11-23] 2024-11-23 hour 18: 218422 events in 0 files, snapshot none (task 6689 ms: download 4311 ms overlapping gunzip 1063 ms, parse 4200 ms, sort 0 ms, write 0 ms, index 586 ms: 10 candidates, 85055 repo-hours, 992 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:01:02Z [load_day 2024-11-23] 2024-11-23 hour 19: 202000 events in 0 files, snapshot none (task 6394 ms: download 4192 ms overlapping gunzip 1052 ms, parse 4064 ms, sort 0 ms, write 0 ms, index 446 ms: 5 candidates, 63861 repo-hours, 762 releases; waiting 528 ms; commit 0 ms)
2026-11-08T09:01:10Z [load_day 2024-11-23] 2024-11-23 hour 20: 192936 events in 0 files, snapshot none (task 7693 ms: download 4879 ms overlapping gunzip 1293 ms, parse 4948 ms, sort 0 ms, write 0 ms, index 547 ms: 7 candidates, 63994 repo-hours, 678 releases; waiting 589 ms; commit 0 ms)
2026-11-08T09:01:10Z [load_day 2024-11-23] 2024-11-23 hour 21: 189716 events in 0 files, snapshot none (task 7504 ms: download 5077 ms overlapping gunzip 1266 ms, parse 4908 ms, sort 0 ms, write 0 ms, index 478 ms: 5 candidates, 64549 repo-hours, 863 releases; waiting 540 ms; commit 0 ms)
2026-11-08T09:01:20Z [load_day 2024-11-23] 2024-11-23 hour 22: 175548 events in 0 files, snapshot none (task 9820 ms: download 7605 ms overlapping gunzip 1275 ms, parse 5210 ms, sort 0 ms, write 0 ms, index 394 ms: 7 candidates, 55003 repo-hours, 851 releases; waiting 2579 ms; commit 0 ms)
2026-11-08T09:01:20Z [load_day 2024-11-23] 2024-11-23 hour 23: 167637 events in 0 files, snapshot none (task 7223 ms: download 4561 ms overlapping gunzip 1203 ms, parse 4696 ms, sort 0 ms, write 0 ms, index 471 ms: 3 candidates, 53483 repo-hours, 580 releases; waiting 542 ms; commit 0 ms)
2026-11-08T09:01:27Z [load_day 2024-11-23] 2024-11-23: repo_hour merged from 24 files to 1 (1715339 rows, 7395 ms)
2026-11-08T09:01:30Z [load_day 2024-11-23] 2024-11-23: index committed in 10549 ms (23 + 1 + 24 files)
2026-11-08T09:01:30Z [load_day 2024-11-23] 2024-11-23: 4624973 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:01:30Z [load_day 2024-11-23] attempt 1 succeeded