[00:16:42.037] New invocation is queued and will start shortly
[00:16:43.121] Starting the invocation (attempt 1)
[00:16:43.146] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/101c0cd0df21795db4afe1ac4cb63366435780ef"
[00:16:43.146] Popped gitiles commit info from properties and tags
[00:16:43.146] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[00:16:43.152] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[00:16:43.153] Buildbucket request:
{
"requestId": "8850383275478978944",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "101c0cd0df21795db4afe1ac4cb63366435780ef",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850383275478978944"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[00:16:43.987] Scheduled build:
{
"id": "8684953213595353313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"number": 100457,
"createdBy": "project:chromium",
"createTime": "2026-04-10T00:16:43.212192272Z",
"updateTime": "2026-04-10T00:16:43.212192272Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "101c0cd0df21795db4afe1ac4cb63366435780ef",
"ref": "refs/heads/main"
}
}
}
[00:16:43.987] Task URL: https://cr-buildbucket-dev.appspot.com/build/8684953213595353313
[00:16:43.987] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:2:0) after 4m3s
[00:16:44.490] Received PubSub notification, asking Buildbucket for the build status
[00:16:44.512] Build status: SCHEDULED
[00:20:47.001] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:2:0)
[00:20:47.050] Build status: SCHEDULED
[00:20:47.050] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:4:0) after 5m19s
[00:26:06.078] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:4:0)
[00:26:06.114] Build status: SCHEDULED
[00:26:06.115] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:5:0) after 1m21s
[00:27:27.128] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:5:0)
[00:27:27.161] Build status: SCHEDULED
[00:27:27.161] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:6:0) after 9m49s
[00:37:16.183] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:6:0)
[00:37:16.206] Build status: SCHEDULED
[00:37:16.206] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:7:0) after 4m41s
[00:41:57.218] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:7:0)
[00:41:57.239] Build status: SCHEDULED
[00:41:57.239] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:8:0) after 3m58s
[00:45:55.254] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:8:0)
[00:45:55.297] Build status: SCHEDULED
[00:45:55.297] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:9:0) after 6m28s
[00:52:23.310] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:9:0)
[00:52:23.383] Build status: SCHEDULED
[00:52:23.383] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:10:0) after 1m6s
[00:53:29.400] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:10:0)
[00:53:29.463] Build status: SCHEDULED
[00:53:29.463] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:11:0) after 4m38s
[00:58:07.480] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:11:0)
[00:58:07.526] Build status: SCHEDULED
[00:58:07.526] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:12:0) after 7m23s
[01:05:30.548] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:12:0)
[01:05:30.643] Build status: SCHEDULED
[01:05:30.643] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:13:0) after 1m30s
[01:07:00.662] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:13:0)
[01:07:00.724] Build status: SCHEDULED
[01:07:00.724] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:14:0) after 3m25s
[01:10:25.742] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:14:0)
[01:10:25.867] Build status: SCHEDULED
[01:10:25.867] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:15:0) after 2m42s
[01:13:07.885] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:15:0)
[01:13:07.940] Build status: SCHEDULED
[01:13:07.940] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:16:0) after 2m52s
[01:15:59.962] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:16:0)
[01:16:00.008] Build status: SCHEDULED
[01:16:00.008] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:17:0) after 8m42s
[01:24:42.023] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:17:0)
[01:24:42.090] Build status: SCHEDULED
[01:24:42.090] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:18:0) after 5m2s
[01:29:44.106] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:18:0)
[01:29:44.186] Build status: SCHEDULED
[01:29:44.186] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:19:0) after 2m39s
[01:32:23.204] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:19:0)
[01:32:23.254] Build status: SCHEDULED
[01:32:23.254] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:20:0) after 4m34s
[01:36:57.270] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:20:0)
[01:36:57.328] Build status: SCHEDULED
[01:36:57.328] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:21:0) after 7m43s
[01:44:40.341] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:21:0)
[01:44:40.408] Build status: SCHEDULED
[01:44:40.408] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:22:0) after 7m28s
[01:52:08.422] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:22:0)
[01:52:08.470] Build status: SCHEDULED
[01:52:08.470] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:23:0) after 5m22s
[01:57:30.484] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:23:0)
[01:57:30.502] Build status: SCHEDULED
[01:57:30.502] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:24:0) after 2m56s
[02:00:26.527] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:24:0)
[02:00:26.610] Build status: SCHEDULED
[02:00:26.610] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:25:0) after 2m7s
[02:02:33.626] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:25:0)
[02:02:33.663] Build status: SCHEDULED
[02:02:33.663] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:26:0) after 5m17s
[02:07:50.678] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:26:0)
[02:07:50.745] Build status: SCHEDULED
[02:07:50.745] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:27:0) after 6m50s
[02:14:40.760] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:27:0)
[02:14:40.817] Build status: SCHEDULED
[02:14:40.817] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:28:0) after 6m13s
[02:20:53.831] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:28:0)
[02:20:53.897] Build status: SCHEDULED
[02:20:53.897] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:29:0) after 1m41s
[02:22:34.909] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:29:0)
[02:22:34.954] Build status: SCHEDULED
[02:22:34.954] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:30:0) after 3m43s
[02:26:17.968] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:30:0)
[02:26:18.003] Build status: SCHEDULED
[02:26:18.003] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:31:0) after 6m29s
[02:32:47.020] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:31:0)
[02:32:47.106] Build status: SCHEDULED
[02:32:47.106] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:32:0) after 1m23s
[02:34:10.123] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:32:0)
[02:34:10.173] Build status: SCHEDULED
[02:34:10.173] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:33:0) after 2m52s
[02:37:02.189] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:33:0)
[02:37:02.234] Build status: SCHEDULED
[02:37:02.234] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:34:0) after 8m26s
[02:45:28.250] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:34:0)
[02:45:28.290] Build status: SCHEDULED
[02:45:28.290] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:35:0) after 5m45s
[02:51:13.308] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:35:0)
[02:51:13.372] Build status: SCHEDULED
[02:51:13.372] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:36:0) after 7m2s
[02:58:15.387] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:36:0)
[02:58:15.435] Build status: SCHEDULED
[02:58:15.435] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:37:0) after 7m19s
[03:05:34.450] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:37:0)
[03:05:34.501] Build status: SCHEDULED
[03:05:34.501] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:38:0) after 9m34s
[03:15:08.518] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:38:0)
[03:15:08.562] Build status: SCHEDULED
[03:15:08.562] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:39:0) after 2m51s
[03:17:59.578] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:39:0)
[03:17:59.637] Build status: SCHEDULED
[03:17:59.637] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:40:0) after 1m42s
[03:19:41.652] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:40:0)
[03:19:41.696] Build status: SCHEDULED
[03:19:41.696] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:41:0) after 8m19s
[03:28:00.726] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:41:0)
[03:28:00.783] Build status: SCHEDULED
[03:28:00.783] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:42:0) after 9m12s
[03:37:12.801] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:42:0)
[03:37:12.851] Build status: SCHEDULED
[03:37:12.851] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:43:0) after 2m58s
[03:40:10.873] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:43:0)
[03:40:10.894] Build status: SCHEDULED
[03:40:10.895] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:44:0) after 5m35s
[03:45:45.911] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:44:0)
[03:45:45.967] Build status: SCHEDULED
[03:45:45.967] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:45:0) after 8m53s
[03:54:38.987] Handling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:45:0)
[03:54:39.032] Build status: SCHEDULED
[03:54:39.032] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8850383275478978944:46:0) after 6m25s
[04:00:10.198] Received PubSub notification, asking Buildbucket for the build status
[04:00:10.248] Build:
{
"id": "8684953213595353313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"number": 100457,
"createdBy": "project:chromium",
"createTime": "2026-04-10T00:16:43.212192272Z",
"endTime": "2026-04-10T04:00:00.892723380Z",
"updateTime": "2026-04-10T04:00:00.892723380Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "101c0cd0df21795db4afe1ac4cb63366435780ef",
"ref": "refs/heads/main"
}
}
}
[04:00:10.248] Invocation finished in 3h43m28.2155768s with status FAILED