[01:30:13.073] New invocation is queued and will start shortly
[01:30:14.152] Starting the invocation (attempt 1)
[01:30:14.191] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97aaa0667a98055a78a3e87751bd19401f335d95"
[01:30:14.191] Popped gitiles commit info from properties and tags
[01:30:14.191] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:30:14.191] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[01:30:14.192] Buildbucket request:
{
"requestId": "8941247407473554464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941247407473554464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[01:30:47.179] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[01:30:47.179] The invocation will be retried
[01:30:52.252] Starting the invocation (attempt 2)
[01:30:52.281] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97aaa0667a98055a78a3e87751bd19401f335d95"
[01:30:52.281] Popped gitiles commit info from properties and tags
[01:30:52.281] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:30:52.282] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[01:30:52.282] Buildbucket request:
{
"requestId": "8941247407473554464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941247407473554464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[01:31:23.370] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[01:31:23.370] The invocation will be retried
[01:31:33.433] Starting the invocation (attempt 3)
[01:31:33.463] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97aaa0667a98055a78a3e87751bd19401f335d95"
[01:31:33.463] Popped gitiles commit info from properties and tags
[01:31:33.463] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:31:33.463] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[01:31:33.463] Buildbucket request:
{
"requestId": "8941247407473554464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941247407473554464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[01:32:04.571] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[01:32:04.571] The invocation will be retried
[01:32:24.656] Starting the invocation (attempt 4)
[01:32:24.687] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97aaa0667a98055a78a3e87751bd19401f335d95"
[01:32:24.687] Popped gitiles commit info from properties and tags
[01:32:24.687] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:32:24.691] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[01:32:24.691] Buildbucket request:
{
"requestId": "8941247407473554464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941247407473554464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[01:32:55.785] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[01:32:55.785] The invocation will be retried
[01:33:35.847] Starting the invocation (attempt 5)
[01:33:35.874] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97aaa0667a98055a78a3e87751bd19401f335d95"
[01:33:35.874] Popped gitiles commit info from properties and tags
[01:33:35.874] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:33:35.875] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[01:33:35.875] Buildbucket request:
{
"requestId": "8941247407473554464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941247407473554464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[01:34:06.972] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[01:34:06.973] The invocation will be retried
[01:35:27.048] Starting the invocation (attempt 6)
[01:35:27.081] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97aaa0667a98055a78a3e87751bd19401f335d95"
[01:35:27.081] Popped gitiles commit info from properties and tags
[01:35:27.081] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:35:27.081] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[01:35:27.081] Buildbucket request:
{
"requestId": "8941247407473554464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941247407473554464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[01:35:58.172] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[01:35:58.172] The invocation will be retried
[01:38:38.239] Starting the invocation (attempt 7)
[01:38:38.266] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97aaa0667a98055a78a3e87751bd19401f335d95"
[01:38:38.266] Popped gitiles commit info from properties and tags
[01:38:38.266] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:38:38.269] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[01:38:38.269] Buildbucket request:
{
"requestId": "8941247407473554464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941247407473554464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[01:39:09.363] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[01:39:09.363] The invocation will be retried
[01:44:29.476] Starting the invocation (attempt 8)
[01:44:29.507] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97aaa0667a98055a78a3e87751bd19401f335d95"
[01:44:29.507] Popped gitiles commit info from properties and tags
[01:44:29.507] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:44:29.509] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[01:44:29.510] Buildbucket request:
{
"requestId": "8941247407473554464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941247407473554464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[01:45:00.603] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[01:45:00.603] The invocation will be retried
[01:55:00.682] Starting the invocation (attempt 9)
[01:55:00.721] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97aaa0667a98055a78a3e87751bd19401f335d95"
[01:55:00.721] Popped gitiles commit info from properties and tags
[01:55:00.721] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:55:00.723] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[01:55:00.724] Buildbucket request:
{
"requestId": "8941247407473554464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941247407473554464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[01:55:31.821] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[01:55:31.821] The invocation will be retried
[02:05:31.881] Starting the invocation (attempt 10)
[02:05:31.931] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97aaa0667a98055a78a3e87751bd19401f335d95"
[02:05:31.931] Popped gitiles commit info from properties and tags
[02:05:31.931] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[02:05:31.943] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[02:05:31.943] Buildbucket request:
{
"requestId": "8941247407473554464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941247407473554464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[02:06:03.038] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[02:06:03.038] The invocation will be retried
[02:16:03.101] Starting the invocation (attempt 11)
[02:16:03.131] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97aaa0667a98055a78a3e87751bd19401f335d95"
[02:16:03.131] Popped gitiles commit info from properties and tags
[02:16:03.131] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[02:16:03.134] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[02:16:03.134] Buildbucket request:
{
"requestId": "8941247407473554464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941247407473554464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[02:16:34.233] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[02:16:34.233] The invocation will be retried
[02:26:34.690] Starting the invocation (attempt 12)
[02:26:34.717] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97aaa0667a98055a78a3e87751bd19401f335d95"
[02:26:34.717] Popped gitiles commit info from properties and tags
[02:26:34.717] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[02:26:34.717] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[02:26:34.717] Buildbucket request:
{
"requestId": "8941247407473554464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941247407473554464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-rel-dev"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[02:27:06.703] Scheduled build:
{
"id": "8775813768253899169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"number": 12613,
"createdBy": "project:chromium",
"createTime": "2023-07-12T02:27:05.859631103Z",
"updateTime": "2023-07-12T02:27:05.859631103Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
}
}
}
[02:27:06.703] Task URL: https://cr-buildbucket-dev.appspot.com/build/8775813768253899169
[02:27:06.703] Scheduling timer "check-buildbucket-build-status" (chromium/mac-rel-dev:8941247407473554464:35:0) after 2m35s
[02:27:07.927] Received PubSub notification, asking Buildbucket for the build status
[02:27:07.958] Build status: SCHEDULED
[02:27:23.751] Received PubSub notification, asking Buildbucket for the build status
[02:27:23.779] Build:
{
"id": "8775813768253899169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-rel-dev"
},
"number": 12613,
"createdBy": "project:chromium",
"createTime": "2023-07-12T02:27:05.859631103Z",
"endTime": "2023-07-12T02:27:23.053878Z",
"updateTime": "2023-07-12T02:27:23.053878Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97aaa0667a98055a78a3e87751bd19401f335d95",
"ref": "refs/heads/main"
}
}
}
[02:27:23.779] Invocation finished in 57m10.712919726s with status FAILED