[22:32:17.048] New invocation is queued and will start shortly
[22:32:18.115] Starting the invocation (attempt 1)
[22:32:18.142] Ignoring gitiles_ref tag without the buildset tag
[22:32:18.142] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[22:32:18.142] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[22:32:18.142] Buildbucket request:
{
"requestId": "8860174317169046240",
"builder": {
"project": "infra",
"bucket": "ci",
"builder": "build-proto-win"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler-dev.appspot.com",
"invocation": "8860174317169046240",
"job": "infra/build-proto-win",
"triggers": [
{
"cron": {
"generation": "531353"
},
"id": "cron:v1:531353"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860174317169046240"
},
{
"key": "scheduler_job_id",
"value": "infra/build-proto-win"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[22:32:53.027] Failed to schedule Buildbucket build - rpc error: code = Internal desc = 502 Bad Gateway nginx
[22:32:53.027] The invocation will be retried
[22:32:58.110] Starting the invocation (attempt 2)
[22:32:58.137] Ignoring gitiles_ref tag without the buildset tag
[22:32:58.137] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[22:32:58.137] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[22:32:58.137] Buildbucket request:
{
"requestId": "8860174317169046240",
"builder": {
"project": "infra",
"bucket": "ci",
"builder": "build-proto-win"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler-dev.appspot.com",
"invocation": "8860174317169046240",
"job": "infra/build-proto-win",
"triggers": [
{
"cron": {
"generation": "531353"
},
"id": "cron:v1:531353"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860174317169046240"
},
{
"key": "scheduler_job_id",
"value": "infra/build-proto-win"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[22:33:30.978] Failed to schedule Buildbucket build - rpc error: code = Internal desc = 502 Bad Gateway nginx
[22:33:30.979] The invocation will be retried
[22:33:41.031] Starting the invocation (attempt 3)
[22:33:41.057] Ignoring gitiles_ref tag without the buildset tag
[22:33:41.057] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[22:33:41.057] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[22:33:41.058] Buildbucket request:
{
"requestId": "8860174317169046240",
"builder": {
"project": "infra",
"bucket": "ci",
"builder": "build-proto-win"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler-dev.appspot.com",
"invocation": "8860174317169046240",
"job": "infra/build-proto-win",
"triggers": [
{
"cron": {
"generation": "531353"
},
"id": "cron:v1:531353"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860174317169046240"
},
{
"key": "scheduler_job_id",
"value": "infra/build-proto-win"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[22:34:15.868] Failed to schedule Buildbucket build - rpc error: code = Internal desc = 502 Bad Gateway nginx
[22:34:15.868] The invocation will be retried
[22:34:35.928] Starting the invocation (attempt 4)
[22:34:35.958] Ignoring gitiles_ref tag without the buildset tag
[22:34:35.958] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[22:34:35.958] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[22:34:35.959] Buildbucket request:
{
"requestId": "8860174317169046240",
"builder": {
"project": "infra",
"bucket": "ci",
"builder": "build-proto-win"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler-dev.appspot.com",
"invocation": "8860174317169046240",
"job": "infra/build-proto-win",
"triggers": [
{
"cron": {
"generation": "531353"
},
"id": "cron:v1:531353"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860174317169046240"
},
{
"key": "scheduler_job_id",
"value": "infra/build-proto-win"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[22:35:10.013] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[22:35:10.013] The invocation will be retried
[22:35:50.075] Starting the invocation (attempt 5)
[22:35:50.106] Ignoring gitiles_ref tag without the buildset tag
[22:35:50.106] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[22:35:50.107] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[22:35:50.107] Buildbucket request:
{
"requestId": "8860174317169046240",
"builder": {
"project": "infra",
"bucket": "ci",
"builder": "build-proto-win"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler-dev.appspot.com",
"invocation": "8860174317169046240",
"job": "infra/build-proto-win",
"triggers": [
{
"cron": {
"generation": "531353"
},
"id": "cron:v1:531353"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860174317169046240"
},
{
"key": "scheduler_job_id",
"value": "infra/build-proto-win"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[22:36:23.189] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[22:36:23.189] The invocation will be retried
[22:37:43.243] Starting the invocation (attempt 6)
[22:37:43.269] Ignoring gitiles_ref tag without the buildset tag
[22:37:43.269] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[22:37:43.269] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[22:37:43.269] Buildbucket request:
{
"requestId": "8860174317169046240",
"builder": {
"project": "infra",
"bucket": "ci",
"builder": "build-proto-win"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler-dev.appspot.com",
"invocation": "8860174317169046240",
"job": "infra/build-proto-win",
"triggers": [
{
"cron": {
"generation": "531353"
},
"id": "cron:v1:531353"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860174317169046240"
},
{
"key": "scheduler_job_id",
"value": "infra/build-proto-win"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[22:38:18.996] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[22:38:18.996] The invocation will be retried
[22:40:59.054] Starting the invocation (attempt 7)
[22:40:59.078] Ignoring gitiles_ref tag without the buildset tag
[22:40:59.078] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[22:40:59.078] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[22:40:59.078] Buildbucket request:
{
"requestId": "8860174317169046240",
"builder": {
"project": "infra",
"bucket": "ci",
"builder": "build-proto-win"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler-dev.appspot.com",
"invocation": "8860174317169046240",
"job": "infra/build-proto-win",
"triggers": [
{
"cron": {
"generation": "531353"
},
"id": "cron:v1:531353"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860174317169046240"
},
{
"key": "scheduler_job_id",
"value": "infra/build-proto-win"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[22:41:33.815] Failed to schedule Buildbucket build - rpc error: code = Internal desc = 502 Bad Gateway nginx
[22:41:33.815] The invocation will be retried
[22:46:53.861] Starting the invocation (attempt 8)
[22:46:53.887] Ignoring gitiles_ref tag without the buildset tag
[22:46:53.887] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[22:46:53.890] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[22:46:53.890] Buildbucket request:
{
"requestId": "8860174317169046240",
"builder": {
"project": "infra",
"bucket": "ci",
"builder": "build-proto-win"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler-dev.appspot.com",
"invocation": "8860174317169046240",
"job": "infra/build-proto-win",
"triggers": [
{
"cron": {
"generation": "531353"
},
"id": "cron:v1:531353"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860174317169046240"
},
{
"key": "scheduler_job_id",
"value": "infra/build-proto-win"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[22:47:29.598] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[22:47:29.598] The invocation will be retried
[22:57:29.643] Starting the invocation (attempt 9)
[22:57:29.666] Ignoring gitiles_ref tag without the buildset tag
[22:57:29.666] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[22:57:29.666] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[22:57:29.666] Buildbucket request:
{
"requestId": "8860174317169046240",
"builder": {
"project": "infra",
"bucket": "ci",
"builder": "build-proto-win"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler-dev.appspot.com",
"invocation": "8860174317169046240",
"job": "infra/build-proto-win",
"triggers": [
{
"cron": {
"generation": "531353"
},
"id": "cron:v1:531353"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860174317169046240"
},
{
"key": "scheduler_job_id",
"value": "infra/build-proto-win"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[22:58:03.379] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[22:58:03.380] The invocation will be retried
[23:08:03.431] Starting the invocation (attempt 10)
[23:08:03.459] Ignoring gitiles_ref tag without the buildset tag
[23:08:03.459] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[23:08:03.459] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[23:08:03.459] Buildbucket request:
{
"requestId": "8860174317169046240",
"builder": {
"project": "infra",
"bucket": "ci",
"builder": "build-proto-win"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler-dev.appspot.com",
"invocation": "8860174317169046240",
"job": "infra/build-proto-win",
"triggers": [
{
"cron": {
"generation": "531353"
},
"id": "cron:v1:531353"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860174317169046240"
},
{
"key": "scheduler_job_id",
"value": "infra/build-proto-win"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[23:08:38.655] Failed to schedule Buildbucket build - rpc error: code = Internal desc = 502 Bad Gateway nginx
[23:08:38.655] The invocation will be retried
[23:18:38.706] Starting the invocation (attempt 11)
[23:18:38.730] Ignoring gitiles_ref tag without the buildset tag
[23:18:38.730] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[23:18:38.731] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[23:18:38.732] Buildbucket request:
{
"requestId": "8860174317169046240",
"builder": {
"project": "infra",
"bucket": "ci",
"builder": "build-proto-win"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler-dev.appspot.com",
"invocation": "8860174317169046240",
"job": "infra/build-proto-win",
"triggers": [
{
"cron": {
"generation": "531353"
},
"id": "cron:v1:531353"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860174317169046240"
},
{
"key": "scheduler_job_id",
"value": "infra/build-proto-win"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[23:19:14.314] Failed to schedule Buildbucket build - rpc error: code = Internal desc =
[23:19:14.314] The invocation will be retried
[23:29:14.365] Starting the invocation (attempt 12)
[23:29:14.388] Ignoring gitiles_ref tag without the buildset tag
[23:29:14.388] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[23:29:14.514] Failed to prepare PubSub topic - auth: HTTP code (500) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[23:29:14.514] The invocation will be retried
[23:39:14.568] Starting the invocation (attempt 13)
[23:39:14.594] Ignoring gitiles_ref tag without the buildset tag
[23:39:14.594] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[23:39:15.769] Failed to prepare PubSub topic - auth: HTTP code (500) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[23:39:15.769] The invocation will be retried
[23:49:15.838] Starting the invocation (attempt 14)
[23:49:15.861] Ignoring gitiles_ref tag without the buildset tag
[23:49:15.861] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[23:49:15.984] Failed to prepare PubSub topic - auth: HTTP code (502) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[23:49:15.984] The invocation will be retried
[23:59:16.222] Starting the invocation (attempt 15)
[23:59:16.251] Ignoring gitiles_ref tag without the buildset tag
[23:59:16.251] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[23:59:16.603] Failed to prepare PubSub topic - auth: HTTP code (500) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[23:59:16.603] The invocation will be retried
[00:09:16.658] Starting the invocation (attempt 16)
[00:09:16.685] Ignoring gitiles_ref tag without the buildset tag
[00:09:16.685] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[00:09:16.844] Failed to prepare PubSub topic - auth: HTTP code (500) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[00:09:16.844] The invocation will be retried
[00:19:16.894] Starting the invocation (attempt 17)
[00:19:16.919] Ignoring gitiles_ref tag without the buildset tag
[00:19:16.919] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[00:19:17.504] Failed to prepare PubSub topic - auth: HTTP code (500) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[00:19:17.504] The invocation will be retried
[00:29:17.560] Starting the invocation (attempt 18)
[00:29:17.585] Ignoring gitiles_ref tag without the buildset tag
[00:29:17.585] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[00:29:17.948] Failed to prepare PubSub topic - auth: HTTP code (500) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[00:29:17.948] The invocation will be retried
[00:39:17.995] Starting the invocation (attempt 19)
[00:39:18.020] Ignoring gitiles_ref tag without the buildset tag
[00:39:18.020] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[00:39:18.837] Failed to prepare PubSub topic - auth: HTTP code (502) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[00:39:18.837] The invocation will be retried
[00:49:18.885] Starting the invocation (attempt 20)
[00:49:18.909] Ignoring gitiles_ref tag without the buildset tag
[00:49:18.909] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[00:49:19.994] Failed to prepare PubSub topic - auth: HTTP code (500) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[00:49:19.994] The invocation will be retried
[00:59:20.060] Starting the invocation (attempt 21)
[00:59:20.090] Ignoring gitiles_ref tag without the buildset tag
[00:59:20.090] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[00:59:20.474] Failed to prepare PubSub topic - auth: HTTP code (500) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[00:59:20.474] The invocation will be retried
[01:09:20.524] Starting the invocation (attempt 22)
[01:09:20.552] Ignoring gitiles_ref tag without the buildset tag
[01:09:20.552] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:09:21.330] Failed to prepare PubSub topic - auth: HTTP code (502) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[01:09:21.330] The invocation will be retried
[01:19:21.397] Starting the invocation (attempt 23)
[01:19:21.421] Ignoring gitiles_ref tag without the buildset tag
[01:19:21.421] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:19:22.809] Failed to prepare PubSub topic - auth: HTTP code (502) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[01:19:22.809] The invocation will be retried
[01:29:22.859] Starting the invocation (attempt 24)
[01:29:22.886] Ignoring gitiles_ref tag without the buildset tag
[01:29:22.886] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:29:24.165] Failed to prepare PubSub topic - auth: HTTP code (500) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[01:29:24.165] The invocation will be retried
[01:39:24.221] Starting the invocation (attempt 25)
[01:39:24.250] Ignoring gitiles_ref tag without the buildset tag
[01:39:24.250] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:39:25.216] Failed to prepare PubSub topic - auth: HTTP code (500) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[01:39:25.216] The invocation will be retried
[01:49:25.262] Starting the invocation (attempt 26)
[01:49:25.290] Ignoring gitiles_ref tag without the buildset tag
[01:49:25.290] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:49:26.265] Failed to prepare PubSub topic - auth: HTTP code (500) when fetching https://cr-buildbucket-dev.appspot.com/auth/api/v1/server/info
[01:49:26.265] The invocation will be retried
[01:59:26.318] Starting the invocation (attempt 27)
[01:59:26.350] Ignoring gitiles_ref tag without the buildset tag
[01:59:26.350] Preparing PubSub topic for "https://cr-buildbucket-dev.appspot.com"
[01:59:26.350] PubSub topic is "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
[01:59:26.350] Buildbucket request:
{
"requestId": "8860174317169046240",
"builder": {
"project": "infra",
"bucket": "ci",
"builder": "build-proto-win"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler-dev.appspot.com",
"invocation": "8860174317169046240",
"job": "infra/build-proto-win",
"triggers": [
{
"cron": {
"generation": "531353"
},
"id": "cron:v1:531353"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860174317169046240"
},
{
"key": "scheduler_job_id",
"value": "infra/build-proto-win"
},
{
"key": "user_agent",
"value": "luci-scheduler-dev"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler-dev/topics/scheduler.buildbucket.cr-buildbucket-dev~appspot.gserviceaccount.com"
}
}
[01:59:26.747] Received PubSub notification, asking Buildbucket for the build status
[01:59:26.747] Fatal error when handling PubSub notification, aborting invocation - unexpected invocation status "RETRYING", expecting "RUNNING"
[01:59:26.747] Invocation finished in 3h27m9.705930108s with status FAILED