啟用事件導向函式重試功能 (第 1 代)

本文說明如何為事件導向函式啟用重試功能。自動重試功能不適用於 HTTP 函式。

注意：您使用的事件導向函式類型 (CloudEvent 函式或背景函式) 取決於執行函式的執行階段。

重試的元件資訊

Cloud Run functions 會針對事件來源發出的每個事件，至少執行一次事件導向函式。根據預設，如果函式叫用作業因錯誤而終止，系統不會再次叫用函式，並會捨棄事件。為事件導向函式啟用重試功能後，Cloud Run functions 會重試失敗的函式叫用作業，直到作業成功完成或超過重試期限為止。

重試期限為 7 天。Cloud Run functions 會使用指數輪詢策略重試新建立的事件導向函式，輪詢時間會逐漸增加，介於 10 到 600 秒之間。這項政策適用於您首次部署的新函式。即使重新部署函式，這項政策也不會追溯套用至本版本資訊所述變更生效前首次部署的現有函式。

如果函式未啟用重試功能 (預設為停用)，函式一律會回報執行成功，且記錄檔中可能會顯示 200 OK 回應代碼。即使函式發生錯誤，也會發生這種情況。為清楚說明函式何時發生錯誤，請務必適當回報錯誤。

事件導向函式無法完成的原因

在極少數情況下，函式可能會因內部錯誤而提早結束，根據預設，函式可能會也可能不會自動重試。

更常見的情況是，事件導向函式可能會因函式程式碼本身擲回的錯誤，而無法順利完成。可能原因包括：

• 函式包含錯誤且執行階段擲回例外狀況。
• 函式無法連線至服務端點，或在嘗試連線時逾時。
• 函式刻意擲回例外狀況 (例如，當參數驗證失敗時)。
• Node.js 函式傳回遭拒絕的 promise，或將非 null 值傳遞至回呼。

在上述任一情況下，函式預設會停止執行，並捨棄事件。如要在發生錯誤時重試函式，可以設定「retry on failure」(失敗時重新執行) 屬性，變更預設重試政策。這樣可以使系統重複重試事件，直到函式完成或重試逾時為止。

警告：設定「retry on failure」(失敗時重新執行) 會使系統重複重試函式，直到函式成功執行或超過重試期限為止，重試期限可以是好幾天。如果是因錯誤或其他任何類型的參數錯誤而導致失敗，您的函式可能會陷在重試的循環中。 因此您應該僅在處理暫時性失敗 (例如不穩定的端點或間歇性逾時) 時，且僅在未設定這一屬性的情況下對程式碼執行壓力測試之後，才使用此設定。如果您的函式確實困在重試循環中，您必須重新部署函式或刪除函式以結束執行。

啟用或停用重試功能

如要啟用或停用重試功能，可以使用 gcloud 指令列工具或 Google Cloud 控制台。根據預設，系統不會停用重試功能。

透過 gcloud 指令列工具設定重試

如要使用 gcloud 指令列工具啟用重試功能，請在部署函式時加入 --retry 旗標：

gcloud functions deploy FUNCTION_NAME --retry FLAGS...

如要停用重試功能，請重新部署函式，但不要加入 --retry 旗標：

gcloud functions deploy FUNCTION_NAME FLAGS...

從控制台設定重試

如要建立新函式，請按照下列步驟操作：

1. 在「Create Function」(建立函式) 畫面中，選取「Trigger」(觸發條件) 下方的事件類型，做為函式的觸發條件。
2. 勾選「Retry on failure」(失敗時重試) 核取方塊，啟用重試功能。

如要更新現有函式，請按照下列步驟操作：

1. 在「Cloud Run functions Overview」(Cloud Run functions 總覽) 頁面中，按一下要更新的函式名稱，開啟「Function details」(函式詳細資料) 畫面，然後從選單列選擇「Edit」(編輯)，開啟「Trigger」(觸發條件) 窗格。
2. 勾選或取消勾選「Retry on failure」(失敗時重試) 核取方塊，即可啟用或停用重試功能。

最佳做法

本節將說明使用重試的最佳做法。

使用重試來處理暫時性錯誤

由於您的函式會不斷重試，直到成功執行為止，因此應該先透過測試消除像是程式設計錯誤這一類的永久性錯誤，然後再啟用重試。重試最適合用來處理經過重試之後極有可能解決的間歇性或暫時性失敗，例如不穩定的服務端點或逾時。

設定結束條件以避免無限的重試循環

使用重試時，最佳做法是避免函式不斷循環。您可以在函式開始處理「之前」，加入妥善定義的結束條件來達成此目標。請注意，只有在函式順利啟動並能評估結束條件時，這項技術才能發揮作用。

有一個簡單有效的方法，就是捨棄時間戳記早於某特定時間的事件。針對永久性或失敗時間比預期時間長的情況，這樣做有助於避免過度執行。

例如，下方程式碼片段會捨棄 10 秒之前的所有事件：

Node.js

/**
 * Background Cloud Function that only executes within
 * a certain time period after the triggering event
 *
 * @param {object} event The Cloud Functions event.
 * @param {function} callback The callback function.
 */
exports.avoidInfiniteRetries = (event, callback) => {
  const eventAge = Date.now() - Date.parse(event.timestamp);
  const eventMaxAge = 10000;

  // Ignore events that are too old
  if (eventAge > eventMaxAge) {
    console.log(`Dropping event ${event} with age ${eventAge} ms.`);
    callback();
    return;
  }

  // Do what the function is supposed to do
  console.log(`Processing event ${event} with age ${eventAge} ms.`);

  // Retry failed function executions
  const failed = false;
  if (failed) {
    callback('some error');
  } else {
    callback();
  }
};

Python

from datetime import datetime, timezone

# The 'python-dateutil' package must be included in requirements.txt.
from dateutil import parser


def avoid_infinite_retries(data, context):
    """Background Cloud Function that only executes within a certain
    time period after the triggering event.

    Args:
        data (dict): The event payload.
        context (google.cloud.functions.Context): The event metadata.
    Returns:
        None; output is written to Stackdriver Logging
    """

    timestamp = context.timestamp

    event_time = parser.parse(timestamp)
    event_age = (datetime.now(timezone.utc) - event_time).total_seconds()
    event_age_ms = event_age * 1000

    # Ignore events that are too old
    max_age_ms = 10000
    if event_age_ms > max_age_ms:
        print(f"Dropped {context.event_id} (age {event_age_ms}ms)")
        return "Timeout"

    # Do what the function is supposed to do
    print(f"Processed {context.event_id} (age {event_age_ms}ms)")
    return  # To retry the execution, raise an exception here

Go

// Package tips contains tips for writing Cloud Functions in Go.
package tips

import (
	"context"
	"fmt"
	"log"
	"time"

	"cloud.google.com/go/functions/metadata"
)

// PubSubMessage is the payload of a Pub/Sub event.
// See the documentation for more details:
// https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage
type PubSubMessage struct {
	Data []byte `json:"data"`
}

// FiniteRetryPubSub demonstrates how to avoid inifinite retries.
func FiniteRetryPubSub(ctx context.Context, m PubSubMessage) error {
	meta, err := metadata.FromContext(ctx)
	if err != nil {
		// Assume an error on the function invoker and try again.
		return fmt.Errorf("metadata.FromContext: %w", err)
	}

	// Ignore events that are too old.
	expiration := meta.Timestamp.Add(10 * time.Second)
	if time.Now().After(expiration) {
		log.Printf("event timeout: halting retries for expired event '%q'", meta.EventID)
		return nil
	}

	// Add your message processing logic.
	return processTheMessage(m)
}

Java

import com.google.cloud.functions.BackgroundFunction;
import com.google.cloud.functions.Context;
import com.google.gson.Gson;
import functions.eventpojos.PubsubMessage;
import java.time.Duration;
import java.time.ZoneOffset;
import java.time.ZonedDateTime;
import java.util.logging.Logger;

public class RetryTimeout implements BackgroundFunction<PubsubMessage> {
  private static final Logger logger = Logger.getLogger(RetryTimeout.class.getName());
  private static final long MAX_EVENT_AGE = 10_000;

  // Use Gson (https://github.com/google/gson) to parse JSON content.
  private static final Gson gson = new Gson();

  /**
   * Background Cloud Function that only executes within
   * a certain time period after the triggering event
   */
  @Override
  public void accept(PubsubMessage message, Context context) {
    ZonedDateTime utcNow = ZonedDateTime.now(ZoneOffset.UTC);
    ZonedDateTime timestamp = ZonedDateTime.parse(context.timestamp());

    long eventAge = Duration.between(timestamp, utcNow).toMillis();

    // Ignore events that are too old
    if (eventAge > MAX_EVENT_AGE) {
      logger.info(String.format("Dropping event with timestamp %s.", timestamp));
      return;
    }

    // Process events that are recent enough
    // To retry this invocation, throw an exception here
    logger.info(String.format("Processing event with timestamp %s.", timestamp));
  }
}

C#

using CloudNative.CloudEvents;
using Google.Cloud.Functions.Framework;
using Google.Events.Protobuf.Cloud.PubSub.V1;
using Microsoft.Extensions.Logging;
using System;
using System.Threading;
using System.Threading.Tasks;

namespace TimeBoundedRetries;

public class Function : ICloudEventFunction<MessagePublishedData>
{
    private static readonly TimeSpan MaxEventAge = TimeSpan.FromSeconds(10);
    private readonly ILogger _logger;

    // Note: for additional testability, use an injectable clock abstraction.
    public Function(ILogger<Function> logger) =>
        _logger = logger;

    public Task HandleAsync(CloudEvent cloudEvent, MessagePublishedData data, CancellationToken cancellationToken)
    {
        string textData = data.Message.TextData;

        DateTimeOffset utcNow = DateTimeOffset.UtcNow;

        // Every PubSub CloudEvent will contain a timestamp.
        DateTimeOffset timestamp = cloudEvent.Time.Value;
        DateTimeOffset expiry = timestamp + MaxEventAge;

        // Ignore events that are too old.
        if (utcNow > expiry)
        {
            _logger.LogInformation("Dropping PubSub message '{text}'", textData);
            return Task.CompletedTask;
        }

        // Process events that are recent enough.
        // If this processing throws an exception, the message will be retried until either
        // processing succeeds or the event becomes too old and is dropped by the code above.
        _logger.LogInformation("Processing PubSub message '{text}'", textData);
        return Task.CompletedTask;
    }
}

Ruby

require "functions_framework"

FunctionsFramework.cloud_event "avoid_infinite_retries" do |event|
  # Use the event timestamp to determine the event age.
  event_age_secs = Time.now - event.time.to_time
  event_age_ms = (event_age_secs * 1000).to_i

  max_age_ms = 10_000
  if event_age_ms > max_age_ms
    # Ignore events that are too old.
    logger.info "Dropped #{event.id} (age #{event_age_ms}ms)"

  else
    # Do what the function is supposed to do.
    logger.info "Handling #{event.id} (age #{event_age_ms}ms)..."
    failed = true

    # Raise an exception to signal failure and trigger a retry.
    raise "I failed!" if failed
  end
end

PHP

/**
 * This function shows an example method for avoiding infinite retries in
 * Google Cloud Functions. By default, functions configured to automatically
 * retry execution on failure will be retried indefinitely - causing an
 * infinite loop. To avoid this, we stop retrying executions (by not throwing
 * exceptions) for any events that are older than a predefined threshold.
 */

use Google\CloudFunctions\CloudEvent;

function avoidInfiniteRetries(CloudEvent $event): void
{
    $log = fopen(getenv('LOGGER_OUTPUT') ?: 'php://stderr', 'wb');

    $eventId = $event->getId();

    // The maximum age of events to process.
    $maxAge = 10; // 10 seconds

    // The age of the event being processed.
    $eventAge = time() - strtotime($event->getTime());

    // Ignore events that are too old
    if ($eventAge > $maxAge) {
        fwrite($log, 'Dropping event ' . $eventId . ' with age ' . $eventAge . ' seconds' . PHP_EOL);
        return;
    }

    // Do what the function is supposed to do
    fwrite($log, 'Processing event: ' . $eventId . ' with age ' . $eventAge . ' seconds' . PHP_EOL);

    // infinite_retries failed function executions
    $failed = true;
    if ($failed) {
        throw new Exception('Event ' . $eventId . ' failed; retrying...');
    }
}

區分可重試的函式和嚴重錯誤

如果您的函式已啟用重試，那麼所有未處理的錯誤都會觸發重試。 請確保程式碼會擷取不應導致重試的任何錯誤。

Node.js

/**
 * Background Cloud Function that demonstrates
 * how to toggle retries using a promise
 *
 * @param {object} event The Cloud Functions event.
 * @param {object} event.data Data included with the event.
 * @param {object} event.data.retry User-supplied parameter that tells the function whether to retry.
 */
exports.retryPromise = event => {
  const tryAgain = !!event.data.retry;

  if (tryAgain) {
    throw new Error('Retrying...');
  } else {
    console.error('Not retrying...');
    return Promise.resolve();
  }
};

/**
 * Background Cloud Function that demonstrates
 * how to toggle retries using a callback
 *
 * @param {object} event The Cloud Functions event.
 * @param {object} event.data Data included with the event.
 * @param {object} event.data.retry User-supplied parameter that tells the function whether to retry.
 * @param {function} callback The callback function.
 */
exports.retryCallback = (event, callback) => {
  const tryAgain = !!event.data.retry;
  const err = new Error('Error!');

  if (tryAgain) {
    console.error('Retrying:', err);
    callback(err);
  } else {
    console.error('Not retrying:', err);
    callback();
  }
};

Python

from google.cloud import error_reporting


error_client = error_reporting.Client()


def retry_or_not(data, context):
    """Background Cloud Function that demonstrates how to toggle retries.

    Args:
        data (dict): The event payload.
        context (google.cloud.functions.Context): The event metadata.
    Returns:
        None; output is written to Stackdriver Logging
    """

    # Retry based on a user-defined parameter
    try_again = data.data.get("retry") is not None

    try:
        raise RuntimeError("I failed you")
    except RuntimeError:
        error_client.report_exception()
        if try_again:
            raise  # Raise the exception and try again
        else:
            pass  # Swallow the exception and don't retry

Go

// Package tips contains tips for writing Cloud Functions in Go.
package tips

import (
	"context"
	"errors"
	"log"
)

// PubSubMessage is the payload of a Pub/Sub event.
// See the documentation for more details:
// https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage
type PubSubMessage struct {
	Data []byte `json:"data"`
}

// RetryPubSub demonstrates how to toggle using retries.
func RetryPubSub(ctx context.Context, m PubSubMessage) error {
	name := string(m.Data)
	if name == "" {
		name = "World"
	}

	// A misconfigured client will stay broken until the function is redeployed.
	client, err := MisconfiguredDataClient()
	if err != nil {
		log.Printf("MisconfiguredDataClient (retry denied):  %v", err)
		// A nil return indicates that the function does not need a retry.
		return nil
	}

	// Runtime error might be resolved with a new attempt.
	if err = FailedWriteOperation(client, name); err != nil {
		log.Printf("FailedWriteOperation (retry expected): %v", err)
		// A non-nil return indicates that a retry is needed.
		return err
	}

	return nil
}

Java

import com.google.cloud.functions.BackgroundFunction;
import com.google.cloud.functions.Context;
import com.google.gson.Gson;
import com.google.gson.JsonElement;
import com.google.gson.JsonObject;
import functions.eventpojos.PubsubMessage;
import java.nio.charset.StandardCharsets;
import java.util.Base64;
import java.util.logging.Logger;

public class RetryPubSub implements BackgroundFunction<PubsubMessage> {
  private static final Logger logger = Logger.getLogger(RetryPubSub.class.getName());

  // Use Gson (https://github.com/google/gson) to parse JSON content.
  private static final Gson gson = new Gson();

  @Override
  public void accept(PubsubMessage message, Context context) {
    String bodyJson = new String(
        Base64.getDecoder().decode(message.getData()), StandardCharsets.UTF_8);
    JsonElement bodyElement = gson.fromJson(bodyJson, JsonElement.class);

    // Get the value of the "retry" JSON parameter, if one exists
    boolean retry = false;
    if (bodyElement != null && bodyElement.isJsonObject()) {
      JsonObject body = bodyElement.getAsJsonObject();

      if (body.has("retry") && body.get("retry").getAsBoolean()) {
        retry = true;
      }
    }

    // Retry if appropriate
    if (retry) {
      // Throwing an exception causes the execution to be retried
      throw new RuntimeException("Retrying...");
    } else {
      logger.info("Not retrying...");
    }
  }
}

C#

using CloudNative.CloudEvents;
using Google.Cloud.Functions.Framework;
using Google.Events.Protobuf.Cloud.PubSub.V1;
using Microsoft.Extensions.Logging;
using System;
using System.Text.Json;
using System.Threading;
using System.Threading.Tasks;

namespace Retry;

public class Function : ICloudEventFunction<MessagePublishedData>
{
    private readonly ILogger _logger;

    public Function(ILogger<Function> logger) =>
        _logger = logger;

    public Task HandleAsync(CloudEvent cloudEvent, MessagePublishedData data, CancellationToken cancellationToken)
    {
        bool retry = false;
        string text = data.Message?.TextData;

        // Get the value of the "retry" JSON parameter, if one exists.
        if (!string.IsNullOrEmpty(text))
        {
            JsonElement element = JsonSerializer.Deserialize<JsonElement>(data.Message.TextData);

            retry = element.TryGetProperty("retry", out var property) &&
                property.ValueKind == JsonValueKind.True;
        }

        // Throwing an exception causes the execution to be retried.
        if (retry)
        {
            throw new InvalidOperationException("Retrying...");
        }
        else
        {
            _logger.LogInformation("Not retrying...");
        }
        return Task.CompletedTask;
    }
}

Ruby

require "functions_framework"

FunctionsFramework.cloud_event "retry_or_not" do |event|
  try_again = event.data["retry"]

  begin
    # Simulate a failure
    raise "I failed!"
  rescue RuntimeError => e
    logger.warn "Caught an error: #{e}"
    if try_again
      # Raise an exception to return a 500 and trigger a retry.
      logger.info "Trying again..."
      raise ex
    else
      # Return normally to end processing of this event.
      logger.info "Giving up."
    end
  end
end

PHP

use Google\CloudFunctions\CloudEvent;

function tipsRetry(CloudEvent $event): void
{
    $cloudEventData = $event->getData();
    $pubSubData = $cloudEventData['message']['data'];

    $json = json_decode(base64_decode($pubSubData), true);

    // Determine whether to retry the invocation based on a parameter
    $tryAgain = $json['some_parameter'];

    if ($tryAgain) {
        /**
         * Functions with automatic retries enabled should throw exceptions to
         * indicate intermittent failures that a retry might fix. In this
         * case, a thrown exception will cause the original function
         * invocation to be re-sent.
         */
        throw new Exception('Intermittent failure occurred; retrying...');
    }

    /**
     * If a function with retries enabled encounters a non-retriable
     * failure, it should return *without* throwing an exception.
     */
    $log = fopen(getenv('LOGGER_OUTPUT') ?: 'php://stderr', 'wb');
    fwrite($log, 'Not retrying' . PHP_EOL);
}

讓可重試的事件導向函式具備等冪性

可重試的事件導向函式必須是等冪函式。以下是讓這類函式具備等冪性的幾項一般準則：

• 許多外部 API (例如 Stripe) 都可讓您提供冪等鍵做為參數。如果您使用此類 API，應使用事件 ID 做為冪等鍵。
• 冪等可以與至少一次的執行完美搭配使用，因為冪等可以使重試安全執行。因此，編寫可信賴程式碼的一般最佳做法是將冪等與重試結合使用。
• 請確保您的程式碼為內部冪等，例如：
  • 確保異動可以發生多次，也不會變更結果。
  • 在變更狀態之前，查詢交易中的資料庫狀態。
  • 確保所有連帶影響本身也是冪等的。
• 在函式外強制執行交易檢查，不受程式碼影響。 例如，將已處理的特定事件 ID 保持於在某處記錄的狀態。
• 請在頻外處理重複的函式呼叫。比方說，發生重複函式呼叫後，使用單獨的清除程序清除所用資源。

設定重試政策

視函式需求而定，您可能需要直接設定重試政策。這樣一來，您就能設定下列任意組合：

• 將重試期限從 7 天縮短至 10 分鐘。
• 變更指數輪詢重試策略的最短和最長輪詢時間。
• 將重試策略變更為立即重試。
• 設定 dead-letter 主題。
• 設定傳送嘗試次數上限和下限。

如要設定重試政策，請按照下列步驟操作：

1. 編寫 HTTP 函式。
2. 使用 Pub/Sub API 建立 Pub/Sub 訂閱項目，將函式的網址指定為目標。

想進一步瞭解如何直接設定 Pub/Sub，請參閱 Pub/Sub 說明文件中的失敗處理方式。

後續步驟

• 部署 Cloud Run 函式。
• 呼叫 Pub/Sub 觸發條件函式。
• 呼叫 Cloud Storage 觸發條件函式。
• Cloud Run functions 與 Pub/Sub 教學課程。
• Cloud Run functions 與 Cloud Storage 教學課程。