2.0.0 (latest) 1.159.0 1.158.0 1.157.0 1.156.0 1.155.0 1.154.0

    GenerationConfig(
        *,
        temperature: typing.Optional[float] = None,
        top_p: typing.Optional[float] = None,
        top_k: typing.Optional[int] = None,
        candidate_count: typing.Optional[int] = None,
        max_output_tokens: typing.Optional[int] = None,
        stop_sequences: typing.Optional[typing.List[str]] = None,
        presence_penalty: typing.Optional[float] = None,
        frequency_penalty: typing.Optional[float] = None,
        response_mime_type: typing.Optional[str] = None,
        response_schema: typing.Optional[typing.Dict[str, typing.Any]] = None,
        seed: typing.Optional[int] = None,
        audio_timestamp: typing.Optional[bool] = None,
        routing_config: typing.Optional[RoutingConfig] = None,
        logprobs: typing.Optional[int] = None,
        response_logprobs: typing.Optional[bool] = None,
        response_modalities: typing.Optional[typing.List[GenerationConfig.Modality]] = None,
        model_config: typing.Optional[GenerationConfig.ModelConfig] = None
    )

Parameters for the generation.

## Classes

### Modality

    Modality(value)

The modalities of the response.

### ModelConfig

    ModelConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Config for model selection.

### RoutingConfig

    RoutingConfig(
        *,
        routing_config: typing.Union[
            vertexai.generative_models._generative_models.GenerationConfig.RoutingConfig.AutoRoutingMode,
            vertexai.generative_models._generative_models.GenerationConfig.RoutingConfig.ManualRoutingMode,
        ]
    )

The configuration for model router requests.
Deprecated, please use ModelConfig to set routing preference instead.

The routing config is either one of the two nested classes:

- AutoRoutingMode: Automated routing.
- ManualRoutingMode: Manual routing.

Usage:

- AutoRoutingMode:

      routing_config=generative_models.RoutingConfig(
          routing_config=generative_models.RoutingConfig.AutoRoutingMode(
              model_routing_preference=generative_models.RoutingConfig.AutoRoutingMode.ModelRoutingPreference.BALANCED,
          ),
      )

- ManualRoutingMode:

      routing_config=generative_models.RoutingConfig(
          routing_config=generative_models.RoutingConfig.ManutalRoutingMode(
              model_name="gemini-1.5-pro-001",
          ),
      )

## Methods

### GenerationConfig

    GenerationConfig(
        *,
        temperature: typing.Optional[float] = None,
        top_p: typing.Optional[float] = None,
        top_k: typing.Optional[int] = None,
        candidate_count: typing.Optional[int] = None,
        max_output_tokens: typing.Optional[int] = None,
        stop_sequences: typing.Optional[typing.List[str]] = None,
        presence_penalty: typing.Optional[float] = None,
        frequency_penalty: typing.Optional[float] = None,
        response_mime_type: typing.Optional[str] = None,
        response_schema: typing.Optional[typing.Dict[str, typing.Any]] = None,
        seed: typing.Optional[int] = None,
        audio_timestamp: typing.Optional[bool] = None,
        routing_config: typing.Optional[RoutingConfig] = None,
        logprobs: typing.Optional[int] = None,
        response_logprobs: typing.Optional[bool] = None,
        response_modalities: typing.Optional[typing.List[GenerationConfig.Modality]] = None,
        model_config: typing.Optional[GenerationConfig.ModelConfig] = None
    )

Constructs a GenerationConfig object.