Class CodeExecutionMetric (2.4.0)

CodeExecutionMetric(**data: typing.Any)

A metric that executes custom Python code for evaluation.

Methods

CodeExecutionMetric

CodeExecutionMetric(**data: typing.Any)

Create a new model by parsing and validating input data from keyword arguments.

Raises [ValidationError][pydantic_core.ValidationError] if the input data cannot be validated to form a valid model.

self is explicitly positional-only to allow self as a field name.

model_post_init

model_post_init(context: Any, /) -> None

This function is meant to behave like a BaseModel method to initialize private attributes.

It takes context as an argument since that's what pydantic-core passes when calling it.

validate_code

validate_code(value: typing.Optional[str]) -> typing.Optional[str]

API documentation for validate_code method.