Class TrajectoryAnyOrderMatchSpec (1.153.1)

TrajectoryAnyOrderMatchSpec(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Spec for TrajectoryAnyOrderMatch metric - returns 1 if all tool calls in the reference trajectory appear in the predicted trajectory in any order, else 0.

Methods

TrajectoryAnyOrderMatchSpec

TrajectoryAnyOrderMatchSpec(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Spec for TrajectoryAnyOrderMatch metric - returns 1 if all tool calls in the reference trajectory appear in the predicted trajectory in any order, else 0.