Interface Generator.ModelParameterOrBuilder (0.98.0)

0.98.0 (latest) 0.96.0 0.94.0 0.93.0 0.92.0 0.91.0 0.89.0 0.87.0 0.86.0 0.85.0 0.84.0 0.83.0 0.81.0 0.79.0 0.78.0 0.75.0 0.74.0 0.73.0 0.71.0 0.70.0 0.69.0 0.68.0 0.67.0 0.66.0 0.65.0 0.64.0 0.63.0 0.62.0 0.60.0 0.59.0 0.58.0 0.57.0 0.56.0 0.55.0 0.54.0 0.53.0 0.52.0 0.51.0 0.50.0 0.48.0 0.47.0 0.46.0 0.45.0 0.44.0 0.43.0 0.42.0 0.41.0 0.40.0 0.39.0 0.38.0 0.35.0 0.34.0 0.33.0 0.32.0 0.31.0 0.30.0 0.29.0 0.28.0 0.27.0 0.26.0 0.25.0 0.24.0 0.23.0 0.22.0 0.20.0 0.19.0 0.18.0 0.17.0 0.16.0 0.15.0 0.14.7 0.13.1 0.12.1 0.11.5

public static interface Generator.ModelParameterOrBuilder extends MessageOrBuilder

Implements

MessageOrBuilder

Methods

getMaxDecodeSteps()

public abstract int getMaxDecodeSteps()

The maximum number of tokens to generate.

optional int32 max_decode_steps = 2;

Returns
Type	Description
int	The maxDecodeSteps.

getTemperature()

public abstract float getTemperature()

The temperature used for sampling. Temperature sampling occurs after both topP and topK have been applied. Valid range: [0.0, 1.0] Low temperature = less random. High temperature = more random.

optional float temperature = 1;

Returns
Type	Description
float	The temperature.

getTopK()

public abstract int getTopK()

If set, the sampling process in each step is limited to the top_k tokens with highest probabilities. Valid range: [1, 40] or 1000+. Small topK = less random. Large topK = more random.

optional int32 top_k = 4;

Returns
Type	Description
int	The topK.

getTopP()

public abstract float getTopP()

If set, only the tokens comprising the top top_p probability mass are considered. If both top_p and top_k are set, top_p will be used for further refining candidates selected with top_k. Valid range: (0.0, 1.0]. Small topP = less random. Large topP = more random.

optional float top_p = 3;

Returns
Type	Description
float	The topP.

hasMaxDecodeSteps()

public abstract boolean hasMaxDecodeSteps()

The maximum number of tokens to generate.

optional int32 max_decode_steps = 2;

Returns
Type	Description
boolean	Whether the maxDecodeSteps field is set.

hasTemperature()

public abstract boolean hasTemperature()

The temperature used for sampling. Temperature sampling occurs after both topP and topK have been applied. Valid range: [0.0, 1.0] Low temperature = less random. High temperature = more random.

optional float temperature = 1;

Returns
Type	Description
boolean	Whether the temperature field is set.

hasTopK()

public abstract boolean hasTopK()

If set, the sampling process in each step is limited to the top_k tokens with highest probabilities. Valid range: [1, 40] or 1000+. Small topK = less random. Large topK = more random.

optional int32 top_k = 4;

Returns
Type	Description
boolean	Whether the topK field is set.

hasTopP()

public abstract boolean hasTopP()

If set, only the tokens comprising the top top_p probability mass are considered. If both top_p and top_k are set, top_p will be used for further refining candidates selected with top_k. Valid range: (0.0, 1.0]. Small topP = less random. Large topP = more random.

optional float top_p = 3;

Returns
Type	Description
boolean	Whether the topP field is set.