Vertex AI v1beta1 API - Class SpeculativeDecodingSpec (1.0.0-beta61)

Version latest

• 1.0.0-beta61 (latest)
• 1.0.0-beta60

public sealed class SpeculativeDecodingSpec : IMessage<SpeculativeDecodingSpec>, IEquatable<SpeculativeDecodingSpec>, IDeepCloneable<SpeculativeDecodingSpec>, IBufferMessage, IMessage

Reference documentation and code samples for the Vertex AI v1beta1 API class SpeculativeDecodingSpec.

Configuration for Speculative Decoding.

Inheritance

object > SpeculativeDecodingSpec

Implements

IMessageSpeculativeDecodingSpec, IEquatableSpeculativeDecodingSpec, IDeepCloneableSpeculativeDecodingSpec, IBufferMessage, IMessage

Inherited Members

object.GetHashCode()

object.GetType()

object.ToString()

Namespace

Google.Cloud.AIPlatform.V1Beta1

Assembly

Google.Cloud.AIPlatform.V1Beta1.dll

Constructors

SpeculativeDecodingSpec()

public SpeculativeDecodingSpec()

SpeculativeDecodingSpec(SpeculativeDecodingSpec)

public SpeculativeDecodingSpec(SpeculativeDecodingSpec other)

Parameter
Name	Description
other	SpeculativeDecodingSpec

Properties

DraftModelSpeculation

public SpeculativeDecodingSpec.Types.DraftModelSpeculation DraftModelSpeculation { get; set; }

draft model speculation.

Property Value
Type	Description
SpeculativeDecodingSpecTypesDraftModelSpeculation

NgramSpeculation

public SpeculativeDecodingSpec.Types.NgramSpeculation NgramSpeculation { get; set; }

N-Gram speculation.

Property Value
Type	Description
SpeculativeDecodingSpecTypesNgramSpeculation

SpeculationCase

public SpeculativeDecodingSpec.SpeculationOneofCase SpeculationCase { get; }

Property Value
Type	Description
SpeculativeDecodingSpecSpeculationOneofCase

SpeculativeTokenCount

public int SpeculativeTokenCount { get; set; }

The number of speculative tokens to generate at each step.

Property Value
Type	Description
int