Model monitoring data input spec.
datasetUnion type
dataset can be only one of the following:Columnized dataset.
Vertex AI Batch prediction Job.
Vertex AI Endpoint request & response logging.
time_specUnion type
time_spec can be only one of the following:The time interval (pair of startTime and endTime) for which results should be returned.
The time offset setting for which results should be returned.
| JSON representation |
|---|
{ // dataset "columnizedDataset": { object ( |
ModelMonitoringDataset
Input dataset spec.
timestampFieldstring
The timestamp field. Usually for serving data.
data_locationUnion type
data_location can be only one of the following:vertexDatasetstring
Resource name of the Vertex AI managed dataset.
Google Cloud Storage data source.
BigQuery data source.
| JSON representation |
|---|
{ "timestampField": string, // data_location "vertexDataset": string, "gcsSource": { object ( |
ModelMonitoringGcsSource
Dataset spec for data stored in Google Cloud Storage.
gcsUristring
Google Cloud Storage URI to the input file(s). May contain wildcards. For more information on wildcards, see https://cloud.google.com/storage/docs/wildcards.
data format of the dataset.
| JSON representation |
|---|
{
"gcsUri": string,
"format": enum ( |
DataFormat
Supported data format.
| Enums | |
|---|---|
DATA_FORMAT_UNSPECIFIED |
data format unspecified, used when this field is unset. |
CSV |
CSV files. |
TF_RECORD |
TfRecord files |
JSONL |
JsonL files. |
ModelMonitoringBigQuerySource
Dataset spec for data sotred in BigQuery.
connectionUnion type
connection can be only one of the following:tableUristring
BigQuery URI to a table, up to 2000 characters long. All the columns in the table will be selected. Accepted forms:
- BigQuery path. For example:
bq://projectId.bqDatasetId.bqTableId.
querystring
Standard SQL to be used instead of the tableUri.
| JSON representation |
|---|
{ // connection "tableUri": string, "query": string // Union type } |
BatchPredictionOutput
data from Vertex AI Batch prediction job output.
batchPredictionJobstring
Vertex AI Batch prediction job resource name. The job must match the model version specified in [ModelMonitor].[modelMonitoringTarget].
| JSON representation |
|---|
{ "batchPredictionJob": string } |
VertexEndpointLogs
data from Vertex AI Endpoint request response logging.
endpoints[]string
List of endpoint resource names. The endpoints must enable the logging with the [Endpoint].[requestResponseLoggingConfig], and must contain the deployed model corresponding to the model version specified in [ModelMonitor].[modelMonitoringTarget].
| JSON representation |
|---|
{ "endpoints": [ string ] } |
TimeOffset
time offset setting.
offsetstring
[offset] is the time difference from the cut-off time. For scheduled jobs, the cut-off time is the scheduled time. For non-scheduled jobs, it's the time when the job was created. Currently we support the following format: 'w|W': Week, 'd|D': Day, 'h|H': Hour E.g. '1h' stands for 1 hour, '2d' stands for 2 days.
windowstring
[window] refers to the scope of data selected for analysis. It allows you to specify the quantity of data you wish to examine. Currently we support the following format: 'w|W': Week, 'd|D': Day, 'h|H': Hour E.g. '1h' stands for 1 hour, '2d' stands for 2 days.
| JSON representation |
|---|
{ "offset": string, "window": string } |