- Resource: HiveTable
- StorageDescriptor
- FieldSchema
- SerdeInfo
- SerdeType
- Order
- SkewedInfo
- SkewedColumnValue
- SkewedKeyValuesLocation
- Methods
Resource: HiveTable
Stores the hive table information. It includes the table name, schema (column names and types), data location, storage format, serde info, etc. This message closely matches the Table object in the IMetastoreClient
| JSON representation |
|---|
{ "name": string, "description": string, "storageDescriptor": { object ( |
| Fields | |
|---|---|
name |
Identifier. The resource name. Format: projects/{project_id_or_number}/catalogs/{catalogId}/databases/{databaseId}/tables/{tableId} |
description |
Optional. Description of the table. The maximum length is 4000 characters. |
storageDescriptor |
Required. Storage descriptor of the table. |
createTime |
Output only. The creation time of the table. Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: |
partitionKeys[] |
Optional. The partition keys of the table. |
parameters |
Optional. Stores the properties associated with the table. The maximum size is 4MiB. An object containing a list of |
tableType |
Output only. The type of the table. This is EXTERNAL for BigLake hive tables. |
updateTime |
Output only. The update time of the table. Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: |
StorageDescriptor
Contains information about the physical storage of the table data.
| JSON representation |
|---|
{ "columns": [ { object ( |
| Fields | |
|---|---|
columns[] |
Required. Specifies the columns of the table. |
locationUri |
Optional. The Cloud storage uri where the table is located. Defaults to |
inputFormat |
Optional. The fully qualified Java class name of the input format. The maximum length is 4000 characters. |
outputFormat |
Optional. The fully qualified Java class name of the output format. The maximum length is 4000 characters. |
serdeInfo |
Optional. Serialization and deserialization information. |
bucketCols[] |
Optional. Reducer grouping columns and clustering columns and bucketing columns |
sortCols[] |
Optional. Sort order of the data in each bucket |
parameters |
Optional. Key-value pairs for the storage descriptor. The maximum size is 10Kib. An object containing a list of |
skewedInfo |
Optional. Table data skew information. |
compressed |
Optional. Whether the table is compressed. |
numBuckets |
Optional. The number of buckets in the table. |
storedAsSubDirs |
Optional. Whether the table is stored as sub directories. |
FieldSchema
Field schema information.
| JSON representation |
|---|
{ "name": string, "type": string, "comment": string } |
| Fields | |
|---|---|
name |
Required. Name of the field. The maximum length is 767 characters. |
type |
Required. Type of the field. The maximum length is 128 characters. |
comment |
Optional. Comment of the field. The maximum length is 256 characters. |
SerdeInfo
Serialization and deserialization information.
| JSON representation |
|---|
{
"name": string,
"serializationLib": string,
"description": string,
"parameters": {
string: string,
...
},
"serializerClass": string,
"deserializerClass": string,
"serdeType": enum ( |
| Fields | |
|---|---|
name |
Required. Name of the SerDe. Table name by default. The maximum length is 128 characters. |
serializationLib |
Required. The fully qualified Java class name of the serialization library. The maximum length is 4000 characters. |
description |
Optional. Description of the serde. The maximum length is 4000 characters. |
parameters |
Optional. Parameters of the serde. The maximum size is 10Kib. An object containing a list of |
serializerClass |
Optional. The fully qualified Java class name of the serializer. The maximum length is 4000 characters. |
deserializerClass |
Optional. The fully qualified Java class name of the deserializer. The maximum length is 4000 characters. |
serdeType |
Optional. The serde type. |
SerdeType
The serde types.
| Enums | |
|---|---|
SERDE_TYPE_UNSPECIFIED |
The serde type is not specified. |
HIVE |
Hive. |
SCHEMA_REGISTRY |
Schema registry. |
Order
Sort order of the stored data per column.
| JSON representation |
|---|
{ "col": string, "order": integer } |
| Fields | |
|---|---|
col |
Required. The column name. The maximum length is 767 characters. |
order |
Required. Defines the sort order of the column. Ascending if 1, descending if 0. |
SkewedInfo
Stores all the information about skewed table.
| JSON representation |
|---|
{ "skewedColNames": [ string ], "skewedColValues": [ { object ( |
| Fields | |
|---|---|
skewedColNames[] |
Required. The column names that are skewed. The maximum length is 256 characters per column name. |
skewedColValues[] |
Required. The skewed column values. |
skewedKeyValuesLocations[] |
Required. The skewed key values locations. |
SkewedColumnValue
The skewed column values.
| JSON representation |
|---|
{ "values": [ string ] } |
| Fields | |
|---|---|
values[] |
Required. The skewed column values. The maximum length is 256 characters per value. |
SkewedKeyValuesLocation
The skewed key values and their corresponding location.
| JSON representation |
|---|
{ "values": [ string ], "location": string } |
| Fields | |
|---|---|
values[] |
Required. The skewed column values. The maximum length is 256 characters per value. |
location |
Required. The location of the skewed column values. The maximum length is 4000 characters. |
Methods |
|
|---|---|
|
Creates a new hive table. |
|
Deletes an existing table specified by the table name. |
|
Gets the table specified by the resource name. |
|
List all hive tables in a specified project under the hive catalog and database. |
|
Updates an existing table specified by the table name. |