Usage
view: my_view {
derived_table: {
table_format: PARQUET
...
}
}
|
Hierarchy
table_format |
Default Value
PARQUET
Accepts
PARQUET, ORC, AVRO, JSON, or TEXTFILE
Special Rules
table_format is supported only on specific dialects
|
Definition
The table_format parameter specifies the format that a persistent derived table (PDT) will have in an Athena database, which can be one of the following:
- Parquet
- Optimized Row Columnar (ORC)
- Avro
- JavaScript Object Notation (JSON)
- Text file
See the Amazon Athena documentation for details.
See the Dialect support for
table_formatsection for the list of dialects that supporttable_format.
The
table_formatparameter works only with tables that are persistent, such as PDTs and aggregate tables.table_formatis not supported for derived tables without a persistence strategy.
Examples
Create a customer_order_facts PDT on an Amazon Athena database using ORC format:
view: customer_order_facts {
derived_table: {
explore_source: order {
column: customer_id { field: order.customer_id }
column: date { field: order.order_time }
column: city { field: users.city }
column: age_tier { field: users.age_tier }
derived_column: num_orders {
sql: COUNT(order.customer_id) ;;
}
}
table_format: ORC
table_compression: SNAPPY
datagroup_trigger: daily_datagroup
}
}
Dialect support for table_format
The ability to use table_format depends on the database dialect your Looker connection is using. In the latest release of Looker, the following dialects support table_format:
| Dialect | Supported? |
|---|---|
| Actian Avalanche | |
| Amazon Athena | |
| Amazon Aurora MySQL | |
| Amazon Redshift | |
| Amazon Redshift 2.1+ | |
| Amazon Redshift Serverless 2.1+ | |
| Apache Druid | |
| Apache Druid 0.13+ | |
| Apache Druid 0.18+ | |
| Apache Hive 2.3+ | |
| Apache Hive 3.1.2+ | |
| Apache Spark 3+ | |
| ClickHouse | |
| Cloudera Impala 3.1+ | |
| Cloudera Impala 3.1+ with Native Driver | |
| Cloudera Impala with Native Driver | |
| DataVirtuality | |
| Databricks | |
| Denodo 7 | |
| Denodo 8 & 9 | |
| Dremio | |
| Dremio 11+ | |
| Exasol | |
| Google BigQuery Legacy SQL | |
| Google BigQuery Standard SQL | |
| Google Cloud PostgreSQL | |
| Google Cloud SQL | |
| Google Spanner | |
| Greenplum | |
| HyperSQL | |
| IBM Netezza | |
| MariaDB | |
| Microsoft Azure PostgreSQL | |
| Microsoft Azure SQL Database | |
| Microsoft Azure Synapse Analytics | |
| Microsoft SQL Server 2008+ | |
| Microsoft SQL Server 2012+ | |
| Microsoft SQL Server 2016 | |
| Microsoft SQL Server 2017+ | |
| MongoBI | |
| MySQL | |
| MySQL 8.0.12+ | |
| Oracle | |
| Oracle ADWC | |
| PostgreSQL 9.5+ | |
| PostgreSQL pre-9.5 | |
| PrestoDB | |
| PrestoSQL | |
| SAP HANA | |
| SAP HANA 2+ | |
| SingleStore | |
| SingleStore 7+ | |
| Snowflake | |
| Teradata | |
| Trino | |
| Vector | |
| Vertica |