Google Cloud Dataproc v1 API - Class SparkSqlJob (5.22.0) 

public sealed class SparkSqlJob : IMessage<SparkSqlJob>, IEquatable<SparkSqlJob>, IDeepCloneable<SparkSqlJob>, IBufferMessage, IMessage

Reference documentation and code samples for the Google Cloud Dataproc v1 API class SparkSqlJob.

A Dataproc job for running Apache Spark SQL queries.

Inheritance

object > SparkSqlJob

Namespace

Google.Cloud.Dataproc.V1

Assembly

Google.Cloud.Dataproc.V1.dll

Constructors

SparkSqlJob()

public SparkSqlJob()

SparkSqlJob(SparkSqlJob)

public SparkSqlJob(SparkSqlJob other)
Parameter
Name Description
other SparkSqlJob

Properties

HasQueryFileUri

public bool HasQueryFileUri { get; }

Gets whether the "query_file_uri" field is set

Property Value
Type Description
bool

JarFileUris

public RepeatedField<string> JarFileUris { get; }

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.

Property Value
Type Description
RepeatedFieldstring

LoggingConfig

public LoggingConfig LoggingConfig { get; set; }

Optional. The runtime log config for job execution.

Property Value
Type Description
LoggingConfig

Properties

public MapField<string, string> Properties { get; }

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API might be overwritten.

Property Value
Type Description
MapFieldstringstring

QueriesCase

public SparkSqlJob.QueriesOneofCase QueriesCase { get; }
Property Value
Type Description
SparkSqlJobQueriesOneofCase

QueryFileUri

public string QueryFileUri { get; set; }

The HCFS URI of the script that contains SQL queries.

Property Value
Type Description
string

QueryList

public QueryList QueryList { get; set; }

A list of queries.

Property Value
Type Description
QueryList

ScriptVariables

public MapField<string, string> ScriptVariables { get; }

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).

Property Value
Type Description
MapFieldstringstring