Google Cloud Dataproc v1 API - Class PigJob (5.22.0) 

public sealed class PigJob : IMessage<PigJob>, IEquatable<PigJob>, IDeepCloneable<PigJob>, IBufferMessage, IMessage

Reference documentation and code samples for the Google Cloud Dataproc v1 API class PigJob.

A Dataproc job for running Apache Pig queries on YARN.

Inheritance

object > PigJob

Namespace

Google.Cloud.Dataproc.V1

Assembly

Google.Cloud.Dataproc.V1.dll

Constructors

PigJob()

public PigJob()

PigJob(PigJob)

public PigJob(PigJob other)
Parameter
Name Description
other PigJob

Properties

ContinueOnFailure

public bool ContinueOnFailure { get; set; }

Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.

Property Value
Type Description
bool

HasQueryFileUri

public bool HasQueryFileUri { get; }

Gets whether the "query_file_uri" field is set

Property Value
Type Description
bool

JarFileUris

public RepeatedField<string> JarFileUris { get; }

Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.

Property Value
Type Description
RepeatedFieldstring

LoggingConfig

public LoggingConfig LoggingConfig { get; set; }

Optional. The runtime log config for job execution.

Property Value
Type Description
LoggingConfig

Properties

public MapField<string, string> Properties { get; }

Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API might be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.

Property Value
Type Description
MapFieldstringstring

QueriesCase

public PigJob.QueriesOneofCase QueriesCase { get; }
Property Value
Type Description
PigJobQueriesOneofCase

QueryFileUri

public string QueryFileUri { get; set; }

The HCFS URI of the script that contains the Pig queries.

Property Value
Type Description
string

QueryList

public QueryList QueryList { get; set; }

A list of queries.

Property Value
Type Description
QueryList

ScriptVariables

public MapField<string, string> ScriptVariables { get; }

Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).

Property Value
Type Description
MapFieldstringstring