Reference documentation and code samples for the Google Cloud Dataproc V1 Client class PySparkNotebookBatch.
A configuration for running a PySpark Notebook batch workload.
Generated from protobuf message google.cloud.dataproc.v1.PySparkNotebookBatch
Namespace
Google \ Cloud \ Dataproc \ V1Methods
__construct
Constructor.
| Parameters | |
|---|---|
| Name | Description |
data |
array
Optional. Data for populating the Message object. |
↳ notebook_file_uri |
string
Required. The HCFS URI of the notebook file to execute. |
↳ params |
array|Google\Protobuf\Internal\MapField
Optional. The parameters to pass to the notebook. |
↳ python_file_uris |
string[]
Optional. HCFS URIs of Python files to pass to the PySpark framework. |
↳ jar_file_uris |
string[]
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH. |
↳ file_uris |
string[]
Optional. HCFS URIs of files to be placed in the working directory of each executor |
↳ archive_uris |
string[]
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: |
getNotebookFileUri
Required. The HCFS URI of the notebook file to execute.
| Returns | |
|---|---|
| Type | Description |
string |
|
setNotebookFileUri
Required. The HCFS URI of the notebook file to execute.
| Parameter | |
|---|---|
| Name | Description |
var |
string
|
| Returns | |
|---|---|
| Type | Description |
$this |
|
getParams
Optional. The parameters to pass to the notebook.
| Returns | |
|---|---|
| Type | Description |
Google\Protobuf\Internal\MapField |
|
setParams
Optional. The parameters to pass to the notebook.
| Parameter | |
|---|---|
| Name | Description |
var |
array|Google\Protobuf\Internal\MapField
|
| Returns | |
|---|---|
| Type | Description |
$this |
|
getPythonFileUris
Optional. HCFS URIs of Python files to pass to the PySpark framework.
| Returns | |
|---|---|
| Type | Description |
Google\Protobuf\RepeatedField<string> |
|
setPythonFileUris
Optional. HCFS URIs of Python files to pass to the PySpark framework.
| Parameter | |
|---|---|
| Name | Description |
var |
string[]
|
| Returns | |
|---|---|
| Type | Description |
$this |
|
getJarFileUris
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
| Returns | |
|---|---|
| Type | Description |
Google\Protobuf\RepeatedField<string> |
|
setJarFileUris
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
| Parameter | |
|---|---|
| Name | Description |
var |
string[]
|
| Returns | |
|---|---|
| Type | Description |
$this |
|
getFileUris
Optional. HCFS URIs of files to be placed in the working directory of each executor
| Returns | |
|---|---|
| Type | Description |
Google\Protobuf\RepeatedField<string> |
|
setFileUris
Optional. HCFS URIs of files to be placed in the working directory of each executor
| Parameter | |
|---|---|
| Name | Description |
var |
string[]
|
| Returns | |
|---|---|
| Type | Description |
$this |
|
getArchiveUris
Optional. HCFS URIs of archives to be extracted into the working directory
of each executor. Supported file types:
.jar, .tar, .tar.gz, .tgz, and .zip.
| Returns | |
|---|---|
| Type | Description |
Google\Protobuf\RepeatedField<string> |
|
setArchiveUris
Optional. HCFS URIs of archives to be extracted into the working directory
of each executor. Supported file types:
.jar, .tar, .tar.gz, .tgz, and .zip.
| Parameter | |
|---|---|
| Name | Description |
var |
string[]
|
| Returns | |
|---|---|
| Type | Description |
$this |
|