"Managed Service for Apache Spark" is the new name for the product formerly known as "Dataproc on Compute Engine" (cluster deployment) and "Google Cloud Serverless for Apache Spark" (serverless deployment).
Overview of APIs and Client Libraries
Stay organized with collections
Save and categorize content based on your preferences.
Available interfaces
You can use one of several programmatic interfaces when interacting with
Managed Service for Apache Spark. These are the available interfaces, in the order that
we recommend using them:
Google Cloud Client Libraries:
Managed Service for Apache Spark
(alpha and beta release)
client libraries are available in multiple languages and
are built on gRPC. These client
libraries provide a layer of abstraction on top of
gRPC and handle the details of operation polling, retries, and more.
gRPC: If a client library is not available
for your programming language of choice, you can generate gRPC client
libraries for Dataproc in any gRPC-supported language. To do this, you'll
need the
protocol buffers
service definition available from
our repository on GitHub.
You can then follow the instructions for your preferred language on
grpc.io to generate and use your
client.
REST API: If you're unable
to use Managed Service for Apache Spark's client libraries or the gRPC API, use the REST API.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2026-04-08 UTC."],[],[]]