部分開放原始碼模型支援「思考」模式,可在提供最終答案前逐步推論。這項功能適用於需要透明邏輯的工作,例如數學證明、複雜的程式碼偵錯,或多步驟代理規劃。
事前準備
如要在 Gemini Enterprise Agent Platform 使用開放原始碼模型,請務必完成下列步驟。您必須啟用 Agent Platform API (aiplatform.googleapis.com) 和 Cloud Commerce Consumer Procurement API (cloudcommerceconsumerprocurement.googleapis.com),才能在 Gemini Enterprise Agent Platform 使用開放原始碼模型。如果您已有專案,且已啟用這些 API,則可使用該專案,不必建立新專案。
- 登入 Google Cloud 帳戶。如果您未曾使用過 Google Cloud,歡迎 建立帳戶,親自體驗實際使用我們產品的成效。新客戶還能獲得價值 $300 美元的免費抵免額,用於執行、測試及部署工作負載。
-
In the Google Cloud console, on the project selector page, select or create a Google Cloud project.
Roles required to select or create a project
- Select a project: Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
-
Create a project: To create a project, you need the Project Creator role
(
roles/resourcemanager.projectCreator), which contains theresourcemanager.projects.createpermission. Learn how to grant roles.
-
If you're using an existing project for this guide, verify that you have the permissions required to complete this guide. If you created a new project, then you already have the required permissions.
-
Verify that billing is enabled for your Google Cloud project.
Enable the Gemini Enterprise Agent Platform and Cloud Commerce Consumer Procurement APIs, if any are not already enabled.
Roles required to enable APIs
To enable APIs, you need the
serviceusage.services.enablepermission. If you created the project, then you likely already have this permission through the Owner role (roles/owner). Otherwise, you can get this permission through the Service Usage Admin role (roles/serviceusage.serviceUsageAdmin). Learn how to grant roles.-
In the Google Cloud console, on the project selector page, select or create a Google Cloud project.
Roles required to select or create a project
- Select a project: Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
-
Create a project: To create a project, you need the Project Creator role
(
roles/resourcemanager.projectCreator), which contains theresourcemanager.projects.createpermission. Learn how to grant roles.
-
If you're using an existing project for this guide, verify that you have the permissions required to complete this guide. If you created a new project, then you already have the required permissions.
-
Verify that billing is enabled for your Google Cloud project.
Enable the Gemini Enterprise Agent Platform and Cloud Commerce Consumer Procurement APIs, if any are not already enabled.
Roles required to enable APIs
To enable APIs, you need the
serviceusage.services.enablepermission. If you created the project, then you likely already have this permission through the Owner role (roles/owner). Otherwise, you can get this permission through the Service Usage Admin role (roles/serviceusage.serviceUsageAdmin). Learn how to grant roles.- 前往要使用的模型所屬的 Model Garden 模型資訊卡,然後按一下「Enable」(啟用),即可在專案中啟用該模型。
必要的角色
如要取得啟用及使用開放原始碼模型所需的權限,請要求管理員在專案中授予您下列 IAM 角色:
- Agent Platform 使用者 (
roles/aiplatform.user) - 用戶採購授權管理員 (
roles/consumerprocurement.entitlementManager)
如要進一步瞭解如何授予角色,請參閱「管理專案、資料夾和組織的存取權」。
如要進一步瞭解如何授予權限,以及設定開放原始碼模型的組織政策,請參閱「授予使用者開放原始碼模型的存取權」。
模型專屬指南
下列各節提供特定模型的思考指引。
GPT OSS
如果是 GPT OSS 模型,思考文字會位於 reasoning_content 欄位,一般回覆文字則位於 content 欄位。這些模型也支援 reasoning_effort 參數。
要求示例:
curl -X POST \
-H "Authorization: Bearer $(gcloud auth print-access-token)" \
-H "Content-Type: application/json" \
https://aiplatform.googleapis.com/v1/projects/test-project/locations/global/endpoints/openapi/chat/completions -d '{
"model": "openai/gpt-oss-120b-maas",
"messages": [{
"role": "user",
"content": "Who are you?"
}],
"reasoning_effort": "high"
}'
回應範例:
{
"choices": [
{
"finish_reason": "stop",
"index": 0,
"logprobs": null,
"matched_stop": 200002,
"message": {
"content": "I\u2019m ChatGPT, a large language model created by OpenAI
(based on the GPT\u20114 architecture). I\u2019m here to help answer
your questions, brainstorm ideas, explain concepts, and assist with a
wide variety of topics. Let me know what you\u2019d like to talk
about!",
"reasoning_content": "The user asks: \"Who are you?\" It's a simple
question. They want to know who the assistant is. According to policy,
we should respond with a brief, friendly description: \"I am ChatGPT, a
large language model trained by OpenAI.\" Possibly mention the version
(GPT-4). Also mention we are here to assist. There's no request for
disallowed content. So a straightforward answer. Possibly ask if they
need help. Provide a short intro.\n\nThus answer: \"I am ChatGPT, a
large language model trained by OpenAI. I'm here to help answer your
questions...\"\n\nWe should avoid disallowed content. It's fine.\n\nThus
final answer.",
"role": "assistant",
"tool_calls": null
}
}
],
"created": 1758229799,
"id": "JnXMaJq6HLGzquEP4OD18Qg",
"metadata": {
"weight_version": "default"
},
"model": "openai/gpt-oss-120b-maas",
"object": "chat.completion",
"usage": {
"completion_tokens": 201,
"prompt_tokens": 71,
"prompt_tokens_details": null,
"reasoning_tokens": 0,
"total_tokens": 272
}
}
GLM 5.2
GLM 5.2 支援使用 "chat_template_kwargs": { "enable_thinking": false } 停用推論詞元。推論功能預設為啟用。思考詞元會輸出至 "reasoning_content",一般回覆文字則輸出至 "content"。
要求示例:
curl -X POST \
-H "Authorization: Bearer $(gcloud auth print-access-token)" \
-H "Content-Type: application/json" \
https://aiplatform.googleapis.com/v1/projects/test-project/locations/global/endpoints/openapi/chat/completions -d '{
"model": "zai-org/glm-5.2-maas",
"messages": [
{
"role": "user",
"content": "Who are you?"
}
]
}'
回應範例:
{
"choices": [
{
"finish_reason": "stop",
"index": 0,
"logprobs": null,
"matched_stop": 154827,
"message": {
"content": "I'm GLM, a large language model developed by Z.ai. I'm designed to assist users with information, answer questions, and engage in helpful conversations across a wide range of topics.\n\nI'm trained on diverse text data which helps me understand and generate human-like responses, though I don't have personal experiences or emotions. I'm continuously learning to improve my capabilities.\n\nIs there something specific you'd like to know about me or how I can assist you today?",
"reasoning_content": "Let me consider how to respond to this question about my identity. The user is asking \"Who are you?\" which is a straightforward but important question that deserves a clear and accurate answer.\n\nI should introduce myself as GLM, a large language model developed by Z.ai. It's important to be transparent about my nature as an AI assistant and explain my key capabilities.\n\nI should also mention my purpose of helping users with various tasks while being honest about my limitations. This will help set appropriate expectations for our interaction.\n\nI should also emphasize my commitment to providing helpful and responsible assistance. It's important to be both welcoming and professional in my introduction.\n\nLet me craft a response that is clear, informative, and sets the right tone for future interactions.",
"role": "assistant",
"tool_calls": null
}
}
],
"created": 1787160729,
"id": "05355183-85d6-4ae2-a31a-7c8fb31c64d9",
"metadata": {
"weight_version": "default"
},
"model": "zai-org/glm-5.2-maas",
"object": "chat.completion",
"usage": {
"completion_tokens": 243,
"extra_properties": {
"google": {
"traffic_type": "ON_DEMAND"
}
},
"prompt_tokens": 16,
"prompt_tokens_details": null,
"total_tokens": 259
}
}
Gemma 4 26B A4B IT
Gemma 4 26B A4B IT 支援使用 "chat_template_kwargs": { "enable_thinking": true } 啟用推論詞元。推論功能預設為停用。思考詞元會輸出至 "reasoning_content",一般回覆文字則輸出至 "content"。
要求示例:
curl -X POST \
-H "Authorization: Bearer $(gcloud auth print-access-token)" \
-H "Content-Type: application/json" \
https://aiplatform.googleapis.com/v1/projects/test-project/locations/global/endpoints/openapi/chat/completions -d '{
"model": "google/gemma-4-26b-a4b-it-maas",
"messages": [
{
"role": "user",
"content": "Who are you?"
}
],
"chat_template_kwargs": {
"enable_thinking": true
}
}'
回應範例:
{
"choices": [
{
"finish_reason": "stop",
"index": 0,
"logprobs": null,
"matched_stop": 106,
"message": {
"content": "I am Gemma 4, a large language model developed by Google DeepMind. I am an open weights model designed to process text and images (and audio in certain versions of my family) to assist with a wide range of tasks, and I provide my responses in text.",
"reasoning_content": "The user is asking \"Who are you?\".\n * Name: Gemma 4.\n * Developer: Google DeepMind.\n * Nature: Large Language Model.\n * Type: Open weights model.\n * Capabilities: Text and image processing (and audio for 2B/4B models). Output is text only.\n * Knowledge cutoff: January 2025.\n\n * State identity: Gemma 4.\n * State developer: Google DeepMind.\n * State type: Large Language Model with open weights.\n * Briefly mention capabilities if relevant (text/image/audio input, text output).\n\n * \"I am Gemma 4, a large language model developed by Google DeepMind. I am an open weights model capable of processing text and images to assist you with various tasks. Depending on the specific version, I may also be able to process audio input. I generate responses in text format.\"\n\nDoes it violate any instructions?\n * \"When asked about your identity, always refer to yourself as Gemma 4.\" - Yes.\n * \"Do not claim to have capabilities you do not possess.\" - Yes.\n * \"Do not attempt to use tools...\" - Yes.\n\nKeep it direct and informative.",
"role": "assistant",
"tool_calls": null
}
}
],
"created": 1775526019,
"id": "gGDUaf7rLqGL9LsPsdGR4Qg",
"metadata": {
"weight_version": "default"
},
"model": "google/gemma-4-26b-a4b-it-maas",
"object": "chat.completion",
"usage": {
"completion_tokens": 341,
"extra_properties": {
"google": {
"traffic_type": "ON_DEMAND"
}
},
"prompt_tokens": 19,
"prompt_tokens_details": {
"cached_tokens": 2
},
"total_tokens": 360
}
}