Runtime Configuration¶
<<<<<<< agent-changes-20251022-210838
When constructing an agent run, you can pass a RunConfig to customize how the
agent interacts with models, handles audio, and streams responses. By default,
no streaming is enabled and inputs aren’t retained as artifacts. Use RunConfig
to override these defaults.
Class Definition¶
The RunConfig class holds configuration parameters for an agent's runtime behavior.
-
Python ADK uses Pydantic for this validation.
-
Java ADK typically uses immutable data classes.
class RunConfig(BaseModel):
"""Configs for runtime behavior of agents."""
model_config = ConfigDict(
extra='forbid',
)
speech_config: Optional[types.SpeechConfig] = None
response_modalities: Optional[list[str]] = None
save_input_blobs_as_artifacts: bool = False
support_cfc: bool = False
streaming_mode: StreamingMode = StreamingMode.NONE
output_audio_transcription: Optional[types.AudioTranscriptionConfig] = None
max_llm_calls: int = 500
public abstract class RunConfig {
public enum StreamingMode {
NONE,
SSE,
BIDI
}
public abstract @Nullable SpeechConfig speechConfig();
public abstract ImmutableList<Modality> responseModalities();
public abstract boolean saveInputBlobsAsArtifacts();
public abstract @Nullable AudioTranscriptionConfig outputAudioTranscription();
public abstract int maxLlmCalls();
// ...
}
Runtime Parameters¶
| Parameter | Python Type | Java Type | Default (Py / Java) | Description |
|---|---|---|---|---|
speech_config |
Optional[types.SpeechConfig] |
SpeechConfig (nullable via @Nullable) |
None / null |
Configures speech synthesis (voice, language) using the SpeechConfig type. |
response_modalities |
Optional[list[str]] |
ImmutableList<Modality> |
None / Empty ImmutableList |
List of desired output modalities (e.g., Python: ["TEXT", "AUDIO"]; Java: uses structured Modality objects). |
save_input_blobs_as_artifacts |
bool |
boolean |
False / false |
If true, saves input blobs (e.g., uploaded files) as run artifacts for debugging/auditing. |
streaming_mode |
StreamingMode |
Currently not supported | StreamingMode.NONE / N/A |
Sets the streaming behavior: NONE (default), SSE (server-sent events), or BIDI (bidirectional). |
output_audio_transcription |
Optional[types.AudioTranscriptionConfig] |
AudioTranscriptionConfig (nullable via @Nullable) |
None / null |
Configures transcription of generated audio output using the AudioTranscriptionConfig type. |
max_llm_calls |
int |
int |
500 / 500 |
Limits total LLM calls per run. 0 or negative means unlimited (warned); sys.maxsize raises ValueError. |
support_cfc |
bool |
Currently not supported | False / N/A |
Python: Enables Compositional Function Calling. Requires streaming_mode=SSE and uses the LIVE API. Experimental. |
context_window_compression |
Optional[types.ContextWindowCompressionConfig] |
None |
Configuration for context window compression. |
ContextWindowCompressionConfig for ADK's RunConfig ("context_window_compression" attribute)¶
Based on the typical structure in ADK and similar systems, ContextWindowCompressionConfig is used to automatically manage the size of the input provided to the LLM, preventing it from exceeding the model's context window limit.
Settings for ContextWindowCompressionConfig¶
-
trigger_tokens (int): Defines the threshold at which the compression mechanism is activated. When the total tokens in the context window exceed this number, the ADK (via the Live API) will trigger a "cleanup" or compression routine. Common values: 60,000 to 100,000 tokens.
-
sliding_window (types.SlidingWindow): Configures the specific behavior of the sliding window mechanism.
- Settings within SlidingWindow: target_tokens (int): The desired number of tokens to retain after compression. This value must be lower than trigger_tokens. For example, if you trigger at 100k tokens and target 80k, the oldest 20k tokens will be discarded or summarized to make room for new content
Minimal Use Example¶
To use this configuration, you pass it to the context_window_compression parameter of a RunConfig object:
from google.adk.agents import RunConfig
from google.adk import types
# Define the compression strategy
compression_config = types.ContextWindowCompressionConfig(
trigger_tokens=80000,
sliding_window=types.SlidingWindow(
target_tokens=40000
)
)
# Apply it to your RunConfig
run_config = RunConfig(
context_window_compression=compression_config,
# Usually used in tandem with BIDI/Live streaming
streaming_mode=types.StreamingMode.BIDI
)
# Example of how you might use the config (as commented in the original):
# async for event in runner.run_async(user_input, run_config=run_config):
# # ...
print("RunConfig created successfully with Context Window Compression:")
print(run_config)
speech_config¶
Note
The interface or definition of SpeechConfig is the same, irrespective of the language.
Speech configuration settings for live agents with audio capabilities. The
SpeechConfig class has the following structure:
class SpeechConfig(_common.BaseModel):
"""The speech generation configuration."""
voice_config: Optional[VoiceConfig] = Field(
default=None,
description="""The configuration for the speaker to use.""",
)
language_code: Optional[str] = Field(
default=None,
description="""Language code (ISO 639. e.g. en-US) for the speech synthesization.
Only available for Live API.""",
)
The voice_config parameter uses the VoiceConfig class:
class VoiceConfig(_common.BaseModel):
"""The configuration for the voice to use."""
prebuilt_voice_config: Optional[PrebuiltVoiceConfig] = Field(
default=None,
description="""The configuration for the speaker to use.""",
)
¶
class VoiceConfig(_common.BaseModel):
"""The configuration for the voice to use."""
prebuilt_voice_config: Optional[PrebuiltVoiceConfig] = Field(
default=None,
description="""The configuration for the speaker to use.""",
)
RunConfig controls how agents behave at runtime, including streaming mode,
speech settings, LLM call limits, and live agent options. Pass a RunConfig
to runner.run_async() or runner.run_live() to override default behavior.
```python from google.adk.agents.run_config import RunConfig, StreamingMode
main
config = RunConfig(
streaming_mode=StreamingMode.SSE,
max_llm_calls=200,
)
async for event in runner.run_async(
...,
run_config=config,
):
...
```
Manage sessions and context¶
For long-running sessions, you can control how much history is loaded and whether the context window is compressed:
get_session_config: Limits which events are fetched when loading a session. Usenum_recent_eventsorafter_timestampto avoid loading the full event history on every invocation.context_window_compression: Enables context window compression for LLM input, useful when sessions approach model context limits.
Enable streaming¶
To control how the agent delivers responses, set the streaming_mode parameter:
StreamingMode.NONE(default): The runner returns one complete response per turn. Suitable for CLI tools, batch processing, and synchronous workflows.StreamingMode.SSE: Server-Sent Events streaming. The runner yields partial events as the LLM generates, enabling typewriter-style UIs and real-time chat displays.StreamingMode.BIDI: Reserved for bidirectional streaming, but not used in the standardrun_async()path. For bidirectional streaming, userunner.run_live()instead.
Set support_cfc=True alongside StreamingMode.SSE to enable Compositional
Function Calling (CFC), which allows the model to dynamically compose and
execute function calls. CFC uses the Live API under the hood.
Experimental
CFC support is experimental and its API or behavior may change in future releases.
Configure audio and speech¶
For voice-enabled agents, configure speech synthesis, audio transcription, and response modalities.
speech_config: Sets the voice and language for speech output (e.g., the "Kore" voice withen-US).response_modalities: Controls output formats. Set to["AUDIO", "TEXT"]for agents that both speak and return text.output_audio_transcription/input_audio_transcription: Enable transcription of audio output from the model and audio input from the user. Both default toAudioTranscriptionConfig()in Python.
from google.adk.agents.run_config import RunConfig, StreamingMode
from google.genai import types
config = RunConfig(
speech_config=types.SpeechConfig(
language_code="en-US",
voice_config=types.VoiceConfig(
prebuilt_voice_config=types.PrebuiltVoiceConfig(
voice_name="Kore"
)
),
),
response_modalities=["AUDIO", "TEXT"],
streaming_mode=StreamingMode.SSE,
max_llm_calls=1000,
)
import { RunConfig, StreamingMode } from '@google/adk';
import { Modality } from '@google/genai';
const config: RunConfig = {
speechConfig: {
languageCode: "en-US",
voiceConfig: {
prebuiltVoiceConfig: {
voiceName: "Kore"
}
},
},
responseModalities: [Modality.AUDIO, Modality.TEXT],
streamingMode: StreamingMode.SSE,
maxLlmCalls: 1000,
};
import com.google.adk.agents.RunConfig;
import com.google.adk.agents.RunConfig.StreamingMode;
import com.google.common.collect.ImmutableList;
import com.google.genai.types.Modality;
import com.google.genai.types.PrebuiltVoiceConfig;
import com.google.genai.types.SpeechConfig;
import com.google.genai.types.VoiceConfig;
RunConfig runConfig =
RunConfig.builder()
.streamingMode(StreamingMode.SSE)
.maxLlmCalls(1000)
.responseModalities(ImmutableList.of(new Modality(Modality.Known.AUDIO), new Modality(Modality.Known.TEXT)))
.speechConfig(
SpeechConfig.builder()
.voiceConfig(
VoiceConfig.builder()
.prebuiltVoiceConfig(
PrebuiltVoiceConfig.builder().voiceName("Kore").build())
.build())
.languageCode("en-US")
.build())
.build();
Configure live agents¶
When using runner.run_live(), configure real-time behavior with these
additional parameters:
realtime_input_config: Configures how audio input is received from users.proactivity: Allows the model to respond proactively and ignore irrelevant input.enable_affective_dialog: WhenTrue, the model detects user emotions and adapts its tone accordingly.avatar_config: Configures an avatar for live agents.session_resumption: Enables transparent session resumption across disconnects.save_live_blob: WhenTrue, saves live audio and video data to the session and artifact service.tool_thread_pool_config: Runs tool executions in a background thread pool to keep the event loop responsive to user interruptions.
Not all parameters are available in every language. See the API reference for language-specific details.
from google.adk.agents.run_config import RunConfig, ToolThreadPoolConfig
config = RunConfig(
save_live_blob=True,
tool_thread_pool_config=ToolThreadPoolConfig(max_workers=8),
)
Thread pool and the GIL
Thread pools help with blocking I/O and C extensions that release the
GIL (e.g. time.sleep(), network calls, numpy). They do not help
with pure Python CPU-bound code since the GIL prevents true parallel
execution of Python bytecode.
Configure runtime limits and debugging¶
Use these parameters to control runtime guardrails and debugging:
max_llm_calls: Caps the total number of LLM calls per run (default: 500). Set to 0 or negative for unlimited calls, though this is not recommended for production. Values at or abovesys.maxsizeraise an error.save_input_blobs_as_artifacts: WhenTrue, saves input blobs (e.g., uploaded files) as run artifacts for debugging and auditing.custom_metadata: Adict[str, Any]of arbitrary metadata attached to the invocation, useful for tracing or logging.
API reference¶
For the complete list of fields, types, and defaults, see the API reference for your language: