Preview Flyte 2 for production, hosted on Union.ai
Register now
↗
Union.ai Docs
|
Product:
Flyte OSS
Union.ai BYOC
Union.ai Self-managed
Version:
v2
v1
Signup
User guide
Tutorials
Reference
Integrations
Platform deployment
Community
Release notes
Security
Union.ai Docs
User guide
Tutorials
Reference
Integrations
Platform deployment
Community
Release notes
Security
Signup
Documentation navigation for Byoc including user guides, tutorials, API references, and integration examples
LLM-optimized documentation
Run command options
Deploy command options
Migration from Flyte 1
Philosophy and imports
Container images
Configuration and CLI
Tasks and workflows
Secrets, resources, and caching
Parallelism and async
Triggers and dynamic workflows
Examples and common gotchas
Flyte CLI
Flyte SDK
Classes & Protocols
Packages
flyte
AppHandle
Cache
CachePolicy
Cron
Device
Environment
FixedRate
Image
ImageBuild
Link
PodTemplate
Resources
RetryStrategy
ReusePolicy
Secret
TaskEnvironment
Timeout
Trigger
flyte.app
AppEndpoint
AppEnvironment
ConnectorEnvironment
Domain
Link
Parameter
Port
RunOutput
Scaling
Timeouts
flyte.app.extras
FastAPIAppEnvironment
FastAPIPassthroughAuthMiddleware
FlyteWebhookAppEnvironment
flyte.config
Config
flyte.connectors
AsyncConnector
AsyncConnectorExecutorMixin
ConnectorRegistry
ConnectorService
Resource
ResourceMeta
flyte.connectors.utils
flyte.durable
flyte.errors
ActionAbortedError
ActionNotFoundError
BaseRuntimeError
CodeBundleError
CustomError
DeploymentError
ImageBuildError
ImagePullBackOffError
InitializationError
InlineIOMaxBytesBreached
InvalidImageNameError
InvalidPackageError
LogsNotYetAvailableError
ModuleLoadError
NonRecoverableError
NotInTaskContextError
OnlyAsyncIOSupportedError
OOMError
ParameterMaterializationError
PrimaryContainerNotFoundError
RemoteTaskNotFoundError
RemoteTaskUsageError
RestrictedTypeError
RetriesExhaustedError
RuntimeDataValidationError
RuntimeSystemError
RuntimeUnknownError
RuntimeUserError
SlowDownError
TaskInterruptedError
TaskTimeoutError
TraceDoesNotAllowNestedTasksError
UnionRpcError
flyte.extend
AsyncFunctionTaskTemplate
ImageBuildEngine
ImageBuilder
ImageChecker
TaskTemplate
flyte.extras
BatchStats
ContainerTask
CostEstimator
DynamicBatcher
Prompt
TokenBatcher
TokenEstimator
flyte.git
GitStatus
flyte.io
DataFrame
Dir
File
HashFunction
flyte.io.extend
DataFrameDecoder
DataFrameEncoder
DataFrameTransformerEngine
flyte.models
ActionID
ActionPhase
Checkpoints
CodeBundle
GroupData
NativeInterface
PathRewrite
RawDataPath
SerializationContext
TaskContext
flyte.notify
Email
NamedDelivery
NamedRule
Notification
Slack
Teams
Webhook
flyte.prefetch
HuggingFaceModelInfo
ShardConfig
StoredModelInfo
VLLMShardArgs
flyte.remote
Action
ActionDetails
ActionInputs
ActionOutputs
App
Project
Run
RunDetails
Secret
Task
TaskDetails
TimeFilter
Trigger
User
flyte.report
Report
flyte.sandbox
CodeTaskTemplate
ImageConfig
SandboxedConfig
SandboxedTaskTemplate
flyte.storage
ABFS
GCS
S3
Storage
flyte.syncify
Syncify
flyte.types
FlytePickle
Renderable
TypeEngine
TypeTransformer
TypeTransformerFailedError
Integrations
Anthropic
Classes
Packages
flyteplugins.anthropic
Agent
BigQuery
Classes
Packages
flyteplugins.bigquery
BigQueryConfig
BigQueryConnector
BigQueryTask
Code generation
Classes
Packages
flyteplugins.codegen
AutoCoderAgent
CodeGenEvalResult
CodePlan
CodeSolution
ErrorDiagnosis
ImageConfig
Dask
Classes
Packages
flyteplugins.dask
Dask
Scheduler
WorkerGroup
Databricks
Classes
Packages
flyteplugins.databricks
Databricks
DatabricksConnector
Gemini
Classes
Packages
flyteplugins.gemini
Agent
Human-in-the-Loop
Classes
Packages
flyteplugins.hitl
Event
JSONL
Classes
Packages
flyteplugins.jsonl
JsonlDir
JsonlFile
MLflow
Classes
Packages
flyteplugins.mlflow
Mlflow
OpenAI
flyteplugins.openai.agents
Polars
Classes
Packages
flyteplugins.polars.df_transformer
ParquetToPolarsDecodingHandler
ParquetToPolarsLazyFrameDecodingHandler
PolarsLazyFrameToParquetEncodingHandler
PolarsToParquetEncodingHandler
PyTorch
Classes
Packages
flyteplugins.pytorch
Elastic
Ray
Classes
Packages
flyteplugins.ray
HeadNodeConfig
RayJobConfig
WorkerNodeConfig
SGLang
Classes
Packages
flyteplugins.sglang
SGLangAppEnvironment
Snowflake
Classes
Packages
flyteplugins.snowflake
Snowflake
SnowflakeConfig
SnowflakeConnector
Spark
Classes
Packages
flyteplugins.spark
ParquetToSparkDecoder
Spark
SparkToParquetEncoder
Union
Classes
Packages
flyteplugins.union.cli
flyteplugins.union.internal.validate.validate.validate_pb2
flyteplugins.union.internal.validate.validate.validate_pb2_grpc
flyteplugins.union.remote
ApiKey
Assignment
Member
Policy
Role
User
flyteplugins.union.utils.auth
AppClientCredentials
vLLM
Classes
Packages
flyteplugins.vllm
VLLMAppEnvironment
Weights & Biases
Classes
Packages
flyteplugins.wandb
Wandb
WandbSweep
Uctl CLI
uctl
uctl version
uctl append
uctl append identityassignments
uctl apply
uctl apply app
uctl apply clusterconfig
uctl apply clusterconfigid
uctl apply clusterpoolconfig
uctl config
uctl config discover
uctl config docs
uctl config init
uctl config validate
uctl create
uctl create app
uctl create clusterpool
uctl create clusterpoolassignment
uctl create execution
uctl create policy
uctl create project
uctl create role
uctl delete
uctl delete app
uctl delete cluster
uctl delete cluster-pool-attributes
uctl delete cluster-resource-attribute
uctl delete clusterconfig
uctl delete clusterpool
uctl delete clusterpoolassignment
uctl delete execution
uctl delete execution-cluster-label
uctl delete execution-queue-attribute
uctl delete identityassignments
uctl delete plugin-override
uctl delete policy
uctl delete role
uctl delete task-resource-attribute
uctl delete workflow-execution-config
uctl demo
uctl demo exec
uctl demo reload
uctl demo start
uctl demo status
uctl demo teardown
uctl get
uctl get app
uctl get cluster
uctl get cluster-pool-attributes
uctl get cluster-resource-attribute
uctl get clusterconfig
uctl get clusterconfigs
uctl get clusterpool
uctl get clusterpoolconfig
uctl get clusterswithconfig
uctl get echo
uctl get execution
uctl get execution-cluster-label
uctl get execution-queue-attribute
uctl get executionoperation
uctl get identityassignment
uctl get launchplan
uctl get plugin-override
uctl get policy
uctl get project
uctl get role
uctl get task
uctl get task-resource-attribute
uctl get workflow
uctl get workflow-execution-config
uctl register
uctl register examples
uctl register files
uctl update
uctl update cluster-pool-attributes
uctl update cluster-resource-attribute
uctl update execution
uctl update execution-cluster-label
uctl update execution-queue-attribute
uctl update launchplan
uctl update launchplan-meta
uctl update plugin-override
uctl update project
uctl update task-meta
uctl update task-resource-attribute
uctl update workflow-execution-config
uctl update workflow-meta
The page you navigated to
does not exist, so we brought you to the closest page to it.
Union.ai BYOC
Reference
Integrations
vLLM
2.0.11
vLLM
LLM-optimized
This page
Full docs index
On this page
Ask AI
