Braintrust

Braintrust is an AI engineering platform for managing prompts, datasets, experiments, evaluations, observability, and production AI applications.

What agents can do

Create dataset
Create a named dataset under a Braintrust project, or return the existing dataset unchanged when its name already exists in that project.
Create experiment
Create an experiment under a Braintrust project.
Create project
Create a Braintrust project, or return the existing project unchanged when its name already exists.
Create prompt
Upsert a versioned prompt configuration under a Braintrust project without invoking it.
Delete project
Soft-delete a Braintrust project and return its deletion state.
Delete resource
Delete one Braintrust experiment, dataset, or prompt by UUID for explicit lifecycle cleanup.
Fetch events
Fetch one newest-to-oldest page of project log, experiment, or dataset events.
Get resource
Get one project, experiment, dataset, prompt, or function by UUID.

9 more

Insert dataset events
Upsert a batch of examples into an existing Braintrust dataset.
Insert experiment events
Upsert a batch of result events into an existing Braintrust experiment.
List resources
List and filter one page of projects, experiments, datasets, prompts, or functions visible to the connected Braintrust API key.
Query data
Run one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment, or a dataset.
Summarize resource
Return metadata and optional aggregate summaries for one Braintrust experiment or dataset.
Update dataset
Update the name, description, tags, or metadata of a Braintrust dataset.
Update experiment
Update selected metadata and linkage fields on a Braintrust experiment.
Update project
Update selected fields of a Braintrust project.
Update prompt
Update a Braintrust prompt's metadata or configuration without invoking it.

You paste an API key from Braintrust on a page Composio hosts, so the key never passes through Definable.

Keep the connection to yourself or share it with your workspace. Any action that writes or sends can wait for your approval.