braintrust@3.9.0

Notable Changes

• feat: Add instrumentation for @huggingface/inference (#1807)
• feat: Add cohere-ai instrumentation (#1781)
• feat: Add reranking instrumentation for AI SDK and Openrouter SDK #1824
• feat: Instrument Google GenAI embedContent for text (#1821)
• feat: Instrument Anthropic SDK tool runner (1833)

Other Changes

• feat: Capture grounding metadata for Google GenAI (#1773)
• feat: Track server tool use metrics for anthropic SDK (#1772)
• feat: Add per-input trialCount support to Eval() (#1814)
• feat(claude-agent-sdk): Improve task lifecycle and lifecycle details (#1777)
• feat: Add x-bt-use-gateway header to allowed CORS headers (#1836)
• perf: Remove zod from deepCopyEvent (#1796)
• fix(auto-instrumentation): Use sync channel for AI SDK CJS streamText/streamObject in v4+ (#1768)
• fix: Give AI SDK top-level api spans type function (#1769)
• fix(openai): Collect logprob and refulsals output for streaming APIs (#1774)
• fix(claude-agent-sdk): Don't drop tool spans for spawning subagents (#1779)
• fix: Capture anthropic server tool use inputs for streaming APIs (#1776)
• fix(ai-sdk): Restore prompt cache metrics (#1825)
• fix(openai-agents): End child spans on trace end (#1813)
• chore(auto-instrumentation): Upgrade @apm-js-collab/code-transformer to v0.12.0 (#1708)

JavaScript SDK v3.8.0

Changelog

Features

• Add @openrouter/agent instrumentation (#1761)
• Add instrumentation for OpenAI responses.compact() (#1753)
• Add embedding instrumentation to AI SDK (#1754)
• Add instrumentation for @mistralai/mistralai (#1730)

Bug Fixes

• Fix claude agent SDK tool nesting (#1755)
• Fix AI SDK streaming version handling for v3/v4+/v5 (#1739)
• Add tracing polyfill to workerd and edge-light runtimes (#1751)
• Propagate TracingChannel span context in OTEL compat mode (#1724)
• Allow sending undefined source for remote eval params (#1737)

Package: https://www.npmjs.com/package/braintrust/v/3.8.0

Full Changelog: js-sdk-v3.7.1...js-sdk-v3.8.0

JavaScript SDK v3.7.1

Changelog

Bug Fixes

• Preserve all streaming content block types (#1695)
• Fix wrapOpenAI breaking native private fields of client (#1704)
• Propagate templateFormat in ScorerBuilder.create() (#1706)
• Rehydrate remote prompt parameters (#1697)

Other Changes

• Use diagnostics channels for ai sdk wrapper (#1675)
• Use diagnostics channel for openrouter wrapper (#1677)
• Use diagnostics channel for anthropic wrapper (#1679)
• Use diagnostics channel for claude agent sdk wrapper (#1678)
• Use diagnostics channel for google gen ai wrapper (#1676)

Package: https://www.npmjs.com/package/braintrust/v/3.7.1

Full Changelog: js-sdk-v3.7.0...js-sdk-v3.7.1

JavaScript SDK v3.7.0

Changelog

Features

• Add webpack loader for Turbopack support (#1647)

Bug Fixes

• Align Google GenAI auto traces with wrappers (#1636)
• Align Claude agent SDK trace parity between auto-instrumentation and wrappers (#1638)
• Align Anthropic auto-instrumentation with wrappers (#1639)
• Fully preserve returned promise in tracing channel hook (#1617)

Package: https://www.npmjs.com/package/braintrust/v/3.7.0

Full Changelog: js-sdk-v3.6.0...js-sdk-v3.7.0

JavaScript SDK v3.6.0

Changelog

Features

• Add instrumentation for OpenRouter SDK (#1595)

Bug Fixes

• APIPromise workaround in bundlers (#1623)

Maintenance

• Bump version for 3.6.0 (#1630)
• Add e2e tests for jest-node scenario (#1624)

Other Changes

• Feat/fix: Keep track of span context for spans started via channel tracing (#1589)
• Prefer version over environment in JS loaders (#1603)

Package: https://www.npmjs.com/package/braintrust/v/3.6.0

Full Changelog: js-sdk-v3.5.0...js-sdk-v3.6.0

JavaScript SDK v3.5.0

Changelog

Features

• Support Agent tool call tracing for AI SDK v5/v6 auto instrumentation (#1575)
• Attach saved parameters to experiments (#1550)
• Allow associating created prompts with environments (#1489)

Bug Fixes

• Resolve edge AsyncLocalStorage from runtime builtins (#1611)
• Re-throw any queue errors that occurred (#1583)
• Make param types that are forwarded backwards compatible with older open ai SDKs (#1602)
• Preserve .withResponse() on embeddings and moderations create (#1587)
• Make sure params get passed through for compiled prompt (#1558)
• Flush pass in evaluator state if it exists (#1581)
• Record tools in metadata for AI SDK and Google gen ai (#1570)
• Make AI SDK Agent span nodes use use type function (#1568)

Other Changes

• Handle arrays of images when building prompts (#1247)

Package: https://www.npmjs.com/package/braintrust/v/3.5.0

Full Changelog: js-sdk-v3.4.0...js-sdk-v3.5.0

JavaScript SDK v3.4.0

Changelog

Features

• Add model parameter support (#1504)
• Add internal logger (#1526)
• Allow setting tags for all function types (#1533)
• Allow setting tags via prompts.create() (#1531)
• Add sandbox registration and types (#1494)
• Add node test runner integration (#1481)

Bug Fixes

• Fix auto-instrumentation by preserving return semantics from tracePromise and adding isomorphic interface for diagnostics channels (#1501)
• Fix _internal_btql.limit and _internal_btql.cursor being silently overwritten (#1497)

Other Changes

• Update BTQL AST (#1385)
• Use diagnostic channels for OpenAI SDK wrapper (#1499)
• Add duplicate_treatment to btql ast in submodules (#1484)

Package: https://www.npmjs.com/package/braintrust/v/3.4.0

Full Changelog: js-sdk-v3.3.0...js-sdk-v3.4.0

js-sdk-v3.3.0

Changelog

• Add sandbox registration and types (#1337)
• test(ai-sdk): Ensure prompt gets linked with streamText (#1471)
• perf: Improve eval runtime performance (#1459)
• ref: Set @typescript-eslint/prefer-as-const lint rule from warn to error (#1458)

js-sdk-v3.2.0

Changelog

• vitest evals (#1232)
• meta: Remove Python related code from this repo (#1403)
• Auto-instrumentation for TypeScript (#1302)
• add typespec updates for sandboxes (#1392)

Full Changelog: js-sdk-v3.1.0...js-sdk-v3.2.0

js-sdk-v3.1.0

Changelog

• feat(eval): Allow for tags to be passed in at experiment creation time (#1389)
• fix(ai-sdk): Make sure tokens are not double counted between parent/child spans (#1379)