PR Custody

PRPR Custody

fix: Disable LangSmith to restore result metadata capture (fixes 188 errors)

@sohamganatrachecks n/achecks…fix/disable-langsmith-restore-result-metadata → next1 files · +14 −1updated 2w ago

GitHub

▸Description· 2 comments

Summary

Disabled LangSmith by default to fix "Agent completed without result metadata" errors
Added ENABLE_LANGSMITH env var to opt-in if ever needed

Problem

Datadog trace analysis revealed 188 occurrences of:

Agent '{}' completed without result metadata - usage metrics will not be recorded

Root cause: LangSmith was configured at module import and intercepted the Claude SDK stream. It failed with:

ModuleNotFoundError: No module named 'langsmith.integrations.claude_agent_sdk._usage'

This prevented ResultMessage from flowing through to the Datadog tracer, so _process_result_message() was never called and usage metrics were lost.

Evidence from Datadog

Workflow ID: lvdryagv (from PR #7787)
188x "Agent completed without result metadata" errors
7x "Error while tracing Claude Agent stream" with ModuleNotFoundError

Solution

LangSmith is now disabled by default (no env var = disabled)
Set ENABLE_LANGSMITH=true to re-enable if needed
Added documentation in the function explaining the issue

Impact

Restores usage metrics capture (input/output tokens, cost, etc.)
Fixes observability gap in Datadog LLM monitoring

Test plan

Verified syntax is correct
Deploy and verify result metadata is captured in Datadog

🤖 Generated with Claude Code

@sohamganatra5mo ago

@copilot correct the linting issue

@Copilotagent5mo ago

@sohamganatra I've opened a new pull request, #782, to work on those changes. Once the pull request is ready, I'll request review from you.

loading diff…