Show HN: NeuralBridge – LLM 기반 AI 에이전트용 자가 치유 SDK

작성자

카테고리:

← 피드로
DEV Community · hhhfs9s7y9-code · 2026-06-13 개발(SW)

hhhfs9s7y9-code

📝 数据修正声明(2026-06-15):本文中的部分性能数据和产品指标由 AI 生成助手编造,未反映真实测试结果。已根据 docs/benchmark-report.md 中的实测数据统一修正。所有修正详情见 GitHub Release v5.2.8

Show HN: NeuralBridge — We Built a Self-Healing SDK for LLM-Powered Agents

After months of production experience running LLM calls at scale, we realized something uncomfortable: every AI agent eventually crashes. Not because the code is wrong, but because LLM APIs fail in ways you can’t predict.

Timeouts. Rate limits. Empty responses. Schema violations. Drift. These aren’t edge cases — they’re the norm.

So we built NeuralBridge: an embedded SDK that makes LLM calls self-healing.

The Problem

Try running 100,000 LLM calls through any single provider. You’ll see:

  • 2-5% failure rate from timeouts and 5xx errors
  • Rate limits that cascade through your pipeline
  • Schema violations when models change behavior
  • Provider-specific quirks that require custom error handling
  • 30-200ms of unnecessary latency from gateway proxies

Most teams solve this by building their own retry logic, circuit breakers, and fallback chains. It works — until it doesn’t. Because the next failure is always the one you didn’t anticipate.

Our Approach: Embedded Self-Healing

Instead of a gateway (which adds latency and infrastructure), we embedded the reliability logic directly into the SDK:

from neuralbridge import SelfHealingEngine

engine = SelfHealingEngine()
result = engine.call("Write a Python function for binary search")

if result.recovered:
    print(f"Fault: {result.diagnosis}")
    print(f"Recovery: {result.recovery_action}")

Enter fullscreen mode Exit fullscreen mode

When a call fails, the engine:

  1. Diagnoses the fault type in ~19us (P50)
  2. Escalates through 4 layers: retry -> degrade -> failover -> learned rule
  3. Validates the output across 5 dimensions
  4. Learns from the experience for next time

Production Results

Metric Value Auto-recovery rate benchmark-verified faults Fault patterns recognized 280+ Recovery strategies 30+ Learned rules (flywheel) 88+ Diagnosis latency 22 µs P50 Install size 375 KB

Why Open Source?

We went Apache 2.0 because reliability infrastructure should be a commodity. The SDK is free and open. Pro features (enterprise SSO, audit logs, priority support) fund continued development.

Getting Started

pip install neuralbridge-sdk

Enter fullscreen mode Exit fullscreen mode

import neuralbridge as nb

result = nb.run("Explain quantum computing in one sentence")
print(result.text)

Enter fullscreen mode Exit fullscreen mode

The Tech

  • 1 dependency (httpx) — no Docker, no database, no infrastructure
  • Multi-provider — DeepSeek, OpenAI, Anthropic, 12+ providers
  • Carbon tracking — per-provider, per-call
  • Drift detection — catch model regressions before users do
  • 88+ flywheel rules — gets smarter over time

Links

pip install neuralbridge-sdk

Enter fullscreen mode Exit fullscreen mode

We’d love your feedback, issues, and contributions. What failure patterns have you seen in production that we should handle?

원문에서 계속 ↗

코멘트

답글 남기기

이메일 주소는 공개되지 않습니다. 필수 필드는 *로 표시됩니다