Caching Strategies

If Node A (Search) returns "The capital of France is Paris." And 5 steps later, Node F requests the same thing. The graph should serve it from cache.

Semantic Caching

Use a Vector Store to cache LLM responses. If query distance is < 0.05 (meaning "almost identical question"), return the cached answer. This cuts latency from 5s to 50ms.