Summary: GPTCache, a powerful caching library that can be used to speed up and lower the cost of chat applications that rely on the LLM service. GPTCache works as a memcache for AIGC applications, similar to how Redis works for traditional applications.
1 known vulnerabilityLatest: GHSA-xfqj-4cr9-9gr5 β GPTCache: File and image cache keys collide because BufferedReader.peek() only reads the buffered prefix View all β