llm-offline-inference
PublicA comprehensive toolkit for streamlining and simplifying the offline inference process for LLMs across various models and libraries.
A comprehensive toolkit for streamlining and simplifying the offline inference process for LLMs across various models and libraries.