basic-llm-wrapper-cli-flask
PublicBasic LLM wrapper with 3 consumers: CLI, Flask, and load/scaling test. Works with HuggingFace models like Llama and TinyLlama (and others).
Basic LLM wrapper with 3 consumers: CLI, Flask, and load/scaling test. Works with HuggingFace models like Llama and TinyLlama (and others).