llama2-chatbot-cpu
PublicA LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel? Extension For PyTorch with bfloat16.
A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel? Extension For PyTorch with bfloat16.