ChipNeMo is a project released by NVIDIA exploring the application of large language models (LLMs) in industrial chip design. Unlike directly using existing commercial or open-source LLMs, ChipNeMo utilizes domain-specific techniques like a customized tokenizer, domain-adapted continuous pre-training, supervised fine-tuning (SFT) with domain-specific instructions, and a domain-adapted retrieval model.