Meta-Llama-3-120B-Instruct is a large language model that is based on Meta-Llama-3-70B-Instruct and self-merged through MergeKit. It performs exceptionally well in creative writing, but may face challenges in other tasks. The model employs the Llama 3 chat template, with a default context window of 8K, which can be expanded through the rope(theta) parameter. The model may occasionally generate misspellings and tends to use uppercase letters during text generation.