ComfyUI/docs/llm.md

Large Language Models

ComfyUI LTS supports text and multi-modal LLM models from the transformers ecosystem. This means all the LLaMA family models, LLAVA-NEXT, Phi-3, etc. are supported out-of-the-box with no configuration necessary.

In this example, LLAVA-NEXT (LLAVA 1.6) is prompted to describe an image.

You can try the LLAVA-NEXT, Phi-3, and two translation workflows.