Назад

Поддерживаемые модели

Ниже приведены списки поддерживаемых архитектур. Выбранная модель автоматически загрузится с Hugging Face

Список текстовых языковых моделей

Архитектура Модели Пример моделей с huggingface
AfmoeForCausalLM Afmoe TBA
ApertusForCausalLM Apertus swiss-ai/Apertus-8B-2509, swiss-ai/Apertus-70B-Instruct-2509, etc.
AquilaForCausalLM Aquila, Aquila2 BAAI/Aquila-7B, BAAI/AquilaChat-7B, etc.
ArceeForCausalLM Arcee (AFM) arcee-ai/AFM-4.5B-Base, etc.
ArcticForCausalLM Arctic Snowflake/snowflake-arctic-base, Snowflake/snowflake-arctic-instruct, etc.
BaiChuanForCausalLM Baichuan2, Baichuan baichuan-inc/Baichuan2-13B-Chat, baichuan-inc/Baichuan-7B, etc.
BailingMoeForCausalLM Ling inclusionAI/Ling-lite-1.5, inclusionAI/Ling-plus, etc.
BailingMoeV2ForCausalLM Ling inclusionAI/Ling-mini-2.0, etc.
BambaForCausalLM Bamba ibm-ai-platform/Bamba-9B-fp8, ibm-ai-platform/Bamba-9B
BloomForCausalLM BLOOM, BLOOMZ, BLOOMChat bigscience/bloom, bigscience/bloomz, etc.
ChatGLMModel, ChatGLMForConditionalGeneration ChatGLM zai-org/chatglm2-6b, zai-org/chatglm3-6b, ShieldLM-6B-chatglm3, etc.
CohereForCausalLM, Cohere2ForCausalLM Command-R, Command-A CohereLabs/c4ai-command-r-v01, CohereLabs/c4ai-command-r7b-12-2024, CohereLabs/c4ai-command-a-03-2025, CohereLabs/command-a-reasoning-08-2025, etc.
DbrxForCausalLM DBRX databricks/dbrx-base, databricks/dbrx-instruct, etc.
DeciLMForCausalLM DeciLM nvidia/Llama-3_3-Nemotron-Super-49B-v1, etc.
DeepseekForCausalLM DeepSeek deepseek-ai/deepseek-llm-67b-base, deepseek-ai/deepseek-llm-7b-chat, etc.
DeepseekV2ForCausalLM DeepSeek-V2 deepseek-ai/DeepSeek-V2, deepseek-ai/DeepSeek-V2-Chat, etc.
DeepseekV3ForCausalLM DeepSeek-V3 deepseek-ai/DeepSeek-V3, deepseek-ai/DeepSeek-R1, deepseek-ai/DeepSeek-V3.1, etc.
Dots1ForCausalLM dots.llm1 rednote-hilab/dots.llm1.base, rednote-hilab/dots.llm1.inst, etc.
DotsOCRForCausalLM dots_ocr rednote-hilab/dots.ocr
Ernie4_5ForCausalLM Ernie4.5 baidu/ERNIE-4.5-0.3B-PT, etc.
Ernie4_5_MoeForCausalLM Ernie4.5MoE baidu/ERNIE-4.5-21B-A3B-PT, baidu/ERNIE-4.5-300B-A47B-PT, etc.
ExaoneForCausalLM EXAONE-3 LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct, etc.
Exaone4ForCausalLM EXAONE-4 LGAI-EXAONE/EXAONE-4.0-32B, etc.
Fairseq2LlamaForCausalLM Llama (fairseq2 format) mgleize/fairseq2-dummy-Llama-3.2-1B, etc.
FalconForCausalLM Falcon tiiuae/falcon-7b, tiiuae/falcon-40b, tiiuae/falcon-rw-7b, etc.
FalconMambaForCausalLM FalconMamba tiiuae/falcon-mamba-7b, tiiuae/falcon-mamba-7b-instruct, etc.
FalconH1ForCausalLM Falcon-H1 tiiuae/Falcon-H1-34B-Base, tiiuae/Falcon-H1-34B-Instruct, etc.
FlexOlmoForCausalLM FlexOlmo allenai/FlexOlmo-7x7B-1T, allenai/FlexOlmo-7x7B-1T-RT, etc.
GemmaForCausalLM Gemma google/gemma-2b, google/gemma-1.1-2b-it, etc.
Gemma2ForCausalLM Gemma 2 google/gemma-2-9b, google/gemma-2-27b, etc.
Gemma3ForCausalLM Gemma 3 google/gemma-3-1b-it, etc.
Gemma3nForCausalLM Gemma 3n google/gemma-3n-E2B-it, google/gemma-3n-E4B-it, etc.
GlmForCausalLM GLM-4 zai-org/glm-4-9b-chat-hf, etc.
Glm4ForCausalLM GLM-4-0414 zai-org/GLM-4-32B-0414, etc.
Glm4MoeForCausalLM GLM-4.5, GLM-4.6 zai-org/GLM-4.5, etc.
GPT2LMHeadModel GPT-2 gpt2, gpt2-xl, etc.
GPTBigCodeForCausalLM StarCoder, SantaCoder, WizardCoder bigcode/starcoder, bigcode/gpt_bigcode-santacoder, WizardLM/WizardCoder-15B-V1.0, etc.
GPTJForCausalLM GPT-J EleutherAI/gpt-j-6b, nomic-ai/gpt4all-j, etc.
GPTNeoXForCausalLM GPT-NeoX, Pythia, OpenAssistant, Dolly V2, StableLM EleutherAI/gpt-neox-20b, EleutherAI/pythia-12b, OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5, databricks/dolly-v2-12b, stabilityai/stablelm-tuned-alpha-7b, etc.
GptOssForCausalLM GPT-OSS openai/gpt-oss-120b, openai/gpt-oss-20b
GraniteForCausalLM Granite 3.0, Granite 3.1, PowerLM ibm-granite/granite-3.0-2b-base, ibm-granite/granite-3.1-8b-instruct, ibm/PowerLM-3b, etc.
GraniteMoeForCausalLM Granite 3.0 MoE, PowerMoE ibm-granite/granite-3.0-1b-a400m-base, ibm-granite/granite-3.0-3b-a800m-instruct, ibm/PowerMoE-3b, etc.
GraniteMoeHybridForCausalLM Granite 4.0 MoE Hybrid ibm-granite/granite-4.0-tiny-preview, etc.
GraniteMoeSharedForCausalLM Granite MoE Shared ibm-research/moe-7b-1b-active-shared-experts (test model)
GritLM GritLM parasail-ai/GritLM-7B-vllm.
Grok1ModelForCausalLM Grok1 hpcai-tech/grok-1.
HunYuanDenseV1ForCausalLM Hunyuan Dense tencent/Hunyuan-7B-Instruct
HunYuanMoEV1ForCausalLM Hunyuan-A13B tencent/Hunyuan-A13B-Instruct, tencent/Hunyuan-A13B-Pretrain, tencent/Hunyuan-A13B-Instruct-FP8, etc.
HCXVisionForCausalLM HyperCLOVAX-SEED-Vision-Instruct-3B naver-hyperclovax/HyperCLOVAX-SEED-Vision-Instruct-3B
InternLMForCausalLM InternLM internlm/internlm-7b, internlm/internlm-chat-7b, etc.
InternLM2ForCausalLM InternLM2 internlm/internlm2-7b, internlm/internlm2-chat-7b, etc.
InternLM3ForCausalLM InternLM3 internlm/internlm3-8b-instruct, etc.
JAISLMHeadModel Jais inceptionai/jais-13b, inceptionai/jais-13b-chat, inceptionai/jais-30b-v3, inceptionai/jais-30b-chat-v3, etc.
Jais2ForCausalLM Jais2 inceptionai/Jais-2-8B-Chat, inceptionai/Jais-2-70B-Chat, etc.
JambaForCausalLM Jamba ai21labs/AI21-Jamba-1.5-Large, ai21labs/AI21-Jamba-1.5-Mini, ai21labs/Jamba-v0.1, etc.
KimiLinearForCausalLM Kimi-Linear-48B-A3B-Base, Kimi-Linear-48B-A3B-Instruct moonshotai/Kimi-Linear-48B-A3B-Base, moonshotai/Kimi-Linear-48B-A3B-Instruct
Lfm2ForCausalLM LFM2 LiquidAI/LFM2-1.2B, LiquidAI/LFM2-700M, LiquidAI/LFM2-350M, etc.
Lfm2MoeForCausalLM LFM2MoE LiquidAI/LFM2-8B-A1B-preview, etc.
LlamaForCausalLM Llama 3.1, Llama 3, Llama 2, LLaMA, Yi meta-llama/Meta-Llama-3.1-405B-Instruct, meta-llama/Meta-Llama-3.1-70B, meta-llama/Meta-Llama-3-70B-Instruct, meta-llama/Llama-2-70b-hf, 01-ai/Yi-34B, etc.
MambaForCausalLM Mamba state-spaces/mamba-130m-hf, state-spaces/mamba-790m-hf, state-spaces/mamba-2.8b-hf, etc.
Mamba2ForCausalLM Mamba2 mistralai/Mamba-Codestral-7B-v0.1, etc.
MiMoForCausalLM MiMo XiaomiMiMo/MiMo-7B-RL, etc.
MiniCPMForCausalLM MiniCPM openbmb/MiniCPM-2B-sft-bf16, openbmb/MiniCPM-2B-dpo-bf16, openbmb/MiniCPM-S-1B-sft, etc.
MiniCPM3ForCausalLM MiniCPM3 openbmb/MiniCPM3-4B, etc.
MiniMaxM2ForCausalLM MiniMax-M2 MiniMaxAI/MiniMax-M2, etc.
MistralForCausalLM Ministral-3, Mistral, Mistral-Instruct mistralai/Ministral-3-3B-Instruct-2512, mistralai/Mistral-7B-v0.1, mistralai/Mistral-7B-Instruct-v0.1, etc.
MistralLarge3ForCausalLM Mistral-Large-3-675B-Base-2512, Mistral-Large-3-675B-Instruct-2512 mistralai/Mistral-Large-3-675B-Base-2512, mistralai/Mistral-Large-3-675B-Instruct-2512, etc.
MixtralForCausalLM Mixtral-8x7B, Mixtral-8x7B-Instruct mistralai/Mixtral-8x7B-v0.1, mistralai/Mixtral-8x7B-Instruct-v0.1, mistral-community/Mixtral-8x22B-v0.1, etc.
MPTForCausalLM MPT, MPT-Instruct, MPT-Chat, MPT-StoryWriter mosaicml/mpt-7b, mosaicml/mpt-7b-storywriter, mosaicml/mpt-30b, etc.
NemotronForCausalLM Nemotron-3, Nemotron-4, Minitron nvidia/Minitron-8B-Base, mgoin/Nemotron-4-340B-Base-hf-FP8, etc.
NemotronHForCausalLM Nemotron-H nvidia/Nemotron-H-8B-Base-8K, nvidia/Nemotron-H-47B-Base-8K, nvidia/Nemotron-H-56B-Base-8K, etc.
OLMoForCausalLM OLMo allenai/OLMo-1B-hf, allenai/OLMo-7B-hf, etc.
OLMo2ForCausalLM OLMo2 allenai/OLMo-2-0425-1B, etc.
OLMo3ForCausalLM OLMo3 allenai/Olmo-3-7B-Instruct, allenai/Olmo-3-32B-Think, etc.
OLMoEForCausalLM OLMoE allenai/OLMoE-1B-7B-0924, allenai/OLMoE-1B-7B-0924-Instruct, etc.
OPTForCausalLM OPT, OPT-IML facebook/opt-66b, facebook/opt-iml-max-30b, etc.
OrionForCausalLM Orion OrionStarAI/Orion-14B-Base, OrionStarAI/Orion-14B-Chat, etc.
OuroForCausalLM ouro ByteDance/Ouro-1.4B, ByteDance/Ouro-2.6B, etc.
PanguEmbeddedForCausalLM openPangu-Embedded-7B FreedomIntelligence/openPangu-Embedded-7B-V1.1
PanguUltraMoEForCausalLM openpangu-ultra-moe-718b-model FreedomIntelligence/openPangu-Ultra-MoE-718B-V1.1
PhiForCausalLM Phi microsoft/phi-1_5, microsoft/phi-2, etc.
Phi3ForCausalLM Phi-4, Phi-3 microsoft/Phi-4-mini-instruct, microsoft/Phi-4, microsoft/Phi-3-mini-4k-instruct, microsoft/Phi-3-mini-128k-instruct, microsoft/Phi-3-medium-128k-instruct, etc.
PhiMoEForCausalLM Phi-3.5-MoE microsoft/Phi-3.5-MoE-instruct, etc.
PersimmonForCausalLM Persimmon adept/persimmon-8b-base, adept/persimmon-8b-chat, etc.
Plamo2ForCausalLM PLaMo2 pfnet/plamo-2-1b, pfnet/plamo-2-8b, etc.
Plamo3ForCausalLM PLaMo3 pfnet/plamo-3-nict-2b-base, pfnet/plamo-3-nict-8b-base, etc.
QWenLMHeadModel Qwen Qwen/Qwen-7B, Qwen/Qwen-7B-Chat, etc.
Qwen2ForCausalLM QwQ, Qwen2 Qwen/QwQ-32B-Preview, Qwen/Qwen2-7B-Instruct, Qwen/Qwen2-7B, etc.
Qwen2MoeForCausalLM Qwen2MoE Qwen/Qwen1.5-MoE-A2.7B, Qwen/Qwen1.5-MoE-A2.7B-Chat, etc.
Qwen3ForCausalLM Qwen3 Qwen/Qwen3-8B, etc.
Qwen3MoeForCausalLM Qwen3MoE Qwen/Qwen3-30B-A3B, etc.
Qwen3NextForCausalLM Qwen3NextMoE Qwen/Qwen3-Next-80B-A3B-Instruct, etc.
SeedOssForCausalLM SeedOss ByteDance-Seed/Seed-OSS-36B-Instruct, etc.
StableLmForCausalLM StableLM stabilityai/stablelm-3b-4e1t, stabilityai/stablelm-base-alpha-7b-v2, etc.
Starcoder2ForCausalLM Starcoder2 bigcode/starcoder2-3b, bigcode/starcoder2-7b, bigcode/starcoder2-15b, etc.
SolarForCausalLM Solar Pro upstage/solar-pro-preview-instruct, etc.
TeleChat2ForCausalLM TeleChat2 Tele-AI/TeleChat2-3B, Tele-AI/TeleChat2-7B, Tele-AI/TeleChat2-35B, etc.
TeleFLMForCausalLM TeleFLM CofeAI/FLM-2-52B-Instruct-2407, CofeAI/Tele-FLM, etc.
XverseForCausalLM XVERSE xverse/XVERSE-7B-Chat, xverse/XVERSE-13B-Chat, xverse/XVERSE-65B-Chat, etc.
MiniMaxM1ForCausalLM MiniMax-Text MiniMaxAI/MiniMax-M1-40k, MiniMaxAI/MiniMax-M1-80k, etc.
MiniMaxText01ForCausalLM MiniMax-Text MiniMaxAI/MiniMax-Text-01, etc.
Zamba2ForCausalLM Zamba2 Zyphra/Zamba2-7B-instruct, Zyphra/Zamba2-2.7B-instruct, Zyphra/Zamba2-1.2B-instruct, etc.
LongcatFlashForCausalLM LongCat-Flash meituan-longcat/LongCat-Flash-Chat, meituan-longcat/LongCat-Flash-Chat-FP8

Список мультимодальных языковых моделей

В зависимости от модели поддерживаются следующие модальности:

  • T - текст
  • I - изображение
  • V - видео
  • A - aудио

Любые комбинации модальностей, объединённые через +, поддерживаются.

  • напр.: T + I означает, что модель поддерживает ввод только текста, ввод только изображения и ввод с текстом и изображением.

С другой стороны, модальности, разделённые /, являются взаимоисключающими.

  • напр.: T / I означает, что модель поддерживает ввод только текста и ввод только изображения, но не ввод с текстом и изображением.
Архитектура Модели Модальность Пример моделей с huggingface
AriaForConditionalGeneration Aria T + I rhymes-ai/Aria
AudioFlamingo3ForConditionalGeneration AudioFlamingo3 T + A nvidia/audio-flamingo-3-hf, nvidia/music-flamingo-hf
AyaVisionForConditionalGeneration Aya Vision T + I CohereLabs/aya-vision-8b, CohereLabs/aya-vision-32b, etc.
BagelForConditionalGeneration BAGEL T + I ByteDance-Seed/BAGEL-7B-MoT
BeeForConditionalGeneration Bee-8B T + I Open-Bee/Bee-8B-RL, Open-Bee/Bee-8B-SFT
Blip2ForConditionalGeneration BLIP-2 T + I Salesforce/blip2-opt-2.7b, Salesforce/blip2-opt-6.7b, etc.
ChameleonForConditionalGeneration Chameleon T + I facebook/chameleon-7b, etc.
Cohere2VisionForConditionalGeneration Command A Vision T + I CohereLabs/command-a-vision-07-2025, etc.
DeepseekVLV2ForCausalLM DeepSeek-VL2 T + I deepseek-ai/deepseek-vl2-tiny, deepseek-ai/deepseek-vl2-small, deepseek-ai/deepseek-vl2, etc.
DeepseekOCRForCausalLM DeepSeek-OCR T + I deepseek-ai/DeepSeek-OCR, etc.
Ernie4_5_VLMoeForConditionalGeneration Ernie4.5-VL T + I/ V baidu/ERNIE-4.5-VL-28B-A3B-PT, baidu/ERNIE-4.5-VL-424B-A47B-PT
FuyuForCausalLM Fuyu T + I adept/fuyu-8b, etc.
Gemma3ForConditionalGeneration Gemma 3 T + I google/gemma-3-4b-it, google/gemma-3-27b-it, etc.
Gemma3nForConditionalGeneration Gemma 3n T + I + A google/gemma-3n-E2B-it, google/gemma-3n-E4B-it, etc.
GLM4VForCausalLM GLM-4V T + I zai-org/glm-4v-9b, zai-org/cogagent-9b-20241220, etc.
Glm4vForConditionalGeneration GLM-4.1V-Thinking T + I + V zai-org/GLM-4.1V-9B-Thinking, etc.
Glm4vMoeForConditionalGeneration GLM-4.5V T + I + V zai-org/GLM-4.5V, etc.
GraniteSpeechForConditionalGeneration Granite Speech T + A ibm-granite/granite-speech-3.3-8b
H2OVLChatModel H2OVL T + I h2oai/h2ovl-mississippi-800m, h2oai/h2ovl-mississippi-2b, etc.
HunYuanVLForConditionalGeneration HunyuanOCR T + I tencent/HunyuanOCR, etc.
Idefics3ForConditionalGeneration Idefics3 T + I HuggingFaceM4/Idefics3-8B-Llama3, etc.
InternS1ForConditionalGeneration Intern-S1 T + I + V internlm/Intern-S1, internlm/Intern-S1-mini, etc.
InternVLChatModel InternVL 3.5, InternVL 3.0, InternVideo 2.5, InternVL 2.5, Mono-InternVL, InternVL 2.0 T + I + (V) OpenGVLab/InternVL3_5-14B, OpenGVLab/InternVL3-9B, OpenGVLab/InternVideo2_5_Chat_8B, OpenGVLab/InternVL2_5-4B, OpenGVLab/Mono-InternVL-2B, OpenGVLab/InternVL2-4B, etc.
InternVLForConditionalGeneration InternVL 3.0 (HF format) T + I + V OpenGVLab/InternVL3-1B-hf, etc.
KeyeForConditionalGeneration Keye-VL-8B-Preview T + I + V Kwai-Keye/Keye-VL-8B-Preview
KeyeVL1_5ForConditionalGeneration Keye-VL-1_5-8B T + I + V Kwai-Keye/Keye-VL-1_5-8B
KimiVLForConditionalGeneration Kimi-VL-A3B-Instruct, Kimi-VL-A3B-Thinking T + I moonshotai/Kimi-VL-A3B-Instruct, moonshotai/Kimi-VL-A3B-Thinking
LightOnOCRForConditionalGeneration LightOnOCR-1B T + I lightonai/LightOnOCR-1B, etc
Llama4ForConditionalGeneration Llama 4 T + I meta-llama/Llama-4-Scout-17B-16E-Instruct, meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8, meta-llama/Llama-4-Maverick-17B-128E-Instruct, etc.
Llama_Nemotron_Nano_VL Llama Nemotron Nano VL T + I nvidia/Llama-3.1-Nemotron-Nano-VL-8B-V1
LlavaForConditionalGeneration LLaVA-1.5, Pixtral (HF Transformers) T + I llava-hf/llava-1.5-7b-hf, TIGER-Lab/Mantis-8B-siglip-llama3 (see note), mistral-community/pixtral-12b, etc.
LlavaNextForConditionalGeneration LLaVA-NeXT T + I llava-hf/llava-v1.6-mistral-7b-hf, llava-hf/llava-v1.6-vicuna-7b-hf, etc.
LlavaNextVideoForConditionalGeneration LLaVA-NeXT-Video T + V llava-hf/LLaVA-NeXT-Video-7B-hf, etc.
LlavaOnevisionForConditionalGeneration LLaVA-Onevision T + I + V llava-hf/llava-onevision-qwen2-7b-ov-hf, llava-hf/llava-onevision-qwen2-0.5b-ov-hf, etc.
MiDashengLMModel MiDashengLM T + A mispeech/midashenglm-7b
MiniCPMO MiniCPM-O T + I + V + A openbmb/MiniCPM-o-2_6, etc.
MiniCPMV MiniCPM-V T + I + V openbmb/MiniCPM-V-2 (see note), openbmb/MiniCPM-Llama3-V-2_5, openbmb/MiniCPM-V-2_6, openbmb/MiniCPM-V-4, openbmb/MiniCPM-V-4_5, etc.
MiniMaxVL01ForConditionalGeneration MiniMax-VL T + I MiniMaxAI/MiniMax-VL-01, etc.
Mistral3ForConditionalGeneration Mistral3 (HF Transformers) T + I mistralai/Mistral-Small-3.1-24B-Instruct-2503, etc.
MolmoForCausalLM Molmo T + I allenai/Molmo-7B-D-0924, allenai/Molmo-7B-O-0924, etc.
NVLM_D_Model NVLM-D 1.0 T + I nvidia/NVLM-D-72B, etc.
OpenCUAForConditionalGeneration OpenCUA-7B T + I xlangai/OpenCUA-7B
Ovis Ovis2, Ovis1.6 T + I AIDC-AI/Ovis2-1B, AIDC-AI/Ovis1.6-Llama3.2-3B, etc.
Ovis2_5 Ovis2.5 T + I + V AIDC-AI/Ovis2.5-9B, etc.
PaddleOCRVLForConditionalGeneration Paddle-OCR T + I PaddlePaddle/PaddleOCR-VL, etc.
PaliGemmaForConditionalGeneration PaliGemma, PaliGemma 2 T + I google/paligemma-3b-pt-224, google/paligemma-3b-mix-224, google/paligemma2-3b-ft-docci-448, etc.
Phi3VForCausalLM Phi-3-Vision, Phi-3.5-Vision T + I microsoft/Phi-3-vision-128k-instruct, microsoft/Phi-3.5-vision-instruct, etc.
Phi4MMForCausalLM Phi-4-multimodal T + I / T + A / I + A microsoft/Phi-4-multimodal-instruct, etc.
PixtralForConditionalGeneration Ministral 3 (Mistral format), Mistral 3 (Mistral format), Mistral Large 3 (Mistral format), Pixtral (Mistral format) T + I mistralai/Ministral-3-3B-Instruct-2512, mistralai/Mistral-Small-3.1-24B-Instruct-2503, mistralai/Mistral-Large-3-675B-Instruct-2512 mistralai/Pixtral-12B-2409 etc.
QwenVLForConditionalGeneration Qwen-VL T + I Qwen/Qwen-VL, Qwen/Qwen-VL-Chat, etc.
Qwen2AudioForConditionalGeneration Qwen2-Audio T + A Qwen/Qwen2-Audio-7B-Instruct
Qwen2VLForConditionalGeneration QVQ, Qwen2-VL T + I + V Qwen/QVQ-72B-Preview, Qwen/Qwen2-VL-7B-Instruct, Qwen/Qwen2-VL-72B-Instruct, etc.
Qwen2_5_VLForConditionalGeneration Qwen2.5-VL T + I + V Qwen/Qwen2.5-VL-3B-Instruct, Qwen/Qwen2.5-VL-72B-Instruct, etc.
Qwen2_5OmniThinkerForConditionalGeneration Qwen2.5-Omni T + I + V + A Qwen/Qwen2.5-Omni-3B, Qwen/Qwen2.5-Omni-7B
Qwen3VLForConditionalGeneration Qwen3-VL T + I + V Qwen/Qwen3-VL-4B-Instruct, etc.
Qwen3VLMoeForConditionalGeneration Qwen3-VL-MOE T + I + V Qwen/Qwen3-VL-30B-A3B-Instruct, etc.
Qwen3OmniMoeThinkerForConditionalGeneration Qwen3-Omni T + I + V + A Qwen/Qwen3-Omni-30B-A3B-Instruct, Qwen/Qwen3-Omni-30B-A3B-Thinking
RForConditionalGeneration R-VL-4B T + I YannQi/R-4B
SkyworkR1VChatModel Skywork-R1V-38B T + I Skywork/Skywork-R1V-38B
SmolVLMForConditionalGeneration SmolVLM2 T + I SmolVLM2-2.2B-Instruct
Step3VLForConditionalGeneration Step3-VL T + I stepfun-ai/step3
TarsierForConditionalGeneration Tarsier T + I omni-search/Tarsier-7b, omni-search/Tarsier-34b
Tarsier2ForConditionalGeneration Tarsier2 T + I + V omni-research/Tarsier2-Recap-7b, omni-research/Tarsier2-7b-0115
UltravoxModel Ultravox T + A fixie-ai/ultravox-v0_5-llama-3_2-1b