-
google/translategemma-27b-it
Image-Text-to-Text • 29B • Updated • 25.7k • 262 -
kakaocorp/kanana-2-30b-a3b-mid-2601
Text Generation • 31B • Updated • 79 • 30 -
black-forest-labs/FLUX.2-klein-base-4B
Image-to-Image • Updated • 15.6k • • 65 -
google/translategemma-12b-it
Image-Text-to-Text • 13B • Updated • 42.4k • 204
merve PRO
merve
AI & ML interests
I love this website
VLMs, vision & co
Recent Activity
liked
a Space
about 21 hours ago
insomnia7/SAMTok
liked
a Space
about 21 hours ago
Overworld/waypoint-1-small
updated
a model
about 22 hours ago
merve/my_awesome_food_model
Organizations
A collection of real-time detectors.
-
facebook/metaclip-2-worldwide-s16
Zero-Shot Image Classification • 0.4B • Updated • 39 • 8 -
facebook/metaclip-2-worldwide-m16
Zero-Shot Image Classification • 0.5B • Updated • 5 • 3 -
facebook/metaclip-2-worldwide-l14
Zero-Shot Image Classification • 1B • Updated • 118 • 12 -
facebook/metaclip-2-worldwide-b32
Zero-Shot Image Classification • 0.6B • Updated • 96 • 6
All the releases of the week of 30th May.
A collection of DSE models for multimodal retrieval
-
deepseek-ai/DeepSeek-V3-0324
Text Generation • 685B • Updated • 289k • • 3.08k -
Qwen/Qwen2.5-Omni-7B
Any-to-Any • 11B • Updated • 151k • 1.84k -
google/txgemma-27b-chat
Text Generation • 27B • Updated • 488 • 57 -
Qwen2.5 Omni 7B Demo
🏆365Generate text and speech responses from text, audio, images, or video input
Models and datasets of the second week of Jan 2025.
-
ibm-granite/granite-3.0-8b-instruct
Text Generation • 8B • Updated • 14.2k • 204 -
ibm-granite/granite-3.0-2b-instruct
Text Generation • 3B • Updated • 2.44k • 46 -
CohereLabs/aya-expanse-8b
Text Generation • 8B • Updated • 158k • 419 -
CohereLabs/aya-expanse-32b
Text Generation • 32B • Updated • 4.55k • • 286
Recent depth models
Collection of useful computer vision backbones to fine-tune. It also includes large image classification models, that can be used as backbone.
-
microsoft/resnet-50
Image Classification • 25.6M • Updated • 129k • • 472 -
google/vit-base-patch16-224-in21k
Image Feature Extraction • 86.4M • Updated • 790k • 393 -
google/vit-base-patch32-224-in21k
Image Feature Extraction • 88M • Updated • 6.54k • 19 -
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 419k • 101
-
facebook/detr-resnet-50
Object Detection • 41.6M • Updated • 570k • • 924 -
facebook/detr-resnet-101-dc5
Object Detection • 60.7M • Updated • 1.58k • 19 -
facebook/detr-resnet-50-dc5
Object Detection • 41.6M • Updated • 1.31k • 6 -
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 76.5k • 144
This is a collection for models that can be used for zero-shot image classification.
-
openai/clip-vit-large-patch14
Zero-Shot Image Classification • 0.4B • Updated • 7.41M • 1.95k -
openai/clip-vit-base-patch32
Zero-Shot Image Classification • Updated • 14.7M • 843 -
laion/CLIP-ViT-bigG-14-laion2B-39B-b160k
Zero-Shot Image Classification • Updated • 67.5k • 306 -
kakaobrain/align-base
Zero-Shot Image Classification • Updated • 9.84k • 29
-
microsoft/xclip-base-patch32
Video Classification • 0.2B • Updated • 186k • 107 -
facebook/timesformer-base-finetuned-k400
Video Classification • Updated • 26.7k • 42 -
facebook/timesformer-base-finetuned-k600
Video Classification • Updated • 3.34k • 12 -
google/vivit-b-16x2
Video Classification • Updated • 952 • 11
This collection contains models and demos of SAM and it's smaller friends.
A collection dedicated to SigLIP applications
-
Draw To Search Art
🐠72Draw/upload image and search among WikiART using SigLIP
-
Compare Clip Siglip
🏃23Compare strong zero-shot image classification models
-
Multilingual Zero Shot Image Clf
🏢13Comparing powerful multilingual zero-shot image clf models
-
BAAI/bunny-phi-2-siglip-lora
Text Generation • Updated • 210 • 48
A collection of everything SegGPT.
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 76.5k • 144 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 5.13k • 13 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 6.67k • 29 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 18.5k • 29
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 76.5k • 144 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 5.13k • 13 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 6.67k • 29 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 18.5k • 29
A collection of video-language models
-
Video Llava
🐨21Generate descriptions by uploading images or videos
-
llava-hf/LLaVA-NeXT-Video-7B-hf
Video-Text-to-Text • 7B • Updated • 53.8k • 121 -
llava-hf/LLaVA-NeXT-Video-7B-DPO-hf
Video-Text-to-Text • 7B • Updated • 975 • 11 -
llava-hf/LLaVA-NeXT-Video-7B-32K-hf
Image-Text-to-Text • 8B • Updated • 146 • 8
YOLO26 models: detection, segmentation, classification, pose, and OBB variants with demos and ONNX variants.
-
Wuli-art/Qwen-Image-2512-Turbo-LoRA
Text-to-Image • Updated • 29k • 187 -
miromind-ai/MiroThinker-v1.5-235B
Text Generation • 235B • Updated • 2.33k • 244 -
prithivMLmods/Qwen-Image-Edit-2511-Object-Remover
Image-to-Image • Updated • 3.67k • • 45 -
tencent/Youtu-LLM-2B-Base
Text Generation • 2B • Updated • 5.4k • 38
-
facebook/sam3
Mask Generation • 0.9B • Updated • 1.61M • 1.44k -
SAM3 Video Segmentation
🐠100Track and label objects in videos using text prompts or clicks
-
onnx-community/sam3-tracker-ONNX
Mask Generation • Updated • 4.25k • 26 -
SAM3 Tracker WebGPU
🎯22Segment and extract parts from images by clicking
-
NVLM: Open Frontier-Class Multimodal LLMs
Paper • 2409.11402 • Published • 74 -
BRAVE: Broadening the visual encoding of vision-language models
Paper • 2404.07204 • Published • 19 -
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
Paper • 2403.18814 • Published • 47 -
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
Paper • 2409.17146 • Published • 121
Models mentioned in https://huggingface.co/papers/2404.07204
-
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 419k • 101 -
google/flan-t5-xl
3B • Updated • 113k • 526 -
google/siglip-large-patch16-384
Zero-Shot Image Classification • 0.7B • Updated • 17.8k • 11 -
google/vit-huge-patch14-224-in21k
Image Feature Extraction • 0.6B • Updated • 67.8k • 22
-
facebook/deit-base-distilled-patch16-384
Image Classification • 87.6M • Updated • 7.32k • • 7 -
facebook/convnextv2-base-1k-224
Image Classification • 88.7M • Updated • 1.51k • 4 -
facebook/deit-base-distilled-patch16-224
Image Classification • Updated • 6.89k • • 31 -
google/vit-base-patch32-384
Image Classification • 88.3M • Updated • 20k • • 23
A collection of instance/semantic/panoptic segmentation models.
-
facebook/maskformer-swin-large-coco
Image Segmentation • 0.2B • Updated • 1.14k • • 27 -
nvidia/segformer-b0-finetuned-ade-512-512
Image Segmentation • 3.75M • Updated • 316k • • 178 -
facebook/detr-resnet-50-dc5-panoptic
Image Segmentation • 43M • Updated • 22 • 3 -
nvidia/segformer-b5-finetuned-cityscapes-1024-1024
Image Segmentation • Updated • 75.2k • • 37
Collection of image to image editing, image enhancement (SR, deblur, brighten) and text-to-image adapter models.
This collection contains image captioning and OCR models.
-
Salesforce/blip-image-captioning-large
Image-to-Text • 0.5B • Updated • 1.34M • 1.44k -
Salesforce/blip-image-captioning-base
Image-to-Text • Updated • 1.96M • 838 -
microsoft/trocr-base-handwritten
Image-to-Text • 0.3B • Updated • 131k • 473 -
microsoft/git-large-coco
Image-to-Text • 0.4B • Updated • 1.57k • 104
Foundation models for computer vision.
Models and applications of OWL-ViT and OWLv2.
A collection of open-source document AI 📄 📝 📈
Papers about vision-language models, most important ones are on top of the list.
-
Improved Baselines with Visual Instruction Tuning
Paper • 2310.03744 • Published • 39 -
DeepSeek-VL: Towards Real-World Vision-Language Understanding
Paper • 2403.05525 • Published • 48 -
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper • 2308.12966 • Published • 11 -
LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model
Paper • 2404.01331 • Published • 27
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 76.5k • 144 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 5.13k • 13 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 6.67k • 29 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 18.5k • 29
A comprehensive collection on DAv2
This collection has all the vision language leaderboards.
All the models and demos for SAM2
-
google/translategemma-27b-it
Image-Text-to-Text • 29B • Updated • 25.7k • 262 -
kakaocorp/kanana-2-30b-a3b-mid-2601
Text Generation • 31B • Updated • 79 • 30 -
black-forest-labs/FLUX.2-klein-base-4B
Image-to-Image • Updated • 15.6k • • 65 -
google/translategemma-12b-it
Image-Text-to-Text • 13B • Updated • 42.4k • 204
YOLO26 models: detection, segmentation, classification, pose, and OBB variants with demos and ONNX variants.
-
Wuli-art/Qwen-Image-2512-Turbo-LoRA
Text-to-Image • Updated • 29k • 187 -
miromind-ai/MiroThinker-v1.5-235B
Text Generation • 235B • Updated • 2.33k • 244 -
prithivMLmods/Qwen-Image-Edit-2511-Object-Remover
Image-to-Image • Updated • 3.67k • • 45 -
tencent/Youtu-LLM-2B-Base
Text Generation • 2B • Updated • 5.4k • 38
A collection of real-time detectors.
-
facebook/sam3
Mask Generation • 0.9B • Updated • 1.61M • 1.44k -
SAM3 Video Segmentation
🐠100Track and label objects in videos using text prompts or clicks
-
onnx-community/sam3-tracker-ONNX
Mask Generation • Updated • 4.25k • 26 -
SAM3 Tracker WebGPU
🎯22Segment and extract parts from images by clicking
-
facebook/metaclip-2-worldwide-s16
Zero-Shot Image Classification • 0.4B • Updated • 39 • 8 -
facebook/metaclip-2-worldwide-m16
Zero-Shot Image Classification • 0.5B • Updated • 5 • 3 -
facebook/metaclip-2-worldwide-l14
Zero-Shot Image Classification • 1B • Updated • 118 • 12 -
facebook/metaclip-2-worldwide-b32
Zero-Shot Image Classification • 0.6B • Updated • 96 • 6
All the releases of the week of 30th May.
A collection of DSE models for multimodal retrieval
-
deepseek-ai/DeepSeek-V3-0324
Text Generation • 685B • Updated • 289k • • 3.08k -
Qwen/Qwen2.5-Omni-7B
Any-to-Any • 11B • Updated • 151k • 1.84k -
google/txgemma-27b-chat
Text Generation • 27B • Updated • 488 • 57 -
Qwen2.5 Omni 7B Demo
🏆365Generate text and speech responses from text, audio, images, or video input
Models and datasets of the second week of Jan 2025.
-
NVLM: Open Frontier-Class Multimodal LLMs
Paper • 2409.11402 • Published • 74 -
BRAVE: Broadening the visual encoding of vision-language models
Paper • 2404.07204 • Published • 19 -
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
Paper • 2403.18814 • Published • 47 -
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
Paper • 2409.17146 • Published • 121
-
ibm-granite/granite-3.0-8b-instruct
Text Generation • 8B • Updated • 14.2k • 204 -
ibm-granite/granite-3.0-2b-instruct
Text Generation • 3B • Updated • 2.44k • 46 -
CohereLabs/aya-expanse-8b
Text Generation • 8B • Updated • 158k • 419 -
CohereLabs/aya-expanse-32b
Text Generation • 32B • Updated • 4.55k • • 286
Recent depth models
Models mentioned in https://huggingface.co/papers/2404.07204
-
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 419k • 101 -
google/flan-t5-xl
3B • Updated • 113k • 526 -
google/siglip-large-patch16-384
Zero-Shot Image Classification • 0.7B • Updated • 17.8k • 11 -
google/vit-huge-patch14-224-in21k
Image Feature Extraction • 0.6B • Updated • 67.8k • 22
Collection of useful computer vision backbones to fine-tune. It also includes large image classification models, that can be used as backbone.
-
microsoft/resnet-50
Image Classification • 25.6M • Updated • 129k • • 472 -
google/vit-base-patch16-224-in21k
Image Feature Extraction • 86.4M • Updated • 790k • 393 -
google/vit-base-patch32-224-in21k
Image Feature Extraction • 88M • Updated • 6.54k • 19 -
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 419k • 101
-
facebook/deit-base-distilled-patch16-384
Image Classification • 87.6M • Updated • 7.32k • • 7 -
facebook/convnextv2-base-1k-224
Image Classification • 88.7M • Updated • 1.51k • 4 -
facebook/deit-base-distilled-patch16-224
Image Classification • Updated • 6.89k • • 31 -
google/vit-base-patch32-384
Image Classification • 88.3M • Updated • 20k • • 23
-
facebook/detr-resnet-50
Object Detection • 41.6M • Updated • 570k • • 924 -
facebook/detr-resnet-101-dc5
Object Detection • 60.7M • Updated • 1.58k • 19 -
facebook/detr-resnet-50-dc5
Object Detection • 41.6M • Updated • 1.31k • 6 -
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 76.5k • 144
A collection of instance/semantic/panoptic segmentation models.
-
facebook/maskformer-swin-large-coco
Image Segmentation • 0.2B • Updated • 1.14k • • 27 -
nvidia/segformer-b0-finetuned-ade-512-512
Image Segmentation • 3.75M • Updated • 316k • • 178 -
facebook/detr-resnet-50-dc5-panoptic
Image Segmentation • 43M • Updated • 22 • 3 -
nvidia/segformer-b5-finetuned-cityscapes-1024-1024
Image Segmentation • Updated • 75.2k • • 37
This is a collection for models that can be used for zero-shot image classification.
-
openai/clip-vit-large-patch14
Zero-Shot Image Classification • 0.4B • Updated • 7.41M • 1.95k -
openai/clip-vit-base-patch32
Zero-Shot Image Classification • Updated • 14.7M • 843 -
laion/CLIP-ViT-bigG-14-laion2B-39B-b160k
Zero-Shot Image Classification • Updated • 67.5k • 306 -
kakaobrain/align-base
Zero-Shot Image Classification • Updated • 9.84k • 29
Collection of image to image editing, image enhancement (SR, deblur, brighten) and text-to-image adapter models.
-
microsoft/xclip-base-patch32
Video Classification • 0.2B • Updated • 186k • 107 -
facebook/timesformer-base-finetuned-k400
Video Classification • Updated • 26.7k • 42 -
facebook/timesformer-base-finetuned-k600
Video Classification • Updated • 3.34k • 12 -
google/vivit-b-16x2
Video Classification • Updated • 952 • 11
This collection contains image captioning and OCR models.
-
Salesforce/blip-image-captioning-large
Image-to-Text • 0.5B • Updated • 1.34M • 1.44k -
Salesforce/blip-image-captioning-base
Image-to-Text • Updated • 1.96M • 838 -
microsoft/trocr-base-handwritten
Image-to-Text • 0.3B • Updated • 131k • 473 -
microsoft/git-large-coco
Image-to-Text • 0.4B • Updated • 1.57k • 104
Foundation models for computer vision.
This collection contains models and demos of SAM and it's smaller friends.
Models and applications of OWL-ViT and OWLv2.
A collection dedicated to SigLIP applications
-
Draw To Search Art
🐠72Draw/upload image and search among WikiART using SigLIP
-
Compare Clip Siglip
🏃23Compare strong zero-shot image classification models
-
Multilingual Zero Shot Image Clf
🏢13Comparing powerful multilingual zero-shot image clf models
-
BAAI/bunny-phi-2-siglip-lora
Text Generation • Updated • 210 • 48
A collection of open-source document AI 📄 📝 📈
A collection of everything SegGPT.
Papers about vision-language models, most important ones are on top of the list.
-
Improved Baselines with Visual Instruction Tuning
Paper • 2310.03744 • Published • 39 -
DeepSeek-VL: Towards Real-World Vision-Language Understanding
Paper • 2403.05525 • Published • 48 -
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper • 2308.12966 • Published • 11 -
LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model
Paper • 2404.01331 • Published • 27
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 76.5k • 144 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 5.13k • 13 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 6.67k • 29 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 18.5k • 29
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 76.5k • 144 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 5.13k • 13 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 6.67k • 29 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 18.5k • 29
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 76.5k • 144 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 5.13k • 13 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 6.67k • 29 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 18.5k • 29
A comprehensive collection on DAv2
This collection has all the vision language leaderboards.
A collection of video-language models
-
Video Llava
🐨21Generate descriptions by uploading images or videos
-
llava-hf/LLaVA-NeXT-Video-7B-hf
Video-Text-to-Text • 7B • Updated • 53.8k • 121 -
llava-hf/LLaVA-NeXT-Video-7B-DPO-hf
Video-Text-to-Text • 7B • Updated • 975 • 11 -
llava-hf/LLaVA-NeXT-Video-7B-32K-hf
Image-Text-to-Text • 8B • Updated • 146 • 8
All the models and demos for SAM2