[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
-
Updated
Aug 12, 2024 - Python
#
vision-language
Here are 156 public repositories matching this topic...
Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
prompt chinese image-captioning pretrained-models visual-question-answering multimodal text-to-image-synthesis vision-language pretraining referring-expression-comprehension prompt-tuning
-
Updated
Apr 24, 2024 - Python
An open-source implementaion for fine-tuning Qwen-VL series by Alibaba Cloud.
-
Updated
Mar 10, 2026 - Python
[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.
chatbot llama clip mulit-modal vision-language vicuna gpt-4 vision-language-pretraining llava video-chatboat video-conversation
-
Updated
Aug 5, 2025 - Python
A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
representation-learning multimodal vision-and-language contrastive-loss vision-language vision-transformer foundation-models audio-language
-
Updated
Oct 6, 2024 - Python
A Framework of Small-scale Large Multimodal Models
-
Updated
Mar 15, 2026 - Python
CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks
natural-language-processing computer-vision deep-learning robotics pytorch vision manipulation vision-and-language grounding vision-language
-
Updated
Sep 8, 2025 - Python
🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
conversation lmms vision-language llm llava llama3 phi3 llava-llama3 llava-phi3 llama3-llava phi3-llava llama-3-vision phi3-vision llama-3-llava phi-3-llava llama3-vision phi-3-vision
-
Updated
Aug 5, 2025 - Python
[ICLR 2024] Controlling Vision-Language Models for Universal Image Restoration. 5th place in the NTIRE 2024 Restore Any Image Model in the Wild Challenge.
deep-learning prompt pytorch image-denoising image-restoration image-deblurring low-level-vision shadow-removal image-dehazing face-inpainting vision-language diffusion-models low-light-image-enhancement image-deraining jpeg-artifacts-removal image-desnowing all-in-one-image-restoration
-
Updated
Aug 7, 2024 - Python
This is the third party implementation of the paper Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection.
-
Updated
Jul 27, 2025 - Python
Official implementation of SEED-LLaMA (ICLR 2024).
-
Updated
Sep 21, 2024 - Python
多模态中文LLaMA&Alpaca大语言模型（VisualCLA）
-
Updated
Jul 27, 2023 - Python
[IEEE Transactions on Medical Imaging/TMI 2023] This repo is the official implementation of "LViT: Language meets Vision Transformer in Medical Image Segmentation"
-
Updated
Mar 10, 2025 - Python
A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, llama-3.2-vision, qwen-vl, qwen2-vl, phi3-v etc.
finetuning multimodal vision-language foundation-models instruction-tuning large-language-model llava visual-instruction-tuning multimodal-large-language-models large-multimodal-models qwen-vl llava-next
-
Updated
Feb 28, 2026 - Python
[ICCV2021 & TPAMI2023] Vision-Language Transformer and Query Generation for Referring Segmentation
tensorflow keras transformer vision-language referring-segmentation tpami iccv2021 vision-language-transformer
-
Updated
Jan 7, 2022 - Python
[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
chatbot llama multi-modal clip vision-language gpt-4 foundation-models visual-prompting llava llama2 cvpr2024 gpt-4-vision
-
Updated
Jul 17, 2024 - Python
Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
chatbot clip image-encoder video-encoder multimodal dual-encoder vision-language vicuna gpt4 vision-language-pretraining llava video-conversation video-chatbot llama3 gpt4o phi-3-mini
-
Updated
Aug 5, 2025 - Python
Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR 2023
-
Updated
Jun 7, 2023 - Python
💐Kaleido-BERT: Vision-Language Pre-training on Fashion Domain
-
Updated
Jun 29, 2022 - Python
Improve this page
Add a description, image, and links to the vision-language topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the vision-language topic, visit your repo's landing page and select "manage topics."