A Picture is Worth a Thousand Words: Principled Recaptioning Improves Image Generation

Recaptioning images with high-quality samples improve the text-to-image generation

#image-generation #multi-modal

Video Language Planning

Vision language models can make long horizon task plans

#language-model #multi-modal #robotics

PaLI-3 Vision Language Models: Smaller, Faster, Stronger

Contrastive ViT Makes VLM Stronger

#language-model #multi-modal

Collaborative Score Distillation for Consistent Visual Synthesis

Expand dimension by leveraging consistency without changing the architecture

#multi-modal #diffusion-model

LiT:fire:: Zero-Shot Transfer with Locked-image Text Tuning

Image-text pre-training with pre-trained image model enhances zero-shot performance

#multi-modal #contrastive-learning

End-to-end Multi-modal Video Temporal Grounding

Adding depth and flow to RGB improves video understanding

#video-understanding #multi-modal

CLIP-It! Language-Guided Video Summarization

Get highlight clip of your favorite player by typing it

#multi-modal #video-understanding

StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery

Make your cat cute by typing it into this StyleGAN-CLIP hybrid

#multi-modal #generative-adversarial-network #image-manipulation

#image-generation #multi-modal #language-model #retrieval-augmentation #robotics #forecasting #psychiatry #instruction-tuning #diffusion-model #notice #graph-neural-network #responsible-ai #privacy-preserving #scaling #mixture-of-experts #generative-adversarial-network #speech-model #contrastive-learning #self-supervised #image-representation #image-processing #object-detection #pseudo-labeling #scene-text-detection #neural-architecture-search #data-sampling #long-tail #graph-representation #zero-shot #metric-learning #federated-learning #weight-matrix #low-rank #vision-transformer #computer-vision #normalizing-flow #invertible-neural-network #super-resolution #image-manipulation #thread-summarization #natural-language-processing #domain-adaptation #knowledge-distillation #scene-text #model-compression #semantic-segmentation #instance-segmentation #video-understanding #code-generation #graph-generation #image-translation #data-augmentation #model-pruning #signal-processing #text-generation #text-classification #music-representation #transfer-learning #link-prediction #counterfactual-learning #medical-imaging #acceleration #transformer #style-transfer #novel-view-synthesis #point-cloud #spiking-neural-network #optimization #multi-layer-perceptron #adversarial-training #visual-search #image-retrieval #negative-sampling #action-localization #weakly-supervised #data-compression #hypergraph #adversarial-attack #submodularity #active-learning #deblurring #object-tracking #pyramid-structure #loss-function #gradient-descent #generalization #bug-fix #orthogonality #explainability #saliency-mapping #information-theory #question-answering #knowledge-graph #robustness #limited-data #recommender-system #anomaly-detection #gaussian-discriminant-analysis #molecular-graph #video-processing