Collaborative Score Distillation for Consistent Visual Synthesis

Expand dimension by leveraging consistency without changing the architecture

#multi-modal #diffusion-model

LiT:fire:: Zero-Shot Transfer with Locked-image Text Tuning

Image-text pre-training with pre-trained image model enhances zero-shot performance

#multi-modal #contrastive-learning

End-to-end Multi-modal Video Temporal Grounding

Adding depth and flow to RGB improves video understanding

#video-understanding #multi-modal

CLIP-It! Language-Guided Video Summarization

Get highlight clip of your favorite player by typing it

#multi-modal #video-understanding

StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery

Make your cat cute by typing it into this StyleGAN-CLIP hybrid

#multi-modal #generative-adversarial-network #image-manipulation

#language-model #instruction-tuning #multi-modal #diffusion-model #notice #graph-neural-network #responsible-ai #privacy-preserving #scaling #mixture-of-experts #image-generation #generative-adversarial-network #speech-model #contrastive-learning #self-supervised #image-representation #image-processing #object-detection #pseudo-labeling #scene-text-detection #neural-architecture-search #data-sampling #long-tail #graph-representation #zero-shot #metric-learning #federated-learning #weight-matrix #low-rank #vision-transformer #computer-vision #normalizing-flow #invertible-neural-network #super-resolution #image-manipulation #thread-summarization #natural-language-processing #domain-adaptation #knowledge-distillation #scene-text #model-compression #semantic-segmentation #instance-segmentation #video-understanding #code-generation #graph-generation #image-translation #data-augmentation #model-pruning #signal-processing #text-generation #text-classification #music-representation #transfer-learning #link-prediction #counterfactual-learning #medical-imaging #acceleration #transformer #style-transfer #novel-view-synthesis #point-cloud #spiking-neural-network #optimization #multi-layer-perceptron #adversarial-training #visual-search #image-retrieval #negative-sampling #action-localization #weakly-supervised #data-compression #hypergraph #adversarial-attack #submodularity #active-learning #deblurring #object-tracking #pyramid-structure #loss-function #gradient-descent #generalization #bug-fix #orthogonality #explainability #saliency-mapping #information-theory #question-answering #knowledge-graph #robustness #limited-data #recommender-system #anomaly-detection #gaussian-discriminant-analysis #molecular-graph #video-processing