ConGraT: Self-Supervised Contrastive Pretraining for Joint Graph and Text Embeddings

1 code implementation • 23 May 2023 • William Brannon, Suyash Fulay, Hang Jiang, Wonjune Kang, Brandon Roy, Jad Kabbara, Deb Roy

We propose ConGraT(Contrastive Graph-Text pretraining), a general, self-supervised method for jointly learning separate representations of texts and nodes in a parent (or ``supervening'') graph, where each text is associated with one of the nodes.

Contrastive Learning Link Prediction