2513607 – Seminar Large Language Model-Enhanced Representation Learning for Knowledge Graphs (Master)

Seminar Large Language Model-Enhanced Representation Learning for Knowledge Graphs Seminar Large Language Model-Enhanced Representation Learning for Knowledge Graphs In this seminar, we aim to explore state-of-the-art approaches that utilize LLMs for Knowledge Graph representation learning. The research papers chosen for the presentations are published in reputable venues such as EMNLP, NAACL, ACL, etc. The goal of the seminar is to understand the allotted paper and other related literature and present the paper. The students are required to submit a 10-page report on the paper excluding the references and appendix. Also, the students need to reimplement the code provided by the corresponding authors of the papers and produce results on existing datasets. The seminar will be limited to 10 participants.

Allgemeine Informationen

Wichtige Informationen

Effective feature representation is critical for optimizing the performances of machine learning algorithms. Recently, Representation Learning (RL) has advanced significantly, focusing on embedding words and Knowledge Graphs (KGs) into low-dimensional vector spaces. Word embeddings encode words as vectors, capturing context, semantic similarity, and relationships. Similarly, KG representation learning (KGRL) algorithms (a.k.a. KG embedding (KGE) models) are used to represent entities and relations as vectors in a low-dimensional vector space, preserving structure and semantic connections.

KGE models can be unimodal, using a single source of information, or multimodal, integrating multiple sources such as relations between entities, text literals, numeric literals, images, etc. Capturing information from these sources ensures semantically rich representations. Multimodal KGE models either create separate representations for each source in non-unified spaces or a unified representation for KG elements. These embeddings are commonly used for KG completion tasks such as link prediction and entity classification.

Emerging methodologies for KGRL leverage Large Language Models (LLMs) such as LLaMA, GPT 3.5, and PaLM2. The integration of LLMs with KG KGRL signifies a pivotal advancement in the field of artificial intelligence, enhancing the ability to capture and utilize complex knowledge structures.

In this seminar, we aim to explore state-of-the-art approaches that utilize LLMs for Knowledge Graph representation learning.

Contributions of the students:

Each student will be assigned one paper on the topic, which could be a research paper discussing a novel approach or a resource paper presenting datasets, tools, etc. The student will be responsible for the following tasks:

1. Report Writing
- Read the assigned paper thoroughly and write a 15-page seminar report explaining the methods and findings in their own words.
2. Presenting
- Prepare and deliver a seminar presentation to share insights from the paper with other seminar participants.
3. Conducting Experiments
- If the authors provide code, re-implement it for small-scale experiments using Google Colab or make the implementation available via GitHub.

Prerequisites for this course:
- Completion of a foundational course in machine learning.
- Basic understanding of knowledge graphs.
- Proficiency in programming, preferably in Python.

Teaching Team:

Dr. Genet Asefa Gesese
M. Sc. Mary Ann Tan
M. Sc. Mahsa Vafaie

The kick-off meeting will take place on Wednesday, April 30 at 14:00 - 15:30 in room 5A-09 (AIFB building)

Allgemein

Sprache

Englisch

Verfügbarkeit

Zugriff

29. Apr 2025, 15:25 - 30. Jul 2025, 15:25

Aufnahmeverfahren

Sie können diesem Kurs direkt beitreten.

Zeitraum für Beitritte

Unbegrenzt

Für Kursadministration freigegebene Daten

Daten des Persönlichen Profils

Anmeldename
Vorname
Nachname
E-Mail
Matrikelnummer

Zusätzliche Informationen

Objekt-ID

3526361