====== Graph Neural Networks in Big Data Analytics ======

| [[https://ekvv.uni-bielefeld.de/kvv_publ/publ/vd?id=361991412|392232]] | Schönhuth   | Winter 2022/23 | Thu 10:15-11:45 (S) V6-116 and Zoom |

==== Content ====

The recent surge of machine learning (ML) has opened up various opportunities when analyzing big datasets. Beyond basic, non-ML supported techniques of big data analytics, such as identifying similar items in big datasets, or arranging how to distribute jobs on large compute clusters, for example, the ML supported techniques enable to extract knowledge from large datasets at utmost diversity and accuracy.

The seminar will start with a mini lecture. First, lectures will explain how to cluster datasets. Clustering is an 'unsupervised' machine learning technique by which to mine social network graphs, for example. Second, 'supervised' machine learning techniques (where 'deep learning' likely is the most prominent recent technique) and their use in analyzing big data will be discussed. The mini lecture will be followed by seminar presentations, to be presented in small groups of 1-2 students.

==== Important Links ====

  * [[https://lernraumplus.uni-bielefeld.de/course/view.php?id=15934|Lernraum-Plus]]
  * [[https://uni-bielefeld.cloud.panopto.eu/Panopto/Pages/Sessions/List.aspx?folderID=183b799d-b31a-4467-8bed-af3b00ded92c|Seminar Recordings]]

==== Papers ====

You can selected a paper you wish to present In the Lernraum-Plus

=== Review Papers ===
Meant to serve as a reference for the students to familiarize themselves with
  * [[https://arxiv.org/abs/1812.08434|Graph neural nets: A review of methods and applications]], //Zhou et. al//
  * [[https://arxiv.org/abs/1901.00596|A Comprehensive Survey on Graph Neural Nets]], //Wu et. al//
  * [[https://arxiv.org/abs/1712.00468|Graph Signal Processing: Overview, Challenges and Applications]], //Ortega et. al//
  * [[https://arxiv.org/abs/2104.04883|Graph Representation Learning in Biomedicine]], //Li et. al//
  * [[https://www.sciencedirect.com/science/article/pii/S2452310021000329|Graph Representation Learning for Single Cell Biology]], //Hetzel et. al//

=== Important Papers ===
Papers that describe different architectures, etc. These can be presented.
  * [[https://arxiv.org/abs/1710.10903|Graph Attention Networks]], //Veličković et. al//
  * [[https://arxiv.org/abs/1611.07308|Variational Graph Autoencoders]], //Kipf, T. and Welling, M.//
  * [[https://arxiv.org/abs/1609.02907|Semi-Supervised Classification with Graph Convolutional Network]], //Kipf, T. and Welling, M.//
  * [[https://arxiv.org/abs/1905.13177|Graph Normalizing Flows]], //Liu et. al//
  * [[https://arxiv.org/abs/2102.11391|MagNet: A Neural Network for Directed Graphs]], //Zhang et. al//
  * [[https://arxiv.org/abs/1711.07553|Residual Gated Graph Convnets]], //Bresson, X. and Laurent, T.//
  * [[https://arxiv.org/abs/2106.05194|DIGRAC: Digraph Clustering Based on Flow Imbalance]], //He et. al//

=== Applications ===
These papers can be presented too.
  * [[https://arxiv.org/abs/1706.02263|Graph Convolutional Matrix Completion]], //van den Berg et. al//
  * [[https://arxiv.org/abs/1911.02613|Hyper-SAGNN: a self-attention based graph neural network for hypergraphs]], //Zhang et. al//
  * [[https://arxiv.org/abs/2206.00668|Learning to Untangle Genome Assembly with Graph Convolutional Networks]], //Vrček et. al//
  * [[https://arxiv.org/abs/2003.03123|Directional Message Passing for Molecular Graphs]], //Gasteiger et. al//
  * [[https://arxiv.org/abs/2108.11482|ETA Prediction with Graph Neural Networks in Google Maps]], //Derrow-Pinion et. al//
  * [[https://arxiv.org/abs/1906.01227|An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problem]], //Joshi et. al//
  * [[https://dl.acm.org/doi/full/10.1145/3474379|eFraudCom: An E-commerce Fraud Detection System via Competitive Graph Neural Networks]], //Zhang et. al//
==== Time table ====

| **Date** | **Topic** ||
|20.10.2022| [[teaching:2022winter:graphnet:seminar01|Organization & Introduction I]] ({{teaching:2022winter:graphnet:introduction-201022.pdf|slides}})||
|27.10.2022| [[teaching:2022winter:graphnet:seminar02|Introduction II]] ({{teaching:2022winter:graphnet:lecture2-271022.pdf |slides}}) ||
|03.11.2022| [[teaching:2022winter:graphnet:seminar03|Introduction III / How to present]] ({{teaching:2022winter:graphnet:lecture3-031122.pdf |slides}}) ||
|10.11.2022| [[teaching:2022winter:graphnet:seminar04|Introduction IV]] ({{teaching:2022winter:graphnet:lecture4-101122.pdf|slides}}) ||
|17.11.2022| [[teaching:2022winter:graphnet:seminar05|Introduction V]] ({{teaching:2022winter:graphnet:lecture5-171122.pdf|slides}})||
|24.11.2022| //no seminar// ||
|01.12.2022| //no seminar// ||
|08.12.2022|//no seminar// ||
|15.12.2022| An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problem ||
|22.12.2022| Semi-Supervised Classification with Graph Convolutional Network ||
|29.12.2022 | Christmas Break||
|05.01.2023| KGNN: Knowledge Graph Neural Network for Drug-Drug Interaction Prediction | Variational Graph Autoencoders |
|12.01.2023| ETA Prediction with Graph Neural Networks in Google Maps | Do Transformers Really Perform Bad for Graph Representation? |
|19.01.2023| Graph Normalizing Flows ||
|26.01.2023| Graph Convolutional Matrix Completion ||
|02.02.2023| ||