Neural Networks Introduction

Introduction

Neural networks have played a foundational role in the field of deep learning and serve as one of the theoretical bases for many modern mainstream models. This blog will serve as a directory, systematically documenting the research process related to neural networks.

Table of Contents

• Linear Regression

• MLP (MultiLayer Perceptron)

• Convolutional Neural Network ✅

  • Blog

• Recurrent Neural Network

• Graph Neural Network

• GAN (Generative Adversarial Network)

• Diffusion Model

• Attention Mechanism ✅

  • Blog for Transformer

  • Blog for Attention Mechanism

Resources

All the source code will be open-sourced in This Github Repo, to be refactored.