Understanding RNNs and LSTMs: What's the Deal?

✦ AI Summary

A clear explanation of how RNNs work and why they struggle with long-term dependencies, followed by a technical walkthrough of how LSTM's gating mechanisms solve the vanishing gradient problem.

September 20, 2024 · 6 min

Understanding Cross-Entropy

✦ AI Summary

An intuitive introduction to cross-entropy as a loss function in deep learning classification tasks, complete with analogy, formula derivation, and a worked numerical example.

September 18, 2024 · 3 min

Understanding Embedding Layers

✦ AI Summary

A beginner-friendly explanation of embedding layers in deep learning, showing how discrete data like words are transformed into meaningful numerical vectors that allow neural networks to learn semantic relationships.

September 13, 2024 · 4 min

OMR Related Paper Review: Practical End-to-End Optical Music Recognition for Pianoform Music

✦ AI Summary

A review of a paper proposing an end-to-end OMR pipeline for piano music using LMX linearized encoding, covering its encoder-decoder architecture, Zeus dataset, and the advantages of treating music recognition as a sequence generation task.

August 27, 2024 · 8 min

How to Understand Batch Normalization?

✦ AI Summary

Explains Batch Normalization through a vivid classroom-preparation analogy, covering why internal covariate shift hurts training and how BN's normalization with learnable parameters addresses it.

August 11, 2024 · 5 min