Automatic Differentiation (AutoDiff): A Brief Intro with Examples
An introduction to the mechanics of AutoDiff, exploring its mathematical principles, implementation strategies, and applications in currently most-used frameworks.
Solve Optimization Problems on Google Cloud Platform using Google’s OR API and OR-tools MathOpt
A quick guide to implementing and solving mathematical optimization models using Google Cloud Platform (GCP) with OR-tools MathOpt interface and OR API endpoints in Python.
What are Query, Key, and Value in the Transformer Architecture and Why Are They Used?
An analysis of the intuition behind the notion of Key, Query, and Value in Transformer architecture and why is it used.
Graph Attention Networks Paper Explained With Illustration and PyTorch Implementation
A detailed and illustrated walkthrough of the “Graph Attention Networks” paper by Veličković et al. with the PyTorch implementation of the proposed model.
Policy Gradient Algorithm’s Mathematics Explained with PyTorch Implementation
A step-by-step explanation of the vanilla policy gradient algorithm and its implementation.
