Written by **Matthew Russell** who follows Jesus, studies machine learning at the University of Kentucky, and interns at NASA. Get to know him or check out his projects on GitHub.

### Disentangling VAEs, KL Divergence, and Mutual Information

September 24, 2020#probability#math#machine-learning#jointvaeIāve recently been reading about the JointVAE model proposed by Emilien Dupont in the paper Learning Disentangled Joint Continuous and Discrete Representations. The paper builds on the development of variational autoencoders (VAEs). As a quick overview, autoencoders are neural networks that take an input, generate some āsecretā representation of it, then try to use that āsecretā code to reconstruct the input. If it can do that well, then we have found a secret code that summarizes the importantā¦

### Markov Chain Monte Carlo Sampling

September 23, 2020#probability#mathOne of my courses recently introduced Markov Chain Monte Carlo (MCMC) sampling, which has a lot of applications. Iād like to dive into those applications in a future post, but for now letās take a quick look at Metropolis-Hastings MCMC. A Brief Prologue Letās say we have a probability distribution function (within a mulplicative constant) that is very complex. We have an equation, but maybe it is impossible to integrate. Somehow, weād like to draw samples from this distribution to estimateā¦

### Belief Propagation

September 16, 2020#probability#mathLetās say that you and I are roommates, and I notice youāve been gone the last two Friday nights. This is not necessarily unusual, and sometimes your Friday night excursion is a date. However, you donāt communicate well, so I have no idea if you had a date or not. As you prepare to go out for the third Friday in a row, I wonder if this Friday you have a date. You wonāt spill the beans, but I have a mind-reading superpower ā *pause for dramatic effect* ā math š„. I make an educated guess that ifā¦

### It's Not Magic, Just Close

June 27, 2020#machine-learningHow AI recognizes things it has only seen a handful of times, once, or not at all

### Using Numpy with Intel MKL on macOS

April 23, 2020#python#numpy#blasNumpy defaults to OpenBLAS, but conda has automatic MKL support. How can we tell Numpy to skip OpenBLAS and use MKL?

### Setting Up Single-Node Hadoop on an Ubuntu VM (Windows 10 Host)

February 17, 2020#hadoop#ubuntuYou could use the Cloudera Quickstart VM, but then you wouldn't be able to use Kotlin.

### How to Win a Science & Engineering Fair

January 07, 2020#science fairAs competition season comes upon us, several suggestions come to mind for students eager to learn the methods and madness of science fair competitions.

### Apparently You Can Hard Brick SD Cards

December 29, 2019#raspberry-piRecently, I was attempting to setup a Raspberry Pi Zero W with the latest Raspbian Buster Lite image and ran into an ... uh ... issue.

### ALBERT - Alexa-controlled LEGO Biological ExpeRimenT

December 24, 2019#ev3#space#challenge(UPDATE: I didn't win.) Hackster recently (read: September) announced a LEGO MINDSTORMS EV3 and Alexa challenge.

### Initial Commit

December 12, 2019#markdownI've considered starting a blog more than once over the past few years. Also, markdown is the best.