Tagged: deep-learning

On the Issues with Transpose Convolution and GAN Based Synthesis

In this post, we discuss the issue of checkerboard artefacts introduced by transpose convolution layers as well as proposed solutions to this problem. Experiments on audio synthesis are also given, further motivating these methods.

Contrastive Predictive Coding for Representation Learning

An exploration of Noise Contrastive Estimation (NCE) and how it enables Contrastive Predictive Coding (CPC) for learning useful representations from high-dimensional sequential data like speech.