codekansas

A blog of language, neuroscience, and deep learning

deep learning

Convolutional Neural Networks in NLP

July 3, 2018

A visualization of convolutional neural networks in natural language processing

Making Neural Networks Functional

June 11, 2018

Building neural networks in a functional programming language with Hy

Generating Shakespeare

September 18, 2017

A visualization of generating text using an RNN

Decoding Gibberish using Neural Networks

April 16, 2017

Training a neural network to predict word embeddings from spelling, and using nearest neighbor search to decode meaning.

Deep Learning for Calcium Imaging

April 13, 2017

A tutorial on applying supervised and unsupervised deep learning methods to calcium imaging. These methods are applicable to other time-series modeling problems.

Looking at Residual Networks

November 1, 2016

Some thoughts on residual networks (and skip connections in general), including how to build a wrapper for Keras layers.

Using Gensim Word2Vec Embeddings in Keras

August 2, 2016

A short post and script regarding using Gensim Word2Vec embeddings in Keras, with example code.

The Unreasonable Effectiveness of Restricted Boltzmann Machines

July 18, 2016

Building on the Recurrent RBM for sequence modeling. This post relates to what I am doing for my Master's thesis.

Deep Language Modeling for Question Answering using Keras

April 27, 2016

An in-depth introduction to using Keras for language modeling; word embedding, recurrent and convolutional neural networks, attentional RNNs, and similarity metrics for vector embeddings.

A Neural Network in 28 Lines of Theano

February 23, 2016

A quick introduction to using Theano for deep learning, from the bare-bones to a full neural network.

personal

Roaming through Japan

May 8, 2017

Exploring the Land of the Rising Sun for 19 days by train, through Tokyo, Nikko, Sendai, Sapporo, Kyoto, Osaka and Nagoya.

How I Spent Spring Break in Cuba

March 4, 2017

A field guide to traveling to Cuba, written by naive college students for naive college students, mostly as exposition.

Touring the United States and Canada

May 11, 2016

Narration from my trip with my girlfriend through Nashville, Chicago, Toronto, Montreal, and Washington DC.

Evolving List of Opinions about Atlanta Craft Beers

March 30, 2016

Some facts and very sarcastic opinions regarding craft beers that can be bought at the Krogers near my apartment.

language

Convolutional Neural Networks in NLP

July 3, 2018

A visualization of convolutional neural networks in natural language processing

Introduction to Information Retrieval

November 14, 2017

An interactive demo of a document retrieval system, with explanations of how it works

Decoding Gibberish using Neural Networks

April 16, 2017

Training a neural network to predict word embeddings from spelling, and using nearest neighbor search to decode meaning.

Using TF-IDF to Annotate to a Trump Speech

August 8, 2016

Explaining how to use TF-IDF scores for document similarity and applying those to choose documents to cite for particular sentences.

Using Gensim Word2Vec Embeddings in Keras

August 2, 2016

A short post and script regarding using Gensim Word2Vec embeddings in Keras, with example code.

Deep Language Modeling for Question Answering using Keras

April 27, 2016

An in-depth introduction to using Keras for language modeling; word embedding, recurrent and convolutional neural networks, attentional RNNs, and similarity metrics for vector embeddings.

neuroscience

Entropy in Networks of Neurons

September 25, 2017

Do layers of a network of neurons reduce neuron-wise entropy?

Biological Neuron Models

September 20, 2017

An exploration of some biological neuron models, in Javascript

Deep Learning for Calcium Imaging

April 13, 2017

A tutorial on applying supervised and unsupervised deep learning methods to calcium imaging. These methods are applicable to other time-series modeling problems.

visualizations

Convolutional Neural Networks in NLP

July 3, 2018

A visualization of convolutional neural networks in natural language processing

Introduction to Information Retrieval

November 14, 2017

An interactive demo of a document retrieval system, with explanations of how it works

Wireworld

October 1, 2017

A (slightly modified) Wireworld implementation

Entropy in Networks of Neurons

September 25, 2017

Do layers of a network of neurons reduce neuron-wise entropy?

Biological Neuron Models

September 20, 2017

An exploration of some biological neuron models, in Javascript

Generating Shakespeare

September 18, 2017

A visualization of generating text using an RNN

Decoding Gibberish using Neural Networks

April 16, 2017

Training a neural network to predict word embeddings from spelling, and using nearest neighbor search to decode meaning.