Projects

An interactive tool to visualize the training of neural networks. Explore how inputs and outputs are represented in a classifier, and see how hidden nodes and weights change over time. This neural network is a simple classifier. It takes 5x5 pixel images as input, and outputs the digit that each image represents. All 25 pixels of the image are fed into the neural network as input nodes. Hidden Neurons: Iterations: Reset ↺ Train → Iterations: 0 | Accuracy: 0% | Loss: N/A ...

A simple 8 puzzle solver. (With your choice of heuristic function and search algorithm!) | I first wrote an 8 puzzle solver some years in my university Artificial Intelligence class. That version was a terminal program written in Python. Manhattan Distance Hamming Distance A-Star Search Breadth First Greedy Best First ◀ ...

FORTH is a simple stack-based language. It is a great language to learn about compilers and interpreters. This article will show you how to write a FORTH compiler and interpreter in 130* lines of Python. Get all the code on Github Introduction FORTH is a simple stack-based language. It is a great language to learn about compilers and interpreters. This article will show you how to write a FORTH compiler and interpreter in 130* lines of Python. ...

In mid 2021, there was lots of excitement around the flexibility of large transformer models. I wanted to see if I could use GPT-J as an all-in-one news-based trading bot. The idea being, if the model has read enough of the internet as background, it should understand the context of a news article, and output a trading signal for a given company. Read the full paper PDF. Background Back in the dark ages (yes, I mean before Chat-GPT took the internet by storm), transformer-based text generation models were known only to AI researchers and the nerdiest of programmers. It took until the release of OpenAi’s GPT-2 in early 2019 before I joined the hype train. Like everyone else at the time, I wanted to co-opt the power of transformers for fun and profit, but alas OpenAi was only allowing other big-time researchers, or deep-pocketed corporations access to their groundbreaking technology. Thankfully in the meantime, Ben Wang and Aran Komatsuzaki were assembling a crack team of open-source gods to compete with OpenAI. Working at breakneck pace, they released GPT-J, a free and open competitor to GPT-2 and GPT-3 by early 2021, just in time for me to make use of their work in my senior research project for my college degree. ...