Posts
- Feb 14, 2025
Partial solution to BPE Tokenizer Implementation Exercise from Andrej Karpathy. Corresponding youtube video on the tokenizer topic. import regex import requests from collections import Counter GPT4_SPLIT_PATTERN = r"""'(?i:[sdmt]|ll|ve|re)|[^\r\n\p{L}\p{N}]?+\p{L}+|\p{N}{1,3}| ?[^\s\p{L}\p{N}]++[\r\n]*|\s*[\r\n]|\s+(?!\S)|\s+""" SHAKESPEAR_TEXT_URL = "https://raw.githubusercontent.com/karpathy/char-rnn/master/data/tinyshakespeare/input.txt" class BPETokenizer: def __init__(self, *, pattern=GPT4_SPLIT_PATTERN, special_tokens=[]): self.pattern = pattern...
- Feb 11, 2025
Table of Contents Glossed Overview: RLHF for LLM Further Background Readings RLHF in Deep Reinforcement Learning Learning to summarize from human feedback Webgpt: Browser-assisted question-answering with human feedback Training language models to follow instructions with human feedback Training a helpful and harmless...
- Mar 10, 2022
Yesterday I spent way more time than neccessary debugging a piece of python code. It has something to do with how the python dictionary’s get method works with default arguments. TLDR: it is ok when default is a simple value, not recommended...
- Apr 14, 2021
The other day, I shadowed an interview with a data science candidate. The primary focus is obviously not on coding skills, but we do want to assess basic knowledge of the programming language of his choice. So, my colleague asked a very...
- Oct 31, 2019
Notes on Learning To Rank Task We want to learn a function \(f(q, D)\) which takes in a query \(q\) and a list of documents \(D=\{d_1, d_2, ..., d_n\}\), and produces scores using which we can rank/order the list of documents. Types...
- Oct 25, 2019
Yester day I experienced my biggest shakeup ever since I started participating on Kaggle. I dropped from silver zone to nowhere. The competition is an image segmentation competition, and based on past experience, CV competitions has relatively low shakeups(compare to tabular/transaction/time series...
- Aug 22, 2019
I was working on a piece of code today and I need to iterate over a iterable multiple times to do some computes. The body of code is the same for all passes. One obvious thing I can do is to do...
- Aug 21, 2019
When working with machine learning problems, often I use python dictionary to map categorical values to its integer encoded values. Something like: import string feature_encoder = {v:i for i, v in enumerate(string.ascii_lowercase)} To get back the original value, I need to have...
- May 22, 2019
My current website hosting costs me $7.99 a month plus ~$20 for domain name per year. I have been paying this amount for a little more than 3 years, and finally decided to cut the hosting fee by migrating over to github...