Drake Lyrics Generator

My GPT model project involved creating a custom language model trained on Drake lyrics from scratch. Leveraging Python and basic PyTorch functions, I meticulously built all sections of the decoder. This process showcased my deep understanding of essential components, including Multi-Headed Attention, Embeddings, and the Transformer Block. To ensure maintainability and reusability, I incorporated Object-Oriented principles such as Abstraction and Inheritance. The resulting model exemplifies my commitment to clean code and practical solutions in natural language processing.

Python
Pytorch
Pandas
Numpy
project's landing page image