JUPYTER NOTEBOOKS

MT & LLM Notebooks

A collection of Jupyter notebooks in which we explore concepts in machine translation and large language models

Featured Notebook

Advanced MT Evaluation Metrics

Implementation and analysis of BLEU, chrF, METEOR and COMET for machine translation evaluation.

PythonSacreBLEUCOMET
Open in Colab
Advanced MT Evaluation Metrics
Large Language Models

Fine-tuning LLMs for Specialized Tasks

Explore techniques for fine-tuning large language models on domain-specific tasks using LoRA and QLoRA.

PyTorchTransformersPEFT
Open in Colab
Machine Translation
Coming Soon

Building a Neural Machine Translation System

Implementation of a Transformer-based machine translation system from scratch using PyTorch.

PyTorchTransformersNLTK
Coming Soon

Getting Started

Prerequisites

  • Basic understanding of Python and PyTorch
  • Familiarity with neural networks and transformers
  • Google Colab account for running notebooks
  • Basic knowledge of NLP concepts

Setup Instructions

  1. 1Clone the repository from GitHub
  2. 2Open notebooks in Colab or local Jupyter environment
  3. 3Install required dependencies using pip
  4. 4Follow along with the step-by-step instructions