Python and PyTorch: Hands-On AI for Language Models (S-IT0068)

Inter-company training

Duration

 16,00 hours(s)

2 days

Language(s) of service

EN

Who is organizing this training?

Le Luxembourg Lifelong Learning Centre (LLLC) est le centre de formation continue de la Chambre des salariés. Il dispose aujourd’hui d'une large gamme de formations continues qui s’adresse à un large public. Son offre de formation continue a pour but de: permettre aux professionnels d’optimiser leurs chances de promotion et d’évolution en entreprise, etc.

Who is the training for?

This seminar is designed for intermediate Python programmers and AI practitioners who are comfortable with Python, have basic machine learning knowledge, and are eager to deepen their skills in NLP and PyTorch-based model development.

Prerequisites

Basic programming experience with Python and confidence in writing Python code are required.

Goals

  • Understand the Basics of Language Models
  • Build and Fine-Tune Custom Models
  • Apply Techniques to Solve Real-World NLP Problems

Contents

  • Introduction to Language Models and Transformers
    • Fundamentals of NLP and language models (LMs), covering key concepts like tokenization, embeddings, and attention mechanisms.
    • Overview of Transformer architectures and popular models like BERT and GPT.
  • Building a Language Model from Scratch with Python and PyTorch
    • Step-by-step guide to implementing a simple language model in PyTorch, covering layers, tokenization, and loss functions.
    • Training and evaluating the model on a small dataset to understand performance and limitations.
  • Fine-Tuning Pre-trained Models with Python and PyTorch
    • Introduction to Hugging Face Transformers and PyTorch Lightning.
    • Hands-on exercise: fine-tuning a pre-trained model for a specific task, such as sentiment analysis or text classification.

These courses might interest you