HPC Training Series - Course 9 "Running LLMs on HPC: Transformers, Inference & Deployment"

Friday, 17 January 2025 - 10:00


        : Sessions
    /     : Talks
        : Breaks
17 Jan 2025
AM
10:00 Setting up the hands-on environment (local or cloud-based/ HPC), issues solving   ()
10:30 The Greek Competence Center for HPC & AI - Mr Ilias Hatzakis (GRNET)   ()
10:40 Introduction to Hugging Face Transformers, embeddings’ models, and basics of Retrieval-Augmented Generation - Dr Nikos Bakas (GRNET)   ()
PM
12:00 Using LLMs on “Aristotelis” HPC infrastructure: deployment, experimentation, capacity and limitations, applications - Dr George Vlahavas (AUTH)   ()
12:45 --- Break ---
13:00 Inference of Hugging Face’s Pre-Trained LLMs on HPC Systems - Dr Marco Magliulo (LuxProvide / MeluXina)   ()
13:45 Training the Greek LLM Meltemi - Dr Vassilis Katsouros (Athena RC)   ()
14:15 Wrap up / Q&A / Discussion   ()