HPC Training Series - Course 9 "Running LLMs on HPC: Transformers, Inference & Deployment"
Friday, 17 January 2025 -
10:00
Monday, 13 January 2025
Tuesday, 14 January 2025
Wednesday, 15 January 2025
Thursday, 16 January 2025
Friday, 17 January 2025
10:00
Setting up the hands-on environment (local or cloud-based/ HPC), issues solving
Setting up the hands-on environment (local or cloud-based/ HPC), issues solving
10:00 - 10:30
10:30
The Greek Competence Center for HPC & AI
-
Ilias Hatzakis
(GRNET)
The Greek Competence Center for HPC & AI
Ilias Hatzakis
(GRNET)
10:30 - 10:40
10:40
Introduction to Hugging Face Transformers, embeddings’ models, and basics of Retrieval-Augmented Generation
-
Nikos Bakas
(GRNET)
Introduction to Hugging Face Transformers, embeddings’ models, and basics of Retrieval-Augmented Generation
Nikos Bakas
(GRNET)
10:40 - 12:00
12:00
Using LLMs on “Aristotelis” HPC infrastructure: deployment, experimentation, capacity and limitations, applications
-
George Vlahavas
(AUTH)
Using LLMs on “Aristotelis” HPC infrastructure: deployment, experimentation, capacity and limitations, applications
George Vlahavas
(AUTH)
12:00 - 12:45
12:45
Break
Break
12:45 - 13:00
13:00
Inference of Hugging Face’s Pre-Trained LLMs on HPC Systems
-
Marco Magliulo
(LuxProvide / MeluXina)
Inference of Hugging Face’s Pre-Trained LLMs on HPC Systems
Marco Magliulo
(LuxProvide / MeluXina)
13:00 - 13:45
13:45
Training the Greek LLM Meltemi
-
Vassilis Katsouros
(Athena RC)
Training the Greek LLM Meltemi
Vassilis Katsouros
(Athena RC)
13:45 - 14:15
14:15
Wrap up / Q&A / Discussion
Wrap up / Q&A / Discussion
14:15 - 14:30