À propos de ce cours : This course will introduce you to the multiple forms of parallelism found in modern Intel architecture processors and teach you the programming frameworks for handling this parallelism in applications. You will get access to a cluster of modern manycore processors (Intel Xeon Phi architecture) for experiments with graded programming exercises. This course can apply to various HPC and datacenter workloads and framework including artificial intelligence (AI). You will learn how to handle data parallelism with vector instructions, task parallelism in shared memory with threads, parallelism in distributed memory with message passing, and memory architecture parallelism with optimized data containers. This knowledge will help you to accelerate computational applications by orders of magnitude, all the while keeping your code portable and future-proof. Prerequisite: programming in C/C++ or Fortran in the Linux environment and Linux shell proficiency (navigation, file copying, editing files in text-based editors, compilation).
Les destinataires de ce cours : For developers of machine learning libraries and frameworks. For innovators looking to combine machine learning and traditional computing in artificial intelligence systems. For engineers, students and researchers in computational disciplines interested in parallel computing.
Enseigné par : Andrey Vladimirov, Head of High-Performance Computing Research
Colfax International
| Niveau | Intermediate |
| Langue | English |
| Matériel requis | A computer running a recent Intel Corporation Microprocessor |
| Comment réussir | Réussissez tous les devoirs notés pour terminer le cours. |
| Notes des utilisateurs |
- Reading: Modern Code
- Vidéo: 1.0 Introduction
- Vidéo: 1.1 Why this course?
- Vidéo: 1.2 How Computers Get Faster
- Vidéo: 1.3 Intel Architecture
- Vidéo: 1.4 Modern Code
- Vidéo: 1.5 What You Are Going To Learn
- Vidéo: 1.6 Remote Access
- LTI Item: Register for cluster access
- Reading: Vectorization
- Vidéo: 2.1 Vector Operations
- Vidéo: 2.2 Vectorizing Your Code
- Vidéo: 2.3.1 Automatic Vectorization
- Vidéo: 2.3.2 Will This Vectorize?
- Vidéo: 2.4 Guided Automatic Vectorization
- Vidéo: 2.8.1 Stencil Introduction
- Vidéo: 2.8 Stencil
- Reading: Code Download
- Vidéo: 2.5 SIMD-Enabled Functions
- Vidéo: 2.6 Vector Dependence
- Vidéo: 2.7 Strip Mining
- Vidéo: Numerical Integration Introduction
- Vidéo: 2.9 Integral Vectorization
- Reading: Code Download
- Vidéo: 2.10 Learn More
- Reading: Multithreading with OpenMP
- Vidéo: 3.1 Cores and Threads
- Vidéo: Demo: Forks
- Reading: Code Download
- Vidéo: 3.2 Creating Threads
- Vidéo: 3.3 Variable Sharing
- Vidéo: 3.4 Parallel Loops
- Vidéo: 3.5 Data Races Mutexes
- Vidéo: 3.7 Parallel Reduction
- Vidéo: Stencil Introduction
- Vidéo: Stencil Demonstration
- Reading: Code Download
- Vidéo: Learn More
- Reading: Memory Traffic
- Vidéo: 4.1 Cheap Flops
- Vidéo: 4.2 Memory Hierarchy
- Vidéo: 4.3 High Bandwidth Memory
- Vidéo: 4.4 Memory Allocation
- Vidéo: Stencil Introduction
- Vidéo: Demo: Stencil with numactl
- Vidéo: Demo: Stencil with Memkind
- Vidéo: 4.5 Bypassing Caches
- Vidéo: Stencil Demonstration-Nontemporal
- Vidéo: Stencil Demonstration-Char
- Reading: Code Download
- Vidéo: 4.6 Locality in Space
- Vidéo: 4.7 Locality in Time
- Vidéo: Integral Introduction
- Vidéo: Integral Demonstration
- Reading: Code Download
- Reading: Clusters and MPI
- Vidéo: 5.1 Computing Clusters
- Vidéo: 5.2 Message Passing Interface
- Vidéo: 5.3 Programming with MPI
- Vidéo: 5.4 Compiling and Running with MPI
- Vidéo: 5.5 Peer-to-Peer Messaging
- Vidéo: 5.6 Collective Communication
- Vidéo: Stencil Introduction
- Vidéo: Stencil Demonstration-MPI
- Reading: Code Download
- Vidéo: Integral Introduction
- Vidéo: Integral Demonstration
- Reading: Code Download
- Vidéo: Learn More
Each course is like an interactive textbook, featuring pre-recorded videos, quizzes and projects.
Connect with thousands of other learners and debate ideas, discuss course material, and get help mastering concepts.
Earn official recognition for your work, and share your success with friends, colleagues, and employers.
| Acheter le cours | |
|---|---|
| Accéder au contenu du cours | Disponible |
| Accéder au contenu noté | Disponible |
| Recevoir une Note Finale | Disponible |
| Obtenir un Certificat de Cours partageable | Disponible |
Very well explained, very simple, well structured and interesting examples. Although, more diversity of the examples would be interesting, for example, mathematical operations (as matrix-matrix multiplication), bioinformatics, financial, and so on. Also, would be great more exercises, labs and resources.
A very good course with excellent material to enhance your knowledge. The quality of some videos could be improved (sudden changes/gaps).
Highly informative course with a steep learning curve but fruitful.
very nice course, good lecturer! I really enjoyed it!