skill-tree:k:1:2:b
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
skill-tree:k:1:2:b [2020/06/24 17:22] – [Outcomes] kai_h | skill-tree:k:1:2:b [2021/09/13 11:57] (current) – external edit 127.0.0.1 | ||
---|---|---|---|
Line 3: | Line 3: | ||
HPC computer architectures are parallel computer architectures. A parallel computer is built out of | HPC computer architectures are parallel computer architectures. A parallel computer is built out of | ||
- | * compute | + | * Compute |
- | * main memory, | + | * Main memory. |
- | * and a high speed network. | + | * A high-speed network. |
# Aim | # Aim | ||
- | * To provide knowledge about parallel computer architectures, | + | * To provide knowledge about parallel computer architectures, |
# Outcomes | # Outcomes | ||
- | * elementary processing elements like CPUs, GPUs, many core architectures | + | * elementary processing elements like CPUs, GPUs, many-core architectures |
- | * vector systems, and FPGAs | + | * vector systems, and FPGAs |
- | * the NUMA architecture used for symmetric multiprocessing systems where the memory access time depends on the memory location relative to the processor | + | * the NUMA architecture used for symmetric multiprocessing systems where the memory access time depends on the memory location relative to the processor |
- | * network demands for HPC systems (e.g. high bandwidth and low latency) | + | * network demands for HPC systems (e.g. high bandwidth and low latency) |
* typical network architectures used for HPC systems, like fast Ethernet (1 or 10 Gbit) or InfiniBand | * typical network architectures used for HPC systems, like fast Ethernet (1 or 10 Gbit) or InfiniBand | ||
- | | + | |
- | * Comprehend that **GPUs** (Graphical Processing Units) or **GPGPUs** (General Purpose Graphical Processing Units) were originally used for image processing and displaying images on screens before people started to utilize the compute | + | |
+ | * Comprehend that **GPUs** (Graphical Processing Units) or **GPGPUs** (General Purpose Graphical Processing Units) were originally used for image processing and displaying images on screens before people started to utilize the computing | ||
* Comprehend that **FPGAs** (Field-Programmable Gate Arrays) are devices that have configurable hardware and configurations are specified by hardware description languages | * Comprehend that **FPGAs** (Field-Programmable Gate Arrays) are devices that have configurable hardware and configurations are specified by hardware description languages | ||
* Comprehend that **FPGAs** are interesting if one uses them to implement hardware features that are not available in CPUs or GPUs (e.g. low precision arithmetic that needs only a few bits) | * Comprehend that **FPGAs** are interesting if one uses them to implement hardware features that are not available in CPUs or GPUs (e.g. low precision arithmetic that needs only a few bits) | ||
- | * Comprehend that **Vector units** are successors of vector computers (i.e. the first generation of supercomputers) | + | * Comprehend that **Vector units** are successors of vector computers (i.e. the first generation of supercomputers) |
- | * | + | * Comprehend that at an abstract level the high-speed network connects compute units and main memory which leads to three main parallel computer architectures |
+ | * **Shared Memory** where all compute units can directly access the whole main memory | ||
+ | * **Distributed memory** where individual computers are connected with a network | ||
+ | * **NUMA** (Non-Uniform Memory Access) combines properties from shared and distributed memory systems, because at the hardware level a NUMA system resembles a distributed memory | ||
+ | * Comprehend that in general, the effort for programming parallel applications for distributed systems is higher than for shared memory systems | ||
# Subskills | # Subskills | ||
+ | * [[skill-tree: | ||
+ | * [[skill-tree: |
skill-tree/k/1/2/b.1593012135.txt.gz · Last modified: 2020/06/24 17:22 by kai_h