skill-tree:bda:b
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| skill-tree:bda:b [2020/07/19 19:17] – lucy | skill-tree:bda:b [2025/11/05 11:30] (current) – external edit 127.0.0.1 | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| - | # BDA-B Big Data Analytics | + | # BDA Big Data Analytics |
| - | # Background | + | |
| The analysis of large volumes of data is essential in HPC. | The analysis of large volumes of data is essential in HPC. | ||
| Big data analytics covers concepts and tools to perform this task traditionally in the cloud environment -- that, compared to HPC systems, utilizes cheap and less-reliable hardware. | Big data analytics covers concepts and tools to perform this task traditionally in the cloud environment -- that, compared to HPC systems, utilizes cheap and less-reliable hardware. | ||
| However, as tools and concepts matured, they are now applied in HPC environments as well. | However, as tools and concepts matured, they are now applied in HPC environments as well. | ||
| + | |||
| HPC workloads utilize tools and methodology from Data Science (DS) and Artificial Intelligence (AI) to process data in order to obtain results quickly. | HPC workloads utilize tools and methodology from Data Science (DS) and Artificial Intelligence (AI) to process data in order to obtain results quickly. | ||
| AI can be used inside simulations or to steer workflows, while data science can be used to find interesting patterns inside the data. | AI can be used inside simulations or to steer workflows, while data science can be used to find interesting patterns inside the data. | ||
| - | # Aim | + | ## Learning Outcomes |
| - | * To convey principles and tools that can be used for effective data analysis. | + | |
| - | # Outcomes | + | * Examine some theoretical principles |
| - | | + | * Differentiate the various tools that could be used in an HPC environment effectively. |
| - | * Differentiate the various tools that could be used in an HPC environment effectively. | + | * Contrast the different steps in data processing from preparation, |
| - | * Compose a workflow consisting of HPC and big data tools to analyze the data. | + | * Describe and apply the concepts of artificial intelligence and data science. |
| + | * Compose a workflow consisting of HPC and big data tools to analyze the data. | ||
| + | * Apply statistical evaluation techniques to assess the generalization and reliability of ML models and benchmark AI models at scale with a focus on consistency, | ||
| # Subskills | # Subskills | ||
| - | | + | |
| - | * [[skill-tree: | + | * [[skill-tree: |
| - | * [[skill-tree: | + | * [[skill-tree: |
| - | * [[skill-tree: | + | * [[skill-tree: |
| + | * [[skill-tree: | ||
| + | * [[skill-tree: | ||
| + | * [[skill-tree: | ||
| + | * [[skill-tree: | ||
| + | * [[skill-tree: | ||
skill-tree/bda/b.1595179059.txt.gz · Last modified: 2020/07/19 19:17 by lucy
