AI3 AI Modalities

This node introduces various types of AI model modalities and their applications in HPC environments. It groups foundational knowledge and deployment considerations for language, image, audio, video, multimodal, graph, and scientific models, along with principles of interpretability.

• Explain the structure and application of large language models and how they scale in HPC environments.
• Describe the training and inference workflows of image-based models and their resource requirements.
• Summarize techniques used in audio and voice model processing and deployment.
• Identify the challenges of video generation models and their compute/memory implications.
• Understand how multimodal models combine inputs from various domains and the synchronization strategies involved.
• Describe graph neural network architectures and their relevance in scientific and relational data modeling.
• Explain the role of domain-specific scientific models in physics-informed AI and simulation-enhanced learning.
• Apply principles of explainable AI (XAI) to interpret predictions and assess model reliability across modalities.

• 1
• AI3.2 Image Models
• 3
• 4
• AI3.5 Multimodal Models
• 6
• 7
• AI3.8 Explainable AI (XAI)

Caution: All text is AI generated