NVIDIA Deep Learning Institute Releases New Generative AI Teaching Kit
Generative AI, powered by advanced machine learning models and deep neural networks, is revolutionizing industries by generating novel content and driving innovation in fields like healthcare, finance, and entertainment.
NVIDIA is leading this transformation with its cutting-edge GPU architectures and software ecosystems, such as the
H100 Tensor Core
GPU and CUDA platform, which optimize the development and deployment of generative models.
NVIDIA NIM
enhances the efficiency and scalability of AI inference tasks, enabling rapid deployment and iteration across various computing environments and accelerating advancements in generative AI applications.
The importance of generative AI education
As generative AI models, such as GANs and transformers, become increasingly sophisticated, there is a growing demand for skilled professionals who can develop, refine, and ethically deploy these technologies. A strong educational foundation in generative AI equips students with the practical skills and theoretical knowledge needed to innovate in areas like content creation, drug discovery, and autonomous systems.
College and university education in generative AI is crucial due to the rapidly expanding role of AI in almost every industry. By integrating generative AI into their curriculum, universities prepare the next generation of AI researchers, engineers, and thought leaders to advance the field and address the complex challenges associated with AI-driven innovation.
The new Generative AI Teaching Kit, a collaboration between the NVIDIA Deep Learning Institute (DLI) and Dartmouth College, is set to empower the next generation of professionals with the skills and knowledge needed in this rapidly evolving field.
This comprehensive teaching resource enables educators to provide students access to cutting-edge tools, frameworks, and practical exercises that are crucial for understanding the complexities of Generative AI and large language model development and deployment. By equipping students with a deep understanding of generative AI techniques, the Teaching Kit enables educators to foster future innovation and creativity in AI-driven industries.
As students transition into the workforce, they will be better prepared to tackle global challenges, from improving healthcare and science to advancing sustainable technologies.
Sam Raymond, adjunct assistant professor of engineering at Dartmouth College, was instrumental in developing the content. “Empowering students with skills to understand and potentially develop their own GPU-accelerated Generative AI applications is the primary objective,” said Raymond. “I believe students who go through this course will be at a significant advantage in the job market and help bridge the knowledge gap in industries today.”
Overview of the Generative AI Teaching Kit
All Teaching Kits include lecture slides, hands-on labs, Jupyter notebooks, knowledge checks, and free online self-paced courses that provide certificates of competency for students, all comprehensively packaged up and ready for classroom and curriculum integration.
Figure 1. The Generative AI Teaching Kit includes free access to all DLI online self-paced courses, offering certificates for students
.
The aim of the Generative AI Teaching Kit is to introduce the foundational concepts of natural language processing (NLP) that are essential for understanding LLMs and generative AI more broadly. Key concepts of LLMs are then examined using NVIDIA GPUs, tools, and services, as well as open-source libraries and frameworks. A simple pretraining exercise of a GPT model shows basic training processes in the cloud.
The kit also covers diffusion models to explore the application of generative AI in image and video generation. Multi-modal LLM architectures are then introduced, with a focus on optimizing various LLM architectures during fine-tuning using the NVIDIA NeMo framework. Advancements in inference and the refinement of tools like chatbots are also discussed, using NVIDIA NIM, NeMo Guardrails, TensorRT, and TensorRT-LLM to enhance efficiency and scalability in production environments.
The Generative AI Teaching Kit contains focused modules that combine theory, algorithms, programming, and examples:
Module 1:
Introduction to Generative AI
Module 2:
Word Embeddings, Tokens, and NLP
Module 3:
Large Language Models and the Transformer
Module 4:
LLM Scaling Laws and LLM Families
Module 5:
Multimodal Learning and Its Applications
Module 6:
Diffusion Models in Generative AI
Module 7:
Model Training (Pre-Training, Instruction Following, and PEFT)
Module 8:
LLM Orchestration
Module 9:
Scaling Model Training to Distributed Workloads
Through a collaboration with Google, educators also get access to free Google Colab credits to run the lab notebooks in preparation for teaching the course.
This content is valuable for educators across various fields, especially in computer science and engineering. Its modular design enables instructors to tailor the course to meet the specific needs of their students and create a customized learning experience. Select professors from around the world have already been given early access to first-release modules.
“I’m eager to integrate the Generative AI Teaching Kit in my AI in Materials Engineering class,” said Mohadeseh Taheri-Mousavi, assistant professor in the Materials Science and Engineering department at Carnegie Mellon University. “The comprehensive lecture notes with well-structured coding labs with examples from various fields, and associated online courses with certificates, will provide my students with the cutting-edge resources to deeply understand the broad applications of generative AI techniques in various fields.”
Professor Payam Barnaghi from the Department of Brain Sciences at Imperial College London uses LLMs and generative AI in his research using electronic health records and healthcare data. “NVIDIA Generative AI Teaching Kit content is a wonderful resource for students learning the latest developments in AI and machine learning,” said Barnaghi. “As a result of having early access to the first modules, I plan to use this content as the basis for teaching advanced topics in my machine learning for neuroscience courses.”
Given the fast-paced advancements in generative AI, educators can expect the teaching materials to be updated over time. NVIDIA is dedicated to offering high-end educational resources and welcomes feedback to continuously improve the content.
LLM technical certification discounts for students
The Generative AI Teaching Kit also includes access to a 50% discount on the
NVIDIA-Certified Associate: Generative AI LLMs
certification exam and the
NVIDIA-Certified Associate: Generative AI Multimodal
certification exam for educators to distribute to students. It also includes access to both exams free of charge for educators. Both exams are online and proctored remotely, include 50-60 questions, and have a 60-minute time limit.
Figure 1. NVIDIA-Certified Associate
These technical certifications validate students’ expertise in generative AI, offering a competitive advantage in the job market. They can open doors to exciting career opportunities across AI-driven industries.
The NCA Generative AI LLMs certification is an entry-level credential that validates the foundational concepts for developing, integrating, and maintaining AI-driven applications using generative AI and large language models (LLMs) with NVIDIA solutions.
The NCA Generative AI Multimodal certification is an entry-level credential that validates the foundational skills needed to design, implement, and manage AI systems that synthesize and interpret data across text, image, and audio modalities.
NVIDIA recommends that students take these exams after completing the Generative AI Teaching Kit.
Get started
Educators can access the first release of the Generative AI Teaching Kit and other kits for free by joining the
NVIDIA DLI Teaching Kit Program
.
About the NVIDIA Deep Learning Institute
The
NVIDIA Deep Learning Institute
(DLI) offers resources for diverse learning needs, from learning materials to self-paced and live training to educator programs. Individuals, teams, organizations, educators, and students can now find everything they need to advance their knowledge in AI, accelerated computing, accelerated data science, graphics, simulation, and more.
NVIDIA 深度学习培训中心发布全新生成式 AI 教学套件
生成式 AI 由先进的机器学习模型和深度神经网络提供动力支持，通过生成新内容并驱动医疗、金融和娱乐等领域的创新来变革各行各业。
NVIDIA 正凭借其先进的 GPU 架构和软件生态系统（例如
H100 Tensor Core GPU
和 CUDA 平台），引领这一转型，该平台可优化生成式模型的开发和部署。
NVIDIA NIM
可增强 AI 推理任务的效率和可扩展性，从而实现跨各种计算环境的快速部署和迭代，并加速生成式 AI 应用的发展。
生成式 AI 教育的重要性
随着生成式 AI 模型（例如 GANs 和 Transformers）变得越来越复杂，对能够开发、改进和合乎道德地部署这些技术的熟练专业人员的需求也在不断增长。生成式 AI 方面坚实的教育基础可以让学生掌握在内容创作、药物研发和自主系统等领域进行创新所需的实践技能和理论知识。
由于生成式 AI 在几乎每个行业中的作用都在迅速扩展，因此学院和大学教育在生成式 AI 中至关重要。通过将生成式 AI 集成到其课程中，大学可以培养新一代 AI 研究人员、工程师和思想领袖，以推动该领域的发展，并应对与 AI 驱动的创新相关的复杂挑战。
新的生成式 AI 教学套件，由 NVIDIA 深度学习研究所（DLI）和达特茅斯学院合作开发，旨在为新一代专业人士提供这一快速发展领域所需的技能和知识。
借助这一全面的教学资源，教育工作者能够为学生提供先进的工具、框架和实践练习，这些工具、框架和实践练习对于理解生成式 AI 和大语言模型开发和部署的复杂性至关重要。通过让学生深入了解生成式 AI 技术，该教学套件使教育工作者能够在 AI 驱动的行业中培养未来的创新和创造力。
随着学生向劳动力过渡，他们将更好地准备应对全球挑战，从改善医疗和科学到推进可持续技术。
达特茅斯学院（Dartmouth College）工程系兼职助理教授 Sam Raymond 在编写课程内容时发挥了重要作用。Raymond 说：“让学生掌握理解并开发自己的 GPU 加速生成式 AI 应用程序的技能是我们的主要目标。我相信，学习本课程的学生将在就业市场中占据显著优势，并有助于缩小当今各行各业的知识差距。
生成式 AI 教学套件概述
所有教学套件均包含教学幻灯片、动手实验室、Jupyter notebooks、知识检查和免费的在线自定进度课程，为学生提供能力证书。这些课程均经过全面打包，ready for课堂和课程整合。
图 1. 生成式 AI 教学套件包括免费访问所有 DLI 在线自定进度课程，并为学生提供证书。
生成式 AI 教学套件旨在介绍自然语言处理（NLP）的基本概念，这些概念对于更广泛地理解 LLM 和生成式 AI 至关重要。然后，我们使用 NVIDIA GPUs、工具和服务以及开源库和框架来检查 LLM 的关键概念。一个 GPT 模型的简单预训练练习展示了云端的基本训练流程。
该套件还涵盖扩散模型，以探索生成式 AI 在图像和视频生成中的应用。然后，介绍多模态 LLM 架构，重点介绍如何在使用 NVIDIA NeMo 框架进行微调的过程中优化各种 LLM 架构。此外，还讨论了推理方面的进展以及聊天机器人等工具的优化，这些工具使用 NVIDIA NIM、NeMo Guardrails、TensorRT 和 TensorRT-LLM 来提高生产环境的效率和可扩展性。
生成式 AI 教学套件包含结合理论、算法、编程和示例的重点模块。这第一版包括以下模块：
生成式 AI 简介
生成式 AI 中的扩散模型
LLM 编排
未来版本的工具包将提供更多的模块。
这些内容对各个领域的教育工作者都很有价值，尤其是计算机科学和工程领域的教育工作者。其模块化设计使讲师能够根据学生的具体需求定制课程，并打造定制化的学习体验。来自世界各地的精选教授已经可以抢先体验第一版模块。“我非常希望将 Generative AI 教学套件集成到我的 AI 在材料工程课堂中，”卡内基梅隆大学材料科学与工程系助理教授 Mohadeseh Taheri-Mousavi 说，“内容全面的教学笔记包含结构良好的编码实验室和来自各个领域的示例，以及与证书相关的在线课程，将为我的学生提供前沿资源，帮助他们深入了解 Generative AI 技术在各个领域的广泛应用。”
伦敦帝国理工学院大脑科学系的Professor Payam Barnaghi教授使用电子病历和医疗健康数据在研究中使用LLMs和generative AI。“NVIDIA Generative AI Teaching Kit 内容是学生学习 AI 和 machine learning 最新发展的绝佳资源，”Barnaghi 说：“由于能够提前访问首批模块，我计划以这些内容为基础，在神经科学课程的机器学习中教授高级主题。
鉴于生成式 AI 的快速发展，教育工作者可以预期教学材料会随着时间的推移而更新。NVIDIA 致力于提供高端教育资源，并欢迎反馈，以便不断改进内容。
开始使用
教育工作者可以加入
NVIDIA DLI 教学套件计划
，免费获取第一版 Generative AI 教学套件和其他套件。
关于 NVIDIA 深度学习培训中心
NVIDIA 深度学习研究所
(DLI) 为各种学习需求提供资源，从学习材料到自定进度和实时培训，再到教育工作者计划。个人、团队、组织、教育工作者和学生现在可以找到所需的一切资源，以提升他们在 AI、加速计算、加速数据科学、图形、模拟等方面的知识水平。