Abstract

The foundation model has become popular in solving many vision-language tasks, yet the exploration of using the foundation models for solving scientific tasks has just started. There are vast opportunities there due to the comprehensive functions of foundation models as well as the complicated order of magnitude of scientific problems in reality. Combining these two reveals the extreme potential of the foundation model for science. Meanwhile, challenges still remain. For instance, what is the boundary of using foundation models for solving scientific problems? What are the feasible tasks with measurable evaluation metrics? How do we utilize the heterogeneous multi-modal data in the scientific domain? We will provide detailed answers to these questions in this tutorial.

Keywords: Artificial intelligence, machine learning, deep learning, large language model, scientific discovery, physics, chemistry, biology, material, drug discovery, material discovery, graph representation learning, multi-modal learning, multi-agent.

Slides: Part 1, Part 2, Part 3, Part 4, Part 5

Outline

Part 1: Introduction

• Achievements of AI for Science
• What is AI for Science and why?
• What is foundation model for science?
• Goals -- A Roadmap in FM4Science

Part 2: AI and Physics Foundation

• Molecule and Geometry
• Data Structure
• Density Estimation & Generative Modeling
• Pretraining

Part 3: FM for Chemistry and Material

• Single-modal modeling
• Representation: Sequence, Topology, Structure, Surface
• Pretraining
• Downstream: PhysAI, GenAI
• From Single-modal to Multi-modal modeling: Semantics Exploration using GraphCG
• Multi-modal modeling: Early Exploration, Steering, Reasoning & Planning
• Insights for Wet-lab
  • New Material Discovery
  • Advanced Functional Materials

Part 4: FM for Biology

• Single-modal modeling
  • Representation: Sequence, Structure, Rigidity, Surface
  • Pretraining
  • Downstream: PhysAI, GenAI
• Multi-modal modeling
• Insights for Wet-lab
  • Molecular Scale: Molecular Biology, Enzyme Engineering, Gene Edition
  • Cellular Scale: Omics Study, Immunology
  • Organismal Scale: Medicine
  • Ecosystem Scale: Agriculture

Part 5: Perspective and Conclusion