Abstract

The foundation model has become popular in solving many vision-language tasks, yet the exploration of using the foundation models for solving scientific tasks has just started. There are vast opportunities there due to the comprehensive functions of foundation models as well as the complicated order of magnitude of scientific problems in reality. Combining these two reveals the extreme potential of the foundation model for science. Meanwhile, challenges still remain, e.g., Where is the boundary of using foundation models for solving scientific problems? What are the feasible tasks with measurable evaluation metrics? How do we utilize the heterogeneous multi-modal data in the scientific domain? We will provide detailed answers to these questions in this tutorial.

Keywords: Artificial intelligence, machine learning, deep learning, large language model, scientific discovery, physics, chemistry, biology, material, drug discovery, material discovery, graph representation learning, multi-modal learning, multi-agent.