The Center for Artificial Intelligence and Robotics (CAIR), part of the Hong Kong Institute of Science and Innovation of the Chinese Academy of Sciences, has introduced CARES 4.0—a multimodal clinical AI agent system. The launch took place at the IV Symposium on Clinical Robotics and Embodied AI, organized by CAIR in collaboration with the Hong Kong Science and Technology Parks Corporation at the Hong Kong Science Park.
CAIR announced the release of the agent framework and general toolkit, as well as the gradual implementation of medical tools. Models for ultrasound and surgical videos will be available on the platform free of charge.
CAIR Director Liu Hongbin told Leiphone that the changes are qualitative rather than quantitative. Previous versions, from 1.0 to 3.0, were tools that answered questions about images or videos, which doctors had to use independently. Version 4.0 is an agent capable of performing tasks.
For example, a department head who needed a report on surgical volume, consumable usage, and patient composition for the previous month previously required assistance from CARES 3.0; now, the agent can compile this report by clarifying the required type of analysis.
The system is built on the Harness agent framework and CAIR's proprietary foundational models for CT, MRI, ultrasound, endoscopy, and EEG. CAIR confirms that the system has been validated in several leading hospitals across three areas: assistance in the diagnostic process from complaint to pathology, answering natural language questions about departmental operational activities (such as equipment loading and case composition), and conducting statistical analysis and simple machine learning models on specialized datasets.
Liu emphasized that CARES functions as an assistant and provides recommendations. He acknowledged that AI can sometimes hallucinate and noted that the primary task is minimizing this risk, especially when providing decision-making advice. The system is designed to follow clinicians' logic by using guidelines and fresh literature structured as data, and every recommendation is accompanied by a chain of reasoning and sources.
Liu stated: 'The doctor is the final decision-maker.' One function already used in clinical practice is spatial risk warning during procedures, which alerts the doctor when an instrument approaches major blood vessels or nerves. For instance, during bronchoscopy at Sun Yat-sen University First Affiliated Hospital, the system might note that a visible thickening on the airway wall is actually part of a blood vessel, and a biopsy in that location could damage an artery.
Liu added that CAIR systems, mostly earlier tools, are used in over 30 hospitals, including workstations for laryngoscopy in more than 10, bronchoscopy in more than four, and ultrasound in more than 10. According to doctors, the most frequent requests relate to reducing effort and clearer information display so that the AI's output is not misinterpreted.



