[go: up one dir, main page]

CN121331416A - Remote diagnosis and treatment system and household robot - Google Patents

Remote diagnosis and treatment system and household robot

Info

Publication number
CN121331416A
CN121331416A CN202511706317.1A CN202511706317A CN121331416A CN 121331416 A CN121331416 A CN 121331416A CN 202511706317 A CN202511706317 A CN 202511706317A CN 121331416 A CN121331416 A CN 121331416A
Authority
CN
China
Prior art keywords
treatment
doctor
diagnosis
plan
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202511706317.1A
Other languages
Chinese (zh)
Inventor
孙效华
葛亚特
关道文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Southern University of Science and Technology
Original Assignee
Southern University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Southern University of Science and Technology filed Critical Southern University of Science and Technology
Priority to CN202511706317.1A priority Critical patent/CN121331416A/en
Publication of CN121331416A publication Critical patent/CN121331416A/en
Pending legal-status Critical Current

Links

Landscapes

  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

本申请涉及智能医疗领域,公开了一种远程诊疗系统以及居家机器人。居家机器人包括诊疗设备接口基座、交互模块和机械臂模块;诊疗设备接口基座,用于承载可拆卸安装于所述居家机器人上的至少一种诊疗设备,诊疗设备的类型包括基础诊疗设备和根据用户病情确定的专用诊疗设备;交互模块,用于通过交互界面显示数字医生智能体,并通过数字医生智能体与用户进行交互以及采集用户的身体指标数据;机械臂模块,用于响应数字医生智能体的控制指令,控制目标诊疗设备执行干预操作和诊疗操作。居家机器人通过数字医生智能体与用户进行交互控制诊疗设备对用户进行诊疗,可以主动与用户交互和采集用户的身体指标数据,提高了诊疗效率与体验。

This application relates to the field of intelligent healthcare, disclosing a remote diagnosis and treatment system and a home robot. The home robot includes a diagnostic and treatment device interface base, an interaction module, and a robotic arm module. The diagnostic and treatment device interface base is used to support at least one diagnostic and treatment device detachably mounted on the home robot. The types of diagnostic and treatment devices include basic diagnostic and treatment devices and specialized diagnostic and treatment devices determined according to the user's condition. The interaction module is used to display a digital doctor intelligent agent through an interactive interface, and to interact with the user and collect the user's physical indicator data through the digital doctor intelligent agent. The robotic arm module is used to respond to the control commands of the digital doctor intelligent agent and control the target diagnostic and treatment device to perform intervention and treatment operations. The home robot interacts with the user through the digital doctor intelligent agent to control the diagnostic and treatment device to perform diagnosis and treatment on the user. It can proactively interact with the user and collect the user's physical indicator data, improving the efficiency and experience of diagnosis and treatment.

Description

Remote diagnosis and treatment system and household robot
Technical Field
The application relates to the field of intelligent medical treatment, in particular to a remote diagnosis and treatment system and a home robot.
Background
With the popularization of home health management, remote medical treatment and chronic disease long-term management modes, a large number of chronic disease patients (such as diabetes, infertility, cardiovascular diseases, depression and the like) in an off-hospital environment present urgent demands for continuous monitoring, active intervention and periodic review. The medical care field lacks, standardized monitoring facilities lack, patient conscious management dependence and the like, so that the fluctuation of the disease state is often difficult to capture in time, and the patient is difficult to obtain effective intervention at the correct time. However, the prior art relies heavily on cell phone applications, wearable devices, or decentralized detection instrumentation, which often passively wait for a user to upload data or initiate interactions by themselves, making it difficult to create a sustained perception of health. Seriously affecting diagnosis and treatment efficiency and experience.
Disclosure of Invention
In view of the above, the application provides a remote diagnosis and treatment system and a home robot to solve the problems of the prior art that the diagnosis and treatment efficiency and experience are affected.
In a first aspect, the present application provides a home robot, the home robot including a diagnosis and treatment equipment interface base, an interaction module, and a robotic arm module;
The diagnosis and treatment equipment interface base is used for bearing at least one diagnosis and treatment equipment which is detachably installed on the home robot, and the type of the diagnosis and treatment equipment comprises basic diagnosis and treatment equipment and special diagnosis and treatment equipment determined according to the illness state of a user;
the interaction module is used for displaying the digital doctor intelligent agent through an interaction interface, interacting with a user through the digital doctor intelligent agent and collecting body index data of the user;
The mechanical arm module is used for responding to the control instruction of the digital doctor intelligent agent and controlling the target diagnosis and treatment equipment to execute intervention operation and diagnosis and treatment operation.
In an embodiment, the home robot further comprises a diagnosis and treatment equipment management module;
The diagnosis and treatment equipment management module is used for detecting the electrical connection, the data link and the safety state of the diagnosis and treatment equipment when the diagnosis and treatment equipment is carried and installed through the diagnosis and treatment equipment interface base, identifying the type, the equipment function attribute and the equipment state information of the diagnosis and treatment equipment when the detection passes, generating diagnosis and treatment equipment information, and writing the diagnosis and treatment equipment information into the configuration file of the household robot.
In an embodiment, the digital doctor agent is further configured to receive user individual data, generate a monitoring scheme, an intervention scheme, and a consultation scheme for the user according to the user individual data and preset auxiliary data, and send the monitoring scheme, the intervention scheme, and the consultation scheme to a real doctor associated with the user for auditing and confirmation;
The digital doctor agent is further configured to receive a target monitoring scheme, a target intervention scheme, and a target consultation scheme that are audited and confirmed by the real doctor, and perform an intervention operation and a diagnosis operation based on the target monitoring scheme, the target intervention scheme, and the target consultation scheme.
In an embodiment, the home robot further comprises an autonomous movement and context awareness module;
the autonomous movement and situation awareness module is used for acquiring environment information of the environment where the home robot is located and pose information of a user, determining the situation state of the user and sending the situation state to the digital doctor intelligent agent;
The digital doctor intelligent agent is further used for judging whether to execute diagnosis and treatment operation according to the situation state, the target monitoring scheme, the target intervention scheme and the target inquiry scheme.
In a second aspect, the present application provides a remote diagnosis and treatment system, the remote diagnosis and treatment system including a remote diagnosis and treatment cloud platform and a home robot;
the home robot is used for sending the user interaction information and the user diagnosis and treatment information acquired by the digital doctor intelligent agent to the remote diagnosis and treatment cloud platform;
the remote diagnosis and treatment cloud platform is used for storing the interaction information and the diagnosis and treatment information, and displaying the interaction information and the diagnosis and treatment information to a real doctor.
In an embodiment, the home robot is further configured to receive user individual data, generate a monitoring scheme, an intervention scheme and a consultation scheme for a user according to the user individual data and preset auxiliary data, and send the monitoring scheme, the intervention scheme and the consultation scheme to the remote diagnosis and treatment cloud platform;
The remote diagnosis and treatment cloud platform is further used for displaying the monitoring scheme, the intervention scheme and the inquiry scheme to the real doctor, generating a target monitoring scheme, a target intervention scheme and a target inquiry scheme based on the examination and the confirmation of the real doctor, and sending the target monitoring scheme, the target intervention scheme and the target inquiry scheme to the home robot.
In an embodiment, the remote diagnosis and treatment cloud platform is further configured to establish a communication channel with the home robot in response to the access request of the real doctor, and send the audio-visual information and/or the control instruction of the real doctor to the home robot through the communication channel;
The household robot is further used for displaying the image of the real doctor in the interaction module to interact with the user based on the video and audio information, and/or controlling the mechanical arm module to operate the diagnosis and treatment equipment to execute diagnosis and treatment operation based on the control instruction.
In an embodiment, the remote diagnosis and treatment cloud platform further comprises a remote control module;
the remote control module is used for responding to the real-time operation of the real doctor, generating a remote control instruction, and sending the remote control instruction to the home robot based on the communication channel so that the real doctor can remotely control the mechanical arm module to operate the diagnosis and treatment equipment to execute diagnosis and treatment operation.
In an embodiment, the remote diagnosis and treatment cloud platform is further configured to optimize the target monitoring scheme, the target intervention scheme, and the target inquiry scheme according to the interaction information and the diagnosis and treatment information, so as to obtain an optimized monitoring scheme, an optimized intervention scheme, and an optimized inquiry scheme.
In an embodiment, the remote diagnosis and treatment cloud platform is further configured to extract key items in the optimal monitoring scheme, the optimal intervention scheme and the optimal inquiry scheme, display the key items to the real doctor, generate optimal key items based on the audit and confirmation of the real doctor, update the optimal monitoring scheme, the optimal intervention scheme and the optimal inquiry scheme based on the optimal key items, and send the optimal key items to the home robot.
The embodiment of the application has the following beneficial effects:
The embodiment of the application provides a household robot which comprises a diagnosis and treatment equipment interface base, an interaction module and a mechanical arm module, wherein the diagnosis and treatment equipment interface base is used for bearing diagnosis and treatment equipment installed on the household robot, the diagnosis and treatment equipment comprises basic diagnosis and treatment equipment and special diagnosis and treatment equipment determined according to the illness state of a user, the interaction module is used for displaying a digital doctor intelligent body through an interaction interface, interacting with the user through the digital doctor intelligent body and collecting physical index data of the user, and the mechanical arm module is used for responding to instructions of the digital doctor intelligent body and controlling the diagnosis and treatment equipment to perform intervention operation and diagnosis and treatment operation on the user. The household robot diagnoses the user through the digital doctor intelligent body and the user interaction control diagnosis and treatment equipment, can actively interact with the user and collect body index data of the user, and improves diagnosis and treatment efficiency and experience.
Drawings
In order to more clearly illustrate the technical solutions of the present application, the drawings that are required for the embodiments will be briefly described, it being understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope of the present application. Other relevant drawings may be made by those of ordinary skill in the art without undue burden from these drawings.
Fig. 1 shows a schematic structural diagram of a home robot according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a remote diagnosis and treatment system according to an embodiment of the present application;
Fig. 3 shows a schematic structural diagram of one implementation of the telemedicine system in an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments.
The components of the embodiments of the present application generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the application, as presented in the figures, is not intended to limit the scope of the application, as claimed, but is merely representative of selected embodiments of the application. All other embodiments, which can be made by a person skilled in the art without making any inventive effort, are intended to be within the scope of the present application.
The terms "comprises," "comprising," "including," or any other variation thereof, are intended to cover a specific feature, number, step, operation, element, component, or combination of the foregoing, which may be used in various embodiments of the present application, and are not intended to first exclude the presence of or increase the likelihood of one or more other features, numbers, steps, operations, elements, components, or combinations of the foregoing.
Furthermore, the terms "first," "second," "third," and the like are used merely to distinguish between descriptions and should not be construed as indicating or implying relative importance.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which various embodiments of the application belong. The terms (such as those defined in commonly used dictionaries) will be interpreted as having a meaning that is the same as the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein in connection with the various embodiments of the application.
Some embodiments of the present application are described in detail below with reference to the accompanying drawings. The embodiments described below and features of the embodiments may be combined with each other without conflict.
In a first aspect, an embodiment of the present application provides a home robot, where the home robot is used as a carrier of a user-side tool body, and integrates autonomous movement and environment sensing capabilities, an interactive large screen, a lightweight mechanical arm, and a modularized diagnosis and treatment interface base, so that the home robot can autonomously move in a home environment, perform natural interaction with a user, and complete blood pressure, blood sampling, ultrasound and other feature acquisition operations under the control of a digital doctor intelligent agent or a real doctor, thereby providing a data base for subsequent intervention and diagnosis and treatment.
As shown in fig. 1, the home robot includes a diagnosis and treatment device interface base 101, an interaction module 102, and a mechanical arm module 103. The diagnosis and treatment equipment interface base 101 is used for bearing at least one diagnosis and treatment equipment detachably mounted on a household robot, the type of the diagnosis and treatment equipment comprises basic diagnosis and treatment equipment and special diagnosis and treatment equipment determined according to the illness state of a user, the interaction module 102 is used for displaying a digital doctor intelligent agent through an interaction interface, interacting with the user through the digital doctor intelligent agent and collecting body index data of the user, and the mechanical arm module 103 is used for responding to control instructions of the digital doctor intelligent agent and controlling the target diagnosis and treatment equipment to execute intervention operation and diagnosis and treatment operation.
In an embodiment, the home robot may be rented or purchased from a hospital by a user, before the home robot is put into use, the home robot needs to be initialized and diagnosis and treatment equipment is assembled, according to the personalized health requirement and disease type of the user, real doctors input basic information, medical record data and personalized service requirement of the user to the home robot, and according to the personalized health requirement and disease type of the user, basic diagnosis and treatment equipment and special diagnosis and treatment equipment are installed on a diagnosis and treatment equipment interface base of the home robot. On the interface base of the diagnosis and treatment equipment, a batch of basic diagnosis and treatment equipment suitable for most chronic diseases can be connected, for example, a fingertip blood detection module (used for blood sugar, blood fat and partial biochemical index detection), a blood pressure measurement module, an infrared temperature measurement module, an electroencephalogram/electrocardio acquisition module and the like, on the other hand, a batch of special diagnosis and treatment equipment meeting personalized health requirements and disease types of users can be connected on the interface base of the diagnosis and treatment equipment, for example, for IVF/assisted reproduction users, abdomen/gynecological ultrasonic equipment, hormone-related blood sampling equipment, intramuscular injection equipment (used for hormone injection) and reproduction-related hormone detection equipment can be assembled at major points, and used for supporting multi-period emission promotion, follicle monitoring and medicine administration, for users with mental diseases such as depression and the like, an electroencephalogram acquisition equipment, a sleep monitoring-related equipment, a heart rate variability detection equipment and a blood sampling equipment of biomarkers related to depression can be assembled, and used for matching with a behavior monitoring and psychological intervention strategy of a digital doctor intelligent body, and for users with diabetes, a fingertip blood sugar detection equipment, a blood pressure monitoring equipment, a body composition monitoring equipment and a body weight, and necessary injection-related equipment can be assembled for insulin or other relevant equipment, and used for matching or foot-part management and expanding and other imaging modules for long-term diabetes and the like.
It should be noted that, diagnosis and treatment equipment interface base decouples the house robot body and various diagnosis and treatment equipment to form the structure of "general base + pluggable diagnosis and treatment equipment". The base provides a unified physical fixed structure, a data communication channel and a power supply interface, so that plug and play of the diagnosis and treatment equipment is realized. The physical interface structure can be in various forms such as a sliding rail type, a magnetic attraction type or a buckle type, so as to adapt to diagnosis and treatment equipment with different sizes and different installation postures. The diagnosis and treatment equipment interface base not only supports standardized access of basic diagnosis and treatment equipment, but also supports access of special diagnosis and treatment equipment aiming at different disease paths and individual differences, so that a hardware platform is prevented from being independently designed for each disease, and reusability and expansibility of a household robot are improved.
In an embodiment, the home robot further comprises a diagnosis and treatment equipment management module, wherein the diagnosis and treatment equipment management module is used for detecting the electrical connection, the data link and the safety state of the diagnosis and treatment equipment when the diagnosis and treatment equipment is installed on the diagnosis and treatment equipment through the diagnosis and treatment equipment interface base, identifying the equipment type, the equipment function attribute and the equipment state information of the diagnosis and treatment equipment when the detection passes, generating diagnosis and treatment equipment information, and writing the diagnosis and treatment equipment information into a configuration file of the home robot.
In an embodiment, since the home robot is used in the home of the user, the home robot also needs to perform multi-modal sensing calibration and environment modeling before being put into use to support the subsequent personalized active services and accurate navigation. The home robot performs space coordinate calibration on each module or equipment carried in the home robot, establishes a unified coordinate system to realize space alignment of vision, machinery and a sensing system, completes SLAM mapping of the home space through a laser radar, a depth camera and a vision recognition algorithm, generates semantic layer marking information (such as bedrooms, living rooms, kitchens, toilets and the like), marks inaccessible areas (such as bedrooms, private spaces, pet activity areas and the like) according to user setting or AI recognition results, establishes virtual boundaries to ensure operation safety, recognizes furniture positions, common activity areas, illumination states and user daily behavior hot spots, locally caches environment and user activity data, and simultaneously establishes a situation model index for follow-up personalized task scheduling (such as actively initiating health reminding in the common user areas) and model dynamic updating.
In an embodiment, the interaction module 102 includes an image rendering sub-module, where the image rendering sub-module defines a unified digital doctor intelligent body image for a real doctor corresponding to a user, binds the head portrait, gender, voice features and language style of the real doctor, and ensures the cognitive continuity of the user in different modes. The interaction mode is distinguished by adjusting the background, the clothing and the rendering style. In the interactive mode of the autonomous service of the intelligent agent of the digital doctor, the background is a home/living scene, the garment is leisure or has a cartoon style, more anthropomorphic and compatible animation expression is supported, in the interactive mode of the access of the real doctor, the background is switched to a consulting room or office environment, the garment is a formal real doctor garment, the rendering style is closer to the real person, and only the voice and expression of the real doctor are carried.
In one embodiment, the interaction module 102 includes a behavior and speech synthesis sub-module that exhibits different behaviors and voices on the display screen in different interaction modes. Under the interaction mode of autonomous service of the digital doctor intelligent agent, the dialogue content output by the digital doctor intelligent agent is converted into natural voice synthesis and mouth shape and expression animation, the digital doctor intelligent agent is driven to make limb actions such as nodding, indication, smiling and the like, and is matched with intervention tasks (such as exercise guidance and meditation guidance) to conduct gesture demonstration and rhythm guidance, and the digital doctor intelligent agent is driven to generate corresponding emotion and feedback behaviors (encouragement, pacifying, reminding and the like) in combination with task states. In the interactive mode of the access of the real doctor, the voice synthesis of the digital doctor agent is not performed any more, but the voice flow of the real doctor drives the mouth shape and the expression of the individual body in real time, and the behavior actions (such as indication, emphasis and gazing direction) can be simply controlled by the real doctor end or automatically supplemented by the agent according to the semantics, but no independent voice content is generated, so that a single interactive channel is maintained. And in both modes, the method supports the cooperation with animation and prompt sound effects of other interfaces of the screen, and improves the consistency and the understandability of the whole interaction.
In an embodiment, the interaction module 102 includes a multi-mode interface generation sub-module, which generates a reminding card, a task progress bar, a simple chart (blood sugar/blood pressure curve), a questionnaire form and the like on a display screen according to tasks and prompt requirements of the digital doctor intelligent agent in an interaction mode of autonomous service of the digital doctor intelligent agent, and superimposes a real doctor splitting and light interface in a small window form for non-invasive reminding and information collection when video or application is running. Under the interactive mode accessed by a real doctor, semantic analysis is carried out in the background according to real-time voice content and operation intention of the real doctor, auxiliary display content such as key sign trend graphs and historical data, check image contrast graphs, medicine description cards, structured inquiry abstracts, dynamic schematics, short videos or animations is automatically selected and generated for explaining disease mechanisms, treatment schemes or operation steps, interface layout and hierarchy are automatically adjusted to enable information related to a current consultation theme to be presented preferentially, and feedback interface state changes such as prompt tones, loading animations and the like and data loading progress are combined.
In one embodiment, the mechanical arm module 103 supports two modes of autonomous operation of the digital doctor intelligent agent or remote teleoperation of the real doctor, and the mechanical arm module 103 can be configured with various types of light mechanical arms or flexible mechanical arms for controlling diagnosis and treatment equipment (such as a blood pressure cuff, a B-ultrasonic probe, a blood sampling device and the like). The mechanical arm module 103 can be provided with various end effectors (clamping jaws, a probe holder, a syringe interface and the like), and the digital doctor intelligent body or a true man doctor can control the end replacement according to the task type so as to adapt to different diagnosis and treatment or sampling tasks. The mechanical arm module 103 supports force feedback and limit control, and ensures safety and comfort in the process of interaction with a user. In an embodiment, the digital doctor intelligent agent is further configured to receive user individual data, generate a monitoring scheme, an intervention scheme, and a consultation scheme for a user according to the user individual data and preset auxiliary data, and send the monitoring scheme, the intervention scheme, and the consultation scheme to a real doctor associated with the user for auditing and confirmation, and receive a target monitoring scheme, a target intervention scheme, and a target consultation scheme that are audited and confirmed by the real doctor, and execute an intervention operation and a diagnosis operation based on the target monitoring scheme, the target intervention scheme, and the target consultation scheme.
In an embodiment, the user individual data collected by the digital doctor agent includes case information, disease type, health index and treatment history of the user, and the preset auxiliary data includes long-term health data of similar historic patients, wearable device data accessed through the external interface module, electronic medical record (EMR/HIS) records, home IoT health monitoring data and the like, and other stored treatment cases. Based on a built-in special health medical large model, the digital doctor intelligent body fuses user individual data and preset auxiliary data to complete cognitive modeling and health target planning of user states, and the process comprises the following steps: normalizing and extracting features of user individual data and preset auxiliary data, generating a user health image, calling a special health medical large model, reasoning and optimizing monitoring items, intervention measures and inquiry arrangement, and outputting a monitoring scheme, an intervention scheme and an inquiry scheme aiming at a user.
In an embodiment, the monitoring scheme generated by the digital doctor intelligent agent comprises monitoring parameters such as physical sign items, monitoring indexes (blood sugar, blood pressure, heart rate, electroencephalogram, sleep and the like), time planning of fixed-period, event-triggered or multi-condition combined monitoring, defining weights of high-frequency items and key indexes to ensure reasonable resource allocation, corresponding action paths of diagnosis and treatment equipment and the mechanical arm module 103, abnormal detection, signal loss compensation acquisition, threshold trigger alarm and other data quality and alarm rules.
In one embodiment, the intervention scheme generated by the digital doctor intelligent agent comprises intervention types such as medicine reminding, physical therapy, illumination intervention, movement guidance, psychological support and the like, intervention time sequence and frequency which are dynamically adjusted at fixed time or based on monitoring feedback, intervention intensity and duration period which are set according to the difference between disease types and individuals, an post-intervention feedback mechanism for tracking user behaviors and physical sign responses to form a curative effect evaluation loop, and interaction forms for implementing intervention in a multi-mode such as voice, screen, action feedback and the like.
In one embodiment, the digital doctor agent generated inquiry strategy comprises automatically scheduling agent inquiry and real doctor inquiry, inquiring content (such as medication response, living habit, emotion state and the like) defined according to disease progress, and mainly carrying out auxiliary information acquisition tasks to help real doctors acquire necessary structural information before formal consultation.
In one embodiment, the digital doctor agent transmits the monitoring scheme, the intervention scheme and the inquiry scheme to the corresponding real doctor of the user for auditing and confirmation. Analyzing and marking the review necessity of each item in the monitoring scheme, the intervention scheme and the inquiry scheme before sending so as to prompt the links of important review of the true doctor and reduce the burden of the true doctor. The digital doctor intelligent agent receives the target monitoring scheme, the target intervention scheme and the target inquiry scheme which are checked and confirmed by the true doctor, and diagnoses the user based on the target monitoring scheme, the target intervention scheme and the target inquiry scheme. Meanwhile, the built-in special health medical large model can be automatically reversely trained through the target monitoring scheme, the target intervention scheme and the target consultation scheme which are checked and confirmed by the real doctor, so that the self-learning update of the digital doctor intelligent body is realized, and the accuracy of future scheme generation and the individual matching degree are continuously improved.
In one embodiment, the digital doctor agent generates an executable behavior plan according to a target monitoring scheme, a target intervention scheme and a target consultation scheme by combining local situation labels and user states, and the calculation comprises the steps of scheduling time and mode of health reminding, information acquisition and agent consultation, scheduling planning intervention tasks (such as medication reminding, motion guidance, meditation guidance and the like), calling a robot chassis, a mechanical arm and diagnosis equipment to complete physical sign acquisition or equipment operation, and supporting periodic tasks and event triggering tasks (such as monitoring abnormality and dynamic intervention after consultation abnormality).
In an embodiment, the digital doctor agent performs a target monitoring scheme, and unlike passive monitoring in the traditional sense, the digital doctor agent can control the home robot to have autonomous movement, environment understanding and task planning capabilities in a home scene, and "supervise" the user's daily life through behavior recognition and natural interaction. The robot utilizes SLAM map and space semantic information to autonomously plan a path to identify and record daily activities (such as diet, exercise, rest, entertainment and the like) of a patient. In order to reduce interference and improve acceptance, the digital doctor intelligent body generates personalized dialogue strategies to communicate with users naturally, and health related information (such as dining time, sleep quality, emotion state and the like) is acquired in the dialogue process.
In one embodiment, the digital doctor agent performs a target intervention protocol. Target intervention schemes are divided into two categories, planning intervention and situational intervention. According to the target intervention scheme, the digital doctor intelligent body automatically executes fixed tasks such as daily medicine reminding, meditation guiding, movement guiding, work and rest reminding and the like at a preset time, the user is guided to complete the tasks through voice and screen interaction, and in the intervention process, the display screen of the home robot can render the digital doctor intelligent body into a real doctor body-separating image, and voice prompt, expression feedback and visual guiding are provided in a personification mode. And the situational intervention, namely when abnormal conditions occur in a monitoring stage or a consultation stage (such as sedentary, drinking, medication delay, physical sign abnormality and the like of a user are detected), the digital doctor intelligent body selects an intervention strategy (prompting, warning, guiding action or automatically starting consultation) according to specific abnormal types, and in the intervention execution process, the digital doctor intelligent body carries out dynamic behavior adjustment according to language response, emotional state and behavior feedback of the user so as to realize personalized intervention rhythm.
In one embodiment, the digital doctor agent performs a target interrogation regimen. The inquiry of the intelligent body of the digital doctor is an important functional link and is mainly used for collecting structural health information and assisting the diagnosis of a real doctor. The inquiry modes are classified into two modes, namely active inquiry and passive inquiry. And actively inquiring, namely actively initiating inquiry by the digital doctor intelligent body at proper time according to the time and the theme set in the inquiry strategy, performing voice and screen interaction with the patient, and collecting illness state information and behavior feedback. Passive inquiry, that is, the patient can actively initiate an inquiry request, the intelligent body of the digital doctor responds immediately, and the information acquisition and the primary diagnosis process are executed. In the inquiry process, the digital doctor intelligent body can autonomously call the mechanical arm module 103 and diagnosis and treatment equipment in the home robot to complete necessary physical sign acquisition for the user, and in the sampling process, the digital doctor intelligent body is interactively guided with the user through voice and a screen, so that the accuracy and safety of the sampling process are ensured.
In an embodiment, the home robot further comprises an autonomous movement and situation awareness module, wherein the autonomous movement and situation awareness module is used for acquiring environment information of an environment where the home robot is located and pose information of a user, determining a situation state corresponding to the user currently and sending the situation state to the digital doctor intelligent agent, and the digital doctor intelligent agent is further used for judging whether to execute intervention operation and diagnosis and treatment operation according to the situation state, the target monitoring scheme, the target intervention scheme and the target consultation scheme. It will be appreciated that the digital doctor agent maintains the current context state of the patient, such as "eat at dining table", "rest at sofa", "sleep" and "watching television", etc., in combination with environmental information from the environment in which the home robot 201 is collecting and pose information of the user (SLAM map, spatial semantics, user position and pose, lighting/time information, etc.), combines the context information with historical interaction records, health data, for deciding whether to disturb, how to disturb, when to perform a target monitoring scheme, a target intervention scheme, and a target consultation scheme.
In a second aspect, as shown in fig. 2, the embodiment of the present application provides a remote diagnosis and treatment system, where the remote diagnosis and treatment system includes a remote diagnosis and treatment cloud platform 202 and a home robot 201, where the home robot 201 is configured to send, to the remote diagnosis and treatment cloud platform 202, interaction information of interaction with a user through the digital doctor agent and diagnosis and treatment information of diagnosis and treatment performed by the user, and the remote diagnosis and treatment cloud platform 202 is configured to store the interaction information and the diagnosis and treatment information, and display the interaction information and the diagnosis and treatment information to a real doctor.
In an embodiment, the home robot 201 is further configured to receive user individual data, generate a monitoring scheme, an intervention scheme, and a consultation scheme for a user according to the user individual data and preset auxiliary data, and send the generated monitoring scheme, the intervention scheme, and the consultation scheme to the remote diagnosis and treat cloud platform 202, and the remote diagnosis and treat cloud platform 202 is further configured to display the monitoring scheme, the intervention scheme, and the consultation scheme to a real doctor, generate a target monitoring scheme, a target intervention scheme, and a target consultation scheme based on an audit and a confirmation of the real doctor, and send the target monitoring scheme, the target intervention scheme, and the target consultation scheme to the home robot 201.
In an embodiment, the remote diagnosis and treatment cloud platform 202 is further configured to establish a communication channel with the home robot 201 in response to an access request of a real doctor, and send audio-visual information and/or control instructions of the real doctor to the home robot 201 through the communication channel, wherein the home robot 201 is further configured to display an image of the real doctor in the interaction module to interact with a user based on the audio-visual information, and/or control the mechanical arm module to operate the diagnosis and treatment device to diagnose the user based on the control instructions.
In an embodiment, a real doctor accesses the remote diagnosis and treatment cloud platform 202, and after the remote diagnosis and treatment cloud platform 202 logs in its own account, the real-time state, history data and reservation plan of the patient can be checked, and the target patient is selected to initiate remote consultation. The remote diagnosis and treatment cloud platform 202 automatically establishes an encryption communication channel and switches the home robot 201 to a 'real doctor access mode';
In one embodiment, if a real doctor initiates a appointment remote consultation, the digital doctor agent in the home robot 201 will prompt the patient for preparation, if the consultation needs to be empty, the patient will be reminded to avoid eating before 8 hours, if the blood pressure needs to be measured or signs are collected, the patient will be reminded to rest quietly in advance, if mental state assessment is involved, the patient will be guided to maintain good environmental and light conditions, and the digital doctor agent records the preparation state in the background for the real doctor to check and confirm.
In one embodiment, the display of the home robot 201 displays the digital body of the human doctor, which can be switched, and the digital body of the digital doctor and the image of the human doctor do not appear in a voice or visual form at the same time. In the autonomous service stage of the digital doctor intelligent body, the real doctor split image represents the digital doctor intelligent body, the background is a home scene, the clothing is leisure or cartoon vision style, and the split image has the functions of voice interaction and anthropomorphic expression. In the access stage of the real doctor, the body-separating image of the real doctor is switched into the image (head portrait, voice, language style and the like are consistent) which maps the characteristics of the real doctor, the background is switched into the doctor's office or office environment, the clothing is changed into professional real doctor's clothing, the intelligent body closes the voice channel and is only responsible for generating a screen information interface in the background, executing the instructions of the real doctor and generating sound effect feedback (such as button sound and reminding prompt sound). Through the switching mechanism, the patient always sees the image of the same real doctor, but can clearly distinguish whether the current intelligent body mode or the real doctor access mode is the intelligent body mode or the real doctor access mode through visual semantics (clothing, background and rendering style), so that mental burden and communication confusion are reduced.
In one embodiment, during the live doctor access, the digital doctor agent does not make speech or independent expressions, but rather performs the generated interface management and action control as a background assistant. The generation interface is presented by a digital doctor intelligent body to analyze the voice content and instruction intention of a real doctor in real time and generate an auxiliary information display interface which comprises a key sign trend graph, a history detection data visualization, a comparison image, a structured inquiry abstract, a medicine description and the like, and an auxiliary picture, a short video, a chart or a dynamic label for explanation of the real doctor. And the intelligent body generates auxiliary sound effects and interface transition animation according to the operation rhythm of the real doctor, so as to prompt information change, data loading or action confirmation and enhance interaction rhythm sense. And the action execution coordination is that when a true doctor issues a specific operation instruction (such as 'measurement start', 'movement of the mechanical arm close to the abdomen area'), the intelligent agent is responsible for analyzing the command, generating control parameters and driving the robot end to complete the action.
In an embodiment, the remote diagnosis and treatment cloud platform 202 further includes a remote control module, and the remote control module is configured to respond to real-time operation of a doctor, generate a remote control instruction, and send the remote control instruction to the home robot 201 based on the communication channel, so that the doctor can remotely control the mechanical arm module to operate the diagnosis and treatment device to diagnose the user.
In one embodiment, the remote control module supports two teleoperation modes to meet the requirements of remote diagnosis and treatment with different precision and security levels. The first mode is an instruction control mode (the digital doctor agent executes), the real doctor operates the remote control module to send remote control instructions to the home robot 201 through the communication channel of the remote diagnosis and treatment cloud platform 202, and the digital doctor agent automatically plans an action path and executes tasks such as blood pressure measurement, body temperature detection, blood sampling and the like after analyzing the remote control instructions. The digital doctor intelligent agent sends a confirmation prompt to the real doctor equipment before executing the task and waits for the real doctor to confirm and then execute the task, the real doctor can send a confirmation voice through a communication channel of the remote diagnosis and treatment cloud platform 202 and perform operation preparation confirmation with a patient, and in the execution process, a display screen of the home robot 201 displays real-time progress, module state and sampling feedback. Mode two, a fine remote control mode (direct control of a real doctor), and when the task involves high-precision operation (such as B-ultrasonic probe positioning, local blood sampling, electroencephalogram electrode adhesion and the like), the real doctor can directly control the home robot 201 in real time through a remote control module. The remote control module can be provided with a touch feedback control rod, a VR handle control console or a medical special remote mechanical arm control system, and the remote diagnosis and treatment cloud platform 202 transmits low-delay video stream and force feedback data in the remote control process, so that real-time perception of a real doctor is realized, meanwhile, the home robot 201 automatically monitors the mechanical arm range, the safety domain and the force feedback threshold value, operation safety is ensured, a digital doctor intelligent body carries out safety judgment and action prediction in the background, and overload or false triggering of equipment is prevented. In any of the above modes, the real doctor has main control rights, all key actions are required to be confirmed and triggered by the real doctor, and the home robot 201 responds and confirms through voice or a touch screen, so that the safety and controllability of medical actions are ensured.
In an embodiment, the remote diagnosis and treatment cloud platform 202 is further configured to optimize the target monitoring scheme, the target intervention scheme, and the target inquiry scheme according to the interaction information and the diagnosis and treatment information, so as to obtain an optimized monitoring scheme, an optimized intervention scheme, and an optimized inquiry scheme.
In an embodiment, the remote diagnosis and treat cloud platform 202 is further configured to extract key items in the optimized monitoring scheme, the optimized intervention scheme, and the optimized inquiry scheme, display the key items to the real doctor, generate optimized key items based on the audit and confirmation of the real doctor, update the optimized monitoring scheme, the optimized intervention scheme, and the optimized inquiry scheme based on the optimized key items, and send the optimized key items to the home robot 201.
In an embodiment, the home robot 201 classifies and caches the interaction information and diagnosis information generated during the interaction and diagnosis process with the user, and sends the interaction information and diagnosis information to the remote diagnosis cloud platform 202, where the interaction information and diagnosis information include, for example, abnormal signs, intervention failure, emergency events, daily behavior logs, and light interaction records during video and audio playing. All data are accompanied by time stamps, spatial location information (from environmental map and semantic map), task identification (corresponding to specific monitoring/intervention/interviewing tasks), and protocol version numbers, ensuring subsequent traceability analysis.
In an embodiment, the remote diagnosis and treatment cloud platform 202 performs fusion processing on data after receiving the interaction information and the diagnosis and treatment information, performs data denoising, missing value processing and outlier labeling, aligns and associates monitoring data, intervention records, inquiry records and real doctor operation records based on a unified patient identification and time axis, and establishes a time-series health data view for a single patient and a statistical view for a similar disease group.
In an embodiment, the remote diagnosis and treatment cloud platform 202 performs multidimensional analysis on the summarized data based on a proprietary health and medical knowledge model, including but not limited to health trend analysis such as long-term fluctuation trend of blood sugar/blood pressure, sleep quality change, and movement quantity reaching standard condition, intervention effect evaluation such as comparing sign data and behavior change before and after intervention, evaluating effectiveness of intervention measures, compliance and risk evaluation such as counting completion rate, delay condition and abnormal event frequency of executing an intervention plan by a patient, outputting risk classification prompt, and inquiry and operation quality evaluation such as analyzing coverage content, duration and key problem reaching rate of remote inquiry of an agent inquiry and a real doctor, and providing basis for flow optimization. The remote diagnosis cloud platform 202 generates structured optimization suggestions and decision support information based on the multidimensional analysis results, including optimization suggestions for monitoring schemes (e.g., increasing/decreasing the frequency of certain monitoring items, adjusting trigger thresholds, etc.), optimization suggestions for intervention schemes (e.g., adjusting intervention time periods, introducing alternative intervention modes, enhancing certain types of behavioral guidance, etc.), optimization suggestions for interview schemes (e.g., increasing targeted questions, shortening unnecessary answers, increasing specific topic follow-ups, etc.).
In an embodiment, the remote diagnosis and treatment cloud platform 202 automatically optimizes the original target monitoring scheme, the target intervention scheme and the target inquiry scheme according to the optimization suggestion, so as to obtain the optimized monitoring scheme, the optimized intervention scheme and the optimized inquiry scheme. The optimization process is exemplified by a monitoring scheme aspect of adjusting the monitoring frequency, increasing key index monitoring, relaxing or tightening an alarm threshold value and the like, an intervention scheme aspect of increasing or decreasing a certain type of intervention task, changing an intervention period or rhythm, replacing an intervention form which is easier to accept by a user (such as changing from voice reminding to soft visual reminding), and a consultation scheme aspect of rearranging consultation time, increasing a certain type of follow-up problem (agent consultation) and presetting a more simplified consultation script for a real doctor. The remote diagnosis and treatment cloud platform 202 analyzes each item in the optimized monitoring scheme, the optimized intervention scheme and the optimized inquiry scheme according to the influence range and the risk level, and marks different application strategies such as "automatic application", "confirmation by a doctor needing a true person", "only recommended reference", and the like for each item.
In one embodiment, the remote diagnostic cloud platform 202 determines items labeled "require real doctor confirmation" and "advice reference only" as key items (e.g., adjust medication related intervention alerts, key physical sign monitoring thresholds) and sends the key items to the real doctor device. The real doctor can check the key items through the real doctor equipment, can accept, modify or reject the key items, and can manually check the key items, and the final decision of the real doctor can be recorded as a strategy update version and used as labeling data for self-learning of a subsequent model.
In an embodiment, the real doctor apparatus sends the final decision to the remote diagnosis and treat cloud platform 202, and the remote diagnosis and treat cloud platform 202 updates the optimized monitoring scheme, the optimized intervention scheme, and the optimized inquiry scheme based on the final decision and sends to the home robot 201. The digital doctor agent in the home robot 201 can adjust task scheduling rules and dialogue strategies according to the optimized monitoring scheme, the optimized intervention scheme and the optimized inquiry scheme sent by the remote diagnosis and treatment cloud platform 202, the robot end adjusts task timetable, equipment calling strategies and the like, and for safety related strategies (such as newly added alarm rules) needing to be in effect immediately, the system priority is improved, and the first time is distributed and started.
In one embodiment, the remote diagnosis and treat cloud platform 202 uses the modification behavior of the real doctor, the policy application effect and the patient feedback as training data to continuously optimize the proprietary health and medical knowledge model, when a certain type of policy is frequently and manually modified among a plurality of patients, the system automatically adjusts the generation logic to reduce the occurrence of similar errors or improper schemes, and for the policy combination with good proven effect, the system can be marked as a 'preferred path' for generating references for the schemes of the subsequent similar patients. Through the circulation of data acquisition, cloud analysis, strategy optimization, verification by a real doctor, issuing execution and re-acquisition, the self-adaptive update of the strategies of the intelligent agent and the real doctor is realized, and a dynamic evolving health management closed loop is formed.
According to the remote diagnosis and treatment system, the home robot 201 capable of moving autonomously and a digital doctor agent work cooperatively, and the environment mapping, situation understanding and behavior recognition capability are utilized to perform supervision 'monitoring', situational intervention and agent inquiry in a real life scene of a user, so that the user is not passively waited for uploading data or initiating operation. On the diagnosis and treatment equipment interface base of the home robot 201, a batch of basic diagnosis and treatment equipment suitable for management of most chronic diseases can be connected, and a batch of special diagnosis and treatment equipment meeting personalized health requirements and disease types of users can be connected, so that different diagnosis and treatment, detection and monitoring equipment can be flexibly combined. The home robot 201 and diagnosis and treatment equipment are supported to be automatically standardized by an intelligent body locally through high-level instructions by a real doctor through a remote consultation cloud platform or to be subjected to fine teleoperation with high precision and force feedback through special remote control equipment, so that diagnosis and treatment are actively performed on a user. And (3) opening up data links of a patient end, a real doctor end and a cloud end, continuously acquiring and analyzing monitoring logs, intervention records, inquiry contents, teleoperation records and environmental situation data, generating and optimizing a monitoring scheme, an intervention scheme and an inquiry scheme based on a special health/medical model, introducing real doctor audit and feedback as training signals, realizing strategy self-learning update of cooperation of a digital doctor intelligent body and the real doctor, and forming a personalized health management closed loop capable of evolving for a long time. In implementation, referring to fig. 3, a schematic structural diagram of one implementation of a remote diagnosis and treatment system according to an embodiment of the present application is shown. The home robot comprises an autonomous mobile and situation sensing module 301, an interactive large screen and audio/video module 302, a lightweight/flexible mechanical arm module 303, a modularized diagnosis and treatment interface base 304, a local control and communication module 305 and a digital doctor splitting module 306. The digital physician tuning module 306 includes an autonomous monitoring and intervention scheduling sub-module 3061, a physician access and intent mapping sub-module 3062, a context and context awareness sub-module 3063, an image rendering sub-module 3064, a behavioral and speech synthesis sub-module 3065, and a multimodal interface generation sub-module 3066. The remote consultation cloud platform includes a doctor access and consultation management module 307, a device control and data management module 308, an intelligent analysis and plan support module 309, and a system security and external interface module 3010.
The autonomous movement and situation sensing module 301 comprises a movement and positioning system, a laser radar, an RGB-D camera, an IMU and a depth sensor, and supports SLAM mapping and semantic modeling, wherein the movement and positioning system adopts a wheeled movement chassis and a multi-sensor fusion navigation system to realize autonomous movement, path planning and fixed-point stopping. Autonomous obstacle avoidance and user approach actions in complex indoor environments are supported. The autonomous movement and context awareness module combines visual recognition and behavioral analysis to recognize semantic elements (e.g., furniture layout, lighting status, user activity area) in the environment and generate personalized context labels. For example, the scenes of 'the user is dining on a table', 'the user is resting on a sofa', 'the illumination of a bedroom is turned off', and the method is used for behavior planning and intervention strategy triggering of an intelligent agent.
The interactive large screen and audio/video module 302 is configured with a rotatable interactive large screen, and the screen integrates an RGB-D or depth camera for capturing the expression, gesture and interactive action of the user. The screen can be adjusted in angle between vertical and overlook angles through the electric rotating mechanism so as to support interaction experience and hand-eye coordination under different scenes, for example, the screen can be automatically adjusted to overlook angles when the inquiry equipment is operated, and visual guidance of the mechanical arm is assisted. Under the default condition, the large screen always presents the body-separating image of the doctor and provides an anthropomorphic visual interactive interface. In a daily non-medical state, the user can also call other application programs to play media or practical contents (such as music, video, health information and the like), and the two types of interfaces can run simultaneously. When a critical task (remote inquiry, intervention, monitoring or diagnosis) is entered, the screen automatically interrupts other applications and switches to a doctor's personal interaction interface so as to ensure the priority and safety of interaction and diagnosis tasks. The light-weight/flexible mechanical arm module 303 is configured with a plurality of types of light-weight mechanical arms or flexible mechanical arms, and is used for controlling diagnosis and treatment equipment (such as a blood pressure cuff, a B-ultrasonic probe, a blood sampling device and the like), and is provided with a plurality of end effectors (clamping jaws, a probe fixer, an injector interface and the like), and a digital doctor intelligent body autonomously performs end replacement according to task types so as to adapt to different diagnosis and treatment or sampling tasks. The mechanical arm supports force feedback and limit control, ensures safety and comfort in the interaction process with a user, and supports two modes of autonomous operation of an intelligent body or remote teleoperation of a doctor. The modular diagnosis and treatment interface base 304 decouples the robot body from various diagnosis and treatment devices, and forms a structure of a universal base and pluggable diagnosis and treatment devices. The base provides a unified physical fixed structure, a data communication channel and a power supply interface, so that plug and play of the diagnosis and treatment equipment is realized. The physical interface structure can be in various forms such as a sliding rail type, a magnetic attraction type or a buckle type, so as to adapt to diagnosis and treatment equipment with different sizes and different installation postures. Meanwhile, the access to the basic diagnosis and treatment equipment and the special diagnosis and treatment equipment which meet the personalized health requirements and disease types of users are supported. The local control and communication module 305 uniformly schedules task execution of the chassis, the mechanical arm, the interaction screen and the diagnosis and treatment device, and provides an interface for the intelligent agent and the cloud to call. And the data transmission safety is ensured by the real-time connection of the encryption communication protocol and the remote cloud platform. And monitoring the equipment state, the power supply and the network connection in real time, and triggering a local protection and cloud alarm mechanism when abnormal.
The autonomous monitoring and intervention scheduling sub-module 3061 is responsible for maintaining an overall working mode state machine, and generates an executable behavior plan according to a monitoring scheme, an intervention scheme and a consultation scheme issued by the cloud platform by combining a local situation label and a user state.
The doctor access and intention mapping submodule 3062 is responsible for receiving voice instructions and interface operations of the real doctor from the cloud platform when the real doctor accesses remotely, and performing semantic analysis and intention recognition. The doctor intent is mapped to specific control instructions for the home robot. Before key operation, the cloud platform is matched to trigger a doctor to confirm and prompt, safety monitoring and state feedback are carried out on the execution process, and information such as an execution result, failure reasons and the like is returned to a real doctor.
Wherein the context and scenario understanding sub-module 3063, integrating multimodal inputs from the home robot (SLAM map, spatial semantics, user position and posture, lighting/time information, etc.), maintains the current context state of the user, such as "eat at dining table", "rest at sofa", "have fallen asleep", "watch tv", etc. For deciding whether to disturb, how to disturb, when to perform a task, for selecting mood, topics, and presentation (e.g., small window lightweight reminders in an entertainment scenario, rather than complete questioning). Meanwhile, the digital doctor continuously updates the context state (such as user answer, emotion change and task completion degree) in the process of agent inquiry and intervention for subsequent rounds of dialogue and behavior planning.
The image rendering sub-module 3064 defines only one unified digital body-separating image for the real doctor, binds the head portrait, sex, voice characteristics and language style of the doctor, and ensures the cognitive continuity of the user in different modes. The digital doctor intelligent autonomous service mode and the digital personal figure distinction of the real doctor access mode are distinguished through adjustment, background, clothing and rendering styles. Meanwhile, the foreground is ensured to only present one identity-type body-separating image at any moment, and confusion of patients on a digital doctor intelligent body and a true doctor is avoided.
The behavior and voice synthesis submodule 3065 supports animation and prompt sound effects of other interfaces of the screen to cooperate in the autonomous service mode of the digital doctor intelligent agent and the access mode of the real doctor, and the consistency and the understandability of overall interaction are improved.
The multi-mode interface generation submodule 3066 generates a reminding card, a task progress bar, a simple chart (blood sugar/blood pressure curve), a questionnaire form and the like on a screen according to the task and prompt requirements of the digital doctor intelligent agent in the digital doctor intelligent agent mode, and superimposes a doctor body separation and light interface in a small window mode for non-invasive reminding and information acquisition when video or application is running. And under the access mode of the real doctor, according to the real-time voice content and the operation intention of the real doctor, carrying out semantic analysis in the background, and automatically selecting and generating auxiliary display content. The interface layout and the hierarchy are automatically adjusted to enable the information related to the current consultation theme to be presented preferentially, and the feedback interface state change and the data loading progress of the prompting voice, the loading animation and the like are combined.
The doctor access and consultation management module 307 is responsible for doctor identity and authority management, patient list and follow-up plan management, appointment and consultation scheduling, session establishment and mode switching. And the doctor account registration and authentication are supported, and the authority control is performed by combining a hospital end account system, so that only authorized doctors can access specific patients and corresponding equipment control channels. The doctor is provided with a patient list view which is grouped according to disease types, risk grades and follow-up stages, and the remote follow-up plan and the inquiry period are supported to be configured and synchronously issued to the patient-side agent. Receiving an appointment request initiated by an agent at a patient end, generating a consultation task by a doctor after a calendar interface is confirmed, and triggering a consultation preparation reminder at a robot end before the appointment time is reached. When a doctor initiates a remote consultation, an encrypted audio and video channel is established, and a 'doctor access mode' switching instruction is issued to a robot end, so that a digital doctor is split and switched from an intelligent body mode to a doctor mode, and the interaction channels are unified.
The device control and data management module 308 is responsible for unified management and control of the home robots and the diagnosis and treatment devices. The main functions include recording the type, state and configuration of each robot and diagnosis and treatment equipment assembled by the robots (such as a fingertip blood module, an abdomen/gynecologic ultrasonic module, a depression blood sampling module, an intramuscular injection module and the like), and maintaining the topology and the service condition of the equipment. In the instruction control mode, a high-level instruction (such as ' start blood pressure measurement ' and ' abdomen ultrasound) issued by a doctor at the cloud is forwarded to a patient-side agent, and an action sequence is automatically generated and executed by the agent. In the fine remote control mode, a low-delay channel is established with special control equipment (a touch control rod, a VR control terminal and the like) at the doctor side, and position, gesture and force feedback instructions are forwarded, so that real-time teleoperation on the mechanical arm and diagnosis and treatment equipment is realized. And receiving physical sign data, a behavior log, equipment state data and a doctor operation log from the robot end, and completing basic verification, distribution and storage, so as to provide original input for a subsequent intelligent analysis module.
The intelligent analysis and scheme support module 309 is responsible for generating monitoring, intervention and inquiry schemes by calling a proprietary model and outputting optimization suggestions during fusion analysis of multi-source data.
The system security and external interface module 3010 provides security and interconnection capabilities for the whole remote diagnosis and treatment cloud platform.
The home robot 201 provided by the application exemplarily further comprises a processor and a memory, wherein the memory stores a computer program, and the processor executes the computer program to enable the home robot 201 to execute corresponding actions.
The processor may be an integrated circuit chip with signal processing capabilities. The processor may be a general purpose processor including at least one of a central processing unit (Central Processing Unit, CPU), a graphics processor (Graphics Processing Unit, GPU) and a network processor (Network Processor, NP), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like that may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present application.
The Memory may be, but is not limited to, random access Memory (Random Access Memory, RAM), read Only Memory (ROM), programmable Read Only Memory (Programmable Read-Only Memory, PROM), erasable Read Only Memory (Erasable Programmable Read-Only Memory, EPROM), electrically erasable Read Only Memory (Electric Erasable Programmable Read-Only Memory, EEPROM), etc. The memory is used for storing a computer program, and the processor can correspondingly execute the computer program after receiving the execution instruction.
The present application also provides a computer storage medium for storing the computer program used in the above-mentioned home robot 201. The computer storage medium may be a readable storage medium, a nonvolatile storage medium, or a volatile storage medium. For example, the computer storage media may include, but is not limited to, U disk, removable hard disk, read-Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, etc. various media that can store program code.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. The apparatus embodiments described above are merely illustrative, for example, of the flow diagrams and block diagrams in the figures, which illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules or units in various embodiments of the application may be integrated together to form a single part, or the modules may exist alone, or two or more modules may be integrated to form a single part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a smart phone, a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application.
The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application.

Claims (10)

1.一种居家机器人,其特征在于,所述居家机器人包括诊疗设备接口基座、交互模块和机械臂模块;1. A home robot, characterized in that the home robot includes a medical device interface base, an interaction module, and a robotic arm module; 所述诊疗设备接口基座,用于承载可拆卸安装于所述居家机器人上的至少一种诊疗设备,所述诊疗设备的类型包括基础诊疗设备和根据用户病情确定的专用诊疗设备;The diagnostic and treatment device interface base is used to support at least one diagnostic and treatment device that can be detachably installed on the home robot. The types of diagnostic and treatment devices include basic diagnostic and treatment devices and special diagnostic and treatment devices determined according to the user's condition. 所述交互模块,用于通过交互界面显示数字医生智能体,并通过所述数字医生智能体与用户进行交互以及采集所述用户的身体指标数据;The interaction module is used to display a digital doctor agent through an interactive interface, and to interact with the user and collect the user's physical indicator data through the digital doctor agent. 所述机械臂模块,用于响应所述数字医生智能体的控制指令,控制目标诊疗设备执行干预操作和诊疗操作。The robotic arm module is used to respond to the control commands of the digital doctor's intelligent agent and control the target diagnostic and treatment equipment to perform intervention and diagnostic operations. 2.根据权利要求1所述的居家机器人,其特征在于,所述居家机器人还包括诊疗设备管理模块;2. The home robot according to claim 1, wherein the home robot further includes a medical equipment management module; 所述诊疗设备管理模块,用于在通过所述诊疗设备接口基座承载安装所述诊疗设备时,对所述诊疗设备的电气连接、数据链路与安全状态进行检测,并在检测通过时识别所述诊疗设备的类型、设备功能属性及设备状态信息,生成诊疗设备信息,并将所述诊疗设备信息写入所述居家机器人的配置文件中。The diagnostic and treatment equipment management module is used to detect the electrical connection, data link and safety status of the diagnostic and treatment equipment when it is installed on the interface base of the diagnostic and treatment equipment, and to identify the type, functional attributes and status information of the diagnostic and treatment equipment when the detection is successful, generate diagnostic and treatment equipment information, and write the diagnostic and treatment equipment information into the configuration file of the home robot. 3.根据权利要求1所述的居家机器人,其特征在于,所述数字医生智能体还用于,接收用户个体数据,根据所述用户个体数据和预设的辅助数据生成针对所述用户的监测方案、干预方案和问诊方案,并将所述监测方案、所述干预方案和所述问诊方案发送至所述用户关联的真人医生进行审核与确认;3. The home robot according to claim 1, wherein the digital doctor agent is further configured to receive individual user data, generate a monitoring plan, an intervention plan, and a consultation plan for the user based on the individual user data and preset auxiliary data, and send the monitoring plan, the intervention plan, and the consultation plan to a real doctor associated with the user for review and confirmation; 所述数字医生智能体还用于,接收经过所述真人医生审核与确认的目标监测方案、目标干预方案和目标问诊方案,并基于所述目标监测方案、所述目标干预方案和所述目标问诊方案执行干预操作和诊疗操作。The digital doctor agent is also used to receive the target monitoring plan, target intervention plan, and target consultation plan that have been reviewed and confirmed by the real doctor, and to perform intervention and treatment operations based on the target monitoring plan, the target intervention plan, and the target consultation plan. 4.根据权利要求3所述的居家机器人,其特征在于,所述居家机器人还包括自主移动与情境感知模块;4. The home robot according to claim 3, wherein the home robot further includes an autonomous movement and context awareness module; 所述自主移动与情境感知模块,用于获取所述居家机器人所处环境的环境信息和用户位姿信息,确定所述用户的情境状态,并将所述情境状态发送至所述数字医生智能体;The autonomous movement and context awareness module is used to acquire environmental information and user pose information of the home robot's environment, determine the user's context state, and send the context state to the digital doctor intelligent agent; 所述数字医生智能体,还用于根据所述情境状态,以及所述目标监测方案、所述目标干预方案和所述目标问诊方案,判断是否执行干预操作和诊疗操作。The digital doctor intelligent agent is also used to determine whether to perform intervention and treatment operations based on the situational state, the target monitoring plan, the target intervention plan, and the target consultation plan. 5.一种远程诊疗系统,其特征在于,所述远程诊疗系统包括远程诊疗云平台以及如权利要求1-4任一项所述的居家机器人;5. A remote diagnosis and treatment system, characterized in that the remote diagnosis and treatment system includes a remote diagnosis and treatment cloud platform and a home robot as described in any one of claims 1-4; 所述居家机器人,用于将通过所述数字医生智能体获取的用户交互信息以及用户诊疗信息发送至所述远程诊疗云平台;The home robot is used to send user interaction information and user diagnosis and treatment information obtained through the digital doctor intelligent agent to the remote diagnosis and treatment cloud platform. 所述远程诊疗云平台,用于对所述交互信息和所述诊疗信息进行存储,以及将所述交互信息和所述诊疗信息向真人医生展示。The remote diagnosis and treatment cloud platform is used to store the interaction information and the diagnosis and treatment information, and to display the interaction information and the diagnosis and treatment information to real doctors. 6.根据权利要求5所述的远程诊疗系统,其特征在于,所述居家机器人,还用于接收用户个体数据,根据所述用户个体数据和预设的辅助数据生成针对用户的监测方案、干预方案和问诊方案并发送至所述远程诊疗云平台;6. The remote diagnosis and treatment system according to claim 5, wherein the home robot is further configured to receive individual user data, generate a monitoring plan, intervention plan and consultation plan for the user based on the individual user data and preset auxiliary data, and send them to the remote diagnosis and treatment cloud platform; 所述远程诊疗云平台,还用于将所述监测方案、所述干预方案和所述问诊方案向所述真人医生展示,并基于所述真人医生的审核与确认生成目标监测方案、目标干预方案和目标问诊方案,将所述目标监测方案、所述目标干预方案和所述目标问诊方案发送至所述居家机器人。The remote diagnosis and treatment cloud platform is also used to display the monitoring plan, the intervention plan, and the consultation plan to the real doctor, and generate a target monitoring plan, a target intervention plan, and a target consultation plan based on the real doctor's review and confirmation, and send the target monitoring plan, the target intervention plan, and the target consultation plan to the home robot. 7.根据权利要求5所述的远程诊疗系统,其特征在于,所述远程诊疗云平台,还用于响应于所述真人医生的接入请求,与所述居家机器人建立通信通道,并将所述真人医生的影音信息和/或控制指令通过所述通信通道发送至所述居家机器人;7. The remote diagnosis and treatment system according to claim 5, wherein the remote diagnosis and treatment cloud platform is further configured to respond to the access request of the real doctor, establish a communication channel with the home robot, and send the audio-visual information and/or control instructions of the real doctor to the home robot through the communication channel; 所述居家机器人,还用于基于所述影音信息在所述交互模块中显示真人医生形象与用户进行交互,和/或,基于所述控制指令控制所述机械臂模块操作所述诊疗设备执行诊疗操作。The home robot is also used to display a real doctor's image in the interaction module based on the audio-visual information to interact with the user, and/or to control the robotic arm module to operate the diagnostic and treatment equipment to perform diagnostic and treatment operations based on the control instructions. 8.根据权利要求7所述的远程诊疗系统,其特征在于,所述远程诊疗云平台还包括遥控模块;8. The remote diagnosis and treatment system according to claim 7, wherein the remote diagnosis and treatment cloud platform further includes a remote control module; 所述遥控模块,用于响应于所述真人医生的实时操作,生成遥控指令,并基于所述通信通道将所述遥控指令发送至所述居家机器人,以使真人医生遥控所述机械臂模块操作所述诊疗设备执行诊疗操作。The remote control module is used to generate remote control commands in response to the real-time operation of the human doctor, and send the remote control commands to the home robot based on the communication channel, so that the human doctor can remotely control the robotic arm module to operate the diagnostic and treatment equipment to perform diagnostic and treatment operations. 9.根据权利要求6所述的远程诊疗系统,其特征在于,所述远程诊疗云平台,还用于根据所述交互信息和所述诊疗信息,对所述目标监测方案、所述目标干预方案和所述目标问诊方案进行优化,得到优化监测方案、优化干预方案和优化问诊方案。9. The remote diagnosis and treatment system according to claim 6, wherein the remote diagnosis and treatment cloud platform is further configured to optimize the target monitoring scheme, the target intervention scheme, and the target consultation scheme based on the interaction information and the diagnosis and treatment information, so as to obtain an optimized monitoring scheme, an optimized intervention scheme, and an optimized consultation scheme. 10.根据权利要求9所述的远程诊疗系统,其特征在于,所述远程诊疗云平台,还用于提取所述优化监测方案、所述优化干预方案和所述优化问诊方案中的关键项目,将所述关键项目向所述真人医生展示,并基于所述真人医生的审核与确认生成优化关键项目,基于所述优化关键项目,更新所述优化监测方案、所述优化干预方案和所述优化问诊方案并发送至所述居家机器人。10. The remote diagnosis and treatment system according to claim 9, wherein the remote diagnosis and treatment cloud platform is further configured to extract key items from the optimized monitoring plan, the optimized intervention plan, and the optimized consultation plan, display the key items to the real doctor, generate optimized key items based on the real doctor's review and confirmation, update the optimized monitoring plan, the optimized intervention plan, and the optimized consultation plan based on the optimized key items, and send them to the home robot.
CN202511706317.1A 2025-11-19 2025-11-19 Remote diagnosis and treatment system and household robot Pending CN121331416A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202511706317.1A CN121331416A (en) 2025-11-19 2025-11-19 Remote diagnosis and treatment system and household robot

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202511706317.1A CN121331416A (en) 2025-11-19 2025-11-19 Remote diagnosis and treatment system and household robot

Publications (1)

Publication Number Publication Date
CN121331416A true CN121331416A (en) 2026-01-13

Family

ID=98338422

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202511706317.1A Pending CN121331416A (en) 2025-11-19 2025-11-19 Remote diagnosis and treatment system and household robot

Country Status (1)

Country Link
CN (1) CN121331416A (en)

Similar Documents

Publication Publication Date Title
US11923079B1 (en) Creating and testing digital bio-markers based on genetic and phenotypic data for therapeutic interventions and clinical trials
US11284844B2 (en) Electromyography (EMG) assistive communications device with context-sensitive user interface
US9286442B2 (en) Telecare and/or telehealth communication method and system
JP2021099866A (en) Systems and methods
US20190239791A1 (en) System and method to evaluate and predict mental condition
KR20210113299A (en) Systems and methods for interactive and flexible data presentation
Irfan et al. Personalised socially assistive robot for cardiac rehabilitation: Critical reflections on long-term interactions in the real world: B. Irfan et al.
WO2021121381A1 (en) Rehabilitation management system and method
JP2018152810A (en) Communication system and communication control device
Zanella et al. Internet of things for elderly and fragile people
Pepito et al. Caring for older persons in a technologically advanced nursing future
Zhang et al. Evaluation of smart agitation prediction and management for dementia care and novel universal village oriented solution for integration, resilience, inclusiveness and sustainability
WO2026025414A1 (en) Systems and methods for providing hospitalization services
WO2026025416A1 (en) Systems for hospital management
US20210012881A1 (en) Systems, methods and apparatus for treatment protocols
CN119580976A (en) A hospital support platform
CN121331416A (en) Remote diagnosis and treatment system and household robot
CN112740336A (en) Method and electronic device for Artificial Intelligence (AI) -based assisted health sensing in an Internet of things network
WO2026025411A1 (en) Medical service systems and methods
WO2026025412A1 (en) Medical service systems and methods
Lee Reference Model and Architecture of Interactive Cognitive Health Advisor based on Evolutional Cyber-physical Systems.
WO2026025420A1 (en) Medical service systems, devices, and methods
US20250246282A1 (en) Digital therapy management system of reflecting and updating feedback according to actual use of digital therapeutics and operation method thereof
Monroy Rodríguez et al. Wearable and Pervasive Architecture for Digital Companions in Chronic Disease Care
US20260041366A1 (en) Systems and devices having displays and user-detection equipment for interaction with users

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination