Disclosure of Invention
In view of this, the embodiment of the present invention provides a remote medical guidance system, which can effectively improve the efficiency and effect of medical observation.
In a first aspect, an embodiment of the present invention provides a remote medical guidance system, including: the system comprises a first device, a second device and a cloud platform; the first device comprises a detection part, a first communication part and a first human-computer interaction part; the detection part is connected with the first communication part and is used for acquiring medical images of patients; the first communication part is connected with the detection part at one end and the first human-computer interaction part at the other end, and is used for sending the medical image to the cloud platform or downloading guidance information corresponding to the medical image from the cloud platform; the first human-computer interaction part is connected with the first communication part and is used for performing human-computer interaction with a first doctor through a first visual interface; one end of the cloud platform is in communication connection with the first device, and the other end of the cloud platform is in communication connection with the second device, and the cloud platform is used for providing data services for the first device or the second device; the second device comprises a second communication part and a second human-computer interaction part which are connected with each other; the second communication unit is configured to acquire the medical image from the cloud platform or send the guidance information corresponding to the medical image to the cloud platform; and the second human-computer interaction part is used for displaying the acquired medical image to a second doctor and inputting the guidance information of the second doctor on the medical image through a second visual interface.
Optionally, the medical image includes at least one of: endoscopic images, ultrasound images, X-ray images, nuclear magnetic resonance images, CT images, nuclear medicine images, PET-CT images.
Optionally, the first visual interface includes at least one of the following visual buttons: calling, audio, video, image acquisition, video acquisition, file storage, patient information entry, and guidance information acquisition.
Optionally, the second visual interface includes at least one of the following visual buttons: response, audio, video, image capture, video capture, image annotation, file storage, patient information viewing, and instructional information entry.
Optionally, the image annotation includes automatic annotation and/or manual annotation.
Optionally, the automatic labeling is based on a depth learning algorithm for the image.
Optionally, the guidance information comprises a case and/or an expert opinion.
Optionally, the first device further includes an environment information acquisition unit, connected to the first communication unit, and configured to acquire an environment image of an environment in which the patient is located; the first communication part is further used for sending the environment image to the cloud platform; the second human-computer interaction part is further used for displaying the acquired environment image to the second doctor.
Optionally, the first device, the cloud platform, and the second device perform real-time data transmission through a 5G communication network.
Optionally, the first communication unit and the second communication unit are respectively provided with an encryption and decryption unit for performing encryption protection on the medical image of the patient and/or the guidance information.
Optionally, the first communication unit specifically includes: the patient information input module is used for receiving patient information input by a first doctor and sending the patient information to the cloud platform; the case downloading module is used for downloading the case from the cloud platform to the local; the first case storage module is used for downloading and storing cases from the cloud platform to the local; the first case printing module is used for acquiring a case from the cloud platform and printing the case.
Optionally, the second communication unit specifically includes: the patient information viewing module is used for acquiring patient information from the cloud platform and displaying the patient information to the second doctor; a case filling module for receiving the case input by the second doctor; an expert advice module for receiving expert advice input by the second doctor; the case uploading module is used for uploading a case input by a second doctor to the cloud platform; the second case storage module is used for locally storing the case information input by the second doctor; and the second case printing module is used for printing the case input by the second doctor.
According to the remote medical guidance system provided by the embodiment of the invention, the first equipment can acquire the medical image of a patient, send the medical image to the cloud platform or download guidance information corresponding to the medical image from the cloud platform, and perform man-machine interaction with a first doctor through the first visual interface; the second equipment can follow the cloud platform and acquire medical image or send the guidance information that medical image corresponds to the cloud platform, the medical image that will acquire demonstrates to the second doctor, and input the guidance information of second doctor to medical image through the visual interface of second, thus, first doctor just can in time transmit patient's site conditions or medical image data for the second doctor, with the help of second doctor's clinical diagnosis experience, effectively guide to this patient's treatment, thereby help primary hospital to solve the problem of in time carrying out the operation or inspection, let the patient need not go out the door and just can enjoy the service of central hospital department specialist, effectively improved efficiency and effect of seeing a doctor, provide very big facility for doctor and patient.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
It should be understood that the described embodiments are only some embodiments of the invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides a remote medical guidance system including:
the system comprises a first device 1, a second device 2 and a cloud platform 3;
the first device 1 comprises a detection part 11, a first communication part 12 and a first human-computer interaction part 13; the detection part 11 is connected with the first communication part 12 and is used for acquiring medical images of patients; a first communication part 12, one end of which is connected to the detection part 11 and the other end of which is connected to the first human-computer interaction part 13, for sending the medical image to the cloud platform 3 or downloading guidance information corresponding to the medical image from the cloud platform 3; the first human-computer interaction part 13 is connected with the first communication part 12 and is used for performing human-computer interaction with a first doctor through a first visual interface;
the cloud platform 3 is in communication connection with the first device 1 at one end and the second device 2 at the other end, and is used for providing data services for the first device 1 or the second device 2;
the second device 2 comprises a second communication part 21 and a second man-machine interaction part 22 which are connected with each other; a second communication unit 21 configured to acquire a medical image from the cloud platform 3 or transmit guidance information corresponding to the medical image to the cloud platform 3; and the second human-computer interaction part 22 is used for displaying the acquired medical image to a second doctor and inputting guidance information of the second doctor on the medical image through a second visual interface.
According to the remote medical guidance system provided by the embodiment of the invention, the first equipment 1 can acquire the medical image of a patient, send the medical image to the cloud platform 3 or download guidance information corresponding to the medical image from the cloud platform 3, and perform man-machine interaction with a first doctor through the first visual interface; second equipment 2 can follow cloud platform 3 and acquire medical image or send the guidance information that medical image corresponds to cloud platform 3, the medical image that will acquire demonstrates to the second doctor, and input the guidance information of second doctor to medical image through the second visual interface, thus, first doctor just can in time transmit patient's live condition or medical image data for the second doctor, with the help of second doctor's clinical diagnosis experience, effectively guide to this patient's treatment, thereby help primary hospital to solve the problem of in time carrying out the operation or inspection, let the patient need not go out far and just can enjoy the service of central hospital department specialist, provide very big facility for doctor and patient.
The medical image in the embodiment of the present invention may be a video or a picture taken in real time during an operation or an examination, or may be an existing video file or an image file, which is not limited in the embodiment of the present invention.
Specifically, an application scenario of the remote medical guidance system provided by the embodiment of the present invention may be as shown in fig. 2. It should be noted that fig. 2 shows the deployment of the remote medical guidance system by taking an endoscopic image as an example, but the embodiment of the present invention is not limited thereto. The endoscopic image may be replaced with other medical images such as ultrasound images.
In the remote medical guidance system provided by the embodiment of the present invention, the first device may be a device for examining or treating a patient in a primary hospital or an emergency site, and may be operated by a primary doctor or an emergency worker, and the second device may be a device in a hospital having a higher medical level, such as a central hospital, and may be operated by an expert master of the central hospital, and the like.
To facilitate examination or treatment of the patient by the first physician, the first physician may operate the first device through the first visualization interface. In one embodiment of the invention, the first visual interface may comprise at least one of the following visual buttons: calling, audio, video, image acquisition, video acquisition, file storage, patient information entry, and guidance information acquisition.
Wherein the call button may be used to trigger the first device to send a call request to a remote second device to establish a connection with the second device. The audio button may be used to control an audio signal output of the first device and the video button may be used to control a video signal output of the first device. The image capture button may be used to control the first device to capture an image, such as taking a photograph or the like. The video capture button may be used to trigger the first device to capture video. The file storage button can be used for storing a file formed by the collected image signals and the collected video signals. The patient information entry button may be used to receive and store patient information entered by the first physician. The guidance information acquisition button can be used for triggering the first equipment to download and display guidance information of the second doctor on the medical image.
For example, a schematic diagram of a structure of the first visual interface may be as shown in fig. 3.
Optionally, the detecting part 11 of the first device 1 may include multiple types of detectors capable of acquiring medical image signals, such as a camera, an ultrasound detector, a photon detector, and the like, and the medical image generated by the detecting part 11 may also be various, for example, in an embodiment of the present invention, the medical image may include one or more of the following: endoscopic images, ultrasound images, X-ray images, magnetic resonance images, CT images, nuclear medicine images, PET-CT (Positron emission tomography) images. The detection unit 11 can detect a diseased part of a patient to generate a medical image, and then, according to the operation of the first human-machine interaction unit 13, the medical image is transmitted to the cloud platform 3 through the first communication unit 12, and further transmitted to the second device 2 through the cloud platform.
Optionally, in an embodiment of the present invention, the first communication unit 12 may specifically include: the patient information input module is used for receiving patient information input by a first doctor and sending the patient information to the cloud platform; the case downloading module is used for downloading the case from the cloud platform to the local; the first case storage module is used for downloading and storing cases from the cloud platform to the local; the first case printing module is used for acquiring a case from the cloud platform and printing the case.
The second device 2 may be provided at a central hospital, operated by a second doctor (e.g., an expert), for communicating with the first device 1, receiving the medical image transmitted by the first device 1, receiving the guidance information given by the second doctor for the medical image, and feeding back the guidance information to the first device 1.
In order to facilitate the second doctor to view the medical image and give targeted guidance information, the second doctor may operate the second device through the second visual interface. Optionally, in an embodiment of the present invention, the second visual interface may include at least one of the following visual buttons: response, audio, video, image capture, video capture, image annotation, file storage, patient information viewing, and instructional information entry.
Wherein the answer button may trigger the second device 2 to accept a call made by the first device 1. The audio button may be used to control an audio signal output of the second device and the video button may be used to control a video signal output of the second device. The image capture button may be used to control the second device to capture an image of the medical image being presented, forming a screenshot. The video capture button may be used to control the second device to capture a video of the medical image being presented, forming a video clip. The image annotation button can be used for marking and explaining part of the content in the captured image or video, such as marking a lesion area. The file storage button may be used to store the marked medical image. The patient information view button may be used to trigger the second device to present the patient information entered by the first physician. The guidance information entry button may be used to trigger the second device to enter guidance information for the medical image by the second doctor. The second doctor's guidance information may include, for example, a case and/or expert opinions, etc.
Optionally, when performing image annotation, the image annotation operation of the second device 2 may include automatic annotation and/or manual annotation. The automatic labeling may be based on a deep learning algorithm for the image, for example, by learning a large number of medical image samples, features and rules in the aspects of image gray scale, contour shape, and the like of the focus may be obtained, so that the contents in the new medical image are labeled by using the learned features and rules. The manual labeling may be to form a labeled contour from points labeled in the medical image by the second doctor, for example, a circle may be formed from three points labeled in the medical image, the contour of the circle may be used as the labeled contour, or the labeled contour may be formed from a closed curve drawn from multiple points labeled in the medical image.
The second doctor can look at the medical image transmitted from the first apparatus 1, mark a lesion area and the like, and give guidance information on the medical image, such as what kind of disease the lesion is supposed to be, what kind of treatment countermeasure should be taken, and the like.
For example, a schematic diagram of the structure of the second visual interface can be as shown in fig. 4.
Optionally, in an embodiment of the present invention, the second communication unit 21 may specifically include: the patient information viewing module is used for acquiring patient information from the cloud platform and displaying the patient information to the second doctor; a case filling module for receiving the case input by the second doctor; an expert advice module for receiving expert advice input by the second doctor; the case uploading module is used for uploading a case input by a second doctor to the cloud platform; the second case storage module is used for locally storing the case information input by the second doctor; and the second case printing module is used for printing the case input by the second doctor.
Optionally, in an embodiment of the present invention, the second doctor may also use the convenience conditions provided by the remote medical guidance system to perform a viewing or teaching activity, and the second doctor can conveniently perform an operation or a detection and review without going to a medical field, and switch between a video, a note, and a teaching plan, thereby effectively improving teaching efficiency and effect.
Further, in order to enable the second doctor to have a clearer and clearer control on the clinical site of the first device, so as to accurately command the clinical site, in an embodiment of the present invention, the first device 1 may further include an environmental information collecting part 14, and the environmental information collecting part 14 may be connected to the first communication part 13 for collecting an environmental image of the environment where the patient is located; the first communication unit 13 may be further configured to transmit the environment image to the cloud platform 3; the second human-computer interaction portion 22 may also be configured to present the acquired environment image to the second doctor. Optionally, in an embodiment of the present invention, the medical image and the environmental image may be displayed simultaneously or switched to be displayed on the first human-computer interaction interface and the second human-computer interaction interface.
Optionally, in an embodiment of the present invention, the medical image may be from data acquired, generated in real time, or delayed from the operation or detection, and the data transmission between the first device 1, the cloud platform 3, and the second device 2 may be performed in real time or non-real time. When real-time data transmission is required, the first device 1, the cloud platform 3, and the second device 2 may perform real-time data transmission via a 5G communication network.
Further, in order to keep patient information secret, in an embodiment of the present invention, the first communication portion 13 and the second communication portion 21 may further be respectively provided with an encryption and decryption unit for performing encryption protection on the medical image of the patient and/or the guidance information.
The following describes in detail an operation method of the remote medical guidance system according to an embodiment of the present invention. Specifically, in one embodiment of the present invention, a method of operating a telemedicine guidance system may include:
firstly, a doctor in a department of a primary hospital checks a registered patient, a central hospital department specialist is called through a first visual interface video voice, and the central hospital department specialist responds to start endoscopy.
And step two, the department doctor of the primary hospital opens a patient medical record filling template through the first visual interface, fills in the basic information and the state of illness of the patient, and records and stores the information.
And step three, the endoscope is used for examination, the first visual interface can be used for simultaneously observing an operation outdoor scene and an operation field, and voice and video interaction is carried out with a department specialist of a central hospital in real time during examination.
And step four, the doctor in the department of primary hospital can perform the functions of image acquisition, video recording, file storage and the like through the first visual interface in the checking process, and the functions are used for storing, replaying and reproducing the operation checking process.
And fifthly, uploading the patient information input by the doctor in the department of the primary hospital to the cloud.
And step six, the department experts of the central hospital download the patient information from the cloud and check the information.
And seventhly, capturing the images and the videos by a department specialist in the central hospital in the process of the endoscope operation examination, and labeling the captured images and videos and the real-time video played by the main screen.
And step eight, filling out the medical record of the patient by the department expert of the central hospital and providing an expert suggestion.
And step nine, after the endoscope operation examination is finished, department experts of the central hospital upload medical record information of the patient, and the medical record information can be stored and printed.
Step ten, the department specialist of the central hospital uploads the written medical record of the patient to the cloud end for the department doctor of the primary hospital to download.
Step eleven, storing and printing the downloaded case by a doctor in a department of a primary hospital, and carrying out the next diagnosis and treatment on the patient.
In the operation process, the cloud platform can store relevant contents such as patient information, patient medical records, operation examination videos and images, and can also add the contents such as the videos and the images into the deep learning dictionary for deep learning. The cloud platform can also encrypt patient information privacy and hospital related data to protect patient privacy.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments.
In particular, as for the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
For convenience of description, the above devices are described separately in terms of functional division into various units/modules. Of course, the functionality of the units/modules may be implemented in one or more software and/or hardware implementations of the invention.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above description is only for the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.