Disclosure of Invention
The invention aims to provide a burn wound surface tissue activity detection system to solve at least one technical problem in the background technology.
In order to achieve the purpose, the invention adopts the following technical scheme:
in one aspect, the present invention provides a system for detecting activity of surface tissue of a burn wound, comprising:
the acquisition module is used for acquiring a plurality of fluorescence standard images of the surface tissues of the burn wound at certain time intervals. Since the fluorescent image is actually a black-and-white gray-scale image when viewed by the naked eye, the conversion of the picture property from RGB to a gray-scale image is performed here. The RGB to grayscale image conversion can be directly performed by an averaging method, that is: gray (0-255) ═ R + G + B)/3.
The processing module is used for carrying out difference processing on adjacent images in the plurality of fluorescence standard images to obtain a plurality of difference images (the difference images are gray level images (0-255));
the description module is used for describing based on the pixel values of the plurality of difference images to obtain vector descriptors of which the dimensionalities correspond to the number of the plurality of difference images;
and the classification module is used for classifying the tissue activity according to the vector descriptor of each pixel to obtain a burn wound surface tissue activity result.
Preferably, the system for detecting activity of surface tissue of a burn wound further comprises a matching module, which is used for performing pixel matching on the fluorescence standard image acquired by the acquisition module.
Preferably, the description module includes a reading unit for reading the pixel value of each pixel in each difference image in turn.
Preferably, when the maximum value of the vector descriptor of the pixel is smaller than the first threshold value and gradually approaches zero with time, the tissue activity of the corresponding region in the original fluorescence standard image is a quaternary activity.
Preferably, when the maximum value of the vector descriptor of the pixel is greater than the first threshold and less than the second threshold, and the variation value with time is less than the preset variation value, the tissue activity of the corresponding region in the original fluorescence standard image is a tertiary activity.
Preferably, when the maximum value of the vector descriptor of the pixel is larger than the second threshold value and gradually goes to zero along with the time variation, the tissue activity of the corresponding area in the original fluorescence standard image is determined by combining the fluorescence intensity of the pixel of the original fluorescence standard image.
Preferably, when the maximum value of the vector descriptor of the pixel is greater than the second threshold value and gradually goes to zero with time, and the fluorescence intensity of the pixel of the original fluorescence standard image is maintained within the first range, the tissue activity of the corresponding region in the original fluorescence standard image is secondary activity.
Preferably, when the maximum value of the vector descriptor of the pixel is greater than the second threshold value and is maintained at a higher value and gradually goes to zero with time, and the fluorescence intensity of the pixel of the original fluorescence standard image is maintained in the second range, the tissue activity of the corresponding region in the original fluorescence standard image is primary activity.
Preferably, the first range is 80 to 100.
Preferably, the second range is 120 to 140.
In a second aspect, the present invention provides a method for detecting activity of surface tissue of a burn wound, comprising:
collecting a plurality of fluorescence standard images of the surface tissues of the burn wound at certain time intervals;
performing difference processing on adjacent images in the plurality of fluorescence standard images to obtain a plurality of difference images;
describing based on pixel values of the plurality of difference images to obtain vector descriptors of which the dimensionalities correspond to the number of the plurality of difference images;
and classifying the tissue activity according to the vector descriptor of each pixel to obtain a burn wound surface tissue activity result.
In a third aspect, the present invention provides a non-transitory computer-readable storage medium for storing computer instructions which, when executed by a processor, implement the method for detecting activity of surface tissue of a burn wound as described above.
In a fourth aspect, the present invention provides a computer program product comprising a computer program for implementing the method for detecting activity of superficial tissue of a burn wound as described above when the computer program is run on one or more processors.
In a fifth aspect, the present invention provides an electronic device, comprising: a processor, a memory, and a computer program; wherein, a processor is connected with the memory, the computer program is stored in the memory, and when the electronic device runs, the processor executes the computer program stored in the memory, so as to make the electronic device execute the instructions for implementing the method for detecting the activity of the surface tissue of the burn wound as described above.
The invention has the beneficial effects that: the fluorescence recognition rate is improved, effective image information is obtained, the recognition efficiency is improved, the evaluation and recognition accuracy of the activity of the surface tissue of the wound surface are improved, and a reliable basis is provided for doctors to diagnose and treat the burn wound surface.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below by way of the drawings are illustrative only and are not to be construed as limiting the invention.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
For the purpose of facilitating an understanding of the present invention, the present invention will be further explained by way of specific embodiments with reference to the accompanying drawings, which are not intended to limit the present invention.
It should be understood by those skilled in the art that the drawings are merely schematic representations of embodiments and that the elements shown in the drawings are not necessarily required to practice the invention.
Example 1
As shown in fig. 1, this embodiment 1 provides a system for detecting activity of superficial tissue of a burn wound, which includes:
the acquisition module is used for acquiring a plurality of fluorescence standard images of the surface tissues of the burn wound at certain time intervals;
the processing module is used for carrying out difference processing on adjacent images in the plurality of fluorescence standard images to obtain a plurality of difference images;
the description module is used for describing based on the pixel values of the plurality of difference images to obtain vector descriptors of which the dimensionalities correspond to the number of the plurality of difference images;
and the classification module is used for classifying the tissue activity according to the vector descriptor of each pixel to obtain a burn wound surface tissue activity result.
In this embodiment 1, the system for detecting activity of surface tissue of a burn wound further includes a matching module, where the matching module is configured to perform pixel matching on a fluorescence standard image acquired by the acquisition module, and the matching process includes angle adjustment, edge region clipping, and the like.
The description module comprises a reading unit, and the reading unit is used for sequentially reading the pixel value of each pixel in each difference value image.
When the classification module is used for judging the tissue activity: when the maximum value of the vector descriptor of the pixel is smaller than the first threshold value and gradually approaches zero along with the change of time, the tissue activity of the corresponding area in the original fluorescence standard image is the quaternary activity. When the maximum value of the vector descriptor of the pixel is larger than the first threshold and smaller than the second threshold, and the variation value of the pixel along with the time is smaller than the preset variation value, the tissue activity of the corresponding area in the original fluorescence standard image is the tertiary activity. When the maximum value of the vector descriptor of the pixel is larger than a second threshold value and gradually approaches zero along with the time change, the fluorescence intensity of the pixel of the original fluorescence standard image is combined to determine the tissue activity of the corresponding area in the original fluorescence standard image.
Specifically, when the maximum value of the vector descriptor of the pixel is greater than the second threshold value and gradually approaches to zero with time, and the fluorescence intensity of the pixel of the original fluorescence standard image is maintained within the first range, the tissue activity of the corresponding region in the original fluorescence standard image is secondary activity.
When the maximum value of the vector descriptor of the pixel is larger than the second threshold value and keeps at a higher value, and gradually approaches to zero along with the time variation, and the fluorescence intensity of the pixel of the original fluorescence standard image keeps in a second range, the tissue activity of the corresponding area in the original fluorescence standard image is the first-order activity.
Example 2
In this embodiment 2, a method for detecting activity of surface tissue of a burn wound by using the system for detecting activity of surface tissue of a burn wound according to embodiment 1 is provided, and before the method is implemented, a preparation step of a fluorescence imaging video of the burn wound needs to be performed:
step S1: placing mark identifiers at four corners of the target area;
step S2: and collecting a wound fluorescence imaging video of the target area.
The method for acquiring the burn wound fluorescence imaging video in the S2 comprises the following steps:
firstly, carrying out intravenous injection of a fluorescent drug on a burn patient, wherein the fluorescent drug comprises conventional fluorescent contrast agents such as fluorescein sodium, indocyanine green and the like; then, carrying out fluorescence excitation and fluorescence imaging on the target area, and recording the imaging process by video; this process can be implemented by a conventional fluoroscopic camera (patent 202010795967.9) or the like.
Based on the obtained imaging video, the method for detecting the activity of the surface tissues of the burn wound comprises the following steps:
collecting a plurality of fluorescence standard images of the surface tissues of the burn wound at certain time intervals in the imaging video by using an acquisition module; for example, n fluorescence standard images are extracted at regular time intervals (not less than 10 frames per second) within a prescribed time period.
Utilizing a processing module to perform gray-scale map conversion on adjacent images in the plurality of fluorescence standard images: the RGB to grayscale image conversion can be directly performed by an averaging method, that is: gray (0-255) — (R + G + B)/3, and then difference processing is performed to obtain a plurality of difference images. As in embodiment 2, the difference processing is performed on n pictures: the image of the nth frame and the image of the (n-1) th frame are subjected to difference processing, and the difference processing is sequentially carried out from the 1 st frame to the nth frame to obtain n-1 difference images, wherein the formula is as follows:
Figuren-1 difference value=Figuren–Figuren-1
and describing based on the pixel values of the plurality of difference images by using a description module to obtain a vector descriptor with the dimensionality corresponding to the number of the plurality of difference images. For example, in this embodiment 2, Figure is applied to the original image FigurenBased on the Pixel value Figure of the n-1 difference imaget difference value(u, v) (1 ≦ t ≦ n-1) to form an n-1 dimensional vector descriptor: pixel (u, v) ═ Figure1 differencevalue(u,v),Figure2 differencevalue(u,v),...,Figuren-1 difference value(u,v)]。
And classifying the tissue activity by using a classification module according to the vector descriptor of each pixel to obtain a burn wound surface tissue activity result.
In this embodiment 2, the matching module is further used to perform pixel matching on the fluorescence standard image acquired by the acquisition module. Wherein, marking the identifier as anchoring, performing pixel matching on n pictures, and generating Figure by adjusting angle, cutting edge area and the like in the matching processn。
And sequentially reading the pixel value of each pixel in each difference image by using a reading unit in the description module. For example, in embodiment 2, the reading unit sequentially reads the pixel value (0-255) Figure of each pixel in each difference image for n-1 difference imagest difference value(u, v), wherein t is more than or equal to 1 and less than or equal to n-1.
When the classification module is used for judging the tissue activity:
when the maximum value of the vector descriptor of the pixel is smaller than the first threshold (set to 5 in this embodiment 2) and gradually approaches zero with time, the tissue activity of the corresponding region in the original fluorescence standard image is the fourth-order activity (defined as "necrosis"). For example, in this embodiment 2, when the maximum value of the vector descriptor of the pixel lingers in a lower value (the maximum value is lower than 5, and the mean value is close to 0 (which may be defined as less than 0.1)) and then gradually approaches 0, it is divided into class4 (four levels of activity), and the pixels of the corresponding region in the original image are marked as blue.
When the maximum value of the vector descriptor of the pixel is greater than the first threshold value and less than the second threshold value (i.e. the maximum value is between 5 and 10), and the variation value with time is less than the preset variation value (i.e. the mean value is greater than 0.1), the tissue activity of the corresponding region in the original fluorescence standard image is the tertiary activity (the tertiary activity is defined as "stasis"). For example, in this embodiment 2, when the maximum value of the vector descriptor of a pixel is within a certain value (not 0) and lingers (the maximum value is between 5 and 10), and the value does not change significantly with time (the average value is greater than 0.1), the pixels with these features are classified as class3 (tertiary activity), and the pixels in the corresponding area in the original image are marked as purple.
When the maximum value of the vector descriptor of the pixel is larger than a second threshold value and gradually approaches zero along with the time change, the fluorescence intensity of the pixel of the original fluorescence standard image is combined to determine the tissue activity of the corresponding area in the original fluorescence standard image.
Specifically, when the maximum value of the vector descriptor of the pixel is greater than the second threshold (i.e., the maximum value is greater than 10), and gradually goes to zero over time (the mean value is greater than 0.1), and the fluorescence intensity of the pixel of the original fluorescence standard image is maintained within the first range, the tissue activity of the corresponding region in the original fluorescence standard image is secondary activity. For example, in this embodiment 2, when the maximum value of the vector descriptor of a pixel is maintained at a higher value (i.e. the maximum value is greater than 10), and then gradually approaches 0 (the average value is between 0.1 and 0.15), and the fluorescence intensity of the pixel of the original image is maintained between 80 and 100, the pixel is divided into class2, and the pixel of the corresponding area in the original image is marked yellow.
When the maximum value of the vector descriptor of the pixel is larger than the second threshold value and gradually approaches to zero along with the time variation, and the fluorescence intensity of the pixel of the original fluorescence standard image is maintained in the second range, the tissue activity of the corresponding area in the original fluorescence standard image is primary activity (the primary activity is defined as "hyperemia"). For example, in this embodiment 2, when the maximum value of the vector descriptor of a pixel starts to be maintained at a higher value (i.e. the maximum value is greater than 10), then gradually approaches 0 (the average value is greater than 0.15), and the fluorescence intensity of the original image pixel is maintained between 120 and 140, the pixel is divided into class1, and the pixel in the corresponding region in the original image is marked with red.
Example 3
Embodiment 3 of the present invention provides a non-transitory computer-readable storage medium, where the non-transitory computer-readable storage medium is used to store computer instructions, and when the computer instructions are executed by a processor, the method for detecting activity of surface tissue of a burn wound as described above is implemented, where the method includes:
collecting a plurality of fluorescence standard images of the surface tissues of the burn wound at certain time intervals;
performing difference processing on adjacent images in the plurality of fluorescence standard images to obtain a plurality of difference images;
describing based on pixel values of the plurality of difference images to obtain vector descriptors of which the dimensionalities correspond to the number of the plurality of difference images;
and classifying the tissue activity according to the vector descriptor of each pixel to obtain a burn wound surface tissue activity result.
Example 4
Embodiment 4 of the present invention provides a computer program (product) comprising a computer program for implementing the method for detecting activity of surface tissue of a burn wound as described above when the computer program runs on one or more processors, the method comprising:
collecting a plurality of fluorescence standard images of the surface tissues of the burn wound at certain time intervals;
performing difference processing on adjacent images in the plurality of fluorescence standard images to obtain a plurality of difference images;
describing based on pixel values of the plurality of difference images to obtain vector descriptors of which the dimensionalities correspond to the number of the plurality of difference images;
and classifying the tissue activity according to the vector descriptor of each pixel to obtain a burn wound surface tissue activity result.
Example 5
An embodiment 5 of the present invention provides an electronic device, including: a processor, a memory, and a computer program; wherein a processor is connected with the memory, the computer program is stored in the memory, and when the electronic device runs, the processor executes the computer program stored in the memory to make the electronic device execute the instructions for implementing the method for detecting the activity of the superficial tissue of the burn wound as described above, the method includes:
collecting a plurality of fluorescence standard images of the surface tissues of the burn wound at certain time intervals;
performing difference processing on adjacent images in the plurality of fluorescence standard images to obtain a plurality of difference images;
describing based on pixel values of the plurality of difference images to obtain vector descriptors of which the dimensionalities correspond to the number of the plurality of difference images;
and classifying the tissue activity according to the vector descriptor of each pixel to obtain a burn wound surface tissue activity result.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Although the embodiments of the present invention have been described with reference to the accompanying drawings, it is not intended to limit the scope of the present invention, and it should be understood by those skilled in the art that various modifications and variations can be made without inventive efforts based on the technical solutions disclosed in the present invention.