Infant hearing screening method and device
Technical Field
The invention relates to the technical field of medical detection, in particular to a method and a device for screening hearing of infants.
Background
Hearing screening is an objective, rapid, and noninvasive test of infants and young children in a quiet state. Reports at home and abroad show that the difference between the incidence rates of hearing loss of normal neonates and high-risk factor neonates is large, the incidence rates of the normal neonates and the high-risk factor neonates are about 1-3 per thousand, and the incidence rates of the high-risk factor neonates and the high-risk factor neonates are about 2-4%.
If the hearing loss can not be found in time, the hearing loss not only affects children (speech and cognitive development, education, employment and marriage) and families (communication disorder, psychology and economic burden), but also can become a heavy burden of society and affect the development of socioeconomic performance. Modern science and technology can carry out early hearing detection and diagnosis on newborns and infants, for example, infants which are definitely diagnosed as permanent hearing loss can be scientifically intervened and rehabilitated within 6 months of birth, and most of the infants can return to the mainstream society.
Currently, hearing screening mainly adopts sound stimulation response to understand the state of auditory function and diagnose the auditory system; the hearing loss success, nature and lesion site of the infant can be judged by the stimulus response observed by the sound stimulus.
In clinical hearing detection, for infants who cannot actively cooperate to finish behavior audiometry, image processing technology is often needed to be used when sound stimulation reaction is adopted, and whether a corresponding reaction is generated when the user hears sound is obtained through recognition and analysis of facial features of the user in an image.
For example, in the patents CNCN 112315463A; a method and a device for testing the hearing of an infant and an electronic device disclose a testing method, wherein the testing method comprises the steps of playing stimulation audio, and then shooting the facial expression change of the infant before and after the infant hears the sound to judge and analyze.
However, this approach has a number of drawbacks:
1. the time for generating expression change after audio playing and the infants hear the audio is not fixed, the test result depends on the photographed image, but the photographing time is difficult to grasp, which has very high requirements on the operation level of a tester, so that the test result is easier to generate errors due to human factors.
2. After the infant hears the stimulation audio, the infant does not necessarily have a violent reaction, and only part of the face or the expression of the infant may change, and the changes are not easy to be captured by the observer.
Therefore, the method disclosed in the above patent is an ideal state, and is very prone to human error in practice, resulting in inaccurate detection results.
Disclosure of Invention
The invention aims to provide a hearing screening method for infants.
To achieve the above object, in one embodiment of the present invention, a hearing screening method for an infant is provided, which includes the following steps:
step (1), placing an infant in a detection environment, enabling the infant to freely move, and emitting a stimulation audio in the free movement; meanwhile, shooting the facial area of the infant by using a camera to obtain a screening video;
calling a screening video, and judging whether a stimulus audio frequency appears in the screening video;
step (3) acquiring time information of stimulus audio when the stimulus audio appears in the screening video; intercepting a detection video segment after the stimulus audio appears according to the time information, wherein the time length of the detection video segment is preset time length;
step (4) collecting and storing each frame of image in the detection video band to form an infant facial image set, analyzing infant facial expression characteristics in the infant facial image set, and establishing a mapping relation between each image and the facial expression characteristics;
step (5) judging whether the change value of the facial expression features of the infants corresponding to any two images in the infant facial image set exceeds a threshold value or not; and outputting an analysis result according to the change value.
In a preferable scheme of the invention, when the camera is used for shooting in the step (1), the camera is kept right facing the face of the infant; and stimulating audio is emitted at preset time intervals in the shooting process.
In a preferred embodiment of the present invention, the stimulus audio is played and emitted through an electronic player at a predetermined time point.
In a preferred embodiment of the present invention, the method for determining whether the audio stimulus appears in the screening video in step (2) comprises:
calling the stimulus audio in the step (1), carrying out audio analysis on the stimulus audio, and acquiring and archiving audio features of the stimulus audio; judging whether the screening video contains the audio features of the stimulus audio according to the audio features of the stimulus audio; and when the screening video contains the same audio characteristics as the stimulation audio, marking the corresponding time information in the screening video.
In a preferred scheme of the invention, in the step (5), when the variation values of facial expression features of the infants corresponding to any two images in the same detection video segment exceed a threshold value, the infants are judged to hear the sound and make a corresponding response; if the sound does not exceed the threshold, the infant is judged not to hear the sound, and no corresponding response is made.
Another object of the invention is: based on the infant hearing screening method, the invention also discloses an infant hearing screening device, which comprises the following steps:
a camera device; the system is used for recording videos of the faces of infants and synchronously acquiring on-site audio;
a camera steering device; the camera device is arranged on the camera steering device, and the camera device and the face of the infant keep opposite direction by adjusting the camera angle;
an audio player; for playing stimulation audio at a screening site;
a video analysis unit; the video analysis unit comprises an audio comparison module, an image interception module, a facial expression feature recognition module, a facial expression comparison module and a screening result output module.
Preferably, in the infant hearing screening device, the audio comparison module is used for analyzing whether the video contains the stimulation audio;
the image capturing module is used for acquiring each frame of image in the detection video segment;
the facial expression feature recognition module is used for analyzing the image, detecting and acquiring facial expression features of the infant, and associating the image with the corresponding facial expression features;
the facial expression comparison module is used for comparing whether the change value of the facial expression characteristics corresponding to any two images exceeds a threshold value or not;
and the screening result output module is used for outputting a screening analysis result according to the comparison result.
In summary, the invention has the following advantages:
1. the method comprises the steps of recording videos of activities of infants, analyzing the recorded videos, acquiring a detection video segment after stimulus audio is sent out by taking the stimulus audio as a time node, intercepting each frame of image in the detection video segment, associating each frame of image with corresponding facial expression characteristics of each frame of image, and comparing whether the change value of the facial expression characteristics of any two images exceeds a threshold value to serve as reference data for screening analysis, so that the audios of the infants can be accurately screened.
2. In the screening process, a tester does not need to judge the photographing time, and the system can automatically calculate the size relation between the change value and the threshold value, so that higher accuracy can be obtained.
3. According to the invention, the detection object takes the detection video segment with preset duration as a unit by intercepting the detection video segment, so that the whole screening video is avoided being taken as an image or facial feature recognition being taken as comparison data, the calculation amount is greatly reduced, and further the rapid detection can be carried out.
Drawings
FIG. 1 is a schematic block diagram of a hearing screening method for infants according to the present invention.
Detailed Description
The invention provides a hearing screening method for infants, which comprises the following steps:
step (1), placing an infant in a detection environment, enabling the infant to freely move, and emitting a stimulation audio in the free movement; meanwhile, a camera is used for shooting the face area of the infant to obtain a screening video.
The infant should keep a quiet state as much as possible during detection, so that the infant can receive stimulation audio conveniently, and operation errors are reduced. In the shooting process, the infant inevitably rotates the head and other behaviors, so the camera can be provided with a camera steering device and other auxiliary supporting equipment, the infant can be shot right by the camera, and more facial expression characteristics can be collected in the shot image.
When the camera is used for shooting in the step (1), keeping the camera right facing the face of the infant; and stimulating audio is emitted at preset time intervals in the shooting process.
And (2) calling the screening video, and judging whether the stimulus audio frequency appears in the screening video.
The audio is played in the step (1) when the audio is stimulated, the video needs to be analyzed after the shooting is finished, the video itself comprises the audio information, but the audio information in the video may contain other audio, such as the sounding of infants and environmental sounds. However, the stimulus audio may be prepared in advance, and the frequency band and the audio frequency characteristics of the stimulus audio are known in advance, so that it is easy to know which audio frequencies belong to the stimulus audio when performing audio analysis. When the stimulus audio appears in the video, the stimulus audio is played at the current time point, and then the infant receives the stimulus audio and makes a response, so that the detection video segment is the video recorded in a certain time period after the stimulus audio is played. The stimulation audio is played and sent out through an electronic player at a preset time point.
The method for judging whether the stimulus audio frequency appears in the screening video in the step (2) comprises the following steps:
calling the stimulus audio in the step (1), carrying out audio analysis on the stimulus audio, and acquiring and archiving audio features of the stimulus audio; judging whether the screening video contains the audio features of the stimulus audio according to the audio features of the stimulus audio; and when the screening video contains the same audio characteristics as the stimulation audio, marking the corresponding time information in the screening video.
Step (3) acquiring time information of stimulus audio when the stimulus audio appears in the screening video; and intercepting the detection video segment after the stimulus audio appears according to the time information, wherein the time length of the detection video segment is preset time length.
Through the intercepted detection video segment, the detection video segment is analyzed, whether the infant has a corresponding response after the stimulation audio is played can be known, and the preset time of the detection video segment can be 3-5 s; if the infant has a large response or the facial features change greatly, the infant cannot be said to have a response due to the stimulation audio being heard.
And (4) acquiring and storing each frame of image in the detection video band to form an infant facial image set, analyzing infant facial expression characteristics in the infant facial image set, and establishing a mapping relation between each image and the facial expression characteristics. Each frame of image has corresponding facial expression characteristic parameters of the infant after being analyzed.
Step (5) judging whether the change value of the facial expression features of the infants corresponding to any two images in the infant facial image set exceeds a threshold value or not; and outputting an analysis result according to the change value.
In the step (5), when the change values of the facial expression characteristics of the infants corresponding to any two images in the same detection video segment exceed a threshold value, judging that the infants hear the sound and make corresponding response; if the sound does not exceed the threshold, the infant is judged not to hear the sound, and no corresponding response is made.
The invention also discloses an infant hearing screening device based on the infant hearing screening method, which comprises the following steps:
a camera device; the system is used for recording videos of the faces of infants and synchronously acquiring on-site audio;
a camera steering device; the camera device is arranged on the camera steering device, and the camera device and the face of the infant keep opposite direction by adjusting the camera angle;
an audio player; for playing stimulation audio at a screening site;
a video analysis unit; the video analysis unit comprises an audio comparison module, an image interception module, a facial expression feature recognition module, a facial expression comparison module and a screening result output module.
The audio comparison module is used for analyzing whether the video contains the stimulation audio or not;
the image capturing module is used for acquiring each frame of image in the detection video segment;
the facial expression feature recognition module is used for analyzing the image, detecting and acquiring facial expression features of the infant, and associating the image with the corresponding facial expression features;
the facial expression comparison module is used for comparing whether the change value of the facial expression characteristics corresponding to any two images exceeds a threshold value or not;
and the screening result output module is used for outputting a screening analysis result according to the comparison result.
While the present invention has been described in detail with reference to the illustrated embodiments, it should not be construed as limited to the scope of the present patent. Various modifications and changes may be made by those skilled in the art without inventive step within the scope of the appended claims.