WO2013089072A1 - 情報管理装置、情報管理方法、情報管理システム、聴診器、情報管理プログラム、測定システム、制御プログラムおよび記録媒体 - Google Patents
情報管理装置、情報管理方法、情報管理システム、聴診器、情報管理プログラム、測定システム、制御プログラムおよび記録媒体 Download PDFInfo
- Publication number
- WO2013089072A1 WO2013089072A1 PCT/JP2012/081959 JP2012081959W WO2013089072A1 WO 2013089072 A1 WO2013089072 A1 WO 2013089072A1 JP 2012081959 W JP2012081959 W JP 2012081959W WO 2013089072 A1 WO2013089072 A1 WO 2013089072A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- unit
- auscultation
- sound
- information management
- Prior art date
Links
- 238000005259 measurement Methods 0.000 title claims abstract description 495
- 238000007726 management method Methods 0.000 title claims description 361
- 238000002555 auscultation Methods 0.000 claims description 392
- 238000003384 imaging method Methods 0.000 claims description 133
- 238000000034 method Methods 0.000 claims description 42
- 230000005856 abnormality Effects 0.000 claims description 41
- 230000008569 process Effects 0.000 claims description 23
- 230000000694 effects Effects 0.000 claims description 10
- 230000003287 optical effect Effects 0.000 claims description 9
- 230000004044 response Effects 0.000 claims description 9
- 239000000284 extract Substances 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 6
- 238000004891 communication Methods 0.000 description 71
- 230000006870 function Effects 0.000 description 34
- 238000001514 detection method Methods 0.000 description 33
- 238000010586 diagram Methods 0.000 description 24
- 238000012545 processing Methods 0.000 description 24
- 238000004458 analytical method Methods 0.000 description 21
- 238000000926 separation method Methods 0.000 description 20
- 230000002159 abnormal effect Effects 0.000 description 14
- 210000000038 chest Anatomy 0.000 description 12
- 238000003745 diagnosis Methods 0.000 description 11
- 230000004048 modification Effects 0.000 description 10
- 238000012986 modification Methods 0.000 description 10
- 230000005540 biological transmission Effects 0.000 description 8
- 201000010099 disease Diseases 0.000 description 7
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 7
- 238000012546 transfer Methods 0.000 description 7
- 238000006243 chemical reaction Methods 0.000 description 6
- 230000005236 sound signal Effects 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 5
- 210000002445 nipple Anatomy 0.000 description 5
- 230000010365 information processing Effects 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 208000037656 Respiratory Sounds Diseases 0.000 description 3
- 238000013459 approach Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000009434 installation Methods 0.000 description 3
- 239000004973 liquid crystal related substance Substances 0.000 description 3
- 230000000644 propagated effect Effects 0.000 description 3
- 206010011224 Cough Diseases 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000037237 body shape Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 239000000919 ceramic Substances 0.000 description 2
- 238000002591 computed tomography Methods 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 238000002595 magnetic resonance imaging Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 101150012579 ADSL gene Proteins 0.000 description 1
- 102100020775 Adenylosuccinate lyase Human genes 0.000 description 1
- 108700040193 Adenylosuccinate lyases Proteins 0.000 description 1
- 206010003210 Arteriosclerosis Diseases 0.000 description 1
- 206010057190 Respiratory tract infections Diseases 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 208000011775 arteriosclerosis disease Diseases 0.000 description 1
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000036772 blood pressure Effects 0.000 description 1
- 230000003840 blood vessel health Effects 0.000 description 1
- 238000011976 chest X-ray Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 230000037308 hair color Effects 0.000 description 1
- 230000000968 intestinal effect Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 229910052760 oxygen Inorganic materials 0.000 description 1
- 239000001301 oxygen Substances 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000029058 respiratory gaseous exchange Effects 0.000 description 1
- 210000001991 scapula Anatomy 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/684—Indicating the position of the sensor on the body
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B7/00—Instruments for auscultation
- A61B7/02—Stethoscopes
- A61B7/04—Electric stethoscopes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7246—Details of waveform analysis using correlation, e.g. template matching or determination of similarity
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7271—Specific aspects of physiological measurement analysis
- A61B5/7278—Artificial waveform generation or derivation, e.g. synthesising signals from measured signals
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/7475—User input or interface means, e.g. keyboard, pointing device, joystick
- A61B5/749—Voice-controlled interfaces
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B7/00—Instruments for auscultation
- A61B7/02—Stethoscopes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
- A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
- A61B5/0022—Monitoring a patient using a global network, e.g. telephone networks, internet
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/7465—Arrangements for interactive communication between patient and care services, e.g. by using a telephone network
Definitions
- the present invention relates to a stethoscope that acquires a body sound, an information management device that manages measurement information (body sound information) of body sound, and the like, an information management system, and an information management method.
- a patient's body sound (breathing sound, heart sound, etc.)
- the positional information on which part of the patient's body surface the acquired body sound was obtained when the stethoscope was applied Is important. This is because the body sound has location dependence, and the body sound obtained depends on where the stethoscope is applied.
- Patent Document 1 describes that an auscultatory sound signal corresponding to the acquired auscultatory sound is recorded as one file, and appropriate location identification data indicating each appropriate location set in advance on the patient surface is added to this file. ing.
- Patent Document 2 describes that a doctor at a remote location indicates the placement position of an auscultation microphone while viewing a captured patient image.
- Patent Document 3 describes that a user's usage situation in a medical device is monitored by a camera, and the user's behavior is expressed in real time on a graphic, and an error correction is requested from a remote location.
- the auscultatory sound signal corresponding to the auscultatory sound continuously collected from the start to the end of the recording by the on / off switch that controls the start and end of the recording of the auscultatory sound is 1 It is recorded as one file. Then, appropriate location identification data is added to the file thus obtained in accordance with the switching operation of the on / off switch. Therefore, there arises a problem that the operation for recording the auscultatory sound becomes complicated.
- Patent Documents 2 and 3 also do not disclose a configuration that easily associates body sound information with measurement position information.
- the present invention has been made to solve the above-described problems, and an object of the present invention is to provide an information management apparatus, an information management method, an information management system, and an auscultation that can easily associate biological sound information with measurement position information. Is to provide a vessel.
- an information management apparatus provides: An acquisition means for acquiring biological sound information acquired by the sound collector and position information indicating an acquisition position of the biological sound information; Association means for associating the body sound information acquired by the acquisition means with the position information; The acquisition means acquires the position information as sound input to the sound collection device.
- An information management method is an information management method in an information management device, A first acquisition step of acquiring biological sound information acquired by the sound collector; A second acquisition step of acquiring position information indicating an acquisition position of the biological sound information as sound input to the sound collection device; It includes an associating step for associating the body sound information acquired in the first and second acquiring steps with the position information.
- An electronic stethoscope is: A first sound collecting unit for obtaining a body sound; A second sound collection unit that acquires position information indicating the acquisition position from which the biological sound is acquired as sound information; A transmitting unit that transmits the body sound information indicating the body sound and the position information to an association unit that associates the body sound acquired by the first sound collection unit with the position information acquired by the second sound collection unit; It is characterized by having.
- the information management apparatus is an information management apparatus that manages biological sound information collected by a stethoscope, and obtains subject information of a subject whose biological sound information is collected.
- An acquisition means an auscultation support information storage unit for storing a plurality of patterns of auscultation support information including at least one measurement position information indicating a measurement position to which a stethoscope should be applied for each subject information, and a subject acquired by the subject information acquisition means
- Auscultation support information selection means for selecting auscultation support information corresponding to the information from the auscultation support information storage unit, and output control for converting the measurement position information of the auscultation support information selected by the auscultation support information selection means into a video signal and outputting it
- one of the measurement position information output by the output control means is associated with the body sound information collected from the stethoscope.
- An information management method is an information management method for managing body sound information collected by a stethoscope in order to solve the above problem, and acquires subject information of a subject whose body sound information is collected.
- a subject information acquisition step and auscultation support information including one or more measurement position information indicating a measurement position to which a stethoscope is to be applied are obtained from the auscultation support information storage unit storing a plurality of patterns for each subject information in the subject information acquisition step.
- An auscultation support information selection step for selecting auscultation support information corresponding to the subject information
- an output control step for converting the measurement position information of the auscultation support information selected in the auscultation support information selection step into a video signal and outputting it
- Information management for associating one of the measurement position information output in the output control step with the body sound information collected from the stethoscope
- a step, in the information management step, on the basis of the auxiliary information acquired in response to the occurrence of certain events in the video signal output is characterized by identifying one of the measurement location.
- the present invention can reduce the burden on the user regarding the input of position information and can eliminate the need to separately provide an input device for inputting position information.
- the present invention allows an operator to perform measurement using an electronic stethoscope without using a special device that requires complicated operation, and collects biological sound information and measurement thereof. There is an effect that the link with the position information can be easily performed.
- Embodiment 1 An embodiment of the present invention will be described below with reference to FIGS.
- FIG. 2 is a diagram showing an outline of the biological sound measurement system 100.
- the body sound measurement system 100 includes a stethoscope (electronic stethoscope, sound collection device) 1 and a terminal device (information management device) 30.
- a stethoscope electronic stethoscope, sound collection device
- a terminal device information management device
- the body sound of the subject 50 can be acquired by placing the chest piece 2 of the stethoscope 1 on the chest of the subject (living body) 50 to be measured.
- the type of biological sound is not particularly limited, and is, for example, a heart sound, a respiratory sound, or an intestinal sound.
- the acquired body sound is transmitted to the terminal device 30 as body sound information and is managed in the terminal device 30.
- the user (operator) of the stethoscope 1 When acquiring a body sound, the user (operator) of the stethoscope 1 utters the measurement position (acquisition position) or the measurement site (acquisition site) to which the chestpiece 2 is applied, and inputs the voice via the stethoscope 1. To do.
- the measurement position information as voice information input in this way is transmitted to the terminal device 30. Then, the terminal device 30 records the body sound information and the measurement position information in association with each other.
- the user of the stethoscope 1 can associate the body sound information with the position information only by speaking the measurement position.
- the number of sets of biological sound information and position information may be one or plural. With respect to at least one body sound information, it is only necessary that the position where the body sound information is acquired can be specified.
- FIG. 1 is a diagram illustrating a configuration of the biological sound measurement system 100. As shown in FIG. 1, the stethoscope 1 includes a chest piece 2, a cable 3, and an earphone 4.
- the chestpiece 2 is a sound collection unit that contacts the surface of the living body 50 and acquires a body sound emitted from the inside of the living body.
- the chest piece 2 also functions as a sound collection unit that acquires sound emitted by the user of the stethoscope 1.
- the biological sound acquired by the chestpiece 2 is transmitted as an electrical signal to the earphone 4 through the cable 3, and the biological sound is converted into an acoustic signal by the earphone 4.
- FIG. 3 is a cross-sectional view showing an example of the configuration of the chest piece 2.
- the chest piece 2 includes a diaphragm surface (first sound collection unit) 21, a vibration sensor (first sound collection unit) 22, a microphone (second sound collection unit) 23, a digital signal conversion unit 24, A communication unit (transmission unit) 25 is provided.
- the microphone 23, the digital signal conversion unit 24, and the communication unit 25 are provided on the substrate 26.
- the chest piece 2 includes a battery that supplies power to each unit, but the battery is not shown because it is not related to the feature of the present invention.
- Diaphragm surface 21 When the subject 50 emits a biological sound by breathing or the like, the diaphragm surface 21 slightly vibrates in accordance with the wavelength of the biological sound. The minute vibration of the diaphragm surface 21 is propagated to the vibration sensor 22 through the atmosphere.
- the vibration sensor 22 detects minute vibrations of the diaphragm surface 21 and converts the detected minute vibrations into electric signals.
- a sensor having a piezoelectric diaphragm is used as the vibration sensor 22.
- This piezoelectric diaphragm is composed of two layers of a piezoelectric ceramic (upper side) and a metal plate (lower side). More specifically, the piezoelectric ceramic is sandwiched between two layers of electrodes, but the electrodes are omitted in FIG.
- the configuration of the vibration sensor 22 is not limited to that shown in FIG.
- the vibration sensor 22 may include a filter (low-pass filter) that cuts high-frequency sound (for example, sound exceeding 1 kHz). Since most body sounds have a frequency of 1 kHz or less, a body sound with less noise can be obtained by cutting sounds exceeding 1 kHz.
- a filter low-pass filter
- the electrical signal generated by the vibration sensor 22 is transmitted to the earphone 4 via the cable 3 and is output to the digital signal converter 24.
- voice with the vibration sensor 22 is also assumed. Since the sound usually has a frequency exceeding 1 kHz, a part of the sound is cut by the above-described low-pass filter. However, since it is not completely cut, it is possible to acquire the sound.
- the above-described low-pass filter may not be provided.
- the microphone 23 is a dedicated sound collecting device for acquiring a user's voice as measurement position information.
- the user's voice may be acquired using the diaphragm surface 21 and the vibration sensor 22 as described above, but a microphone 23 may be provided separately from the vibration sensor 22 in order to acquire the user's voice more reliably. Good.
- the voice when the voice is acquired by the vibration sensor 22 or the like, the voice propagated in the living body is acquired.
- the microphone 23 when the microphone 23 is used, the voice propagated in the atmosphere can be acquired. Therefore, clearer sound can be acquired by using the microphone 23.
- the digital signal conversion unit 24 converts the electrical signal converted by the vibration sensor 22 into a digital signal, and outputs the digital signal to the communication unit 25 as biological sound information and measurement position information.
- the digital signal conversion unit 24 converts the electrical signal output from the microphone 23 into a digital signal, and the communication unit 25 as measurement position information. Output to.
- the digital signal converter 24 may convert the body sound information and the measurement position information into sound data of a predetermined file format.
- the file format include MP3, WAV, MMA, MP2, AC3, OGG, RA, and AAC.
- the communication unit 25 functions as a transmission unit that transmits biological sound information and measurement position information output from the digital signal conversion unit 24 to the communication unit 31 of the terminal device 30.
- the communication unit 25 may have a function as a reception unit so that the setting conditions and the like of the stethoscope 1 can be changed via the terminal device 30.
- the terminal device 30 is a device that manages biological information and measurement position information acquired by the stethoscope 1.
- the terminal device 30 is, for example, a personal computer, a smartphone, or a PDA (personal digital assistant), but is not particularly limited.
- the terminal device 30 includes a communication unit 31, a main control unit (acquisition unit) 37, a storage unit (storage unit) 38, a display unit (informing unit) 39, and a speaker (informing unit) 40. Yes.
- the communication unit 31 transmits / receives information to / from the stethoscope 1, and particularly functions as a receiving unit that receives biological information and measurement position information from the stethoscope 1.
- the storage unit 38 records (1) a control program for each unit executed by the main control unit 37, (2) an OS program, (3) an application program, and (4) various data read when these programs are executed. Is.
- the storage unit 38 is configured by a nonvolatile storage device such as a hard disk or a flash memory. In particular, the storage unit 38 stores biological information and measurement position information received by the communication unit 31.
- the display unit 39 is, for example, a liquid crystal display, a screen for managing biological information and measurement position information, a screen for showing a predetermined measurement position to the user of the stethoscope 1, and an error for the user of the stethoscope 1 Display a screen to show the message.
- the speaker 40 outputs a warning sound for notifying the user of the stethoscope 1 that the measurement position is incorrect.
- the main control unit 37 controls the terminal device 30 and particularly functions as an acquisition unit that acquires biological information and measurement position information.
- the main control unit 37 manages the acquired biological information and measurement position information in association with each other, and determines whether the measurement position uttered by the user matches a predetermined measurement position.
- the main control unit 37 includes an information separation unit (extraction unit) 32, a speech recognition unit (speech recognition unit) 33, a position information determination unit (determination unit) 34, and an information management unit (association unit). 35, an output control unit (notification control means) 36 is provided.
- the information separation unit 32 converts the sound included in the sound data into the sound as the measurement position information and the sound as the body sound information. And to separate. In other words, the information separation unit 32 extracts the measurement position information and the biological sound information separately from the sound data. In this case, the information separation unit 32 can also be regarded as functioning as an acquisition unit that acquires measurement position information and biological sound information.
- the information separation unit 32 performs, for example, a fast Fourier transform (FFT) on sound data (mixed sound information) including a sound indicating measurement position information and a body sound, and a sound having a frequency of 1 kHz or less (FFT).
- FFT fast Fourier transform
- Biological sound and sound (voice) having a frequency higher than 1 kHz. That is, the information separation unit 32 bisects the sound information included in the sound data with a predetermined frequency as a boundary. And the information separation part 32 produces
- the format of the data file may be as described above, and is not particularly limited. Since the voice information includes voice representing the measurement position, it can be said that the voice information is measurement position information.
- the biological sound data file generated by the information separation unit 32 is output to the information management unit 35, and the voice data file (that is, measurement position information) is output to the voice recognition unit 33.
- the information separation unit 32 corresponds to the body sound data file and the sound data file generated from the same sound data file.
- a file name indicating that the file is present may be given.
- the voice recognition unit 33 recognizes the voice (measurement position information) indicated by the voice data file generated by the information separation unit 32. Specifically, the voice recognition unit 33 analyzes the voice indicated by the voice data file, and thereby the measurement position information represented by the voice is represented by letters, numbers, or a combination thereof (hereinafter referred to as letters, etc.). Convert to Then, the voice recognition unit 33 outputs the measurement position information expressed as characters or the like to the information management unit 35 and the position information determination unit 34.
- the voice recognition method in the voice recognition unit 33 is not particularly limited. For example, all the words included in the sound may be recognized, or only predetermined words included in the sound may be recognized.
- the position information determination unit 34 compares the measurement position indicated by the measurement position information output from the voice recognition unit 33 with the measurement position designated as the measurement position at that time. If it is determined that the two do not match, the position information determination unit 34 outputs mismatch information indicating that to the output control unit 36.
- the user of the stethoscope 1 may mistakenly recognize a predetermined measurement position and utter the measurement position. For example, when the measurement position is shown with respect to the image imitating the subject's chest, the user may misrecognize whether the indicated position is the right side or the right side when viewed from the subject. is assumed.
- the output control unit 36 controls the display unit 39 and the speaker 40. In particular, when receiving the mismatch information from the position information determination unit 34, the output control unit 36 displays a message indicating that the measurement position is incorrect on the display unit 39 and outputs a warning sound from the speaker 40.
- the information management unit 35 associates and manages the body sound information separated by the information separation unit 32 and the measurement position information.
- the information management unit 35 associates an identifier (for example, a file name) of biological sound information with an identifier (for example, a file name) of measurement position information as sound information (an association table). And the correspondence table is stored in the storage unit 38.
- the information management unit 35 may associate the identifier of the biological sound information with the measurement position information as characters or numbers recognized by the voice recognition unit 33.
- FIG. 4 is a diagram illustrating an example of the association table.
- a pre-designated measurement position such as upper right
- an actually measured measurement position such as “measurement site” in FIG. 4
- sound data biological sound information
- Identifier No. 123, etc. Since it is assumed that there is only one subject, it is only necessary that at least the body sound information and the measurement position information are associated with each other by the association table.
- the sound information output from the microphone 23 may be handled as the measurement position information, and thus the information separation unit 32 is provided. There is no necessity. In this case, the voice information output from the microphone 23 may be input to the voice recognition unit 33 without passing through the information separation unit 32. The biological sound information may be input to the information management unit 35 without going through the information separation unit 32.
- the information management unit 35 can function as an acquisition unit that acquires biological sound information
- the voice recognition unit 33 can function as an acquisition unit that acquires measurement position information
- FIG. 5 is a flowchart illustrating an example of a processing flow in the biological sound measurement system 100.
- FIG. 6 is a diagram illustrating an example of a screen displayed on the display unit 39. Here, the flow of processing when measuring a body sound after the user of the stethoscope 1 utters the measurement position will be described.
- a predetermined measurement position is displayed on the display unit 39 (S1).
- the main control unit 37 determines which measurement position should be selected at a certain time based on information about the measurement position stored in the storage unit 38 in advance. According to the determination of the main control unit 37, the output control unit 36 performs display control of the measurement position.
- the measurement order is determined for the plurality of measurement positions, and the measurement positions are selected according to a predetermined order.
- the first to sixth measurement positions are displayed so as to overlap the schematically drawn human body image, and the first measurement position is highlighted. Has been.
- a word expressing the first measurement position (“front chest, upper right”) is displayed as an image 42.
- the user of the stethoscope 1 utters information (measurement position information) for specifying the first measurement position toward the chest piece 2.
- information for specifying the first measurement position toward the chest piece 2.
- the user of the stethoscope 1 speaks “upper right”, “No. 1”, and the like. This sound is converted into an electrical signal by the vibration sensor 22, converted into a digital signal by the digital signal conversion unit 24, and then transmitted as sound information to the communication unit 31 of the terminal device 30 by the communication unit 25.
- the voice is acquired by the microphone 23, converted into a digital signal by the digital signal converter 24, and then transmitted as voice information to the communication unit 31 by the communication unit 25.
- the voice information received by the communication unit 31 is input to the main control unit 37 (first acquisition step) (S2) and output to the voice recognition unit 33.
- the voice recognition unit 33 recognizes the voice indicated by the voice information (S3).
- the information separation unit 32 is not necessarily required.
- mixed sound information including biological sound information and measurement position information is input to the information separation unit 32.
- the information separation unit 32 separates the mixed sound information into biological sound information and measurement position information, outputs the biological sound information to the information management unit 35, and outputs the measurement position information to the voice recognition unit 33.
- the voice recognition unit 33 outputs the result of voice recognition (measured position information as characters or numbers) to the information management unit 35 and the position information determination unit 34.
- the position information determination unit 34 determines whether the measurement position indicated by the acquired measurement position information matches the measurement position selected at that time (S4).
- position information determination unit 34 determines that they match (YES in S4), measurement and recording of a biological sound are started when recording button 44 is pressed by the user (S5). .
- the body sound information acquired by the stethoscope 1 is transmitted to the communication unit 31 and input to the main control unit 37 (second acquisition step).
- the biological sound information is output to the information management unit 35 via the information separation unit 32 or directly.
- the information management unit 35 Upon receiving the body sound information, the information management unit 35 creates a correspondence table for associating the previously received measurement position information with the body sound information, and uses the created correspondence table as the body sound information and the body sound information.
- the measured position information is stored in the storage unit 38 (S6) (association step).
- the output control unit 36 displays the measured waveform of the body sound on the display unit 39 as the image 43.
- the main control unit 37 determines whether or not the next measurement position is designated in advance based on information on the measurement position stored in the storage unit 38 in advance (S7).
- the output control unit 36 highlights the second measurement position in the image 41 as shown in FIG. A word representing the measurement position (“front chest, middle right”) is displayed as an image 46.
- the output control unit 36 displays the waveform of the second body sound on the display unit 39 as an image 47.
- the position information determination unit 34 determines that the measurement position indicated by the measurement position information does not match the measurement position selected at that time (NO in S4), the position information determination unit 34 Disagreement information indicating that fact is output to the output control unit 36.
- the output control unit 36 Upon receiving the mismatch information, the output control unit 36 displays a message 48 indicating that the measurement position is incorrect on the display unit 39 and outputs a warning sound from the speaker 40 as shown in FIG. (S8).
- the main control unit 37 determines that the measurement at all predetermined measurement positions has been completed (NO in S7), the main control unit 37 ends the series of processes.
- the playback button 45 is a button for playing back the body sound information stored in the storage unit 38.
- the terminal device 30 may acquire measurement position information after acquiring body sound information.
- the measurement position information acquired within a predetermined time after the body sound information is acquired in the stethoscope 1 is used as the body sound information acquired earlier. What is necessary is just to make it the setting which recognizes that it is corresponding measurement position information.
- the point in time when the body sound information or the measurement position information is acquired in the stethoscope 1 is, for example, the point in time when the body sound information or the measurement position information is buffered in a temporary storage memory (storage unit) included in the stethoscope 1.
- the measurement position information corresponding to the acquired body sound information may be set to be recognized.
- the information management unit 35 manages the acquisition (or transmission or reception) time of the body sound information and the measurement position information, and acquires (or transmits) the body sound information and the measurement position information. Or, the correspondence between the two is determined from the temporal relationship of reception). For this purpose, time information indicating an acquisition (or transmission or reception) time is added to the body sound information and the measurement position information. Alternatively, the correspondence relationship between the body sound information and the measurement position information and the time information may be indicated by a table or the like.
- the setting is such that the body sound information acquired within a predetermined time after the measurement position information is acquired by the stethoscope 1 is recognized as the body sound information corresponding to the previously acquired measurement position information. do it.
- the body sound information transmitted (or received) within a predetermined time after the measurement position information is transmitted by the communication unit 25 (or after the measurement position information is received by the communication unit 31) It may be set to recognize that it is biological sound information corresponding to the measurement position information acquired.
- the body sound information and the measurement position information are transmitted and received as separate files, it is preferable to determine the correspondence between them by some method.
- the body sound information and the measurement position information are transmitted and received as the same file, the correspondence between the two is obvious, and it is not necessary to determine the correspondence between the two when receiving the sound file. From this viewpoint, it is preferable to transmit and receive the body sound information and the measurement position information as the same file. Therefore, the sound (measurement position information) acquired by the microphone 23 and the biological sound acquired by the vibration sensor 22 may be included in one sound data file and then transmitted to the communication unit 31.
- the stethoscope 1 includes a nonvolatile storage unit capable of storing body sound information and measurement position information, and the data can be transferred from the storage unit of the stethoscope 1 to the storage unit 38 of the terminal device 30. Good.
- the main control unit 37 acquires biological sound information and measurement position information from the storage unit 38.
- the stethoscope 1 has a function corresponding to at least the information management unit 35, and the association between the body sound information and the measurement position information is performed.
- the stethoscope 1 may have the same function as the main control unit 37.
- the noise acquired by the microphone 23 is canceled out by the noise included in the body sound acquired by the vibration sensor 22 or the like. It may be used. That is, a noise having a phase opposite to that of the noise acquired by the microphone 23 is generated in a digital circuit or an analog circuit, and the uttered signal is superimposed on the biological sound signal to attenuate the noise included in the biological sound.
- the stethoscope 1 may have such a circuit configuration.
- the terminal device 30 may be realized as a server.
- a second terminal device that can be arranged in the vicinity of the user of the stethoscope 1, and to include the output control unit 36, the display unit 39, and the speaker 40 in the second terminal device.
- the information specifying the measurement position and the above-described mismatch information may be transmitted from the terminal device 30 as the server to the second terminal device.
- the user can input measurement position information via the stethoscope 1. Therefore, it is not necessary to prepare an interface for inputting characters, such as a keyboard, and the body sound and the measurement position information can be associated with one stethoscope. This configuration is particularly useful when a doctor or the like visits a remote place where facilities are not provided.
- the stethoscope since the stethoscope is originally a sound collector, it is not always necessary to separately provide a voice input device for inputting measurement position information. Therefore, measurement position information can be acquired with a simple configuration.
- the correspondence between the body sound information and the measurement position information is clear, and the body sound information and the measurement position information are associated and managed. Can be easily done.
- Embodiment 2 Another embodiment according to the present invention will be described.
- Patent Document 1 discloses an auscultation system that allows a nurse or the like to collect a body sound using a stethoscope in a state where an image showing an appropriate position mark indicating the position and recording order of an appropriate position is displayed on a patient pseudo image. Has been. This auscultation system records the auscultation sound signal corresponding to the acquired auscultation sound as one file, and adds appropriate location identification data indicating each preset location on the patient surface to this file.
- Patent Document 3 discloses a telemedicine diagnosis system that informs a user through a medical service window by superimposing a symbol of a standard medical treatment position on which a stethoscope is to be applied on a captured image of a patient's body or a copy graphic. .
- Patent Document 4 discloses a diagnosis system in which a measurement position on which a stethoscope is applied is recognized from an image captured by a digital camera, and the photographer confirms whether or not the recognized measurement position information is correct. .
- measurement position information is automatically acquired by collecting auscultation sounds when the recognized measurement position is correct.
- the measurement position information that indicates where the acquired body sound was obtained when the electronic stethoscope was applied to the patient's body surface is important. is there. This is because the body sound has location dependence, and the body sound obtained depends on where the electronic stethoscope is applied. As described above, it is particularly important to manage body sound information together with measurement position information in a diagnosis mode in which a doctor is at a remote place or auscultates on a different day from the date of collection. In other words, the body sound information acquired by the electronic stethoscope is meaningless if there is no correlation with the measurement position of the patient at the time of acquisition.
- Patent Document 3 does not disclose a configuration for associating body sound information with measurement position information.
- the present invention has been made in view of the above problems, and its purpose is to allow an operator to perform measurement using an electronic stethoscope without using a special device that requires complicated operations.
- An object of the present invention is to realize an information management device, an information management method, a control program, and a recording medium that make it easy to link the collected body sound information and its measurement position information.
- the auscultation system means that a subject's body sound is acquired by an electronic stethoscope, and the acquired electronic data, that is, body sound information, is managed by the information management device of the present invention and used for medical treatment of the subject. It is a system that makes it possible.
- a subject who is examined by an electronic stethoscope is referred to as a patient.
- the subject (patient) is assumed to be a human, but an auscultation system in which any living body other than a human being is a subject (patient) also falls within the scope of the present invention.
- the information management apparatus of the present invention is not limited to the above example, and can be introduced into any other system capable of acquiring and using body sound information from a living body for purposes other than medical treatment.
- FIG. 8 is a diagram showing an outline of the auscultation system in the embodiment of the present invention.
- the auscultation system 1200 includes at least an electronic stethoscope 1003 for the operator U to collect (ie, auscultate) the body sound of the patient P, and an information management device 1100 used by the operator U during auscultation. And is built.
- the operator U is present at the medical treatment site 1001 for treating the patient P, and performs medical treatment of the patient P at the medical treatment site 1001 using various devices such as an electronic stethoscope 1003.
- the various devices may include, for example, an oxygen saturation meter, an electrocardiograph, a blood pressure meter, a thermometer, an arteriosclerosis meter, a blood vessel health meter, and the like.
- the information management device 1100 and the electronic stethoscope 1003 are communicably connected to each other wirelessly or by wire.
- the operator U can operate the information management apparatus 1100 to read out and refer to information necessary for medical treatment of the patient P, for example, information related to the patient P or information related to the medical procedure.
- the operator U can manage biological sound information collected from the electronic stethoscope 1003 using the information management apparatus 1100.
- the information management device 1100 is realized by an information processing terminal device possessed by the operator U and excellent in portability, or a desktop personal computer (PC) installed in the clinical site 1001.
- the information management apparatus 1100 of the present invention is realized by a multi-function mobile communication terminal such as a smartphone.
- the operator U examines the patient P using the electronic stethoscope 1003 and the information management device 1100. It is also possible to make a final diagnosis of the medical condition and treat it. As described above, an auscultation system including the electronic stethoscope 1003 and the information management apparatus 1100 also falls within the scope of the present invention.
- the auscultation system 1200 shown in FIG. 8 also falls within the scope of the present invention.
- the auscultation system 1200 may be constructed to include the electronic stethoscope 1003 and the information management device 1100 at the clinical site 1001 and the management server 1004 at the remote support center 1002.
- the information management apparatus 1100 and the management server 1004 are connected to be communicable with each other via a communication network 1005 such as the Internet.
- the operator U does not have advanced knowledge, skill and authority as a doctor, or is a non-specialized medical treatment, but under the guidance of a professional doctor, the electronic stethoscope 1003 and the information management device It may be possible to operate 1100 and have the skill to perform simple diagnosis and treatment immediately at the clinical site 1001.
- an electronic stethoscope 1003 and an information management device 1100 that are operated by an operator U who is an advanced nurse (NP) or other medical staff are provided in the clinical site 1001 of the auscultation system 1200.
- a management server 1004 that manages the electronic medical records of each patient managed by the auscultation system 1200 is provided in the support center 1002 that is located away from the clinical site 1001.
- a doctor D having specialized knowledge and skills is stationed, and provides guidance to the operator U using an information processing terminal device or a communication device such as a telephone (not shown). Can support medical care.
- the body sound information directly collected from the patient P by the operator U using the electronic stethoscope 1003 is stored in the management server 1004 via the information management device 1100.
- the doctor D can access the management server 1004, acquire the body sound information of the patient P in a remote place, and conduct examination and treatment.
- the operator U can perform a simple treatment under the guidance of the doctor D, or can introduce other cooperative hospitals that can be handled when the medical treatment site 1001 cannot handle them.
- the body sound information collected from the electronic stethoscope 1003 needs to be managed together with the measurement position information indicating from which measurement position on the body surface of the patient P.
- the association between the body sound information and the measurement position information is Indispensable.
- the information management apparatus 1100 realized by a smartphone executes association between the body sound information and the measurement position information, and appropriately manages the information of the patient P.
- FIG. 9 is a block diagram illustrating a hardware configuration of the information management apparatus 1100 according to this embodiment.
- the information management apparatus 1100 includes at least a control unit 1010, an input unit 1011 or an operation unit 1013, a display unit 1012 or a projection unit 1014, a wireless communication unit 1016, an imaging unit 1017, and a storage unit 1019.
- the information management apparatus 1100 includes a communication unit 1015 and a voice input unit 1018, and an external interface, a voice output unit, a call processing unit, and a broadcast image receiving unit (not shown) in order to realize the functions inherent to the smartphone.
- Various components that are typically included in a smartphone such as a tuner / demodulator, GPS, and sensors (acceleration sensor, tilt sensor, etc.) may be provided.
- the input unit 1011 and the display unit 1012 are integrally formed to constitute a touch panel.
- the display unit 1012 may be realized by a liquid crystal display monitor, and the operation unit 1013 may be realized by a keyboard and a mouse instead of the input unit 1011. .
- the input unit 1011 is for inputting an instruction signal for the user to operate the information management apparatus 1100 via the touch panel.
- the input unit 1011 displays a touch surface that receives contact of an indicator (such as a finger or a pen), contact / non-contact (approach / non-approach) between the indicator and the touch surface, and a contact (approach) position thereof. It is comprised with the touch sensor for detecting.
- the touch sensor may be realized by any sensor as long as it can detect contact / non-contact between the indicator and the touch surface. For example, it is realized by a pressure sensor, a capacitance sensor, an optical sensor, or the like.
- the display unit 1012 displays information managed by the information management apparatus 1100, and displays an operation screen for a user to operate the information management apparatus 1100 as a GUI (Graphical User Interface) screen.
- the display unit 1012 is realized by a display device such as an LCD (Liquid Crystal Display).
- the operation unit 1013 is used by the user to directly input an instruction signal to the information management apparatus 1100.
- the operation unit 1013 is realized by an appropriate input mechanism such as a button, switch, key, or jog dial.
- the operation unit 1013 is a switch for turning on / off the power of the information management apparatus 1100 or a dial for adjusting enlargement / reduction of the projection image output from the projection unit 1014.
- the projection unit 1014 is a so-called projector that receives the video signal processed and output by the control unit 1010 and enlarges and projects it as an optical image.
- the projector may be built in the information management apparatus 1100.
- the projector may be realized as a separate device from the information management device 1100. In this case, the separate projector is connected to the information management device 1100 by wire or wirelessly, and a video signal is transmitted and received.
- the communication unit 1015 communicates with an external device via a communication network.
- the communication unit 1015 is connected to the management server 1004 of the support center 1002 (or the information terminal device (not shown) of the doctor D) via the communication network 1005, and between the information management device 1100 and the management server 1004. Realize data transmission and reception.
- the communication unit 1015 transmits / receives voice call data, e-mail data, and the like to / from other apparatuses via the mobile phone network. can do.
- the wireless communication unit 1016 communicates with an external device wirelessly.
- the wireless communication unit 1016 performs wireless communication with the electronic stethoscope 1003 and receives the biological sound information obtained by converting the biological sound collected by the electronic stethoscope 1003 into a digital signal from the electronic stethoscope 1003.
- the wireless communication unit 1016 is not particularly limited, but may realize any wireless communication means such as infrared communication such as IrDA and IrSS, Bluetooth (registered trademark) communication, WiFi communication, and a non-contact type IC card. However, a plurality of these means may be realized.
- the configuration of the wireless communication unit 1016 is not essential.
- the image capturing unit 1017 captures a still image or a moving image, and includes an appropriate image capturing mechanism including a lens and an image sensor.
- the imaging unit 1017 is realized by a CCD (Charge-Coupled Device) camera or a CMOS (Complementary Metal-Oxide-Semiconductor) camera, but other imaging devices may be used as the imaging unit 1017.
- CCD Charge-Coupled Device
- CMOS Complementary Metal-Oxide-Semiconductor
- the voice input unit 1018 receives voice input generated outside the information management apparatus 1100, and is realized by a microphone or the like.
- the voice input via the voice input unit 1018 may be voice-recognized and converted into an instruction signal for the information management apparatus 1100.
- the storage unit 1019 includes (1) a control program executed by the control unit 1010 of the information management apparatus 1100, (2) an OS program executed by the control unit 1010, and (3) various functions that the control unit 1010 has in the information management apparatus 1100. And (4) various data to be read when the application program is executed. Alternatively, (5) the control unit 1010 stores data used for calculation and calculation results in the course of executing various functions.
- the above data (1) to (4) include ROM (read only memory), flash memory, EPROM (Erasable Programmable ROM), EEPROM (registered trademark) (Electrically EPROM), HDD (Hard Disc Drive), etc. It is stored in a non-volatile storage device.
- the data (5) is stored in a volatile storage device such as a RAM (Random Access Memory). Which data is to be stored in which storage device is appropriately determined from the purpose of use, convenience, cost, physical restrictions, and the like of the information management device 1100.
- a volatile storage device such as a RAM (Random Access Memory).
- the body sound information of the patient P is stored in the storage unit 1019 realized by a nonvolatile storage device.
- the live view image captured by the imaging unit 1017 is temporarily stored in the storage unit 1019 realized by a volatile storage device.
- the control unit 1010 performs overall control of each unit included in the information management apparatus 1100.
- the control unit 1010 is realized by, for example, a CPU (central processing unit), and the function of the information management device 1100 is such that the CPU as the control unit 1010 reads a program stored in a ROM or the like into a RAM or the like. It is realized by executing.
- Various functions (especially information management functions) realized by the control unit 1010 will be described in detail below with reference to other drawings.
- FIG. 7 is a functional block diagram showing the main configuration of the information management apparatus 1100 according to this embodiment.
- control unit 1010 of the information management apparatus 1100 includes, as functional blocks, a patient information acquisition unit 1020, an auscultation support information selection unit 1021, an output control unit 1022, an event detection unit 1023, a body sound information acquisition unit 1024, and An information management unit 1025 is provided.
- Each functional block of the control unit 1010 described above is stored in a storage device (storage unit 1019) in which a CPU (central processing unit) or the like is realized by a ROM (read only memory), an NVRAM (non-Volatile random access memory), or the like. This can be realized by reading the program stored in a RAM (random access memory) or the like and executing it.
- a CPU central processing unit
- NVRAM non-Volatile random access memory
- the storage unit 1019 is a storage unit for reading or writing data when the above-described units of the control unit 1010 execute an information management function in the auscultation system.
- the storage unit 1019 includes at least an auscultation support information storage unit 1030.
- the storage unit 1019 may include a biological sound information storage unit 1031.
- the patient information acquisition unit 1020 acquires all information related to the patient that is input to the own device. All information related to the patient (hereinafter, simply referred to as patient information) is input via the operation unit 1013, the patient's still image and moving image captured by the imaging unit 1017, the patient information input via the input unit 1011. Information on the patient and the voice of the patient's own voice or the voice of the patient himself / herself inputted via the voice input unit 1018.
- the patient information (subject information) acquired by the patient information acquisition unit 1020 is supplied to the auscultation support information selection unit 1021.
- the patient information is referred to by the auscultation support information selection unit 1021 in order to select optimal auscultation support information.
- the auscultation support information selection unit 1021 selects auscultation support information suitable for the patient based on the patient information.
- the auscultation support information is information that is referred to when the operator U performs auscultation, and at least the measurement position information (which position on the patient's body surface) so that the operator U can perform appropriate auscultation according to the patient. Information indicating whether or not a stethoscope is applied.
- the auscultation support information may further include various information useful for the operator U to perform auscultation, such as an auscultation procedure and precautions during auscultation.
- the optimal auscultation content may vary from patient to patient. In particular, the measurement position information is considered to depend on patient attributes (particularly physique).
- the auscultation support information selection unit 1021 selects auscultation support information including information useful for optimal auscultation for the patient according to patient attributes. For example, the auscultation support information selection unit 1021 can select auscultation support information indicating measurement position information that matches the patient's physique.
- the auscultation support information is stored in advance in the auscultation support information storage unit 1030 in several patterns for each assumed patient attribute.
- the output control unit 1022 converts the auscultation support information selected by the auscultation support information selection unit 1021 into a video signal, and outputs the video signal to the video signal output unit.
- the video signal output unit is an appropriate output device that can process the video signal and display it so as to be visible to the operator U.
- the display unit 1012 and the projection unit 1014 are included in the video signal output unit. That is, the output control unit 1022 can output the auscultation support information to the display unit 1012 for display, or can output the auscultation support information to the projection unit 1014 for projection onto a screen or the like.
- the operator U can perform auscultation suitable for the patient by referring to the auscultation support information displayed on the display unit 1012 or the screen.
- the event detection unit 1023 monitors each part of the information management apparatus 1100 and detects an event occurring in the information management apparatus 1100. In the present embodiment, when the event detection unit 1023 detects an event that satisfies a specific condition, the event detection unit 1023 notifies the information management unit 1025 that the specific event has occurred.
- the event detected by the event detection unit 1023 is a trigger for the information management unit 1025 to store the biological sound information in the biological sound information storage unit 1031.
- a specific instruction signal is input via the operation unit 1013 in which a specific instruction signal is input through the input unit 1011 in which the imaging unit 1017 has captured a specific image.
- auxiliary information necessary for specifying the measurement position.
- the body sound information acquisition unit 1024 controls the wireless communication unit 1016 to acquire the body sound information of the patient received by the wireless communication unit 1016.
- the biological sound information acquisition unit 1024 converts the data format of the biological sound information into a format that can be handled by the information management unit 1025 or receives header information provided when the biological sound information is received, as necessary. Or the like may be converted into a format recognizable by the information management unit 1025, or appropriate information processing may be performed.
- the information management unit 1025 manages the acquired body sound information, and particularly links the body sound information with the measurement position information. Specifically, the information management unit 1025 specifies, for the body sound information acquired by the body sound information acquisition unit 1024, at which position on the patient body surface the body sound information is collected. . Then, the information management unit 1025 stores the measurement position information indicating the measurement position in the biological sound information storage unit 1031 in association with the biological sound information.
- the body sound information storage unit 1031 may store body sound information temporarily and in a nonvolatile manner. In this case, the body sound information stored in the body sound information storage unit 1031 is transferred to an external storage device by an information transfer control unit (information transfer control unit) (not shown) at an appropriate timing, or the management shown in FIG. Or transferred to the server 1004.
- an information transfer control unit information transfer control unit
- the information management unit 1025 can recognize that auscultation is being performed according to the auscultation support information while the auscultation support information is being output by the output control unit 1022. Specifically, since the measurement position information is included in the auscultation support information, the information management unit 1025 has the biological sound information at the position indicated by any of the measurement position information in the output auscultation support information. It can be grasped that it was collected. Furthermore, as described above, the information management unit 1025 can identify the measurement position by grasping the occurrence of a specific event detected by the event detection unit 1023.
- the information management unit 1025 performs electronic auscultation based on the content of the auscultation support information selected and output and the information acquired by using the occurrence of a specific event detected during the output of the auscultation support information.
- the measurement position information of the body sound information collected from the vessel can be specified, and the body sound information and the measurement position information can be linked.
- the auscultation support information selection unit 1021 selects auscultation support information according to patient attributes in the information management apparatus 1100 realized by a widely used apparatus such as a PC or a smartphone.
- the output control unit 1022 displays it so as to be visible to the operator U.
- the information management unit 1025 specifies the measurement position of the acquired body sound information based on the auscultation support information being output and the information acquired in response to a specific event that occurred during the output of the auscultation support information. .
- the information management unit 1025 can store the acquired body sound information and measurement position information in the body sound information storage unit 1031 in association with each other.
- the measurement using the electronic stethoscope is performed by the operator without using a special device that requires complicated operations, and the collected body sound information and The association with the measurement position information can be easily performed.
- the information management apparatus 1100 is realized by an apparatus (such as a smartphone) that includes a projection unit 1014 (projector function) and an imaging unit 1017. If such an information management apparatus 1100 is used to realize the information management function of the present invention, it is possible to receive many more advantages in addition to the effects described above.
- an information management apparatus 1100 is used to realize the information management function of the present invention, it is possible to receive many more advantages in addition to the effects described above.
- the auscultation system 1200 is realized using the imaging unit 1017 and the projection unit 1014 (projector function) of the information management apparatus 1100 will be described using a specific example.
- the patient information acquisition unit 1020 acquires patient information as a live view image captured by the imaging unit 1017.
- the imaging unit 1017 is activated, and the imaging unit 1017 starts imaging the patient.
- the operator U only needs to install the information management apparatus 1100 at an appropriate position so that the patient P is within the imaging range of the imaging unit 1017. According to the above configuration, the operator U is not required to manually input patient information, and there is an effect that complicated operations can be further reduced.
- FIG. 10 is a diagram illustrating an example of a live view image of the patient P captured by the imaging unit 1017.
- the patient image 1040 is an image obtained by imaging the front surface of the patient P
- the patient image 1041 is an image obtained by imaging the rear surface of the patient P.
- the operator U wants to auscultate the front surface of the patient P
- the operator U uses the information management device 1100 to photograph the front surface of the patient P.
- the patient information acquisition unit 1020 acquires the live view images sequentially supplied from the imaging unit 1017 and supplies them to the auscultation support information selection unit 1021.
- This live view image may be displayed on the display unit 1012 of the information management apparatus 1100.
- the auscultation support information selection unit 1021 has an image recognition function by controlling an image recognition processing unit (image recognition processing means) (not shown). Thereby, a patient's physique can be grasped
- the predetermined rule is, for example, that the patient always stands in front of a black board (any color is acceptable as long as the skin color can be reflected) and spreads his arms left and right as in chest X-ray photography. For example, decide to (hold the handrail). If a patient image taken according to such a rule is recognized as an image, the auscultation support information selection unit 1021 uses a line such as a patient's neck, shoulder, arm, armpit, and waist as a characteristic part without erroneous recognition. It becomes possible to extract accurately.
- the operator U inputs and designates whether to examine the patient's front surface or the back surface to the information management apparatus 1100 in advance when photographing the patient.
- the auscultation support information selection unit 1021 can extract a characteristic portion of the front surface of the upper body of the human body such as a collarbone, a rib, a nipple, and a navel as a characteristic portion.
- the auscultation support information selection unit 1021 can also extract characteristic parts of the back of the upper body of the person, such as the scapula and back muscles, as characteristic parts. Thereby, since the characteristic part which should be detected is restrict
- the auscultation support information selection unit 1021 detects all pre-defined feature parts in the live view image, and based on the detection result, the auscultation support information selection unit 1021 detects the patient. It may be determined whether the image is taken from the front or the back. For example, the auscultation support information selection unit 1021 may determine that the patient image 1040 in FIG. 10 is the front image based on the detection of the nipple and the navel. Alternatively, the auscultation support information selection unit 1021 may determine whether the face is the front or the back depending on whether the patient's face is recognized or whether the patient's hair color or skin color head is almost single color. Good. Thus, since the auscultation support information selection unit 1021 determines whether the front or the back is from the patient image, it is not necessary to manually specify whether the operator U is the front or the back, so that complicated operations can be further reduced. effective.
- the auscultation support information selection unit 1021 determines the physique of the patient based on the positional relationship between the extracted feature parts (distance between feature parts) and the distance between the imaging unit 1017 and the subject (here, patient P). presume.
- the auscultation support information selection unit 1021 determines, based on the patient image 1040 on the front surface of the patient, the size of a triangle having the vertices of both nipples and navels as vertices and the distance between the imaging unit 1017 and the subject It is possible to estimate the size, aspect ratio, height, and the like of the body.
- the auscultation support information selection unit 1021 estimates patient attributes. For example, the auscultation support information selection unit 1021 determines three items for the attributes of the patient P in the patient image 1040: (1) front, (2) height: 150 to 170 cm, and (3) body type: standard.
- the auscultation support information selection unit 1021 is configured to recognize a live view image acquired by the patient information acquisition unit 1020, but a patient image that is a still image captured by the imaging unit 1017 is used.
- the structure to process may be sufficient.
- the patient feels uncomfortable that the image captured by the imaging unit 1017 remains as data.
- the latest care must be taken when handling such personal information. Therefore, in consideration of the patient's feelings, the patient image data is configured so as to be acquired only so that the patient image data is not permanently stored in the device, or the patient image data is no longer necessary after use. Needs to be configured in the information management apparatus 1100 so as to be deleted immediately.
- the auscultation support information selection unit 1021 selects auscultation support information suitable for the attribute based on the determined patient attribute.
- the auscultation support information storage unit 1030 stores some auscultation support information according to the orientation of the patient (front or back) and the patient's physique.
- the auscultation support information selection unit 1021 selects and reads the auscultation support information associated with the orientation and physique of the patient determined as described above from the auscultation support information storage unit 1030.
- FIG. 11 is a diagram showing a specific example of the data structure of the auscultation support information database stored in the auscultation support information storage unit 1030.
- auscultation support information is stored in association with each patient attribute, that is, for each direction, height, and body type.
- the auscultation support information database shown in FIG. 11 as a table format data structure is an example, and there is no intention to limit the data structure of the auscultation support information database.
- the auscultation support information selection unit 1021 can recognize the correspondence between patient attributes and auscultation support information to be selected, the auscultation support information database may have any data structure. This is the same in any of the following embodiments.
- the auscultation support information selection unit 1021 determines from the patient image 1040 that the patient attribute is front, 150 to 170 cm, and standard, the auscultation support information “Temp027” that matches this attribute is displayed. select.
- the auscultation support information of the selected “Temp027” includes information that is optimal and useful for auscultating the patient P in the patient image 1040.
- FIG. 12 is a diagram showing a specific example of the auscultation support information stored in the auscultation support information storage unit 1030.
- the auscultation support information of Temp027 in FIG. 12 indicates auscultation support information selected by the auscultation support information selection unit 1021 as a result of the image recognition processing of the patient image 1040.
- the auscultation support information of Temp127 indicates auscultation support information selected by the auscultation support information selection unit 1021 as a result of the image recognition processing of the patient image 1041.
- the auscultation support information is image data
- the measurement position information is defined using the contour 1060 of the patient's body and the characteristic part of the patient's body as reference positions.
- the characteristic portion may be expressed by a reference point 1061 or the like, or may be expressed by a reference line 1062 or the like.
- At least the measurement position information is represented by a mark arranged with reference to the contour 1060 of the patient's body, the reference point 1061, and / or the reference line 1062.
- a circle is measurement position information.
- the auscultation support information may include measurement order information that specifies the order in which auscultation is performed.
- the measurement order information is expressed by an arrow connecting the circles and the circles, or is expressed by a number given to each circle.
- the measurement order information expressed by numbers assigned to individual circles can be used as measurement position identification information for individually identifying the measurement positions.
- the operator U can understand which position of the patient P should be applied with the electronic stethoscope 1003 in which order by viewing the auscultation support information.
- the auscultation support information is assumed to be an image, but the data format of the auscultation support information in the present invention is not particularly limited.
- the auscultation support information may simply be position information (coordinate information) in a predetermined coordinate system. For example, it is conceivable to express the measurement position information as an X coordinate value and a Y coordinate value with the origin (0, 0) between the nipples.
- the output control unit 1022 functions as a projection control unit that outputs the video signal of the selected auscultation support information to the projection unit 1014 and enlarges and projects it onto the external light receiving unit.
- the output control unit 1022 may output an auscultation support information image as shown in FIG. 12 as it is as a projection image.
- the output control unit 1022 may generate the projection image by superimposing the measurement position information (and measurement order information) in the auscultation support information on the patient image acquired by the patient information acquisition unit 1020.
- FIG. 13 is a diagram illustrating a specific example of the projection image generated by the output control unit 1022.
- the auscultation support information selection unit 1021 selects the auscultation support information of Temp027 in FIG. 12 based on the patient image 1040 in FIG.
- the output control unit 1022 superimposes the measurement position information (circle) included in the auscultation support information of Temp027 on the image of the patient image 1040.
- the output control unit 1022 may further superimpose measurement order information (numbers given to circles, arrows, and the like) included in the auscultation support information.
- the output control unit 1022 determines the superimposed position where the contour 1060, the reference point 1061, or the reference line 1062 of the auscultation support information matches the patient image of the patient image 1040 as much as possible, thereby measuring position information (circle). Can be correctly superimposed on the body surface of the patient P in the patient image 1040.
- the output control unit 1022 generates the projection image 1043 as shown in FIG.
- the projection image 1043 is generated by superimposing the measurement position information and measurement order information of the auscultation support information of Temp027 on the patient image 1040.
- the video signal of the projection image (auscultation support information itself or a generated image such as the projection image 1043) is output from the output control unit 1022 to the projection unit 1014.
- the projection unit 1014 enlarges and projects the received video signal onto the light receiving unit (wall, screen, etc.).
- the operator U can understand where the electronic stethoscope 1003 should be applied according to the physique of the patient P by visually recognizing the projection image. Further, when the measurement order information is included in the projection image, the operator U can understand in which order the electronic stethoscope 1003 should be applied.
- the operator U is more than when Temp027 shown together with the model is output.
- the measurement position on the body surface of the patient P can be grasped more accurately.
- FIGS. 14 to 16 are diagrams for explaining usage patterns in which a projection image is projected onto the actual body of the patient P.
- the operator U adjusts the distance and orientation between the patient P and the information management device 1100 so that the optical image output from the projection unit 1014 is projected onto the patient P.
- an installation table 1050 may be provided, and an information management apparatus 1100 as a projector may be fixedly installed on the installation table 1050.
- the operator U may adjust the magnification of the projection image via the operation unit 1013 (such as a dial) or the input unit 1011 of the information management apparatus 1100.
- the operator U may operate the operation unit 1013 to reduce the magnification of the projection image until the contour of the projection image 1043 matches the actual contour of the patient P's body.
- the most preferable projection state is a state in which the contour of the projected image 1043 matches the actual contour of the patient P's body.
- the operator U can intuitively grasp the measurement position based on the measurement position information projected on the body surface of the patient P.
- the inconvenience that the operator U has the wrong measurement position and order can be avoided. It becomes possible. Therefore, auscultation failures due to erroneous operations can be greatly reduced.
- the projected auscultation support information is information that matches the patient's physique
- the projected measurement position can also more accurately reproduce the location of the patient to be auscultated.
- the information management apparatus 1100 of the present invention displays measurement position information suitable for the patient's physique on the patient's body surface, and the operator U can intuitively grasp the measurement position. Therefore, even if the operator U does not have medical knowledge, there is an effect that the operator U can perform auscultation correctly.
- the operator U does not perform auscultation from a position facing the patient P, but extends his hand from the position on the side of the patient P, and electronically moves to the measurement position.
- Auscultation should be performed with a stethoscope 1003 applied. Patients who undergo auscultation often suffer from diseases such as respiratory infections that can be splashed by cough. Therefore, it is recommended that the auscultator perform auscultation from the side of the patient when auscultating the front of the patient so that the patient does not cough.
- the auscultation form of the present invention is not inconsistent with the recommended auscultation form.
- the information management unit 1025 grasps the measurement position information and measurement order information of the auscultation support information output from the output control unit 1022, thereby measuring the measurement position of the body sound information collected by the electronic stethoscope 1003. And measurement position information can be linked and managed. Specifically, association is performed according to the following procedure.
- the electronic stethoscope 1003 collects a continuous sound waveform for one measurement position, and transfers the biological sound information of one file to the information management apparatus 1100 for one measurement position. It is. In this embodiment, the electronic stethoscope 1003 transfers biological sound information to the information management apparatus 1100 online in real time from the start to the end of sound waveform collection.
- the event detection unit 1023 detects the start of reception of biological sound information as a specific event via the wireless communication unit 1016.
- the information management unit 1025 acquires information (auxiliary information) necessary for specifying the measurement position in the started auscultation using the occurrence of the event as a trigger. Specifically, since the output control unit 1022 outputs a projection image (for example, the projection image 1043 in FIG. 13), it is determined what number of file reception has been received. This is acquired as auxiliary information.
- the information management unit 1025 displays the first file (body sound information). Is determined to have been started.
- the information management unit 1025 refers to the auscultation support information output by the output control unit 1022.
- the first body sound information from which reception has started is collected at the position of the measurement position (number 1 in the circle in the example shown in FIG. 12) where the measurement order information is number 1. Is specified.
- the information management unit 1025 associates the body sound information with the measurement position information “1” specified as described above, and the body sound.
- the information is stored in the information storage unit 1031.
- FIG. 17 is a diagram illustrating a specific example of measurement position information and biological sound information stored in the biological sound information storage unit 1031.
- the plurality of body sound information is shown as an example of a data structure in a table format.
- the biological sound information may be stored in any data structure as long as the information management apparatus 1100 can recognize the association between the measurement position information and the biological sound information. This is the same in any of the following embodiments.
- the information management unit 1025 stores the biological sound information of one file in the biological sound information storage unit 1031 for one measurement position.
- the information management unit 1025 stores the measurement position information specified as described above in association with the biological sound information.
- the file name given to the body sound information is not particularly limited, for example, it is preferable to give a file name that indicates which auscultation support information is based on auscultation support information.
- the body sound information in which the measurement name information “1” is associated with the file name “Temp027_1.wav” is the body sound information at the position of the circle 1 in the auscultation support information of Temp027. Be recognized.
- the information management unit 1025 may store other information such as patient information and measurement date in association with biological sound information.
- the biological sound information stored in the biological sound information storage unit 1031 by the information management unit 1025 is transferred to, for example, the management server 1004 by an information transfer control unit (not shown).
- the management server 1004 can receive and store the body sound information together with the measurement position information. Therefore, if a doctor D who is not present at the clinical site 1001 accesses the management server 1004, the doctor D can understand which measurement position of the patient the sound is and reproduce the body sound information.
- FIG. 18 is a flowchart showing a flow of information management processing performed by the information management apparatus 1100.
- the operator U operates the information management apparatus 1100 (for example, touches an icon) to start an application related to an electronic stethoscope.
- the imaging unit 1017 captures a live view image.
- the operator U adjusts the direction of the information management apparatus 1100 so that the upper body of the patient P is captured in the imaging range of the imaging unit 1017.
- the patient information acquisition unit 1020 acquires a live view image (patient image showing a patient) captured by the imaging unit 1017 (S102).
- the auscultation support information selection unit 1021 performs an image recognition process on the acquired patient image, and detects a characteristic part necessary to determine patient attributes (S103). Here, based on the detected characteristic part, it may be determined whether the patient attribute, that is, whether the image is a front image or a back image of the patient.
- image recognition was successful when the necessary features were detected and the patient's orientation (front or back) was determined. If the image recognition is not successful (NO in S104), the imaging unit 1017 continues shooting until necessary information appears in the live view image (S102).
- the auscultation support information selection unit 1021 estimates the remaining patient attributes (S105). Specifically, the height, body shape, etc. of the patient are estimated based on the detected characteristic part. Then, the auscultation support information selection unit 1021 selects auscultation support information suitable for the patient from the auscultation support information storage unit 1030 based on the estimated orientation, height, and body shape of the patient (S106).
- the output control unit 1022 generates a video signal of the projection image based on the auscultation support information selected by the auscultation support information selection unit 1021, and outputs the video signal to the projection unit 1014 (S107).
- the light of the video signal output from the projection unit 1014 is projected onto the body surface of the patient P.
- the operator U installs the information management device 1100 such that the human-shaped contour of the projection image matches the size of the actual patient P, The direction and the magnification of the projection unit 1014 are adjusted.
- the operator U performs auscultation using the electronic stethoscope 1003 according to the measurement position information and measurement order information projected on the patient P's body.
- the information management unit 1025 acquires auxiliary information necessary for specifying the measurement position of the biological sound information collected at this time (S109). Specifically, for example, the event detection unit 1023 detects that the biological sound information is received from the electronic stethoscope 1003 as a specific event (S108). Then, the information management unit 1025 specifies how many times the biological sound information is the biological sound information received since the projection image was output in S107, and uses this as auxiliary information (S109). .
- the information management unit 1025 specifies the measurement position of the biological sound information collected at this time based on the number of receptions of the biological sound information and the auscultation support information currently being output (S110). For example, if the number of receptions is 0, the measurement position of the body sound information received for the first time can be specified as the first measurement position in the auscultation support information.
- the information management unit 1025 associates the measurement position information of the specified measurement position with the received body sound information and stores it in the body sound information storage unit 1031 (S111).
- the event detection unit 1023 waits for the next body sound information to be received.
- the information management apparatus 1100 may end a series of information management processes.
- an information transfer control unit (not shown) transfers the body sound information stored by the information management unit 1025 to the management server 1004 in the support center 1002 in a state where the measurement position information is linked. Also good.
- the auscultation support information selection unit 1021 selects auscultation support information according to patient attributes (physique of the patient) in the information management apparatus 1100 realized by a widely used apparatus such as a PC or a smartphone. To do.
- the output control unit 1022 displays it so as to be visible to the operator U. Specifically, the projection is performed so as to match the size on the body surface of the patient P.
- the information management unit 1025 specifies the measurement position of the acquired body sound information based on the auscultation support information being projected and the information acquired in response to a specific event that occurred during the projection of the auscultation support information. .
- the information management unit 1025 can store the acquired body sound information and measurement position information in the body sound information storage unit 1031 in association with each other.
- the operator U does not need to perform a complicated input operation in order to select optimal auscultation support information, and only needs to place the patient within the imaging range of the imaging unit 1017.
- the auscultation support information is displayed on the body surface of the patient P in the same size, the operator U can perform auscultation more accurately without mistaking the measurement position and the measurement order.
- the information management unit 1025 of the information management device 1100 specifies the measurement position of the biological sound information based on the measurement position information included in the auscultation support information being output and the number of receptions of the biological sound information.
- the information management unit 1025 can store the body sound information in the storage unit in association with the measurement position information of the specified measurement position.
- the measurement using the electronic stethoscope is performed by the operator without using a special device that requires complicated operations, and the collected body sound information and The association with the measurement position information can be easily performed.
- the output control unit 1022 in the present embodiment further notifies the operator U to change the range captured by the imaging unit 1017 so that a live view image can be obtained by which the auscultation support information selection unit 1021 can estimate the patient's physique.
- the structure which performs this may be sufficient.
- FIG. 19 is a diagram illustrating an example in which a screen for notifying that the shooting range is to be changed is displayed on the display unit 1012.
- the output control unit 1022 displays the live view image currently acquired by the patient information acquisition unit 1020 on the display unit 1012. Subsequently, when a necessary characteristic portion is not detected from the live view image, for example, a case where the contour of the patient P is not captured as illustrated in FIG. 19 is assumed. In this case, the output control unit 1022 determines that the image recognition has not been successful, and causes the display unit 1012 to display a message notifying the operator U to change the shooting range, as illustrated in FIG.
- the operator U can quickly respond so that an appropriate live view image can be obtained.
- the auscultation support information selection unit 1021 selects auscultation support information for the patient for the front side and the back side, respectively. In order to select auscultation support information, the auscultation support information selection unit 1021 performs image recognition processing with a relatively high load. Such high-load processing is preferably reduced as much as possible.
- the operator U may provide a rule that imaging is always performed from the front of the patient. Then, when the first patient image is input for the patient, the auscultation support information selecting unit 1021 immediately detects the front feature portion on the assumption that the patient image is the front patient image. There may be. Then, the auscultation support information selection unit 1021 can immediately detect the feature portion of the back surface on the premise that the patient image input for the second time is the patient image on the back surface.
- the front patient image has more distinct features (such as nipples and navels) than the back patient image, and the physique of the patient can be estimated at high speed with a lower load process.
- the auscultation support information selection unit 1021 immediately estimates the patient's physique based on the patient image that is assumed to be the front, selects the matching auscultation support information for the front, and sets the estimated physique The matching back auscultation support information may be selected together.
- the back side is integrated with the front side and the back side, and the size itself does not change in the same patient. Therefore, the auscultation support information selection unit 1021 may select the back auscultation support information based on the patient's physique estimated based on the front patient image. As a result, the auscultation support information selection unit 1021 can correctly select auscultation support information suitable for the patient for both the front side and the back side even if the entire image recognition process for the patient image on the back side is omitted.
- the information management unit 1025 is configured to specify the measurement position of the biological sound information based on the event that the biological sound information is acquired.
- the information management unit 1025 is not limited to this configuration, and may be a configuration in which a measurement position where biological sound information is to be collected next is designated in advance and presented to the operator U.
- the information management unit 1025 When the specific auscultation support information is output from the output control unit 1022, the information management unit 1025 first determines that the measurement should be started from the measurement position where the measurement order information is the first. Then, the information management unit 1025 instructs the output control unit 1022 to highlight the measurement position information whose measurement order information is No. 1.
- the output control unit 1022 outputs auscultation support information and highlights only the measurement position information designated by the information management unit 1025. For example, the output control unit 1022 can display the specified measurement position information by placing the cursor on it, blink the designated measurement position information, display it in an enlarged manner, or display it in a different color. The operator U can recognize that the highlighted measurement position is a place where he / she next applies a stethoscope.
- the information management unit 1025 completes the auscultation of the first measurement position, and then highlights the second measurement position information. It can be determined that it should be done. At this time, the information management unit 1025 instructs the output control unit 1022 to highlight the second measurement position information instead of the first.
- the information management unit 1025 detects the start or end of auscultation at each measurement position, and detects an event that the event detection unit 1023 has started receiving biological sound information or an event that has been received. The example to do was demonstrated.
- the method by which the information management unit 1025 determines the start or end of auscultation is not limited to the above.
- the operator U flicks the touch panel of the information management apparatus 1100 when starting or ending one auscultation.
- the event detection unit 1023 detects that the touch panel is flicked through the input unit 1011 as an event. Then, the information management unit 1025 can determine the start or end of one auscultation.
- the electronic stethoscope 1003 is provided with a button for inputting start or end of auscultation, and when the operator U starts or ends one auscultation, the button of the electronic stethoscope 1003 is provided. It is conceivable to press.
- the event detection unit 1023 detects, as an event, that the button of the electronic stethoscope 1003 has been pressed via the wireless communication unit 1016. Then, the information management unit 1025 can determine the start or end of one auscultation.
- a contact sensor is provided on the auscultation surface in contact with the patient's body surface of the electronic stethoscope 1003, and the sensor may detect whether the electronic stethoscope 1003 is in contact with or away from the patient's body surface. It is done.
- the event detection unit 1023 detects a time point when the electronic stethoscope 1003 is in contact with and a time point when the electronic stethoscope 1003 is separated via the wireless communication unit 1016. Thereby, the information management unit 1025 can determine the start or end of one auscultation.
- the sensor of the electronic stethoscope 1003 may detect whether the sensor is stationary on the patient body surface or moving on the patient body surface to the next measurement position.
- the event detection unit 1023 detects, via the wireless communication unit 1016, the time when the electronic stethoscope 1003 starts to stop, the time when the movement stops and the movement starts, the time when the movement ends and the movement stops, and so on. Thereby, the information management unit 1025 can determine that one stop is one auscultation.
- the imaging unit 1017 may be configured to capture the front or back surface of the patient P onto which the projection image 1043 output from the projection unit 1014 is projected.
- the live view image acquired by the imaging unit 1017 is image-recognized by an image recognition processing unit (not shown).
- the event detection unit 1023 moves from the state where the electronic stethoscope 1003 is stationary for a predetermined time or the state where the electronic stethoscope 1003 is stationary to the next location. Is detected as an event.
- the information management unit 1025 can determine that one stop is one auscultation.
- the auscultation support information stored in the auscultation support information storage unit 1030 may include measurement position identification information instead of the measurement order information.
- the measurement position identification information is an ID for identifying each piece of measurement position information included in the auscultation support information, and is given for each measurement position information.
- the measurement position information is a circle arranged based on the contour 1060, the reference point 1061, the reference line 1062, and the like. It may be an alphabet uniquely assigned to the circle.
- the output control unit 1022 may generate a projection image by superimposing the auscultation support information as described above on the patient image shown in FIG.
- FIG. 20 is a diagram illustrating another specific example of the projection image generated by the output control unit 1022.
- the auscultation support information includes measurement position information represented by a circle and measurement position identification information (alphabet) given to each measurement position information.
- the output control unit 1022 superimposes the auscultation support information selected by the auscultation support information selection unit 1021 on the patient image 1040 (FIG. 10) acquired from the imaging unit 1017 to generate a projection image 1044 shown in FIG. 20. be able to.
- the measurement order information is not specified, so that the operator U can perform auscultation in any order from any measurement position. Become. That is, the degree of freedom of the auscultation procedure is improved for the operator U.
- the information management unit 1025 associates the measurement position information with the body sound information by a method different from the above. It must be made.
- FIG. 21 is a diagram showing the external appearance of an electronic stethoscope 1003 used in this modification.
- the electronic stethoscope 1003 includes an operation button 1051 and a display unit 1052.
- the operation button 1051 is an operation for the operator U to input to the electronic stethoscope 1003 and specify which measurement position of the auscultation support information output by the information management apparatus 1100 is to be auscultated. Button.
- the display unit 1052 displays measurement position identification information corresponding to the measurement position selected by the operator U.
- the auscultation support information output by the output control unit 1022 of the information management device 1100 is transmitted from the information management device 1100 to the electronic stethoscope 1003 via the wireless communication unit 1016.
- the electronic stethoscope 1003 outputs the measurement position information included in the received auscultation support information as an option to the operator U.
- the operator U when the auscultation support information shown in FIG. 20 is received, the operator U presents eight options A to H as selectable measurement position information. For example, each time the operation button 1051 is pressed, the measurement position identification information displayed on the display unit 1052 is switched to A, B, C,. The operator U performs auscultation and collects body sound information in a state where the measurement position identification information corresponding to the measurement position to be measured is displayed on the display unit 1052.
- the operator U applies the electronic stethoscope 1003 to the measurement position where the measurement position identification information in FIG.
- the electronic stethoscope 1003 associates the measurement position identification information “D” with the collected body sound information and transmits the body sound information to the information management apparatus 1100.
- the information management apparatus 1100 receives the measurement position identification information “D” and the biological sound information via the wireless communication unit 1016.
- the event detection unit 1023 detects an event for which body sound information is received as a specific event.
- the information management unit 1025 uses the detection of this event as a trigger to acquire auxiliary information necessary for specifying the measurement position, that is, here, measurement position identification information “D” received together with the body sound information.
- the information management unit 1025 uses the received body sound information and the measurement position identification information “D”. Corresponding measurement position information can be associated and managed.
- the information management unit 1025 associates the collected body sound information with the measurement position from which the sound is collected. Can be managed. According to the above configuration, since the measurement order is not designated by the measurement order information, the operator U can perform auscultation in any order from any measurement position. That is, the degree of freedom of the auscultation work is improved for the operator U.
- the information management unit 1025 compares the timing of receiving the body sound information with the measurement order information of the auscultation support information in order to specify the measurement position of the received body sound information.
- the configuration is such that the identification information associated with the received body sound information is referred to.
- the configuration of the information management unit 1025 is not limited to the above.
- the information management unit 1025 can specify the measurement position of the received biological sound information by analyzing the video while the operator U is auscultating the patient P.
- FIG. 22 is a functional block diagram showing the main configuration of the information management apparatus 1100 according to this embodiment.
- the information management apparatus 1100 of this embodiment shown in FIG. 22 is different from the information management apparatus 1100 of Embodiment 2-1 shown in FIG. 7 in that the information management unit 1025 of the control unit 1010 further includes a measurement position information generation unit. 1026.
- the CPU or the like reads the program stored in the storage device (storage unit 1019) realized by ROM, NVRAM, or the like into the RAM or the like. It is a functional block that can be realized by execution.
- the imaging unit 1017 is configured to capture the state of the patient P when the operator U is auscultating the patient P.
- Auscultation support information may be configured to be projected onto the body surface of the patient P, may be configured to be projected onto another light receiving unit, or may be configured to be displayed on another display unit.
- the imaging unit 1017 captures a patient image of the patient P undergoing auscultation.
- FIG. 23 is a diagram showing a specific example of a patient image 1045 at the time of auscultation photographed by the imaging unit 1017 in the present embodiment.
- the patient image 1045 shows that the operator U is placing the electronic stethoscope 1003 on a predetermined measurement position. If the auscultation support information is projected onto the body surface of the patient P, the projected auscultation support information is shown together. It is preferable that the operator U performs auscultation at a position where these subjects are not hidden from the imaging unit 1017 as much as possible so that the contact position between the patient P and the electronic stethoscope 1003 is clearly captured (for example, FIG. 16). ).
- the event detection unit 1023 detects that a measurement is started for one measurement position or is being measured as a specific event.
- the event detection unit 1023 may detect the event based on a signal during auscultation start or during auscultation transmitted from the electronic stethoscope 1003 to the wireless communication unit 1016.
- the event detection unit 1023 may detect an auscultation start or an auscultation event based on the result of image recognition processing of a live view image (for example, a patient image 1045) acquired by the imaging unit 1017.
- the measurement position information generation unit 1026 of the information management unit 1025 acquires a frame at the time when a specific event is detected by the event detection unit 1023 in the live view image.
- the frame is an image showing the state at the time when the body sound information is collected (position of the electronic stethoscope 1003), and the frame is auxiliary information necessary for specifying the measurement position.
- the measurement position information generation unit 1026 is necessary to specify the measurement position of the frame (for example, the patient image 1045 in FIG. 23) at the time when the event is detected among the live view images acquired by the imaging unit 1017. Is acquired as auxiliary information.
- the information management unit 1025 adopts the patient image 1045 acquired by the measurement position information generation unit 1026 as measurement position information as it is, and manages this in association with the body sound information received from the start of the event. be able to.
- the body sound information is stored in the body sound information storage unit 1031 in association with the patient image in which the position of the electronic stethoscope 1003 when the sound is collected is linked. Therefore, even when the doctor D reads the body sound information later, the doctor D can know at which measurement position the sound is collected based on the associated patient image.
- the operator U may operate the information management apparatus 1100 so as to record the state of auscultation at all measurement locations when starting auscultation using the electronic stethoscope 1003.
- the operator U touches a recording start button displayed on the window of the electronic stethoscope application when starting auscultation.
- the imaging unit 1017 starts video recording.
- the measurement position information generation unit 1026 may cut out a video frame at the time when the event detection unit 1023 detects the auscultation start timing for each measurement position as measurement position information.
- the measurement position information generation unit 1026 of the information management unit 1025 specifies the measurement position from the acquired patient image 1045 by image recognition processing, and does not adopt the patient image 1045 as it is and specifies the measurement. It is preferable to convert into measurement position information or measurement position identification information representing the position.
- the measurement position information generation unit 1026 controls an image recognition processing unit (not shown) to recognize in the patient image 1045 where the electronic stethoscope 1003 is located in the auscultation support information. For example, the measurement position information generation unit 1026 compares the patient image 1045 with the auscultation support information shown in FIG. 20, and places the electronic stethoscope 1003 at the position indicated by the circle with the measurement position identification information “C”. Can be recognized as hitting. Therefore, the measurement position information generation unit 1026 specifies the measurement position not by the patient image 1045 itself but by measurement position information (such as coordinate values) to which measurement position identification information “C” or “C” is assigned. What is necessary is just to produce
- auxiliary information auxiliary information
- the information management unit 1025 can specify the measurement position based on the auxiliary information.
- the information management unit 1025 specifies the measurement position information specified based on the auxiliary information generated or acquired as described above by the measurement position information generation unit 1026 with respect to the body sound information received at the timing when the patient image 1045 is acquired. (Or auxiliary information itself) is linked and managed.
- the doctor D reads the biological sound information later, based on the measurement position information (or measurement position identification information) associated with the measurement position, the sound is collected at which measurement position. It becomes possible to know.
- the measurement position information generation unit 1026 quickly deletes the patient image 1045 used for specifying the measurement position. It is preferable.
- the measurement position information generation unit 1026 recognizes the patient image 1045 and identifies the measurement position, and then generates a model image in which the identified measurement position is clearly shown without using the patient image 1045 as it is. May be.
- FIG. 24 is a diagram illustrating a specific example of the model image indicating the measurement position generated by the measurement position information generation unit 1026.
- the model image 1046 includes information indicating a reference position, that is, a human body outline 1060, a reference point 1061, a reference line 1062, and the like.
- the model image 1046 includes measurement position information 1063 that clearly indicates the measurement position.
- the model image 1046 includes all the measurement position information specified by the auscultation support information, but the measurement position information 1063 that clearly indicates the measurement position is highlighted.
- the measurement position information 1063 is represented by a color different from other measurement position information.
- the measurement position information generation unit 1026 may generate only the measurement position information that clearly indicates the measurement position, and may generate the model image 1046 so as not to represent the remaining measurement position information.
- the information management unit 1025 associates and manages the model image 1046 generated as described above by the measurement position information generation unit 1026 with respect to the body sound information received at the timing when the patient image 1045 is acquired.
- the doctor D can know at which measurement position the sound is collected based on the associated model image.
- the present embodiment aims to further simplify the configuration and operation of the information management apparatus 1100 by omitting the configuration for projecting auscultation support information onto the patient P by the projection unit 1014.
- the output control unit 1022 outputs the auscultation support information selected by the auscultation support information selection unit 1021 to the display unit 1012 of the own apparatus instead of the projection unit 1014. That is, in the present embodiment, the output control unit 1022 functions as a display control unit that controls the content displayed on the display unit 1012.
- the operator U confirms the auscultation support information displayed on the display unit 1012, grasps the approximate measurement position and the order of those measurements, Can undergo auscultation.
- the information management apparatus 1100 manages the association between the measurement position and the biological sound information.
- the configuration and operation of the information management apparatus 1100 are omitted by omitting the configuration of “photographing the patient, estimating the physique of the patient, and strictly selecting auscultation support information that matches the physique of the patient”. Can be further simplified.
- the patient information acquisition unit 1020 acquires not the patient image but the information input by the operator U or the information stored in advance in the management server 1004 as the patient information.
- the patient information acquired by the patient information acquisition unit 1020 includes information indicating whether the patient to be auscultated from now on is front or back, information indicating what medical condition of the patient is being examined, patient history, Age, gender, height, weight, etc.
- the auscultation support information storage unit 1030 stores several patterns of auscultation support information according to the above-described patient information (or patient attributes specified based on the patient information).
- the auscultation support information selection unit 1021 selects patient information acquired by the patient information acquisition unit 1020 or auscultation support information that matches the patient attributes specified based on the patient information.
- the output control unit 1022 outputs the auscultation support information selected by the auscultation support information selection unit 1021 not to the projection unit 1014 but to the display unit 1012 of its own device. For example, the output control unit 1022 generates and displays these video signals to display the auscultation support information (Temp027 and Temp127), the projection image 1043, and the projection image 1044 shown in FIG. 12 on the display unit 1012. Output to the unit 1012.
- the high load processing such as the image recognition function and the projector function can be omitted to simplify the configuration of the information management device 1100, and substantially the same effects as those of the above embodiments can be obtained. It is possible.
- the same effect means that, without using a special device that requires complicated operation, the operator performs measurement using an electronic stethoscope, and the collected body sound information and its measurement position information This is an effect that it is possible to easily perform the association.
- the information management apparatus 1100 of the present invention can be realized by various information processing apparatuses.
- the information management apparatus 1100 of the present invention includes a personal computer (PC), an AV device such as a digital TV, a notebook computer, a tablet PC, a mobile phone, a PDA (Personal Digital Assistant), a digital camera, It can be applied to a digital video camera.
- the information management unit 1025 in Embodiments 2-1 to 2-3 described above further performs auscultation on the spot.
- the configuration may also be such that the input information input by the operator U in relation to the body sound information is associated.
- the operator U performs auscultation using the electronic auscultation device 1003 according to the auscultation support information. Since the operator U is listening to the collected body sound information on the spot, there may be a case where the sound can be diagnosed to some extent.
- the operator U operates the electronic stethoscope 1003 or the information management device 1100 to collect the collected biological sound. Check to indicate that the information contains sounds of interest.
- the information management unit 1025 uses the sound that is of interest to the body sound information acquired at that time. Input information (such as a flag) indicating the presence is associated and stored in the body sound information storage unit 1031.
- the doctor D at a remote location accesses the management server 1004 and reproduces the body sound information included in the electronic medical record.
- the management server 1004 displays a mark indicating that the operator U who collected this sound is interested based on the input information associated with the body sound information.
- it is possible to present to the doctor D by giving a noticeable color to the measurement position of the sound.
- the management server 1004 may output a warning sound indicating that the operator U is interested in the sound just before reproducing the body sound information.
- the doctor D when the doctor D views the body sound information, the doctor D is alerted that “the sound is anxious”. Thereby, the consciousness that the doctor D listens to the body sound information more carefully works. As a result, it is possible to reduce the probability that the doctor D who makes the final diagnosis overlooks an abnormality in the case where the remote doctor D performs the final diagnosis because the medical experience of the operator U is shallow. .
- Embodiment 3 Another embodiment of the present invention will be described below with reference to FIG.
- members having the same functions as those in the drawings described in the above-described embodiments are denoted by the same reference numerals and description thereof is omitted.
- Patent Document 5 when creating a medical image, after acquiring image data in which a predetermined part of a living body is imaged, body sound measurement is performed on the imaged part, and the results are associated with each other. A medical image display system for displaying medical images is described.
- a measurement system for performing medical image photographing will be described in consideration of the biological sound measurement result obtained by performing the biological sound measurement.
- FIG. 25 is a block diagram illustrating an outline of a measurement system 3600 according to the third embodiment and a configuration of main parts of an image capturing device 3006 constituting the measurement system 3600.
- the measurement system 3600 includes at least an electronic stethoscope 1003 and an image capturing device 3006. Furthermore, the measurement system 3600 may include the above-described auscultation system 1200 (FIG. 8) as necessary. That is, the electronic stethoscope 1003 and the image capturing device 3006 in the third embodiment can be connected to various devices in the auscultation system 1200 in the above-described second embodiment so as to communicate with each other as necessary. Is possible.
- the electronic stethoscope 1003 collects body sound information of the patient P.
- the electronic stethoscope 1003 functions as part of the auscultation system 1200 shown in FIG.
- the image imaging device 3006 captures the patient P using an appropriate imaging unit and acquires image data.
- the image data acquired by the image capturing device 3006 is used as a medical image by the operator U or the doctor D.
- the image capturing apparatus 3006 is linked to the auscultation system 1200 shown in FIG.
- the image capturing apparatus 3006 can select and execute an optimal image capturing process for the patient P in consideration of the auscultation result of the patient P derived by the auscultation system 1200.
- the image capturing device 3006 includes a communication unit 3011 that transmits and receives information to and from each device of the auscultation system 1200, a storage unit 3012 that stores various types of information processed by the image capturing device 3006, and a patient.
- the image capturing unit 3013 that performs the above shooting and the control unit 3010 that controls each unit of the image capturing apparatus 3006 are configured.
- the communication unit 3011 communicates with each device of the auscultation system 1200 and receives the auscultation result of the patient P derived by the auscultation system 1200.
- the storage unit 3012 stores, for example, image data captured by the imaging unit 3013, and stores analysis result information d1 and part information d2 acquired by the communication unit 3011.
- the imaging unit 3013 is not limited to this.
- the imaging unit 3013 may be a living body using appropriate means such as X-ray, CT (Computed Tomography), MRI (Magnetic Resonance Imaging), magnetic measurement, bioelectric signal, ultrasound, or light.
- Image may include a positioning mechanism that arranges the image sensor unit at an appropriate site in order to image a desired site of the patient P.
- the control unit 3010 includes an auscultation result acquisition unit 3020, an imaging site identification unit 3021, and an imaging control unit 3022 as functional blocks.
- the auscultation result acquisition unit 3020 controls the communication unit 3011 to acquire the auscultation result from the information management device 1100.
- the auscultation result acquired by the auscultation result acquisition unit 3020 includes at least two pieces of information.
- the first is analysis result information d1 indicating the analysis result of the body sound information collected by the electronic stethoscope 1003.
- the second part is part information d2 indicating the part from which the body sound information is collected.
- an auscultation result including at least the presence / absence of an abnormality determined by the information management apparatus 1100 based on the body sound information of the patient P and the part from which the body sound information is collected is acquired.
- the analysis result information d1 may include information determined by an abnormality determination unit (abnormality determination means) 2000 (not shown).
- the abnormality determination unit 2000 is included in the information management apparatus 1100 and is connected to the electronic stethoscope 1003 so as to be communicable.
- the biological sound information is received from the electronic stethoscope 1003, and the biological sound information is an abnormal candidate (abnormal).
- a determination process is performed to determine whether or not the sound is likely to be a sound.
- the information management apparatus 1100 may include an abnormality determination unit 2000 that analyzes body sound information collected by the electronic stethoscope 1003.
- the abnormality determination unit 2000 may be included in a device (not shown) different from the information management device 1100 that constitutes the auscultation system 1200.
- the abnormality determination unit 2000 determines whether or not the biological sound information is an abnormality candidate by a known method.
- a well-known method there is a method of performing determination by comparing body sound information with sample data.
- the abnormality determination unit 2000 obtains a similarity between the input body sound information and each sample data by well-known waveform matching, and if there is sample data whose similarity is equal to or greater than a threshold, it is determined as an abnormality candidate.
- An example is a process for determining that the sample data is normal (not an abnormal candidate) if there is no sample data.
- the image capturing apparatus 3006 is connected to the information management apparatus 1100 in the second embodiment so as to be communicable.
- the auscultation result acquisition unit 3020 acquires the determination result of the abnormality determination unit 2000 as analysis result information d1.
- the body sound information is stored and managed by the information management apparatus 1100 or the management server 1004 in the auscultation system 1200, and the body sound information is collected from the body sound information.
- the site information indicating the selected site is associated.
- the information management device 1100 may accept the input of the part information immediately before the operator U collects the body sound information from the patient P using the electronic stethoscope 1003, for example.
- the part information is, for example, measurement position information indicating from which part on the body surface of the patient P the body sound is collected, which can be represented by a number given to the circle in FIG. It is.
- the part information is stored in association with the body sound information in the information management apparatus 1100 as described above.
- the information management apparatus 1100 transmits the part associated with the body sound information as the part information d2 to the image capturing apparatus 3006 together with the analysis result information d1 of the body sound information.
- the auscultation result acquisition unit 3020 acquires the auscultation result transmitted as described above, that is, the analysis result information d1 and the part information d2.
- the auscultation result acquired by the auscultation result acquisition unit 3020 is used by the imaging region specifying unit 3021 to specify the imaging region.
- the imaging part specifying unit 3021 specifies a part of a living body to be imaged by the imaging unit 3013.
- the imaging part specifying unit 3021 specifies the position where the body sound information, which is suggested to be abnormal or possibly abnormal by the analysis result information d1, is taken as a part to be imaged.
- the imaging part specifying unit 3021 can specify the part to be imaged by the part information d2 acquired together with the analysis result information d1.
- the analysis result information d1 acquired from the information management apparatus 1100 according to the second embodiment includes a determination result “possibility of being abnormal (can be an abnormal candidate)” determined by the above-described well-known method.
- the imaging part specifying unit 3021 specifies a part to be imaged with reference to the part information d2 acquired together with the analysis result information d1. For example, when the part information d2 indicates a number “3” in FIG. 13, the imaging part specifying unit 3021 has an indication of an abnormality in the part.
- part (refer FIG. 13) is specified as an imaging target site
- the imaging part specifying unit 3021 may function not only to select whether or not imaging is necessary, but also to narrow down parts that should be subjected to precise imaging with higher resolution. For example, the imaging part specifying unit 3021 may determine that only the part “3” in which an abnormality is recognized is imaged with a setting different from the imaging method for other parts (for example, with high resolution). .
- the imaging control unit 3022 performs various settings for the imaging unit 3013 based on the site specified by the imaging site specifying unit 3021 and then controls the imaging unit 3013 to image the living body. In other words, the imaging control unit 3022 executes image imaging processing with different settings (in the manner of imaging) for the site specified by the imaging site specifying unit 3021 and the other site.
- the positioning mechanism of the imaging unit 3013 is set so that the “3” site of the patient P is appropriately captured. Control and shoot.
- the imaging control unit 3022 may set the imaging unit 3013 so that the resolution is high only when imaging the part “3”, and perform a series of imaging including other parts. .
- Image data acquired by the imaging unit 3013 according to the control of the imaging control unit 3022 is stored in the storage unit 3012.
- the imaging control unit 3022 preferably stores the acquired image data in association with the corresponding analysis result information d1 and part information d2.
- the imaging control unit 3022 includes, in the image data obtained by imaging the part “3” by the imaging unit 3013, analysis result information d1 indicating “possibly abnormal (abnormal candidate)” and “ The information is stored in the storage unit 3012 in association with the part information d2 indicating the part 3 ′′.
- the analysis result information d1 includes disease name information as necessary. It doesn't matter.
- the image capturing control unit 3022 can associate the suspected disease name with the acquired image data and store the image data in the storage unit 3012. . If such image data is displayed on a display unit (not shown) together with the disease name and sound type determination result, more detailed information can be provided to the doctor D.
- the abnormality determination unit 2000 can determine not only the presence / absence of an abnormality but also the degree of abnormality (level), the degree of abnormality (level) rather than supplying the disease name as the analysis result information d1 to the image capturing apparatus 3006. ) May be preferable.
- the image capturing apparatus 3006 of the present invention it is possible to limit the part subjected to the image capturing process for the patient P to the minimum necessary.
- the imaging region specifying unit 3021 will respond according to the level of abnormality. This is because the imaging region can be specified in more detail.
- the imaging region specifying unit 3021 can specify the imaging target area size according to the level of abnormality. Although it is desirable to avoid taking a medical image with an unnecessarily large size, it is meaningless at an image size that does not provide sufficient information for the doctor D to diagnose the patient P. Therefore, in addition to supplying abnormal part information d2 as an auscultation result, it is desirable to output analysis result information d1 including an abnormal level to the image capturing apparatus 3006. And it is preferable that the imaging part specific
- the imaging control unit 3022 controls the imaging unit 3013 according to the size designated by the imaging site specifying unit 3021 and acquires a medical image of an appropriate size for an appropriate site.
- the imaging control unit 3022 allows the imaging unit 3013 to be measured based on the imaging target site specified by the imaging site specifying unit 3021 and the determined imaging target area size.
- the medical image can be taken by arranging it at an appropriate place.
- the acquired image data is associated with the part information d2 and the analysis result information d1 (the content of the abnormality, the level of the abnormality) and is stored in the storage unit 3012, and is used as a medical image for diagnosis by the doctor D. Be utilized. Furthermore, since the above-mentioned attached information associated with the image data is managed, it can be used as reference information when the same subject needs to be photographed again after the first diagnosis. Is possible. Thereby, it is possible to improve the measurement accuracy in the subsequent image capturing process. For example, there is a case where the medical image measured for the first time does not have information expected by the doctor D (eg, the resolution is low, the imaging area is narrow, the abnormal part is photographed with a shift). In that case, the imaging part specifying unit 3021 changes the measurement part, the resolution, and the imaging target area size specified last time, and corrects the image data including the information requested by the doctor D to be captured. Is the method.
- the medical image measured for the first time does not have information expected by the doctor D (eg
- the image capturing apparatus 3006 takes the auscultation result output by the auscultation system 1200 into consideration, and minimizes the part to be subjected to the image capturing process on the patient P. It is possible to narrow down. That is, the image capturing apparatus 3006 and the image capturing method that are appropriate to the extent that the doctor D can diagnose and that can minimize the burden on the patient P are realized. Specifically, the imaging region specifying unit 3021 determines to capture only the region where abnormality (or the possibility) is recognized based on the auscultation result, or only the region with high resolution. Or decide to shoot. For example, when the imaging unit 3013 is a mechanism that performs imaging with X-rays, the radiation dose received by the patient P can be reduced.
- the above-described auscultation system 1200 may be the body sound measurement system 100 in the first embodiment.
- the above-described electronic stethoscope 1003 may be the stethoscope 1.
- the information management device 1100 described above may be the terminal device 30.
- the terminal device 30 includes the abnormality determination unit 2000 described above, and the analysis result information d1 may include information determined by the abnormality determination unit 2000.
- the part information d2 may be measurement position information as audio information input via the stethoscope 1. Then, the terminal device 30 may supply the analysis result information d1 and the part information d2 to the image capturing device 3006.
- each block of the terminal device 30 described above, in particular, the main control unit 37 may be configured by hardware logic, or may be realized by software using a CPU as follows.
- each block of the information management apparatus 1100 in particular, a patient information acquisition unit 1020, an auscultation support information selection unit 1021, an output control unit 1022, an event detection unit 1023, a body sound information acquisition unit 1024, an information management unit 1025, and a measurement
- the position information generation unit 1026 may be configured by hardware logic, or may be realized by software using a CPU as follows.
- each block of the image capturing apparatus 3006, in particular, the auscultation result acquisition unit 3020, the imaging site specifying unit 3021, and the imaging control unit 3022 may be configured by hardware logic, and uses a CPU as follows. It may be realized by software.
- the terminal device 30, the information management device 1100, and the image capturing device 3006 include a CPU (central processing unit) that executes instructions of a control program that realizes each function, a ROM (read memory only) that stores the program, A RAM (random access memory) for expanding the program and a storage device (recording medium) such as a memory for storing the program and various data are provided.
- An object of the present invention is to provide program codes (execution format program, intermediate code program, source) of control programs of the terminal device 30, the information management device 1100, and the image capturing device 3006, which are software that implements the functions described above.
- the recording medium in which the program is recorded in a computer-readable manner is supplied to each of the terminal device 30, the information management device 1100, and the image capturing device 3006, and the computer (or CPU or MPU) is recorded on the recording medium. This can also be achieved by reading and executing the program code.
- Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R.
- Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM (registered trademark) / flash ROM.
- each of the terminal device 30, the information management device 1100, and the image capturing device 3006 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network.
- the communication network is not particularly limited.
- the Internet intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available.
- the transmission medium constituting the communication network is not particularly limited.
- infrared rays such as IrDA and remote control, Bluetooth ( (Registered Trademark), 802.11 wireless, HDR (High Data Rate), mobile phone network, satellite line, terrestrial digital network, and the like can also be used.
- the present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.
- An information management apparatus includes an acquisition unit that acquires biological sound information acquired by a sound collection device and position information indicating an acquisition position of the biological sound information; Association means for associating the body sound information acquired by the acquisition means with the position information; The acquisition means acquires the position information as sound input to the sound collection device.
- the sound collection device acquires position information indicating the acquisition position of the biological sound information as the user's voice.
- the acquisition unit acquires the body sound information and the position information.
- the association unit associates the body sound information and the position information acquired by the acquisition unit with each other.
- a sound collecting device for acquiring biological sound information can be used as an input device for inputting position information, and the necessity of providing an input device for inputting position information can be eliminated.
- the position information is acquired as the same sound information together with the biological sound information, It is preferable that the information management device further includes an extraction unit that extracts the position information and the biological sound information from the sound information.
- the position information and the body sound information can be extracted separately by the extraction unit.
- the information management device further includes voice recognition means for voice recognition of the voice, Preferably, the association unit associates the biological sound information with the position information recognized by the voice recognition unit.
- the position information acquired as voice is voice-recognized by the voice recognition means. Therefore, position information can be acquired as letters or numbers, or a combination thereof. Therefore, the storage capacity can be reduced as compared with the case where the position information is stored as sound. Further, the position information can be displayed as characters or numbers, and the user can easily confirm the position information.
- the information management device includes: a determination unit that determines whether or not a position indicated by the position information that has been voice-recognized by the voice recognition unit matches a predetermined position; In the case where the determination unit determines that the position indicated by the position information does not match the predetermined position, it is preferable to further include a notification control unit that notifies the notification unit to that effect.
- the information management device further includes a notification unit that notifies that when the position indicated by the position information does not match the predetermined position.
- the information management device further includes a display unit that indicates a predetermined position where the sound collecting device is brought into contact with a living body to be measured.
- a predetermined measurement position can be shown to the user.
- an information management program for operating the information management apparatus the information management program for causing a computer to function as each of the above-described means, and a computer-readable recording medium on which the information management program is recorded are also provided in the technical scope of the present invention. Included in the range.
- An information management method is an information management method in an information management device, A first acquisition step of acquiring biological sound information acquired by the sound collector; A second acquisition step of acquiring position information indicating an acquisition position of the biological sound information as sound input to the sound collection device; It includes an associating step for associating the body sound information acquired in the first and second acquiring steps with the position information.
- the body sound information acquired by the sound collection device is acquired in the first acquisition step, and the position information indicating the acquisition position of the body sound information is acquired in the second acquisition step.
- the order of the first acquisition step and the second acquisition step is not limited, and the first acquisition step may be performed after the second acquisition step.
- the position information acquired in the second acquisition step is input as sound through the sound collector.
- the body sound information and the position information are associated.
- a sound collection device that acquires biological sound can be used as an input device for inputting position information, and it is possible to eliminate the need to separately provide an input device for inputting position information.
- An electronic stethoscope is: A first sound collecting unit for obtaining a body sound; A second sound collection unit that acquires position information indicating the acquisition position from which the biological sound is acquired as sound information; A transmitting unit that transmits the body sound information indicating the body sound and the position information to an association unit that associates the body sound acquired by the first sound collection unit with the position information acquired by the second sound collection unit; It is characterized by having.
- the first sound collecting unit obtains the body sound
- the second sound collecting unit obtains the position information indicating the acquisition position of the body sound as the sound information by the user's voice.
- the first sound collection unit and the second sound collection unit may be the same sound collection unit or may be different from each other.
- the transmitting unit transmits the body sound information indicating the body sound and the position information to the association unit.
- the body sound is associated with the position information.
- a sound collection device that acquires biological sound can be used as an input device for inputting position information, and it is possible to eliminate the need to separately provide an input device for inputting position information.
- the second sound collection unit is a member different from the first sound collection unit, and may be suitable for obtaining sound.
- the second sound collection unit has a configuration suitable for acquisition of sound, that is, acquisition of position information. Therefore, position information can be acquired efficiently.
- An information management system including the information management device and the electronic stethoscope is also included in the technical scope of the present invention.
- the present invention can also be expressed as follows.
- the information management apparatus is an information management apparatus that manages biological sound information collected by a stethoscope, and obtains subject information of a subject whose biological sound information is collected.
- An acquisition means an auscultation support information storage unit for storing a plurality of patterns of auscultation support information including at least one measurement position information indicating a measurement position to which a stethoscope should be applied for each subject information, and a subject acquired by the subject information acquisition means
- Auscultation support information selection means for selecting auscultation support information corresponding to the information from the auscultation support information storage unit, and output control for converting the measurement position information of the auscultation support information selected by the auscultation support information selection means into a video signal and outputting it
- one of the measurement position information output by the output control means is associated with the body sound information collected from the stethoscope.
- the auscultation support information storage unit can select auscultation support information suitable for the subject based on the subject information acquired by the subject information acquisition means.
- the auscultation support information includes measurement position information indicating a measurement position where the stethoscope should be applied.
- the output control means outputs auscultation support information suitable for the subject (in particular, measurement position information included therein) as a video signal. Thereby, the measurement position which should apply a stethoscope is visualized about the test subject. The user can perform auscultation suitable for the subject with reference to the visualized measurement position information.
- the information management means can recognize that auscultation is being performed according to the auscultation support information during that time. That is, since the auscultation support information includes the measurement position information, the information management unit collects the body sound information at a position indicated by any of the measurement position information of the output auscultation support information. It can be judged. In addition, the information management means can acquire auxiliary information necessary for specifying the measurement position, triggered by the occurrence of a specific event that occurs during the output of the auscultation support information (video signal).
- the information management means collects the body sound information of the body sound information collected from the stethoscope based on the measurement position information included in the auscultation support information being output and the acquired auxiliary information. It is possible to specify which measurement position is the target.
- the information management means can link the measurement position information of the specified measurement position to the biological sound information.
- the output control means outputs auscultation support information suitable for the subject as a video signal so as to be visually recognized by the user.
- the information management means associates the body sound information with the measurement position, what is necessary is that the information management means itself can acquire the auscultation support information selected earlier and the occurrence of a specific event. Only auxiliary information.
- the measurement using the stethoscope is performed by the operator without using a special device that requires a complicated operation, and the collected body sound information and its information It is possible to easily link the measurement position information.
- the information management apparatus of the present invention preferably includes a projection unit that projects the video signal output by the output control unit as an optical video so that the user can visually recognize the video signal.
- the auscultation support information storage unit stores a plurality of the auscultation support information for each subject's physique
- the subject information acquisition means is the subject subject of the subject imaged by the imaging unit. It is preferable that the image is acquired, and the auscultation support information selection unit estimates the physique of the subject based on the subject image and selects auscultation support information corresponding to the estimated physique.
- the user does not need to perform a complicated input operation in order to select the optimal auscultation support information, and only needs to place the subject within the imaging range of the imaging unit.
- the user can accurately grasp where the stethoscope should be applied in accordance with the physique of the subject.
- the optical image output from the projection unit is projected on the body surface of the subject.
- the user can intuitively grasp the measurement position from the measurement position information projected on the body surface of the subject.
- the form in which the measurement position information is projected onto the body surface of the subject can avoid the inconvenience that the user has the wrong measurement position (or measurement order). It becomes. Therefore, auscultation failures due to erroneous operations can be greatly reduced.
- the projected auscultation support information is information that matches the physique of the subject, the projected measurement position can also more accurately reproduce the location of the patient to be auscultated. .
- the information management device of the present invention displays measurement position information suitable for the subject's physique on the subject's body surface, the user can intuitively grasp a more suitable measurement position for the subject. Therefore, even if the user does not have medical knowledge, there is an advantage that the user can perform auscultation correctly.
- the information management apparatus of the present invention is provided with measurement order information indicating the order of measurement for each measurement position information in the auscultation support information, and the output control means assigns each measurement position information to each measurement order.
- the information management means converts the number of times the body sound information is received after the image signal is output as auxiliary information when the body sound information is received from the stethoscope.
- One piece of measurement position information acquired and associated with the biological sound information may be specified based on the number of times and the measurement order information.
- the information management unit can recognize that auscultation is being performed according to the auscultation support information during that period. That is, since the auscultation support information includes the measurement position information and the measurement order information, the information management means indicates each measurement position information in the order indicated by the measurement order information of the output auscultation support information. It can be determined that the biological sound information is sequentially collected at the position. In addition, the information management means triggers an event that the body sound information is received while the auscultation support information (video signal) is output, and auxiliary information necessary for specifying the measurement position, that is, the body sound information The number of times of reception (the number of the body sound information received since the video signal was output) can be acquired.
- the information management means may identify what number of measurement position information the body sound information received earlier is the body sound information with reference to the reception count and the measurement order information of the auscultation support information. it can.
- the information management means may be configured such that the stethoscope imaged by the imaging unit when the stethoscope starts collecting biological sound information or is being collected. You may acquire the test subject image of the said test subject who is applied as auxiliary information.
- the test subject image captured by the imaging unit is an image showing the state (the position of the stethoscope) at the time when the body sound information is collected.
- the subject image is also auxiliary information necessary for specifying the measurement position, and for the user, it can be said that the measurement position information itself indicates the measurement position.
- the information management means can use such a subject image for management of body sound information, and can easily link the measurement position to the body sound information.
- the information management means may associate the subject image with the biological sound information.
- the information management means can manage the subject image, which is the measurement position information itself indicating the measurement position, in association with the biological sound information.
- the information management means specifies one measurement position information linked to the biological sound information from the auscultation support information being output as a video signal based on the position of the stethoscope reflected in the subject image. Also good.
- the information management means specifies a measurement position based on the position of the stethoscope reflected in the subject image and the auscultation support information being output as a video signal, and generates a model image representing the specified measurement position.
- the body sound information may be linked.
- the body sound information can be managed in association with the measurement position without storing the subject image together with the body sound information.
- the information management apparatus of the present invention may include a display unit that displays the video signal output by the output control unit so that the user can visually recognize the video signal.
- the user can grasp the position of the subject to which the stethoscope should be applied by visually recognizing the video displayed on the display unit.
- An information management method is an information management method for managing body sound information collected by a stethoscope in order to solve the above problem, and acquires subject information of a subject whose body sound information is collected.
- a subject information acquisition step and auscultation support information including one or more measurement position information indicating a measurement position to which a stethoscope is to be applied are obtained from the auscultation support information storage unit storing a plurality of patterns for each subject information in the subject information acquisition step.
- An auscultation support information selection step for selecting auscultation support information corresponding to the subject information
- an output control step for converting the measurement position information of the auscultation support information selected in the auscultation support information selection step into a video signal and outputting it
- Information management for associating one of the measurement position information output in the output control step with the body sound information collected from the stethoscope
- a step, in the information management step, on the basis of the auxiliary information acquired in response to the occurrence of certain events in the video signal output is characterized by identifying one of the measurement location.
- a measurement system includes an electronic stethoscope for performing auscultation on a person to be measured, any one of the above information management devices, and the above information management device. And an image imaging device that performs an image imaging process on the measurement subject based on an auscultation result indicating a result of auscultation performed using the electronic stethoscope output by the information management device.
- abnormality determination means for analyzing the body sound information collected by the electronic stethoscope, and the imaging apparatus includes the presence / absence of an abnormality determined by the abnormality determination means based on the body sound information;
- Auscultation result acquisition means for acquiring an auscultation result including at least a part from which body sound information is collected, and a part determined to have an abnormality based on the auscultation result acquired by the auscultation result acquisition means
- a part specifying means for specifying the image, and an imaging control means for capturing the part specified by the part specifying means in a manner different from imaging for other parts, and acquiring the image data of the measurement subject It is characterized by having.
- the image capturing apparatus can perform the image capturing process by using the auscultation result output by the information management apparatus including the abnormality determining unit. That is, a link between the measurement related to the auscultatory sound and the measurement for image capturing is realized. For example, it is possible to perform image capturing focusing on a specific part where abnormality is recognized in the body sound information. Alternatively, for example, when there is no particular problem with auscultation, the inconvenience that unnecessary image capturing is performed on the part is solved.
- the information management apparatus may be realized by a computer.
- a control program for the information management apparatus that causes the information management apparatus to be realized by the computer by causing the computer to operate as each unit, and A computer-readable recording medium on which it is recorded also falls within the scope of the present invention.
- the biological sound acquired by the sound collecting device and the acquisition position of the biological sound can be managed in association with each other, and the present invention is a stethoscope and an information management device that manages auscultation results using a stethoscope. Can be applied.
- the information management apparatus of the present invention can manage the biological sound information collected and collected by the electronic stethoscope and the measurement position of the living body where the measurement is performed at that time. Therefore, it can be widely used in a system using biological sound information in consideration of the measurement position. In particular, it is suitably used for an auscultation system that listens to collected biological sound information in consideration of the measurement position and performs medical care.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Acoustics & Sound (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physiology (AREA)
- Psychiatry (AREA)
- Signal Processing (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
Description
集音装置が取得した生体音情報と、当該生体音情報の取得位置を示す位置情報とを取得する取得手段と、
上記取得手段が取得した生体音情報と上記位置情報とを対応付ける対応付け手段とを備え、
上記取得手段は、上記集音装置に入力された音声としての上記位置情報を取得することを特徴としている。
集音装置が取得した生体音情報を取得する第1取得工程と、
上記生体音情報の取得位置を示す位置情報を、上記集音装置に入力された音声として取得する第2取得工程と、
上記第1および第2取得工程において取得した生体音情報と上記位置情報とを対応付ける対応付け工程とを含むことを特徴としている。
生体音を取得する第1集音部と、
上記生体音を取得した取得位置を示す位置情報を音声情報として取得する第2集音部と、
上記第1集音部が取得した生体音と、上記第2集音部が取得した位置情報とを対応付ける対応付け手段へ、上記生体音を示す生体音情報および上記位置情報を送信する送信部とを備えることを特徴としている。
本発明の実施の一形態について図1~図6に基づいて説明すれば、以下のとおりである。
まず、本発明の一実施形態である生体音測定システム(情報管理システム)100の概要について、図2を参照しつつ説明する。
図1は、生体音測定システム100の構成を示す図である。図1に示すように、聴診器1は、チェストピース2、ケーブル3、イヤホン4を備えている。
図3は、チェストピース2の構成の一例を示す断面図である。図3に示すように、チェストピース2は、ダイアフラム面(第1集音部)21、振動センサ(第1集音部)22、マイクロフォン(第2集音部)23、デジタル信号変換部24、通信部(送信部)25を備えている。マイクロフォン23、デジタル信号変換部24および通信部25は、基板26の上に設けられている。
ダイアフラム面21は、被験者50が呼吸などを行うことにより生体音を発すると、この生体音の波長に合わせて微小振動する。このダイアフラム面21の微小振動は、大気を介して振動センサ22に伝搬される。
振動センサ22は、ダイアフラム面21の微小振動を検出し、検出した微小振動を電気信号に変換する。図3に示す例では、振動センサ22として圧電振動板を有するセンサを用いている。この圧電振動板は、圧電セラミックス(上側)と金属板(下側)との2層からなっている。より詳細には、圧電セラミックスは、2層の電極によって挟まれているが、図3では、当該電極は省略されている。なお、振動センサ22の構成は、図3に示すものに限定されない。
マイクロフォン23は、測定位置情報としてのユーザの音声を取得するための専用の集音装置である。ユーザの音声は、上述のようにダイアフラム面21および振動センサ22を用いて取得してもよいが、ユーザの音声をより確実に取得するために、振動センサ22とは別にマイクロフォン23を設けてもよい。
デジタル信号変換部24は、振動センサ22が変換した電気信号をデジタル信号に変換し、生体音情報および測定位置情報として通信部25へ出力する。
通信部25は、デジタル信号変換部24から出力された生体音情報および測定位置情報を端末装置30の通信部31へ送信する送信部として機能する。
端末装置30は、聴診器1によって取得された生体情報および測定位置情報を管理する装置である。この端末装置30は、例えば、パーソナルコンピュータ、スマートフォン、PDA(personal digital assistant)であるが、特に限定されない。
主制御部37は、端末装置30の制御を行うものであり、特に、生体情報と測定位置情報とを取得する取得手段として機能する。この主制御部37は、取得した生体情報と測定位置情報とを対応付けて管理するとともに、ユーザが発声した測定位置が、予め定められた測定位置と一致しているかどうかを判定する。
情報分離部32は、通信部31が測定位置情報を生体音情報とともに同一の音データとして受信する場合に、その音データに含まれる音を、測定位置情報としての音と生体音情報としての音とに分離する。換言すれば、情報分離部32は、上記音データから、測定位置情報と生体音情報とを別々に抽出する。この場合、情報分離部32は、測定位置情報および生体音情報を取得する取得手段として機能すると見なすこともできる。
音声認識部33は、情報分離部32によって生成された音声データファイルが示す音声(測定位置情報)を音声認識する。具体的には、音声認識部33は、音声データファイルが示す音声を解析することにより、音声によって表されている測定位置情報を、文字または数字、もしくはその組み合わせ(以下、文字等と表現する)に変換する。そして、音声認識部33は、文字等として表現された測定位置情報を情報管理部35および位置情報判定部34へ出力する。
位置情報判定部34は、音声認識部33から出力された測定位置情報が示す測定位置と、その時点で測定位置として指定されている測定位置とを比較する。両者が一致しないと判定すると、位置情報判定部34は、その旨を示す不一致情報を出力制御部36へ出力する。
出力制御部36は、表示部39およびスピーカ40を制御するものである。特に、出力制御部36は、位置情報判定部34から不一致情報を受信した場合に、測定位置が間違っている旨のメッセージを表示部39に表示するとともに、警告音をスピーカ40から出力する。
情報管理部35は、情報分離部32によって分離された生体音情報と測定位置情報とを対応づけて管理する。
次に、生体音測定システム100における処理の流れの一例について、図5および図6を参照しつつ説明する。図5は、生体音測定システム100における処理の流れの一例を示すフローチャートである。図6は、表示部39に表示される画面の一例を示す図である。ここでは、聴診器1のユーザが測定位置の発声を行った後に、生体音を測定する場合の処理の流れについて説明する。
(生体音情報と測定位置情報との取得順序の変更例)
端末装置30は、生体音情報を取得した後に、測定位置情報を取得してもかまわない。この場合、両者の対応関係を明確にするために、生体音情報が聴診器1において取得されてから後の所定の時間内に取得された測定位置情報を、先に取得された生体音情報に対応する測定位置情報であると認識する設定にすればよい。生体音情報または測定位置情報が聴診器1において取得された時点とは、例えば、生体音情報または測定位置情報が、聴診器1が備える一時記憶メモリ(記憶部)にバッファされた時点である。
また、聴診器1が通信部25を備えている必要は必ずしもない。聴診器1が生体音情報および測定位置情報を記憶可能な不揮発性の格納部を備えており、聴診器1の格納部から端末装置30の格納部38へデータの移動が可能な構成にしてもよい。この場合、主制御部37は、格納部38から生体音情報および測定位置情報を取得する。
また、生体音情報と、測定位置情報とを別々に取得する(同時には取得しない)場合に、マイクロフォン23によって取得した雑音を、振動センサ22等によって取得した生体音に含まれるノイズを打ち消すために用いてもよい。すなわち、マイクロフォン23によって取得したノイズの逆位相の音をデジタル回路またはアナログ回路において発生させ、発声させた信号を生体音の信号に重ね合わせることで、生体音に含まれるノイズを減衰させる。このような回路構成を聴診器1が備えていてもよい。
端末装置30をサーバとして実現してもよい。この場合には、聴診器1のユーザの近傍に配置可能な第2端末装置を設け、この第2端末装置に出力制御部36、表示部39およびスピーカ40を含めることが好ましい。測定位置を指定する情報および上述の不一致情報は、サーバとしての端末装置30から第2端末装置へ送信されればよい。
生体音測定システム100では、ユーザは、聴診器1を介して測定位置情報を入力することができる。それゆえ、キーボードなど、文字入力するためのインターフェースを用意する必要がなく、聴診器ひとつで、生体音と測定位置情報とを対応付けることができる。この構成は、医師等が設備の整っていない遠隔地へ赴いたときなどに特に有用である。
本発明に係る他の実施形態について説明する。
従来、生体(患者、被験者)から生体音(呼吸音、心音など)を採取し、その採取した生体音をデジタル信号(生体音情報)として記録可能な電子聴診器が普及している。電子聴診器によって生体音情報が電子的に記録されることにより、医師が患者に対して聴診器を使ってその場で診断を行うといった従来の診断形態とは異なる、多様な診断形態を実現することが可能になっている。例えば、患者および電子聴診器の操作者とは離れた場所にいる医師が、採取された生体音情報を受信して、遠隔地から診断を行うことが可能である。また、採取され記録された生体音情報を後日聞き直すことができるので、医師は、採取日の異なる生体音情報を聞き比べることが可能である。
〔発明が解決しようとする課題〕
電子聴診器によって患者の生体音を取得する場合、取得した生体音が、患者の体表面のどの箇所に電子聴診器を当てたときに得られたものであるのかを示す測定位置情報は重要である。生体音には場所依存性があり、どこに電子聴診器を当てるかによって得られる生体音が異なるからである。上述したとおり、医師が遠隔地にいたり、採取日とは別の日に聴診したりする診断形態においては、生体音情報を測定位置情報とともに管理することが特に重要である。つまり、電子聴診器で取得される生体音情報は、その取得時の患者の測定位置と相関がなければ、意味のない情報となる。
〔実施形態2-1〕
本発明の情報管理装置に関する実施形態について、図7~図21に基づいて説明すると以下の通りである。
図8は、本発明の実施形態における聴診システムの概要を示す図である。図8に示すとおり、聴診システム1200は、少なくとも、操作者Uが患者Pの生体音を採取する(すなわち聴診する)ための電子聴診器1003と、操作者Uが聴診時に使用する情報管理装置1100とを含んで構築される。
図9は、本実施形態における情報管理装置1100のハードウェア構成を示すブロック図である。情報管理装置1100は、図9に示すとおり、少なくとも、制御部1010、入力部1011または操作部1013、表示部1012または投影部1014、無線通信部1016、撮像部1017および記憶部1019を備えている。さらに、情報管理装置1100は、スマートフォンとして本来備わっている機能を実現するために、通信部1015および音声入力部1018、ならびに、図示しない、外部インターフェース、音声出力部、通話処理部、放送受像部(チューナ・復調部など)、GPSおよびセンサ(加速度センサ、傾きセンサなど)など、スマートフォンが標準的に備えている各種部品を備えていてもよい。
図7は、本実施形態における情報管理装置1100の要部構成を示す機能ブロック図である。
本実施形態では、情報管理装置1100は、投影部1014(プロジェクタ機能)および撮像部1017を備えた装置(スマートフォンなど)で実現されている。このような情報管理装置1100を用いて、本発明の情報管理機能を実現すれば、上述した効果に加えてさらに多くの有利な点を享受することができる。以下では、情報管理装置1100の撮像部1017および投影部1014(プロジェクタ機能)を利用して、聴診システム1200を実現する場合について、具体例を用いて説明する。
図18は、情報管理装置1100が実施する情報管理処理の流れを示すフローチャートである。
本実施形態における出力制御部1022は、さらに、聴診支援情報選択部1021が患者の体格を推定できるライブビュー画像が得られるように、撮像部1017で撮影する範囲を変更するよう操作者Uに通知を行う構成であってもよい。
診療現場1001にて、患者の診察を行う場合、たいてい、患者の前面と背面との両方を聴診する必要がある。本実施形態では、聴診支援情報選択部1021は、前面用と背面用にそれぞれその患者のための聴診支援情報を選択する。聴診支援情報を選択するために、聴診支援情報選択部1021は、比較的負荷の高い画像認識処理を行っている。こうした負荷の高い処理は、できるだけ削減されることが好ましい。
上述の説明では、情報管理部1025は、生体音情報が取得されたというイベントに基づいて、その生体音情報の測定位置を特定する構成であった。
本実施形態では、情報管理部1025が、各測定位置での聴診の開始または終了を判断する方法して、イベント検知部1023が生体音情報の受信を開始したイベントまたは受信が完了したイベントを検知する例について説明した。
本実施形態において、聴診支援情報記憶部1030に記憶されている聴診支援情報は、測定順番情報の代わりに、測定位置識別情報を含んでいてもよい。測定位置識別情報は、聴診支援情報に含まれている測定位置情報の各々を識別するためのIDであり、測定位置情報ごとに付与されているものである。
本発明の情報管理装置に関する他の実施形態について、図22~図24に基づいて説明すれば、以下のとおりである。なお、説明の便宜上、上述の実施形態2-1にて説明した図面と同じ機能を有する部材については、同じ符号を付記し、その説明を省略する。
図22は、本実施形態における情報管理装置1100の要部構成を示す機能ブロック図である。
しかしながら、患者の裸の写真や映像を撮影して紐付ける、すなわち、不揮発的に保存することは、当該情報の機密性に鑑みても、また、撮影される患者の心情を考慮しても容易にできることではない。
上述の各実施形態では、情報管理装置1100が投影部1014を備え、聴診支援情報を患者Pに直接投影する構成について説明した。上記構成によれば、操作者Uは、患者Pの体表面上にて直感的に測定位置を把握することができ、操作者Uが測定位置および順番を間違うという不都合を回避することが可能となる。
上述の実施形態2-1~実施形態2-3における情報管理部1025は、電子聴診器1003が採取した生体音情報に、測定位置情報を関連付けるのに加えて、さらに、その場で聴診を行った操作者Uが、その生体音情報に関連して入力した入力情報を関連付ける構成であってもよい。
本発明の他の実施形態について、図25に基づいて説明すれば、以下のとおりである。なお、説明の便宜上、上述の実施形態にて説明した図面と同じ機能を有する部材については、同じ符号を付記し、その説明を省略する。
特許文献5には、医用画像を作成する際に、生体の所定部位が撮影された画像データを取得した後、撮影された部位に対して生体音測定を行い、それらの結果を関連付けて、当該医用画像を表示する医用画像表示システムが記載されている。
図25は、実施形態3に係る測定システム3600の概要、および、測定システム3600を構成する画像撮像装置3006の要部構成を示すブロック図である。
画像撮像装置3006は、図25に示すとおり、聴診システム1200の各装置との間で情報の送受信を行う通信部3011、画像撮像装置3006が処理する各種情報を記憶するための記憶部3012、患者の撮影を実施する撮像部3013、および、画像撮像装置3006の各部を統括して制御する制御部3010を含む構成となっている。
最後に、上述した端末装置30の各ブロック、特に主制御部37は、ハードウェアロジックによって構成してもよいし、次のようにCPUを用いてソフトウェアによって実現してもよい。
本発明は上述した各実施形態に限定されるものではなく、請求項に示した範囲で種々の変更が可能であり、異なる実施形態にそれぞれ開示された技術的手段を適宜組み合わせて得られる実施形態についても本発明の技術的範囲に含まれる。
本発明は、以下のようにも表現できる。
上記取得手段が取得した生体音情報と上記位置情報とを対応付ける対応付け手段とを備え、
上記取得手段は、上記集音装置に入力された音声としての上記位置情報を取得することを特徴としている。
上記情報管理装置は、上記音情報から、上記位置情報と上記生体音情報とを抽出する抽出手段をさらに備えることが好ましい。
上記対応付け手段は、上記生体音情報と、上記音声認識手段によって音声認識された位置情報とを対応付けることが好ましい。
上記位置情報が示す位置が、上記所定の位置と一致しないと上記判定手段が判定した場合に、その旨を報知部に報知させる報知制御手段とをさらに備えることが好ましい。
集音装置が取得した生体音情報を取得する第1取得工程と、
上記生体音情報の取得位置を示す位置情報を、上記集音装置に入力された音声として取得する第2取得工程と、
上記第1および第2取得工程において取得した生体音情報と上記位置情報とを対応付ける対応付け工程とを含むことを特徴としている。
生体音を取得する第1集音部と、
上記生体音を取得した取得位置を示す位置情報を音声情報として取得する第2集音部と、
上記第1集音部が取得した生体音と、上記第2集音部が取得した位置情報とを対応付ける対応付け手段へ、上記生体音を示す生体音情報および上記位置情報を送信する送信部とを備えることを特徴としている。
2 チェストピース(集音装置)
21 ダイアフラム面(第1集音部)
22 振動センサ(第1集音部)
23 マイクロフォン(第2集音部)
25 通信部(送信部)
30 端末装置(情報管理装置)
31 通信部(受信部)
32 情報分離部(抽出手段)
33 音声認識部(音声認識手段)
34 位置情報判定部(判定手段)
35 情報管理部(対応付け手段)
36 出力制御部(報知制御手段)
37 主制御部(取得手段)
38 格納部(記憶部)
39 表示部(報知部)
40 スピーカ(報知部)
50 被験者(生体)
100 生体音測定システム(情報管理システム)
1001 診療現場
1002 サポートセンター
1003 電子聴診器(聴診器)
1004 管理サーバ
1005 通信網
1010 制御部
1011 入力部
1012 表示部
1013 操作部
1014 投影部
1015 通信部
1016 無線通信部
1017 撮像部
1018 音声入力部
1019 記憶部
1020 患者情報取得部(被験者情報取得手段)
1021 聴診支援情報選択部(聴診支援情報選択手段)
1022 出力制御部(出力制御手段)
1023 イベント検知部(イベント検知手段)
1024 生体音情報取得部(生体音情報取得手段)
1025 情報管理部(情報管理手段/紐付け手段)
1026 測定位置情報生成部(測定位置情報生成手段/補助情報取得手段)
1030 聴診支援情報記憶部
1031 生体音情報記憶部
1040 患者画像(被験者画像)
1041 患者画像(被験者画像)
1043 投影画像
1044 投影画像
1045 患者画像(被験者画像)
1046 模型画像
1050 設置台
1051 操作ボタン
1052 表示部
1100 情報管理装置
1200 聴診システム
2000 異常判定部(異常判定手段)
3006 画像撮像装置
3010 制御部
3011 通信部
3012 記憶部
3013 撮像部
3020 聴診結果取得部(聴診結果取手段)
3021 撮像部位特定部(部位特定手段)
3022 撮像制御部(撮像制御手段)
3600 測定システム
Claims (26)
- 集音装置が取得した生体音情報と、当該生体音情報の取得位置を示す位置情報とを取得する取得手段と、
上記取得手段が取得した生体音情報と上記位置情報とを対応付ける対応付け手段とを備え、
上記取得手段は、上記集音装置に入力された音声としての上記位置情報を取得することを特徴とする情報管理装置。 - 上記位置情報は、上記生体音情報とともに同一の音情報として取得され、
上記音情報から、上記位置情報と上記生体音情報とを抽出する抽出手段をさらに備えることを特徴とする請求項1に記載の情報管理装置。 - 上記音声を音声認識する音声認識手段をさらに備え、
上記対応付け手段は、上記生体音情報と、上記音声認識手段によって音声認識された位置情報とを対応付けることを特徴とする請求項1または2に記載の情報管理装置。 - 上記音声認識手段によって音声認識された位置情報が示す位置が、所定の位置と一致するかどうかを判定する判定手段と、
上記位置情報が示す位置が、上記所定の位置と一致しないと上記判定手段が判定した場合に、その旨を報知部に報知させる報知制御手段とをさらに備えることを特徴とする請求項3に記載の情報管理装置。 - 上記位置情報が示す位置が、上記所定の位置と一致しない場合に、その旨を報知する報知部をさらに備えることを特徴とする請求項4に記載の情報管理装置。
- 測定対象となる生体における、上記集音装置を当接させる所定の位置を示す表示部をさらに備えることを特徴とする請求項1から5までのいずれか1項に記載の情報管理装置。
- 請求項1から6までのいずれか1項に記載の情報管理装置を動作させる情報管理プログラムであって、コンピュータを上記各手段として機能させるための情報管理プログラム。
- 請求項7に記載の情報管理プログラムを記録したコンピュータ読み取り可能な記録媒体。
- 情報管理装置における情報管理方法であって、
集音装置が取得した生体音情報を取得する第1取得工程と、
上記生体音情報の取得位置を示す位置情報を、上記集音装置に入力された音声として取得する第2取得工程と、
上記第1および第2取得工程において取得した生体音情報と上記位置情報とを対応付ける対応付け工程とを含むことを特徴とする情報管理方法。 - 生体音を取得する第1集音部と、
上記生体音を取得した取得位置を示す位置情報を音声情報として取得する第2集音部と、
上記第1集音部が取得した生体音と、上記第2集音部が取得した位置情報とを対応付ける対応付け手段へ、上記生体音を示す生体音情報および上記位置情報を送信する送信部とを備えることを特徴とする聴診器。 - 上記第2集音部は、上記第1集音部とは異なる部材であり、音声の取得に適したものであることを特徴とする請求項10に記載の聴診器。
- 請求項1から6までのいずれか1項に記載の情報管理装置と、
請求項10または11に記載の聴診器とを備えることを特徴とする情報管理システム。 - 聴診器によって採取された生体音情報を管理する情報管理装置において、
生体音情報を採取される被験者の被験者情報を取得する被験者情報取得手段と、
聴診器を当てるべき測定位置を示す測定位置情報を1以上含む聴診支援情報を、被験者情報ごとに複数パターン記憶する聴診支援情報記憶部と、
上記被験者情報取得手段によって取得された被験者情報に対応する聴診支援情報を上記聴診支援情報記憶部から選択する聴診支援情報選択手段と、
上記聴診支援情報選択手段によって選択された聴診支援情報の測定位置情報を映像信号化して出力する出力制御手段と、
上記出力制御手段によって出力された測定位置情報のうちの1つを、上記聴診器から採取された生体音情報に紐付ける情報管理手段とを備え、
上記情報管理手段は、上記映像信号出力中の特定のイベントの発生を契機に取得した補助情報に基づいて、1つの測定位置情報を特定することを特徴とする情報管理装置。 - 上記出力制御手段によって出力された上記映像信号を光学的映像として、ユーザが視認可能なように投影する投影部を備えていることを特徴とする請求項13に記載の情報管理装置。
- 上記聴診支援情報記憶部は、上記聴診支援情報を、被験者の体格ごとに複数記憶するものであり、
上記被験者情報取得手段は、撮像部が撮像した上記被験者の被験者画像を取得し、
上記聴診支援情報選択手段は、
上記被験者画像に基づいて被験者の体格を推定し、推定した体格に対応する聴診支援情報を選択することを特徴とする請求項14に記載の情報管理装置。 - 上記投影部から出力された光学的映像は、上記被験者の体表面上に投影されることを特徴とする請求項15に記載の情報管理装置。
- 上記聴診支援情報において、測定位置情報ごとに測定の順番を示す測定順番情報が付与されており、
上記出力制御手段は、各測定位置情報をそれぞれの測定順番情報とともに映像信号化し、
上記情報管理手段は、
上記聴診器から上記生体音情報が受信されたことを契機に、上記映像信号が出力されてから上記生体音情報が受信された回数を補助情報として取得し、上記回数と上記測定順番情報とに基づいて、上記生体音情報に紐付ける1つの測定位置情報を特定することを特徴とする請求項13から16までのいずれか1項に記載の情報管理装置。 - 上記情報管理手段は、
上記聴診器が生体音情報の採取を開始したこと、または、採取中であることを契機に、撮像部が撮像した、聴診器が当てられている上記被験者の被験者画像を補助情報として取得することを特徴とする請求項13から16までのいずれか1項に記載の情報管理装置。 - 上記情報管理手段は、
上記被験者画像を上記生体音情報に紐付けることを特徴とする請求項18に記載の情報管理装置。 - 上記情報管理手段は、
上記被験者画像に写る聴診器の位置に基づいて、映像信号として出力中の聴診支援情報の中から、上記生体音情報に紐付ける1つの測定位置情報を特定することを特徴とする請求項18に記載の情報管理装置。 - 上記情報管理手段は、
上記被験者画像に写る聴診器の位置と、映像信号として出力中の聴診支援情報とに基づいて測定位置を特定し、特定した測定位置を表す模型画像を生成して、上記生体音情報に紐付けることを特徴とする請求項18に記載の情報管理装置。 - 上記出力制御手段によって出力された上記映像信号を、ユーザが視認可能なように表示する表示部を備えていることを特徴とする請求項13から21までのいずれか1項に記載の情報管理装置。
- 聴診器によって採取された生体音情報を管理する情報管理方法であって、
生体音情報を採取される被験者の被験者情報を取得する被験者情報取得ステップと、
聴診器を当てるべき測定位置を示す測定位置情報を1以上含む聴診支援情報を、被験者情報ごとに複数パターン記憶する聴診支援情報記憶部から、上記被験者情報取得ステップにて取得された被験者情報に対応する聴診支援情報を選択する聴診支援情報選択ステップと、
上記聴診支援情報選択ステップにて選択された聴診支援情報の測定位置情報を映像信号化して出力する出力制御ステップと、
上記出力制御ステップにて出力された測定位置情報のうちの1つを、上記聴診器から採取された生体音情報に紐付ける情報管理ステップとを備え、
上記情報管理ステップでは、上記映像信号出力中の特定のイベントの発生を契機に取得した補助情報に基づいて、1つの測定位置情報を特定することを特徴とする情報管理方法。 - 被測定者に対して聴診を実施するための電子聴診器と、
請求項13から22までのいずれか1項に記載の情報管理装置と、
上記情報管理装置によって出力された、上記電子聴診器を用いて実施された聴診の結果を示す聴診結果に基づいて、上記被測定者に対して画像撮像処理を実施する画像撮像装置とを含み、
上記情報管理装置は、さらに、上記電子聴診器によって採取された生体音情報を解析する異常判定手段を備え、
上記画像撮像装置は、
上記異常判定手段が上記生体音情報に基づいて判定した異常の有無と、上記生体音情報が採取された部位とを少なくとも含む聴診結果を取得する聴診結果取得手段と、
上記聴診結果取得手段によって取得された聴診結果に基づいて、異常が有ると判定された部位を特定する部位特定手段と、
上記部位特定手段によって特定された部位に対して、それ以外の部位に対する撮像とは異なる仕方で撮像を行い、上記被測定者の画像データを取得する撮像制御手段とを備えていることを特徴とする、測定システム。 - コンピュータを、請求項13から22までのいずれか1項に記載の情報管理装置の各手段として機能させるための制御プログラム。
- 請求項25に記載の制御プログラムを記録したコンピュータ読み取り可能な記録媒体。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/363,482 US20150230751A1 (en) | 2011-12-13 | 2012-12-10 | Information management apparatus, information management method, information management system, stethoscope, information management program, measurement system, control program, and recording medium |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2011-272783 | 2011-12-13 | ||
JP2011272782 | 2011-12-13 | ||
JP2011-272782 | 2011-12-13 | ||
JP2011272783 | 2011-12-13 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2013089072A1 true WO2013089072A1 (ja) | 2013-06-20 |
Family
ID=48612519
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2012/081959 WO2013089072A1 (ja) | 2011-12-13 | 2012-12-10 | 情報管理装置、情報管理方法、情報管理システム、聴診器、情報管理プログラム、測定システム、制御プログラムおよび記録媒体 |
Country Status (3)
Country | Link |
---|---|
US (1) | US20150230751A1 (ja) |
JP (1) | JPWO2013089072A1 (ja) |
WO (1) | WO2013089072A1 (ja) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2015174944A1 (en) * | 2014-05-12 | 2015-11-19 | Electrosalus Biyomedikal San. Ve Tic. A.S. | Auscultation data acquisition, communication and evaluation system incorporating mobile facilities |
JP2017000198A (ja) * | 2015-06-04 | 2017-01-05 | 日本光電工業株式会社 | 電子聴診システム |
JP2017136248A (ja) * | 2016-02-04 | 2017-08-10 | 公立大学法人岩手県立大学 | 聴診システム |
JP2019153141A (ja) * | 2018-03-05 | 2019-09-12 | メタウォーター株式会社 | 対象状態情報報管理システム及び対象状態情報管理方法 |
JP2020110356A (ja) * | 2019-01-11 | 2020-07-27 | オムロンヘルスケア株式会社 | 生体音測定装置 |
JP2020156624A (ja) * | 2019-03-25 | 2020-10-01 | 株式会社シェアメディカル | デジタル聴診器を用いた遠隔診療システム |
JPWO2021106865A1 (ja) * | 2019-11-29 | 2021-06-03 | ||
JP2021083944A (ja) * | 2019-11-29 | 2021-06-03 | 株式会社シェアメディカル | 聴診部位マッピングシステム及び聴診音データ生成アプリ |
KR102502620B1 (ko) * | 2022-07-22 | 2023-02-24 | 스마트사운드주식회사 | 인공지능을 이용한 질병 분류 방법 및 이를 위한 전자 장치 |
WO2023074823A1 (ja) * | 2021-10-28 | 2023-05-04 | テルモ株式会社 | 心音取得装置、心音取得システム、心音取得方法およびプログラム |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150077430A1 (en) * | 2013-09-13 | 2015-03-19 | CAPTUREPROOF, Inc. | Imaging uniformity system |
JP6072717B2 (ja) * | 2014-03-06 | 2017-02-01 | Necプラットフォームズ株式会社 | 測定支援装置、測定支援方法、測定支援システム、及びプログラム |
CA3041237A1 (en) * | 2015-10-22 | 2017-04-27 | Tyto Care Ltd. | System, method and computer program product for physiological monitoring |
WO2018102821A1 (en) * | 2016-12-02 | 2018-06-07 | Children's National Medical Center | Apparatus and method for identification of wheezing in auscultated lung sounds |
US11298101B2 (en) * | 2018-08-31 | 2022-04-12 | The Trustees Of Dartmouth College | Device embedded in, or attached to, a pillow configured for in-bed monitoring of respiration |
JP7302251B2 (ja) * | 2019-04-15 | 2023-07-04 | 東洋製罐株式会社 | 情報管理方法および識別情報付与装置 |
TR201917456A2 (tr) * | 2019-11-11 | 2020-11-23 | Atatuerk Ueniversitesi Rektoerluegue Bilimsel Arastirma Projeleri Bap Koordinasyon Birimi | Organ sesleri dinleme cihazı |
CN114359953A (zh) * | 2020-09-29 | 2022-04-15 | 华为技术有限公司 | 指示听诊位置的方法及设备 |
CN112914581A (zh) * | 2020-09-30 | 2021-06-08 | 世耳医疗科技(上海)有限公司 | 一种人体生物电检测设备、检测系统及检测方法 |
US20220199247A1 (en) * | 2020-12-21 | 2022-06-23 | Sheikh K. Jasimuddin | Telemedicine stethoscope device |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010044452A1 (ja) * | 2008-10-16 | 2010-04-22 | 国立大学法人長崎大学 | 情報判定支援方法、音情報判定方法、音情報判定支援装置、音情報判定装置、音情報判定支援システム及びプログラム |
WO2011034843A1 (en) * | 2009-09-16 | 2011-03-24 | 3M Innovative Properties Company | Electronic stethoscope system for telemedicine applications |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080081956A1 (en) * | 2006-09-29 | 2008-04-03 | Jayesh Shah | System and method for integrating voice with a medical device |
-
2012
- 2012-12-10 US US14/363,482 patent/US20150230751A1/en not_active Abandoned
- 2012-12-10 JP JP2013549259A patent/JPWO2013089072A1/ja active Pending
- 2012-12-10 WO PCT/JP2012/081959 patent/WO2013089072A1/ja active Application Filing
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010044452A1 (ja) * | 2008-10-16 | 2010-04-22 | 国立大学法人長崎大学 | 情報判定支援方法、音情報判定方法、音情報判定支援装置、音情報判定装置、音情報判定支援システム及びプログラム |
WO2011034843A1 (en) * | 2009-09-16 | 2011-03-24 | 3M Innovative Properties Company | Electronic stethoscope system for telemedicine applications |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10716533B2 (en) | 2014-05-12 | 2020-07-21 | Electrosalus Biyomedikal San. Ve Tic. A. S. | Auscultation data acquisition, communication and evaluation system incorporating mobile facilities |
WO2015174944A1 (en) * | 2014-05-12 | 2015-11-19 | Electrosalus Biyomedikal San. Ve Tic. A.S. | Auscultation data acquisition, communication and evaluation system incorporating mobile facilities |
JP2017000198A (ja) * | 2015-06-04 | 2017-01-05 | 日本光電工業株式会社 | 電子聴診システム |
EP3108816A3 (en) * | 2015-06-04 | 2017-05-24 | Nihon Kohden Corporation | Electronic auscultation system |
JP2017136248A (ja) * | 2016-02-04 | 2017-08-10 | 公立大学法人岩手県立大学 | 聴診システム |
JP7032957B2 (ja) | 2018-03-05 | 2022-03-09 | メタウォーター株式会社 | 対象状態情報報管理システム及び対象状態情報管理方法 |
JP2019153141A (ja) * | 2018-03-05 | 2019-09-12 | メタウォーター株式会社 | 対象状態情報報管理システム及び対象状態情報管理方法 |
JP7206928B2 (ja) | 2019-01-11 | 2023-01-18 | オムロンヘルスケア株式会社 | 生体音測定装置 |
JP2020110356A (ja) * | 2019-01-11 | 2020-07-27 | オムロンヘルスケア株式会社 | 生体音測定装置 |
JP2020156624A (ja) * | 2019-03-25 | 2020-10-01 | 株式会社シェアメディカル | デジタル聴診器を用いた遠隔診療システム |
JPWO2021106865A1 (ja) * | 2019-11-29 | 2021-06-03 | ||
WO2021106865A1 (ja) * | 2019-11-29 | 2021-06-03 | 株式会社村田製作所 | 生体音響センサおよびそれを備えた聴診器 |
JP2021083944A (ja) * | 2019-11-29 | 2021-06-03 | 株式会社シェアメディカル | 聴診部位マッピングシステム及び聴診音データ生成アプリ |
JP7367772B2 (ja) | 2019-11-29 | 2023-10-24 | 株式会社村田製作所 | 生体音響センサおよびそれを備えた聴診器 |
US12089002B2 (en) | 2019-11-29 | 2024-09-10 | Murata Manufacturing Co., Ltd. | Bioacoustic sensor and stethoscope including the same |
WO2023074823A1 (ja) * | 2021-10-28 | 2023-05-04 | テルモ株式会社 | 心音取得装置、心音取得システム、心音取得方法およびプログラム |
KR102502620B1 (ko) * | 2022-07-22 | 2023-02-24 | 스마트사운드주식회사 | 인공지능을 이용한 질병 분류 방법 및 이를 위한 전자 장치 |
US11937971B2 (en) | 2022-07-22 | 2024-03-26 | Smartsound Corporation | Method for classifying disease using artificial intelligence and electronic apparatus therefor |
JP7468948B2 (ja) | 2022-07-22 | 2024-04-16 | スマートサウンド・コーポレイション | 人工知能を用いた疾病分類方法およびそのための電子装置 |
Also Published As
Publication number | Publication date |
---|---|
US20150230751A1 (en) | 2015-08-20 |
JPWO2013089072A1 (ja) | 2015-04-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2013089072A1 (ja) | 情報管理装置、情報管理方法、情報管理システム、聴診器、情報管理プログラム、測定システム、制御プログラムおよび記録媒体 | |
JP7387185B2 (ja) | 生理学的モニタのためのシステム、方法、及びコンピュータプログラム製品 | |
JP7642134B2 (ja) | スパイロメトリデータを収集するための方法およびシステム | |
US20170007126A1 (en) | System for conducting a remote physical examination | |
KR101616473B1 (ko) | 스마트폰 원격진료기 | |
WO2013089073A1 (ja) | 情報解析装置、電子聴診器、情報解析方法、測定システム、制御プログラム、および、記録媒体 | |
US7300407B2 (en) | Handheld auscultatory scanner with synchronized display of heart sounds | |
EP1495721A2 (en) | Biological-sound data processing system, program, and recording medium | |
AU2017263802B2 (en) | A user interface for navigating through physiological data | |
JP2002052022A (ja) | 聴診器マウス | |
JP2013123494A (ja) | 情報解析装置、情報解析方法、制御プログラム、および、記録媒体 | |
WO2014017313A1 (ja) | 測定支援装置、測定支援方法、制御プログラム、および、記録媒体 | |
JP2020039526A (ja) | 体動検出装置及び放射線撮影システム | |
JP2020039525A (ja) | 放射線撮影システム | |
US11083403B1 (en) | Pulmonary health assessment system | |
JP2008167866A (ja) | 診断ロボット、診断ロボットの制御方法及び制御プログラム | |
JP2022119551A (ja) | リモート触診サポートシステム、情報処理装置、およびリモート触診サポート方法 | |
WO2009053913A1 (en) | Device and method for identifying auscultation location | |
JP2020081364A (ja) | 情報処理装置、システム、情報処理方法、およびプログラム | |
CN118317737A (zh) | 医学图像采集单元辅助装置 | |
KR20240114930A (ko) | 전자 청진기를 이용한 원격 진료 보조 장치 및 방법 | |
KR20230111288A (ko) | 스마트 헬스케어 장치 | |
JP2024140917A (ja) | 生体音検出装置および生体音検出方法 | |
WO2024220490A1 (en) | Electronic digital stethoscope and uses thereof | |
KR20210035504A (ko) | 의료영상과 청진정보가 결합된 환자 상태정보 제공방법 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12857847 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2013549259 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14363482 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 12857847 Country of ref document: EP Kind code of ref document: A1 |