TW201216255A - Method and system for self-managed sound enhancement - Google Patents

Abstract

A system and method are provided for capturing hearing characteristics from self-administered hearing tests or from professionally administered hearing tests, including loudness tolerance levels as at different sound frequencies, as an individualized audiological profile for automatically enhancing audio to complement and address as closely as possible an individual's hearing deficits. The user may self-administer a hearing test on a convenient personal apparatus, such as a smartphone. The system includes the ability for capturing an environment profile. The user's hearing is protected against harm in the enhanced audio setting while being provided with the option of a ''enhanced hearing'' experience. The invention is useful for any individual seeking an enhanced hearing experience, whether having hearing within normal range or hearing that is impaired. Thus the system is useful as a hearing aid.

Description

201216255 VI. Description of the Invention: CROSS-REFERENCE TO RELATED APPLICATIONS This application contains the assignee of the present application, the assignee of the present application, the number of the applicants in the year of the year, 8" 61/371,068 and September 2010丨The subject of the co-pending provisional application submitted on the day. Regarding the non-applicability under federally-sponsored research and development, the "Sequence List List appendix does not apply ^ on the disc, and the transfer to the 5th-issued statement No. 61/379, 237, Or computer program [Technical Field to Which the Invention Is Affected] The present invention is generally directed to audiology and digital sound for a system and method based on personalized auditory profiles. [Prior Art] Hearing loss has been evaluated as In developed countries, millions of people around the world suffer from hearing impairment and are not aware of their hearing loss. The decline in hearing includes age, health, occupation, injury, and disease, and the common practice of enhancing user experience. Disability. Many of these abilities may be caused by many factors in the package 201216255. Loss of hearing may lead to a significant decline in quality of life, impaired interpersonal relationships, reduced job opportunities and reduced productivity. Different types of hearing loss and related conditions May affect people’s daily activities in different ways, especially Talk and listen to music. Usually 'hearing sensitivity to high-pitched sounds tends to drop first. People don't usually realize that their hearing sensitivity drops until they suffer from hearing problems, for example, it's difficult to hear conversations on the phone or in noisy Listening to problems in the environment. For people with hearing loss, their static power is usually sufficient in most cases. Because their hearing loss is tolerable, they tend to ignore this or find a solution. Avoid talking by phone in noisy environments and don't like to seek help from a hearing health professional. Individuals with significant hearing loss can call a hearing health professional to get a prescription and get a hearing aid! ^Although wearing a hearing aid is considered to be hearing : Lost patients invade one of the smaller assistive technologies' but it is not without asking. People who use hearing aids to make phone conversations or enjoy music through headphones are awkward and inconvenient to use. Microphone hearing aid pickup Feedback noise, screaming. A common problem associated with hearing loss is tinnitus. The conscious experience of the sound of the ear (ie, not the 孭 / / , 罟 罟 ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) A ringing tone that interferes with multiple frequencies and his voice. Tinnitus is a significant audible loss of power for common diseases and symptoms. It is known that tinnitus is combined with age-related audio-visual individual n 曰 different degrees and in many different ways Mode ps people. Some people with chronic ear can ignore the disease,

S 5 201216255 And others will feel tinnitus ^, disturbing people, distracting, and even becoming disabled. Tinnitus can interfere with sleep, cause emotional grief, and have a beneficial effect on health. Many tinnitus geniuses & their intended tinnitus changes in different sound environments, more annoying in a silent environment and less annoying in a sound-rich ring: This regulation has led to the development of sound therapy for tinnitus treatment. The most common recommendation is to “avoid silence” by enriching the background sound. This can be achieved by simply playing some background sounds or music. More sophisticated sound therapies include measuring the pitch and loudness of the tinnitus signal' and providing signals that can be played through the ear level device and the sound generator. One aspect of the present invention is that hearing PF 〇 flling is performed, in particular, by self-management testing. The lowest audible hearing level of the pair-group hearing measurement frequency was measured during the hearing profiling period. Various methods for obtaining the lowest audible hearing level are known. However, during the application of hearing analysis to the hearing enhancement device (for example, a hearing aid, a personal listening device such as a smart phone, etc.), one can insist on increasing or decreasing. Volume of the device: Audio that is enhanced by other means, the enhanced audio is the second part of the audio measurement and the determination of the hearing profile and the change of the hearing profile. One problem is to enhance the unintentional second discomfort and damage in the audio. A person may have a lower tolerance for a certain hearing frequency: a person's tolerance to the south and a lower tolerance for another frequency. The sound tolerance tolerance between people is different. This difference is less pronounced between people with normal hearing. However, for people with hearing impairments that are not at the same level as 201216255 (such as hearing loss, tinnitus, and hearing loss with tinnitus, this is not the case. Because of the difference in the sound and sound profile of a person's person with normal hearing The hearing curve should not be used as a standard. Because of &, adjusting the force curve without regard to the human's acoustic tolerance tolerance profile may result in hearing discomfort or damage. Increase the device volume early. Fully audible and understood by the sound enhancement process, the enhanced audio is dangerous. Increasing or decreasing the device volume implies an audio that passes through the same factor inflammatory, or large, or reduces the audio frequency of all audiometry. People usually need Amplify the frequency of the hearing measurement for each limited range of UP 0 and fly fine j. Increasing or decreasing the loudness of the audio of all H frequencies may lead to a series of hearing problems. It is necessary to be able to handle different sound levels with different levels of hearing impairment. Tolerate the short label (four) ', and more specifically, the solution to the problem found in this article, the second question, such as in a telephone conversation Hearing difficulties caused by feedback from the use of hearing aids during listening to music. Some patents relating to the present invention are Nos. 7,613,314, 7, 5 2 9, 5 4 5, β, and 6, 944, 474 US Patent. SUMMARY OF THE INVENTION In accordance with the present invention, a method and method for generating a substantially normal hearing experience in a hearing impaired individual is provided. In particular, the present invention includes capturing an individual. Audio j# six 4 main feet r, 丨 + , , features to generate a personalized auditory profile; analyze the personalized auditory profile; generate the result of the processing; then automatically enhance the rounding signal of the audio reproduction device to the field, &, 》 The result of personal processing, to achieve a full-fledged audio experience. Processing # at $ > 1 θ, ~ fruit including based on frequency loudness enhancement 5 7 201216255 human hearing parameters and solution and Compensating for other hearing-related features required for personal hearing. This allows the activity to be as close as possible to normal hearing standards while maintaining a safety margin to prevent over-proof or further hearing impairment. Personal users can self-administer audiometry using personal devices (such as smart phones). Personalized hearing profiles typically include the following: (丨) three typical loudness levels at each hearing measurement frequency (ie, optimal level, Measured values for discomfort and minimum audible level; (2) measured values from tinnitus tests with tinnitus loudness and pitch; and (3) custom settings for the user's settings can include inclusion in a noisy environment The setting is performed or selected by the user to be used in a noise environment. The present invention is intended for any individual seeking to enhance the listening experience, regardless of whether the hearing is within the normal range or has been compromised. For a hearing aid. In particular embodiments, the various separate functions of the present invention can be combined into a single multi-function device or multiple devices. The soft-based system in accordance with the present invention can perform various functions in a system with any computerized smart phone, personal amplifier or body with personalized listening, or remote storage. The features are characterized and analyzed to be stored locally or remotely, and then as a programmable audio reproduction device (eg personal amplifiers or their combined material (eg, pre-recorded audio reproduction. Simplified in audio reproduction devices) The local storage of the files is performed on a removable storage device (for example, a combination of personal computers, smart ones). The personal audio based on the soft system captures a specific frequency is listened to as a personalized hearing profile 6 This profile is used as a control input to enhance An audio 'audio program or similar source music from a suitable computer, a smart phone, or the like) is programmed by the T audio reproduction device, and the signal processing includes: receiving an audio channel in the form of a time domain sound 201216255 frequency signal. & material, capturing and analyzing the current frequency composition of the acoustic environment to thereby generate a current environment pre-environmental environment profile reflecting the two networks', and the acoustic environment is changed to a pulse response digital killer (four) If a (4) wave device is present, the stored personalized audio profile and the current % environment profile are applied to the frequency of the audio suffix - group required ^ The difference is in the pre-selected vertical frequency audio program material; the modified wide material is converted from the time domain to the frequency domain; by modifying the sound (four) material at each auditory frequency The level and the individual's voice are sound-sensitive (hereinafter also called discomfort w. . a and 嘀 #HU) to compare the loudness of the modified audio program material, and the plastic product at the rate. The rainbow's selected frequency half a degree to produce a frequency domain sound equivalent time domain audio output, ... converts the frequency domain sigma frequency signal into a nine 13 57 , and transmits the time domain audio output signal to the individual. Audio hearing characteristics The H is stored in the local end, and the processing of the interpreter is performed on the personal device and can be stored locally on the personal device, such as the Internet, and stored in the electricity. At the central hearing processing center where the link is connected, it is retrieved as needed to reproduce the sound according to the principles of the present invention. Environmental Sources ("In each of the embodiments, the principles of the present invention may exist in the presence of a brother" > News or colored noise) In the case of the case, or go; the case where both of the Tusi 丄廿 焉 存在 are applied to the audio program. According to the present invention, the sensory level (SL), / tinnitus loudness refers to the individual tinnitus t The guide, " by subtracting the tinnitus from the individual tinnitus intensity, and the audible level to calculate. Although '·, 曰 tinnitus, but use different methods to solve the problem of using sound therapy. According to the capture In the form of 9 3 201216255, the audio hearing characteristics and loudness of the personalized auditory profile are generated, and the tinnitus mitigation signal is generated. The tinnitus pitch in the ', 里 TM ^ ^ ^ ^. These mitigation signals are used independently (no other increase 35 It is part of sound reproduction by horse. The invention allows the computerized device to be accommodating LV t ^ j user valley easy to generate personalized hearing 祜 to supplement the personal needs of the j member, and at the same time to enter the choice a, Φ au 扛 for dry discomfort and hearing damage degree ^ Bring the user's listening experience back to "normal,. In addition, test results that can be captured, analyzed, and local and / or managed and other two: when storing self-managed and special listening experience, the choice of land' The user can modify the normal hearing experience that has been arrested according to his or her preference. The present invention recognizes that the difference between the result of the test and the sound enhancement process is the same as that of the sound enhancement process. In the two ^s support bridge. According to the main factors that prove the feasible method, the force feature is the sound enhancement process to achieve the normal hearing 8 test. This will be more clearly understood with reference to the following detailed description and with reference to the accompanying drawings. [Embodiment] The hierarchical ring (4) shows the high side 4 of the personal device 1, and there are eight, "the member 2, the pair of headphones 3, and the control device are intervened and the keyboard." The device ^ stores or receives the test scenario 5 initiated by the individual user 6 via the control 4, and then interacts with the responding user 6 into the auditory sense as explained below. Generate personalization as explained below. The personalized auditory profile is stored locally (s) on the device 1a

S 10 201216255 Removable storage device (May finger drive or non-volatile far =: store: m link 8β remotely stored in accessible storage system 8 。. Personalized auditory profile is used for the same The heart is wide: (4) on the above, thus the output to the same earphone 3 or speaker 9, the 曰县号 is modified. The audio signal output heart programming material u is the second: the frequency-related and time-related characteristics of the material 11 are personalized For the implementation of the present invention, a custom enhanced sound τ (CES) system μ is provided for information input and auditory profiling. Analyze, visualize (1), react (4), and sub-systems and classes of repositories. The classes described in this paper are software-based groups of objects with similar performance, common behavior, mutual relations, and common semantics. The subsystem is a group that collaborates to perform the actions that the subsystem is responsible for. In the subsystem, 'each class works by performing different tasks and communicating with each other to complete each task. When the software is on the general hardware platform with the appropriate capabilities, one or more devices 1Α/1Β/8Α of the system 1〇 provide the dual function of testing to generate the sound and reproduce the sound in a specific environment. In the test mode The system 10 interactively measures the individual's hearing ability in one function (usually used before subsequent storage) and measures the ring 3 brother's voice/noise (usually simultaneously) in another function. System 〇 Local or remote storage Personalized hearing profile. System 丨〇 local storage environment profile. The raw data can also be analyzed locally or remotely (via the telecommunication link) to generate a personality 5 11 201216255. In the reproduction or the current replay mode of Cao De, the system 1 源 4 4 r r r r r 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改 修改And 'and preferences in specific soils' system 10 captures and /3⁄4 Libeco or receives captured data, ^^^ . , analyzes the shellfish, generates a g-definition y standard for each hearing frequency The target gain and/or the tinnitus number is applied to the hearing signal, and the enhanced hearing output signal is formed to prevent ♦ unscrupulous or harmful (four) degrees. The components of a CES system 10 include an auditory profile subsystem, a system 12, an analysis subsystem 14, a display subsystem 16, a user identification subsystem 18^system 20, a back-to-the-cash system, a crying 99, a current control $22, and A data repository 24 that communicates with a repository 26 (which may be local or remote).疋 Hearing Subsystem The Hearing Profile Subsystem 12 performs tests related to the audio hearing characteristics of each ear. The responsibilities of the subsystem include: determining the user: the hearing characteristics; determining the user's tinnitus characteristics 4 determining the user's optimal loudness level for each hearing frequency; determining the user's uncomfortable level for each frequency; generating the required audio "" In the audiometric measurement, the user's audio listening characteristics are determined by the professional management of the auditory social characteristics; and the categories in which the personality is generated include: professional management, "sense class 2 8; tinnitus matching test 2 '' then try selector 3 4 See Figure 2, auditory profile subsystem audiometry class 27; self-administered listening class 3; comfortable and uncomfortable hearing level test class and audio test signal generator class 36. 12 201216255 Analysis Subsystem Analysis Subsystem 1 The results of the 4 divisions are generated by C-personalized auditory screeds and generated at the audio output signal 1 sub-li/frequency signal sub-system to generate enhanced Tan; determining the required audio ^ Responsibilities include: interpreting the user's auditory brief; generating a specific mitigation that corrects one or more types of mitigation sounds to mitigate the sound of the class 2 processing user's custom settings. The noise and state sounds are:)) = 曰 and e) pure audio signals. Referring to Figure 3, the subsystems and classes of the analysis subsystem u include the Xingzi system 38 and the signal processing subsystem 4. , Sound Reduction Subsystem: Customizer Class 4 "Gain Subsystem 3δ class is gain algorithm selection: I5, and target gain calculator 37. The classes in the signal processing subsystem are derivatives selected for benefit 39 and filtering occurs. The sound mitigation subsystem u '", the sound mitigation selector 43 and the sound mitigation generator 45, the user identification subsystem process and maintains the personalized identity; the $profile is checked. See Figures 4, 48 and User identification 50. The user identification subsystem 18 manages the user identification auditory profile. The responsibilities of the subsystem 18 include determining the identity of the user; and the classes in the maintenance user's personalized auditory user identification subsystem 18 include the profile object audio signal subsystem audio signal. Subsystem 20 manages all problems with 3 13 201216255. The 栝.攸θ frequency programming source of the subsystem acquires the pre-enhanced audio signal; according to the processing result of the tool analysis subsystem, the enhanced frequency is generated from the preamble The audio signal; and the scheduling of the signal. Referring to Figure 5, the audio signal subsystem audio signal acquirer 52, the sound murder, the illusion class has been dry 56. ^ 52 The 遽 scheduler 54, and the audio processor display subsystem display subsystem have a user interface element 16 that provides a traditional design that interacts with the user when using the present invention and can be a suitable system. Data Warehousing Connector Data Repository The connector 24 is a class for the (4) repository 26. The responsibilities of this class include: establishing... the database query statement; obtaining/updating/inserting/clearing from the data repository, ', generating capital: (4) The data is retrieved from the library. j. In addition to Beca' and the response from the data repository 26, the content that the controller needs to display for decryption will be displayed on the display subsystem. The controller 22 is a module that is interpreted according to the request. Responsibilities include the necessary information to determine and present. Logic flow of the framework 14 201216255 Figures 6A and 6β and the following paragraphs depict the logic flow of the CES system 1 and process 100 in accordance with the present invention in an activity diagram. And the activity diagram of the software-based system shown in FIG. 6B is generally a node that does not require force to be used, and includes elements of the sound enhancement process, the native force b and mutual relationship. The sound enhancement process includes: monitoring the user equipment centroid 102, determining whether the user profile exists and the location where the profile is stored 104, detecting the environment noise level 1〇6; generating a personalized auditory profile Mg; Determining the profile and time of the user profile; analyzing the personalized auditory profile 112; : generating an enhanced audio message through the 114; and playing the enhanced audio of the enhanced L-band on the user device. For the sound enhancement process Several of the main steps 'have the following general (virtual code) on; some exemplary embodiments provided by: monitoring user equipment status (checking equipment status) - checking the presence of the power signal of the equipment, if there is a power signal, Mark the device status as ON. 〇 If there is no power signal, mark the device status as off (). **Software-based systems continually and in parallel perform device state monitoring in parallel with other processes in the sound enhancement process. At any given point in time, if the device status is OFF, the software-based system will stop running. Check the existence of the shortcast and the location where the profile is stored

S 15 201216255 Check internet connectivity 〇 If there is no internet connection and the device status is 0N • Check the presence of the profile • If the local device has a profile, 〇 Check the slate age • If the local device has no profile and the device The status is 0N, 〇 check the surrounding noise level and generate an audible profile. 0 If there is an internet connection and the device status is 〇N, check the presence of the profile and the location of the profile • If the data repository has a profile and device status 0N, 下载 download the profile from the data repository to the local device 〇 check profile age and signal enhancements • if the local device has a profile and the device status is 0N, upload the profile from the local device to the data repository 〇 Check profile age and signal enhancements • If both the data repository and the local device have a profile and the device status is 0N, 〇 compare the timestamps of the two profiles

S 201216255 If the local slot is recent and the device status is 0N, • Upload the profile from the local device to the data repository • Check profile age and signal enhancement if the profile in the data repository is recent and device status 0N, • Upload the profile from the data repository to the local device • Check profile age and signal enhancements • If no profile is found and the device status is 0N, 〇 Check the ambient noise level, then generate a hearing summary Age and Signal Enhancement - If the profile age is greater than one day and the device status is 0N, 〇 Reset Profile Age 〇 Check Profile Existence and Profile Save Location 17 5 201216255 - If the profile age is less than or equal to one day and the device The status is 〇N, 〇 Check the CES status. If CES is enabled, • Analyze the personalized audio profile to generate enhanced audio signals. Play enhanced audio. If CES is disabled, • Play pre-enhanced audio check around noise level (environment) _Measure the level of surrounding noise 〇 if the surrounding noise level is greater than 4 5dB and the device status, etc. a warning message is displayed on • Check the noise level around the square

个性 If the surrounding noise level is less than or equal to 45 dB and the device status is equal to 0N, a personalized audio profile is generated. During the replay of the audio program material, the environment profile is continuously updated in real time. The typical period for updating the environment profile is l〇〇ms. However, in a slowly changing ambient noise environment, the update is approximately at a frequency of a digital sound sampling rate from about 16 ms to 50 ms to several minutes. Generate a personalized auditory profile - choose the type of audiometry to perform 〇 If the user chooses self-administered audiometry

S 18 201216255 Perform pure tone audiometry on each ear separately • Play audio signals at each hearing measurement frequency • Ask the user to select the smallest audible level at each hearing measurement frequency • Repeat pure tone audiometry until used for all hearing The minimum audible level of the measured frequency is captured to perform an uncomfortable hearing determination for each ear separately • play an audio signal at each hearing measurement frequency • ask the user to select an ill- loudness level at each hearing measurement frequency • repeat the discomfort hearing measurement until The uncomfortable loudness level for all hearing measurement frequencies is captured to perform an optimal hearing measurement for each ear separately • Play an audio signal at each hearing measurement frequency • Ask the user to select the optimal loudness level at each hearing measurement frequency • Repeat Optimal hearing measurement until the optimal loudness level for all hearing measurement frequencies is captured " the user wishes to perform the tinnitus matching test • If the user wants to perform the tinnitus matching test 〇 perform the tinnitus matching test 19 201216255 Determine the test ear determine the tinnitus type match the tinnitus Pitch matching Tinnitus loudness • If the user does not want to perform a tinnitus matching test, skip the tinnitus matching test if the user selects a professionally managed hearing test for each ear input for all hearing measurement frequencies for air conduction without obscuration for the minimum audible level for each ear Input air conduction for all audiometry frequencies with masked minimum audible level for each ear input for all audiometry frequencies for bone conduction unobstructed minimum audible level for each ear input for all audiometry frequencies The minimum audible level input with occlusion of the bone conduction is used for all hearing measurement frequencies. The minimum audible level of the prefrontal bone conduction without occlusion is the minimum audible for each ear input for the forehead bone conduction for all audiometry frequencies. Level for each ear input for all hearing measurement frequencies for the uncomfortable loudness level for each ear input for all hearing measurement frequencies for the optimum loudness level input tinnitus matching results

S 20 201216255 Enter the result of the language acceptance threshold test Enter the result of the language recognition test Input the audio source used in the language reception threshold test. The audio source used in the 5 recognition test generates a personalized auditory profile based on the captured data. As indicated above, the tested protocol was used for hearing sensitivity at different frequencies and other protocols tested were used for personal tinnitus. The tinnitus pitch, the ear sensation level, and the tinnitus minimum audible level are referred to as the tinnitus matching process. The type of tinnitus contemplated by the present invention is: subjective, i.e., perception of sound in the absence of any external sound source. The program is implemented in five steps. See Figure A, (these steps are: test the ear um um tone number determination (B); tinnitus type correct pronunciation south (1); and tinnitus sensory level determination (e explain these steps in detail. 乂I' Wenping step 1 The purpose of the test ear determination is to determine which ear is used as the test ear. The tinnitus can be perceived at different locations: the one-sided, 报告 reported tinnitus position' will select the test ear accordingly. Figure _P according to the included program and most It is not necessary to explain the outlined steps. The next point relates to the special sensed tinnitus report position θ nD will be considered as test 4 (AA) then 'the opposite side of the ear

The opposite side of the ear is intended to make the possible # % I t between the ear 21 S 201216255 and the test stimulus. Minimize and improve the accuracy of the results. If the perceived position of the sensitive chicken is biased to the side, then the opposite ear will be considered the test ear (AA1.. Aurora AA). Choosing the opposite side of the ear and the possible stimuli between the test stimuli, the child j 1 combat accuracy. This interference is minimized and the test results are refined. If the perceived ear σ bird's newspaper owner, you θ η position is neither personal head

Without leaning to one side, then the ears of Xinggu k ^ J gossip I will be considered as test ears (1)). In the absence of a difference in hearing ability between the two ears, the S-ear will be randomly selected (AC). Step 2: Deafness tone determination Tinnitus is considered to be related to the tone. The purpose of this step is to determine the number of tones that the user perceives. Referring to Figure 9, the determination process will ask the user for the number of deaf tones and save the input value (BA). In an embodiment of the invention, the test focuses on the most disturbing tinnitus tones (usually for individuals, subjectively determined by the individual). In another embodiment, the test focuses on the two most prominent ear's tones. In yet another embodiment, the test and its profiling support any tinnitus pitch number' in which case all such tones will be noted (BB). Step 3: Tinnitus type determination The purpose of each step is to determine the type of tinnitus (tone tinnitus or similar)

miscellaneous , ! -*» 1 η - I horse). Figure 10 shows no such step. The program sets the test accordingly

S 22 201216255 Try #号型 (CA). If the user has a right-handed corpse with tone tinnitus, then the test # number type will be in pure note form (CB). The user has a similar noise to the tinnitus, then the test signal type will be the shape of the narrowband noise & (CC). In an embodiment of the invention, the determining process begins by playing two test signals to the user at 4000 Hz, one test signal being in the form of pure tone and the other test signal being in the form of narrowband noise. The test signal is selected to play at 4 beeps because most people report tinnitus in the range of 4〇_z. The user is asked to compare the test signals and select the test signal that sounds closest to 1 tinnitus. Depending on the user's choice in the test signal, the type of tinnitus will be obtained and the type of test signal will be set accordingly. Step 4: Tinnitus pitch

The purpose of this step is to measure the user's perceived tinnitus pitch. This determination process will play a test signal for the range of the hearing measurement frequency. Each test signal is played on a 1 〇 ship, which means that 10 dB for the corresponding frequency is greater than the minimum response level of the predicted measurement. The user will select the test signal that sounds closest to the user's own tinnitus. In one embodiment of the invention, the user needs to repeat the tinnitus tone determination three times, and the final matched ear pitch pitch is the average of these measurements. If the user has more than one tinnitus tone, the user will have to perform the tinnitus tone determination six times, performing a three-tone determination for each tone tone. % There are different ways to measure the tinnitus pitch. In the embodiment of the present invention, the discrete frequency method is used. The test signal will be set to the form of discrete 23 " 201216255 data. The determination process using two optional forced selection methods provides a pair of test signals, and the user will select the pitch to be close to the test signal with the ° bird. Figure 11 is an embodiment of tinnitus determination. The determination process begins: 4〇_z. This choice is because most users report that their tinnitus is at about 4〇_z. The test completion standard is the accuracy of obtaining i coffee for all frequencies. In a further embodiment of the invention, a continuous frequency method is used. Referring to Figure 12, the test signal can be set to take values at limited intervals of frequency. The user selects the test signal whose pitch is close to the user's tinnitus. Step 5: Tinnitus sensory level, minimum tinnitus audible level, and tinnitus level determination f Three levels of testing, such as minimum sensory level, comfort level, and UCL level, can be applied to each tinnitus tone. In this regard, the 'three-level test' needs to be explained; the flow charts in ® 13A and 13B are exemplary. In the multi-feature test shown in Figures UA and 13B, the determining step begins by setting the frequency of the test signal to the identified earing pitch (EA). The next task is to identify the minimum audible level (EB) at the pitch of the tinnitus. The determination process plays the test signal at different audible levels and the user is queried to identify the test signal that the user believes to be the smallest audible level. This is an iterative process. The test then identifies the sensory level of its tinnitus. During the determination process, the test signal is placed at a different audible level (starting at a level below the minimum audible level). The user is asked to identify the test signal whose loudness is equal to the user's tinnitus. At this time, the sound intensity is set to the ringing loudness (EC). By ringing loudness from the ear (ec) ^

S 24 201216255 Mind the minimum audible level (EB) of the tinnitus to calculate the tinnitus sensory level. In one embodiment, the tinnitus discomfort level (TUCL) is captured by playing a narrowband noise of the already recognized earing pitch to the user and requesting the user to confirm the loudness level of the noise that caused the discomfort. In another embodiment, the user needs to repeat the tinnitus sensory level and the tinnitus minimum audible level determination three times. The sensory level of the final match is the average of these measurements. If the user has more than one earing tone, then these tinnitus tones need to be determined. A personalized auditory profile including the analysis results of the ear bird test can be obtained prior to the sound reproduction (i.e., the sound enhancement process). This profile can be updated in any predetermined schedule 'but it is usually updated daily to ensure that the sound enhancement process is recent. Figure 14 generally summarizes the process by which the sound of the present invention adds audio program material as an audio signal to a personalized auditory profile 2〇4 and preferably to the latest (i.e., most recent) environment profile 2〇2, As further depicted in FIG. The sound enhancement process begins with the acoustic environment frequency composition analysis (FA). The system automatically captures and analyzes the frequency composition of the acoustic environment. As described above, the system then generates an environment profile 2〇2. The system provides, stores a personalized auditory profile 2〇4 (including minimum audible level, acoustic sound tolerance level, and current environmental profile), personalized auditory profile 2〇4 and = frequency signal - used to adjust the increase纟 (FB). The environmental profile and personalized listening are used to obtain the filter or filter coefficients or parameters, such as finite impulse response (FlR); t-wave 2G6. The waver is used to provide a desired specific frequency gain that is determined based on the personalized auditory simplification from any source and the audio signal Em of the audio program material. The corresponding gain is adjusted by the incoming 25 201216255 audio 彳§ number. As the modified audio signal is generated, the system converts the modified audio signal from the time domain audio signal to the frequency domain audio signal (FC) by the Fourier analyzer 210. Thereafter, applying the time domain audio signal (FD) acoustic sound tolerance level analysis by performing the acoustic sound tolerance level analyzer 212 includes checking the loudness of the modified audio signal and based on the stored personality The auditory profile compares the loudness of the modified audio signal to the user's acoustic loudness tolerance level at each of the hearing measurement frequencies. If the loudness level at a particular frequency is greater than the user's acoustic loudness level, the system will adjust the loudness (FE) accordingly. As the tolerance level analysis is completed, the system converts the adjusted frequency domain audio signal back to its equivalent time domain audio signal (ff) in the inverse Fourier transform module 214, thereby producing what is needed for enhanced audio playback. Enhance the audio signal. Then release any loudness warning signal provided to the user. In one embodiment of the invention, the system ι 〇 will be audible tolerant to the sound level and will be static. In the other embodiment of the present invention, the high force, the tinnitus sensory level, the tinnitus, the most j 1 ά ν, the tinnitus sound and the small audible level, and the ear sound tolerance Level, and I as the type of hearing loss that will have tinnitus. ~ ▼ Shoulder Hearing System 10 provides the user with a ^ ^ ^ and manual gain adjustment. The automatic gain adjustment option is different from the 'item' option. Manual edge adjustment

26 201216255 In one embodiment of the invention, system 1 begins with the function of activating the acoustic environment frequency composition analysis. The system automatically captures and analyzes the frequency components in the current acoustic environment and generates updated environmental slots in a predetermined schedule (typically every 50 ms). The system then uses the updated environmental profile characteristics to automatically determine the amount of gain required to allow the user to comfortably listen and understand the enhanced audio as needed without suffering any new or further cues and damage. In another embodiment of the invention, system 10 provides a plurality of gain adjustment options to the user. The user can automatically adjust the amount of gain needed to listen to and include enhanced audio that is managed by the sound enhancement process in various environments. In summary, this software-based system automates the enhancement process of audio from computerized devices to complement the user's unique audio-visual features based on the user's personalized auditory profile. Personalized auditory simplifications can be obtained through self-administered audiometry or professionally managed hearing. Self-official, hearing measurement refers to the simplification produced by computerized devices. This method performs a capture process on each ear, and this method includes performing force measurement, UCL testing, optimal level (MCL) testing, and/or tinnitus matching testing. Not all of these tests must be used for system iq and are considered optional. The system saves the personalized auditory profile in the local hearing enhancement device and/or submits a copy to the data repository. The professional management test refers to the roots, although the health professional M provides the f material to compile the slot. As summarized below, the data from the professional test includes pure tone audiograms and off-MCL test results for each hearing measurement. The security provider can access the data on the appropriately enabled device or access the network access data repository via the Internet. 27 201216255 A software-based system in accordance with the present invention will be capable of receiving any parameters from a professionally generated audiogram. According to standard names in the art, these parameters include: unshaded or obscured AC in conventional tests, BC unobscured or obscured, BC forehead unobscured or obscured, pta, MCL, UCL, SRT Language recognition, and audio sources used in language reception threshold (SRT) and speech recognition tests, ie, sound clips on CD or tape, or computer generated sound clips for the left and right ears at the following frequencies :

Hearing level at -125Hz dB at hearing rate dB - hearing level at -500 Hz dB at hearing rate dB at ~1 kHz dB at hearing loss at 2 kHz hearing level at 3 kHz dB at 4 kHz Listening level at ~6kHz dB - Listening level dB at 8kHz By default, the system uses the most recent personalized auditory profile as the basis for its sonic and reluctant processes. During operation, the system compares the most recent personalized auditory slot with the profiles in the local device and data repository. If the profile stored in the data repository 26 is updated, the profile will overwrite the local version (unless otherwise configured). If the profile in the local device is newer then the system uploads the local profile to the data repository. When there is no internet connection, the system uses the local profile for the sound enhancement process. Capital

The comparison process between S 28 201216255 ' is usually performed daily as the profile of the local device changes to the frequency of monitoring. Whenever the system detects a change, 仃 calculates the gain and uses the updated data to perform the sound enhancement. ..., new, see below, an exemplary implementation of the CESound (also known as the ACHEearing process) in accordance with the present invention is characterized as a series of virtual code lists. In order to make this virtual code more ambiguous, for the sake of brevity, no attempt has been made to describe it using a specific language (such as Java) that is common in programming languages. The intent here is to make use of general statements, and the interpretation of some general statements is obvious to those of ordinary skill in the software programming arts. Enable CESound(Boolean enable) { /氺氺•If the user turns off CESound ' then disable all filter wood / if (enable == false) { disableAllFiltersO; return; } /氺氺* If the user opens CESound, then do the following: * - Get the user's auditory profile * - Calculate the appropriate filter parameters according to the current algorithm * - Generate input filter (for use by the device being captured, Example 29 5 201216255 such as microphone or sound card input) * - Generate output filter (for output devices such as speakers or headphones) * - Apply input filter to the device being captured * - Apply the wheel filter to the output device

UserProfile userProfile = getUserProfi1e(); Fi1terCoefficients fi1terCoefficients = calculateFilterCoefficients(userProfile);

Array inputFiIters = generatelnputFilters(filterCoefficients);

Array outputF iIters = generateOutputFilters(fi1terCoefficients); applyFilters(inputSource, inputFiIters); applyFilters(outputDevice, outputFiIters);

UserProfile get UserProfile() {

UserProfile userProfile = new UserProfi1e(); // the UserProfile object to be returned / wood* If you can connect to the central repository of the remote repository, synchronize with the central repository to find out if the user has the most recently launched user File if (connectToCentralDatabase() == true) { 201216255

User user = getCurrentUser(); userProfile = syncUserProfile(user); } else { /氺* If you are unable to connect to the central repository, then use the recently launched user profile in the local repository of the *device wood / userProfile = getLocalUserProfi1e() ; return userProfile; perform HearingTestO {

UserProf i1e userProfile = new UserProf i1e(); performMinimalAudibleLevelTest(userProfile); performMostUncomfortableLevelTest(userProfile); if (mode ID ia log A sk(" Would you like to perforin Tinnitus Matching?")) { performTinnitusMatchingTest(userProfile); acquireUserlnformationO; saveToLocalDatabase(userProf i1e); saveToCentralDatabase(userProfile); 5 31 201216255 perform MimimalAudibleLevelTest(UserProf ile userProf ile){ userProfile.setMALRightlOOO(RIGHT_EAR, 1 000 ); userProfile.setMALRight2000 (RIGHT_EAR, 2000 ); userProfile.setMALRight4000(RIGHT_EAR, 4000); userProfile.setMALRight8000(RIGHT_EAR, 8000); userProfile.setMALRight250(RIGHT_EAR, 250); userProfile.setMALRight500 (RIGHT_EAR, 500 ); userProfile·setMALLeft1 000 (LEFT-EAR, 1 000 ); userProfile.setMALLeft2000(LEFT_EAR, 2000 ; userProfile.setMALLeft4000(LEFT_EAR, 4000); userProfile.setMALLeft8000(LEFT_EAR, 8000); userProfile. setMALLef 1:250 (LEFT-EAR, 250); userProfile.setMALLeft500(LEFT_EAR, 500); perf Orm MostUncomforableLevelTest(UserProf i le userProfile) { userProfile.setMALRightl 000(RIGHT_EAR, 1 000); userProfile.setMALRight2000(RIGHT_EAR, 2000); userProfile.setMALRight4000(RIGHT_EAR, 4000); userProfile.setMALRight800 0(RIGHT_EAR, 800 0); userProfile .setMALRight250(RIGHT_EAR, 250); userProfile.setMALRight500(RIGHT_EAR, 500 ); s 32 201216255 userProfile.setMALLeftl000(LEFT_EAR,1000); userProfile.setMALLeft2000(LEFT_EAR, 2000); userProfile.setMALLeft4000(LEFT_EAR,4000); userProfile.setMALLeft8000 (LEFT_EAR, 8000); userProfile.setMALLeft250(LEFT_EAR,250); userProfile.setMALLeft500(LEFT_EAR, 500) int saveToCentralDatabase (userProfile if CopenConnectionToCentralDatabaseC) == fa 1se){ return CONNECTION_FAILED; } updateProfileToCentralDatabase(userProfile); performTinnitus MatchingTest { userProfi1e. Set TinnitusMatchingFrequencyCget

Tinni tusMatching Frequency ); userProf i1e.set Tinni tusMatchingArap1itude(get

Tinnitus Matching Amplitude); The invention has been explained with reference to specific embodiments. Other embodiments will be apparent to those skilled in the art. Therefore, the present invention does not impose other limitations than the limitations indicated in the scope of the appended claims. BRIEF DESCRIPTION OF THE DRAWINGS Figure 1A is a high level block diagram showing one or more personal devices for use with a remote storage medium in accordance with the present invention; Figure 1B is a high level block diagram of a system in accordance with the present invention; Figure 3 is a block diagram of an analysis subsystem in accordance with the present invention; Figure 4 is a block diagram of the user identification subsystem; Figure 5 is a block diagram of the audio signal subsystem; Figure 6A and Figure 6B Common is the activity diagram of the sound enhancement process according to the present invention; FIG. 7 is a flow chart of the tinnitus matching process; FIG. 8 is a flow chart of the test ear selection process of the tinnitus matching process; Figure 1 is a flow chart of the tinnitus type determination process of the tinnitus matching process; Figure 11 {The test of the tinnitus matching process to the tone of the tinnitus tone selected; Fig. Fig. 12 is the tinnitus of the tinnitus matching process Flowchart of the pitch determination process, 13A and FIG. 13B are together a flow chart for a three-stage tinnitus test for each ear in the tinnitus matching process; FIG. 14 is a block diagram of FIG. Is a flow chart of the sound enhancement process; and is a high level of the device having the sound enhancement process capability of Figure 14.

S 34 201216255 [Description of main components] 1A ~ device, 1B ~ device; 2~ display; 3~ earphone; 4~ control interface 5~ test scheme 6 ~ personal user 7~ storage device 8 A~ storage system 9 8B ~ Telecom Link y 9 ~ Speaker; 10 ~ Enhanced Sound TM (CES) 11 ~ Programming Material 5 12 ~ Auditory Slots 9 14 ~ Analysis Subsystem 9 16 ~ Display Subsystem 9 18 ~ User Identification Subsystem 9 20 ~ Audio Signal Sub-System 22 ~ Response Controller > 24 ~ Data Repository Connector 26 ~ Data Repository 27 ~ Professional Management of Hearing Test 28 ~ Self-Managed Hearing System; Classification; Classification;

S 35 201216255 3 0~ tinnitus matching test class; 3 2~ comfort and discomfort hearing level test class; 34~ test selector; 35~ gain algorithm selector; 36~ audio test signal generator class; 37~ target gain calculation 38~gain subsystem; 39~ algorithm selector; 40~ signal processing subsystem; 42~sound mitigation subsystem; 43~sound mitigation selector; 4 5~sound mitigation generator; 46~customizer; 48 ~ profile object; 5 0 ~ logo; 206 ~ finite impulse response (FIR) filter; 210 ~ Fourier analyzer; 212 ~ sound tolerance level analyzer; 214 ~ FFT inverse transform module.

36 S

Claims (1)

201216255 VII. Patent application scope: 1. A system for enhancing an individual's hearing experience, comprising: an element for capturing and storing audio audio characteristics of the above individuals; for analyzing the audio listening characteristics of the above individuals to generate personalized hearing The components of the profile; and the components for applying the personalized auditory profile described above to enhance the audio to the individual. 2. The system of claim 1, further comprising means for generating a contextual profile for adapting the enhanced audio to the surrounding acoustic environment. 3. The system of claim 2, wherein the audio is produced by a computerized device to compensate for frequency-related loudness defects in the individual's hearing in a customized loudness level. 4. The system of claim 3, wherein the application is an audio amplification component of a personal hearing aid device. The personalized listening described above 5. The system profile as described in claim 1 of the patent application includes: ^ The system described in item 5. The system described in 5) 1) Test level of loudness level 6 · If the fifth step of the patent application scope includes the optimum level and discomfort level. 7. If the patent application scope is established at multiple hearing measurement frequencies. 8. If the patent application scope first includes: , the above loudness level includes the minimum audible level. In the system described in the above, the loudness level is the above-mentioned loudness level, which is the measured value from the tinnitus test described above. 9. If you apply for a patent scope! The term described includes subsystems that produce processing results based on gain operations. The above-mentioned knife-analysis element is 10.10. The system according to claim 9 of the patent application scope is related to the frequency-dependent input phase phase " sign. The frequency benefit and compression of the above-mentioned processing results are different from the scope of patent application i. The result of the item personalizes the audio output. The above-mentioned section 2 of the patent application scope is used to store the personalized auditory profile. The above repository is equipped with horses to collect data from any source and store profiles. And respond to the use of the above analysis components: new specific personalized hearing. + Request to use a special and personalized hearing profile The above personalization ^ The hearing profile as described in claim 12 includes the personal customization settings described above. The system described in item 13 of the above-mentioned personalized C patent scope further includes measurements from the tinnitus test. The above-mentioned capital 15. As described in item 12 of the patent application scope, the 枓 repository is configured to include professional tubes, '!R, , ± % force measurement data. 16. The repository of item 12 of the scope of the patent application can be accessed via an internet connection. , system, of which the above-mentioned capital 1 7. As claimed in the patent scope, item 12 is a portable electronic component. L. System, "Scaping above" S 38 201216255 - 18. The system of claim 12, wherein the above-mentioned analysis component is a portable electronic component. 1 9. The system of claim 1, wherein the application component is an audio amplifying component of a personal hearing aid device. 20. A method for enhancing personal hearing, comprising: capturing audio audio characteristics of said individual at least in part by self-administered testing; analysing said personal hearing characteristics to produce a personalized hearing profile; The profile is stored in the storage device; and the stored personalized audiovisual profile is applied to the personal electronic device that reproduces the sound to enhance the audio to the individual. 21. The method of claim 2, further comprising: generating an environmental profile; and an auditory profile to compensate for the customized response. The above-mentioned personalization uses the above-mentioned environmental profile and the frequency-related loudness in the personal listening level within the above-mentioned personalization level. 2 The hearing profile described in the second paragraph of the patent application includes: The minimum audible level. The above-mentioned loudness level 'personalized 1) test level of the loudness level, the loudness level includes 23. The method as recited in claim 22 further includes an optimum level and an uncomfortable level. 24. The method of claim 22, wherein the auditory profile further comprises: 2) measurements from a tinnitus test. Transmitted to the individual's shock 25. A sound for custom enhancement 39 5 201216255 includes: an element for receiving an unenhanced audio signal from a source; for capturing and analyzing the frequency composition of the surrounding acoustic environment to produce an environmental simplicity An element for receiving a stored personalized auditory profile; a filter device receiving the personalized auditory profile and the environmental profile described above to establish filter coefficients, and receiving the unenhanced audio signal as an input For modifying the loudness of the audio signal at a plurality of frequencies to obtain a modified audio signal; a time domain to frequency domain converter for converting the modified audio signal from the time domain to the frequency domain; analyzing and adjusting components, Means for analyzing the loudness tolerance level of the modified audio signal by comparing the loudness tolerance level of the personalized auditory profile described above with a loudness level of the modified audio signal at a plurality of frequencies, and for tuning over the above Loudness of the selected auditory frequency of the loudness tolerance level to produce an enhanced frequency domain audio signal; For converting the enhanced audio signal into a frequency domain to time domain individuals enhanced audio special effect. The device of claim 25, wherein the filter device is a time domain finite impulse response filter bank. 27. The apparatus of (4) (4), wherein the time domain to frequency domain conversion is a Fourier transform element, and the element for converting the enhanced audio signal is an inverse Fourier transform element. 28. The device of claim 25, wherein at least the S 40 201216255 audio signal converter is incorporated into the personal hearing aid device. 5 41