CN108763978B - Information prompting method, device, terminal, earphone and readable storage medium - Google Patents
Information prompting method, device, terminal, earphone and readable storage medium Download PDFInfo
- Publication number
- CN108763978B CN108763978B CN201810520637.1A CN201810520637A CN108763978B CN 108763978 B CN108763978 B CN 108763978B CN 201810520637 A CN201810520637 A CN 201810520637A CN 108763978 B CN108763978 B CN 108763978B
- Authority
- CN
- China
- Prior art keywords
- earphone
- information
- user
- headset
- ear
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000005236 sound signal Effects 0.000 claims abstract description 68
- 238000004590 computer program Methods 0.000 claims description 24
- 238000004891 communication Methods 0.000 claims description 23
- 230000006870 function Effects 0.000 claims description 22
- 210000000613 ear canal Anatomy 0.000 claims description 14
- 230000008859 change Effects 0.000 claims description 2
- 238000011084 recovery Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000013475 authorization Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000005674 electromagnetic induction Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000009647 facial growth Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000704 physical effect Effects 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/70—Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
- G06F21/88—Detecting or preventing theft or loss
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1083—Reduction of ambient noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1091—Details not provided for in groups H04R1/1008 - H04R1/1083
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Theoretical Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
Abstract
本申请涉及一种信息提示方法、装置、终端、耳机及可读存储介质。该方法包括：当耳机的丢失模式开启时，基于所述耳机内置的音频信息播放音频信号；当检测到所述耳机插入用户耳朵时，基于所述音频信号获取当前使用者的用户信息；若当前使用者的用户信息与预设用户信息不匹配，则根据预设提示策略发出预设提示信息。通过上述方法，当耳机丢失后会通过耳机播放音频信号，当耳机被他人拾取时，能够发出与耳机的机主相关联的提示信息，以使得拾取者能够找到失主进行归还，增加了耳机丢失后的找回几率，减少了用户的损失。
The present application relates to an information prompting method, device, terminal, earphone and readable storage medium. The method includes: when the lost mode of the earphone is turned on, playing an audio signal based on the built-in audio information of the earphone; when detecting that the earphone is inserted into the user's ear, acquiring the user information of the current user based on the audio signal; If the user information of the user does not match the preset user information, the preset prompt information is sent according to the preset prompt policy. Through the above method, when the earphone is lost, the audio signal will be played through the earphone, and when the earphone is picked up by others, a prompt message associated with the owner of the earphone can be issued, so that the picker can find the lost owner and return it. The probability of recovery is reduced, and the loss of users is reduced.
Description
Technical Field
The present application relates to the field of communications technologies, and in particular, to an information prompting method, an information prompting device, a terminal, an earphone, and a readable storage medium.
Background
The earphone is very high in use frequency in daily life of people, and a user can listen to music, talk, voice, video, movie and television playing and other activities through the earphone. As communication devices are miniaturized and portable, earphones become smaller and smaller, and wireless earphones are widely used. Because the volume of earphones such as earplug type earphones and in-ear type earphones is small, the wireless earphones are easy to lose and difficult to get back after losing, and certain loss is brought to users.
Disclosure of Invention
The embodiment of the application provides an information prompting method, an information prompting device, a terminal, an earphone and a readable storage medium, which can send out prompting information after the earphone is lost, so that the earphone retrieving probability is improved.
An information prompting method comprises the following steps:
when the loss mode of the earphone is started, playing an audio signal based on audio information built in the earphone;
when the earphone is detected to be inserted into the ear of the user, acquiring user information of the current user based on the audio signal;
and if the user information of the current user is not matched with the preset user information, sending out preset prompt information according to a preset prompt strategy.
An information presentation device comprising:
the audio playing module is used for playing audio signals based on audio information built in the earphone when the loss mode of the earphone is started;
the information acquisition module is used for acquiring the user information of the current user based on the audio signal when the earphone is detected to be inserted into the ear of the user;
and the information prompting module is used for sending out preset prompting information according to a preset prompting strategy if the user information of the current user is not matched with the preset user information.
A terminal comprising a memory and a processor, the memory having stored therein computer readable instructions, which when executed by the processor, cause the processor to perform the steps of the above method.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.
An earphone comprising an electroacoustic transducer, a memory, a processor and a computer program stored on and executable on the memory, the processor being electrically connected to the electroacoustic transducer and the memory, the steps of the method being performed when the computer program is executed by the processor.
According to the information prompting method, the information prompting device, the information prompting terminal, the earphone and the computer readable storage medium, when the loss mode of the earphone is started, the audio signal is played based on the audio information built in the earphone, when the earphone is detected to be inserted into the ear of a user, the user information of the current user is obtained based on the audio signal, and if the user information of the current user is not matched with the preset user information, the preset prompting information is sent according to the preset prompting strategy. By the method, the audio signal can be played through the earphone after the earphone is lost, and when the earphone is picked up by others, the prompt message associated with the owner of the earphone can be sent out, so that the picking-up person can find the lost owner for returning, the retrieving probability after the earphone is lost is increased, and the loss of a user is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a diagram of an application environment of an information prompting method in one embodiment;
FIG. 2 is a schematic diagram of the internal structure of the earphone according to one embodiment;
FIG. 3 is a flowchart illustrating a method for prompting for information according to an embodiment;
FIG. 4 is a flowchart illustrating a method for prompting for information in another embodiment;
FIG. 5 is a flowchart illustrating a method for prompting for information in another embodiment;
FIG. 6 is a block diagram showing the structure of an information presentation apparatus according to an embodiment;
fig. 7 is a block diagram of a partial structure of an earphone associated with the terminal provided in the embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.
Fig. 1 is a schematic diagram of an application environment of an information prompting method in one embodiment. As shown in fig. 1, the application environment includes a terminal 110, a server 120, and a headset 130, and the terminal 110 and the headset 130 respectively communicate wirelessly with the server 120.
The terminal 110 may be a mobile phone, a tablet computer, a personal digital assistant, a wearable device, or the like. The server 120 may be a cloud server, an independent physical server, or a cluster of physical servers. Types of headphones 130 include, but are not limited to, in-ear, head-mounted, and in-ear. The terminal 110, the server 120, and the headset 130 may communicate with each other in a wireless manner, thereby implementing data transmission.
The earpiece 130 comprises an acoustoelectric transducer 131, the acoustoelectric transducer 131 being located at a tip portion of the earpiece, the acoustoelectric transducer 131 outputting an audio signal acquired by the earpiece 130 into the ear canal of the user when the tip portion of the earpiece is positioned in the ear canal of the user. The acoustoelectric transducer 131 includes a speaker for playing audio signals and a microphone for recording audio signals around the earphone 130, and optionally, the microphone can also collect echo signals formed by the audio signals played by the speaker after being reflected and vibrated by the internal structure of the ear. In one embodiment, the speaker and the microphone are of a unitary construction.
Optionally, an Application (APP) is installed on the terminal 110, and the APP refers to a computer program that is operated in a user mode, can interact with a user, and has a visual user interface for performing one or more specific tasks. The terminal 110 interacts with the user through the application program, for example, the headset loss mode can be opened through the headset management application on the terminal 110, and then the server 120 sends a related instruction to the headset 130, so that the headset 130 sends an information prompt, and the recovery probability after the headset is lost is increased.
Fig. 2 is a schematic diagram of the internal structure of the earphone according to an embodiment. The headset includes a processor, memory, and a communication interface connected by a system bus. Wherein the processor is used for providing calculation and control capability and supporting the operation of the whole earphone. The memory is used for storing data, programs, instruction codes and/or the like, and at least one computer program is stored on the memory, and the computer program can be executed by the processor to realize the information prompting method suitable for the earphone provided by the embodiment of the application. The Memory may include a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random-Access-Memory (RAM). For example, in one embodiment, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a database, and a computer program. The database stores data related to an information prompting method for implementing the above embodiments. The computer program can be executed by a processor to implement an information prompting method provided by various embodiments of the present application. The internal memory provides a cached operating environment for the operating system, databases, and computer programs in the non-volatile storage medium. The communication interface comprises a mobile communication interface, a wifi communication interface, a Bluetooth communication interface and the like, and the earphone is in communication connection with the server through the communication interface so as to complete data transmission.
It will be appreciated by those skilled in the art that the configuration shown in fig. 1 is a block diagram of only a portion of the configuration relevant to the present application and does not constitute a limitation of the headset to which the present application is applied, and that a particular headset may include more or fewer components than those shown in the drawings, or some components may be combined, or have a different arrangement of components.
Fig. 3 is a flowchart of an information prompting method in an embodiment, and the information prompting method in this embodiment is described by taking the earphone in fig. 1 as an example. By the information prompting method, information can be prompted after the earphone is lost, and the probability of finding the earphone is increased. The information prompting method comprises the following steps 302-306:
step 302: and when the loss mode of the earphone is started, playing an audio signal based on the audio information built in the earphone.
When the earphone is lost, a user can start a loss mode of the earphone through the terminal, wherein the terminal is a terminal bound with the earphone in advance, and in the loss mode, the terminal transmits a loss instruction to the earphone through the server to indicate the earphone to send an information prompt.
Specifically, the earphone can be managed through a specific application program on the terminal, and when the earphone is lost, the lost mode of the earphone is started through the application program on the terminal. For example, a user binds the earphone with a mobile phone, a tablet personal computer or wearable equipment in advance, the state of the earphone can be managed through the mobile phone, the tablet personal computer or the wearable equipment, when the earphone is lost, a lost mode of the earphone is started in a management interface of the mobile phone, the tablet personal computer or the wearable equipment, the earphone can be triggered to perform information prompt, and the user can find the earphone conveniently.
Further, when the earphone receives the loss instruction, the audio signal is played based on the audio information built in the earphone. The earphone is pre-stored with an audio signal, which can be used to detect user behavior and user information, and specifically, the audio signal can be stored in a memory in the earphone, and the audio signal can be an audio signal with a specific frequency, such as ultrasonic waves, which cannot be heard by the user even if the audio signal is played when the earphone is located in the ear of the user, so that the detection of the user behavior and the user information can be completed without being perceived by the user. Optionally, the audio signal may also be music or voice, the earphone plays the music or voice at the maximum volume, which can attract the attention of others, when someone in the vicinity of the earphone hears the sound played by the earphone, the lost earphone can be found and picked up, which can increase the probability of finding the earphone.
Step 304: and when the earphone is detected to be inserted into the ear of the user, acquiring user information of the current user based on the audio signal.
When the other person finds the earphone and wears it, the earphone is worn in the ear to receive the sound propagated on the earphone. Furthermore, the earphone of the earphone can send out an audio signal and collect a return signal, and whether the earphone of the earphone is positioned in the ear canal of the user can be judged by analyzing the return signal. For example, an earphone of the earphone emits an audio signal (e.g., an ultrasonic signal) with a specific frequency, the audio signal may have different effects when passing through different obstacles, and at this time, signals from around the earphone are collected, and the collected signals are analyzed and compared, and if it is detected that the returned signal matches with the data of the human ear, it is determined that the earphone is inserted into the ear of the user.
And after detecting that the earphone is inserted into the ear of the user, acquiring identity information related to the user wearing the earphone at present. In particular, an acoustic feature model associated with the current user's ear internal structure may be obtained from the audio signal currently playing in the headset. The acoustic feature model may be understood as a spatial feature of a structure inside the ear of the user where the earphone is currently located, that is, different acoustic feature models may be used to represent different positions of the earphone inside the ear of the user. Furthermore, the acoustic feature model can be used to generate an acoustic signature to verify the identity of the user, i.e. generate the ear print information of the user, wherein the ear print is a feature unique to the human body, like fingerprint and facial growth.
Step 306: and if the user information of the current user is not matched with the preset user information, sending out preset prompt information according to a preset prompt strategy.
The preset user information may be owner information, i.e., owner of the headset. Optionally, the preset user information may further include a plurality of preset user information, such as family, friends, colleagues, etc. of the owner. The earphone acquires the user information of the current user, judges whether the user information of the current user is matched with the preset user information or not, and sends out the preset prompt information according to the preset prompt strategy if the user information of the current user is not matched with the preset user information.
For example, when it is determined that the current user is not the preset user, the headset may play a specific voice message to prompt the current user to return the headset, where the voice message played by the headset includes personal information of the owner of the headset, such as name, phone number, address, and the like. Therefore, after other people pick up the lost earphones, the lost earphones can be quickly found out by acquiring the prompt information played by the earphones.
According to the information prompting method, when the loss mode of the earphone is started, the audio signal is played based on the audio information built in the earphone, when the earphone is detected to be inserted into the ear of a user, the user information of the current user is obtained based on the audio signal, and if the user information of the current user is not matched with the preset user information, the preset prompting information is sent according to the preset prompting strategy. By the method, the audio signal can be played through the earphone after the earphone is lost, and when the earphone is picked up by others, the prompt message associated with the owner of the earphone can be sent out, so that the picking-up person can find the lost owner to return, the retrieving probability after the earphone is lost is increased, and the user loss is avoided.
In one embodiment, before the lost mode of the headset is turned on, the information prompting method further includes: and when the earphone is connected to a wireless network, establishing wireless communication connection with a server based on the earphone identification of the earphone.
The wireless network (wireless network) is a network implemented by using a wireless communication technology, and may include a wireless network (such as GPRS, 4G, 5G, and the like) implemented by using a public mobile communication network, a Wireless Local Area Network (WLAN), and the like. The earphone comprises a wireless communication interface, and can be connected to a wireless network through the wireless communication interface, for example, when the earphone is in the coverage of the wireless local area network, the earphone can be connected to the wireless local area network through a wifi communication module built in the earphone.
When the earphone is connected to the wireless network, a communication connection is established with a server based on the earphone identification on the earphone. The earphone identification refers to the identification of the earphone, the earphone sends the identification to the server through the wireless network, and after the server verifies that the identification of the earphone passes, the earphone is connected with the server. After the communication connection between the headset and the server is established, data can be transmitted to each other through the wireless network, for example, the server can send a request or a control instruction to the headset, and the headset can return related data according to the request sent by the server or execute related operations according to the control instruction sent by the server.
In one embodiment, as shown in fig. 4, the information prompting method further includes:
step 402: and when the loss mode of the earphone is started, acquiring the current position information of the earphone.
When the loss mode of the headset is started, the present embodiment acquires the current position information of the headset in real time in order to quickly lock the position of the headset. Specifically, the headset may include a GPS module, and the current location information of the target headset may be acquired by the GPS module.
Step 404: and the earphone sends a position instruction carrying the position information to the server so as to indicate the server to send the position information of the earphone to the user terminal.
Specifically, the position information is used for determining the current geographic position of the earphone, the earphone acquires the current position information through GPS positioning, the earphone generates a data packet as a position instruction according to the acquired current position information, and the position instruction is sent to the server.
After receiving the position instruction, the server extracts the position information of the earphone from the position instruction and sends the position information of the earphone to the user terminal through the wireless communication network, wherein the user terminal is a terminal pre-associated with the owner of the earphone, namely the terminal bound with the earphone. Therefore, the earphone owner can read the position information of the earphone on the terminal, and the earphone owner can lock the position of the earphone quickly and get back the earphone conveniently.
In one embodiment, as shown in fig. 5, when it is detected that the earphone is inserted into the ear of the user, the user information of the current user is obtained based on the audio signal, that is, step 304 includes:
step 502: and sending out an audio signal based on the earphone and collecting a returned signal.
The earphone of the earphone can send out audio signals and collect returned signals, and whether the earphone of the earphone is positioned in the ear canal of a user can be judged by analyzing the returned signals.
Step 504: determining whether the earpiece is positioned in an ear canal of a user based on analyzing the returned signal.
For example, an earphone of the earphone emits an audio signal (e.g., an ultrasonic signal) with a specific frequency, the audio signal may have different effects when passing through different obstacles, and at this time, signals from around the earphone are collected, and the collected signals are analyzed and compared, and if it is detected that the returned signal matches with the data of the human ear, it is determined that the earphone is inserted into the ear of the user.
Step 506: when the earphone is positioned in the ear canal of the user, an echo signal formed after the audio signal is reflected and vibrated by the internal structure of the ear is collected.
The earphone includes an electroacoustic transducer, which can be used as a speaker to convert an electrical signal corresponding to an audio signal into a sound wave signal that can be heard by a user. Meanwhile, the electroacoustic transducer is very sensitive to sound waves in the internal structure (ear canal) of the ear of a user, can cause the vibration of a cone of a loudspeaker, and drives a coil connected with the cone to make a motion of cutting magnetic lines of force in a magnetic field of a permanent magnet, so that current changing along with the change of the sound waves is generated (the phenomenon of generating the current is physically called as an electromagnetic induction phenomenon), and meanwhile, electromotive force of audio frequency is output at two ends of the coil. Thus, the electroacoustic transducer can also collect acoustic echo signals generated by the reflection and vibration of the audio signals by the internal structures of the ear. That is, the electroacoustic transducer may be used as a microphone. The microphone is based on the principle that after the energy of the electroacoustic transducer is reversely converted, an acoustic signal is converted into mechanical vibration and then converted into an electric signal, and therefore the acquisition function of an echo signal is achieved.
Electroacoustic transducers, although they differ in their type, function or operating state, comprise two basic components, namely an electrical system and a mechanical vibration system, which are interconnected by some physical effect inside the electroacoustic transducer to accomplish the conversion of energy.
The acoustic echo signal formed by the audio signal reflected and vibrated by the internal structure of the ear is recorded by the electroacoustic transducer playing the audio signal, and a microphone does not need to be additionally arranged in the earphone to collect the acoustic echo signal, so that the cost is saved, and the internal structure of the earphone is simplified.
Alternatively, an acoustic echo signal formed by the reflection and vibration of the audio signal by internal structures of the ear can also be picked up by a microphone arranged in the headset. When the earphone is worn in the ear of the user, the microphone is arranged on one side of the earphone, which is in contact with the internal structure of the ear of the user, namely, the microphone is arranged on the earphone shell provided with the loudspeaker through hole.
Step 508: and determining an acoustic feature model associated with the internal structure of the ear of the current user according to the audio signal and the echo signal.
The audio signal played by the earphone loudspeaker is s (t), the acoustic echo signal collected by the microphone in the ear canal is r (t), and the acoustic feature model associated with the internal structure of the ear of the current user is represented by w (t), so that the following expression can be obtained:
r(t)＝s(t)*w(t) (1)
where w (t) is a parameter reflecting the coupling of the earpiece to the user's ear and can be used to characterize the acoustic characteristics of the space in which the earpiece is placed in the user's ear. In formula (1), the audio signal is s (t) and the acoustic echo signal is r (t) can be obtained by monitoring through an audio circuit provided in an earphone or an electronic device, and then an acoustic feature model w (t) associated with the internal structure of the ear of the current user can be obtained. The acoustic feature model w (t) may be understood as a spatial feature of the structure inside the ear of the user where the earphone is currently located, that is, different acoustic feature models w (t) may be used to represent different positions of the earphone inside the ear of the user. Accordingly, the ear print characteristics of each user can also be characterized by an acoustic feature model w (t).
Furthermore, a noise factor e (t) may be added to the above formula (1), where the noise factor e (t) includes ambient noise and circuit noise; the environmental noise is the environmental noise generated in the process of recording the acoustic echo signal when the audio signal s (t) is not played, and the environmental noise can be collected by an additional microphone; circuit noise is noise caused in a circuit built in the headphone, and is an inherent property of the headphone. Adding the noise factor e (t) as a known parameter, and considering the noise factor e (t), the formula (1) can be revised as:
r(t)＝s(t)*w(t)+e(t) (2)
in the formula (2), the newly added noise factor e (t), the audio signal s (t), and the acoustic echo signal r (t) are known parameters, and then the acoustic feature model w (t) associated with the internal structure of the ear of the current user can be obtained.
The information prompting method provided by the embodiment can represent the identity information of the user through the acoustic feature model associated with the internal structure of the ear of the current user, so that the safety and convenience of the identity authentication of the user are improved, the identity of the user can be determined only when the user wears the earphone, an additional device is not needed to be added in the process of acquiring the identity information, and the device cost is saved.
In one embodiment, sending out the preset prompting message according to the preset prompting policy includes: playing specific voice information based on an electroacoustic transducer of the earphone, wherein the voice information comprises personal information of an earphone owner. For example, when it is determined that the current user is not the default user, the headset plays the following voice message "headset lost, please contact XXX, phone XXX, address XXX, thank you! After the lost earphone is picked up by others, the personal information of the earphone owner can be acquired through the voice information played by the earphone, so that the lost earphone can be found quickly. For example, when the earphone is dropped by the earphone owner in public places such as companies, subways and schools, the earphone can be picked up by passersby with high probability, the earphone in the loss mode can help the picking person to find the loser quickly, the probability of finding the earphone is increased, and the user loss is avoided.
In one embodiment, the information prompting method further includes: and if the user information of the current user is not matched with the preset user information, controlling all functions or appointed functions of the earphone to enter a locking state.
Specifically, when it is determined that the current user of the headset is not the preset user, that is, the headset is in a state of being picked up by another person, if the function of the headset can be used normally, the sense of possession of the picker may be caused, and thus the picker does not return the headset. At this time, the earphone is controlled to enter a locking state in which all functions or designated functions are unavailable, for example, the earphone is controlled not to be connected with other terminal equipment, that is, the current user cannot normally use the earphone, so that the earphone has no use value for the current user, and the current user is prompted to return the earphone.
In one embodiment, the information prompting method further includes: and if the user information of the current user is not matched with the preset user information, sending the user information of the current user to a server, and sending the user information of the current user to a user terminal through the server.
Specifically, when it is determined that the current user of the headset is not the preset user, that is, the headset is in a state of being picked up by others, the ear print information of the current user is sent to the user terminal, so that the owner of the headset can determine the identity of the headset picker through the ear print information. For example, after the owner acquires the ear print information, the owner can determine the exact identity of the current user through the assistance of the police, so that the probability of retrieving the earphone is further improved. Optionally, under the condition of obtaining the authorization of the police department, the ear print information can be directly sent to a preset police system, and an ear print database in the police system is called, so that the police can directly determine the exact identity of the current user according to the ear print information and quickly retrieve the earphone.
It should be understood that, although the steps in the flowcharts corresponding to the above-described embodiments are sequentially shown as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 3-5 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.
As shown in fig. 6, in one embodiment, there is provided an information presentation apparatus including: the system comprises an audio playing module 610, an information obtaining module 620 and an information prompting module 630.
And the audio playing module 610 is configured to play an audio signal based on audio information built in the earphone when the loss mode of the earphone is turned on.
An information obtaining module 620, configured to obtain user information of a current user based on the audio signal when it is detected that the earphone is inserted into the ear of the user.
The information prompting module 630 is configured to send out a preset prompting message according to a preset prompting policy if the user information of the current user is not matched with the preset user information.
In the above information prompting device, when the loss mode of the earphone is turned on, the audio playing module 610 plays an audio signal based on the audio information built in the earphone, when it is detected that the earphone is inserted into the ear of the user, the information obtaining module 620 obtains the user information of the current user based on the audio signal, and if the user information of the current user is not matched with the preset user information, the information prompting module 630 sends out the preset prompting information according to the preset prompting policy. Through the device, audio signals can be played through the earphone after the earphone is lost, when the earphone is picked up by others, prompt information associated with the owner of the earphone can be sent out, so that the picking up person can find the owner of the earphone to return, the retrieving probability after the earphone is lost is increased, and the loss of a user is reduced.
In one embodiment, the information prompting device further comprises a wireless connection module for establishing wireless communication connection with the server based on the earphone identification on the earphone when the earphone is connected to the wireless network.
In one embodiment, the information prompting device further comprises a position sending module, configured to obtain current position information of the headset when a loss mode of the headset is turned on; the earphone sends a position instruction carrying the position information to the server to indicate the server to send the position information of the earphone to a user terminal; the user terminal is a terminal pre-associated with the owner of the earphone.
In one embodiment, the information obtaining module 620 is further configured to send out an audio signal based on the headset and collect a returned signal; determining whether the earphone is located in the ear canal of the user based on analyzing the returned signal; when the earphone is positioned in the ear canal of a user, acquiring an echo signal formed by the audio signal after the audio signal is reflected and vibrated by the internal structure of the ear; and determining an acoustic feature model associated with the internal structure of the ear of the current user according to the audio signal and the echo signal.
In one embodiment, the information prompt module 630 is further configured to play a specific voice message based on the electroacoustic transducer of the headset, wherein the voice message includes personal information of the owner of the headset.
In one embodiment, the information prompt device further includes a function control module, configured to control all functions or designated functions of the earphone to enter a locked state if the user information of the current user does not match preset user information.
In one embodiment, the information prompting device further includes an information sending module, configured to send the user information of the current user to a server if the user information of the current user does not match preset user information, and send the user information of the current user to a user terminal through the server.
The division of each module in the information presentation apparatus is only for illustration, and in other embodiments, the information presentation apparatus may be divided into different modules as needed to complete all or part of the functions of the information presentation apparatus.
For specific limitations of the information prompting device, reference may be made to the above limitations of the information prompting method, which are not described herein again. The modules in the information prompting device can be wholly or partially realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
The implementation of each module in the information prompting device provided in the embodiment of the present application may be in the form of a computer program. The computer program may be run on a terminal or a server. The program modules constituted by the computer program may be stored on the memory of the terminal or the server. The computer program, when executed by a processor, implements the steps of the information prompting method described in the embodiments of the present application.
The embodiment of the present application further provides an earphone, which includes an electroacoustic transducer, a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor is electrically connected to the electroacoustic transducer and the memory, and when the processor executes the computer program, the information prompting method described in the above embodiments is implemented.
The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the information prompting method as described in the embodiments above.
The embodiment of the application also provides a computer program product. A computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of information prompting as described in the embodiments above.
The embodiment of the application also provides the terminal equipment. As shown in fig. 7, for convenience of explanation, only the parts related to the embodiments of the present application are shown, and details of the technology are not disclosed, please refer to the method part of the embodiments of the present application. Taking a terminal device as an earphone as an example:
fig. 7 is a block diagram of a partial structure of an earphone associated with the terminal provided in the embodiment of the present application. Referring to fig. 7, the headset includes: radio Frequency (RF) circuit 710, memory 720, input unit 730, display unit 740, sensor 750, audio circuit 760, wireless fidelity (WiFi) module 770, processor 780, and power supply 790. It will be appreciated by those skilled in the art that the earphone configuration shown in fig. 7 does not constitute a limitation of the earphone and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.
The RF circuit 710 may be used for receiving and transmitting signals during information transmission or communication, and may receive downlink information of a base station and then process the downlink information to the processor 780; the uplink data may also be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 710 may also communicate with networks and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to Global System for mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE)), e-mail, Short Messaging Service (SMS), and the like.
The memory 720 may be used to store software programs and modules, and the processor 780 performs various functional applications of the headset and data processing by operating the software programs and modules stored in the memory 720. The memory 720 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function (such as an application program for a sound playing function, an application program for an image playing function, and the like), and the like; the data storage area may store data (such as audio data, an address book, etc.) created according to the use of the headset, and the like. Further, the memory 720 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The input unit 730 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the headset 700. Specifically, the input unit 730 may include a touch panel 731 and other input devices 732. The touch panel 731, which may also be referred to as a touch screen, can collect touch operations of a user (e.g., operations of the user on or near the touch panel 731 by using a finger, a stylus, or any other suitable object or accessory) thereon or nearby, and drive the corresponding connection device according to a preset program. In one embodiment, the touch panel 731 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts it to touch point coordinates, and sends the touch point coordinates to the processor 780, and can receive and execute commands from the processor 780. In addition, the touch panel 731 may be implemented by various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The input unit 730 may include other input devices 732 in addition to the touch panel 731. In particular, other input devices 732 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), and the like.
The display unit 740 may be used to display information input by the user or information provided to the user and various menus of the headset. The display unit 740 may include a display panel 741. In one embodiment, the Display panel 741 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-emitting diode (OLED), or the like. In one embodiment, the touch panel 731 can cover the display panel 741, and when the touch panel 731 detects a touch operation on or near the touch panel 731, the touch operation is transmitted to the processor 780 to determine the type of the touch event, and then the processor 780 provides a corresponding visual output on the display panel 741 according to the type of the touch event. Although in fig. 7, the touch panel 731 and the display panel 741 are two independent components to implement the input and output functions of the headset, in some embodiments, the touch panel 731 and the display panel 741 may be integrated to implement the input and output functions of the headset.
The headset 700 may also include at least one sensor 750, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel 741 according to the brightness of ambient light, and a proximity sensor that may turn off the display panel 741 and/or a backlight when the earphone is moved to the ear. The motion sensor can comprise an acceleration sensor, the acceleration sensor can be used for detecting the magnitude of acceleration in each direction, the magnitude and the direction of gravity can be detected when the earphone is static, and the motion sensor can be used for identifying the application of the posture of the earphone (such as horizontal and vertical screen switching), vibration identification related functions (such as pedometer and knocking) and the like; the earphone may be provided with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor.
The audio circuit 760, speaker 761, and microphone 762 may provide an audio interface between a user and headphones. The audio circuit 760 can transmit the electrical signal converted from the received audio data to the speaker 761, and the electrical signal is converted into a sound signal by the speaker 761 and output; on the other hand, the microphone 762 converts the collected sound signal into an electric signal, converts the electric signal into audio data after being received by the audio circuit 760, and then outputs the audio data to the processor 780 for processing, and then may transmit the audio data to another earphone via the RF circuit 710, or may output the audio data to the memory 720 for subsequent processing.
WiFi belongs to short-range wireless transmission technology, and the headset can help the user send and receive e-mail, browse web pages, access streaming media and the like through the WiFi module 770, which provides wireless broadband internet access for the user. Although fig. 7 shows WiFi module 770, it is understood that it does not belong to the essential components of headset 700 and may be omitted as desired.
The processor 780 is a control center of the headset, connects various parts of the entire headset using various interfaces and lines, and performs various functions of the headset and processes data by running or executing software programs and/or modules stored in the memory 720 and calling up data stored in the memory 720, thereby integrally monitoring the headset. In one embodiment, processor 780 may include one or more processing units. In one embodiment, processor 780 may integrate an application processor and a modem processor, where the application processor primarily handles operating systems, user interfaces, applications, and the like; the modem processor handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 780.
The headset 700 also includes a power supply 790 (e.g., a battery) for powering the various components, which may preferably be logically coupled to the processor 780 via a power management system that provides management of charging, discharging, and power consumption.
In one embodiment, the headset 700 may also include a bluetooth module or the like.
In the embodiment of the present application, when the processor 780 included in the terminal device executes the computer program stored in the memory, the information prompting method described in the foregoing embodiments is implemented.
When the computer program running on the processor is executed, the audio signal can be played through the earphone after the earphone is lost, and when the earphone is picked up by others, the prompt message associated with the owner of the earphone can be sent out, so that the picking-up person can find the lost owner to return, the retrieving probability after the earphone is lost is increased, and the loss of a user is reduced.
Any reference to memory, storage, database, or other medium used herein may include non-volatile and/or volatile memory. Suitable non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and bus dynamic RAM (RDRAM).
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (13)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810520637.1A CN108763978B (en) | 2018-05-28 | 2018-05-28 | Information prompting method, device, terminal, earphone and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810520637.1A CN108763978B (en) | 2018-05-28 | 2018-05-28 | Information prompting method, device, terminal, earphone and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108763978A CN108763978A (en) | 2018-11-06 |
| CN108763978B true CN108763978B (en) | 2020-05-12 |
Family
ID=64006469
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810520637.1A Expired - Fee Related CN108763978B (en) | 2018-05-28 | 2018-05-28 | Information prompting method, device, terminal, earphone and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108763978B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109767600B (en) * | 2019-02-01 | 2021-08-03 | 谷东科技有限公司 | AR glasses capable of automatically alarming and implementation method thereof |
| CN110324746B (en) * | 2019-07-23 | 2020-11-24 | 奇酷互联网络科技（深圳）有限公司 | Earphone false touch prevention method and device, storage medium and earphone |
| CN110650408B (en) * | 2019-10-29 | 2022-04-19 | 歌尔股份有限公司 | Earphone, anti-lost method, anti-lost system and computer readable storage medium |
| CN111818165A (en) * | 2020-07-09 | 2020-10-23 | 深圳市科奈信科技有限公司 | Earphone retrieving prompting method and system, electronic equipment and storage medium |
| CN113473285B (en) * | 2021-06-23 | 2025-01-24 | 泰凌微电子(上海)股份有限公司 | Device positioning method and earphone |
| CN113810889B (en) * | 2021-08-16 | 2024-06-21 | 百度在线网络技术（北京）有限公司 | Information interaction method, device, equipment and storage medium |
| CN113993076A (en) * | 2021-11-23 | 2022-01-28 | 歌尔科技有限公司 | Earphone positioning method and device, earphone equipment and storage medium |
| CN114157952A (en) * | 2021-11-26 | 2022-03-08 | 歌尔科技有限公司 | Earphone anti-lost early warning method, device, earphone and computer-readable storage medium |
| CN115038003A (en) * | 2022-06-11 | 2022-09-09 | 深圳市华冠智联科技有限公司 | A Bluetooth headset playback control system |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8259984B2 (en) * | 2007-06-29 | 2012-09-04 | Sony Ericsson Mobile Communications Ab | Headset with on-ear detection |
| US9351090B2 (en) * | 2012-10-02 | 2016-05-24 | Sony Corporation | Method of checking earphone wearing state |
| CN105760732A (en) * | 2016-01-29 | 2016-07-13 | 宇龙计算机通信科技(深圳)有限公司 | Authentication method, device and system |
| CN107071175A (en) * | 2017-04-18 | 2017-08-18 | 广东小天才科技有限公司 | Alarm clock control method of mobile equipment and mobile equipment |
| CN107066865A (en) * | 2017-04-26 | 2017-08-18 | 广东小天才科技有限公司 | Unlocking control method and device |
| CN107277657B (en) * | 2017-05-18 | 2019-12-17 | 深圳市冠旭电子股份有限公司 | A kind of earphone retrieving method, device and earphone |
-
2018
- 2018-05-28 CN CN201810520637.1A patent/CN108763978B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN108763978A (en) | 2018-11-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108763978B (en) | Information prompting method, device, terminal, earphone and readable storage medium | |
| CN108922537B (en) | Audio recognition method, device, terminal, earphone and readable storage medium | |
| CN108519871B (en) | Audio signal processing method and related product | |
| CN108391205B (en) | Left and right channel switching method and device, readable storage medium, and terminal | |
| CN108710486B (en) | Audio playback method, device, earphone, and computer-readable storage medium | |
| CN108521621B (en) | Signal processing method, device, terminal, earphone and readable storage medium | |
| CN108668009B (en) | Input operation control method, device, terminal, earphone and readable storage medium | |
| CN108429969B (en) | Audio frequency playing method, device, terminal, earphone and readable storage medium storing program for executing | |
| CN108538320B (en) | Recording control method and device, readable storage medium, and terminal | |
| CN108540900B (en) | Volume adjusting method and related product | |
| CN108430003A (en) | Sound effect compensation method and device, readable storage medium and terminal | |
| CN108763901B (en) | Ear print information acquisition method and device, terminal, earphone and readable storage medium | |
| CN108803859A (en) | Information processing method, device, terminal, earphone and readable storage medium | |
| CN108600885B (en) | Sound signal processing method and related product | |
| CN108900694A (en) | Method and device for obtaining earprint information, terminal, earphone and readable storage medium | |
| CN110460721A (en) | A startup method, device and mobile terminal | |
| CN108810787B (en) | Foreign object detection method, device and terminal based on audio equipment | |
| CN108616640A (en) | Terminal unlocking method and device, readable storage medium and terminal | |
| CN108391208B (en) | Signal switching method, device, terminal, earphone, and computer-readable storage medium | |
| CN108551648B (en) | Quality detection method and device, readable storage medium and terminal | |
| HK1258459A1 (en) | Input operation control method, device, terminal, headset and readable storage medium | |
| HK1258459B (en) | Input operation control method, device, terminal, headset and readable storage medium | |
| HK1257924B (en) | Audio signal processing method and related products | |
| HK1257924A1 (en) | Audio signal processing method and related products | |
| HK1257905B (en) | Sound effect compensation method, device, readable storage medium and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200512 |