CN111930339B - Device control method, device, storage medium and electronic device - Google Patents

Abstract

The application discloses a device control method, a device, a storage medium and wearable equipment. The method may be applied to a wearable device comprising at least a first audio output device arranged to correspond to a left ear side and a second audio output device arranged to correspond to a right ear side, the method comprising: responding to the audio output instruction, acquiring information of the use environment of the wearable device, wherein the information of the use environment comprises whether other users appear on the left ear side and the right ear side; if the use environment of the wearable device comprises that other users only appear on one side of the right ear, controlling the first audio output device to output audio; and if the use environment of the wearable device comprises the presence of other users on only one side of the left ear, controlling the second audio output device to output audio. The method and the device can improve the protection capability of the wearable device on the privacy of the user when outputting the audio.

Description

Device control method, device, storage medium and electronic device

Technical Field

The present application belongs to the technical field of electronic equipment, and in particular, relates to a device control method, apparatus, storage medium and electronic equipment.

Background technique

With the development of technology, smart wearable devices have begun to emerge and gradually mature. Currently, a common type of smart wearable devices includes head-mounted smart devices, such as smart glasses, smart helmets, smart headbands, etc. These smart wearable devices are not just hardware devices, but can also achieve powerful functions such as audio playback through software support, data interaction, and cloud interaction. However, in related technologies, wearable devices have poor protection capabilities for user privacy when outputting audio.

Summary of the invention

The embodiments of the present application provide a device control method, apparatus, storage medium, and electronic device, which can improve the ability of a wearable device to protect user privacy when outputting audio.

In a first aspect, an embodiment of the present application provides a device control method, which is applied to a wearable device, wherein the wearable device includes at least a first audio output device and a second audio output device, wherein the first audio output device is arranged on a side corresponding to a left ear, and the second audio output device is arranged on a side corresponding to a right ear, and the method includes:

In response to the audio output instruction, obtaining information about the use environment of the wearable device, wherein the information about the use environment includes whether other users appear on the left ear side and the right ear side;

If the usage environment of the wearable device includes other users appearing only on the right ear, controlling the first audio output device to output audio;

If the usage environment of the wearable device includes other users appearing only on the left ear side, the second audio output device is controlled to output audio.

In a second aspect, an embodiment of the present application provides a device control apparatus, which is applied to a wearable device, wherein the wearable device includes at least a first audio output device and a second audio output device, wherein the first audio output device is arranged on a side corresponding to a left ear, and the second audio output device is arranged on a side corresponding to a right ear, and the apparatus includes:

an acquisition module, configured to acquire information about a use environment of the wearable device in response to an audio output instruction, wherein the information about the use environment includes whether other users appear on the left ear side and the right ear side;

A first control module, configured to control the first audio output device to output audio if the use environment of the wearable device includes other users appearing only on the right ear side;

The second control module is used to control the second audio output device to output audio if the usage environment of the wearable device includes other users appearing only on the left ear side.

In a third aspect, an embodiment of the present application provides a storage medium on which a computer program is stored. When the computer program is executed on a computer, the computer executes the process in the device control method provided by the embodiment of the present application.

In a fourth aspect, an embodiment of the present application also provides a wearable device, including a memory, a processor, a first audio output device and a second audio output device, wherein the first audio output device is arranged on a side corresponding to a left ear, and the second audio output device is arranged on a side corresponding to a right ear, and the processor is used to execute the process in the device control method provided in the embodiment of the present application by calling a computer program stored in the memory.

In the embodiment of the present application, the wearable device can control only the first audio output device to output audio alone when other users appear only on the right ear side, and only control the second audio output device to output audio alone when other users appear only on the left ear side. Compared with the method in the related art that all audio output devices of the wearable device output audio when playing audio, since the embodiment of the present application can control the first audio output device to output audio alone or control the second audio output device to output audio alone according to the use environment of the wearable device, the embodiment of the present application can effectively prevent the output audio from being heard by other users, thereby improving the wearable device's ability to protect user privacy when outputting audio.

BRIEF DESCRIPTION OF THE DRAWINGS

The technical solution and beneficial effects of the present application will be made apparent by describing in detail the specific implementation methods of the present application in conjunction with the accompanying drawings.

FIG1 is a flow chart of a device control method provided in an embodiment of the present application.

FIG. 2 is another schematic flow chart of the device control method provided in an embodiment of the present application.

FIG. 3 is another schematic flow chart of the device control method provided in an embodiment of the present application.

4 to 10 are scenario schematic diagrams of the device control method provided in the embodiments of the present application.

FIG. 11 is a schematic diagram of the structure of the device control device provided in an embodiment of the present application.

FIG. 12 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

FIG. 13 is another schematic diagram of the structure of the electronic device provided in an embodiment of the present application.

Detailed ways

Please refer to the drawings, where the same component symbols represent the same components. The principle of the present application is illustrated by implementing it in an appropriate computing environment. The following description is based on the illustrated specific embodiments of the present application, which should not be considered as limiting other specific embodiments of the present application that are not described in detail herein.

It is understandable that the execution subject of the embodiments of the present application may be an electronic device such as a smart phone or a tablet computer.

Please refer to Figure 1, which is a flow chart of the device control method provided in an embodiment of the present application. The device control method can be applied to a wearable device, which includes at least a first audio output device and a second audio output device. The first audio output device is arranged on a side corresponding to the left ear, and the second audio output device is arranged on a side corresponding to the right ear. That is, when the wearable device is worn by a user, the first audio output device can be located on the left ear side of the user, and the second audio output device can be located on the right ear side of the user.

In some embodiments, the audio output device may include an electroacoustic transducer device such as a speaker.

The process of the device control method provided in the embodiment of the present application may include:

101. In response to an audio output instruction, obtain information about a use environment of the wearable device, where the information about the use environment includes whether other users appear on the left ear and the right ear.

With the development of technology, smart wearable devices have begun to emerge and gradually mature. Currently, a common type of smart wearable devices includes head-mounted smart devices, such as smart glasses, smart helmets, smart headbands, etc. These smart wearable devices are not just a hardware device, but can also achieve powerful functions such as audio playback through software support, data interaction, and cloud interaction. However, in the related art, wearable devices have poor protection capabilities for user privacy when outputting audio. For example, in the related art, when a wearable device outputs audio, all speakers will output audio at the same time. When all speakers output audio at the same time, it is easy to leak user privacy due to "sound leakage".

In an embodiment of the present application, for example, in response to an audio output instruction, that is, when audio output is required, the wearable device can first obtain information about its current usage environment, and the information about the usage environment may include whether other users besides the current user of the wearable device appear on the left ear and the right ear.

After acquiring the information of the use environment, the electronic device can detect whether other users appear only on the right ear side or other users appear only on the left ear side.

If it is detected that the usage environment of the wearable device includes other users appearing only on the right ear side, the process of 102 can be entered.

If it is detected that the usage environment of the wearable device includes other users appearing only on the left ear side, the process of 103 can be entered.

102. If the usage environment of the wearable device includes other users appearing only on the right ear side, control the first audio output device to output audio.

For example, after obtaining information about the usage environment, the wearable device detects that other users appear only on the right ear side but not on the left ear side. Then the wearable device can only control the first audio output device to output audio alone, while the second audio output device may not output audio.

103. If the usage environment of the wearable device includes other users appearing only on the left ear, control the second audio output device to output audio.

For example, after obtaining information about the usage environment, the wearable device detects that other users appear only on the left ear side but not on the right ear side. Then the wearable device can only control the second audio output device to output audio, while the first audio output device does not output audio.

It is understandable that in the embodiment of the present application, the wearable device can control only the first audio output device to output audio alone when other users appear only on the right ear side, and only control the second audio output device to output audio alone when other users appear only on the left ear side. Compared with the method in the related art that all audio output devices of the wearable device output audio when playing audio, since the embodiment of the present application can control the first audio output device to output audio alone or control the second audio output device to output audio alone according to the use environment of the wearable device, the embodiment of the present application can effectively prevent the output audio from being heard by other users, thereby improving the wearable device's ability to protect user privacy when outputting audio.

Please refer to Figure 2, which is another flow chart of the device control method provided in an embodiment of the present application. The device control method can be applied to a wearable device, which includes at least a first audio output device and a second audio output device. The first audio output device is arranged on a side corresponding to the left ear, and the second audio output device is arranged on a side corresponding to the right ear. That is, when the wearable device is worn by a user, the first audio output device can be located on the left ear side of the user, and the second audio output device can be located on the right ear side of the user.

In some embodiments, the audio output device may include an electroacoustic transducer device such as a speaker.

The process of the device control method provided in the embodiment of the present application may include:

201. In response to an audio output instruction, obtain information about a use environment of the wearable device, where the information about the use environment includes whether other users appear on the left ear and the right ear.

For example, in response to an audio output instruction, that is, when audio output is required, the wearable device can first obtain information about its current usage environment.

In this embodiment, the information of the use environment may include whether other users other than the user of the wearable device (i.e., the current user) appear on the left ear and the right ear. Of course, the information of the use environment may also include other information, which is not specifically limited in the embodiment of the present application.

After obtaining the information of the use environment of the wearable device, the wearable device can detect whether the use environment is that other users appear only on the right ear side or other users appear only on the left ear side. In addition, the wearable device can also simultaneously detect whether the wearable device is performing a call service.

It should be noted that if the wearable device can perform call services independently, then the wearable device performing call services can refer to the wearable device answering or dialing a call. If the wearable device cannot perform call services independently, then the wearable device performing call services can refer to the smartphone connected to the wearable device answering or dialing a call, and the smartphone sends the call voice data to the wearable device, and plays the call voice to the current user or collects the call voice of the current user through the wearable device. That is, at this time, the wearable device plays the role of a headset in the call service.

If it is detected that the wearable device is performing a call service and other users appear only on the right ear side, the process of 202 may be entered.

If it is detected that the wearable device is performing a call service and other users appear only on the left ear side, the process of 203 may be entered.

202. If the wearable device is performing a call service and the usage environment of the wearable device includes other users appearing only on the right ear side, control the first audio output device to output audio.

For example, the wearable device detects that it is currently conducting a call service, and there are other users only on the right ear side of the current user, but no other users on the left ear side of the current user, then the electronic device can only control the first audio output device set on the left ear side of the user to output audio alone.

In one embodiment, the process of 202 may also include: if the usage environment of the wearable device is that other users appear only within the preset range on the right ear side of the user, and no other users appear within the preset range on the left ear side of the user, and a call service is being conducted, then the wearable device may only control the first audio output device set on the left ear side of the user to output audio alone, while the second audio output device set on the right ear side of the user may not output audio.

It is understandable that when other users appear only on the right ear of the user, but not on the left ear of the user, the embodiment of the present application can only control the first audio output device arranged on the left ear of the user to output audio alone, while the second audio output device arranged on the right ear of the user does not output audio. In this way, the sound source can be effectively kept away from other users on the right ear. On the one hand, the sound source can be kept far away from the other user, thereby effectively preventing the other user from hearing the call voice when the sound attenuation is large. On the other hand, the shielding effect of the current user's head can be used to block the sound propagation, thereby effectively preventing the other user from hearing the call voice. Therefore, the embodiment of the present application can also enhance the privacy protection of calls.

In some embodiments, the preset range may be a value such as 1 meter, 1.5 meters, or 0.8 meters. For example, if the wearable device is used in an environment where other users appear only within 1 meter of the user's right ear, and no other users appear within 1 meter of the user's left ear, and a call service is being conducted, the wearable device may only control the first audio output device disposed on the user's left ear to output audio alone, while the second audio output device disposed on the user's right ear may not output audio.

203. If the wearable device is performing a call service and the usage environment of the wearable device includes other users appearing only on the left ear side, control the second audio output device to output audio.

For example, the wearable device detects that it is currently conducting a call service, and there are other users only on the left ear side of the current user, but no other users on the right ear side of the current user, then the electronic device can only control the second audio output device set on the right ear side of the user to output audio alone.

In one embodiment, the process of 203 may also include: if the usage environment of the wearable device is that other users appear only within the preset range on the left ear side of the user, and no other users appear within the preset range on the right ear side of the user, and a call service is being conducted, then the wearable device may only control the second audio output device set on the right ear side of the user to output audio alone, while the first audio output device set on the left ear side of the user may not output audio.

It is understandable that when other users appear only on the left ear of the user, but not on the right ear of the user, the embodiment of the present application can only control the second audio output device disposed on the right ear of the user to output audio alone, while the first audio output device disposed on the left ear of the user does not output audio. In this way, the sound source can be effectively kept away from other users on the left ear. On the one hand, the sound source can be kept far away from the other user, thereby effectively preventing the other user from hearing the call voice when the sound attenuation is large. On the other hand, the shielding effect of the current user's head can be used to block the sound propagation, thereby effectively preventing the other user from hearing the call voice. Therefore, the embodiment of the present application can also enhance the privacy protection of calls.

In some embodiments, the preset range may be a value such as 1 meter, 1.5 meters, or 0.8 meters. For example, if the wearable device is used in an environment where other users appear only within 1 meter of the left ear of the user, and no other users appear within 1 meter of the right ear of the user, and a call service is being conducted, the wearable device may only control the second audio output device disposed on the right ear of the user to output audio alone, while the first audio output device disposed on the left ear of the user may not output audio.

Please refer to Figure 3, which is another flow chart of the device control method provided in an embodiment of the present application. The device control method can be applied to a wearable device, which includes at least a first audio output device and a second audio output device. The first audio output device is arranged on a side corresponding to the left ear, and the second audio output device is arranged on a side corresponding to the right ear. That is, when the wearable device is worn by a user, the first audio output device can be located on the left ear side of the user, and the second audio output device can be located on the right ear side of the user.

In some embodiments, the audio output device may include an electroacoustic transducer device such as a speaker.

The process of the device control method provided in the embodiment of the present application may include:

301. In response to an audio output instruction, obtain information about a use environment of the wearable device, where the information about the use environment includes whether other users appear on the left ear and the right ear.

For example, in response to an audio output instruction, that is, when audio output is required, the wearable device can first obtain information about its current usage environment.

In this embodiment, the information of the use environment may include whether other users other than the user of the wearable device (i.e., the current user) appear on the left ear and the right ear. Of course, the information of the use environment may also include other information, which is not specifically limited in the embodiment of the present application.

302. If the output audio is a music file, mix the left channel audio and the right channel audio of the music file into a mono audio.

For example, the electronic device can also detect whether the audio to be output is a music file.

If it is detected that the audio to be output is a music file, the wearable device can mix the left channel audio and the right channel audio of the music file into a mono audio.

If it is detected that the audio to be spoken is not a music file, the wearable device can perform other operations.

After obtaining the information of the use environment of the wearable device, the wearable device can detect whether the use environment is that other users appear only on the right ear side or other users appear only on the left ear side.

If it is detected that other users appear only on the right ear side, the process of 303 may be entered.

If it is detected that other users appear only on the left ear side, the process of 304 may be entered.

303. If the usage environment of the wearable device includes other users appearing only on the right ear side, control the first audio output device to output the mixed mono audio.

For example, if the wearable device detects that other users appear only on the right ear of the current user, but not on the left ear of the current user, the electronic device can only control the first audio output device set on the left ear of the user to output the mixed mono audio alone.

In one embodiment, the process of 303 may include: if the usage environment of the wearable device is that other users appear only within a preset range on the right ear side of the user, and no other users appear within the preset range on the left ear side of the user, then the wearable device can only control the first audio output device set on the left ear side of the user to output the mixed mono audio alone, while the second audio output device set on the right ear side of the user may not output audio.

It is understandable that when other users appear only on the right ear side of the user, but not on the left ear side of the user, the embodiment of the present application can only control the first audio output device arranged on the left ear side of the user to output audio alone, while the second audio output device arranged on the right ear side of the user does not output audio. In this way, the sound source can be effectively kept away from other users on the right ear side. On the one hand, the sound source can be kept far away from the other user, thereby effectively preventing the other user from hearing the sound of the music when the sound attenuation is large. On the other hand, the shielding effect of the current user's head can be used to block the sound propagation, thereby effectively preventing the other user from hearing the sound of the music. Therefore, the embodiment of the present application can also effectively avoid disturbing other users when playing music.

304. If the usage environment of the wearable device includes other users appearing only on the left ear side, control the second audio output device to output the mixed mono audio.

For example, if the wearable device detects that other users appear only on the left ear of the current user, but not on the right ear of the current user, the electronic device can only control the second audio output device set on the right ear of the user to output the mixed mono audio alone.

In one embodiment, the process of 304 may also include: if the usage environment of the wearable device is that other users appear only within a preset range on the left ear side of the user, and no other users appear within the preset range on the right ear side of the user, then the wearable device can only control the second audio output device set on the right ear side of the user to output the mixed mono audio separately, while the first audio output device set on the left ear side of the user may not output audio.

It is understandable that when other users appear only on the left ear side of the user, but not on the right ear side of the user, the embodiment of the present application can only control the second audio output device disposed on the right ear side of the user to output the mixed mono audio alone, while the first audio output device disposed on the left ear side of the user does not output audio. In this way, the sound source can be effectively kept away from other users on the left ear side. On the one hand, the sound source can be kept far away from the other user, thereby effectively preventing the other user from hearing the sound of the music when the sound attenuation is high. On the other hand, the shielding effect of the current user's head can be used to block the sound propagation, thereby effectively preventing the other user from hearing the sound of the music. Therefore, the embodiment of the present application can also effectively avoid disturbing other users when playing music.

In one implementation, the wearable device may further include a microphone, and the information about the use environment acquired by the wearable device may include: a noise value of the surrounding environment acquired by the microphone.

Then, in the 302 process, if the output audio is a music file, the left channel audio and the right channel audio of the music file are mixed into a mono audio, including: if the noise value is less than a preset threshold and the output audio is a music file, the left channel audio and the right channel audio of the music file are mixed into a mono audio.

For example, if the wearable device detects that the noise value of the surrounding environment is less than a preset threshold, then the environment in which the wearable device is located can be considered to be a quiet environment. In this case, the wearable device can mix the left channel audio and the right channel audio of the music file to be output into a mono audio. Afterwards, if the use environment of the wearable device is that other users appear only on the right ear side, the wearable device can control the first audio output device set on the left ear side of the user to output the mixed mono audio alone, while the second audio output device set on the right ear side of the user does not output any audio. If the use environment of the wearable device is that other users appear only on the left ear side, the wearable device can control the second audio output device set on the right ear side of the user to output the mixed mono audio, while the first audio output device set on the left ear side of the user may not output any audio.

It can be understood that, through the above method, it is possible to effectively prevent the current user of the wearable device from disturbing other users due to playing music in a quiet environment.

In one embodiment, the wearable device may further include a first camera module and a second camera module, wherein the first camera module may be arranged at a side corresponding to the left ear, and the second camera module may be arranged at a side corresponding to the right ear. Then, the wearable device may detect whether other users appear at the left ear side through images captured by the first camera module, and detect whether other users appear at the right ear side through images captured by the second camera module.

For example, the wearable device can detect whether other users appear on the left ear side of the user through the image captured by the first camera module corresponding to the left ear side of the user, and detect whether other users appear on the right ear side of the user through the image captured by the second camera module corresponding to the right ear side of the user. For example, if a portrait appears in the image captured by the first camera module, it can be determined that other users appear on the left ear side. If a portrait appears in the image captured by the second camera module, it can be determined that other users appear on the right ear side.

In one embodiment, the first camera module and the second camera module may also be depth camera modules, that is, the wearable device may calculate the depth information of the portrait in the image captured by the first camera module and the second camera module, and calculate the distance between other users and the wearable device based on the depth information. Based on the distance between other users and the wearable device, the wearable device may detect whether other users appear within a preset range on the left ear side of the user, or whether other users appear within a preset range on the right ear side of the user.

In another implementation, the information about the use environment of the wearable device may also be obtained in the following manner:

For example, the wearable device may further include a sensor, which may be used to receive gesture information input by a user.

Then, obtaining information about the usage environment of the wearable device may include: receiving gesture information input by the user through a sensor, wherein, when the sensor receives a preset first gesture, determining that the usage environment of the wearable device includes other users appearing only on the right ear side, and when the sensor receives a preset second gesture, determining that the usage environment of the wearable device includes other users appearing only on the left ear side.

For example, a sensor may be provided on the wearable device, and the sensor may be used to receive gesture information of the user, for example, the sensor may receive gesture operations such as tapping, touching (such as pressing or sliding) by the user. Then, the current user of the wearable device may input information of the corresponding usage environment to the wearable device by sending corresponding gestures to the sensor. For example, when the current user of the wearable device determines that other users appear only on the right side, the current user may send a preset first gesture to the sensor, thereby inputting environmental information that other users appear only on the right side to the wearable device. For another example, when the current user of the wearable device determines that other users appear only on the left side, the current user may send a preset second gesture to the sensor, thereby inputting environmental information that other users appear only on the left side to the wearable device.

For example, the preset first gesture may be tapping the sensor once, the preset second gesture may be tapping the sensor twice, etc. Alternatively, the preset first gesture may be short pressing the touch sensor, the preset second gesture may be long pressing the touch sensor, etc.

In another embodiment, the information of the use environment of the wearable device can also be obtained in the following manner:

For example, the wearable device may include a first sensor and a second sensor, wherein the first sensor is disposed on a side corresponding to a left ear, and the second sensor is disposed on a side corresponding to a right ear, and both the first sensor and the second sensor may be used to receive gesture information input by a user.

Then, obtaining information about the usage environment of the wearable device may include: if the gesture input by the user and received by the first sensor matches the preset trigger gesture, it is determined that the usage environment of the wearable device includes other users appearing only on the right ear side; if the gesture input by the user and received by the second sensor matches the preset trigger gesture, it is determined that the usage environment of the wearable device includes other users appearing only on the left ear side.

For example, two sensors may be provided on the wearable device, namely a first sensor and a second sensor. The first sensor may be provided on a side corresponding to the left ear, and the second sensor may be provided on a side corresponding to the right ear. Both the first sensor and the second sensor may be used to receive gesture information of the user, for example, the first sensor and the second sensor may receive gesture operations such as tapping, touching (such as pressing or sliding) of the user.

Then, the current user of the wearable device can input the corresponding use environment information to the wearable device by sending a corresponding gesture to the first sensor or the second sensor. For example, when the current user of the wearable device determines that other users appear only on the right side, the current user can send a preset trigger gesture to the first sensor, thereby inputting the environment information that other users appear only on the right side to the wearable device. For another example, when the current user of the wearable device determines that other users appear only on the left side, the current user can send a preset trigger gesture to the second sensor, thereby inputting the environment information that other users appear only on the left side to the wearable device.

In some implementations, the preset trigger gesture may be tapping the sensor once or the preset trigger gesture may be a sliding operation, and so on.

Please refer to Figures 4 to 10, which are scene schematic diagrams of the device control method provided in the embodiments of the present application.

In this embodiment, the wearable device may be, for example, smart glasses. A schematic diagram of the smart glasses may be shown in FIG4 . Referring to FIG4 , a first speaker 1 and a second speaker 2 are respectively provided on the left and right temples of the smart glasses 10. The first speaker and the second speaker are installed inside the temples. A first sound outlet 3 is also provided at a position corresponding to the first speaker 1. A second sound outlet (not shown) is also provided at a position corresponding to the second speaker 2. A first microphone 4 may be provided on the upper side of the right temple of the smart glasses 10, and a second microphone (not shown) may be provided on the lower side of the temple.

The smart glasses 10 can be used to play audio. For example, the smart glasses 10 can receive an audio file from a smartphone 20 and play the audio file. For example, when the current user is wearing smart glasses and the current user uses a smartphone to make an incoming call, the smartphone can transmit the audio data corresponding to the call voice of the other party to the smart glasses, and the smart glasses can play it to the current user through the first speaker and the first sound outlet. In addition, the smart glasses can also collect the call voice of the current user through the first microphone and the second microphone, and send the call voice data of the current user to the smartphone, and then the smartphone transmits it to the other party through the communication network.

For example, the structural diagram of the audio playback system of the smart glasses can be shown in Figure 5. The main control chip (SOC) of the smart glasses can receive the audio data corresponding to the call voice of the caller from the smart phone, and transmit the audio data to the audio power amplifier. The audio signal corresponding to the call voice is amplified and processed by the audio power amplifier and then transmitted to the speaker for playback. Among them, the audio power amplifier may include a first audio power amplifier corresponding to the left ear side and a second audio power amplifier corresponding to the right ear side, and the speaker also includes a first speaker corresponding to the left ear side and a second speaker corresponding to the right ear side.

For example, the current user wears smart glasses, and the smart glasses establish a data transmission connection with the current user's smartphone. For example, at this time, the smartphone receives a call from the current user's friend, and the current user answers the call. During the call, the current user 5 finds that there is another person 6 on his right side and the other person 6 is relatively close to the current user 5. The scene can be shown in Figure 6. In this case, in order to avoid the leakage of the call voice, the current user can tap the first sensor once. After the smart glasses receive the tapping gesture from the user through the first sensor, the tapping gesture can be matched with the preset trigger gesture. For example, the preset trigger gesture is a gesture of tapping once. Then, at this time, the smart glasses can only control the first speaker set on the left ear side to output the call voice, while the second speaker set on the right ear side does not output the call voice. At this time, the state diagram of the audio playback system of the smart glasses can be shown in Figure 7, that is, the playback path corresponding to the second audio power amplifier and the second speaker is disconnected.

For another example, during a call, the current user 5 finds that there is another person 7 on his left side and the other person 7 is relatively close to the current user 5. This scene can be shown in Figure 8. In this case, in order to avoid leakage of call voice, the current user can tap the second sensor once. After the smart glasses receive the tapping gesture from the user through the second sensor, the tapping gesture can be matched with the preset trigger gesture. For example, the preset trigger gesture is a gesture of tapping once. Then, at this time, the smart glasses can only control the second speaker set on the right ear side to output the call voice, while the first speaker set on the left ear side does not output the call voice. At this time, the state diagram of the audio playback system of the smart glasses can be shown in Figure 9, that is, the playback path corresponding to the first audio power amplifier and the first speaker is disconnected.

For another example, after ending the call, the current user enters a quiet office area, and the current user opens the music application using a smart phone and orders multiple songs. At this time, the current user finds that other colleagues are sitting on his left. In this case, in order to avoid disturbing other colleagues with the played songs, the current user taps the second sensor once. After the smart glasses receive the tapping gesture from the user through the second sensor, the tapping gesture can be matched with the preset trigger gesture. For example, the preset trigger gesture is a gesture of tapping once. Then, at this time, the smart glasses can mix the left channel audio and the right channel audio of the song into mono audio, and only control the second speaker set on the right ear side to output the mixed song, while the first speaker set on the left ear side does not output the song. At this time, the state diagram of the audio playback system of the smart glasses can be as shown in Figure 10, that is, the playback path corresponding to the first audio power amplifier and the first speaker is disconnected.

Please refer to FIG11, which is a schematic diagram of the structure of the device control device provided in the embodiment of the present application. The device control device can be applied to a wearable device, wherein the wearable device at least includes a first audio output device and a second audio output device, wherein the first audio output device is arranged on a side corresponding to the left ear, and the second audio output device is arranged on a side corresponding to the right ear. The device control device 300 may include: an acquisition module 301, a first control module 302, and a second control module 303.

An acquisition module 301 is used to acquire information about a use environment of the wearable device in response to an audio output instruction, wherein the information about the use environment includes whether other users appear on the left ear and the right ear;

A first control module 302 is configured to control the first audio output device to output audio if the use environment of the wearable device includes other users appearing only on the right ear side;

The second control module 303 is used to control the second audio output device to output audio if the usage environment of the wearable device includes other users appearing only on the left ear.

In one implementation, the first control module 302 is used to: if the wearable device is performing a call service and the use environment of the wearable device includes other users appearing only on the right ear, control the first audio output device to output audio;

The second control module 303 is used to: if the wearable device is performing a call service and the use environment of the wearable device includes other users appearing only on the left ear, control the second audio output device to output audio.

In one implementation, the acquisition module 301 is further configured to: if the output audio is a music file, mix the left channel audio and the right channel audio of the music file into a mono audio.

Then, the first control module 302 is used to: if the usage environment of the wearable device includes other users appearing only on the right ear side, control the first audio output device to output the mixed mono audio.

The second control module 303 is used to: if the usage environment of the wearable device includes other users appearing only on the left ear side, control the second audio output device to output the mixed mono audio.

In one implementation, the wearable device further includes a microphone, and the information about the usage environment further includes: a noise value of the surrounding environment obtained by the microphone.

The acquisition module 301 is further configured to: if the noise value is less than a preset threshold and the output audio is a music file, mix the left channel audio and the right channel audio of the music file into a mono audio.

In one embodiment, the wearable device further includes a first camera module and a second camera module, wherein the first camera module is arranged on a side corresponding to a left ear, and the second camera module is arranged on a side corresponding to a right ear.

Then, the acquisition module 301 is also used to: detect whether there is other users on the left ear side through the image taken by the first camera module, and detect whether there is other users on the right ear side through the image taken by the second camera module.

In one embodiment, the wearable device further includes a sensor, and the sensor is used to receive gesture information input by a user.

Then, the acquisition module 301 is used to: receive gesture information input by the user through the sensor, wherein, when the sensor receives a preset first gesture, it is determined that the use environment of the wearable device includes other users appearing only on the right ear side; when the sensor receives a preset second gesture, it is determined that the use environment of the wearable device includes other users appearing only on the left ear side.

In one embodiment, the wearable device further includes a first sensor and a second sensor, wherein the first sensor is arranged on a side corresponding to a left ear, and the second sensor is arranged on a side corresponding to a right ear, and the first sensor and the second sensor are used to receive gesture information input by a user.

Then, the acquisition module 301 is also used for: if the gesture input by the user and received by the first sensor matches the preset trigger gesture, then determining that the usage environment of the wearable device includes other users appearing only on the right ear side; if the gesture input by the user and received by the second sensor matches the preset trigger gesture, then determining that the usage environment of the wearable device includes other users appearing only on the left ear side.

In one implementation, the first control module 302 is used to control the first audio output device to output audio if the usage environment of the wearable device includes other users appearing only within a preset range on the right ear side.

The second acquisition module 303 is used to: if the use environment of the wearable device includes other users appearing only within a preset range on the left ear side, control the second audio output device to output audio.

An embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed on a computer, the computer executes the process in the device control method provided in this embodiment.

An embodiment of the present application also provides a wearable device, including a memory, a processor, a first audio output device, and a second audio output device, wherein the first audio output device is arranged on a side corresponding to a left ear, and the second audio output device is arranged on a side corresponding to a right ear, and the processor is used to execute the process in the device control method provided in this embodiment by calling a computer program stored in the memory.

For example, the wearable device may be a mobile terminal such as a tablet computer or a smart phone. Please refer to FIG12 , which is a schematic diagram of the structure of a wearable device provided in an embodiment of the present application.

The wearable device 400 may include components such as an audio output module 401, a memory 402, and a processor 403. Those skilled in the art will appreciate that the wearable device structure shown in FIG. 12 does not limit the wearable device, and may include more or fewer components than shown, or combine certain components, or arrange components differently.

The audio output module 401 may include a first audio output device and a second audio output device. The first audio output device is arranged on the side corresponding to the left ear, and the second audio output device is arranged on the side corresponding to the right ear. The first audio output device and the second audio output device may both be speakers, etc.

The memory 402 may be used to store applications and data. The applications stored in the memory 402 include executable codes. The applications may be composed of various functional modules. The processor 403 executes various functional applications and data processing by running the applications stored in the memory 402.

The processor 403 is the control center of the wearable device. It uses various interfaces and lines to connect the various parts of the entire wearable device. By running or executing applications stored in the memory 402 and calling data stored in the memory 402, it executes various functions of the wearable device and processes data, thereby monitoring the wearable device as a whole.

In this embodiment, the processor 403 in the wearable device loads the executable code corresponding to the process of one or more applications into the memory 402 according to the following instructions, and the processor 403 runs the application stored in the memory 402 to execute:

In response to the audio output instruction, obtaining information about the use environment of the wearable device, wherein the information about the use environment includes whether other users appear on the left ear side and the right ear side;

If the usage environment of the wearable device includes other users appearing only on the right ear, controlling the first audio output device to output audio;

If the usage environment of the wearable device includes other users appearing only on the left ear side, the second audio output device is controlled to output audio.

Please refer to FIG. 13 , the wearable device 400 may include components such as an audio output module 401 , a memory 402 , a processor 403 , a battery 404 , a power amplifier 405 , and a microphone 406 .

The audio output module 401 may include a first audio output device and a second audio output device. The first audio output device is arranged on the side corresponding to the left ear, and the second audio output device is arranged on the side corresponding to the right ear. The first audio output device and the second audio output device may both be speakers, etc.

The memory 402 may be used to store applications and data. The applications stored in the memory 402 include executable codes. The applications may be composed of various functional modules. The processor 403 executes various functional applications and data processing by running the applications stored in the memory 402.

The processor 403 is the control center of the wearable device. It uses various interfaces and lines to connect various parts of the entire wearable device. By running or executing applications stored in the memory 402 and calling data stored in the memory 402, it executes various functions of the wearable device and processes data, thereby monitoring the wearable device as a whole.

The battery 404 can provide power support for various components and modules of the wearable device, thereby ensuring the normal operation of each component and module.

The power amplifier 405 may be used to increase the audio power at the sound generating output element, reconstructing the input audio signal.

The microphone 406 may be used to pick up sound signals in the surrounding environment.

In this embodiment, the processor 403 in the wearable device loads the executable code corresponding to the process of one or more applications into the memory 402 according to the following instructions, and the processor 403 runs the application stored in the memory 402 to execute:

In response to the audio output instruction, obtaining information about the use environment of the wearable device, wherein the information about the use environment includes whether other users appear on the left ear side and the right ear side;

If the usage environment of the wearable device includes other users appearing only on the right ear, controlling the first audio output device to output audio;

If the usage environment of the wearable device includes other users appearing only on the left ear side, the second audio output device is controlled to output audio.

In one embodiment, the processor 403 can be used to execute: if the wearable device is performing a call service and the usage environment of the wearable device includes other users appearing only on the right ear side, then control the first audio output device to output audio; if the wearable device is performing a call service and the usage environment of the wearable device includes other users appearing only on the left ear side, then control the second audio output device to output audio.

In one embodiment, the processor 403 can be used to execute: if the output audio is a music file, the left channel audio and the right channel audio of the music file are mixed into mono audio; if the use environment of the wearable device includes other users appearing only on the right ear side, the first audio output device is controlled to output the mixed mono audio; if the use environment of the wearable device includes other users appearing only on the left ear side, the second audio output device is controlled to output the mixed mono audio.

In one implementation, the wearable device further includes a microphone, and the information about the usage environment further includes: a noise value of the surrounding environment obtained by the microphone.

Then, when the processor 403 executes the step of mixing the left channel audio and the right channel audio of the music file into a mono audio if the output audio is a music file, it can execute the step of: if the noise value is less than a preset threshold and the output audio is a music file, mixing the left channel audio and the right channel audio of the music file into a mono audio.

In one embodiment, the wearable device further includes a first camera module and a second camera module, wherein the first camera module is arranged on a side corresponding to a left ear, and the second camera module is arranged on a side corresponding to a right ear.

Then, the processor 403 is used to execute: detecting whether other users appear on the left ear side through the image taken by the first camera module, and detecting whether other users appear on the right ear side through the image taken by the second camera module.

In one embodiment, the wearable device further includes a sensor, and the sensor is used to receive gesture information input by a user.

Then, when the processor 403 executes the acquisition of information on the usage environment of the wearable device, it can execute: receiving gesture information input by the user through the sensor, wherein, when the sensor receives a preset first gesture, determining that the usage environment of the wearable device includes other users appearing only on the right ear side, and when the sensor receives a preset second gesture, determining that the usage environment of the wearable device includes other users appearing only on the left ear side.

In one embodiment, the wearable device further includes a first sensor and a second sensor, wherein the first sensor is arranged on a side corresponding to a left ear, and the second sensor is arranged on a side corresponding to a right ear, and the first sensor and the second sensor are used to receive gesture information input by a user.

Then, when the processor 403 executes the acquisition of information on the usage environment of the wearable device, it can execute: if the gesture input by the user and received by the first sensor matches the preset trigger gesture, it is determined that the usage environment of the wearable device includes other users appearing only on the right ear side; if the gesture input by the user and received by the second sensor matches the preset trigger gesture, it is determined that the usage environment of the wearable device includes other users appearing only on the left ear side.

In one embodiment, the processor 403 can be used to execute: if the use environment of the wearable device includes other users appearing only within a preset range on the right ear side, then control the first audio output device to output audio; if the use environment of the wearable device includes other users appearing only within a preset range on the left ear side, then control the second audio output device to output audio.

In the above embodiments, the description of each embodiment has its own emphasis. For the part that is not described in detail in a certain embodiment, please refer to the detailed description of the device control method above, and will not be repeated here.

The device control apparatus provided in the embodiment of the present application belongs to the same concept as the device control method in the above embodiment. Any method provided in the device control method embodiment can be run on the device control apparatus. The specific implementation process is detailed in the device control method embodiment and will not be repeated here.

It should be noted that, for the device control method described in the embodiment of the present application, a person of ordinary skill in the art can understand that all or part of the process of implementing the device control method described in the embodiment of the present application can be completed by controlling the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, such as a memory, and executed by at least one processor, and the execution process may include the process of the embodiment of the device control method. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), etc.

For the device control device of the embodiment of the present application, each functional module can be integrated into a processing chip, or each module can exist physically separately, or two or more modules can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, a disk or an optical disk.

The above is a detailed introduction to a device control method, apparatus, storage medium and wearable device provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims (8)

1. A device control method, applied to a wearable device, characterized in that the wearable device comprises at least a first audio output device and a second audio output device, the first audio output device is arranged on a side corresponding to a left ear, and the second audio output device is arranged on a side corresponding to a right ear, the method comprising: In response to the audio output instruction, obtaining information about the use environment of the wearable device, wherein the information about the use environment includes whether other users appear on the left ear side and the right ear side; If the wearable device is performing a call service and the use environment of the wearable device includes other users appearing only on the right ear side, controlling the first audio output device to output audio; If the wearable device is performing a call service and the use environment of the wearable device includes other users appearing only on the left ear, controlling the second audio output device to output audio; If the audio output by the wearable device is a music file, the noise value of the surrounding environment acquired by the microphone of the wearable device is less than a preset threshold, and the use environment of the wearable device includes other users appearing only on the right ear, the left channel audio and the right channel audio of the music file are mixed into a mono audio, and the first audio output device is controlled to output the mixed mono audio; If the audio output by the wearable device is a music file, the noise value of the surrounding environment obtained by the microphone of the wearable device is less than a preset threshold, and the usage environment of the wearable device includes other users appearing only on the left ear, the left channel audio and the right channel audio of the music file are mixed into mono audio, and the second audio output device is controlled to output the mixed mono audio. 2. The device control method according to claim 1, characterized in that the wearable device further comprises a first camera module and a second camera module, the first camera module is arranged on a side corresponding to the left ear, and the second camera module is arranged on a side corresponding to the right ear; the method further comprises: The image taken by the first camera module is used to detect whether there is another user on the left ear side, and the image taken by the second camera module is used to detect whether there is another user on the right ear side. 3. The device control method according to claim 1, characterized in that the wearable device further comprises a sensor, and the sensor is used to receive gesture information input by the user; The obtaining of information about the use environment of the wearable device includes: receiving gesture information input by the user through the sensor, wherein when the sensor receives a preset first gesture, determining that the use environment of the wearable device includes other users appearing only on the right ear side, and when the sensor receives a preset second gesture, determining that the use environment of the wearable device includes other users appearing only on the left ear side. 4. The device control method according to claim 1, characterized in that the wearable device further comprises a first sensor and a second sensor, the first sensor is arranged on a side corresponding to a left ear, the second sensor is arranged on a side corresponding to a right ear, and the first sensor and the second sensor are used to receive gesture information input by a user; The obtaining of information about the use environment of the wearable device includes: If the gesture input by the user and received by the first sensor matches the preset trigger gesture, determining that the usage environment of the wearable device includes other users appearing only on the right ear side; If the gesture input by the user and received by the second sensor matches the preset trigger gesture, it is determined that the usage environment of the wearable device includes other users appearing only on the left ear side. 5. The device control method according to claim 1, characterized in that the method comprises: If the use environment of the wearable device includes other users only within a preset range on the right ear side, controlling the first audio output device to output audio; If the usage environment of the wearable device includes other users appearing only within a preset range on the left ear side, the second audio output device is controlled to output audio. 6. A device control apparatus, applied to a wearable device, characterized in that the wearable device comprises at least a first audio output device and a second audio output device, the first audio output device is arranged on a side corresponding to a left ear, and the second audio output device is arranged on a side corresponding to a right ear, the apparatus comprising: an acquisition module, configured to acquire information about a use environment of the wearable device in response to an audio output instruction, wherein the information about the use environment includes whether other users appear on the left ear side and the right ear side; a first control module, configured to control the first audio output device to output audio if the wearable device is performing a call service and the use environment of the wearable device includes other users appearing only on the right ear side, and to mix the left channel audio and the right channel audio of the music file into a mono audio if the audio output by the wearable device is a music file, the noise value of the surrounding environment acquired by the microphone of the wearable device is less than a preset threshold, and the use environment of the wearable device includes other users appearing only on the right ear side, and control the first audio output device to output the mixed mono audio; The second control module is used to control the second audio output device to output audio if the wearable device is conducting a call service and the use environment of the wearable device includes other users appearing only on the left ear side; and is also used to mix the left channel audio and the right channel audio of the music file into mono audio if the audio output by the wearable device is a music file, the noise value of the surrounding environment obtained by the microphone of the wearable device is less than a preset threshold, and the use environment of the wearable device includes other users appearing only on the left ear side, and control the second audio output device to output the mixed mono audio. 7. A computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 5. 8. A wearable device, comprising a memory, a processor, a first audio output device and a second audio output device, wherein the first audio output device is arranged on a side corresponding to a left ear, and the second audio output device is arranged on a side corresponding to a right ear, and the processor is used to execute the method according to any one of claims 1 to 5 by calling a computer program stored in the memory.