KR102063342B1 - Method and system for controlling earset - Google Patents

Abstract

The present invention provides a method and system for controlling an earset. According to one or more exemplary embodiments, a method for controlling an earset includes: recognizing a touch gesture on a touch area of a first earset of an earset pair, and in response to recognizing a first type of touch gesture, a second type of touch gesture within a preset time. The first control signal is generated with respect to the recognized first type of touch gesture when the second type of touch gesture is no longer recognized within the preset time, And generating a second control signal with respect to the recognized first type of touch gesture when the second type of touch gesture is further recognized within time.

Description

Earset control method and system {METHOD AND SYSTEM FOR CONTROLLING EARSET}

The following description relates to an earset control method and system, and a computer program stored in a computer readable recording medium coupled to a computer for executing the earset control method according to embodiments of the present invention and a recording medium thereof.

Earset (earset) is a device that includes a earphone and a microphone that is used to connect to the phone to talk without using a hand, for example, connected to a smartphone to receive and output not only a telephone call, but also audio such as music or Various control signals for controlling the smartphone can be provided to the smartphone through physical buttons, sensors, or voice. For example, Korean Patent Laid-Open Publication No. 10-2017-0030375 discloses a Bluetooth earset with a built-in ear canal microphone.

Through the limited input interface (for example, the touch interface of the touch sensor included in the earset) included in the earset, an earset control method for easily controlling various functions, a computer device performing the earset control method, and the earset control method A computer program stored on a computer readable recording medium and the recording medium are provided for execution.

Earset control method for controlling the transmission of the audio signal according to whether the user wears the earset, a computer device for performing the earset control method, a computer program stored in a computer-readable recording medium for executing the earset control method on the computer and recording thereof Provide the medium.

The earset control method for quickly returning the set value of the earset to the default setting, the computer device performing the earset control method, the computer program stored in the computer readable recording medium and the recording medium for executing the earset control method on the computer. to provide.

Recognizing a touch gesture on a touch area of the first earset of the earset pair; In response to recognizing the first type of touch gesture, checking whether the second type of touch gesture is further recognized within a preset time; And generating a first control signal with respect to the recognized first type of touch gesture when the second type of touch gesture is not recognized within the preset time, and generating the second type of touch gesture within the preset time. Is further recognized, the method may further include generating a second control signal with respect to the recognized first type of touch gesture.

Transmitting an audio signal to the first earset and the second earset; Determining whether both the first earset and the second earset are separated from a user's ear based on an output value of a proximity sensor included in each of the first earset and the second earset; And if it is determined that both the first earset and the second earset are separated from the user's ear, stopping the transmission of the audio signal.

Storing basic settings of the first earset and the second earset; Storing current setting values of the first earset and the second earset; Recognizing a touch gesture for a touch area of each of the first earset and the second earset; And when a preset touch gesture for each of the first earset and the second earset is continuously recognized within a preset time range, the current setting values of the first earset and the second earset based on the basic setting value. It provides an earset control method comprising the step of changing.

In combination with a computer, a computer program stored in a computer readable recording medium for executing the earset control method on a computer is provided.

Provided is a computer-readable recording medium having recorded thereon a program for executing the earset control method on a computer.

A computer device comprising: at least one processor implemented to execute instructions readable by the computer device, wherein the at least one processor recognizes a touch gesture on a touch area of a first earset of an earset pair, In response to the recognition of the first type of touch gesture, it is determined whether the second type of touch gesture is further recognized within a preset time, and when the second type of touch gesture is not further recognized within the preset time, A first control signal is generated for the recognized first type of touch gesture, and when the second type of touch gesture is further recognized within the preset time, a first control signal for the recognized first type of touch gesture. To provide a computer device for generating.

A computer device comprising: at least one processor implemented to execute instructions readable by the computer device, wherein the at least one processor transmits an audio signal to a first earset and a second earset, It is determined whether both the first earset and the second earset are separated from a user's ear based on an output value of a proximity sensor included in each of the earset and the second earset, and both the first earset and the second earset A computer device is provided for stopping transmission of the audio signal when determined to be detached from a user's ear.

A computer device comprising: at least one processor implemented to execute instructions readable by the computer device, wherein the at least one processor stores basic settings of a first earset and a second earset, Stores current settings of the first earset and the second earset, recognizes a touch gesture for each touch area of the first earset and the second earset, and presets each of the first earset and the second earset. When a touch gesture is continuously recognized within a preset time range, a computer device is provided to change current setting values of the first earset and the second earset based on the basic setting values.

Various functions can be controlled more easily through the limited input interface included in the earset (for example, the touch interface of the touch sensor included in the earset). For example, different control of the sound source control and the volume control may be possible according to the following touch gesture even for the same touch gesture.

The transmission of the audio signal may be controlled according to whether the user wears the earset. For example, if the user detaches both ears from the ear, the user can automatically stop playback of the sound source or stop transmitting audio signals for phone calls.

You can quickly return the earset's settings to their default settings. For example, if the audio volume level suddenly becomes too high or the audio volume level suddenly becomes too low while operating the audio volume level, the user can quickly return the audio volume to the basic level through a simple touch operation.

1 is a block diagram illustrating an example of a computer device according to an embodiment of the present invention.
2 is a diagram illustrating an example of communication between an ear set pair and an electronic device according to one embodiment of the present invention.
3 illustrates another example of communication between an earset pair and an electronic device according to an embodiment of the present invention.
4 is a flowchart illustrating an example of an earset control method according to an embodiment of the present invention.
5 is a flowchart illustrating an example of an earset control method according to an embodiment of the present invention.
6 is a flowchart illustrating another example of an earset control method according to an embodiment of the present invention.
7 is a flowchart illustrating an example of a method for controlling an earset in an earset according to an embodiment of the present invention.
8 is a flowchart illustrating an example of an earset control method according to another embodiment of the present invention.
9 is a flowchart illustrating an example of an earset control method according to another exemplary embodiment of the present invention.

Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings.

Earset control method according to embodiments of the present invention can be implemented through a computer device to be described later. In this case, a computer program according to an embodiment of the present invention may be installed and run on the computer device, and the computer device may perform the earset control method according to the embodiments of the present invention under control of the driven computer program. . The above-described computer program may be stored in a computer-readable recording medium in combination with a computer device to cause the computer to execute the earset control method.

1 is a block diagram illustrating an example of a computer device according to an embodiment of the present invention. The electronic device and / or the earset pair to be described later may be implemented by the computer device 100 shown in FIG. 1, and the method of controlling an earset according to an embodiment of the present invention is described with reference to FIG. 1. It may be performed by the electronic device and / or earset pair implemented by (100).

As illustrated in FIG. 1, the computer device 100 may include a memory 110, a processor 120, a communication interface 130, and an input / output interface 140. The memory 110 may be a computer-readable recording medium, and may include a permanent mass storage device such as random access memory (RAM), read only memory (ROM), and a disk drive. In this case, the non-volatile mass storage device such as a ROM and a disk drive may be included in the computer device 100 as a separate permanent storage device separate from the memory 110. In addition, the memory 110 may store an operating system and at least one program code. These software components may be loaded into the memory 110 from a computer readable recording medium separate from the memory 110. Such a separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, disk, tape, DVD / CD-ROM drive, memory card, and the like. In other embodiments, software components may be loaded into memory 110 via communication interface 130 rather than a computer readable recording medium. For example, the software components may be loaded into the memory 110 of the computer device 100 based on a computer program installed by files received via the network 160.

The processor 120 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to the processor 120 by the memory 110 or the communication interface 130. For example, the processor 120 may be configured to execute a command received according to a program code stored in a recording device such as the memory 110.

The communication interface 130 may provide a function for the computer device 100 to communicate with other devices (eg, storage devices described above) through the network 160. For example, a request, command, data, file, etc. generated by the processor 120 of the computer device 100 according to a program code stored in a recording device such as the memory 110 may be controlled according to the control of the communication interface 130. 160 may be transferred to other devices. Conversely, signals, commands, data, files, and the like from other devices may be received by the computer device 100 via the communication interface 130 of the computer device 100 via the network 160. Signals, commands, data, and the like received through the communication interface 130 may be transmitted to the processor 120 or the memory 110, and the files and the like may be further included in the storage medium (described above). Persistent storage).

The input / output interface 140 may be a means for interfacing with the input / output device 150. For example, the input device may include a device such as a microphone, a keyboard or a mouse, and the output device may include a device such as a display or a speaker. As another example, the input / output interface 140 may be a means for interfacing with a device in which functions for input and output are integrated into one, such as a touch screen. The input / output device 150 may be configured as the computer device 100 and one device.

Also, in other embodiments, the computer device 100 may include fewer or more components than the components of FIG. 1. However, it is not necessary to clearly show most of the prior art components. For example, the computer device 100 may be implemented to include at least some of the input and output devices 150 described above, or may further include other components such as a transceiver, a database, and the like.

The communication method is not limited, and a communication method utilizing a communication network (for example, mobile communication network, wired internet, wireless internet, and broadcasting network) that the network 160 may include, as well as Bluetooth or Near Field Communication (NFC). Near field communication, such as may also be included. For example, the network 160 may include a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), and a broadband network (BBN). And one or more of networks such as the Internet. In addition, network 160 may include any one or more of network topologies, including bus networks, star networks, ring networks, mesh networks, star-bus networks, trees, or hierarchical networks, and the like. It is not limited.

Meanwhile, according to an embodiment, at least one of the earset pairs may include components different from those of FIG. 1. For example, as will be described later with reference to FIG. 4, the earset device 400 may be implemented to include the components 410-470 of FIG. 4.

2 is a diagram illustrating an example of communication between an ear set pair and an electronic device according to one embodiment of the present invention. In general, a smartphone may communicate with peripheral devices such as an ear set or a wireless speaker using a short range wireless communication protocol such as Bluetooth, Zigbee, or Wi-Fi. In the embodiment of FIG. 2, an example in which the electronic device 210 communicates with the earset pair using the short range wireless communication protocol will be described. However, the electronic device 210 may only communicate with one device (the first earset device 220 in the embodiment of FIG. 2) at a time by using one short range wireless communication protocol (for example, Bluetooth 4.1). exist. In other words, it may be considered that the electronic device 210 cannot simultaneously communicate with two or more devices through one short range wireless communication protocol. In the present embodiment, the electronic device 210 may communicate with the first earset device 220 as one device using one short range wireless communication protocol, and the first earset device 220 may be different from the second earset device 230. Can be communicated through To this end, the first earset device 220 and the second earset device 230 may perform short-range wireless communication with each other. For example, the second earset device 230 may transmit the voice input through the microphone included in the second earset device 230 to the electronic device 210 through the first earset device 220. Conversely, the control signal transmitted by the electronic device 210 may be transmitted to the second earset device 230 through the first earset device 220. For example, a true wireless stereo (TWS) scheme may be used for relay communication of voice.

3 illustrates another example of communication between an earset pair and an electronic device according to an embodiment of the present invention. Unlike the embodiment of FIG. 2, the electronic device 210 may simultaneously communicate with both the first earset device 220 and the second earset device 230 using one short range wireless communication protocol. For example, short-range wireless communication protocols such as Bluetooth 5.0 provide a technology that enables a smartphone to connect and communicate with two devices simultaneously. 3 may simultaneously communicate with both the first and second earset devices 220 and 230 using a short range wireless communication protocol capable of simultaneously communicating with a plurality of devices.

4 is a block diagram illustrating an example of an internal configuration of an earset device according to one embodiment of the present invention. The ear set device 400 according to the present exemplary embodiment may correspond to the first ear set device 220 and / or the second ear set device 230 described above with reference to FIGS. 2 and 3. The earset device 400 may include a controller 410, a speaker 420, a microphone 430, a touch sensor 440, a proximity sensor 450, an LED 460, and a communication unit 470. According to an embodiment, the earset device 400 may include at least one of the components 410 to 470 described with reference to FIG. 4 (eg, the LED 460) or another component (eg, the acceleration sensor or the like). Gravity sensors, etc.) may be further included.

The controller 410 is an electronic circuit and / or chipset for controlling the speaker 420, the microphone 430, the touch sensor 440, the proximity sensor 450, the LED 460, and the communication unit 470. It can be implemented in the form of.

The speaker 420 may be a component for outputting an audio signal. For example, an audio signal transmitted from the electronic device 210 may be output through the speaker 420 of the earset device 400.

 The microphone 430 may be a component for receiving ambient audio signals. For example, a voice command of a user may be input through the microphone 430 and transmitted to the electronic device 210 through the communication unit 470.

The touch sensor 440 may be a component for receiving a user's touch command. For example, according to various touch gestures recognized through the touch area provided outside of the earset device 400 for the touch sensor 440, control of the earset device 400, sound source playback, sound source stop, and assistant call are performed. Various controls may be handled, such as calling translation functions, volume control, and the like. For example, various touch gestures may be made by a combination of touch gestures classified into taps, hold, very long, and the like. Such touch gestures may be classified according to touch time as an example. More specifically, the tap touch gesture may be recognized when the touch is released within a time of less than 1 second after the touch is generated in the touch area. The hold touch gesture may be recognized when the touch is released within a time less than a predetermined time (for example, 3 seconds) after the touch is generated in the touch area. The Berry Long Touch gesture may be recognized when the touch is held for a certain time (eg, 5 seconds) or more.

The proximity sensor 450 may be a component for detecting whether the earset device 400 is worn on a user's ear. For example, the proximity sensor 450 may be located between the body of the earset device 400 and the part inserted into the ear part of the user, thereby effectively detecting whether the earset device 400 is worn on the user's ear.

The light emitting diode (LED) 460 may be a component for providing various notifications related to the earset device 400. For example, the earset device 400 may provide various notifications to the user based on the color of the light output through the LED 460 or the output time, period, etc. of the light.

As described above, the communication unit 470 may be a component for communicating with the electronic device 210 or another earset device (eg, the second earset device 230).

5 is a flowchart illustrating an example of an earset control method according to an embodiment of the present invention. The earset control method according to the present embodiment may be performed by the computer device 100 implementing the electronic device 210 described above. For example, the processor 120 of the computer device 100 may be implemented to execute a control instruction according to a code of an operating system included in the memory 110 or a code of at least one program. In this case, the processor 120 may perform the steps 510 to 540 included in the method of FIG. 5 according to a control command provided by a code stored in the computer device 100. Can be controlled. The at least one program described above may be an application installed in the computer device 100 to control the ear set.

In operation 510, the computer device 100 may recognize a touch gesture of a touch area of the first earset of the earset pair. For example, the ear set pair may correspond to the first ear set device 220 and the second ear set device 230 described with reference to FIGS. 2 and 3, and the first ear set may correspond to the first ear set device 220 as an example. have. Recognition of the touch gesture may be processed using a touch sensor included in the first earset, as described above. For example, a sensing value recognized by the touch sensor of the first earset may be transmitted to the computer device 100, and the computer device 100 may perform a touch gesture on the touch area of the first earset through the transmitted sensing value. I can recognize it. According to an exemplary embodiment, it may be considered that the first earset recognizes the touch gesture according to the sensing value recognized by the touch sensor and transmits information on the type of the recognized touch gesture to the computer device 100. Recognition of this touch gesture may be applied to the same or similarly in other embodiments.

In operation 520, in response to the first type of touch gesture being recognized, the computer device 100 may determine whether the second type of touch gesture is further recognized within a predetermined time. In this case, step 530 may be performed when the second type of touch gesture is not recognized within the preset time, and step 540 may be performed when the second type of touch gesture is recognized within the preset time. For example, the first type of touch gesture may be the tap touch gesture described above, and the second type of touch gesture may be a hold touch gesture, but is not limited thereto.

In operation 530, the computer device 100 may generate a first control signal with respect to the recognized first type of touch gesture. For example, the first control signal may include a first sound source control signal related to sound source control.

In operation 540, the computer device 100 may generate a second control signal with respect to the recognized first type of touch gesture. In one example, the second control signal may include a first volume control signal associated with audio volume control.

For example, when only the tap touch gesture is recognized, the computer device 100 may generate a first sound source control signal (eg, a control signal for starting playback of music) in response to the recognition of the tap touch gesture. Can be. If a tap touch gesture is input and a hold touch gesture is input within a predetermined time, a first volume control signal (for example, a control signal for increasing the level of the audio volume) is received in response to the recognition of the tap touch gesture. Can be generated. In this case, the same tap touch gesture may additionally be used to generate one of different control signals, such as starting playback of music and increasing volume, depending on whether a hold touch gesture is input. In this case, the types of touch gestures may be classified based on the time of the touch continuously recognized in the touch area. Previously, the tap touch gesture may be recognized when the touch is released within a time of less than 1 second after the touch is generated in the touch area, and the hold touch gesture is touched within a time of less than 3 seconds after the touch is generated in the touch area. It may be recognized when the release is made, and the berry long touch gesture has been described with respect to an embodiment that may be recognized when the touch is maintained for 5 seconds or more.

In this case, the computer device 100 may further generate a second volume control signal for the second type of touch gesture that is further recognized in operation 540. For example, the first volume control signal may include a signal for increasing or decreasing the audio volume level by one level from the current level, and the second volume control signal may increase the audio volume level by the second type of touch gesture at the current level. It may include a signal for gradually increasing according to the touch time recognized according to. More specifically, when the hold touch gesture is recognized within a preset time after the tap touch gesture is recognized, the audio volume level may be increased or decreased by one level from the current level, and the touch is recognized as the hold touch gesture is maintained. The audio volume level may increase gradually over time (for example, by 1 level per 200 ms).

Meanwhile, different earsets in a pair of two earsets may be implemented to have different earset controls for the same touch gesture. For example, a tap touch gesture on the left earset may be used to control the start of playback of a sound source (eg, music), and the same tap touch gesture on the right earset may be used to control the end of playback of a sound source. . As another example, the tap touch gesture and hold touch gesture for the left earset may be used to control the decrease in audio volume, and the tap touch gesture and hold touch gesture for the right earset may be used to control the increase in audio volume. . As another example, the hold touch gesture for the right earset may be used to control the call of the assistant for voice recognition, and the hold touch gesture for the left earset recognized during voice recognition may be used to control the termination of the voice recognition. have. As another example, the hold touch gesture for the left earset is used to control the invocation of the translation function, and the hold touch gesture for the right earset recognized while the translation function is being provided to control the termination of the translation function being provided. Can be.

If a telephone call is being received at the electronic device 210, a tap touch gesture for the left earset or the right earset may be used to control the call connection for the incoming phone call, and a hold touch gesture for the incoming call call. It may be used for control of call rejection. In addition, when a call is connected in the electronic device 210, two consecutive tap touch gestures for the left earset or the right earset may be used for controlling the termination of the call. As another example, when a sound source is being played, two or three consecutive tap touch gestures for the left earset or the right earset may be used for controlling the sound source change to be played back.

In another embodiment, when the sound source is being played in the electronic device 210, the Berry Long Touch gesture recognized by the left ear set or the right ear set may be used to control external sound listening with the sound source. For example, listening to the external sound may be a function of outputting the ambient sound input through the microphone 430 described above with the audio of the sound source being played through the speaker 420.

6 is a flowchart illustrating another example of an earset control method according to an embodiment of the present invention. Steps 610-640 included in the method of FIG. 6 may be performed in parallel with steps 510-540 of FIG. 5 by the computer device 100.

In operation 610, the computer device 100 may recognize a touch gesture of a touch area of the second earset of the earset pair. In operation 510 of FIG. 5, the computer device 100 recognizes a touch gesture on the touch area of the first earset, while the computer device 100 performs the touch area on the touch area of the second earset in parallel with this operation. Touch gestures can also be recognized.

In operation 620, in response to the first type of touch gesture being recognized with respect to the touch area of the second earset, the computer device 100 generates a second type of touch gesture with respect to the touch area of the second earset within a preset time. You can check whether it is recognized more. As described above with reference to FIG. 5, the computer device 100 may further utilize a touch gesture recognized through the second earset as well as the first earset. For example, the first type of touch gesture may be a tap touch gesture, and the second type of touch gesture may be a hold touch gesture, but is not limited thereto.

In operation 630, the computer apparatus 100 may generate a second sound source control signal related to sound source control for the first kind of touch gesture recognized for the touch area of the second earset.

In operation 640, the computer device 100 may generate a third volume control signal related to audio volume control for the first type of touch gesture recognized for the touch area of the second earset.

As described above with reference to FIG. 5, when only the tap touch gesture is recognized through the touch area of the second earset, the computer device 100 may recognize the second sound source control signal (example) in response to the recognition of the tap touch gesture. Can generate a control signal for terminating the reproduction of music. If the tap touch gesture is recognized and the hold touch gesture is recognized within a predetermined time, a third volume control signal (for example, a control signal for reducing the level of the audio volume 1) is generated in response to the recognition of the tap touch gesture. Can be generated. In this case, the same tap touch gesture may additionally be used to generate one of different control signals, such as ending playback of the music and decreasing volume, depending on whether the hold touch gesture is recognized. As described above, the types of touch gestures may be classified based on the time of the touch continuously recognized in the touch area. Previously, the tap touch gesture may be recognized when the touch is released within a time of less than 1 second after the touch is generated in the touch area, and the hold touch gesture is touched within a time of less than 3 seconds after the touch is generated in the touch area. It may be recognized when the release is made, and the berry long touch gesture has been described with respect to an embodiment that may be recognized when the touch is maintained for 5 seconds or more.

In this case, the computer device 100 may further generate a fourth volume control signal for the second type of touch gesture further recognized in operation 640. For example, the first volume control signal described with reference to FIG. 5 may include a signal for increasing the audio volume level by one level from the current level, and the second volume control signal may increase the audio volume level by the second type from the current level. It may include a signal for gradually increasing in accordance with the touch time recognized according to the touch gesture. Conversely, the third volume control signal described with reference to FIG. 6 may include a signal for decreasing the audio volume level by one level from the current level, and the fourth volume control signal may reduce the audio volume level by the second type from the current level. It may include a signal for gradually decreasing according to the touch time recognized according to the touch gesture. More specifically, when the hold touch gesture is recognized within a preset time after the tap touch gesture is recognized in the second earset, the audio volume level may be decreased by one level from the current level, and as the hold touch gesture is maintained, the touch may be The audio volume level may gradually decrease (eg, decrease by one level per 200 ms) as time is recognized.

As already described, different earsets in a pair of two earsets may be implemented to have different earset controls for the same touch gesture. For example, a tap touch gesture on the left earset may be used to control the start of playback of the sound source (eg, music), and the same tap touch gesture on the right earset may be used to control the end of playback of the sound source. . As another example, the tap touch gesture and hold touch gesture for the left earset may be used to control the decrease in audio volume, and the tap touch gesture and hold touch gesture for the right earset may be used to control the increase in audio volume. . As another example, the hold touch gesture for the right earset may be used to control the call of the assistant for voice recognition, and the hold touch gesture for the left earset recognized during voice recognition may be used to control the termination of the voice recognition. have. As another example, the hold touch gesture for the left earset is used to control the invocation of the translation function, and the hold touch gesture for the right earset recognized while the translation function is being provided to control the termination of the translation function being provided. Can be.

7 is a flowchart illustrating an example of a method for controlling an earset in an earset according to an embodiment of the present invention. The earset control method according to the present embodiment may be performed by the earset device 400 described above as an example. For example, the controller 410 of the earset device 400 may include the method of FIG. 7 under the control of an electronic circuit constituting the controller 410 and / or a program embedded in a chipset included in the controller 410. The earset device 400 may be controlled to perform the steps 710 to 740.

In operation 710, the earset device 400 may recognize a touch gesture on the touch area included in the earset device 400. For example, the earset device 400 may recognize a touch gesture with respect to the touch area through the touch sensor 440 included in the earset device 400.

In operation 720, in response to the first type of touch gesture being recognized, the earset device 400 may determine whether the second type of touch gesture is further recognized within a preset time. In this case, step 730 may be performed when the second type of touch gesture is not recognized within the preset time, and step 740 may be performed when the second type of touch gesture is recognized within the preset time. For example, the first type of touch gesture may be the tap touch gesture described above, and the second type of touch gesture may be a hold touch gesture, but is not limited thereto.

In operation 730, the earset device 400 may generate a first control signal with respect to the recognized first type of touch gesture. For example, the first control signal may include a first sound source control signal related to sound source control. In the embodiment of FIG. 5, the first control signal is generated by the computer device 100 implementing an electronic device 210 such as a smartphone, whereas in the embodiment of FIG. 7, the first control signal is the earset device 400. It may be generated by, and may be transmitted to the electronic device 210 through the communication unit 470 included in the earset device 400. For example, the electronic device 210 may control a sound source currently being reproduced according to the first sound source control signal transmitted from the earset device 400.

In operation 740, the earset device 400 may generate a second control signal with respect to the recognized first type of touch gesture. In one example, the second control signal may include a first volume control signal associated with audio volume control. In the embodiment of FIG. 5, the second control signal is generated by the computer device 100 implementing an electronic device 210 such as a smartphone, whereas in the embodiment of FIG. 7, the second control signal is the earset device 400. It may be generated by, and may be transmitted to the electronic device 210 through the communication unit 470 included in the earset device 400. For example, the electronic device 210 may control the audio volume currently being provided to the earset device 400 according to the first volume control signal transmitted from the earset device 400. In another embodiment, it may also be considered that the earset device 400 controls the audio volume of the earset device 400 itself according to the generated first volume control signal.

When only the tap touch gesture is recognized, the earset device 400 may generate a first sound source control signal (for example, a control signal for starting playback of music) in response to the recognition of the tap touch gesture. If a tap touch gesture is input and a hold touch gesture is input within a predetermined time, a first volume control signal (for example, a control signal for increasing the level of the audio volume) is received in response to the recognition of the tap touch gesture. Can be generated. In this case, the same tap touch gesture may additionally be used to generate one of different control signals, such as starting playback of music and increasing volume, depending on whether a hold touch gesture is input. In this case, the types of touch gestures may be classified based on the time of the touch continuously recognized in the touch area. Previously, the tap touch gesture may be recognized when the touch is released within a time of less than 1 second after the touch is generated in the touch area, and the hold touch gesture is touched within a time of less than 3 seconds after the touch is generated in the touch area. It may be recognized when the release is made, and the berry long touch gesture has been described with respect to an embodiment that may be recognized when the touch is maintained for 5 seconds or more.

In this case, the earset device 400 may further generate a second volume control signal for the second type of touch gesture that is further recognized in operation 740. For example, the first volume control signal may include a signal for increasing or decreasing the audio volume level by one level from the current level, and the second volume control signal may increase the audio volume level by the second type of touch gesture at the current level. It may include a signal for gradually increasing according to the touch time recognized according to. More specifically, when the hold touch gesture is recognized within a preset time after the tap touch gesture is recognized, the audio volume level may be increased or decreased by one level from the current level, and the touch is recognized as the hold touch gesture is maintained. The audio volume level may increase gradually over time (for example, by 1 level per 200 ms).

Meanwhile, different earsets in a pair of two earsets may be implemented to have different earset controls for the same touch gesture. For example, a tap touch gesture on the left earset may be used to control the start of playback of the sound source (eg, music), and the same tap touch gesture on the right earset may be used to control the end of playback of the sound source. . As another example, the tap touch gesture and hold touch gesture for the left earset may be used to control the decrease in audio volume, and the tap touch gesture and hold touch gesture for the right earset may be used to control the increase in audio volume. . As another example, the hold touch gesture for the right earset may be used to control the call of the assistant for voice recognition, and the hold touch gesture for the left earset recognized during voice recognition may be used to control the termination of the voice recognition. have. As another example, the hold touch gesture for the left earset is used to control the invocation of the translation function, and the hold touch gesture for the right earset recognized while the translation function is being provided to control the termination of the translation function being provided. Can be.

If a telephone call is being received at the electronic device 210, a tap touch gesture for the left earset or the right earset may be used to control the call connection for the incoming phone call, and a hold touch gesture for the incoming call call. It may be used for control of call rejection. In addition, when a call is connected in the electronic device 210, two consecutive tap touch gestures for the left earset or the right earset may be used for controlling the termination of the call. As another example, when a sound source is being played, two or three consecutive tap touch gestures for the left earset or the right earset may be used for controlling the sound source change to be played back.

In another embodiment, when the sound source is being played in the electronic device 210, the Berry Long Touch gesture recognized by the left ear set or the right ear set may be used to control external sound listening with the sound source. For example, listening to the external sound may be a function of outputting the ambient sound input through the microphone 430 described above with the audio of the sound source being played through the speaker 420.

The embodiment of FIG. 7 considers a first earset of the earset pair. In the case of the second earset, control signals (third and fourth control signals) different from the control signals (first and second control signals) of the first earset may be generated.

8 is a flowchart illustrating an example of an earset control method according to another embodiment of the present invention. The earset control method according to the present embodiment may be performed by the computer device 100 implementing the electronic device 210 described above. For example, the processor 120 of the computer device 100 may be implemented to execute a control instruction according to a code of an operating system included in the memory 110 or a code of at least one program. Here, the processor 120 may perform the steps 810 to 850 included in the method of FIG. 8 according to a control command provided by a code stored in the computer device 100. Can be controlled. The at least one program described above may be an application installed in the computer device 100 to control the ear set.

In operation 810, the computer device 100 may transmit an audio signal to the first earset and the second earset. Here, the first earset and the second earset may correspond to the first earset device 220 and the second earset device 230 described above. The audio signal may include an audio signal according to reproduction of a sound source or an audio signal according to connection of a telephone call. In this case, it is assumed that both the first earset and the second earset are coupled to the user's ear.

In operation 820, the computer apparatus 100 may determine whether both the first earset and the second earset are separated from the user's ear, based on an output value of the proximity sensor included in each of the first and second earsets. Here, the proximity sensor may correspond to the proximity sensor 450 described with reference to FIG. 4. As described above, the proximity sensor 400 may be a component for detecting whether the earset device 400 is worn on the user's ear. For example, the proximity sensor 450 may be located between the body of the earset device 400 and the part inserted into the ear part of the user, thereby effectively detecting whether the earset device 400 is worn on the user's ear. In this case, step 830 may be performed when both the first earset and the second earset are separated from the user's ear, and if both the first earset and the second earset are combined without being separated from the user's ear, step 810 may be repeated.

In operation 830, the computer device 100 may stop transmitting the audio signal. In other words, if only one of the first and second earsets is detached from the user's ear, it is likely that the user disconnected one earset from the ear for a moment to hear outside sounds or to talk to others. It is high, and it is likely that it does not mean an explicit stop of playing a sound source or a stop of a telephone call. On the other hand, it is likely that the user detaches both earsets from the ear is an explicit intention that they do not want to hear the audio signal at present. Accordingly, the computer device 100 may stop the transmission of the audio signal when both the first earset and the second earset are separated from the user's ear. Stopping transmission of an audio signal during a phone call may mean converting a phone call using an earset into a phone call using the computer device 100. In addition, stopping transmission of an audio signal during reproduction of a sound source may mean stopping reproduction of a sound source or switching to reproduction of a sound source using the computer apparatus 100.

In operation 840, the computer apparatus 100 determines whether at least one of the first earset and the second earset is coupled to the user's ear based on a change in the output value of the proximity sensor included in each of the first and second earsets. You can decide. If at least one of the first earset and the second earset is coupled to the user's ear, step 810 may be performed again and transmission of the stopped audio signal may be resumed. If at least one of the first earset and the second earset is not coupled to the user's ear in step 840, the computer device 100 may perform step 850.

In operation 850, the computer device 100 may determine whether a predetermined time has elapsed. Here, the elapse of the predetermined time may mean whether the predetermined time has elapsed from when the first earset and the second earset are both separated from the user's ear. For example, the computer device 100 may record the time when both the first earset and the second earset are separated from the user's ear in step 820, and compare the recorded time with the current time in step 850. It is possible to determine whether the predetermined time has elapsed. If the predetermined time has elapsed in step 850 of the computer device 100, that is, if the first and / or second earset are not coupled to the user's ear for more than the predetermined time, the method of FIG. 8 may be terminated. have. In addition, when the preset time has not elapsed, the computer device 100 may monitor whether the first earset and / or the second earset are coupled to the user's ear, as in step 840.

As such, after both the first and second earsets are disconnected from the user's ear, the first and / or second earset is again coupled to the user's ear, indicating that the user wishes to resume the use of the earset, which the user paused for a while. Since it is likely to be an expression of intention, the computer device 100 resumes transmission of the stopped audio signal when at least one of the first earset and the second earset is coupled to the user's ear, thereby outputting the sound source using the earset or making a phone call. You can continue the connection. In addition, after both the first earset and the second earset are separated from the user's ear, and the first earset and / or the second earset are not coupled to the user's ear until a predetermined time elapses, the output of the sound source or The telephone call can be disconnected.

In one embodiment, transmitting the audio signal in step 810 may mean transmitting the audio signal of the sound source currently being reproduced. In this case, stopping the transmission of the audio signal in step 830 may mean stopping the transmission of the audio signal currently being reproduced and stopping the transmission of the audio signal. In some embodiments, stopping transmission of the audio signal in operation 830 may mean converting the reproduction of the sound source through the earset to the reproduction of the sound source through the computer device 100.

In another embodiment, transmitting the audio signal in step 810 may mean transmitting the audio signal transmitted through the currently connected telephone call. In this case, stopping transmission of the audio signal in step 830 may mean stopping transmission of the audio signal transmitted through the currently connected telephone call. In some embodiments, stopping transmission of the audio signal in step 830 may mean ending the telephone call.

9 is a flowchart illustrating an example of an earset control method according to another exemplary embodiment of the present invention. The earset control method according to the present embodiment may be performed by the computer device 100 implementing the electronic device 210 described above. For example, the processor 120 of the computer device 100 may be implemented to execute a control instruction according to a code of an operating system included in the memory 110 or a code of at least one program. Here, the processor 120 performs the computer device 100 such that the computer device 100 performs steps 910 to 940 included in the method of FIG. 9 according to a control command provided by a code stored in the computer device 100. Can be controlled. The at least one program described above may be an application installed in the computer device 100 to control the ear set.

In operation 910, the computer device 100 may store basic setting values of the first earset and the second earset. Here, the first earset and the second earset may correspond to the first earset device 220 and the second earset device 230 described above. The basic setting value is not particularly limited but may include, for example, a basic value for the audio volume. For example, the basic setting value for the audio volume represented by the level of 1 to 15 may be preset to 7, and the computer apparatus 100 may store and manage the preset basic setting value 7.

In operation 920, the computer device 100 may store current setting values of the first earset and the second earset. For example, the current setting value may include current values for audio volumes of the first earset and the second earset. If the current setting value is 10, the audio volume of the audio signal output from the first earset and the second earset may have a size corresponding to 10.

In operation 930, the computer apparatus 100 may recognize a touch gesture for each touch area of the first earset and the second earset. As described above, the recognition of the touch gesture may be processed using a touch sensor included in each of the first earset and the second earset. Sensing values recognized by the touch sensors of each of the first and second earsets may be transmitted to the computer device 100 through each of the first and second earsets or through one of the first and second earsets. In addition, the computer device 100 may recognize a touch gesture for each touch area of the first earset and the second earset through the transmitted sensing value.

In operation 940, when the touch gestures preset for each of the first earset and the second earset are continuously recognized within a preset time range, the computer device 100 based on the current settings of the first earset and the second earset. Can be changed based on the set value. For example, the preset touch gesture may be two consecutive tap touch gestures. In this case, the computer apparatus 100 may change the current setting value to the default setting value when two consecutive tap touch gestures are recognized in each of the two ear sets in a predetermined time range.

Referring to FIGS. 5 and 6, an embodiment in which the level of the audio volume may be gradually increased or decreased in accordance with the touch time through the hold touch gesture following the tap touch gesture is described. In this case, a situation may be provided to the user in which the audio volume suddenly increases or decreases suddenly due to the user's immaturity or mistake. If the sudden increase in audio volume can be embarrassing for the user, in some cases it may cause an abnormality in the user's hearing. In order to quickly solve this situation, in the present embodiment, the computer device 100, when the preset touch gestures for each of the first earset and the second earset are continuously recognized within the preset time range, the first earset and the second earset. By changing the current settings of the earset based on the default settings, it is possible to control the audio volume to change quickly to the default settings. In a more specific embodiment, when the preset touch gesture is continuously recognized within the preset time range, and at the same time the current setting value is out of the preset value range, the computer apparatus 100 displays the current of the first earset and the second earset. The setpoint can be changed based on the default setpoint. In this case, the range of the preset value may be determined based on at least one of the maximum value of the audio volume and the minimum value of the audio volume.

In the above, an embodiment of quickly changing the audio volume to the default setting has been described. However, it can be easily understood through the above description that the embodiment of FIG. 9 may be utilized to change various settings to the default setting in addition to the audio volume. There will be.

As such, according to embodiments of the present disclosure, various functions may be more easily controlled through a limited input interface (eg, a touch interface of a touch sensor included in the earset) included in the earset. For example, different control of the sound source control and the volume control may be possible according to the following touch gesture even for the same touch gesture. In addition, the transmission of the audio signal may be controlled according to whether the user wears the earset. For example, if the user detaches both ears from the ear, the user can automatically stop playback of the sound source or stop transmitting audio signals for phone calls. It is also possible to quickly return the settings of the earsets to the default settings. For example, if the audio volume level suddenly becomes too high or the audio volume level suddenly becomes too low while operating the audio volume level, the user can quickly return the audio volume to the basic level through a simple touch operation.

The system or apparatus described above may be implemented as a hardware component or a combination of hardware components and software components. For example, the devices and components described in the embodiments are, for example, processors, controllers, arithmetic logic units (ALUs), digital signal processors, microcomputers, field programmable gate arrays (FPGAs). May be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For convenience of explanation, one processing device may be described as being used, but one of ordinary skill in the art will appreciate that the processing device includes a plurality of processing elements and / or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as parallel processors.

The software may include a computer program, code, instructions, or a combination of one or more of the above, and configure the processing device to operate as desired, or process it independently or collectively. You can command the device. Software and / or data may be any type of machine, component, physical device, virtual equipment, computer storage medium or device in order to be interpreted by or to provide instructions or data to the processing device. It can be embodied in. The software may be distributed over networked computer systems so that they may be stored or executed in a distributed manner. Software and data may be stored on one or more computer readable media.

The method according to the embodiment may be embodied in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The medium may be to continue to store a computer executable program, or to temporarily store for execution or download. In addition, the medium may be a variety of recording means or storage means in the form of a single or several hardware combined, not limited to a medium directly connected to any computer system, it may be distributed on the network. Examples of the medium include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, And ROM, RAM, flash memory, and the like, configured to store program instructions. In addition, examples of another medium may include a recording medium or a storage medium managed by an app store that distributes an application, a site that supplies or distributes various software, a server, or the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

Although the embodiments have been described by the limited embodiments and the drawings as described above, various modifications and variations are possible to those skilled in the art from the above description. For example, the described techniques may be performed in a different order than the described method, and / or components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different form than the described method, or other components. Or even if replaced or substituted by equivalents, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and equivalents to the claims are within the scope of the following claims.

Claims (21)

In the earset control method,
Recognizing a touch gesture on a touch area of the first earset of the earset pair;
In response to recognizing the first type of touch gesture, checking whether the second type of touch gesture is further recognized within a preset time; And
If the second type of touch gesture is not recognized within the preset time, a first control signal is generated for the recognized first type of touch gesture, and the second type of touch gesture is generated within the preset time. Generating a second control signal for the recognized first type of touch gesture if further recognized
Earset control method comprising a. The method of claim 1,
The first control signal includes a first sound source control signal associated with the sound source control,
And the second control signal comprises a first volume control signal associated with audio volume control. The method of claim 2,
Generating the second control signal,
And generating a second volume control signal according to a recognition time of the recognized second type of touch gesture. The method of claim 3,
The first volume control signal includes a signal for increasing or decreasing an audio volume level by one level from a current level,
And the second volume control signal comprises a signal for gradually increasing or decreasing an audio volume level according to a touch time recognized according to the second type of touch gesture at a current level. The method of claim 1,
And the first type of touch gesture and the second type of touch gesture are classified based on the time of the touch continuously recognized in the touch area. The method of claim 1,
Recognizing a touch gesture on a touch area of a second earset of the earset pair;
In response to the first type of touch gesture being recognized with respect to the touch area of the second earset, checking whether the second type of touch gesture is further recognized with respect to the touch area of the second earset within a preset time; And
A third control signal for the first type of touch gesture recognized for the touch area of the second earset when the second type of touch gesture is no longer recognized for the touch area of the second earset within the preset time; Generate a second value for the first type of touch gesture recognized for the touch area of the second earset when the second type of touch gesture is further recognized for the touch area of the second earset. 4 Steps to generate a control signal
Earset control method further comprising. The method of claim 6,
The third control signal includes a second sound source control signal associated with the sound source control,
And the fourth control signal comprises a third volume control signal associated with audio volume control. The method of claim 7, wherein
Generating the fourth control signal,
And generating a fourth volume control signal for the second recognized touch gesture when the second type of touch gesture is further recognized for the touch area of the second earset within the preset time. Control method. The method of claim 6,
And the second control signal and the fourth control signal are signals for controlling audio volume in different ways. In the earset control method,
Transmitting an audio signal to the first earset and the second earset;
Determining whether both the first earset and the second earset are separated from a user's ear based on an output value of a proximity sensor included in each of the first earset and the second earset; And
If it is determined that both the first earset and the second earset are separated from the user's ear, stopping transmission of the audio signal
Including,
Determining whether a predetermined time has elapsed from when the first earset and the second earset are both separated from a user's ear;
Resuming transmission of the audio signal when at least one of the first earset and the second earset is coupled to a user's ear before the predetermined time elapses; And
Terminating a service associated with transmission of an audio signal when at least one of the first earset and the second earset is not coupled to a user's ear until the preset time elapses
Earset control method further comprising. The method of claim 10,
Determining whether at least one of the first earset and the second earset is coupled to the user's ear based on a change in an output value of the proximity sensor included in each of the first earset and the second earset; And
If it is determined that at least one of the first earset and the second earset is coupled to the ear of the user, resuming transmission of the paused audio signal.
Earset control method further comprising. The method of claim 10,
Transmitting the audio signal,
Transmit the audio signal of the currently playing sound source,
Stopping the transmission of the audio signal,
And stopping transmission of the audio signal by stopping playback of the currently playing sound source. The method of claim 10,
Transmitting the audio signal,
Transmit audio signals through the phone call that is currently connected,
Stopping the transmission of the audio signal,
Stopping transmission of an audio signal transmitted through the currently connected telephone call. In the earset control method,
Storing basic settings of the first earset and the second earset;
Storing current setting values of the first earset and the second earset;
Recognizing a touch gesture for a touch area of each of the first earset and the second earset; And
Changing a current setting value of the first earset and the second earset to the basic setting value when a preset touch gesture for each of the first earset and the second earset is continuously recognized within a preset time range;
Earset control method comprising a. The method of claim 14,
The basic setting value includes a basic value for audio volume of the first earset and the second earset,
And the current setting value includes a current value for audio volume of the first earset and the second earset. The method of claim 14,
The changing step,
When the preset touch gesture is continuously recognized within a preset time range and at the same time the current preset value is out of a preset range, the current preset values of the first earset and the second earset are set to the basic preset value. Earset control method to change based on. A computer program stored in a computer readable recording medium in combination with a computer for executing the method of any one of claims 1 to 16 on a computer. A computer-readable recording medium having recorded thereon a computer program for executing the method of any one of claims 1 to 16. In a computer device,
At least one processor implemented to execute readable instructions on the computer device
Including,
By the at least one processor,
Recognize a touch gesture on a touch area of the first earset of the earset pair,
In response to the recognition of the first type of touch gesture, confirming whether the second type of touch gesture is further recognized within a preset time,
When the second type of touch gesture is not recognized further within the preset time, a first control signal is generated for the recognized first type of touch gesture, and the second type of touch gesture is generated within the preset time. Generating a second control signal for the recognized first type of touch gesture when further recognized;
Computer devices. In a computer device,
At least one processor implemented to execute instructions readable by the computer device
Including,
By the at least one processor,
Transmit audio signals to the first and second earsets,
Determine whether both the first earset and the second earset are separated from a user's ear, based on an output value of a proximity sensor included in each of the first earset and the second earset,
If it is determined that both the first earset and the second earset are separated from the user's ear, transmission of the audio signal is stopped,
Determine whether a predetermined time has elapsed from when the first earset and the second earset are both separated from the user's ear,
Resume transmission of the audio signal when at least one of the first earset and the second earset is coupled to a user's ear before the predetermined time elapses,
If at least one of the first earset and the second earset is not coupled to a user's ear until the predetermined time elapses, terminating a service related to transmission of an audio signal;
Computer devices. In a computer device,
At least one processor implemented to execute readable instructions on the computer device
Including,
By the at least one processor,
Save the default settings for the first and second earsets,
Store current setting values of the first earset and the second earset,
Recognize a touch gesture for a touch area of each of the first earset and the second earset,
When a preset touch gesture for each of the first earset and the second earset is continuously recognized within a preset time range, changing the current setting values of the first earset and the second earset to the default setting values.
Computer devices.

Images