KR102832296B1 - A device - Google Patents

Abstract

A device according to an embodiment of the present disclosure includes a first sensor, a second sensor, and a controller that recognizes a swipe gesture when an object is detected by one of the first and second sensors and then the other sensor detects the object for a preset reference time, and the controller can change reference values of the first and second sensors for detecting the object when recognizing the swipe gesture.

Description

{A device}

The present disclosure relates to a device for detecting an object and recognizing a user gesture and a method of operating the same.

Recently, as the issue of contagiousness has increased due to COVID-19 and other factors, concerns about touch input that requires direct contact with the screen have increased. Accordingly, the demand for non-contact touch that can receive user input through gestures such as push and swipe without directly touching the screen has increased significantly.

However, in the case of non-contact touch, there is a problem of misrecognition and malfunction since direct touch is not performed. For example, if a user makes a swipe gesture several times in a row, the movement becomes smaller due to fatigue accumulated from the periodic repetitive movement of the wrist or arm, and there is a problem of the gesture not being accurately detected.

Therefore, a method to improve recognition accuracy for non-contact touch is required.

Publication of Patent Publication No. 10-2015-0040246 (April 14, 2015)

The present disclosure seeks to improve recognition accuracy for non-contact touch.

The present disclosure seeks to provide a device capable of recognizing continuous swipe gestures.

The present disclosure seeks to improve a problem in which a user's gestures become smaller and less recognizable when the gestures are made continuously.

A device according to an embodiment of the present disclosure includes a first sensor, a second sensor, and a controller that recognizes a swipe gesture when an object is detected by one of the first and second sensors and then the other sensor detects the object for a preset reference time, and the controller can change reference values of the first and second sensors for detecting the object when recognizing the swipe gesture.

The controller can change the reference values of the first sensor and the second sensor based on the position of the last detected object when recognizing the swipe gesture.

The controller can change the reference values of the first sensor and the second sensor for detecting an object to a position a preset distance away from the location of the last detected object when recognizing the swipe gesture.

The preset distance can range from 1 to 5 cm.

The controller can change the reference value to the initial value when recognizing a push gesture after changing the reference value.

The controller can change the reference value to the initial value if a preset threshold time has passed after changing the reference value.

The reference value may be a signal value that serves as a reference for the first sensor and the second sensor to determine whether an object exists within the reference distance.

The controller can recognize a swipe gesture from the first sensor toward the second sensor and then ignore the object in the second sensor for a preset retention time, and can recognize a swipe gesture from the second sensor toward the first sensor and then ignore the object in the first sensor for the retention time.

The device may include a display device having a residual image display.

A method of operating a device according to an embodiment of the present disclosure may include a step of detecting an object from one of a first sensor and a second sensor, a step of detecting an object from the other sensor for a preset reference time after detecting the object, a step of recognizing a swipe gesture when the object is sequentially detected from the first sensor and the second sensor, and a step of changing reference values of the first sensor and the second sensor for detecting the object when recognizing the swipe gesture.

According to an embodiment of the present disclosure, there is an advantage in that the problem of not recognizing a swipe gesture is minimized as the user's movement gradually becomes smaller when a swipe gesture is continuously input.

According to an embodiment of the present disclosure, since the reference value of the sensor is changed based on the position of the last object, there is an advantage in that the recognition accuracy of continuous swipe gestures can be improved regardless of the size of the movement that is different for each user.

FIG. 1 is a drawing illustrating an example of a display device having a residual image display.
Figure 2 is an example drawing for explaining non-contact touch.
FIG. 3 is a diagram for explaining a method for a device according to an embodiment of the present disclosure to recognize various gestures through non-contact touch.
FIG. 4 is an exemplary drawing illustrating an appearance of a device having an infrared sensor according to an embodiment of the present disclosure.
FIG. 5 is a diagram illustrating signal waveforms from a sensor when a device according to an embodiment of the present disclosure recognizes gestures such as push and swipe.
FIG. 6 is a control block diagram of a device according to an embodiment of the present disclosure.
FIG. 7 is a flowchart illustrating a method for a device to recognize gestures such as push and swipe according to an embodiment of the present disclosure.
Figure 8 is a drawing for explaining a problem of not recognizing a user's continuous swipe gesture.
FIG. 9 is a diagram illustrating a variation of a reference value for recognizing a continuous swipe gesture according to an embodiment of the present disclosure.
FIG. 10 is a flowchart illustrating an operation method for improving recognition accuracy of a swipe gesture by another device according to an embodiment of the present disclosure.

Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing symbols, identical or similar components will be given the same reference numerals and redundant descriptions thereof will be omitted.

The suffixes "module" and "part" used for components in the following description are given or used interchangeably only for the convenience of writing the specification, and do not have distinct meanings or roles in themselves.

In addition, when describing the embodiments disclosed in this specification, if it is determined that a detailed description of a related known technology may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, it should be understood that terms such as “comprises” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

FIG. 1 is a drawing illustrating an example of a display device having a residual image display.

A display device having a residual image display may be composed of a fixed module (10) and a rotating module (20). The fixed module (10) may be a part that does not rotate while an image is output, and the rotating module (20) may be a part that rotates while an image is output.

The fixed module (10) may include at least some or all of a motor (not shown) for rotating the rotating module (20) and a power supply unit (not shown) that receives and supplies power from the outside.

A motor (not shown) receives power and generates rotational force as it rotates, and this rotational force can be transmitted to a rotation module (20).

The rotation module (20) can rotate by receiving rotational power generated from a motor (not shown). The rotation module (20) can rotate about 60 times per second, but this is only an example and is not limited thereto.

The rotation module (20) may be equipped with a main control board (100). The main control board (100) may be equipped with various elements for driving the rotation module (20) and outputting images.

And, the rotation module (20) may include an LED bar (24) equipped with a plurality of LEDs (25). Meanwhile, other light-emitting elements other than LEDs may be placed on the LED bar (24). That is, the LED (25) and the LED bar (24) are merely examples for convenience of explanation, and a bar or plate equipped with other light-emitting elements may be placed on the rotation module (20).

Each LED bar (24) may have multiple LEDs (25) mounted along a line. The multiple LEDs (25) mounted on the LED bar (24) may be in a line shape.

While the rotating module (20) rotates, a plurality of LEDs (25) mounted on a plurality of LED bars (24) can blink to output an image. In this respect, the rotating module (20) can be a display.

The display may be formed in a cylindrical shape as illustrated in Fig. 1, but may also be formed in various other shapes (e.g., circular). For example, a display device having a circular afterimage display may have a light-emitting element positioned to emit light toward the upper side, but this is merely exemplary and is not limited thereto.

The arrows shown in Figure 1 indicate the direction of rotation, and are shown as rotating clockwise. However, this is exemplary, and the display may also rotate counterclockwise.

When the display is cylindrical, a plurality of LED bars (24) can be arranged in a longitudinal direction perpendicular to the rotational direction of the plurality of LEDs. Specifically, a plurality of LED bars (24) are arranged at a predetermined interval and can be arranged in a longitudinal direction in the vertical direction.

When the display is circular, the plurality of LED bars can be arranged lengthwise in a horizontal direction with respect to the rotational direction of the plurality of LEDs. Specifically, the plurality of LED bars can be spaced apart at a predetermined interval. And, each of the plurality of LED bars can be arranged lengthwise in an outward direction from the center of the rotation module.

Meanwhile, a PCB equipped with LEDs may be installed on each of the plurality of LED bars (24). The PCB may sequentially integrate a plurality of red LEDs emitting red light, a green LED emitting green light, and a blue LED emitting blue light. The red LEDs, green LEDs, and blue LEDs may be sequentially arranged along one direction on the PCB, but according to an embodiment, when the red LEDs, green LEDs, and blue LEDs are referred to as one LED module, a plurality of LED modules may be arranged along one direction. In this case, the red LEDs belonging to each LED module may be arranged along one direction, the green LEDs belonging to each LED module may be arranged along one direction, and the blue LEDs belonging to each LED module may be arranged along one direction.

The present disclosure can be implemented regardless of the shape of the display. That is, the present disclosure can be applied to both a display device having a circular display and a display device having a cylindrical display. Hereinafter, the present disclosure is described based on a display device having a cylindrical display, but it is obvious that the present disclosure can also be applied to a display device having a circular display.

These display devices have a problem in that it is difficult to receive touch input from the user because the display is rotating. Therefore, the display device can recognize non-contact touch. Non-contact touch can mean indirect touch recognized through the user's hand or hand movements, etc. instead of direct touch on the screen, etc. Non-contact touch can also be called distant touch, virtual touch, spatial touch, etc.

In addition, the non-contact touch can be recognized not only in a display device having a residual display, but also in a display device having a general display and various electronic devices without a display. In this specification, a device means various electronic devices including various display devices.

Figure 2 is an example drawing for explaining non-contact touch.

Fig. 2 (a) shows an example of a device recognizing a conventional touch, and Fig. 2 (b) shows an example of a device recognizing a non-contact touch.

As shown in (a) of Fig. 2, the device could recognize touch only when the user's hand, etc. directly touches the surface of the device, such as the screen.

As illustrated in (b) of Fig. 2, the device can recognize a touch based on a virtual reference plane (R) located at a predetermined distance from the device surface even if the user's hand, etc. does not directly touch the device, and such a touch can be referred to as a non-contact touch. That is, according to the example of (b) of Fig. 2, the device can recognize a non-contact touch when the user's hand, etc. is recognized within the virtual reference plane (R).

The virtual reference plane (R) may represent a plane formed by points located at a predetermined distance from a sensor (not shown) and may have various shapes such as a flat surface or a curved surface. Detecting an object within the reference plane (R) may mean the same as detecting an object within a predetermined distance from the device.

The device can recognize these non-contact touches and recognize gestures such as Push and Swipe. Push is a single touch followed by immediate release, and can be used for executing or selecting something. Swipe is a drag while touching, and can be used for scrolling, etc.

FIG. 3 is a diagram for explaining a method for a device according to an embodiment of the present disclosure to recognize various gestures through non-contact touch.

Fig. 3 (a) shows an example of a device recognizing a push gesture, and Fig. 3 (b) shows an example of a device recognizing a swipe gesture.

As illustrated in (a) of Fig. 3, when an object, such as a user's hand, is detected within a reference plane (R), the device can recognize it as a push gesture and perform an action corresponding to the push gesture. To this end, the device can be equipped with at least one sensor (S).

As illustrated in (b) of Fig. 3, the device can recognize a swipe gesture when an object is detected by one sensor (S1) and then another sensor (S2). That is, the device can recognize a swipe gesture when an object is sequentially detected by at least two sensors (S1) (S2).

In this way, the device may have at least one sensor to recognize a push gesture or a swipe gesture. In particular, the device may have at least two sensors to recognize a swipe gesture.

The sensor may be an infrared sensor (IR sensor), but this is only an example and is not limited thereto. That is, the device may be equipped with various types of sensors capable of recognizing objects.

For convenience of explanation, this specification assumes that the device has two infrared sensors; however, this is only an example, and the number and types of sensors may vary.

FIG. 4 is an exemplary drawing illustrating an appearance of a device having an infrared sensor according to an embodiment of the present disclosure.

As illustrated in the example of FIG. 4, the device may include two sensors (S1) (S2), and the two sensors (S1) (S2) may be infrared sensors.

Infrared sensors can be divided into a light emitting part that generates infrared light and a light receiving part that detects infrared light. In other words, an infrared sensor can detect an object by emitting infrared light through the light emitting part and detecting the light that is reflected back by the object through the light receiving part.

As in the example of Fig. 4, two sensors (S1) (S2) can be installed on one side (e.g., the top side) of the device, and gestures such as a push or a swipe can be recognized through the two sensors (S1) (S2).

FIG. 5 is a diagram illustrating signal waveforms from a sensor when a device according to an embodiment of the present disclosure recognizes gestures such as push and swipe.

The first and second sensors (S1) (S2) can output High when an object is detected within the reference plane (R), and can output Low when an object is not detected within the reference plane (R).

The device can obtain whether the second sensor (S2) outputs high for a first reference time (e.g., 100 ms) after a predetermined time (e.g., 10 ms) has elapsed after the first sensor (S1) outputs high. If the second sensor (S2) does not output high for the first reference time, the device can recognize it as a push gesture, and if the second sensor (S2) outputs high, the device can recognize it as a swipe gesture. In this respect, the first reference time may be a period for recognizing a swipe.

And, the device may have a recovery holding time for a second reference time (e.g., 200 ms) after the first reference time has elapsed. The device may ignore the second sensor (S2) even if it outputs high during the second reference time. In other words, the device may not recognize the push gesture even if the second sensor (S2) outputs high during the second reference time. This is to minimize the problem of misrecognition as a push gesture when the user's hand is maintained within the reference surface (R) after a swipe gesture. The second reference time may be a holding period to prevent malfunction.

Although not shown in FIG. 5, conversely, the device can obtain whether the first sensor (S1) outputs high for a first reference time (e.g., 100 ms) after a predetermined time (e.g., 10 ms) has elapsed after the second sensor (S2) outputs high. If the first sensor (S1) does not output high for the first reference time, the device can recognize it as a push gesture, and if the first sensor (S1) outputs high, the device can recognize it as a swipe gesture. Similarly, the device can have a hold time for a second reference time after the first reference time has elapsed.

As described above, the device can distinguish between push gestures and swipe gestures through two sensors (S1) (S2), so there is an advantage in minimizing misrecognition problems.

FIG. 6 is a control block diagram of a device according to an embodiment of the present disclosure, and FIG. 7 is a flowchart for explaining a method for a device according to an embodiment of the present disclosure to recognize gestures such as push and swipe.

As illustrated in FIG. 6, the device may include first and second sensors (S1) (S2) and a controller (170). The controller (170) may recognize a gesture, such as a push or a swipe, based on the sensing results of the first and second sensors (S1) (S2), and perform an operation corresponding to the recognized gesture.

If the device is a display device having a residual image display as described in Fig. 1, the controller (170) may be provided on the main control board (100).

The first and second sensors (S1) (S2) can obtain sensing values as digital values by A/D conversion. For example, the sensing values of the first and second sensors (S1) (S2) can be values between 0 and 1024. The closer an object is to the first and second sensors (S1) (S2), the higher the sensing value, and the farther away an object is, the lower the sensing value.

The first and second sensors (S1) (S2) can output a high signal when the sensing value exceeds a first reference value. The first reference value can be a reference value for determining whether an object exists within a reference distance from the sensor. In other words, the first reference value can be a reference value for determining whether to output a signal. The first reference value can be 700, but this is only an example.

In addition, the first and second sensors (S1) (S2) can output a low signal when the sensing value is less than the second reference value. The second reference value may be a reference value for filtering out cases where an object is incorrectly recognized as existing due to dust or the like even though the object does not exist. The second reference value may be a reference value for determining misrecognition due to white noise. The second reference value may be 300, but this is only an example. That is, the first and second sensors (S1) (S2) can recognize that an object does not exist when the sensing value is 250. As described above, the present disclosure has an advantage of minimizing the problem of misrecognition of the sensor through the second reference value.

Next, referring to FIG. 7, we describe how the device recognizes gestures such as push and swipe.

The controller (170) can determine whether the sensing value of the first sensor (S1) exceeds the first reference value and whether the sensing value of the second sensor (S2) is less than the second reference value (S101).

That is, the controller (170) can determine whether the first sensor (S1) outputs high and the second sensor (S2) outputs low.

When the sensing value of the first sensor (S1) exceeds a first reference value and the sensing value of the second sensor (S2) is less than a second reference value, the controller (170) can determine whether the sensing value of the first sensor (S1) is less than the second reference value and the sensing value of the second sensor (S2) exceeds the first reference value during a first reference time (S103).

That is, the controller (170) can determine whether the first sensor (S1) outputs low and the second sensor (S2) outputs high during the first reference time when the first sensor (S1) outputs high and the second sensor (S2) outputs low.

The first reference time may be a period for recognizing the above-mentioned swipe.

The controller (170) can recognize a user gesture as a swipe gesture from the first sensor (S1) toward the second sensor (S2) when the first sensor (S1) outputs low and the second sensor (S2) outputs high during the first reference time (S105).

In summary, the controller (170) can recognize that a swipe gesture is input from the first sensor (S1) toward the second sensor (S2) when the first sensor (S1) outputs high and the second sensor (S2) outputs low for a first reference time after the first sensor (S1) outputs low and the second sensor (S2) outputs high.

Meanwhile, the controller (170) can recognize the user gesture as a push gesture for the first sensor (S1) when the first sensor (S1) does not output low or the second sensor (S2) does not output high during the first reference time (S107).

That is, the controller (170) can recognize that a push gesture is input to the first sensor (S1) when the first sensor (S1) outputs high and the second sensor (S2) outputs low, and then the first sensor (S1) does not output low or the second sensor (S2) does not output high for a first reference time.

Meanwhile, if the sensing value of the first sensor (S1) does not exceed the first reference value or the sensing value of the second sensor (S2) does not fall below the second reference value in step S101, the controller (170) can determine whether the sensing value of the first sensor (S1) is less than the second reference value and whether the sensing value of the second sensor (S2) exceeds the first reference value (S111).

That is, the controller (170) can determine whether the first sensor (S1) outputs low and the second sensor (S2) outputs high.

When the sensing value of the first sensor (S1) is less than the second reference value and the sensing value of the second sensor (S2) exceeds the first reference value, the controller (170) can determine whether the sensing value of the first sensor (S1) exceeds the first reference value and the sensing value of the second sensor (S2) is less than the second reference value during the first reference time (S113).

That is, when the first sensor (S1) outputs low and the second sensor (S2) outputs high, the controller (170) can determine whether the first sensor (S1) outputs high and the second sensor (S2) outputs low during the first reference time.

The controller (170) can recognize a user gesture as a swipe gesture from the second sensor (S2) toward the first sensor (S1) when the first sensor (S1) outputs high and the second sensor (S2) outputs low during the first reference time (S115).

In summary, the controller (170) can recognize that a swipe gesture is input from the second sensor (S2) toward the first sensor (S1) when the first sensor (S1) outputs low and the second sensor (S2) outputs high for a first reference time after the first sensor (S1) outputs high.

Meanwhile, the controller (170) can recognize the user gesture as a push gesture to the second sensor (S2) when the first sensor (S1) does not output high or the second sensor (S2) does not output low during the first reference time (S117).

That is, the controller (170) can recognize that a push gesture is input to the second sensor (S2) when the first sensor (S1) does not output high or the second sensor (S2) does not output low for a first reference time after the first sensor (S1) outputs low and the second sensor (S2) outputs high low.

In this way, the device according to the embodiment of the present disclosure can recognize a push gesture to each sensor or a swipe gesture in a specific direction based on the sensing results of the first and second sensors (S1) (S2).

Meanwhile, in the case of following the above-described method, the recognition accuracy for push gestures and about 1 to 2 consecutive swipe gestures is high. However, in the case of continuous swipe gestures exceeding about 2 times, the movement becomes small due to fatigue accumulated from periodic repetitive movements of the wrist or arm, so that gestures that do not reach the reference value set in the device may occur and thus may not be recognized. In addition, in the case of continuous movements in an arbitrary space, a problem may occur in which the center point of the hand moves upward or downward rather than the reference plane and thus may not be recognized. In other words, a problem may occur in which the user gesture is not recognized due to human body fatigue caused by continuous movements.

Figure 8 is a drawing for explaining a problem of not recognizing a user's continuous swipe gesture.

Figure 8 (a) shows a case where a swipe gesture is recognized and operates normally, and Figure 8 (b) shows a case where a user makes a swipe gesture but it is not recognized, resulting in a malfunction.

The controller (170) can recognize a first swipe gesture when the sensing value of the second sensor (S2) exceeds the first reference value during a first reference time after the sensing value of the first sensor (S1) exceeds the first reference value. In addition, in order for the controller (170) to recognize a continuous swipe gesture, that is, the second swipe gesture immediately after recognizing the first swipe gesture, the sensing value of the second sensor (S2) must be detected as being less than the first reference value before the sensing value of the first sensor (S1) is detected as exceeding the first reference value, as illustrated in (a) of FIG. 8.

Meanwhile, as shown in (b) of Fig. 8, when the first swipe gesture is recognized and the sensing value of the second sensor (S2) is maintained above the first reference value, there is a problem in that the second swipe gesture is not recognized even if the sensing value of the first sensor (S1) exceeds the first reference value.

That is, when the reference values for recognizing the swipe gesture by the first and second sensors (S1) (S2) are fixed, a problem may occur in which the swipe gesture is not recognized when it is performed continuously.

Accordingly, the present disclosure aims to increase the recognition rate for continuous swipe gestures, and to this end, a reference value for recognizing the swipe gesture can be varied.

FIG. 9 is a diagram illustrating a variation of a reference value for recognizing a continuous swipe gesture according to an embodiment of the present disclosure.

As illustrated in (a) and (b) of FIG. 9, the controller (170) can recognize a first swipe gesture when the sensing value of the second sensor (S2) exceeds the first reference value during a first reference time after the sensing value of the first sensor (S1) exceeds the first reference value. At this time, the first reference value of the first sensor (S1) may be a sensing value for the first and second sensors (S1) (S2) to detect an object within a first distance (R1).

When the controller (170) recognizes the first swipe gesture, it can change the first reference value. Specifically, the controller (170) can change a location that is a preset distance (k) away from the location of the last detected object to a new reference value.

Here, the distance (k) can be preset when the device is manufactured. The distance (k) can be calculated based on statistical results of analyzing hand movements when people perform continuous swipe gestures. For example, it can be determined based on the difference in hand movements when people generally perform continuous swipe gestures by only using the snap of the wrist in a comfortable state with a greatly reduced proportion of upper arm muscles used. For example, the distance (k) can correspond to 1 to 5 cm, but this is only an example and is not limited thereto. Preferably, the distance (k) can be 2 cm.

That is, referring to (b) of FIG. 9, the controller (170) can change the first reference value to a sensing value for detecting an object within a second distance (R2) obtained by adding a preset distance (k) from the object position (H) when recognizing the first swipe gesture. Accordingly, as illustrated in (c) of FIG. 9, after the controller (170) recognizes the first swipe gesture, the reference value for recognizing the swipe gesture can be set to a sensing value for detecting an object within the second distance (R2) by the first and second sensors (S1) (S2).

As shown in (d) and (e) of FIG. 9, the controller (170) can recognize the second swipe gesture when the sensing value of the second sensor (S2) exceeds the changed first reference value during the first reference time after the sensing value of the first sensor (S1) exceeds the changed first reference value.

And, the controller (170) can change the first reference value again based on the final position of the object when recognizing the second swipe gesture. Specifically, as shown in (e) of FIG. 9, the controller (170) can change the first reference value to a sensing value for detecting an object within a second distance (R3) that is obtained by adding a preset distance (k) from the position (H) of the object when recognizing the first swipe gesture.

As described above, the controller (170) can change the first reference value to a position that is a preset distance (k) away from the last position of the object (e.g., hand) each time it recognizes the swipe gesture consecutively. Accordingly, there is an advantage in that the swipe gesture can be recognized more accurately even if the motion margin is insufficient or the center point of the movement moves because the first reference value is fixed.

Next, with reference to FIG. 10, an operation method for improving recognition accuracy for continuous swipe gestures according to an embodiment of the present disclosure is described in detail.

FIG. 10 is a flowchart illustrating an operation method for improving recognition accuracy of a swipe gesture by another device according to an embodiment of the present disclosure.

Steps S101 to S117 illustrated in Fig. 10 are the same as those described in Fig. 7, so redundant description will be omitted.

Meanwhile, as in steps S105 and S117, the controller (170) can change the first reference value when it recognizes a swipe gesture.

Specifically, the controller (170) can change the first reference value to a value obtained by subtracting a preset reference signal value from the last distance signal value (S200).

Here, the last distance signal value may mean the sensing value of the sensor when the previous swipe gesture is recognized. In other words, the last distance signal value may be the sensing value corresponding to the position of the last object when the previous swipe gesture is recognized. In addition, the reference signal value may be the sensing value corresponding to a preset distance (k).

In summary, the controller (170) can change the first reference value to a sensing value corresponding to a position that is a preset distance (k) away from the final position of the object (e.g., hand).

After changing the first reference value, the controller (170) can determine whether the sensing value of the first sensor (S1) exceeds the first reference value and whether the sensing value of the second sensor (S2) is less than the second reference value (S201).

When the sensing value of the first sensor (S1) exceeds a first reference value and the sensing value of the second sensor (S2) is less than a second reference value, the controller (170) can determine whether the sensing value of the first sensor (S1) is less than the second reference value and the sensing value of the second sensor (S2) exceeds the first reference value during a first reference time (S203).

The controller (170) can recognize a user gesture as a swipe gesture from the first sensor (S1) toward the second sensor (S2) if the sensing value of the first sensor (S1) is less than the second reference value and the sensing value of the second sensor (S2) exceeds the first reference value during the first reference time (S205).

The controller (170) can recognize a user gesture as a push gesture for the first sensor (S1) if the sensing value of the first sensor (S1) is equal to or greater than the second reference value or if the sensing value of the second sensor (S2) is equal to or less than the first reference value during the first reference time (S207).

Meanwhile, if the sensing value of the first sensor (S1) does not exceed the first reference value or the sensing value of the second sensor (S2) does not fall below the second reference value in step S201, the controller (170) can determine whether the sensing value of the first sensor (S1) is less than the second reference value and whether the sensing value of the second sensor (S2) exceeds the first reference value (S211).

When the sensing value of the first sensor (S1) is less than the second reference value and the sensing value of the second sensor (S2) exceeds the first reference value, the controller (170) can determine whether the sensing value of the first sensor (S1) exceeds the first reference value and the sensing value of the second sensor (S2) is less than the second reference value during the first reference time (S213).

The controller (170) can recognize a user gesture as a swipe gesture from the second sensor (S2) toward the first sensor (S1) when the sensing value of the first sensor (S1) exceeds the first reference value and the sensing value of the second sensor (S2) is less than the second reference value during the first reference time (S215).

The controller (170) can recognize a user gesture as a push gesture for the second sensor (S2) when the sensing value of the first sensor (S1) is lower than or equal to the first reference value or the sensing value of the second sensor (S2) is higher than or equal to the second reference value during the first reference time (S217).

That is, each of steps S201 to S217 is identical to steps S101 to S117. However, if the controller (170) recognizes a push gesture in step S207 or S217, it can return to step S101. Then, when the controller (170) recognizes a push gesture, it can change the first reference value back to the reference value set when the device is manufactured. That is, when the controller (170) recognizes a push gesture, it can change the first reference value to an initial value. The initial value is a reference value set when the device is manufactured, and may be a default value.

Of course, although not shown in Fig. 10, the controller (170) can change the changed first reference value to the initial value even if the preset threshold time has been exceeded after changing the reference value.

Meanwhile, if the controller (170) recognizes the swipe gesture in step S205 or S215, it can return to step S200. That is, if the controller (170) recognizes the swipe gesture, it can change the first reference value back to the last position of the object.

In this way, according to the embodiment of the present disclosure, the controller (170) has an advantage in that it can improve the problem of not recognizing continuous swipe gestures by changing the first reference value when recognizing the swipe gesture.

The above-described present disclosure can be implemented as a computer-readable code on a medium having a program recorded thereon. The computer-readable medium includes all kinds of recording devices that store data that can be read by a computer system. Examples of the computer-readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. In addition, the computer may include a controller of a display device. Accordingly, the above detailed description should not be construed as limiting in all aspects but should be considered as illustrative. The scope of the present disclosure should be determined by a reasonable interpretation of the appended claims, and all changes within the equivalency range of the present disclosure are intended to be included in the scope of the present disclosure.

The above description is merely an example of the technical idea of the present invention, and those skilled in the art will appreciate that various modifications and variations may be made without departing from the essential characteristics of the present invention.

Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to explain it, and the scope of the technical idea of the present invention is not limited by these embodiments.

The scope of protection of the present invention should be interpreted by the claims below, and all technical ideas within a scope equivalent thereto should be interpreted as being included in the scope of the rights of the present invention.

Claims (10)

Sensor 1;
a second sensor; and
A controller is included that recognizes a swipe gesture when an object is detected by one of the first sensor and the second sensor and then an object is detected by the other sensor for a preset reference time.
The above controller
When recognizing the above swipe gesture, the reference values of the first sensor and the second sensor for detecting the object are changed,
The above criteria are
The signal value that serves as a reference for the first sensor and the second sensor to determine whether an object exists within a reference distance
Device.
In claim 1,
The above controller
When recognizing the above swipe gesture, the reference values of the first sensor and the second sensor are changed based on the position of the last detected object.
Device.
In claim 2,
The above controller
The reference values of the first sensor and the second sensor for detecting the object are changed to a position that is a preset distance away from the location of the last detected object when recognizing the swipe gesture.
Device.
In claim 3,
The above preset distance corresponds to 1 to 5 cm.
Device.
In claim 1,
The above controller
After changing the above reference value, when recognizing a push gesture, change the above reference value to the initial value.
Device.
In claim 1,
The above controller
If the preset threshold time is exceeded after changing the above reference value, the above reference value is changed to the initial value.
Device.
delete In claim 1,
The above controller
After recognizing a swipe gesture from the first sensor in the direction of the second sensor, the object in the second sensor is ignored for a preset retention time, and after recognizing a swipe gesture from the second sensor in the direction of the first sensor, the object in the first sensor is ignored for the preset retention time.
Device.
In claim 1,
The above device
A display device comprising a residual image display
Device.
A step of detecting an object from either a first sensor or a second sensor;
A step of detecting an object from another object for a preset reference time after detecting the above object;
A step of recognizing an object as a swipe gesture when the object is sequentially detected by the first sensor and the second sensor; and
Including a step of changing the reference values of the first sensor and the second sensor for detecting an object when recognizing the swipe gesture,
The above criteria are
The signal value that serves as a reference for the first sensor and the second sensor to determine whether an object exists within a reference distance
How the device operates.

Images