CN106095201B - A kind of double-click detection method of projection interactive system - Google Patents
A kind of double-click detection method of projection interactive system Download PDFInfo
- Publication number
- CN106095201B CN106095201B CN201610389335.6A CN201610389335A CN106095201B CN 106095201 B CN106095201 B CN 106095201B CN 201610389335 A CN201610389335 A CN 201610389335A CN 106095201 B CN106095201 B CN 106095201B
- Authority
- CN
- China
- Prior art keywords
- click
- double
- connected domain
- change curve
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Image Analysis (AREA)
- Position Input By Displaying (AREA)
Abstract
The present invention relates to a kind of double-click detection methods of projection interactive system, including：Acquisition finger touches in real time or light pen clicks each frame infrared image of blank, obtains area change curve, x coordinate change curve and y-coordinate change curve；Judge whether connected domain is sufficiently stable in the center point coordinate at each moment, if stablizing, then judge the shape of area change curve to be unimodal or bimodal, comparison to the bimodal and unimodal progress connected domain shape for meeting condition, judge whether similar, if similar, the front and back position of centre of gravity clicked twice and coincidence degree are compared, if the small and degree of overlapping of position of centre of gravity distance difference is higher, it is judged as YES double-click.The present invention in double click procedure touch twice or click action, from the variation of connected domain area, the stability of centre coordinate, touch duration and interval time, touch area shape, and the degree of overlapping etc. of touch area is analyzed, and stability is improved.
Description
Technical field
The present invention relates to the human-computer interaction technique field based on computer vision technique, especially a kind of projection interactive system
Double-click detection method.
Background technology
Human-computer interaction technology is that a vital field, developing history substantially represent meter in computer science
The developing history of calculation machine.From the clumsy switching system on earliest mainframe, to the appearance of early stage keyboard and mouse, and work as
The development speed of the touch screen of lower prevalence, human-computer interaction technology makes rapid progress.In recent years, at full speed due to computer vision technique
Development and the appearance of new sensor such as depth camera Kinect, LeapMotion etc. so that various portables it is man-machine
Interactive mode emerges one after another.However, since Kinect even depth camera is all apparent insufficient in range accuracy and spatial resolution,
It is directly interacted with computer using Kinect even depth camera, is unable to reach the purpose for carrying out accurate operation, it can not be direct
It sensitively operates, especially double-clicks this to space carrying out convenient in display area on wall using projector projects
Precision and the more demanding operation of time precision.
The system to be formed is combined using light pen and camera, projected image is operated, is that one kind for occurring recently is new
Technology.Currently, in the human-computer interaction technology realized using the system, it is directly to front and back point twice in double click procedure to double-click detection
Position is hit to be judged, by comparing click location whether it is completely the same come realize double-click.The disadvantages of this method is to utilize light
Pen carries out double click operation, and due to the shake of human hand, each click location inevitably moves；Hot spot is detected using infrared image
Also inevitably there is slight change in position, light spot shape, are difficult to overlap so as to cause spot center twice, double click operation success rate
It is low.In addition, in double click procedure, since service speed is too fast, it is susceptible to light pen and lifts the phenomenon that being not enough, conventional method does not have
There is the rule that changes with time of the contact area to light pen during entirely touching and wall to analyze, it is therefore more likely that will work as
The behavior of preceding light pen is mistaken for clicking, to cause faulty operation.
Invention content
The purpose of the present invention is to provide a kind of projection interactive systems that can improve double-click stability and system sensitivity
Double-click detection method.
To achieve the above object, present invention employs following technical schemes：A kind of double-click detection side of projection interactive system
Method, this method include the steps that following order：
（1）Camera acquires finger touch in real time or light pen clicks each frame infrared image of blank, passes through background modeling
The connected domain of finger touch or light pen click location is obtained with foreground extraction algorithm, counts the face that the connected domain engraves when each
Product value and center point coordinate obtain area change curve, x coordinate change curve and y-coordinate change curve；
（2）Judge that connected domain is in the center point coordinate at each moment by x coordinate change curve and y-coordinate change curve
It is no sufficiently stable, if the determination result is YES, then enter in next step, otherwise, be judged as non-double-click, terminates；
（3）To this touch or click the area change curve of connected domain formed and analyze, judge this touch or
The shape of the area change curve of click：If judging, the shape of area change curve is unimodal, and touch or click continue
Time is more than threshold value Th_click, then is judged as non-double-click, terminates；If judging the shape of area change curve to be unimodal, and touch
The duration touched or clicked is less than threshold value Th_click, then enters in next step；If judging, the shape of area change curve is double
Peak, and total duration T is less than threshold value Th_doubleclick, then enters step 5；If judging the shape of area change curve
Shape is that bimodal and total duration T is more than threshold value Th_doubleclick, then is judged as non-double-click, terminates；Wherein, Th_
Click is click duration threshold value, and Th_doubleclick is to double-click duration threshold；
（4）The last time touched or click is judged, if the last duration for touching or clicking is more than threshold value Th_
Click, or the last time difference for touching or clicking finish time and this touch or carved at the beginning of clicking are more than Th_
Gap is then judged as non-double-click, terminates；If the duration that the last time touches or clicks is less than Th_click, and is touched with this
The time interval touched or clicked is less than Th_gap, then enters step 6；Wherein, Th_gap is the time interval between clicking twice
Threshold value；
（5）Bimodal curve is split, after the completion of segmentation, two unimodal are used as that this segmentation obtains are clicked twice
It is analyzed, into next step；
（6）Respective time span t1 and t3 is clicked twice before and after analysis, and the time interval t2 between clicking twice,
Judge whether to meet the condition double-clicked, if satisfied, then entering in next step；
（7）During being clicked twice before and after finding respectively, area maximum moment corresponding connected domain extracts two connected domains
Shape information be compared, if similarity is higher, enter in next step；Otherwise, it is judged as non-double-click, terminates；
（8）To it is front and back click twice during, the position of centre of gravity of corresponding connected domain of respective area maximum moment is compared
Compared with, judge the coincidence degree of two connected domains, if position of centre of gravity distance differ small and degree of overlapping it is higher, be judged as YES double-click；
Otherwise, it is judged as non-double-click, terminates.
The area of the connected domain refers to the number of pixels of the connected domain.
In step（2）In, using the center of gravity of connected domain as the center for touching or clicking, touches or click recording this
During, according to the x coordinate and y-coordinate of each moment focus point position, the curve that two coordinates change over time is obtained,
The standard deviation of coordinate values in two curves is counted respectively, if the standard deviation is more than 20 pixels, illustrates to touch during this
Touch or click unstable, movement has occurred in finger or light pen；It is stable, finger if standard deviation is less than 20 pixels
Or light pen does not move.
In step（3）In, it is as follows to unimodal and bimodal judgment method：
3a）In the training process, either finger is motionless or moves for a long time after pressing light pen or finger for long-press light pen,
Connected domain minimal face product value is touched to obtain down state；
3b）Single Gauss modeling, single Gaussian error e1 after statistical modeling are carried out to touching connected domain area change curve；
3c）Double gauss modeling, the double gauss error e 2 after statistical modeling are carried out to touching connected domain area change curve；
3d）Compare single Gaussian error e1 and double gauss error e 2, if single Gaussian error e1 is less than double gauss error e 2, and it is single
Gaussian error e1 is less than modeling error threshold value Th_model, then is judged as unimodal；If single Gaussian error e1 is more than double gauss error
E2, and double gauss error e 2 is less than modeling error threshold value Th_model, then is judged as bimodal.
In step（6）In, it is described meet double-click condition refer to, if the front and back duration clicked twice be respectively t1 and
T3 clicks the difference in length threshold value Th_diff of time twice, when t1 and t3 is respectively less than threshold value Th_click, and the difference of the two
Absolute value abs (t1-t3) be less than threshold value Th_diff, and the time interval t2 between clicking twice is less than threshold value Th_gap.
In step（7）In, to the shape analysis of connected domain, the specific method is as follows：
7a）It touches or clicks in connection area image from two and extract profile information；
7b）The center of gravity of two connected domains is calculated separately, and carries out center of gravity alignment；
7c）The principal direction for calculating two profiles, judges whether two principal direction angle values are more than 15 °, if judging result is
It is then to regard as two connected domain shapes dissmilarities；Otherwise, into next step；
7d）By the principal direction alignment of two profiles, profile is rotated, ensures the principal direction angle one of two profiles
Sample；
7e）To on profile point carry out equiangular sampling, obtain sampled point to position of centre of gravity distance samples curve；
7f）The similitude of distance samples curve is calculated, if similarity is more than 0.8, enters the step（8）.
In step（8）In, the calculating of the position of centre of gravity distance refers to calculating the Europe between two connected domain barycentric coodinates
Formula distance；The coincidence degree calculating of described two connected domains refers to the assumption that the area that S1, S2 are respectively two connected domains, and S3 is
The overlapping area of the two, being overlapped the calculation of ratio r is：r=S3/max(S1,S2)；If Euclidean distance is less than 30 pixels
Distance, and r>0.9, then it is assumed that be currently to double-click, otherwise, be judged as non-double-click, terminate.
As shown from the above technical solution, the present invention in double click procedure touch twice or click action, from connected domain face
The long-pending stability of variation, centre coordinate, the duration of touch and interval time, the shape of touch area and Petting Area
The degree of overlapping in domain etc. is analyzed, prevented double click operation because hand light exercise and caused by detect failure, improve
Stability.In addition, insufficient phenomenon is lifted for what is be susceptible in light pen double click procedure, by touching connected domain face
The long-pending rule that changes with time is analyzed, and is realized the double-click detection under this situation, is improved the sensitivity of total system.
Description of the drawings
Fig. 1 is flow chart of the method for the present invention；
Fig. 2 is two unimodal schematic diagrames that the adjacent area change curve clicked twice is formed
Fig. 3 is bimodal cutting schematic diagram；
Fig. 4 is unimodal bimodal detection method flow chart；
Fig. 5 is time analysis schematic diagram on area change curve；
Fig. 6 is the calculating of connected domain principal direction and profile distance samples schematic diagram；
Fig. 7 is connected domain shape analysis flow chart；
Fig. 8 is connected domain overlapping region schematic diagram.
Specific implementation mode
As shown in Figure 1, a kind of double-click detection method of projection interactive system, this method includes the steps that following order：
（1）Camera acquires finger touch in real time or light pen clicks each frame infrared image of blank, passes through background modeling
The connected domain of finger touch or light pen click location is obtained with foreground extraction algorithm, counts the face that the connected domain engraves when each
Product value and center point coordinate obtain area change curve, x coordinate change curve and y-coordinate change curve；
（2）Judge that connected domain is in the center point coordinate at each moment by x coordinate change curve and y-coordinate change curve
It is no sufficiently stable, if the determination result is YES, then enter in next step, otherwise, be judged as non-double-click, terminates；
（3）To this touch or click the area change curve of connected domain formed and analyze, judge this touch or
The shape of the area change curve of click：If judging, the shape of area change curve is unimodal, and touch or click continue
Time is more than threshold value Th_click, then is judged as non-double-click, terminates；If judging the shape of area change curve to be unimodal, and touch
The duration touched or clicked is less than threshold value Th_click, then enters in next step；If judging, the shape of area change curve is double
Peak, and total duration T is less than threshold value Th_doubleclick, then enters step 5；If judging the shape of area change curve
Shape is that bimodal and total duration T is more than threshold value Th_doubleclick, then is judged as non-double-click, terminates；Wherein, Th_
Click is click duration threshold value, and Th_doubleclick is to double-click duration threshold；
（4）The last time touched or click is judged, if the last duration for touching or clicking is more than threshold value Th_
Click, or the last time difference for touching or clicking finish time and this touch or carved at the beginning of clicking are more than Th_
Gap is then judged as non-double-click, terminates；If the duration that the last time touches or clicks is less than Th_click, and is touched with this
The time interval touched or clicked is less than Th_gap, then enters step 6；Wherein, Th_gap is the time interval between clicking twice
Threshold value；
（5）Bimodal curve is split, after the completion of segmentation, two unimodal are used as that this segmentation obtains are clicked twice
It is analyzed, into next step；
（6）Respective time span t1 and t3 is clicked twice before and after analysis, and the time interval t2 between clicking twice,
Judge whether to meet the condition double-clicked, if satisfied, then entering in next step；
（7）During being clicked twice before and after finding respectively, area maximum moment corresponding connected domain extracts two connected domains
Shape information be compared, if similarity is higher, enter in next step；Otherwise, it is judged as non-double-click, terminates；
（8）To it is front and back click twice during, the position of centre of gravity of corresponding connected domain of respective area maximum moment is compared
Compared with, judge the coincidence degree of two connected domains, if position of centre of gravity distance differ small and degree of overlapping it is higher, be judged as YES double-click；
Otherwise, it is judged as non-double-click, terminates.
The area of the connected domain refers to the number of pixels of the connected domain.System of the invention signified refer to using light pen and
Camera combines the projection interactive system to be formed.
In step（2）In, using the center of gravity of connected domain as the center for touching or clicking, touches or click recording this
During, according to the x coordinate and y-coordinate of each moment focus point position, the curve that two coordinates change over time is obtained,
The standard deviation of coordinate values in two curves is counted respectively, if the standard deviation is more than 20 pixels, illustrates to touch during this
Touch or click unstable, movement has occurred in finger or light pen；It is stable, finger if standard deviation is less than 20 pixels
Or light pen does not move.
As shown in figure 4, in step（3）In, it is as follows to unimodal and bimodal judgment method：
3a）In the training process, either finger is motionless or moves for a long time after pressing light pen or finger for long-press light pen,
Connected domain minimal face product value is touched to obtain down state；
3b）Single Gauss modeling, single Gaussian error e1 after statistical modeling are carried out to touching connected domain area change curve；
3c）Double gauss modeling, the double gauss error e 2 after statistical modeling are carried out to touching connected domain area change curve；
3d）Compare single Gaussian error e1 and double gauss error e 2, if single Gaussian error e1 is less than double gauss error e 2, and it is single
Gaussian error e1 is less than modeling error threshold value Th_model, then is judged as unimodal；If single Gaussian error e1 is more than double gauss error
E2, and double gauss error e 2 is less than modeling error threshold value Th_model, then is judged as bimodal.
As shown in figure 5, in step（6）In, the condition double-clicked that meets refers to, if the front and back duration clicked twice
Respectively t1 and t3 clicks the difference in length threshold value Th_diff of time twice, when t1 and t3 is respectively less than threshold value Th_click, and
The absolute value abs (t1-t3) of the difference of the two is less than threshold value Th_diff, and the time interval t2 between clicking twice is less than threshold
Value Th_gap is possible to be to double-click, otherwise, not consider.
As shown in fig. 7, in step（7）In, to the shape analysis of connected domain, the specific method is as follows：
7a）It touches or clicks in connection area image from two and extract profile information；
7b）The center of gravity of two connected domains is calculated separately, and carries out center of gravity alignment；
7c）The principal direction for calculating two profiles, judges whether two principal direction angle values are more than 15 °, if judging result is
It is then to regard as two connected domain shapes dissmilarities；Otherwise, into next step；
7d）By the principal direction alignment of two profiles, profile is rotated, ensures the principal direction angle one of two profiles
Sample；
7e）To on profile point carry out equiangular sampling, obtain sampled point to position of centre of gravity distance samples curve；
7f）The similitude of distance samples curve is calculated, if similarity is more than 0.8, enters the step（8）.
The principal direction is exactly the direction where the longest axis by the connected domain center of gravity.Relatively connected domain shape it
Before, the angle for the principal direction for investigating them is needed, if angle is more than 15 °, is fair to consider that the two connected domain shapes
It is dissimilar；If angle is less than 15 °, need their principal direction being aligned, to eliminate principal direction difference to subsequent distance
The comparison of curve interferes.
Two connected domains in Fig. 6 are the connected domain at corresponding maximum moment during touching or click twice respectively
Contour curve, the black origin on curve is equiangular sampling point, and the phantom line segments in figure are longest of the connected domain Jing Guo center of gravity
Direction where axis, that is, connected domain principal direction.Two connected domain principal direction angles in Fig. 6 are less than threshold value, therefore can
To continue to analyze in next step.
Calculating of the profile apart from point sampling and distance Curve is as follows：
Firstly the need of the number N of setting sampled point, such as N=20, such decile angle is 360/N=18 degree.It is opened from 0 degree
Begin, it is primary to configuration sampling every 20 degree centered on center of gravity, as shown in the black color dots in Fig. 6.
The calculation of distance Curve is as follows：Using the upper extreme point of the corresponding main shaft of connected domain principal direction as starting point, by the inverse time
Needle direction records profile sampled point to the distance of center of gravity.
Distance Curve similarity system design is as follows：
In view of in double click procedure, although clicking twice, corresponding connected domain is similar in shape, and size may not be complete
It is complete consistent.Therefore the curve that needs to adjust the distance carries out certain normalization.Firstly the need of the long axis length for calculating two connected domains
Ratio value.If the ratio is between [0.8,1.2], it may be considered that the two connected domain sizes are relatively, can carry out
Compare in next step.Then it by the corresponding distance value of each sampled point, is normalized according to the length of the connected domain long axis.Into
When the specific Similarity measures of row, weighed by calculating the Euclidean distance between the vector being made of distance Curve.Europe
Family name's distance is bigger, illustrates that similarity is lower；Otherwise it is higher.
In step（8）In, the calculating of the position of centre of gravity distance refers to calculating the Europe between two connected domain barycentric coodinates
Formula distance illustrates the displacement for having larger between clicking twice if Euclidean distance is more than the distance of 30 pixels, is not to double-click；
If it is less than the distance of 30 pixels, it is likely that be to double-click.The coincidence degree calculating of described two connected domains refers to the assumption that
S1, S2 are respectively the area of two connected domains, and S3 is the overlapping area of the two, and being overlapped the calculation of ratio r is：r=S3/max
(S1,S2)；If Euclidean distance is less than the distance of 30 pixels, and r>0.9, then it is assumed that be currently to double-click, otherwise, be judged as non-double
It hits, terminates.As shown in figure 8, the dashed region in figure is connected domain overlapping region, if the area ratio of the part is more than 0.9,
It may determine that it is to double-click that this, which touches or clicks,.
The area of connected domain refers to the number of pixels of the connected domain in bianry image.In the process that light pen is contacted with wall
In, then the area of connected domain stablizes a period of time, then process again from big to small there are one from small to large.If area
The shape of change curve is a spike, then being likely to once click.If curve is one bimodal, it is likely to one
It is secondary to lift the double-click being not enough.According to testing result, follow-up different flow is respectively enterd.
Using the center of gravity of connected domain as touch or click center, record this touch or click during, each when
The x coordinate and y-coordinate for carving focus point position, obtain the curve that two coordinates change over time.If the weight of x coordinate and y-coordinate
Heart position is all stable, and it is static to illustrate that this touches or clicks, and finger or light pen do not have during touching or clicking
It moves；Otherwise, illustrate that movement has occurred in finger or light pen, then terminate.
Analyze touching or clicking connected domain area change curve, with judge current touch or click click or
Lift the double-click being not enough, i.e., unimodal and bimodal classification, as shown in Figure 2.If it find that being bimodal, it is also necessary to bimodal progress
Cutting, become two it is unimodal.
As shown in figure 3, the purpose of bimodal cutting is the area change song lifted finger or light pen under insufficient situation
Line, is divided into two sections, and will be bimodal between finger or light pen lift corresponding data point of insufficient moment and filter out.It completes
After double gauss modeling, bimodal position has completed to position.Therefore only it needs to be determined that the data of which moment point need to clear up
Fall.Cutting method is as follows：According to area change curve, area threshold is calculated, is less than this threshold value on the curve of areas
Moment can be considered as lifting insufficient phenomenon although area value is more than 0.
The estimation of area threshold parameter, it is motionless by being pressed for a long time to light pen or finger, and for a long time by moving down
The analysis of dynamic process, come light pen when obtaining down state or the area minimum value of the corresponding connected domain of finger.Estimate to improve parameter
The precise value of meter, can be with times of collection enough long-press and moving operation.Then, the half for selecting minimal face product value, as
Area threshold parameter.As shown in figure 8, dotted line indicates the area threshold parameter that estimation obtains, in area change curve, area value
All data values less than the line will be all filtered out.
In conclusion the present invention acquires finger touch in real time or light pen clicks each frame infrared image of blank, face is obtained
Product change curve, x coordinate change curve and y-coordinate change curve；Judge connected domain each moment center point coordinate whether
It is sufficiently stable, if stablizing, the shape of area change curve is judged to be unimodal or bimodal, to meeting the bimodal and unimodal of condition
Carry out connected domain shape comparison, judge whether it is similar, if similar, to the front and back position of centre of gravity clicked twice and coincidence degree
It is compared, if the small and degree of overlapping of position of centre of gravity distance difference is higher, is judged as YES double-click.The present invention is in double click procedure
Twice touch or click action, from the variation of connected domain area, the stability of centre coordinate, the duration of touch and interval when
Between, the degree of overlapping etc. of the shape of touch area and touch area analyzed, improve stability.
Claims (5)
1. a kind of double-click detection method of projection interactive system, this method includes the steps that following order：
(1) camera acquires finger touch in real time or light pen clicks each frame infrared image of blank, by background modeling with before
Scape extraction algorithm obtains the connected domain of finger touch or light pen click location, counts the area value that the connected domain engraves when each
And center point coordinate, obtain area change curve, x coordinate change curve and y-coordinate change curve；
(2) judge whether connected domain is sufficient in the center point coordinate at each moment by x coordinate change curve and y-coordinate change curve
It is enough to stablize, if the determination result is YES, then enter in next step, otherwise, be judged as non-double-click, terminates；
(3) the area change curve of this touch or the connected domain for clicking formation is analyzed, judges that this touches or clicks
Area change curve shape：If judging, the shape of area change curve is unimodal, and the duration for touching or clicking
More than threshold value Th_click, then it is judged as non-double-click, terminates；If judge the shape of area change curve to be unimodal, and touch or
The duration of click is less than threshold value Th_click, then enters in next step；If judging, the shape of area change curve is bimodal, and
And total duration T is less than threshold value Th_doubleclick, then enters step 5；If judging the shape of area change curve is
Bimodal and total duration T is more than threshold value Th_doubleclick, then is judged as non-double-click, terminates；Wherein, Th_
Click is click duration threshold value, and Th_doubleclick is to double-click duration threshold；
(4) the last time touched or click is judged, if the last duration for touching or clicking is more than threshold value Th_
Click, or the last time difference for touching or clicking finish time and this touch or carved at the beginning of clicking are more than Th_
Gap is then judged as non-double-click, terminates；If the duration that the last time touches or clicks is less than Th_click, and is touched with this
The time interval touched or clicked is less than Th_gap, then enters step 6；Wherein, Th_gap is the time interval between clicking twice
Threshold value；
(5) bimodal curve is split, after the completion of segmentation, two unimodal are used as that this segmentation obtains is clicked into progress twice
Analysis, into next step；
(6) analysis is front and back clicks respective time span t1 and t3 twice, and the time interval t2 between clicking twice, judgement
Whether satisfaction double-click condition, if satisfied, then enter in next step；
(7) during being clicked twice before and after finding respectively, area maximum moment corresponding connected domain extracts the shape of two connected domains
Shape information is compared, if similarity is higher, is entered in next step；Otherwise, it is judged as non-double-click, terminates；
(8) to it is front and back click twice during, the position of centre of gravity of corresponding connected domain of respective area maximum moment is compared, and is sentenced
The coincidence degree for two connected domains of breaking is judged as YES double-click if the small and degree of overlapping of position of centre of gravity distance difference is higher；Otherwise,
It is judged as non-double-click, terminates；
In step (7), to the shape analysis of connected domain, the specific method is as follows：
It 7a) touches or clicks in connection area image from two and extract profile information；
The center of gravity of two connected domains 7b) is calculated separately, and carries out center of gravity alignment；
The principal direction for 7c) calculating two profiles, judges whether two principal direction angle values are more than 15 °, if the determination result is YES, then
It is dissimilar to regard as two connected domain shapes；Otherwise, into next step；
7d) principal direction of two profiles is aligned, profile is rotated, ensures that the principal direction angle of two profiles is the same；
7e) on profile point carry out equiangular sampling, obtain sampled point to position of centre of gravity distance samples curve；
The similitude of distance samples curve 7f) is calculated, if similarity is more than 0.8, enters the step (8)；
In step (8), the calculating of the position of centre of gravity distance refers to, calculate between two connected domain barycentric coodinates it is European away from
From；The coincidence degree calculating of described two connected domains refers to the assumption that the area that S1, S2 are respectively two connected domains, and S3 is the two
Overlapping area, being overlapped the calculation of ratio r is：R=S3/max (S1, S2)；If Euclidean distance be less than 30 pixels away from
From, and r>0.9, then it is assumed that be currently to double-click, otherwise, be judged as non-double-click, terminate.
2. the double-click detection method of projection interactive system according to claim 1, it is characterised in that：The face of the connected domain
Product refers to the number of pixels of the connected domain.
3. the double-click detection method of projection interactive system according to claim 1, it is characterised in that：It, will in step (2)
The center of gravity of connected domain is as the center for touching or clicking, during recording this touch or clicking, when according to each
The x coordinate and y-coordinate for carving focus point position, obtain the curve that two coordinates change over time, and count sat in two curves respectively
Mark numerical value standard deviation, if the standard deviation be more than 20 pixels, illustrate this in the process touch or click it is unstable, finger or
Movement has occurred in person's light pen；It is stable, finger or light pen do not move if standard deviation is less than 20 pixels.
4. the double-click detection method of projection interactive system according to claim 1, it is characterised in that：It is right in step (3)
Unimodal and bimodal judgment method is as follows：
3a) in the training process, either finger is motionless or moves for a long time after pressing light pen or finger for long-press light pen, to obtain
It obtains down state and touches connected domain minimal face product value；
3b) single Gauss modeling, single Gaussian error e1 after statistical modeling are carried out to touching connected domain area change curve；
3c) double gauss modeling, the double gauss error e 2 after statistical modeling are carried out to touching connected domain area change curve；
3d) more single Gaussian error e1 and double gauss error e 2, if single Gaussian error e1 is less than double gauss error e 2, and single Gauss
Error e 1 is less than modeling error threshold value Th_model, then is judged as unimodal；If single Gaussian error e1 is more than double gauss error e 2, and
Double gauss error e 2 is less than modeling error threshold value Th_model, then is judged as bimodal.
5. the double-click detection method of projection interactive system according to claim 1, it is characterised in that：In step (6), institute
It refers to, if the front and back duration clicked twice is respectively t1 and t3, clicking the length of time twice to state the condition for meeting and double-clicking
Discrepancy threshold Th_diff, when t1 and t3 is respectively less than threshold value Th_click, and the absolute value abs (t1-t3) of the difference of the two is less than
Threshold value Th_diff, and the time interval t2 between clicking twice is less than threshold value Th_gap.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610389335.6A CN106095201B (en) | 2016-05-30 | 2016-05-30 | A kind of double-click detection method of projection interactive system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610389335.6A CN106095201B (en) | 2016-05-30 | 2016-05-30 | A kind of double-click detection method of projection interactive system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106095201A CN106095201A (en) | 2016-11-09 |
| CN106095201B true CN106095201B (en) | 2018-10-09 |
Family
ID=57447042
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610389335.6A Active CN106095201B (en) | 2016-05-30 | 2016-05-30 | A kind of double-click detection method of projection interactive system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106095201B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107817919A (en) * | 2017-10-26 | 2018-03-20 | 歌尔科技有限公司 | A kind of decision method of touch action, device and touch sensor |
| CN108089753B (en) * | 2017-12-28 | 2021-03-09 | 安徽慧视金瞳科技有限公司 | Positioning method for predicting fingertip position by using fast-RCNN |
| CN109493288B (en) * | 2018-10-23 | 2021-12-07 | 安徽慧视金瞳科技有限公司 | Light spot self-adaptive mapping method for interactive classroom teaching system |
| CN109445588A (en) * | 2018-10-23 | 2019-03-08 | 北京快乐认知科技有限公司 | Point based on image recognition tracer technique is read to give directions part click judging method |
| JP7287222B2 (en) * | 2019-09-30 | 2023-06-06 | セイコーエプソン株式会社 | Projector and projector control method |
| CN113197571B (en) * | 2021-05-07 | 2024-07-19 | 广州晓康医疗科技有限公司 | Gait training evaluation method and device based on radar |
| CN113568524B (en) * | 2021-07-20 | 2023-09-08 | 中国银联股份有限公司 | Touch screen behavior detection method and device, electronic equipment and storage medium |
| CN115237309B (en) * | 2022-09-21 | 2022-12-20 | 深圳市方成教学设备有限公司 | Display control method based on intelligent writing board and intelligent writing board |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102402680A (en) * | 2010-09-13 | 2012-04-04 | 株式会社理光 | Hand and indication point positioning method and gesture confirming method in man-machine interactive system |
| CN102693025A (en) * | 2011-03-21 | 2012-09-26 | 中国科学院软件研究所 | Touch finger identification method for multi-touch interaction system |
| CN103092334A (en) * | 2011-10-31 | 2013-05-08 | 财团法人资讯工业策进会 | Virtual mouse driving device and virtual mouse simulation method |
| CN103092439A (en) * | 2013-02-21 | 2013-05-08 | 盐城工学院 | Improved identification method for infrared interactive touch spot |
| CN103543934A (en) * | 2012-07-10 | 2014-01-29 | 联想(北京)有限公司 | Control method of electronic device and electronic device |
-
2016
- 2016-05-30 CN CN201610389335.6A patent/CN106095201B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102402680A (en) * | 2010-09-13 | 2012-04-04 | 株式会社理光 | Hand and indication point positioning method and gesture confirming method in man-machine interactive system |
| CN102693025A (en) * | 2011-03-21 | 2012-09-26 | 中国科学院软件研究所 | Touch finger identification method for multi-touch interaction system |
| CN103092334A (en) * | 2011-10-31 | 2013-05-08 | 财团法人资讯工业策进会 | Virtual mouse driving device and virtual mouse simulation method |
| CN103543934A (en) * | 2012-07-10 | 2014-01-29 | 联想(北京)有限公司 | Control method of electronic device and electronic device |
| CN103092439A (en) * | 2013-02-21 | 2013-05-08 | 盐城工学院 | Improved identification method for infrared interactive touch spot |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106095201A (en) | 2016-11-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106095201B (en) | A kind of double-click detection method of projection interactive system | |
| CN102301322B (en) | Method and electronic device for virtual handwritten input | |
| CN103809733B (en) | Man-machine interactive system and method | |
| US9459694B2 (en) | Cursor movement device | |
| US8970696B2 (en) | Hand and indicating-point positioning method and hand gesture determining method used in human-computer interaction system | |
| Murugappan et al. | Extended multitouch: recovering touch posture and differentiating users using a depth camera | |
| CN103383731B (en) | A kind of projection interactive method based on finger tip location, system and the equipment of calculating | |
| CN102096471B (en) | Human-computer interaction method based on machine vision | |
| CN107957812A (en) | Touch device and touch device discrimination method | |
| CN103677441B (en) | Infrared multipoint identification method, infrared multipoint identification device and infrared touch screen | |
| CA2481396A1 (en) | Gesture recognition method and touch system incorporating the same | |
| CN103984928A (en) | Finger gesture recognition method based on field depth image | |
| US20110243448A1 (en) | Handwritten data management system, handwritten data management program and handwritten data management method | |
| KR20150034215A (en) | Method and system for human-to-computer gesture based simultaneous interactions using singular points of interest on a hand | |
| WO2019119361A1 (en) | Method for avoiding mistakenly touching edge, touch control device and storage medium | |
| CN102163108B (en) | Method and device for identifying multiple touch points | |
| WO2018018624A1 (en) | Gesture input method for wearable device, and wearable device | |
| CN102508574A (en) | Projection-screen-based multi-touch detection method and multi-touch system | |
| CN105353927B (en) | Capacitive touch device and object identification method thereof | |
| CN103164022A (en) | Multi-finger touch method, device and portable type terminal device | |
| CN103793056A (en) | Mid-air gesture roaming control method based on distance vector | |
| CN107527353A (en) | A kind of projected picture housing detection method of view-based access control model processing | |
| Simion et al. | Finger detection based on hand contour and colour information | |
| CN103914668B (en) | A kind of touch recognition device preventing mistaken touch and recognition methods | |
| CN107992232A (en) | A kind of label type object identification system based on infrared multiple spot frame |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A Double Click Detection Method for Projection Interactive Systems Effective date of registration: 20230922 Granted publication date: 20181009 Pledgee: China Postal Savings Bank Co.,Ltd. Chaohu City Branch Pledgor: ANHUI HUISHI JINTONG TECHNOLOGY Co.,Ltd. Registration number: Y2023980058335 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |