[go: up one dir, main page]

CN104142739B - Laser point tracking system and method based on optical mouse sensing array - Google Patents

Laser point tracking system and method based on optical mouse sensing array Download PDF

Info

Publication number
CN104142739B
CN104142739B CN201410394465.XA CN201410394465A CN104142739B CN 104142739 B CN104142739 B CN 104142739B CN 201410394465 A CN201410394465 A CN 201410394465A CN 104142739 B CN104142739 B CN 104142739B
Authority
CN
China
Prior art keywords
laser
laser point
optical mouse
spot
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410394465.XA
Other languages
Chinese (zh)
Other versions
CN104142739A (en
Inventor
王国利
赫明潇
郭雪梅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SYSU CMU Shunde International Joint Research Institute
Original Assignee
SYSU CMU Shunde International Joint Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SYSU CMU Shunde International Joint Research Institute filed Critical SYSU CMU Shunde International Joint Research Institute
Priority to CN201410394465.XA priority Critical patent/CN104142739B/en
Publication of CN104142739A publication Critical patent/CN104142739A/en
Application granted granted Critical
Publication of CN104142739B publication Critical patent/CN104142739B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Position Input By Displaying (AREA)

Abstract

本发明公开了一种基于光学鼠标传感阵列的激光点追踪系统,包括激光笔、投影光幕、计算机,以及光学鼠标传感阵列和单片机,传感阵列利用多个光电鼠标传感芯片排列构置,扩展单个传感有限的感知范围,且所述光幕能将激光点转化为激光散斑作为轨迹追踪特征;此外,还提出了一种基于光学鼠标传感阵列的激光点追踪方法,本方法有效融合传感阵列中多个传感数据获取激光点轨迹,算法简单同时扩展性强,适用于不同规模的传感阵列。本发明成本低,方便安装于现有体系的投影系统中,且操作简单利于远距离操作,同时该系统不受环境及投影光线影响,稳定性强。

The invention discloses a laser point tracking system based on an optical mouse sensor array, which includes a laser pointer, a projection light curtain, a computer, an optical mouse sensor array and a single-chip computer. position to expand the limited perception range of a single sensor, and the light curtain can convert laser points into laser speckles as trajectory tracking features; in addition, a laser point tracking method based on an optical mouse sensor array is also proposed. The method effectively fuses multiple sensing data in the sensing array to obtain the laser point trajectory. The algorithm is simple and has strong scalability, which is suitable for sensing arrays of different scales. The invention has low cost, is convenient to be installed in the projection system of the existing system, and is easy to operate to facilitate long-distance operation. At the same time, the system is not affected by the environment and projection light, and has strong stability.

Description

一种基于光学鼠标传感阵列的激光点追踪系统及方法A laser point tracking system and method based on an optical mouse sensor array

技术领域technical field

本发明涉及投影成像领域,尤其涉及一种基于光学鼠标传感阵列的激光点追踪系统及方法。The invention relates to the field of projection imaging, in particular to a laser point tracking system and method based on an optical mouse sensor array.

背景技术Background technique

目前投影系统在教学及工作生活中非常普及,投影系统是一种面向多参与者进行有效的交互演示方式,但用于操控投影系统的人机交互设备(鼠标和键盘)极大的限制了使用者的自由性,他们往往不得不在需要进行人机交互时,从参与者当中走回到电脑前操作。基于此,一些新的面向投影系统的交互设备被设计并使用,主要包括三种:多功能的投影激光笔,无线鼠标以及基于机器视觉的激光光点追踪装置。但上述技术用于投影交互场景时都存在各自特定的局限性。At present, the projection system is very popular in teaching and working life. The projection system is an effective interactive demonstration method for multiple participants, but the human-computer interaction equipment (mouse and keyboard) used to control the projection system greatly limits the use The freedom of participants, who often have to walk from the participants back to the computer when human-computer interaction is required. Based on this, some new interactive devices for projection systems have been designed and used, mainly including three types: multifunctional projection laser pointers, wireless mice, and laser spot tracking devices based on machine vision. However, the above-mentioned technologies all have their own specific limitations when used for projecting interactive scenes.

首先,现在投影系统中最常用的一种就是多功能激光笔,这种装置在传统激光笔上加入了演示文稿翻页的功能按键,使得投影系统使用者可以脱离鼠标和键盘演示自己的文档。但一个明显的问题是这样的装置功能十分有限,同时无法向鼠标一样通过移动来操控光标在投影界面上完成更复杂的人机交互操作。First of all, the most commonly used type of projection system is the multi-functional laser pointer. This device adds a function button for turning pages of presentations to the traditional laser pointer, so that users of the projection system can present their own documents without using the mouse and keyboard. But an obvious problem is that the functions of such a device are very limited, and at the same time, it is impossible to control the cursor by moving it to complete more complex human-computer interaction operations on the projection interface like a mouse.

其次,无线鼠标近年来也成为有线鼠标的替代者,鼠标这种传统人机交互设备不再受到距离的限制,可以远距离操控电脑。但鼠标的工作特性决定它必须紧贴一个工作面来测定自身的移动从而完成对光标的控制,这样的操作显然在投影演示时极不自然且十分不便利。Secondly, the wireless mouse has also become a substitute for the wired mouse in recent years. The mouse, a traditional human-computer interaction device, is no longer limited by distance and can control the computer from a distance. However, the working characteristics of the mouse determine that it must stick to a working surface to measure its own movement to complete the control of the cursor. Such an operation is obviously extremely unnatural and inconvenient during projection presentations.

此外,基于机器视觉来追踪激光笔光点位置轨迹的方法,借助光点在图像中的位置来估算光点的实际位置,利用光点的位置轨迹代替鼠标对自身位置的测量来操作电脑光标从而替代鼠标。这种方法利用一台摄像机来实时获取投影光幕上的图像,利用数字图像处理方法提取推算激光点的位置,但这种方法易受环境光线和投影图像光照条件的影响,稳定性不高,同时图像处理的算法复杂度高计算能力大且对设备、计算及它们的存储能力都有高要求,同时出于隐私的考虑,其适用场合受到一定限制。In addition, the method of tracking the position trajectory of the laser pointer light point based on machine vision uses the position of the light point in the image to estimate the actual position of the light point, and uses the position track of the light point instead of the mouse to measure its own position to operate the computer cursor. Alternative to the mouse. This method uses a camera to obtain images on the projection light curtain in real time, and uses digital image processing methods to extract and calculate the position of the laser point, but this method is easily affected by ambient light and lighting conditions of the projected image, and its stability is not high. At the same time, the algorithm complexity of image processing is high and the computing power is high, and there are high requirements for equipment, computing and their storage capabilities. At the same time, due to privacy considerations, its applicable occasions are limited.

发明内容Contents of the invention

本发明所要解决的问题是,提供一种基于光学鼠标传感阵列的激光点追踪系统及方法,解决原有的投影装置或方法中,功能单一、操作不便、稳定性不强的问题。The problem to be solved by the present invention is to provide a laser point tracking system and method based on an optical mouse sensor array to solve the problems of single function, inconvenient operation and low stability in the original projection device or method.

为解决上述问题,本发明公开了一种基于光学鼠标传感阵列的激光点追踪系统,包括激光笔、投影光幕以及计算机,其中,还包括光学鼠标传感阵列和单片机,其中,In order to solve the above problems, the present invention discloses a laser point tracking system based on an optical mouse sensor array, including a laser pointer, a projection light curtain and a computer, wherein it also includes an optical mouse sensor array and a single-chip microcomputer, wherein,

所述光学鼠标传感阵列,设于所述投影光幕之后,对激光笔发出的激光点经所述投影光幕散射在传感阵列面上形成的激光散斑图像进行计算和比较,并输出激光斑的位移信息给所述单片机;The optical mouse sensor array is arranged behind the projection light curtain, calculates and compares the laser speckle image formed by the laser point emitted by the laser pen on the sensor array surface through the scattering of the projection light curtain, and outputs The displacement information of the laser spot is given to the single-chip microcomputer;

所述单片机,根据接收的激光斑点位移信息判断激光点轨迹的起止,并对所有传感获得的位移信息融合处理,产生激光点轨迹信息,并将该轨迹信息发送给计算机;The single-chip microcomputer judges the start and end of the laser spot track according to the received laser spot displacement information, and fuses and processes all the displacement information obtained by sensing to generate laser spot track information, and sends the track information to the computer;

所述计算机,识别激光点轨迹信息并根据该轨迹信息同时执行投影程序。The computer recognizes the laser point track information and simultaneously executes the projection program according to the track information.

优选地,所述投影光幕与光学鼠标传感阵列之间平行间隔设置,所述间隔距离为400mm~600mm,最好的隔开距离为550mm,这样的投影效果最好,且所述光学鼠标传感阵列形成的阵列面覆盖的面积大小和投影光幕的大小相同为好。Preferably, the projection light curtain and the sensor array of the optical mouse are arranged at a parallel interval, the interval distance is 400mm-600mm, and the best interval distance is 550mm, which has the best projection effect, and the optical mouse The size of the area covered by the array surface formed by the sensor array is preferably the same as the size of the projection light curtain.

进一步地,所述光学鼠标传感阵列由等间隔设置的光学鼠标传感芯片排列而成,所述光学鼠标传感阵列最少设为4个,相邻的两光学鼠标传感芯片之间的距离设置为激光点散射形成激光散斑模型半径的倍,假设将传感面激光点经过散射形成的光斑模型化为半径r的原型,则传感的排列间隔为这样覆盖的面将最广。Further, the optical mouse sensing array is arranged by optical mouse sensing chips arranged at equal intervals, and the optical mouse sensing array is at least set to 4, and the distance between two adjacent optical mouse sensing chips Set to the radius of the laser speckle model formed by laser point scattering times, assuming that the light spot formed by the scattering of the laser point on the sensing surface is modeled as a prototype of radius r, the sensor arrangement interval is This will cover the widest area.

优选地,所述光学鼠标传感芯片为无通光小孔的芯片,也就是说将光学鼠标传感芯片上的通光小孔去除,以增强芯片对激光光斑的敏感性。Preferably, the optical mouse sensor chip is a chip without a light-through hole, that is to say, the light-through hole on the optical mouse sensor chip is removed to enhance the sensitivity of the chip to laser spot.

优选地,所述投影光幕采用采用双面粗糙的半透明透光材质,比如磨砂有机玻璃制成。投影仪产生的投影图像可以在光幕表面漫反射,从而呈现投影。而激光笔产生的光点有较强的穿透性可以通过光幕,激光透过后产生折射,在光学鼠标传感阵列面产生干涉现象,从而形成激光散斑。Preferably, the projection light curtain is made of double-sided rough translucent light-transmitting material, such as frosted plexiglass. The projected image produced by the projector can be diffusely reflected on the surface of the light curtain to present the projection. The light spot produced by the laser pointer has strong penetrability and can pass through the light curtain. After the laser passes through, it will be refracted, and interference will occur on the surface of the optical mouse sensor array, thereby forming laser speckle.

进一步地,所述单片机通过蓝牙串口模块将所述激光点轨迹信息无线发送给所述计算机。当然也可以采用其他任一无线传输的方式如ZigBee等发送给计算机。Further, the single-chip microcomputer wirelessly sends the laser point trajectory information to the computer through the Bluetooth serial port module. Of course, any other wireless transmission method such as ZigBee can also be used to send the data to the computer.

基于本发明的另一构思,还提供一种基于光学鼠标传感阵列的激光点追踪方法,该方法包括如下步骤:Based on another conception of the present invention, a kind of laser spot tracking method based on optical mouse sensor array is also provided, and this method comprises the following steps:

步骤1,传感阵列部署:测量经激光笔射入并透过投影光幕到达间隔设于光幕之后的传感阵列面上的激光光斑半径,并调整所述传感阵列中的光学鼠标传感芯片的间隔,其中,该间隔优选调整为激光光斑半径的倍,这样,能覆盖一个呈正方形的无盲区追踪区域;事先将传感阵列与光幕平行放置,并隔开一定距离d,再用激光笔在光幕上投射一个激光点,并在传感阵列所在平面测量产生的激光光斑半径r,同时将传感阵列中光学鼠标传感芯片的间隔调整为最后建立激光点追踪器与电脑间的连接,传感芯片最少为4个且横纵等间隔排列,形成一个矩形形状。Step 1, sensor array deployment: measure the laser spot radius that enters through the laser pointer and passes through the projection light curtain to reach the sensor array surface that is spaced behind the light curtain, and adjust the optical mouse sensor in the sensor array. The spacing of the sensor chip, wherein the spacing is preferably adjusted to the laser spot radius In this way, a square tracking area without blind spots can be covered; the sensor array is placed parallel to the light curtain in advance, and separated by a certain distance d, and then a laser pointer is used to project a laser point on the light curtain, and the sensor array The laser spot radius r generated by measuring the plane where the array is located, and at the same time adjust the interval of the optical mouse sensor chip in the sensor array to Finally, the connection between the laser point tracker and the computer is established. There are at least 4 sensor chips arranged at equal intervals horizontally and vertically to form a rectangular shape.

步骤2,光点轨迹获取:设定光斑轨迹的起点为(0,0),同时每个时刻仅选取一个传感芯片测量光斑位移的增量,并计算光斑在t时刻的位置坐标xt、ytStep 2. Acquisition of light spot trajectory: set the starting point of the light spot trajectory as (0,0), and at the same time select only one sensor chip at each moment to measure the increment of the light spot displacement, and calculate the position coordinates x t , y t ;

步骤3,光点轨迹终止判断:利用光学鼠标传感阵列中的寄存器squal的值是否为零判定激光点轨迹是否终止。Step 3, judging the termination of the light spot track: whether the value of the register squal in the sensor array of the optical mouse is zero is used to determine whether the laser spot track is terminated.

进一步地,在计算出光斑在t时刻的位置坐标xt、yt后,再对激光光点轨迹数据进行空间插值和平滑处理;Further, after calculating the position coordinates x t and y t of the light spot at time t, the spatial interpolation and smoothing processing are performed on the laser spot trajectory data;

优选地,光斑在t时刻的位置坐标值xt、yt由光斑在t-1时刻的位置坐标值加上在第t时刻选择的传感i的测量值计算得出,其中,当使用光学鼠标传感阵列时,光斑的位移增量(Δxi,t,Δyi,t)被存储在每个芯片的寄存器Delta_X和Delta_Y中。光斑在t时刻的位置可以用如下式式计算:Preferably, the position coordinate values x t and y t of the light spot at time t are calculated by adding the measured value of sensor i selected at time t to the position coordinate value of the light spot at time t-1, wherein, when using optical When the mouse senses the array, the displacement increment (Δxi , t , Δy i, t ) of the light spot is stored in the registers Delta_X and Delta_Y of each chip. The position of the light spot at time t can be calculated by the following formula:

进一步地,上述式中Δxi,t和Δyi,t是在第t时刻选择了传感i的测量;选择的依据是该时刻传感i的SQUAL寄存器的值Ssqual_i是传感阵列中最大的。Further, in the above formula, Δxi , t and Δy i, t are the measurements of sensor i selected at time t; the selection is based on the fact that the value S squal_i of the SQUAL register of sensor i at this time is the maximum value in the sensor array of.

作为另一种计算光斑在t时刻的位置坐标,将t时刻传感阵列中的所有传感芯片检测到的光斑位移增量进行加权运算得到加权值,由光斑在t-1时刻的位置坐标值加上在第t时刻的加权值计算得到光斑在t时刻的位置坐标值xt、yt得出。As another way to calculate the position coordinates of the light spot at time t, the weighted calculation is performed on the spot displacement increments detected by all the sensor chips in the sensor array at time t to obtain the weighted value, and the position coordinate value of the light spot at time t-1 Adding the weighted value at the t-th moment to calculate the position coordinate values x t and y t of the light spot at the t-time.

其中,所述加权运算的加权方法如下:Wherein, the weighting method of the weighting operation is as follows:

Δx(y)t=WDt Δx(y) t = WD t

其中,式W和Dt的计算方式如下:Among them, the formulas W and D t are calculated as follows:

Dt=[Δx(y)1,t…Δx(y)i,t…Δx(y)N,t]TD t = [Δx(y) 1, t ... Δx(y) i, t ... Δx(y) N, t ] T ;

此时,激光点每一时刻的位置点坐标信息为:At this time, the position coordinate information of the laser point at each moment is:

优选地,在激光点每一时刻的位置点再采用三次样条插值的方法进行插值采样。Preferably, a cubic spline interpolation method is used to perform interpolation sampling at the position of the laser point at each moment.

更优选地,通过计算相邻时刻轨迹点的均值对激光点轨迹进行平滑处理,具体为:More preferably, the laser point trajectory is smoothed by calculating the mean value of the trajectory points at adjacent moments, specifically:

其中,x′t为t时刻的横坐标位移平均值,y′t为t时刻的纵坐标位移平均值。Among them, x′ t is the average displacement of abscissa at time t, and y′ t is the average displacement of ordinate at time t.

此外,判断光点轨迹是否结束的的方法具体包含有如下步骤:In addition, the method for judging whether the track of the light spot has ended specifically includes the following steps:

用激光笔滑出一新的手势轨迹;Use a laser pointer to slide out a new gesture track;

检测所有传感芯片的Squal寄存器值是否均为0,判断激光点是否存在于投影光幕上;Detect whether the Squal register values of all sensor chips are 0, and judge whether the laser point exists on the projection light curtain;

通过定时器设定一阀值时间,并判断传感芯片的Squal寄存器值为0保持的时间是否达到设定的阀值时间,来判断轨迹是否结束。Set a threshold time through the timer, and judge whether the time that the Squal register value of the sensor chip is held at 0 reaches the set threshold time, to determine whether the track ends.

进一步地,当检测到所有传感芯片的Squal寄存器值均为0时,则设定并启动定时器,若不是,则重新检测;Further, when detecting that the Squal register values of all sensor chips are 0, set and start the timer, if not, re-detect;

当传感芯片的Squal寄存器值为0保持的时间达到定时器设定的时间时,则表征该轨迹结束,定时器关闭,若否,则再次判断是否存在有传感芯片的Squal寄存器值不为0,并重新检测开始上述步骤。When the Squal register value of the sensor chip is kept at 0 and reaches the time set by the timer, it means that the track ends and the timer is closed. If not, it is judged again whether there is a Squal register value of the sensor chip that is not 0, and retest to start the above steps.

与现有技术相比,本发明所提供的一种基于光学鼠标传感阵列的激光点追踪系统及追踪方法,成本较低,安装简单,使用方便,易于扩展,可替代传统的鼠标的人机交互系统,在不改变人们对于投影系统使用习惯的前提下,功能更多,操作简单且利于远距离操作,同时该系统不受外部环境及本身投影光线的影响,稳定性强,尤其适用于投影系统中较远距离的人机交互需要。Compared with the prior art, the laser point tracking system and tracking method based on the optical mouse sensor array provided by the present invention has lower cost, simple installation, convenient use, easy expansion, and can replace the traditional mouse human-machine The interactive system, without changing people's usage habits of the projection system, has more functions, is easy to operate and is conducive to long-distance operation. At the same time, the system is not affected by the external environment and its own projection light, and has strong stability. It is especially suitable for projection Long-distance human-computer interaction needs in the system.

附图说明Description of drawings

图1是本发明所提供的一种基于光学鼠标传感阵列的激光点追踪系统的结构示意图;Fig. 1 is the structural representation of a kind of laser point tracking system based on optical mouse sensing array provided by the present invention;

图2是本发明实施例所述的光学鼠标传感阵列的布设示意图;Fig. 2 is the layout schematic diagram of optical mouse sensing array described in the embodiment of the present invention;

图3(a)是本发明实施例所述的平滑处理前的轨迹的示意图;Fig. 3 (a) is a schematic diagram of the trajectory before smoothing according to the embodiment of the present invention;

图3(b)是本发明实施例所述的采用平滑处理后的轨迹的示意图;Fig. 3 (b) is a schematic diagram of the trajectory after smoothing according to the embodiment of the present invention;

图4是本发明所述的激光点轨迹起止的判定方法的具体流程示意图。Fig. 4 is a schematic flow chart of the method for determining the start and end of the laser point track according to the present invention.

具体实施方式detailed description

以下实施例仅用于更加清楚地说明本发明的技术方案,而不能以此来限制本发明的保护范围。如在说明书及权利要求当中使用了某些词汇来指称特定部件。本领域技术人员应可理解,硬件制造商可能会用不同名词来称呼同一个部件。本说明书及权利要求并不以名称的差异来作为区分部件的方式,而是以部件在功能上的差异来作为区分的准则。说明书后续描述为实施本发明的较佳实施方式,然所述描述乃以说明本新型的一般原则为目的,并非用以限定本发明的范围。本发明的保护范围当视所附权利要求所界定者为准。The following examples are only used to illustrate the technical solution of the present invention more clearly, but not to limit the protection scope of the present invention. Certain terms are used, for example, in the description and claims to refer to particular components. Those skilled in the art should understand that hardware manufacturers may use different terms to refer to the same component. The specification and claims do not use the difference in name as the way to distinguish components, but use the difference in function of the components as the criterion for distinguishing. The subsequent description of the specification is a preferred implementation mode for implementing the present invention, but the description is for the purpose of illustrating the general principles of the present invention, and is not intended to limit the scope of the present invention. The scope of protection of the present invention should be defined by the appended claims.

下面结合附图和具体实施例对本发明做进一步详细说明。The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments.

本发明是基于光学鼠标芯片的光流算法固件对图像流移动的快速检测能力,结合激光散斑图像跟踪特性,实现了一种面向投影交互的、激光点轨迹追踪的投影系统。如图1所示,本发明实施例所述的基于激光点轨迹的追踪系统,包括有光学鼠标传感阵列1、投影光幕2、单片机3、蓝牙串口模块4、激光笔5以及计算机,其中光学鼠标传感阵列1由多个光学鼠标传感芯片7横纵等间隔排列组成,此处仅以四个为例,且优选采用四个,当然也可以设为6个、8个、9个等设置为几排几列的方式,该四个光学鼠标传感芯片7构成2X2方式的传感阵列,形成一个方形,传感阵列利用多个光学鼠标传感芯片排列构置,能够扩展单个传感有限的感知范围;所述的光学鼠标传感阵列的布设方法如附图2所示,将投射到传感阵列所在平面的光斑模型化为半径r的圆形,则光学鼠标传感7之间的间隔可以达到同时形成一个的正方形的无盲区光点轨迹感知追踪区域;其中投影光幕2采用灯具中常用的有机玻璃,用于作为投影图像的接受反射面,同时对激光光点进行散射,使激光在穿过光幕后产生激光散斑图样6,从而能被传感阵列捕获并计算光斑位移,光幕安装时需要离开传感阵列平面一定距离d,为了获得更好的捕捉效果,该距离在400~600mm之间均可。所述传感阵列1与投影光幕2平行放置,并隔开一定距离;传感芯片利用所述投影光幕对激光点散射产生的散斑图像流进行计算比较,从而输出激光斑位移信息;所述单片机3用于判断激光点轨迹的起止,并对所有传感获得的位移信息融合处理,产生激光点轨迹信息;所述蓝牙串口模块4用于实现单片机与计算机之间的无线连接,使用本蓝牙串口,只要在PC端插入一个USB蓝牙适配器,就可以与众多的设备同时进行串口通讯,而互不影响,而且都是无线方式,保持桌面干净整洁;所述计算机用于识别激光点轨迹从而理解交互手势,同时通过投影仪执行常规投影程序。The invention is based on the rapid detection ability of the optical flow algorithm firmware of the optical mouse chip on the movement of the image flow, combined with the tracking characteristics of the laser speckle image, and realizes a projection system oriented to projection interaction and laser point trajectory tracking. As shown in Figure 1, the tracking system based on the laser point trajectory described in the embodiment of the present invention includes an optical mouse sensor array 1, a projection light curtain 2, a single-chip microcomputer 3, a bluetooth serial port module 4, a laser pointer 5 and a computer, wherein The optical mouse sensor array 1 is composed of a plurality of optical mouse sensor chips 7 arranged horizontally and vertically at equal intervals. Here, only four are used as an example, and four are preferably used. Of course, it can also be set to 6, 8, or 9 The four optical mouse sensor chips 7 form a 2X2 sensor array, forming a square. The sensor array utilizes a plurality of optical mouse sensor chips to arrange and configure a single sensor chip. limited range of perception; the layout method of the optical mouse sensing array is as shown in Figure 2, and the light spot projected onto the plane where the sensing array is located is modeled as a circle of radius r, then the optical mouse sensor 7 The interval between can reach while forming a A square spot track perception and tracking area without blind spots; the projection light curtain 2 adopts the plexiglass commonly used in lamps, which is used as the receiving reflection surface of the projected image, and at the same time scatters the laser light spot, so that the laser light passes through the light curtain Generate laser speckle pattern 6, which can be captured by the sensor array and calculate the spot displacement. When installing the light curtain, it needs to leave a certain distance d from the plane of the sensor array. In order to obtain a better capture effect, the distance is between 400 and 600mm Can. The sensor array 1 and the projection light curtain 2 are placed in parallel and separated by a certain distance; the sensor chip uses the projection light curtain to calculate and compare the speckle image streams generated by laser point scattering, thereby outputting laser spot displacement information; The single-chip microcomputer 3 is used to judge the start and end of the laser point track, and fuses and processes all the displacement information obtained by sensing to generate the laser point track information; the bluetooth serial port module 4 is used to realize the wireless connection between the single-chip microcomputer and the computer, using This bluetooth serial port, as long as a USB bluetooth adapter is inserted on the PC side, it can communicate with many devices at the same time without affecting each other, and it is all wireless, keeping the desktop clean and tidy; the computer is used to identify the laser point track Interaction gestures are thereby understood, while regular projection procedures are performed through the projector.

本发明还提供一种基于光学鼠标传感阵列的激光点追踪方法,该方法同样基于上述面向投影交互的激光点轨迹追踪系统实现对投影系统中手持激光笔光点的轨迹追踪。其详细步骤如下:The present invention also provides a laser point tracking method based on an optical mouse sensor array, which is also based on the projection interaction-oriented laser point track tracking system to track the track of the light point of the hand-held laser pointer in the projection system. The detailed steps are as follows:

步骤1、系统安装及传感阵列部署Step 1. System installation and sensor array deployment

将磨砂有机玻璃光幕安装于光学鼠标传感阵列平面前,保证光幕与传感阵列平面平行,并隔开一定距离,优选使光幕与传感阵列平面隔开距离为d=550mm。之后,向光幕投射一个激光点,在传感阵列平面测量经过光幕散射后的激光光斑的半径r,根据光斑半径将传感阵列中传感芯片的间隔调整为最后,连接各个模块,并给装置供电,同时建立激光点追踪器与电脑的连接,调节投影仪将投影图像投射到光幕上。The frosted plexiglass light curtain is installed in front of the optical mouse sensor array plane to ensure that the light curtain is parallel to the sensor array plane and separated by a certain distance. The distance between the light curtain and the sensor array plane is preferably d=550mm. After that, project a laser point to the light curtain, measure the radius r of the laser spot scattered by the light curtain on the plane of the sensor array, and adjust the distance between the sensor chips in the sensor array to Finally, connect each module, supply power to the device, establish a connection between the laser point tracker and the computer, and adjust the projector to project the projected image onto the light curtain.

步骤2、传感阵列的数据融合及光点轨迹获取Step 2. Data fusion of sensor array and acquisition of light point trajectory

激光点的轨迹可以通过联合不同时刻传感阵列所检测到的光斑位移信息得到。本发明关于计算光斑在t时刻的位置坐标xt、yt,给出两种融合传感阵列测量得到光斑轨迹的方法,第一种方法是主传感选取:The trajectory of the laser point can be obtained by combining the spot displacement information detected by the sensor array at different times. Regarding the calculation of the position coordinates x t and y t of the light spot at time t, the present invention provides two methods for obtaining the track of the light spot by fusion sensor array measurement. The first method is the selection of the main sensor:

当使用光学鼠标传感阵列时,光斑的位移增量被存储在每个芯片的寄存器Delta_X和Delta_Y中。假设光斑轨迹的起点为(0,0),同时每个时刻仅选取一个传感芯片测量的光斑位移增量,这个特殊的传感被叫做主传感,则光斑在t时刻的位置可以用(1)式计算:When using an optical mouse sensor array, the displacement increment of the light spot is stored in the registers Delta_X and Delta_Y of each chip. Assuming that the starting point of the spot track is (0,0), and at the same time, only one sensor chip is selected to measure the spot displacement increment at each moment. This special sensor is called the main sensor, and the position of the spot at time t can be used ( 1) Formula calculation:

进一步地,(1)式中Δxi,t和Δyi,t是在第t时刻选择了传感i的测量;此时传感i就是我们选择的主传感,选择的依据是该时刻传感i的SQUAL寄存器的值Ssqual_i是传感阵列中最大的;而光学鼠标传感芯片的SQUAL寄存器的值是一个用于衡量芯片所获取图像流的质量的指标,当这个值越高的时候,传感芯片捕捉到的图像流质量越高,则计算的图像流的位移越准确,所以这种方法中主传感的测量是这一时刻最准确的测量;这种方法虽然对测量信息恢复存在一定误差,但在可容忍的限度内,并且不会因为传感阵列规模的增大而增加运算复杂度,适用于传感阵列规模较大的情况。Furthermore, in formula (1), Δxi , t and Δy i, t are the measurements of sensor i selected at time t; at this time, sensor i is the main sensor we choose, and the basis for selection is that sensor i is selected at this time The value S of the SQUAL register of sensor i is the largest in the sensor array; and the value of the SQUAL register of the optical mouse sensor chip is an index used to measure the quality of the image stream obtained by the chip, when the value is higher , the higher the quality of the image stream captured by the sensor chip, the more accurate the displacement of the calculated image stream is, so the measurement of the main sensor in this method is the most accurate measurement at this moment; There is a certain error, but it is within a tolerable limit, and the computational complexity will not be increased due to the increase in the size of the sensor array, and it is suitable for the case of a large sensor array.

另一种方法是传感测量加权融合:Another approach is sensory measurement weighted fusion:

由于传感的部署方法使某一时间段内光斑不仅仅只被阵列中的一个传感捕捉测量到,所以一种更有效利用传感测量信息的方法是将第t时刻传感阵列中所有传感芯片检测到的光斑位移增量经行加权,加权方法如下式:Since the deployment method of the sensor makes the light spot not only captured and measured by one sensor in the array in a certain period of time, a more effective way to use the sensor measurement information is to combine all sensors in the sensor array at the tth time The spot displacement increment detected by the sensor chip is weighted, and the weighting method is as follows:

Δx(y)t=WDt (2)Δx(y) t = WD t (2)

其中,in,

Dt=[Δx(y)1,t…Δx(y)i,t…Δx(y)N,t]TD t = [Δx(y) 1, t ... Δx(y) i, t ... Δx(y) N, t ] T ;

此时,激光点每一时刻的位置由(3)式计算:At this time, the position of the laser point at each moment is calculated by formula (3):

采用传感测量加权融合这种方法利用了更多的传感测量数据,对光斑轨迹的追踪更加精确。The method of weighted fusion of sensory measurements utilizes more sensory measurement data, and the tracking of the spot trajectory is more accurate.

步骤3、激光光点轨迹的插值及平滑Step 3. Interpolation and smoothing of laser spot trajectory

其中,步骤3主要是针对激光点轨迹移动过快时,采样频率达到极限依然无法获得足够的轨迹点数据的情况,本发明采用三次样条插值的方法根据(3)式中已经获得的位置点插值产生更多的轨迹点,spline fitting的最大好处就是可以用较低的阶数来对比较复杂的数据进行拟合,这样的好处就是可以避免使用高阶多项式的时候引入一些不必要的误差,可以带来相对较好的插值结果,同时计算得也比较快。由于三次样条插值保证了插值后点轨迹斜率和曲率的连续,所以符合人对激光点的书写操作特性。Wherein, step 3 is mainly aimed at the situation that when the laser point track moves too fast, the sampling frequency reaches the limit and still cannot obtain enough track point data, the present invention adopts the method of cubic spline interpolation according to the position point obtained in (3) formula Interpolation generates more trajectory points. The biggest advantage of spline fitting is that it can fit more complex data with a lower order. The advantage of this is that it can avoid introducing unnecessary errors when using high-order polynomials. It can bring relatively good interpolation results, and at the same time, the calculation is faster. Since the cubic spline interpolation ensures the continuity of the slope and curvature of the point trajectory after interpolation, it conforms to the characteristics of human writing operation on laser points.

进一步地,提出一种利用相邻时刻轨迹点的均值来平滑由于人操控激光笔时手部抖动产生的不规则的轨迹方法,具体为:Furthermore, a method of using the mean value of the trajectory points at adjacent times to smooth the irregular trajectory caused by hand shaking when man controls the laser pointer is proposed, specifically:

利用所述方法得到的激光点轨迹及平滑轨迹如图3(b)所示,实例中操作者用激光笔书写了一个数字“3”,相比没经过平滑处理的与图3(a),经过平滑处理的明显更准确、更形象。The laser point trajectory and smooth trajectory obtained by using the method are shown in Figure 3(b). In the example, the operator wrote a number "3" with a laser pen. Compared with Figure 3(a) without smoothing, The smoothed ones are noticeably more accurate and visual.

该方法提出了有效融合传感阵列中多个传感数据获取激光点轨迹的方法,算法简单同时扩展性强,适用于不同规模的传感阵列。This method proposes a method for effectively fusing multiple sensing data in the sensing array to obtain the laser point trajectory. The algorithm is simple and scalable, and is suitable for sensing arrays of different scales.

步骤4、判断激光光点轨迹的起止Step 4. Determine the start and end of the laser spot track

图4是基于光斑存在性的激光笔轨迹起止的判定方法的详细流程示意图。FIG. 4 is a schematic flowchart of a detailed flow chart of a method for determining the start and end of a laser pointer track based on the existence of a light spot.

当本装置用于人机交互时,将每一个相互独立的激光点轨迹区分成为一个重要的问题。模拟人用笔书写时,当完成一个字符的书写后笔尖会离开纸面稍作停顿,相应的在操作激光点追踪器时,当激光笔刻画完一个手势轨迹后,关闭激光笔并停顿一定时间,优选为2秒,则所述的激光点追踪器可以自动判定该部分光点轨迹结束,再有光点轨迹被捕捉时,将会自动划归为新的轨迹。这里利用光学鼠标传感中寄存器SQUAL的值来判定是否关闭激光笔,当没有激光点在光幕上时,阵列中所有的传感的寄存器SQUAL的值都将为0,若不是,则重新检测。当检测所有传感芯片的Squal寄存器值均为0时,则设定定时器,给出一停顿时间。When the device is used for human-computer interaction, it becomes an important issue to distinguish each independent laser point track. When the simulated human writes with a pen, after finishing writing a character, the pen tip will leave the paper and pause for a while. Correspondingly, when operating the laser point tracker, after the laser pointer completes a gesture trajectory, turn off the laser pointer and pause for a certain period of time. , preferably 2 seconds, then the laser point tracker can automatically determine that this part of the light point track ends, and when another light point track is captured, it will be automatically classified as a new track. Here, the value of the register SQUAL in the optical mouse sensor is used to determine whether to turn off the laser pointer. When there is no laser point on the light curtain, the values of all the sensing registers SQUAL in the array will be 0. If not, re-detect . When it is detected that the Squal register values of all sensor chips are 0, a timer is set to give a pause time.

然后再判断定时器设定的时间是否达到,若达到预设的时间,则表征该轨迹结束,再关闭定时器,然后可以用激光笔开始新的轨迹;若否,则再次判断是否存在有某个或多个传感芯片的Squal寄存器值不为0,若是,则重新检测并开始上述步骤,若否,也重新检测并开始上述步骤。本发明通过利用光学鼠标传感中寄存器SQUAL的值是否为零来判定激光点在光幕上的存在性,结合设定阈值时间的方法判定单个激光点轨迹是否终止,新的轨迹是否开始。Then judge whether the time set by the timer is reached, if it reaches the preset time, it means that the track is over, then turn off the timer, and then use the laser pointer to start a new track; if not, then judge again whether there is a certain The Squal register value of one or more sensor chips is not 0, if yes, then re-detect and start the above steps, if not, also re-detect and start the above steps. The present invention judges the existence of the laser point on the light curtain by using whether the value of the register SQUAL in the optical mouse sensor is zero, and combines the method of setting the threshold time to judge whether the track of a single laser point is terminated and whether a new track starts.

相对原来的纯鼠标或激光笔操作的单一,本发明使用更方便,且功能变得更强大,使传统的激光笔具备了书写的功能,且不受外部光线的干扰,稳定性强。Compared with the single operation of the original pure mouse or laser pointer, the present invention is more convenient to use, and the function becomes more powerful, so that the traditional laser pointer has the function of writing, and is not disturbed by external light, and has strong stability.

值得注意的是,以上所述仅为本发明的较佳实施例,并非因此限定本发明的专利保护范围,本发明还可以对上述各种零部件的构造进行材料和结构的改进,或者是采用技术等同物进行替换。故凡运用本发明的说明书及图示内容所作的等效结构变化,或直接或间接运用于其他相关技术领域均同理皆包含于本发明所涵盖的范围内。It is worth noting that the above description is only a preferred embodiment of the present invention, and does not limit the scope of patent protection of the present invention. The present invention can also improve the materials and structures of the above-mentioned various components, or use technical equivalents are substituted. Therefore, all equivalent structural changes made by using the description and illustrations of the present invention, or directly or indirectly applied to other related technical fields are also included in the scope of the present invention.

Claims (12)

1.一种基于光学鼠标传感阵列的激光点追踪系统,包括激光笔、投影光幕以及计算机,其特征在于还包括光学鼠标传感阵列和单片机,其中,1. a laser spot tracking system based on optical mouse sensing array, comprising laser pointer, projection light curtain and computer, is characterized in that also comprising optical mouse sensing array and single-chip microcomputer, wherein, 所述光学鼠标传感阵列,设于所述投影光幕之后,对激光笔发出的激光点经所述投影光幕散射在传感阵列面上形成的激光散斑图像进行计算和比较,并输出激光斑点的位移信息给所述单片机;The optical mouse sensor array is arranged behind the projection light curtain, calculates and compares the laser speckle image formed by the laser point emitted by the laser pen on the sensor array surface through the scattering of the projection light curtain, and outputs The displacement information of the laser spot is given to the single-chip microcomputer; 所述单片机,根据接收的激光斑点位移信息判断激光点轨迹的起止,并对所有传感获得的位移信息融合处理,产生激光点轨迹信息,并将该轨迹信息通过蓝牙串口模块无线发送给计算机;The single-chip microcomputer judges the start and end of the laser point track according to the received laser spot displacement information, and fuses and processes all the displacement information obtained by sensing to generate laser point track information, and wirelessly sends the track information to the computer through the Bluetooth serial port module; 所述计算机,识别激光点轨迹信息并根据该轨迹信息执行交互程序;The computer recognizes laser point trajectory information and executes an interactive program according to the trajectory information; 所述投影光幕与光学鼠标传感阵列之间平行间隔设置,所述间隔距离为400mm~600mm;The projection light curtain and the optical mouse sensor array are arranged at a parallel interval, and the interval distance is 400 mm to 600 mm; 所述光学鼠标传感阵列由等间隔设置的至少4个光学鼠标传感芯片排列而成,相邻的两光学鼠标传感芯片之间的距离设置为激光点散射形成激光散斑模型半径的倍。The optical mouse sensor array is arranged by at least 4 optical mouse sensor chips arranged at equal intervals, and the distance between two adjacent optical mouse sensor chips is set to 100% of the radius of the laser speckle model formed by laser point scattering. times. 2.如权利要求1所述的激光点追踪系统,其特征在于,所述光学鼠标传感芯片为无通光小孔的芯片。2. The laser point tracking system according to claim 1, wherein the optical mouse sensor chip is a chip without a small hole for light transmission. 3.如权利要求2所述的激光点追踪系统统,其特征在于,所述投影光幕采用双面粗糙的半透明透光材质制成。3. The laser point tracking system according to claim 2, wherein the projection light curtain is made of double-sided rough translucent light-transmitting material. 4.一种基于光学鼠标传感阵列的激光点追踪方法,其特征在于该方法包含如下步骤:4. A laser point tracking method based on optical mouse sensing array, is characterized in that the method comprises the steps: 步骤1,传感阵列部署:测量经激光笔射入并透过投影光幕到达间隔设于光幕之后的传感阵列面上的激光光斑半径,并调整所述光学鼠标传感阵列中各传感芯片的间隔;Step 1, sensor array deployment: measure the radius of the laser spot that enters through the laser pointer and passes through the projection light curtain to reach the sensor array surface behind the light curtain, and adjust the laser spot radius of each sensor array in the optical mouse sensor array. Sense chip spacing; 步骤2,激光点轨迹的获取:将光斑的位移增量存储于传感芯片的寄存器中,设定光斑轨迹的起点为(0,0),同时每个时刻仅选取一个传感芯片测量光斑位移的增量,并计算光斑在t时刻的位置坐标xt、ytStep 2. Acquisition of the laser point track: store the displacement increment of the spot in the register of the sensor chip, set the starting point of the spot track as (0,0), and select only one sensor chip at each time to measure the spot displacement , and calculate the position coordinates x t and y t of the spot at time t ; 步骤3,激光点轨迹的起止判断:利用光学鼠标传感阵列中的寄存器squal的值是否为零判定激光点轨迹是否终止。Step 3, judging the start and end of the laser point track: whether the value of the register squal in the optical mouse sensor array is zero is used to determine whether the laser point track is terminated. 5.如权利要求4所述的激光点追踪方法,其特征在于,所述光学鼠标传感阵列中的所述传感芯片最少为4个,且横纵等间隔排列,相邻传感芯片之间的距离调整为激光光斑半径的倍。5. laser point tracking method as claimed in claim 4, is characterized in that, the described sensing chip in described optical mouse sensing array is at least 4, and horizontally and vertically equally spaced arrangement, between adjacent sensing chips The distance between is adjusted to the laser spot radius times. 6.如权利要求5所述的激光点追踪方法,其特征在于,在计算出光斑在t时刻的位置坐标xt、yt后,再对激光光点轨迹数据进行空间插值和平滑处理。6. The laser point tracking method according to claim 5, wherein after calculating the position coordinates x t and y t of the light spot at time t, spatial interpolation and smoothing are performed on the laser light point track data. 7.如权利要求4或6所述的激光点追踪方法,其特征在于,光斑在t时刻的位置坐标值xt、yt由光斑在t-1时刻的位置坐标值加上在第t时刻选择的传感i的测量值计算得出,其中,选择依据为该时刻传感的SQUAL寄存器的Ssqual值,且选取传感阵列中Ssqual值最大的传感的测量作为测量值。7. The laser point tracking method as claimed in claim 4 or 6, characterized in that, the position coordinate values x t and y t of the light spot at the t moment are added by the position coordinate value of the light spot at the t-1 moment The measured value of the selected sensor i is calculated, wherein the selection basis is the S squal value of the SQUAL register sensed at this moment, and the measurement of the sensor with the largest S squal value in the sensing array is selected as the measured value. 8.如权利要求4或6所述的激光点追踪方法,其特征在于,将t时刻传感阵列中的所有传感芯片检测到的光斑位移增量进行加权运算得到加权值,由光斑在t-1时刻的位置坐标值加上在第t时刻的加权值计算得到光斑在t时刻的位置坐标值xt、yt8. The laser point tracking method as claimed in claim 4 or 6, characterized in that, the light spot displacement increments detected by all sensor chips in the sensor array at t time are carried out weighted calculation to obtain weighted value, by the light spot at t The position coordinate value at time -1 is added to the weighted value at time t to calculate the position coordinate values x t and y t of the light spot at time t . 9.如权利要求8所述的激光点追踪方法,其特征在于,所述加权运算的加权方法如下:9. laser point tracking method as claimed in claim 8, is characterized in that, the weighting method of described weighting operation is as follows: Δx(y)t=WDt Δx(y) t = WD t 其中,in, WW == SS sthe s qq uu aa ll __ 11 ΣΣ ii == 11 NN SS sthe s qq uu aa ll __ ii SS sthe s qq uu aa ll __ 22 ΣΣ ii == 11 NN SS sthe s qq uu aa ll __ ii ...... SS sthe s qq uu aa ll __ NN ΣΣ ii == 11 NN SS sthe s qq uu aa ll __ ii ,, Dt=[Δx(y)1,t … Δx(y)i,t … Δx(y)N,t]TD t = [Δx(y) 1, t ... Δx(y) i, t ... Δx(y) N, t ] T ; 此时,激光点每一时刻的位置点坐标信息为:At this time, the position coordinate information of the laser point at each moment is: xx tt == xx tt -- 11 ++ ΔxΔx tt ythe y tt == ythe y tt -- 11 ++ ΔyΔy tt .. 10.如权利要求6所述的激光点追踪方法,其特征在于,所述空间插值是在激光点每一时刻的位置点再采用三次样条插值的方法进行插值采样。10. The laser point tracking method according to claim 6, wherein the spatial interpolation is to perform interpolation sampling by using a cubic spline interpolation method at each moment of the laser point. 11.如权利要求6或9所述的激光点追踪方法,其特征在于,通过计算相邻时刻轨迹点的均值对激光点轨迹进行平滑处理,具体为:11. The laser point tracking method as claimed in claim 6 or 9, wherein the smoothing process is performed on the laser point track by calculating the mean value of the track points at adjacent moments, specifically: xx ′′ tt == (( xx tt -- 11 ++ xx tt ++ xx tt ++ 11 )) // 33 ythe y ′′ tt == (( ythe y tt -- 11 ++ ythe y tt ++ ythe y tt ++ 11 )) // 33 其中,x′t为t时刻的横坐标位移平均值,y′t为t时刻的纵坐标位移平均值。Among them, x′ t is the average displacement of abscissa at time t, and y′ t is the average displacement of ordinate at time t. 12.如权利要求4所述的激光点追踪方法,其特征在于,激光点轨迹的起止包括如下步骤:12. The laser point tracking method according to claim 4, wherein the starting and ending of the laser point track comprises the following steps: 步骤S1,判断激光点是否存在于投影光幕上:检测所有传感芯片的Squal寄存器值是否均为0,若均为0,则通过定时器设定一阀值时间,若不是全为0,则重新检测;Step S1, judge whether the laser point exists on the projection light curtain: check whether the Squal register values of all sensor chips are 0, if all 0, then set a threshold time by the timer, if not all 0, then retest; 步骤S2,判断轨迹是否结束:判断传感芯片的Squal寄存器值为0保持的时间是否达到设定的阀值时间,当传感芯片的Squal寄存器值为0保持的时间达到定时器设定的时间时,表征该轨迹结束,定时器关闭,若否,则再次判断是否存在有传感芯片的Squal寄存器值不为0,并重新检测重复开始上述步骤。Step S2, judging whether the trajectory is over: judging whether the Squal register value of the sensor chip is held at 0 for a set threshold time, when the Squal register value of the sensor chip is held for 0 time reaches the time set by the timer , it indicates that the track ends, and the timer is closed. If not, it is judged again whether the Squal register value of the sensor chip is not 0, and the above steps are repeated for re-detection.
CN201410394465.XA 2014-08-12 2014-08-12 Laser point tracking system and method based on optical mouse sensing array Active CN104142739B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410394465.XA CN104142739B (en) 2014-08-12 2014-08-12 Laser point tracking system and method based on optical mouse sensing array

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410394465.XA CN104142739B (en) 2014-08-12 2014-08-12 Laser point tracking system and method based on optical mouse sensing array

Publications (2)

Publication Number Publication Date
CN104142739A CN104142739A (en) 2014-11-12
CN104142739B true CN104142739B (en) 2017-05-17

Family

ID=51851941

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410394465.XA Active CN104142739B (en) 2014-08-12 2014-08-12 Laser point tracking system and method based on optical mouse sensing array

Country Status (1)

Country Link
CN (1) CN104142739B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104298372A (en) * 2014-11-13 2015-01-21 厦门美拓通信技术有限公司 Method for realizing virtual mouse and touch operation through laser pen
CN104464448B (en) * 2015-01-06 2016-11-30 京东方科技集团股份有限公司 Laser pen track record drive circuit and method, display device and driving method thereof, laser pen track record control system and method
CN104678672B (en) * 2015-03-16 2018-03-23 京东方科技集团股份有限公司 A kind of electrochromism module, display panel, display device and display methods
CN106771348A (en) * 2016-12-13 2017-05-31 哈尔滨工业大学深圳研究生院 A kind of fluid velocity measurement apparatus and method based on optical mouse sensor
CN109828681B (en) * 2017-11-20 2022-10-11 深圳市Tcl高新技术开发有限公司 Laser pen optical flow trajectory tracking method, projection equipment and computer readable storage medium
CN111653060A (en) * 2020-05-14 2020-09-11 深圳市地质环境研究院有限公司 Geological disaster detection method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5914783A (en) * 1997-03-24 1999-06-22 Mistubishi Electric Information Technology Center America, Inc. Method and apparatus for detecting the location of a light source
US6714310B1 (en) * 1999-09-06 2004-03-30 Canon Kabushiki Kaisha Coordinate input apparatus and method, and computer-readable memory therefor
CN101896867A (en) * 2007-11-07 2010-11-24 豪威科技有限公司 Apparatus and method for tracking a light pointer
CN202351838U (en) * 2011-11-11 2012-07-25 中国矿业大学 Novel projector curtain

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AT506617B1 (en) * 2008-02-27 2011-03-15 Isiqiri Interface Tech Gmbh DISPLAY AREA AND COMBINED CONTROL DEVICE

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5914783A (en) * 1997-03-24 1999-06-22 Mistubishi Electric Information Technology Center America, Inc. Method and apparatus for detecting the location of a light source
US6714310B1 (en) * 1999-09-06 2004-03-30 Canon Kabushiki Kaisha Coordinate input apparatus and method, and computer-readable memory therefor
CN101896867A (en) * 2007-11-07 2010-11-24 豪威科技有限公司 Apparatus and method for tracking a light pointer
CN202351838U (en) * 2011-11-11 2012-07-25 中国矿业大学 Novel projector curtain

Also Published As

Publication number Publication date
CN104142739A (en) 2014-11-12

Similar Documents

Publication Publication Date Title
CN104142739B (en) Laser point tracking system and method based on optical mouse sensing array
US10620712B2 (en) Interactive input system and method
US8941620B2 (en) System and method for a virtual multi-touch mouse and stylus apparatus
US6621483B2 (en) Optical screen pointing device with inertial properties
CN105683882B (en) Waiting time measurement and test macro and method
US8971565B2 (en) Human interface electronic device
US7006236B2 (en) Method and apparatus for approximating depth of an object's placement onto a monitored region with applications to virtual interface devices
CN108369470B (en) Improved stylus recognition
US9652043B2 (en) Recognizing commands with a depth sensor
US8957864B2 (en) Coordinate input apparatus and method
CN104123046B (en) Method for judging touch gesture by touch system and touch system
CN102782616A (en) Methods for detecting and tracking touch objects
JP2017507406A (en) Apparatus and method for operating with reduced sensitivity in a touch sensing device
JP2017509955A (en) Dynamic allocation of possible channels in touch sensors
CN104049779A (en) Method and device for achieving rapid mouse pointer switching among multiple displayers
WO2015069252A1 (en) Object position determination
TW201423484A (en) Motion detection system
US9857919B2 (en) Wearable device with intelligent user-input interface
CN103761011B (en) A kind of method of virtual touch screen, system and the equipment of calculating
CN112445326B (en) Projection interaction method based on TOF camera, system thereof and electronic equipment
CN110134261B (en) Electronic pen capable of restoring real writing
JP6643825B2 (en) Apparatus and method
CN106415460A (en) Wearable device with intelligent user input interface
CN104049747A (en) Mouse device for directly controlling cursor with finger
TW201124884A (en) Movement detection device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant