[go: up one dir, main page]

CN108387993B - Rotatable lens device and tracking method based on eyeball tracking technology - Google Patents

Rotatable lens device and tracking method based on eyeball tracking technology Download PDF

Info

Publication number
CN108387993B
CN108387993B CN201810184255.6A CN201810184255A CN108387993B CN 108387993 B CN108387993 B CN 108387993B CN 201810184255 A CN201810184255 A CN 201810184255A CN 108387993 B CN108387993 B CN 108387993B
Authority
CN
China
Prior art keywords
guide rail
lens
cambered
rotating
eyeball
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810184255.6A
Other languages
Chinese (zh)
Other versions
CN108387993A (en
Inventor
江慧绿
李超宏
厉以宇
陈浩
王勤美
黄锦海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wenzhou Medical University
Original Assignee
Wenzhou Medical University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wenzhou Medical University filed Critical Wenzhou Medical University
Priority to CN201810184255.6A priority Critical patent/CN108387993B/en
Publication of CN108387993A publication Critical patent/CN108387993A/en
Application granted granted Critical
Publication of CN108387993B publication Critical patent/CN108387993B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/02Mountings, adjusting means, or light-tight connections, for optical elements for lenses
    • G02B7/023Mountings, adjusting means, or light-tight connections, for optical elements for lenses permitting adjustment

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Accessories Of Cameras (AREA)
  • Eyeglasses (AREA)

Abstract

本发明涉及一种可旋转镜头装置,其包括主体部件,其包括弧面型旋转座,该弧面型旋转座设置在主体部件上;镜头部件,其包括镜头和弧面型容纳槽,所述镜头固定在所述弧面型容纳槽中,所述弧面型容纳槽收容于所述弧面型旋转座中,所述弧面型容纳槽可沿弧面型旋转座旋转;转动部件,设置在主体部件和镜头部件之间,以驱动镜头部件进行旋转;控制部件,设置在主体部件内部,与转动部件电连接;一种基于眼球跟踪技术的跟踪方法,利用可旋转镜头装置实现眼球跟踪;弧面型容纳槽相对弧面型旋转座的旋转,效率高、实时性好;通过控制部件控制镜头部件跟随观察者的眼球旋转,实现自动旋转,操作方便灵活、定位准确且即时。

Figure 201810184255

The present invention relates to a rotatable lens device, which includes a main body part, which includes a camber-shaped rotating seat, and the camber-surface-type rotating seat is arranged on the main body part; The lens is fixed in the cambered accommodating slot, the cambered accommodating slot is accommodated in the cambered swivel base, and the cambered accommodating slot can rotate along the cambered swivel base; the rotating part is provided with Between the main body part and the lens part, the lens part is driven to rotate; the control part is arranged inside the main body part and is electrically connected with the rotating part; a tracking method based on eye tracking technology uses a rotatable lens device to realize eye tracking; The rotation of the cambered accommodating slot relative to the cambered swivel has high efficiency and good real-time performance; the lens component is controlled by the control component to follow the eyeball rotation of the observer to realize automatic rotation, with convenient and flexible operation, accurate and instant positioning.

Figure 201810184255

Description

一种可旋转镜头装置及基于眼球跟踪技术的跟踪方法A rotatable lens device and tracking method based on eye tracking technology

技术领域technical field

本发明涉及眼球跟踪技术及镜头技术领域,特别涉及结合眼球跟踪技术的可旋转镜头技术领域,具体是指一种基于眼球跟踪技术的可旋转镜头装置及其跟踪方法,在手机、平板电脑等产品中,用于图像拍摄以及视频聊天中镜头跟随人眼眼球转动而旋转。The present invention relates to the field of eye tracking technology and lens technology, in particular to the technical field of rotatable lens combined with eye tracking technology, and in particular to a rotatable lens device based on eye tracking technology and a tracking method thereof, which are used in mobile phones, tablet computers and other products , used for image capture and video chat, the camera rotates following the movement of the human eye.

背景技术Background technique

随着第四代移动网络以及光网的覆盖,网络进入速度更快、产品更多、资费更低的时代,最低网速可达10M以上,视频画面清晰度和流畅度将越来越好,视频聊天将越来越普及,而高效、快捷、方便的视频聊天方式将成为今后的一个发展方向,视频聊天主要部件为镜头,因此,智能镜头将成为今后研究的一个热点。此外,人类是通过头部运动或眼球运动来实现不同角度景物的观察,根据这种特点,将其应用到智能镜头中,将会是一种非常有效有意义的方式。With the coverage of the fourth-generation mobile network and optical network, the network has entered an era of faster speed, more products, and lower tariffs. The minimum network speed can reach more than 10M, and the clarity and fluency of video images will become better and better. Video chat will become more and more popular, and an efficient, fast and convenient way of video chat will become a development direction in the future. The main component of video chat is the lens. Therefore, the smart lens will become a hot spot in future research. In addition, humans observe different angles of scenery through head movement or eye movement. According to this feature, it will be a very effective and meaningful way to apply it to smart lenses.

目前市场上大部分相机、手机、平板电脑等产品只能拍摄镜头前方的人、物、风景等,镜头是固定不动的,固定的镜头给手机等产品的某些功能带来不便,尤其在视频聊天过程中无法通过自己实时改变对方镜头中捕获的视场,只能通过告知对方,旋转该产品位置来达到效果,其缺点操作不方便,效率非常低,实时性差,不能即时准确定位。此外,市场上也存在小部分带有可旋转镜头的手机或其他产品,虽然可通过手动改变镜头方向以达到改变视场的效果,但不能实时智能改变视场,尤其在视频聊天中也是无法通过自己改变对方镜头中捕获视场的效果,其缺点效率低,实时性差等。At present, most cameras, mobile phones, tablet computers and other products on the market can only take pictures of people, objects, landscapes, etc. in front of the lens. The lens is fixed, and the fixed lens brings inconvenience to certain functions of mobile phones and other products, especially in During the video chat, you cannot change the field of view captured by the other party's lens in real time by yourself. You can only achieve the effect by informing the other party and rotating the position of the product. It has the disadvantages of inconvenient operation, very low efficiency, poor real-time performance, and cannot be accurately positioned in real time. In addition, there are also a small number of mobile phones or other products with rotatable lenses on the market. Although the direction of the lens can be changed manually to achieve the effect of changing the field of view, the field of view cannot be intelligently changed in real time, especially in video chat. The disadvantages of changing the effect of the field of view captured in the opponent's lens by yourself are low efficiency and poor real-time performance.

中国发明专利CN103293828B中,描述了一种可旋转镜头的电子产品,通过手动控制改变镜头位置及方向,具体内容可见专利CN103293828B。类似专利还有专利CN1882044A和专利CN103019010A等。关于基于眼球跟踪技术的可旋转镜头专利基本上未看到过。In the Chinese invention patent CN103293828B, an electronic product with a rotatable lens is described, and the position and direction of the lens can be changed by manual control, and the specific content can be found in the patent CN103293828B. Similar patents include patent CN1882044A and patent CN103019010A and so on. Patents for rotatable lenses based on eye-tracking technology are largely unseen.

因此,迫切需要一种新型的智能镜头,根据眼球运动来实现镜头位置的改变,能在视频聊天过程中实现实时主动观察对方周围环境,并具有操作方便灵活、效率高、实时性好、即时准确定位等特点。Therefore, there is an urgent need for a new type of smart lens, which can change the position of the lens according to eye movements, and can actively observe the surrounding environment of the other party in real time during the video chat process. positioning, etc.

发明内容SUMMARY OF THE INVENTION

为了克服背景技术的不足,本发明提供一种可旋转镜头装置及基于眼球跟踪技术的跟踪方法。In order to overcome the deficiencies of the background technology, the present invention provides a rotatable lens device and a tracking method based on eye tracking technology.

本发明所采用的技术方案是:一种可旋转镜头装置,其包括主体部件,其包括弧面型旋转座,该弧面型旋转座设置在主体部件上;镜头部件,其包括镜头和弧面型容纳槽,所述镜头固定在所述弧面型容纳槽中,所述弧面型容纳槽收容于所述弧面型旋转座中,所述弧面型容纳槽可沿弧面型旋转座旋转;转动部件,设置在主体部件和镜头部件之间,以驱动镜头部件进行旋转;控制部件,设置在主体部件内部,与转动部件电连接。The technical scheme adopted by the present invention is: a rotatable lens device, which includes a main body part, which includes a cambered rotating seat, and the cambered surface type rotating seat is arranged on the main body part; the lens part includes a lens and a cambered surface The lens is fixed in the cambered accommodating slot, the cambered accommodating slot is accommodated in the cambered swivel base, and the cambered accommodating slot can rotate along the cambered swivel base The rotating part is arranged between the main body part and the lens part to drive the lens part to rotate; the control part is arranged inside the main body part and is electrically connected with the rotating part.

所述转动部件包括第一驱动件、第二驱动件、第一旋转组件和第二旋转组件,所述第一驱动件设置在主体部件上,驱动第一旋转组件带动镜头部件沿弧面型旋转座左右转动;所述第二驱动件设置在主体部件上,驱动第二旋转组件带动镜头部件沿弧面型旋转座上下转动。The rotating component includes a first driving component, a second driving component, a first rotating component and a second rotating component. The first driving component is arranged on the main body component and drives the first rotating component to drive the lens component to rotate along the arc surface. The seat rotates left and right; the second driving member is arranged on the main body part, and drives the second rotating assembly to drive the lens part to rotate up and down along the arc-shaped rotating seat.

所述第一旋转组件包括相配合的齿条和齿轮,或者相配合的导轨和滑块,所述第二旋转组件包括相配合的齿条和齿轮,或者相配合的导轨和滑块。The first rotating assembly includes a matching rack and gear, or a matching guide rail and a slider, and the second rotating assembly includes a matching rack and gear, or matching guide rail and slider.

所述弧面型旋转座包括第一弧面型旋转座和第二弧面型旋转座,所述导轨或齿条沿左右方向安装在第一弧面型旋转座的内侧和/或沿前后方向安装在第二弧面型旋转座的内侧,所述滑块或齿轮固定在弧面型容纳槽的外侧或第一弧面型旋转座的外侧,且与导轨或齿条相适配。The cambered swivel seat includes a first cambered swivel seat and a second cambered swivel seat, and the guide rails or racks are mounted on the inner side of the first cambered swivel seat along the left-right direction and/or in the front-rear direction Installed on the inner side of the second cambered rotating seat, the slider or the gear is fixed on the outer side of the cambered accommodating groove or the outer side of the first cambered rotating seat, and is matched with the guide rail or the rack.

所述导轨包括第一导轨和第二导轨,所述第一导轨的两端以弧面型旋转座的轴心为对称中心,固定在弧面型旋转座的内侧;所述第二导轨的两端以第一导轨为对称中心,固定在弧面型旋转座的内侧,所述滑块包括第一滑块和第二滑块,均固定在弧面型容纳槽的外侧,且与相对应的第一导轨和第二导轨相适配,所述第一导轨两端之间的部分、第二导轨两端之间的部分均能沿弧面型旋转座的内侧摆动。The guide rail includes a first guide rail and a second guide rail. The two ends of the first guide rail take the axis of the camber type rotating seat as the center of symmetry and are fixed on the inner side of the camber type rotating seat; The end takes the first guide rail as the center of symmetry, and is fixed on the inner side of the cambered rotating seat. The first guide rail and the second guide rail are matched, and the part between the two ends of the first guide rail and the part between the two ends of the second guide rail can swing along the inner side of the arc-shaped rotating seat.

所述滑块为磁性材质,以及对应设有一个用于固定滑块的磁块,所述磁块与滑块位于一个面的两侧。The slider is made of magnetic material, and a magnetic block for fixing the slider is correspondingly provided, and the magnetic block and the slider are located on both sides of one surface.

所述的弧面型旋转座为内部空心的外壳,所述滑块和相对应的导轨隐藏在弧面型旋转座内部,所述的滑块为磁性滑块,所述滑块和导轨在弧面型旋转座内部可自由摆动。The cambered rotating seat is an inner hollow shell, the slider and the corresponding guide rail are hidden inside the cambered rotating seat, the slider is a magnetic slider, and the slider and the guide rail are in the arc. The inside of the surface swivel seat can swing freely.

所述的弧面型旋转座为内部中空的壳体,所述导轨包括第一导轨和第二导轨,所述第一导轨的两端以弧面型旋转座的轴心为对称中心,固定在弧面型旋转座的内部;所述第二导轨的两端以第一导轨为对称中心,固定在弧面型旋转座的内部,所述滑块包括第一滑块和第二滑块,均固定在弧面型容纳槽的内部,且与相对应的第一导轨和第二导轨相适配,所述第一导轨两端之间的部分、第二导轨两端之间的部分均能沿弧面型旋转座的内部摆动,所述滑块为磁性材质,以及对应在弧面型容纳槽内侧固定设有一个与滑块相吸的磁块。The cambered swivel seat is an inner hollow shell, and the guide rail includes a first guide rail and a second guide rail. The inside of the cambered rotating seat; the two ends of the second guide rail are fixed inside the cambered rotating seat with the first guide rail as the center of symmetry, and the sliding block includes a first sliding block and a second sliding block, both of which are It is fixed inside the arc-shaped accommodating groove, and is matched with the corresponding first guide rail and second guide rail, and the part between the two ends of the first guide rail and the part between the two ends of the second guide rail can be The inside of the cambered rotating seat swings, the sliding block is made of magnetic material, and a magnetic block that attracts the sliding block is fixed on the inner side of the cambered accommodating groove.

一种基于眼球跟踪技术的跟踪方法,其步骤在于:A tracking method based on eye tracking technology, the steps of which are:

1)镜头对着眼睛,要求观察者头部正对所述的主体部件,可进行平行移动,眼睛注视显示部件,采集该时刻的图像,并将图像发送到控制部件;1) The lens is facing the eyes, and the observer's head is required to face the main body part, which can be moved in parallel, the eyes are fixed on the display part, the image at this moment is collected, and the image is sent to the control part;

2)由控制部件提取图像中所有外眼图像,进行图像降噪、旋转和校正;2) Extract all outer eye images in the image by the control component, and perform image noise reduction, rotation and correction;

3)以外眼中心点作为参考点,计算出虹膜中心点偏移外眼中心点的量,取平均值,得到眼球偏移量,并通过公式换算获得转动部件的转动角度;3) Using the center point of the outer eye as the reference point, calculate the amount that the center point of the iris is offset from the center point of the outer eye, take the average value, obtain the offset amount of the eyeball, and obtain the rotation angle of the rotating part by formula conversion;

4)控制部件将转动角度发送到转动部件,以驱动镜头部件旋转。4) The control part sends the rotation angle to the rotation part to drive the lens part to rotate.

步骤3)中所述的眼球偏移量与转动部件转动角度间的关系,其具体计算过程如下:The relationship between the offset of the eyeball and the rotation angle of the rotating part described in step 3), the specific calculation process is as follows:

31)在人眼横向方向建立一个直角坐标系XOY,以眼角连线右方向为X轴正方向,连线中心垂直向上为Y轴正方向,眼球在X轴偏移量记为x,眼球在Y轴偏移量记为y;31) Establish a Cartesian coordinate system XOY in the lateral direction of the human eye. The right direction of the line connecting the corner of the eye is the positive direction of the X axis, and the vertical upward direction of the center of the line is the positive direction of the Y axis. The offset of the eyeball on the X axis is recorded as x, and the eyeball is in the The Y-axis offset is recorded as y;

32)在人眼纵向方向建立一个直角坐标系ZOY,以眼轴为Z轴,记眼球眼轴长度为z,则眼球半径R=z/2,眼球左右偏移量为y,对应眼球上下旋转角度θ2为,根据几何关系,可得32) Establish a rectangular coordinate system ZOY in the longitudinal direction of the human eye, take the eye axis as the Z axis, and record the eye axis length as z, then the eyeball radius R=z/2, the left and right offset of the eyeball is y, corresponding to the up and down rotation of the eyeball The angle θ2 is, according to the geometric relationship, we can get

Figure BDA0001589792270000041
Figure BDA0001589792270000041

同理可得,眼球左右旋转角度θ1为:In the same way, the left and right rotation angle θ1 of the eyeball is:

Figure BDA0001589792270000042
Figure BDA0001589792270000042

33)转动部件3为二维转动,姿态角设为左右旋转角α1和上下旋转角α2,根据几何关系,则左右旋转角α1和上下旋转角α2分别为:33) The rotating part 3 is a two-dimensional rotation, and the attitude angle is set as the left and right rotation angle α1 and the up and down rotation angle α2. According to the geometric relationship, the left and right rotation angle α1 and the up and down rotation angle α2 are respectively:

Figure BDA0001589792270000043
Figure BDA0001589792270000043

方向规定与眼球转动方向一致。The direction regulation is consistent with the direction of eye movement.

本发明的有益效果是:本发明弧面型容纳槽相对弧面型旋转座的旋转,效率高、实时性好;通过控制部件控制镜头部件跟随观察者的眼球旋转,实现自动旋转,操作方便灵活、定位准确且即时。The beneficial effects of the present invention are: the rotation of the cambered accommodating groove relative to the cambered swivel seat of the present invention has high efficiency and good real-time performance; the control unit controls the lens unit to follow the eyeball rotation of the observer to realize automatic rotation, and the operation is convenient and flexible , accurate and instant positioning.

附图说明Description of drawings

图1是本发明的主体部件结构示意图。FIG. 1 is a schematic view of the structure of the main body part of the present invention.

图2是本发明镜头组件的一个实施例。FIG. 2 is an embodiment of a lens assembly of the present invention.

图3是本发明镜头组件的一个实施例。FIG. 3 is an embodiment of the lens assembly of the present invention.

图4是本发明镜头组件的一个实施例。FIG. 4 is an embodiment of the lens assembly of the present invention.

图5是本发明镜头组件的一个实施例。FIG. 5 is an embodiment of the lens assembly of the present invention.

图6是本发明眼球偏移量的流程图。FIG. 6 is a flow chart of the displacement of the eyeball according to the present invention.

图7是本发明眼睛与镜头组件的示意图。Figure 7 is a schematic diagram of the eye and lens assembly of the present invention.

图8是本发明XOY坐标系的示意图。FIG. 8 is a schematic diagram of the XOY coordinate system of the present invention.

图9是本发明YOZ坐标系的示意图。FIG. 9 is a schematic diagram of the YOZ coordinate system of the present invention.

图10是本发明的使用实施例。Figure 10 is an example of use of the present invention.

具体实施方式Detailed ways

本发明中,内侧指内凹层的外表面,如弧面型旋转座内侧是指弧面型旋转座内凹层的那层外表面;外侧指外凸层的外表面,如弧面型旋转座外侧是指弧面型旋转座外凸层的外表面。In the present invention, the inner side refers to the outer surface of the inner concave layer. For example, the inner side of the cambered rotary seat refers to the outer surface of the inner concave layer of the cambered rotary seat; the outer side refers to the outer surface of the outer convex layer, such as the cambered rotary seat. The outer side of the seat refers to the outer surface of the convex layer of the cambered rotary seat.

下面结合附图对本发明实施例作进一步说明:Embodiments of the present invention will be further described below in conjunction with the accompanying drawings:

如图1和图2所示,一种可旋转镜头装置,其包括主体部件1,其包括弧面型旋转座11,该弧面型旋转座11设置在主体部件1上;镜头部件2,其包括镜头21和弧面型容纳槽22,所述镜头21通过螺丝固定在所述弧面型容纳槽22中,所述弧面型容纳槽22收容于所述弧面型旋转座11中,所述弧面型容纳槽22可沿弧面型旋转座11旋转;转动部件3,设置在主体部件1和镜头部件2之间,以驱动镜头部件2进行旋转;控制部件5,设置在主体部件1内部,与转动部件3电连接,弧面型容纳槽22相对弧面型旋转座11的旋转,效率高、实时性好;通过控制部件5控制镜头部件2跟随观察者的眼球旋转,实现自动旋转,操作方便灵活、定位准确且即时。As shown in FIGS. 1 and 2, a rotatable lens device includes a main body part 1, which includes a cambered rotary base 11, which is arranged on the main body part 1; a lens part 2, which It includes a lens 21 and a cambered accommodating slot 22, the lens 21 is fixed in the cambered accommodating slot 22 by screws, and the cambered accommodating slot 22 is accommodated in the cambered rotating seat 11, so The arc-shaped accommodating groove 22 can rotate along the arc-shaped rotating base 11; the rotating part 3 is arranged between the main body part 1 and the lens part 2 to drive the lens part 2 to rotate; the control part 5 is arranged on the main body part 1 Inside, it is electrically connected with the rotating part 3, and the rotation of the cambered accommodating groove 22 relative to the cambered swivel base 11 has high efficiency and good real-time performance; the lens part 2 is controlled by the control part 5 to follow the eyeball of the observer to rotate to realize automatic rotation , the operation is convenient and flexible, the positioning is accurate and instant.

所述转动部件3可以实现一维转动,也可以实现二维转动。The rotating member 3 can realize one-dimensional rotation or two-dimensional rotation.

如图2所示,一维转动,能左右转动,或者能上下转动;所述转动部件3包括驱动件和旋转组件,所述驱动件设置在主体部件1上,驱动旋转组件带动镜头部件2沿弧面型旋转座11左右或者上下转动。As shown in Figure 2, one-dimensional rotation can be rotated left and right, or can be rotated up and down; the rotating part 3 includes a driving part and a rotating assembly, the driving part is arranged on the main body part 1, and the driving rotating assembly drives the lens part 2 along the The cambered rotating seat 11 rotates left and right or up and down.

如图3所示,二维转动,既能左右转动,又能上下转动;所述转动部件3包括第一驱动件31、第二驱动件32、第一旋转组件和第二旋转组件,所述第一驱动件31设置在主体部件1上,驱动第一旋转组件带动镜头部件2沿弧面型旋转座11左右转动;所述第二驱动件32设置在主体部件1上,驱动第二旋转组件带动镜头部件2沿弧面型旋转座11上下转动,所述第一驱动件31、第二驱动件32采用电机,更为优选的,采用伺服电机,以实现即动急停,精准地控制第一旋转组件和第二旋转组件的旋转角度。As shown in FIG. 3, the two-dimensional rotation can rotate left and right as well as up and down; the rotating member 3 includes a first driving member 31, a second driving member 32, a first rotating assembly and a second rotating assembly. The first driving member 31 is disposed on the main body part 1, and drives the first rotating assembly to drive the lens part 2 to rotate left and right along the arc-shaped rotating base 11; the second driving member 32 is disposed on the main body part 1, and drives the second rotating assembly. Drive the lens component 2 to rotate up and down along the cambered rotating base 11, the first driving member 31 and the second driving member 32 are motors, and more preferably, servo motors are used to realize immediate emergency stop and accurately control the first driving member 31 and the second driving member 32. Rotation angle of a rotating assembly and a second rotating assembly.

所述第一旋转组件可采用包括导轨41(或齿条),以及与之相配合的滑块42(或齿轮),所述第二旋转组件也是如此,包括导轨41(或齿条),以及与之相配合的滑块42(或齿轮),此处,可以允许一个旋转组件采用导轨41与滑块42的配合,另一个旋转组件采用齿条与齿轮的配合。The first rotating assembly can include a guide rail 41 (or a rack) and a sliding block 42 (or a gear) matched with it, and the second rotating assembly is also the same, including a guide rail 41 (or a rack), and The sliding block 42 (or gear) matched with it, here, can allow one rotating component to use the cooperation of the guide rail 41 and the sliding block 42, and the other rotating component to use the cooperation of the rack and the gear.

如图3所示,以2个弧面型旋转座,以第一旋转组件和第二旋转组件均采用导轨41和滑块42的配合为例。As shown in FIG. 3 , with two cambered rotating seats, the first rotating assembly and the second rotating assembly both adopt the cooperation of the guide rail 41 and the sliding block 42 as an example.

所述弧面型旋转座11包括第一弧面型旋转座111和第二弧面型旋转座112,且第一弧面型旋转座111高于第二弧面型旋转座112,一个导轨41a沿左右方向安装在第一弧面型旋转座111的内侧,另一个导轨41b沿前后方向安装在第二弧面型旋转座112的内侧,导轨41a对应的滑块42a固定在弧面型容纳槽22的外侧,导轨41b对应的滑块42b固定在第一弧面型旋转座111的外侧,在转动过程中,滑块42a沿导轨41a滑移,带动镜头部件2左右旋转,完成左右旋转后,滑块42b沿导轨41b滑移,带动镜头部件2上下旋转,完成上下旋转,最终使得镜头21与人眼眼球转动相对应。镜头部件2相对第一弧面型旋转座111的旋转,不会对第二弧面型旋转座112造成任何影响,当第一弧面型旋转座111相对第二弧面型旋转座112上下移动时,第一弧面型旋转座111与弧面型容纳槽22之间的导轨41a和滑块42a的配合正好构成第一弧面型旋转座111对弧面型容纳槽22的限位,从而使得第一弧面型旋转座111和弧面型容纳槽22同时相对第二弧面型旋转座112上下移动。同理,可以先进行第一弧面型旋转座111的上下旋转,再进行弧面型容纳槽22的左右旋转;或者可以同时进行。The cambered swivel base 11 includes a first cambered swivel 111 and a second cambered swivel 112, and the first cambered swivel 111 is higher than the second cambered swivel 112, and a guide rail 41a The other guide rail 41b is installed on the inner side of the second cambered rotating seat 112 in the front-rear direction, and the slider 42a corresponding to the guide rail 41a is fixed in the cambered accommodating groove. On the outside of 22, the slider 42b corresponding to the guide rail 41b is fixed on the outside of the first arc-shaped rotating seat 111. During the rotation, the slider 42a slides along the guide rail 41a to drive the lens part 2 to rotate left and right. After the left and right rotation is completed, The slider 42b slides along the guide rail 41b, and drives the lens component 2 to rotate up and down, so as to complete the up and down rotation, and finally make the lens 21 correspond to the rotation of the human eyeball. The rotation of the lens component 2 relative to the first arc-shaped rotating base 111 will not cause any influence on the second arc-shaped rotating base 112. When the first arc-shaped rotating base 111 moves up and down relative to the second arc-shaped rotating base 112 At the same time, the cooperation of the guide rail 41a and the slider 42a between the first cambered rotary seat 111 and the cambered accommodating slot 22 just constitutes the limit of the first cambered rotary seat 111 to the cambered accommodating slot 22, so that the The first cambered rotating seat 111 and the cambered accommodating groove 22 are moved up and down relative to the second cambered rotating seat 112 at the same time. Similarly, the up and down rotation of the first cambered rotating seat 111 can be performed first, and then the left and right rotation of the cambered accommodating groove 22 can be performed; or it can be performed simultaneously.

所述导轨41安装在弧面型旋转座11内侧,可采用导轨41直接固定在弧面型旋转座11内侧外表面上,其导轨41高出弧面型旋转座11内侧;更为优选的方案,导轨41从弧面型旋转座11内侧表面内嵌到弧面型旋转座11里面,其导轨41与弧面型旋转座11内侧齐平,或者直接在弧面型旋转座11内侧加工导轨槽,形成所述的导轨41。The guide rail 41 is installed on the inner side of the cambered swivel base 11, and the guide rail 41 can be directly fixed on the inner and outer surfaces of the cambered swivel base 11, and the guide rail 41 is higher than the inner side of the cambered swivel base 11; a more preferred solution , the guide rail 41 is embedded from the inner surface of the camber type rotating seat 11 into the camber type rotating seat 11, and the guide rail 41 is flush with the inner side of the camber type rotating seat 11, or the guide rail groove is directly processed on the inner side of the camber type rotating seat 11 , forming the guide rail 41 .

所述的滑块42可以是普通滑块,如此通过紧固件直接安装在对应的位置上即可。The sliding block 42 can be a common sliding block, so that it can be directly installed at the corresponding position by means of fasteners.

所述滑块42可以是磁性滑块,以及对应设有一个用于固定滑块42的磁块43,这里所说的磁块43与磁性滑块是指可互相吸引的磁性材料,比如铁块与磁石、磁石与磁石等,其中磁性滑块可以是滑块本身采用磁性,也可以由磁块固定在滑块42上形成。The slider 42 may be a magnetic slider, and a corresponding magnetic block 43 for fixing the slider 42 is provided. The magnetic block 43 and the magnetic slider here refer to magnetic materials that can attract each other, such as iron blocks. In the case of magnets, magnets and magnets, and the like, the magnetic slider may be the slider itself using magnetism, or it may be formed by a magnet block fixed on the slider 42 .

在上述实施例中,滑块42a位于弧面型容纳槽22的外侧,磁块43a位于弧面型容纳槽22的内侧或者内嵌到弧面型容纳槽22里面,滑块42b位于第一弧面型旋转座111的外侧,磁块43b位于第一弧面型旋转座111的内侧或者内嵌到弧面型容纳槽22里面,滑块42a与磁块43a相吸在一起,滑块42b与磁块43b相吸在一起,通过第一驱动件31带动导轨41a上的滑块42a,同时滑块42a带动相吸的固定在弧面型容纳槽22上的磁块43a,从而传动连接并控制镜头部件1绕第一弧面型旋转座111做左右旋转;同理,完成左右旋转后,在第二驱动件32带动下,完成上下旋转;或者可同时进行。In the above embodiment, the slider 42a is located outside the arc-shaped accommodating groove 22, the magnetic block 43a is located inside the arc-shaped accommodating groove 22 or embedded in the arc-shaped accommodating groove 22, and the slider 42b is located in the first arc-shaped accommodating groove 22. On the outside of the surface-type rotating seat 111, the magnetic block 43b is located inside the first arc-type rotating seat 111 or is embedded in the arc-type receiving groove 22, the slider 42a and the magnet block 43a are attracted together, and the slider 42b and the The magnetic blocks 43b are attracted together, and the first driving member 31 drives the slider 42a on the guide rail 41a, and the slider 42a drives the attracted magnet 43a fixed on the arc-shaped receiving groove 22, so as to drive the connection and control The lens component 1 rotates left and right around the first arc-shaped rotating base 111 ; similarly, after the left and right rotation is completed, the second driving member 32 drives to complete the up and down rotation; or it can be performed simultaneously.

如图4所示,以1个弧面型旋转座,以第一旋转组件和第二旋转组件均采用导轨41和滑块42的配合为例。As shown in FIG. 4 , taking a camber-type rotating seat, the first rotating assembly and the second rotating assembly both adopt the cooperation of the guide rail 41 and the slider 42 as an example.

所述导轨41包括第一导轨411和第二导轨412,所述第一导轨411的两端以弧面型旋转座11的轴心为对称中心,固定在弧面型旋转座11的内侧;所述第二导轨412的两端以第一导轨411为对称中心,固定在弧面型旋转座11的内侧,所述滑块42包括第一滑块421和第二滑块422,均固定在弧面型容纳槽22的外侧,且与相对应的第一导轨411和第二导轨412相适配,所述第一导轨411两端之间的部分、第二导轨412两端之间的部分均能沿弧面型旋转座11的内侧摆动,先进行左右旋转,则第一滑块421会沿第一导轨411左右滑移,由于左右旋转带动弧面型容纳槽22相对弧面型旋转座11产生了偏移,而第二滑块422是固定在弧形容纳槽22上的,是会随弧形容纳槽22旋转的,而第二滑块422与第二导轨412始终是相接触的,故在左右旋转过程中,第二滑块422会带动第二导轨412两端之间的部分同时沿左或右偏移;完成左右旋转后,再进行上下旋转,则第二滑块422会沿第二导轨412上下滑移,也可以先进行上下旋转,再进行左右旋转,二者之间没有顺序关系,导轨会在对应的滑块带动下,发生偏移,以适应即将发生的另一个方向的旋转。The guide rail 41 includes a first guide rail 411 and a second guide rail 412. The two ends of the first guide rail 411 take the axis of the cambered rotating seat 11 as the center of symmetry and are fixed on the inner side of the cambered rotating seat 11; Both ends of the second guide rail 412 take the first guide rail 411 as the center of symmetry, and are fixed on the inner side of the arc-shaped rotating seat 11. The slider 42 includes a first slider 421 and a second slider 422, both of which are fixed on the arc surface. The outer side of the surface-type accommodating groove 22 is adapted to the corresponding first guide rail 411 and the second guide rail 412. The part between the two ends of the first guide rail 411 and the part between the two ends of the second guide rail 412 are both It can swing along the inner side of the camber-type rotating seat 11, and rotate left and right first, then the first slider 421 will slide left and right along the first guide rail 411, and the camber-type accommodating groove 22 is driven relative to the camber-type rotating seat 11 due to the left-right rotation. There is an offset, and the second sliding block 422 is fixed on the arc-shaped accommodating groove 22, and will rotate with the arc-shaped accommodating groove 22, and the second sliding block 422 is always in contact with the second guide rail 412, Therefore, during the left and right rotation, the second sliding block 422 will drive the part between the two ends of the second guide rail 412 to shift to the left or right at the same time; The second guide rail 412 slides up and down. It can also be rotated up and down first, and then rotated left and right. There is no sequence relationship between the two. rotation.

如图5所示,以1个内部中空的弧面型旋转座,以第一旋转组件和第二旋转组件均采用导轨41和滑块42的配合为例。As shown in FIG. 5 , taking a cambered rotating seat with a hollow inside, the first rotating assembly and the second rotating assembly both adopt the cooperation of the guide rail 41 and the slider 42 as an example.

所述的弧面型旋转座11为内部中空的壳体,所述导轨41包括第一导轨411和第二导轨412,所述第一导轨411的两端以弧面型旋转座的轴心为对称中心,固定在弧面型旋转座11的内部;所述第二导轨412的两端以第一导轨411为对称中心,固定在弧面型旋转座11的内部,所述滑块42包括第一滑块421和第二滑块422,均固定在弧面型容纳槽22的内部,且与相对应的第一导轨411和第二导轨412相适配,所述第一导轨411两端之间的部分、第二导轨412两端之间的部分均能沿弧面型旋转座11的内部摆动,所述滑块42为磁性材质,以及对应在弧面型容纳槽22内侧固定设有一个与滑块42相吸的磁块43。The cambered swivel base 11 is a hollow shell, the guide rail 41 includes a first guide rail 411 and a second guide rail 412, and the two ends of the first guide rail 411 are centered on the cambered swivel base. The center of symmetry is fixed inside the arc-shaped rotating seat 11; the two ends of the second guide rail 412 take the first guide rail 411 as the center of symmetry, and are fixed inside the arc-shaped rotating seat 11, and the slider 42 includes the first guide rail 411 as the center of symmetry. A sliding block 421 and a second sliding block 422 are fixed inside the arc-shaped accommodating groove 22 and are matched with the corresponding first guide rail 411 and the second guide rail 412 . The part between the two ends of the second guide rail 412 and the part between the two ends of the second guide rail 412 can swing along the interior of the cambered rotating seat 11 , the slider 42 is made of magnetic material, and a The magnet block 43 attracting the slider 42 .

如图6和图7所示,一种基于眼球跟踪技术的跟踪方法,其步骤在于:As shown in Figure 6 and Figure 7, a tracking method based on eye tracking technology, its steps are:

1)镜头21对着眼睛,要求观察者头部7正对所述的主体部件1,可进行平行移动,眼睛注视显示部件6,采集该时刻的图像,并将图像发送到控制部件5;1) the lens 21 is facing the eyes, and the head 7 of the observer is required to face the described main body part 1, and can be moved in parallel, the eyes are fixed on the display part 6, the image at this moment is collected, and the image is sent to the control part 5;

2)由控制部件5提取图像中所有外眼图像,进行图像降噪、旋转和校正;2) Extract all outer eye images in the image by the control component 5, and perform image noise reduction, rotation and correction;

3)以外眼中心点作为参考点,计算出虹膜中心点偏移外眼中心点的量,取平均值,得到眼球偏移量,并通过公式换算获得转动部件3的转动角度;3) use the outer eye center point as the reference point, calculate the amount that the iris center point offsets the outer eye center point, take the average value, obtain the eyeball offset, and obtain the rotation angle of the rotating part 3 by formula conversion;

4)控制部件5将转动角度发送到转动部件3,以驱动镜头部件2旋转。4) The control part 5 sends the rotation angle to the rotation part 3 to drive the lens part 2 to rotate.

如图8和图9所示,步骤3)中所述的眼球偏移量与转动部件3转动角度间的关系,其具体计算过程如下:As shown in Figure 8 and Figure 9, the relationship between the eyeball offset and the rotation angle of the rotating member 3 described in step 3), the specific calculation process is as follows:

31)为了简单起见,在人眼横向方向建立一个直角坐标系XOY,以眼角连线右方向为X轴正方向,连线中心垂直向上为Y轴正方向,记眼球偏移量记为(x,y);31) For the sake of simplicity, a Cartesian coordinate system XOY is established in the lateral direction of the human eye. The right direction of the line connecting the corner of the eye is the positive direction of the X axis, and the vertical upward direction of the center of the line is the positive direction of the Y axis, and the eyeball offset is recorded as (x , y);

32)由于人眼眼球为轴(眼轴)对称系统,为了简单起见,取人眼纵向截面进行分析,在人眼纵向方向建立一个直角坐标系ZOY,眼轴作为Z轴,记眼球眼轴长度为z,已知正常人眼眼轴(角膜到视网膜间的距离)长度z约为24mm,人眼眼球近似球形,通过眼球旁边有六条肌肉控制着眼球的转动,其近似绕着眼球中心(眼球球心)转动,则眼球半径R=z/2=12mm,假设眼球左右偏移量为y,对应眼球上下旋转角度θ2为,根据几何关系,可得32) Since the human eyeball is an axis (eye axis) symmetrical system, for the sake of simplicity, the longitudinal section of the human eye is taken for analysis, and a rectangular coordinate system ZOY is established in the longitudinal direction of the human eye, the eye axis is used as the Z axis, and the length of the eye axis is recorded. is z, it is known that the length z of the normal human eye axis (the distance between the cornea and the retina) is about 24mm, and the human eyeball is approximately spherical. The center of the sphere) rotates, then the radius of the eyeball is R=z/2=12mm. Assuming that the left and right offset of the eyeball is y, the corresponding up and down rotation angle of the eyeball is θ2. According to the geometric relationship, we can get

Figure BDA0001589792270000091
Figure BDA0001589792270000091

同理可得,眼球左右旋转角度θ1为:In the same way, the left and right rotation angle θ1 of the eyeball is:

Figure BDA0001589792270000092
Figure BDA0001589792270000092

33)转动部件3为二维转动,姿态角设为左右旋转角α1和上下旋转角α2,其旋转方式与眼球旋转方式一致,模仿人眼旋转,则眼球旋转角度与镜头部件旋转角度相同,根据几何关系,则左右旋转角α1和上下旋转角α2分别为:33) The rotating part 3 is a two-dimensional rotation, the attitude angle is set as the left and right rotation angle α1 and the up and down rotation angle α2, and its rotation method is consistent with the eyeball rotation method, imitating the rotation of the human eye, then the eyeball rotation angle is the same as the rotation angle of the lens part, according to The geometric relationship, the left and right rotation angle α1 and the up and down rotation angle α2 are respectively:

Figure BDA0001589792270000093
Figure BDA0001589792270000093

方向规定与眼球转动方向一致。The direction regulation is consistent with the direction of eye movement.

所述的主体部件1可以是任何合适的产品,可以为手机、平板电脑、笔记本电脑等电子产品。The main body part 1 can be any suitable product, and can be an electronic product such as a mobile phone, a tablet computer, and a notebook computer.

为了实现镜头能跟随观察者人眼眼球进行智能主动旋转,以实现全视角、自由查看被观察者周围的环境,当然,该主动旋转,可以在对应的主体部件1中设置一个授权程序,只有在授权程序开启的状态下,可旋转镜头装置才会主动旋转。在本发明的具体实施例中,视频聊天过程中具体的眼球跟踪方法和步骤如下:In order to realize the intelligent and active rotation of the lens following the observer's human eyes, so as to achieve a full viewing angle and freely view the surrounding environment of the observed person, of course, for the active rotation, an authorization program can be set in the corresponding main body part 1, only in the The rotatable lens device will automatically rotate only when the authorization program is turned on. In a specific embodiment of the present invention, the specific eye tracking method and steps in the video chat process are as follows:

如图10所示,假设A作为观察者,B作为被观察者,观察者头部A7正对主体部件A1,首先,通过被观察者授权,开启被观察者镜头跟随观察者眼球自动跟踪的功能,镜头部件A2采集到的人脸视频通过主体部件A1发送到主体部件B1上,同时,通过控制部件B5将采集该时刻的图像,提取图中所有外眼图像,进行图像降噪、旋转和校正等图像预处理,分析眼球的外眼中心和虹膜中心,并以外眼中心点作为参考点,计算出虹膜中心点偏移外眼中心点的量,取平均值,得到眼球偏移量;接着,通过眼球偏移量与转动部件B3转动角度关系进行公式换算,分析出镜头部件B2需转动的角度,将计算得到的转动角度输送到转动部件B3,驱动镜头部件B1旋转;然后将此时B镜头拍摄到的视频传送到主体部件A1上,主体部件A1通过显示部件A6显示,观察者A就能看到希望看到的对方那边的景物,最后,观察者A可通过平移头部A7,观察者A眼睛注视显示部件A6,头部A7正对所述的主体部件A1,重复上述步骤,实现B区域不同角度的观察。同样的,被观察者B也可以通过显示部件B6看到观察者A这边的景物。As shown in Figure 10, assuming that A is the observer, B is the observed, and the observer's head A7 is facing the main body part A1, first, through the authorization of the observer, enable the function of the observer's lens to follow the observer's eyeball automatically. , the face video collected by the lens part A2 is sent to the main part B1 through the main part A1, and at the same time, the control part B5 will collect the image at this moment, extract all the outer eye images in the figure, and perform image noise reduction, rotation and correction. Wait for image preprocessing, analyze the outer eye center and iris center of the eyeball, and use the outer eye center point as a reference point, calculate the amount of the iris center point offset from the outer eye center point, take the average value, and obtain the eyeball offset; then, Through formula conversion between the eyeball offset and the rotation angle of the rotating part B3, the angle that the lens part B2 needs to be rotated is analyzed, and the calculated rotation angle is sent to the rotating part B3, and the lens part B1 is driven to rotate; The captured video is sent to the main part A1, the main part A1 is displayed on the display part A6, and the observer A can see the scene on the other side that he wants to see. Finally, the observer A can move the head A7 to observe. Person A looks at the display part A6, the head A7 faces the main body part A1, and repeats the above steps to realize the observation of the B area from different angles. Similarly, the observed person B can also see the scene on the side of the observer A through the display part B6.

以上结合附图所描述的实施例仅是本发明的优选实施方式,而并非对本发明的保护范围的限定,任何基于本发明精神所做的改进都理应在本发明保护范围之内。The embodiments described above in conjunction with the accompanying drawings are only preferred embodiments of the present invention, rather than limiting the protection scope of the present invention. Any improvements made based on the spirit of the present invention should fall within the protection scope of the present invention.

Claims (3)

1.一种基于眼球跟踪技术的跟踪方法,其特征在于:其采用2个可旋转镜头装置,每个可旋转镜头装置均包括1. a tracking method based on eye tracking technology, is characterized in that: it adopts 2 rotatable lens devices, and each rotatable lens device comprises 主体部件(1),其包括弧面型旋转座(11),该弧面型旋转座(11)设置在主体部件(1)上;a main body part (1), comprising a cambered rotating seat (11), the cambered rotating seat (11) being arranged on the main body part (1); 镜头部件(2),其包括镜头(21)和弧面型容纳槽(22),所述镜头(21)固定在所述弧面型容纳槽(22)中,所述弧面型容纳槽(22)收容于所述弧面型旋转座(11)中,所述弧面型容纳槽(22)可沿弧面型旋转座(11)旋转;A lens component (2), comprising a lens (21) and an arc-shaped accommodating groove (22), the lens (21) being fixed in the arc-shaped accommodating groove (22), and the arc-shaped accommodating groove ( 22) being accommodated in the cambered swivel seat (11), and the cambered accommodating groove (22) can rotate along the cambered swivel seat (11); 转动部件(3),设置在主体部件(1)和镜头部件(2)之间,以驱动镜头部件(2)进行旋转;a rotating part (3), arranged between the main body part (1) and the lens part (2), to drive the lens part (2) to rotate; 控制部件(5),设置在主体部件(1)内部,与转动部件(3)电连接;a control part (5), arranged inside the main body part (1), and electrically connected with the rotating part (3); 所述转动部件(3)包括第一驱动件(31)、第二驱动件(32)、第一旋转组件和第二旋转组件,The rotating component (3) includes a first driving member (31), a second driving member (32), a first rotating assembly and a second rotating assembly, 所述第一驱动件(31)设置在主体部件(1)上,驱动第一旋转组件带动镜头部件(2)沿左右转动;The first driving member (31) is arranged on the main body part (1), and drives the first rotating assembly to drive the lens part (2) to rotate left and right; 所述第二驱动件(32)设置在主体部件(1)上,驱动第二旋转组件带动镜头部件(2)沿上下转动;The second driving member (32) is arranged on the main body part (1), and drives the second rotating assembly to drive the lens part (2) to rotate up and down; 所述第一旋转组件包括相配合的齿条和齿轮,或者相配合的导轨(41)和滑块(42),所述第二旋转组件包括相配合的齿条和齿轮,或者相配合的导轨(41)和滑块(42);The first rotating assembly includes a matching rack and gear, or a matching guide rail (41) and a slider (42), and the second rotating assembly includes a matching rack and gear, or a matching guide rail (41) and slider (42); 所述导轨(41)包括第一导轨(411)和第二导轨(412),所述第一导轨(411)的两端以弧面型旋转座的轴心为对称中心,固定在弧面型旋转座(11)的内侧;所述第二导轨(412)的两端以第一导轨(411)为对称中心,固定在弧面型旋转座(11)的内侧,所述滑块(42)包括第一滑块(421)和第二滑块(422),均固定在弧面型容纳槽(22)的外侧,且与相对应的第一导轨(411)和第二导轨(412)相适配,所述第一导轨(411)两端之间的部分、第二导轨(412)两端之间的部分均能沿弧面型旋转座(11)的内侧摆动;The guide rail (41) includes a first guide rail (411) and a second guide rail (412). Both ends of the first guide rail (411) take the axis of the camber type rotating seat as the center of symmetry, and are fixed on the camber type rotating seat. The inner side of the rotating seat (11); the two ends of the second guide rail (412) take the first guide rail (411) as the center of symmetry, and are fixed on the inner side of the arc-shaped rotating seat (11), and the sliding block (42) It includes a first sliding block (421) and a second sliding block (422), both of which are fixed on the outer side of the arc-shaped accommodating groove (22) and are in phase with the corresponding first guide rail (411) and second guide rail (412). Adaptation, the part between the two ends of the first guide rail (411) and the part between the two ends of the second guide rail (412) can swing along the inner side of the arc-shaped rotating seat (11); 其步骤在于:The steps are: 1)观察者的镜头(21)对着观察者的眼睛,采集观察者眼睛实时的图像,并将图像发送到被观察者的控制部件(5);1) the lens (21) of the observer faces the eyes of the observer, collects the real-time image of the observer's eyes, and sends the image to the control part (5) of the observed person; 2)由被观察者的控制部件(5)提取图像中所有外眼图像,进行图像降噪、旋转和校正;2) Extract all outer eye images in the image by the control part (5) of the observed person, and perform image noise reduction, rotation and correction; 3)以外眼中心点作为参考点,计算出虹膜中心点偏移外眼中心点的量,取平均值,得到眼球偏移量,并通过公式换算获得被观察者的转动部件(3)的转动角度;3) Using the center point of the outer eye as the reference point, calculate the amount that the center point of the iris deviates from the center point of the outer eye, take the average value to obtain the offset amount of the eyeball, and obtain the rotation of the rotating part (3) of the observed person through formula conversion angle; 4)被观察者的控制部件(5)将转动角度发送到被观察者的转动部件(3),以驱动被观察者的镜头部件(2)旋转,然后将此时被观察者的镜头部件(2)拍摄到的景物传送到观察者的主体部件(1)上,观察者的主体部件(1)通过观察者的显示部件(6)显示,观察者就能看到希望看到的被观察者那边的景物。4) The control part (5) of the person being observed sends the rotation angle to the rotating part (3) of the person being observed, so as to drive the lens part (2) of the person being observed to rotate, and then the lens part ( 2) The photographed scene is transmitted to the main body part (1) of the observer, and the main body part (1) of the observer is displayed by the display part (6) of the observer, so that the observer can see the person to be observed. Scenery over there. 2.根据权利要求1所述的基于眼球跟踪技术的跟踪方法,其特征在于:所述滑块(42)为磁性材质,以及对应设有一个用于固定滑块(42)的磁块(43),所述磁块(43)与滑块(42)位于弧面型容纳槽(22)的内外两侧。2. The tracking method based on eye tracking technology according to claim 1, wherein the slider (42) is made of magnetic material, and a magnetic block (43) for fixing the slider (42) is correspondingly provided. ), the magnetic block (43) and the slider (42) are located on the inner and outer sides of the arc-shaped accommodating groove (22). 3.根据权利要求2所述的基于眼球跟踪技术的跟踪方法,其特征在于:步骤3)中所述的眼球偏移量与转动部件(3)转动角度间的关系,其具体计算过程如下:3. the tracking method based on eyeball tracking technology according to claim 2, is characterized in that: the relation between the eyeball offset described in the step 3) and the rotation angle of the rotating part (3), its concrete calculation process is as follows: 31)在人眼横向方向建立一个直角坐标系XOY,以眼角连线右方向为X轴正方向,连线中心垂直向上为Y轴正方向,眼球在X轴偏移量记为x,眼球在Y轴偏移量记为y;31) Establish a Cartesian coordinate system XOY in the lateral direction of the human eye. The right direction of the line connecting the corner of the eye is the positive direction of the X axis, and the vertical upward direction of the center of the line is the positive direction of the Y axis. The offset of the eyeball on the X axis is recorded as x, and the eyeball is in the The Y-axis offset is recorded as y; 32)在人眼纵向方向建立一个直角坐标系ZOY,以眼轴为Z轴,记眼球眼轴长度为z,则眼球半径R=z/2,眼球左右偏移量为y,对应眼球上下旋转角度θ2为,根据几何关系,可得32) Establish a rectangular coordinate system ZOY in the longitudinal direction of the human eye, take the eye axis as the Z axis, and record the eye axis length as z, then the eyeball radius R=z/2, and the left and right offset of the eyeball is y, corresponding to the up and down rotation of the eyeball The angle θ2 is, according to the geometric relationship, we can get
Figure FDA0002551763810000021
Figure FDA0002551763810000021
同理可得,眼球左右旋转角度θ1为:In the same way, the left and right rotation angle θ1 of the eyeball is:
Figure FDA0002551763810000031
Figure FDA0002551763810000031
33)转动部件3为二维转动,姿态角设为左右旋转角α1和上下旋转角α2,根据几何关系,则左右旋转角α1和上下旋转角α2分别为:33) The rotating part 3 is a two-dimensional rotation, and the attitude angle is set as the left and right rotation angle α1 and the up and down rotation angle α2. According to the geometric relationship, the left and right rotation angle α1 and the up and down rotation angle α2 are respectively:
Figure FDA0002551763810000032
Figure FDA0002551763810000032
方向规定与眼球转动方向一致。The direction regulation is consistent with the direction of eye movement.
CN201810184255.6A 2016-04-01 2016-04-01 Rotatable lens device and tracking method based on eyeball tracking technology Active CN108387993B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810184255.6A CN108387993B (en) 2016-04-01 2016-04-01 Rotatable lens device and tracking method based on eyeball tracking technology

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610205550.6A CN105700103B (en) 2016-04-01 2016-04-01 A kind of rotatable lens assembly and the tracking based on eye tracking technology
CN201810184255.6A CN108387993B (en) 2016-04-01 2016-04-01 Rotatable lens device and tracking method based on eyeball tracking technology

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201610205550.6A Division CN105700103B (en) 2016-04-01 2016-04-01 A kind of rotatable lens assembly and the tracking based on eye tracking technology

Publications (2)

Publication Number Publication Date
CN108387993A CN108387993A (en) 2018-08-10
CN108387993B true CN108387993B (en) 2020-09-18

Family

ID=56219010

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201810184255.6A Active CN108387993B (en) 2016-04-01 2016-04-01 Rotatable lens device and tracking method based on eyeball tracking technology
CN201610205550.6A Active CN105700103B (en) 2016-04-01 2016-04-01 A kind of rotatable lens assembly and the tracking based on eye tracking technology

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201610205550.6A Active CN105700103B (en) 2016-04-01 2016-04-01 A kind of rotatable lens assembly and the tracking based on eye tracking technology

Country Status (1)

Country Link
CN (2) CN108387993B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107875526B (en) * 2017-11-27 2020-01-24 温州医科大学附属第一医院 Precise control method of radiotherapy apparatus during adaptive radiotherapy of ocular tumors
CN110995908B (en) 2020-01-07 2021-08-03 维沃移动通信有限公司 Electronic device, photographing method and photographing device

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1984246A (en) * 2006-04-18 2007-06-20 华为技术有限公司 Camera
CN101282699A (en) * 2005-08-25 2008-10-08 卡尔蔡司医疗技术股份公司 Contact Lenses for Eye Surgery
US7446813B2 (en) * 2003-07-25 2008-11-04 Kabushiki Kaisha Toshiba Active camera apparatus and robot apparatus
CN202168140U (en) * 2011-07-04 2012-03-14 鸿富锦精密工业(深圳)有限公司 Camera Angle Adjustment Device
CN102599934A (en) * 2012-03-13 2012-07-25 华中科技大学 Data acquisition device of three-dimensional ultrasound image based on rear-end scanning
CN102822714A (en) * 2010-10-26 2012-12-12 松下电器产业株式会社 Lens unit
CN202806604U (en) * 2012-07-27 2013-03-20 长城汽车股份有限公司 Angle-adjustable back-up camera
CN103072140A (en) * 2012-12-18 2013-05-01 北京理工大学 Binocular three-dimensional bionic eye mechanism with panoramic capture and positioning functions
CN103353663A (en) * 2013-06-28 2013-10-16 北京智谷睿拓技术服务有限公司 Imaging adjustment apparatus and method
CN203759720U (en) * 2013-11-18 2014-08-06 原相科技股份有限公司 Image acquisition module
KR20150018924A (en) * 2013-08-09 2015-02-25 한국전자통신연구원 Shape-variable optical element
JP2015052772A (en) * 2013-08-06 2015-03-19 孝郎 林 Eyesight correction device

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7307798B2 (en) * 2003-07-29 2007-12-11 The Brunton Company Multi-step locking eye cup twist up device
CN201170835Y (en) * 2008-03-13 2008-12-24 深圳市同洲电子股份有限公司 Camera
CN101732870A (en) * 2008-11-07 2010-06-16 鸿富锦精密工业(深圳)有限公司 Simulated eye
CN101670584B (en) * 2009-09-25 2011-06-08 上海大学 Bionic mechanical eyeball
CN202548498U (en) * 2012-05-03 2012-11-21 合硕科技股份有限公司 Spherical lens device capable of automatically tracking and focusing
CN103209287A (en) * 2013-03-11 2013-07-17 张国柱 Photographing method of regulation and control camera lens, special camera and special glasses frame
JP6072621B2 (en) * 2013-06-18 2017-02-01 オリンパス株式会社 Imaging device and control method thereof
CN104199553B (en) * 2014-09-15 2016-01-27 苏州思源科安信息技术有限公司 For guiding instruction human-computer interface device and the method for mobile terminal iris recognition
CN204775056U (en) * 2015-06-15 2015-11-18 金百盛电子科技(深圳)有限公司 Electronic equipment for multi -function vehicle
CN105243362A (en) * 2015-09-23 2016-01-13 努比亚技术有限公司 Camera control apparatus and method

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7446813B2 (en) * 2003-07-25 2008-11-04 Kabushiki Kaisha Toshiba Active camera apparatus and robot apparatus
CN101282699A (en) * 2005-08-25 2008-10-08 卡尔蔡司医疗技术股份公司 Contact Lenses for Eye Surgery
CN1984246A (en) * 2006-04-18 2007-06-20 华为技术有限公司 Camera
CN102822714A (en) * 2010-10-26 2012-12-12 松下电器产业株式会社 Lens unit
CN202168140U (en) * 2011-07-04 2012-03-14 鸿富锦精密工业(深圳)有限公司 Camera Angle Adjustment Device
CN102599934A (en) * 2012-03-13 2012-07-25 华中科技大学 Data acquisition device of three-dimensional ultrasound image based on rear-end scanning
CN202806604U (en) * 2012-07-27 2013-03-20 长城汽车股份有限公司 Angle-adjustable back-up camera
CN103072140A (en) * 2012-12-18 2013-05-01 北京理工大学 Binocular three-dimensional bionic eye mechanism with panoramic capture and positioning functions
CN103353663A (en) * 2013-06-28 2013-10-16 北京智谷睿拓技术服务有限公司 Imaging adjustment apparatus and method
JP2015052772A (en) * 2013-08-06 2015-03-19 孝郎 林 Eyesight correction device
KR20150018924A (en) * 2013-08-09 2015-02-25 한국전자통신연구원 Shape-variable optical element
CN203759720U (en) * 2013-11-18 2014-08-06 原相科技股份有限公司 Image acquisition module

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
高帧频紧凑型自适应光学扫描激光检眼镜;江慧绿;《光学学报》;20151130;第35卷(第11期);第1117002-3-1117002-8页 *

Also Published As

Publication number Publication date
CN105700103A (en) 2016-06-22
CN105700103B (en) 2018-06-29
CN108387993A (en) 2018-08-10

Similar Documents

Publication Publication Date Title
CN106393179B (en) A kind of nine-degree of freedom binocular bionic eye
US10880470B2 (en) Robotic camera system
US10603794B2 (en) Robotic camera system
CN106042005B (en) The method of work of bionic eye location tracking system
CN105893965A (en) Binocular visual image synthesis device and method used for unspecified person
US20140135062A1 (en) Positioning apparatus for photographic and video imaging and recording and system utilizing same
CN105376554B (en) 3D cameras mechanism, the mobile device with the mechanism and control method
CN113221865A (en) Single-camera binocular iris image acquisition method and device
US20120287160A1 (en) Display device and rotation method of same
CN108387993B (en) Rotatable lens device and tracking method based on eyeball tracking technology
CN201904848U (en) Tracking and shooting device based on multiple cameras
CN106982314A (en) One kind shoots adjusting means and its adjusting method
CN202735673U (en) Single-lens naked-eye 3D image photographing device
CN209893018U (en) Intelligent follow-up adjustment display support
CN102960987A (en) Self-portrait mirror based on semi-transparency, semi-reflection and human eye recognition
CN205142372U (en) Automatic shooting device of cell -phone
WO2018053919A1 (en) Smart user companion terminal device and usage method thereof
CN106671101A (en) Intelligent shooting robot
CN212660243U (en) A full scene recorder
CN206216742U (en) A kind of nine-degree of freedom binocular bionic eye
CN109756663A (en) A kind of control method of AR equipment, device and AR equipment
CN114244989B (en) Control method of intelligent watch with lifting rotary camera
CN205901975U (en) Head-mounted human eye deflection control shooting display and shooting equipment system
CN114584742A (en) Video monitoring device
CN108594861B (en) Camera placing and moving device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant