CN118209961A - Light emission module, depth camera and electronic equipment - Google Patents
Light emission module, depth camera and electronic equipment Download PDFInfo
- Publication number
- CN118209961A CN118209961A CN202211626836.3A CN202211626836A CN118209961A CN 118209961 A CN118209961 A CN 118209961A CN 202211626836 A CN202211626836 A CN 202211626836A CN 118209961 A CN118209961 A CN 118209961A
- Authority
- CN
- China
- Prior art keywords
- light
- light source
- pattern
- laser
- component
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Measurement Of Optical Distance (AREA)
Abstract
本申请公开了一种光发射模组、深度相机及电子设备。沿光发射模组的出光光路,光发射模组依次包括光投射组件、光调制组件及光反射组件。光投射组件用于沿第一方向投射激光。光调制组件用于调制光投射组件投射的激光。光反射组件用于改变经过光调制组件调制后的激光的传输路径,使沿第一方向传输改变成沿第二方向传输。第二方向与第一方向不同,经过光反射组件投射出的激光为结构光图案或泛光图案。本申请可采用同一个光发射模组就能兼顾近距离测距和远距离测距两种需求。而且,光反射组件可改变经过光调制组件调制后的激光的传输路径,使沿第一方向传输改变成沿第二方向传输,由此可使光发射模组作为潜望式模组,节省了深度相机和电子设备的厚度。
The present application discloses a light emitting module, a depth camera and an electronic device. Along the light output path of the light emitting module, the light emitting module includes a light projection component, a light modulation component and a light reflection component in sequence. The light projection component is used to project a laser along a first direction. The light modulation component is used to modulate the laser projected by the light projection component. The light reflection component is used to change the transmission path of the laser modulated by the light modulation component, so that the transmission along the first direction is changed to the transmission along the second direction. The second direction is different from the first direction, and the laser projected by the light reflection component is a structured light pattern or a floodlight pattern. The present application can use the same light emitting module to take into account both short-range ranging and long-range ranging requirements. Moreover, the light reflection component can change the transmission path of the laser modulated by the light modulation component, so that the transmission along the first direction is changed to the transmission along the second direction, thereby enabling the light emitting module to be used as a periscope module, saving the thickness of the depth camera and the electronic device.
Description
技术领域Technical Field
本申请涉及测距技术领域,特别涉及一种光发射模组、深度相机及电子设备。The present application relates to the field of distance measurement technology, and in particular to a light emission module, a depth camera and an electronic device.
背景技术Background technique
近年来三维深度感知设备开始进入人们的眼球,高精度的深度传感器作为一种新型的获取外界信息的媒介,有利于推动机器视觉的发展,实现机器人理解外部世界,同时也推动了人机交互的发展。深度感知技术大致可分为被动式和主动式。传统的双目立体视觉测距是一种被动式测距方法,其受环境光影响大、立体匹配过程复杂。主动式测距方法主要有结构光编码测距和飞行时间技术(Time of flight,ToF)测距两种方法。结构光编码测距法本质上属于激光三角测距,随着距离的增加,测距精度会急剧下降。ToF测距是一种通过测量发射信号和被物体反射回的信号之间的时间差,通过这个时间差,计算出物体和传感器之间距离的测距技术。虽然目前ToF测距技术获取的深度图像分辨率比较低,但相较于结构光编码测距技术,TOF测距技术响应时间更短、抗干扰性更强、刷新率更高、深度信息计算量更小、算法要求更低等,因此TOF测距技术有着更为广阔的应用市场。In recent years, three-dimensional depth sensing devices have begun to enter people's eyes. As a new medium for obtaining external information, high-precision depth sensors are conducive to promoting the development of machine vision, enabling robots to understand the external world, and also promoting the development of human-computer interaction. Depth perception technology can be roughly divided into passive and active. Traditional binocular stereo vision ranging is a passive ranging method, which is greatly affected by ambient light and has a complex stereo matching process. Active ranging methods mainly include structured light coding ranging and time of flight (ToF) ranging. Structured light coding ranging is essentially laser triangulation ranging. As the distance increases, the ranging accuracy will drop sharply. ToF ranging is a ranging technology that measures the time difference between the transmitted signal and the signal reflected by the object, and calculates the distance between the object and the sensor through this time difference. Although the depth image resolution obtained by ToF ranging technology is relatively low, compared with structured light coding ranging technology, TOF ranging technology has a shorter response time, stronger anti-interference, higher refresh rate, smaller depth information calculation, and lower algorithm requirements. Therefore, TOF ranging technology has a broader application market.
目前,TOF光发射模组一般采用泛光形式或散斑形式投射到物体上,散斑或泛光被物体反射后被TOF光接收模组接收。其中,泛光照射方式在近距离范围内可使得TOF测距计算得到细节丰富的深度点云信息,但随着照射距离的变远,照射光的能量急剧下降,易受环境光的影响,导致无法探测远距离物体的深度信息。而激光散斑照射方式的能量密度更高,可以投射到更远的距离,使得TOF测距计算得到远距离物体的点云信息,但由于散斑点数量有限,对应得到的点云比较稀疏,缺少目标物体的点云细节。At present, the TOF light transmitting module generally projects onto the object in the form of floodlight or speckle. The speckle or floodlight is reflected by the object and then received by the TOF light receiving module. Among them, the floodlight illumination method can enable the TOF ranging calculation to obtain detailed depth point cloud information within a short range, but as the illumination distance becomes farther, the energy of the illumination light drops sharply and is easily affected by ambient light, resulting in the inability to detect the depth information of distant objects. The laser speckle illumination method has a higher energy density and can be projected to a farther distance, allowing the TOF ranging calculation to obtain the point cloud information of distant objects, but due to the limited number of scattered spots, the corresponding point cloud is relatively sparse and lacks the point cloud details of the target object.
发明内容Summary of the invention
本申请实施方式提供了一种光发射模组、深度相机及电子设备。Embodiments of the present application provide a light emission module, a depth camera, and an electronic device.
沿所述光发射模组的出光光路,所述光发射模组依次包括光投射组件、光调制组件及光反射组件。所述光投射组件用于沿第一方向投射激光。所述光调制组件用于调制所述光投射组件投射的所述激光。所述光反射组件用于改变经过所述光调制组件调制后的所述激光的传输路径,使沿所述第一方向传输改变成沿第二方向传输。所述第二方向与所述第一方向不同,经过所述光反射组件投射出的激光为结构光图案或泛光图案。Along the light output path of the light emitting module, the light emitting module includes a light projection component, a light modulation component and a light reflection component in sequence. The light projection component is used to project laser light in a first direction. The light modulation component is used to modulate the laser light projected by the light projection component. The light reflection component is used to change the transmission path of the laser light modulated by the light modulation component, so that the transmission along the first direction is changed to the transmission along the second direction. The second direction is different from the first direction, and the laser light projected by the light reflection component is a structured light pattern or a flood light pattern.
本申请实施方式的深度相机包括光发射模组及光接收模组,所述光接收模组用于接收被物体反射回的所述结构光图案或所述泛光图案。沿所述光发射模组的出光光路,所述光发射模组依次包括光投射组件、光调制组件及光反射组件。所述光投射组件用于沿第一方向投射激光。所述光调制组件用于调制所述光投射组件投射的所述激光。所述光反射组件用于改变经过所述光调制组件调制后的所述激光的传输路径,使沿所述第一方向传输改变成沿所述第二方向传输。所述第二方向与所述第一方向不同,经过所述光反射组件投射出的激光为结构光图案或泛光图案。The depth camera of the embodiment of the present application includes a light emitting module and a light receiving module, and the light receiving module is used to receive the structured light pattern or the floodlight pattern reflected back by the object. Along the light output path of the light emitting module, the light emitting module includes a light projection component, a light modulation component and a light reflection component in sequence. The light projection component is used to project laser along a first direction. The light modulation component is used to modulate the laser projected by the light projection component. The light reflection component is used to change the transmission path of the laser modulated by the light modulation component, so that the transmission along the first direction is changed to the transmission along the second direction. The second direction is different from the first direction, and the laser projected through the light reflection component is a structured light pattern or a floodlight pattern.
本申请实施方式的电子设备包括本体及深度相机,所述深度相机与所述本体结合。所述深度相机包括光发射模组及光接收模组。所述光接收模组用于接收被物体反射回的所述结构光图案或所述泛光图案。沿所述光发射模组的出光光路,所述光发射模组依次包括光投射组件、光调制组件及光反射组件。所述光投射组件用于沿第一方向投射激光。所述光调制组件用于调制所述光投射组件投射的所述激光。所述光反射组件用于改变经过所述光调制组件调制后的所述激光的传输路径,使沿所述第一方向传输改变成沿所述第二方向传输。所述第二方向与所述第一方向不同,经过所述光反射组件投射出的激光为结构光图案或泛光图案。The electronic device of the embodiment of the present application includes a main body and a depth camera, and the depth camera is combined with the main body. The depth camera includes a light emitting module and a light receiving module. The light receiving module is used to receive the structured light pattern or the floodlight pattern reflected back by an object. Along the light output path of the light emitting module, the light emitting module includes a light projection component, a light modulation component and a light reflection component in sequence. The light projection component is used to project a laser along a first direction. The light modulation component is used to modulate the laser projected by the light projection component. The light reflection component is used to change the transmission path of the laser modulated by the light modulation component, so that the transmission along the first direction is changed to the transmission along the second direction. The second direction is different from the first direction, and the laser projected through the light reflection component is a structured light pattern or a floodlight pattern.
本申请实施方式的电子设备包括本体及光发射模组,所述光发射模组与所述本体结合。沿所述光发射模组的出光光路,所述光发射模组依次包括光投射组件、光调制组件及光反射组件。所述光投射组件用于沿第一方向投射激光。所述光调制组件用于调制所述光投射组件投射的所述激光。所述光反射组件用于改变经过所述光调制组件调制后的所述激光的传输路径,使沿所述第一方向传输改变成沿所述第二方向传输。所述第二方向与所述第一方向不同,经过所述光反射组件投射出的激光为结构光图案或泛光图案。The electronic device of the embodiment of the present application includes a body and a light emitting module, and the light emitting module is combined with the body. Along the light output light path of the light emitting module, the light emitting module includes a light projection component, a light modulation component and a light reflection component in sequence. The light projection component is used to project a laser along a first direction. The light modulation component is used to modulate the laser projected by the light projection component. The light reflection component is used to change the transmission path of the laser modulated by the light modulation component, so that the transmission along the first direction is changed to the transmission along the second direction. The second direction is different from the first direction, and the laser projected through the light reflection component is a structured light pattern or a floodlight pattern.
本申请实施方式的光发射模组、深度相机及电子设备,经过光反射组件投射出的激光为结构光图案或泛光图案,可以在近距离范围内,采用泛光照射方式可得到细节丰富的深度点云信息,进而得到更准确的距离,而在远距离范围内,采用结构光照射方式可进行远距离测距。即,采用同一个光发射模组就能兼顾近距离测距和远距离测距两种需求。另外,由于光反射组件可改变经过光调制组件调制后的激光的传输路径,使沿第一方向传输改变成沿第二方向传输,由此可以使光发射模组作为潜望式模组,能够节省深度相机和电子设备的厚度,满足了时下人们对产品轻薄化的追求。The light emitting module, depth camera and electronic device of the embodiment of the present application, the laser projected by the light reflecting component is a structured light pattern or a floodlight pattern, and in the close range, the floodlight illumination method can be used to obtain the depth point cloud information with rich details, and thus obtain a more accurate distance, and in the long range, the structured light illumination method can be used for long-distance ranging. That is, the same light emitting module can take into account both the needs of close-range ranging and long-distance ranging. In addition, because the light reflecting component can change the transmission path of the laser modulated by the light modulating component, so that the transmission along the first direction is changed to the transmission along the second direction, the light emitting module can be used as a periscope module, which can save the thickness of the depth camera and the electronic device, and meet people's pursuit of thin and light products nowadays.
本申请实施方式的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本申请实施方式的实践了解到。Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the embodiments of the present application.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
本申请的上述和/或附加的方面和优点从结合下面附图对实施方式的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:
图1是本申请一些实施方式的光发射模组的结构示意图;FIG1 is a schematic diagram of the structure of an optical emission module in some embodiments of the present application;
图2是图1所示的光发射模组中第一光源和第二光源的结构示意图;FIG2 is a schematic structural diagram of a first light source and a second light source in the light emitting module shown in FIG1 ;
图3是本申请另一些实施方式的光发射模组的结构示意图;FIG3 is a schematic diagram of the structure of the light emission module of other embodiments of the present application;
图4是图3所示的光发射模组中第一光源和第二光源的结构示意图;FIG4 is a schematic structural diagram of a first light source and a second light source in the light emitting module shown in FIG3 ;
图5是本申请某些实施方式的光发射模组发射激光的原理示意图;FIG5 is a schematic diagram showing the principle of emitting laser by a light emitting module in certain embodiments of the present application;
图6是本申请还一些实施方式的光发射模组的结构示意图;FIG6 is a schematic diagram of the structure of a light emitting module according to some other embodiments of the present application;
图7是本申请又一些实施方式的光发射模组的结构示意图;FIG7 is a schematic diagram of the structure of the light emission module of some other embodiments of the present application;
图8是本申请再一些实施方式的光发射模组的结构示意图;FIG8 is a schematic diagram of the structure of a light emitting module in some other embodiments of the present application;
图9是本申请某些实施方式的深度相机的结构示意图;FIG9 is a schematic diagram of the structure of a depth camera according to some embodiments of the present application;
图10是本申请某些实施方式的电子设备的一个视角的结构示意图;FIG10 is a schematic structural diagram of an electronic device according to some embodiments of the present application from one viewing angle;
图11是本申请某些实施方式的电子设备的另一个视角的结构示意图。FIG. 11 is a schematic structural diagram of an electronic device according to certain embodiments of the present application from another perspective.
主要元件符号说明:Description of main component symbols:
电子设备1000;Electronic equipment 1000;
深度相机100、光发射模组10、光接收模组30、处理器50、本体200;Depth camera 100, light transmitting module 10, light receiving module 30, processor 50, body 200;
光投射组件11、第一光源111、第二光源113、光源115、驱动器117、第一衬底1111、第一发光元件1113、第二衬底1131、第二发光元件1133、光调制组件13、准直元件131、衍射光学元件133、驱动元件135、光反射组件15。The light projection component 11, the first light source 111, the second light source 113, the light source 115, the driver 117, the first substrate 1111, the first light-emitting element 1113, the second substrate 1131, the second light-emitting element 1133, the light modulation component 13, the collimating element 131, the diffractive optical element 133, the driving element 135, and the light reflection component 15.
具体实施方式Detailed ways
以下结合附图对本申请的实施方式作进一步说明。附图中相同或类似的标号自始至终表示相同或类似的元件或具有相同或类似功能的元件。另外,下面结合附图描述的本申请的实施方式是示例性的,仅用于解释本申请的实施方式,而不能理解为对本申请的限制。The embodiments of the present application are further described below in conjunction with the accompanying drawings. The same or similar reference numerals in the accompanying drawings represent the same or similar elements or elements with the same or similar functions from beginning to end. In addition, the embodiments of the present application described below in conjunction with the accompanying drawings are exemplary and are only used to explain the embodiments of the present application, and cannot be understood as limiting the present application.
TOF光发射模组一般采用泛光形式或散斑形式投射到物体上,散斑或泛光被物体反射后被TOF光接收模组接收。其中,泛光照射方式在近距离范围内可使得TOF测距计算得到细节丰富的深度点云信息,但随着照射距离的变远,照射光的能量急剧下降,易受环境光的影响,导致无法探测远距离物体的深度信息。而激光散斑照射方式的能量密度更高,可以投射到更远的距离,使得TOF测距计算得到远距离物体的点云信息,但由于散斑点数量有限,对应得到的点云比较稀疏,缺少目标物体的点云细节。为了解决此问题,本申请实施方式提供了一种光发射模组10(图1、图3及图6至图8所示)、深度相机100(图9所示)及电子设备1000(图10和图11所示)。The TOF light emitting module is generally projected onto an object in the form of floodlight or speckle, and the speckle or floodlight is reflected by the object and received by the TOF light receiving module. Among them, the floodlight irradiation method can enable the TOF ranging calculation to obtain detailed depth point cloud information within a short range, but as the irradiation distance becomes farther, the energy of the irradiated light drops sharply, and it is easily affected by ambient light, resulting in the inability to detect the depth information of distant objects. The laser speckle irradiation method has a higher energy density and can be projected to a farther distance, so that the TOF ranging calculation obtains the point cloud information of distant objects, but due to the limited number of scattered spots, the corresponding point cloud is relatively sparse, lacking the point cloud details of the target object. In order to solve this problem, the embodiment of the present application provides a light emitting module 10 (shown in Figures 1, 3 and Figures 6 to 8), a depth camera 100 (shown in Figure 9) and an electronic device 1000 (shown in Figures 10 and 11).
请参阅图1、图3及图6至图8,沿光发射模组10的出光光路,光发射模组10依次包括光投射组件11、光调制组件13及光反射组件15。光投射组件11用于沿第一方向X投射激光。光调制组件13用于调制光投射组件11投射的激光。光反射组件15用于改变经过光调制组件13调制后的激光的传输路径,使沿第一方向X传输改变成沿第二方向Z传输,第二方向Z与第一方向X不同,经过光反射组件15投射出的激光为结构光图案或泛光图案。Please refer to Figures 1, 3, and 6 to 8. Along the light path of the light emitting module 10, the light emitting module 10 includes a light projection component 11, a light modulation component 13, and a light reflection component 15 in sequence. The light projection component 11 is used to project laser light along a first direction X. The light modulation component 13 is used to modulate the laser light projected by the light projection component 11. The light reflection component 15 is used to change the transmission path of the laser light modulated by the light modulation component 13, so that the transmission along the first direction X is changed to the transmission along the second direction Z, and the second direction Z is different from the first direction X. The laser light projected by the light reflection component 15 is a structured light pattern or a flood light pattern.
光发射模组10是一种用于发射激光的部件,出光光路为光发射模组10发出的激光从起点向远处发射时经过的路线,且激光依次经过光投射组件11、光调制组件13及光反射组件15,即,激光先经过光投射组件11,再经过光调制组件13,然后再经过光反射组件15之后出射至光发射模组10的外部。The light emitting module 10 is a component for emitting laser. The light output path is the route that the laser emitted by the light emitting module 10 passes through when it is emitted from a starting point to a distance, and the laser passes through the light projection component 11, the light modulation component 13 and the light reflection component 15 in sequence, that is, the laser first passes through the light projection component 11, then passes through the light modulation component 13, and then passes through the light reflection component 15 before being emitted to the outside of the light emitting module 10.
需要说明的是,激光光束可以是彼此之间完全平行,也可以是彼此之间并不完全平行,换句话说,激光光束也可以具有一定的发散角度,而本申请中的“第一方向X”或“第二方向Z”均是指激光光束的中心主光束的传输方向。具体地,“第一方向X”是从光发射组件至光反射组件15之间的激光光束的中心光束的方向,“第二方向Z”是光反射组件15之后的激光光束的中心光束的传输方向。第一方向X和第二方向Z不同具体可为第一方向X和第二方向Z相交。更具体地,第一方向X和第二方向Z之间的夹角可为锐角、直角或钝角。本申请实施方式中,第一方向X和第二方向Z之间的夹角为直角。It should be noted that the laser beams may be completely parallel to each other, or may not be completely parallel to each other. In other words, the laser beam may also have a certain divergence angle, and the "first direction X" or "second direction Z" in this application refers to the transmission direction of the central main beam of the laser beam. Specifically, the "first direction X" is the direction of the central beam of the laser beam from the light emitting component to the light reflecting component 15, and the "second direction Z" is the transmission direction of the central beam of the laser beam after the light reflecting component 15. The first direction X and the second direction Z are different, and specifically, the first direction X and the second direction Z intersect. More specifically, the angle between the first direction X and the second direction Z may be an acute angle, a right angle, or an obtuse angle. In the embodiment of the present application, the angle between the first direction X and the second direction Z is a right angle.
本申请实施方式的光发射模组10,经过光反射组件15投射出的激光为结构光图案或泛光图案,可以在近距离范围内,采用泛光照射方式可得到细节丰富的深度点云信息,进而得到更准确的距离,而在远距离范围内,采用结构光照射方式可进行远距离测距。即,采用同一个光发射模组10就能兼顾近距离测距和远距离测距两种需求,节省了设备成本和空间。另外,由于光反射组件15可改变经过光调制组件13调制后的激光的传输路径,使沿第一方向X传输改变成沿第二方向Z传输,由此可以使光发射模组10作为潜望式模组,能够节省深度相机100和电子设备1000的厚度,满足了时下人们对产品轻薄化的追求。The light emitting module 10 of the embodiment of the present application projects a laser in a structured light pattern or a floodlight pattern through the light reflecting component 15. In a close range, the floodlight illumination method can be used to obtain detailed depth point cloud information, thereby obtaining a more accurate distance, and in a long range, the structured light illumination method can be used for long-distance ranging. That is, the same light emitting module 10 can take into account both the needs of close-range ranging and long-range ranging, saving equipment costs and space. In addition, since the light reflecting component 15 can change the transmission path of the laser modulated by the light modulating component 13, so that the transmission along the first direction X is changed to the transmission along the second direction Z, the light emitting module 10 can be used as a periscope module, which can save the thickness of the depth camera 100 and the electronic device 1000, meeting people's pursuit of thin and light products nowadays.
下面结合附图对光发射模组10做进一步地说明。The light emitting module 10 is further described below with reference to the accompanying drawings.
具体地,请参阅图1、图3及图6至图8,光调制组件13包括准直元件131及衍射光学元件133。Specifically, referring to FIG. 1 , FIG. 3 and FIG. 6 to FIG. 8 , the light modulation component 13 includes a collimating element 131 and a diffractive optical element 133 .
请参阅图1、图3及图6,在某些实施方式中,光投射组件11可包括第一光源111和第二光源113。第一光源111位于准直元件131的焦平面上,即,第一光源111的发光面位于准直元件131的焦平面上。第一光源111投射出的激光依次经过准直元件131准直、经衍射光学元件133复制、及经过光反射组件15改变传输方向后形成结构光图案。第二光源113位于准直元件131的离焦面上,即,第二光源113的发光面位于准直元件131的虚焦位置。第二光源113投射出的激光依次经过准直元件131准直、经衍射光学元件133复制、及经过光反射组件15改变传输方向后形成泛光图案。因此,在第一光源111被点亮的情况下,光发射模组10处于结构光投射模式;在第一光源111被点亮的情况下,光发射模组10处于泛光投射模式。Referring to FIG. 1 , FIG. 3 and FIG. 6 , in some embodiments, the light projection component 11 may include a first light source 111 and a second light source 113. The first light source 111 is located on the focal plane of the collimating element 131, that is, the light emitting surface of the first light source 111 is located on the focal plane of the collimating element 131. The laser light projected by the first light source 111 is collimated by the collimating element 131, replicated by the diffractive optical element 133, and changed in transmission direction by the light reflecting component 15 to form a structured light pattern. The second light source 113 is located on the defocusing plane of the collimating element 131, that is, the light emitting surface of the second light source 113 is located at the virtual focus position of the collimating element 131. The laser light projected by the second light source 113 is collimated by the collimating element 131, replicated by the diffractive optical element 133, and changed in transmission direction by the light reflecting component 15 to form a flood light pattern. Therefore, when the first light source 111 is lit, the light emitting module 10 is in a structured light projection mode; when the first light source 111 is lit, the light emitting module 10 is in a flood light projection mode.
更具体地,请参阅图2,左图为第一光源111的结构示意图,右图为第二光源113的结构示意图。第一光源111可以是垂直腔面发射激光器(Vertical-Cavity Surface-Emitting Laser,VCSEL)、水平腔面发射激光器(Horizontal-Cavity Surface-EmittingLaser,HCSEL)、或波长为红外波段,具体可以根据系统需要来选择不同发射波长,一般为850nm、940nm等。第一光源111包括第一衬底1111及设置于第一衬底1111并随机分布的多个第一发光元件1113。第二光源113以是发光二极体(LightEmittingDiode,LED)、VCSEL或HCSEL。第二光源113包括第二衬底1131及设置于第二衬底1131上的多个第二发光元件1133,多个第二发光元件1133可以阵列分布在第二衬底1131上,也可以随机分布在第二衬底1131上,第二发光元件1133发出的激光的波长与第一发光元件1113发出的激光的波长一致。More specifically, please refer to FIG. 2 , the left figure is a schematic diagram of the structure of the first light source 111, and the right figure is a schematic diagram of the structure of the second light source 113. The first light source 111 can be a vertical cavity surface emitting laser (Vertical-Cavity Surface-Emitting Laser, VCSEL), a horizontal cavity surface emitting laser (Horizontal-Cavity Surface-Emitting Laser, HCSEL), or a wavelength in the infrared band. Specifically, different emission wavelengths can be selected according to system requirements, generally 850nm, 940nm, etc. The first light source 111 includes a first substrate 1111 and a plurality of first light-emitting elements 1113 disposed on the first substrate 1111 and randomly distributed. The second light source 113 can be a light-emitting diode (Light Emitting Diode, LED), VCSEL or HCSEL. The second light source 113 includes a second substrate 1131 and a plurality of second light-emitting elements 1133 disposed on the second substrate 1131. The plurality of second light-emitting elements 1133 may be distributed in an array on the second substrate 1131 or may be randomly distributed on the second substrate 1131. The wavelength of the laser emitted by the second light-emitting element 1133 is consistent with the wavelength of the laser emitted by the first light-emitting element 1113.
请继续参阅图2,在一些实施方式中,第一光源111与第二光源113不同。Please continue to refer to FIG. 2 . In some embodiments, the first light source 111 is different from the second light source 113 .
在一个例子中,第一发光元件1113的数量少于第二发光元件1133的数量。例如,左图所示的第一光源111中的第一发光元件1113的数量为132个,右图所示的第二光源113中的第二发光元件1133的数量为140个。由此,请结合图5,在第一光源111点亮时,第二光源113不工作,此时,132个第一发光元件1113发出的激光形成清晰的光斑点图,清晰的光斑点图在经过准直元件131准直后再经衍射光学元件133复制并扩散为更大视场的结构光光斑图,最后该结构光光斑图经过光反射组件15改变传输方向。在第二光源113点亮时,第一光源111不工作,此时,因第二光源113位于虚焦位置,则140个第二发光元件1133发出的激光为模糊扩散的光斑点图,光斑点相互重叠在一起,成为分布均匀的泛光,分布均匀的泛光在经过准直元件131准直后再经衍射光学元件133复制并扩散为更大视场的泛光光斑图,最后该泛光光斑图经过光反射组件15改变传输方向。由于第二发光元件1133的数量较多,则形成的泛光光斑更为均匀。In one example, the number of first light-emitting elements 1113 is less than the number of second light-emitting elements 1133. For example, the number of first light-emitting elements 1113 in the first light source 111 shown in the left figure is 132, and the number of second light-emitting elements 1133 in the second light source 113 shown in the right figure is 140. Therefore, please refer to Figure 5. When the first light source 111 is turned on, the second light source 113 is not working. At this time, the lasers emitted by the 132 first light-emitting elements 1113 form a clear light spot pattern. After being collimated by the collimating element 131, the clear light spot pattern is replicated and diffused into a structured light spot pattern with a larger field of view by the diffractive optical element 133. Finally, the structured light spot pattern changes the transmission direction through the light reflecting component 15. When the second light source 113 is on, the first light source 111 is not working. At this time, because the second light source 113 is in a virtual focus position, the laser light emitted by the 140 second light-emitting elements 1133 is a blurred and diffused light spot pattern, and the light spots overlap each other to form a uniformly distributed flood light. The uniformly distributed flood light is collimated by the collimating element 131, and then replicated and diffused by the diffractive optical element 133 to form a flood light spot pattern with a larger field of view. Finally, the flood light spot pattern changes its transmission direction through the light reflecting component 15. Since the number of the second light-emitting elements 1133 is large, the flood light spot formed is more uniform.
在另一个例子中,第一发光元件1113的孔径小于第二发光元件1133的孔径。需要说明的是,第一发光元件1113和第二发光元件1133大致呈圆形。由于第一发光元件1113的孔径较小,则可形成结构光散斑。而由于第二发光元件1133的孔径较大,则形成更为均匀的泛光光斑。In another example, the aperture of the first light emitting element 1113 is smaller than the aperture of the second light emitting element 1133. It should be noted that the first light emitting element 1113 and the second light emitting element 1133 are substantially circular. Since the aperture of the first light emitting element 1113 is smaller, a structured light spot can be formed. Since the aperture of the second light emitting element 1133 is larger, a more uniform flood light spot is formed.
在还一个例子中,相邻第一发光元件1113之间的间距大于相邻第二发光元件1133之间的间距。相邻第一发光元件1113之间的间距是指相邻第一发光元件1113的同一位置点之间距离,例如一个第一发光元件1113的中心到相邻的另一个第一发光元件1113的中心之间的距离,如图2所示的D1,或一个第一发光元件1113的最右边点到相邻的另一个第一发光元件1113的最右边点之间的距离。同样地,相邻第二发光元件1133之间的间距是指相邻第二发光元件1133的同一位置点之间距离,例如一个第二发光元件1133的中心到相邻的另一个第二发光元件1133的中心之间的距离,如图2所示的D2,或一个第二发光元件1133的最右边点到相邻的另一个第二发光元件1133的最右边点之间的距离。其中,D1>D2,由此第一发光元件1113发出的激光可形成结构光散斑,而第二发光元件1133发出的激光则可形成均匀的泛光光斑。In another example, the spacing between adjacent first light-emitting elements 1113 is greater than the spacing between adjacent second light-emitting elements 1133. The spacing between adjacent first light-emitting elements 1113 refers to the distance between the same position points of adjacent first light-emitting elements 1113, such as the distance between the center of one first light-emitting element 1113 to the center of another adjacent first light-emitting element 1113, as shown in D1 in FIG. 2, or the distance between the rightmost point of one first light-emitting element 1113 to the rightmost point of another adjacent first light-emitting element 1113. Similarly, the spacing between adjacent second light-emitting elements 1133 refers to the distance between the same position points of adjacent second light-emitting elements 1133, such as the distance between the center of one second light-emitting element 1133 to the center of another adjacent second light-emitting element 1133, as shown in D2 in FIG. 2, or the distance between the rightmost point of one second light-emitting element 1133 to the rightmost point of another adjacent second light-emitting element 1133. Wherein, D1>D2, thereby the laser emitted by the first light-emitting element 1113 can form a structured light spot, and the laser emitted by the second light-emitting element 1133 can form a uniform flood light spot.
在另一些实施方式中,请参阅图4,第一光源111与第二光源113相同。即,第一光源111的第一衬底1111与第二光源113的第二衬底1131完全相同,第一光源111的第一发光元件1113与第二光源113的第二发光元件1133也完全相同,包括数量、分布、孔径等均完全相同。换句话说,第一光源111与第二光源113的规格是完全相同的。此时,请结合图1及图3,相较于第一光源111,第二光源113更远离准直元件131。更具体地,在第一光源111与第二光源113相同的情况下,第二光源113与准直元件131的距离(图3所示),比在第一光源111与第二光源113不同的情况下,第二光源113与准直元件131的距离更远(图1所示),即L2>L1。如此,图3所示的光发射模组10采用规格相同的第一光源111和第二光源113,仅通过设计两个光源与准直元件131之间的距离来实现投射结构光和泛光,节省了选型成本。In other embodiments, please refer to FIG. 4 , the first light source 111 is identical to the second light source 113. That is, the first substrate 1111 of the first light source 111 is identical to the second substrate 1131 of the second light source 113, and the first light-emitting element 1113 of the first light source 111 is identical to the second light-emitting element 1133 of the second light source 113, including the number, distribution, aperture, etc. are all identical. In other words, the specifications of the first light source 111 and the second light source 113 are identical. At this time, please refer to FIG. 1 and FIG. 3 , compared with the first light source 111, the second light source 113 is farther away from the collimating element 131. More specifically, when the first light source 111 and the second light source 113 are identical, the distance between the second light source 113 and the collimating element 131 (as shown in FIG. 3 ) is farther than when the first light source 111 and the second light source 113 are different, the distance between the second light source 113 and the collimating element 131 (as shown in FIG. 1 ), that is, L2>L1. Thus, the light emitting module 10 shown in FIG. 3 uses the first light source 111 and the second light source 113 of the same specification, and only designs the distance between the two light sources and the collimating element 131 to realize the projection of structured light and floodlight, thereby saving the selection cost.
在一个实施方式中,请参阅图1及图3,第一光源111投射出的激光依次经过准直元件131准直、经衍射光学元件133复制、及经过光反射组件15改变传输方向后形成散斑形式的结构光图案。In one embodiment, referring to FIG. 1 and FIG. 3 , the laser light projected by the first light source 111 is collimated by the collimating element 131 , replicated by the diffractive optical element 133 , and changed in transmission direction by the light reflecting component 15 to form a structured light pattern in the form of speckles.
在另一个实施方式中,请参阅图6,第一光源111投射出的激光依次经过准直元件131准直、经衍射光学元件133复制、及经过光反射组件15改变传输方向后形成线阵形式的结构光图案。In another embodiment, referring to FIG. 6 , the laser light projected by the first light source 111 is collimated by the collimating element 131 , replicated by the diffractive optical element 133 , and changed in transmission direction by the light reflecting component 15 to form a linear array structured light pattern.
需要说明的是,无论是形成散斑形式的结构光图案,还是形成线阵形式的结构光图案,第一光源111和第二光源113都可以如前所述采用相同规格的光源,也可以采用不同规格的光源。It should be noted that, no matter whether a structured light pattern in the form of speckle or a structured light pattern in the form of a linear array is formed, the first light source 111 and the second light source 113 may be light sources of the same specifications as described above, or may be light sources of different specifications.
请参阅图7,在某些实施方式中,光投射组件11包括光源115及驱动器117。光源115用于投射激光,准直元件131用于准直从光源115投射出的激光,衍射光学元件133复制从准直元件131出射的激光。驱动器117与光源115连接,驱动器117用于驱动光源115在准直元件131的光轴上移动,以选择性地使光源115位于准直元件131的焦平面上或离焦面上,以分别形成结构光图案或泛光图案。Referring to Fig. 7, in some embodiments, the light projection assembly 11 includes a light source 115 and a driver 117. The light source 115 is used to project laser light, the collimating element 131 is used to collimate the laser light projected from the light source 115, and the diffractive optical element 133 replicates the laser light emitted from the collimating element 131. The driver 117 is connected to the light source 115, and the driver 117 is used to drive the light source 115 to move on the optical axis of the collimating element 131, so as to selectively make the light source 115 located on the focal plane or the defocused plane of the collimating element 131, so as to form a structured light pattern or a flood light pattern, respectively.
其中,驱动器117可以是伸缩型的直线电机、压电陶瓷型的驱动电机、或者是包括转动电机和传动结构,传动结构用于将驱动电机的驱动力传递至光源115。驱动器117用于驱动光源115在准直元件131的光轴上移动,以使光源115能在准直元件131的焦平面上和离焦面上切换。由此,在光源115位于准直元件131的焦平面上的情况下,从光发射模组10出射的激光为结构光图案,且依据光源115的选型不同,具体可以为散斑形式的结构光图案和线阵形式的结构光图案。在光源115位于准直元件131的离焦面上的情况下,从光投射组件11出射的激光为泛光图案。The driver 117 may be a telescopic linear motor, a piezoelectric ceramic drive motor, or a rotary motor and a transmission structure, and the transmission structure is used to transmit the driving force of the drive motor to the light source 115. The driver 117 is used to drive the light source 115 to move on the optical axis of the collimating element 131, so that the light source 115 can be switched between the focal plane and the defocusing plane of the collimating element 131. Thus, when the light source 115 is located on the focal plane of the collimating element 131, the laser emitted from the light emitting module 10 is a structured light pattern, and according to the selection of the light source 115, it can be a structured light pattern in the form of speckle and a structured light pattern in the form of a linear array. When the light source 115 is located on the defocusing plane of the collimating element 131, the laser emitted from the light projection assembly 11 is a flood light pattern.
另外,驱动器117的设置可以是沿着准直元件131的光轴设置,即分布在电子设备1000的X方向(宽度方向)上,也可以是分布在电子设备1000的Y方向(长度方向),由此可不占用Z方向的空间,更有利于节省电子设备1000的厚度空间。In addition, the driver 117 can be arranged along the optical axis of the collimating element 131, that is, distributed in the X direction (width direction) of the electronic device 1000, or distributed in the Y direction (length direction) of the electronic device 1000, thereby not occupying the space in the Z direction, which is more conducive to saving the thickness space of the electronic device 1000.
本申请实施方式的光发射模组10中,光投射组件11仅采用一个光源115,再利用驱动器117驱动光源115以改变光源115的位置,使得从光发射模组10出射的激光为结构光图案或泛光图案,节省了一个光源115。In the light emitting module 10 of the embodiment of the present application, the light projection component 11 only uses one light source 115, and then uses the driver 117 to drive the light source 115 to change the position of the light source 115, so that the laser emitted from the light emitting module 10 is a structured light pattern or a floodlight pattern, saving one light source 115.
请参阅图8,在某些实施方式中,光投射组件11包括光源115,光源115用于投射激光。光调制组件13包括准直元件131、衍射光学元件133及驱动元件135。准直元件131用于准直从光源115投射出的激光。衍射光学元件133用于复制从准直元件131出射的激光。驱动元件135与准直元件131连接,驱动元件135用于驱动准直元件131在准直元件131的光轴上移动,以选择性地使光源115位于准直元件131的焦平面上或离焦面上,以分别形成结构光图案或泛光图案。Referring to FIG. 8 , in some embodiments, the light projection component 11 includes a light source 115, and the light source 115 is used to project laser light. The light modulation component 13 includes a collimating element 131, a diffractive optical element 133, and a driving element 135. The collimating element 131 is used to collimate the laser light projected from the light source 115. The diffractive optical element 133 is used to replicate the laser light emitted from the collimating element 131. The driving element 135 is connected to the collimating element 131, and the driving element 135 is used to drive the collimating element 131 to move on the optical axis of the collimating element 131, so as to selectively make the light source 115 located on the focal plane or the defocused plane of the collimating element 131, so as to form a structured light pattern or a flood light pattern, respectively.
其中,准直元件131包括但不限于凸透镜、凹透镜、球面镜、非球面镜等。同时,准直元件131可包括一个或多个透镜,例如图8所示的准直元件131包括三个透镜。The collimating element 131 includes but is not limited to a convex lens, a concave lens, a spherical mirror, an aspherical mirror, etc. Meanwhile, the collimating element 131 may include one or more lenses. For example, the collimating element 131 shown in FIG. 8 includes three lenses.
驱动元件135可以是伸缩型的直线电机、压电陶瓷型的驱动电机、或者是包括转动电机和传动结构,传动结构用于将驱动电机的驱动力传递至准直元件131。驱动元件135用于驱动准直元件131在准直元件131的光轴上移动,以使光源115能在准直元件131的焦平面上和离焦面上切换。例如,图8所示的驱动元件135驱动三个透镜中的一个透镜从位置P1移动至位置P2。在该透镜处于位置P1时,光源115位于准直元件131的焦平面上,从光发射模组10出射的激光为结构光图案,且依据光源115的选型不同,具体可以为散斑形式的结构光图案和线阵形式的结构光图案;在该透镜处于位置P2时,光源115位于准直元件131的离焦面上,从光投射组件11出射的激光为泛光图案。The driving element 135 can be a telescopic linear motor, a piezoelectric ceramic driving motor, or a rotating motor and a transmission structure, and the transmission structure is used to transmit the driving force of the driving motor to the collimating element 131. The driving element 135 is used to drive the collimating element 131 to move on the optical axis of the collimating element 131, so that the light source 115 can switch between the focal plane and the defocusing plane of the collimating element 131. For example, the driving element 135 shown in FIG8 drives one of the three lenses to move from position P1 to position P2. When the lens is at position P1, the light source 115 is located on the focal plane of the collimating element 131, and the laser emitted from the light emitting module 10 is a structured light pattern, and according to the selection of the light source 115, it can be a structured light pattern in the form of speckle and a structured light pattern in the form of a linear array; when the lens is at position P2, the light source 115 is located on the defocusing plane of the collimating element 131, and the laser emitted from the light projection component 11 is a flood pattern.
另外,驱动元件135的设置可以是沿着准直元件131的光轴设置,即分布在电子设备1000的X方向(宽度方向)上,也可以是分布在电子设备1000的Y方向(长度方向),此时可不占用Z方向的空间,更有利于节省电子设备1000的厚度空间。In addition, the driving element 135 can be arranged along the optical axis of the collimating element 131, that is, distributed in the X direction (width direction) of the electronic device 1000, or distributed in the Y direction (length direction) of the electronic device 1000. In this case, it does not occupy the space in the Z direction, which is more conducive to saving the thickness space of the electronic device 1000.
本申请实施方式的光发射模组10中,光投射组件11也仅采用一个光源115,再利用驱动元件135驱动光源115以改变光源115的位置,使得从光发射模组10出射的激光为结构光图案或泛光图案,节省了一个光源115。In the light emitting module 10 of the embodiment of the present application, the light projection component 11 also only uses one light source 115, and then uses the driving element 135 to drive the light source 115 to change the position of the light source 115, so that the laser emitted from the light emitting module 10 is a structured light pattern or a floodlight pattern, saving one light source 115.
请参阅图9,本申请提供的深度相机100包括上述任一实施方式所述的光发射模组10及光接收模组30。光接收模组30用于接收被物体反射回的结构光图案或泛光图案。9 , the depth camera 100 provided in the present application includes the light emitting module 10 and the light receiving module 30 described in any of the above embodiments. The light receiving module 30 is used to receive the structured light pattern or flood light pattern reflected by the object.
光接收模组30为TOF摄像头,用于接收被物体反射回的结构光图案或泛光图案。The light receiving module 30 is a TOF camera, which is used to receive the structured light pattern or floodlight pattern reflected by the object.
进一步地,深度相机100还可包括处理器50,处理器50与光接收模组30和光发射模组10均连接。处理器50用于根据光接收模组30接收的结构光图案或泛光图案获取深度相机100与物体之间的距离。Furthermore, the depth camera 100 may further include a processor 50, which is connected to both the light receiving module 30 and the light emitting module 10. The processor 50 is used to obtain the distance between the depth camera 100 and the object according to the structured light pattern or flood light pattern received by the light receiving module 30.
更进一步地,在另一些例子中,处理器50用于控制光发射模组10和光接收模组30工作以获得初始距离,在初始距离大于预设距离的情况下,处理器50用于控制光发射模组10投射结构光图案,及控制光接收模组30接收结构光图案,以获取深度相机100与物体之间的最终距离;而在初始距离小于预设距离的情况下,处理器50用于控制光发射模组10投射泛光图案,及控制光接收模组30接收泛光图案,以获取深度相机100与物体之间的最终距离。由此,深度相机100可以既准确测量出远处物体的距离,也可以准确测量出近处物体的距离,适应性更强。本申请实施方式的深度相机100,经过光反射组件15投射出的激光为结构光图案或泛光图案,可以在近距离范围内,采用泛光照射方式可得到细节丰富的深度点云信息,进而得到更准确的距离,而在远距离范围内,采用结构光照射方式可进行远距离测距。即,采用同一个光发射模组10就能兼顾近距离测距和远距离测距两种需求,节省了设备成本和空间。另外,由于光反射组件15可改变经过光调制组件13调制后的激光的传输路径,使沿第一方向X传输改变成沿第二方向Z传输,由此可以使光发射模组10作为潜望式模组,能够节省深度相机100和电子设备1000的厚度,满足了时下人们对产品轻薄化的追求。Furthermore, in other examples, the processor 50 is used to control the light emitting module 10 and the light receiving module 30 to work to obtain the initial distance. When the initial distance is greater than the preset distance, the processor 50 is used to control the light emitting module 10 to project the structured light pattern and control the light receiving module 30 to receive the structured light pattern to obtain the final distance between the depth camera 100 and the object; and when the initial distance is less than the preset distance, the processor 50 is used to control the light emitting module 10 to project the floodlight pattern and control the light receiving module 30 to receive the floodlight pattern to obtain the final distance between the depth camera 100 and the object. As a result, the depth camera 100 can accurately measure the distance of distant objects as well as the distance of nearby objects, and has stronger adaptability. In the depth camera 100 of the embodiment of the present application, the laser projected by the light reflecting component 15 is a structured light pattern or a floodlight pattern. In the close range, the floodlight illumination method can be used to obtain the depth point cloud information with rich details, thereby obtaining a more accurate distance, and in the long range, the structured light illumination method can be used for long-distance ranging. That is, the same light emitting module 10 can meet both the requirements of short-range and long-range distance measurement, saving equipment cost and space. In addition, since the light reflecting component 15 can change the transmission path of the laser modulated by the light modulating component 13, so that the transmission along the first direction X is changed to the transmission along the second direction Z, the light emitting module 10 can be used as a periscope module, which can save the thickness of the depth camera 100 and the electronic device 1000, meeting people's pursuit of thin and light products.
更进一步地,在另一些例子中,无论是进行远距离物体的距离检测,还是近距离物体的距离检测,每次测距时,光发射模组10可先发射泛光图案,光接收模组30同步接收泛光图案被物体或空间反射回来的相移图像;根据相移法相位调制的不同,相应地采集多幅不同相位的相移图像,处理器50采集光接收模组30输出的多幅相移图像的RAW数据,计算得到图像中每个像素对应的相位差,滤除不可靠像素生成的深度信息,再根据相移法深度计算公式得到泛光深度图;接着,光发射模组10发射结构光图案(例如散斑图案),光接收模组30同步接收结构光图案被物体或空间反射回来的结构光相移图像;根据相移法相位调制的不同,相应地采集多幅不同相位的散斑相移图像;处理器50采集光接收模组30输出的多幅散斑相移图像的RAW数据,计算得到图像中散斑点所在像素对应的相位差,滤除不可靠像素生成的深度信息,再根据相移法深度计算公式得到散斑点所在像素的散斑深度图;最后对先后得到的泛光深度图和散斑深度图进行融合,最终得到融合后的深度图信息。本申请实施方式的深度相机100,每次测距都融合泛光深度图和散斑深度图,使得测出的距离更为准确。Furthermore, in other examples, whether it is distance detection of a distant object or a close object, each time the distance is measured, the light emitting module 10 may first emit a floodlight pattern, and the light receiving module 30 may synchronously receive a phase-shifted image of the floodlight pattern reflected by the object or space; according to the difference in phase modulation of the phase-shifting method, a plurality of phase-shifted images with different phases are collected accordingly, and the processor 50 collects RAW data of the plurality of phase-shifted images output by the light receiving module 30, calculates the phase difference corresponding to each pixel in the image, filters out the depth information generated by unreliable pixels, and then obtains the floodlight depth map according to the depth calculation formula of the phase-shifting method; then, the light emitting module 1 0 emits a structured light pattern (such as a speckle pattern), and the light receiving module 30 synchronously receives a structured light phase shift image of the structured light pattern reflected by an object or space; according to the different phase modulations of the phase shift method, a plurality of speckle phase shift images with different phases are collected accordingly; the processor 50 collects the RAW data of the plurality of speckle phase shift images output by the light receiving module 30, calculates the phase difference corresponding to the pixel where the speckle is located in the image, filters out the depth information generated by the unreliable pixel, and then obtains the speckle depth map of the pixel where the speckle is located according to the depth calculation formula of the phase shift method; finally, the flood depth map and the speckle depth map obtained successively are fused to finally obtain the fused depth map information. The depth camera 100 of the embodiment of the present application fuses the flood depth map and the speckle depth map each time the distance is measured, so that the measured distance is more accurate.
请参阅图10及图11,本申请一实施方式的电子设备1000括本体200及上述任一实施方式所述的深度相机100,深度相机100与本体200结合。10 and 11 , an electronic device 1000 according to an embodiment of the present application includes a body 200 and the depth camera 100 described in any of the above embodiments, and the depth camera 100 is combined with the body 200 .
请参阅图10及图11,本申请另一实施方式的电子设备1000括本体200及上述任一实施方式所述的光发射模组10,光发射模组10与本体200结合。Please refer to FIG. 10 and FIG. 11 . An electronic device 1000 according to another embodiment of the present application includes a body 200 and the light emitting module 10 described in any of the above embodiments. The light emitting module 10 is combined with the body 200 .
其中,电子设备1000包括但不限于为手机、平板电脑、相机、摄像机、个人数字助理、穿戴式设备、智能机器人、智能车辆等。其中,穿戴式设备包括智能手环、智能手表、智能眼镜等。The electronic device 1000 includes but is not limited to a mobile phone, a tablet computer, a camera, a video camera, a personal digital assistant, a wearable device, an intelligent robot, an intelligent vehicle, etc. The wearable device includes a smart bracelet, a smart watch, and smart glasses.
请结合图1,本申请实施方式的电子设备1000,经过光反射组件15投射出的激光为结构光图案或泛光图案,可以在近距离范围内,采用泛光照射方式可得到细节丰富的深度点云信息,进而得到更准确的距离,而在远距离范围内,采用结构光照射方式可进行远距离测距。即,采用同一个光发射模组10就能兼顾近距离测距和远距离测距两种需求,节省了设备成本和空间。另外,由于光反射组件15可改变经过光调制组件13调制后的激光的传输路径,使沿第一方向X传输改变成沿第二方向Z传输,由此可以使光发射模组10作为潜望式模组,能够节省深度相机100和电子设备1000的厚度,满足了时下人们对产品轻薄化的追求。Please refer to Figure 1. The electronic device 1000 of the embodiment of the present application, the laser projected by the light reflection component 15 is a structured light pattern or a floodlight pattern. In the close range, the floodlight illumination method can be used to obtain the depth point cloud information with rich details, and then obtain a more accurate distance. In the long range, the structured light illumination method can be used for long-distance ranging. That is, the same light emitting module 10 can take into account both the needs of close-range ranging and long-range ranging, saving equipment cost and space. In addition, because the light reflection component 15 can change the transmission path of the laser modulated by the light modulation component 13, so that the transmission along the first direction X is changed to the transmission along the second direction Z, the light emitting module 10 can be used as a periscope module, which can save the thickness of the depth camera 100 and the electronic device 1000, and meet people's pursuit of thin and light products.
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本申请的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本申请的实施例所属技术领域的技术人员所理解。Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.
在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读存储介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,计算机可读存储介质可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读存储介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置)、便携式计算机盘盒(磁装置)、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编辑只读存储器(EPROM或闪速存储器)、光纤装置、以及便携式光盘只读存储器(CDROM)。另外,计算机可读存储介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。The logic and/or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable storage medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, a computer-readable storage medium can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples (non-exhaustive list) of computer-readable storage media include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable storage medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.
应当理解,本申请的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.
本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。此外,在本申请各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。上述提到的存储介质可以是只读存储器,磁盘或光盘等。A person of ordinary skill in the art will appreciate that all or part of the steps carried by the method for implementing the above-mentioned embodiment can be completed by instructing the relevant hardware through a program, and the program can be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment. In addition, each functional unit in each embodiment of the present application can be integrated into a processing module, or each unit can exist physically alone, or two or more units can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. The above-mentioned storage medium can be a read-only memory, a disk or an optical disk, etc.
尽管上面已经示出和描述了本申请的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本申请的限制,本领域的普通技术人员在本申请的范围内可以对上述实施例进行变化、修改、替换和变型,本申请的范围由权利要求及其等同物限定。Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application. The scope of the present application is defined by the claims and their equivalents.
Claims (11)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211626836.3A CN118209961A (en) | 2022-12-16 | 2022-12-16 | Light emission module, depth camera and electronic equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211626836.3A CN118209961A (en) | 2022-12-16 | 2022-12-16 | Light emission module, depth camera and electronic equipment |
Publications (1)
Publication Number | Publication Date |
---|---|
CN118209961A true CN118209961A (en) | 2024-06-18 |
Family
ID=91449475
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211626836.3A Pending CN118209961A (en) | 2022-12-16 | 2022-12-16 | Light emission module, depth camera and electronic equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN118209961A (en) |
-
2022
- 2022-12-16 CN CN202211626836.3A patent/CN118209961A/en active Pending
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10739607B2 (en) | Light source module, sensing device and method for generating superposition structured patterns | |
US10001583B2 (en) | Structured light projection using a compound patterned mask | |
US20160127713A1 (en) | 3d depth sensor and projection system and methods of operating thereof | |
CN112505713B (en) | Distance measuring device and method, computer readable medium and electronic device | |
CN109756725A (en) | Structured light projector, 3D camera module and terminal equipment | |
CN108508621A (en) | Structured light projection module, image acquisition device and electronic equipment | |
US9170471B2 (en) | Optical system having integrated illumination and imaging optical systems, and 3D image acquisition apparatus including the optical system | |
CN108490637B (en) | Laser emitter, optoelectronic device, depth camera and electronic device | |
CN108107663A (en) | Laser emitter, optoelectronic device, depth camera and electronic device | |
CN110174075A (en) | A kind of list Zoom structure optical depth camera and Zooming method | |
CN108333858A (en) | Laser emitter, optoelectronic device, depth camera and electronic device | |
US11025871B1 (en) | Driving scanning projector display with pulses shorter than pixel duration | |
US20250067847A1 (en) | Method and system for detecting fiber position in a fiber scanning projector | |
TWI747289B (en) | Imaging device and imaging method | |
CN118209961A (en) | Light emission module, depth camera and electronic equipment | |
US11575875B2 (en) | Multi-image projector and electronic device having multi-image projector | |
JP6626552B1 (en) | Multi-image projector and electronic device having multi-image projector | |
CN112782910B (en) | Structured light projection device | |
CN213091888U (en) | Depth measurement system and electronic device | |
CN111541151A (en) | A light-emitting device, laser equipment and electronic equipment | |
KR102103919B1 (en) | Multi-image projector and electronic device having multi-image projector | |
CN207780462U (en) | Laser emitter, optoelectronic device and depth camera | |
CN222166032U (en) | Three-dimensional scanner of multi-scanning system | |
CN214954356U (en) | Speckle projector and electronic equipment | |
CN214122648U (en) | Three-dimensional imaging device and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination |