CN108303835B - Structured light projector and control method thereof, depth camera and electronic device - Google Patents
Structured light projector and control method thereof, depth camera and electronic device Download PDFInfo
- Publication number
- CN108303835B CN108303835B CN201810162450.9A CN201810162450A CN108303835B CN 108303835 B CN108303835 B CN 108303835B CN 201810162450 A CN201810162450 A CN 201810162450A CN 108303835 B CN108303835 B CN 108303835B
- Authority
- CN
- China
- Prior art keywords
- structured light
- optical element
- laser
- light projector
- diffractive optical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000003287 optical effect Effects 0.000 claims abstract description 95
- 230000006378 damage Effects 0.000 claims abstract description 10
- 230000002547 anomalous effect Effects 0.000 claims description 17
- 230000002159 abnormal effect Effects 0.000 claims description 15
- 230000001960 triggered effect Effects 0.000 claims description 11
- 229920006302 stretch film Polymers 0.000 claims description 6
- 239000002985 plastic film Substances 0.000 claims 1
- 229920006255 plastic film Polymers 0.000 claims 1
- 230000002829 reductive effect Effects 0.000 abstract description 13
- 230000001070 adhesive effect Effects 0.000 abstract description 9
- 239000000853 adhesive Substances 0.000 abstract description 7
- 230000001681 protective effect Effects 0.000 description 12
- 239000000758 substrate Substances 0.000 description 12
- 239000000463 material Substances 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 4
- 230000002093 peripheral effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000007480 spreading Effects 0.000 description 4
- 238000003892 spreading Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 239000003292 glue Substances 0.000 description 3
- 230000000670 limiting effect Effects 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 241001391944 Commicarpus scandens Species 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000002834 transmittance Methods 0.000 description 2
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 230000004308 accommodation Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 239000004568 cement Substances 0.000 description 1
- 238000005336 cracking Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
- G03B15/02—Illuminating scene
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/4233—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having a diffractive element [DOE] contributing to a non-imaging application
- G02B27/425—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having a diffractive element [DOE] contributing to a non-imaging application in illumination systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Projection Apparatus (AREA)
Abstract
The invention discloses a structured light projector. The structured light projector includes a laser emitter, a collimating element, a diffractive optical element, and a light transmissive stretched film. The laser emitter is used for emitting laser. The collimating element is used for collimating the laser light. The diffractive optical element is used for diffracting the laser light collimated by the collimating element to form a laser light pattern. An extended film is disposed on and bonded to the diffractive optical element, the extended film providing adhesion to the diffractive optical element when the diffractive optical element is broken. The invention also discloses a control method of the structured light projector, a depth camera and an electronic device. The structured light projector, the control method of the structured light projector, the depth camera and the electronic device in the embodiment of the invention combine the diffractive optical element with the transparent extension film, so that when the diffractive optical element is broken, the adhesive force provided by the extension film can prevent the diffractive optical element from splitting, further the diffractive optical element can still reduce the energy of laser, and the harm of the laser to human bodies is reduced.
Description
Technical Field
The present invention relates to the field of optical technologies, and in particular, to a structured light projector, a control method of the structured light projector, a depth camera, and an electronic device.
Background
The structured light camera utilizes an infrared laser emitter to emit laser light, thereby assisting the infrared camera in acquiring structured light images. The energy of the laser emitted by the infrared laser emitter is attenuated after passing through a Diffractive Optical Element (DOE), so that the injury to a human body is avoided. However, since the diffractive optical element is relatively easy to break, the laser emitted by the infrared laser emitter may be directly irradiated on the human body, and particularly, the laser may be directly irradiated on the eyes of the human body when the face is unlocked, which may cause great harm to the user.
Disclosure of Invention
Embodiments of the present invention provide a structured light projector, a control method of a structured light projector, a depth camera and an electronic device.
The structured light projector of an embodiment of the present invention includes:
a laser transmitter for transmitting laser light;
a collimating element to collimate the laser light;
a diffractive optical element for diffracting the laser light collimated by the collimating element to form a laser light pattern; and
a light-transmissive extended film disposed on and bonded to the diffractive optical element, the extended film providing adhesion to the diffractive optical element upon breakage of the diffractive optical element.
The control method of the structured light projector of the embodiment of the present invention includes:
emitting the laser light to form the laser light pattern;
acquiring a structured light image, wherein the structured light image is formed by collecting the laser pattern;
processing the structured light image to determine whether the structured light image has anomalous speckle; and
determining that the structured light projector is operating abnormally when the structured light image exhibits the anomalous spot.
The depth camera of the embodiment of the invention comprises:
the structured light projector; and
an image collector for collecting the laser pattern projected into a target space by the structured light projector.
An electronic device according to an embodiment of the present invention includes:
a housing; and
the depth camera mounted on and exposed from the housing to acquire the structured light image.
The structured light projector, the control method of the structured light projector, the depth camera and the electronic device in the embodiment of the invention combine the diffractive optical element with the transparent extension film, so that when the diffractive optical element is broken, the adhesive force provided by the extension film can prevent the diffractive optical element from splitting, further the diffractive optical element can still reduce the energy of laser, and the harm of the laser to human bodies is reduced.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a schematic diagram of a structured light projector according to certain embodiments of the present invention.
FIG. 2 is a schematic diagram of a structured light projector according to certain embodiments of the present invention.
FIG. 3 is a schematic diagram of a structured light projector according to certain embodiments of the present invention.
Fig. 4 is a schematic diagram of a structured light projector according to some embodiments of the present invention.
FIG. 5 is a schematic plan view of an extended film according to certain embodiments of the invention.
FIG. 6 is a schematic plan view of an extended film according to certain embodiments of the invention.
FIG. 7 is a schematic diagram of a depth camera in accordance with certain embodiments of the invention.
Fig. 8 is a flow chart illustrating a method of controlling a structured light projector according to some embodiments of the present invention.
Fig. 9 is a flow chart illustrating a method of controlling a structured light projector according to some embodiments of the present invention.
Fig. 10 is a flow chart illustrating a method of controlling a structured light projector according to some embodiments of the present invention.
Fig. 11 is a flow chart illustrating a method of controlling a structured light projector according to some embodiments of the present invention.
Fig. 12 is a flow chart illustrating a method of controlling a structured light projector according to some embodiments of the present invention.
Fig. 13 is a schematic plan view of an electronic device according to some embodiments of the invention.
Description of the main element symbols:
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are exemplary only for the purpose of illustrating the embodiments of the present invention and are not to be construed as limiting the embodiments of the present invention.
In the description of the embodiments of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of describing the embodiments of the present invention and simplifying the description, but do not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the embodiments of the present invention. Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", may explicitly or implicitly include one or more of the described features. In the description of the embodiments of the present invention, "a plurality" means two or more unless specifically limited otherwise.
In the description of the embodiments of the present invention, it should be noted that, unless explicitly stated or limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; may be mechanically connected, may be electrically connected or may be in communication with each other; either directly or indirectly through intervening media, either internally or in any other suitable relationship. Specific meanings of the above terms in the embodiments of the present invention can be understood by those of ordinary skill in the art according to specific situations.
In embodiments of the invention, unless expressly stated or limited otherwise, the first feature "on" or "under" the second feature may comprise the first and second features being in direct contact, or the first and second features being in contact, not directly, but via another feature therebetween. Also, the first feature being "on," "above" and "over" the second feature includes the first feature being directly on and obliquely above the second feature, or merely indicating that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature includes the first feature being directly under and obliquely below the second feature, or simply meaning that the first feature is at a lesser elevation than the second feature.
The following disclosure provides many different embodiments or examples for implementing different configurations of embodiments of the invention. In order to simplify the disclosure of embodiments of the invention, the components and arrangements of specific examples are described below. Of course, they are merely examples and are not intended to limit the present invention. Furthermore, embodiments of the invention may repeat reference numerals and/or reference letters in the various examples, which have been repeated for purposes of simplicity and clarity and do not in themselves dictate a relationship between the various embodiments and/or arrangements discussed. In addition, embodiments of the present invention provide examples of various specific processes and materials, but one of ordinary skill in the art may recognize applications of other processes and/or use of other materials.
Referring to fig. 1-4, a structured light projector 220 according to an embodiment of the present invention includes a laser emitter 221, a collimating element 222, a diffractive optical element 223, and a light transmissive stretched film 224. The laser transmitter 221 is for emitting laser light. The collimating element 222 is used to collimate the laser light. The diffractive optical element 223 is used to diffract the laser light collimated by the collimating element 222 to form a laser light pattern. The spreading film 224 is disposed on the diffractive optical element 223 and is bonded to the diffractive optical element 223, and the spreading film 224 provides adhesion to the diffractive optical element 223 when the diffractive optical element 223 is broken.
The structured light projector 220 of the embodiment of the invention utilizes the transparent extension film 224 to combine with the diffractive optical element 223, so that when the diffractive optical element 223 is broken, the adhesive force provided by the extension film 224 can prevent the diffractive optical element 223 from splitting, and further the diffractive optical element 223 can still reduce the energy of laser and reduce the harm of the laser to human body.
In some embodiments, the Laser transmitter 221 includes a Vertical-Cavity Surface-Emitting Laser (VCSEL) or a Distributed Feedback Laser (DFB). The light-transmissive stretched film 224 may mean that the light transmittance of the stretched film 224 is 80% or more.
In certain embodiments, the extensible film 224 is a plastic or rubber film having adhesive properties.
Thus, the stretch film 224 is not easily damaged when the structured light projector 220 is dropped or impacted, and can still work normally, so that the diffractive optical element 223 that may be broken can be stuck to prevent the diffractive optical element 223 from being split.
Specifically, the stretch film 224 may have adhesive properties, for example, the stretch film 224 may also be an optical glue. By utilizing the characteristics of high light transmittance, high ductility (not easy to break), high viscosity and the like of the optical cement, the diffractive optical element 223 can not be scattered when being broken by external force under the condition of not influencing the normal operation of the structured light projector 220.
Referring to fig. 2-4, in some embodiments, diffractive optical element 223 includes opposing diffractive entrance surface 2232 and diffractive exit surface 2234, and extended film 224 is disposed on diffractive entrance surface 2232 and/or diffractive exit surface 2234.
In this manner, the size of the stretch film 224 may be reduced, thereby reducing the material required to stretch the film 224.
Specifically, extended film 224 is located on diffractive entrance surface 2232 and/or diffractive exit surface 2234, and it is understood that extended film 224 is located on diffractive entrance surface 2232, or extended film 224 is located on diffractive exit surface 2234, or extended film 224 is located on both diffractive entrance surface 2232 and diffractive exit surface 2234. When the stretched film 224 is positioned on the diffractive entrance surface 2232 or on the diffractive exit surface 2234, the size of the stretched film 224 is greatly reduced, and the material required to manufacture the stretched film 224 is reduced, thereby reducing the manufacturing cost of the stretched film 224. When the stretched film 224 is provided on both the diffractive incident surface 2232 and the diffractive exit surface 2234, both the diffractive incident surface 2232 and the diffractive exit surface 2234 can be protected, and a better adhesive force can be provided when the diffractive optical element 223 is broken, thereby improving safety.
Referring to fig. 5 and 6, in some embodiments, extended film 224 at least partially covers diffractive entrance surface 2232 and/or diffractive exit surface 2234.
In this manner, the size of the stretch film 224 may be further reduced, thereby reducing the material required to stretch the film 224.
Specifically, the extended film 224 at least partially covers the diffractive entrance surface 2232 and/or the diffractive exit surface 2234, and it is understood that the extended film 224 partially covers the diffractive entrance surface 2232, or the extended film 224 completely covers the diffractive entrance surface 2232, or the extended film 224 partially covers the diffractive exit surface 2234, or the extended film 224 completely covers the diffractive exit surface 2234, or the extended film 224 partially covers the diffractive entrance surface 2232 and partially covers the diffractive exit surface 2234, or the extended film 224 partially covers the diffractive entrance surface 2232 and completely covers the diffractive exit surface 2234, or the extended film 224 partially covers the diffractive exit surface 2234 and completely covers the diffractive entrance surface 2232, or the extended film 224 completely covers the diffractive exit surface 2234 and completely covers the diffractive entrance surface 2232.
When extended film 224 partially covers diffractive entrance surface 2232, or extended film 224 partially covers diffractive exit surface 2234, or extended film 224 partially covers diffractive entrance surface 2232 and completely covers diffractive exit surface 2234, or extended film 224 partially covers diffractive exit surface 2234 and completely covers diffractive entrance surface 2232, the size of extended film 224 is further reduced, and the material required to manufacture extended film 224 is further reduced, thereby further reducing the manufacturing cost of extended film 224.
When the extended film 224 completely covers the diffractive incident surface 2232, or the extended film 224 completely covers the diffractive exit surface 2234 and completely covers the diffractive incident surface 2232, the diffractive incident surface 2232 and the diffractive exit surface 2234 can be more completely protected, and a better adhesive force can be provided when the diffractive optical element 223 is broken, thereby improving safety.
When the stretched film 224 partially covers the diffractive incident surface 2232 and/or the diffractive emission surface 2234, the shape of the stretched film 224 partially covering the corresponding stretched film may be set according to actual circumstances. For example, it can be determined experimentally which regions of diffractive entrance surface 2232 and diffractive exit surface 2234 are relatively easily broken, and thus the extensible film 224 is manufactured from the relatively easily broken regions to protect the easily broken regions with the extensible film 224.
Referring again to FIG. 5, in one embodiment, since the corner positions of the diffractive optical element 223 are more prone to cracking, the spreading film 224 can be disposed at each corner position of the diffractive optical element 223.
Referring again to fig. 1, in some embodiments, the extensible film 224 wraps the entire diffractive optical element 223, i.e., the extensible film 224 completely wraps the surfaces of the diffractive optical element 223, each of which includes: a diffractive incident surface 2232, a diffractive emission surface 2234, and all side surfaces connecting the diffractive incident surface 2232 and the diffractive emission surface 2234.
In this manner, the stretched film 224 can further ensure that the diffractive optical element 223 does not split.
Specifically, the extended film 224 may completely wrap the diffractive optical element 223, and thus, even if the diffractive optical element 223 is broken, the extended film 224 may cause the diffractive optical element 223 to be substantially kept as it is, that is, may cause the diffractive optical element 223 not to be scattered.
In some embodiments, the difference between the refractive index of the extended film 224 and the refractive index of the diffractive optical element 223 is less than 0.1.
In this manner, the ductile film 224 may be prevented from disrupting the formation of the laser pattern.
Specifically, the refractive index of the diffractive optical element 223 is generally 1.3 to 1.7, and if the difference between the refractive index of the stretched film 224 and the refractive index of the diffractive optical element 223 is too large, for example, greater than 0.1, the laser light is easily refracted at a large angle when passing through the interface between the stretched film 224 and the diffractive optical element 223, so that the direction of the laser light is greatly changed, and the formation of the laser light pattern is damaged. The difference between the refractive index of the extended film 224 and the refractive index of the diffractive optical element 223 needs to be less than 0.1, so that the structured light projector 220 can function properly.
In some embodiments, the refractive index of the extended film 224 is the same as the refractive index of the diffractive optical element 223.
Referring to fig. 1-4, in some embodiments, the structured light projector 220 of the present invention may further include a lens barrel assembly 225 and a substrate assembly 226, wherein the lens barrel assembly 225 is disposed on the substrate assembly 226 and forms a receiving cavity 2252 together with the substrate assembly 226. The substrate assembly 226 includes a substrate 2262 and a circuit board 2264 carried on the substrate 2262. The lens barrel assembly 225 includes a lens barrel 2254 and a protective cover 2256. The lens barrel 2254 includes a top wall 2254A and a ring-shaped peripheral wall 2254B extending from the top wall 2254A, the peripheral wall 2254B is disposed on the substrate assembly 226, and the top wall 2254A is opened with a light-passing hole 2254C communicating with the accommodation cavity 2252. A protective cover 2256 is provided on the top wall 2254A. The protective cover 2256 includes a baffle 2256B with an exit opening 2256A and an annular sidewall 2256C extending from the baffle 2256B. The diffractive optical element 223 is carried on the top wall 2254A and is housed within a protective shroud 2256. Opposite sides of the diffractive optical element 223 are abutted against the protective cover 2256 and the ceiling 2254A, respectively, and the baffle 2256B includes an abutting surface 2258 near the light-passing hole 2254C, and the diffractive optical element 223 is abutted against the abutting surface 2258.
In particular, diffractive optical element 223 includes opposing diffractive entrance surface 2232 and diffractive exit surface 2234. The diffractive optical element 223 is carried on the top wall 2254A, the diffractive exit surface 2234 collides with a surface of the baffle 2256B near the clear aperture 2254C (the collision surface 2258), and the diffractive entrance surface 2232 collides with the top wall 2254A. The light-passing hole 2254C is aligned with the receiving cavity 2252 and the light-exiting through hole 2256A is aligned with the light-passing hole 2254C. The top wall 2254A, the side wall 2256C, and the baffle 2256B collide with the diffractive optical element 223, thereby preventing the diffractive optical element 223 from falling off from the protective cover 2256 in the light outgoing direction. In some embodiments, the protective cover 2256 is affixed to the top wall 2254A by glue 227.
With continued reference to fig. 1-4, in some embodiments, the collimating element 222 includes an optical portion 2222 and a mounting portion 2224 disposed around the optical portion 2222, the collimating element 222 includes a collimating incident surface 2226 and a collimating emergent surface 2228 located on opposite sides of the collimating element 222, the optical portion 2222 includes two curved surfaces located on opposite sides of the collimating element 222, the mounting portion 2224 abuts against the top wall 2254A, and one of the curved surfaces of the optical portion 2222 extends into the light-passing hole 2254C.
When the structured light projector 220 is assembled, the collimating element 222 and the substrate assembly 226 to which the laser emitter 221 is attached are inserted into the housing cavity 2252 in this order from the bottom end of the peripheral wall 2254B of the lens barrel assembly 225 along the optical path. The laser transmitter 221 may be mounted on the substrate assembly 226 first, and then the substrate assembly 226 mounted with the laser transmitter 221 is combined with the lens barrel assembly 225. The diffractive optical element 223 is carried on the top wall 2254A against the direction of the optical path, and then the protective cover 2256 is mounted on the top wall 2254A, so that the diffractive optical element 223 is housed inside the protective cover 2256. In this manner, the structured light projector 220 is simple to install. In other embodiments, the diffractive optical element 223 may be disposed inside the protective cover 2256 in an inverted manner, and then the diffractive optical element 223 and the protective cover 2256 may be mounted on the top wall 2254A. At this time, diffraction exit surface 2234 of diffractive optical element 223 collides with collision surface 2258, diffraction entrance surface 2232 collides with top wall 2254A and faces collimation exit surface 2228 of optical unit 2222, and collimation entrance surface 2226 of optical unit 2222 faces laser emitter 221. In this manner, the installation of the structured light projector 220 is simpler.
Referring to fig. 7, a depth camera 200 according to an embodiment of the present invention includes a structured light projector 220 and an image collector 240 according to any one of the above embodiments. The image collector 240 is used to collect the laser light pattern projected into the target space by the structured light projector 220.
The depth camera 200 of the embodiment of the invention utilizes the transparent extension film 224 to combine with the diffractive optical element 223, so that when the diffractive optical element 223 is broken, the diffractive optical element 223 is not split by the adhesive force provided by the extension film 224, and the diffractive optical element 223 can still reduce the energy of laser and reduce the harm of the laser to human body.
In some embodiments, the image collector 240 may be an infrared camera.
Referring to fig. 8, a method for controlling a structured light projector 220 according to an embodiment of the present invention includes:
step 01: emitting laser light to form a laser pattern;
step 02: acquiring a structured light image, wherein the structured light image is formed by collecting a laser pattern;
step 03: processing the structured light image to determine whether the structured light image has anomalous spots; and
step 04: the structured light projector 220 is determined to be operating abnormally when the structured light image appears abnormally speckled.
Referring again to fig. 1, in some embodiments, the structured light projector 220 may further include a processor 228. The processor 228 is configured to:
acquiring a structured light image, wherein the structured light image is formed by collecting a laser pattern;
processing the structured light image to determine whether the structured light image has anomalous spots; and
the structured light projector 220 is determined to be operating abnormally when the structured light image appears abnormally speckled.
Referring again to FIG. 7, in some embodiments, the depth camera 200 further includes a processor 228 coupled to the structured light projector 220 and the image collector 240, the processor 228 configured to:
acquiring a structured light image, wherein the structured light image is formed by collecting a laser pattern;
processing the structured light image to determine whether the structured light image has anomalous spots; and
the structured light projector 220 is determined to be operating abnormally when the structured light image appears abnormally speckled.
That is, the control method of the embodiment of the present invention may be implemented by the structured light projector 220 of the embodiment of the present invention or the depth camera 200 of the embodiment of the present invention, wherein the step 01 may be implemented by the structured light projector 220, and the steps 02, 03, and 04 may be implemented by the processor 228.
The structured light projector 220, the structured light projector control method and the depth camera 200 according to the embodiments of the present invention can determine whether the structured light projector 200 is abnormal according to the structured light image, for example, when the diffractive optical element 223 is broken, abnormal spots generally appear on the laser pattern after diffraction of the broken diffractive optical element 223, and therefore, the structured light projector 220 can be determined to be abnormal when the structured light image is abnormal spots, and whether the structured light projector 200 is abnormal can be accurately determined.
The structured light image according to the embodiment of the present invention may be obtained by collecting the laser pattern projected into the target space by the structured light projector 220 through the image collector 240, and the structured light image collected and obtained by the image collector 240 may be transmitted to the processor 228 through a wired communication and/or a wireless communication manner, so that the processor 228 may obtain the structured light image.
Referring to fig. 9, in some embodiments, the control method includes:
step 05: determining whether the structured light projector 220 is triggered;
In certain embodiments, the processor 228 is configured to determine whether the structured light projector 220 is triggered and to proceed to the step of emitting laser light to form a laser light pattern when the structured light projector 220 is triggered.
That is, step 05 may be implemented by processor 228.
Thus, it can be quickly determined whether the structured light projector 220 is working abnormally.
Specifically, whether the structured light projector 220 is triggered is judged, when the structured light projector 220 is triggered, it is indicated that the structured light projector 220 starts to operate, whether the structured light projector 220 operates abnormally can be judged according to a first frame structured light image after the structured light projector 220 starts to operate, and if the structured light projector 220 operates abnormally, a countermeasure can be taken in time, so that the power consumption of the structured light projector 220 is reduced or a safety accident is avoided.
In some embodiments, when the structured light projector 220 is not triggered, the control method proceeds to step 05 again, i.e., determines again whether the structured light projector 220 is triggered, so that it can be found accurately and timely when the structured light projector 220 is triggered.
Referring to fig. 10, in some embodiments, after step 03, the method includes:
step 06: the structured light projector 220 is determined to be operating properly when the structured light image is free of anomalous speckle.
In some embodiments, the processor 228 is configured to determine that the structured light projector 220 is operating properly when the structured light image is free of anomalous speckle.
That is, step 06 may be implemented by processor 228.
In this manner, the structured light projector 220 can function properly.
Specifically, when the structured light image does not have abnormal spots, the structured light projector 220 operates normally, and thus the structured light projector 220 can operate normally to cooperate with the image collector 240 to collect the structured light image.
Referring to fig. 11, in some embodiments, when the structured-light image has abnormal spots, the control method includes:
step 07: turning off the structured light projector 220 or reducing the emission power of the laser emitter 221.
In some embodiments, the processor 228 is configured to turn off the structured light projector 220 or reduce the emission power of the laser emitter 221 when an anomalous spot appears in the structured light image.
That is, step 07 may be implemented by processor 228.
In this way, the power consumption of the structured light projector 220 can be reduced and the harm of laser light to human body can be reduced.
Specifically, when the structured light image has abnormal spots, the structured light projector 220 works abnormally, so the structured light projector 220 can be directly turned off, the structured light projector 220 is prevented from consuming more energy, and the problem that the laser hurts the human body is avoided.
In some embodiments, when the structured light image has abnormal spots, although the structured light projector 220 is abnormally operated, the regions corresponding to the abnormal spots are normally abnormal, and other regions can still operate normally, so that the emission power of the laser emitter 221 can be reduced, and the structured light projector 220 can still operate. Since the abnormal spot may cause damage to the human body, the emission power of the laser emitter 221 may be reduced.
Referring to fig. 12, in some embodiments, when the structured-light image has abnormal spots, the control method includes:
step 08: and prompting the user.
In some embodiments, processor 228 is configured to prompt the user when an anomalous speckle appears in the structured light image.
That is, step 08 may be implemented by processor 228.
In this manner, the user may be prompted to know that the structured light image is abnormally speckled.
Specifically, the electronic device 1000 includes at least one of a display screen, an electro-acoustic element (e.g., a horn), and a vibration motor. The processor 228 may prompt the user by controlling at least one of a display screen that may display image, text information, an electro-acoustic element that may emit sound information, and a vibration motor that may prompt the user by vibrating information. The processor 228 may prompt the user through the display screen, or prompt the user through the electroacoustic component, or prompt the user through the vibration motor, or prompt the user through the display screen and the electroacoustic component, or prompt the user through the display screen and the vibration motor, or prompt the user through the electroacoustic component and the vibration motor, or prompt the user through the display screen, the electroacoustic component and the vibration motor, which is not limited in detail herein.
It should be noted that the processor 228 of any of the above embodiments may be applied to the structured light projector 220 or the depth camera 200, or the structured light projector 220 or the depth camera 200 includes the processor 228 of any of the above embodiments.
Referring to fig. 13, an electronic device 1000 according to an embodiment of the invention includes a housing 100 and a depth camera 200 according to any one of the above embodiments. The depth camera 200 is mounted on the housing 100 and exposed from the housing 100 to acquire a structured light image.
The electronic device 1000 according to the embodiment of the invention utilizes the light-transmitting extending film 224 to combine with the diffractive optical element 223, so that when the diffractive optical element 223 is broken, the adhesive force provided by the extending film 224 can prevent the diffractive optical element 223 from splitting, and further the diffractive optical element 223 can still reduce the energy of the laser, and reduce the harm of the laser to the human body.
In some embodiments, the electronic device 1000 includes a mobile phone, a tablet computer, a notebook computer, a smart band, a smart watch, a smart helmet, smart glasses, and the like.
In the description herein, references to the description of the terms "one embodiment," "some embodiments," "an illustrative embodiment," "an example," "a specific example" or "some examples" or the like mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, such as an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processing module-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (IPM overcurrent protection circuit) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of embodiments of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and not to be construed as limiting the present invention, and those skilled in the art can make changes, modifications, substitutions and alterations to the above embodiments within the scope of the present invention.
Claims (14)
1. A structured light projector, comprising:
a laser transmitter for transmitting laser light;
a collimating element to collimate the laser light;
a diffractive optical element for diffracting the laser light collimated by the collimating element to form a laser light pattern; and
a light-transmissive stretched film for reducing direct damage of collimated laser light passing through a diffractive optical element that generates cracks, the stretched film being provided on and bonded to the diffractive optical element, the stretched film providing, when the diffractive optical element generates cracks, a bonding force to the diffractive optical element such that the collimated laser light of the collimating element is not directed;
wherein a difference between a refractive index of the extended film and a refractive index of the diffractive optical element is less than 0.1.
2. The structured light projector of claim 1 wherein the stretch film is a plastic film or a rubber film.
3. The structured light projector of claim 1 wherein the diffractive optical element comprises opposing diffractive entrance and exit faces, the extended film being on the diffractive entrance face and/or the diffractive exit face.
4. The structured light projector of claim 3 wherein the extended film at least partially covers the diffractive entrance surface and/or the diffractive exit surface.
5. The structured light projector of claim 1 wherein the extended film wraps around the diffractive optical element.
6. The structured light projector of any one of claims 1 to 5 comprising a processor configured to:
acquiring a structured light image, wherein the structured light image is formed by collecting the laser pattern;
processing the structured light image to determine whether the structured light image has anomalous speckle; and
determining that the structured light projector is operating abnormally when the structured light image exhibits the anomalous spot.
7. A method of controlling a structured light projector as claimed in any one of claims 1 to 5, wherein the method of controlling comprises:
emitting the laser light to form the laser light pattern;
acquiring a structured light image, wherein the structured light image is formed by collecting the laser pattern;
processing the structured light image to determine whether the structured light image has anomalous speckle; and
determining that the structured light projector is operating abnormally when the structured light image exhibits the anomalous spot.
8. The control method according to claim 7, characterized by comprising:
determining whether the structured light projector is triggered;
entering the step of emitting the laser light to form the laser light pattern when the structured light projector is triggered.
9. The control method of claim 7, wherein after the step of processing the structured light image to determine whether the structured light image has anomalous speckle, comprising:
determining that the structured light projector is functioning properly when the structured light image is free of the anomalous spot.
10. The control method according to claim 7, wherein when the structured light image has the abnormal spot, the control method comprises:
turning off the structured light projector or reducing the emission power of the laser emitter.
11. The control method according to claim 7, wherein when the structured light image has the abnormal spot, the control method comprises:
and prompting the user.
12. A depth camera, comprising:
the structured light projector of any one of claims 1 to 5; and
an image collector for collecting the laser pattern projected into a target space by the structured light projector.
13. The depth camera of claim 12, further comprising a processor coupled to the structured light projector and the image collector, the processor configured to:
acquiring a structured light image, wherein the structured light image is formed by collecting the laser pattern;
processing the structured light image to determine whether the structured light image has anomalous speckle; and
determining that the structured light projector is operating abnormally when the structured light image exhibits the anomalous spot.
14. An electronic device, comprising:
a housing; and
the depth camera of claim 12 or 13, mounted on and exposed from the housing to acquire the structured light image.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810162450.9A CN108303835B (en) | 2018-02-27 | 2018-02-27 | Structured light projector and control method thereof, depth camera and electronic device |
| CN202110271504.7A CN113156742B (en) | 2018-02-27 | 2018-02-27 | Structured light projector and control method thereof, depth camera and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810162450.9A CN108303835B (en) | 2018-02-27 | 2018-02-27 | Structured light projector and control method thereof, depth camera and electronic device |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110271504.7A Division CN113156742B (en) | 2018-02-27 | 2018-02-27 | Structured light projector and control method thereof, depth camera and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108303835A CN108303835A (en) | 2018-07-20 |
| CN108303835B true CN108303835B (en) | 2021-04-09 |
Family
ID=62848795
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110271504.7A Expired - Fee Related CN113156742B (en) | 2018-02-27 | 2018-02-27 | Structured light projector and control method thereof, depth camera and electronic device |
| CN201810162450.9A Expired - Fee Related CN108303835B (en) | 2018-02-27 | 2018-02-27 | Structured light projector and control method thereof, depth camera and electronic device |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110271504.7A Expired - Fee Related CN113156742B (en) | 2018-02-27 | 2018-02-27 | Structured light projector and control method thereof, depth camera and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN113156742B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113156742A (en) * | 2018-02-27 | 2021-07-23 | Oppo广东移动通信有限公司 | Structured light projector, method of controlling structured light projector, depth camera, and electronic apparatus |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020019704A1 (en) | 2018-07-27 | 2020-01-30 | Oppo广东移动通信有限公司 | Control system of structured light projector, and electronic device |
| CN109218588B (en) * | 2018-10-31 | 2020-04-03 | Oppo广东移动通信有限公司 | Image acquisition method, image acquisition device, structured light assembly and electronic device |
| CN109167905B (en) * | 2018-10-31 | 2020-07-31 | Oppo广东移动通信有限公司 | Image acquisition method, image acquisition device, structured light assembly and electronic device |
| CN109167904B (en) * | 2018-10-31 | 2020-04-28 | Oppo广东移动通信有限公司 | Image acquisition method, image acquisition device, structured light assembly and electronic device |
| CN109451107B (en) * | 2018-11-16 | 2021-09-03 | Oppo广东移动通信有限公司 | Electronic device |
| CN109932828B (en) | 2019-02-01 | 2024-10-01 | 杭州驭光光电科技有限公司 | Light projection method and light projection device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101392158A (en) * | 2007-09-20 | 2009-03-25 | 蒂萨股份公司 | Transparent adhesive tape |
| CN106281189A (en) * | 2016-08-18 | 2017-01-04 | 付竹兰 | A kind of preparation method of hot melt laminating Special safety film |
| CN106529545A (en) * | 2016-09-26 | 2017-03-22 | 北京林业大学 | Speckle image quality recognition method and system based on image feature description |
| CN107167997A (en) * | 2017-06-05 | 2017-09-15 | 深圳奥比中光科技有限公司 | Laser projection module and depth camera |
| CN107608167A (en) * | 2017-10-11 | 2018-01-19 | 深圳奥比中光科技有限公司 | Laser projection device and its method of controlling security |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4455743B2 (en) * | 2000-09-12 | 2010-04-21 | 山本光学株式会社 | Manufacturing method of polarizing lens |
| US9291753B2 (en) * | 2011-05-30 | 2016-03-22 | Panasonic Intellectual Property Management Co., Ltd. | Diffraction optical element and production method therefor |
| CN105929558A (en) * | 2016-06-20 | 2016-09-07 | 深圳奥比中光科技有限公司 | Laser module used for generating structured light |
| CN113156742B (en) * | 2018-02-27 | 2022-05-20 | Oppo广东移动通信有限公司 | Structured light projector and control method thereof, depth camera and electronic device |
-
2018
- 2018-02-27 CN CN202110271504.7A patent/CN113156742B/en not_active Expired - Fee Related
- 2018-02-27 CN CN201810162450.9A patent/CN108303835B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101392158A (en) * | 2007-09-20 | 2009-03-25 | 蒂萨股份公司 | Transparent adhesive tape |
| CN106281189A (en) * | 2016-08-18 | 2017-01-04 | 付竹兰 | A kind of preparation method of hot melt laminating Special safety film |
| CN106529545A (en) * | 2016-09-26 | 2017-03-22 | 北京林业大学 | Speckle image quality recognition method and system based on image feature description |
| CN107167997A (en) * | 2017-06-05 | 2017-09-15 | 深圳奥比中光科技有限公司 | Laser projection module and depth camera |
| CN107608167A (en) * | 2017-10-11 | 2018-01-19 | 深圳奥比中光科技有限公司 | Laser projection device and its method of controlling security |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113156742A (en) * | 2018-02-27 | 2021-07-23 | Oppo广东移动通信有限公司 | Structured light projector, method of controlling structured light projector, depth camera, and electronic apparatus |
| CN113156742B (en) * | 2018-02-27 | 2022-05-20 | Oppo广东移动通信有限公司 | Structured light projector and control method thereof, depth camera and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113156742B (en) | 2022-05-20 |
| CN113156742A (en) | 2021-07-23 |
| CN108303835A (en) | 2018-07-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108303835B (en) | Structured light projector and control method thereof, depth camera and electronic device | |
| US11846525B2 (en) | Optical proximity sensor integrated into a camera module for an electronic device | |
| KR102494677B1 (en) | Bracket assempbly for a multi-component vision system in an electronic device | |
| US20220417394A1 (en) | Electronic device having a vision system assembly held by a self-aligning bracket assembly | |
| CN108344378B (en) | Laser projection module and damage detection method, depth camera and electronic device | |
| US20130153755A1 (en) | Optical Proximity Sensing | |
| CN108319034B (en) | Laser projection module, depth camera and electronic device | |
| US10895753B2 (en) | Structured light generation device and diffractive optical element thereof | |
| US20170131560A1 (en) | Diffractive optical element and laser diode-doe module | |
| WO2020000998A1 (en) | Laser projector, image acquisition apparatus and electronic device | |
| CN108387365A (en) | Laser projection module and its damage detection method, depth camera and electronic device | |
| CN108490629B (en) | Structured light projector and its detection method and device, image acquisition device and electronic equipment | |
| CN108508620A (en) | Detection method and detection device of laser projection module and electronic device | |
| CN108924295B (en) | Photoelectric modules, depth cameras and terminals | |
| JP6069017B2 (en) | Head-up display device | |
| US11563930B2 (en) | Laser projection component, detection method thereof, and electronic device | |
| CN108508624A (en) | Laser projection module, detection method and device thereof, depth camera and electronic device | |
| CN108445643B (en) | Structured light projection module, detection method and device thereof, image acquisition structure and electronic device | |
| JP6537947B2 (en) | Proximity sensor and electronic device | |
| CN108490595B (en) | Structured light projection module, image acquisition device and electronic equipment | |
| EP4403995A1 (en) | Systems and methods for projecting illumination from a device edge | |
| JP2857974B2 (en) | Road luminous sign device | |
| US20220397756A1 (en) | Optical scanning device | |
| WO2019165853A1 (en) | Laser projection module, depth camera and electronic device | |
| TW202121780A (en) | Light transmissive sheet, laser projection module, depth camera and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20210409 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |