CN109413239B

CN109413239B - Electronic equipment, control method of electronic equipment, and control device of electronic equipment

Info

Publication number: CN109413239B
Application number: CN201811368403.6A
Authority: CN
Inventors: 杨鑫
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-11-16
Filing date: 2018-11-16
Publication date: 2021-03-12
Anticipated expiration: 2038-11-16
Also published as: CN109413239A

Abstract

The application provides an electronic device, a control method of the electronic device and a control device of the electronic device. The electronic equipment comprises a display screen, a cover plate and a projection module. The display screen is provided with a display area, and the display area is used for displaying the first image. The cover plate is arranged on the display screen, a first sub-area and a second sub-area are formed on the cover plate, and the first sub-area corresponds to the display area. The projection module and the display screen are positioned on the same side of the cover plate, and the projection module is used for projecting a second image to the second sub-area. Because first subregion corresponds with the display area, the first image that the display area shows can see through first subregion in order to supply the user to look over, and in addition, the second image that projection module throws can see through the second subregion in order to supply the user to look over, and projection module neither can shelter from the first image that the display screen shows, can throw out the second image again for electronic equipment can present first image and second image simultaneously, has enlarged electronic equipment's the area of showing the image.

Description

Electronic device, control method for electronic device, and control device for electronic device

Technical Field

The present invention relates to the field of consumer electronics, and more particularly, to an electronic device, a control method of the electronic device, and a control apparatus of the electronic device.

Background

Electronic equipment, such as a mobile phone, a tablet computer, a notebook computer, etc., is usually provided with a display screen to display images, and also with other functional devices, such as a receiver, an optical sensor, a proximity sensor, a camera, etc., for normal operation of the functional devices, the functional devices are usually arranged in a space staggered from the display screen, and in a case that the front size of the electronic equipment is not changed, the arrangement of the functional devices results in a smaller area of the electronic equipment to display images.

Disclosure of Invention

The embodiment of the application provides an electronic device, a control method of the electronic device and a control device of the electronic device.

The electronic equipment of this application embodiment includes display screen, apron and projection module. The display screen is provided with a display area, and the display area is used for displaying a first image. The cover plate is arranged on the display screen, a first sub-area and a second sub-area are formed on the cover plate, and the first sub-area corresponds to the display area. The projection module and the display screen are located on the same side of the cover plate, and the projection module is used for projecting a second image to the second sub-area.

In the electronic equipment of this application embodiment, first subregion corresponds with the display area, and the first image that the display area shows can see through first subregion for the user to look over, and in addition, the second image that projection module throws can see through the second subregion for the user to look over, and projection module neither can shelter from the first image that the display screen shows, can throw out the second image again for electronic equipment can present first image and second image simultaneously, has enlarged electronic equipment's the area of showing the image.

In the control method of the electronic device according to the embodiment of the present application, the electronic device includes a display screen, a cover plate, a projection module and a structured light assembly, the display screen is formed with a display area, the display area is used for displaying a first image, the cover plate is disposed on the display screen, the cover plate is formed with a first sub-area and a second sub-area, the first sub-area corresponds to the display area, the projection module, the display screen and the structured light assembly are all located on the same side of the cover plate, the projection module is used for projecting a second image to the second sub-area, the structured light assembly is disposed corresponding to the second sub-area, the structured light assembly includes a structured light projector and a structured light camera, the structured light projected by the structured light projector passes through the second sub-area to a target object, the structured light camera is used for receiving the structured light modulated by the target object and passing through the second sub-area, the control method comprises the following steps: acquiring an exposure time sequence of the structured light camera receiving the modulated structured light; processing the exposure time sequence to obtain a projection time sequence of the projection module, wherein the projection time sequence is staggered with the exposure time sequence; and controlling the projection module to project the second image according to the projection time sequence.

In the control method of the electronic device according to the embodiment of the application, the structured light camera receives modulated structured light in an exposure time sequence, the projection module projects a second image in a projection time sequence staggered with the exposure time sequence, a user can still view the second image when the user obtains depth information by using the structured light module, the projection module is prevented from influencing the structured light camera to receive the modulated structured light when projecting the second image, and the depth information obtained by the structured light module is more accurate.

In the control method of the electronic device according to the embodiment of the present application, the electronic device includes a display screen, a cover plate, a projection module and a structured light assembly, the display screen is formed with a display area, the display area is used for displaying a first image, the cover plate is disposed on the display screen, the cover plate is formed with a first sub-area and a second sub-area, the first sub-area corresponds to the display area, the projection module, the display screen and the structured light assembly are all located on the same side of the cover plate, the projection module is used for projecting a second image to the second sub-area, the structured light assembly is disposed corresponding to the second sub-area, the structured light assembly includes a structured light projector and a structured light camera, the structured light projected by the structured light projector passes through the second sub-area to a target object, the structured light camera is used for receiving the structured light modulated by the target object and passing through the second sub-area, the control method comprises the following steps: judging whether the structured light camera is started or not; and when the structured light camera is opened, controlling the projection module to be closed.

According to the control method of the electronic equipment, when the structured light camera is judged to be opened, the projection module is closed, the influence of a second image projected by the projection module when the structured light camera receives modulated structured light is avoided, and the depth information obtained by the structured light assembly is accurate.

In the control device of the electronic device according to the embodiment of the present application, the electronic device includes a display screen, a cover plate, a projection module and a structured light assembly, the display screen is formed with a display area, the display area is used for displaying a first image, the cover plate is disposed on the display screen, the cover plate is formed with a first sub-area and a second sub-area, the first sub-area corresponds to the display area, the projection module, the display screen and the structured light assembly are all located on the same side of the cover plate, the projection module is used for projecting a second image to the second sub-area, the structured light assembly is disposed corresponding to the second sub-area, the structured light assembly includes a structured light projector and a structured light camera, the structured light projected by the structured light projector passes through the second sub-area to a target object, the structured light camera is used for receiving the structured light modulated by the target object and passing through the second sub-area, the control device comprises an acquisition module, a processing module and a control module, wherein the acquisition module is used for acquiring an exposure time sequence of the structured light camera receiving the modulated structured light; the processing module is used for processing the exposure time sequence to obtain a projection time sequence of the projection module, and the projection time sequence is staggered with the exposure time sequence; the control module is used for controlling the projection module to project the second image according to the projection time sequence.

In the control device of the electronic device according to the embodiment of the application, the structured light camera receives modulated structured light through an exposure time sequence, the projection module projects a second image through a projection time sequence staggered with the exposure time sequence, the user can still view the second image when the user acquires depth information through the structured light component, the projection module is prevented from influencing the structured light camera to receive modulated structured light when projecting the second image, and the depth information obtained by the structured light component is accurate.

In the control device of the electronic device according to the embodiment of the present application, the electronic device includes a display screen, a cover plate, a projection module and a structured light assembly, the display screen is formed with a display area, the display area is used for displaying a first image, the cover plate is disposed on the display screen, the cover plate is formed with a first sub-area and a second sub-area, the first sub-area corresponds to the display area, the projection module, the display screen and the structured light assembly are all located on the same side of the cover plate, the projection module is used for projecting a second image to the second sub-area, the structured light assembly is disposed corresponding to the second sub-area, the structured light assembly includes a structured light projector and a structured light camera, the structured light projected by the structured light projector passes through the second sub-area to a target object, the structured light camera is used for receiving the structured light modulated by the target object and passing through the second sub-area, the control device comprises a judging module and a control module, wherein the judging module is used for judging whether the structured light camera is started or not; the control module is used for controlling the projection module to be closed when the structured light camera is opened.

In the control device of the electronic device according to the embodiment of the application, when the structured light camera is judged to be opened, the projection module is closed, so that the projection module cannot project the second image, the influence of the second image projected by the projection module when the structured light camera receives modulated structured light is avoided, and the depth information obtained by the structured light assembly is more accurate.

Additional aspects and advantages of embodiments of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of embodiments of the present application.

Drawings

The above and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

FIG. 1 is a schematic structural diagram of an electronic device according to some embodiments of the present application;

FIG. 2 is a schematic diagram of a portion of an electronic device according to some embodiments of the present application;

FIG. 3 is a schematic cross-sectional view of an electronic device of some embodiments of the present application taken along line A-A of FIG. 2;

FIGS. 4 and 5 are schematic views of portions of electronic devices according to some embodiments of the present application;

FIGS. 6-8 are schematic cross-sectional views of an electronic device of some embodiments of the present application taken along a line A-A corresponding to that shown in FIG. 2;

FIG. 9 is a flow chart illustrating a method for controlling an electronic device according to some embodiments of the present disclosure;

FIG. 10 is a block diagram of a control device of an electronic device according to some embodiments of the present application;

FIG. 11 is a timing diagram illustrating display timing, exposure timing, and projection timing according to some embodiments of the present disclosure;

fig. 12 and 13 are schematic flow charts illustrating a method of controlling an electronic device according to some embodiments of the present disclosure; and

fig. 14 is a block diagram of a control device of an electronic device according to some embodiments of the present disclosure.

Detailed Description

Embodiments of the present application will be further described below with reference to the accompanying drawings. The same or similar reference numbers in the drawings identify the same or similar elements or elements having the same or similar functionality throughout.

In addition, the embodiments of the present application described below in conjunction with the accompanying drawings are exemplary and are only for the purpose of explaining the embodiments of the present application, and are not to be construed as limiting the present application.

Referring to fig. 1 to fig. 3, an electronic apparatus 1000 according to an embodiment of the present disclosure includes a display screen 10, a cover plate 20, and a projection module 30. The display screen 10 is formed with a display area 11, and the display area 11 is used for displaying a first image. The cover plate 20 is disposed on the display screen 10. The cover plate 20 is formed with a first sub-area 21 and a second sub-area 22, and the first sub-area 21 corresponds to the display area 11. The projection module 30 is located on the same side of the cover plate 20 as the display screen 10. The projection module 30 is used for projecting a second image to the second sub-area 22.

Specifically, the electronic device 1000 may further include a housing 40, where the housing 40 may be used to mount functional devices such as the display screen 10, the cover plate 20, and the projection module 30, and the functional devices may also be a main board, a dual-camera module, a receiver, and the like. The specific form of the electronic device 1000 may be a mobile phone, a tablet computer, a smart watch, a head display device, and the like, and the electronic device 1000 is used as the mobile phone for description in the present application, it is understood that the specific form of the electronic device 1000 is not limited to the mobile phone, and is not limited herein.

Referring to fig. 2 and 3, the display screen 10 may be mounted on the housing 40, and specifically, the display screen 10 may be mounted on one surface of the housing 40, or mounted on two opposite surfaces of the housing 40. In the example shown in fig. 3, the display screen 10 is mounted on the front of the housing 40. The display screen 10 may be used to display a first image, which may be text, image, video, icon, etc. information. The specific type of display screen 10 may be a liquid crystal display screen, an OLED display screen, a Micro LED display screen, etc. The display screen 10 is formed with a display area 11.

The display area 11 comprises opposing front and back surfaces 12, 13. The display area 11 is used for displaying the first image, and the light is emitted outward in a direction in which the back surface 13 is directed to the front surface 12 and is received by the user after passing through the front surface 12. Pixels are formed in the display region 11, and in one example, the pixels may self-emit light to exhibit corresponding colors, and in another example, the pixels may exhibit corresponding colors under the influence of a backlight. The shape of the display area 11 may be a regular shape such as a circle, an ellipse, a racetrack, a rounded rectangle, or a rectangle to suit the needs of different types of electronic devices 1000 and different users.

In some examples, the display screen 10 may further include a non-display area, and the non-display area may be formed at a periphery of the display area 11. The non-display area may not be used for display, and the non-display area may be used for bonding with the housing 40 or for wiring, for example, the non-display area may be bonded with the housing 40 by an adhesive without affecting the display function of the display area 11. The display screen 10 may also be a touch display screen integrated with a touch function, and after obtaining image information displayed on the display screen 10, a user may perform touch on the display screen 10 to implement a predetermined interactive operation.

Referring to fig. 2 and fig. 3, the cover plate 20 is disposed on the display screen 10, and can protect the display screen 10 from dust and water. In addition, the cover plate 20 may be made of a material with good light transmittance, such as glass or sapphire, so that the cover plate 20 has good light transmittance. The cover plate 20 is formed with a first subregion 21 and a second subregion 22.

The first subregion 21 may be contiguous with the second subregion 22 or may be spaced from the second subregion 22. Furthermore, the first sub-area 21 may be located near the edge of the cover plate 20, and the second sub-area 22 may be located at the middle of the cover plate 20. The first sub-area 21 corresponds to the display area 11, and the display area 11 may be disposed below, for example, directly below, the first sub-area 21. The first image displayed by the display area 11 may pass through the first sub-area 21 for viewing by the user. The cover plate 20 further includes first and second

opposing faces

23, 24, and the front face 12 of the display screen 10 is joined to the second face 24. External light of the electronic device 1000 may enter the electronic device 1000 after sequentially passing through the first surface 23 and the second surface 24, and light emitted by elements in the electronic device 1000 may also be emitted to the outside of the electronic device 1000 after sequentially passing through the second surface 24 and the first surface 23, for example, a first image displayed in the display area 11 is provided for a user to view after sequentially passing through the second surface 24 and the first surface 23.

The projection module 30 is located on the same side of the cover plate 20 as the display screen 10. The projection module 30 corresponds to the second sub-region 22. In the example shown in fig. 3, the projection module 30 and the cover plate 20 may be disposed on opposite sides of the display screen 10, the front 12 of the display screen 10 is combined with the cover plate 20, and the projection module 30 is disposed on a side where the back 13 of the display screen 10 is located. In other examples, the projection module 30 and the display screen 10 may also be disposed on the second surface 24 of the cover plate 20 at the same time in a manner of being spaced apart from each other, that is, the projection module 30 is disposed right below the second sub-region 22, the display screen 10 is disposed right below the first sub-region 21, and the display screen 10 and the projection module 30 have an overlap in the Z direction (as shown in fig. 1 and 3), so as to reduce the thickness of the electronic device 1000 in the Z direction.

The projection module 30 is used for projecting a second image to the second sub-area 22. The projection range of the projection module 30 can cover the second sub-region 22, so that the second sub-region 22 can present the second image. The second image may be a continuous image with the display content of the first image, for example, a frame image, the first image is a part of the image, and the second image is another part of the image, so that the area of the electronic device 1000 for displaying the image is larger. The projection state of the second image may be the same as or different from the display state of the first image. Taking the refresh frequency of the first image and the projection frequency of the second image as an example, when the refresh frequency of the first image is the same as the projection frequency of the second image, the electronic device 1000 may synchronously present the first image and the second image, so that the entire screen is continuous; when the refresh frequency of the first image is different from the projection frequency of the second image, for example, the refresh frequency of the first image is higher, the first image may be an image with a higher frame rate, such as a text, a video, etc., and the projection frequency of the second image is lower, the second image may be an image with a lower frame rate, such as an icon for displaying the state of the electronic device 1000 (the battery capacity of the electronic device 1000, the network connection state, the system time), etc. The projection module 30 may include a light source, a display chip and a projection lens, and the display chip and the projection lens are sequentially disposed on a light path of the light source. When the projection module 30 works, the light emitted from the light source irradiates the display chip, the display chip is driven to display the initial second image, and the projection lens magnifies the initial second image into the second image and projects the second image onto the second sub-area 22. The light source can be an LED light source or a laser light source. The light sources of the different projection modules 30 emit light beams with different wavelengths, so the projected second image may include one or more of infrared light, ultraviolet light, and visible light.

In some examples, the display area 11 can be independently driven to display the first image, and the projection module 30 can be independently driven to project the second image, so that the projection state of the second image is the same as or different from the display state of the first image. For example, the display screen 10 displays a first image at a display timing T1 (as shown in fig. 11), and the projection module 30 projects a second image at the display timing T1, so that the refresh frequency of the first image is the same as the projection frequency of the projection module 30, that is, the refresh frequency of the first image is the same as the projection frequency of the second image, and thus, the electronic device 1000 can synchronously present the first image and the second image, so that the whole screen is continuous. For another example, the display area 11 displays the first image with the luminance, and the projection module 30 displays the second image with the projection luminance different from the luminance, so that the luminance of the first image is different from the luminance of the second image.

In summary, in the electronic apparatus 1000 according to the embodiment of the application, the first sub-area 21 corresponds to the display area 11, and the first image displayed in the display area 11 can be viewed by the user through the first sub-area 21, and in addition, the projection module 30 can project the second image without blocking the first image displayed in the display screen 10, so that the electronic apparatus 1000 can present the first image and the second image at the same time, and the area of the electronic apparatus 1000 displaying the images is enlarged.

Referring to fig. 3, in some embodiments, the display screen 10 is formed with a through-groove 14 penetrating the front surface 12 and the back surface 13, and the through-groove 14 does not have a display function.

Specifically, when the projection module 30 is disposed on the side of the display screen 10 where the back surface 13 is located, that is, the projection module 30 and the cover plate 20 are disposed on opposite sides of the display screen 10 (as shown in fig. 3), the second image projected by the projection module 30 passes through the through groove 14 to reach the second sub-area 22. When the projection module 30 is disposed in the through slot 14 corresponding to the second sub-area 22, the projection module 30 directly projects a second image onto the second sub-area 22. The through grooves 14 may correspond to the second sub-regions 22, and may, for example, correspond in position, have the same shape, and have the same size, or may, of course, correspond in position, have different shapes, and have different sizes. In the embodiment, since the through groove 14 is disposed on the display screen 10, and the through groove 14 corresponds to the projection module 30, the first image displayed by the display screen 10 and the second image projected by the projection module 30 do not interfere with each other, and a user can view the first image and the second image through the first sub-area 21 and the second sub-area 22 at the same time, so as to enlarge the area of the electronic device 1000 on which the images are displayed.

Further, in the example shown in fig. 4, the through-groove 14 includes a notch 141 formed on an edge of the display screen 10, or the through-groove 14 intersects the edge of the display screen 10. The notch 141 may be formed on any one or more of the upper edge, the lower edge, the left edge, the right edge, and the like of the display screen 10. The shape of the notch 141 may be any shape such as triangle, semicircle, rectangle, racetrack, etc., and is not limited herein.

In the example shown in fig. 5, the through-groove 14 includes a through-hole 142 spaced apart from the edge of the display screen 10, or the through-groove 14 opens within the range enclosed by the edge of the display screen 10. The through holes 142 may be disposed near any one or more of the upper edge, the lower edge, the left edge, the right edge, and the like of the display screen 10. The shape of the through hole 142 may be any shape such as triangle, circle, rectangle, racetrack, etc., and is not limited herein.

In some examples, the through slot 14 may also include the notch 141 and the through hole 142. The number of the notches 141 and the through holes 142 may be equal or unequal.

In some embodiments, the display screen 10 may not have a through-groove, and no picture is displayed in a region corresponding to the projection device 30 (hereinafter, referred to as the projection region 14), and the light transmittance is high, and is not less than 75% so as not to affect the display of the projection device 30. In this case, the projection area 14 of the display screen 10 is made of ordinary glass without pixel units, and the display area 11 is provided with pixel units.

Referring to fig. 1 to 3, in some embodiments, the electronic device 1000 further includes a structured light assembly 50, and the structured light assembly 50 can obtain depth information of the target object by using the structured light for three-dimensional modeling, generating a three-dimensional image, ranging, and the like. The structured light assembly 50 is located on the same side of the cover 20 as the display screen 10, in one example, the display screen 10 is located on the side of the second face 24 of the cover 20, and the structured light assembly 50 is disposed on the side of the display screen 10 away from the cover 20, that is, the structured light assembly 50 and the cover 20 are disposed on opposite sides of the display screen 10. The structured light assembly 50 is arranged in correspondence with the second sub-area 22. The structured light assembly 50 includes a structured light projector 51 and a structured light camera 52, the structured light projected by the structured light projector 51 passes through the second sub-region 22 to reach the target object, and the structured light camera 52 is configured to receive the structured light modulated by the target object and passing through the second sub-region 22. When the projection area 14 is disposed on the display screen 10, the structured light projected by the structured light projector 51 passes through the projection area 14 and the second sub-area 22 to reach the target object, and the structured light camera 52 is configured to receive the structured light modulated by the target object and passing through the second sub-area 22 and the projection area 14. Wherein the structured light camera 52 may be an infrared camera.

Since the second sub-area 22 and the projection area 14 are both transparent areas, and the structured light emitted by the structured light projector 51 does not pass through the display area 11 of the display screen 10 before passing through the second sub-area 22, the speckle pattern of the structured light is not affected by the display area 11 of the display screen 10, so that the interference of the display screen 10 can be avoided. Similarly, the structured light modulated by the target object does not pass through the display area 11 of the display screen 10 before reaching the structured light camera 52, and the speckle pattern of the modulated structured light is not affected by the display area 11 of the display screen 10, so that the interference of the display screen 10 can be avoided. As shown in fig. 6, the electronic device 1000 further includes a bracket 60, and the structured light camera 52 may be disposed on the same bracket 60 as the structured light projector 51 or may be separately mounted on the housing 40.

Referring to fig. 1-3 together, in some embodiments, the structured light assembly 50 further includes a floodlight 53, and the floodlight 53 can be used to emit supplemental light to the outside, and the supplemental light can be used to supplement the light intensity in the environment when the ambient light is weak. In one example, the supplemental light may be infrared light. After the supplemental light is emitted onto the target object and reflected by the target object, the supplemental light can be captured by the structured light camera 52 to obtain a two-dimensional image of the target object, and the two-dimensional image information can be used for identification. As shown in fig. 6, the floodlight 53 may be disposed on the same bracket 60 as the structured light projector 51 and the structured light camera 52. At this time, the supplementary light emitted by the floodlight 53 enters the external environment after passing through the second sub-region 22, and the reflected supplementary light can pass through the second sub-region 22 again to be received by the structured light camera 52.

Referring to fig. 4 and 5, in some embodiments, the structured light assembly 50 corresponds to the through-slot 14, the structured light projector 51 projects the structured light through the through-slot 14, and the structured light camera 52 is configured to receive the modulated structured light through the through-slot 14.

At this time, the light incident surface of the structured light camera 52 may be aligned with the through groove 14, and the structured light modulated by the target object passes through the through groove 14 and is received by the structured light camera 52. In this embodiment, because the modulated structured light does not need to pass through the microscopic gap of the display area 11, and is not diffracted again by the microscopic gap, the speckle image obtained by the structured light camera 52 is the speckle image modulated by the target object, and the processing difficulty of calculating the depth image based on the speckle image is reduced. In the examples of fig. 4 and 5, the structured light assembly 50 and the projection module 30 both correspond to the through slot 14. In other examples, the structured light assembly 50 and the projection module 30 correspond to different through slots 14, respectively.

Referring to fig. 6, in some embodiments, the electronic device 1000 further includes a bracket 60, and the structured light assembly 50 and the projection module 30 are disposed on the bracket 60. The projection module 30 is located right below the second sub-region 22.

In particular, the bracket 60 may be mounted on the housing 40 such that the projection module 30 is located directly below the second sub-region 22, i.e. the bracket 60 faces the second sub-region 22. When the projection module 30 and the structured light assembly 50 are mounted on the bracket 60, the projection module 30 and the structured light assembly 50 are opposite to the second sub-region 22.

Referring to fig. 7, in some embodiments, the electronic device 1000 further includes at least two brackets 60, the structured light assembly 50 is disposed on one bracket 60, and the projection module 30 is disposed on the other bracket 60. The projection module 30 is located right below the second sub-region 22. Wherein, the bracket 60 for mounting the structured light assembly 50 and the bracket 60 for mounting the projection module 30 are both opposite to the second sub-area 22. The two brackets 60 may be located on the same datum line (see fig. 7) or may be offset from each other to form a stepped configuration. For example, the bracket 60 on which the structured light assembly 50 is mounted is closer to the cover plate 20 than the bracket 60 on which the projection module 30 is mounted, so that the structured light assembly 50 can project structured light and receive modulated structured light more quickly.

Referring to fig. 8, in some embodiments, the electronic device 1000 further includes at least two brackets 60, the structured light assembly 50 is disposed on one bracket 60, and the projection module 30 is disposed on the other bracket 60. The projection module 30 is located at a side of the second sub-region 22. The bracket 60 for mounting the structured light assembly 50 may face the second sub-region 22, and the bracket 60 for mounting the projection module 30 may be located at a side of the second sub-region 22. For example, the housing 40 includes a top wall 41, a bottom wall 42, and a side wall 43 connecting the top wall 41 and the bottom wall 42, and the cover plate 20 is combined with the top wall 41. A bracket 60 for mounting the structured light assembly 50 is mounted on the bottom wall 42, and a bracket 60 for mounting the projection module 30 is mounted on the side wall 43. At this time, the projection module 30 projects the second image from the side toward the second sub-area 22.

Referring to fig. 1, 9 and 11 together, an embodiment of the present application provides a method for controlling an electronic device 1000. The electronic device 1000 includes a display screen 10, a cover plate 20, a projection module 30 and a structured light assembly 50. The display screen 10 is formed with a display area 11, and the display area 11 is used for displaying a first image. The cover plate 20 is disposed on the display screen 10. The cover plate 20 is formed with a first sub-area 21 and a second sub-area 22, and the first sub-area 21 corresponds to the display area 11. The projection module 30, the display screen 10 and the structured light assembly 50 are located on the same side of the cover plate 20. The projection module 30 is used for projecting a second image to the second sub-area 22. The structured light assembly 50 is arranged in correspondence with the second sub-area 22. The structured light assembly 50 includes a structured light projector 51 and a structured light camera 52, the structured light projected by the structured light projector 51 passes through the second sub-area 22 to the target object, and the structured light camera 52 is configured to receive the structured light modulated by the target object and passing through the second sub-area 22. The control method of the embodiment of the application comprises the following steps:

010, acquiring an exposure time sequence T2 of the structured light camera 52 receiving the modulated structured light;

020, processing the exposure timing T2 to obtain a projection timing T3 of the projection module 30, wherein the projection timing T3 is staggered with the exposure timing T2; and

030, control the projection module 30 to project the second image at the projection timing T3.

Referring to fig. 1 and 9 together, in some embodiments, the electronic device 1000 further includes a processor 200. The processor 200 is configured to obtain an exposure timing T2 when the structured light camera 52 receives the modulated structured light, process the exposure timing T2 to obtain a projection timing T3 of the projection module, wherein the projection timing T3 is staggered with the exposure timing T2, and control the projection module 30 to project the second image at the projection timing T3. That is, processor 200 may implement

steps

010, 020, and 030.

Referring to fig. 10, the present embodiment further provides a control device 100 of an electronic apparatus 1000. The electronic device 1000 includes a display screen 10, a cover plate 20, a projection module 30, and a structured light assembly 50. The display screen 10 is formed with a display area 11, and the display area 11 is used for displaying a first image. The cover plate 20 is disposed on the display screen 10. The cover plate 20 is formed with a first sub-area 21 and a second sub-area 22, and the first sub-area 21 corresponds to the display area 11. The projection module 30, the display screen 10 and the structured light assembly 50 are located on the same side of the cover plate 20. The projection module 30 is used for projecting a second image to the second sub-area 22. The structured light assembly 50 is arranged in correspondence with the second sub-area 22. The structured light assembly 50 includes a structured light projector 51 and a structured light camera 52, the structured light projected by the structured light projector 51 passes through the second sub-area 22 to the target object, and the structured light camera 52 is configured to receive the structured light modulated by the target object and passing through the second sub-area 22. The control device 100 according to the embodiment of the present application includes an acquisition module 101, a processing module 102, and a control module 103. The obtaining module 102 is configured to obtain an exposure timing T2 when the structured light camera 52 receives the modulated structured light. The processing module 102 is configured to process the exposure timing T2 to obtain a projection timing T3 of the projection module 30, wherein the projection timing T3 is staggered with the exposure timing T2. The control module 103 is used for controlling the projection module 30 to project the second image at the projection time sequence T3.

Specifically, after the structured light projected by the structured light projector 51 passes through the second sub-area 22 to the target object, the structured light camera 52 may receive the structured light modulated by the target object and passing through the second sub-area 22 at a certain exposure timing T2. Since the light projected by the projection module 30 may be reflected by the second sub-area 22 during the process of projecting the second image by the projection module 30, the reflected light may easily interfere with the structured light camera 52. For example, infrared light in light projected by the projection module 30 is reflected by the second sub-area 22, and if the structured light camera 52 receives the modulated structured light and the projection module 30 projects the second image simultaneously, the structured light camera 52 receives the modulated structured light including the infrared light projected by the projection module 30 and reflected by the second sub-area 22, so that when the received infrared light is used to calculate the depth of the target object, accurate depth information of the target object cannot be obtained. Therefore, in order to make the modulated structured light received by the structured light camera 52 not include the infrared light reflected by the second sub-region 22 and projected by the projection module 30, the exposure timing T2 of the structured light camera 52 must be shifted from the projection timing T3 of the projection module 30.

In the present embodiment, the exposure timing T2 of the structured light camera 52 is first acquired, and then the exposure timing T2 is processed to obtain the projection timing T3 of the projection module 30, so that the exposure timing T2 of the structured light camera 52 is shifted from the projection timing T3 of the projection module 30. Specifically, the projection timing T3 can be obtained by changing the phase of the exposure timing T2, such that the exposure timing T2 is staggered from the projection timing T3, that is, when the control signal of the structured light camera 52 is at a high level (the structured light camera 52 is turned on), the control signal of the projection module 30 is at a low level (the projection module 30 is turned off), and when the control signal of the structured light camera 52 is at a low level (the structured light camera 52 is turned off), the control signal of the projection module 30 is at a high level (the projection module 30 is turned on). Finally, the projection module 30 is controlled to project the second image at the projection timing T3. Therefore, when the structured light camera 52 receives the modulated structured light at the exposure timing T2 and the projection module 30 projects the second image at the projection timing T3 staggered from the exposure timing T2, the structured light received by the structured light camera 52 is mainly the structured light modulated by the target object, so that the depth of the target object obtained according to the structured light is accurate.

It should be noted that, in use, the structured light camera 52 and the structured light projector 51 may be turned on simultaneously, or the time interval between the turning on of the structured light camera 52 and the turning on of the structured light projector 51 is very small, so the above-mentioned time when the structured light camera 52 is turned on, that is, the time when the structured light projector 51 is turned on, can be regarded as the time.

In summary, in the control method and the control apparatus 100 of the electronic device 1000 according to the embodiment of the present application, when the structured light camera 52 receives the modulated structured light at the exposure timing T2, and the projection module 30 projects the second image at the projection timing T3 staggered from the exposure timing T2, the user can still view the second image when the user obtains the depth information by using the structured light element 50, and the projection module 30 is prevented from influencing the structured light camera 52 to receive the modulated structured light when projecting the second image, so that the depth information obtained by the structured light element 50 is more accurate.

Referring to fig. 11 and 12, in some embodiments, the display screen 10 displays the first image at a display time sequence T1. The control method further comprises the following steps:

040, determine whether the structured light camera 52 is on; and

050, when the structured light camera 52 is not turned on, the projection module 30 is controlled to project the second image at the display timing T1.

Referring to fig. 1 and 12, in some embodiments, the display screen 10 displays the first image at a display time sequence T1. The processor 200 is further configured to determine whether the structured light camera 52 is turned on, and control the projection module 30 to project the second image T3 in a display timing manner when the structured light camera 52 is not turned on. That is, the processor 200 may perform

steps

040 and 050.

When the electronic device 1000 needs to acquire the depth information of the target object, the structured light camera 52 needs to be turned on. When the electronic device 1000 can be used as a medium for displaying images only, it is not necessary to turn on the structured light camera 52. Therefore, by determining whether the structured light camera 52 is turned on, the application scene of the electronic device 1000 can be determined at present.

Specifically, the manner of determining whether the structured light camera 52 is turned on in step 040 includes multiple manners, for example, whether the voltage at two ends of the structured light camera 52 is the working voltage is detected, and if not, it indicates that the structured light camera 52 is not turned on. For example, whether the structured light camera 52 continuously outputs the photosensitive data is detected, and if not, it indicates that the structured light camera 52 is not turned on.

When it is determined that the structured light camera 52 is not turned on, it may be determined that the electronic device 1000 is not currently acquiring depth information of the target object. At this time, the electronic device 1000 may be used only as a medium for displaying images, that is, the display screen 10 may display the first image at the display timing T1, and the projection module 30 may project the second image at the same or different projection timing as the display timing T1. In the present embodiment, when the structured light camera 52 is not turned on, the projection module 30 is controlled to project the second image at the display timing T1, and the refresh frequency of the second image is the same as the projection frequency of the projection module 30, so that the electronic device 1000 can synchronously present the first image and the second image.

When the structured light camera 52 is turned on, it may be determined that the electronic device 1000 is currently acquiring depth information of a target object. At this time, steps 010, 020 and 030 are sequentially performed, that is, steps of obtaining the exposure timing T2 when the structured light camera 52 receives the modulated structured light, processing the exposure timing T2 to obtain the projection timing T3 of the projection module 30, interleaving the projection timing T3 with the exposure timing T2, and controlling the projection module 30 to project the second image at the projection timing T3 are performed, so that the projection module 30 projects the second image at the projection timing T3 interleaved with the exposure timing T2, thereby preventing the structured light camera 52 from being interfered by the light projected by the projection module 30.

Referring to fig. 1 and fig. 13 together, the present disclosure further provides a control method of an electronic device 1000. The electronic device 1000 includes a display screen 10, a cover plate 20, a projection module 30 and a structured light assembly 50. The display screen 10 is formed with a display area 11, and the display area 11 is used for displaying a first image. The cover plate 20 is disposed on the display screen 10. The cover plate 20 is formed with a first sub-area 21 and a second sub-area 22, and the first sub-area 21 corresponds to the display area 11. The projection module 30, the display screen 10 and the structured light assembly 50 are located on the same side of the cover plate 20. The projection module 30 is used for projecting a second image to the second sub-area 22. The structured light assembly 50 is arranged in correspondence with the second sub-area 22. The structured light assembly 50 includes a structured light projector 51 and a structured light camera 52, the structured light projected by the structured light projector 51 passes through the second sub-area 22 to the target object, and the structured light camera 52 is configured to receive the structured light modulated by the target object and passing through the second sub-area 22. The control method of the embodiment of the application comprises the following steps:

040, determine whether the structured light camera 52 is on; and

060, when the structured light camera 52 is turned on, the projection module 30 is controlled to be turned off.

Referring to fig. 1 and 13 together, in some embodiments, the electronic device 1000 further includes a processor 200. The processor 200 is further configured to determine whether the structured light camera 52 is turned on, and control the projection module 30 to turn off when the structured light camera 52 is turned on. That is, the processor 200 may also perform

steps

040 and 060.

Referring to fig. 1 and 14, the present embodiment further provides a control device 100 of an electronic apparatus 1000. The electronic device 1000 includes a display screen 10, a cover plate 20, a projection module 30 and a structured light assembly 50. The display screen 10 is formed with a display area 11, and the display area 11 is used for displaying a first image. The cover plate 20 is disposed on the display screen 10. The cover plate 20 is formed with a first sub-area 21 and a second sub-area 22, and the first sub-area 21 corresponds to the display area 11. The projection module 30, the display screen 10 and the structured light assembly 50 are located on the same side of the cover plate 20. The projection module 30 is used for projecting a second image to the second sub-area 22. The structured light assembly 50 is arranged in correspondence with the second sub-area 22. The structured light assembly 50 includes a structured light projector 51 and a structured light camera 52, the structured light projected by the structured light projector 51 passes through the second sub-area 22 to the target object, and the structured light camera 52 is configured to receive the structured light modulated by the target object and passing through the second sub-area 22. The control device 100 according to the embodiment of the present application includes a determination module 104 and a control module 103. The determining module 104 is used for determining whether the structured light camera 52 is turned on. The control module 103 is used for controlling the projection module 30 to be closed when the structured light camera 52 is turned on.

In the present embodiment, when it is determined that the structured light camera 52 is turned on, it is determined that the electronic device 1000 needs to perform the step of acquiring the depth information of the target object. At this time, the projection module 30 is turned off, so that the structured light camera 52 is prevented from being influenced by the second image projected by the projection module 30 when receiving the modulated structured light, and the depth information obtained by the structured light component 50 is more accurate.

When it is determined that the structured light camera 52 is not turned on, the projection module 30 may be controlled to project the second image to the second sub-area 22, that is, step 070 shown in fig. 13 is implemented, so that the projection module 30 projects the second image to the second sub-area 22 at the same projection timing T2 as or different from the display timing T1 of the display screen 10, and the electronic device 1000 can present the first image and the second image at the same time, thereby enlarging the area of the electronic device 1000 for displaying the image.

In summary, in the control method and the control apparatus 100 of the electronic device 1000 according to the embodiment of the present application, when the structured light camera 52 is determined to be turned on, the projection module 30 is turned off, so that the projection module 30 cannot project the second image, and the structured light camera 52 is prevented from being influenced by the second image projected by the projection module 30 when receiving the modulated structured light, and the depth information obtained by the structured light element 50 is relatively accurate.

In this application, unless expressly stated or limited otherwise, the first feature "on" or "under" the second feature may be directly contacting the first and second features or indirectly contacting the first and second features through intervening media. Also, a first feature "on," "over," and "above" a second feature may be directly or diagonally above the second feature, or may simply indicate that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature may be directly under or obliquely under the first feature, or may simply mean that the first feature is at a lesser elevation than the second feature.

In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction. Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.

The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory. It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments. In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium. The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims

1. an electronic device, is characterized in that, comprises:

a display screen, the display screen is formed with a display area, and the display area is used to display the first image;

a cover plate, the cover plate is disposed on the display screen, the cover plate is formed with a first sub-area and a second sub-area, and the first sub-area corresponds to the display area;

a projection module, wherein the projection module and the display screen are located on the same side of the cover plate, and the projection module is used for projecting a second image to the second sub-region;

A structured light assembly, the structured light assembly and the display screen are located on the same side of the cover plate, the structured light assembly is arranged corresponding to the second sub-area, and the structured light assembly includes a structured light projector and a structure a light camera, the structured light projected by the structured light projector passes through the second sub-area to the target object, and the structured light camera is used for receiving the modulated structured light passing through the second sub-area; and

a processor, wherein the processor is configured to: when the structured light camera is turned on, acquire the exposure timing of the structured light camera receiving the modulated structured light;

processing the exposure timing to obtain the projection timing of the projection module, the projection timing is interleaved with the exposure timing, and the projection timing is obtained by changing the phase of the exposure timing; and

The projection module is controlled to project the second image at the projection timing.

2 . The electronic device according to claim 1 , wherein the electronic device further comprises a bracket, the structured light assembly and the projection module are both arranged on the bracket, and the projection module is located in the bracket. 3 . directly below the second sub-region.

3 . The electronic device according to claim 1 , wherein the electronic device further comprises at least two brackets, the structured light assembly is arranged on one of the brackets, and the projection module is arranged on the other bracket. 4 . On the bracket, the projection module is located directly below the second sub-region.

4 . The electronic device according to claim 1 , wherein the electronic device further comprises at least two brackets, the structured light assembly is arranged on one of the brackets, and the projection module is arranged on the other bracket. 5 . On the bracket, the projection module is located on one side of the second sub-region.

5. The electronic device according to claim 1, wherein the display screen displays the first image in a display sequence, and the processor is further configured to:

Determine whether the structured light camera is turned on;

When the structured light camera is not turned on, controlling the projection module to project the second image at the display timing; and

When the structured light camera is turned on, the step of acquiring the exposure timing sequence of the structured light camera receiving the modulated structured light is performed.

6. A control method for electronic equipment, wherein the electronic equipment comprises a display screen, a cover plate, a projection module and a structured light assembly, and the display screen is formed with a display area, and the display area is used to display the first An image, the cover plate is disposed on the display screen, the cover plate is formed with a first sub-area and a second sub-area, the first sub-area corresponds to the display area, the projection module, The display screen and the structured light assembly are located on the same side of the cover plate, the projection module is used to project a second image to the second sub-area, the structured light assembly and the second sub-area The regions are set correspondingly, the structured light assembly includes a structured light projector and a structured light camera, the structured light projected by the structured light projector passes through the second sub-region to the target object, and the structured light camera is used to receive the The target object modulates and passes through the structured light of the second sub-region, and the control method includes:

When the structured light camera is turned on, acquiring the exposure timing of the structured light camera receiving the modulated structured light;

processing the exposure sequence to obtain a projection sequence of the projection module, the projection sequence being interleaved with the exposure sequence; and

7 . The control method according to claim 6 , wherein the display screen displays the first image in a display sequence, and the control method further comprises: 8 .

Determine whether the structured light camera is turned on;

8. A control device for electronic equipment, wherein the electronic equipment comprises a display screen, a cover plate, a projection module and a structured light assembly, the display screen is formed with a display area, and the display area is used to display the first An image, the cover plate is disposed on the display screen, the cover plate is formed with a first sub-area and a second sub-area, the first sub-area corresponds to the display area, the projection module, The display screen and the structured light assembly are located on the same side of the cover plate, the projection module is used to project a second image to the second sub-area, the structured light assembly and the second sub-area The regions are set correspondingly, the structured light assembly includes a structured light projector and a structured light camera, the structured light projected by the structured light projector passes through the second sub-region to the target object, and the structured light camera is used to receive the The target object modulates and passes through the structured light of the second sub-region, and the control device includes:

an acquisition module, when the structured light camera is turned on, the acquisition module is configured to acquire the exposure timing of the structured light camera receiving the modulated structured light;

a processing module, the processing module is configured to process the exposure timing to obtain the projection timing of the projection module, the projection timing is interleaved with the exposure timing; and

The control module is used for controlling the projection module to project the second image at the projection timing.