CN109327578B - Electronic device and its control method and control device - Google Patents

Abstract

The application discloses an electronic device and a control method and a control device thereof. The electronic device includes a display screen and a structured light assembly. The display screen comprises a display area for displaying images, wherein the front and the back of the display area are opposite to each other, and the display screen comprises a first sub-screen capable of being independently controlled to form a first sub-display area and a second sub-screen capable of forming a second sub-display area. The structured light assembly comprises a structured light camera which is arranged on one side of the back of the display screen, and the structured light camera is used for receiving the modulated laser passing through the first sub-display area. When the structured light camera is started, the first sub-display area displays images at a first display time sequence, the structured light camera performs exposure at an exposure time sequence, and the first display time sequence is staggered with the effective working state corresponding to the exposure time sequence. Because the structure light camera sets up in the back place one side of display screen, need not set up the trompil of aiming at with the structure light camera on the display screen, electron device's screen accounts for than higher.

Description

Electronic device and its control method and control device

technical field

The present application relates to the technical field of consumer electronics, and more particularly, to an electronic device, a control method for the electronic device, and a control device for the electronic device.

Background technique

In the related art, in order to make the functions of the electronic device more diverse, the electronic device is provided with a depth image acquisition module to acquire the depth information of the scene, however, the depth image acquisition module is arranged on the front of the electronic device (with a display screen). side), the screen-to-body ratio of the electronic device will be reduced.

SUMMARY OF THE INVENTION

Embodiments of the present application provide an electronic device, a control method for the electronic device, and a control device for the electronic device.

The electronic device of the embodiment of the present application includes a display screen and a structured light assembly. The display screen includes a display area for displaying images, the display area is formed with opposite front and back sides, the light emitted by the display screen is emitted to the outside along the direction of the back side pointing to the front side, and the display screen is The screen includes a first sub-screen and a second sub-screen that can be independently controlled, the first sub-screen forms a first sub-display area, and the second sub-screen forms a second sub-display area. The structured light assembly includes a structured light camera, the structured light camera is arranged on the side where the back of the display screen is located, the structured light camera corresponds to the first sub-display area, and the structured light camera is used for for receiving the modulated laser light passing through the first sub-display area. When the structured light camera is turned on, the first sub-display area displays the image at a first display timing, the structured light camera is exposed at an exposure timing, and the effective working state corresponding to the first display timing is the same as that of the first display timing. The effective working states corresponding to the exposure timings are staggered.

The control method of the embodiment of the present application can be used in an electronic device, and the electronic device includes a display screen and a structured light assembly. The display screen includes a display area for displaying images, the display area is formed with opposite front and back sides, the light emitted by the display screen is emitted to the outside along the direction of the back side pointing to the front side, and the display screen is The screen includes a first sub-screen and a second sub-screen that can be independently controlled, the first sub-screen forms a first sub-display area, and the second sub-screen forms a second sub-display area. The structured light assembly includes a structured light camera, the structured light camera is arranged on the side where the back of the display screen is located, the structured light camera corresponds to the first sub-display area, and the structured light camera is used for for receiving the modulated laser light passing through the first sub-display area. The control method includes: judging whether the structured light camera is turned on; when the structured light camera is turned on, controlling the first sub-display area to display the image at a first display timing, and the structured light camera at an exposure timing Exposure is performed, and the effective working state corresponding to the first display timing sequence is staggered from the effective working state corresponding to the exposure timing sequence.

The control device of the embodiment of the present application can be used in an electronic device, and the electronic device includes a display screen and a structured light assembly. The display screen includes a display area for displaying images, the display area is formed with opposite front and back sides, the light emitted by the display screen is emitted to the outside along the direction of the back side pointing to the front side, and the display screen is The screen includes a first sub-screen and a second sub-screen that can be independently controlled, the first sub-screen forms a first sub-display area, and the second sub-screen forms a second sub-display area. The structured light assembly includes a structured light camera, the structured light camera is arranged on the side where the back of the display screen is located, the structured light camera corresponds to the first sub-display area, and the structured light camera is used for for receiving the modulated laser light passing through the first sub-display area. The control device includes a judgment module and a control module. The judging module is used for judging whether the structured light camera is turned on. The control module is configured to control the first sub-display area to display the image at a first display timing when the structured light camera is turned on, and the structured light camera to perform exposure at an exposure timing, and the first display timing The corresponding effective working state is staggered from the effective working state corresponding to the exposure sequence.

In the electronic device, the control method for the electronic device, and the control device for the electronic device according to the embodiments of the present application, since the structured light camera is arranged on the side where the back of the display screen is located, the display screen does not need to have an opening aligned with the structured light camera , the screen ratio of electronic devices is relatively high. In addition, when the structured light camera is turned on, the effective working state corresponding to the exposure timing of the structured light camera is staggered from the effective working state corresponding to the first display timing, thereby reducing or avoiding interference to the structured light camera when displaying images in the display area.

Additional aspects and advantages of embodiments of the present application will be set forth, in part, in the following description, and in part will be apparent from the following description, or learned by practice of embodiments of the present application.

Description of drawings

The above and/or additional aspects and advantages of the present application will become apparent and readily understood from the following description of embodiments taken in conjunction with the accompanying drawings, wherein:

FIG. 1 is a schematic structural diagram of an electronic device according to some embodiments of the present application.

FIG. 2 is a partial structural schematic diagram of an electronic device according to some embodiments of the present application.

FIG. 3 is a schematic cross-sectional view of the electronic device according to some embodiments of the present application along the line A-A shown in FIG. 2 .

FIG. 4 is a schematic structural diagram of a structured light projector according to some embodiments of the present application.

FIG. 5 is a schematic cross-sectional view of the electronic device according to some embodiments of the present application along the line A-A shown in FIG. 2 .

FIG. 6 and FIG. 7 are partial structural schematic diagrams of electronic devices according to some embodiments of the present application.

FIG. 8 is a schematic cross-sectional view of the electronic device according to some embodiments of the present application along the line A-A shown in FIG. 2 .

FIG. 9 and FIG. 10 are partial structural schematic diagrams of electronic devices according to some embodiments of the present application.

11 to 15 are schematic cross-sectional views of the electronic device according to some embodiments of the present application along the position corresponding to the line A-A shown in FIG. 2 .

FIG. 16 is a schematic flowchart of a control method of an electronic device according to some embodiments of the present application.

FIG. 17 is a schematic block diagram of a control device of an electronic device according to some embodiments of the present application.

FIG. 18 is a schematic flowchart of a control method of an electronic device according to some embodiments of the present application.

FIG. 19 is a partial structural schematic diagram of an electronic device according to some embodiments of the present application.

FIG. 20 is an exploded schematic view of a display screen of some embodiments of the present application.

21 to 24 are schematic diagrams of the first display timing, the second display timing and the exposure timing of some embodiments of the present application.

25 and 26 are schematic flowcharts of control methods for electronic devices according to some embodiments of the present application.

FIG. 27 is a partial structural schematic diagram of an LCD display screen according to some embodiments of the present application.

FIG. 28 is a partial structural schematic diagram of an OLED display screen according to some embodiments of the present application.

FIG. 29 and FIG. 30 are partial structural schematic diagrams of Micro LED display screens according to some embodiments of the present application.

Detailed ways

The embodiments of the present application will be further described below with reference to the accompanying drawings. The same or similar reference numbers refer to the same or similar elements or elements having the same or similar functions throughout the drawings.

In addition, the embodiments of the present application described below in conjunction with the accompanying drawings are exemplary, only used to explain the embodiments of the present application, and should not be construed as limitations on the present application.

In this application, unless otherwise expressly stated and defined, a first feature "on" or "under" a second feature may be in direct contact with the first and second features, or the first and second features indirectly through an intermediary touch. Also, the first feature being "above", "over" and "above" the second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is level higher than the second feature. The first feature being "below", "below" and "below" the second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature has a lower level than the second feature.

Please refer to FIG. 1 and FIG. 2 , the electronic device 1000 according to the embodiment of the present application includes a display screen 10 and a structured light assembly 20 . The electronic device 1000 may further include a housing 30, which may be used to install functional devices such as the display screen 10 and the structured light assembly 20, and the functional devices may also be a motherboard, a dual-camera module, a receiver, and the like. The specific form of the electronic device 1000 can be a mobile phone, a tablet computer, a smart watch, a head-mounted display device, etc. This application uses the electronic device 1000 as a mobile phone for description. It can be understood that the specific form of the electronic device 1000 is not limited to a mobile phone, and is not limited here.

The display screen 10 may be installed on the housing 30 , specifically, the display screen 10 may be installed on one surface of the housing 30 , or simultaneously installed on two opposite surfaces of the housing 30 . In the example shown in FIG. 1, the display screen 10 is installed on the front of the housing 30, and the display screen 10 can cover 85% and more of the area of the front, such as 85%, 86%, 87%, 88%, 89%, 90%, 91%, 92%, 93%, 95% or even 100%. The display screen 10 may be used to display images, and the images may be text, images, videos, icons and other information.

The display screen 10 includes a display area 11, and the display area 11 can be used for displaying images. To adapt to different types of electronic devices 1000 and the needs of different users, the shape of the display area 11 can be in the shape of a circle, an ellipse, a racetrack, a rectangle with rounded corners, a rectangle and the like.

Please refer to FIG. 3 , the display area 11 is formed with a front side 12 and a back side 13 opposite to each other. The display area 11 can be used to display images. The light emitted by the display screen 10 is emitted outward along the direction of the back side 13 and the front side 12, and when the light passes through It is received by the user after passing through the front surface 12 , that is, the user can observe the image displayed on the display screen 10 from the front surface 12 . Please refer to FIG. 1 , it can be understood that the front surface 12 is the display surface, and the back surface 13 is the surface opposite to the display surface. Both the front side 12 and the back side 13 may be flat or curved.

In some examples, the display screen 10 may further include a non-display area, and the non-display area may be formed on the periphery of the display area 11 . The non-display area may not be used for display. The non-display area may be combined with the casing 30 or used for wiring. For example, the non-display area and the casing 30 may be bonded by adhesive without affecting the display function of the display area 11 . The display screen 10 may also be a touch display screen integrated with a touch function. After acquiring the image information displayed on the display screen 10 , the user can touch the display screen 10 to realize a predetermined interactive operation.

Referring to FIG. 1 again, in some embodiments, the display area 11 includes a plurality of pixels, the plurality of pixels are arranged in a predetermined manner, and there are microscopic gaps between adjacent pixels. The display area 11 includes a first sub-display area 111 and a second sub-display area 112 . The pixel density of the first sub-display area 111 is smaller than that of the second sub-display area 112 .

The pixel density of the first sub-display area 111 is smaller than that of the second sub-display area 112 , that is, the microscopic gap of the first sub-display area 111 is larger than the microscopic gap of the second sub-display area 112 . The blocking effect of light is small, and the transmittance of light passing through the first sub-display area 111 is relatively high.

In some embodiments, the pixel density of the first sub-display area 111 is greater than that of the second sub-display area 112 , or the pixel density of the first sub-display area 111 is equal to the pixel density of the second sub-display area 112 .

In some embodiments, the shapes of the first sub-display area 111 and the second sub-display area 112 can be set according to specific requirements, which are not limited here. etc., the second sub-display area 112 and the first sub-display area 111 may complement each other and together form the display area 11 in the shape of a rectangle or a rounded rectangle. The first sub-display area 111 may be located near the edge of the display area 11 , and the second sub-display area 112 may be located in the middle of the display area 11 . The first sub-display area 111 may be used to display status icons of the electronic device 1000 , for example, used to display the battery level, network connection status, system time and the like of the electronic device 1000 .

The structured light component 20 can acquire depth information of a target object by using structured light for three-dimensional modeling, three-dimensional image generation, ranging, and the like. The structured light assembly 20 may be installed in the casing 30 of the electronic device 1000 , and specifically, after being installed on the bracket, the bracket and the structured light assembly 20 may be installed in the casing 30 together. The structured light assembly 20 may include a structured light projector 21 , a structured light camera 22 and a flood light 23 .

Please refer to FIGS. 1 to 4 , the structured light projector 21 is arranged on the side where the back surface 13 of the display screen 10 is located, or in other words, the structured light projector 21 is arranged below the display area 11 (for example, it can be arranged in the first sub-display area) 111 ), the structured light projector 21 is used to emit laser light passing through the display area 11 . Specifically, the structured light projector 21 may include a light source 211 , a collimating element 212 and a diffractive optical element 213 . The light (for example, infrared laser) emitted by the light source 211 is first collimated by the collimating element 212 , and then diffracted by the diffractive optical element 213 . It is emitted from the structured light projector 21 and then passes through the display area 11 to be projected to the outside world. Diffraction occurs when light passes through the microscopic gap, that is, the microscopic gap of the display area 11 and the diffractive structure on the diffractive optical element 213 both have a diffractive effect on the light emitted by the light source 211 .

The laser light passing through the display area 11 and entering the outside world may contain both a pattern diffracted by the diffractive optical element 213 (the pattern includes a plurality of spots diffracted by the diffractive optical element 213 ), and a pattern diffracted by the microscopic gap of the display screen 10 (the pattern includes a plurality of spots diffracted by the diffractive optical element 213 and then diffracted by the display screen 10), so that the speckle pattern after passing through the display area 11 has a high irrelevance, which is conducive to the subsequent analysis of the obtained speckle pattern. The spot pattern is processed. In one example, the transmittance of the display area 11 can reach 60% or more, so that the laser light emitted by the structured light projector 21 has less loss when passing through the display area 11 .

The structured light camera 22 can be an infrared camera. The laser is emitted to the target object, and after being modulated by the target object, it can be acquired by the structured light camera 22. After the structured light camera 22 receives the modulated laser light, a speckle image is obtained, and the speckle image is processed. Get the depth data of the target object. The structured light camera 22 can also be arranged on the side where the back surface 13 of the display screen 10 is located, that is, arranged under the display screen 10 (for example, it can be arranged under the first sub-display area 111 ), and specifically can be arranged with the structured light projector 21 on the side of the display screen 10 . On the same bracket, or the structured light camera 22 is directly mounted on the housing 30 . At this time, the light incident surface of the structured light camera 22 can be aligned with the display area 11, and the laser modulated by the target object passes through the display area 11 and is then received by the structured light camera 22. Specifically, the laser light modulated by the target object can be After the microscopic gap of the display screen 10 is diffracted, it is received by the structured light camera 22 .

The flood light 23 can be used to emit supplementary light outward, and the supplementary light can be used to supplement the light intensity in the environment when the ambient light is weak. In one example, the supplemental light can be infrared light. After the supplementary light is emitted to the target object and reflected by the target object, it can be acquired by the structured light camera 22 to obtain a two-dimensional image of the target object, and the two-dimensional image information can be used for identification. The floodlight 23 can also be arranged on the side where the back surface 13 of the display screen 10 is located, that is, arranged under the display screen 10 (for example, it can be arranged under the first sub-display area 111 ). The light camera 22 is arranged on the same bracket. At this time, the supplementary light emitted by the floodlight 23 passes through the microscopic gap of the display area 11 and enters the external environment, and the reflected supplementary light can pass through the microscopic gap again to be received by the structured light camera 22 .

To sum up, since the structured light camera 22 is disposed on the side of the back surface 13 of the display screen 10 , the display screen 10 does not need to have an opening aligned with the structured light camera 22 , and the screen ratio of the electronic device 1000 is relatively high. In addition, in the embodiment of the present application, the structured light assembly 20 is arranged below the display screen 10. Compared with the time of flight that can collect depth information, the resolution of the depth image obtained by the structured light assembly 20 is higher. Using higher-resolution depth images can improve the accuracy of face recognition, and using higher-resolution depth images in 3D scene modeling can improve the matching degree between the modeled 3D scene and the actual scene.

If the structured light projector 21 is disposed under the display screen 10, the laser light projected by the structured light projector 21 will be affected by the microscopic gaps in the display screen 10 when passing through the first sub-display area 111, that is, the scattered light projected into the scene The spots in the spot image include both the spots formed by the first diffraction of the laser light by the diffractive optical element 213 of the structured light projector 21 , and the spots formed by the first diffraction of the laser light by the diffractive optical element 213 and then by the second diffraction of the display screen 10 . The structured light camera 22 is arranged under the display screen 10, and the structured light camera 10 receives the laser light diffracted by the display screen 10 when it is reflected by the target object and passes through the display screen 10, then the speckle image collected by the structured light camera 22 is in the speckle image. The spots also include spots formed by the laser being diffracted only once by the diffractive optical element 213 and reflected by the target object, spots formed by the laser being diffracted once by the diffractive optical element 213 and then diffracted by the display screen 10 twice and reflected by the target object, and the laser beam diffracted by the target object. The optical element 213 is diffracted once and then diffracted twice by the display screen 10 and is reflected by the target object, and a spot is formed by the third diffraction of the display screen 10 again. When calculating the depth image, the following two calculation methods are included:

(1) Depth calculation is performed directly based on all the spots in the speckle image. At this time, the reference spot in the reference image also includes the reference spot formed by the laser diffracted by the diffractive optical element 213 only once and reflected by the calibration object. The reference spot formed by the reflection and the reference spot formed by the third diffraction of the display screen 10 after the laser is diffracted once by the diffractive optical element 213 and then diffracted for the second time by the display screen 10 and reflected by the calibration object.

(2) Only the spots formed by the laser light diffracted once by the emitting optical element 213 and reflected by the target object are left, and the remaining spots are filtered out, so as to calculate the depth according to the remaining spots. At this time, the reference spot in the reference image only includes the reference spot formed by the laser light diffracted only once by the incident optical element 213 and reflected by the calibration object. Among them, the brightness of the spots formed after different diffraction orders is different. Therefore, various kinds of spots can be distinguished by the brightness, so that unnecessary spots can be filtered out.

If the structured light projector 21 is disposed under the display screen 10, and the laser beam projected by the structured light projector 21 passes through the display screen 10 without being affected by the microscopic gap of the display screen 10 (that is, the display screen 10 is formed with the display screen 10 shown in FIG. 5 ). Through slot 14), the spots in the speckle image collected by the structured light camera 22 disposed under the display screen 10 also include the spots formed by the laser light diffracted only once by the diffractive optical element 213 and reflected by the target object, and the laser light passing through the diffractive optics. The spot formed by the second diffraction of the display screen 10 after the element 213 is first diffracted and reflected by the target object. When calculating the depth image, the following two calculation methods are included:

(1) Depth calculation is performed directly based on all the spots in the speckle image. At this time, the reference spot in the reference image also includes the reference spot formed by the laser light diffracted by the diffractive optical element 213 only once and reflected by the calibration object, and the laser light diffracted once by the diffractive optical element 213 and reflected by the calibration object. Reference spot formed by secondary diffraction.

(2) Only the spots formed by the laser light diffracted once by the emitting optical element 213 and reflected by the target object are left, and the remaining spots are filtered out, so as to calculate the depth according to the remaining spots. At this time, the reference spot in the reference image only includes the reference spot formed by the laser light diffracted only once by the incident optical element 213 and reflected by the calibration object. Among them, the brightness of the spots formed after different diffraction orders is different. Therefore, various kinds of spots can be distinguished by the brightness, so that unnecessary spots can be filtered out.

Referring to FIG. 5 , in some embodiments, the display screen 10 is formed with a through slot 14 , and the through slot 14 does not have a display function. The through groove 14 penetrates through the front surface 12 and the back surface 13 . While the structured light projector 21 is disposed on the side where the back surface 13 of the display screen 10 is located, the structured light projector 21 is used for emitting the laser light passing through the through slot 14 . In one embodiment, the through grooves 14 may be opened on the first sub-display area 111 .

At this time, the light emitting surface of the structured light projector 21 can be aligned with the through slot 14 , and the laser light emitted by the structured light projector 21 passes through the through slot 14 and then enters the outside world. In this embodiment, the laser light entering the outside world does not need to pass through the microscopic gap of the display area 11, and will not be diffracted again by the microscopic gap, so that after the speckle image is acquired by the structured light camera 22, the subsequent calculation of the depth image based on the speckle image can be reduced. processing difficulty.

Specifically, in the example shown in FIG. 6 , the through groove 14 includes a notch 141 formed on the edge of the display screen 10 , or in other words, the through groove 14 intersects the edge of the display screen 10 . Specifically, the notch 141 may be formed on any one or more edges of the display screen 10 such as the upper edge, the lower edge, the left edge, the right edge, and the like. The shape of the notch 141 may be any shape such as triangle, semicircle, rectangle, racetrack shape, etc., which is not limited herein.

In the example shown in FIG. 7 , the through-slot 14 includes through-holes 142 spaced from the edge of the display screen 10 , or in other words, the through-slot 14 is opened within the range enclosed by the edge of the display screen 10 . Specifically, the through hole 142 may be close to any one or more edges such as the upper edge, the lower edge, the left edge, and the right edge of the display screen 10 . The shape of the through hole 142 may be any shape such as a triangle, a circle, a rectangle, a racetrack, etc., which is not limited herein.

In some examples, the through groove 14 may also include the above-mentioned notches 141 and through holes 142 at the same time. The numbers of the notches 141 and the through holes 142 may be equal or unequal.

Referring to FIG. 8 , in some embodiments, the floodlight 23 is arranged on the side where the back surface 13 of the display screen 10 is located, and the floodlight 23 is used to emit supplementary light passing through the through slot 14 .

At this time, the supplementary light is directly emitted to the outside after passing through the through slot 14, and the supplementary light will not be weakened in the process of passing through the display area 11, so as to ensure that the target object receives a large amount of supplementary light.

Similar to the structured light projector 21 , as shown in FIG. 9 , the through groove 14 includes a notch 141 formed on the edge of the display screen 10 , or in other words, the through groove 14 intersects the edge of the display screen 10 . Specifically, the notch 141 may be formed on any one or more edges of the display screen 10 such as the upper edge, the lower edge, the left edge, the right edge, and the like. The shape of the notch 141 may be any shape such as triangle, semicircle, rectangle, racetrack shape, etc., which is not limited herein.

Alternatively, as shown in FIG. 10 , the through-slot 14 includes through-holes 142 spaced from the edge of the display screen 10 , or in other words, the through-slot 14 is opened within the range enclosed by the edge of the display screen 10 . Specifically, the through hole 142 may be close to any one or more edges such as the upper edge, the lower edge, the left edge, and the right edge of the display screen 10 . The shape of the through hole 142 may be any shape such as a triangle, a circle, a rectangle, a racetrack, etc., which is not limited herein.

In addition, in the examples shown in FIGS. 8 to 10 , the floodlight 23 and the structured light projector 21 may correspond to the same through slot 14 . In the example shown in FIG. 11 , the floodlight 23 and the structured light projector 21 may correspond to different through slots 14 .

Referring to FIGS. 3 , 5 , 8 and 11 , in some embodiments, the electronic device 1000 further includes a cover plate 40 , and the cover plate 40 is disposed on the side where the front surface 12 of the display screen 10 is located. When the display screen 10 is provided with the through groove 14 , the infrared transmission layer 50 is disposed on the area of the cover plate 40 corresponding to the through groove 14 .

The cover plate 40 may be made of a material with better light transmittance such as glass or sapphire. The infrared transmission layer 50 can be an infrared transmission ink or an infrared transmission film. The infrared transmission layer 50 has a high transmittance to infrared light (for example, light with a wavelength of 940 nanometers), for example, the transmittance can reach 85%. or above, and the transmittance of light other than infrared light is low or completely impermeable to light other than infrared light. Therefore, it is difficult for the user to see the structured light projector 21 or the floodlight 23 aligned with the through-slot 14 through the cover plate 40 , and the appearance of the electronic device 1000 is more beautiful.

In some embodiments, the infrared transmission layer 50 is formed in the area of the cover plate 40 corresponding to the first sub-display area 111 .

Referring to FIG. 12 , in some embodiments, the electronic device 1000 further includes a cover plate 40 , the cover plate 40 is disposed on the side where the front surface 12 of the display screen 10 is located, and the area of the cover plate 40 corresponding to the structured light projector 21 An infrared antireflection film 60 is formed.

The infrared antireflection film 60 can increase the transmittance of infrared light. When the structured light projector 21 projects infrared laser light, the infrared antireflection film 60 can increase the transmittance of the infrared laser light passing through the cover plate 40 to reduce the infrared laser light passing through. The loss when the cover plate 40 is used, thereby reducing the power consumption of the electronic device 1000 . Specifically, the infrared anti-reflection film 60 may be coated on the upper surface, the lower surface, or both the upper surface and the lower surface of the cover plate 40 .

Certainly, an infrared anti-reflection film 60 may also be formed in the area of the cover plate 40 corresponding to the structured light camera 22 to reduce the loss of the outside infrared light passing through the cover plate 40 before reaching the structured light camera 22 . An infrared anti-reflection film 60 may also be formed on the area of the cover plate 40 corresponding to the floodlight 23 to reduce the loss of the supplementary light emitted by the floodlight 23 when passing through the cover plate 40 . At this time, a visible light antireflection film 80 may be formed on the area of the cover plate 40 that does not correspond to the structured light projector 21 , the structured light camera 22 and the floodlight 23 , so as to improve the visibility of the visible light emitted by the display screen 10 when passing through the cover plate 40 . transmittance.

Referring to FIG. 13 , in some embodiments, the area of the display screen 10 corresponding to the structured light projector 21 is formed with an infrared anti-reflection film 60 .

The infrared anti-reflection film 60 can increase the transmittance of infrared light. When the structured light projector 21 projects infrared laser light, the infrared anti-reflection film 60 can increase the transmittance of the infrared laser light passing through the display screen 10 to reduce the infrared laser light passing through. The loss when the display screen 10 is used, thereby reducing the power consumption of the electronic device 1000 . Specifically, the infrared anti-reflection film 60 may be formed on the front side 12 or the back side 13 of the display area 11 , or on the front side 12 or the back side 13 of the display area 11 at the same time. In one example, the infrared anti-reflection film 60 can also be formed inside the display screen 10. For example, when the display screen 10 is a liquid crystal display screen, the infrared anti-reflection film 60 can be formed on the polarizer in the display screen 10, or formed on the The electrode plate of the display screen 10, etc.

Certainly, when the through-slot 14 is not provided in the position corresponding to the display screen 10 and the structured light projector 21 , the infrared anti-reflection film 60 may also be formed in the area corresponding to the display screen 10 and the structured light projector 21 . When the through-slot 14 is not provided at the position corresponding to the display screen 10 and the floodlight 23 , the infrared antireflection film 60 may also be formed in the area corresponding to the display screen 10 and the floodlight 23 .

Referring to FIG. 14 , in some embodiments, an infrared transmission layer 50 is formed in a region of the display screen 10 corresponding to the structured light camera 22 . As mentioned above, the infrared transmission layer 50 has a high transmittance for infrared light, but a low transmittance for light other than infrared light (such as visible light) or completely impermeable to light other than infrared light (such as visible light). However, it is difficult for the user to see the structured light camera 22 .

At the same time, when the through-slot 14 is not provided in the position corresponding to the display screen 10 and the structured light projector 21, the infrared transmission layer 50 may also be formed in the area corresponding to the display screen 10 and the structured light projector 21, so that it is difficult for the user to see the structure Light projector 21 . When the through-slot 14 is not provided at the position corresponding to the display screen 10 and the floodlight 23 , the infrared transmission layer 50 may also be formed in the area corresponding to the display screen 10 and the floodlight 23 . In one embodiment, an infrared transmission layer 50 is formed in an area of the display screen 10 corresponding to the first sub-display area 111 .

Referring to FIG. 15 , in some embodiments, the display screen 10 is formed with through grooves 14 extending through the front surface 12 and the back surface 13 . The electronic device 1000 further includes a visible light camera 70 , and the visible light camera 70 is aligned with the through slot 14 . A visible light anti-reflection film 80 and/or an infrared cut-off film 90 are formed on the cover plate 40 in a region corresponding to the through groove 14 .

The visible light camera 70 may be used to receive visible light passing through the cover plate 40 and the through slot 14 to obtain images. Forming the visible light anti-reflection film 80 on the cover plate 40 in the area corresponding to the through groove 14 can increase the transmittance of visible light when passing through the cover plate 40 , so as to improve the imaging quality of the visible light camera 70 . Forming the infrared cut-off film 90 on the cover plate 40 in the area corresponding to the through groove 14 can reduce the transmittance of infrared light when passing through the cover plate 40 , or completely prevent the infrared light from entering the visible light camera 70 , so as to reduce the effect of infrared light on the visible light camera 70 Imaging effects.

Referring to FIG. 16 , an embodiment of the present application provides a control method, which can be used for the electronic device 1000 of any of the foregoing embodiments. The first sub-display area 111 and the second sub-display area 112 can be independently controlled, the structured light camera 22 corresponds to the first sub-display area 111, and the control method includes:

01: Determine whether the structured light camera 22 is turned on;

02: When the structured light camera 22 is turned on, the first sub-display area 111 is controlled to display images at the first display timing, and the structured light camera 22 is exposed at the exposure timing, and the effective working state corresponding to the first display timing is valid. The working status is staggered.

Please refer to FIG. 17 , the control method of the embodiment of the present application can be implemented by the control device 400 of the embodiment of the present application, and the control device 400 can be used for the electronic device 1000 . The control device 400 includes a judgment module 401 and a control module 402 . Wherein, step 01 may be implemented by the judgment module 401 , and step 02 may be implemented by the control module 402 . That is to say, the judging module 401 can be used to judge whether the structured light camera 22 is turned on. The control module 402 can be used to control the first sub-display area 111 to display images at a first display timing when the structured light camera 22 is turned on, the structured light camera 22 to perform exposure at an exposure timing, and the effective working state and exposure timing corresponding to the first display timing. The corresponding valid working states are staggered.

Please refer to FIG. 1 , the control method of the embodiment of the present application can be implemented by the electronic device 1000 of the embodiment of the present application, that is, when the structured light camera 22 is turned on, the first sub-display area 111 displays images at the first display timing, and the structured light camera 22 Exposure is performed at the exposure sequence, and the effective working state corresponding to the first display sequence is staggered from the effective working state corresponding to the exposure sequence. In some embodiments, the electronic device 1000 may further include a processor 200 , wherein steps 01 and 02 may be implemented by the processor 200 .

When the structured light camera 22 is turned on, the structured light camera 22 receives the modulated laser light passing through the first sub-display area 111 . At this time, the light used for displaying the image in the first sub-display area 111 will interfere with the structured light camera 22 , thereby As a result, the speckle image obtained by the structured light camera 22 has a large error, and the depth information of the target object cannot be accurately obtained. Therefore, the effective working state corresponding to the exposure timing of the structured light camera 22 and the effective working state corresponding to the first display timing of the first sub-display area 111 can be staggered from each other, that is, when the first sub-display area 111 displays images, the structured light camera 22 does not During exposure, the first sub-display area 111 does not display an image when the structured light camera 22 performs exposure, thereby reducing or avoiding interference to the structured light camera 22 when the first sub-display area 111 displays an image.

It can be understood that in use, the structured light projector 21 and the structured light camera 22 can be turned on at the same time, or the time interval between the two turning on is very small, so the above-mentioned moment when the structured light camera 22 is turned on can be regarded as a structure The moment when the light projector 21 is turned on.

Referring to FIG. 1 again, in some embodiments, when the first sub-display area 111 displays an image, the electronic device 1000 generates a first interrupt signal to stop the exposure of the structured light camera 22 ; and/or, in the structured light camera 22 During exposure, the electronic device 1000 generates a second interrupt signal to stop the first sub-display area 111 from displaying images.

Referring to Figure 18, in some embodiments, step 02 includes:

021: When an image is displayed in the first sub-display area 111, a first interrupt signal is generated to stop the exposure of the structured light camera 22; and/or

022: When the structured light camera 22 is exposed, a second interrupt signal is generated to stop the first sub-display area 111 from displaying images.

Referring to FIG. 17 again, in some embodiments, steps 021 and 022 may be implemented by the control module 402 , that is, the control module 402 may be configured to generate a first interrupt when the first sub-display area 111 displays an image signal to stop the exposure of the structured light camera 22 ; and/or, when the structured light camera 22 is exposed, a second interrupt signal is generated to stop the display of images in the first sub-display area 111 . In addition, steps 021 and 022 may also be implemented by the processor 200 .

In some embodiments, the frame rate of the image displayed in the first sub-display area 111 may be determined first, for example, the first sub-display area 111 displays at a frame rate of 30 frames per second, 40 frames per second, or 60 frames per second, etc. For an image, the first display timing of the first sub-display area 111 can be determined according to the frame rate of the image displayed in the first sub-display area 111 . When an image is displayed in the first sub-display area 111, the control signal corresponding to the first display timing may be at a high level. At this time, a first interrupt signal may be generated to stop the exposure of the structured light camera 22. The exposure timing of the structured light camera 22 corresponds to When the first sub-display area 111 does not display an image, the control signal corresponding to the first display timing can be low, and the structured light camera 22 can determine whether to perform exposure according to the frame rate of the acquired image. , when the structured light camera 22 is exposed, the control signal corresponding to the exposure timing of the structured light camera 22 may be a high level, and when the structured light camera 22 is not exposed, the control signal corresponding to the exposure timing of the structured light camera 22 may be low level, so that the exposure timing of the structured light camera 22 can be obtained and the effective working state corresponding to the first display timing (that is, the corresponding control signal is high level) and the effective working state corresponding to the exposure timing (that is, the corresponding control signal high level) are staggered from each other. When the first sub-display area 111 displays an image, the structured light camera 22 stops exposure, thereby reducing or avoiding interference to the structured light camera 22 when the first sub-display area 111 displays an image.

In some embodiments, the frame rate of the image acquired by the structured light camera 22 may be determined first, for example, the structured light camera 22 performs exposure at a frame rate of 30 frames per second, 40 frames per second, or 60 frames per second, etc. The frame rate of the image acquired by the light camera 22 can determine the exposure timing of the structured light camera 22 . When the structured light camera 22 performs exposure, the control signal corresponding to the exposure timing may be at a high level. At this time, a second interrupt signal may be generated to stop the first sub-display area 111 from displaying images, and the first sub-display area 111 The control signal corresponding to the display timing may be low level; when the structured light camera 22 is not exposing, the control signal corresponding to the exposure timing may be low level, and the first sub-display area 111 may determine whether to display the image according to the frame rate of the displayed image For images, when an image is displayed in the first sub-display area 111, the control signal corresponding to the first display timing of the first sub-display area 111 can be a high level, and when the first sub-display area 111 does not display an image, the first sub-display area 111 The control signal corresponding to the first display timing of the area 111 can be low level, so that the first display timing of the first sub-display area 111 can be obtained and the effective working state corresponding to the first display timing can be obtained (that is, the corresponding control signal is high. level) and the effective working state corresponding to the exposure timing sequence (ie, the corresponding control signal is at a high level) are staggered from each other. When the structured light camera 22 is exposed, the first sub-display area 111 stops displaying images, so as to reduce or avoid interference to the structured light camera 22 when the first sub-display area 111 displays images.

Specifically, referring to FIG. 19 , in an example, the first sub-display area 111 and the second sub-display area 112 can be independently controlled, and the display screen 10 is an independent screen structure, that is, the display screen 10 is a whole, Each of the plurality of pixels of the display screen 10 can be independently controlled. The first sub-display area 111 includes a first pixel set composed of a plurality of pixels, and the second sub-display area 112 includes a second pixel set composed of a plurality of pixels. It can be understood that the plurality of pixels in the first pixel set and the plurality of pixels in the second pixel set can be independently controlled. At this time, the type of the display screen 10 can be a self-luminous display screen, such as an OLED display screen or a Micro LED display screen, and each pixel of the self-luminous display screen can be independently controlled to emit light or not to emit light or to emit light in different For light emission with luminance, the display timing of the first sub-display area 111 and/or the second sub-display area 112 can be controlled by controlling the light-emitting timing of the pixels. In addition, the pixels of the self-luminous display screen can emit light by themselves to present corresponding colors.

Referring to FIG. 20 , in another example, the first sub-display area 111 and the second sub-display area 112 can be independently controlled, and the display screen 10 includes the first sub-screen 16 and the second sub-screen 17 , that is, the display screen 10 It can be composed of two independent sub-screens (the first sub-screen 16 and the second sub-screen 17 ), and the first sub-screen 16 and the second sub-screen 17 can be controlled independently. The first sub-screen 16 may form the first sub-display area 111 , and the second sub-screen 17 may form the second sub-display area 112 . At this time, the first sub-screen 16 and the second sub-screen 17 can be of the same type, for example, both are liquid crystal displays, both are OLED displays, or both are Micro LED displays; the first sub-screen 16 and the second sub-screen 17 The types of LEDs can also be different, for example, the first sub-screen 16 is a display screen (such as a liquid crystal display screen) that emits light through a backlight, and the second sub-screen 17 is a self-illuminating display screen (such as an OLED display screen or a Micro LED display screen, etc. ). For another example, the first sub-screen 16 is a self-luminous display screen (such as an OLED display screen or a Micro LED display screen, etc.), and the second sub-screen 17 is a display screen (such as a liquid crystal display screen) that emits light through a backlight. Of course, the first sub-screen 16 may also be an OLED display screen, and the second sub-screen 17 may be a Micro LED display screen, etc. The specific selection method is not limited to the above examples. The display screen that emits light through the backlight can control the display timing of the first sub-display area 111 and/or the second sub-display area 112 by controlling the lighting timing of the backlight. The pixels of the display screen illuminated by the backlight can also present corresponding colors under the action of the backlight.

In some embodiments, when the first sub-screen 16 and the second sub-screen 17 are combined to form the display screen 10, the human eye is difficult to perceive the boundary line between the first sub-screen 16 and the second sub-screen 17, and the When the first sub-screen 16 and the second sub-screen 17 display images, even if the first sub-screen 16 and the second sub-screen 17 jointly display the same frame of image, the human eye will not perceive the first sub-screen 16 and the second sub-screen 17 17Boundary lines between the displayed images.

The specific shapes of the first sub-screen 16 and the second sub-screen 17 can be set according to requirements. For example, the second sub-screen 17 is approximately rectangular, the first sub-screen 16 is also approximately rectangular, and the first sub-screen 16 and the second sub-screen 17 are approximately rectangular. The sub-screens 17 are connected to form a substantially rectangular display screen 10; for example, as shown in FIG. The shape of the through hole 172 can be a racetrack shape, a water drop shape, etc., and the shapes of the first sub-screen 16 and the second sub-screen 17 are complementary to each other and can together form the display screen 10 in the shape of a rounded rectangle. Of course, the final shape of the display screen 10 and the shape of the first sub-screen 16 or the second sub-screen 17 may also be a circle, an ellipse, a racetrack shape, etc., which are not limited here. The first sub-screen 16 may be located at the edge of the entire display screen 10 , and the second sub-screen 17 may be located at the middle position of the entire display screen 10 . The first sub-screen 16 may be used to display status icons of the electronic device 1000 , for example, used to display the battery level, network connection status, system time and the like of the electronic device 1000 .

Referring to FIG. 21 , in some embodiments, when the structured light camera 22 is turned on, the second sub-display area 112 displays images at the second display timing T1 , and the period of the first display timing T2 is greater than the period of the second display timing T1 .

Referring to FIG. 16 again, in some embodiments, the control method further includes:

03: When the structured light camera 22 is turned on, the second sub-display area 112 is controlled to display images at the second display timing T1, and the period of the first display timing T2 is greater than the period of the second display timing T1.

Referring to FIG. 17 again, in some embodiments, step 03 may be implemented by the control module 402, that is to say, the control module 402 may be used to control the second sub-display area 112 to display the second sub-display area 112 when the structured light camera 22 is turned on. The display timing T1 displays an image, and the period of the first display timing T2 is greater than the period of the second display timing T1. In addition, step 03 may also be implemented by the processor 200 .

In some embodiments, the second display timing T1 may be a commonly used display timing, and the frame rate corresponding to the second display timing T1 is, for example, 60 frames per second, 72 frames per second, or 75 frames per second, etc. When the light camera 22 is turned on, the image displayed by the second sub-display area 112 usually does not interfere with the structured light camera 22 . Therefore, the second sub-display area 112 can display the image at the second display timing T1, so that the second sub-display area 112 Images can be displayed clearly and stably.

In some embodiments, the period of the first display timing T2 may be greater than the period of the second display timing T1, wherein the period may refer to the inverse of the frame rate, that is, when the structured light camera 22 is turned on, the first sub-display area 111 The frame rate of the displayed image may be smaller than the frame rate of the displayed image in the second sub-display area 112 . Specifically, in order to facilitate control, when the structured light camera 22 is turned on, the first display timing T2 and the exposure timing T3 may be interleaved with each other (refer to FIG. 21 , when the control signal corresponding to the first display timing T2 is at a high level, The control signal corresponding to the exposure timing T3 is at a low level, and when the control signal corresponding to the first display timing T2 is at a low level, the control signal corresponding to the exposure timing T3 is at a high level), that is, the first sub-display area 111 displays the image. The frame rate is equal to the frame rate of the image acquired by the structured light camera 22 , and the frame rate of the image acquired by the structured light camera 22 is usually lower than the frame rate of the image displayed in the second sub-display area 112 , so the frame rate of the image displayed in the first sub-display area 111 is also The frame rate of the image displayed in the second sub-display area 112 is smaller than that of the second sub-display area 112 , that is, the period of the first display timing T2 is greater than the period of the second display timing T1 . In addition, the period of the first display timing T2 is greater than the period of the second display timing T1 , which can also reduce the power consumption of displaying images in the first sub-display area 111 .

Of course, in other embodiments, the first display timing T2, the second display timing T1, and the exposure timing T3 can also be set to other settings according to requirements. For example, referring to FIG. 22, the period of the first display timing T2 can also be smaller than that of the second display timing. The cycle of timing T1; please refer to Figure 23, the first display timing T2 is the same as the second display timing T1; please refer to Figure 24, the period of the first display timing T2 can be smaller than the period of the exposure timing T3; the period of the first display timing T2 It may be greater than the period of the exposure sequence T3, etc., as long as the effective working state corresponding to the first display sequence T2 and the effective working state corresponding to the exposure sequence T3 are staggered, which is not specifically limited here.

In some embodiments, when the structured light camera 22 is turned off, the first sub-display area 111 and the second sub-display area 112 both display images at the second display timing.

Referring to FIG. 16 again, in some embodiments, the control method further includes:

04: When the structured light camera 22 is turned off, control both the first sub-display area 111 and the second sub-display area 112 to display images at the second display timing.

Referring to FIG. 17 again, in some embodiments, step 04 can be implemented by the control module 402, that is to say, the control module 402 can be used to control the first sub-display area 111 and the second sub-display area 111 and the second sub-display area 111 when the structured light camera 22 is turned off. Each of the sub-display areas 112 displays images at the second display timing. In addition, step 04 may also be implemented by the processor 200 .

When the structured light camera 22 is turned off, it means that the user does not need to use the structured light camera 22 at this time, that is, at this time, the structured light camera 22 does not need to receive the modulated laser light passing through the first sub-display area 111 , there is no problem that the image displayed in the first sub-display area 111 interferes with the structured light camera 22. Therefore, both the first sub-display area 111 and the second sub-display area 112 can be controlled to display images at the second display timing, so that the entire display All areas 11 can display images clearly and stably, so as to improve the user's perception when using the electronic device 1000 .

In some embodiments, the electronic device 1000 includes a hardware clock, and both the first display timing and the exposure timing are determined by the hardware clock. The first display timing and the exposure timing can be accurately determined by the same hardware clock, so that the first display timing and the exposure timing are on the same timeline, thereby accurately staggering the effective working state corresponding to the first display timing and the effective work corresponding to the exposure timing. state, to reduce or avoid interference to the structured light camera 22 when the first sub-display area 111 displays images. The second display timing can also be determined by the hardware clock.

In some embodiments, the first display timing and the exposure timing can also be determined by means of the same system clock, and it only needs to satisfy that the first display timing and the exposure timing are on the same time line to accurately stagger the effective timing corresponding to the first display timing. The working state and the valid working state corresponding to the exposure timing sequence may be sufficient, which is not specifically limited here.

Please refer to FIG. 19 and FIG. 20, it can be understood that, in combination with the above description of the display screen 10, when the display screen 10 is an independent display screen 10, the display timing of the first sub-display area 111 can be controlled by controlling the first pixel. The light-emitting timing of the set is implemented; controlling the display timing of the second sub-display area 112 can be implemented by controlling the light-emitting timing of the second pixel set. When the display screen 10 includes the first sub-screen 16 and the second sub-screen 17, controlling the display timing of the first sub-display area 111 can be realized by controlling the display timing of the first sub-screen 16; controlling the second sub-display area 112 The display timing can be realized by controlling the display timing of the second sub-screen 17 . The picture displayed in the first sub-display area 111 and the picture displayed in the second sub-display area 112 may together form a complete display picture. For example, when the electronic device 1000 is playing a movie, the display area 11 needs to display one frame of the movie picture. If there is a tree, a man, and a woman in the movie screen, the man and woman may all be located in the second sub-display area 112, most of the woman's body is in the second sub-display area 112, and her arms are in the first sub-display area 112. in area 111. Or; the picture displayed in the first sub-display area 111 and the picture displayed in the second sub-display area 112 are two independent display pictures. For example, if the electronic device 1000 is currently performing the task of playing a movie, the movie picture is displayed in the second sub-display. The first sub-display area 111 can synchronously display the battery power, network connection status, system time, etc. of the electronic device 1000, or synchronously display messages of instant messaging or message notifications of various applications. Similarly, when the display screen 10 includes the first sub-screen 16 and the second sub-screen 17, the picture displayed on the first sub-screen 16 and the picture displayed on the second sub-screen 17 can also form a complete display screen together, or the first The picture displayed on the sub-screen 16 and the picture displayed on the second sub-screen 17 are two independent display pictures.

In some embodiments, when the structured light camera 22 is turned on, the first sub-display area 111 and the second sub-display area 112 can also be controlled to display in different display states. The different display states may be on or off, display with different brightness, and the like. The display states of the first sub-display area 111 and the second sub-display area 112 can be independently controlled, and the user can control the second sub-display area 112 to display normally according to actual needs, and the first sub-display area 111 is used in conjunction with the structured light camera 22 . For example, when the structured light projector 21 emits laser light or the structured light camera 22 receives the modulated structured light, the first sub-display area 111 can be turned off, or the display brightness of the first sub-display area 111 can be turned down to reduce the first sub-display area 111. When a sub-display area 111 is displayed, the influence on the laser light emitted by the structured light projector 21 to the scene, or the reception of the modulated laser light by the structured light camera 22 .

Referring to FIG. 25 , the embodiment of the present application further provides another control method, wherein the first sub-display area 111 and the second sub-display area 112 emit light together or can be independently controlled, and the structured light camera 22 and the first sub-display area 111 corresponds, the control method includes:

05: Determine whether the structured light camera 22 is turned on;

06: When the structured light camera 22 is turned on, the display area 11 is controlled to display images at the first display timing, the structured light camera 22 is exposed at the exposure timing, and the effective working state corresponding to the first display timing and the effective working state corresponding to the exposure timing are staggered .

Referring to FIG. 17 again, the control method of the embodiment of the present application can be implemented by the control device 400 of the embodiment of the present application, and the control device 400 can be used for the electronic device 1000 . The control device 400 includes a judgment module 401 and a control module 402 . Wherein, step 05 can be implemented by the judgment module 401 , and step 06 can be implemented by the control module 402 . That is to say, the judging module 401 can be used to judge whether the structured light camera 22 is turned on. The control module 402 can be used to control the display area 11 to display images with a first display timing when the structured light camera 22 is turned on, and the structured light camera 22 to perform exposure with an exposure timing. The working status is staggered.

Please refer to FIG. 1 again, the control method of the embodiment of the present application can be implemented by the electronic device 1000 of the embodiment of the present application, that is, when the structured light camera 22 is turned on, the display area 11 displays the image in the first display sequence, and the structured light camera 22 displays the image in the first display sequence. The exposure sequence is exposed, and the effective working state corresponding to the first display sequence is staggered from the effective working state corresponding to the exposure sequence. In some embodiments, the electronic device 1000 may further include a processor 200 , wherein steps 05 and 06 may be implemented by the processor 200 .

When the structured light camera 22 is turned on, the structured light camera 22 receives the modulated laser light passing through the first sub-display area 111 , and the light used for displaying the image in the first sub-display area 111 will interfere with the structured light camera 22 , thereby As a result, the speckle image obtained by the structured light camera 22 has a large error, and the depth information of the target object cannot be accurately obtained. Therefore, the effective working state corresponding to the exposure timing of the structured light camera 22 and the effective working status corresponding to the first display timing of the display area 11 can be staggered from each other, that is, when the display area 11 displays an image, the structured light camera 22 does not perform exposure, and the structured light camera 22 does not perform exposure. 22 during exposure, the display area 11 does not display an image, thereby reducing or avoiding interference to the structured light camera 22 when the first sub-display area 111 displays an image.

It can be understood that in use, the structured light projector 21 and the structured light camera 22 can be turned on at the same time, or the time interval between the two turning on is very small, so the above-mentioned moment when the structured light camera 22 is turned on can be regarded as a structure The moment when the light projector 21 is turned on.

Referring to FIG. 1 again, in some embodiments, when the display area 11 displays an image, the electronic device 1000 generates a first interrupt signal to stop the exposure of the structured light camera 22; and/or, when the structured light camera 22 is exposed, The electronic device 1000 generates the second interrupt signal to stop the display area 11 from displaying images.

Referring to Figure 26, in some embodiments, step 06 includes:

061: When an image is displayed in the display area 11, a first interrupt signal is generated to stop the exposure of the structured light camera 22; and/or

062: When the structured light camera 22 is exposed, a second interrupt signal is generated to stop the display area 11 from displaying images.

Referring to FIG. 17 again, in some embodiments, steps 061 and 062 may be implemented by the control module 402, that is to say, the control module 402 may be used to generate a first interrupt signal to enable the display area 11 to display an image. The structured light camera 22 stops exposure; and/or, when the structured light camera 22 is exposed, a second interrupt signal is generated to stop the display area 11 from displaying images. In addition, steps 061 and 062 may also be implemented by the processor 200 .

In some embodiments, the frame rate at which the display area 11 displays images may be determined first. For example, the display area 11 displays images at a frame rate of 30 frames per second, 40 frames per second, or 60 frames per second. According to the display area 11 The frame rate of the displayed image can determine the first display timing of the display area 11 . When an image is displayed in the display area 11, the control signal corresponding to the first display timing may be at a high level. At this time, a first interrupt signal may be generated to stop the exposure of the structured light camera 22, and the control signal corresponding to the exposure timing of the structured light camera 22 It can be a low level; when the display area 11 does not display an image, the control signal corresponding to the first display timing can be a low level, and the structured light camera 22 can determine whether to perform exposure according to the frame rate of the acquired image. During exposure, the control signal corresponding to the exposure timing of the structured light camera 22 may be at a high level, and when the structured light camera 22 is not exposing, the control signal corresponding to the exposure timing of the structured light camera 22 may be at a low level, so that Obtain the exposure timing of the structured light camera 22 and make the effective working state corresponding to the first display timing (that is, the corresponding control signal is high) and the effective working state corresponding to the exposure timing (that is, the corresponding control signal is high). stagger. When the display area 11 displays an image, the structured light camera 22 stops exposure, thereby reducing or avoiding interference to the structured light camera 22 when the first sub-display area 111 displays an image.

In some embodiments, the frame rate of the image acquired by the structured light camera 22 may be determined first, for example, the structured light camera 22 performs exposure at a frame rate of 30 frames per second, 40 frames per second, or 60 frames per second, etc. The frame rate of the image acquired by the light camera 22 can determine the exposure timing of the structured light camera 22 . When the structured light camera 22 performs exposure, the control signal corresponding to the exposure timing may be at a high level. At this time, a second interrupt signal may be generated to stop the display area 11 from displaying images, and the control signal corresponding to the first display timing of the display area 11 It can be a low level; when the structured light camera 22 is not exposing, the control signal corresponding to the exposure timing can be a low level, and the display area 11 can determine whether to display the image according to the frame rate of the displayed image. When the display area 11 displays the image , the control signal corresponding to the first display timing of the display area 11 may be a high level, and when the display area 11 does not display an image, the control signal corresponding to the first display timing of the display area 11 may be a low level, so that the display can be obtained. The first display timing of zone 11 and the effective working state corresponding to the first display timing (ie the corresponding control signal is high level) and the effective working state corresponding to the exposure timing (ie the corresponding control signal is high level) are staggered from each other . When the structured light camera 22 is exposed, the display area 11 stops displaying images, so that interference to the structured light camera 22 when the first sub-display area 111 displays images can be reduced or avoided.

19 , in one example, the first sub-display area 111 and the second sub-display area 112 emit light together, and the display screen 10 is an independent screen structure, that is, the display screen 10 is a whole. At this time, the type of the display screen 10 may be a display screen that emits light through a backlight, such as a liquid crystal display screen or the like.

Specifically, referring to FIG. 19 , in an example, the first sub-display area 111 and the second sub-display area 112 can be independently controlled, and the display screen 10 is an independent screen structure, that is, the display screen 10 is a whole, Each of the plurality of pixels of the display screen 10 can be independently controlled. The first sub-display area 111 includes a first pixel set composed of a plurality of pixels, and the second sub-display area 112 includes a second pixel set composed of a plurality of pixels. It can be understood that the plurality of pixels in the first pixel set and the plurality of pixels in the second pixel set can be independently controlled. At this time, the type of the display screen 10 can be a self-luminous display screen, such as an OLED display screen or a Micro LED display screen, and each pixel of the self-luminous display screen can be independently controlled to emit light or not to emit light or to emit light in different For light emission with luminance, the display timing of the first sub-display area 111 and/or the second sub-display area 112 can be controlled by controlling the light-emitting timing of the pixels. In addition, the pixels of the self-luminous display screen can emit light by themselves to present corresponding colors.

When the display screen 10 is an integral and independent screen structure, the control of the display area 11 can be facilitated, and the processes required for manufacturing the electronic device 1000 can be reduced, thereby reducing the cost of the electronic device 1000 .

Referring to FIG. 20 , in another example, the first sub-display area 111 and the second sub-display area 112 can be independently controlled, and the display screen 10 includes the first sub-screen 16 and the second sub-screen 17 , that is, the display screen 10 It can be composed of two independent sub-screens (the first sub-screen 16 and the second sub-screen 17 ), and the first sub-screen 16 and the second sub-screen 17 can be controlled independently. The first sub-screen 16 may form the first sub-display area 111 , and the second sub-screen 17 may form the second sub-display area 112 . At this time, the first sub-screen 16 and the second sub-screen 17 can be of the same type, for example, both are liquid crystal displays, both are OLED displays, or both are Micro LED displays; the first sub-screen 16 and the second sub-screen 17 The types of LEDs can also be different, for example, the first sub-screen 16 is a display screen (such as a liquid crystal display screen) that emits light through a backlight, and the second sub-screen 17 is a self-illuminating display screen (such as an OLED display screen or a Micro LED display screen, etc. ). For another example, the first sub-screen 16 is a self-luminous display screen (such as an OLED display screen or a Micro LED display screen, etc.), and the second sub-screen 17 is a display screen (such as a liquid crystal display screen) that emits light through a backlight. Of course, the first sub-screen 16 may also be an OLED display screen, and the second sub-screen 17 may be a Micro LED display screen, etc. The specific selection method is not limited to the above examples. The display screen that emits light through the backlight can control the display timing of the first sub-display area 111 and/or the second sub-display area 112 by controlling the lighting timing of the backlight. The pixels of the display screen illuminated by the backlight can also present corresponding colors under the action of the backlight.

In some embodiments, when the first sub-screen 16 and the second sub-screen 17 are combined to form the display screen 10, the human eye is difficult to perceive the boundary line between the first sub-screen 16 and the second sub-screen 17, and the When the first sub-screen 16 and the second sub-screen 17 display images, even if the first sub-screen 16 and the second sub-screen 17 jointly display the same frame of image, the human eye will not perceive the first sub-screen 16 and the second sub-screen 17 17Boundary lines between the displayed images.

The specific shapes of the first sub-screen 16 and the second sub-screen 17 can be set according to requirements. For example, the second sub-screen 17 is approximately rectangular, the first sub-screen 16 is also approximately rectangular, and the first sub-screen 16 and the second sub-screen 17 are approximately rectangular. The sub-screens 17 are connected to form a substantially rectangular display screen 10; for example, as shown in FIG. The shape of the through hole 172 can be a racetrack shape, a water drop shape, etc., and the shapes of the first sub-screen 16 and the second sub-screen 17 are complementary to each other and can together form the display screen 10 in the shape of a rounded rectangle. Of course, the final shape of the display screen 10 and the shape of the first sub-screen 16 or the second sub-screen 17 may also be a circle, an ellipse, a racetrack shape, etc., which are not limited here. The first sub-screen 16 may be located at the edge of the entire display screen 10 , and the second sub-screen 17 may be located at the middle position of the entire display screen 10 . The first sub-screen 16 may be used to display status icons of the electronic device 1000 , for example, used to display the battery level, network connection status, system time and the like of the electronic device 1000 .

Please refer to FIG. 21 , in some embodiments, when the structured light camera 22 is turned off, the display area 11 displays images at the second display timing T1 .

Referring to FIG. 25 again, in some embodiments, the control method further includes:

07: When the structured light camera 22 is turned off, the display area 11 is controlled to display images at the second display timing T1.

Referring to FIG. 17 again, in some embodiments, step 07 can be implemented by the control module 402, that is, the control module 402 can be used to control the display area 11 to display the second display timing T1 when the structured light camera 22 is turned off Display images. In addition, step 07 may also be implemented by the processor 200 .

When the structured light camera 22 is turned off, it means that the user does not need to use the structured light camera 22 at this time, that is, at this time, the structured light camera 22 does not need to receive the modulated laser light passing through the first sub-display area 111 , there is no problem that the image displayed in the first sub-display area 111 interferes with the structured light camera 22. Therefore, the display area 11 can be controlled to display the image at the second display timing T1, so that the entire display area 11 can be displayed clearly and stably images, so as to enhance the user's experience when using the electronic device 1000 .

In some embodiments, the second display timing T1 may be a relatively common display timing, and the frame rate corresponding to the second display timing T1 is, for example, 60 frames per second, 72 frames per second, or 75 frames per second.

In some embodiments, the period of the first display timing T2 may be greater than the period of the second display timing T1, wherein the period may refer to the inverse of the frame rate, that is, the frame of the image displayed in the display area 11 when the structured light camera 22 is turned on The frame rate may be lower than the frame rate of the image displayed by the display area 11 when the structured light camera 22 is turned off. Specifically, in order to facilitate control, when the structured light camera 22 is turned on, the first display timing T2 and the exposure timing T3 may be interleaved with each other (refer to FIG. 21 , when the control signal corresponding to the first display timing T2 is at a high level, The control signal corresponding to the exposure timing T3 is low level, and when the control signal corresponding to the first display timing T2 is low level, the control signal corresponding to the exposure timing T3 is high level), that is, the display area 11 is turned on in the structured light camera 22 When the frame rate of the displayed image is equal to the frame rate of the image acquired by the structured light camera 22, the frame rate of the image acquired by the structured light camera 22 is usually lower than the frame rate of the displayed image commonly used in the display area 11 (the display area 11 is closed when the structured light camera 22 is turned off). frame rate of the displayed image), so that the frame rate of the image displayed in the display area 11 when the structured light camera 22 is turned on is lower than the frame rate of the image displayed by the display area 11 when the structured light camera 22 is turned off, that is, the period of the first display timing T2 is greater than The cycle of the second display timing T1. In addition, the period of the first display timing T2 is greater than the period of the second display timing T1, which can also reduce the power consumption of the display area 11 for displaying images when the structured light camera 22 is turned on.

Of course, in other embodiments, the first display timing T2, the second display timing T1, and the exposure timing T3 can also be set to other settings according to requirements. For example, referring to FIG. 22, the period of the first display timing T2 can also be smaller than that of the second display timing. The cycle of timing T1; please refer to Figure 23, the first display timing T2 is the same as the second display timing T1; please refer to Figure 24, the period of the first display timing T2 can be smaller than the period of the exposure timing T3; the period of the first display timing T2 It may be greater than the period of the exposure sequence T3, etc., as long as the effective working state corresponding to the first display sequence T2 and the effective working state corresponding to the exposure sequence T3 are staggered, which is not specifically limited here.

In some embodiments, the electronic device 1000 includes a hardware clock, and both the first display timing and the exposure timing are determined by the hardware clock. The first display timing and the exposure timing can be accurately determined by the same hardware clock, so that the first display timing and the exposure timing are on the same timeline, thereby accurately staggering the effective working state corresponding to the first display timing and the effective work corresponding to the exposure timing. state, to reduce or avoid interference to the structured light camera 22 when the first sub-display area 111 displays images. The second display timing can also be determined by the hardware clock.

In some embodiments, the first display timing and the exposure timing can also be determined by means of the same system clock, and it only needs to satisfy that the first display timing and the exposure timing are on the same time line to accurately stagger the effective timing corresponding to the first display timing. The working state and the valid working state corresponding to the exposure timing sequence may be sufficient, which is not specifically limited here.

Referring to FIG. 27, in some embodiments, the display screen 10 is an entire LCD display screen 93, or the first sub-screen 16 is an LCD display screen 93, or the second sub-screen 17 is an LCD display screen 93, or When the first sub-screen 16 and the second sub-screen 17 are both LCD display screens 93, the LCD display screen 93 may include a backlight module 931, a lower polarizer 932, and a thin-film transistor (TFT) arranged in sequence along the light-emitting direction. ) substrate 933 , liquid crystal layer 934 , color filter 935 and upper polarizer 936 . The backlight module 931 can be regarded as a backlight source. The lower polarizer 932 and the upper polarizer 936 are used to control whether the light passes through or not. Specifically, the upper polarizer 936 and the lower polarizer 932 respectively form a fence angle, which blocks out the component of the light that is perpendicular to the fence, and is only allowed to be parallel to the fence. amount passed. The TFT substrate 933 is used to provide conductive paths to generate voltages. Color filter 935 is used to form color images. The liquid crystal layer 934 includes liquid crystal molecules. Due to the anisotropy of the liquid crystal molecular structure, that is, the dielectric coefficient and the refractive index of the liquid crystal molecules are anisotropic, the photoelectric effect caused by the liquid crystal molecules will be different due to different directions. According to these characteristics of the liquid crystal itself, the LCD display screen 93 generates a voltage through the TFT substrate 933 to form an electric field between the upper polarizer 936 and the lower polarizer 932, and uses the electric field to control the rotation of the liquid crystal molecules to change the traveling direction of the light to make the light Through or blocked by the lower polarizer 932 and the upper polarizer 936, different electric fields can form different gray-scale brightness.

Referring to FIG. 28, in some embodiments, the display screen 10 is a whole OLED display screen 95, or the first sub-screen 16 is an OLED display screen 95, or the second sub-screen 17 is an OLED display screen 95, or When the first sub-screen 16 and the second sub-screen 17 are both OLED display screens 95 , the OLED display screen 95 may include a substrate 951 , an anode 952 , a hole transport layer 953 , a light emitting layer 954 , an electron transport layer 955 and a cathode 956 . The substrate 951 is used to support the entire OLED display screen 95 . When a voltage is applied to the anode 952 and the cathode 956 of the OLED, electrons and holes are injected from the cathode 956 and the anode 952, respectively, to the organic functional layer sandwiched between the two electrodes. The injected electrons and holes migrate from the electron transport layer 955 and the hole transport layer 953 to the light emitting layer 954, respectively. After the electrons and holes are injected into the light-emitting layer 954, they are bound together by the Coulomb force to form hole pairs, that is, excitons. The excitons migrate under the action of the electric field, transferring energy to the dopant material in the light-emitting layer 954 . The electrons in the dopant material of the light-emitting layer 954 transition from the ground state to the excited state after absorbing energy. Since the excited state is unstable, the electron will jump from the excited state back to the ground state again, releasing energy in the form of photons. Depending on the energy level of the excited state of the luminescent material, the electrons release photons of different energies in the process of transitioning back to the ground state. The energy determines the wavelength of light, and different wavelengths mean different colors of light. In this way, the OLED display screen 95 can emit various colors of light in the form of self-illumination. The brightness or intensity of light emitted by the OLED display screen 95 depends on the properties of the luminescent material and the magnitude of the applied current. For the same OLED display screen 95, the higher the current, the higher the brightness of the light. Each pixel in the OLED display screen 95 (consisting of a plurality of sub-pixels that can be self-luminous) can be controlled on/off by an independent thin film transistor, so that each pixel can emit light continuously and independently.

Please refer to FIG. 29 and FIG. 30. In some embodiments, the display screen 10 is a whole Micro LED display screen 97, or the first sub-screen 16 is a Micro LED display screen 97, or the second sub-screen 17 is a Micro LED display screen 97. When the LED display screen 97 or the first sub-screen 16 and the second sub-screen 17 are both Micro LED display screens 97 , the Micro LED display screen 97 may include a driving substrate 971 , a packaging substrate 972 , a support 973 and a plurality of pixels 974 . The driving substrate 971 and the packaging substrate 972 are disposed opposite to each other, and a plurality of pixels 974 are arranged between the driving substrate 971 and the packaging substrate 972 . A visible light source 9741 is correspondingly disposed in each pixel 974 .

The driving substrate 971 is provided with a display driving circuit (not shown in the figure), and the driving substrate 971 can control the on, off and light emission brightness of the light source in each pixel 974 . The packaging substrate 972 is used to encapsulate and protect the light source, and the material of the packaging substrate 972 may be a plastic with a certain hardness such as polyethylene terephthalate (PET) or polycarbonate (PC), or glass. The support 973 is used to maintain a certain distance between the driving substrate 971 and the packaging substrate 972, and prevent the pixels 974 from being excessively squeezed.

Each pixel 974 further includes a lower pixel electrode 9742 and an upper pixel electrode 9743, the lower pixel electrode 9742 is arranged on the driving substrate 971, the upper pixel electrode 9743 is arranged under the packaging substrate 972, and the visible light source 9741 is sandwiched between the lower pixel electrode 9742 and the upper pixel between electrodes 9743. The material of the pixel electrode can be indium tin oxide or conductive metal.

As shown in FIG. 29 , in an example, the multiple visible light sources 9741 include red light sources, green light sources and blue light sources, and each visible light source 9741 and the corresponding pixel electrode form a pixel 974, so that the pixels 974 containing different light sources emit light Lights of different colors.

Referring to FIG. 30 , in another example, the structure of the pixel 974 may also include a visible light source 9741 and a color conversion layer 9744 . For example, the plurality of visible light sources 9741 include a red light source and a blue light source, and each visible light source 9741 and a pixel 974 formed by a corresponding pixel electrode emit light of a corresponding color. The pixels 974 including the red light source emit red light, the pixels 974 including the blue light source emit blue light, and the pixels 974 including the blue light source and the color conversion layer 9744 emit green light. Pixels 974 also include spacer layers 9745 that facilitate uniform heights between pixels 974 .

To sum up, the LCD display screen 93 can display images by controlling the backlight module 931 to emit light, wherein the backlight module 931 of the LCD display screen 93 can only be controlled as a whole, that is, the entire display screen 93 emits light or does not emit light as a whole; the OLED display screen 95 can be controlled by The light-emitting layer 954 of each pixel is independently controlled to emit light of different colors and brightness to display images; the Micro LED display 97 can independently control each visible light source 9741 to emit light of different brightness and different colors to display images.

In the description of this specification, description with reference to the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples", etc., mean specific features described in connection with the embodiment or example , structure, material or feature is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, those skilled in the art may combine and combine the different embodiments or examples described in this specification, as well as the features of the different embodiments or examples, without conflicting each other.

In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. In the description of the present application, "plurality" means at least two, such as two, three, etc., unless expressly and specifically defined otherwise.

Although the embodiments of the present application have been shown and described above, it should be understood that the above embodiments are exemplary and should not be construed as limitations to the present application. Embodiments are subject to variations, modifications, substitutions and variations.

Claims (13)

1. An electronic device, comprising:

the display screen comprises a display area for displaying images, wherein the display area is provided with a front surface and a back surface which are opposite to each other, light rays emitted by the display screen are emitted to the outside along the direction of the back surface pointing to the front surface, the display screen comprises a first sub-screen and a second sub-screen which can be independently controlled, the first sub-screen forms a first sub-display area, and the second sub-screen forms a second sub-display area;

the structured light assembly comprises a structured light camera, the structured light camera is arranged on one side of the back surface of the display screen, the structured light camera corresponds to the first sub-display area, and the structured light camera is used for receiving the modulated laser passing through the first sub-display area;

when the structured light camera is started, the first sub-display area displays the image with a first display time sequence, the second sub-display area displays the image with a second display time sequence, the period of the first display time sequence is larger than that of the second display time sequence, the structured light camera is exposed with an exposure time sequence, and the effective working state corresponding to the first display time sequence is staggered with the effective working state corresponding to the exposure time sequence.

2. The electronic device according to claim 1, wherein the first sub-screen and the second sub-screen are of the same type, and both the first sub-screen and the second sub-screen are LCD display screens;

or the first sub-screen and the second sub-screen are both OLED display screens;

or the first sub screen and the second sub screen are both Micro LED display screens.

3. The electronic device of claim 1, wherein the first sub-display area and the second sub-display area both display the image at a second display timing when the structured light camera is turned off.

4. The electronic device according to claim 1, wherein the electronic device comprises a hardware clock, and the first display timing and the exposure timing are both determined by the hardware clock.

5. The electronic device according to claim 1, wherein the electronic device generates a first interrupt signal to stop the exposure of the structured light camera when the first sub-display area displays the image; and/or

And when the structured light camera is exposed, the electronic device generates a second interrupt signal so as to stop the first sub-display area from displaying the image.

6. The electronic device of claim 1, wherein the structured light assembly comprises a structured light projector disposed on a side of the display screen where the back surface is located, the structured light projector corresponding to the first sub-display, the structured light projector for emitting laser light through the first sub-display.

7. The electronic device according to claim 1, further comprising a cover plate disposed on a side of the front surface of the display screen, wherein an infrared-transmitting layer is disposed on an area of the cover plate corresponding to the first sub-display area.

8. The electronic device of claim 1, wherein the display screen comprises a plurality of pixels, and wherein a pixel density of the first sub-display area is less than a pixel density of the second sub-display area.

9. The control method of the electronic device is characterized in that the electronic device comprises a display screen and a structured light assembly, the display screen comprises a display area for displaying images, the display area is provided with a front surface and a back surface which are opposite to each other, light rays emitted by the display screen are emitted to the outside along the direction pointing to the front surface from the back surface, the display screen comprises a first sub-screen and a second sub-screen which can be independently controlled, the first sub-screen forms a first sub-display area, and the second sub-screen forms a second sub-display area; the structured light assembly comprises a structured light camera, the structured light camera is arranged on one side of the back surface of the display screen, the structured light camera corresponds to the first sub-display area, and the structured light camera is used for receiving the modulated laser which passes through the first sub-display area; the control method comprises the following steps:

judging whether the structured light camera is started or not;

when the structured light camera is started, the first sub-display area is controlled to display the image in a first display time sequence, the structured light camera is controlled to expose in an exposure time sequence, the second sub-display area is controlled to display the image in a second display time sequence, the period of the first display time sequence is larger than that of the second display time sequence, and the effective working state corresponding to the first display time sequence is staggered with the effective working state corresponding to the exposure time sequence.

10. The control method according to claim 9, characterized by further comprising:

and when the structured light camera is closed, controlling the first sub-display area and the second sub-display area to display the image at a second display time sequence.

11. The method according to claim 9, wherein the electronic device includes a hardware clock, and the first display timing and the exposure timing are determined by the hardware clock.

12. The method of claim 9, wherein the controlling the first sub-display area to display the image at a first display timing and the structured light camera to perform exposure at an exposure timing comprises:

when the image is displayed in the first sub-display area, generating a first interrupt signal to stop the exposure of the structured light camera; and/or

And generating a second interrupt signal to stop the first sub-display area from displaying the image when the structured light camera is exposed.

13. The control device of the electronic device is characterized in that the electronic device comprises a display screen and a structured light assembly, the display screen comprises a display area for displaying images, the display area is provided with a front surface and a back surface which are opposite to each other, light rays emitted by the display screen are emitted to the outside along the direction pointing to the front surface from the back surface, the display screen comprises a first sub-screen and a second sub-screen which can be independently controlled, the first sub-screen forms a first sub-display area, and the second sub-screen forms a second sub-display area; the structured light assembly comprises a structured light camera, the structured light camera is arranged on one side of the back surface of the display screen, the structured light camera corresponds to the first sub-display area, and the structured light camera is used for receiving the modulated laser which passes through the first sub-display area; the control device includes:

the judging module is used for judging whether the structured light camera is started or not;

the control module is used for controlling the first sub-display area to display the image in a first display time sequence and the structured light camera to expose in an exposure time sequence when the structured light camera is started, and controlling the second sub-display area to display the image in a second display time sequence, wherein the period of the first display time sequence is greater than that of the second display time sequence, and the effective working state corresponding to the first display time sequence is staggered with the effective working state corresponding to the exposure time sequence.

Images