CN109561207B

CN109561207B - Electronic device and control method thereof

Info

Publication number: CN109561207B
Application number: CN201811369358.6A
Authority: CN
Inventors: 杨鑫
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-11-16
Filing date: 2018-11-16
Publication date: 2021-03-23
Anticipated expiration: 2038-11-16
Also published as: CN109561207A

Abstract

The control method of the electronic device comprises a display screen, a projector and a time-of-flight receiver, wherein the display screen comprises a pixel area and a non-pixel area, the projector is used for projecting a projection picture to the non-pixel area, and the time-of-flight receiver is used for receiving laser reflected by the outside of the electronic device from the non-pixel area; the control method comprises the following steps: detecting whether the pixel area displays an image picture, detecting whether the flight time receiver is started, and controlling the projector to be closed when the pixel area displays the image picture and the flight time receiver is started; and when the pixel area displays the image picture and the flight time receiver is closed, controlling the projector to be switched on. The control method of the electronic device starts the projector to form a projection picture in the non-pixel area when the pixel area displays the image picture and the flight time receiver is closed, so that the pixel area and the non-pixel area of the display screen can display the image picture, and the area of the electronic device capable of displaying the image picture is increased. The application also discloses an electronic device.

Description

Electronic device and control method thereof

Technical Field

The present disclosure relates to the field of display technologies, and more particularly, to an electronic device and a control method of the electronic device.

Background

In an existing electronic device having a display screen, if a Time Of Flight (TOF) depth camera is disposed on a front surface Of the electronic device, an image screen cannot be displayed where the TOF depth camera is disposed Of the electronic device, resulting in a small area Of the electronic device capable Of displaying the image screen.

Disclosure of Invention

The embodiment of the application provides an electronic device and a control method of the electronic device.

The control method of the electronic device comprises a display screen, a projector and a time-of-flight receiver, wherein the display screen comprises a pixel area and a non-pixel area, the projector is used for projecting a projection picture to the non-pixel area, and the time-of-flight receiver is used for receiving laser reflected by the outside of the electronic device from the non-pixel area; the control method comprises the steps of detecting whether the pixel area displays an image picture, detecting whether the flight time receiver is started, and controlling the projector to be turned off when the pixel area displays the image picture and the flight time receiver is started; and when the pixel area displays an image picture and the time-of-flight receiver is closed, controlling the projector to be switched on to form the projection picture in the non-pixel area.

The electronic device of the embodiment of the application comprises a display screen, a projector, a time-of-flight projector and a processor. The display screen comprises a pixel area and a non-pixel area; the projector is used for projecting a projection picture to the non-pixel area; the time-of-flight receiver is used for receiving laser light reflected back from the outside of the electronic device from the non-pixel area; the processor is used for detecting whether the pixel area displays an image picture or not, detecting whether the time-of-flight receiver is started or not, and controlling the projector to be turned off when the pixel area displays the image picture and the time-of-flight receiver is started; and when the pixel area displays an image picture and the time-of-flight receiver is closed, controlling the projector to be switched on to form the projection picture in the non-pixel area.

According to the electronic device and the control method of the electronic device, when the image picture is displayed in the pixel area and the flight time receiver is started, the projector is turned off, so that light projected onto the non-pixel area by the projector is prevented from being reflected onto the flight time receiver and received by the flight time receiver, and the precision of the flight time receiver for collecting the image picture is improved; meanwhile, when the pixel area displays the image picture and the flight time receiver is closed, the projector is started to form a projection picture in the non-pixel area, so that the pixel area and the non-pixel area of the display screen can display the image picture, and the area of the electronic device capable of displaying the image picture is increased.

Additional aspects and advantages of embodiments of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of embodiments of the present application.

Drawings

The above and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present application.

Fig. 2 is a schematic plan view of an electronic device according to an embodiment of the present application.

Fig. 3 is a schematic perspective view of an electronic device according to an embodiment of the present application.

Fig. 4 to 6 are schematic partial cross-sectional views of electronic devices according to embodiments of the present application.

Fig. 7 is a schematic view of a method for controlling an electronic device according to an embodiment of the present application.

Fig. 8 is a schematic view of a method for controlling an electronic device according to an embodiment of the present application.

Detailed Description

Embodiments of the present application will be further described below with reference to the accompanying drawings. The same or similar reference numbers in the drawings identify the same or similar elements or elements having the same or similar functionality throughout.

In addition, the embodiments of the present application described below in conjunction with the accompanying drawings are exemplary and are only for the purpose of explaining the embodiments of the present application, and are not to be construed as limiting the present application.

Referring to fig. 1 to 3, an electronic device 100 according to an embodiment of the present disclosure includes a display screen 20, a projector 30 and a time-of-flight receiver 40, wherein the display screen 20 includes a pixel area 21 and a non-pixel area 22, the projector 30 is configured to project a projection image onto the non-pixel area 22, and the time-of-flight receiver 40 is configured to receive laser light reflected from an exterior of the electronic device 100 from the non-pixel area 22. The control method comprises the following steps:

01, detecting whether the pixel area 21 displays an image picture;

02, detecting whether the time-of-flight receiver 40 is on; and

03, controlling the projector 30 to be turned off when the pixel area 21 displays the image picture and the time-of-flight receiver 40 is turned on;

04, when the pixel area 21 displays the image picture and the time-of-flight receiver 40 is turned off, the projector 30 is controlled to be turned on to form a projection picture in the non-pixel area 22.

The control method of the above embodiment may be executed by the electronic apparatus 100. Specifically, the electronic device 100 is configured to control the projector 30 to be turned off when the pixel area 21 displays the image picture and the time-of-flight receiver 40 is turned on, and to control the projector 30 to be turned on to form the projected picture in the non-pixel area 22 when the pixel area 21 displays the image picture and the time-of-flight receiver 40 is turned off. Further, the electronic device 100 further includes a processor 70, and the processor 70 is configured to perform steps 01 to 04. That is, the processor 70 may be configured to detect whether the pixel area 21 is displaying an image picture, detect whether the time-of-flight receiver 40 is on, and control the projector 30 to turn off when the pixel area 21 is displaying an image picture and the time-of-flight receiver 40 is on; when the pixel area 21 displays an image picture and the time-of-flight receiver 40 is turned off, the projector 30 is controlled to be turned on to form a projected picture in the non-pixel area 22.

The electronic device 100 may be a mobile phone, a tablet computer, a notebook computer, an intelligent watch, an intelligent bracelet, a teller machine, and the like, and the embodiment of the application takes the electronic device 100 as a mobile phone as an example for description, it is understood that the specific form of the electronic device 100 may be other, and is not limited herein.

Referring to fig. 4, the projector 30 and the time-of-flight receiver 40 are both disposed in the electronic device 100 and are both disposed below the display screen 20, wherein the lower side of the display screen 20 is the side opposite to the direction of light emitted when the pixel area 21 displays the image picture. Referring to fig. 2, the projector 30 may be disposed at a position corresponding to the non-pixel region 22, and at this time, the orthographic projection of the projector 30 on the display screen 20 falls into the non-pixel region 22; referring to fig. 6, the projector 30 may also be disposed at a position not corresponding to the non-pixel region 22, for example, the projector 30 may be disposed on the sidewall 132 of the recess 13, and in this case, the orthographic projection of the projector 30 on the display screen 20 may fall into the pixel region 21. The time-of-flight receiver 40 may be disposed at a position corresponding to the non-pixel region 22.

The non-pixel region 22 may be a solid region, which may include a glass substrate therein; the non-pixel region 22 may also be a gap formed on the display panel 20. The processor 70 is electrically connected to the display screen 20, the projector 30 and the time-of-flight receiver 40.

When the pixel area 21 displays the image picture and the time-of-flight receiver 40 is turned on, the processor 70 turns off the projector 30, so as to prevent the light projected onto the non-pixel area 22 by the projector 30 from being reflected onto the time-of-flight receiver 40 and received by the time-of-flight receiver 40, thereby improving the accuracy of the time-of-flight receiver 40 in acquiring the image picture.

When the pixel area 21 displays the image picture and the time-of-flight receiver 40 is turned off, the processor 70 turns on the projector 30 to form a projection picture in the non-pixel area 22, and both the pixel area 21 and the non-pixel area 22 of the display screen 20 can display the image picture.

In the electronic device 100 and the control method of the electronic device 100 according to the embodiment of the present application, when the pixel area 21 displays an image and the time-of-flight receiver 40 is turned on, the projector 30 is turned off, so that light projected onto the non-pixel area 22 by the projector 30 is prevented from being reflected onto the time-of-flight receiver 40 and received by the time-of-flight receiver 40, and thus the accuracy of acquiring the image by the time-of-flight receiver 40 is improved; meanwhile, when the pixel area 21 displays an image picture and the time-of-flight receiver 40 is turned off, the projector 30 is turned on to form a projection picture in the non-pixel area 22, so that both the pixel area 21 and the non-pixel area 22 of the display screen 20 can display the image picture, thereby increasing the area of the electronic device 100 capable of displaying the image picture.

Referring to fig. 2 and 5, an electronic device 100 according to an embodiment of the present disclosure includes a housing 10, a display screen 20, a projector 30, a time-of-flight receiver 40, a floodlight 50, a time-of-flight projector 60, and a processor 70.

The housing 10 has an approximately rectangular frame-like (or plate-like) structure. The housing 10 includes a front face 11 and the housing 10 includes a top edge 12. When the electronic device 100 is used normally, for example, when a user uses the electronic device 100 to talk, browse a web page, etc., the front surface 11 of the casing 10 faces the user side, and the top edge 12 faces the upper side of the casing 10. The front surface 11 of the casing 10 is provided with a groove 13, the groove 13 is approximately rectangular, the groove 13 is positioned at one end of the casing 10 close to the top edge 12, the center of the groove 13 is positioned on a perpendicular bisector of the top edge 12, the longer side of the groove 13 is parallel to the top edge 12, and the shorter side of the groove 13 is perpendicular to the top edge 12. In other embodiments, the notch 13 may be located near an end of the top edge 12.

The display screen 20 is disposed on the front face 11 of the housing 10 and covers the recess 13. The display screen 20 may be a touch display screen, and the display screen 20 may include a display module 23, a protective cover 24 and a touch sensor. The display module 23 is disposed between the protective cover 24 and the housing 10. The display module 23 includes a pixel area 21 and a non-pixel area 22. The non-pixel region 22 is located at one end of the display screen 20 and corresponds to the groove 13, and specifically, the non-pixel region 22 covers the groove 13. The pixel region 21 has a plurality of pixel units formed thereon, and the plurality of pixel units can be commonly used for displaying an image frame. The non-pixel region 22 does not include pixel units, and the non-pixel region 22 cannot directly display a picture. The display panel 20 corresponding to the non-pixel area 22 may include any one of a glass substrate, a diffuser plate, a diffraction plate, and a fresnel lens. The touch sensor can be arranged on the display module 23; alternatively, the touch sensor may be disposed on the protective cover 24; alternatively, the touch sensor may be disposed on the display module 23 and the protective cover 24. In other embodiments, the non-pixel region 22 may also be a notch formed in the display module 23, and at this time, the touch sensor corresponding to the non-pixel region 22 may be disposed on the protective cover 24.

The projector 30 is disposed on the housing 10 and is accommodated in the groove 13. Referring to fig. 5, the projector 30 may be disposed on the bottom wall 131 of the recess 13 and opposite (or corresponding) to the non-pixel region 22; alternatively, referring to fig. 6, the projector 30 may be disposed on the sidewall 132 of the groove 13. The projector 30 is configured to project a projection screen onto the non-pixel area 22, and a user can see the projection screen displayed on the non-pixel area 22. The projector 30 may be a micro projector.

The time-of-flight receiver 40, the floodlight 50 and the time-of-flight projector 60 are all disposed on the housing 10 and housed in the recess 13, and specifically, the time-of-flight receiver 40, the floodlight 50 and the time-of-flight projector 60 are all disposed on the bottom wall 131 of the recess 13 and are opposed to (or correspond to) the non-pixel regions 22.

The time-of-flight projector 60 may include a light source for emitting laser light to a diffuser and a diffuser (diffuser) for diffusing the laser light emitted by the light source. The time-of-flight projector 60 may also project laser light from the non-pixel region 22 toward an object to be measured external to the electronic device 100.

The time-of-flight receiver 40 is used for receiving the laser light reflected by the object to be measured from the non-pixel region 22. The time-of-flight receiver 40 and the time-of-flight projector 60 together constitute a TOF depth camera that can be used to detect the distance between the TOF depth camera and the object under test. Specifically, the time-of-flight projector 60 projects laser light from the non-pixel region 22 toward the object to be measured, and the laser light is reflected by the object to be measured to the time-of-flight receiver 40 after being projected onto the object to be measured. The distance between the TOF depth camera and the object to be measured can be obtained by the TOF depth camera according to the time of the laser emitted by the time-of-flight projector 60 and the time of the laser reflected back from the object to be measured received by the time-of-flight receiver 40. In other embodiments, the time-of-flight projector 60 emits laser light to the object to be measured, the time-of-flight receiver 40 collects the laser light reflected back by the object to be measured to obtain a phase difference, and the TOF depth camera calculates depth information of the object to be measured according to the phase difference and the light emitting frequency of the laser light.

The floodlight 50 can emit light from the non-pixel area 22 to the outside of the electronic device 100. Floodlight 50 may be used as a fill light for time-of-flight receiver 40.

In this embodiment, the floodlight 50, the time-of-flight receiver 40, the projector 30 and the time-of-flight projector 60 are connected by a straight line, which is parallel to the top edge 12. The floodlight 50, the time-of-flight receiver 40, the projector 30 and the time-of-flight projector 60 are sequentially disposed at intervals on the bottom wall 131 of the recess 13. In other embodiments, the floodlight 50, the time-of-flight receiver 40 and the time-of-flight projector 60 are sequentially disposed at intervals on the bottom wall 131 of the recess 13, the center connecting lines of the floodlight 50, the time-of-flight receiver 40 and the time-of-flight projector 60 are in a straight line, the projector 30 is disposed on the side wall 132 of the recess 13, and the center of the orthographic projection of the projector 30 on the bottom wall 131 is on the straight line.

A processor 70 is disposed on the housing 10, the processor 70 being electrically connected to the floodlight 50, the time-of-flight receiver 40, the projector 30 and the time-of-flight projector 60. The processor 70 is operable to control the projector 30 to be switched off when the pixel area 21 displays an image frame and any one or more of the floodlight 50, the time-of-flight receiver 40 and the time-of-flight projector 60 are switched on. The processor 70 is also operable to control the projector 30 to be on (the projector 30 projects a projection image onto the non-pixel areas 22) to form a projection image on the non-pixel areas 22 when the image is displayed on the pixel areas 21 and the floodlight 50, the time-of-flight receiver 40 and the time-of-flight projector 60 are all off.

In particular, the processor 70 may be configured to detect whether the pixel area 21 is displaying an image frame, detect whether the time-of-flight receiver 40, the floodlight 50 and the time-of-flight projector 60 are on, and control the projector 30 to be off when the pixel area 21 is displaying an image frame and the time-of-flight receiver 40 is on. The processor 40 turns off the projector 30 when the time-of-flight receiver 40 is turned on, thereby preventing light projected onto the non-pixel region 22 by the projector 30 from reflecting onto the time-of-flight receiver 40 and being received by the time-of-flight receiver 40, and improving the accuracy of image pictures acquired by the time-of-flight receiver 40.

The processor 70 may also be configured to detect whether the pixel area 21 is displaying an image frame, detect whether the time-of-flight receiver 40, the floodlight 50 and the time-of-flight projector 60 are on, and control the projector 30 to be off when the pixel area 21 is displaying an image frame and the floodlight 50 is on. The processor 40 turns off the projector 30 when the floodlight 50 is turned on, so as to prevent light emitted by the floodlight 50 from being projected on the non-pixel area 22 and affecting a projection picture formed by the projector 30 projected on the non-pixel area 21.

The processor 70 may also be configured to detect whether the pixel area 21 is displaying an image frame, detect whether the time-of-flight receiver 40, the floodlight 50 and the time-of-flight projector 60 are on, and control the projector 30 to be off when the pixel area 21 is displaying an image frame and the time-of-flight projector 60 is on. The processor 40 turns off the projector 30 when the time-of-flight projector 60 is on, thereby preventing light emitted from the time-of-flight projector 60 from being projected onto the non-pixel area 22 and affecting a projection picture formed by the projector 30 projected onto the non-pixel area 21.

The processor 70 may also be configured to detect whether the pixel area 21 is displaying an image frame, detect whether the time-of-flight receiver 40, the floodlight 50 and the time-of-flight projector 60 are on, and control the projector 30 to be off when the pixel area 21 is displaying an image frame and the time-of-flight receiver 40 and the time-of-flight projector 60 are on.

The processor 70 may also be configured to detect whether the pixel area 21 is displaying an image frame, detect whether the time-of-flight receiver 40, the floodlight 50 and the time-of-flight projector 60 are on, and control the projector 30 to be off when the pixel area 21 is displaying an image frame and the time-of-flight receiver 40 and the floodlight 50 are on.

The processor 70 may also be configured to detect whether the pixel area 21 is displaying an image frame, detect whether the time-of-flight receiver 40, the floodlight 50 and the time-of-flight projector 60 are on, and control the projector 30 to turn off when the pixel area 21 is displaying an image frame and the time-of-flight receiver 40, the floodlight 50 and the time-of-flight projector 60 are on.

Referring to fig. 7, in some embodiments, when the pixel area 21 displays an image frame and the projector 30 projects the projection frame onto the non-pixel area 21, the image frame and the projection frame together form a complete display frame.

Specifically, when the pixel area 21 displays an image picture and the projector 30 projects a projection picture to the non-pixel area 21, the image picture and the projection picture are two parts of the same complete picture, and the image picture and the projection picture are complementary and jointly form the complete picture, that is, the image picture and the projection picture jointly form a complete picture. For example, referring to fig. 7, when a complete picture includes a complete human body, a part of the human body (a part of the head and the body) can be displayed in the pixel region 21 and form an image picture, another part of the human body (another part of the head) can be displayed in the non-pixel region 22 and form a projection picture, and the image picture and the human body in the projection picture together form a complete human body.

Referring to fig. 8, in some embodiments, when the pixel area 21 displays an image frame and the projector 30 projects a projection frame onto the non-pixel area 21, the image frame and the projection frame are two independent display frames.

Specifically, the projection screen and the image screen may not be related, for example, when the image screen displays a video screen, the projection screen may be a screen related to a user's chat, a message alert screen, a remaining power amount, a current time, a signal strength, a notification information screen, or the like. The image screen may be various, and the image screen may be a screen related to various applications, for example, the image screen may be a screen, a chat interface, a browser interface, a screen included in a game, or the like. The projection screen may be a relatively fixed screen, for example, the projection screen may be any one or more of a message reminding screen, a remaining power amount, a current time, a signal strength, a notification information screen, and the like.

Referring to fig. 5, in some embodiments, the electronic device 100 further includes a bracket 80 disposed in the recess 13, and at least one of the floodlight 50, the time-of-flight receiver 40, the projector 30 and the time-of-flight projector 60 is mounted on the bracket 80.

The number of the brackets 80 may be one, two, three, or four. When the number of support 80 is one, floodlight 50, time of flight receiver 40, projector 30 and time of flight projector 60 can all be installed on this support 80, and floodlight 50, time of flight receiver 40, projector 30, time of flight projector 60 and this support 80 can form a module jointly, and this module can be installed in recess 13 as a whole. Alternatively, one part of the floodlight 50, the time-of-flight receiver 40, the projector 30 and the time-of-flight projector 60 is mounted on the stand 80, and the other part of the floodlight 50, the time-of-flight receiver 40, the projector 30 and the time-of-flight projector 60 is mounted on the casing 10. When the number of the brackets 80 is two, the floodlight 50, the time-of-flight receiver 40 and the time-of-flight projector 60 may be mounted on one bracket 80, the projector 30 is mounted on the other bracket 80, and both brackets 80 are mounted in the recess 13.

In the description herein, reference to the description of the terms "certain embodiments," "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples" means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the feature. In the description of the present application, "a plurality" means at least two, e.g., two, three, unless specifically limited otherwise.

Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations of the above embodiments may be made by those of ordinary skill in the art within the scope of the present application, which is defined by the claims and their equivalents.

Claims

1. A control method for an electronic device, wherein the electronic device includes a display screen, a projector and a time-of-flight receiver, the display screen includes a pixel area and a non-pixel area, and the pixel area is used to display a complete an image picture, the projector is used for projecting a projection picture to the non-pixel area, the time-of-flight receiver is used for receiving the laser reflected from the outside of the electronic device from the non-pixel area, the projector and the The time-of-flight receivers are two independent structures, and the orthographic projection of the projector on the display screen falls into the pixel area; the control method includes:

Detecting whether the pixel area is displaying an image;

detecting whether the time-of-flight receiver is on; and

When the pixel area displays an image picture and the time-of-flight receiver is turned on, controlling the projector to turn off;

When the pixel area displays an image picture and the time-of-flight receiver is turned off, the projector is controlled to be turned on to form the projection picture in the non-pixel area.

2. An electronic device, characterized in that the electronic device comprises:

a display screen, the display screen includes a pixel area and a non-pixel area, and the pixel area is used to display a complete image;

a projector, wherein the projector is used to project a projection image to the non-pixel area, and the orthographic projection of the projector on the display screen falls into the pixel area;

a time-of-flight receiver, the time-of-flight receiver and the projector are two independent structures, and the time-of-flight receiver is used for receiving the laser light reflected from the outside of the electronic device from the non-pixel area; and

a processor for:

Detecting whether the pixel area is displaying an image;

detecting whether the time-of-flight receiver is on; and

3 . The electronic device according to claim 2 , wherein the electronic device further comprises a housing, a floodlight and a time-of-flight projector, the display screen is arranged on the housing, and the projector is 3 . Set on the housing, the floodlight, the time-of-flight receiver and the time-of-flight projector are all set in the housing and below the display screen, the floodlight, all the Both the time-of-flight receiver and the time-of-flight projector correspond to the non-pixel area.

4 . The electronic device according to claim 3 , wherein a groove is formed on the front of the casing, the floodlight, the time-of-flight receiver, the projector and the time-of-flight projection are 4 . are accommodated in the grooves.

5 . The electronic device according to claim 4 , wherein the floodlight, the time-of-flight receiver and the time-of-flight projector are all arranged on the bottom wall of the groove, and the projection The gauge is arranged on the side wall of the groove.

6. The electronic device according to claim 4, wherein the electronic device further comprises a bracket disposed in the groove, the floodlight, the time-of-flight receiver, and the time-of-flight At least one of the projectors is mounted on the bracket.

7 . The electronic device according to claim 3 , wherein the casing comprises a top edge, the non-pixel area is located at one end of the display screen close to the top edge, and the center of the non-pixel area is 7 . on the mid-perpendicular line of the top edge.

8 . The electronic device according to claim 7 , wherein the display screen corresponding to the non-pixel area comprises any one of a glass substrate, a diffusion plate, a diffraction plate, and a Fresnel lens. 9 .