CN109257463B - Terminal device, control method thereof and computer-readable storage medium - Google Patents

Abstract

Embodiments of the present invention provide a terminal device and a control method thereof, relate to the technical field of terminals, and are used to solve the problem that the photosensitive device limits the screen ratio of the terminal device to further increase. The terminal device includes: a lens, an image sensor, a control module and a display screen; when an image is captured by a camera module composed of a lens and an image sensor, the image sensor receives ambient light through the lens, and senses the received ambient light to generate a first The control module converts the first electrical signal into an image signal; when the image is not captured by the camera module composed of the lens and the image sensor and the display screen displays the image, the image sensor receives the ambient light through the lens and senses the received environment The light generates a second electrical signal, and the control module determines the brightness of the ambient light according to the second electrical signal, and adjusts the display brightness of the display screen according to the brightness of the ambient light. The embodiments of the present invention are used in the manufacture of terminal equipment.

Description

A terminal device and its control method and computer-readable storage medium

technical field

The present invention relates to the technical field of terminals, and in particular, to a terminal device and a control method thereof.

Background technique

With the development of terminal technology, terminal devices are becoming more and more intelligent, and the screen ratio of terminal devices is also increasing. Among them, automatically adjusting the display brightness of the display screen of the terminal device according to the ambient light brightness is an important embodiment of the intelligence of the terminal device.

At present, in the prior art, photosensitive devices are mainly used to automatically adjust the display brightness of the display screen of the terminal device according to the ambient light brightness. The brightness is adjusted to the display brightness corresponding to the ambient light brightness. As the screen ratio of terminal equipment becomes higher and higher, the terminal equipment becomes thinner and lighter, and the requirements for the stacking space of the structure of terminal equipment become more and more strict. The photosensitive device that displays the brightness of the screen has only a single photosensitive function, and needs to occupy a certain structural control, which seriously restricts the further increase of the screen ratio of the terminal device.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a terminal device and a control method thereof, which are used to solve the problem that the photosensitive device that automatically adjusts the display brightness of the display screen of the terminal device according to the ambient light brightness limits the screen ratio of the terminal device to further increase.

In order to solve the above-mentioned technical problems, the present invention is achieved in this way:

In a first aspect, an embodiment of the present invention provides a terminal device, including: a lens, an image sensor, a control module, and a display screen;

The image sensor is located on the light-emitting side of the lens, and the image sensor is electrically connected to the control module;

When capturing an image through the camera module composed of the lens and the image sensor, the image sensor is used to receive ambient light through the lens, and sense the received ambient light to generate a first electrical signal, and the control module is used for converting the first electrical signal into an image signal;

When the image is not captured by the camera module composed of the lens and the image sensor and the display screen displays the image, the image sensor is used to receive ambient light through the lens, and sense the received ambient light to generate the first Two electrical signals, the control module is configured to determine the brightness of the ambient light according to the second electrical signal, and adjust the display brightness of the display screen according to the brightness of the ambient light.

In a second aspect, an embodiment of the present invention provides a method for controlling a terminal device, including:

When an image is captured by the camera module of the terminal device, the photosensitive device of the camera module is controlled to sense the received ambient light to generate a first electrical signal, and the first electrical signal is converted into an image signal;

When the image is not captured by the camera module of the terminal device and the display screen of the terminal device displays the picture, the photosensitive device of the camera module is controlled to sense the received ambient light to generate a second electrical signal, and a second electrical signal is generated according to the The second electrical signal determines the brightness of ambient light, and adjusts the display brightness of the display screen according to the brightness of the ambient light.

In a third aspect, an embodiment of the present invention provides a terminal device, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program is executed by the processor At the same time, the steps of implementing the control method of the terminal device according to the first aspect.

In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and the computer program is implemented as described in the first aspect when the computer program is executed by a processor. The steps of the control method of the terminal equipment.

The terminal device provided by the embodiment of the present invention includes: a lens, an image sensor, a control module, and a display screen; wherein, the image sensor is located on the light-emitting side of the lens, and the image sensor is electrically connected to the control module; When the camera module composed of the lens and the image sensor captures an image, the image sensor is used to receive ambient light through the lens, and sense the received ambient light to generate a first electrical signal, and the control module is used to The first electrical signal is converted into an image signal. When the image is not captured by the camera module composed of the lens and the image sensor and the display screen displays the image, the image sensor is used to receive ambient light through the lens. , and sense the received ambient light to generate a second electrical signal, the control module is configured to determine the brightness of the ambient light according to the second electrical signal, and adjust the display brightness of the display screen according to the brightness of the ambient light. That is, when the image is captured by the camera module, the ambient light received by the image sensor of the camera module generates a first electrical signal, which is then converted into an image signal; The ambient light received by the image sensor of the module generates a second electrical signal, and determines the brightness of the ambient light according to the second electrical signal, and then adjusts the display brightness of the display screen according to the brightness of the ambient light. The display brightness of the display screen can be adjusted by the brightness of the image sensor of the camera module. Therefore, the use of a photosensitive device can be avoided in the embodiment of the present invention, because the embodiment of the present invention can automatically adjust the brightness according to the ambient light without using a photosensitive device. The display brightness of the display screen of the terminal device, therefore, the embodiment of the present invention can solve the problem that the photosensitive device limits the screen ratio of the terminal device to further increase.

Description of drawings

1 is an architecture diagram of an Android operating system provided by an embodiment of the present invention;

FIG. 2 is one of schematic structural diagrams of a terminal device provided by an embodiment of the present invention;

3 is a comparison diagram of response frequency bands of an image sensor and a photosensitive device provided by an embodiment of the present invention;

FIG. 4 is the second schematic structural diagram of a terminal device provided by an embodiment of the present invention;

5 is a comparison diagram of the response field of view of an image sensor and a photosensitive device provided by an embodiment of the present invention;

6 is an optical path diagram of ambient light with an incident angle greater than a field of view of a camera module provided by an embodiment of the present invention;

FIG. 7 is a third schematic structural diagram of a terminal device provided by an embodiment of the present invention;

8 is a schematic structural diagram of a diffusion module provided by an embodiment of the present invention;

9 is a schematic diagram of a state of a diffusion module provided by an embodiment of the present invention;

FIG. 10 is another state schematic diagram of the diffusion module provided by the embodiment of the present invention;

11 is a flowchart of steps of a method for controlling a terminal device provided by an embodiment of the present invention;

FIG. 12 is a schematic diagram of a hardware structure of a terminal device according to an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

The term "and/or" in this article is only an association relationship to describe the associated objects, indicating that there can be three kinds of relationships, for example, A and/or B, it can mean that A exists alone, A and B exist at the same time, and A and B exist independently B these three cases.

The terms "first" and "second" and the like in the description and claims of the present invention are used to distinguish synchronized objects, rather than to describe a specific order of the objects. For example, the first interface, the second interface, etc. are used to distinguish different interfaces, rather than to describe a specific order of the interfaces.

In the embodiments of the present invention, words such as "exemplary" or "for example" are used to mean serving as an example, illustration or illustration. Any embodiments or designs described as "exemplary" or "such as" in the embodiments of the present invention should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present the related concepts in a specific manner. In addition, in the description of the embodiments of the present invention, unless otherwise specified, the meaning of "plurality" refers to two or more.

At present, in the prior art, photosensitive devices are mainly used to automatically adjust the display brightness of the display screen of the terminal device according to the ambient light brightness. The brightness is adjusted to the display brightness corresponding to the ambient light brightness. As the screen ratio of terminal equipment becomes higher and higher, the terminal equipment becomes thinner and lighter, and the requirements for the stacking space of the structure of terminal equipment become more and more strict. The photosensitive device that displays the brightness of the screen has only a single photosensitive function, and needs to occupy a certain structural control, which seriously restricts the further increase of the screen ratio of the terminal device.

In order to solve this problem, an embodiment of the present invention provides a terminal device and a control method thereof. The terminal device includes: a lens, an image sensor, a control module, and a display screen; wherein, the image sensor is located on the light-emitting side of the lens, and The image sensor is electrically connected to the control module; when an image is captured by the camera module composed of the lens and the image sensor, the image sensor is used to receive ambient light through the lens, and sense the received ambient light Generating a first electrical signal, the control module is used to convert the first electrical signal into an image signal, when the image is not captured by the camera module composed of the lens and the image sensor and the display screen displays the image , the image sensor is configured to receive ambient light through the lens, and sense the received ambient light to generate a second electrical signal, the control module is configured to determine the brightness of the ambient light according to the second electrical signal, and The brightness of the ambient light adjusts the display brightness of the display screen. That is, when the image is captured by the camera module, the ambient light received by the image sensor of the camera module generates a first electrical signal, which is then converted into an image signal; The ambient light received by the image sensor of the module generates a second electrical signal, and determines the brightness of the ambient light according to the second electrical signal, and then adjusts the display brightness of the display screen according to the brightness of the ambient light. The display brightness of the display screen can be adjusted by the brightness of the image sensor of the camera module. Therefore, the use of a photosensitive device can be avoided in the embodiment of the present invention, because the embodiment of the present invention can automatically adjust the brightness according to the ambient light without using a photosensitive device. The display brightness of the display screen of the terminal device, therefore, the embodiment of the present invention can solve the problem that the photosensitive device limits the screen ratio of the terminal device to further increase.

The terminal device in the embodiment of the present invention may be a terminal device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present invention.

The following takes the Android operating system as an example to introduce a software environment to which the method for controlling a terminal device provided by the embodiment of the present invention is applied.

As shown in FIG. 1 , it is a schematic structural diagram of a possible Android operating system provided by an embodiment of the present invention. In FIG. 1, the architecture of the Android operating system includes four layers, namely: an application layer, an application framework layer, a system runtime layer, and a kernel layer (specifically, a Linux kernel layer).

The application layer includes various applications (including system applications and target applications) in the Android operating system.

The application framework layer is the framework of the application, and developers can develop some applications based on the application framework layer under the condition of complying with the development principles of the framework of the application.

The system runtime layer includes libraries (also called system libraries) and the Android operating system runtime environment. The library mainly provides various resources required by the Android operating system. The Android operating system operating environment is used to provide a software environment for the Android operating system.

The kernel layer is the operating system layer of the Android operating system and belongs to the bottom layer of the Android operating system software layer. The kernel layer provides core system services and hardware-related drivers for the Android operating system based on the Linux kernel.

Taking the Android operating system as an example, in this embodiment of the present invention, a developer can develop a software program for implementing the control method of the terminal device provided by the embodiment of the present invention based on the system architecture of the Android operating system as shown in FIG. The control method of the terminal device may run based on the Android operating system as shown in FIG. 1 . That is, the processor or the terminal can implement the control method of the terminal device provided by the embodiment of the present invention by running the software program in the Android operating system.

The terminal device in this embodiment of the present invention may be a mobile terminal or a non-mobile terminal. The mobile terminal may be a mobile phone, a tablet computer, a notebook computer, a handheld computer, a vehicle-mounted terminal, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc.; The mobile terminal may be a personal computer (personal computer, PC), a television (television, TV), a teller machine, or a self-service machine, etc. The embodiment of the present invention is not specifically limited.

Embodiment 1.

An embodiment of the present invention provides a terminal device. Specifically, as shown in FIG. 2 , the terminal device includes: a lens 11 , an image sensor 12 , a control module 13 , and a display screen 14 .

The image sensor 12 is located on the light-emitting side of the lens 11 , and both the image sensor 12 and the display screen 14 are electrically connected to the control module 13 .

Specifically, the lens 11 in the embodiment of the present invention includes: a plurality of optical lenses for adjusting the received ambient light, and outputting the modulated ambient light to the image sensor 12 on the output side; the image sensor 12 specifically It can be a metal-oxide-semiconductor (Complementary Metal-Oxide Semiconductor, CMOS) image sensor.

When capturing an image through the camera module composed of the lens 11 and the image sensor 12, the image sensor 12 is used to receive ambient light through the lens 11, and sense the received ambient light to generate a first electrical signal, the The control module 13 is used for converting the first electrical signal into an image signal.

That is, when an image is captured by the camera module composed of the lens 11 and the image sensor 12, the working principle and working state of each component (the lens 11, the image sensor 12, the control module 13) are the same as those in the prior art, so First of all, the embodiment of the present invention can ensure that the camera module composed of the lens 11 and the image sensor 12 can normally capture images.

When the image is not captured by the camera module composed of the lens 11 and the image sensor 12 and the display screen 14 displays the picture, the image sensor 12 is used to receive ambient light through the lens 11, and receive the ambient light by induction. The received ambient light generates a second electrical signal, and the control module 13 is configured to determine the brightness of the ambient light according to the second electrical signal, and adjust the display brightness of the display screen 14 according to the brightness of the ambient light.

Exemplarily, the application scenarios in which the image is not captured by the camera module composed of the lens 11 and the image sensor 12 and the screen is displayed on the display screen 14 may include: browsing web pages through a terminal device, playing games through a terminal device, The terminal device edits text and uses other camera modules of the terminal device to take photos, videos, and video calls. This is not limited in this embodiment of the present invention. The module captures an image and the display screen 14 displays an image (not a standby interface).

Further, referring to Fig. 3, Fig. 3 shows the response sensitivity of the image sensor in the commonly used camera module to light of different wavelengths (shown by the solid curve in Fig. 3) and the commonly used photosensitive devices for photosensitive detection to different wavelengths. The light response sensitivity (shown by the dashed curve in Figure 3). As shown in Figure 3, the response sensitivity curve of the image sensor to light of different wavelengths shows that the wavelength range of the light that the image sensor can respond to is 400nm-1000nm. The wavelength range of the light that can be responded is 400nm-700nm, and the response spectrum range of the photosensitive device completely falls within the response spectrum range of the image sensor, so the image sensor in the camera module can be used to accurately detect the brightness of the ambient light. .

It should be noted that, since the wavelength range that the photosensitive device can respond to completely falls within the wavelength range of the light that the image sensor can respond to, the working state of the image sensor in the above-mentioned embodiment when capturing an image can be the same as that when the image is not captured and the display However, since the image sensor needs to sense a longer wavelength range when capturing images, the power consumption of the image sensor is larger. The working state when the image is working will greatly increase the power consumption of the terminal device. Therefore, the working state of the image sensor when capturing an image can be different from the working state when the image is not captured and the display screen is displayed, and the image sensor is in the working state. The wavelength range sensed when the image is captured is larger than the wavelength range when the image is not captured and the display screen displays a picture.

The terminal device provided by the embodiment of the present invention includes: a lens, an image sensor, a control module, and a display screen; wherein, the image sensor is located on the light-emitting side of the lens, and the image sensor is electrically connected to the control module; When the camera module composed of the lens and the image sensor captures an image, the image sensor is used to receive ambient light through the lens, and sense the received ambient light to generate a first electrical signal, and the control module is used to The first electrical signal is converted into an image signal. When the image is not captured by the camera module composed of the lens and the image sensor and the display screen displays the image, the image sensor is used to receive ambient light through the lens. , and sense the received ambient light to generate a second electrical signal, the control module is configured to determine the brightness of the ambient light according to the second electrical signal, and adjust the display brightness of the display screen according to the brightness of the ambient light. That is, when the image is captured by the camera module, the ambient light received by the image sensor of the camera module generates a first electrical signal, which is then converted into an image signal; The ambient light received by the image sensor of the module generates a second electrical signal, and determines the brightness of the ambient light according to the second electrical signal, and then adjusts the display brightness of the display screen according to the brightness of the ambient light. The display brightness of the display screen can be adjusted by the brightness of the image sensor of the camera module. Therefore, the use of a photosensitive device can be avoided in the embodiment of the present invention, because the embodiment of the present invention can automatically adjust the brightness according to the ambient light without using a photosensitive device. The display brightness of the display screen of the terminal device, therefore, the embodiment of the present invention can solve the problem that the photosensitive device limits the screen ratio of the terminal device to further increase.

Optionally, when capturing an image through the camera module composed of the lens 11 and the image sensor 12, the control module 13 is further configured to determine the brightness of the ambient light according to the first electrical signal, and determine the brightness of the ambient light according to the ambient light. to adjust the display brightness of the display screen 14.

In the above embodiment, when an image is captured by the camera module composed of the lens and the image sensor, the control module is further configured to determine the brightness of the ambient light according to the first electrical signal, and adjust the brightness of the ambient light according to the brightness of the ambient light. The display brightness of the display screen can also be adjusted when an image is captured by the camera module composed of the lens and the image sensor.

Optionally, as shown in FIG. 4 , the terminal device provided by the embodiment of the present invention may further include: a lens barrel 15 , an infrared filter 16 , a printed circuit board (Printed Circuit Board, PCB) and/or a flexible circuit board (FlexiblePrinted Circuit, FPC) and other components;

Wherein, the lens barrel 15 forms an accommodating cavity for placing the lens 11 shown, for fixing the lens 11; the infrared filter 16 is located between the light-emitting side of the lens 11 and the image sensor 12, and is used for The infrared light in the ambient light output by the lens 11 is filtered; the PCB) and/or the FPC are electrically connected to the image sensor 12 for conducting the electrical signals generated by the image sensor 12 .

Still further, referring to Figure 5, Figure 5 shows the response sensitivity of the image sensor in the commonly used camera module to light with different field angles (shown by the solid curve in Figure 5) and the commonly used photosensitive devices for photosensitive detection. Response sensitivity to light at different field angles (shown by the dashed curve in Figure 5). As can be seen from Figure 5, the field of view of the image sensor receiving light is about 80°, while the field of view of the photosensitive device receiving light exceeds 120°. If the image sensor of the camera module is directly used for environmental detection, then The image sensor of the camera module can only detect the light within the field of view of the camera module. As shown in Figure 6, the large-angle light beyond the field of view of the camera module cannot reach the camera due to the structure of the camera module itself. Therefore, if the angle of ambient light exceeds the field of view of the image sensor of the camera module, the brightness of the ambient light cannot be accurately detected, and the display brightness of the display screen of the terminal device cannot be adjusted accurately.

In order to avoid the above problems, as shown in FIG. 7 , the terminal device provided by the embodiment of the present invention further includes: a diffusion module 18 located on the light incident side of the lens 11 ;

When capturing an image through the camera module composed of the lens 11 and the image sensor 12, the diffusion module 18 is used to transmit ambient light;

When an image is not captured by the camera module composed of the lens 11 and the image sensor 12 and the display screen 14 displays a picture, the diffusion module 18 is used for scattering the ambient light input to the lens 11 .

That is, when an image is captured by the camera module composed of the lens 11 and the image sensor 12, the diffusion module 18 does not diffuse the ambient light, but directly transmits the ambient light, thereby ensuring that the camera module can shoot images normally, When the image is not captured by the camera module composed of the lens 11 and the image sensor 12 and the display screen 14 displays the image, the diffusion module scatters the ambient light input to the lens 11, so the incident angle can be avoided The environment larger than the field of view of the camera module cannot be detected by the image sensor of the camera module, so that the brightness of the ambient light can be accurately detected.

Further, optionally, as shown in FIG. 8 , the diffusion module 18 includes: a first light-transmitting electrode layer 181 , a second light-transmitting electrode layer 182 , and the first light-transmitting electrode layer 181 and the second light-transmitting electrode layer 182 . The liquid crystal layer 183 between the two light-transmitting electrode layers 182 .

Exemplarily, the light-transmitting electrode may specifically be an electrode made of a light-transmitting conductive material such as indium tin oxide (ITO), graphene, or the like.

The working principle of the diffusion module 18 provided in the above embodiment will be described below with reference to FIG. 9 and FIG. 10 .

First, as shown in FIG. 9 , when the diffusion module 18 is in one state, the liquid crystal molecules in the liquid crystal layer 183 do not need to be arranged. At this time, the diffusion module 18 scatters the received light and transmits it.

Next, referring to FIG. 10 , when the diffusion module 18 is in another state, the liquid crystal molecules in the liquid crystal layer 183 need to be arranged, and at this time, the diffusion module 18 directly transmits the received light.

Exemplarily, the state shown in FIG. 9 may be the state when both the first light-transmitting electrode 181 and the second light-transmitting electrode 182 are connected to a low level, and the state shown in FIG. 10 may be that the first light-transmitting electrode connection 181 is connected. The state when the second light-transmitting electrode connection 182 is connected to a high level.

Optionally, the low level can be the reference ground of the terminal equipment, and the high level can be the power supply voltage of the terminal equipment; The electrode connection 181 inputs the reference ground voltage and the first light-transmitting electrode connection 181 inputs the power supply voltage. The light-transmitting electrode connection 181 and the second light-transmitting electrode 182 are both input with a reference ground voltage.

Optionally, the terminal device further includes: a light-transmitting cover plate disposed on the light incident side of the lens; the diffusion module is packaged in the light-transmitting cover plate.

Specifically, the lens 11 of the camera module of the terminal equipment will have a light-transmitting cover on the light-incident side to protect the lens 11 from dust and water. In terms of volume, in the embodiment of the present invention, the diffusion module 18 can be packaged in the light-transmitting cover plate in front of the lens 11 .

Embodiment two,

An embodiment of the present invention provides a method for controlling a terminal device. Specifically, as shown in FIG. 11 , the method includes:

S11. Determine whether an image is being captured by a camera module of the terminal device.

In the above step S11, if the image is being captured by the camera module of the terminal device, then step S12 is executed, and if the image is captured by the camera module of the terminal device, then step S13 is executed.

S12. Control the photosensitive device of the camera module to sense the received ambient light to generate a first electrical signal, and convert the first electrical signal into an image signal.

S13. Determine whether the display screen of the terminal device is displaying a picture.

In the above step S13, if the display screen of the terminal device does not display a picture, the process ends, and if the display screen of the terminal device is displaying a picture, step S14 is executed.

S14. Control the photosensitive device of the camera module to generate a second electrical signal by sensing the received ambient light, determine the brightness of the ambient light according to the second electrical signal, and adjust the display screen according to the brightness of the ambient light display brightness.

Optionally, the method further includes: when capturing an image through the camera module of the terminal device, controlling the diffusion module of the terminal device to transmit ambient light;

When the image is not captured by the camera module of the terminal device and the display screen of the terminal device displays the picture, the diffusion module of the terminal device is controlled to scatter the ambient light input to the lens of the camera module.

Optionally, the diffusion module includes: a first light-transmitting electrode layer, a second light-transmitting electrode layer, and a liquid crystal layer located between the first light-transmitting electrode layer and the second light-transmitting electrode layer;

The controlling the diffusion module of the terminal device to transmit ambient light includes: applying a first voltage to the second transparent electrode;

The controlling the diffusion module of the terminal device to scatter the ambient light input to the lens of the camera module includes: applying a second voltage to the second transparent electrode.

Optionally, the method further includes:

When an image is captured by the camera module of the terminal device, the brightness of the ambient light is determined according to the first electrical signal, and the display brightness of the display screen is adjusted according to the brightness of the ambient light.

In the terminal device control method provided by the embodiment of the present invention, when an image is captured by a camera module of the terminal device, the image sensor of the camera module senses the received ambient light to generate a first electrical signal, and transmits the The first electrical signal is converted into an image signal, and when the image is not captured by the camera module of the terminal device and the display screen of the terminal device displays the picture, the image sensor of the camera module senses the received ambient light to generate the first signal. and the brightness of the ambient light is determined according to the second electrical signal, and the display brightness of the display screen is adjusted according to the brightness of the ambient light. That is, when the image is captured by the camera module, the ambient light received by the image sensor of the camera module generates a first electrical signal, which is then converted into an image signal; The ambient light received by the image sensor of the module generates a second electrical signal, and determines the brightness of the ambient light according to the second electrical signal, and then adjusts the display brightness of the display screen according to the brightness of the ambient light. The display brightness of the display screen can be adjusted by the brightness of the image sensor of the camera module. Therefore, the use of a photosensitive device can be avoided in the embodiment of the present invention, because the embodiment of the present invention can automatically adjust the brightness according to the ambient light without using a photosensitive device. The display brightness of the display screen of the terminal device, therefore, the embodiment of the present invention can solve the problem that the photosensitive device limits the screen ratio of the terminal device to further increase.

Embodiment three,

FIG. 12 is a schematic diagram of the hardware structure of a terminal device implementing various embodiments of the present invention. As shown in FIG. 12 , the terminal device 100 includes but is not limited to: a radio frequency unit 101 , a network module 102 , an audio output unit 103 , and an input unit 104 , sensor 105 , display unit 106 , user input unit 107 , interface unit 108 , memory 109 , processor 110 , and power supply 111 and other components. Those skilled in the art can understand that the structure of the terminal device shown in FIG. 12 does not constitute a limitation on the terminal device, and the terminal device may include more or less components than the one shown, or combine some components, or different components layout. In the embodiment of the present invention, the terminal device includes but is not limited to a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

The processor 110 is configured to control the photosensitive device of the camera module to generate a first electrical signal by sensing the received ambient light when an image is captured by the camera module of the terminal device, and to send the first electrical signal to the camera module. An electrical signal is converted into an image signal; when the image is not captured by the camera module of the terminal device and the display screen of the terminal device displays the picture, the photosensitive device of the camera module is controlled to sense the received ambient light to generate the first and the brightness of the ambient light is determined according to the second electrical signal, and the display brightness of the display screen is adjusted according to the brightness of the ambient light.

The terminal device provided by the embodiment of the present invention includes: a lens, an image sensor, a control module, and a display screen; wherein, the image sensor is located on the light-emitting side of the lens, and both the image sensor and the display screen are connected to the control module. Electrical connection; when an image is captured by the camera module composed of the lens and the image sensor, the image sensor is used to receive ambient light through the lens, and sense the received ambient light to generate a first electrical signal, and the control The module is used to convert the first electrical signal into an image signal, and when the image is not captured by the camera module composed of the lens and the image sensor and the display screen displays the picture, the image sensor is used to pass the image. The lens receives ambient light and senses the received ambient light to generate a second electrical signal, the control module is configured to determine the brightness of the ambient light according to the second electrical signal, and adjust the display according to the brightness of the ambient light display brightness of the screen. That is, when the image is captured by the camera module, the ambient light received by the image sensor of the camera module generates a first electrical signal, which is then converted into an image signal; The ambient light received by the image sensor of the module generates a second electrical signal, and determines the brightness of the ambient light according to the second electrical signal, and then adjusts the display brightness of the display screen according to the brightness of the ambient light. The display brightness of the display screen can be adjusted by the brightness of the image sensor of the camera module. Therefore, the use of a photosensitive device can be avoided in the embodiment of the present invention, because the embodiment of the present invention can automatically adjust the brightness according to the ambient light without using a photosensitive device. The display brightness of the display screen of the terminal device, therefore, the embodiment of the present invention can solve the problem that the photosensitive device limits the screen ratio of the terminal device to further increase.

It should be understood that, in this embodiment of the present invention, the radio frequency unit 101 may be used for receiving and sending signals in the process of sending and receiving information or during a call. Specifically, after receiving the downlink data from the base station, it is processed by the processor 110; The uplink data is sent to the base station. Generally, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with the network and other devices through a wireless communication system.

The terminal device provides the user with wireless broadband Internet access through the network module 102, such as helping the user to send and receive emails, browse web pages, and access streaming media.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into audio signals and output as sound. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the terminal device (eg, call signal reception sound, message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.

The input unit 104 is used to receive audio or video signals. The input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042. The graphics processor 1041 captures images of still pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode data is processed. The processed image frames may be displayed on the display unit 106 . The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the network module 102. The microphone 1042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 101 for output in the case of a telephone call mode.

The terminal device also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and/or when the terminal device is moved to the ear. or backlight. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the terminal device (such as horizontal and vertical screen switching, related games , magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 105 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, Infrared sensors, etc., are not repeated here.

The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

The user input unit 107 may be used to receive input numerical or character information, and generate key signal input related to user setting and function control of the terminal device. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072 . The touch panel 1071, also referred to as a touch screen, can collect the user's touch operations on or near it (such as the user's finger, stylus, etc., any suitable object or attachment on or near the touch panel 1071). operate). The touch panel 1071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 110, the command sent by the processor 110 is received and executed. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1071 , the user input unit 107 may also include other input devices 1072 . Specifically, other input devices 1072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be described herein again.

Further, the touch panel 1071 can be covered on the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits it to the processor 110 to determine the type of the touch event, and then the processor 110 determines the type of the touch event according to the touch The type of event provides corresponding visual output on display panel 1061 . Although in FIG. 12 , the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the terminal device, but in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated The input and output functions of the terminal device are implemented, which is not specifically limited here.

The interface unit 108 is an interface for connecting an external device and a terminal device. For example, external devices may include wired or wireless headset ports, external power (or battery charger) ports, wired or wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 108 may be used to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more elements in the terminal device or may be used between the terminal device and the external device. transfer data between.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required for at least one function, etc.; Data created by the use of the mobile phone (such as audio data, phone book, etc.), etc. Additionally, memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is the control center of the terminal equipment, uses various interfaces and lines to connect various parts of the entire terminal equipment, runs or executes the software programs and/or modules stored in the memory 109, and calls the data stored in the memory 109. , perform various functions of the terminal equipment and process data, so as to monitor the terminal equipment as a whole. The processor 110 may include one or more processing units; optionally, the processor 110 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem The modulation processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 110 .

The terminal device may also include a power supply 111 (such as a battery) that supplies power to various components. Optionally, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption management through the power management system. and other functions.

In addition, the terminal device includes some unshown functional modules, which are not repeated here.

Embodiment four,

Embodiments of the present invention further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process of the above-mentioned embodiment of the control method for a terminal device can be implemented, and can achieve the same In order to avoid repetition, the technical effect will not be repeated here. Among them, the computer-readable storage medium, such as a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk or an optical disk, etc.

The terminal device and the computer storage medium provided in the embodiments of the present invention are all used to execute the corresponding methods provided above. Therefore, for the beneficial effects that can be achieved, reference may be made to the beneficial effects of the corresponding methods provided above. , and will not be repeated here.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

From the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course hardware can also be used, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present invention.

The embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of the present invention, without departing from the spirit of the present invention and the scope protected by the claims, many forms can be made, which all belong to the protection of the present invention.

Claims (8)

1. A terminal device, comprising: the device comprises a lens, an image sensor, a control module and a display screen;

the image sensor is positioned on the light emitting side of the lens and is electrically connected with the control module;

when a camera module consisting of the lens and the image sensor is used for shooting an image, the image sensor is used for receiving ambient light through the lens and sensing the received ambient light to generate a first electric signal, and the control module is used for converting the first electric signal into an image signal;

when an image is not shot through a camera module consisting of the lens and the image sensor and the display screen displays a picture, the image sensor is used for receiving ambient light through the lens and sensing the received ambient light to generate a second electric signal, and the control module is used for determining the brightness of the ambient light according to the second electric signal and adjusting the display brightness of the display screen according to the brightness of the ambient light;

the terminal device further includes: the diffusion module is positioned on the light incident side of the lens;

when the camera shooting module consisting of the lens and the image sensor shoots an image, the diffusion module is used for transmitting ambient light;

when the image is not shot through the camera module consisting of the lens and the image sensor and the display screen displays a display screen, the diffusion module is used for scattering the ambient light input into the lens.

2. The terminal device of claim 1, wherein the diffusion module comprises: the liquid crystal display panel comprises a first light-transmitting electrode layer, a second light-transmitting electrode layer and a liquid crystal layer located between the first light-transmitting electrode layer and the second light-transmitting electrode layer.

3. The terminal device according to claim 2, wherein the terminal device further comprises: the light-transmitting cover plate is arranged on the light incidence side of the lens; the diffusion module is packaged in the light-transmitting cover plate.

4. The terminal device according to any one of claims 1 to 3, wherein when an image is captured by a camera module comprising the lens and the image sensor, the control module is further configured to determine a brightness of ambient light according to the first electrical signal, and adjust the display brightness of the display screen according to the brightness of the ambient light.

5. A control method of a terminal device, comprising:

when an image is shot through a camera module of the terminal equipment, a photosensitive device of the camera module is controlled to sense received ambient light to generate a first electric signal, and the first electric signal is converted into an image signal;

when an image is not shot through a camera module of the terminal equipment and a display screen of the terminal equipment displays a picture, controlling a photosensitive device of the camera module to sense received ambient light to generate a second electric signal, determining the brightness of the ambient light according to the second electric signal, and adjusting the display brightness of the display screen according to the brightness of the ambient light;

the method further comprises the following steps:

when the image is shot through the camera module of the terminal equipment, controlling the diffusion module of the terminal equipment to transmit ambient light;

and when the image is not shot through the camera module of the terminal equipment and the display screen of the terminal equipment displays a display picture, controlling the diffusion module of the terminal equipment to scatter the ambient light input into the lens of the camera module.

6. The method of claim 5, wherein the diffusion module comprises: the liquid crystal display panel comprises a first light-transmitting electrode layer, a second light-transmitting electrode layer and a liquid crystal layer positioned between the first light-transmitting electrode layer and the second light-transmitting electrode layer;

control terminal equipment's diffusion module transmission ambient light includes: applying a first voltage to the second transparent electrode;

the control the diffusion module of terminal equipment carries out the scattering to the ambient light of the camera lens of inputing the module of making a video recording, include: applying a second voltage to the second transparent electrode.

7. The method according to any one of claims 5-6, further comprising:

when the image is shot through the camera module of the terminal device, the brightness of the ambient light is determined according to the first electric signal, and the display brightness of the display screen is adjusted according to the brightness of the ambient light.

8. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the control method of a terminal device according to any one of claims 5 to 7.

Images