CN111090104B - Imaging processing method and electronic device - Google Patents

Abstract

The invention discloses an imaging processing method and an electronic device. The method includes: acquiring a first target position of a target object in a first image, the first image being generated by a pixel array in an on state of a TOF sensor module; determining A first sub-pixel array corresponding to the first target position in a sub-pixel array list, the sub-pixel array list including a plurality of sub-pixel arrays of the pixel array; closing other sub-pixel arrays except the first sub-pixel array a pixel array, and based on the first sub-pixel array, the first image is updated. It can be seen that the present invention realizes the imaging of the target object by dividing the pixel array of the TOF sensor module into a plurality of sub-pixel arrays in advance, and during the imaging process of the target object, only a part of the necessary sub-pixel arrays are turned on. Therefore, the power consumption of the TOF sensor module can be effectively reduced.

Description

Image processing method and electronic device

technical field

The invention relates to the field of terminals, in particular to an imaging processing method and electronic equipment.

Background technique

The TOF (Time of flight, time of flight) sensor module can continuously send light pulses to the target object through the pixel array of the transmitting sensor, and then use the pixel array of the receiving sensor to receive the light pulses returned from the target object, and detect the flight of the light pulse (round trip) time to get the distance of the target object, and generate a depth image or 3D (Dimensions, dimension) image through the measured points.

At present, when the TOF sensor module performs imaging processing of the target object, all the pixel arrays of the transmitting sensor and the receiving sensor will be in the working state, and the power consumption is high.

Therefore, there is an urgent need for an imaging processing solution with lower power consumption.

Contents of the invention

The purpose of the embodiments of the present invention is to provide an imaging processing method and electronic equipment to solve the problem of high power consumption of the TOF sensor module during object imaging processing.

In a first aspect, a method for imaging processing is provided, the method comprising:

Obtain the first target position of the target object in the first image, the first image is generated by the pixel array in the ON state of the TOF sensor module;

determining a first sub-pixel array corresponding to the first target position in a sub-pixel array list, the sub-pixel array list including a plurality of sub-pixel arrays of the pixel array;

Turning off other sub-pixel arrays other than the first sub-pixel array, and updating the first image based on the first sub-pixel array.

In a second aspect, an electronic device is provided, and the electronic device includes:

An acquisition module, configured to acquire the first target position of the target object in the first image, the first image being generated by the pixel array in the ON state of the TOF sensor module;

A determining module, configured to determine a first sub-pixel array corresponding to the first target position in a sub-pixel array list, the sub-pixel array list including a plurality of sub-pixel arrays of the pixel array;

A closing module, configured to close other sub-pixel arrays other than the first sub-pixel array, and update the first image based on the first sub-pixel array.

In a third aspect, an electronic device is provided, and the electronic device includes: a processor, a memory, and a computer program stored on the memory and operable on the processor, the computer program being executed by the processor When executed, the steps of the method described in the first aspect are realized.

In a fourth aspect, a computer-readable storage medium is provided, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method described in the first aspect are implemented.

In the embodiment of the present invention, the pixel array of the TOF sensor module is divided into multiple sub-pixel arrays in advance, and only part of the necessary sub-pixel arrays are turned on during the imaging process of the target object to realize the imaging of the target object , so that the power consumption of the TOF sensor module can be effectively reduced.

Description of drawings

The accompanying drawings described here are used to provide a further understanding of the present invention, and constitute a part of the present invention. The schematic embodiments of the present invention and their descriptions are used to explain the present invention, and do not constitute improper limitations to the present invention. In the attached picture:

FIG. 1 is a schematic flow chart of an imaging processing method provided by an embodiment of the present invention;

Fig. 2a is a schematic diagram of sub-pixel array division of an emission sensor of a TOF sensor module provided by an embodiment of the present invention;

Fig. 2b is a schematic diagram of sub-pixel array division of an emission sensor of a TOF sensor module provided by another embodiment of the present invention;

Fig. 2c is a schematic diagram of sub-pixel array division of a receiving sensor of a TOF sensor module provided by an embodiment of the present invention;

Fig. 2d is a schematic diagram of sub-pixel array division of a receiving sensor of a TOF sensor module provided by another embodiment of the present invention;

Fig. 2e is a schematic diagram of a first image and a second image including a target object provided by an embodiment of the present invention;

Fig. 2f is a schematic diagram of a third image including a target object provided by an embodiment of the present invention;

Fig. 3 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention;

Fig. 4 is a schematic structural diagram of an electronic device provided by another embodiment of the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

Various embodiments of the present invention are described in detail below in conjunction with accompanying drawing:

Fig. 1 is a schematic flowchart of an imaging processing method provided by an embodiment of the present invention, which can be executed by an electronic device. Referring to Fig. 1, the method may specifically include the following steps:

Step 102: Obtain the first target position of the target object in the first image, the first image is generated by the pixel array in the ON state of the TOF sensor module.

Wherein, the pixel array of the TOF sensor module includes the pixel array of the transmitting sensor as shown in Figure 2a and Figure 2b, and the pixel array of the receiving sensor as shown in Figure 2c to 2f; the target object can be in the The object in the overlapping region of the viewing angle of the transmitting sensor and the receiving sensor may also be an object outside the overlapping region of the viewing angle; the pixel array of the transmitting sensor includes a large number of laser diodes, which can transmit electrical signals Convert it into an optical pulse signal and emit it to the target object. The emission sensor can be a vertical cavity surface emitting laser (Vertical Cavity Surface Emitting Laser, VCSEL) chip, or a distributed Bragg reflector laser diode and a grating-coupled sampling reflective laser diode, etc. .

The pixel array of the receiving sensor includes a large number of photodiodes, which can receive the light pulse signal reflected by the target object, and convert the light pulse signal into an electrical signal, and generate a digital signal matrix ( That is, the image); the receiving sensor can be a chip similar to a complementary metal oxide semiconductor (ComplementaryMetal Oxide Semiconductor, CMOS) chip, and the difference between this chip and the CMOS chip is to realize higher quantum efficiency in the infrared band through circuit design (ie The photoelectric conversion capability of the chip is stronger), and the exposure mode of the chip is global exposure; the first image is an image including the target object generated by the pixel array of the receiving sensor.

It should be noted that one implementation of step 102 may be:

Step 1021: When it is detected that the TOF sensor module is turned on, turn on the pixel array of the transmitting sensor and the pixel array of the receiving sensor of the TOF sensor module;

Step 1022: Based on the pixel array of the transmitting sensor and the pixel array of the receiving sensor, generate a first image containing a target object, and acquire a first target position of the target object in the first image.

Step 104: Determine a first sub-pixel array corresponding to the first target position in a sub-pixel array list, where the sub-pixel array list includes a plurality of sub-pixel arrays of the pixel array.

Wherein, the sub-pixel array list includes: a first sub-pixel array list and a second sub-pixel array list, and the first sub-pixel array list includes a plurality of sub-pixel arrays obtained by dividing the pixel array of the receiving sensor of the TOF sensor module. Pixel array (as shown in Figure 2c, occupying two sub-pixel arrays of the A1 area and B1 area of the pixel array respectively; or as shown in Figure 2d to 2f, respectively occupying the A1 area, B1 area, C1 area and D1 area of the pixel array four sub-pixel arrays), the second sub-pixel array list includes a plurality of sub-pixel arrays obtained by dividing the pixel array of the emission sensor of the TOF sensor module (as shown in FIG. Two sub-pixel arrays in area B; as shown in FIG. 2b, four sub-pixel arrays respectively occupying area A, area B, area C and area D of the pixel array).

It should be noted that one implementation of step 104 may be:

Step 1041: Determine a first receiving sub-pixel array corresponding to the first target position in the first sub-pixel array list, the first receiving sub-pixel array is used to receive the light pulse signal reflected by the target object;

Step 1042: Determine the first emitting sub-pixel array corresponding to the first receiving sub-pixel array in the second sub-pixel array list, the first emitting sub-pixel array is used to emit the light to the target object Pulse signal.

Referring to Figure 2b and Figure 2e, assuming that the transmitting sensor is a VCSEL chip, the pixel array of the transmitting sensor is divided into four sub-pixel arrays of A area, B area, C area and D area, and the pixel array of the receiving sensor is divided into A1 area, For the four sub-pixel arrays in B1, C1, and D1, the target object is an object in the overlapping area of the field of view of the transmitting sensor and the receiving sensor, then step 1021, step 1022, step 1041 and step 1042 are specific Examples can be:

After the electronic device monitors that the TOF sensor module is switched from the off state to the on state, the sub-pixel arrays of the A area, B area, C area, and D area of the emitting sensor are turned on, and the A1 area and B1 area of the receiving sensor are turned on. , the sub-pixel arrays in C1 and D1 areas; the sub-pixel arrays in the A, B, C and D areas of the transmitting sensor emit light pulse signals to the target object "F", and receive the A1, B1, and C1 areas of the sensor The sub-pixel arrays in the area and the D1 area receive the light pulse signal emitted by the target object, and convert the light pulse signal into an electrical signal, and generate a digital signal matrix through the amplification circuit and the analog-to-digital conversion circuit in the logic circuit area (that is, the first image containing the target object "F" as shown in the left figure in Figure 2e), the electronic device determines the first target position based on the coordinates of the target object "F" in the first image, and determines the second The first receiving sub-pixel array that needs to be turned on in the receiving sensor corresponding to a target position is the sub-pixel array in the B1 area, and based on the pre-established corresponding relationship between the receiving sub-pixel array and the transmitting sub-pixel array, the first receiving sub-pixel array is determined The corresponding first emitting sub-pixel array is the sub-pixel array of the B area.

It can be seen that by determining the corresponding first receiving sub-pixel array based on the first target position, and determining the corresponding first emitting sub-pixel array based on the first receiving sub-pixel array, it is possible to more accurately and efficiently determine A necessary sub-pixel array capable of ensuring complete imaging of the target object is produced.

Step 106: Turn off other sub-pixel arrays except the first sub-pixel array, and update the first image based on the first sub-pixel array.

It should be noted that, in step 106, an implementation manner of closing other sub-pixel arrays and image updating may be as follows:

Step 1061: Turn off the first receiving sub-pixel array and other sub-pixel arrays except the first emitting sub-pixel array;

Step 1062: Update the first image based on the first receiving sub-pixel array and the first transmitting sub-pixel array.

Referring to Fig. 2b and Fig. 2e, assuming that the first receiving sub-pixel array is the sub-pixel array of B1 area, and the first transmitting sub-pixel array is the sub-pixel array of B area, then step 1061 and step 1062 can be exemplified specifically as follows:

The electronic device turns off the sub-pixel arrays in the A1 area, C1 area, and D1 area, and the sub-pixel arrays in the A area, C area, and D area, and the sub-pixel array in the B area of the transmitting sensor emits a light pulse signal to the target object "F", The sub-pixel array in the B1 area of the receiving sensor receives the light pulse signal emitted by the target object, and converts the light pulse signal into an electrical signal, which is updated through the amplification circuit and analog-to-digital conversion circuit in the logic circuit area, as shown in the figure The first image containing the target object "F" is shown on the left in 2e.

Based on this, by turning off other non-essential sub-pixel arrays and updating the first image based on the necessary sub-pixel arrays, the power consumption of the TOF sensor module can be effectively reduced on the basis of ensuring complete imaging of the target object.

It should be noted that an implementation of image updating in step 106 may be:

Step 1061': Based on the first sub-pixel array, generate a second image, where the second image is a partial image including the target object in the first image;

Step 1062': update the position of the target object in the second image;

Step 1063': If it is detected that the target object moves out of the second image, turn on other sub-pixel arrays except the first sub-pixel array;

Step 1064': Generate a third image based on the sub-pixel array list.

Referring to Fig. 2b, Fig. 2e and Fig. 2f, assuming that the first receiving sub-pixel array is the sub-pixel array of B1 area, and the first emitting sub-pixel array is the sub-pixel array of B area, then step 1061' to step 1064' can be specifically illustrated for:

The sub-pixel array in area B of the transmitting sensor transmits a light pulse signal to the target object "F", and the sub-pixel array in area B1 of the receiving sensor receives the light pulse signal emitted by the target object and converts the light pulse signal As an electrical signal, through the amplification circuit and the analog-to-digital conversion circuit in the logic circuit area, the second image as shown in the right figure in Figure 2e is generated, and the second image is the target contained in the first image as shown in the left figure in Figure 2e A partial image of the object "F"; the electronic device updates the position of the target object "F" in the second image every preset time, and if it detects that the target object "F" moves out of the second image, it will reopen the A1 area, C1 The sub-pixel arrays of Zones A and D1, and the sub-pixel arrays of Zones A, C, and D; the sub-pixel arrays of Zones A, B, C, and D of the transmit sensor transmit light pulses to the target object "F" signal, the sub-pixel arrays in the A1 area, B1 area, C1 area, and D1 area of the receiving sensor receive the light pulse signal emitted by the target object, and convert the light pulse signal into an electrical signal, through the logic circuit area The amplification circuit and the analog-to-digital conversion circuit regenerate the digital signal matrix (that is, the third image containing the target object "F" as shown in FIG. 2f).

Based on this, when it is detected that the target object moves out of the second image, all the sub-pixel arrays in the sub-pixel array list are turned on to generate the third image containing the target object, thereby ensuring the integrity of the imaging of the target object.

Further, after step 106, the method also includes a step of re-determining the necessary sub-pixel array, an implementation of this step may be:

S1: Obtain a third target position of the target object in the third image;

S2: Determine a third sub-pixel array corresponding to the third target position in the sub-pixel array list, where the third sub-pixel array is different from the first sub-pixel array;

S3: Turn off other sub-pixel arrays other than the third sub-pixel array, and update the third image based on the third sub-pixel array.

It should be noted that one implementation of S2 may be:

S21: Determine a third receiving sub-pixel array corresponding to the third target position in the first sub-pixel array list;

S22: Determine a third transmitting sub-pixel array corresponding to the third receiving sub-pixel array in the second sub-pixel array list.

Referring to Figure 2f, S1, S21, S22 and S3 can be specifically exemplified as:

The electronic device determines the third target position based on the coordinates of the target object "F" in the third image; the electronic device determines that the third receiving sub-pixel array corresponding to the third target position that needs to be turned on by the receiving sensor is the sub-pixel in the C1 area Array, and based on the pre-established corresponding relationship between the receiving sub-pixel array and the transmitting sub-pixel array, it is determined that the third transmitting sub-pixel array corresponding to the third receiving sub-pixel array is the sub-pixel array of the C area; the electronic device closes the A1 area, The sub-pixel arrays in B1 and D1 areas, as well as the sub-pixel arrays in A, B, and D areas, the sub-pixel arrays in C area of the transmitting sensor emit light pulse signals to the target object "F", and receive the light pulse signals in the C1 area of the sensor. The sub-pixel array receives the light pulse signal emitted by the target object, converts the light pulse signal into an electrical signal, and updates the information contained in FIG. 2f through the amplification circuit and analog-to-digital conversion circuit in the logic circuit area A third image of the target object "F".

It can be seen that by determining the corresponding third sub-pixel array based on the updated third target position of the target object, and turning off other non-essential sub-pixel arrays, the first image is updated based on the necessary sub-pixel array. The power consumption of the TOF sensor module is reduced on the basis of complete imaging of the object.

It can be seen that in this embodiment, the pixel array of the TOF sensor module is divided into multiple sub-pixel arrays in advance, and only part of the necessary sub-pixel arrays are turned on during the imaging process of the target object to realize the imaging of the target object, thereby The power consumption of the TOF sensor module can be effectively reduced.

FIG. 3 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention. Referring to FIG. 3 , the electronic device may specifically include an acquisition module 302, a determination module 304, and a shutdown module 306, wherein:

An acquisition module 302, configured to acquire a first target position of the target object in the first image, the first image being generated by the pixel array in the ON state of the TOF sensor module;

A determining module 304, configured to determine a first sub-pixel array corresponding to the first target position in a sub-pixel array list, where the sub-pixel array list includes a plurality of sub-pixel arrays of the pixel array;

The closing module 306 is configured to close other sub-pixel arrays except the first sub-pixel array, and update the first image based on the first sub-pixel array.

Optionally, the sub-pixel array list includes: a first sub-pixel array list and a second sub-pixel array list, the first sub-pixel array list includes the pixel array obtained by dividing the receiving sensor of the TOF sensor module A plurality of sub-pixel arrays, the second sub-pixel array list includes a plurality of sub-pixel arrays obtained by dividing the pixel array of the emission sensor of the TOF sensor module;

Wherein, the determining module 304 includes:

The first determination sub-module is configured to determine a first receiving sub-pixel array corresponding to the first target position in the first sub-pixel array list, and the first receiving sub-pixel array is used to receive reflection of the target object light pulse signal;

The second determining sub-module is used to determine the first transmitting sub-pixel array corresponding to the first receiving sub-pixel array in the second sub-pixel array list, and the first transmitting sub-pixel array is used to transmit to the target The object emits the light pulse signal.

Optionally, close module 306, including:

A shutdown sub-module, configured to shut down other sub-pixel arrays other than the first receiving sub-pixel array and the first emitting sub-pixel array;

An updating sub-module, configured to update the first image based on the first receiving sub-pixel array and the first transmitting sub-pixel array.

Optionally, close module 306, including:

The first generating submodule is configured to generate a second image based on the first sub-pixel array, the second image being a partial image including the target object in the first image;

An update submodule, configured to update the position of the target object in the second image;

Turning on a sub-module, configured to turn on other sub-pixel arrays other than the first sub-pixel array if it is detected that the target object moves out of the second image;

The second generating submodule is configured to generate a third image based on the sub-pixel array list.

Optionally, the electronic equipment also includes:

a second acquiring module, configured to acquire a third target position of the target object in the third image;

A second determination module, configured to determine a third sub-pixel array corresponding to the third target position in the sub-pixel array list, where the third sub-pixel array is different from the first sub-pixel array;

A second closing module, configured to close other sub-pixel arrays other than the third sub-pixel array, and update the third image based on the third sub-pixel array.

It can be seen that in this embodiment, the pixel array of the TOF sensor module is divided into multiple sub-pixel arrays in advance, and only part of the necessary sub-pixel arrays are turned on during the imaging process of the target object to realize the imaging of the target object, thereby The power consumption of the TOF sensor module can be effectively reduced.

The device provided in the embodiment of the present invention can realize each process implemented by the device in the method embodiment shown in Fig. 1 to Fig. 2f, and details are not repeated here to avoid repetition. Moreover, it should be noted that among the various components of the device of the present invention, the components are logically divided according to the functions to be realized, but the present invention is not limited thereto, and each component can be divided as required. Re-divided or combined.

FIG. 4 is a schematic diagram of a hardware structure of an electronic device implementing various embodiments of the present invention,

The electronic device 400 includes but is not limited to: a radio frequency unit 401, a network module 402, an audio output unit 403, an input unit 404, a sensor 405, a display unit 406, a user input unit 407, an interface unit 408, a memory 409, a processor 410, and Power supply 411 and other components. Those skilled in the art can understand that the structure of the electronic device shown in Figure 4 does not constitute a limitation on the electronic device, and the electronic device may include more or less components than shown in the illustration, or combine some components, or different components layout. In the embodiment of the present invention, electronic devices include but are not limited to mobile phones, tablet computers, notebook computers, palmtop computers, vehicle-mounted terminals, wearable devices, and pedometers.

Wherein, the radio frequency unit 401 is used to obtain the first target position of the target object in the first image, and the first image is generated by the pixel array in the ON state of the TOF sensor module;

A processor 410, configured to determine a first sub-pixel array corresponding to the first target position in a sub-pixel array list, where the sub-pixel array list includes a plurality of sub-pixel arrays of the pixel array;

Turning off other sub-pixel arrays other than the first sub-pixel array, and updating the first image based on the first sub-pixel array.

By pre-dividing the pixel array of the TOF sensor module into multiple sub-pixel arrays, and during the imaging process of the target object, only some of the necessary sub-pixel arrays are turned on to realize the imaging of the target object, thereby effectively reducing the Power consumption of the TOF sensor module.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 401 can be used for receiving and sending signals during sending and receiving information or during a call. Specifically, the downlink data from the base station is received and processed by the processor 410; Uplink data is sent to the base station. Generally, the radio frequency unit 401 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 401 can also communicate with the network and other devices through a wireless communication system.

The electronic device provides users with wireless broadband Internet access through the network module 402, such as helping users send and receive emails, browse web pages, and access streaming media.

The audio output unit 403 may convert audio data received by the radio frequency unit 401 or the network module 402 or stored in the memory 409 into an audio signal and output as sound. Also, the audio output unit 403 may also provide audio output related to a specific function performed by the electronic device 400 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 403 includes a speaker, a buzzer, a receiver, and the like.

The input unit 404 is used for receiving audio or video signals. The input unit 404 can include a graphics processing unit (Graphics Processing Unit, GPU) 4041 and a microphone 4042, and the graphics processing unit 4041 is used for still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The data is processed. The processed image frames may be displayed on the display unit 406 . The image frames processed by the graphics processor 4041 may be stored in the memory 409 (or other storage media) or sent via the radio frequency unit 401 or the network module 402 . The microphone 4042 can receive sound, and can process such sound into audio data. The processed audio data can be converted into a format that can be sent to a mobile communication base station via the radio frequency unit 401 for output in the case of a phone call mode.

The electronic device 400 also includes at least one sensor 405, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 4061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 4061 and the / or backlighting. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is still, and can be used to identify the posture of electronic equipment (such as horizontal and vertical screen switching, related games) , magnetometer posture calibration), vibration recognition-related functions (such as pedometer, knocking), etc.; the sensor 405 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.

The display unit 406 is used to display information input by the user or information provided to the user. The display unit 406 may include a display panel 4061, and the display panel 4061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.

The user input unit 407 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the electronic device. Specifically, the user input unit 407 includes a touch panel 4071 and other input devices 4072 . The touch panel 4071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 4071 or near the touch panel 4071). operate). The touch panel 4071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the For the processor 410, receive the command sent by the processor 410 and execute it. In addition, the touch panel 4071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 4071 , the user input unit 407 may also include other input devices 4072 . Specifically, other input devices 4072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.

Furthermore, the touch panel 4071 can be covered on the display panel 4061, and when the touch panel 4071 detects a touch operation on or near it, it will be sent to the processor 410 to determine the type of the touch event, and then the processor 410 will The type of event provides a corresponding visual output on the display panel 4061 . Although in FIG. 4, the touch panel 4071 and the display panel 4061 are used as two independent components to realize the input and output functions of the electronic device, in some embodiments, the touch panel 4071 and the display panel 4061 can be integrated. The implementation of the input and output functions of the electronic device is not specifically limited here.

The interface unit 408 is an interface for connecting an external device to the electronic device 400 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 408 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.

The memory 409 can be used to store software programs as well as various data. The memory 409 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of mobile phones (such as audio data, phonebook, etc.), etc. In addition, the memory 409 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The processor 410 is the control center of the electronic device, and uses various interfaces and lines to connect various parts of the entire electronic device, by running or executing software programs and/or modules stored in the memory 409, and calling data stored in the memory 409 , to perform various functions of the electronic equipment and process data, so as to monitor the electronic equipment as a whole. The processor 410 may include one or more processing units; optionally, the processor 410 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem The tuner processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 410 .

The electronic device 400 may also include a power supply 411 (such as a battery) for supplying power to various components. Optionally, the power supply 411 may be logically connected to the processor 410 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. Management and other functions.

In addition, the electronic device 400 includes some functional modules not shown, which will not be repeated here.

Optionally, an embodiment of the present invention further provides an electronic device, including a processor, a memory, and a computer program stored in the memory and operable on the processor. When the computer program is executed by the processor, the above-mentioned imaging processing is implemented. Each process of the method embodiment can achieve the same technical effect, and will not be repeated here to avoid repetition.

The embodiment of the present invention also provides a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process of the above-mentioned imaging processing method embodiment is realized, and the same technology can be achieved. Effect, in order to avoid repetition, will not repeat them here. Wherein, the computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk or an optical disk, and the like.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in various embodiments of the present invention.

Embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementations, and the above-mentioned specific implementations are only illustrative, rather than restrictive, and those of ordinary skill in the art will Under the enlightenment of the present invention, without departing from the gist of the present invention and the protection scope of the claims, many forms can also be made, all of which belong to the protection of the present invention.

Claims (9)

1. An image processing method, characterized in that, comprising: Acquiring the first target position of the target object in the first image, the first image is generated by the pixel array of the transmitting sensor and the pixel array of the receiving sensor in the ON state of the TOF sensor module; determining a first subpixel array of the transmitting sensor and the receiving sensor corresponding to the first target position in a list of subpixel arrays, the list of subpixel arrays including a plurality of subpixel arrays of the pixel array; Turning off other sub-pixel arrays other than the first sub-pixel array, and updating the first image based on the first sub-pixel array, wherein the updated first image includes a complete imaging of the target object , Wherein, the determining the first sub-pixel array of the transmitting sensor and the receiving sensor corresponding to the first target position in the sub-pixel array list includes: determining the receiving sensor corresponding to the first target position in the sub-pixel array list The first receiving sub-pixel array that needs to be turned on, based on the pre-established correspondence between the receiving sub-pixel array and the transmitting sub-pixel array, determines the first transmitting sub-pixel array corresponding to the first receiving sub-pixel array; The updating of the first image based on the first sub-pixel array includes: generating a second image based on the first sub-pixel array, the second image being that the target is included in the first image Partial image of the object; update the position of the target object in the second image; if it is detected that the target object moves out of the second image, turn on other sub-pixel arrays other than the first sub-pixel array ; Generate a third image based on the sub-pixel array list. 2. The method according to claim 1, wherein the sub-pixel array list comprises: a first sub-pixel array list and a second sub-pixel array list, and the first sub-pixel array list includes dividing the TOF A plurality of sub-pixel arrays obtained by the pixel array of the receiving sensor of the sensor module, the second sub-pixel array list includes a plurality of sub-pixel arrays obtained by dividing the pixel array of the emitting sensor of the TOF sensor module; Wherein, the determining the first sub-pixel array of the transmitting sensor and the receiving sensor corresponding to the first target position in the sub-pixel array list includes: determining a first receiving sub-pixel array corresponding to the first target position in the first sub-pixel array list, the first receiving sub-pixel array is used to receive the light pulse signal reflected by the target object; Determining a first emitting sub-pixel array corresponding to the first receiving sub-pixel array in the second sub-pixel array list, where the first emitting sub-pixel array is used to transmit the light pulse signal to the target object. 3. The method according to claim 2, wherein said turning off other sub-pixel arrays other than the first sub-pixel array, and updating the first image based on the first sub-pixel array comprises: turning off the first receive sub-pixel array and other sub-pixel arrays than the first transmit sub-pixel array; The first image is updated based on the first receive sub-pixel array and the first transmit sub-pixel array. 4. The method according to claim 1, wherein, after generating the third image based on the sub-pixel array list, further comprising: acquiring a third target position of the target object in the third image; determining a third sub-pixel array corresponding to the third target position in the sub-pixel array list, where the third sub-pixel array is different from the first sub-pixel array; Turning off other sub-pixel arrays except the third sub-pixel array, and updating the third image based on the third sub-pixel array. 5. An electronic device, characterized in that it comprises: An acquisition module, configured to acquire the first target position of the target object in the first image, the first image being generated by the pixel array of the transmitting sensor and the pixel array of the receiving sensor in the ON state of the TOF sensor module; A determination module, configured to determine the first sub-pixel array of the transmitting sensor and the receiving sensor corresponding to the first target position in the sub-pixel array list, the sub-pixel array list includes a plurality of sub-pixel arrays of the pixel array, the The determining module is specifically used to: determine the first receiving sub-pixel array that needs to be turned on by the receiving sensor corresponding to the first target position in the sub-pixel array list, based on the pre-established corresponding relationship between the receiving sub-pixel array and the transmitting sub-pixel array , determining the first emitting sub-pixel array corresponding to the first receiving sub-pixel array; A closing module, configured to close other sub-pixel arrays other than the first sub-pixel array, and update the first image based on the first sub-pixel array, wherein the updated first image includes the For complete imaging of the target object, the closing module is specifically configured to: generate a second image based on the first sub-pixel array, the second image is a partial image including the target object in the first image; update The position of the target object in the second image; if it is detected that the target object moves out of the second image, turn on other sub-pixel arrays other than the first sub-pixel array; based on the sub-pixel List of arrays to generate the third image. 6. The electronic device according to claim 5, wherein the sub-pixel array list comprises: a first sub-pixel array list and a second sub-pixel array list, and the first sub-pixel array list includes dividing the A plurality of sub-pixel arrays obtained by the pixel array of the receiving sensor of the TOF sensor module, the second sub-pixel array list includes a plurality of sub-pixel arrays obtained by dividing the pixel array of the emitting sensor of the TOF sensor module; The determination module includes: The first determination sub-module is configured to determine a first receiving sub-pixel array corresponding to the first target position in the first sub-pixel array list, and the first receiving sub-pixel array is used to receive reflection of the target object light pulse signal; The second determining sub-module is used to determine the first transmitting sub-pixel array corresponding to the first receiving sub-pixel array in the second sub-pixel array list, and the first transmitting sub-pixel array is used to transmit to the target The object emits the light pulse signal. 7. The electronic device according to claim 6, wherein the closing module comprises: A shutdown sub-module, configured to shut down other sub-pixel arrays other than the first receiving sub-pixel array and the first emitting sub-pixel array; An updating sub-module, configured to update the first image based on the first receiving sub-pixel array and the first transmitting sub-pixel array. 8. An electronic device, characterized in that it comprises: a memory, a processor, and a computer program stored on the memory and operable on the processor, when the computer program is executed by the processor, the The steps of the method as claimed in any one of claims 1 to 4. 9. A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method according to any one of claims 1 to 4 is realized. method steps.

Images