CN105991911A - Control method, control device and electronic device - Google Patents

Abstract

The invention discloses a control method for controlling an imaging device, wherein the imaging device comprises an image sensor and an actuator, the actuator is connected with the image sensor and is used for driving the image sensor to move along a first direction parallel to an optical axis, the image sensor comprises a photosensitive area, and the photosensitive area comprises a pixel array formed by a plurality of pixels. The control method comprises the following steps: determining the exposure time of a target scene; determining an average exposure time of each pixel according to the exposure time and the stroke of the actuator; and controlling the actuator to drive the image sensor to move along the first direction until the exposure is finished. In addition, the invention also discloses a control device and an electronic device. According to the control method, the control device and the electronic device, in the exposure process, the actuator is controlled to drive the image sensor to move, so that a picture with a zooming effect is shot, the operation is simple and convenient, and meanwhile, the interestingness of shooting of the electronic device is increased.

Description

Control method, control device and electronic device

technical field

The invention relates to imaging technology, in particular to a control method, a control device and an electronic device.

Background technique

The image sensor of the existing mobile phone is fixedly set, and when shooting some special effects, the operation is complicated and the effect is poor.

Contents of the invention

The present invention aims to solve at least one of the technical problems existing in the prior art. Therefore, the present invention needs to provide a control method, a control device and an electronic device.

The control method according to the embodiment of the present invention is used to control the imaging device, the imaging device includes an image sensor and an actuator, and the actuator is connected to the image sensor and used to drive the image sensor along a direction parallel to the optical axis. Moving in the first direction, the image sensor includes a photosensitive area, the photosensitive area includes a pixel array composed of a plurality of pixels, and the control method includes the following steps:

Determine the exposure time of the target scene;

determining an average exposure time for each pixel based on the exposure time and the stroke of the actuator; and

controlling the actuator to drive the image sensor to move along the first direction until the exposure ends.

In some embodiments, the step of determining the exposure time includes:

The exposure time is determined according to the current ambient light.

In some embodiments, the step of controlling the actuator to drive the image sensor to move along the first direction to the end of exposure comprises:

controlling the actuator to drive the image sensor to move from an initial position along the first direction;

In some embodiments, the step of controlling the actuator to drive the image sensor to move along the first direction to the end of exposure comprises:

controlling the actuator to drive the image sensor to move one pixel at a time along the first direction and exposing each pixel for the average exposure time.

The control device according to the embodiment of the present invention is used to control the imaging device, the imaging device includes an image sensor and an actuator, and the actuator is connected to the image sensor and used to drive the image sensor along a direction parallel to the optical axis. Moving in the first direction, the image sensor includes a photosensitive area, the photosensitive area includes a pixel array composed of a plurality of pixels, and the control device includes:

A determining module, configured to determine the exposure time of the target scene;

a calculation module for determining an average exposure time for each pixel according to the exposure time and the stroke of the actuator; and

A control module, configured to control the actuator to drive the image sensor to move along the first direction until the exposure ends.

In some implementations, the determining module is configured to determine the exposure time according to current ambient light.

In some embodiments, the control module is used to control the actuator to drive the image sensor to move from an initial position along the first direction.

In some implementations, the control module is used to control the actuator to drive the image sensor to move one pixel at a time along the first direction and expose each pixel for the average exposure time.

An electronic device according to an embodiment of the present invention includes the above-mentioned control device.

In some embodiments, the electronic device includes a mobile phone or a tablet computer.

The control method, control device, and electronic device of the embodiments of the present invention control the actuator to drive the image sensor to move during the exposure process, thereby taking pictures with a zoom effect. of interest.

Advantages of additional aspects of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

Description of drawings

The above and/or additional aspects and advantages of the present invention will become apparent and comprehensible from the description of the embodiments in conjunction with the following drawings, wherein:

Fig. 1 is a schematic flowchart of a control method according to an embodiment of the present invention.

Fig. 2 is a schematic diagram of functional modules of the control device according to the embodiment of the present invention.

detailed description

Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary, are only for explaining the embodiments of the present invention, and should not be construed as limiting the embodiments of the present invention.

Please refer to FIG. 1, the control method according to the embodiment of the present invention is used to control the imaging device, the imaging device includes an image sensor and an actuator, the actuator is connected to the image sensor and used to drive the image sensor along a first direction parallel to the optical axis Mobile, the image sensor includes a photosensitive area, the photosensitive area of the image sensor is used to convert light signals into electrical signals, the photosensitive area includes a pixel array composed of multiple pixels, and the signals acquired by each pixel are combined to form a complete image screen. The control method includes the steps of:

S10: Determine the exposure time of the target scene;

S20: Determine the average exposure time of each pixel according to the exposure time and the stroke of the actuator; and

S30: Control the actuator to drive the image sensor to move along the first direction until the exposure ends.

Referring to FIG. 2 , the control device 100 according to the embodiment of the present invention includes a determination module 10 , a timing module 20 and a control module 30 . As an example, the control method of the embodiment of the present invention can be implemented by the control device 100 of the embodiment of the present invention, and can be applied to the electronic device 1000 and used to control the imaging device 200 of the electronic device 1000 . The imaging device 200 includes an image sensor 210 and an actuator 220 .

The image sensor 210 is used to convert the collected optical signal into an electrical signal to form an image. The actuator 220 is used to drive the image sensor 210 to move in a predetermined direction.

Wherein, step S10 of the control method in the embodiment of the present invention can be implemented by the determination module 10 , step S20 can be implemented by the calculation module 20 , and step S30 can be implemented by the control module 30 . That is to say, the determination module 10 is used to determine the exposure time of the target scene. The calculation module 20 is used to determine the average exposure time of each pixel according to the exposure time and the stroke of the actuator 220 . The control module 30 is used to control the actuator 220 to drive the image sensor 210 to move along the first direction until the exposure ends.

Usually, for the portable electronic device 1000 such as a mobile phone, due to the limited design size, the imaging device 200 or the camera module is relatively simple in design compared with a professional camera such as a SLR camera, and its functions and performance are relatively weak. Therefore, the user needs to perform relatively complicated operations when performing some special shooting, and the effect is often not good.

As an example, in some implementations, if it is desired to capture an image with a zoom effect, it is necessary to change the focal length during the exposure process of the capture. However, the image sensor 210 of the existing electronic device 1000 is fixed. If the user wants to capture an image with a zoom effect, he often needs to move the mobile phone forward or backward smoothly after triggering the shooting. The operation is complicated and the shooting success rate is low.

The control method of the embodiment of the present invention controls the actuator 220 to drive the image sensor 210 to move during the exposure process, so as to achieve the effect of changing the focal length during the process of shooting an image with a zoom effect, without the need for the user to manually move the electronic device 1000 back and forth . Wherein, the moving time is also the exposure time, and the exposure time is the exposure time of the target scene or the environment or scene to be photographed.

In this way, the control method, the control device 100 and the electronic device 1000 according to the embodiment of the present invention control the actuator 220 to drive the image sensor 210 to move during the exposure process, so as to take pictures with a zoom effect, and the operation is simple and convenient. It also increases the fun of taking pictures with the electronic device 1000 .

As an example, in some embodiments, the actuator 220 may be a microelectro-mechanical system (MEMS). MEMS includes fixed electrodes, movable electrodes and deformable connectors. The movable electrodes cooperate with the fixed electrodes. The connector is fixedly connected to the fixed electrode and the movable electrode. The fixed electrodes and the movable electrodes are used to generate electrostatic force under the action of driving voltage. The connecting part is used to deform along the moving direction of the movable electrode under the action of electrostatic force to allow the movable electrode to move so as to drive the image sensor 210 to move.

Generally, under the setting of certain shape and size, the deformable wire can only be deformed along the moving direction of the movable electrode under the action of external force, and within a certain range of external force (less than a predetermined threshold), the shape of the deformable wire The variable is proportional to the magnitude of the external force, while in other directions, the deformable wire remains rigid and not easily deformed.

In some examples, the amount of deformation of the deformable wire is less than or equal to 150 microns. That is, the stroke of the actuator 220 is less than or equal to 150 microns.

Through the action of electrostatic force, the actuator 220 can drive the image sensor 210 to move by a distance equivalent to the pixel size each time. For example, in some examples, the pixel size of the image sensor 210 is 2 micrometers, and the image sensor 210 can be driven to move 2 micrometers at a time by precisely controlling the magnitude of the electrostatic force, that is, to move one pixel.

During the image capturing process, the image sensor 210 needs to receive an appropriate amount of incoming light after the shutter is opened, and then generate an image according to photoelectric conversion. The light environment of different subjects or scenes is different, and the appropriate amount of light or exposure time that can be imaged is different. Therefore, the first step is to determine the exposure time for the current shot.

In some examples, when the imaging device 200 sets automatic exposure, the exposure time is determined according to the current ambient light in the target scene. Generally, the imaging device 200 is preset with exposure values corresponding to different light environments. After setting to automatic exposure, the determining module 10 will determine the exposure time according to the current ambient light.

Of course, in some advanced settings, the user can manually set the exposure time, so the exposure time can be determined according to the user's input.

Further, after the exposure time is determined, the average exposure time of each pixel can be determined according to the stroke of the actuator 220 .

Wherein, the travel of the actuator 220 is also the travel of the image sensor 210 , in units of pixels. For example, according to the explanation of the above embodiment, the travel of the actuator 220 is less than or equal to 150 microns, and the size of each pixel is 2 microns, so the travel of the image sensor 210 is 75 pixels.

If the exposure time is t, the average exposure time of each pixel is t/75.

It should be noted that the size of the pixels, the stroke of the actuator 220 and the average exposure time of each pixel are illustrative illustrations and should not be regarded as limitations of the present invention.

It can be understood that, usually during the process of capturing images, the image sensor 210 faces the subject, that is to say, the first direction is parallel to the optical axis and faces the subject, or the first direction is perpendicular to the plane where the electronic device 1000 is located. .

Further, the actuator 220 is controlled to drive the image sensor 210 to move along the first direction according to the determined parameters until the exposure process ends.

Preferably, in some implementations, step S30 includes:

The actuator is controlled to drive the image sensor to move from the initial position along the first direction.

In some embodiments, the step of controlling the actuator to drive the image sensor to move from the initial position along the first direction can be implemented by the control module 30 . In other words, the control module 30 is used to control the actuator 220 to drive the image sensor 210 to move from the initial position along the first direction.

After each imaging, the image sensor 210 should be reset, that is, return to the initial position. It can be understood that when the actuator 220 drives the 210 to move, the deformable wire of the actuator 220 will be deformed. If the deformed state remains, the actuator 220 is more likely to be damaged. In addition, resetting the image sensor 210 also facilitates precise control of the actuator 220 .

Preferably, in some implementations, step S30 includes:

The actuator is controlled to drive the image sensor to move one pixel at a time along the first direction and each pixel is exposed for an average exposure time.

In some embodiments, the step of controlling the actuator to drive the image sensor to move one pixel at a time along the first direction and to expose each pixel for an average exposure time can be implemented by the control module 30 . In other words, the control module 30 is used to control the actuator 220 to drive the image sensor 210 to move one pixel at a time along the first direction and expose each pixel for an average exposure time.

Specifically, during operation, after the exposure is started, the actuator 220 is controlled to drive the image sensor 210 to move in the first direction, that is, the direction toward the object according to the stroke, so that the focal length changes. During the moving process, the pixel is used as the unit, and one pixel is moved at a time, and the average exposure time obtained by exposure calculation is reached until the end of the exposure process.

In this way, the moving process of the image sensor 210 can be made smoother so as to obtain an ideal zoom effect image with continuous gradual change, and the zoom effect in the image will not be insufficient and abrupt due to the abrupt moving process.

It should be noted that in an exemplary embodiment of the present invention, the actuator 220 can support movement at a single pixel level, but the above description does not limit this application. For example, in other embodiments, the actuator 220 The minimum movement accuracy of the actuator 220 (that is, the minimum distance for one movement) can be multiple pixel widths, therefore, correspondingly, in step S20 can be: determine the actuator 220 according to the minimum movement according to the exposure time and the stroke of the actuator 220 The average exposure time corresponding to the movement of the precision. Exemplarily, for example, the stroke of the actuator 220 (that is, the image sensor 210 that is mounted on the actuator 220 and then moves with the actuator 220) moves a stroke of 150 microns, and the minimum movement accuracy of the actuator 220 (that is, The minimum distance for moving once) is 2 pixel widths, taking the size of each pixel as 1.5 microns as an example, the minimum movement accuracy of the actuator 220 is 3 microns, and the stroke of the image sensor 210 corresponds to 50 actuators The minimum movement precision of 220; if the exposure time corresponding to the environment or scene is t, the average exposure time corresponding to the movement of the actuator 220 according to the minimum movement precision is t/50.

In describing the embodiments of the present invention, it should be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front ", "Back", "Left", "Right", "Vertical", "Horizontal", "Top", "Bottom", "Inside", "Outside", "Clockwise", "Counterclockwise", etc. The orientation or positional relationship is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the embodiment of the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, use a specific configuration and operation, and therefore should not be construed as limiting the embodiments of the present invention.

In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of said features. In the description of the embodiments of the present invention, "plurality" means two or more, unless otherwise specifically defined.

In the description of the embodiments of the present invention, it should be noted that unless otherwise specified and limited, the terms "installation", "connection", and "connection" should be understood in a broad sense, for example, it can be a fixed connection or a It is a detachable connection, or an integral connection; it can be mechanically connected, it can be electrically connected, or it can communicate with each other; it can be directly connected or indirectly connected through an intermediary, and it can be internal communication between two components or two components interaction relationship. Those of ordinary skill in the art can understand the specific meanings of the above terms in the embodiments of the present invention according to specific situations.

In the embodiments of the present invention, unless otherwise clearly specified and limited, the first feature being "on" or "under" the second feature may include direct contact between the first and second features, and may also include the first and second features. The second features are not in direct contact but through another feature between them. Moreover, "above", "above" and "above" the first feature on the second feature include that the first feature is directly above and obliquely above the second feature, or simply means that the first feature is horizontally higher than the second feature. "Below", "beneath" and "under" the first feature to the second feature include that the first feature is directly below and obliquely below the second feature, or simply means that the first feature has a lower level than the second feature.

The above disclosure provides many different embodiments or examples for implementing different structures of embodiments of the present invention. To simplify the disclosure of the embodiments of the present invention, the components and arrangements of specific examples are described above. Of course, they are only examples and are not intended to limit the invention. Furthermore, embodiments of the present invention may repeat reference numerals and/or reference letters in different instances, such repetition is for simplicity and clarity and does not in itself indicate a relationship between the various embodiments and/or arrangements discussed. . In addition, embodiments of the present invention provide examples of various specific processes and materials, but one of ordinary skill in the art may recognize the use of other processes and/or the use of other materials.

In the description of this specification, reference to the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific examples" or "some examples" etc. Specific features, structures, materials, or features described in an embodiment or example are included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples.

Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments or portions of code comprising one or more executable instructions for implementing specific logical functions or steps of the process , and the scope of preferred embodiments of the invention includes alternative implementations in which functions may be performed out of the order shown or discussed, including substantially concurrently or in reverse order depending on the functions involved, which shall It is understood by those skilled in the art to which the embodiments of the present invention pertain.

The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processing modules, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment used. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connection with one or more wires (electronic device), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. processing to obtain the program electronically and store it in computer memory.

It should be understood that each part of the embodiments of the present invention may be implemented by hardware, software, firmware or a combination thereof. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: Discrete logic circuits, ASICs with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. During execution, one or a combination of the steps of the method embodiments is included.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like.

Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present invention, those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.

Claims (10)

1. a control method, is used for controlling imaging device, it is characterised in that described imaging device includes Imageing sensor and actuator, described actuator is connected with described imageing sensor and is used for driving described image Sensor moves along the first direction being parallel to optical axis, and described imageing sensor includes photosensitive region, described sense Light region includes that the pel array that multiple pixel is constituted, described control method comprise the steps:

Determine the time of exposure of target scene；

Stroke according to described time of exposure and described actuator determines the mean exposure time of each pixel；And

Controlling described actuator drives described imageing sensor to move to end exposure along described first direction.

2. control method as claimed in claim 1, it is characterised in that described determine time of exposure Step includes:

Described time of exposure is determined according to current environment light.

3. control method as claimed in claim 1, it is characterised in that the described actuator of described control drives The step that dynamic described imageing sensor moves to end exposure along described first direction includes:

Controlling described actuator drives described imageing sensor to be moved along described first direction by initial position.

4. control method as claimed in claim 1, it is characterised in that the described actuator of described control drives The step that described imageing sensor moves to end exposure along described first direction includes:

Control described actuator drive described imageing sensor along described first direction move every time a pixel and Mean exposure time described in each pixel exposure.

5. control a device, be used for controlling imaging device, it is characterised in that described imaging device includes figure As sensor and actuator, described actuator is connected with described imageing sensor and is used for driving described image to pass Sensor moves along the first direction being parallel to optical axis, and described imageing sensor includes photosensitive region, described photosensitive Region includes that the pel array that multiple pixel is constituted, described control device include:

Determine module, for determining the time of exposure of target scene；

Computing module, for determining the flat of each pixel according to the stroke of described time of exposure and described actuator All time of exposure；And

Control module, is used for controlling described actuator and drives described imageing sensor to move along described first direction To end exposure.

Control device the most as claimed in claim 5, it is characterised in that described determine module for according to work as Front ambient light determines described time of exposure.

Control device the most as claimed in claim 5, it is characterised in that described control module is used for controlling institute Stating actuator drives described imageing sensor to be moved along described first direction by initial position.

Control device the most as claimed in claim 5, it is characterised in that described control module is used for controlling institute State actuator drives described imageing sensor to move a pixel and the exposure of each pixel along described first direction every time Mean exposure time described in light.

9. an electronic installation, it is characterised in that include the control as described in claim 5-8 any one Device.

10. electronic installation as claimed in claim 9, it is characterised in that described electronic installation includes mobile phone Or panel computer.