CN105049682B - Digital camera system and the method for controlling the digital camera system - Google Patents

Abstract

A kind of digital camera system can include the lens unit of the image of detection main body and the parallel first processor for performing image compensation data generating process and optical compensation process.The optical compensation process can be the process for the movement that the lens unit is selectively controlled based on the corresponding exercise data of movement with camera module.Image compensation data generating process can be the process for generating image compensation data corresponding with described image.

Description

Digital camera system and method for controlling the same

Cross References to Related Applications

This application claims Korean Patent Application No. 10-2014-0046885 filed on April 18, 2014 entitled "Digital Photographing System and Controlling Method Thereof" and filed on June 20, 2014 entitled "Digital Photographing System and Controlling Method Thereof," Korean Patent Application No. 10-2014-0076061, the contents of which are hereby incorporated by reference in their entirety.

technical field

Some embodiments of the invention may relate to digital camera systems and methods for controlling the same.

Background technique

In general, a digital camera system may process images received through an imaging device using a digital signal processor, compress the processed images to generate image files, and store the generated image files in a memory.

In addition, digital photography systems can display images of image files on a display device, such as an LCD, received by an imaging device or stored in a storage medium. However, a digital photographing system such as a camera may shake due to a user's motion (hand shake, etc.) or any disturbance when the user captures a desired image. Due to this shaking, the image input through the imaging device shakes and thus the quality of the image is degraded.

[Related technical literature]

[Patent Document]

(Patent Document 1) Korean Patent Application Publication No. 10-2010-0104383

Contents of the invention

Some embodiments of the present disclosure may provide a digital camera system and a method for controlling the digital camera system, which are capable of motion data about camera motion based on a motion sensor when the camera motion occurs during the process of photographing a subject. The optical compensation process and the image compensation process are applied in parallel to compensate for shaking or disturbance of the captured image.

Some implementations of the digital camera system and the method for controlling the digital camera system may execute the optical compensation process and the image compensation data in parallel according to whether the moving distance of the camera module in each axial direction is within a preset reference range generation process, and the shake of the image due to motion can be compensated by selectively applying the optical compensation process under predetermined conditions. The moving distance of the camera module may be calculated based on motion data corresponding to the motion of the camera module.

Some embodiments of the present disclosure can shorten image compensation processing due to motion by separately applying an optical compensation processor controlling movement of the lens unit and an image compensation data generation process generating image compensation data using preset synchronization information under predetermined conditions time and to ensure the reliability of the image quality, for motion (hand shake or horizontal/vertical movement) that may occur when the image (still or moving picture) is taken.

Description of drawings

The above and other aspects, features and other advantages of the present invention will be more clearly understood from the following detailed description, which description is given in conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram illustrating a digital camera system according to an exemplary embodiment of the present disclosure;

2 is a diagram showing a configuration of a camera module of a digital camera system according to an exemplary embodiment of the present disclosure;

3 is a diagram illustrating functions of an autofocus processor of a digital camera system according to an exemplary embodiment of the present disclosure;

4 and 5 are diagrams illustrating a calibration (preprocessing) process according to an exemplary embodiment of the present disclosure;

FIG. 6 is a diagram illustrating an image compensation process in a first processor according to an exemplary embodiment of the present disclosure;

7 is a diagram illustrating a process of calculating moving pixel information between image frames in an application processor according to an exemplary embodiment of the present disclosure; and

FIG. 8 is a flowchart illustrating a method for controlling a digital camera system according to an exemplary embodiment of the present disclosure.

Detailed ways

The objects, features and advantages of the present disclosure can be more clearly understood from the following detailed description of the exemplary embodiments, which are given in conjunction with the accompanying drawings. Throughout the drawings, the same reference numerals are used to designate the same or similar components, and redundant descriptions thereof will be omitted. Further, in the following description, the terms "first", "second", "one side", "another side", etc. are used to distinguish a specific component from other components, but the configuration of these components should not be interpreted as being limited by these terms. Further, in the description of the present disclosure, when it is determined that a detailed description of a related field will obscure the gist of the present disclosure, its description will be omitted.

Hereinafter, a digital photographing system and a method for controlling the same according to exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing a digital camera system according to an exemplary embodiment of the present disclosure, FIG. 2 is a diagram showing a configuration of a camera module of the digital camera system according to an exemplary embodiment of the present disclosure, and FIG. 3 is a diagram showing the function of an autofocus processor of a digital camera system according to an exemplary embodiment of the present disclosure.

As shown in FIGS. 1 and 2 , a digital camera system 10 according to an exemplary embodiment of the present disclosure may include a camera module 140, a motion sensor 100, a first processor 110, an optical driver 120, an optical driver module 130, a second processing device 160, memory 170 and autofocus processor 180. The digital camera system 10 may be included, for example, in mobile multifunction devices such as digital cameras, cellular phones, and tablet computers, or in laptop computers, desktop computers, etc., but the digital camera system 10 is not limited thereto.

The motion sensor 100 may be provided inside or outside the camera module 140 and may generate or output motion data corresponding to the motion of the camera module 140 . The motion sensor 100 may include an angular velocity sensor 101 and an acceleration sensor 102 . The angular velocity sensor 101 may sense a change in the rotation component (angular velocity) of the camera module 140 , for example, but not limited to, a change due to hand shaking or disturbance, or the like. The acceleration sensor 102 may sense changes in a linear component (velocity), such as, but not limited to, changes due to movement of the camera module 140 in a vertical or horizontal direction.

For example: 1) The angular velocity sensor 101 can be a gyroscope sensor, which can sense the change of the angular velocity of the camera module 140 in two directions of the yaw axis and the pitch axis to compensate for the camera module caused by the user's hand shake or interference. 140's vertical and horizontal shaking or movement, and 2) the acceleration sensor 102 can sense changes in the speed of the camera module 140 in the horizontal (x-axis) or vertical (y-axis) direction due to user's movement or disturbance, which is different from that caused by the camera module 140 The linear component corresponding to the movement of the module 140 .

The lens unit 141 may include a lens barrel 141 a and a position sensor 142 . The lens barrel 141a may include an image sensor 141b and a lens group (not shown) that optically processes light from the subject 141c to detect or capture image frames such as images of still or moving pictures of the subject 141c. The position sensor 142 may sense a position change of the lens barrel 141a (see FIG. 3 ).

For example, a lens group (not shown) may include at least one of a zoom lens, a focus lens, and a compensation lens. The image sensor 141b may be, for example, but not limited to, a Charge Coupled Device (CCD), Complementary Metal Oxide Semiconductor (CMOS), or any device that converts an optical signal of light incident through the lens barrel 141a into an electrical analog signal. The position sensor 142 can sense the position change of the lens barrel 141 a to transmit the current position information of the lens barrel 141 a to the first processor 110 . The position sensor 142 may be, for example, but not limited to, a Hall sensor (not shown) that detects the current position of the lens barrel 141a using a Hall effect in which a voltage varies with a magnetic field strength.

The optical driver 120 may generate a driving voltage and a control signal of the optical driving module 130 to move the lens unit 141 according to a control signal input from the first processor 110 .

In addition, the optical driver 120 may control driving of the optical driving module 130 based on a switching operation corresponding to a control signal controlling a moving range of the lens unit 141 . The optical driver 120 may be, for example, but not limited to, a motor driving integrated chip (IC). The optical driver 120 may be embedded in the first processor 110 .

In this embodiment, the optical driving module 130 may include first and second actuators 131 and 132 including voice coil motors (VCM) or piezoelectric devices. The first actuator 131 can control the movement of the lens unit 141 in the vertical direction (y-axis direction), and the second actuator 132 can control the movement of the lens unit 141 in the horizontal direction (x-axis direction).

The first processor 110 may perform the image compensation data generation process and the optical compensation process in parallel or simultaneously. For example, the optical compensation process may control the movement of the lens unit 141 based on motion data, and the image compensation data generation process may generate image compensation data corresponding to an image, but is not limited thereto. The image compensation data generation process and the optical compensation process can be performed simultaneously.

For example, the optical compensation process can be selectively performed according to whether the moving distance of the camera module 140 in a moving direction (each axial direction, such as the x-axis or y-axis direction) is within a preset reference range, and its details will be Described below. The moving distance of the camera module 140 may be calculated based on, for example but not limited to, motion data (data of acceleration or angular velocity change) corresponding to the motion of the camera module 140 .

In addition, when performing the image compensation data generation process, the first processor 110 may generate image compensation data synchronized with each image frame of the image based on preset synchronization information. For example, the image compensation data _ID (see FIG. 6 ) may include dummy data configured with null data and metadata configured with focal length information of the lens unit 141 and motion data depending on changes in acceleration.

For example, by using synchronization information (timing of detection of focal length information of the lens unit 141 and motion data, see FIG. 5 ), the first processor 110 can 1) combine the dummy data with the period or part in which the optical compensation process is performed and 2) synchronizing metadata with image frames acquired during periods or portions in which the optical drive process was not performed.

In addition, the optical drive processor or the first processor 110 may store the image compensation data _ID in the memory 170 or transmit the image compensation data _ID to the application processor or the second processor 160 .

When performing the optical compensation process, the first processor 110 may be in the predetermined position according to whether the moving distance (which may be calculated based on the motion data) of the camera module 140 in the moving direction (each axial direction, such as the x-axis or the y-axis direction) is The optical compensation process is selectively performed within a reference range.

The motion data may include, for example but not limited to, data of a rotation component (angular velocity) of the camera module 140 and a linear component (acceleration) of motion of the camera module 140 in a horizontal or vertical direction due to user's hand shake or disturbance.

When the movement distance of the camera module 140 is within the reference range, the first processor 110 may perform an optical compensation process of controlling the movement of the lens unit 141 so that the movement of the camera module 140 can be compensated. For example, the reference range may be the maximum movable range D _X or D _Y of the lens unit in the horizontal (x-axis) direction or vertical (y-axis) direction, but is not limited thereto.

Specifically, the first processor 110 may control the movement of the lens barrel 141 a based on the position information of the lens barrel 141 a transmitted from the position sensor 142 so as to be able to compensate for shaking of an image due to the movement of the camera module 140 . For example, the first processor 110 may generate a control signal to move the lens barrel 141a as much as the moving distance of the camera module 140 in a direction opposite to the moving direction of the camera module 140, and transmit the generated control signal to the optics. drive 120 .

The optical driver 120 may generate a driving voltage and a control signal of the optical driving module 130 to move the lens unit 141 according to or in response to a control signal transmitted from the first processor 110 . In addition, the optical driver 120 may control the driving of the optical driving module 130 based on a switching operation corresponding to a control signal to move the lens unit 141 .

Accordingly, it is possible to detect or capture an image frame obtained by compensating for shaking or disturbance due to motion of the camera module 140 using the lens unit 141 in a period or portion in which the optical compensation process is performed.

The second processor 160 can use the image compensation data transmitted from the first processor 110 to calculate the moving pixel information between the various image frames on the display 190, and then can compensate the movement caused by the camera module 140 based on the calculated moving pixel information. Jittering or disturbance of the image caused by motion.

Specifically, the second processor 160 may use image compensation data acquired based on the synchronization information and the image frames constituting the image, such as dummy data and metadata, to calculate moving pixel information between individual image frames, and to compensate Jitter or disturbance of the image caused by the movement. For example, the second processor 160 may be an application processor, which is mounted in a mobile phone or the like, and may include an Image Sensing Processor (ISP).

The auto focus processor 180 may calculate focal length information (including a focal length) about each image frame of a subject acquired through the lens unit 141 and may transmit the focal length information to the first processor 110 . Focus information can also be detected by proximity sensors and/or optical or acoustic means.

For example, as shown in FIG. 3 , the autofocus processor 180 may control the position of the focal length f to move from _f1 to _f2 so as to move from P1 to P2 at the position of the main body 141c or from L1 at the position of the lens barrel 141a By L2 the image of the subject is explicitly projected onto the image sensor 141b, and focal length information such as the focal length (which is the distance between the focal length f and the image of the subject projected onto the image sensor 141b) can be calculated and then transmitted The focal length information is sent to the first processor 110 .

The memory 170 may store image compensation data generated by the first processor 110 and/or synchronization information generated or established during calibration. Memory 170 may be, for example but not limited to, volatile memory such as static random access memory (SRAM) and dynamic random access memory (DRAM), or nonvolatile memory such as read only memory (ROM) and flash memory.

The display 190 may be a display device that visually outputs data on a screen, and may be, for example, a cathode ray tube (CRT), a liquid crystal display (LCD), a plasma display panel (PDP), a light emitting diode (LED), and an organic light emitting diode (OLED). ), but it need not be limited thereto.

The above-mentioned first processor 110, application processor or second processor 160, and autofocus processor 180 may include algorithms for performing the aforementioned functions, and may be implemented through firmware, software or hardware (for example, a semiconductor chip or an application-specific integration) circuit) is realized.

Hereinafter, a calibration (preprocessing) process of a digital camera system according to an exemplary embodiment of the present disclosure will be described in more detail with reference to FIGS. 4 and 5 .

4 is a flow chart showing a calibration process of a digital camera system according to an exemplary embodiment of the present disclosure, and FIG. Graphical representation of synchronization information.

First, as shown in FIG. 4 , the calibration (preprocessing) of the digital camera system according to an exemplary embodiment of the present disclosure may include at least one or more of the following steps: 1) using the lens unit 141 to detect, capture, or sense Each image frame of a moving picture (or still image) (S10), 2) acquires motion data output from the motion sensor 100 (S20), and 3) calculates an acquisition timing (acquisition timing) for the image frame and motion data ) synchronization information (S30). Here, the calibration may be performed once at an early stage, and then may be stored in the memory 170, the first processor 110, etc., and thus may be repeatedly used.

For example, as shown in FIG. 5 , 1) each image frame f ₁ to f _n constituting a moving picture is detected, captured or sensed through the lens unit 141 . Here, the shooting speed of the moving picture (period T _C and detection speed of each image frame) may be configured differently according to the shooting mode of the moving picture (for example, 30 frames per second (fps) or 40 fps).

2) The motion sensor 100 may output motion data a ₁ to a _n due to or corresponding to the motion of the camera module 140 (which may be generated at a constant speed during the capture process of the moving picture) (preferably, the angular velocity detected by the gyro sensor) changing data). Here, the output speed of the motion data a ₁ to a _n may be changed according to the setting of the motion sensor 100 .

3) Based on the motion data a ₁ to a _n output from the motion sensor 100, detect timings t ₁ to t _4n+1 (at which detection timings most accurately represent image frames f ₁ to f caused by motion of the camera module 140 Motion data (a ₅ to a _4n+1 of _n 's movement is detected) may be calculated, and the detection timing t ₁ to t _4n+1 may have a predetermined period T _a . ΔT of FIG. 5 represents a delay time before synchronization of motion data, which may be generated due to a difference between an output speed of motion data of the motion sensor 100 and a shooting speed of an image start.

Here, the detection timing may be configured differently according to the photographing mode of the moving picture (for example, 30 fps), which is just an example, and thus the detection timing is not limited to that described above.

Therefore, synchronous information about the timing of extraction of motion data and the timing at which the respective image frames _f1 to _fn of the moving picture can be acquired (the detection speed of the image frame of the moving picture (for example, 30 fps) and the detection of the motion data corresponding thereto The timing t ₅ to t _4n+1 ) can be obtained through a calibration (preprocessing) process.

Hereinafter, a digital photographing system and a method for controlling the same according to exemplary embodiments of the present disclosure will be described in detail with reference to FIGS. 1 , 2 and 5 to 8 .

6 is a diagram showing an image compensation data generation process of a digital camera system according to an exemplary embodiment of the present disclosure, and FIG. 7 is a diagram showing a configuration in a computational digital camera system according to an exemplary embodiment of the present disclosure. An illustration of a process of moving pixel information between image frames of an image, and FIG. 8 is a flowchart illustrating a method for controlling a digital camera system according to an exemplary embodiment of the present disclosure.

First, as shown in FIGS. 1 and 8 , the digital photographing system 10 and the method for controlling the digital photographing system according to an exemplary embodiment of the present disclosure can perform: 1) image (still or moving pictures) of each image frame is photographed (detected) (S100). The detection speed and cycle of the image frame may be set differently according to the shooting mode of the image. The captured image frames of the moving picture may be transmitted to the second processor 160 through the lens unit 141 .

Next, 2) In the case where motion of the camera module 140 (hand shake, horizontal or vertical motion, or any disturbance) occurs while shooting, capturing, or sensing (detecting) an image of the subject 141c through the lens unit 141, due to Changes in angular velocity (rotational components in the direction of the yaw or pitch axis) caused by hand tremors in motion and changes in acceleration (horizontal (x-axis) or vertical Motion data of (speed change in the y-axis) direction) may be output from the motion sensor 100 (S110).

Next, 3) the first processor 110 can execute the image compensation data generation process, which is based on the synchronization information preset by the calibration (in the detection timing _t5 to _54n+1 of the motion data, corresponding to the current moving picture Synchronization information (detection timing of motion data) of shooting speed (for example, 30fps or 50fps) can generate image compensation data (dummy data and metadata configured) synchronized with image frames of moving pictures (S120).

In addition, 4) the first processor 110 can use the angular velocity (the rotational component in the direction of the yaw axis or the pitch axis) and the acceleration (the velocity in the horizontal (x-axis) or vertical (y-axis) direction) applied from the motion sensor 100 Change) motion data to calculate the actual moving direction and the moving distance of the camera module 140 in the horizontal (x-axis) or vertical (y-axis) direction, so as to determine whether to perform the optical compensation process (S130).

For example, the first processor 110 may determine whether the moving distance of the camera module 140 in the horizontal (x-axis) or vertical (y-axis) direction is within a preset reference range (such as but not limited to the horizontal (D _x ) direction and the vertical (D x ) direction _Y ) within the maximum movable range of the lens unit 141 in the direction).

In addition, i) when the moving distance of the camera module 140 is within the reference range, the first processor 110 may receive current position information of the lens barrel 141 a from the position sensor 142 . ii) The first processor 110 may control the movement of the lens barrel 141 a based on the position information to compensate for shaking of an image depending on the motion of the camera module 140 . For example, the first processor 110 may generate a control signal to move the lens unit 141 as much as the actual moving distance of the camera module 140 in a direction opposite to the moving direction of the camera module 140, and transmit the generated control signal to the optical driver. 120.

iii) The optical driver 120 can generate the control signal and the driving current of the optical driving module 130 based on the control signal, and then use the control signal to control the driving of the optical driving module (such as but not limited to a voice coil motor or piezoelectric device) 130, thereby performing An optical driving process that controls the moving range of the lens unit 141 .

Here, the first actuator 131 may control the movement of the lens unit 141 in the vertical direction (y-axis direction), and the second actuator 132 may control the movement of the lens unit 141 in the horizontal direction (x-axis direction).

The first processor 110 may i) combine the dummy data with the image in which the optical compensation is performed based on synchronization information such as the detection timing of the motion data corresponding to the current shooting speed for shooting moving pictures set in the calibration for generating the image compensation data. The image frames (hand-shake compensation image frames through the optical compensation process) of the images acquired in the part are synchronized (S140).

Also, the first processor may ii) synchronize metadata with an image frame of an image acquired in a portion in which optical compensation is not performed (S150). Here, dummy data can be configured with null data (values that can be ignored or meaningless), and metadata can be configured with motion data (for example, data of acceleration changes) and lens Focal distance information (such as focal length) of the unit 141.

The auto focus processor 180 may calculate focal length information (eg, focal length) of the lens unit 141 at image frame acquisition timings t ₁ to t _4n+1 to transmit the focal length information (eg, focal length) to the first processor 110 .

For example, as shown in FIG. 6 , 1) respective image frames _f1 to _fn of a moving picture detected, captured or sensed by the lens unit 141 at a constant shooting speed (for example, 30 fps) may be transmitted to the second processor 160, And 2) based on the motion data corresponding to the motion of the camera module 140 (such as the data of acceleration change and angular velocity change), the first processor 110 can determine whether the camera module 140 is in the horizontal (x-axis) or vertical (y-axis) direction. Whether the moving distance is within a preset reference range (such as but not limited to the maximum movable range of the lens unit 141 in the horizontal (D _X ) and vertical (D _Y ) directions as shown in FIG. 2 ) to determine whether to perform optical drive process.

3) The first processor 110 can execute the image compensation process in parallel, and it can generate synchronization information configured based on the shooting speed corresponding to the moving picture (for example, but not limited to, detection timings t ₅ , t ₉ , and t ₁₃ to t _4n+1 ) of dummy data and metadata image compensation data _ID synchronized with the image frame.

For example, i) virtual data D ₁ , D ₂ , D ₃ , ..., D _n can be based on the section or period in which optical compensation is performed (eg, section a or when the camera module 140 is in the horizontal (x-axis) or vertical ( The synchronization information (for example, detection timing t ₅ , t ₉ , t ₁₃ to t _4n+1 ) of the image frame of the image acquired in the y-axis) direction when the moving distance is within the preset reference range) is synchronized.

ii) Based on the synchronization information, the metadata can be related to the part where optical compensation is not performed (for example, part b or when the movement distance of the camera module 140 in the horizontal (x-axis) or vertical (y-axis) direction exceeds a preset reference range or Image frame synchronization of images _acquired in when outside the preset reference range _{) (for example, metadata M 4 , M 5 , and M 6} to M _n (motion data and focal length information such as the focal length of the lens unit 141 of each image frame of the photographed moving picture) may be synchronized with the image frame of the image acquired at part b.

iii) Therefore, according to whether the optical driving process is performed when all the image frames _f1 to _fn of the image are detected, sensed or captured by the lens unit 141, the image compensation data ID = _D of the image generated by the image compensation data generation process ₁ , D ₂ , D ₃ , . . . , M ₄ , M ₅ , and M ₆ to M _N may be configured with dummy data and metadata synchronized with image frames based on preset synchronization information corresponding to a shooting speed of a moving picture.

In addition, when the shooting of the image ends, the first processor 110 may store the image compensation data of the image in the memory 170 or transmit the image compensation data to the second processor 160 .

Next, the second processor 160 may use the image compensation data transferred from the first processor 110 to calculate moving pixel information between respective image frames constituting the image (S160).

For example, the second processor 160 may calculate the respective images using image frames constituting the images and motion data of acceleration changes of the motion sensor 100 and metadata M ₄ , M ₅ , and M ₆ to M _N including focal length information of the lens unit 141. Moving pixel information between frames, image frames and motion data and metadata are synchronized at the acquisition timing of each image frame.

For example, as shown in FIG. 7, the moving pixel information between image frames in the second processor 160 can be calculated by the following equations 1 to 4, where _Wd represents the horizontal distance or width of the image sensor 141b, and the field of view ( FOV) represents the viewing angle, _RS represents the screen resolution (graphics setting value) of the display, _δp represents the number of moving pixels for each image frame on the display, and _δS represents the moving distance of the camera module 140.

Here, the moving pixel information between image frames calculated using the focal length of the lens unit 141 and motion data of acceleration change (data acquired by the acceleration sensor 102 ) may include the number of moving pixels and the moving direction.

[equation 1]

W _d ＝2*1*tan(FOV/2)

[equation 2]

δ _p : δ _s = R _s : W _d

[equation 3]

δ _s =∫∫(δ ² s/δt ² )

[equation 4]

δ _p ＝δ _s *R _s /(2*tan(FOV/2))

Next, since the moving pixel information between image frames calculated by the second processor 160 can be stored in the memory 170 or the like, and the compensated image can be transmitted through a dedicated player by using the image and the moving pixel information corresponding to the image. etc. output, which can reduce the power consumption and processing time of image compensation more than a post-compensation method for capturing an image and then using an image processing technique.

As described above, the digital camera system according to the exemplary embodiment of the present disclosure can apply the optical compensation process and image compensation in parallel according to motion (hand shake, horizontal/vertical movement, or any disturbance) that may occur when still or moving pictures are taken. Data generation process, thereby shortening the image compensation processing time for motion and ensuring the reliability of image compensation.

Although the preferred embodiments of the present disclosure have been disclosed for the purpose of illustration, they are all for explaining the present disclosure in detail and thus the digital camera system and the method for controlling the digital camera system according to the present disclosure are not limited thereto , but those skilled in the art will understand that various modifications, additions and substitutions can be made without departing from the scope and spirit of the present disclosure as disclosed in the appended claims.

Accordingly, any and all modifications, variations or equivalent arrangements should be considered to fall within the scope of the present disclosure, and the detailed scope of the disclosure will be disclosed by the appended claims.

Claims (30)

1. a kind of digital camera system, which includes：

Lens unit detects the image of main body；And

First processor controls the movement of the lens unit simultaneously based on the corresponding exercise data of movement with camera module Generation image compensation data corresponding with described image,

Wherein, described image offset data includes virtual data and metadata,

The virtual data in the first processor based on the exercise data by using pre-determined synchronization information and with being controlled The image frame synchronization of the described image obtained in the part of the movement of the lens unit,

The portion of movement of the metadata with being not based on the exercise data control lens unit in the first processor The image frame synchronization of the described image obtained in point.

2. digital camera system according to claim 1, wherein the first processor exists according to the camera module Whether displacement distance on moving direction in preset reference range selectively controls the movement of the lens unit, institute Displacement distance is stated to be calculated based on the exercise data.

3. digital camera system according to claim 2, wherein the displacement distance in the camera module is in When in the term of reference, the first processor controls the lens unit based on the location information of the lens unit It is mobile.

4. digital camera system according to claim 3, wherein the term of reference can for the maximum of the lens unit Moving range.

5. digital camera system according to claim 2, wherein：

The first processor is based on the synchronizing information and generates described image offset data, the image compensation data and the figure Each image frame synchronization of picture,

The virtual data include empty data and

The metadata includes the focus information of the exercise data and the lens unit, and the exercise data is included about adding The information of velocity variations.

6. digital camera system according to claim 1, which further includes：

Second processor forms described image by using the described image offset data calculating generated by the first processor Each picture frame between mobile Pixel Information and based on the mobile Pixel Information compensation described image.

7. digital camera system according to claim 6, which further includes：

Autofocus Processor, calculate the lens unit focus information and the transmission focus information at described first Manage device.

8. digital camera system according to claim 1, wherein the exercise data includes：

Represent the data of the variation of the rotational component of the camera module；And

Represent the data of the variation of the linear component of the camera module.

9. digital camera system according to claim 7, which further includes：

Memory stores the described image offset data generated by the first processor；And

Display exports the described image compensated by the second processor.

10. digital camera system according to claim 2, which further includes：

Optical drive module, the mobile lens unit；And

Optical drive is generated according to the control signal of the movement for the lens unit transmitted from the first processor Driving voltage and control signal simultaneously apply the driving voltage generated and control signal to the optical drive module.

11. digital camera system according to claim 1, wherein the lens unit is included in the camera module In.

12. digital camera system according to claim 1, wherein the first processor will be based on the exercise data control The movement and generation described image offset data corresponding with described image for making the lens unit merge.

13. a kind of method for controlling digital camera system, this method includes：

Detect the image of main body；

The movement of lens unit is selectively controlled based on the corresponding exercise data of movement with camera module；And

Generation image compensation data corresponding with described image, described image offset data include virtual data and metadata,

It is wherein parallel to perform to the control of movement of the lens unit and the generation of described image offset data,

Wherein, the generation of described image offset data includes：

By the virtual data and the described image that is obtained in the part for performing the control to the movement of the lens unit Image frame synchronization；And

By the metadata and the described image that obtains in the part for the control for being not carried out the movement to the lens unit Image frame synchronization.

14. according to the method for claim 13, wherein the control of the movement to the lens unit includes：

The moving direction and displacement distance of the camera module are calculated based on the exercise data；

Determine the displacement distance whether in preset reference range；And

When the displacement distance is in the term of reference, the displacement distance and moving direction of the lens unit are controlled.

15. the method according to claim 11, wherein

The virtual data includes empty data, and the metadata includes the focal length letter of the exercise data and the lens unit Breath, the exercise data include the information about acceleration change.

16. according to the method for claim 15, wherein the focus information of the lens unit is by automatic focusing Device calculates and transmission.

17. according to the method for claim 13, this method further includes：

Receive described image offset data；

The quantity of the mobile pixel for each picture frame for forming described image is calculated by using described image offset data；With And

Quantity compensation described image based on the mobile pixel.

18. according to the method for claim 13, this method further includes：

Before the detection described image,

Each picture frame of the described image of the main body is detected by the lens unit；

Detect the exercise data corresponding with the movement of the camera module from motion sensor；And

Calculate the synchronizing information on the acquisition opportunity about described image frame and the exercise data.

19. a kind of digital camera system, which includes：

Lens unit detects the image of main body；And

First processor calculates the movement of camera module based on the corresponding exercise data of movement with the camera module Whether direction and displacement distance simultaneously determine the displacement distance of the camera module on the moving direction in default In term of reference, and image compensation data corresponding with described image is generated,

Wherein, described image offset data includes virtual data and metadata,

The virtual data in the first processor based on the exercise data by using pre-determined synchronization information and with being controlled The image frame synchronization of the described image obtained in the part of the movement of the lens unit and

The portion of movement of the metadata with being not based on the exercise data control lens unit in the first processor The image frame synchronization of the described image obtained in point.

20. digital camera system according to claim 19, wherein：

The first processor is generated in the displacement distance of the camera module when except the term of reference to be included The metadata of the exercise data, and when the displacement distance of the camera module is in the term of reference Control the lens unit movement and

The lens unit detection passes through the movement for mobile the compensated picture frame for controlling the lens unit.

21. digital camera system according to claim 20, wherein at the displacement distance of the camera module When in the term of reference, location information of the first processor based on the lens unit controls the lens unit It is mobile.

22. digital camera system according to claim 20, wherein the metadata is included based on pre-determined synchronization information The focus information of the exercise data and the lens unit, the exercise data include the information about acceleration change, institute State exercise data and do not control the movement of the lens unit in the first processor part in the described image frame that obtains It is corresponding.

23. digital camera system according to claim 22, which further includes：

Second processor calculates the mobile Pixel Information about each picture frame using the metadata and is based on the shifting Dynamic Pixel Information compensation described image.

24. digital camera system according to claim 23, which further includes：

Autofocus Processor, calculate the lens unit the focus information and the transmission focus information to described the One processor.

25. a kind of digital camera system, which includes：

Camera module, the lens unit including being used to sense image；And

Processor controls the movement of the lens unit and generates for compensating in response to the movement of the camera module The image compensation data of the image of sensing,

Wherein, described image offset data includes virtual data and metadata,

The virtual data by using pre-determined synchronization information and in movement of the processor based on the camera module Control the described image obtained in the part of the movement of the lens unit image frame synchronization and

The metadata and the movement that lens unit described in the motion control of the camera module is not based in the processor Part in the image frame synchronization of described image that obtains.

26. digital camera system according to claim 25, wherein the shifting that the processor will control the lens unit The dynamic data with generating the image sensed for compensation merge.

27. digital camera system according to claim 25, wherein shifting of the processor according to the camera module Dynamic distance selectively controls the movement of the lens unit.

28. digital camera system according to claim 27, wherein at the displacement distance of the camera module When in preset range, the processor controls the movement of the lens unit based on the location information of the lens unit, And the camera module the displacement distance when except the preset range, processor generation include about The focus information of the data of the information of acceleration change and the lens unit.

29. digital camera system according to claim 28, wherein the preset range is the removable of the lens unit Dynamic range.

30. digital camera system according to claim 25, wherein image of the processor based on the image sensed Mobile Pixel Information compensation described image between frame.