JP6800642B2 - Accessory device, control device, control method of these - Google Patents

Description

The present invention relates to an accessory device that assists panning.

There is panning as a shooting technique that expresses the sense of speed of a moving subject. The purpose of the photographing technique is to make a moving subject stand still and let the background flow by panning the camera according to the movement of the subject.

Here, in the above-mentioned shooting technique, the photographer needs to pan according to the movement of the subject, but the panning speed is too fast or too slow, so that there is a difference between the moving speed of the subject and the panning speed. If it occurs, the image may be blurred even to the subject. To solve such a problem, panning assist has been proposed as a technique for assisting the photographer in panning photography. The panning assist is a method of absorbing the difference between the moving speed of the subject and the panning speed by moving the shift lens for image stabilization based on the panning speed and the motion vector of the subject detected from the image.

Patent Document 1 discloses a method for succeeding in panning by detecting a difference between the speed of a subject and the speed at which the camera is shaken and correcting the amount of deviation corresponding to the difference by using a camera shake correction function. There is. In Patent Document 2, by changing the output timing of the shake detecting means according to the exposure time and the frame rate, the motion vector amount of the subject image and the output timing of the shake detecting means are matched, and the detection accuracy of the moving speed of the subject is matched. Is disclosed how to increase.

Japanese Unexamined Patent Publication No. 2006-317848 JP-A-2015-161730

However, the methods disclosed in Patent Documents 1 and 2 can be carried out only in an integrated camera in which the motion vector detection unit, the camera shake correction control unit, and the panning assist control unit are configured in the same main body, and the lens. Cannot be implemented in interchangeable camera systems.

Generally, the CPU that controls the camera body in an interchangeable lens camera system always performs parallel processing in order to operate various installed functions, and depending on the priority of the parallel processing, panning assist Processing may be delayed. Also, in data transfer (lens communication) via the mount terminal between the camera body and the interchangeable lens, communication such as focus lens control, aperture control, and status acquisition is performed as needed, so panning is taken. Communication for assist may be delayed.

That is, in an interchangeable lens camera system, a situation may occur in which lens communication cannot be performed at a timing assumed in advance due to exhaustion of the lens communication band and concentration of CPU load. If the motion vector and the lens angular velocity whose detection timings do not match each other are used in the panning assist, the wrong subject angular velocity is calculated, which may cause performance deterioration or operation abnormality. On the other hand, the operation for still image shooting by the photographer may occur at an arbitrary timing. Therefore, it is necessary to realize the panning assist that secures the responsiveness of the release and corrects the moving component of the subject even in the situation where the lens communication for the panning assist is not completed. Therefore, in order to improve the performance of the panning assist by the interchangeable lens camera system, it is necessary to appropriately manage the timing of the motion vector and the lens angular velocity.

The present invention is, accessory apparatus with improved panning assist performance, the control device, to provide these control how.

Accessory device according to one aspect of the present invention is an accessory device that is attachable to the imaging apparatus, and a communication means for communicating with the imaging device, and detecting means for detecting an angular velocity, in the first mode, is detected was based on the angular velocity to control the movement of the lens has in the second mode, and control means for controlling the movement of the lens based on the first information calculated based on the motion vector amount, a, prior Symbol second mode, said communication means transmits the second information indicating the detected angular velocity, and the third information is information indicating the timing at which the angular velocity is detected, said first receives the information and the third information, in the first mode, the control means to control the movement of the lens regardless of the first information.

Control apparatus as another aspect of the present invention is a control apparatus having a communication means for communicating with removably attached accessory device, the control unit of the accessory device in the first mode before Symbol accessory based on the angular velocity detected by the detection means of the apparatus controls the movement of the lens, in a second mode, controls the movement of the lens based on the first information calculated based on the motion vector quantity, before in serial second mode, said communication means comprises a second information indicating the detected angular velocity by detecting means of said accessory device, and the third information is information indicating the timing at which the angular velocity is detected, the It is characterized in that it receives and transmits the first information and the third information, and in the first mode, the control means controls the movement of the lens regardless of the first information. To do.

The control method of the accessory device as another aspect of the present invention is a control method of the accessory device that can be attached to the image pickup device and has a communication means for communicating with the image pickup device, the step of detecting the angular velocity, and the first step. in one mode, based on the angular velocity that was detected to control the movement of the lens, in the second mode, acquired by the communication means, based on the first information calculated based on the motion vector quantity transmission and controlling the movement of the lens Te, in the second mode, the second information indicating the detected angular velocity, and the third information is information indicating the timing at which the angular velocity is detected, the and, wherein the steps of the first information to receive said third information, have a, in the first mode, the movement of the lens being controlled regardless of the first information And.

The control method of the control device as another aspect of the present invention is a control method of a control device having a communication means for communicating with the detachably attached accessory device, and the control means of the accessory device is the first. in mode before Symbol controls the movement of the lens based on detected by the detecting means the angular velocity of the accessory device, in the second mode, obtained from the control device, first calculated based on the motion vector quantity 1 the movement of the lens is controlled on the basis of the information, in the second mode, the second information indicating the detected angular velocity by detecting means of said accessory device, the information indicating the timing in which the angular velocity is detected It receives a certain third information, wherein the first information and to have the sending and the third information, in the first mode, the movement of the lens is the first information An accessory device characterized by being controlled regardless .

Other objects and features of the present invention will be described in the following examples.

According to the present invention, the accessory device with improved panning assist performance, the controller can provide these control how.

It is a block diagram of the camera system in each embodiment. It is a flowchart of the image pickup synchronous communication process by the camera body in each Example. It is a flowchart of the exposure setting process by the camera body in each Example. It is a flowchart of the exposure processing by the camera body in each Example. It is a flowchart of the reception processing of the synchronous signal communication by the interchangeable lens in each embodiment. It is a flowchart of the reception process of the setting communication of the lens angular velocity detection period by the interchangeable lens in each embodiment. It is a flowchart of the reception process of subject angular velocity communication by an interchangeable lens in each embodiment. It is a flowchart of the reception process of the exposure start timing communication by the interchangeable lens in each Example. It is a flowchart of the reception process of the panning assist result communication by the interchangeable lens in each embodiment. It is a timing chart of the panning assist processing by the camera system in Example 1. It is a timing chart of the panning assist processing by the camera system in Example 1. It is a timing chart of the panning assist processing by the camera system in Example 1. It is explanatory drawing of the calculation method of the drive amount of the vibration isolation control part in Example 1. FIG. It is a timing chart of the panning assist processing by the camera system in Example 2. It is explanatory drawing of the calculation method of the driving amount of the vibration isolation control part in Example 2. FIG.

Hereinafter, examples of the present invention will be described in detail with reference to the drawings.

First, the camera system according to the first embodiment of the present invention will be described with reference to FIG. FIG. 1 is a block diagram of the camera system 10 (imaging apparatus or imaging system) in this embodiment. In this embodiment, the camera system 10 is an interchangeable lens camera system including a camera body 100 (imaging device or imaging device body) and an interchangeable lens 200 (lens device) that can be attached to and detached from the camera body 100. is there.

As shown in FIG. 1, an interchangeable lens 200 is detachably attached to the camera body 100 of this embodiment via a lens mount portion 12. The interchangeable lens 200 that can be attached to the camera body 100 is provided with an imaging optical system including a focus lens 201, a zoom control unit 202, an aperture 203, and an anti-vibration control lens 204. Note that FIG. 1 shows one lens as the focus lens 201, the zoom control unit 202 (zoom lens), or the anti-vibration control lens 204, and each lens is composed of a plurality of lenses. It may be a lens group. The luminous flux formed through the image pickup optical system is guided to the image pickup element 102 and is imaged as an optical image on the image pickup element 102.

First, the configuration of the camera body 100 will be described. The shutter 101 controls the amount of exposure to the image sensor 102. The image pickup device 102 includes a CCD sensor and a CMOS sensor, and converts an optical image of a subject into an analog image signal. That is, the image sensor 102 photoelectrically converts the optical image formed via the image pickup optical system and outputs an image signal. Further, the image sensor 102 may have a plurality of pixels (focus detection pixels) used for focus detection. The A / D conversion unit 103 converts the analog image signal output from the image sensor 102 into a digital image signal, and outputs the digital image signal to the image processing unit 140 and the memory control unit 105. The optical image of the subject can be observed by the optical viewfinder 114 through the mirrors 112 and 113 while the mirror 112 is down. The timing generation unit 104 supplies a clock signal and a synchronization signal to the image sensor 102, the A / D conversion unit 103, the image processing unit 140, the memory control unit 105, and the system control unit 130.

The image processing unit 140 performs predetermined pixel complementation processing and color conversion processing on the digital image signal from the A / D conversion unit 103 or the data from the memory control unit 105 to generate image data. Further, the image processing unit 140 performs a predetermined arithmetic process using the digital image signal. The image processing unit 140 determines the position of the subject and tracks the subject based on the color and shape of the subject. Further, the image processing unit 140 has a motion vector detecting unit 141 (motion vector detecting means). The motion vector detection unit 141 detects a motion vector (motion vector amount) in the first period based on the subject position over a plurality of frames of the tracked subject. The subject position is composed of the upper left coordinate of the subject, the height and the width. The calculation result of the image processing unit 140 is output to the system control unit 130 via the memory control unit 105.

The memory control unit 105 controls the A / D conversion unit 103, the timing generation unit 104, the image processing unit 140, the memory 107, the recording unit 108, and the image display unit 106. The output data from the A / D conversion unit 103 is written to the memory 107 and the recording unit 108 via the image processing unit 140 and the memory control unit 105. The memory 107 and the recording unit 108 store captured still images and moving images. The memory 107 is composed of a volatile memory and is also used as a work area of the system control unit 130. The recording unit 108 is used as an image recording area composed of a non-volatile memory attached to the inside or the outside of the camera body 100.

The image display unit 106 is configured by using an LCD or the like, and in the case of an EVF, the captured image data is sequentially displayed to realize the EVF function. Further, the image display unit 106 displays an image (captured image) recorded on the recording unit 108 at the time of image reproduction. The shutter control unit 110 controls the shutter 101 based on the control signal from the system control unit 130 in cooperation with the mirror control unit 111. The mirror control unit 111 controls the mirror 112 based on the control signal from the system control unit 130.

The system control unit 130 controls the entire camera system 10 including the camera body 100 according to input signals from the shutter switch 115 (SW1), the shutter switch 116 (SW2), the camera operation unit 117, the memory control unit 105, and the like. To do. That is, the system control unit 130 controls the interchangeable lens 200 and the like via the image sensor 102, the memory control unit 105, the shutter control unit 110, the mirror control unit 111, and the I / F 120 according to the above-mentioned input signals.

The shutter switch 115 (SW1) instructs the system control unit 130 to start operations such as AF processing, AE processing, and AWB processing. The shutter switch 116 (SW2) instructs the system control unit 130 to start exposure. Upon receiving the exposure start instruction, the system control unit 130 controls the interchangeable lens 200 via the mirror control unit 111, the shutter control unit 110, the memory control unit 105, and the I / F 120 to expose (record) the image sensor 102. The process of recording the image data in the unit 108) is started. In this embodiment, it is necessary to drive the anti-vibration control unit 209 at the time of exposure to control the interchangeable lens 200. Therefore, the system control unit 130 notifies the interchangeable lens 200 of the exposure start timing information via the I / F 120. The exposure start timing information (exposure timing) can be notified by communication processing, or may be notified via a terminal provided on the dedicated I / F 120.

The camera operation unit 117 includes various buttons, a touch panel, a power on / off button, and the like, and outputs an instruction received by the photographer's operation to the system control unit 130. According to the operation of the photographer via the camera operation unit 117, the system control unit 130 performs each operation such as AF mode, AE mode, and panning assist mode, which are one of various functions mounted on the camera body 100. Switch modes. The camera power control unit 118 manages the external battery and the built-in battery of the camera body 100. When the battery is removed or the battery is exhausted, the camera power control unit 118 performs an emergency shutoff process for controlling the camera body 100. At this time, the system control unit 130 shuts off the power supplied to the interchangeable lens 200.

The AF control unit 131 is provided in the system control unit 130 and controls the AF processing of the camera body 100. At the time of AF processing, the AF control unit 131 drives the focus lens 201 based on the lens information such as the focus position and focal length obtained from the interchangeable lens 200 via the I / F 120 and the AF evaluation value according to the AF mode. Calculate the quantity. The drive amount of the focus lens 201 is input to the interchangeable lens 200 via the lens communication control unit 133 provided in the system control unit 130 and the I / F 120. For example, in the phase difference AF mode, the AF control unit 131 makes the optical image of the subject incident on the focus detection unit (not shown) via the mirror 112 and the focus detection sub-mirror (not shown) to obtain the phase difference AF evaluation. The drive amount of the focus lens 201 is calculated based on the value or the like. In the contrast AF mode, the AF control unit 131 calculates the drive amount of the focus lens 201 based on the contrast AF evaluation value calculated by the image processing unit 140. In the imaging surface phase difference AF mode, the AF control unit 131 drives the focus lens 201 based on the imaging surface phase difference AF evaluation value output from the pixels of the image sensor 102 (pixels used for focus detection). Calculate the quantity. Further, the AF control unit 131 switches the position of the AF frame for calculating the evaluation value according to the AF evaluation modes such as the one-point AF mode, the multi-point AF mode, and the face detection AF mode.

The AE control unit 132 is provided in the system control unit 130 and controls the AE processing of the camera body 100. At the time of AE processing, the AE control unit 132 follows the AE mode, and based on the lens information such as the open F value and the focal length obtained from the interchangeable lens 200 via the I / F 120, and the AE evaluation value, the AE control amount. (Aperture control amount, shutter control amount, exposure sensitivity, etc.) are calculated. The aperture control amount is input to the interchangeable lens 200 via the lens communication control unit 133 and the I / F 120. The shutter control amount is input to the shutter control unit 110. The exposure sensitivity is input to the image sensor 102. For example, in the viewfinder shooting mode, the AE control unit 132 determines the AE control amount based on the AE evaluation value obtained by incidenting the optical image of the subject on the brightness determination unit (not shown) via the mirror 112 and the mirror 113. Calculate. In the live view shooting mode, the AE control unit 132 calculates the AE control amount based on the AE evaluation value calculated by the image processing unit 140. Further, the AE control unit 132 switches the AE frame position and the weighting amount for calculating the evaluation value according to the metering modes such as the evaluation metering mode, the average metering mode, and the face detection metering mode.

The panning assist control unit 134 (calculation means) is provided in the system control unit 130, and controls the panning assist processing of the camera body 100. The panning assist function can be executed only when the live view shooting mode is set and the attached interchangeable lens 200 supports panning assist. When the panning assist function cannot be executed, the panning assist control unit 134 controls only the flow amount of the image according to the panning assist mode. Specifically, the panning assist control unit 134 controls the shutter so that the deflection angle during exposure becomes an arbitrary amount based on the angular velocity information (lens angular velocity information) obtained from the angular velocity detection unit 208 of the interchangeable lens 200. The amount is notified to the AE control unit 132, and only the flow amount of the image is controlled. Note that the angular velocity information can also be obtained from the angular velocity detection unit when the camera body 100 is equipped with an angular velocity detection unit (not shown).

On the other hand, when the panning assist function can be executed, the panning assist control unit 134 instructs the interchangeable lens 200 whether or not the panning assist processing can be executed according to the panning assist mode. Further, based on the angular velocity information obtained from the interchangeable lens 200 via the I / F 120, the lens information such as the focal length, the amount of motion vector input from the image processing unit 140, and the like, the subject such as the subject angular velocity and the subject angular acceleration Calculate the angular velocity information.

Further, the panning assist control unit 134 sets a value of the lens angular velocity detection period based on the frame rate, the shutter speed, and the like so that the lens angular velocity detection period of the interchangeable lens 200 matches (corresponds to) the motion vector detection period. Calculate. The subject angular velocity information and the set value of the lens angular velocity detection period are transmitted to the interchangeable lens 200 via the lens communication control unit 133 and the I / F 120 as communication means. In this embodiment, the subject angular velocity information transmitted from the camera body 100 to the interchangeable lens 200 includes time information (of the angular velocity) in which the angular velocity detection unit 208 detects the angular velocity, as will be described later with reference to FIG. 10 (A). Detection time information) is included.

The lens communication control unit 133 is provided in the system control unit 130, and controls communication processing between the camera body 100 and the interchangeable lens 200. When it is detected that the interchangeable lens 200 is attached via the I / F 120, the lens communication control unit 133 starts communication between the camera body 100 and the interchangeable lens 200, receives lens information as appropriate, and receives camera information and the like. Send a drive command, etc. For example, consider a case where the interchangeable lens 200 set in the live view shooting mode and mounted is compatible with panning assist. In this case, when the imaging synchronization signal is input from the timing generation unit 104, the lens communication control unit 133 performs synchronization signal communication for notifying the communication start delay time from the imaging synchronization signal to the start of communication. When the exposure by the shutter switch 116 (SW2) is completed, the lens communication control unit 133 receives the panning assist result information from the interchangeable lens 200. In the live view shooting mode, when the imaging synchronization signal is input from the timing generator 104, the lens communication control unit 133 collectively receives the lens information (focus lens position, focus lens state, aperture state, focal length, etc.). To do.

The I / F 120 is a communication interface between the camera body 100 and the interchangeable lens 200. The I / F 120 transmits / receives lens information, control commands, and the like by performing communication using an electric signal between the system control unit 130 of the camera body 100 and the lens control unit 210 via the connector 20.

Next, the configuration of the interchangeable lens 200 will be described. The focus lens 201 moves in a direction along the optical axis OA (optical axis direction) to change the focus (focus state) of the imaging optical system. The focus control unit 205 is controlled by the lens control unit 210 to drive the focus lens 201. Further, the focus control unit 205 outputs focus information such as the position of the focus lens 201 to the lens control unit 210.

The zoom control unit 202 moves in the optical axis direction to change the focal length of the imaging optical system. The zoom control unit 206 is controlled by the lens control unit 210 to drive the zoom control unit 202. Further, the zoom control unit 206 outputs zoom information such as the focal length to the lens control unit 210. The aperture 203 (aperture value) of the aperture 203 is variable, and the amount of light is changed according to the aperture diameter. The aperture control unit 207 is controlled by the lens control unit 210 to drive the aperture 203. Further, the aperture control unit 207 outputs aperture information such as an aperture value (F value) to the lens control unit 210.

The anti-vibration control lens 204 moves in a direction orthogonal to the optical axis OA (direction orthogonal to the optical axis) to reduce image blur caused by camera shake due to camera shake or the like. The anti-vibration control unit 209 is controlled by the lens control unit 210 to drive the anti-vibration control lens 204. Further, the vibration isolation control unit 209 outputs vibration isolation information such as the vibration isolation possible range to the lens control unit 210.

The angular velocity detecting unit 208 (angular velocity detecting means) detects the angular velocity (velocities in the Yaw direction and the Pitch direction) of the interchangeable lens 200 and outputs the angular velocity to the lens control unit 210. The angular velocity detection unit 208 is controlled by the lens control unit 210. The angular velocity detection unit can also be provided on the camera body 100. In this embodiment, the lens control unit 210 acquires the time information (detection time information of the angular velocity) at which the angular velocity detection unit 208 detects the angular velocity.

The lens operation unit 211 includes a focus ring, a zoom lens, an AF / MF switch, an IS on / off switch, and the like, and outputs an instruction received by the photographer's operation to the lens control unit 210. According to the operation of the photographer via the lens operation unit 211, the system control unit 130 switches the operation mode for various functions mounted on the interchangeable lens 200. The memory 212 is composed of a volatile memory.

The lens control unit 210 controls the focus control unit 205, the zoom control unit 206, the aperture control unit 207, the vibration isolation control unit 209, the angular velocity detection unit 208, and the like according to the input signal from the lens operation unit 211 or the I / F 220. To do. As a result, the lens control unit 210 controls the entire interchangeable lens 200. Further, the lens control unit 210 transmits the information input from each control unit, the detection unit, and the like to the camera body 100 via the I / F 220 in response to the lens information acquisition command received via the I / F 220. .. In this embodiment, the lens control unit 210 operates (controls) the angular velocity detection unit 208 based on the image pickup synchronization signal information input from the camera body 100 by communication and the set value of the lens angular velocity detection period. The lens control unit 210 transmits the angular velocity information and the angular velocity detection time information acquired from the angular velocity detection unit 208 to the camera body 100 via the I / F 220.

The I / F 220 is an interface (communication means) for communication between the camera body 100 and the interchangeable lens 200. The I / F 220 transmits / receives lens information, control commands, and the like by performing communication using an electric signal between the system control unit 130 of the camera body 100 and the lens control unit 210 via the connector 20.

Next, the image pickup synchronous communication process of the camera body 100 in this embodiment will be described with reference to FIG. FIG. 2 is a flowchart of imaging synchronous communication processing of the camera body 100, and is a camera body when the camera body 100 is in the live view shooting mode and the attached interchangeable lens 200 supports panning assist. It shows 100 operations. The image pickup synchronous communication process is a process started in the live view shooting mode, and is a process for the lens control unit 210 to communicate with the interchangeable lens 200 at the timing of the image pickup synchronous signal.

First, in step S201, the system control unit 130 determines whether or not live view shooting is continuing. If the live view shooting is continuing, the process proceeds to step S202. On the other hand, if the live view shooting is not continued, the imaging synchronous communication process of this flow is terminated.

In step S202, the system control unit 130 determines whether or not the imaging synchronization signal has been input. If the imaging synchronization signal is input, the process proceeds to step S203. On the other hand, if the imaging synchronization signal is not input, the process returns to step S201. In step S203, the system control unit 130 stores the time when the imaging synchronization signal is input as the imaging synchronization signal time in the internal memory (not shown) of the system control unit 130, the memory 107, or the like. Subsequently, in step S204, the system control unit 130 determines whether or not unprocessed lens communication remains. If unprocessed lens communication remains, the process proceeds to step S205. On the other hand, if there is no unprocessed lens communication remaining, the process proceeds to step S206. In step S205, the system control unit 130 completes the unprocessed lens communication and proceeds to step S206.

In step S206, the system control unit 130 determines whether or not to carry out synchronous signal communication. When the interchangeable lens 200 supports panning assist and the panning assist mode is effective, the system control unit 130 determines that synchronous signal communication is to be performed, and proceeds to step S207. On the other hand, if the system control unit 130 determines that the synchronous signal communication is not performed, the process returns to step S201.

In step S207, the system control unit 130 measures the elapsed time from the imaging synchronization signal time, and stores this elapsed time as a delay time (synchronization signal communication delay time) in the internal memory or the memory 107. Subsequently, in step S208, the system control unit 130 performs synchronous signal communication to the interchangeable lens 200 via the I / F 120. The transmission data of the synchronous signal communication includes the synchronous signal delay time. Subsequently, in step S209, the system control unit 130 transmits the set value communication of the lens angular velocity detection period to the interchangeable lens 200 via the I / F 120, and returns to step S201. As the transmission data of this communication, the system control unit 130 detects the angular velocity of the lens as timing information for synchronizing the motion vector detection period (the period during which the camera body 100 detects the motion vector) and the angular velocity detection period by the interchangeable lens 200. Send the set value of the period.

By performing the above processing, the image pickup synchronization signal can be notified from the camera body 100 to the interchangeable lens 200, and the lens angular velocity detection period can be set.

Next, the exposure setting process of the camera body 100 will be described with reference to FIG. FIG. 3 is a flowchart of the exposure setting process of the camera body 100, in which the camera body 100 is in the live view shooting mode and the attached interchangeable lens 200 supports panning assist. The operation of 100 exposure setting processing is shown. The exposure setting process is a process performed for each frame in the live view shooting mode, and is a process for controlling the exposure of the next frame.

First, in step S301, the system control unit 130 determines whether or not live view shooting is continuing. If the live view shooting is continuing, the process proceeds to step S302. On the other hand, if live view shooting is not ongoing, the exposure setting process of this flow is terminated.

In step S302, the system control unit 130 determines whether or not it is the exposure setting timing of the image sensor 102 of the next frame. If it is the exposure setting timing, the process proceeds to step S303. On the other hand, if it is not the exposure setting timing, the process returns to step S301.

In step S303, the system control unit 130 calculates the exposure set value based on the AE control amount, the camera mode, and the like. Further, the system control unit 130 controls the exposure of the next frame by outputting the exposure set value to the memory control unit 105. Subsequently, in step S304, the panning assist control unit 134 determines whether or not to perform the panning assist processing. When the interchangeable lens 200 supports panning assist and the panning assist mode is effective, the panning assist control unit 134 determines that the panning assist processing is to be performed, and proceeds to step S305. On the other hand, if the panning assist control unit 134 determines that the panning assist processing is not performed, the process returns to step S301.

In step S305, the panning assist control unit 134 sets the lens angular velocity detection period so that the motion vector detection period and the angular velocity detection period match (correspond to) based on the exposure setting of the next frame and the like. , Calculated as the relative time from the imaging synchronization signal. The calculated angular velocity detection period setting value is transmitted to the interchangeable lens 200 in step S209 described above.

Subsequently, in step S306, the panning assist control unit 134 exchanges the angular velocity and the detection time information of the angular velocity detected by the angular velocity detection unit 208 based on the set value of the lens angular velocity detection period transmitted from the camera body 100 to the interchangeable lens 200. Obtained from lens 200. However, as shown in FIG. 10A, the angular velocity information acquired in step S306 is the angular velocity information in the angular velocity detection period that matches (corresponds to) the motion vector detection period in the previous frame. The panning assist control unit 134 receives (acquires) the angular velocity information (lens angular velocity) and the angular velocity detection time information (lens angular velocity detection time) from the interchangeable lens 200 in association with each other. For example, as in the communication commands shown in Table 1, the panning assist control unit 134 (lens communication control unit 133, I / F120) receives (acquires) the lens angular velocity and the lens angular velocity detection time in the same communication packet. .. In other words, the lens control unit 210 (I / F220) transmits the lens angular velocity and the lens angular velocity detection time in the same communication packet.

Subsequently, in step S307, the panning assist control unit 134 calculates the angular velocity information (including the subject angular velocity and the subject angular acceleration) of the subject. The angular velocity information of the subject is calculated based on the angular velocity information acquired from the interchangeable lens 200 in step S306, the lens information such as the angular velocity detection time information and the focal length, and the amount of motion vector input from the image processing unit 140. Will be done. Further, the panning assist control unit 134 outputs the calculated angular velocity information of the subject to the lens communication control unit 133.

Subsequently, in step S308, the lens communication control unit 133 performs the subject angular velocity communication in order to transmit the subject angular velocity information to the interchangeable lens 200. In this embodiment, the panning assist control unit 134 (lens communication control unit 133) associates the angular velocity information of the subject with the acquisition time of the angular velocity information acquired from the interchangeable lens 200 in step S306, and transmits the angular velocity information to the interchangeable lens 200. To do. At this time, the panning assist control unit 134 transmits the angular velocity information (subject angular velocity) and the angular velocity detection time information (lens angular velocity detection time) of the subject to the interchangeable lens 200 in association with each other. For example, as in the communication commands shown in Table 2, the panning assist control unit 134 transmits the subject angular velocity and the lens angular velocity detection time in the same communication packet. In other words, the lens control unit 210 (I / F220) receives (acquires) the subject angular velocity and the lens angular velocity detection time in the same communication packet.

When the subject angular velocity communication in step S308 is completed, the process returns to step S301.

By performing the above processing, it is possible to control the exposure of the next frame and set the lens angular velocity detection period for notifying the interchangeable lens 200 with the next imaging synchronization signal. Further, the subject angular velocity can be notified to the interchangeable lens 200, and the angular velocity information can be acquired from the interchangeable lens 200.

Next, the exposure process of the camera body 100 will be described with reference to FIG. FIG. 4 is a flowchart of the exposure process of the camera body 100. FIG. 4 shows the operation of the live view exposure processing of the camera body 100 in the live view shooting mode and when the attached interchangeable lens 200 supports panning assist. The live view exposure process is a process started by an exposure start instruction (shooting start instruction) via the shutter switch 116 (SW2) in the live view shooting mode.

First, in step S401, the system control unit 130 notifies the interchangeable lens 200 of the exposure start timing (shooting start timing) by communication via the lens communication control unit 133. Subsequently, in step S402, the system control unit 130 controls the shutter control unit 110 and the image sensor 102 to perform the exposure process and acquire the image data. The image data is held in the memory 107 via the image processing unit 140 and the memory control unit 105.

Subsequently, in step S403, the lens communication control unit 133 determines whether or not to perform the panning assist process. When the interchangeable lens 200 supports panning assist and the panning assist mode is effective, the lens communication control unit 133 determines that the panning assist processing is to be performed, and proceeds to step S404. On the other hand, if the panning assist process is not performed, the process proceeds to step S405.

In step S404, the lens communication control unit 133 performs communication for receiving the panning assist result information from the interchangeable lens 200. In step S405, the system control unit 130 creates EXIF information added to the image file. The EXIF information is recorded in the memory 107 via the memory control unit 105. In this embodiment, the EXIF information includes the panning assist result information received in step S404, as well as the lens information, the shutter speed, the shooting conditions (camera mode) such as the aperture value, and the like.

Subsequently, in step S406, the system control unit 130 controls the image processing unit 140 to create an image file from the image data and the EXIF information. Further, the system control unit 130 holds the image data in the memory 107 via the memory control unit 105, and then records the image data in the recording unit 108.

By performing the above processing, the result of the panning assist performed at the time of exposure can be acquired from the interchangeable lens 200, and the panning assist result is recorded in the acquired image data or displayed on the image display unit 106. It becomes possible to do.

Further, by transmitting the set value of the lens angular velocity detection period from the camera body 100 to the interchangeable lens 200, the timing of the motion vector detection period of the camera body 100 and the angular velocity detection period of the lens can be matched. Further, the angular velocity information detected by the interchangeable lens 200 and the detection time of the angular velocity information are associated with each other and transmitted to the camera body 100. Further, the angular velocity information (angular velocity detected by the interchangeable lens 200) detection time is associated with the angular velocity information of the subject calculated based on the angular velocity information and the motion vector detection information, and is transmitted to the interchangeable lens 200. This makes it possible to control the vibration isolation control unit 209 so as to correctly correct the amount of movement of the subject during exposure during the live view release exposure process described later. That is, even if a request for live view release exposure processing is made in a situation where the transmission processing of the angular velocity information to the camera body 100 and the transmission processing of the angular velocity information of the subject from the camera body 100 are not completed, the correct correction is possible. Become. Further, even if a request for live view release exposure processing occurs in a situation where the communication for panning assist is not completed at the assumed timing, correct correction is possible.

Next, the reception process of the synchronous signal communication by the interchangeable lens 200 will be described with reference to FIG. FIG. 5 is a flowchart of the reception process of the synchronous signal communication of the interchangeable lens 200. FIG. 5 shows a process started when the interchangeable lens 200 receives a synchronization signal communication from the camera body 100 in the live view shooting mode and the mounted interchangeable lens 200 supports panning assist. ing.

First, in step S501, the lens control unit 210 stores the time when the communication is performed by storing the current time of the free run timer used for time management in the interchangeable lens 200. This time is stored in the internal memory (not shown) of the lens control unit 210 or the memory 212.

Subsequently, in step S502, the lens control unit 210 determines whether or not communication is performed by the communication data length of the predetermined synchronization signal communication (whether or not all data transmission / reception is completed). If the communication (transmission / reception) of all data is not completed, step S502 is repeated until the communication of all data is completed. On the other hand, when the communication of all the data is completed, the process proceeds to step S503. In step S503, the lens control unit 210 subtracts the delay time (synchronous signal delay time) included in the received data of the synchronous signal communication from the time (time when the communication is performed) stored in step S501. This makes it possible to calculate (set) the time of the in-lens imaging synchronization signal that matches the imaging synchronization signal timing in the camera body 100.

By performing the above processing, the interchangeable lens 200 can know the in-lens imaging synchronization signal time that coincides with the imaging synchronization signal timing in the camera body 100.

Next, with reference to FIG. 6, the reception process of the set value communication of the lens angular velocity detection period by the interchangeable lens 200 will be described. FIG. 6 is a flowchart of the reception process of the set value communication of the lens angular velocity detection period by the interchangeable lens 200. FIG. 6 shows when the interchangeable lens 200 receives the set value communication of the lens angular velocity detection period from the camera body 100 in the live view shooting mode and when the mounted interchangeable lens 200 supports panning assist. Indicates the process to be started.

First, in step S601, the lens control unit 210 determines whether or not communication is performed by the communication data length of the set value communication of the lens angular velocity detection period determined in advance (whether or not all data transmission / reception is completed). If the communication (transmission / reception) of all data is not completed, step S601 is repeated until the communication of all data is completed. On the other hand, when the communication of all data is completed, the process proceeds to step S602.

In step S602, the lens control unit 210 determines the lens angular velocity detection period included in the received data of the set value communication of the lens angular velocity detection period and the time of the in-lens imaging synchronization signal calculated in step S503 described above. Set the lens angular velocity detection period. That is, the lens control unit 210 detects the angular velocity from the lens angular velocity detection unit 208 at the timing when the time of the lens angular velocity detection period (the period during which the angular velocity detection unit 208 detects the angular velocity) elapses from the time of the in-lens imaging synchronization signal. Get the angular velocity in the period.

Subsequently, in step S603, the lens control unit 210 stores the time information (lens angular velocity detection time) when the angular velocity detection unit 208 detects the angular velocity. The lens angular velocity detection time is stored in, for example, an internal memory (not shown) of the lens control unit 210 or a memory 212. More specifically, the lens control unit 210 stores the current time of the free run timer used for time management in the interchangeable lens 200. The stored time (time information) is preferably the central time of the period indicated by the set value of the lens angular velocity detection period transmitted from the camera body 100. However, this embodiment is not limited to this, and may be the start time or end time of the period indicated by the set value of the lens angular velocity detection period.

By performing the above processing, the interchangeable lens 200 can set a lens angular velocity detection period that coincides with the motion vector detection period in the camera body 100.

Next, with reference to FIG. 7, the reception process of the subject angular velocity communication by the interchangeable lens 200 will be described. FIG. 7 is a flowchart of the reception process of the subject angular velocity communication by the interchangeable lens 200. FIG. 7 shows a process started when the interchangeable lens 200 receives the subject angular velocity communication from the camera body 100 in the live view shooting mode and the mounted interchangeable lens 200 supports panning assist. ing.

First, in step S701, the lens control unit 210 transmits the angular velocity information (lens angular velocity) stored in step S602 and the angular velocity detection time information (lens angular velocity detection time) stored in step S603 to the camera body 100. Send. Therefore, the lens control unit 210 stores these information (data) in the transmission buffer.

Subsequently, in step S702, the lens control unit 210 determines whether or not communication is performed by the communication data length of the predetermined subject angular velocity communication (whether or not all data transmission / reception is completed). If the transmission / reception (communication) of all data is not completed, step S702 is repeated until the communication of all data is completed. On the other hand, when the communication of all data is completed, the process proceeds to step S703.

In step S703, the lens control unit 210 transmits the angular velocity information and the angular velocity detection time information prepared in step S701 to the camera body 100. Subsequently, in step S704, the lens control unit 210 sends the angular velocity information of the subject and the detection time information of the angular velocity to the panning assist control unit 134 in case the request for the live view release exposure process is communicated from the camera body 100. Remember. As will be described later with reference to FIG. 10A, the lens angular velocity detection time received from the camera body 100 in step S703 is associated with the angular velocity information stored by the interchangeable lens 200 in step S603. This is the detection time information of the angular velocity transmitted to the main body 100.

In this way, the mechanism is such that the time when the interchangeable lens 200 detects the angular velocity information is transmitted to the camera body 100 and then transmitted to the interchangeable lens 200 again for the following reasons. That is, the series of communication processes of transmitting the angular velocity information from the interchangeable lens 200 to the camera body 100 and transmitting the subject angular velocity information from the camera body 100 to the interchangeable lens 200 are not synchronized with the live view release exposure process. Therefore, even if a series of communication processes are not completed, it is necessary to realize a panning assist operation during the live view release exposure process. According to the configuration of this embodiment, the subject angular velocity information when calculating the driving amount for driving the subject so that the vibration isolation control unit 209 corrects the moving amount during exposure, and the lens angular velocity which is the predicted base point time. It can be guaranteed that there is no deviation from the detection time. An irregular case in which the subject angular velocity information and the lens angular velocity detection time, which is the predicted base point time, may deviate from each other will be described in the time chart described later.

In this embodiment, the lens angular velocity information communication transmitted from the interchangeable lens 200 to the camera body 100 and the subject angular velocity information from the camera body 100 to the interchangeable lens 200 have been described as separate communication processes, but the present invention is limited to this. It's not a thing. In this embodiment, the data format may be defined as full-duplex communication, and it may be carried out by one communication process.

By performing the above processing, the interchangeable lens 200 can set the lens angular velocity detection period that matches the motion vector detection period of the camera body 100, and can acquire the subject angular velocity information from the camera body 100. ..

Next, the reception process of the exposure start timing communication by the interchangeable lens 200 will be described with reference to FIG. FIG. 8 is a flowchart of the reception process of the exposure start timing communication by the interchangeable lens 200. FIG. 8 shows when the interchangeable lens 200 receives the exposure start timing communication from the camera body 100 in the live view shooting mode and the mounted interchangeable lens 200 is compatible with the panning assist. Indicates the processing to be performed.

First, in step S801, the lens control unit 210 determines whether or not the exposure should be subjected to the panning assist process. For example, the determination is made with reference to the area of the memory 212 to be written in step S602. When carrying out the panning assist process, the process proceeds to step S802. On the other hand, if the panning assist process is not performed, the process proceeds to step S804.

In step S802, the lens control unit 210 (calculation means) determines the subject at the current time based on the subject angular velocity information and the angular velocity detection time information stored in step S703 and the current time (exposure start timing time). Predict the angular velocity. That is, the lens control unit 210 calculates the predicted angular velocity of the subject. When the current time is T and the subject angular velocity at the current time T is V, the lens control unit 210 performs a prediction calculation as represented by the following equation (1).

In the formula (1), v is a subject angular velocity (subject angular velocity information) that the interchangeable lens 200 transmits to the camera body 100 in step S703 and is acquired by the camera body 100 in step S306. a is a subject angular acceleration (subject angular acceleration information) acquired by the camera body 100 in step S306. t is the angular velocity information acquisition time (lens angular velocity information acquisition time) acquired by the camera body 100 in step S306. However, the prediction operation is not limited to the equation (1), and other equations and methods may be used.

Subsequently, in step S803, the lens control unit 210 controls the anti-vibration control unit 209 using the subject angular velocity V at the current time, and executes the panning assist process. For example, the lens control unit 210 acquires the vibration isolation amount g (panning amount) from the angular velocity detection unit 208, and calculates the panning assist vibration isolation amount G using the following equation (2).

However, the calculation method of the panning assist vibration isolation amount G is not limited to this. By controlling the vibration isolation control lens 204 so as to cancel the panning assist vibration isolation amount during exposure, it is possible to make a moving subject still.

In step S804, the lens control unit 210 performs a vibration isolation process (vibration isolation control) using only the vibration isolation amount from the angular velocity detection unit 208, so that normal camera shake correction is performed.

By performing the above processing, the interchangeable lens 200 can transmit the panning assist result applied at the time of exposure to the camera body 100, and the camera body 100 records the panning assist result in the acquired image data. can do.

Next, with reference to FIG. 9, the reception process of the panning assist result communication by the interchangeable lens 200 will be described. FIG. 9 is a flowchart of the reception process of the panning assist result communication by the interchangeable lens 200. FIG. 9 shows a process started when the interchangeable lens 200 receives the panning assist result communication from the camera body 100 in the live view shooting mode and the mounted interchangeable lens 200 supports panning assist. Is shown.

First, in step S901, the lens control unit 210 prepares (holds) the panning assist result in the transmission buffer in order to transmit the subject angular velocity and the like predicted and calculated in step S802 to the camera body 100 as the panning assist result. Subsequently, in step S902, the lens control unit 210 determines whether or not communication is performed by the communication data length of the predetermined panning assist result communication (whether or not all data transmission / reception is completed). If the communication (transmission / reception) of all data is not completed, step S902 is repeated until the communication of the previous data is completed. On the other hand, when the communication of all data is completed, the reception process of this flow is terminated.

By performing the above processing, the interchangeable lens 200 can obtain the subject angular velocity in consideration of the elapsed time from the time when the lens angular velocity detection time is acquired to the start of exposure, and can perform more accurate panning assist. ..

Next, the panning assist process by the camera system 10 (camera body 100 and interchangeable lens 200) will be described with reference to FIG. 10 (A). FIG. 10A is a timing chart of the panning assist processing by the camera system 10. FIG. 10A shows the processing timing of the camera system 10 in the panning assist mode when the live view shooting mode and the mounted interchangeable lens 200 are compatible with the panning assist.

The image pickup synchronization signal 1001 is a synchronization signal output by the timing generation unit 104. The image pickup storage 1002 is a storage period of the image pickup device 102, and receives the image pickup synchronization signal 1001 and starts reading in order from the upper part of the screen. The synchronous signal communication 1003 is the timing of the synchronous signal communication implemented in step S208 of FIG. The lens angular velocity detection period set value communication 1004 is the timing of the lens angular velocity detection period set value communication performed in step S209 of FIG.

The lens angular velocity communication 1005 is the timing of the lens angular velocity communication carried out in step S703 of FIG. The subject angular velocity communication 1006 is the timing of the subject angular velocity communication performed in step S704 of FIG. The exposure timing communication 1007 is the timing of the exposure start communication performed in step S401 of FIG. The lens angular velocity detection period 1008 is the lens angular velocity detection period set in step S602 of FIG. When the lens angular velocity detection period is completed, the lens angular velocity corresponding to that period is calculated, and the lens angular velocity information and the acquisition time of the lens angular velocity information are associated with each other and stored.

The angular velocity output 1009 is an output from the angular velocity detection unit 208. The lens control unit 210 samples the angular velocity output 1009 during the lens angular velocity detection period 1008. The subject movement correction amount prediction 1010 during panning assist exposure calculates the drive amount of the vibration isolation control unit 209 for correcting the subject movement amount during exposure, which is carried out in step S802 of FIG. 8, by a prediction formula. The base point time in the process (that is, the lens angular velocity information acquisition time t) is shown. The panning assist correction process 1011 shows the control period of the vibration isolation control unit 209, which is carried out in step S803 of FIG.

Hereinafter, the basic sequence for realizing the panning assist processing in the live view release exposure processing will be described. For example, the synchronization signal communication 1013 is executed in response to the imaging synchronization signal 1012, and the lens control unit 210 calculates the in-lens imaging synchronization signal time that matches the imaging synchronization signal 1012. After that, the set value communication 1014 of the lens angular velocity detection period is carried out. As a result, the set value 1015 of the lens angular velocity detection period is transmitted to the interchangeable lens 200 as the start timing of the motion vector detection period 1016 of the camera body 100 and the time information corresponding to the motion vector detection period. As a result, the lens control unit 210 sets the lens angular velocity detection period 1017. At this time, the lens control unit 210 stores the time information that is the time of the center of gravity of the lens angular velocity detection period 1017 as the lens angular velocity detection time. The lens angular velocity information and the lens angular velocity detection time obtained after the lens angular velocity detection period 1017 is completed are notified to the camera body 100 by the lens angular velocity communication 1018.

When the camera body 100 receives the lens angular velocity information, the camera body 100 generates subject angular velocity information based on the motion vector information detected in the motion vector detection period 1016 and the lens angular velocity information received from the interchangeable lens 200. The subject angular velocity information generated here is notified to the camera body 100 by the subject angular velocity communication 1019. By repeating the above processing, the camera body 100 continues to transmit accurate subject angular velocity information to the interchangeable lens 200 unless a live view release exposure processing request is generated from the photographer.

Subsequently, the live view release exposure process when the photographer presses the shutter switch 116 at the timing of the live view release exposure process request 1020 will be described. 1021 shows a live view release exposure process for still image shooting. The camera body 100 executes the exposure timing communication 1023 at a timing 1022 before the predetermined time 1022 before the live view release exposure process 1021 is started. As a result, the camera body 100 transmits the start timing of the live view release exposure process for still image shooting to the interchangeable lens 200. In this embodiment, the exposure timing is notified by communication processing, but the timing notification method does not have to be communication.

Upon receiving the exposure timing communication 1007, the panning assist control unit 134 calculates the amount of movement of the subject during the live view release exposure process, that is, the amount of correction for driving the anti-vibration control unit 209 during exposure during the period 1024. The arithmetic expression used at this time is the expression (1) described with reference to step S802 of FIG. In the formula (1), the current position T corresponds to the exposure start timing time, which is the time obtained by adding the predetermined time 1022 until the exposure start to the reception time of the exposure timing communication 1007. Further, v is the lens angular velocity information obtained during the lens angular velocity detection period 1017. a is the subject angular velocity notified to the interchangeable lens 200 by the subject angular velocity communication 1019. t is the lens angular velocity information acquisition time 1025. That is, the vibration isolation control unit 209 is driven to the live view release exposure processing period 1027 so as to correct the amount of movement of the subject in the period indicated by the broken line 1026. The method of calculating the panning correction amount during the live view release exposure process described here will be described later with reference to FIG.

In order to realize the panning assist function as described above, the subject angular velocity information is generated based on the angular velocity detection information of the interchangeable lens 200 and the motion vector detection information of the camera body 100, and the subject angular velocity information is further transferred to the interchangeable lens 200. Send. As a result, when the live view release exposure processing request 1020 is generated, it is possible to calculate the amount of correction that the subject has moved by the time of exposure.

FIG. 10A shows a case where the live view release exposure processing request 1020 is generated at the timing when a series of information exchange between the camera body 100 and the interchangeable lens 200 is completed. Next, referring to FIG. 10B, as an example in which a series of information exchange between the camera body 100 and the interchangeable lens 200 is not completed, the subject angular velocity information is transmitted from the camera body 100 to the interchangeable lens 200. The case where the live view release exposure processing request is generated will be described before.

In FIG. 10B, the description of 1001 to 1018 is the same as that of 1001 to 1008 in FIG. 10A, and the lens angular velocity information and the lens angular velocity detection time are notified to the camera body 100 by the lens angular velocity communication 1018. The lens.

Based on the motion vector information detected in the motion vector detection period 1016 and the angular velocity information detected in the lens angular velocity detection period 1017, the camera body 100 transmits the subject angular velocity information to the interchangeable lens 200. In FIG. 10B, the live view release exposure processing request 1020 is generated before the communication of the subject angular velocity information. In this case, the panning assist processing at the time of the live view release exposure processing request 1020 is performed based on the information in the previous imaging synchronization signal. That is, the interchangeable lens 200 notifies the camera body 100 of the lens angular velocity information and the lens angular velocity detection time by the lens angular velocity communication 1030 based on the angular velocity information detected in the lens angular velocity detection period 1029 indicated by the broken line. The camera body 100 generates subject angular velocity information based on the motion vector information detected in the motion vector detection period 1028 shown by the broken line and the angular velocity information detected in the lens angular velocity detection period 1029 shown by the broken line. Then, the camera body 100 notifies the interchangeable lens 200 of the generated subject angular velocity information by subject angular velocity communication 1031. At this time, the lens angular velocity detection time 1032 is stored in the subject angular velocity communication 1031. Therefore, the panning assist control unit 134 does not need to store the lens angular velocity information acquisition time performed in each imaging synchronization signal processing. That is, the panning assist control unit 134 can calculate the drive amount of the vibration isolation control unit 209 in the live view release exposure process according to the equation (1) only by the information received by the subject angular velocity communication 1031.

FIG. 10A has described a case where a series of information exchange between the camera body 100 and the interchangeable lens 200 is completed within a predetermined imaging synchronization signal period. However, between the camera body 100 and the interchangeable lens 200, communication processing such as AF or AE is performed in addition to the communication for panning assist. Therefore, the communication band cannot be secured by performing communication other than panning assist, and for example, lens angular velocity communication 1018 or subject angular velocity communication 1019 cannot be performed within a predetermined imaging synchronization signal period, and the following There is a possibility that the imaging synchronization signal period will be delayed. Hereinafter, such a case will be described with reference to FIG. 10 (C).

FIG. 10C shows that the subject angular velocity communication 1033 cannot be performed during the predetermined imaging synchronization signal period and is processed in the next imaging synchronization signal period. In FIG. 10C, the live view release exposure processing request 1020 is generated before the subject angular velocity communication 1033 is processed. In this case, since the process shifts to the live view release exposure process, the subject angular velocity communication 1033 indicated by the diagonal line is not performed. Therefore, the panning assist processing according to the live view release exposure processing request 1020 is performed based on the information in the previous imaging synchronization signal. That is, the interchangeable lens 200 notifies the camera body 100 of the lens angular velocity information and the lens angular velocity detection time by the lens angular velocity communication 1030 based on the angular velocity information detected in the lens angular velocity detection period 1029 indicated by the broken line. The camera body 100 generates subject angular velocity information based on the motion vector information detected in the motion vector detection period 1028 shown by the broken line and the angular velocity information detected in the lens angular velocity detection period 1029 shown by the broken line. Then, the camera body 100 notifies the interchangeable lens 200 of the generated subject angular velocity information by subject angular velocity communication 1031. At this time, the lens angular velocity detection time 1032 is stored in the subject angular velocity communication 1031. Therefore, the panning assist control unit 134 does not need to store the lens angular velocity information acquisition time performed in each imaging synchronization signal processing. That is, the panning assist control unit 134 can calculate the drive amount of the vibration isolation control unit 209 in the live view release exposure process according to the equation (1) only by the information received by the subject angular velocity communication 1031.

In this embodiment, the lens angular velocity communication 1005 and the subject angular velocity communication 1006 are expressed as separate communications, but they may be defined in a full-duplex communication format and integrated as one communication process.

Next, with reference to FIG. 11, a method of calculating the driving amount of the vibration isolation control unit 209 at the time of exposure will be described. FIG. 11 is an explanatory diagram of a method of calculating the driving amount of the vibration isolation control unit 209 at the time of exposure. In FIG. 11, the vertical axis represents the subject angular velocity, and the horizontal axis represents the time (elapsed time).

The point 1101 is information at the time of detecting the lens angular velocity, which is a starting point for calculating the panning assist correction amount. t is the lens angular velocity detection time. v is subject angular velocity information generated based on the motion vector information of the camera body 100 executed at the same timing as the lens angular velocity detection period and the lens angular velocity detection period. The lens angular velocity detection time t is the time of the center of gravity of the lens angular velocity detection period 1017 in the case of FIG. 10 (A), and the lens angular velocity detection period 1029 in each of the cases of FIGS. 10 (B) and 10 (C). It is the time of the center of gravity of. The subject angular velocity information v is the information transmitted to the lens by the subject angular velocity communication 1019 in the case of FIG. 10 (A), and the subject angular velocity communication 1031 in each of the cases of FIGS. 10 (B) and 10 (C). This is information transmitted to the interchangeable lens 200. The subject angular velocity information at point 1101 includes the angular acceleration information a of the subject, and the subject angular velocity V at the time of the live view release exposure processing at point 1102 is converted into a linear format by using the prediction formula (formula (1)). Predict.

In this embodiment, the interchangeable lens transmits the lens angular velocity detection time together with the lens angular velocity detection information to the camera body. Then, the camera body generates subject angular velocity information based on the lens angular velocity information and motion vector information received from the interchangeable lens, and transmits the subject angular velocity information and the lens angular velocity detection time to the interchangeable lens. With such a configuration, a panning assist function that can appropriately predict the amount of movement of the subject and correct it using the anti-vibration control unit during the live view release exposure process that the photographer operates at an arbitrary timing. It will be possible to realize an interchangeable lens camera system equipped with.

Next, Example 2 of the present invention will be described. In this embodiment, the amount of movement of the subject in the live view release exposure process is corrected with higher accuracy. The basic configuration of this embodiment is the same as that of the first embodiment.

In the first embodiment, as shown in FIG. 11, the amount of movement of the subject at the exposure timing is linearly predicted by using one subject angular velocity information transmitted to the interchangeable lens 200 immediately before the live view release exposure process. .. However, in a shooting scene where panning is generally performed, the distance between the camera body 100 and the subject gradually decreases, so that the amount of movement of the subject to be corrected during exposure increases at an accelerating rate. Therefore, there is a possibility that the error of the interpolation amount becomes large in the linear interpolation as in the first embodiment. Therefore, in this embodiment, the amount of movement of the subject in the live view release exposure process is predicted by a polynomial by storing a plurality of subject angular velocity information transmitted from the camera body 100 to the interchangeable lens 200.

The panning assist process by the camera system 10 (camera body 100 and interchangeable lens 200) will be described with reference to FIG. FIG. 12 is a timing chart of the panning assist processing by the camera system 10. FIG. 12 shows the processing timing of the camera system 10 in the panning assist mode in the live view shooting mode and when the mounted interchangeable lens 200 supports the panning assist. In FIG. 12, the processes of 1001 to 1027 are the same as those of 1001 to 1027 in FIG. 10 (A) described in the first embodiment.

Unlike the first embodiment, this embodiment is a subject in two periods of a motion vector detection period 1028 (same timing as the lens angular velocity detection period 1029) and a motion vector detection period 1016 (same timing as the lens angular velocity detection period 1017). Use angular velocity information. The subject angular velocity information in the motion vector detection period 1028 is transmitted to the interchangeable lens 200 by the subject angular velocity communication 1031. The subject angular velocity information in the motion vector detection period 1016 is transmitted to the interchangeable lens 200 by the subject angular velocity communication 1019.

Next, with reference to FIG. 13, a method of calculating the driving amount of the vibration isolation control unit 209 at the time of exposure will be described. FIG. 13 is an explanatory diagram of a method of calculating the driving amount of the vibration isolation control unit 209 at the time of exposure. In FIG. 13, the vertical axis represents the subject angular velocity, and the horizontal axis represents the time (elapsed time).

In FIG. 13, the point 1201 is information transmitted to the interchangeable lens 200 by the subject angular velocity communication 1031, and information on the subject's angular velocity v1 and the subject's angular acceleration a1 at time t1 is stored. The point 1202 is information transmitted to the interchangeable lens 200 by the subject angular velocity communication 1019, and stores the information of the subject's angular velocity v2 and the subject's angular acceleration a2 at time t2.
It is possible to calculate a quadratic prediction formula based on the information of the above two points (points 1201 and 1202), and in this embodiment, the calculation is performed using the following formula (3) as the prediction formula.

Using equation (3), the angular velocity information V of the subject at the time of exposure, that is, at point 1203, is obtained. In this embodiment, the amount of movement of the subject during the live view release exposure process is calculated based on the subject velocity information of two points before the live view release exposure process, but a polynomial using three or more points is used. You may predict.

In this embodiment, the interchangeable lens transmits the lens angular velocity detection time together with the lens angular velocity detection information to the camera body. Then, the camera body generates subject angular velocity information based on the lens angular velocity information and motion vector information received from the interchangeable lens, and transmits the generated subject angular velocity information and lens angular velocity detection time to the interchangeable lens. With such a configuration, the interchangeable lens can predict the amount of movement of the subject during exposure with higher accuracy by using the plurality of subject angular velocity information and the angular velocity detection time transmitted from the camera body. For this reason, it is possible to realize an interchangeable lens camera system equipped with a panning assist function that can predict the amount of movement of the subject during exposure with higher accuracy and correct it using the vibration isolation control unit. ..

(Other Examples)
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

As described above, in each embodiment, the control device of the camera body 100 receives the calculation means (follow-up assist control unit 134) and the communication means for receiving the angular velocity and the detection time information of the angular velocity detected during the detection period of the angular velocity. (Lens communication control unit 133). The calculation means calculates the angular velocity information of the subject based on the motion vector and the angular velocity. The communication means transmits the angular velocity information of the subject in association with the detection time information of the angular velocity, and also transmits the exposure start timing.

Further, in each embodiment, the control device of the interchangeable lens 200 is a communication means (I / F220) that receives the detection period of the angular velocity set based on the detection period of the motion vector, and the angular velocity information of the subject at the time of exposure. It has a calculation means (lens control unit 210) for calculating. The communication means transmits the angular velocity detected during the angular velocity detection period and the angular velocity detection time information, and receives the angular velocity information of the subject calculated based on the motion vector and the angular velocity in association with the angular velocity detection time information. Then, the exposure start timing is received. The calculation means calculates the angular velocity information of the subject at the time of exposure based on the received angular velocity information of the subject, the detection time information of the angular velocity, and the exposure start timing. Preferably, the calculation means performs vibration isolation control based on the angular velocity information of the subject at the time of exposure. Further, preferably, the calculation means calculates the angular velocity information of the subject at the time of exposure based on the angular velocity information of the subject received immediately before the exposure start timing. Also preferably, the communication means receives the angular velocity information of the plurality of subjects acquired at different timings before receiving the exposure start timing. Then, the calculation means calculates the angular velocity information of the subject at the time of exposure by using the angular velocity information of the plurality of subjects. Further, preferably, the communication means performs the transmission of the angular velocity detected during the detection period of the angular velocity and the reception of the angular velocity information of the subject by the same communication process by full-duplex communication.

According to each embodiment, it is possible to provide a control device, an image pickup device, a lens device, a control method, a program, and a storage medium having improved panning assist performance.

Although preferable examples of the present invention have been described above, the present invention is not limited to these examples, and various modifications and modifications can be made within the scope of the gist thereof.

133 Lens communication control unit (communication means)
134 Panning assist control unit (calculation means)
141 Motion vector detection unit (motion vector detection means)

Claims (16)

An accessory device that can be attached to an imaging device
A communication means for communicating with the image pickup device and
A detection means that detects the angular velocity and
In the first mode, based on the angular velocity that was detected to control the movement of the lens, in a second mode, controls the movement of the lens based on the first information calculated based on the motion vector quantity a control means for the,
Prior Symbol second mode, said communication means transmits the second information indicating the detected angular velocity, and the third information is information indicating the timing at which the angular velocity is detected, said first It receives the information and the third information,
In the first mode, the control means is an accessory device that controls the movement of the lens regardless of the first information . The communication means transmits the second information together with the third information so that the second information and the third information are transmitted by communication at the same timing .
Claim 1 is characterized in that the communication means receives the first information together with the third information so that the first information and the third information are received by communication at the same timing. The accessory device described in. The communication means receives the fourth information indicating the detection timing of the angular velocity, and receives the fourth information.
The accessory device according to claim 1 or 2, wherein the detection means detects the angular velocity at a timing based on the fourth information. The first information, the accessory device according to any one of claims 1 to 3, characterized in that said a second information and the motion vector quantity and based have information calculated on. The communication means receives the fifth information indicating the time from the start of exposure to the start of communication by the communication executed in response to the start of exposure .
Before Symbol detection means, the accessory device according to claim 1, any one of 4, characterized by detecting the angular speed at a timing based on the reception of the fifth information. Further having a calculation means for calculating the lens control amount used for controlling the movement of the lens by the control means .
The accessory device according to any one of claims 1 to 5, wherein the calculation means calculates the lens control amount based on the first information, the third information, and the angular acceleration information. .. A control device having a communication means for communicating with a detachably attached accessory device.
Control means of said accessory device, in the first mode, based on the detected angular velocity by detecting means to control the movement of the lens in the front Symbol accessory device, in the second mode, is calculated based on the motion vector quantity and control the movement of the lens based on the first information,
Prior Symbol second mode, said communication means comprises a second information indicating the detected angular velocity by detecting means of said accessory device, and the third information is information indicating the timing at which the angular velocity is detected, receive, transmit the first information and the third information,
In the first mode, the control means is a control device that controls the movement of the lens regardless of the first information . The communication means receives the second information together with the third information so that the second information and the third information are received by communication at the same timing .
7. The communication means is characterized in that the first information is transmitted together with the third information so that the first information and the third information are transmitted by communication at the same timing. The control device described in. The communication means transmits a fourth information indicating the detection timing of the angular velocity.
The control device according to claim 7 or 8, wherein the detection means detects the angular velocity at a timing based on the fourth information. The first information, the controller according to any one of claims 7 to 9, characterized in that said second information is the motion vector quantity and based have information calculated on. The communication means transmits the fifth information indicating the time from the start of exposure to the start of communication by the communication executed in response to the start of exposure .
Before Symbol detection means, the control device according to any one of claims 7 to 10, characterized in that to detect the angular velocity at a timing based on the transmission of the fifth information. The accessory device further includes a calculation means for calculating a lens control amount used for controlling the movement of the lens by the control means .
The calculation means according to any one of claims 7 to 11, wherein the calculation means calculates the lens control amount based on the first information, the third information, and the angular acceleration information. Control device. The control device according to any one of claims 7 to 12, wherein the third information is information indicating a timing at which the angular velocity is detected. A control method for an accessory device that can be attached to an image pickup device and has a communication means that communicates with the image pickup device.
Steps to detect angular velocity and
In the first mode, based on the angular velocity that was detected to control the movement of the lens, in the second mode, acquired by the communication unit, the first information calculated based on the motion vector quantity Based on the step of controlling the movement of the lens,
In the second mode, the second information indicating the detected angular velocity, and transmits the third information corresponding angular velocity is information indicative of the detected timing, and the said first information 3 possess receiving the information, and
A control method, characterized in that, in the first mode, the movement of the lens is controlled regardless of the first information . Further has a step of calculating the lens control amount,
The control method according to claim 14, wherein the lens control amount is calculated based on the first information, the third information, and the angular acceleration information. A control method for a control device having a communication means for communicating with a detachably attached accessory device.
Control means of said accessory device, in a first mode, controls the movement of the lens based on detected by the detecting means the angular velocity of the previous SL accessory device, in the second mode, obtained from the control device, controls the movement of the lens based on the first information calculated based on the motion vector quantity,
In the second mode, the second information indicating the detected angular velocity by detecting means of said accessory device, to the angular velocity to receive the third information indicating the detected timing, the possess and transmitting said third information and the first information,
A control method, characterized in that, in the first mode, the movement of the lens is controlled regardless of the first information .