JP6917800B2 - Image processing device and its control method and program - Google Patents

Description

The present invention relates to an image processing device, a control method thereof, and a program.

In recent years, digital cameras capable of shooting high-resolution moving images represented by 4K (3840 × 2160 to 4096 × 2160) and 8K (7680 × 4320 to 8192 × 4320) are known. In addition, some such digital cameras are provided with a plurality of output terminals such as 3G-SDI, HDMI (registered trademark), DisplayPort, etc., and can output moving images shot at high resolution. However, for example, when outputting a 4K60p video using a 3G-SDI terminal, at least four terminals are required. Making it possible to output a high-resolution video leads to an increase in size and cost of a digital camera. In some cases.

Therefore, in order to suppress the increase in size and cost, the number of the latest output terminals compatible with high resolution mounted on the digital camera may be limited. In that case, since a performance difference occurs between the plurality of output terminals, the output signal is controlled according to the performance of the output terminals and the connected devices connected to the output terminals. Patent Document 1 states that a display range (resolution, etc.) of a video signal to be output can be input to each device according to whether a video output device such as a computer records by the recording device or displays by the display device. The technology to change to is disclosed.

Further, when there is a performance difference between a plurality of output terminals, it is conceivable to limit the output terminals for outputting a moving image according to the function operated in the digital camera. For example, the shooting assist function that displays a confirmation video works well at a resolution of 2K (1920 x 1080 to 2048 x 1080), so the video is output only at the SDI terminal, while the 4K video is output at one terminal. Output only at the HDMI terminal capable of 4K output. Further, for example, by limiting the simultaneous output of the moving image signal by the SDI terminal and the HDMI terminal, the processing load can be reduced and the cost of the member to be used can be reduced.

Japanese Unexamined Patent Publication No. 10-174057

By the way, when there is a functional difference between terminals and a limitation of simultaneous output of video signals between terminals, if the digital camera detects the connection of a predetermined terminal and the output destination of the video signal is switched to the terminal, the user can use it. It is possible to reduce the trouble of and improve the convenience. On the other hand, if you switch the output destination of the video signal only by using the connection as a trigger without considering the usage status of the digital camera and the terminal used, you can check the video that was done using the original output terminal. Is interrupted. For example, if another monitor is connected to the HDMI terminal while the magnifying focus function, which is one of the shooting assist functions, is being output to the monitor connected to the SDI terminal, the video of the monitor connected to the SDI terminal will be displayed. May disappear and the magnifying focus function may be interrupted. Similarly, if another monitor is connected to the HDMI terminal when checking the video being recorded on the monitor connected to the SDI terminal, the confirmation of the video being recorded will be interrupted, causing a disadvantage to the user. .. That is, in a device in which the output and functions are restricted for each terminal, it has been desired to control the moving image output in consideration of the usage state of the device while enjoying the convenience of switching the output destination by connecting to a predetermined terminal. ..

The present invention has been made in view of the above problems, and an object of the present invention is to realize a technique capable of controlling moving image output with reduced disadvantage to the user in a device in which output and functions are restricted for each terminal. That is.

In order to solve this problem, for example, the image processing apparatus of the present invention has the following configuration. That is, the acquisition means for acquiring the captured first moving image signal, the detection means for detecting that an external device is connected to the first output terminal, and the first output according to the detection by the detection means. The output is such that the first video signal output in the second format from the second output terminal whose predetermined performance is limited by that of the terminal is output from the first output terminal in the first format. A second output terminal as a control means for switching and a first video signal as a second video signal including at least one of a video signal and an index for confirming the state of the moving image frame being imaged. The control means has an assist means for outputting to, and the control means has a first when the assist means outputs a second moving image signal when the connection to the first output terminal is detected. It is characterized in that it does not switch to the output from the output terminal of.

According to the present invention, it is possible to control the moving image output while reducing the disadvantage of the user in the device in which the output and the function are restricted for each terminal.

A block diagram showing a functional configuration example of a digital camera as an example of the image processing device according to the first embodiment. A flowchart showing a series of operations related to the moving image output switching process according to the first embodiment. A flowchart showing a series of operations related to the moving image output switching process according to the second embodiment.

(Embodiment 1)
Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. In the following, as an example of the image processing device, an example of using a digital camera equipped with an image sensor and capable of outputting moving images from a plurality of output terminals will be described. However, the present embodiment is not limited to this example, and the present embodiment can be applied to any electronic device that controls the input moving image to be resized and displayed. For example, the present embodiment can be applied to a moving image recorder in which a moving image input from an external input terminal is enlarged and output to a display device and recorded on an external or built-in recording medium. Similarly, the electronic device may include a mobile phone terminal such as a personal computer, a PDA, a smartphone, a portable image viewer, a game machine, a tablet terminal, a projection device, a medical device, an in-vehicle device, and the like.

(Configuration of Digital Camera 100)
FIG. 1 is a block diagram showing a functional configuration example of a digital camera 100 as an example of the image processing device of the present embodiment. One or more of the functional blocks shown in FIG. 1 may be realized by hardware such as an ASIC or a programmable logic array (PLA), or may be realized by a programmable processor such as a CPU or MPU executing software. You may. It may also be realized by a combination of software and hardware. Therefore, in the following description, the same hardware can be realized as the main body even if different functional blocks are described as the main body of operation.

The digital camera 100 of the present embodiment includes a plurality of terminals such as an HDMI terminal and an SDI terminal, and has an assist function at the time of shooting (simply shooting assist) only on a monitor connected to a specific output terminal (for example, an SDI terminal). (Also known as) can be provided as a low-resolution video. On the other hand, it is configured to be able to output a high resolution (or high frame rate) moving image such as a captured moving image only to another specific terminal (for example, HDMI terminal). Video output to multiple terminals is exclusively controlled. For example, if the HDMI terminal is newly connected while the SDI terminal is connected, the specific functions (such as shooting assist function and recording) described below will be described below. Priority is given to output to the HDMI terminal unless is enabled.

When the assist function at the time of shooting is enabled, at least one of a moving image and an index for confirming the state of the moving image frame being shot is displayed in order to adjust the shooting conditions more accurately. The assist function according to the present embodiment includes, for example, a function for enlarging and displaying a part of a moving image (enlarged focus) for facilitating the focusing work, and an index for emphasizing the in-focus part. Includes a peaking function that is superimposed on the video. In addition, a zebra display, a Wave Form Monitor (WFM), and the like may be included to facilitate confirmation of the brightness in the image.

Further, in the following description, the case where the digital camera 100 does not have a display device such as a display panel in the main body and the captured moving image or the moving image related to the shooting assist function is performed on the monitor connected to the output terminal. explain. However, the digital camera 100 may have a display device.

The bus 101 includes a data bus, and each block of the digital camera 100 exchanges data. The lens unit 102 is composed of, for example, a fixed lens group, a variable magnification lens group, an aperture, and a correction lens group for condensing light from a subject on the image sensor 103. The lens unit 102 is controlled by the control unit 108, and a subject image is formed on the image plane of the image sensor 103. The correction lens group has a function of correcting the image formation position moved by the operation of the variable magnification lens group and a function of performing focus adjustment.

The image sensor 103 has a configuration in which a plurality of pixels having a photoelectric conversion element are arranged two-dimensionally. The image sensor 103 photoelectrically converts the subject image imaged by the lens unit 102 with each pixel, further analog-digitally converts it with an A / D conversion circuit, and outputs a digital imaging signal for each pixel. The image sensor 103 may be an image sensor such as a CCD (Charge-Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The generated imaging signal is output to the preprocessing unit 104.

The preprocessing unit 104 converts the imaging signal output from the image sensor 103 into RAW data (RAW image) and outputs it to the RAW processing unit 105.

The RAW processing unit 105 is a reduced RAW data obtained by reducing the RAW data generated by the preprocessing unit 104 by a predetermined ratio, or a cutout RAW obtained by cutting out a predetermined size from the RAW data generated by the preprocessing unit 104. Data is generated and stored in the DRAM 110. At the same time, the full angle of view RAW data for recording generated by the preprocessing unit 104 is stored in the DRAM 110 as it is. Which RAW data is used for the external output changes depending on the enabled / disabled state of the terminal output and the magnified focus. For example, in the mode of capturing a 4K moving image, when the moving image signal of the entire angle of view of 4K is output from the HDMI 120, the reduced RAW data and the cut-out RAW data are not used. On the other hand, in the mode of capturing a 4K moving image, reduced RAW data is used when outputting a moving image signal having a full angle of view from SDI118 or HDMI120 to 2K. Further, in the mode of capturing a 4K moving image, when the moving image signal with enlarged focus is output from the SDI 118, the cut-out RAW data obtained by cutting out 2K at an arbitrary position from the 4K moving image signal is used.

The image generation unit 106 performs RAW development processing such as interpolation processing and image quality adjustment processing on either of the reduced RAW data and the cutout RAW data generated by the RAW processing unit 105, and the full angle of view RAW data. The image generation unit 106 generates YUV format image data (cutout YUV data, reduced YUV data, full angle of view YUV data) corresponding to each RAW data by RAW development processing, and stores the image data in the DRAM 110.

The operation unit 107 includes, for example, a touch panel and operation members (buttons, dials, levers, etc.) for the user to input an operation on the digital camera 100. When the operation unit 107 is operated by the user, the operation unit 107 notifies the control unit 108 of the operation information. The setting of the shooting assist function, that is, the enabled state of the magnifying focus, zebra, peaking, WFM, etc. can be set independently by the input from the operation unit 107. The setting method may be a menu operation or a dedicated physical key operation.

The control unit 108 includes, for example, a CPU (MPU), expands the program recorded in the ROM 111 into the RAM 109, and executes the program to control each block of the digital camera 100 and control data transfer between the blocks. To do. Further, the control unit 108 controls each block of the digital camera 100 according to the operation information from the operation unit 107 that receives the operation from the user.

The RAM (Random Access Memory) 109 is a volatile memory in which the control unit 108 expands the program stored in the ROM 111 and uses it as a work area. The DRAM (Dynamic Random Access Memory) 110 is a volatile memory used by each block of the digital camera 100 as a work area. The DRAM 110 has an upper limit on the amount of data (read / write speed) that can be read / written (read / write) in a predetermined period, and reading / writing of data exceeding the upper limit is restricted. The DRAM 110 can be replaced with a high-speed volatile memory or non-volatile memory by a mechanism different from that of the DRAM. Further, the RAM 109 and the DRAM 110 may be configured to coexist on the same storage device.

The ROM (Read Only Memory) 111 is, for example, a non-volatile memory including a Flash ROM, and stores a program executed by the control unit 108 and the like. Alternatively, the program data stored in the recording medium 115 may be loaded into the RAM 109 and used as a ROM.

The on-screen display (OSD) unit 112 generates OSD data (display items) such as various setting menus and face frames, and stores them in the DRAM 110. The moving image compression unit 113 compresses the full angle of view YUV data generated by the image generation unit 106 stored in the DRAM 110 in, for example, MPEG format, and stores the moving image data in the DRAM 110.

The media control unit 114 records the moving image data generated by the moving image compression unit 113 and stored in the DRAM 110 on the recording medium 115 according to a format compatible with a computer such as a FAT file system.

The recording medium 115 includes a semiconductor memory such as a memory card. It may be a detachable recording medium that can be removed from the digital camera 100. In this case, data can be exchanged with and from the digital camera 100 by being attached to a PC or the like in addition to the digital camera 100.

The assist unit 116 generates assist effects for various shooting assists of zebra display, peaking display, and WFM (Wave Form Monitor) with respect to the YUV data generated by the image generation unit 106. Then, the assist unit 116 transmits the result of superimposing the generated assist effect to, for example, the SDI output unit 117 in order to output the result from the specific output terminal. In addition, the assist unit 116 transfers the moving image signal to the SDI output unit 117 as it is by disabling which shooting assist is enabled by the control unit 108 according to the state such as the menu setting of the main body or the shooting assist itself is disabled. Is controlled. For example, when the activation of the zebra display is instructed, the assist unit 116 performs image processing such as drawing a diagonal line on a moving image having a predetermined brightness value or more with respect to the YUV data, and a predetermined position on the image data is determined. Indicates whether the brightness value is equal to or higher than. When the peaking display is enabled, the assist unit 116 detects the edge of the YUV data and then superimposes a specific color on the detected edge. When WFM is enabled, the entire luminance data contained in the image data is shown by extracting the luminance values from the YUV data and plotting them on a graph.

The SDI output unit 117 synthesizes the YUV data output from the assist unit 116 and the OSD data output from the OSD unit 112, and outputs the external output signal to the SDI 118 (to output to the SDI monitor 121). It should be noted that the synthesis of OSD data is not essential, and the presence or absence of synthesis may be switched by an operation from the operation unit 107.

The SDI 118 changes the external output signal input from the SDI output unit 117 into the SDI format, and outputs the signal to the outside via the SDI terminal (not shown). Further, the control unit 108 can set data (metadata) to be superimposed on the moving image signal output from the SDI 118 via the bus 101. For example, it is possible to superimpose information on shooting that cannot be understood only by watching a moving image, such as the state of the digital camera 100 during shooting, the gamma of a moving image, and the state of a lens. In this way, it is possible to notify a display device (not shown) such as a monitor of the state of the camera body in addition to the moving image. Further, when an external recorder (not shown) that receives and records an SDI signal is connected instead of the display device, information instructing the external recorder to start / stop recording can be superimposed as metadata. .. By doing so, it is possible to control the recording start / stop of the external recorder by operating only the digital camera 100.

The HDMI output unit 119 synthesizes the YUV data and the OSD data stored in the DRAM 110 and outputs the YUV data and the OSD data to the HDMI 120 as an external output signal. It should be noted that the synthesis of OSD data is not essential, and the presence or absence of synthesis may be switched by an operation from the operation unit 107.

The HDMI 120 changes the external output signal output by the HDMI output unit 119 into the HDMI format and outputs the signal to the outside. Further, the HDMI 120 may include an HDMI terminal (not shown), and includes a connection detection unit 120a for detecting the connection of the HDMI monitor 122 connected to the HDMI terminal. Further, the HDMI 120 includes an ability information acquisition unit 120b that acquires an EDID (Extended Display Identification) for notifying information on a moving image signal that can be received by the connected HDMI monitor 122. The EDID information acquired by the capability information acquisition unit 120b is stored in the DRAM 110.

In the above example, an example in which an image for magnifying focus is generated by the RAW processing unit 105 has been described. However, the RAW processing unit 105 may enlarge or cut out an image with respect to the reduced YUV data or the full angle of view YUV data, and the assist unit 116 may generate YUV data for enlarged display. Further, the assist effect other than the enlargement focus applied by the assist unit 116 may be applied to the image before enlargement or the image after enlargement.

Further, in the above example, it has been described that the reduced RAW data and the cut-out RAW data are not used when the moving image signal of the entire angle of view of 4K is output from the HDMI 120 in the mode of recording the moving image of 4K. However, it may be controlled not to generate the reduced RAW data and the cut-out RAW data itself.

(A series of operations related to HDMI output and SDI output switching processing)
Next, with reference to FIG. 2, a series of operations related to the HDMI output and SDI output switching process will be described. This series of operations is realized by the control unit 108 expanding and executing the program stored in the ROM 111 in the work area of the RAM 109 and controlling each unit such as the assist unit 116. Further, it is assumed that the digital camera 100 does not have a display device inside, and is set to output the captured moving image from either the SDI terminal or the HDMI terminal in some format.

In S201, the control unit 108 determines whether it has detected that an external device is connected to the HDMI terminal. The control unit 108 determines whether or not an external device is connected to the HDMI terminal by referring to, for example, the detection result of the connection detection unit 120a. When the control unit 108 determines that the connection of the external device to the HDMI terminal has been detected, the control unit 108 proceeds to S206 in order to realize the processing according to the function used by the user. On the other hand, if it is determined that the connection of the external device to the HDMI terminal has not been detected, the process proceeds to S202.

In S202, the control unit 108 determines whether or not a moving image signal is being output from the HDMI 120. The control unit 108 may realize this determination by referring to, for example, a flag (HDMI output flag) stored on the DRAM 110 indicating the output state of the HDMI terminal, or the state of the HDMI output unit 119. It may be realized by checking directly. As will be described later, this step is performed when it is determined that the shooting assist function is effective (S206) or when it is determined that the set moving image signal cannot be output (S209), that is, the SDI terminal. It is also executed when controlled to output a signal from. When the control unit 108 determines that the moving image signal is being output from the HDMI 120, the process proceeds to S203, and when it is determined that the HDMI is stopping the output, the control unit 108 proceeds to S204 without performing S203.

In S203, the control unit 108 controls the HDMI output unit 119 to stop the output of the moving image signal to the HDMI 120. Then, if necessary, the flag (HDMI output flag) stored on the DRAM 110 is changed to a value indicating that the HDMI output has stopped.

In S204, the control unit 108 determines whether or not a moving image signal is output from the SDI 118. That is, since this step is executed in a state where the output from the HDMI terminal of the HDMI terminal and the SDI terminal is stopped, the control unit 108 continues the output from the SDI terminal or outputs from the SDI terminal. Determine if you want to start anew. The control unit 108 may make this determination by referring to a flag (SDI output flag) that indicates the output state of the moving image from the SDI terminal stored on the DRAM 110, or directly determines the state of the SDI output unit 117. The judgment may be made with reference to it. When the control unit 108 determines that the moving image signal is output from the SDI 118, the control unit 108 ends this series of operations while maintaining the moving image output from the SDI 118. On the other hand, if it is determined that the output is not being performed from the SDI 118, the process proceeds to S205 to start the SDI output.

In S205, the control unit 108 activates the assist unit 116 and the SDI output unit 117, and starts transmitting the moving image signal to which the set shooting assist is applied to the SDI 118. At the same time, the flag stored on the DRAM 110 indicating the output state of the SDI is changed to a value indicating that the SDI is being output. If the RAW processing unit 105 has not generated the RAW data required for external output, the RAW processing unit 105 is used to generate the RAW data, the reduced RAW data, or the cut-out RAW data. Control. If any of the shooting assist functions is not enabled, the assist unit 116 transfers the YUV data read from the DRAM 110 to the SDI output unit 117 as it is.

As described above, in S201 to S205, the control unit 108 stops the HDMI output when the HDMI 120 does not output the moving image signal, and controls the output from the output terminal so that the moving image signal is output from the SDI 118. ..

Next, the process when the HDMI connection is detected in S201 described above will be described.

In S206, the control unit 108 determines whether or not the shooting assist is enabled. When the application of any of the magnifying focus, zebra, peaking, and WFM is set by the operation unit 107, the control unit 108 determines that the shooting assist is enabled and proceeds to S202. On the other hand, when the control unit 108 determines that none of the applications is set, the control unit 108 proceeds to S207 in order to output a high resolution (and high frame rate) moving image signal from the HDMI output. For this determination, for example, the shooting assist state may be stored as a flag in the DRAM 110 according to the setting from the operation unit 107, and the control unit 108 may determine validity / invalidity with reference to the flag. That is, even when the HDMI connection is detected, the HDMI output can be disabled if the shooting assist is enabled. As a result, when the shooting assist is performed by the SDI output, the shooting assist function is not interrupted by continuing the video output of the SDI without connecting to the HDMI.

In S207, the control unit 108 controls the capability information acquisition unit 120b and reads the EDID of the connected external device. In S208, the control unit 108 analyzes the EDID stored in the DRAM 110 and detects the type of moving image signal that can be received by the connected external device.

In S209, the control unit 108 determines whether or not the moving image signal to be output from the HDMI 120 can be received by the connected external device (that is, whether or not the moving image signal to be output can be output). When the control unit 108 determines that the connected external device cannot receive the moving image signal, the control unit 108 proceeds to S202. On the other hand, when the control unit 108 determines that the connected external device can receive the moving image signal, the control unit 108 proceeds to S210. More specifically, for example, in the case of setting to output a moving image signal having a 4K resolution from the HDMI 120, if an external device that only supports reception up to the 2K resolution is connected, the process proceeds to S202. On the other hand, when the connected external device supports the reception of a moving image signal having a 4K resolution, the control unit 108 proceeds to S210 to output HDMI.

In S210, the control unit 108 determines whether or not a moving image signal is being output from the SDI 118. As described above, the output to the HDMI and SDI terminals is exclusive, and the output to the HDMI terminal, which has less performance limitation than the SDI terminal, has higher priority. Therefore, when the control unit 108 determines that the output to the HDMI terminal is possible by the processing of S206 to S209, the control unit 108 stops the SDI output and starts the HDMI output. The control unit 108 may make the above determination by referring to the flag stored on the DRAM 110, or may make the above determination by directly referring to the state of the SDI output unit 117. When the control unit 108 determines that the SDI output is in progress in order to switch to the HDMI output, the control unit 108 proceeds to S211 to stop the SDI output. On the other hand, if it is determined that the SDI output is not in progress, the process proceeds to S212.

In S211 the control unit 108 controls the assist unit 116 and the SDI output unit 117 to stop the output of the moving image signal to the SDI 118. When the output state of the moving image signal is managed by the flag (SDI output flag) on the DRAM 110, the value of the state flag is changed to a value indicating that the SDI output has stopped. The assist unit 116 may or may not be stopped.

In S212, the control unit 108 determines whether or not a moving image signal is being output from the HDMI 120. The control unit 108 may refer to the flag (HDMI output flag) stored on the DRAM 110, or may directly check the state of the HDMI output unit 119. In order to switch to HDMI output, the control unit 108 ends this series of processing when HDMI output is in progress, and proceeds to S213 when HDMI output is stopped.

In S213, the control unit 108 activates the HDMI output unit 119 and starts transmitting the moving image signal to the HDMI 120. The HDMI output unit 119 shall continue to operate until the HDMI output is stopped in S203. When the state is managed by the flag on the DRAM 110, the value of the state flag is changed to a value indicating that HDMI is output.

In the above-described embodiment, the case where there is one SDI terminal has been described as an example, but there may be a plurality of SDI terminals. When a plurality of SDI terminals are provided, each SDI terminal may be controlled independently, or the same moving image may be output to the plurality of SDI terminals. Further, instead of the SDI terminal, a terminal to which a detachable panel can be connected may be mounted.

In this embodiment, the control for switching between HDMI output and SDI output has been described, but the enabled state of various shooting assists that affect only SDI output can be switched at any timing during SDI output.

As described above, in the present embodiment, when an external device is connected to the HDMI terminal in a digital camera in which HDMI output is prioritized, when a predetermined function using SDI output (shooting assist function) is effective, HDMI is used. SDI output was continued without enabling output. By doing so, when a connection to a terminal (HDMI) capable of high-resolution moving image output with priority occurs while using a predetermined function (shooting assist function) that uses another output terminal. Even if there is, the function can be continuously used without interruption.

(Embodiment 2)
Next, the second embodiment will be described. In the first embodiment, when the external device is connected to the HDMI, if the shooting assist function is effective, the SDI output is continued without connecting the HDMI. In the second embodiment, when the moving image is output to the SDI output while recording, the SDI output is continued without connecting the HDMI. The digital camera 100 of the present embodiment is different from the first embodiment in a part of the switching process related to the above-mentioned points, but the configuration of the digital camera 100 and other processes of the switching process are the same as those of the first embodiment. .. For this reason, the same components are designated by the same reference numerals, duplicate explanations are omitted, and differences will be mainly described.

(A series of operations related to HDMI output and SDI output switching processing)
The operation related to the switching process of HDMI output and SDI output will be described with reference to FIG. As in the first embodiment, this series of operations is realized by controlling each part of the digital camera 100 by deploying and executing the program stored in the ROM 111 in the RAM 109 by the control unit 108.

The control unit 108 executes S201 to S205 in the same manner as in the first embodiment. That is, when the HDMI 120 does not output the moving image signal, the control unit 108 stops the HDMI output and controls the output from the output terminal so that the moving image signal is output from the SDI 118.

On the other hand, when it is determined in S201 that the connection at the HDMI terminal is detected, in S301, the control unit 108 determines whether or not the moving image signal is recorded on the recording medium 115. For example, whether or not the history of the operation of recording start and recording stop by the operation unit 107 is sequentially stored in the DRAM 110, and the control unit 108 records the moving image signal on the recording medium 115 based on the history of the DRAM 110. To judge. The control unit 108 proceeds to S302 when it is determined that recording is being performed, and proceeds to S307 when it is determined that recording is not being performed. The control unit 108 determines whether or not a moving image signal is recorded on the recording medium 115 based on the operating state of each unit constituting the digital camera 100 such as the moving image compression unit 113 and the media control unit 114. Is also good.

When the moving image signal is not being recorded on the recording medium 115, the control unit 108 executes the same processing as in S207 to S213 of the first embodiment. That is, the EDID is read and analyzed, and the type of moving image signal that can be received by the connected external device is detected. When the video signal to be output from the HDMI 120 can be received by the connected external device (that is, the video signal to be output can be output), the control unit 108 stops the SDI output and outputs the video signal from the HDMI terminal. Starts output and then ends a series of operations.

In the present embodiment, when the connection at the HDMI terminal is detected, the moving image signal is not output from the HDMI terminal when the moving image is recorded on the recording medium 115. At this time, the control unit 108 may display a message (warning screen or switching selection screen) indicating the limitation on the HDMI terminal output on the monitor connected via the SDI terminal or the HDMI terminal. For example, the control unit 108 superimposes OSD or metadata on the video signal output from the SDI 118 and causes the monitor connected to the SDI terminal to display a predetermined screen. After that, when the control unit 108 receives a user operation (for example, a menu operation) to switch the output of the moving image to HDMI via the operation unit 107, the video output may be switched to the HDMI terminal. In this way, the monitor display can be switched according to the user's wishes in each usage scene.

Further, when the moving image signal is not output from the HDMI terminal due to the recording of the moving image, the control unit 108 periodically monitors the connection state and the recording state (or the operation of recording) of the HDMI terminal. , The HDMI terminal output may be switched to when the recording state is completed.

Further, in the present embodiment, the number of SDI terminals is one, but there may be a plurality of SDI terminals. When a plurality of SDI terminals are provided, each SDI terminal may be controlled independently, or the same moving image may be output to the plurality of SDI terminals. Further, instead of the SDI terminal, a terminal to which a detachable panel can be connected may be mounted.

As described above, in the present embodiment, when an external device is connected to HDMI in a digital camera in which HDMI output is prioritized, if a predetermined function (recording function) using SDI output is effective, HDMI is used. SDI output was continued without enabling output. By doing so, when a connection to a terminal (HDMI) capable of outputting a high-resolution moving image with priority occurs while using a predetermined function (recording function) using another output terminal. Even if there is, the monitoring of the record can be continued without interruption.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

103 ... image sensor, 105 ... RAW processing unit, 108 ... control unit, 116 ... assist unit, 118 ... SDI, 120a ... connection detection unit

Claims (21)

An acquisition means for acquiring the first imaged moving image signal, and
A detection means for detecting that an external device is connected to the first output terminal,
The first moving image signal, which is output in a second format from a second output terminal whose predetermined performance is limited to that of the first output terminal in response to detection by the detection means, is said to be the first. A control means for switching the output from the output terminal of 1 so as to output in the first format, and
The first moving image signal is output to the second output terminal as a second moving image signal including at least one of a moving image signal and an index for confirming the state of the moving image frame being imaged. With assisting means,
When the control means outputs the second moving image signal via the assist means when the connection to the first output terminal is detected, the control means is output from the first output terminal. An image processing device characterized in that it does not switch to the output of. The image processing apparatus according to claim 1, further comprising an operating means for changing the enabled state of the assisting means. The first or second aspect of the present invention, wherein the assist means outputs the second moving image signal, which is a moving image signal obtained by enlarging a part of the moving image frame, to the second output terminal. Image processing equipment. Further, when it is determined that the external device connected to the first output terminal can correspond to the first type, the control means outputs from the first output terminal in the first type. The image processing apparatus according to any one of claims 1 to 3, wherein the output is switched as described above. The control means is characterized in that it determines whether or not the external device can support the first type based on the capability information received from the external device connected to the first output terminal. The image processing apparatus according to claim 4. The control means is characterized in that by outputting a moving image signal in which metadata is superimposed from the second output terminal, information regarding photographing is transmitted to a display device connected to the second output terminal. The image processing apparatus according to any one of claims 1 to 5. The image processing apparatus according to any one of claims 1 to 6, wherein the predetermined performance relates to a magnitude of resolution of a moving image signal that can be output from an output terminal. The image processing apparatus according to any one of claims 1 to 7, wherein the predetermined performance relates to a high frame rate of a moving image signal that can be output from an output terminal. The image processing apparatus according to any one of claims 1 to 8, wherein the acquisition means further includes an image pickup means for outputting the captured moving image signal. The image processing apparatus according to any one of claims 1 to 9, wherein the first output terminal corresponds to HDMI (registered trademark) and the second output terminal corresponds to SDI. It is a control method of an image processing apparatus having a first output terminal and a second output terminal.
An acquisition step in which the acquisition means acquires the first imaged moving image signal,
A detection step in which the detection means detects that an external device is connected to the first output terminal.
The first moving image in which the control means outputs in a second format from the second output terminal whose predetermined performance is limited to that of the first output terminal in response to detection by the detection means. A control step of switching the output so that the signal is output from the first output terminal in the first format, and
The assist means outputs the first moving image signal as a second moving image signal including at least one of a moving image signal and an index for confirming the state of the moving image frame being imaged. It has an assist process that outputs to the terminal,
In the control step, when the connection to the first output terminal is detected, if the second moving image signal is output by the assist step, the output from the first output terminal is performed. A control method for an image processing device, which is characterized in that it does not switch to. The control method for an image processing apparatus according to claim 11, further comprising an operation step for enabling the assist step. 11. How to control the image processing device. In the control step, when it is determined that the external device connected to the first output terminal can correspond to the first type, the first output terminal outputs the first type. The control method for an image processing apparatus according to any one of claims 11 to 13, wherein the output is switched as described above. The control step is characterized in that it is determined whether or not the external device can support the first type based on the capability information received from the external device connected to the first output terminal. 14. The method for controlling an image processing apparatus according to claim 14. The control step is characterized in that by outputting a moving image signal in which metadata is superimposed from the second output terminal, information regarding shooting is transmitted to a display device connected to the second output terminal. The control method of the image processing apparatus according to any one of claims 11 to 15. The control method for an image processing device according to any one of claims 11 to 16, wherein the predetermined performance relates to a magnitude of resolution of a moving image signal that can be output from an output terminal. The control method for an image processing device according to any one of claims 11 to 17, wherein the predetermined performance relates to a high frame rate of a moving image signal that can be output from an output terminal. The control method for an image processing apparatus according to any one of claims 11 to 18, wherein the acquisition step further includes an imaging step of outputting the captured moving image signal. The image processing apparatus according to any one of claims 11 to 19, wherein the first output terminal corresponds to HDMI (registered trademark) and the second output terminal corresponds to SDI. Control method. A program for causing a computer to function as each means of the image processing apparatus according to any one of claims 1 to 10.

Images