TWI450025B - A device that can simultaneous capture multi-view 3D images - Google Patents

Description

Device capable of synchronously capturing multi-view 3D images

The invention is a device capable of synchronously capturing multi-view 3D images, and the utility model can increase the functions of soft and hardware required for synchronously capturing multi-view 3D images by using a conventional shooting device, and can use a plurality of shooting devices. The ability to capture any multi-view 3D image in a simple, fast and perfect way.

The conventional multi-view 3D image is displayed by means of Parallax Barrier or Lenticular, and the multi-view image is separated at appropriate positions so that the viewer's left and right eyes can be viewed separately. To the different visual images, and finally through the synthesis of human brain stereo vision to achieve the effect of stereoscopic vision (see the Republic of China patent application number: 097135421). As shown in FIG. 1 , it is a conventional multi-view 3D image acquisition method. Generally, a plurality of (for example, five) special photographic devices 1 are used to obtain a multi-view image V _i , where i=1, 2, 3, 4, 5, i is a view number. For the average user, such special shooting devices are not easy to obtain and the price is high, so it is still not popular. Recently, a dual-lens digital camera (such as Fujitsu's FinePix Real 3D System) has appeared on the market, but it is only necessary to shoot dual-views, which cannot meet the needs of multi-view shooting. In addition, digital cameras, cameras and mobile phones, which have long been popular in the market, lack the ability to capture multi-view 3D images. In the patent of the Republic of China Patent No.: I243595, although the concept of simultaneous shooting has been mentioned, it is only limited to the application of two, and the technology of simultaneous shooting has not been discussed in depth, so that it cannot satisfy the multi-view. The need for shooting.

In view of the deficiencies of the prior art, the present invention is a device capable of simultaneously capturing multi-view 3D images, and mainly provides a method for effectively capturing multi-view 3D images for a general digital camera, a camera, and a mobile phone. It is also possible to connect most of the digital cameras, cameras and mobile phones through wired or wireless means to transmit the necessary synchronization signals and image data to achieve simultaneous shooting of multi-view 3D images.

As shown in FIG. 2, it is a schematic diagram of a conventional conventional camera system structure. The conventional camera system 5 is mainly composed of a camera (host) 10 and a wireless remote controller 21. The imaging device 10 is mainly composed of an optical lens module 11, an image sensor 12, a shutter (E & M Shutter) 13, a universal serial bus (USB) interface 14, and a wireless device. Transmission module (Wireless Module, such as blue tooth, wifi and other standard wireless transmission methods) 15, infrared transmission module (IR Module) 16, shutter button 17, operating function button 18, display screen 19, memory (such as HDD , memory card, etc. 24, and microprocessor 20 and other components. The microprocessor 20 mainly performs Auto Exposure, Auto White Balance, Flash Setting, Color Reproduction, Noise Reduction, and Edge Enhancement ( Edge Enhancement), Image Size Setting, Digital Zoom, and Image Transfer. The wireless remote controller 21 is operated by The function button 22 is composed of a wireless transmitting module (such as an infrared (IR), radio frequency (RF) transmitting module) 23 component. The optical, electrical, and mechanical action relationships between the various components are conventional techniques and will not be described here. The invention provides a method for simultaneously capturing multi-view 3D images, that is, a method for simultaneously capturing multi-view 3D images is proposed for the above-mentioned conventional shooting device. The method mainly utilizes the skill of the prior art to increase the functions of soft and hardware necessary for synchronously capturing multi-view 3D images on a conventional shooting device, and can use any of the shooting devices to achieve simple and fast shooting. The effect of multi-view 3D images. The implementation method of the present invention will be described below in the form of wireless synchronization and wired synchronization.

Embodiment 1 Wireless synchronization mode

As shown in FIG. 3, the present invention is a schematic diagram of adding soft and hardware functions for capturing multi-view 3D images in wireless synchronization. In terms of hardware functions, a set of 3D operation function button 18' and a touch panel 19' are disposed on the host 10 of the conventional camera device; and a set of the same 3D is added to the wireless remote controller 21 Operate the function button 18'. Of course, the function of the set of 3D operation function button 18' can also be completely replaced by the touch panel 19', that is, on the display screen 19, the same figure as the set of 3D operation function button 18' is displayed. (Not shown in the figure), you can directly touch the digital graphic to achieve the same effect. In terms of software functions, a set of 3D processing software programs 20' are added to the components of the microprocessor 20.

As shown in FIG. 4, it is a schematic diagram of a 3D operation function button. The set of 3D operation function button buttons 18', 21' are mainly composed of a 3D function button 50, a 2D function button 51, a unit button 52, a number button 53, The maximum allowable parallax movement button 54 and the image zoom button 55 are configured. The purpose of each button is explained below where appropriate.

As shown in FIG. 5, the present invention is a schematic diagram of a wireless simultaneous shooting multi-view 3D image system architecture. For the use of most of the same type of camera (such as five) 201, 202, 203, 204, 205, in order to shoot multi-view 3D images (such as five-view 3D images), you must first select one by the user (such as The 3D function button 50) shown in FIG. 4 is taken as the master shooting device 201, and the other camera devices are automatically defined as the slave shooting devices 202, 203, 204, 205. Therefore, the multi-view 3D image is captured by the main camera 201 and the corresponding interaction between the slave cameras 202, 203, 204, and 205, so that most of the simultaneous shooting can be achieved. The mechanism of the interaction is mainly through the wireless transmission mode 210, by which the master camera device 201 transmits a command signal M to the slave camera devices 202, 203, 204, 205; and the slave camera devices 202, 203, 204 And 205, transmitting an appropriate reply signal R according to the received command signal M. The command signal M and the reply signal R are generated by the 3D processing program 20' of the main camera 201 and the slave camera 202, 203, 204, 205.

As shown in FIG. 6, it is a schematic diagram of the 3D processing software program of the present invention. The 3D processing program 20' is mainly composed of a 3D main mode program 100 and a 3D slave mode program 100'.

The 3D main mode program 100 is mainly composed of a 3D connection program 110, an optimal 3D parallax adjustment program 120, a synchronous photography program 140, a multi-view image synthesis program 150, and an end program 160. Wherein, the optimal 3D parallax adjustment program 120 is a 3D parameter setting program 121. It is composed of a parallax adjustment program 130.

In addition, the 3D slave mode program 100' is composed of a 3D link correspondence program 110', a parallax adjustment corresponding program 130', a synchronous photography corresponding program 140', a multi-view image synthesis corresponding program 150', and a The composition of the corresponding program 160' is completed.

The relationship between the 3D main mode program 100 and the interaction with the 3D slave mode program 100' will be described below.

When the 3D function button 50 of the main photographing device 201 is pressed, the 3D processing program 20' is started and brought into the 3D main mode program 100 to perform the 3D operation. The 3D main mode program 100 first executes the 3D linking program 110 to confirm and obtain the number of the slave photographing devices 202, 203, 204, 205 and the device number. The 3D connection program 110 transmits a connection command signal M(C) by the main imaging device 201 (the device number is i=1). After receiving the connection command signal M(C), the slave imaging devices 202, 203, 204, and 205 start the 3D processing program 20' and enter the 3D slave mode program 100', and simultaneously execute the 3D link matching program 110. '. The 3D link corresponding program 110' mainly transmits a reply signal R(i), wherein i=2, 3, 4, 5 is a slave device number, and represents the slave camera devices 202, 203, 204, 205. The respective number. The main imaging device 201 can confirm the number of the imaging devices 202, 203, 204, and 205 and the imaging position based on the slave device number i, and can confirm the slave imaging devices 202, 203, 204, and 205. The number of views of the image taken (View Number). The master and slave device number i are preset by the user in the master and slave imaging devices, and the shooting positions are sequentially set according to the device number i.

After the execution of the linking program 110 is completed, the main 3D mode 100 is advanced. The execution of the optimal 3D parallax adjustment program 120 is entered. As shown in Fig. 1, when shooting multi-view 3D images, it is necessary to set each camera in an appropriate position and have an appropriate Stereo Base and Convergence Angle to achieve natural And comfortable 3D imagery. For the shooting of multi-view 3D images, how to provide a simple and correct method to obtain the best parallax between the various scenes becomes an important topic for multi-view photography.

As described in the Republic of China Patent Application No.: I243595 patent, a "allowable maximum shooting parallax" method is utilized to capture the best 3D image. The calculation of the "maximum shooting parallax" is calculated based on the size and distance of the object, the environment in which the shooting equipment and the final 3D image are viewed, and the "permissible maximum shooting parallax" is determined. The shooting device refers to the screen size on the shooting device; the final 3D image viewing environment refers to the distance between the eyes, the viewing distance, the size of the screen used to display the 3D image, and the maximum allowable viewing virtual depth. The calculation formula is as follows : Maximum allowable shooting parallax = L _e * D _vmax / (D _vmax + D _e ) * S _c / S _m (1)

Where L _e : the distance between the two eyes

D _vmax : maximum virtual depth allowed

D _e : viewing distance

S _c : digital camera screen size

S _m : Watch the screen size.

For details on the formula and formula, please refer to the patent of I243595. Here, the above L _e , D _vmax , D _e , S _c , and S _{m are} defined as 3D parameters. The present invention also adopts the calculation formula of the patent to calculate the setting "allowable maximum shooting parallax". In addition, in order to improve the convenience of operation, the optimal 3D parallax adjustment program 120 provides a 3D parameter setting program 121 and a parallax adjustment program 130, which allows the user to be simple and correct according to the "allowable maximum shooting parallax". Adjust the best 3D parallax between the scenes.

As shown in FIG. 7, the 3D parameter setting program 121 mainly provides a simple parallax setting operation interface 225, so that the user can simply input each 3D parameter. The parallax setting operation interface 225 is mainly displayed on the display screen 19 of the main imaging device 201, and displays the two-eye spacing 230, the viewing distance 240, the viewing screen size 250, the allowable maximum virtual depth 260, and the viewing number 270. And an interface that allows for the maximum shooting of the 3D parameter setting such as the parallax 280.

As shown in FIG. 8, when the user selects the interface 230 for the two-eye distance setting, the second interface 231 of the other two-eye distance input is provided. The preset interface 231 displays a preset value 232 of various distances between the two eyes. The user can select the appropriate two-eye spacing by moving the function button 18, 22 or directly touch the touch panel 19'. The preset value 232 of the distance between the two eyes is selected to achieve the purpose of setting the distance between the two eyes. In addition, a blank field 233 is also provided on the interface 231. The user can directly input the appropriate two-eye spacing through the digital button 53 (shown in FIG. 4) on the 3D operation function button 18', 21'. . Of course, the digital graphic of the digital button 53 (not shown) can be directly displayed on the screen 19, and the digital graphic can be directly touched through the touch panel 19' to achieve the distance between the two eyes. Enter the purpose of the setting.

As shown in FIG. 9, when the user selects the viewing distance setting interface 240 At the time, another secondary interface 241 for viewing distance input is provided. The preset value 242 of the viewing distance is displayed on the interface 241. The user can select the appropriate viewing distance by moving the function button 18, 22, or directly touch the touch panel 19'. The preset value 242 of the viewing distance is used for the purpose of setting the viewing distance input. In addition, a blank field 243 is also provided on the interface 241, and the user can directly input an appropriate viewing distance through the digital button 53 (shown in FIG. 4) on the 3D operation function button buttons 18', 21'. Of course, the digital graphic of the digital button 53 (not shown) can be directly displayed on the screen 19, and the digital graphic can be directly touched through the touch panel 19', and the viewing distance can also be input. The purpose of the setting.

As shown in FIG. 10, when the user selects the interface 250 for viewing the screen size setting, another interface 251 for viewing the screen size input is provided. The preset interface 251 displays a preset value 252 of various viewing screen sizes. The user can select the appropriate viewing screen size by moving the function button 18, 22 or directly touch the touch panel 19'. Select the preset value 252 of the viewing screen size to achieve the purpose of viewing the screen size input setting. In addition, a blank field 253 is also provided on the interface 251, and the user can directly input the appropriate viewing screen size through the digital button 53 (shown in FIG. 4) on the 3D operation function button 18', 21'. . Of course, the digital graphic of the digital button 53 (not shown) can be directly displayed on the screen 19, and the digital graphic can be directly touched through the touch panel 19', and the viewing screen size can also be achieved. Enter the purpose of the setting.

As shown in FIG. 11, when the user selects the interface 260 that can tolerate the maximum virtual depth setting, then another allowable maximum virtual depth input is provided. Interface 261. The preset interface 261 displays various preset values 262 for allowing the maximum virtual depth. The user can select the appropriate allowable maximum virtual depth by moving the function button 18, 22 or through the touch panel 19'. The direct touch selects the preset value 262 of the allowable maximum virtual depth to achieve the maximum allowable virtual depth input setting. In addition, a blank field 263 is also provided on the interface 261. The user can directly input the appropriate maximum allowable value through the digital button 53 (shown in FIG. 4) on the 3D operation function button 18', 21'. Virtual depth. Of course, the digital graphic of the digital button 53 (not shown) can be directly displayed on the screen 19, and the digital graphic can be directly touched through the touch panel 19', and the maximum allowable maximum can be achieved. The purpose of the virtual depth input setting.

As shown in FIG. 12, when the user selects the interface 270 of the view number setting, the sub-interface 271 for inputting another view number is provided. The preset number 272 of each view number is displayed on the interface 271. The user can select the appropriate view number by using the function button 18, 22, or directly through the touch panel 19'. Touch to select the number of view numbers 272 (if the i-th station is selected), and achieve the purpose of setting the number of view numbers. The preset number 272 of each of the view number numbers is the slave device number of the slave imaging devices 202, 203, 204, and 205 when the 3D connection program 110 is executed.

As shown in FIG. 13, when the user selects the interface 280 that can accommodate the maximum shooting parallax setting, another secondary interface 281 that can accommodate the maximum shooting parallax setting is provided. The interface 281 displays operation interfaces such as calculation adjustment 282, reading 283, and storage 284. The user can select the appropriate operation interface 282, 283, 284 by moving the function button 18, 22, or The operation interface 282, 283, 284 is directly touched through the touch panel 19'. When the read operation interface 283 is selected, the 3D parameter stored in the memory of the microprocessor 20 is read; when the storage operation interface 284 is selected, the currently set 3D parameter is stored in the The microprocessor 20 is in memory. When the computing operation interface 282 is selected, the parallax adjustment program 130 is entered.

As shown in FIG. 14, the parallax adjustment program 130 is mainly composed of an allowable maximum disparity value calculation program 285, a visual image reading program 286, and a parallax adjustment operation interface 290.

The allowable maximum disparity value calculation program 285 calculates and displays an allowable maximum disparity value according to the 3D parameter set by the user and using the formula (1). The visual image reading program 286, as shown in FIG. 6, is a main imaging device 201 that transmits a command signal obtained from the device image according to the number of view numbers (i) input by the user. M (Ii). When the slave camera i (in the 3D slave mode 100' state), after receiving the command signal M(Ii), an image reply signal R(Ii) is returned, and the image echoes the signal R(Ii), that is, This device number i and image are included. In addition, the visual image reading program 286 also displays the view number (i) for the convenience of the user.

As shown in FIG. 15, the parallax adjustment operation interface 290 is composed of a view synthesis image 291, a movable parallax comparison line 294, and a movable optical axis alignment line 297.

The visual composite image 291 is composed of the visual 1 image 292 and the visual i image 293; or the visual 1 image 292 and all the visual i images 293 are transparent and overlapped. Mode, displayed in the interface 290.

The movable parallax calibration line 294 is displayed on the interface 290 in the form of two vertical lines 295, 296 according to the allowable maximum disparity value. The distance between the two vertical lines 295, 296 is the allowable maximum disparity value. The movable parallax calibration line 294 is used to assist in setting the optimal stereo base and Convergence Angle between the main camera 201 and the slave camera i. In general, when using a multi-camera shooting device to capture multi-view 3D images, the best setting is to have all the cameras have the same stereo base and convergence angle, so that the multi-view 3D images obtained by the shooting can be equal. The effect of parallax. Therefore, the movable parallax calibration line 294 can be used to assist the user in adjusting the stereo base distance and the convergence angle between the main imaging device 201 and the slave imaging device i to correctly set the visual 1 image 292 and The parallax between the visual image 293. In addition, the movement of the movable parallax calibration line 294 can be moved through the maximum allowable parallax line movement button 54 (shown in FIG. 4) on the 3D operation function button 18', 21' to simultaneously change the two The horizontal position of the vertical lines 295, 296, or the horizontal position of the two vertical lines 295, 296 are directly moved through the touch panel 19'. Through the action of the displacement, it can be confirmed that the visual 1 image 292 and the visual i image 293, and the parallax between all corresponding points, do not exceed the allowable maximum disparity value. In this way, the most comfortable 3D image of the viewer can be provided when viewing.

The movable optical axis alignment line 297 is formed by a pair of orthogonal horizontal lines 298 and vertical lines 299 for assisting the alignment of the main imaging device 201 with respect to the relative geometric relationship from the imaging device i. That is, by using the movable optical axis calibration line 297, the optical axes of the respective imaging devices can be set in the same water. On the plane, and focus to the same point. The movement of the movable optical axis calibration line 297 can be changed by moving the function button 18, 22 to change the position where the horizontal line 298 is orthogonal to the vertical line 299, or directly move the horizontal line 298 and the vertical through the touch panel 19'. Line 299 is in direct position. In addition, the image zoom button 55 (shown in FIG. 4) on the 3D operation function button 18', 21' is centered on the horizontal line 298 and the vertical line 299, and the view synthesis image 291 is Reduce, or enlarge the process. Of course, for the movable parallax calibration line 294 and the movable optical axis calibration line 297, scaling processing of the same magnification is also required.

As shown in FIG. 6, after the above-described parallax adjustment operation, the user can press the shutter button 17 of the photographing device or the shutter button button on the wireless remote controller to take a multi-view 3D image. Therefore, the 3D main mode program 100 executed on the main photographing device 201, that is, enters the synchronous photographing program 140; and all of the 3D slave mode programs 100' executed from the photographing devices 202, 203, 204, 205, Then, the synchronous photography corresponding program 140' is entered. For the shooting of multi-view images, as mentioned above, in addition to the optimization of the parallax between the visual images, it is necessary to ensure the synchronization of the shutters of each camera for dynamic subjects; It is necessary to have the same shooting conditions for each camera to obtain images with the same brightness and color to ensure the quality of multi-view 3D images. Therefore, the main photographing device 201, in the synchronous photographing program 140, mainly transmits a synchronizing command signal M(S) to all of the photographing devices 202, 203, 204, and 205. The synchronization command signal M(S) mainly includes a shooting condition signal M(S _C ), a shutter synchronization signal M(S _S ), and an image number signal M(S _N ). The shooting condition signal can be composed of parameters such as image size, exposure setting value, white balance setting value, focal length, digital zoom, and flash setting. Therefore, after the synchronization command signal M(S) is received from the photographing devices 202, 203, 204, and 205, the photographing condition signal is set according to the photographing condition signal, and according to the shutter synchronization signal, at an appropriate time. , the shutter 13 (shown in Figure 3) is activated for the purpose of synchronous photography. In addition, the image numbering signal is used to record the order of the image capturing to facilitate subsequent processing of the multi-view image.

After the above synchronous shooting operation, as shown in FIG. 16, the user can select the multi-view image preview interface 300. Therefore, as shown in FIG. 6, the 3D main mode program 100 executed on the main photographing device 201 enters the multi-view image synthesizing program 150; and all of the slave photographing devices 202, 203, 204, and 205 The executed 3D slave mode program 100' enters the multi-view image composition corresponding program 150'.

The multi-view image synthesis program 150 is mainly composed of a multi-view image acquisition program and an image synthesis display program. The multi-view image acquisition program, as shown in FIG. 6, is used by the main camera 201 to transmit a command signal M (I _all) obtained by all the slave devices to all the slave devices 202, 203, 204, and 205. ). After all this, the command signal is received at M (I _all) from the imaging means 202,203,204,205, i.e. a self-backhaul reply to a video signal R (I _i), the image reply signal R (I _i ), that is, the device number i and the image are included. After all the view images captured by the photographing devices 202, 203, 204, and 205 are obtained, the image synthesizing program is alternately arranged in a sub-pixel (refer to the Republic of China Patent Application No.: 097135421), The visor image is synthesized to make a multi-view 3D image, and the multi-view 3D image is displayed on the interface 290.

After the above synchronous shooting operation, as shown in FIG. 17, the user can select the ending interface 301. Therefore, as shown in FIG. 6, the 3D main mode program 100 executed on the main photographing device 201, that is, enters the end program 160; and all the 3D slaves executed from the photographing devices 202, 203, 204, 205 The mode program 100' enters the end corresponding program 160'. The end program 160, as shown in FIG. 6, is used by the main photographing device 201 to transmit an end command signal M(E _all ) to all of the slave photographing devices 202, 203, 204, and 205. After receiving the command signal M(E _all ), the slave photographing devices 202, 203, 204, and 205 automatically return to the normal 2D mode after returning from the end to confirm the reply signal R(E _i ). . When the main imaging device 201 receives all of the confirmation reply signals R(E _i ), it also automatically switches back to the normal 2D mode to end the 3D mode.

Embodiment 2: Wired synchronization mode

As shown in FIG. 18, it is a schematic diagram of the present invention for adding a soft and hardware function to a multi-view 3D image by wired synchronization. The function of adding the 3D hardware in the second embodiment is substantially the same as that in the first embodiment shown in FIG. 3. The only difference is that a USB interface 14' is added, and the original USB interface 14 is used as a device. The serial bus (Device USB); and the additional USB interface 14'Host. Therefore, as shown in FIG. 19, the connection of the plurality of imaging devices can be connected in series, and the main universal serial bus (Host USB) of the main imaging device 401 is connected to the Device USB of the imaging device 402. The Host USB from the camera 402 is connected to the Device USB of the next slave device, and so on. In addition, as shown in FIG. 20, it can be connected in a manner, through a USB sharer (Hub) 410, by the Host USB of the main camera 401 and all the slave imaging devices 402, Device USB connection of 403, 404, 405.

In addition, the function of adding the 3D software in the second embodiment is substantially the same as the content of the first embodiment shown in FIG. 3. The only difference is that the second embodiment in the manner of serial connection is for the device. The 3D slave mode program 100' in the device 20 needs to add a signal transmission function, that is, the command signal M transmitted from the front end needs to be confirmed by a device number, and if it is a command for the back end slave device, It needs to be passed to the back end; the reply signal R sent from the back end is passed to the front end. Of course, in the second embodiment in series, the transmitted shutter synchronization signal M(S _S ) has a slight delay for each of the slave cameras 402, 403, 404, and 405. However, due to the high bandwidth of the USB transmission, the delay is only microseconds (ms). For the object that is not moving fast, the consistency of the position between the multiple visual images is not destroyed.

On the other hand, the resolution of the image sensor used in the current general shooting device has been as high as several million pixels or even tens of millions of pixels. In this regard, the wireless synchronous shooting method used in the first embodiment of the present invention, if the processing of the visual image transmission is performed under the aforementioned parallax adjustment and multi-view image synthesis operation, is subject to the limitation of the wireless bandwidth. And appear inefficient. Compared with the wireless synchronization mode, due to the high USB transmission bandwidth, the image of each slave camera can be transmitted to the main camera at high speed, which facilitates the operation of the above-described parallax adjustment and multi-view image synthesis. Therefore, the combination of wireless and wired can improve the efficiency of multi-view shooting.

1‧‧‧Study most of the (such as five) special photographic devices

5‧‧‧Study camera system

10‧‧‧Learning camera (host)

11‧‧‧Optical lens module

12‧‧‧Image sensor

13‧‧ ‧Shutter

14, 14'‧‧‧USB interface

15‧‧‧Wireless Transmission Module

16‧‧‧Infrared transmission module

17‧‧‧Shutter button

18‧‧‧Learning function button

18'‧‧‧A set of 3D operating function button

19‧‧‧ Display screen

19'‧‧‧ touch panel

20‧‧‧Microprocessor

20’‧‧‧A set of 3D processing software programs

21‧‧‧Wireless remote control

21'‧‧‧A set of 3D operation function button

22‧‧‧Learning function button

23‧‧‧Wireless Transmitter Module

24‧‧‧ memory

50‧‧‧3D function button

51‧‧‧2D function button

52‧‧‧unit button

53‧‧‧Digital button

54‧‧‧Maximum allowable parallax line button

55‧‧‧Image zoom button

100‧‧‧3D main mode program

100’‧‧‧3D slave mode program

110‧‧‧3D link procedure

110’‧‧‧3D Link Correspondence Procedure

120‧‧‧ an optimal 3D parallax adjustment procedure

121‧‧‧A 3D parameter setting procedure

130‧‧‧ a parallax adjustment procedure

130’‧‧‧ a parallax adjustment procedure

140‧‧‧A synchronous photography program

140'‧‧‧A synchronous photography counterpart

150‧‧‧Multiple visual image synthesis program

150'‧‧‧Multi-view image synthesis program

160‧‧‧End procedure

160’‧‧‧ End of the corresponding procedure

200‧‧‧ Most of the same type of camera

201‧‧‧Main camera

202, 203, 204, 205‧‧‧ from the camera

210‧‧‧ Ways of wireless transmission

225‧‧‧Simple parallax setting operation interface

230‧‧‧ Interface for setting the distance between two eyes

231‧‧‧Second interface for two-eye spacing input

232‧‧‧Preset values for various distances between the two eyes

233‧‧‧ blank column

240‧‧‧ viewing distance parameter setting interface

241‧‧‧ viewing distance input interface

242‧‧‧Preset values for various viewing distances

243‧‧‧ blank column

250‧‧‧View screen for setting screen size parameters

251‧‧‧View screen size input interface

252‧‧‧Preview the preset value of the screen size

253‧‧‧ blank column

260‧‧‧ Interface that allows maximum virtual depth parameter setting

261‧‧‧Internable interface for maximum virtual depth input

262‧‧‧Preset values for the maximum allowable virtual depth

263‧‧‧ blank column

270‧‧‧ Vision number parameter setting interface

271‧‧‧View interface number input interface

272‧‧‧ Preset numbers for each number of views

280‧‧‧Interface that allows maximum shooting parallax parameter setting

281‧‧‧Internable interface for maximum shooting parallax setting

282‧‧‧ Calculation and adjustment of the operation interface

283‧‧‧Read the operation interface that allows the maximum shooting disparity value

284‧‧‧Storage operation interface for allowing maximum shooting disparity

285‧‧‧ Maximum allowable disparity calculation procedure

286‧‧·Vision image reading program

290‧‧‧ Parallax adjustment operation interface

291‧‧ Vision composite image

292‧‧‧Sight 1 image

293‧‧‧ Vision i images

294‧‧‧ movable parallax calibration line

295, 296‧‧ vertical lines

297‧‧‧Removable optical axis calibration straight line

298‧‧‧ horizontal line

299‧‧‧ vertical line

300‧‧‧Multi-view image preview interface

400‧‧‧ Most of the cameras

401‧‧‧Main camera

402, 403, 404, 405‧‧‧ from the camera

410‧‧‧USB Sharer (Hub)

V _i ‧‧‧Multi-view image

i‧‧‧Device number, view number

M‧‧‧ Command Signal

R‧‧‧ reply signal

M(C)‧‧‧A link command signal

M (Ii) ‧ ‧ individual command signals obtained from device images

R(i)‧‧‧ replies

M(S)‧‧‧ Synchronous command signal

M(S _C )‧‧‧Photographic conditions signal

M(S _S )‧‧‧Shutter sync signal

M(S _N )‧‧‧ image number signal

M(I _all )‧‧‧All command signals obtained from the device image

M (E _all ) ‧ ‧ end of the command signal

R(E _i )‧‧‧ End confirmation reply signal

Stereo Base‧‧‧ Stereo Base

Convergence Angle‧‧‧ Convergence angle

L _e ‧‧‧ spacing between eyes

D _vmax ‧‧‧ allows maximum virtual depth

D _e ‧‧‧ viewing distance

S _c ‧‧‧ digital camera screen size

S _m ‧‧‧view screen size

FIG. 1 is a schematic diagram of a conventional multi-view 3D image acquisition method.

2 is a schematic view showing the structure of a conventional conventional camera system.

FIG. 3 is a schematic diagram showing the function of adding soft and hardware functions for capturing multi-view 3D images by wireless synchronization according to the first embodiment of the present invention.

Figure 4 is a schematic diagram of a 3D operation function button.

FIG. 5 is a schematic diagram of the architecture of the multi-view 3D image system capable of wirelessly simulating the present invention.

Figure 6 is a schematic diagram of a 3D processing software program of the present invention.

Figure 7 is a schematic diagram of a simple parallax setting operation interface.

Figure 8 is a schematic diagram showing the input of the secondary interface by a distance between two eyes.

As shown in FIG. 9, it is a schematic diagram of a viewing distance input sub-interface.

As shown in FIG. 10, it is a schematic diagram of an input screen size input sub-interface.

As shown in FIG. 11, it is a schematic diagram of a maximum virtual depth input sub-interface.

As shown in FIG. 12, it is a schematic diagram of inputting a secondary interface into a view number.

As shown in FIG. 13, it is a schematic diagram of a sub-interface that can accommodate the maximum shooting parallax setting.

Fig. 14 is a schematic diagram showing the configuration of a parallax adjustment program.

Figure 15 is a schematic diagram of a parallax adjustment operation interface.

FIG. 16 is a schematic diagram of a multi-view image preview interface.

Figure 17 is a schematic diagram of the end interface.

FIG. 18 is a schematic diagram showing the addition of hardware and software functions required for capturing multi-view 3D images by wire synchronization according to the second embodiment of the present invention.

Figure 19 is a schematic diagram of Embodiment 2 of the present invention which can be connected in series Figure.

FIG. 20 is a schematic diagram of Embodiment 2 of the present invention which can be connected in parallel.

10‧‧‧Learning camera (host)

11‧‧‧Optical lens module

12‧‧‧Image sensor

13‧‧ ‧Shutter

14, 14'‧‧‧USB interface

15‧‧‧Wireless Transmission Module

16‧‧‧Infrared transmission module

17‧‧‧Shutter button

18‧‧‧Learning function button

18'‧‧‧A set of 3D operating function button

19‧‧‧ Display screen

19'‧‧‧ touch panel

20‧‧‧Microprocessor

20’‧‧‧A set of 3D processing software programs

21‧‧‧Wireless remote control

21'‧‧‧A set of 3D operation function button

22‧‧‧Learning function button

23‧‧‧Wireless Transmitter Module

24‧‧‧ memory

Claims (24)

A device capable of simultaneously capturing multi-view 3D images, which is a multi-camera shooting device that adds the following components: a set of 3D operation function buttons, which are composed of a plurality of buttons, and are used for shooting multi-view 3D images. Fast and convenient 3D operation; a touch panel that fits on the screen of the camera for multi-view 3D image capture, providing fast and convenient 3D operation; and a 3D processing software program Within the microprocessor of the camera, it can provide a fast and convenient 3D operation for shooting of any number of multiple view images; the 3D processing software program is mainly composed of the following processing programs: a 3D main mode The program is mainly used by the main shooting device to wirelessly transmit a command signal from the shooting device to synchronously capture the multi-view 3D image; the 3D main mode program is operated through the 3D function button. In order to start the execution of the following processing program: a 3D connection program is transmitted by the main shooting device to all the slave shooting devices by wireless means. No. to link and activate all the state of the multi-view shooting from the camera; an optimal 3D parallax adjustment program is a program for parallax adjustment between multiple view 3D images, which provides a simple parallax adjustment method. Set the optimal parallax between the scenes; a synchronous shooting program, by the main shooting device, wirelessly transmits a synchronous command signal to all the shooting devices, so that the main shooting device and all the secondary shooting devices can Simultaneously capture multi-view images; A multi-view image synthesizing program is a main shooting device that wirelessly transmits a command signal obtained by transmitting an image from the photographing device to obtain a view image of all the photographing devices and to perform multi-view 3D. The synthesis of the image; and an end program is performed by the main shooting device to wirelessly transmit an end command signal from the photographing device and end the operation of the main photographing device 3D; a 3D slave mode program, mainly After receiving the command signal from the camera through the wireless device, a response signal is transmitted to the main camera to achieve simultaneous shooting of the multi-view 3D image. The apparatus for simultaneously capturing a multi-view 3D image according to the first aspect of the patent application, wherein the number of the plurality of camera units may be two or more, and may be One of the imaging devices is set as the primary imaging device, and the other imaging devices are set as the secondary imaging devices. The apparatus for simultaneously capturing multi-view 3D images according to the first aspect of the patent application, wherein the plurality of camera devices are optical lens modules, image sensors, shutters, USB interfaces, wireless transmission modules, An imaging device consisting of an infrared transmission module, a shutter button, an operation button, a display screen, a memory, a microprocessor, and a remote controller. The device for synchronously capturing multi-view 3D images according to the first aspect of the patent application, wherein the set of 3D operation function keys is mainly composed of the following buttons: a 3D function button provides a multi-view 3D image. Shooting start operation, can start and execute 3D processing software in a main camera A 2D function button provides a multi-view 3D image capture termination operation, which can terminate the 3D processing program in the main camera and automatically switch back to the 2D image capture operation; a unit button provides a The operation of selecting the length unit; a set of numeric buttons, which are buttons composed of numbers and decimal points, providing numerical input operations; a maximum allowable disparity line moving button, which is a horizontally moving button to provide a maximum allowable disparity line for movement The operation of the horizontal position; and an image zoom button is an image zoom button to provide operations for reducing and enlarging the multi-view image. The device for synchronously capturing multi-view 3D images according to the first aspect of the patent application, wherein the set of 3D operation function buttons can be composed of mechanical buttons, and can be installed on the host of the photographing device and the remote controller. on. In addition, the set of 3D operation function buttons may also be formed by a graphic button, that is, a graphic such as the set of 3D operation function keys is displayed on the display screen, and the graphic panel can directly touch the graphic through the touch panel. The same effect. The apparatus for simultaneously capturing multi-view 3D images according to the first aspect of the patent application, wherein the optimal 3D parallax adjustment program is mainly composed of the following processing programs: a 3D parameter setting program, mainly providing an input The operation interface is used to input necessary 3D parameters; and a parallax adjustment program mainly adjusts the parallax between the multi-view 3D images according to a disparity value. The apparatus for simultaneously capturing multi-view 3D images according to item 6 of the patent application scope, wherein the 3D parameter mainly refers to the distance between the two eyes L _e , the viewing distance D _e , the viewing screen size S _m , and the screen size of the shooting device. S _c , the maximum allowable virtual depth D _vmax , and the device number i; the 3D parameters can be input through an operation interface or using preset values provided by the operation interface. The apparatus for simultaneously capturing multi-view 3D images according to claim 6 of the patent application scope, wherein the parallax adjustment program is mainly composed of the following processing program: an allowable maximum disparity value calculation program according to the 3D a parameter to calculate an allowable maximum shooting disparity value; a visual image reading program is performed by the main shooting device to wirelessly transmit a different device image from the camera with the device number i The obtained command signal; and a parallax adjustment operation interface program are an adjustment operation interface to facilitate optical axis alignment and parallax adjustment for each camera. A device capable of simultaneously capturing multi-view 3D images as described in claim 8 wherein the maximum allowable disparity value is calculated according to the following formula: maximum allowable parallax = L _e * D _vmax / (D _vmax +D _e )* S _c /S _m . The apparatus for synchronously capturing multi-view 3D images according to claim 8 of the patent application, wherein the parallax adjustment operation interface program is mainly composed of the following interface program: a visual composite image interface, and a main camera The captured visual image and the visual image taken from the camera with the device number i For example, a synthesis and display processing; a movable parallax calibration line interface is formed by two movable vertical lines, and the two vertical lines are displayed on the visual composite image, the two vertical The distance between the lines can be regarded as a disparity value, which can be used to adjust the disparity of each camera; and a movable optical axis calibration linear interface is composed of a movable horizontal line and a vertical line, and the horizontal line is formed. And the vertical line is displayed on the visual composite image, so that the optical axis alignment adjustment can be performed on each shooting device. The apparatus for simultaneously capturing a multi-view 3D image as described in claim 10, wherein the view synthesis image interface is capable of making a view image of the main camera and a view image from the camera Translucent and overlapping image processing. The apparatus for simultaneously capturing multi-view 3D images according to claim 10, wherein the distance between the two vertical lines in the movable parallax calibration line interface is the allowable maximum shooting parallax value. The apparatus for simultaneously capturing a multi-view 3D image according to claim 10, wherein the movable parallax calibration line interface is configured to move the button through the parallax line or through the touch panel while changing the movement Two vertical horizontal positions. The apparatus for simultaneously capturing multi-view 3D images according to claim 10, wherein the movable optical axis aligns the linear interface, and can be changed by a conventional operation function button or through a touch panel. The horizontal line is perpendicular to the vertical line. Simultaneous shooting of multi-view 3D as described in item 4 of the patent application scope The image capturing device, wherein the image zooming button is configured to align the movable optical axis with a straight line at a position orthogonal to the horizontal line and the vertical line, and simultaneously synthesize the image, the movable parallax calibration line, and The movable optical axis aligns the straight line and performs image processing for reduction or enlargement. The device for simultaneously capturing a multi-view 3D image according to the seventh aspect of the patent application, wherein the operation interface of the 3D parameter is operable to input the 3D parameter through the operation of the unit button and the digital button. The apparatus for simultaneously capturing multi-view 3D images according to the first aspect of the patent application, wherein the synchronous command signal is mainly composed of a lower command signal: a photographing condition signal mainly by photographing by the main photographing device Setting a signal composed of parameters; a shutter synchronization signal is a shutter signal of the main camera; and an image number signal is a number signal for recording the sequence of the multi-view image to facilitate multi-view Subsequent processing of images. The device capable of synchronously capturing multi-view 3D images according to claim 17 of the patent application, wherein the photographing setting parameter refers to an image size, an exposure setting value, a white balance setting value, a focal length, a digital zoom, a flash setting, and a color weight. Photographic parameters such as noise removal, edge enhancement, and edge enhancement. The device for synchronously capturing multi-view 3D images according to the first aspect of the patent application, wherein the 3D slave mode program is mainly composed of a command signal: a 3D link corresponding program corresponding to the main camera device Transmitting the link command signal to enable the slave camera to activate the 3D slave mode program after receiving the link command signal, and to the master camera Transmitting a reply signal including the slave device number; a parallax adjustment corresponding program corresponding to the command signal obtained by the individual slave device images transmitted by the master camera, and causing the slave camera to receive the individual slave device image After the command signal is obtained, the main camera emits a reply signal including the slave device number and the image captured by the slave device; and a synchronous photography corresponding program corresponding to the camera transmitted by the master camera The condition signal, the shutter synchronization signal, and the image number signal enable the slave camera to set the same camera setting parameter as the master camera after receiving the camera condition signal; and receive the shutter synchronization signal After the shutter image is taken, and after receiving the image number signal, the image obtained by the photograph is recorded by the same number; a multi-view image synthesis corresponding program corresponds to the main camera All command signals obtained from the device image, so that all the slave cameras receive all of the slaves After the command signal obtained by the image is received, a response signal including the slave device number and the image captured by the slave device is separately transmitted to the main camera; and an end corresponding program is transmitted corresponding to the main camera The end command signal is such that after receiving the end command signal, all the slave imaging devices individually transmit an end confirmation reply signal to the main camera and automatically end the 3D operation. A device capable of simultaneously capturing multi-view 3D images, which is used for most of the shooting devices, and the adding device has the following components: A USB connection terminal can be set as the USB connection terminal of Host or Device; a set of 3D operation function keys, which are composed of a plurality of keys, are used for shooting multi-view 3D images, providing fast and convenient 3D operation; A touch panel is attached to the screen of the camera for multi-view 3D image capture, providing fast and convenient 3D operation; and a 3D processing software program, which is installed in the camera microprocessor The system can provide a fast and convenient 3D operation for shooting of any number of multiple visual images. The 3D processing software program is mainly composed of the following processing programs: a 3D main mode program, mainly by the main shooting The device transmits a command signal from the photographing device in a wireless manner to achieve the effect of simultaneously capturing the multi-view 3D image; the 3D main mode program starts the execution of the following processing program through the operation of the 3D function button It consists of a 3D connection program, which is a wireless transmission method that transmits a link command signal to all the slave cameras to link and activate all the slave shots. The device enters the state of multi-view shooting; an optimal 3D parallax adjustment program is a program for parallax adjustment between multiple visual 3D images, which can provide a simple parallax adjustment method to set the optimal parallax between the visual views. a synchronous photography program, in which the main shooting device transmits a synchronous command signal to all the shooting devices by wireless means, so that the main shooting device and all the slave shooting devices can simultaneously capture the multi-view images; A multi-view image synthesizing program is a main shooting device that wirelessly transmits a command signal obtained by transmitting an image from the photographing device to obtain a view image of all the photographing devices and to perform multi-view 3D. The synthesis of the image; and an end program is performed by the main shooting device to wirelessly transmit an end command signal from the photographing device and end the operation of the main photographing device 3D; a 3D slave mode program, mainly After receiving the command signal from the camera through the wireless device, a response signal is transmitted to the main camera to achieve simultaneous shooting of the multi-view 3D image. The apparatus for simultaneously capturing multi-view 3D images according to claim 20, wherein the number of the plurality of camera units may be two or more, and may be One of the imaging devices is set as the primary imaging device, and the other imaging devices are set as the secondary imaging devices. The device for simultaneously capturing multi-view 3D images according to claim 20, wherein the plurality of cameras refers to an optical lens module, an image sensor, a shutter, a USB interface, an infrared transmission module, Shutter button, operation button, display screen, memory, microprocessor, and remote control components. The device for simultaneously capturing multi-view 3D images according to claim 20, wherein the connection of the plurality of cameras is connected by means of parallel connection, that is, the host USB and all slaves of the main camera are connected. Device USB connection of the camera. One of the applications described in item 20 of the patent application can simultaneously shoot multiple scenes The device of the 3D image, wherein the connection of the plurality of camera devices is connected by serial connection, that is, the Host USB of the main camera device is connected with any Device USB from the camera device, and the other two adjacent devices are connected. The connection between the cameras is connected by one of the Host USBs of the camera and the other Device USB of the camera.