JP2013182219A - Panoramic imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a panoramic imaging apparatus capable of geometrically converting a panoramic landscape to a desired format, while realizing miniaturization and power-saving properties.SOLUTION: The panoramic imaging apparatus includes a panoramic information acquisition unit 2 acquiring the panoramic landscape and making the panoramic landscape incident on a geometric conversion processing unit 3. The geometric conversion processing unit 3 includes a liquid crystal lens layer 23 into which liquid crystal molecules 35 are encapsulated between a first substrate 21 and a second substrate 22, orientation-controls the liquid crystal molecules 35 by voltage which is an external stimulus applied to the liquid crystal lens layer 23, to geometrically convert the panoramic landscape by the orientation change of the liquid crystal molecules 35. Thus, a storage space for installing a mechanical movable mechanism moving a lens, a moving space for moving the lens, and further a large-scale mechanical mechanism for moving the mechanical movable mechanism, which are required in a conventional method are not required so that the miniaturization and power-saving properties are improved by the factors and the panoramic landscape can be geometrically converted to the desired format.

Description

  The present invention relates to a panoramic imaging apparatus, and is suitable for application to, for example, imaging a wide range of visual field scenery (hereinafter referred to as panoramic scenery).

  In recent years, imaging devices such as digital cameras and video cameras installed for crime prevention can capture a wide range of panoramic views around 360 ° as panoramic images so that the entire range of the space to be monitored can be seen at a glance. A panoramic imaging device is known (see, for example, Patent Document 1). In this type of panoramic imaging apparatus, it is required to obtain a panoramic image that allows not only the surrounding environment to be observed over a wide range with a minimum amount of information but also a detailed observation of only a predetermined area.

  By the way, in recent years, it is possible to observe a wide field of view without increasing the amount of information of an image, and a wide angle that enables detailed observation at a clear high-resolution central portion (hereinafter referred to as an attention area) within the angle of view. A lens (hereinafter referred to as a wide-angle foveal lens) is also considered (see, for example, Patent Document 2).

  Therefore, a panoramic imaging apparatus in which a wide-angle foveal lens is attached to the above-described panoramic imaging apparatus is also conceivable. In such a panoramic imaging device, the wide-angle foveal lens can observe a wide field of view without increasing the amount of information of the panoramic image, and can also perform detailed observation of the attention area within the angle of view. Become.

Japanese translation of PCT publication No. 2002-515984 Special table 2010-530086

  However, since the panoramic imaging device using the wide-angle foveal lens having such a configuration has a high-resolution attention area only in the central portion within the angle of view, the panoramic imaging device is fixed within the angle of view. When you want to observe in detail the existing subject image (hereinafter also referred to as the attention image), move the lens optical axis (also referred to as the line of sight) with a large movable mechanism such as a motor, and focus on the attention area of the wide-angle foveal lens. It is necessary to match the image of interest you want.

  Therefore, a panoramic imaging device using such a wide-angle foveal lens requires a storage space for installing a mechanical movable mechanism for moving the wide-angle foveal lens and a movement space for moving the wide-angle foveal lens itself. Therefore, there is a problem that it is difficult to improve the size reduction accordingly. In addition, this panoramic imaging apparatus also requires a large mechanical mechanism for moving a mechanical movable mechanism, so that there is a problem that it is difficult to improve the energy saving.

  Therefore, the present invention has been made in consideration of the above points, and an object thereof is to propose a panoramic imaging apparatus capable of geometrically transforming a panoramic landscape into a desired form while achieving downsizing and energy saving.

  In order to solve such a problem, claim 1 of the present invention includes a panorama information acquisition unit that acquires a panoramic landscape and makes it incident on a geometric conversion processing unit, and the geometric conversion processing unit includes a refractive index changing unit enclosed therein. A refractive index changing layer is provided between the first substrate and the second substrate, the orientation of the refractive index changing means is controlled by an external stimulus applied to the refractive index changing layer, and the orientation changing of the refractive index changing means is performed. The panoramic landscape is geometrically transformed.

  According to the present invention, a conventional storage space for installing a mechanical movable mechanism for moving a lens, a movement space for moving the lens itself, and a large mechanical mechanism for moving the mechanical movable mechanism. Therefore, it is possible to propose a panoramic imaging apparatus capable of reducing the size and energy saving as compared with the conventional technique and geometrically converting a panoramic landscape into a desired form.

It is the schematic which shows the whole structure of a panoramic imaging device. It is the photograph which showed the panorama projection image which improved the resolution by partial expansion processing. FIG. 3 is a photograph showing a panoramic developed image obtained by developing the panoramic projection image shown in FIG. 2 and correcting distortion. It is a photograph which shows the panorama projection image after a rotation process. FIG. 5 is a photograph showing a panoramic developed image obtained by developing the panoramic projection image shown in FIG. 4 and correcting distortion. It is the schematic where it uses for description of arrangement | positioning relationship between each structure in a geometric transformation process part, a 3rd reflective mirror, and an image pick-up element. It is the schematic which shows the whole structure of a geometric transformation process part. It is the schematic which shows the side cross-section structure of the liquid crystal lens for geometric conversion lenses. It is the schematic which shows the whole structure of an ITO electrode layer. It is the schematic which shows the orientation state of the liquid crystal molecule at the time of an expansion process, and the orientation state of the liquid crystal molecule at the time of a rotation process. It is the schematic which shows the whole structure of an electrode cell. It is the schematic which shows the side cross-section structure of the micro liquid crystal lens cell by other embodiment. It is the upper side figure and side sectional view which show the orientation state of the liquid crystal molecule in the micro liquid crystal lens cell in an initial state. It is a sectional side view which shows the orientation state of the liquid crystal molecule in the micro liquid crystal lens cell at the time of an expansion process. It is a top view which shows the orientation state of the liquid crystal molecule in the micro liquid crystal lens cell at the time of a rotation process. It is the schematic which shows the whole panorama imaging device structure by other embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(1) Overview of Panorama Imaging Device In FIG. 1, reference numeral 1 denotes a panorama imaging device. The panorama imaging device 1 includes a panorama information acquisition unit 2, a geometric conversion processing unit 3, an imaging unit 4, and an image processing unit. 5 and a display unit 6, and the geometric transformation processing unit 3, the imaging unit 4, and the image processing unit 5 are connected to the control unit 7. Here, the panorama information acquisition unit 2 enters a projected panoramic image in which a 360 ° field of view around the panorama imaging device 1 (hereinafter also referred to as a panoramic landscape) is reflected in an annular shape into the geometric conversion processing unit 3. Has been made to get.

  In practice, the panorama information acquisition unit 2 includes a mortar-shaped (truncated cone-shaped) first reflecting mirror 10 having an open bottom, and a mortar that is disposed below the first reflecting mirror 10 and also has an open bottom. A second reflecting mirror 11 having a shape and a third reflecting mirror 12 having a disk shape disposed above the second reflecting mirror 11, and includes a first reflecting mirror 10, a second reflecting mirror 11, and a third reflecting mirror 12. These center axes are made to coincide with each other, and these center axes are arranged along the vertical direction. Further, the panorama information acquisition unit 2 reflects the panoramic landscape in the lateral direction of the first reflecting mirror 10 toward the second reflecting mirror 11 below by the first reflecting mirror 10, and then the panorama information is acquired by the second reflecting mirror 11. The landscape can be reflected toward the upper third reflection mirror 12, and finally the panoramic landscape can be incident on the geometric conversion processing unit 3 by the third reflection mirror 12.

  Here, the first reflection mirror 10 has a configuration in which a mirror is disposed on the outer surface, and reflects the panoramic scenery reflected on the outer surface toward the inner surface of the second reflection mirror 11 below. The inclination angle of the outer surface is adjusted. The second reflecting mirror 11 has a configuration in which a mirror is arranged on the inner side surface, and reflects the panoramic landscape reflected on the inner side surface toward the lower surface of the third reflecting mirror 12 arranged in the upper central region. Thus, the inclination angle of the inner surface is adjusted. The third reflecting mirror 12 has a configuration in which a mirror is arranged on a flat bottom surface, and reflects a panoramic landscape reflected on the bottom surface toward the geometric conversion processing unit 3 below through the diaphragm unit 13. It is made to let you.

  Here, the control unit 7 connected to the geometric transformation processing unit 3 has a microcomputer configuration, and mainly includes a CPU (Central Processing Unit), a memory, a ROM (Read Only Memory), etc., and is stored in the ROM. Various functions are realized by reading the program to be executed and executing the program by the CPU. Incidentally, the control unit 7 includes a cursor as an enlargement region, a reduction region, or the like, in addition to various buttons including an enlargement command button, a reduction command button, a rotation command button, and the like. An operation unit (not shown) provided with a mouse or the like that can be designated with is connected. The control unit 7 can control various circuit units and implement various operations in response to user input operations performed on operation units such as various buttons and a mouse.

  For example, when the control unit 7 receives an enlargement command command, a reduction command command, or a rotation command command given by the user performing an input operation on the operation unit from the operation unit, the control command 7 A command signal and a rotation command signal are generated and sent to the geometric transformation processing unit 3. Here, the geometric transformation processing unit 3 transmits the light beam incident from the panorama information acquisition unit 2 to the imaging unit 4 through an input side lens group, a condenser lens, and an output side lens group, which will be described later. This can be imaged on the imaging device 15 of the imaging unit 4.

  At this time, when the geometric transformation processing unit 3 receives an enlargement command signal, a reduction command signal, or a rotation command signal from the control unit 7, liquid crystal molecules in a liquid crystal lens layer (described later) provided therein are The alignment state can be changed according to the enlargement command signal, the reduction command signal, or the rotation command signal, and the refractive index of the liquid crystal lens layer can be changed. As a result, the geometric conversion processing unit 3 refracts the luminous flux indicating the panoramic landscape by the liquid crystal molecules, enlarges or reduces one or a plurality of locations, or rotates the entire luminous flux to enlarge, reduce, or rotate the panoramic landscape. An image can be formed on the image sensor 15 of the imaging unit 4. In the case of this embodiment, the imaging unit 4 is configured such that the imaging element 15 is horizontally arranged so that a light beam can be incident from the vertical direction from the geometric conversion processing unit 3 disposed above. Yes.

  The imaging unit 4 can expose a panoramic landscape imaged on the imaging device 15 (charge accumulation by photoelectric conversion), generate an image signal related to the panoramic landscape, and send the image signal to the image processing unit 5. Here, when the image processing unit 5 receives, for example, an image signal partially enlarged by the geometric conversion processing unit 3 from the imaging unit 4, the image processing unit 5 performs correction processing, and the geometric conversion processing unit 3 in the panoramic landscape. The portion subjected to enlargement processing is reduced and corrected to the original magnification, and this is sent to the display unit 6 as a corrected image signal. As a result, as shown in FIG. 2, the display unit 6 has a panoramic image (hereinafter referred to as a panoramic projection image) I1 in which the overall magnification is uniform and a 360 ° panoramic landscape is displayed in an annular shape. Can be displayed. At this time, in the panorama projection image I1 displayed on the display unit 6, the attention area AR1 optically enlarged once by the geometric conversion processing unit 3 has improved resolution, and only that portion is more detailed. The resulting panorama projection image I1 can be presented to the user.

  Further, when an image expansion command input from the operation unit is given via the control unit 7, the image processing unit 5 performs an image expansion process on the corrected image signal to generate a developed image signal, which is displayed on the display unit. 6 to send. Thereby, the panorama projection image I1 is separated by the predetermined separation line B1 on the display unit 6 based on the developed image signal, and the panorama projection image I1 is developed into a rectangular shape as shown in FIG. A panoramic image (hereinafter referred to as a panoramic developed image) I2 obtained by correcting a 360 ° panoramic landscape so that there is no distortion from one end to the other end can be displayed.

  In practice, when the panorama imaging apparatus 1 generates a panorama projection image I 1 as shown in FIG. 2, first, the panorama landscape obtained by the panorama information acquisition unit 2 is connected to the image sensor 15 of the imaging unit 4. The image signal is generated to generate an image signal, which is sent to the display unit 6 as it is without being corrected by the image processing unit 5. Accordingly, a panorama projection image that has not been enlarged, reduced, or rotated can be displayed on the display unit 6 based on the image signal.

  When the user wants to increase the resolution in the panorama projection image displayed on the display unit 6 as shown in FIG. 2, for example, only the area of the human image H1 in the panorama projection image I1 is the attention area AR1, the operation unit After the person image H1 is designated as the attention area AR1 by the cursor or the like by the input operation, an enlargement instruction command is given. As a result, in the panorama imaging apparatus 1, an enlargement designation command is given from the control unit 7 to the geometric conversion processing unit 3, and the geometric conversion processing unit 3 refracts the light beam at the portion corresponding to the attention area AR1 and optically. The image signal obtained by the imaging unit 4 based on the luminous flux is sent to the image processing unit 5.

  In the panorama imaging apparatus 1, the attention area AR1 enlarged by the geometric conversion processing unit 3 is reduced by the image processing unit 5 by the same magnification as the enlargement ratio in the geometric conversion processing unit 3, and returned to the original magnification. An image signal is generated and sent to the display unit 6. As a result, as shown in FIG. 2, the display unit 6 forms an attention area AR1 having the same overall magnification and high resolution only in the portion of the person image H1, and other areas other than the attention area AR1. A panoramic projection image I1 with a reduced area resolution can be displayed. Here, in FIG. 2, in the region other than the attention region AR1, the alignment state of the liquid crystal molecules in the liquid crystal lens layer is the alignment state for enlarging the attention region AR1, and therefore the influence thereof. The luminous flux is refracted and the resolution is reduced.

  For example, when the image processing unit 5 receives an image signal partially reduced by the geometric transformation processing unit 3 from the imaging unit 4, for example, the image processing unit 5 performs correction processing on the image signal, and the geometric transformation processing unit 3 performs the reduction processing. The enlarged portion is enlarged and corrected to the original magnification, and this is sent to the display unit 6. As a result, a panorama projection image having the same overall magnification can be displayed on the display unit 6. At this time, the portion of the panorama projection image displayed on the display unit 6 that has been optically reduced once by the geometric conversion processing unit 3 has a reduced resolution, and the data amount of the entire panorama projection image is reduced. It can be reduced.

  By the way, the image processing unit 5 performs correction processing on the image signal to separate the panorama projection image I1 shown in FIG. 2 from the separation line B1 and develop it into a rectangular shape, and correct distortion caused by the panorama projection, A panoramic developed image I2 having no distortion as shown in FIG. 3 can be finally generated. At this time, when the attention area AR1 is specified so as to straddle the separation line B1 of the panorama projection image I1, the attention area AR1 is divided by the image development process, and the attention area is separated at both ends of the panorama development image I2. Each AR1 appears. As a result, as shown in FIG. 3, the panorama imaging apparatus 1 can generate a panoramic developed image I2 in which it is difficult for the user to recognize the attention area AR1.

  Therefore, the panorama imaging apparatus 1 of the present invention performs optical rotation processing on the panorama projection image I1 as shown in FIG. 2 in the geometric conversion processing unit 3, for example, as shown in FIG. The entire panorama projection image I1 (FIG. 2) can be rotated by a predetermined angle about the center point as a rotation axis to generate a panorama projection image I3 in which the separation line B1 is shifted from the attention area AR1, and this can be displayed on the display unit 6. . As a result, when the panorama imaging apparatus 1 generates a panorama development image from the panorama projection image I3, as shown in FIG. 5, for example, a part of interest such as the face of a human image in the attention area AR2 is the separation line B1. The attention area AR2 that is easy for the user to visually recognize can be generated in the panorama development image I4 by avoiding being displayed at both ends of the panorama development image I4.

  Note that FIG. 5 shows a panorama developed image having non-uniform resolution in which the panorama projection image I3 (FIG. 4) obtained by rotating the panorama projection image I1 shown in FIG. I4. As described above, the panorama imaging apparatus 1 generates the panorama development image I4 in which the important part of the attention area AR2 does not straddle the separation line B1, so that the attention area AR2 in the panorama development image I4 is interrupted. It is also possible to use an important portion that is not desired to be used for pattern matching or the like in a detection device or an authentication device (not shown).

  In this case, by using the panorama projection image I3 and the panorama development image I4 generated by executing the rotation process at the speed of light in the optical system in this way, the detection device, the authentication device, etc. A correction process for correcting the interruption is not required, and the load on the application in the detection device or the authentication device can be reduced accordingly.

  In practice, in the panorama imaging apparatus 1, when the panorama projection image I3 subjected to the rotation processing is generated, the entire light flux from the panorama information acquisition unit 2 is refracted and rotated by the liquid crystal molecules in the geometric conversion processing unit 3, A panoramic landscape based on the emitted light obtained by rotating the entire light beam can be imaged on the imaging device 15 of the imaging unit 4. The imaging unit 4 performs exposure (charge accumulation by photoelectric conversion) of the panoramic landscape imaged on the imaging device 15, generates an image signal related to the panoramic landscape, and sends this to the image processing unit 5. The image signal can be sent as it is to the display unit 6 without performing correction processing or the like in the image processing unit 5. As a result, a panorama projection image whose whole is rotated by a predetermined angle with the center point as the rotation axis can be displayed on the display unit 6.

(2) Configuration of Geometric Conversion Processing Unit Next, the geometric conversion processing unit 3 that can perform optical enlargement processing, reduction processing, and rotation processing will be specifically described below. Here, in this panoramic imaging device 1, as shown in FIG. 6, the terminal third reflecting mirror 12 (terminal reflecting mirror) for allowing the light beam of the panoramic landscape to enter the geometric conversion processing unit 3 is formed in a planar shape. In addition, since the arrangement of each component in the geometric conversion processing unit 3 is defined by the relationship between the third reflecting mirror 12 and the image pickup device 15, the control in the geometric conversion processing unit 3 can be simplified. ing.

  In this case, the geometric conversion processing unit 3 is disposed between the input side lens group 18a, the output side lens group 18b, and the input side lens group 18a and the output side lens group 18b, and is a biconvex condensing lens 24. The input side lens group 18 a is disposed so as to face the third reflection mirror 12, and the output side lens group 18 b is disposed so as to face the imaging element 15.

In the panoramic imaging device 1, when the focal length of the condenser lens 24 arranged at the center of the optical system is f, the distance f ₁ from the third reflecting mirror 12 to the input side lens group 18a and the input side lens group 18a the distance f ₂ to the condenser lens 24, the distance f ₃ from the condenser lens 24 to the output-side lens unit 18b, the length f and the distance f ₄ from the output side lens group 18b to the imaging element 15 described above, respectively Are located at the same distance.

  Here, it is assumed that the focal length of the input side lens group 18a is locally controlled so that the input side lens group 18a is a multifocal convex lens. That is, when a part of the panoramic landscape is enlarged, the focal length of an arbitrary part to be enlarged is made longer than the other part. At this time, the output side lens group 18b is a multifocal concave lens, and controls the focal length of the part corresponding to the part where the focal length of the input side lens group 18a is made longer than the other parts. Thereby, the geometric conversion processing unit 3 can form an image obtained by enlarging a local arbitrary portion as intended on the image sensor 15.

  Similarly, when the focal length of the input side lens group 18a is changed non-uniformly as a convex lens or concave lens, the output side lens group 18b is controlled so as to be the focal length of the corresponding non-uniform concave lens or convex lens. Thus, for example, an image having an arbitrary non-uniform magnification such as the magnification around a plurality of points can be formed on the image sensor 15. As described above, the geometric conversion processing unit 3 makes the third reflecting mirror 12 planar so that a panoramic scene without aberration is incident, and the input side lens group 18a, the output side lens group 18b, and the condenser lens 24 By adjusting each arrangement position, the focal length distribution of the output side lens group 18b corresponding to the focal length distribution of the input side lens group 18a can be calculated by a very simple calculation, and thus the input side lens group 18a. Thus, the control of the output side lens group 18b is simplified.

  Next, a detailed configuration of the geometric conversion processing unit 3 will be described. As shown in FIG. 7, the geometric conversion processing unit 3 uses the input side lens group 18 a, the condenser lens 24, and the output of the light beam obtained from the third reflecting mirror 12 via the diaphragm 13 (FIG. 6) not shown. It passes through the side lens group 18b in order and can be imaged on the image pickup device 15 of the image pickup section 4.

  In the geometric conversion processing unit 3, for example, the input side lens group 18a includes two liquid crystal lenses 20a and 20b for geometric conversion lenses, and the output side lens group 18b also includes two liquid crystal lenses for geometric conversion lenses. The drive circuit 16 is connected to the liquid crystal lenses 20a, 20b, 20c, and 20d for the geometric conversion lenses.

  Here, the drive circuit 16 applies the enlargement ratio command voltage, the reduction ratio command voltage, or the rotation command voltage to the liquid crystal lenses 20a, 20b, 20c, and 20d for the geometric conversion lens, thereby the first substrate 21 and the second substrate. The orientation state of the liquid crystal molecules sealed in the liquid crystal lens layer 23 between 22 can be changed, and the refractive index of the liquid crystal lenses 20a, 20b, 20c, and 20d for geometric conversion lenses can be changed by the liquid crystal molecules.

  In practice, the drive circuit 16 includes a reference voltage wiring 25 connected to the reference electrodes 30 of the liquid crystal lenses 20a, 20b, 20c, and 20d for geometric conversion lenses, respectively, and a first wiring group 26 and a second wiring group. 27 are respectively connected to ITO (Indium Tin Oxide) electrode layers 31 of the liquid crystal lenses 20a, 20b, 20c, and 20d for geometric conversion lenses. Accordingly, the liquid crystal lenses 20a, 20b, 20c, and 20d for the geometric conversion lenses are supplied from the drive circuit 16 through the reference voltage wiring 25, the first wiring group 26, and the second wiring group 27 to the reference electrode 30 and the ITO electrode layer 31. When a voltage for compensating the pretilt angle of the aligned liquid crystal molecules is applied between them, all the liquid crystal molecules in the liquid crystal lens layer 23 can be aligned parallel to the liquid crystal lens surface and aligned in one direction of the basic alignment direction.

  Here, in the case of this embodiment, the geometric transformation processing unit 3 is configured of the liquid crystal lenses 20a, 20b, 20c, and 20d for geometric transformation lenses provided in the input side lens group 18a and the output side lens group 18b, respectively. Has the same configuration, and has a two-layer structure in which two geometric conversion lens liquid crystal lenses 20a and 20b are stacked in the input side lens group 18a, and the output side lens group 18b is also used for two geometric conversion lenses. It has a two-layer structure in which the liquid crystal lenses 20c and 20d are laminated.

  This is because the liquid crystal molecules of the liquid crystal lens layer 23 of each of the geometric conversion lens liquid crystal lenses 20a and 20b have anisotropy in the basic alignment direction in the input side lens group 18a. The liquid crystal molecules 20a and 20b for the conversion lens are configured to have a multi-layer structure in which the anisotropy of liquid crystal molecules can be reduced. Specifically, when the input side lens group 18a has a structure in which two geometric conversion lens liquid crystal lenses 20a and 20b are stacked in two layers as in this embodiment, for example, By making the basic alignment directions of the liquid crystal molecules of the liquid crystal lens 20a for the geometric conversion lens of the second layer and the liquid crystal molecules of the liquid crystal lens 20b of the second layer of geometric conversion lens orthogonal (90 degrees), The structure reduces anisotropy.

  Also in the output side lens group 18b, as in the input side lens group 18a, the liquid crystal molecules of the liquid crystal lens layer 23 in each of the geometric conversion lens liquid crystal lenses 20c and 20d cause anisotropy in the basic alignment direction. Therefore, for example, the basic alignment directions of the liquid crystal molecules of the first-layer geometric conversion lens liquid crystal lens 20c and the liquid crystal molecules of the second-layer geometric conversion lens liquid crystal lens 20d are orthogonal (90 degrees). Thus, the structure reduces the anisotropy of the liquid crystal molecules.

  In this embodiment, the input side lens group 18a having a two-layer structure in which two geometric conversion lens liquid crystal lenses 20a and 20b are laminated, and two geometric conversion lens liquid crystal lenses 20c, 20c, Although the case where the output side lens group 18b having a two-layer structure in which 20d is laminated is applied has been described, the present invention is not limited to this, and a plurality of other liquid crystal lenses for geometric conversion lenses such as three or four are laminated. A multi-layered input side lens group and output side lens group in which the anisotropy of liquid crystal molecules is reduced may be applied.

  With such a configuration, the drive circuit 16 converts the magnification ratio command voltage or the reduction ratio command voltage into the geometric conversion lens liquid crystal by the first wiring group 26 based on, for example, the magnification command instruction or the reduction command instruction from the control unit 7. They can be applied to the ITO electrode layers 31 of the lenses 20a, 20b, 20c, and 20d, respectively. Further, the drive circuit 16 applies a rotation command voltage to the ITO electrode layers 31 of the geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d by the second wiring group 27 based on the rotation command command from the control unit 7, respectively. Can do.

  Here, the liquid crystal lenses 20a and 20b for the geometric conversion lens of the input side lens group 18a and the liquid crystal lenses 20c and 20d for the geometric conversion lens of the output side lens group 18b have the same basic configuration as described above. Therefore, in order to avoid duplication of description, the following description will be given focusing on one of the geometric conversion lens liquid crystal lenses 20a and 20b in the input side lens group 18a. As shown in FIG. 8, in practice, a liquid crystal lens 20a for a geometric conversion lens according to the present invention has a reference electrode 30 made of a transparent electrode member, a liquid crystal lens layer on a first substrate 21 made of a transparent member such as glass. 23 and a second substrate 22 made of a transparent member in the same manner as the first substrate 21, and a configuration in which an ITO electrode layer 31 is provided on the second substrate 22.

  Incidentally, in the case of this embodiment, as shown in FIG. 7, in the liquid crystal lenses 20a and 20b for the geometric conversion lens of the input side lens group 18a, the ITO electrode layer 31 is disposed on the third reflection mirror 12 side. The light beam reflected by the third reflecting mirror 12 can pass through the ITO electrode layer 31, the second substrate 22, the liquid crystal lens layer 23, the reference electrode 30, and the first substrate 21 in this order. On the other hand, in the geometric conversion lens liquid crystal lenses 20c and 20d of the output side lens group 18b, the first substrate 21 is disposed on the condenser lens 24 side, and the ITO electrode layer 31 is disposed on the imaging element 15 side. The luminous flux that has passed through the liquid crystal lenses 20a and 20b for the geometric conversion lens and the condenser lens 24 of the side lens group 18a is reflected on the first substrate 21, the reference electrode 30, the liquid crystal lens layer 23, the second substrate 22 and the ITO electrode layer 31. You can pass in order.

Here, in the case of this embodiment, the ITO electrode layer 31 provided on the entire incident surface of the liquid crystal lens 20a for geometric conversion lens has a total of 8 vertical and 8 horizontal, for example, as shown in FIG. _X8 enlargement / reduction electrodes EL _{2, mn} (m represents the number of rows in the matrix, n represents the number of columns in the matrix, and in this case, m and n represent any integer from 1 to 8) are arranged in a matrix, each scale voltage line L ₂ are connected to each scale electrode EL _{2, mn.} The ITO electrode layer 31 has, for example, an enlargement ratio command voltage V _{2, mn} (m, n represents a corresponding enlargement / reduction electrode EL _{2, mn} based on an enlargement instruction signal from the control unit 7, and in this case m , n represents represents an integer of 1 to 8) can be applied to a predetermined scaling electrode EL _{2, mn} through a scaling voltage wiring L ₂ from the driving circuit 16.

For example, looking at the vertical n-th column in scaling electrodes _EL 2,1n ~EL 2,8n the ITO electrode layer 31, as shown in FIG. 9, first row scaling electrodes of EL _2,1n with enlargement ratio command voltage V _2,1n , second row enlargement / reduction electrode EL _2,2n with enlargement ratio command voltage V _2,2n , third row enlargement / reduction electrode EL _2,3n the magnification command voltage V _2,3N, magnification command voltage V _{2, 4n} to scale electrode EL _{2, 4n} of the fourth row, the voltage V ₂ to the scale electrodes EL _2,5N row 5 _{, 5n} , enlargement / reduction electrode EL _2,6n on the 6th row, enlargement rate command voltage V _2,6n , enlargement / reduction electrode EL _2,7n on the 7th row, enlargement rate command voltage V _2,7n , 8 An enlargement ratio command voltage _V2,8n can be applied from the drive circuit 16 to the enlargement / reduction electrodes _EL2,8n in the row as required based on the enlargement command signal. Of the enlargement / reduction electrode EL _{2, mn} , the enlargement / reduction voltage wiring L _2, and the enlargement ratio command voltage V _{2, mn} , the subscript “2” is distinguished from the rotation electrode described later. This is a reference sign.

When the enlargement ratio command voltage V _{2, mn} is applied from the drive circuit 16 to one or a plurality of enlargement / reduction electrodes EL _{2, mn} , the liquid crystal lens 20a for geometric conversion lens is expanded / reduced electrode EL _{2. , mn} changes the alignment state of the tilt angle of the liquid crystal molecules in the liquid crystal lens layer 23 in accordance with the voltage value of the magnification command voltage V2 _{, mn} , and the alignment state of these liquid crystal molecules optically changes the panoramic landscape. It can be in a state of a refractive index distribution that performs the same function as an aspherical convex lens that can be enlarged (an aspherical convex lens whose focal length becomes shorter as it goes away from the center).

  Here, FIG. 10A and FIG. 10B showing the side cross-sectional configuration of FIG. 10A are liquid crystal lens layers when, for example, one predetermined point in the panorama projection image displayed on the display unit 6 is designated as the enlargement designation position P1. 23 is a schematic diagram in which the alignment state of liquid crystal molecules 35 in the entire image 23 is imagined. In practice, a plurality of liquid crystal molecules 35 are stacked in the liquid crystal lens layer 23, but in FIG. 10A and FIG. 10B, the liquid crystal molecules 35 are illustrated in a simplified manner with attention paid to the liquid crystal molecules arranged in a line. 10A and 10B show, for example, a single-layer liquid crystal in which a first-layer geometric conversion lens liquid crystal lens 20a and a second-layer geometric conversion lens liquid crystal lens 20b are stacked. It is an image figure when considering it as a layer.

In this case, the enlargement ratio command voltage V _{2, mn} is applied to the enlargement / reduction electrodes EL _{2, mn} corresponding to the enlargement designation position P1, and the tilt angle of the liquid crystal molecules 35 in the liquid crystal lens layer 23 is accordingly applied. The orientation state of can be controlled. Such liquid crystal molecules 35 are virtually imaged by laminating at least two layers of the liquid crystal lenses 20a for geometric conversion lenses. In the case of a single layer, the liquid crystal molecules 35 are formed on the first substrate 21 or the second substrate 22. The closer it is, the more it can be constrained in the basic alignment direction due to the properties of the liquid crystal.

  That is, the liquid crystal molecules 35 close to the first substrate 21 or the second substrate 22 subjected to the rubbing process can be an elliptical structure having a single refraction property that changes only the tilt angle by the magnification command voltage. On the other hand, the liquid crystal molecules 35 located away from the first substrate 21 or the second substrate 22 subjected to the rubbing process move toward the basic alignment direction as they move away from the first substrate 21 or the second substrate 22 subjected to the rubbing process. The liquid crystal lens layer can be regarded as an elliptical structure having birefringence in which the constraint is weakened and the refractive index in the minor axis direction is different from the refractive index in the major axis direction, and the orientation state is controlled. The light beam passing through the inside 23 can be refracted in a desired direction.

In the case of this embodiment, in the liquid crystal lens layer 23, the liquid crystal molecules 35 aligned in one direction (the optical axis direction orthogonal to the surface direction of the liquid crystal lens layer 23) are enlarged facing the enlargement designated position P1. By applying the enlargement ratio command voltage V _{2, mn} to the reduction electrodes EL _{2, mn} , as shown in FIG. 10A, they are oriented radially with the enlargement designated position P1 as the enlargement center.

At this time, in the region close to the substrate of the liquid crystal lens layer 23, as shown in FIG. 10B, the major axis direction of the liquid crystal molecules 35 facing the enlargement designated position P1 is substantially parallel to the surface direction of the liquid crystal lens layer 23. The major axis direction of the liquid crystal molecules 35 gradually inclines in the optical axis direction as the distance from the enlargement designated position P1 increases _{, and} the influence of the enlargement ratio command voltage V2 _{, mn} increases away from the enlargement designated position P1. The major axis direction of the liquid crystal molecules 35 not received is aligned with the optical axis direction.

  Thereby, in the liquid crystal lens layer 23, the enlargement designated position P1 corresponds to the convex portion of the aspherical convex lens, and the same function as the aspherical convex lens whose focal length becomes shorter as the enlargement designated position P1 becomes the enlargement center and moves away from it. The liquid crystal molecules 35 can be aligned so as to have a refractive index distribution. Thus, the liquid crystal lenses 20a, 20b, 20c, and 20d for the geometric conversion lens realize liquid crystal that realizes an aspherical convex lens in which, when a light beam is incident, the focal length decreases as the distance from the enlargement designated position P1 becomes the center. A light beam is refracted by the molecules 35, and a panoramic landscape enlarged around the enlargement designated position P1 can be imaged on the image sensor 15.

Incidentally, when the reduction ratio command voltage V ′ _{2, mn} is applied from the drive circuit 16 to one or a plurality of enlargement / reduction electrodes EL _{2, mn} , the liquid crystal lens 20a for geometric conversion lens is used for enlargement / reduction. The alignment state of the liquid crystal molecules 35 in the liquid crystal lens layer 23 facing the electrodes EL _{2, mn} changes according to the voltage value of the reduction rate command voltage V ′ _{2, mn} , and the alignment state of these liquid crystal molecules 35 changes to a panoramic view. It can be in a state of a refractive index distribution that works in the same way as an aspheric concave lens that can be optically reduced (an aspheric concave lens that becomes longer as the focal distance is away from the center).

Specifically, in this embodiment, in the liquid crystal lens layer 23, the liquid crystal molecules 35 aligned in one direction by the reference voltage are applied to the enlargement / reduction electrodes EL _{2, mn} facing the reduction designated position. By applying the reduction rate command voltage V ′ _{2, mn, the} reduction direction command voltage V ′ _{2, mn} is oriented radially with the reduction specified position as the reduction center.

  At this time, in the liquid crystal lens layer 23, the major axis direction of the liquid crystal molecules 35 facing the reduction designated position is different from the case of the aspherical convex lens, and the liquid crystal lens layer 23 is aligned so as to be arranged upside down in FIG. 10B. The longer axis direction of the liquid crystal molecules 35 gradually tilts in the optical axis direction as the distance from the specified reduction position increases, and the longer axis direction of the liquid crystal molecules 35 that are far from the specified reduction position and are not affected by the reduction rate command electrode is the optical axis. Aligned in the direction. Thereby, in the liquid crystal lens layer 23, the reduction designated position corresponds to the concave part of the aspherical concave lens, and the refraction works in the same manner as the aspherical concave lens whose focal length becomes longer as the reduction designated position is set as the reduction center and the distance from the reduction designated position increases. The liquid crystal molecules 35 can be aligned so as to have a rate distribution.

  Thus, the liquid crystal molecules 20a, 20b, 20c, and 20d for the geometric conversion lenses are liquid crystal molecules that realize an aspherical concave lens in which, when a light beam is incident, the focal length increases as the distance from the reduction specified position becomes the center. The light beam is refracted by 35, and a panoramic landscape that is reduced around the specified reduction position and decreases as the distance from the reduction position can be imaged on the image sensor 15.

In addition to such a configuration, as shown in FIG. 9, the ITO electrode layer 31, for example, when focusing on one scale electrodes EL _2,51, vertically centered scaling electrodes EL _2,51 A total of four rotating electrodes EL ¹¹ _1,51 , EL ¹² _1,51 , EL ²¹ _1,51 , EL ²² _1,51 of 2 × 2 × 2 are arranged. A pair of electrode cells 37 is composed of the expansion / reduction electrode EL _2,51 and the four rotation electrodes EL ¹¹ _1,51 , EL ¹² _1,51 , EL ²¹ _1,51 , EL ²² _1,51. Yes.

That is, in this way, the ITO electrode layer 31 has a total of four rotation electrodes EL ^xy _{1, mn} (2 × 2 × 2 × 2 in the center, with each of the enlargement / reduction electrodes EL _{2, mn} at the center. m, n represents the correspondence with the expansion / reduction electrodes EL _{2, mn} of the m-th row of the matrix and the n-th row of the matrix, and in this case, an integer from 1 to 8 X and y are integers of 1 or 2, and the rotation electrode arrangement positions are represented in a matrix), whereby the rotation electrodes EL ^xy _{1 and mn} are regularly arranged as a whole. Has been.

As shown in FIG. 11, in the case of this embodiment, the electrode cell 37 has a quadrilateral shape and has circular enlargement / reduction electrodes EL2 _{, mn} at the center, and this enlargement / reduction electrode EL. _Two- sided rotation electrodes EL ¹¹ _{1, mn} , EL ¹² _{1, mn} , EL ²¹ _{1, mn} , EL ²² _{1, mn} are arranged at the four corners with _{2, mn} as the center. Then, the electrode cell 37, each rotating electrode ^{_{EL 11 1, mn, EL 12}} 1, mn, EL 21 1, mn, rotational voltage lines L ₁ are respectively connected to the EL ²² _{1, mn,} the driving circuit 16 to the rotation electrodes EL ¹¹ _{1, mn} , EL ¹² _{1, mn} , EL ²¹ _{1, mn} , L ²² _{1, mn} through the rotation voltage wiring L ₁ to the rotation command voltages V ¹¹ _{1, mn} , V ¹² _{1 , mn} , V ²¹ _{1, mn} , V ²² _{1, mn} can be applied, respectively.

Thus rotating electrode ^{_{EL 11 1, mn ~EL 22 1}} , mn , by rotation command voltage ^{_{V 11 1, mn ~V 22 1}} , mn is applied, the substrate in the liquid crystal lens layer 23 that faces (rubbing The refractive index of the liquid crystal lens layer 23 is changed by rotating the liquid crystal molecules 35 which are located away from the processed first substrate 21 or the second substrate 22) and are free from the constraint of the alignment direction of the liquid crystal to a predetermined angle. Thus, the panoramic landscape imaged on the image sensor 15 can be rotated. In FIG. 9, the rotation voltage wiring L ₁ connected to each of the rotation electrodes EL ^xy _{1 and mn} is omitted and not shown. Of the rotation electrode EL ^xy _{1, mn} , the rotation voltage wiring L ₁ and the rotation command voltage V ^xy _{1, mn} , the subscript “1” is indicated by the above-described enlargement / reduction electrode EL _{2, mn,} etc. It is the code | symbol attached | subjected in order to distinguish with.

For example, as shown in FIGS. 10A and 10B, when the entire captured image in which the alignment process of the liquid crystal molecules 35 has been changed by the enlargement process is rotated with the enlargement designated position P1 as the rotation center position, the operation unit Rotation command voltage V ^xy _{1, mn} can be applied to each rotation electrode EL ^xy _{1, mn} based on the input operation from. As a result, as shown in FIGS. 10C and 10D, in the liquid crystal lens layer 23, the liquid crystal molecules radially aligned around the enlargement / reduction electrodes EL _{2, n} to which the enlargement ratio command voltage V _{2, mn} is applied. 35 can be rotated by a predetermined angle around the rotation center position P2 in this state, and the orientation state can be changed.

For example, in FIG. 10C, the liquid crystal molecules 35 before rotation are indicated by thin bar-like lines A1, the liquid crystal molecules 35 after rotation are indicated by dark bar-like lines A2, and the rotation command voltage V ^xy _{1, mn} is applied to each rotation electrode EL. ^By being applied to ^xy _{1, mn} , the liquid crystal molecules 35 are slightly rotated counterclockwise around the rotation center position P2. Accordingly, when the light flux is incident, the geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d refract the light flux by the liquid crystal molecules 35 rotated by a predetermined angle around the rotation center position P2, and the rotation center position. A panoramic landscape rotated about P2 can be imaged on the image sensor 15.

(3) Operation and Effect In the above configuration, in the panorama imaging device 1, a panoramic landscape around 360 ° is passed to the geometric conversion processing unit 3 via the first reflection mirror, the second reflection mirror, and the third reflection mirror. The panorama information acquisition unit 2 to be incident is provided, and the geometric conversion processing unit 3 includes a liquid crystal lens layer 23 in which liquid crystal molecules 35 are aligned in one direction between the first substrate 21 and the second substrate 22, The liquid crystal lenses 20a, 20b, 20c, and 20d for geometric conversion lenses having the ITO electrode layer 31 on which the enlargement / reduction electrodes EL _{2 and mn} are arranged in a matrix form on the liquid crystal lens layer 23 are provided.

Further, in the geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d, when enlargement designation is performed on one or a plurality of locations in the captured image, one or a plurality of enlargement / reductions corresponding to the enlargement designation position P1. magnification command voltage V _{2, mn} is applied to the reduction electrode EL _{2, mn,} the liquid crystal molecules 35 in the liquid crystal lens layer 23 that is facing the scale electrodes EL _{2, mn} is with distance from the designated position They are oriented so as to have a refractive index distribution that works the same as an aspherical convex lens with a shorter focal length.

  As a result, in the liquid crystal lenses 20a, 20b, 20c, and 20d for geometric conversion lenses, when the luminous flux passes, the refractive index is changed by the liquid crystal molecules 35 whose orientation state has changed, and the enlargement specified position P1 is enlarged. A panoramic landscape can be imaged on the image sensor 15.

Thus, the geometric transform lens for liquid crystal lens 20a, 20b, 20c, in 20d, merely applying the magnification command voltage V _{2, mn} a predetermined scaling electrode EL _{2, mn,} the liquid crystal lens layer 23 The orientation state of the liquid crystal molecules 35 is changed to enlarge only a desired part of the panoramic landscape, and only the desired part without increasing the data amount of the entire panorama projection image while maintaining the wide field of view. Resolution can be improved.

As described above, in this panoramic imaging device 1, by providing the liquid crystal lenses 20a, 20b, 20c, and 20d for geometric conversion lenses, when a region to be observed in detail exists in the panorama projection image, a motor or the like is used. Even if the lens itself is not moved by a large-scale movable mechanism, the desired location in the panorama projection image can be optically applied by simply applying the enlargement ratio command voltage V2 _{, mn} to the predetermined enlargement / reduction electrode EL2 _{, mn.} Therefore, there is no need for a storage space for installing a mechanical movable mechanism for moving the lens as in the prior art or a movement space for moving the lens itself, and only the liquid crystal molecules 35 are used. Therefore, it is not necessary to move the mechanical movable mechanism, so that it is possible to reduce the size and improve the energy saving.

Further, in this panoramic imaging apparatus 1, an ITO electrode layer 31 in which a plurality of enlargement / reduction electrodes EL _{2, mn} are arranged in a matrix is provided on the liquid crystal lenses 20a, 20b, 20c, 20d for geometric conversion lenses. Therefore, by simultaneously applying the enlargement ratio command voltage V2 _{, mn} to the enlargement / reduction electrodes EL2 _{, mn} at the desired position, the orientation state of the liquid crystal molecules 35 at a plurality of locations can be changed at the same time to change the refractive index. Thus, a panoramic landscape obtained by simultaneously enlarging a plurality of places with a plurality of enlargement designated positions P1 as an enlargement center can be imaged on the image sensor 15.

  In this panoramic imaging device 1, an image signal obtained by enlarging one or a plurality of portions of the panoramic landscape by the geometric conversion lens liquid crystal lenses 20 a, 20 b, 20 c, and 20 d is sent from the imaging unit 4 to the image processing unit 5. Then, the enlarged portions enlarged by the geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d are reduced again by the image processing unit 5 to return to the original magnification.

  As described above, in the panorama imaging apparatus 1, the enlarged portion enlarged by the geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d is reduced by the image processing unit 5 and returned to the original scale, and this is panorama. Since it is displayed on the display unit 6 as a projected image, it is possible for the user to unmagnify and enlarge the enlarged portion with the resolution improved by the liquid crystal lenses 20a, 20b, 20c, and 20d for geometric conversion lenses. Without presenting, it is possible to present to the user a natural panoramic projection image that is entirely scaled. Further, in this panoramic imaging device 1, a panoramic image in which a panoramic projection image in which a peripheral visual field image is displayed in an annular shape is developed from the separation line B 1 can be generated and displayed on the display unit 6.

In addition, in the panorama imaging apparatus 1, when one or a plurality of locations in the panorama projection image is designated for reduction, the geometric conversion processing unit 3 performs one or more enlargement / reduction corresponding to the reduction designated position. The reduction rate command voltage V _{2, mn} is applied to the electrode EL _{2, mn} . Thus, the geometric transformation processing part 3, the reduction ratio command voltage V _2, the liquid crystal molecules 35 in the liquid crystal lens layer _{23 mn} is opposed to the applied scale electrode EL _{2, mn,} away from the designated position Accordingly, the refractive index distribution is the same as that of the aspherical concave lens whose focal length becomes longer.

  Thus, in the panoramic imaging device 1, when the light beam passes through the geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d, the refractive index of the light beam is changed by the liquid crystal molecules 35 whose orientation state has changed, and the reduction designated position is set. A panoramic landscape reduced as a reduction center can be imaged on the image sensor 15.

As a result, in this panoramic imaging apparatus 1, the geometric conversion processing unit 3 _applies the reduction rate command voltage V to the predetermined enlargement / reduction electrodes EL2 _{, mn} of the liquid crystal lenses 20a, 20b, 20c, 20d for geometric conversion lenses. By simply applying ' _{2, mn} ' _, the alignment state of the liquid crystal molecules 35 in the liquid crystal lens layer 23 changes, and the portion desired by the user in the panoramic landscape is reduced to reduce the resolution, thereby making it unnecessary. The amount of data to be allocated can be reduced.

As described above, in the panoramic imaging device 1, the geometric conversion processing unit 3 _applies the reduction ratio command voltage to the predetermined enlargement / reduction electrode EL2 _{, mn} without moving the lens itself by a large movable mechanism such as a motor. By simply applying V´2 _{, mn} , it is possible to optically reduce a desired location in the panoramic landscape, and a storage space for installing a mechanical movable mechanism that moves the lens as in the past, A moving space for moving the lens itself is unnecessary, and further, only the liquid crystal molecules 35 are moved, and there is no need to move a mechanical movable mechanism, so that downsizing and improvement in energy saving can be achieved.

Further, in this panoramic imaging device 1, a plurality of enlargement / reduction electrodes EL2 _{, mn} are arranged in a matrix on the liquid crystal lens layer 23 of the geometric conversion lens liquid crystal lenses 20a, 20b, 20c, 20d. Since the electrode layer 31 is provided, the reduction ratio command voltage V′2 _{, mn} is simultaneously applied to the enlargement / reduction electrodes EL2 _{, mn} at desired positions, thereby aligning the liquid crystal molecules 35 at a plurality of locations. It is possible to change the refractive index by changing the state at the same time, and thus it is possible to form an image on the image pickup device 15 in a panoramic landscape in which a plurality of reduction specified positions are reduced at the same time.

  In this case, in the panorama imaging apparatus 1, the geometric conversion is performed by re-magnifying the reduced portion obtained by reducing one or more portions of the panoramic landscape in this way by the image processing unit 5 and returning the original magnification to the original magnification. Natural panorama projection image with a reduced scale overall without presenting to the user an unnaturally reduced reduced portion that has been reduced by the lens liquid crystal lenses 20a, 20b, 20c, and 20d and reduced in resolution. Or, a panoramic image obtained by developing it can be presented to the user.

Furthermore, in this panoramic imaging device 1, an enlargement ratio command voltage V2 _{, mn} is applied to one or a plurality of enlargement / reduction electrodes EL2 _{, mn} by the liquid crystal lenses 20a, 20b, 20c, 20d for geometric conversion lenses. At the same time _, by applying the reduction ratio command voltage V _{2, mn} to the remaining one or more enlargement / reduction electrodes EL _{2, mn} , the enlargement ratio command voltage V _{2, mn} and the reduction ratio command Each liquid crystal molecule 35 can be changed to a different alignment state for each region by the voltage V _{2, mn} . Thus, in the panorama imaging apparatus 1, the liquid crystal molecules 35 in the geometric conversion processing unit 3 refract the light beam from the panorama information acquisition unit 2 and expand it with the enlargement designated position P1 as the enlargement center at a certain point. A panoramic landscape that has been reduced around the specified reduction position at another location can be imaged on the image sensor 15.

  Even in this case, in the panorama imaging apparatus 1, an enlarged portion obtained by enlarging one or more portions of the panoramic landscape is reduced again by the image processing unit 5, and one or more portions of the panoramic landscape are reduced. The reduced portion is enlarged again by the image processing unit 5, and the overall magnification is restored to the original magnification so as to be unified. Images and panoramic images can be presented to the user. Further, in this way, the panorama imaging apparatus 1 reduces the data amount by reducing unnecessary portions while maintaining the surrounding 360 ° field of view, thereby increasing the data amount of the entire panorama projection image. In addition, it is possible to present a panoramic projection image in which only a desired portion is enlarged and the resolution is improved to the user.

Further, in the liquid crystal lenses 20a, 20b, 20c, and 20d for the geometric conversion lens, an ITO in which a plurality of rotation electrodes EL _{1, mn} are regularly arranged vertically and horizontally apart from the enlargement / reduction electrodes EL _{2, mn.} The electrode layer 31 was provided on the liquid crystal lens layer 23. Thereby, in this panoramic imaging device 1, the rotation command voltages V1 _{, mn} are respectively applied to the rotation electrodes EL1 _{, mn} of the liquid crystal lenses 20a, 20b, 20c, 20d for the geometric conversion lenses, whereby each rotation is applied. By changing the alignment state of the liquid crystal molecules 35 in the liquid crystal lens layer 23 facing the electrodes EL _{1, mn} , the liquid crystal molecules 35 can be rotated by a predetermined angle.

  Thereby, in this panoramic imaging device 1, when the light beam passes through the geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d, the refractive index of the light beam is changed by the liquid crystal molecules 35 whose orientation state has changed, and the liquid crystal is changed. With the numerator 35, the panorama landscape can be rotated by a predetermined angle around the rotation center position, and the rotated panorama landscape can be imaged on the image sensor 15.

  Thereby, in the panorama imaging device 1, the attention area AR1 is positioned on the separation line B1 in the case of the panorama projection image, and when the panorama projection image is developed into the panorama image, the attention area AR1 is divided at both ends of the panorama image. Even in such a case, it is possible to generate a panoramic image in which the attention area AR1 is not divided by appropriately rotating the panorama projection image so that the attention area AR1 does not overlap the separation line B1.

  According to the above configuration, the panorama information acquisition unit 2 that acquires a panoramic landscape and enters the geometric conversion processing unit 3 is provided. The geometric conversion processing unit 3 includes the liquid crystal lens layer 23 in which the liquid crystal molecules 35 are sealed. Provided between the first substrate 21 and the second substrate 22, the orientation of the liquid crystal molecules 35 is controlled by a voltage as an external stimulus applied to the liquid crystal lens layer 23, and the panoramic landscape is geometrically converted by the orientation change of the liquid crystal molecules 35. By doing so, a storage space for installing a mechanical movable mechanism for moving the lens as in the past, a moving space for moving the lens itself, and a large mechanical mechanism for moving the mechanical movable mechanism Therefore, it is possible to reduce the size and improve the energy saving, and to convert the panoramic landscape into a desired form.

(4) Other Embodiments (4-1) Geometric Conversion Lens Liquid Crystal Lenses According to Other Embodiments The present invention is not limited to the present embodiments, and is within the scope of the gist of the present invention. For example, in the above-described embodiment, the liquid crystal lens layer 23 which is a continuous space without being divided is used, and the enlargement / reduction electrode EL _{2, mn} and the rotation electrode are used. A case will be described in which the liquid crystal lenses 20a, 20b, 20c, and 20d for the continuous geometric conversion lens in which the ITO electrode layer 31 in which the EL ^xy _{1, mn} are continuously patterned are provided on the liquid crystal lens layer 23 are applied. However, the present invention is not limited to this, and as shown in FIG. 12, a plurality of micro liquid crystal lens cells 41 each having a liquid crystal lens layer 45 separated by a partitioning portion 40 are connected vertically and horizontally and arranged in an array. Micro LCD lens A discrete type liquid crystal lens for a geometric conversion lens in which an electrode cell 37 is provided for each cell 41 may be applied.

In this case, the micro liquid crystal lens cell 41 used in the discrete type liquid crystal lens for geometric conversion lens has, for example, substantially the same size as the electrode cell 37, and the liquid crystal is sealed in the sealed space divided by the partition portion 40 made of a transparent member. The molecule has a sealed configuration. The discrete geometric transform lens for liquid crystal lens for micro liquid crystal lens cell 41 is arranged in the gap without an array, magnification command voltage V ₂ by the electrode cells 37, _{respectively, mn,} the reduction ratio command voltage _{V'2 , mn} and rotation command voltage V ^xy _{1, mn} are applied, the orientation state of the liquid crystal molecules is changed for each micro liquid crystal lens cell 41, and the same effect as the above-described embodiment can be obtained.

Here, FIG. 13A and FIG. 13B showing a side sectional configuration of FIG. 13A are schematic views of the liquid crystal lens layer 45 in one micro liquid crystal lens cell 41, and when the pretilt angle is canceled in the liquid crystal lens layer 45 The alignment state of the liquid crystal molecules 35 is shown. In this case, in the liquid crystal lens layer 45, the liquid crystal molecules 35 are laid in parallel only in the plane direction by the rubbing process, and the enlargement ratio distribution according to the rotation of the panoramic landscape and the distance from the enlargement center point of the panoramic landscape _Can be controlled by the enlargement ratio command voltage V _{2, mn} and the rotation command voltage V ^xy _{1, mn} applied to the electrode cell 37.

  Even in this case, when the pretilt angle of the liquid crystal molecules 35 is 0 degree, the orientation direction of the liquid crystal molecules 35 is determined by the direction of the rubbing treatment, so that the influence on the anisotropic optical system is reduced. In the internal lens unit, as in the above-described embodiment, in the input side lens group and the output side lens group, two liquid crystal lenses for geometric conversion lenses are stacked, and two micro liquid crystal lens cells 41 are stacked. It becomes the structure.

  For example, in the input side lens group, the liquid crystal molecules of the first-layer micro liquid crystal lens cell 41 may be rotated by 90 degrees with the liquid crystal molecules of the second-layer micro liquid crystal lens cell 41 (note that these micro liquid crystal lens cells 41 have a configuration in which Lamination of the liquid crystal lens cell 41 can also be said to discretize the liquid crystal molecules 35 in a direction (optical axis direction) perpendicular to the top surface of the micro liquid crystal lens cell 41 when the top view of FIG. 10A is viewed. Similarly to the above-described embodiment, the liquid crystal molecules in the first-layer micro liquid crystal lens cell 41 in the output-side lens group are the same as those in the second-layer micro-liquid crystal lens cell 41 as in the input-side lens group. The structure can be rotated 90 degrees with liquid crystal molecules.

In this case, in such a micro liquid crystal lens cell 41, first, when the pretilt angle is 0 degree, the rotation command voltage V ^xy _{1, mn} is given so that the liquid crystal molecules 35 are parallel to the rubbing direction. As shown in FIG. 13B, the liquid crystal molecules 35 are non-rotated and can be parallel to the surface direction. Since the liquid crystal molecules 35 close to the first substrate 21 or the second substrate 22 subjected to the rubbing process are constrained in the rubbing direction with a pretilt angle without applying a voltage, the liquid crystal molecules 35 are moved from the upper surface of the micro liquid crystal lens cell 41. When viewed, it looks like FIG. 13A. That is, it is necessary to perform an operation for applying the rotation command voltage V ^xy _{1, mn} to the non-rotating state with respect to the liquid crystal molecules 35 located at a position away from the first substrate 21 or the second substrate 22 subjected to the rubbing process. .

Thereafter, in the micro liquid crystal lens cell 41, a predetermined magnification command voltage V _{2, mn} is applied, so that the liquid crystal molecules 35 correspond to the magnitude of the magnification command voltage V _{2, mn} as shown in FIG. The alignment state of the liquid crystal molecules 35 is such that the refractive index distribution has the same function as an aspherical convex lens whose focal length decreases with increasing distance from the position where the enlargement command voltage is applied (that is, having a tilt angle). It can change.

On the other hand, when rotating the light beam passing through the micro liquid crystal lens cell 41, the rotation command voltage V ^xy is given after giving the enlargement command voltage V _{2, mn} etc. so that the pretilt angle of the liquid crystal molecules 35 becomes 0 degree. By changing _{1, mn} , the pan angle of the liquid crystal molecules 35 located relatively far from the substrate is controlled to be constant as shown in FIG. Thus, even in such a discrete type liquid crystal lens for geometric conversion lens, the alignment state of the liquid crystal molecules can be freely changed according to the voltage, and the same effect as the above-described embodiment can be obtained.

In the embodiment described above, a total of 64 enlargement / reduction electrodes El _{2, mn} (m, n) arranged in a matrix of 8 vertically and 8 horizontally as the enlargement electrodes and the reduction electrodes. Is an integer of any one of 1 to 8), but the present invention is not limited to this, and the number of expansion / reduction electrodes El _{2, mn} may be any number, vertical M, horizontal A total of M × N expansion / reduction electrodes El _{2, mn} arranged in a matrix with N pieces (M and N are arbitrary integers) (where m is an integer from 1 to M and n is Any integer of 1 to N) may be applied.

Further, in the above embodiment, as the rotation electrode and the vertical eight horizontal eight respective scaling electrode EL _2, respectively associated with _mn, each scale electrode EL _{2, mn} A total of (8 × 8) × 4 rotation electrodes EL ^xy _{1, mn} (x and y are integers of 1 or 2) that are regularly arranged in the center and two vertically and two horizontally. Although the case where the present invention is applied has been described, the present invention is not limited to this, and the number of the rotation electrodes EL ^xy _{1, mn} may be any number, and may be M in the vertical direction and N in the horizontal direction (M and N are arbitrary integers). Each enlargement / reduction electrode EL _{2, mn} (where m is an integer from 1 to M and n is an integer from 1 to N) is associated with each enlargement / reduction electrode EL _{2. , mn} centered around X (vertical) and Y (horizontal) where X and Y are arbitrary integers. Total (M × N) × (X × Y) rotating electrodes EL ^xy _{1, mn} (in this case , X may be any integer from 1 to X, y may be any integer from 1 to Y)

  Furthermore, in addition to the liquid crystal lenses 20a, 20b, 20c, and 20d for the continuous geometric conversion lens described above and the discrete liquid crystal lens for the geometric conversion lens as a modification, a liquid crystal lens larger than the micro liquid crystal lens cell 41 is used. Geometry with various configurations, such as a liquid crystal lens for hybrid geometric conversion lenses, in which the liquid crystal lens layer is discretely divided into cells and an ITO electrode layer having a continuous electrode pattern is provided on the liquid crystal lens layer. A liquid crystal lens for a conversion lens may be applied. In the geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d using the continuous liquid crystal lens layer employed in the above-described embodiment, the partition portion 40 is formed as compared with the discrete geometric conversion lens. A panoramic landscape with as much light as it can have can be imaged on the image sensor 15, and the magnification and rotation at each point of the panoramic landscape can be arbitrarily specified, and these panoramic landscapes can be changed smoothly and smoothly. Can be made.

Further, in the above-described embodiment, the ITO electrode layer 31 in which the enlargement / reduction electrodes EL _{2, mn} and the rotation electrodes EL ^xy _{1, mn} are arranged in a predetermined pattern is provided on the liquid crystal lens layer 23, and enlargement processing is performed. The case where the reduction processing and the rotation processing can be executed by one geometric conversion lens liquid crystal lens 20a, 20b, 20c, 20d has been described. However, the present invention is not limited to this, and the enlargement / reduction electrode EL is not limited thereto. An ITO electrode layer in which only _{2, mn} are arranged in a predetermined pattern is provided on the liquid crystal lens layer 23, and only the enlargement process and the reduction process are performed by one liquid crystal lens for a geometric conversion lens, or a rotation electrode An ITO electrode layer in which only EL ^xy _{1 and mn} are arranged in a predetermined pattern may be provided on the liquid crystal lens layer 23, and only the rotation process may be executed by one liquid crystal lens for a geometric conversion lens.

  Further, the liquid crystal lens for the geometric conversion lens that can execute only the enlargement process and the reduction process and the liquid crystal lens for the geometric conversion lens that can execute only the rotation process are stacked and combined to form the internal lens unit. May be. As described above, when the rotation of the pan angle and the tilt angle of the liquid crystal molecules can be controlled separately for each geometric conversion lens, the enlargement ratio distribution and the rotation amount are continuously changed. There is an advantage that a panoramic view can be obtained, the electrode arrangement on each liquid crystal lens layer can be simplified, and a larger amount of light can be obtained.

Further, in the embodiment described above, changing the alignment state of the liquid crystal molecules 35 by applying magnification command voltage V _{2, mn,} the reduction ratio command voltage _{V'2, mn,} the rotation command voltage V ^xy _{1, mn} The geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d for enlarging, reducing, or rotating the panoramic landscape formed on the image sensor 15 have been described. However, the present invention is not limited to this. By applying a predetermined voltage to the ITO electrode layer 31, the orientation state of the liquid crystal molecules 35 can be arbitrarily changed, and the panoramic landscape imaged on the image sensor 15 can be translated and converted into various other states. A geometric conversion lens may be applied.

For example, when the panoramic landscape imaged on the image sensor 15 is translated, the geometric conversion lens liquid crystal lens of the input side lens group 18a among the geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d. Taking 20a as an example, the enlargement ratio command voltage V _{2, mn} (or the reduction ratio command voltage V ′ _{2, mn} ) applied to the enlargement / reduction electrodes EL _{2, mn} at a specific location is divided into four surroundings. By making the rotation command voltage V ^xy _{1, mn} equal and applying this as a movement command voltage, the orientation state of the liquid crystal molecules 35 is changed, and the panoramic landscape imaged on the image sensor 15 is changed, for example, upward or downward. It can be operated as a liquid crystal lens for a geometric conversion lens that moves in one direction of the direction, left direction, or right direction.

  Specifically, in order to move the panoramic landscape in one direction, the liquid crystal lens 20b for the geometric conversion lens in which the orientation direction of the liquid crystal molecules 35 is orthogonal to the liquid crystal molecules 35 of the liquid crystal lens 20a for the geometric conversion lens is described above. By operating in the same manner as the geometric conversion lens liquid crystal lens 20a and simultaneously moving the liquid crystal molecules 35 of the geometric conversion lens liquid crystal lenses 20a and 20b in one arbitrary direction, the same as the arbitrary one direction. It becomes possible to translate the panoramic landscape in one direction.

That is, in the above-described embodiment, the enlargement rate command voltage V _{2, mn} (or the reduction rate command voltage V ′ _{2, mn} ) from the reference voltage applied to the reference electrode 30 and the four rotation command voltages V ^{xy around it.} _The geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d can translate the image in addition to enlargement, reduction, and rotation by the bias voltage to _{1, mn} . In this case, in the geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d, after the pretilt angle is set to 0 degree by the bias voltage, the voltage based on the value corresponds to the parallel movement amount.

  Furthermore, the present invention is not limited to this. The liquid crystal lens for a geometric conversion lens that can execute only the enlargement process and / or the reduction process, the liquid crystal lens for a geometric conversion lens that can execute only the rotation process, and the parallel movement process only. The internal lens portion may be configured by stacking and combining liquid crystal lenses for possible geometric conversion lenses. At this time, in order to obtain a panoramic view equivalent to the above-described embodiment, it is necessary to pay attention to the order of parallel movement processing, enlargement processing and / or reduction processing, and rotation processing.

Further, in the embodiment described above, the liquid crystal molecules 35 magnification command voltage V _{2, mn,} the reduction ratio command voltage _{V'2, mn,} the orientation state by applying a rotation command voltage V ^xy _{1, mn} changes Although the case where the geometric conversion lens that changes the refractive index of the liquid crystal lenses 20a, 20b, 20c, and 20d for the geometric conversion lens is applied has been described, the present invention is not limited to this. Geometries that change the refractive index using various refractive index changing means that change the internal refractive index without changing the external shape of the target member by applying external stimuli such as intermolecular force and radiation from the outside. A scientific conversion lens may be applied.

  In addition, for example, as a method of changing the refractive index of light, a structure in which an indium tin oxide, tungsten oxide, tantalum oxide, aluminum, palladium, and magnesium / nickel alloy thin film are stacked on a glass plate or a plastic substrate. A method of changing the refractive index by changing the transparency of the thin film material by applying electricity and magnetic force from the outside may be applied.

  Further, in the above-described embodiment, the case where the geometric conversion lens using the geometric conversion lens liquid crystal lenses 20a, 20b, 20c, and 20d in which the refractive index of light is changed by the liquid crystal molecules 35 has been described. The present invention is not limited to this, and a geometric conversion lens that converts the refractive index of not only light but also electrons, electricity, magnetic force, atomic / molecular force, radiation, etc. may be applied.

(4-2) Panorama Information Acquisition Unit According to Other Embodiment In FIG. 16, in which parts corresponding to those in FIG. 1 are assigned the same reference numerals, 51 denotes a panorama imaging apparatus according to another embodiment, and the panorama described above The configuration of the panorama information acquisition unit 2 is different from that of the imaging device 1. In the case of this embodiment, the panorama information acquisition unit 52 has a conical shape and has a configuration in which mirrors are provided on all inclined surfaces. The panorama information acquisition unit 52 is arranged so that the apex faces the image sensor, and the apex is arranged on the optical axis of the image sensor 15, and reflects a 360 ° field image reflected on an inclined surface. Thus, the light can enter the lower image sensor 15. Even with the panorama imaging device 51 provided with such a panorama information acquisition unit 52, the same effects as those of the above-described embodiment can be obtained.

  In addition, as a panorama information acquisition unit according to another embodiment, a fish-eye lens made of, for example, glass and having a hemispherical bottom may be used. In this case, the center axis of the panorama information acquisition unit is imaged. It arrange | positions on the optical axis of the element 15, and arrange | positions so that a bottom part may oppose the image pick-up element 15, a panoramic landscape is bent in the said bottom part, and it injects into the image pick-up element 15 below. Even with the panorama imaging device 51 provided with such a panorama information acquisition unit 52, the same effects as those of the above-described embodiment can be obtained. It should be noted that various configurations may be applied to the panorama information acquisition unit. In short, panorama information acquisition units having various configurations may be applied as long as a panoramic landscape over a wide range can be incident on the image sensor 15. .

  Also, as the panorama information acquisition unit, for example, a panorama information acquisition unit that applies a wide range of field of view such as 180 ° or 120 ° of the surroundings to the geometric transformation processing unit 3 in addition to the 360 ° field of view landscape is applied. May be.

  In the above-described embodiment, the case where the panorama information acquisition unit 2 that causes the visible light obtained from the panoramic scenery to enter the geometric conversion processing unit 3 as the panorama information is described as the panorama information acquisition unit. The present invention is not limited to this, and is obtained from a panoramic landscape, for example, infrared rays such as near infrared rays and far infrared rays, photoelectromagnetic waves such as terahertz waves and radiation, magnetism, electricity, electrons, and quantum as a panoramic information. A panorama information acquisition unit that is incident on the screen may be applied. In this case, in the panorama imaging apparatus, a geometric conversion processing unit and an imaging element applicable to the panorama information are used according to the type of panorama information obtained by the panorama information acquisition unit.

DESCRIPTION OF SYMBOLS 1,51 Panorama imaging device 2,52 Panorama information acquisition part 3 Geometric conversion process part 20a, 20b, 20c, 20d Liquid crystal lens for geometric conversion lenses 21 1st board | substrate 22 2nd board | substrate 23 Liquid crystal lens layer (refractive index change layer) )
35 Liquid crystal molecules (refractive index changing means)
30 Reference electrode (second electrode)
31 ITO electrode layer (first electrode)
EL _{2, mn} Expansion / reduction electrode (expansion electrode, reduction electrode)
EL _{1, mn} rotating electrode

Claims (7)

A panorama information acquisition unit that acquires a panoramic landscape and enters the geometric transformation processing unit,
The geometric transformation processing unit
Having a refractive index changing layer enclosing the refractive index changing means between the first substrate and the second substrate, and controlling the orientation of the refractive index changing means by an external stimulus applied to the refractive index changing layer; A panoramic imaging apparatus characterized in that the panoramic landscape is geometrically transformed by changing the orientation of the refractive index changing means. The geometric transformation processing unit
The refractive index changing layer is a liquid crystal lens layer, and the refractive index changing means is a liquid crystal molecule;
The first substrate has a first electrode, the second substrate has a second electrode,
A voltage is applied between the first electrode and the second electrode as the external stimulus, thereby controlling the orientation of the liquid crystal molecules and refracting a light beam by the liquid crystal molecules to geometrically transform the panoramic landscape. The panorama imaging apparatus according to claim 1. The geometric transformation processing unit
The first electrode is provided with a plurality of enlargement / reduction electrodes arranged regularly,
The voltage is applied only to one or more selected enlargement / reduction electrodes among the plurality of enlargement / reduction electrodes, so that the one or more selected enlargement / reduction electrodes are opposed to each other. The panorama imaging apparatus according to claim 2, wherein liquid crystal molecules are controlled in orientation, and the light flux is refracted by the liquid crystal molecules to enlarge and / or reduce the panoramic landscape. The geometric transformation processing unit
The first electrode is provided with a plurality of rotation electrodes arranged regularly,
A voltage is applied to the plurality of rotating electrodes to control the orientation of the liquid crystal molecules facing the rotating electrodes, and the light beam is refracted by the liquid crystal molecules to rotate the panoramic landscape. The panoramic imaging apparatus according to claim 2 or 3. The geometric transformation processing unit
By applying a bias voltage from the second electrode to the first electrode, the alignment of the liquid crystal molecules between the first electrode and the second electrode is controlled, and the light beam is refracted by the liquid crystal molecules to cause the panorama. The panoramic imaging apparatus according to any one of claims 2 to 4, wherein the landscape is moved in parallel. The panorama information acquisition unit
A plurality of reflecting mirrors that reflect the panoramic landscape and enter the geometric transformation processing unit are provided, and of the reflecting mirrors, reflection of a terminal reflecting mirror that finally enters the panoramic landscape to the geometric transformation processing unit The panoramic imaging apparatus according to claim 1, wherein the surface is formed in a flat shape. The panorama information acquisition unit
The visible light obtained from the panoramic landscape, infrared rays, optical electromagnetic waves, magnetism, electricity, electrons, and quantum are incident on the geometric transformation processing unit as panoramic information. 7. The panoramic imaging device described in the item.