JPH09186951A - Image recording and reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reproduce an image smoothly in the case of recording images from plural view points and reproducing an image from a different view point from that at the recording. SOLUTION: An image pickup device 1 picks up an object 3 in time series to detect a posture of the image pickup device 1 at each time and detected view points and visual line direction data are stored in a storage section 5 together with picked-up time series image data. Then the stored image data are rearranged based on the view point and visual line direction data. At reproduction, the image data read from the storage section 5 are displayed on display section 6 based on the view point and visual line direction data received from a view point input section 6.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image recording / reproducing apparatus for recording / reproducing an image of an object viewed from a plurality of viewpoint positions.

[0002]

2. Description of the Related Art Conventionally, as a method of recording a photographed image obtained by picking up a subject and reproducing the subject as an image viewed from a designated viewpoint position, the images are picked up in time series and There has been a method in which the position, orientation, etc. of the image pickup means at the time of image pickup are recorded together with the image, the position and orientation are designated at the time of reproduction, and the image corresponding thereto is reproduced. Another example is a method of dynamically accessing a pair of stereoscopic images selected from a set of images calculated in advance, as disclosed in Japanese Patent Laid-Open No. 6-187424.
In addition, there has been a method proposed by the applicant of the present invention, in which stereoscopic image information is completely obtained in advance and is reproduced in a procedure specified at the time of reproduction.

[0003]

However, in the method of using the images recorded in time series at the time of image capturing, an image of the same subject, the same landscape, the inside of a building, etc. is taken from an arbitrary viewpoint position different from that at the time of image capturing. It was impossible to reproduce naturally at any speed. For example, even if the change in the viewpoint position during playback is the same as during image capture, if the viewpoint change speed during image capture and playback is different, the viewpoint position change during playback is smoothly followed and the change in viewpoint position is abrupt. It was difficult to obtain a reproduced image according to the above.

Further, when the method of changing the viewpoint position and the line-of-sight direction cannot be covered by a single moving image pickup, in order to reproduce the image following the change of the viewpoint, the moving images picked up in a plurality of times are taken. Therefore, it is necessary to jump to one address of a series of time-series images captured at different viewpoint positions (line-of-sight direction) on the recording means during reproduction. For this reason, it is more difficult to reproduce a natural image that can smoothly and smoothly follow a change in the viewpoint position (line of sight) different from that at the time of image capturing. Further, the method of reproducing the image after obtaining the stereoscopic information requires a huge amount of calculation in advance, and thus is not suitable for interactive reproduction in the real image space according to the viewpoint position at the time of reproduction.

Therefore, a first object of the present invention is to provide an image recording / reproducing apparatus capable of smooth and natural image reproduction even when the way of changing the viewpoint position or the line-of-sight direction is different between the time of image generation and the time of reproduction. It is to be. A second object of the present invention is to provide an image recording / reproducing apparatus which can achieve the first object when an image is generated using an image pickup means. A third object of the present invention is to provide an image recording / reproducing apparatus capable of achieving the first object for image data recorded in time series. A fourth object of the present invention is to provide an image recording / reproducing apparatus capable of achieving the first object by detecting a viewpoint position or a line-of-sight direction only with image data.

A fifth object of the present invention is to provide an image recording / reproducing apparatus according to the first object, which is capable of reproducing an image by naturally following a change in a viewpoint position or a line-of-sight direction designated during reproduction. Is. A sixth object of the present invention is to efficiently compress images obtained at different viewpoint positions or line-of-sight directions.
It is an object of the present invention to provide an image recording / reproducing device conforming to the purpose of A seventh object of the present invention is to provide an image recording / reproducing apparatus according to the first object, which generates a reproducible image address by following a change in the viewpoint position and line-of-sight direction at the time of reproduction. An eighth object of the present invention is to provide an image recording / reproducing apparatus according to the fifth object which can perform high-speed image reproduction by limiting the change pattern of the viewpoint position and the line-of-sight direction.

A ninth object of the present invention is to achieve an image reproduction capable of high-speed follow-up with the change of the line-of-sight direction during reproduction when the virtual distance between the viewpoint and the object or the viewpoint position is fixed. To provide an image recording / reproducing apparatus conforming to the above. The tenth object of the present invention is based on the fifth object capable of performing zooming image reproduction in a predetermined direction when the line-of-sight direction during reproduction is fixed or high-speed image reproduction when the viewpoint is moved in the predetermined direction. An object is to provide an image recording / reproducing device. An eleventh object of the present invention is to provide an image recording apparatus conforming to the first object capable of high-speed reproduction depending on the viewpoint position, the line-of-sight direction, and the positional relationship between the subject in the image data.

[0008]

According to the present invention, image data generating means for generating image data, storage means for storing the image data and viewpoint position and line-of-sight direction data corresponding to the image data, and A processing means for rearranging the image data based on the viewpoint position and line-of-sight direction data stored in the storage means is provided.

[0009]

According to the present invention, an image from an arbitrary viewpoint position can be reproduced regardless of the moving image recording order at the time of image capturing.

[0010]

FIG. 1 is a system configuration diagram according to an embodiment of the present invention. The present embodiment is an apparatus for recording and reproducing another viewpoint image of the subject 3. In the figure, reference numeral 1 denotes an image pickup apparatus for obtaining an other-viewpoint image by an operator holding a hand or the like to photograph a subject from an arbitrary position, and 2s and 2g constitute a posture and position detecting means of the image pickup apparatus 1. For example, taking a detection method using magnetism as an example, 2 g is a magnetic field generator and is mounted on the image pickup apparatus 1. 2
Reference numeral s denotes a magnetic field detector, which is used to connect the magnetic field generator 2g to the imaging device 1
A magnetic signal representing the position and orientation of the is input and converted into position / orientation data based on a conversion table or the like. The position
As another example of the attitude detecting means, a mechanical joint equipped with a sensor such as a potentiometer may be used, and the imaging device 1 may be attached to the tip. Reference numeral 4 is an index processing unit, 5 is a storage unit, 6 is an image display unit such as a monitor, and 7 is a viewpoint input device for inputting a viewpoint position / posture during reproduction. The index processing unit and the storage unit are realized by the functions in the microcomputer 8.

The image pickup device 1 is, for example, an electronic camera, and has a lens driving device, a focusing device, an exposure amount adjusting device, a sensor sensitivity adjusting device, a fixed or removable image recording device, and the like, which are not shown. As the attitude / position detecting means 2s and 2g, commercially available products are Polhemu.
s company's FASTRAK ^™ and Ascension Tec
FlockofBirds from hnologies
Magnetic detection type sensor means such as ^TM (above product name) is used. By using this, the three-dimensional position of the imaging device 1,
Attitude data can be extracted in almost real time.

FIG. 2 shows the main configuration of the index processing unit 4, which includes an image transfer unit 41, a position / orientation data reading unit 43 that operates in synchronization with the image pickup apparatus 1, and an image index generation using the position / orientation data as a search index. , A writing unit 42 and the like.

FIG. 3 shows the main configuration of the storage unit 5, which is an image data read / write unit 51 for reading and writing image data, an index read unit 52 for reading an index from the image data, and an index rearrangement unit 5.
3. An image data rearrangement unit 54 capable of rearranging images from an arbitrary viewpoint during image reproduction, a recording medium 55 such as a memory, and the like.

The processing procedure performed in the microcomputer 8 will be described below. As parameters obtained by the posture / position detecting means 2s and 2g, a three-dimensional position vector of the image pickup apparatus 1 is expressed as (X, Y, Z), and a posture direction is expressed as θ and φ. Here, θ and φ represent the optical axis direction of the imaging device 1, and the longitude (XY) defined on the absolute coordinate system set at the object center.
In-plane angle with respect to X-axis) Latitude (angle with Z-axis)
Are respectively shown.

First, an index writing control and transfer control method of image data in the index processing unit 4 will be described. Index generation and writing unit 4
2 is taken in with respect to the position / orientation data of the imaging device which is taken in by the position / orientation data reading unit 43 in synchronization with the image data sent from the imaging device 1 via the image transfer unit 41 at a predetermined frame rate. The position / orientation parameter estimation corresponding to the image is performed in accordance with a predetermined prediction function, using a prediction filter such as a Kalman filter in consideration of noise and time delay of the sensor output. Furthermore, in order to simplify the rearrangement process in the index generation / writing unit 42, the distance from the origin r = (X ² + Y ² + Z
² ) ^1/2 is monitored at any time, and when it reaches a predetermined value, the posture indexes θ and φ are added to the header area assigned in advance in the image data and the result is transferred to the storage unit 5. FIG.
Shows a writing format example of the position / orientation index given to each image.

Next, a method of rearranging image data in the storage unit 5 will be described. In the present embodiment, when a disk type disk medium such as an optical (magnetic) disk is used as the storage medium 55, the image data arranged on the same track has a latitude index in the circumferential direction at a predetermined interval (for example, an interval of 5 degrees). Rearrange to align. At this time, it is not necessary for the data on the same radius (track) to have the same longitude index, but image data with the same longitude index is basically arranged on the same track, but it is arranged across adjacent tracks. May be. The longitude indexes are arranged at a predetermined interval in the radial direction from small to large (or vice versa). By rearranging the images in ascending order (descending order) with respect to the posture or the position index in this way, the images are taken at temporally different positions (for example, the same subject is imaged a plurality of times with different viewpoint parameters). However, if the distance between the indexes is small, the difference between the frame numbers or addresses after rearrangement is small (for example, they are adjacent to each other).

By making the array of the indexes (or the corresponding position / orientation data) at a constant minute interval, the follow-up response characteristic with respect to the change of the viewpoint position and the line-of-sight direction at the time of reproduction is remarkably improved. That is, it becomes possible to perform image reproduction in which changes in the viewpoint position and the line-of-sight direction are gradually changed or the change patterns thereof are smoothly followed. In particular, when the position of the viewpoint and the direction of the line of sight at the time of reproduction are directly operated by using a detection means such as a mouse or an operating lever, the viewpoint signal is estimated using a prediction filter (Kalman filter, etc.) for the detection signal, and the corresponding image You may play in search of an index.

In order to speed up the rearrangement process, corresponding image data areas may be allocated on the recording medium 55 in advance so that the index data are arranged at predetermined intervals.
In that case, the index may be written in the recording medium 55 in advance. In addition, the index data transferred from the index processing unit 4 is judged, and if it is equal to any of the preset index values (or the difference from the set value is less than or equal to a predetermined threshold value), the corresponding on the recording medium is dealt with. Image data may be recorded in the setting area. When writing image data to the posture index address that has been set in this way,
The entire recording area is not always filled at the end of the imaging operation. In this case, the rearrangement may be performed so that the empty data area disappears after the imaging operation is completed. However, as described above, the arrangement order is basically such that the longitude index is the same on the same track and the latitude index is from small to large (or vice versa).

Regarding when and at what timing the above-mentioned rearrangement of image data is performed, the following four ways can be mentioned. (1) Rearrangement is performed after the image acquisition from the image pickup apparatus is once completed. (2) Sequential rearrangement is performed every time an image is captured from the imaging device. (3) Rearrange at regular intervals. (4) Sequential rearrangement is performed every time a fixed amount is transferred according to the amount of image data transferred from the processing unit 4.

Any of the above methods may be used depending on the reproduction purpose. In particular, (1) or (3) is desirable when priority is given to high-speed capturing of the subject image. When it is desired to shorten the rearrangement processing time without giving priority to the image capturing speed, any one of (2), (3), and (4) may be used.
The method (3) or (4) enables control of the image capturing speed and rearrangement speed. It should be noted that the rearranged image data sequence (not necessarily the time-series image data at the time of image capturing as described above) obtained in the above-described manner is similar to normal moving image compression (method MPEG, Motion-JPEG, etc.). The above method may be applied for compression.

Next, a second embodiment will be described.
In the present embodiment, memory rearrangement is performed based on the viewpoint movement pattern designated by the reproducing means. The trajectory pattern that represents the change in the viewpoint position or direction is reconstructed in advance as virtual time-series data, and the image data string corresponding to the movement of the specified pattern is arranged and stored in the cache memory, etc., and is specified during playback. The image is generated at high speed according to the movement of the generated viewpoint. In this case, index information may not be added at the time of rearrangement. At the time of rearrangement, the index sequence corresponding to the specified ordered sequence pattern can be automatically obtained by using the reference table or the conversion formula of the viewpoint position parameter and the index.

In particular, the constraints of the first embodiment are relaxed, and the posture / position parameters of the image pickup apparatus 1 are used.
Prepare a plurality of sequence patterns such that the change of the viewpoint state draws one trajectory in the dimensional space (X, Y, Z, θ, φ), and correspond to the sequence pattern of the viewpoint position / orientation designated at the time of reproduction. After rearranging the image data sequence or index sequence, the image is reproduced at high speed. For example, as in the case of the first embodiment, when the image captured from different viewpoint positions of the specific subject (which has already been captured under a plurality of viewpoint position / orientation conditions) is reproduced, the specified viewpoint position change While the pattern maintains the distance r from the origin, the viewpoint position is a predetermined plane aX + bY + cZ = d and the spherical surface X ² + Y.
It is assumed that the vehicle moves on the circumference of the circle which is the intersection curve with ² + Z ² = r ² . Alternatively, the sequence pattern may be displayed on the terminal in a menu format, and detailed parameter settings may be performed for the selected pattern.

Further, when changing the viewpoint parameter of the image at the start of reproduction after rearrangement, the corresponding start index value and start image address are obtained from the given initial viewpoint parameter from the reference table, and the subsequent images are obtained. Rows can be played. In particular, when the trajectory of the viewpoint parameter is closed in the five-dimensional space, the index of the first image for reproduction after the initial value of the viewpoint parameter is changed is adjacent to the index of the last image on the trajectory of the viewpoint parameter (in short, the trajectory is You can repeat the rearrangement as in (close).

In addition, reproduction may be performed with a plurality of designated viewpoint movement patterns. This makes it possible to complicate the change in the viewpoint position and preset an arbitrary viewpoint movement pattern. It is also possible to change the parameters of the equation that specifies the sequence pattern, and to specify the start point and end point coordinates (in the five-dimensional space) of each pattern.

Next, a third embodiment will be described.
In the present embodiment, a real shot or rearrangement of CG image data is performed so as to enable real-time follow-up of image display with respect to a predetermined change in the viewpoint position / direction designated by the reproducing means during image reproduction. Here, as in the second embodiment, the locus of the viewpoint change in the state space is not specified in advance, but the distribution range in the line-of-sight direction is known in advance (the range of the direction of the viewpoint from time to time in the forward movement is a certain range). When changing with), etc. When recording and reproducing live-action images, a gyroscope, odometer, and multiple imaging devices with different optical axis directions are installed on the moving body, and the inside and outside of the building are measured while measuring the position and running distance of the moving body. You just have to take a picture of the scenery and the streets. In the present embodiment, for images from each imaging device,
Index data is generated based on the position of the moving body and the unique line-of-sight direction data. In this case, the posture index does not change with respect to the image pickup apparatus, but it goes without saying that the position of the moving body changes momentarily during image pickup. If each of the image pickup devices is installed at a predetermined interval in the line-of-sight direction, it is particularly desirable that the moving body position or the travel distance index be sampled at a constant interval and recorded in the storage unit 5 together with the image data.

Here, in particular, a case will be described in which a detecting means such as a mouse or an operating lever is used for direct operation, and the virtual viewpoint at the time of reproduction changes the line-of-sight direction while moving the center of gravity in a predetermined direction. FIG. 4 shows the storage unit 5 according to this embodiment.
A configuration example of (a portion surrounded by a dotted line) and a viewpoint input unit 7 during reproduction are shown. In FIG. 4, in addition to the configuration of FIG. 3, a high-speed image transfer memory (cache memory) is provided corresponding to N discrete line-of-sight directions with respect to the moving direction.
56, a multiplexer 57, and a control unit 58 that performs switching control by the multiplexer 57, prediction of a reproduction address position, and the like based on information from the viewpoint input unit 7. In this case, the image data string arranged in each cache memory 56 is re-created so that the posture index indicating the line-of-sight direction is constant and the position index (for example, moving distance) is updated at predetermined intervals. It is assumed that they are arranged. In the case of this embodiment,
Point-of-view position (moving distance) during playback by synchronization means (not shown)
The addresses may be updated in synchronization between the memories so that and the start image address of each cache memory always correspond to each other.

When the viewpoint looks around at a specific place in the virtual space during reproduction, images with different line-of-sight directions at the same position index are arranged at the head addresses of the memories 56 and reproduced by the multiplexer 57. The images may be switched, or images having the same position index may be rearranged in the order of the line-of-sight direction and recorded in a predetermined image memory (not shown) before being reproduced, as described above. Further, a smooth image can be reproduced by automatically generating an interpolated image sequence using an affine transformation or the like for an image in an intermediate direction of the line-of-sight direction set in advance.
In addition, it is possible to reproduce an object image including a background while changing the viewpoint position around a specific object by using the first embodiment together. In this case, the CG image from the predetermined viewpoint position based on the three-dimensional shape model of the object may be combined with the background. As a result, it is possible to perform viewpoint-following (interactive) image reproduction having a high response speed and a wide reproduction range, particularly walk-through of a photographed image space and continuous viewpoint conversion reproduction of an object.

Next, a fourth embodiment will be described.
In the present embodiment, as shown in FIG. 5, a large number of image pickup devices 1 coupled by a synchronizing means are provided in a dome-shaped hemisphere, and a still image or a moving image of a subject in the hemisphere is picked up in each of them. The present embodiment is particularly effective for reproducing a moving image from an arbitrary viewpoint position or an arbitrarily changing viewpoint position (or line-of-sight direction) when the subject is accompanied by motion such as movement or deformation. . FIG. 5 shows the arrangement of the image pickup apparatus 1 and the configuration of the index processing unit 4 connected to each. The three-dimensional position and the optical axis direction of each image pickup device 1 are known and fixed, and the images obtained by synchronizing the image pickup devices with each other have unique viewpoint positions and
The posture index is added by the index processing unit 4 according to the format of FIG.
The index processing unit 4 may be built in the imaging device 1.

After the rearrangement, the posture parameters used in the first embodiment are continuously reproduced on a predetermined orbit designated in advance. In this case, as shown in FIG. 6, the interpolation image generation unit 59 automatically generates an image at an intermediate viewpoint position between adjacent imaging devices (or between adjacent image indexes).

Below, assuming that the line-of-sight direction changes Δφ and Δθ between adjacent image pickup devices 1 are larger than the update amount (increase / decrease) of the line-of-sight direction change used in the first embodiment, an example of interpolation image generation processing Will be explained. In particular, if the line-of-sight direction is (θ _i ,
The line-of-sight direction between the images obtained at the same time by the two imaging devices 1 of (φ _i ) and (θ _i , φ _{i + 1} ) is φ _ij = φ _i + (j /
n) An example will be described for the case of generating an image sequence given by Δφ. The processing is similar in other cases.

[1] Orthogonal proper coordinate system C _i , C _{i + 1} defined on each image pickup device (the origin is a common position with the principal point, the Z axis is the line-of-sight direction, and the X and Y axes are basically sensors. Affine transformation is performed on the in-plane) to obtain the intrinsic coordinate system C _ij having the j-th line-of-sight direction. [2] Extract corresponding points between images from the two image pickup devices. For the corresponding point extraction processing, an existing method such as block correlation processing between two images centering on each point on the image may be used.

[3] Three-dimensional coordinate calculation of corresponding points (represented by the unique coordinate system of one image pickup device). [4] Map the corresponding points on the image as a projected image on the coordinate system after conversion. [5] A point having no corresponding point in the other image is considered to be on the image plane determined by the specifications of the image pickup optical system, and one image pickup device coordinate system is set in the coordinate system C _ij specific to the line-of-sight direction (φ _ij ). The pixel value (luminance, hue) of the point after mapping is the same as the point before mapping, by performing a geometrical transformation (3D affine transformation, etc.).

By generating the interpolated image sequence by the above method, it is possible to continuously perform image reproduction that follows changes in the viewpoint position even if images from a small number of image pickup devices having different line-of-sight directions are recorded. However, the interpolation image generation method is not particularly limited to this. In the case of the present embodiment, the interpolation image sequence is generated in advance before the image reproduction, so that the image reproduction according to the viewpoint position can be performed at high speed.

The arrangement of the image pickup device 1 is not limited to that shown in FIG. 5, and may be, for example, on a cylindrical surface surrounding the subject, or on the wall surface or ceiling surface in the building. In these cases, an index showing the position peculiar to the image pickup apparatus is required.

Next, a fifth embodiment will be described.
FIG. 7 shows a system configuration diagram of the present embodiment. In the present embodiment, a compound eye camera 1A is used as the imaging device 1, and the position and orientation of the compound eye camera 1A are detected by processing image data obtained by placing the subject 3 on the camera calibration pattern 8. And The present inventor has proposed this processing method. Other processes such as index generation and rearrangement are the same as those in the first embodiment.

[0036]

As described above, according to the first aspect of the present invention, an image from an arbitrary viewpoint position can be reproduced regardless of the moving image recording order at the time of image capturing. Also, according to the second aspect, an image from an arbitrary viewpoint position can be reproduced at high speed regardless of the moving image recording order at the time of imaging and the way of changing the viewpoint position at the time of imaging. According to the third aspect, it is possible to reproduce an image from an arbitrary viewpoint position by an arbitrary reproduction procedure even after capturing images in time series. According to the fourth aspect of the invention, it is possible to reduce the weight and size of the imaging means without mounting any special position / orientation detecting means.

According to the fifth aspect of the invention, it is possible to perform image reproduction that follows changes in the viewpoint position during reproduction. According to the sixth aspect of the present invention, it is possible to achieve the capacity saving and the compactness of the storage means and to efficiently compress the multi-viewpoint / non-time series image data sequence. According to the seventh aspect, the images can be rearranged in the viewpoint position at the time of reproduction, or in the ascending order (or descending order) of the line-of-sight direction. According to the eighth invention, it is possible to perform high-speed reproduction of an image according to the viewpoint position by limiting the number of parameters.

According to the ninth aspect, it is possible to perform high speed reproduction of an image which changes only in the line-of-sight direction during reproduction. According to the tenth aspect, it is possible to perform high-speed image reproduction while continuously zooming images in a specific direction or walking through the virtual space during reproduction. According to the eleventh aspect, it is possible to perform high-speed image reproduction according to the viewpoint position change pattern.

[Brief description of the drawings]

FIG. 1 is a configuration diagram showing a first embodiment of the present invention.

FIG. 2 is a block diagram showing the configuration of an index processing unit.

FIG. 3 is a block diagram showing an internal configuration of a storage unit.

FIG. 4 is a block diagram showing a configuration of a storage unit when a plurality of image pickup devices having different line-of-sight directions are mounted on a moving body according to the third embodiment to record an image.

FIG. 5 is a configuration diagram showing an arrangement of an image pickup device according to a fourth embodiment.

FIG. 6 is a block diagram showing a configuration of a recording unit when rearrangement of images and generation of an interpolated image sequence from images between imaging devices.

FIG. 7 is a configuration diagram showing a system configuration when the position / orientation of the image pickup apparatus according to the fifth embodiment is detected by a calibration pad.

FIG. 8 is a configuration diagram showing an example of an image format including an index.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Image pickup means 2 Posture / position detection means 4 Index processing unit 5 Storage means 7 Viewpoint position / posture input section during reproduction 8 Calibration pad 41 Image transfer means 43 Position / posture data reading means 42 Image index generation / writing means 51 Image data recording medium 52 Index reading means 53 Index rearranging means 54 Image data rearranging means

Claims (15)

[Claims] 1. Image data generating means for generating image data, the image data and a viewpoint position corresponding to the image data,
An image recording / reproducing apparatus comprising: storage means for storing line-of-sight direction data; and processing means for rearranging the image data based on the viewpoint position and line-of-sight direction data stored in the storage means. 2. The image data generating means comprises image pickup means and detection means for detecting the position and orientation of the image pickup means to obtain the viewpoint position and line-of-sight direction data.
2. The image recording / reproducing apparatus according to claim 1, further comprising an index processing unit that generates an index of an image based on the line-of-sight data, and stores the image data at the time of imaging and the index in the storage unit. 3. The image data generating unit generates image data in time series and stores the image data in the storage unit, and then the processing unit rearranges the image data based on the index. The image recording / reproducing apparatus according to claim 2. 4. The image recording / reproducing apparatus according to claim 2, wherein the detecting means detects the position and orientation of the image pickup means by processing the image data. 5. The processing means rearranges the image data having the index so that the viewpoint position and line-of-sight direction data are arranged at predetermined intervals. The image recording / reproducing apparatus according to item 1. 6. The image according to claim 1, wherein the processing means compresses and encodes the image data by using the image data at an adjacent or near address of the storage means after rearranging the image data. Recording / playback device. 7. A viewpoint position and line-of-sight direction input means at the time of image reproduction, an address generating means for generating an image address on the storage means based on the viewpoint position and the line-of-sight direction, and an output means for outputting an image of the address. The image recording / reproducing apparatus according to claim 1, further comprising: 8. The image recording / reproducing apparatus according to claim 7, wherein the address generating means generates an address using one viewpoint position parameter and two line-of-sight direction angle parameters. 9. The processor according to claim 1, wherein the processing means rearranges image data having a fixed distance between a viewpoint position and a predetermined point and different line-of-sight directions using only the line-of-sight direction data. Image recording / reproducing device. 10. The image recording / reproducing apparatus according to claim 1, wherein the processing means rearranges image data having a fixed line-of-sight direction and different distances between a viewpoint position and a predetermined point. 11. The image recording / reproducing apparatus according to claim 1, wherein the image data after the rearrangement of the storage unit is collectively transferred to another storage unit. 12. A disk medium is used as the storage means, the index processing means creates a latitude index and a longitude index, and the processing means stores image data arranged on the same track of the disk medium. The rearrangement is performed so that the latitude indexes are arranged at a predetermined interval in the circumferential direction, and the image data having the same longitude index are basically arranged on the same track. The described image recording / reproducing apparatus. 13. The image recording / reproducing apparatus according to claim 1, wherein the rearrangement by the processing means is performed every time an image is fetched from the image data generating means. 14. The image recording / reproducing apparatus according to claim 1, wherein the rearrangement by the processing means is performed at regular intervals. 15. The image recording / reproducing apparatus according to claim 1, wherein the rearrangement by the processing means is performed for each fixed amount of image data.