JPH0877368A - Image processing method and device therefor - Google Patents

Abstract

PURPOSE: To provide an image processing method by which various kinds of image displays can be performed without increasing the load of a CPU and device therefor. CONSTITUTION: The rotation parameter stored in a parameter RAM 60 by a CPU is read by a matrix arithmeitc circuit 66 and a matrix calculation is performed based on the read parameter. A coefficient is read from a coefficient RAM 61 by a coefficient RAM access circuit 62, and coordinates X and Y are calculated based on the arithmetic result of the matrix aritmethic circuit and the coefficient by a product sum arithmetic circuit 65. When a screen performs a screen axis rotation, the calculation based on the rotation parameter is performed by the product sum arithmeitc circuit 65. At this time, the reading of the parameter is performed for every screen or for every line. The coefficient read from the coefficient RAM 61 can be set to various kinds of parameters.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing method and apparatus for performing image movement conversion processing and image rotation conversion processing.

[0002]

2. Description of the Related Art Conventionally, in an image processing device used in a game machine, a plurality of background images (still images) displaying a background are displayed.
In addition, a foreground image (moving image) for displaying a character appearing in the game is overlaid and displayed on the screen of the raster scan monitor. Such an image processing apparatus is provided with a scroll function of moving or rotating the background image vertically and vertically. In the scroll screen displayed by this scroll function, the foreground image displaying the character is fixed at approximately the center of the screen screen, and the background image is moved with respect to this.
Even if the background image is moved, in the actual calculation in the image processing device, the background image side is a virtual still image stored in the image memory of the image processing device, and the information about this image is converted. However, such a calculation, that is, a process of moving the background image is not performed. The graphical image of the actual calculation is such that the frame of the screen screen and the viewpoint of the player move freely over the entire background image stored in the image memory. The screen screen is a virtual screen that is set for each circuit that performs movement conversion or rotation conversion, but from the viewpoint of an image display screen, it is a monitor screen of the display device. You can think of it.

Further, the following processing method is adopted as the arithmetic processing for moving and rotating the scroll screen which is the background image.

For each line of the background image, the X and Y coordinates of the starting point (left end) and the horizontal increments ΔX and ΔY are calculated from the formula of movement and rotation.

For each line, horizontal increments ΔX and ΔY are added to the X and Y coordinates of the starting point in dot periods.

The position coordinates of each pixel are calculated.

The image memory is accessed at the address corresponding to the position coordinates to generate the image data of the background image.

Specifically, as the screen coordinate calculation, the start coordinate value of the scroll screen and the horizontal coordinate increment are obtained for each line by software, and the calculation is performed based on them.

[0009]

By the way, when the background image is moved and rotated as a scroll screen as described above, the X,
It is necessary to calculate the Y coordinate and the horizontal increments ΔX and ΔY by software. Therefore, the CPU requires a large amount of overhead for the calculation for moving and rotating. As a result, there is a problem that the load on the CPU increases and other processing executed by the CPU is limited.

The present invention has been proposed in view of the above problems of the prior art, and its main purpose is to provide CP.
An object of the present invention is to provide an image processing method and apparatus capable of displaying various images without increasing the load on U.

The object of the present invention will be described in more detail. In the following description, the item numbers of the respective objects substantially correspond to the item numbers of the claims, but the inventions of the respective claims are not limited to the respective items but achieve one or more of the objects described below. It was made to do.

It is a first object of the present invention to provide an image processing method capable of displaying various images while reducing the load on software.

A second object of the present invention is to provide an image processing method capable of changing parameters for each line while reducing the load on software.

A third object of the present invention is to provide an image processing method capable of changing parameters in various ways.

A fourth object of the present invention is to provide an image processing apparatus which can realize the first object with a simple structure.

A fifth object of the present invention is to provide an image processing apparatus which can realize the above second object with a simple structure.

A sixth object of the present invention is to provide an image processing apparatus which can realize the third object with a simple structure.

A seventh object of the present invention is to provide an image processing apparatus which can realize the above fourth to sixth objects by hardware.

An eighth object of the present invention is to reduce the load on the CPU by performing coordinate conversion processing by hardware and to enlarge or reduce or distort the image in the horizontal or vertical direction. An object is to provide an image processing device capable of

A ninth object of the present invention is to provide an image processing apparatus capable of displaying various images with a simple structure by using coefficients for various parameters.

A tenth object of the present invention is to provide an image processing apparatus capable of rotating the screen axis of the screen while reducing the load on the CPU.

An eleventh object of the present invention is to provide an image processing apparatus capable of displaying various images by changing parameters for each line when the screen axis is rotated.

[0023]

In order to achieve the above object, an image processing method according to the invention of claim 1 reads out image data of an image to be displayed on a monitor from an image memory, and creates an image based on the image data. In an image processing method for generating a signal, a plurality of parameters used for calculation of coordinate conversion processing are calculated in advance and stored in a parameter memory, and a coefficient for one monitor screen is stored in a coefficient memory for each pixel. The plurality of parameters are read from the parameter memory for each monitor screen, the coefficients are read from the coefficient memory, the coordinate conversion processing is performed based on the parameters and the coefficients, and the read address of the image memory is generated. It is characterized by doing.

The image processing method according to a second aspect of the present invention is the image processing method according to the first aspect, wherein the parameters stored in the parameter memory are rewritten for each line of one monitor screen, and the parameters are rewritten for each line from the parameter memory. It is characterized in that the plurality of parameters are read out.

An image processing method according to a third aspect of the present invention is the image processing method according to the first or second aspect, wherein at least one of a plurality of parameters for reading the coefficient stored in the coefficient memory for each pixel from the parameter memory. 1
It is characterized in that the above-mentioned calculation is performed by substituting each parameter.

An image processing apparatus according to a fourth aspect of the present invention reads out image data of an image to be displayed on a monitor from an image memory and generates a video signal based on the image data. A CPU that specifies a plurality of parameters and coefficients used for
A parameter memory for storing the plurality of parameters,
A coefficient memory that stores the coefficients for one monitor screen for each pixel, and a plurality of parameters stored in the parameter memory are read in screen units, and the coefficients are read from the coefficient memory to obtain the parameters and the coefficients. An address generating unit that performs a coordinate conversion process calculation based on the coordinate conversion process and generates a read address of the image memory is provided.

An image processing apparatus according to a fifth aspect of the present invention is the image processing apparatus according to the fourth aspect, wherein the CPU rewrites the parameters stored in the parameter memory for each line of the monitor, and the address generation means It is characterized in that the parameters are read in units of the lines and the calculation is performed based on the parameters.

An image processing apparatus according to a sixth aspect of the present invention is the image processing apparatus according to the fourth or fifth aspect of the invention, wherein the address generating means is provided with a plurality of parameters for reading the coefficients stored in the coefficient memory from the parameter memory. It is characterized in that the calculation is performed by substituting at least one of these parameters.

According to a seventh aspect of the present invention, in the image processing apparatus according to the fourth, fifth or sixth aspect, the address generating means has a matrix arithmetic circuit for performing matrix arithmetic based on the parameters, and the matrix. It is characterized by having a product-sum operation circuit for calculating a coordinate value based on an operation result and the coefficient.

The image processing apparatus according to the present invention represents the viewpoints of the rotation matrix parameters A to I and the screen screen before coordinate conversion (Px, Py, P).
z), which represents the center point in the coordinate conversion (Cx, Cy, C
z), (Mx, My, Mz) representing the amount of parallel movement, a perspective transformation coefficient k, and a CPU for designating a predetermined coefficient;
A to F, Px, Py, Pz, Cx, Cy of
A parameter memory that stores Cz, Mx, and My as rotation parameters, a register in which the perspective transformation coefficient k is set, a coefficient memory that stores a coefficient for one screen screen for each pixel, and a rotation parameter from the parameter memory. Based on (Sx, Sy, Sz) representing a predetermined point on the screen screen before reading and coordinate conversion and the rotation parameter, matrix calculation of the following formulas (1) and (2) is performed to perform each pixel Represents the viewpoint after coordinate conversion of (Xp,
Yp, Zp) and a matrix operation circuit for calculating (Xs, Ys, Zs) representing a predetermined point on the screen screen after coordinate conversion,

(Equation 5)

(Equation 6) The coefficient is read from the coefficient memory, and the following equation (4) is calculated from Xp, Yp, Xs, and Ys of each pixel, the perspective conversion coefficient k set in the register, and the coefficient, and the coordinate is calculated. The product-sum operation circuit for calculating X and Y and X = k (Xs−Xp) + Xp Y = k (Ys−Yp) + Yp k = −Zp / (Zs−Zp) (4) The arithmetic circuit is characterized in that at least one of k on the X coordinate side and k on the Y coordinate side in the equation (4) is replaced with a coefficient read from the coefficient memory to perform the arithmetic operation.

The image processing apparatus according to the present invention represents the viewpoints of the rotation matrix parameters A to I and the screen screen before coordinate conversion (Px, Py, P).
z), which represents the center point in the coordinate conversion (Cx, Cy, C
z), (Mx, My, Mz) representing the amount of parallel movement, a perspective transformation coefficient k, and a CPU for designating a predetermined coefficient;
A to F, Px, Py, Pz, Cx, Cy of
A parameter memory that stores Cz, Mx, and My as rotation parameters, a register in which the perspective transformation coefficient k is set, a coefficient memory that stores a coefficient for one screen screen for each pixel, and a rotation parameter from the parameter memory. Based on (Sx, Sy, Sz) representing a predetermined point on the screen screen before reading and coordinate conversion and the rotation parameter, matrix calculation of the following formulas (1) and (2) is performed to perform each pixel Represents the viewpoint after coordinate conversion of (Xp,
Yp, Zp) and a matrix operation circuit for calculating (Xs, Ys, Zs) representing a predetermined point on the screen screen after coordinate conversion,

(Equation 7)

[Equation 8] The coefficient is read from the coefficient memory, and the following equation (4) is calculated from Xp, Yp, Xs, and Ys of each pixel, the perspective conversion coefficient k set in the register, and the coefficient, and the coordinate is calculated. The product-sum operation circuit for calculating X and Y and X = k (Xs−Xp) + Xp Y = k (Ys−Yp) + Yp k = −Zp / (Zs−Zp) (4) The arithmetic circuit replaces at least one parameter of the parameters including k on the X coordinate side, k on the Y coordinate side, Xp of each pixel, and Yp in the equation (4) with a coefficient read from the coefficient memory. It is characterized by performing the calculation.

The image processing apparatus according to the tenth aspect of the present invention indicates the start coordinates of the screen screen (Xst, Y).
st, Zst), CPU indicating horizontal coordinate increment of screen screen (ΔX, ΔY), and vertical coordinate increment of screen screen (ΔXst, ΔYst)
And Xst, Yst, Δ for each screen screen
Parameter memory for storing X, ΔY, ΔXst, and ΔYst, and the Xs stored in the parameter memory
t, Yst, ΔX, ΔY, ΔXst, ΔYst are read out for each screen of the screen screen, and based on them, the following formula (7) is calculated to calculate the coordinates Sx, Sy of the screen screen. It is characterized by including a product-sum calculation circuit for calculating and Sx = Xst + ΔX · Hcnt + ΔXst · Vcnt Sy = Yst + ΔY · Hcnt + ΔYst · Vcnt (7).

An image processing apparatus according to an eleventh aspect of the present invention is the image processing apparatus according to the tenth aspect, wherein the CPU has the Xst, Yst, and Δ in the parameter memory.
X and ΔY are rewritten for each line of the screen screen, and the product-sum calculation circuit reads the Xst, Yst, ΔX, and ΔY stored in the parameter memory for each line of the screen screen. It is characterized in that the calculation of the equation (7) is performed.

[0034]

According to the first aspect of the present invention, a plurality of parameters used for the calculation of the coordinate conversion process are stored in the parameter memory, and the coefficients for one monitor screen are stored in the coefficient memory for each pixel. The parameter is read once for each monitor screen, and the coordinate conversion processing is performed based on this parameter and the coefficient read from the coefficient memory. Therefore, it is not necessary to calculate the parameter and the coefficient during the calculation.

According to the second aspect of the invention, since the parameter is read out for each line of one monitor screen, different coordinate conversion processing operations are performed on the image data of each line to generate a read address. You can
Therefore, for example, it becomes possible to display a distorted image, a swaying image, and the like on a line-by-line basis.

According to the third aspect of the present invention, at least one parameter of the plurality of parameters stored in the parameter memory can be replaced with a coefficient set for each pixel. It is also possible to change every time, and various image displays can be realized.

According to the fourth aspect of the present invention, the plurality of parameters and coefficients designated by the CPU are stored in advance in the parameter memory and the coefficient memory, and the parameters are read out by the address generating means on a screen-by-screen basis. The coordinates are read out and the calculation of the coordinate conversion processing is performed based on them. Therefore, the CPU does not need to specify the parameter and the coefficient when performing the coordinate conversion process,
The load on the CPU is reduced.

According to the fifth aspect of the present invention, the address generating means reads out the parameters for each line of one monitor screen, so that it is possible to perform the operation based on the different parameters on a line-by-line basis. Etc. can be displayed.

According to the sixth aspect of the invention, the address generating means can replace at least one parameter of the plurality of parameters read from the parameter memory with a coefficient set for each pixel. It is possible to change the parameter for each pixel.

According to the seventh aspect of the invention, the load on the CPU can be reduced because the matrix arithmetic circuit and the product-sum arithmetic circuit perform arithmetic processing by hardware.

According to the eighth aspect of the present invention, the CPU represents the rotation matrix parameters A to I and the viewpoint on the screen screen before coordinate conversion (Px, Py, P).
z), which represents the center point in the coordinate conversion (Cx, Cy, C
z), (Mx, My, Mz) representing the amount of parallel movement, the perspective transformation coefficient k, and a predetermined coefficient, of which A to
F, Px, Py, Pz, Cx, Cy, Cz, Mx, My
Is stored in the parameter memory, k is set in the register, and the coefficient is stored in the coefficient memory. The matrix calculation circuit, based on the rotation parameter and (Sx, Sy, Sz) representing a predetermined point on the screen screen before coordinate conversion,
By performing the matrix calculation of the equations (1) and (2), the viewpoint after coordinate conversion of each pixel is represented (Xp, Yp, Zp) and the predetermined point on the screen screen after coordinate conversion is represented (Xs,
Ys, Zs) is calculated. The product-sum control circuit uses the above X
Based on p, Yp, Xs, Ys, the coefficient, and the perspective transformation coefficient k, the equation (4) is calculated to calculate the coordinates X, Y. In this way, the CPU specifies each parameter and coefficient in advance, and the matrix calculation circuit and the product-sum calculation circuit calculate the coordinates during the calculation of the coordinate conversion process.
The load on U is reduced. Further, according to the present invention, of the perspective transformation coefficients k set in the register, either or both of the k on the X coordinate side and the k on the Y coordinate side are converted into the coefficient stored in the coefficient memory. Replace and calculate. By converting the value of k in this way, the image can be enlarged or reduced in the horizontal direction or the vertical direction.

According to the ninth aspect of the invention, of the perspective transformation coefficient k set in the register, a parameter including k on the X coordinate side and k on the Y coordinate side, and parameters including Xp and Yp of each pixel. Among them, at least one parameter is replaced with the coefficient stored in the coefficient memory to perform the calculation.

According to the tenth aspect of the invention, the CPU
Indicates the start coordinates of the screen screen (Xst, Y
st, Zst), indicating the horizontal coordinate increment of the screen screen (ΔX, ΔY), and indicating the vertical coordinate increment of the screen screen (ΔXst, ΔYst) are specified in the parameter memory. Xst, Yst, △ X, △
Y, ΔXst, and ΔYst are stored for each line. Further, the product-sum calculation circuit reads out the parameters stored in the parameter memory only once for one screen screen, performs the calculation of equation (7), and coordinates S on the screen screen.
Calculate x and Sy. As a result, it becomes possible to perform a rotation process centered on an axis (screen axis) perpendicular to the screen screen of the screen screen.

According to the eleventh aspect of the present invention, the product-sum operation circuit is rewritten by the CPU for each line of the screen screen Xst, Yst, ΔX, ΔY, ΔXs.
Since t and ΔYst are read out and the calculation is performed, it is possible to display a distorted image, a swaying image, and the like in line units.

[0045]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of an image processing apparatus according to the present invention will be described below with reference to the drawings.

A. Configuration of Embodiment FIG. 1 is a block diagram showing an embodiment of an image processing apparatus according to the present invention. In the figure, a bus 15 is connected to a CPU 15 that controls the entire system, a ROM 16 that stores a program, a sprite engine 17 that performs image processing of a foreground image, and a scroll engine 18 that performs image processing of a plurality of background images. There is. Further, the sprite engine 17 is connected to a command RAM 19 for storing command data from the CPU 15 and foreground image data, and a frame buffer 20 for expanding the foreground image data. To the scroll engine 18, a video RAM (hereinafter, referred to as VRAM) 21 that stores image data for each dot of a background image and a color RAM 22 are connected.

<Sprite Engine 17> The sprite engine 17 selects and reads image data of a foreground image such as a character from the command RAM 19 and rotates, enlarges,
After processing such as reduction and color calculation, it is written in a predetermined address of the frame buffer 20. The sprite engine 17 also sequentially reads the image data for one frame written in the frame buffer 20, and the bus 14
It is supplied directly to the scroll engine 18 without going through. C
The PU 15 supplies the command data to the sprite engine 17 by executing the program in the ROM 16. This command data is data (drawing command) indicating a drawing command for the foreground image, and the sprite engine 17 uses the command RAM 1 as a command table.
9 is written. Then, it is read by the sprite engine 17 and executed by being set in an internal system register.

<Scroll Engine 18 and D / A Converter 23> (1) Outline of Scroll Engine 18 The scroll engine 18 has a background image generation unit 41 and a display control unit 42. The background image generation unit 41 uses the VRA
The image data of each background image is read from M21, and the image data is output for each pixel. Further, the display control unit 42
The priority of the image data of the foreground image supplied from the sprite engine 17 is compared with the priority of the image data of the background image, and the image data is synthesized based on those priorities to generate RGB data and synchronized with the horizontal synchronization signal. And output. Then, this RGB data is supplied to the D / A converter 23. As a result, the D / A converter 23 converts the RGB data into an analog signal and outputs it as a video signal. This video signal is supplied to a monitor (not shown) and displayed on the TV screen.

(2) Configuration of VRAM 21 The VRAM 21 will be described. The VRAM 21 stores pattern data composed of image data of cells of vertical and horizontal 8 × 8 pixels. Further, the above cell is vertically and horizontally 28 × 40.
When the background image for one frame is formed by spreading the cells, pattern name data is stored corresponding to the arrangement. The pattern name data indicates the address of the pattern data on the VRAM 21.

(3) Types of scroll screens In this embodiment, there are background images BG0 and BG1 as scroll screens, and these background images can be rotary scroll screens. The rotating scroll screen here is
It is a scroll screen that performs rotation about coordinate axes (X, Y, Z axes) as a rotation axis and rotation about a screen axis perpendicular to the monitor screen as a rotation axis.

(4) Relationship between the scroll screen at the time of displaying the rotary scroll screen, the screen screen and the viewpoint The scroll screen at the time of displaying the rotary scroll screen,
The relationship between the screen screen and the viewpoint will be described with reference to the drawings. When the state shown in FIG. 2 is the initial state, when FIG. 3 is “X-axis rotation” in which the screen screen is rotated around the X axis with respect to the scroll screen, FIG. In the case of “Y-axis rotation” rotated about the axis, FIG. 5 shows the case of “Z-axis rotation” rotated about the Z axis on the screen screen with respect to the scroll screen.

(5) Movement / rotation conversion type When the screen screen moves as shown in FIGS. 3 to 5 from the state shown in FIG. 2, the image on the screen screen is displayed as shown in FIGS. 6 to 9. Becomes 6 corresponds to FIG. 2, FIG. 7 corresponds to FIG. 3, FIG. 8 corresponds to FIG. 4, and FIG. 9 corresponds to FIG. Note that the lower part of FIGS. 6 to 9 is the rotation matrix parameter in the state of each drawing.

Next, the movement / rotation conversion formula used in this embodiment will be described with reference to FIG. According to this figure, the screen screen that has undergone the movement rotation conversion (ie,
(Rotary scroll screen display screen) rotates the viewpoint and screen screen based on the center point, and collects the points where the line of sight from the converted viewpoint through the converted screen screen intersects with the fixed scroll map. It turns out that it is a thing.

In FIG. 10, the viewpoint (P
(x, Py, Pz) is rotated about the center point (Cx, Cy, Cz), and further translated to move the viewpoint after conversion to (X
The movement-rotation conversion equation, which is the movement rotation of (p, Yp, Zp), is given by the following equation.

[0055]

[Equation 9] However, Mx, My, and Mz are parallel movement amounts with respect to the X, Y, and Z axes, and A to I are rotation matrix parameters.

Further, the points (Sx, Sy, Sz) on the screen screen before coordinate conversion are moved and rotated in the same manner as described above, so that the points on the screen screen after coordinate conversion are (Xs, Y).
s, Zs) is given by the following equation.

[0057]

[Equation 10] Furthermore, the point on the scroll screen to be displayed passes through the point on the screen screen after conversion from the viewpoint after conversion (X, Y,
The viewpoint leading to Z) is expressed by the following equation.

[0058]

[Equation 11] Here, the scroll screen to be displayed, that is, VRAM
Since the background image stored in 21 is a plane of Z = 0, the X and Y coordinates of the scroll screen to be displayed are represented by the following equation.

X = k (Xs−Xp) + Xp Y = k (Ys−Yp) + Yp (4) where k = −Zp / (Zs−Zp) The above k is called a perspective transformation coefficient, and (1 ) And equation (2) are expressed as follows.

[0060]

[Equation 12] In the equation (5), the viewpoint (Px, Py, P
z), the center point (Cx, Cy, Cz) before conversion, the translation amount (Mx, My, Mz) and the rotation matrix parameters G to I are fixed values within one frame, so k is the value before conversion. It changes according to the values of points (Sx, Sy, Sz) on the screen.

Since the screen screen before conversion is usually the same as the monitor screen, Sx is the H count value which is the horizontal coordinate value of the monitor screen, and Sy is the V count value which is the vertical coordinate value of the monitor screen. And Sz is 0. The screen screen coordinate value when this screen screen is rotated by the vertical line (screen axis) of the screen screen is expressed by the following formula.

[0062]

[Equation 13] a, b, c, d: screen screen rotation matrix parameters Hcnt, Vcnt: HV counter values Csx, Csy: screen screen rotation center coordinates Msx, Msy, Msz: screen screen parallel movement amount The above equation (6) is It is expressed as follows.

Sx = Xst + ΔX · Hcnt + ΔXst · Vcnt Sy = Yst + ΔY · Hcnt + ΔYst · Vcnt Sz = Zst (7) where Xst = −a · Csx−b · Csy + Csx + Msx Yst = −c · Csx -DCsy + Csy + Msy Zst = Msz ΔXst = b ΔYst = d ΔX = a ΔY = c Xst, Yst, Zst: Screen screen start coordinates ΔXst, ΔYst: Screen screen vertical direction coordinate increments ΔX, ΔY : Screen screen horizontal direction coordinate increment From the above, the display coordinates (X, Y) for each dot can be obtained from the following equation. X = kx (Xsp + dX · Hcnt) + Xp Y = kx (Ysp + dY · Hcnt) + Yp (8) where Xsp = A {(Xst + ΔXst · Vcnt) -P
x} + B {(Yst + ΔYst · Vcnt) −Py} +
C (Zst-Pz) Ysp = D {(Xst + ΔXst · Vcnt) -P
x} + E {(Yst + ΔYst · Vcnt) −Py} +
F (Zst-Pz) Xp = A (Px-Cx) + B (Py-Cy) + C (Pz
-Cz) + Cx + Mx Yp = D (Px-Cx) + E (Py-Cy) + F (Pz
−Cz) + Cy + My dX = A · ΔX + B · ΔY dY = D · ΔX + E · ΔY (6) Configuration of Background Image Generating Unit 41 FIG. 11 is a block diagram showing the configuration of the background image generating unit 41. The background image generation unit 41 generates background images BG0 and BG1, reads pattern name data for each of two frames from the VRAM 21, reads pattern data from the VRAM 21 for each of the pattern name data for the two frames, and By outputting the pixels of the pattern data, the background image BG for two frames is output.
0, BG1 image data is obtained.

(6-1) Parameter RAM 60 The parameter RAM 60 stores, as a table, the rotation parameters used in the calculation for performing the coordinate conversion process. The parameter RAM 60 is stored in the CPU 15 via the terminal 46.
Then, the following rotation parameters are written.

Screen screen start coordinates Xst, Ys
t, Zst Screen screen vertical coordinate increment ΔXst, ΔYst Screen screen horizontal coordinate increment ΔX, ΔY Rotation matrix parameters A to F Viewpoint coordinates Px, Py, Pz Center coordinates Cx, Cy, Cz Translation amount Mx, My (6-2) Matrix operation circuit 66 The matrix operation circuit 66 uses the parameter RAM 60 described above.
The parameters are read from and the matrix operation is performed based on them. The matrix calculation circuit 66 uses the rotation matrix parameters A to F and the viewpoints (Px, Py, P) before conversion.
z), the center point (Cx, Cy, Cz), and the parallel movement amount (Mx, My, Mz) are substituted into the above equation (1) to calculate Xp, Yp of the converted viewpoints. Along with this, the rotation matrix parameters A to F and the center points (Cx, Cy,
Cz), the amount of parallel movement (Mx, My), the H count value as Sx, the V count value as Sy, and the fixed value 0 as Sz are substituted into the equation (2), and the converted screen screen is displayed. Calculate Xs and Ys.

(6-3) Coefficient RAM 61 and coefficient RAM
Access circuit 62 Further, the coefficient RAM 61 is a RAM that stores a rotation parameter used for coordinate conversion calculation, in addition to the parameter RAM. For example, k shown in the equation (4), that is, the perspective transformation coefficient is stored. This coefficient RAM 61
A coefficient for one screen is written in the table via the terminal 46 by the CPU 15. This coefficient is calculated by the CPU 15 and written in the vertical and horizontal blanking periods.

Here, the coefficient for one screen written in the coefficient RAM 61 from the CPU 15 depends on the type of movement rotation conversion as described above, that is, whether it is X-axis rotation, Y-axis rotation, or Z-axis rotation. The amount of data required is different. The coefficient is calculated by the CPU 15 by the minimum required amount of data, and is written in the coefficient RAM 61 via the terminal 46. Then, the CPU 15 specifies to the coefficient RAM access circuit 62 two address increments based on the start address at the start of access and the H count value and V count value. As a result, the coefficient RAM access circuit 62 accesses the coefficient RAM 61 to sequentially read the coefficient of each pixel, and supplies the coefficient to the product-sum calculation circuit 65 described later. The coefficient RAM 61 can be accessed line by line or dot by dot.

This coefficient is also used as a parameter other than the above-mentioned perspective transformation coefficient. The switching process will be described later.

(6-4) Product-sum calculation circuit 65 The product-sum calculation circuit 65 determines the horizontal count value by Xp, Yp, Xs, Ys supplied from the matrix calculation circuit 66 and the coefficient read from the coefficient RAM 61. The formula (4) is calculated synchronously to calculate the coordinates X and Y of the scroll screen. The coordinates X and Y obtained by the product-sum calculation circuit 65 are
It is supplied to the VRAM access circuit 67.

When the screen screen is rotated on the screen axis, the product-sum calculation circuit 65 causes the start coordinate (Xst, Yst, Zst) of the screen screen, the vertical coordinate increment (ΔXst, ΔYst), and the horizontal direction. Coordinate increment (△
X, ΔY) is substituted into the above equation (7) to calculate the screen screen coordinate value.

(6-5) VRAM access circuit 67 The VRAM access circuit 67 accesses the VRAM 21 using the coordinates X and Y of the scroll screen as the pixel address of the background image. The lower 3 bits of each of the coordinates X and Y (when the size of the cell is vertical and horizontal 8 dots × 8 dots) becomes the pixel position address in the cell, and the address except the 6 bits becomes the pattern name address. VR
The AM access circuit 67 reads the pattern name data from the VRAM 21, and uses the pattern data address and the pixel position address in this pattern name data as VRA.
The pattern data, which is a color code, is read from M21, pixel data is formed from this color code and the priority code in the pattern name data, and the pixel data is output from the terminal 68.

(6-6) Horizontal Counter 63, Vertical Counter 64 The horizontal counter 63 counts the dot pulse generated by the built-in oscillator to obtain the H count value and the horizontal synchronizing pulse. The vertical counter 64 counts the horizontal synchronizing pulse to obtain a V count value and a vertical synchronizing pulse. The H count value and the V count value are supplied to the matrix calculation circuit 66 and the coefficient RAM access circuit 62, and H count value
The count value is supplied to the product-sum calculation circuit 65. Further, the horizontal and vertical sync pulses are supplied to the sprite engine 17 from the terminal 69. In the background image generator 41, the horizontal counter 63, the vertical counter 64, and the VRA
The constituent elements excluding the M access circuit 67 are configured as one integrally formed circuit block 41a.

B. Operation of Embodiment Next, the operation of the image processing apparatus of this embodiment having the above-described configuration will be described.

(1) Line Reading Mode of Rotation Parameter As described above, when the screen axis of the screen screen is rotated, the coordinate value of the screen screen is obtained by the above equation (7). Six rotation parameters (Xst, Yst, ΔXst, ΔYst, ΔX, Δ used for this coordinate calculation
Y) is the parameter RA shown in FIG. 11 as described above.
It is stored in M60 as a table. Normally, these parameters are read once per screen, and the product-sum calculation circuit 65 performs the above calculation. Further, the image can be rotated by enlarging / reducing by changing the six rotation parameters.

FIG. 12 shows a concrete example of the case where the above parameters are read once for one screen and the calculation is performed. In the figure, the left side shows the scroll screen and the right side shows the image displayed on the TV screen. The arrow on the scroll screen indicates the coordinate image of the screen screen. FIG. 11A shows a normal case in which a character on the scroll screen is displayed. (B) shows a case in which the character is displayed so as to rotate to the left by 30 ° by rotating the screen screen by 30 ° on the Z axis. (C) shows a case where the character is displayed so as to rotate 60 ° to the left by rotating the screen screen by 60 ° on the Z axis. (D) shows a case where the character is rotated 90 ° to the left by rotating the screen screen by 90 ° on the Z axis.

In FIG. 11, the matrix operation circuit 66 uses the start coordinates (Xst, Yst) and the horizontal coordinate increments (ΔX, Δ) of the six rotation parameters.
In some cases, only a total of four (Y) are read line by line.
In this case, the CPU 15 rewrites the rotation parameter line by line and instructs the matrix calculation circuit 66 to read the rotation parameter line by line. As a result, the matrix calculation circuit reads these rotation parameters line by line from the parameter RAM 66, and the product-sum calculation circuit 65 performs the above calculation line by line based on this rotation parameter. A specific example in this case is shown in FIG. FIG.
In (d), the screen screen start coordinates (Xst, Yst), ... Of each line are different, and the horizontal coordinate increments (ΔX, ΔY) have the same value for all lines. Therefore, by changing the screen screen start coordinates (Xst, Yst) of each line for each screen, an image that appears to shake horizontally is displayed.

Further, as shown in FIG.
As in the case of (b), by rotating the screen screen by 30 ° on the Z axis, the character shakes 30 ° to the left while swinging.
It appears to rotate. Further, as shown in FIG. 12C, the screen screen is displayed in the same manner as in the case of FIG.
By rotating the Z-axis, the character is displayed so as to rotate 60 ° to the left while swinging. Further, as shown in FIG. 12D, as in the case of FIG. 12D, by rotating the screen screen by 90 ° on the Z axis, the character is displayed so as to rotate leftward by 90 ° while swinging.

(2) Coefficient data mode In this embodiment, as described above, the coefficients stored in the coefficient table of the coefficient RAM 61 may be used as rotation parameters other than the perspective conversion coefficient. The following four modes are set as the coefficient data mode indicating which parameter this coefficient is used for.

Mode 0: Used as k on the X coordinate side and k on the Y coordinate side.

Mode 1: Used as k on the X coordinate side.

Mode 2: Used as k on the Y coordinate side.

Mode 3: Used as the viewpoint coordinate Xp after rotation conversion.

Switching between these modes is shown in FIG.
This will be specifically described with reference to FIG. This switching is CP
Under the control of U15, it can be performed either for each line or for each dot. FIG. 14 is a diagram showing the configuration of the product-sum calculation circuit 65. In the figure, the arithmetic circuit 7
0 from the matrix arithmetic circuit 66 to Xp, Yp, X
s, Ys are supplied. The arithmetic circuit 70 uses these to obtain (Xs-Xp) and (Ys-Yp), and (Xs-
The value of (Xp) is supplied to the parameter setting unit 75, and Xp is supplied to the switch 71. Further, the arithmetic circuit 70 displays (Ys
The value of (-Yp) is supplied to the parameter setting unit 78, and Yp is supplied to the switch 73.

Further, the coefficient RAM access circuit 62 transfers the coefficient data read from the coefficient RAM 61 to the switch 7
1, 72, 73, and 74. Further, the switches 72 and 74 are supplied with the value of k set in the registers 81 and 82 by the CPU 15, respectively.

When the coefficient data mode is "mode 0", the switch 71 outputs Xp from the arithmetic circuit 70 to the parameter setting unit 76, and the switch 73 outputs Yp from the arithmetic circuit 70 to the parameter setting unit 79. Is output. On the other hand, the coefficients from the coefficient RAM 61 are output from the switches 72 and 74 to the parameter setting units 77 and 80. And each parameter setting part 75-7
The outputs from 7 and 78 to 80 are arithmetic circuits 83 and 8
4 is supplied. In the arithmetic circuit 83, (Xs-X
Based on p), Xp, and k, the calculation on the X coordinate side of the equation (4) is performed. Further, in the arithmetic circuit 84, (Ys-Y
Based on p), Yp, and k, the calculation on the Y coordinate side of the equation (4) is performed.

When the coefficient data mode is "mode 1", the switches 71 and 73 output Xp and Yp from the arithmetic circuit 70 as in the case of "mode 0". In this "mode 1", the switch 72 outputs the coefficient from the coefficient RAM 61, but the switch 74 outputs k set in the register 82.
The value of is output. Therefore, the coefficient stored in the coefficient RAM 61 is set only to k on the X coordinate side. A specific example of an image in this case is shown in FIG. As shown in the figure, for example, the original picture OG on the scroll screen can be rotated while changing the enlargement / reduction rate in the X-axis direction.

On the other hand, in the case of "mode 2", the switch 7
The value of k set in the register 81 is output from 2
The switch 73 outputs the coefficient from the coefficient RAM 61. Therefore, the coefficient stored in the coefficient RAM 61 is Y
Only set to k on the coordinate side. An example of a specific image in this case is shown in FIG. As shown in the figure, for example, the original picture OG can be rotated while changing the enlargement / reduction rate in the Y-axis direction.

Further, when the coefficient data mode is "mode 3", the switch 71 outputs the coefficient stored in the coefficient RAM 61. That is, the coefficient stored in the coefficient RAM 61 is set only in Xp. A specific example in this case is shown in FIG. As shown in the figure,
Since Xp includes the translation amount in the X-axis direction, the original picture O
It is possible to rotate by changing only the amount of parallel movement of G in the X-axis direction.

C. As described above, according to the present embodiment, the CPU 15 calculates the rotation parameter and the coefficient, stores them in the parameter RAM 66 and the coefficient RAM 61, and stores them in the matrix operation circuit 6.
6 and the product-sum operation circuit 65 read them out at a predetermined timing and perform the operation, the CPU does not need to perform all the complicated operations as in the conventional case, and the load on the CPU 15 is reduced. Further, since the rotation parameter can be read out not only on the screen but also on a line-by-line basis, the rotation parameter can be changed on a line-by-line basis simply by changing the reading method. Furthermore, since the coefficients stored in the coefficient table of the coefficient RAM 61 can be set to a plurality of parameters including the perspective conversion coefficient, various images can be displayed with a simple configuration.

D. Other Examples The present invention is not limited to the above-mentioned examples,
It can be widely used in image display devices of computers other than video game machines, that is, personal computers and the like.

[0091]

As described above, according to the present invention, C
Distorted image, without increasing load on PU,
Further, it is possible to obtain an effect that various images such as a shaking image can be displayed.

[Brief description of drawings]

FIG. 1 is a block diagram showing an overall configuration of an image processing apparatus according to an embodiment of the present invention.

FIG. 2 is a perspective view showing a scroll screen, a screen screen, and a line of sight.

FIG. 3 is a perspective view of the screen screen of FIG. 2 rotated about the scroll screen in the X-axis direction.

FIG. 4 is a perspective view of the screen screen of FIG. 2 rotated in the Y-axis with respect to the scroll screen.

5 is a perspective view of the screen screen of FIG. 2 rotated by the Z axis with respect to the scroll screen.

6 is a front view showing a screen screen corresponding to FIG. 2. FIG.

7 is a front view showing a screen screen corresponding to FIG. 3. FIG.

8 is a front view showing a screen screen corresponding to FIG. 4. FIG.

9 is a front view showing a screen screen corresponding to FIG. 5. FIG.

FIG. 10 is a graph for explaining “parameters” and “coefficients” of the movement rotation conversion formula.

FIG. 11 is a block diagram showing a configuration of a background image generation unit 41.

FIG. 12 is a diagram showing a scroll screen and a TV screen when a rotation parameter is read out once per screen.

FIG. 13 is a diagram showing a scroll screen and a TV screen when a rotation parameter is read line by line.

FIG. 14 is a diagram illustrating switching of coefficient data modes in a product-sum calculation circuit 65.

FIG. 15 is a diagram showing a specific image example in each of the coefficient data modes.

[Explanation of symbols]

 15 ... CPU 18 ... Scroll engine 21 ... VRAM 41 ... Background image generation unit 60 ... Parameter RAM (parameter memory) 61 ... Coefficient RAM 62 ... Coefficient RAM access circuit 65 ... Sum-of-products arithmetic circuit (address generation means) 66 ... Matrix arithmetic circuit (Address generating means) 67 ... VRAM access circuit 81, 82 ... Register

Continuation of front page (51) Int.Cl. ⁶ Identification number Office reference number FI Technical display location G09G 5/36 520 K 9377-5H L 9377-5H 530 E 9377-5H G 9377-5H

Claims (11)

[Claims] 1. An image processing method for reading out image data of an image to be displayed on a monitor from an image memory and generating a video signal based on the image data, wherein a plurality of parameters used for calculation of coordinate conversion processing are calculated in advance. And the coefficients for one monitor screen are stored in the coefficient memory for each pixel, the plurality of parameters are read out for each monitor screen from the parameter memory, and the coefficients are read from the coefficient memory. An image processing method, comprising reading out, performing a coordinate conversion processing operation based on the parameters and coefficients, and generating a read address of the image memory. 2. The image according to claim 1, wherein the parameters stored in the parameter memory are rewritten for each line of one monitor screen, and the plurality of parameters are read out for each line from the parameter memory. Processing method. 3. The coefficient stored for each pixel in the coefficient memory is replaced with at least one parameter of a plurality of parameters read from the parameter memory,
The image processing method according to claim 1, wherein the calculation is performed. 4. In an image processing apparatus for reading out image data of an image to be displayed on a monitor from an image memory and generating a video signal based on the image data, a plurality of parameters and coefficients used for calculation of coordinate conversion processing are designated. CPU, a parameter memory for storing the plurality of parameters, a coefficient memory for storing the coefficient for one monitor screen for each pixel, and a plurality of parameters stored in the parameter memory for each screen, An image processing apparatus comprising: an address generating unit that reads the coefficient from the coefficient memory, performs a coordinate conversion process based on the parameter and the coefficient, and generates a read address of the image memory. 5. The CPU rewrites the parameters stored in the parameter memory for each line of the monitor, and the address generating means reads the parameters in units of the lines and performs an operation based on the parameters. 5. The method according to claim 4, wherein
The image processing device described. 6. The address generation means replaces the coefficient stored in the coefficient memory with at least one parameter of a plurality of parameters read from the parameter memory and performs the calculation. The image processing device according to item 4 or 5. 7. The address generation means includes a matrix operation circuit that performs a matrix operation based on the parameters, and a product-sum operation circuit that calculates a coordinate value based on a result of the matrix operation and the coefficient. The image processing device according to claim 4, 5, or 6. 8. Rotation matrix parameters A to I, which represent viewpoints of the screen screen before coordinate conversion (Px, P).
y, Pz), which represents the center point in the coordinate conversion (Cx, C
y, Cz), which represents the amount of translation (Mx, My, Mz),
A CPU that specifies the perspective transformation coefficient k and a predetermined coefficient, and AF of the above AI, Px, Py, Pz, Cx,
A parameter memory that stores Cy, Cz, Mx, and My as rotation parameters, a register in which the perspective transformation coefficient k is set, a coefficient memory that stores a coefficient for one screen screen for each pixel, and a rotation from the parameter memory. Read parameters,
Represents a predetermined point on the screen screen before coordinate conversion (S
x, Sy, Sz) and the rotation parameter,
The matrix calculation of the following expressions (1) and (2) is performed to represent the viewpoint after coordinate conversion of each pixel (Xp, Yp, Zp).
And a predetermined point on the screen screen after coordinate conversion (X
s, Ys, Zs) and a matrix operation circuit for calculating [Equation 2] The coefficient is read from the coefficient memory, and the following equation (4) is calculated from Xp, Yp, Xs, and Ys of each pixel, the perspective conversion coefficient k set in the register, and the coefficient, and the coordinates are calculated. A sum of products operation circuit for calculating X, Y and X = k (Xs−Xp) + Xp Y = k (Ys−Yp) + Yp k = −Zp / (Zs−Zp) (4) The image processing device, wherein the arithmetic circuit replaces at least one of k on the X coordinate side and k on the Y coordinate side in the equation (4) with a coefficient read from the coefficient memory to perform the arithmetic operation. 9. Rotation matrix parameters A to I, which represent viewpoints of the screen screen before coordinate conversion (Px, P).
y, Pz), which represents the center point in the coordinate conversion (Cx, C
y, Cz), which represents the amount of translation (Mx, My, Mz),
A CPU that specifies the perspective transformation coefficient k and a predetermined coefficient, and AF of the above AI, Px, Py, Pz, Cx,
A parameter memory that stores Cy, Cz, Mx, and My as rotation parameters, a register in which the perspective transformation coefficient k is set, a coefficient memory that stores a coefficient for one screen screen for each pixel, and a rotation from the parameter memory. Read parameters,
Represents a predetermined point on the screen screen before coordinate conversion (S
x, Sy, Sz) and the rotation parameter,
The matrix calculation of the following expressions (1) and (2) is performed to represent the viewpoint after coordinate conversion of each pixel (Xp, Yp, Zp).
And a predetermined point on the screen screen after coordinate conversion (X
s, Ys, Zs) and a matrix operation circuit for calculating [Equation 4] The coefficient is read from the coefficient memory, and the following equation (4) is calculated from Xp, Yp, Xs, and Ys of each pixel, the perspective conversion coefficient k set in the register, and the coefficient, and the coordinate is calculated. A sum of products operation circuit for calculating X, Y and X = k (Xs−Xp) + Xp Y = k (Ys−Yp) + Yp k = −Zp / (Zs−Zp) (4) The arithmetic circuit replaces at least one parameter among the parameters including k on the X coordinate side, k on the Y coordinate side, Xp of each pixel, and Yp in the equation (4) with a coefficient read from the coefficient memory. An image processing device, characterized in that the image processing device performs an arithmetic operation. 10. The start coordinate of the screen screen (Xst, Yst, Zst), the horizontal coordinate increment of the screen screen (ΔX, ΔY), and the vertical coordinate increment of the screen screen (ΔXst). , ΔYst), and the Xst, Yst, ΔX, and Δ for each screen screen.
Parameter memory for storing Y, ΔXst, ΔYst, and Xst, Ys stored in the parameter memory
t, ΔX, ΔY, ΔXst, and ΔYst are read out for each screen of the screen, and based on them, the operation of the following formula (7) is performed to coordinate Sx, S of the screen.
An image processing apparatus comprising: a product-sum operation circuit for calculating y; and Sx = Xst + ΔX · Hcnt + ΔXst · Vcnt Sy = Yst + ΔY · Hcnt + ΔYst · Vcnt (7). 11. The CPU stores the Xst, Yst, and Δ in the parameter memory.
X and ΔY are rewritten for each line of the screen screen, and the product-sum operation circuit is configured to store the Xst and Ys stored in the parameter memory.
11. The image processing apparatus according to claim 10, wherein t, .DELTA.X, .DELTA.Y are read out for each line of the screen screen and the operation of the equation (7) is performed.