CN100384209C - Image processing device and image processing method - Google Patents

Abstract

A CPU (200) acquires one or more picked-up image data GD to be attached to decoration image data, from a plurality of picked-up image data GD inputted and acquires image processing control information GI correlated with the acquired picked-up image data. The CPU (200) acquires desired decoration image data FD and acquires layout control information LI from the acquired decoration image data FD. Furthermore, the CPU (200) acquires image quality adjustment information GC from the acquired layout control information LI. By using the acquired image processing control information GI and the image quality adjustment information GC, the CPU (200) executes an image adjustment to the picked-up image data GD. The CPU (200) attaches the picked-up image data GD which has been subjected to image quality adjustment, to the decoration image data FD according to the layout control information LI, thereby generating image data for output.

Description

Image processing device and image processing method

technical field

The present invention relates to a technique for generating output image data using decorative image data for decorating image data and layout control information specifying the arrangement position and arrangement size of the image data arranged relative to the decorative image data.

Background technique

Currently, a technique has been put into practical use for the decoration image data, for example, frame-type decoration image data such as arrangement image data, such as photographed image data, is attached to the decoration image data, and an output image in which the arrangement image is surrounded by the decoration image is output. onto paper media. In this technique, when the arrangement image data is attached to the decoration image data, layout control information composed of a script file describing the arrangement position and arrangement size of the arrangement image data with respect to the decoration image data is used.

The layout control information is associated with each decorative image, and the user only needs to select the decorative image data and the attached configuration image data, and the configuration image data whose size fits to the predetermined size can be pasted on the predetermined position of the decorative image data, and the desired image data can be obtained. The image surrounded by the decoration image is used as the output image.

However, in the existing above-mentioned technologies, there is a problem that the theme of the decorative image data, such as seasons, events, and image quality (image) of the arrangement image data arranged in the decoration image data cannot be reconciled.

Also, even in the case of attaching a plurality of layout image data to the decoration image data, there is a possibility that image quality adjustment between the layout image data is not taken into account, and enhancement and weakening cannot be attached to the decoration image data. That's the problem with multiple configurations of image data.

For example, there are cases where it is desired that the layout image data pasted in the largest size has a better appearance than other layout image data, or it is desirable to adjust all layout image data pasted to the decoration image data to have the same image quality.

Contents of the invention

The present invention was made to solve the above-mentioned problems, and an object of the present invention is to perform image processing capable of obtaining an output result with a good appearance by reconciling the image quality of the decoration image data and the arrangement image data arranged in the decoration image data. Furthermore, an object of the present invention is to appropriately perform image quality adjustment on the arrangement image data at each arrangement position when a plurality of arrangement image data are arranged with respect to the decoration image data.

In order to solve the above-mentioned problems, a first aspect of the present invention provides an image processing device that performs image processing on arrangement image data arranged with respect to decoration image data. The image processing device according to the first aspect of the present invention includes: a layout image data acquisition unit that acquires the layout image data; a decoration image data acquisition unit that acquires the decoration image data; a layout control information acquisition unit that acquires the layout control information. information, the layout control information is associated with the acquired decoration image data, and specifies the layout position, layout size and image quality adjustment information of the layout image data relative to the decoration image data, and the image quality adjustment information specifies Correction level of the configured configuration image data; feature amount acquisition means that analyzes the configuration image data, and obtains a feature amount for an image quality characteristic parameter representing a characteristic related to the image quality of the configuration image data; correction amount determination means , which determines the amount of correction to the configuration image data in such a way as to eliminate or reduce the deviation between the acquired feature amount and a preset reference value for the feature amount; increasing or decreasing the determined correction amount from the correction level specified by the acquired layout control information, and performing image quality adjustment processing on the acquired configuration image data by applying the increased or decreased correction amount; and output image data generation A means for generating output image data from the configuration image data to which image quality adjustment processing has been applied and the decoration image data based on the layout control information.

According to the image processing device according to the first aspect of the present invention, since the image quality adjustment processing is performed on the acquired layout image data using the image quality adjustment information specified by the layout control information, the image quality adjustment processing is performed from the image quality adjustment processing based on the layout control information. Since the arrangement image data and the decoration image data generate the output image data, the image quality of the decoration image data and the arrangement image data arranged in the decoration image data can be harmonized, and an output result with a good appearance can be obtained.

In the image processing apparatus according to the first aspect of the present invention, instead of specifying the correction level, the image quality adjustment information may specify correction information for the arranged image data; and the image quality adjustment means may use the The correction information is used to increase or decrease the determined correction amount. Furthermore, the correction information for the configuration image data may also be correction values of one or more image quality adjustment parameters related to the image quality of the configuration image data. In this case, when the correction processing of the configuration image data can be controlled based on the layout control information, and correction values of one or more image quality adjustment parameters related to the image quality of the configuration image data are specified as the image quality adjustment information , the correction processing of the configuration image data can be collectively controlled.

In the image processing device according to the first aspect of the present invention, the decorative image data may be image data representing a predetermined theme, and the correction information for the arrangement image data may be predetermined according to the decorative image data. Correction values for several image quality adjustment parameters for the theme. In this case, image quality adjustment processing suitable for the theme of the decoration image data can be performed on the configuration image data.

In the image processing device according to the first aspect of the present invention, the correction level for the arrangement image data is specified by the image quality adjustment information. In this case, the degree of correction can be controlled according to the image quality adjustment information.

The image processing apparatus according to the first aspect of the present invention includes: a feature value acquisition unit that analyzes the arrangement image data, and obtains a feature amount for an image quality characteristic parameter representing a characteristic related to the image quality of the arrangement image data; and correction. an amount determining means for determining a correction amount to the arrangement image data in such a manner as to eliminate or reduce a deviation between the acquired feature amount and a preset reference value for the feature amount; The amount of correction used to increase or decrease the decision. In this case, the correction amount suitable for the image quality characteristic can be determined for each configuration image data, and the determined correction amount can be increased or decreased according to the correction level specified by the image quality adjustment information. Therefore, it is possible to perform appropriate image quality adjustment processing for each arrangement image data and image quality adjustment processing compatible with the decoration image data.

In the image processing device according to the first aspect of the present invention, the decoration image data may be image data representing a predetermined theme; the determination of the correction amount may be related to the image quality of the arrangement image data. A plurality of image quality adjustment parameters are respectively implemented; the correction levels are respectively specified for the plurality of image quality adjustment parameters and are adapted to a predetermined theme of the decorative image data. In this case, the correction processing of the configuration image data suitable for the theme of the decoration image data can be collectively controlled.

In the image processing apparatus according to the first aspect of the present invention, the configuration image data may be associated with image processing control information specifying image processing conditions during image processing; The image quality adjustment processing of the data is performed with priority given to the image processing control information. In this case, image quality adjustment processing can be performed in accordance with specified image processing conditions at the time of image processing. Therefore, it is possible to preferentially perform image quality adjustment processing according to the user's intention.

In the image processing apparatus according to the first aspect of the present invention, the configuration image data may be associated with image processing control information specifying image processing conditions during image processing; The image quality adjustment processing of data is performed with priority given to the image quality adjustment information. In this case, it is possible to obtain an output result that achieves a good appearance in harmony with the decoration image data.

In the image processing apparatus according to the first aspect of the present invention, the configuration image data may be associated with image processing control information specifying image processing conditions during image processing; The image quality adjustment processing of the data is carried out by applying information combined with the image processing control information and the image quality adjustment information. In this case, image quality adjustment processing suitable for specified image processing conditions can be performed on the configuration image data, and image quality adjustment processing suitable for decoration image data can be performed.

In the image processing device according to the first aspect of the present invention, the decoration image data may have a plurality of arrangement positions; the arrangement image data acquiring means may acquire a plurality of the arrangement image data; The obtained decoration image data is associated with each other, and the arrangement position, arrangement size, and configuration image data of the plurality of arrangement image data arranged with respect to the decoration image data having the plurality of arrangement positions are specified respectively. image quality adjustment information; the image quality adjustment processing performed by the image quality adjustment unit using the image quality adjustment information specified by the acquired layout control information is to The plurality of arrangement image data at the arrangement positions are respectively implemented; the generation of the output image data by the output image data generation means is to use the image quality adjustment processing applied each of the above-mentioned layout control information. The configuration image data and the decoration image data are implemented.

According to the image processing device according to the first aspect of the present invention, since the image quality adjustment processing is performed on each of the plurality of arrangement image data arranged at each arrangement position of the decoration image data by using the image quality adjustment information specified by the layout control information, according to The layout control information generates the output image data from the arrangement image data and the decoration image data subjected to the image quality adjustment processing, so that the decoration image data and the image quality of a plurality of arrangement image data arranged in the decoration image data can be harmonized, Get good-looking output.

The image processing apparatus according to the first aspect of the present invention may further include changing means for changing a result of image quality adjustment processing performed on the arrangement image data using the image quality adjustment information. In this case, the result of the image quality adjustment processing performed on the image data using the image quality adjustment information can be changed according to the user's preference.

A second aspect of the present invention provides an image processing method that uses a layout that defines the arrangement position and arrangement size of arrangement image data arranged with respect to decoration image data, and image quality adjustment information for the arrangement image data and is associated with the decoration image data. Control information, performing image processing on the configuration image data. The image processing method according to the second aspect of the present invention: acquiring the arrangement image data; acquiring the decoration image data; acquiring layout control information associated with the acquired decoration image data and specifying an arrangement position, an arrangement size, and image quality adjustment information of the arrangement image data of the decoration image data, the image quality adjustment information specifying a correction level for the arranged arrangement image data; Image quality characteristic parameters of image quality-related characteristics of the image data to obtain feature quantities; and determine the value of the correction amount of the configuration image data; increase or decrease the determined correction amount by using the correction level specified by the acquired layout control information, and apply the increased or decreased correction amount to the acquired configuration image data. image quality adjustment processing; generating output image data from the configuration image data to which the image quality adjustment processing has been applied and the decoration image data based on the layout control information.

The image processing method according to the second aspect of the present invention can obtain the same effects as those of the image processing device according to the first aspect of the present invention, and can be realized in various ways like the image processing device according to the first aspect of the present invention.

In the image processing method according to the second aspect of the present invention, a plurality of the arrangement image data may be acquired; the layout control information is associated with the acquired decoration image data, and specifies the position relative to the plurality of arrangement positions. The arrangement position of the arrangement image data of the decoration image data, the arrangement size, and the image quality adjustment information for the arranged arrangement image data; the image quality adjustment information specified by the obtained layout control information is adopted The image quality adjustment process is performed on each of the plurality of arrangement image data arranged at each arrangement position of the decoration image data; the generation of the output image data is performed by using the applied Each configuration image data and the decoration image data subjected to image quality adjustment processing are implemented.

The image processing method according to the second aspect of the present invention can also be realized as an image processing program and a computer-readable recording medium on which the image processing program is recorded.

In order to solve the above-mentioned problems, a third aspect of the present invention provides an image processing device that performs image processing on arrangement image data arranged with respect to decoration image data. The image processing apparatus according to the third aspect of the present invention includes: an arrangement image data selection means for selecting the arrangement image data to be arranged for each arrangement position of the decoration image data;

an arrangement image data analyzing part that analyzes each of the selected arrangement image data, and obtains an image quality characteristic parameter representing a characteristic related to the image quality of the arrangement image data; and

an image quality adjustment section that acquires layout control information that specifies arrangement positions and arrangement sizes of a plurality of arrangement image data with respect to the decoration image data, and specifies a correction amount of the arrangement image data for each arrangement position, The correction amount is determined by at least one of the configuration position and the configuration size, and according to the correction amount, the value of the reference image quality parameter preset for the image quality characteristic parameter and the obtained Image quality adjustment is performed on each of the selected configuration image data based on the deviation between the values of the image quality characteristic parameters; and output image data generation means that applies the applied image quality adjustment process based on the layout control information. The respective configuration image data and the decoration image data are used to generate output image data.

According to the image processing device according to the third aspect of the present invention, since the layout control information is obtained and the image quality is adjusted for each selected layout image data according to the predetermined correction amount, when a plurality of layout image data are arranged in the decoration image data When , the layout control information can be used to appropriately adjust the image quality of the layout image data in each layout position.

Furthermore, by analyzing the arrangement image data, it is possible to perform image quality adjustment processing in consideration of the characteristics of each arrangement image data. In addition, by combining the characteristics of each arrangement image data obtained by analysis and the correction amount specified by the layout control information, it is further possible to perform appropriate image quality adjustment processing for each arrangement position.

In the image processing device according to the third aspect of the present invention, the correction amount may be such that the correction amount for the arrangement image data arranged at the center of the decoration image data is larger than that for other positions of the decoration image data. The adjustment of the image quality of the configuration image data performed by the image quality adjustment part is by increasing the degree of reduction of the deviation as the correction amount increases. to implement. In this case, since the degree of reduction of deviation becomes larger as the correction amount specified by the layout control information becomes larger, strong image quality adjustment processing is performed on the configuration image data. In addition, since the correction amount is set so that the correction amount of the layout image data arranged in the center of the decoration image data is larger than the correction amount of the layout image data arranged in other positions, it is possible to make the correction amount of the layout image data arranged in the center of the decoration image data larger. The appearance of configuration image data has been improved.

In the image processing device according to the third aspect of the present invention, the correction amount may be set so that the correction amount for the arrangement image data corresponding to the largest arrangement size is larger than the correction amount for other arrangement image data. set up;

The image quality adjustment of the configuration image data by the image quality adjustment means is performed by increasing the degree of reduction of the deviation as the correction amount increases. Also, since the correction amount is set so that the correction amount for the layout image data corresponding to the largest layout size is larger than the correction amount for other layout image data, the appearance of the layout image data with the largest layout size can be improved. become good.

A fourth aspect of the present invention provides an image processing device that performs image processing on arrangement image data arranged with respect to decoration image data. An image processing device according to a fourth aspect of the present invention includes: a placement image data selection unit that selects the placement image data to be placed at each of the placement positions of the decoration image data; and a placement image data analysis unit that analyzes Each of the selected configuration image data obtains an image quality characteristic parameter representing a characteristic related to the image quality of the configuration image data; an image quality adjustment part obtains layout control information specifying The configuration position and configuration size of multiple configuration image data of the data, and the correction degree of the configuration image data of each configuration position is specified at the same time, and by eliminating or reducing the preset value of the image quality characteristic parameters according to the specified correction degree performing image quality adjustment processing on the configuration image data for a deviation between the value of the reference image quality parameter and the acquired value of the image quality characteristic parameter; and output image data generating means that employs, based on the layout control information, The arrangement image data and the decoration image data to which the image quality adjustment processing has been applied generate output image data.

According to the image processing device according to the fourth aspect of the present invention, each selected layout image data is analyzed, and image quality characteristic parameters representing characteristics related to the image quality of the layout image data are obtained, and the parameters are eliminated or reduced by a predetermined degree of correction. Image quality adjustment is performed on the deviation between the value of the reference image quality parameter set in advance by the image quality characteristic parameter and the acquired value of the image quality characteristic parameter. Therefore, image quality adjustment can be appropriately performed on the layout image data at each layout position by using both the layout control information and the analysis result of the layout image data.

A fifth aspect of the present invention provides an image processing device that performs image processing on arrangement image data arranged relative to decorative image data. The image processing device according to the fifth aspect of the present invention includes an arrangement image data selection unit that selects the arrangement image data to be arranged. the arrangement image data to the respective arrangement positions of the decoration image data; image quality adjustment level setting means for acquiring layout control information specifying a plurality of arrangement images with respect to the decoration image data The configuration position and configuration size of the data, and the priority order of each configuration position is stipulated, and the image quality adjustment level for the selected configuration image data is set according to the specified priority order; performing image quality adjustment on each of the selected configuration image data at a predetermined image quality adjustment level; and an output image data generating unit that adopts each configuration image to which the image quality adjustment processing has been applied based on the layout control information. data and the decoration image data to generate output image data.

According to the image processing device according to the fifth aspect of the present invention, the image quality adjustment level is set for each selected layout image data according to the priority order specified by the acquired layout control information, and the image quality adjustment level is set based on the set image quality adjustment level. Image quality adjustment is performed on each selected placement image data, so when a plurality of placement image data is arranged in decoration image data, image quality adjustment can be appropriately performed on placement image data in each placement position using layout control information .

In the image processing device according to the fifth aspect of the present invention, it is also possible to compare the degree of correction of the arrangement image data arranged at the arrangement position with the highest priority with the correction degree of the arrangement image data arranged at other arrangement positions. If the degree is high, the setting of the image quality adjustment level for each of the selected configuration image data is performed by the image quality adjustment level setting means. In this case, since strong image quality adjustment processing can be performed on the arrangement image data arranged at the arrangement position with the highest priority order, the appearance of the arrangement image data arranged at the arrangement position with the highest order of priority can be made good.

In the image processing device according to the fifth aspect of the present invention, the degree of correction of the arrangement image data arranged at the arrangement position with the highest priority and the degree of correction of the arrangement image data arranged at other arrangement positions may be set to If the degrees are equal, the setting of the image quality adjustment level for each of the selected configuration image data is performed by the image quality adjustment level setting means. In this case, equal image quality adjustment can be performed on each arrangement image data arranged in the decoration image data, and harmony between each arrangement image data can be realized.

The image processing apparatus according to the fifth aspect of the present invention may further include a configuration image data analysis unit that analyzes each of the selected configuration image data to obtain an image quality characteristic parameter indicating a characteristic related to the image quality of the configuration image data; By eliminating or reducing the deviation between the value of the reference image quality parameter set in advance for the image quality characteristic parameter and the value of the obtained image quality characteristic parameter, the configuration image performed by the image quality adjustment part is implemented. Image quality adjustment of data; by comparing the reduction degree of the deviation of the arrangement image data arranged at the arrangement position with the highest priority with the arrangement image data of the captured images arranged at other arrangement positions If the degree of reduction is large, the setting of the image quality adjustment level for each of the selected configuration image data by the image quality adjustment level setting means is performed. In this case, by considering the characteristics of the arrangement image data, it is possible to implement strong image quality adjustment processing on the arrangement image data arranged at the arrangement position with the highest priority.

In the image processing device according to the fifth aspect of the present invention, the priority may be higher as the arrangement size increases; or the priority may be higher as the arrangement position is closer to the decorative image data. center becomes higher. When the arrangement size is large, the arrangement image data of the arrangement is also large, so the effect of the image quality adjustment processing is easy to accept, and the center of the decoration image data is easy to be conspicuous, so it is desirable to improve the appearance by the image quality adjustment processing.

The image processing apparatus according to any one of the third, fourth, and fifth aspects of the present invention may further include changing means for changing the image quality adjustment performed by the image quality adjusting means for the arrangement image data. process result. In this case, the image quality of the placement image data can be changed according to the user's preference.

A sixth aspect of the present invention provides an image processing apparatus for performing image processing on the arrangement image data using layout control information specifying arrangement positions and arrangement sizes of a plurality of arrangement image data arranged with respect to the decoration image data. An image processing apparatus according to a sixth aspect of the present invention includes: placement image data selection means for selecting the placement image data to be placed in each of the placement positions of the decoration image data; and priority order giving means for prioritizing an order is assigned to each of the arrangement positions; an image quality adjustment unit that performs image quality adjustment on the selected arrangement image data according to the assigned priority order; and an output image data generation unit that performs an image quality adjustment based on the layout control information. , generating output image data using the configuration image data subjected to the image quality adjustment processing and the decoration image data.

According to the image processing device according to the sixth aspect of the present invention, priority can be assigned to each arrangement position by the priority assigning means, an image quality adjustment level can be set for each selected arrangement image data according to the assigned priority, and an image quality adjustment level can be set according to the set priority. In the image quality adjustment level, image quality adjustment is performed for each selected configuration image data.

A seventh aspect of the present invention provides an image processing apparatus for performing image processing on the arrangement image data using layout control information specifying arrangement positions and arrangement sizes of a plurality of arrangement image data arranged with respect to the decoration image data. An image processing device according to a seventh aspect of the present invention includes: decoration image data acquisition means for acquiring a plurality of decoration image data; and arrangement image data selection means for selecting each of the decoration image data to be placed in the acquired decoration image data. The arrangement image data at the arrangement position; priority order giving means for giving priority to each of the arrangement positions of the acquired decoration image data; performing image quality adjustment on each of the selected configuration image data; and an output image data generation unit that uses the configuration image data to which image quality adjustment processing has been applied and the decoration image data to generate an output image data generating unit based on the layout control information. Output image data.

According to the image processing device according to the seventh aspect of the present invention, since the prioritization means assigns a priority order to each arrangement position for a plurality of decoration image data, image quality adjustment is set for each selected arrangement image data according to the assigned priority order. According to the set image quality adjustment level, the image quality adjustment is performed on each selected layout image data, so even when processing a plurality of decorative image data, appropriate image quality adjustment processing can be performed on each layout position.

In the image processing apparatus according to the seventh aspect of the present invention, the priority assignment by the priority assignment means may be performed based on the respective arrangement positions and arrangement dimensions. In this case, priority can be given according to the layout control information.

The image processing apparatus according to the seventh aspect of the present invention may further include priority input means for inputting the priority, and give priority by the priority giving means according to the input priority. In this case, priority can be given through the priority input means.

In the image processing device according to the seventh aspect of the present invention, it is also possible to compare the degree of correction of the arrangement image data arranged at the arrangement position with the highest priority with the correction degree of the arrangement image data arranged at other arrangement positions. If the degree is high, the image quality adjustment of the selected configuration image data by the image quality adjustment means is performed. In this case, it is possible to perform stronger image quality adjustment processing on the arrangement image data arranged at the arrangement position with the highest priority than the image quality adjustment processing performed on the arrangement image data arranged at other arrangement positions.

The image processing apparatus according to the seventh aspect of the present invention may further include a configuration image data analysis unit that analyzes the selected configuration image data to obtain an image quality characteristic parameter indicating a characteristic related to the image quality of the configuration image data; By making the deviation between the value of the reference image quality parameter preset for the image quality characteristic parameter of the arrangement image data arranged at the arrangement position with the highest priority and the obtained value of the image quality characteristic parameter The degree of reduction is greater than the degree of reduction of the deviation of the arrangement image data of the captured images arranged at other arrangement positions, and the image quality adjustment of the arrangement image data by the image quality adjustment means is performed. In this case, by considering the characteristics of the arrangement image data, image quality adjustment processing can be performed, and arrangement image data arranged at the arrangement position with the highest priority can be compared with arrangement images arranged at other arrangement positions. Image quality adjustment processing performed on data Strong image quality adjustment processing.

The image processing device according to the sixth or seventh aspect of the present invention may further include changing means for changing the result of image quality adjustment processing performed by the image quality adjusting means on the arrangement image data. In this case, the image quality of the configuration image data can be changed according to the user's preference.

An eighth aspect of the present invention provides an image processing method for performing image processing on arrangement image data arranged with respect to decoration image data. An image processing method according to an eighth aspect of the present invention: selecting the arrangement image data to be arranged for each of the arrangement positions of the decoration image data; analyzing the selected arrangement image data to obtain display and arrangement image data The image quality characteristic parameters of the characteristics related to the image quality; obtain the layout control information, the layout control information specifies the layout position and layout size of a plurality of layout image data relative to the decoration image data, and specifies the layout position for each layout position Configure the correction amount of the image data, the correction amount is determined by at least one of the configuration position and the configuration size, and eliminate or reduce the reference image quality parameter preset for the image quality characteristic parameter according to the correction amount value, and the value of the obtained image quality characteristic parameter, implement image quality adjustment on each of the selected configuration image data; according to the layout control information, use the image quality adjustment process applied The image data and the decoration image data are respectively arranged to generate output image data.

According to the image processing method related to the eighth aspect of the present invention, the same effect as that of the image processing device related to the third aspect of the present invention can be obtained, and the image processing method related to the eighth aspect of the present invention is similar to that of the image processing device related to the third aspect of the present invention. The image processing device can also be realized in various ways.

A ninth aspect of the present invention provides an image processing method for performing image processing on arrangement image data arranged with respect to decoration image data. An image processing method according to a ninth aspect of the present invention: selecting the arrangement image data to be arranged for each of the arrangement positions of the decoration image data; analyzing the selected arrangement image data to obtain a display and arrangement image An image quality characteristic parameter of a characteristic related to the image quality of data; a layout control that specifies the arrangement position and arrangement size of a plurality of arrangement image data with respect to the decoration image data and specifies the degree of correction of the arrangement image data for each arrangement position information, eliminating or reducing the deviation between the value of the reference image quality parameter preset for the image quality characteristic parameter and the obtained value of the image quality characteristic parameter according to the specified correction degree; according to the layout control information, Output image data is generated using the configuration image data to which the image quality adjustment processing has been applied and the decoration image data.

According to the image processing method according to the ninth aspect of the present invention, the same effects as those of the image processing device according to the fourth aspect of the present invention can be obtained, and the image processing method according to the ninth aspect of the present invention is similar to that of the fourth aspect of the present invention. The image processing device can also be realized in various ways.

A tenth aspect of the present invention provides an image processing method for performing image processing on arrangement image data arranged with respect to decoration image data. An image processing method according to a tenth aspect of the present invention: selecting the arrangement image data to be arranged at each of the arrangement positions of the decoration image data; acquiring a predetermined plurality of arrangement image data for the decoration image data Layout control information that configures the location and size and specifies the priority of each configuration location, and sets the image quality adjustment level for the selected configuration image data according to the specified priority; adjusts the image quality according to the setting level, performing image quality adjustment on the selected configuration image data; generating output image data using the configuration image data subjected to image quality adjustment processing and the decoration image data according to the layout control information.

According to the image processing method according to the tenth aspect of the present invention, the same effect as that of the image processing device according to the fifth aspect of the present invention can be obtained, and the image processing method according to the tenth aspect of the present invention is similar to that of the image processing device according to the fifth aspect of the present invention. The image processing device can also be realized in various ways.

An eleventh aspect of the present invention provides an image processing method for performing image processing on the arrangement image data using layout control information specifying arrangement positions and arrangement sizes of a plurality of arrangement image data arranged with respect to the decoration image data. An image processing method according to an eleventh aspect of the present invention: selecting the arrangement image data to be arranged at the arrangement positions of the decorative image data; assigning priority to the arrangement positions; Sequentially performing image quality adjustment on the selected configuration image data; generating output image data by using the configuration image data subjected to image quality adjustment processing and the decoration image data according to the layout control information.

According to the image processing method according to the eleventh aspect of the present invention, the same effect as that of the image processing device according to the sixth aspect of the present invention can be obtained, and the image processing method according to the eleventh aspect of the present invention is similar to that of the sixth aspect of the present invention. The image processing device can also be realized in various ways.

A twelfth aspect of the present invention provides an image processing method for performing image processing on the arrangement image data using layout control information specifying arrangement positions and arrangement sizes of a plurality of arrangement image data arranged with respect to the decoration image data. The image processing method according to the twelfth aspect of the present invention: acquiring a plurality of the decorative image data; selecting the arrangement image data to be arranged at the respective arrangement positions of the acquired decorative image data; Assigning a priority order to each arrangement position of each decorative image data; performing image quality adjustment on each selected arrangement image data according to the assigned priority order; using the applied image quality according to the layout control information The respective configuration image data processed and the decoration image data are adjusted to generate output image data.

According to the image processing method according to the twelfth aspect of the present invention, the same effect as that of the image processing device according to the fifth aspect of the present invention can be obtained, and the image processing method according to the twelfth aspect of the present invention is similar to that of the image processing device according to the fifth aspect of the present invention. The image processing device can also be realized in various ways.

The image processing methods according to the eighth to twelfth aspects of the present invention can also be realized as an image processing program and a computer-readable recording medium on which the image processing program is recorded.

Description of drawings

FIG. 1 is an explanatory diagram showing a schematic configuration of an image processing system including an image processing device according to an embodiment.

Fig. 2 is a functional block diagram of the personal computer 20 (CPU 200) related to the first embodiment.

FIG. 3 is a flowchart showing a processing procedure of image processing executed in the personal computer 20 according to the first embodiment.

FIG. 4 is a flowchart showing a processing procedure of image processing executed in the personal computer 20 according to the first embodiment.

Fig. 5 is an explanatory diagram schematically showing an example of an image in decorative image data.

FIG. 6 is an explanatory diagram schematically showing a file structure of a decoration image file FF including decoration image data FD and layout control information LI.

FIG. 7 is an explanatory diagram schematically showing a file structure of a captured image file including captured image data GD and image processing control information GI.

FIG. 8 is an explanatory diagram showing an example of image quality adjustment information GC corresponding to the theme of the decoration image data FD specified in the layout control information LI in the first embodiment.

9 is an explanatory diagram showing another example of image quality adjustment information GC corresponding to the theme of the decoration image data FD specified in the layout control information LI in the first embodiment.

FIG. 10 is an explanatory diagram showing an example of image processing control information GI.

FIG. 11 is an explanatory diagram showing an example of a combination table of image processing control information GI and image quality adjustment information GC in the first embodiment.

Fig. 12 is an explanatory diagram schematically showing an output image of output unit data in the second embodiment.

FIG. 13 is an explanatory diagram showing an example of image quality adjustment information GC defined in each decoration image data FD of the second embodiment.

FIG. 14 is an explanatory diagram schematically showing an image example of decoration image data FD having a plurality of arrangement positions where captured image data is arranged.

FIG. 15 is an explanatory diagram schematically showing a file structure of a decoration image file FF provided with layout control information LI for a plurality of captured image data GD.

Fig. 16 is a functional block diagram of the personal computer 20 (CPU 200) related to the third embodiment.

Fig. 17 is a flowchart showing a processing procedure of image processing executed in the personal computer 20 according to the third embodiment.

FIG. 18 is an explanatory diagram schematically showing an arrangement position and an arrangement size of captured image data in decorative image data.

FIG. 19 is an explanatory diagram schematically showing a file structure of a decoration image file FF including decoration image data FD and layout control information LI.

Fig. 20 is an explanatory diagram showing an example of the correction level for each arrangement position specified in the layout control information LI in the third embodiment.

FIG. 21 is an explanatory diagram schematically showing a file structure of a captured image file including captured image data GD and image processing control information GI.

Fig. 22 is a flowchart showing a processing procedure of image processing implemented in the personal computer according to the fourth embodiment.

FIG. 23 is an explanatory diagram showing an example of correction amounts for each arrangement position specified in the layout control information LI in the fourth embodiment.

Fig. 24 is a flowchart showing a processing procedure of image processing implemented in the personal computer according to the fifth embodiment.

FIG. 25 is an explanatory view showing the order and results of the determination of the priority for each arrangement position in the fifth embodiment.

FIG. 26 is an explanatory diagram showing an example of using a plurality of decoration image data FD.

FIG. 27 is an explanatory diagram showing an example of weighting coefficients for the captured image data GD arranged at each arrangement position of the decoration image data FD.

Detailed ways

Hereinafter, an image processing apparatus and an image number processing method related to the present invention will be described based on embodiments with reference to the drawings.

·The first embodiment:

An image processing system including an image processing device according to this embodiment will be described with reference to FIG. 1 . FIG. 1 is an explanatory diagram showing a schematic configuration of an image processing system including an image processing device according to the present embodiment.

The image processing system includes: a digital still camera 10 as an input device that generates image data; a personal computer 20 as an image processing device that performs image processing on the basis of image data generated by the digital still camera 10, and outputs output image data ; and a color printer 30 as an output device that outputs an image with the output image data. In addition, the color printer 30 may have the image processing function of the personal computer 20, and in this case, image processing and image output can be performed independently. In addition, as an output device, in addition to the printer 30, a monitor 25 such as a CRT display or an LCD display, a projector, or the like can be used. In the following description, a color printer 30 used in connection with a personal computer 20 is used as an output device.

The personal computer 20 is a general-purpose personal computer, and includes: a central processing unit (CPU) 200 which performs image processing calculations using the layout control information LI; a random access memory (RAM) 201 which temporarily stores various types of input image data, etc. Data; a hard disk (HDD) 202 (or a read only memory (ROM)) storing programs, reference tables, and the like for performing image processing using the layout control information LI. The personal computer 20 also includes, in addition, a memory card slot 203 for mounting a memory card MC, and an input/output terminal 204 for connecting a connection cable from the digital still camera 10 or the like.

The digital still image camera 10 is a camera that obtains images by imaging optical information on digital devices (photoelectric conversion elements called CCDs and photoelectron multiplier tubes), including: a photoelectric conversion circuit, which is equipped with a circuit for converting optical information into electrical signals. CCD, etc.; an image acquisition circuit, which is used to acquire an image by controlling a photoelectric conversion circuit; and an image processing circuit for processing the acquired digital image, etc. The digital still camera 10 stores captured images as digital data in a memory card MC as a storage device. As the storage format of the image data in the digital still camera 10, it is generally the JPEG data format as the non-reversible compression storage method, and the TIFF data format as the reversible compression storage method, but other RAW data formats, GIF Save format such as data format, BMP data format, etc.

The digital still camera 10, when generating image data, writes shooting information describing shooting conditions set at the time of shooting and image processing control information GI stored in a memory (for example, ROM) of the digital still camera 10 in advance. To the header unit of the image data, the image data is stored in the memory card MC or the like. The image processing control information GI is information experimentally obtained in advance so as to obtain a desired output result when image data generated by an arbitrary image data generating device such as the digital still camera 10 is output from a predetermined output device. The combination of the still camera 10 and the output device (for example, the printer 30 ) is a value obtained in advance for each parameter specifying the image quality adjustment condition.

Furthermore, the digital still camera 10 may store decoration image data FD and layout control information LI for decorating the layout image data GD in a memory, and write them into the memory card MC together with the generated captured image data. The layout control information LI defines the arrangement position and arrangement size of the arrangement image data GD with respect to the decoration image data FD, and is associated with the decoration image data. In addition, in the following description, the captured image data will be described as an example of the layout image data. However, the layout image data may be image data that is placed in the decoration image data FD, and image data generated by computer graphics are included. Limited to the image data of the camera. The decoration image data FD is, for example, data of a frame image, data of an album paper image on which a plurality of arrangement image data is attached, and may be either bitmap data or vector data. The layout control information LI is described by a script file. In this embodiment, in addition to specifying the layout position and layout size of the layout image data GD relative to the decoration image data FD, it also specifies the layout image data that is placed on each layout position. The image quality adjustment information GC of the image quality adjustment condition of GD.

Image data generated in the digital still camera 10 is sent to the color printer 30 via the cable CV, the computer 20, or via the cable CV, for example. Alternatively, the image file is sent to the color printer 30 via the computer 20 in which the memory card MC storing image data in the digital still camera 10 is installed in the memory card slot, or by directly connecting the memory card MC to the printer 30 . In addition, in the following description, the case where the image data is processed by the personal computer 20 and the processed image data is output to the color printer 30 will be described.

The color printer 30 is a printer capable of outputting color images, and is formed, for example, by jetting four color inks of cyan (C), magenta (M), yellow (Y), and black (K) onto a printing medium. An inkjet printer that forms an image with a dot pattern. Alternatively, it is an electrophotographic printer that forms an image on a printing medium by transferring and fixing color toner. Regarding color ink, in addition to the above four colors, light cyan (LC), light deep red (LM) and dark yellow (DY) can also be used.

Image processing in personal computer 20:

The outline of the functional configuration of the personal computer 20 (CPU 200 ) will be described with reference to FIG. 2 . Fig. 2 is a functional block diagram of the personal computer 20 (CPU 200) related to the first embodiment.

The personal computer 20 (CPU 200) includes: a captured image data acquisition unit that acquires one or a plurality of captured image data GD attached to the decoration image data from a plurality of input captured image data GD; The image processing control information acquisition unit of the data-related image processing control information GI. CPU 200 includes: a decoration image data acquisition unit that acquires desired decoration image data FD; and a layout control information acquisition unit that acquires layout control information LI from the acquired decoration image data FD.

CPU 200 includes image quality adjustment means for performing image quality adjustment on captured image data GD using image processing control information GI acquired by image processing control information acquisition means and layout control information LI acquired by layout control information acquisition means. More specifically, CPU 200 performs image quality adjustment processing on at least one of image quality adjustment information GC and image processing control information GI specified in layout control information LI, and cannot acquire image quality adjustment information GC and image processing control information GI. In the case of both control information GI, image quality adjustment processing is not performed on the captured image data GD. The CPU 200 includes an output image data generation unit for attaching each captured image data GD whose image quality has been adjusted by the image quality adjustment unit to the decoration image data FD according to the layout control information LI to generate image data for output. Further, the CPU 200 includes user adjustment means for performing further image quality adjustment processing reflecting user preference input via the input means to the image quality adjustment processing performed using at least one of the image quality adjustment information GC and the image processing control information GI. . The user adjustment means may change the pasting position and pasting size of the captured image data GD pasted on the decoration image data FD according to the layout control information LI.

The image processing performed in the personal computer 20 according to the first embodiment will be described with reference to FIGS. 3 to 11 . FIG. 3 is a flowchart showing a processing procedure of image processing executed in the personal computer 20 according to the first embodiment. FIG. 4 is a flowchart showing a processing procedure of image processing executed in the personal computer 20 according to the first embodiment. Fig. 5 is an explanatory diagram schematically showing an image example of decoration image data. FIG. 6 is an explanatory diagram schematically showing a file structure of a decoration image file FF including decoration image data FD and layout control information LI. FIG. 7 is an explanatory diagram schematically showing a file structure of a captured image file including captured image data GD and image processing control information GI. FIG. 8 is an explanatory diagram showing an example of image quality adjustment information GC corresponding to the theme of the decoration image data FD specified in the layout control information LI in the first embodiment. 9 is an explanatory diagram showing another example of image quality adjustment information GC corresponding to the theme of the decoration image data FD specified in the layout control information LI in the first embodiment. FIG. 10 is an explanatory diagram showing an example of image processing control information GI. FIG. 11 is an explanatory diagram showing an example of a combination table of image processing control information GI and image quality adjustment information GC in the first embodiment. In addition, the image example of the decoration image data FD conceptually represents the state when it is expanded on the image buffer, and the file structure of each file also conceptually represents the state stored in the memory.

The image processing implemented in this embodiment, for example, can be started when the memory card MC is installed in the personal computer 20, or when the digital still camera 10 is connected to the personal computer 20 via a communication cable, or can be started after The keyboard and the like are executed when image processing is instructed by the user.

When starting image processing, the personal computer 20 (CPU 200 ) acquires the selected decorative image data FD and temporarily stores it in the RAM 201 (step S100 ). The decoration image data FD can be selected, for example, on the digital still camera 10, or can be selected from the decoration image data prestored in the HDD 202 on the personal computer 20 via a keyboard, or Choose through the network. In addition, the decorative image data FD may have a plurality of arrangement positions for arranging a plurality of captured image data GD. This is the case in the decoration image data FD having one arrangement position.

The decoration image data FD is, for example, image data of frames corresponding to themes such as seasons and events, image data of a photo album (album), or data for decoration called illustration data (illustratdata) of photographed images. The decoration image data FD , for example, when the image is output (when the image buffer is expanded) it shows the form shown in Figure 5. In the example of Figure 5, as the box with the season as the theme, a calendar box is shown, ready for pasting Attached is the arrangement position of the captured image data GD.

The decoration image data FD is processed in the form of the decoration image file FF provided with the decoration image data FD and the layout control information L1. The decoration image file FF has, for example, the file structure shown in FIG. 6. The layout control information L1 specifies the arrangement position information (for example, coordinate information) where the captured image data GD is to be arranged, and specifies the arrangement of the captured image data GD in the arrangement position. size (resize), and image quality adjustment information GC for the arranged captured image data GD (see FIGS. 8 and 9 ).

Furthermore, α channel data (channel data) is described in the layout control information L1. The α-channel data are, for example, respective gradation values ( R, G, and B data values) are data for determining the transmittance of the image data on the lower layer side to the image data on the upper layer side. For example, if the R, G, and B data of the image data on the upper layer are applied in the form of a coefficient α, the R, G, and B data of the image data on the lower layer are applied in the form of a coefficient (1-α). When the value is 255, the image data of the lower layer side does not appear in the composite image (no see-through), and when the value is 0, the image data of the lower layer side completely appears in the composite image (see-through). By using any value within the range of 0 to 255, a semi-transparent decorative effect can be obtained.

Next, the CPU 200 obtains the selected captured image data GD, and temporarily stores it in the RAM 201 (step S110 ). The selection of the captured image data GD may be performed, for example, on the digital still camera 10, or may be performed on the personal computer 20 via a keyboard or the like. Generally, as already described, the decorative image data FD to be used is selected (determined), and then the captured image data GD to be arranged at each arrangement position of the decorative image data FD is selected.

The captured image data GD may form one captured image file GF together with the image processing control information GI, for example, as shown in FIG. 7 . The image processing control information GI may be described in the header unit when the captured image data GD has a header unit, or may be associated with the captured image data GD through the third additional link data.

The CPU 200 retrieves the image quality adjustment information GC from the layout control information L1 of the acquired decoration image file FF (decoration image data FD), and when the image quality adjustment information GC can be retrieved ("Yes" in step S120), the image quality adjustment information GC is retrieved from the acquired image quality adjustment information GC. The image file GF (captured image data GD) searches for image processing control information GI (step S130).

When the image processing control information GI can be retrieved from the acquired captured image data GD (YES in step S130), the CPU 200 shifts the process to S1 in FIG. When the control information GI is being processed (NO in step S130), the processing is shifted to S2 in FIG. 4 .

The CPU 200 retrieves the image quality adjustment information GC from the layout control information LI of the acquired decoration image file FF (decoration image data FD), and when the image quality adjustment information GC cannot be retrieved ("No" in step S120), it retrieves the image quality adjustment information GC from the acquired layout control information LI. The captured image file GF (captured image data GD) retrieves the image processing control information GI (step S140).

When the image processing control information GI can be retrieved from the acquired captured image data GD (YES in step S140), the CPU 200 shifts the processing to S3 in FIG. When the control information GI is being processed (NO in step S140), the processing is shifted to S4 in FIG. 4 .

Continuing the description with reference to FIG. 4, when the CPU 200 shifts the processing to S1, it executes image quality adjustment processing using image processing control information GI and image quality adjustment information GC (step S150).

Here, an example of the image quality adjustment information GC will be described with reference to FIG. 9 . In the example of FIG. 8, "season" becomes the theme of the decoration image data FD, and corresponds to the calendar frame shown in FIG. 5, for example. As the image quality adjustment information GC, correction amount or tendency of correction is specified for each image quality adjustment parameter of contrast, brightness, chroma, sharpness, and memory color (skin color, green, sky). For example, the memory colors (green, sky) set to "standard" in the decoration image data FD of April are all set to "strong" in the decoration image data FD of July, as the colors emphasizing the green and sky in summer. content.

On the other hand, in the example of FIG. 9, "event" becomes the theme of the decoration image data FD, for example, birthday, Christmas, a fireworks display, and a wedding ceremony are prepared as themes. As the image quality adjustment information GC, correction amount or tendency of correction is specified for each image quality adjustment parameter of contrast, lightness, chroma, sharpness, memory color (skin color, green, sky), and noise removal. For example, in the image quality adjustment information GC of the decorative image data FD about "Fireworks Display" photographed under dark photographing conditions, noise is removed as "selected". Also, in the image quality adjustment information GC of the decorative image data FD having a wedding ceremony as the theme, "soft focus" is set as an image quality adjustment parameter for sharpness.

The image processing control information GI has, for example, the contents shown in FIG. 10 . In the image processing control information GI, shooting scenes at the time of shooting are classified into 11 modes, and correction amounts or trends of correction for optimum image quality adjustment parameters are specified for shooting scenes corresponding to each mode.

The image processing control information GI is the image processing condition (image quality adjustment condition) set corresponding to the shooting scene at the time of shooting, and the image quality adjustment information GC is the image processing condition set corresponding to the theme of the decoration image data FD. conditions (image quality adjustment conditions), which are not the same. Therefore, there are cases where the two pieces of information GI and GC conflict with each other. When the two pieces of information GI and GC coexist, it is necessary to determine whether to combine the two pieces of information GI and GC appropriately or to use only one of the pieces of information.

In this embodiment, the CPU 200 synthesizes the image processing control information GI and the image quality adjustment information GC using the composition table shown in FIG. 11 . In the example of FIG. 11 , image processing control information GI and image quality adjustment information GC are synthesized under equal conditions, but either image processing control information GI or image quality adjustment information GC may be prioritized. When the composite correction amount (correction tendency) is determined using both information GI and GC, the CPU 200 applies the determined composite correction amount (correction tendency) to perform image quality adjustment processing on the captured image data GD.

Now, the image quality adjustment processing using the image processing control information GI and the image quality adjustment information GC will be specifically described. The CPU 200 scans the captured image data GD in units of pixels to obtain image statistical values (image quality characteristic parameter values) representing characteristics of the captured image data GD. As image quality characteristic parameter values, for example, values regarding parameters called contrast, sharpness, and lightness are found. For each image quality characteristic parameter value, the personal computer 20 stores in HDD 202 a reference image quality parameter value as a reference in advance, and the CPU 200 eliminates or reduces the difference between each image quality characteristic parameter value obtained through analysis and the reference image quality parameter value. The method of deviation determines the correction amount for each image quality characteristic parameter value, that is, the analysis correction amount.

The CPU 200 corrects the determined analysis correction amount using the composite correction amount (correction tendency) of each image quality adjustment parameter obtained from the image processing control information GI and the image quality adjustment information GC. That is, the correction correction amount is obtained by increasing or decreasing the determined analysis correction amount by using the synthetic correction amount.

The CPU 200 performs image quality adjustment processing on each captured image data GD using the obtained correction amount. Image quality adjustment processing, for example, each image quality parameter for shading, highlighting, brightness, contrast, color balance, memory color correction, using the input level and output of the RGB components of the captured image data GD The level corresponds to the tone curve (S-curve) to implement. In the image quality adjustment processing using the tone curve, with respect to RGB components or R, G, Each component of B changes each tone curve.

Specifically, in the tone curve, a point to which the correction amount is applied is experimentally determined for each image quality parameter, and by applying the correction amount, the passing point of the tone curve at the point is changed to change the input-output characteristic. Therefore, if the changed R, G, and B tone curves are applied to the captured image data GD, input-output conversion is performed on the RGB components of the captured image data GD, and captured image data GD with adjusted image quality is obtained. .

The acquisition of the analytical correction amount for each image quality parameter and the image quality adjustment processing (automatic image quality adjustment processing) for correcting the correction amount are summarized, for example, as follows specifically. Also, the reference value refers to a reference image quality parameter value.

· Regarding contrast, shadowing, and highlighting, shadow points and highlight points are detected from captured image data, an analysis correction amount is obtained from a reference value, and histogram expansion is performed using the correction amount. Also, the analytical correction amount is obtained from the luminance standard deviation, and the tone curve is changed (corrected) by the correction correction amount.

・For brightness, the image is determined to be dark (underexposed) or bright (overexposed) based on the luminance value calculated from each area divided into 14 image data, and the analytical correction amount is obtained from the reference value, Correction of the tone curve is carried out with the correction correction amount.

・As for the color balance degree, the deviation of the color balance degree is analyzed from the histograms of the R component, the G component, and the B component of the image data, and the reference values for each RGB component are analyzed from the tone curves of the R component, the G component, and the B component. Each analysis correction amount is obtained, and color seepage is reduced by each correction correction amount. Also, when intentional color seepage (color seepage) is specified in the image quality adjustment information GC or image processing control information GI, it is preferable not to perform automatic adjustment of the color balance.

· Regarding chromaticity, analyze the chromaticity distribution of image data, determine the analysis correction amount based on the reference value, further determine the correction correction amount, and emphasize the chromaticity. Therefore, the lower the chromaticity of the image data, the higher the level of emphasis on chromaticity.

・For sharpness, analyze the frequency and edge intensity distribution of the image data, determine the application amount (analysis correction amount) of the unsharp mask (unsharp mask) based on the reference value, further determine the correction correction amount, and use the determined correction correction Amount (Apply Amount) to implement a blur mask for image quality adjustments. The reference value is determined based on the frequency distribution, and the reference value becomes smaller for high-frequency image data (landscapes, etc.), and becomes larger for low-frequency image data (persons, etc.). Also, the amount of application of the blur mask is related to the edge intensity distribution, and the amount of application becomes larger for image data having blur characteristics, and the like.

When the process shifts to S2, CPU 200 performs image quality adjustment processing using image quality adjustment information GC (step S160). More specifically, the image quality adjustment process is performed on the captured image data GD by applying the correction amount (inclination of correction) for each image quality adjustment parameter specified as the image quality adjustment information GC. When describing, as the image quality adjustment information GC, the reduction degree of the deviation between each image quality characteristic parameter value and the reference image quality parameter value, that is, the application level of the automatic image quality adjustment amount, the reduction degree specified by the image quality adjustment information GC is used for The analytical correction amount is corrected as the correction correction amount. On the other hand, when a specific value of each image quality parameter is described as the image quality adjustment information GC, the described value may be used as the correction amount as it is. That is, the image quality adjustment information GC is directly used as the correction correction amount instead of the analysis correction amount obtained by analyzing the captured image data GD. When the image quality adjustment information GC is used, it can be used as a correction amount suitable for the theme of the decoration image data FD.

When the process shifts to S3, the CPU 200 performs image quality adjustment processing using the image processing control information GI (step S170). More specifically, the image quality adjustment process is performed on the captured image data GD by applying the correction amount (inclination of correction) for each image quality adjustment parameter specified as the image processing control information GI. When describing, as the image processing control information GI, the reduction degree of the deviation between each image quality characteristic parameter value and the reference image quality parameter value, that is, the application level of the automatic image quality adjustment amount, the reduction degree specified by the image processing control information GI is used for The analytical correction amount is corrected as the correction correction amount. On the other hand, when a specific value of each image quality parameter is described as the image processing control information GI, the described value may be used as the correction amount as it is. That is, the image processing control information GI is directly used as the correction correction amount instead of the analysis correction amount obtained by analyzing the captured image data GD. When the image processing control information GI is used, it can be used as a correction amount reflecting the photographer's intention.

When the process shifts to S4, CPU 200 does not perform image quality adjustment processing on the captured image data.

The CPU 200 synthesizes (overlays) the decoration image data FD and the captured image data GD according to the layout control information LI to generate output image data (step S180). CPU 200, when there is a change request from the user for the captured image data GD to which image quality adjustment processing is performed on at least one of the image quality adjustment information GC and the image processing control information GI or not to be performed (step S182 "YES"), the requested change is performed on the captured image data GD (step S184), and the process moves to step S190. A change request from the user is input through an input device such as a keyboard and a mouse connected to the personal computer 20, and the change request includes, for example, a change request for arrangement position of captured image data and image quality adjustment of captured image data. In addition, it is also possible to perform rearrangement of captured image data as required.

For example, synthesis of the captured image data GD with the decoration image data FD is performed as follows. The CPU 200 interprets the script file regarding the layout position and layout size described in the layout control information LI, determines the layout position and layout size of the captured image data with respect to the decoration image data FD according to the interpretation result, and determines the decoration image based on the α channel data. The grayscale value of the data FD is used to synthesize (overlay) two image data. The CPU 200 adjusts (reduces or enlarges) the size of each captured image data according to the arrangement size of the arrangement position described in the script file.

The synthesis process of the two images performed by the CPU 200 can be performed, for example, by adding the R, G, and B values of the captured image data by applying the value of the α-channel data described above to obtain the R, G, and B values of the output image data. implement. That is, by setting the α channel data to 0 with respect to the region where the captured image should appear in the output image (composited image), the decoration image data FD does not interfere with the playback of the captured image data GD, and the region where the captured image should appear in the output image In the area of the decoration image (decoration area, frame area), the alpha channel data is set to 255, and reproduction of the captured image is not allowed.

CPU 200 outputs the output image data to the printer driver and display driver (step S190), and ends this processing routine. In the printer driver, RGB-CMYK color conversion processing using a lookup table or the like, halftone processing, and the like are performed, and the output image data is output to the printer 30 as raster data to which a print control command is added, for example.

As described above, according to the personal computer 20 as the image processing device related to the first embodiment, it is possible to use the layout control information LI of the decoration image data FD for the captured image data GD attached to the decoration image data FD. The predetermined image quality adjustment information GC executes image quality adjustment processing. Therefore, by specifying, as the image quality adjustment information GC, the amount of correction to the captured image data GD and the tendency of correction suitable for the image (image) and theme of the decoration image data FD, it is possible to make the image, theme and image quality of the decoration image data FD FD The image quality adjustment processing of the image data GD results in coincidence, matching, or suitability. As a result, an output image with a good appearance can be obtained.

Furthermore, even when image processing control information GI specifying image processing conditions is added to the captured image data GD in association, it is possible to combine the correction amount (correction tendency) specified by the image processing control information GI with the correction amount specified by the image adjustment information GC. Image quality adjustment processing is performed for a predetermined correction amount (correction tendency). Therefore, image quality adjustment processing suitable for the shooting scene can be applied to the captured image data GD, and image quality adjustment processing suitable for the image and theme of the decoration image data FD can be performed. As a result, not only the captured image, but also a composite image of the decorative image and the captured image can be output with a harmonious appearance and good appearance.

·The second embodiment:

Image processing in the personal computer 20 as the second embodiment will be described with reference to FIGS. 12 and 13 . Fig. 12 is an explanatory diagram schematically showing an output image of output unit data in the second embodiment. FIG. 13 is an explanatory diagram showing an example of image quality adjustment information GC defined in each decoration image data FD of the second embodiment. In addition, since the configuration of the image processing system including the configuration of the personal computer 20 is the same as that already described in the first embodiment, the same reference numerals are attached and descriptions thereof are omitted. Moreover, the output image of the output unit data shown in FIG. 12 is, for example, an image (image) that expresses the captured image data GD and decoration image data FD developed on the image buffer as a concept, or an output image that is output to an output medium. The image of the image.

In the first embodiment, the image quality adjustment using the image processing control information GI and the image quality adjustment information GC for the captured image data GD attached to the decoration image data FD is not limited to the output unit, such as a print job unit. Processing is described. On the other hand, in the second embodiment, it is clarified that a plurality of decoration image data FD1, 2 can be included in a print job, and that the captured image data GD1, 2 attached to each decoration image data FD1, 2 can be Apply different image quality adjustment information to this GC.

As shown in FIG. 12, when there are a plurality of decoration image data FD1, 2 for one print job, the image quality adjustment information GC specified in each decoration image data FD1, 2 is applied to each captured image data GD1, 2. That is, the image quality adjustment process for the pasted captured image data GD is controlled by the image quality adjustment information GC specified by the layout control information LI of the decoration image data FD to be pasted.

Variations:

(1) In the above-mentioned first and second embodiments, the captured image data GD is analyzed to obtain the analytical correction amount for each image quality adjustment parameter, and the obtained analytical correction amount is applied to the image processing control information GI and the image quality adjustment information. The correction amount after GC correction is subjected to image quality adjustment processing. However, the image quality adjustment processing may be performed using the image processing control information GI and the image quality adjustment information GC without analyzing the captured image data GD. At this time, each tone curve is changed with respect to the RGB components or each of the R, G, and B components using the composite correction amount (correction tendency) for each image quality adjustment parameter obtained from the image processing control information GI and the image quality adjustment information GC. .

(2) Summarizing the image quality adjustment processing using the correction amount for each image quality parameter, for example, it is specifically implemented as follows. Here, the reference value refers to a reference image quality adjustment parameter value.

・For contrast, shadows, and highlights, the histogram is expanded by the composite correction amount. Also, the tone curve is changed (corrected) by the composite correction amount.

· Regarding lightness, correction of the tone curve is carried out with a composite correction amount.

・As for the color balance, the composition correction amount is applied to each tone curve of the R component, G component, and B component to reduce color seepage.

・For chroma, chroma is emphasized according to the composite correction amount.

• Regarding sharpness, image quality adjustment is performed by implementing an unsharp mask (unsharpmask) with a composite correction amount (applied amount).

In this case, the image quality adjustment processing for the captured image data GD can be directly controlled by the image quality adjustment information GC specified in the layout control information LI. Therefore, image quality adjustment processing suitable for the decorative image data FD or the theme of the decorative image data FD can be performed on the captured image data GD.

In the first embodiment, the case where one captured image data GD is arranged for one decoration image data FD is described, but as shown in FIGS. A plurality of captured image data GD1 and GD2 are arranged for each decoration image data FD. FIG. 14 is an explanatory diagram schematically showing an image example of decoration image data FD having a plurality of arrangement positions where captured image data is arranged. FIG. 15 is an explanatory diagram schematically showing a file structure of a decoration image file FF provided with layout control information LI for a plurality of captured image data GD.

In this case, independent image quality adjustment information GC1 and GC2 are defined for each arrangement position 1 and 2, respectively. Therefore, independent image quality adjustment processing can be performed on the captured image data GD1 , GD2 at each arrangement position of the decorative image data FD.

The image processing device in each of the above embodiments may also be a digital still camera. In this case, image data obtained by combining the captured image data and the decorative image data may be output as captured image data. For example, if a frame provided with a one-point image of a character is used as decorative image data, a captured image with the one-point image of the character can be obtained as a synthesized image.

·The third embodiment:

Referring to FIG. 16, an outline of the functional configuration of the personal computer 20 (CPU 200) related to the third embodiment will be described. Fig. 16 is a functional block diagram showing the personal computer 20 (CPU 200) related to the third embodiment. In addition, in the layout control information LI used in the embodiments after the third embodiment, in addition to the arrangement position and the arrangement size of the arrangement image data GD with respect to the decoration image data FD, it also stipulates the arrangement position and arrangement size for each arrangement position. The correction amount, correction level, and priority order of each arrangement position of the arrangement image data GD.

The personal computer 20 (CPU 200) includes a captured image data selection unit that selects a plurality of captured image data GD to be attached to the decoration image data from a plurality of input captured image data GD, and analyzes the selected captured image data to obtain a display image. A captured image data analyzing unit of image quality characteristic parameters of quality characteristics. The CPU 200 includes layout control information acquiring means for acquiring layout control information LI from the selected decorative image data FD, and image quality adjustment level setting means for setting an image quality adjustment level for the captured image data GD using the acquired layout control information LI. .

The CPU 200 includes image quality adjustment means for using the captured image data GD selected by the captured image data selection means, the analysis result by the captured image data analysis means, the layout control information LI, and the image quality adjustment level setting means Image quality adjustment is performed on each captured image data GD at a predetermined image quality adjustment level. The CPU 200 includes an output image data generation unit for attaching each captured image data GD whose image quality has been adjusted by the image quality adjustment unit to the decorative image data FD according to the layout control information LI to generate output image data. Further, the CPU 200 includes a user adjustment unit for performing image quality adjustment processing performed on the analysis result used in the captured image data analysis unit and the image quality adjustment level set by the layout control information LI to reflect the user's input via the input means. Further image quality adjustment processing for preferences. In addition, the user adjustment means may change the pasting position and pasting size of the captured image data GD pasted on the decoration image data FD according to the layout control information LI.

The image processing performed in the personal computer 20 according to the third embodiment will be described with reference to FIGS. 17 to 21 . Fig. 17 is a flowchart showing a processing procedure of image processing executed in the personal computer 20 according to the third embodiment. FIG. 18 is an explanatory diagram schematically showing an arrangement position and an arrangement size of captured image data in decorative image data. FIG. 19 is an explanatory diagram schematically showing a file structure of a decoration image file FF including decoration image data FD and layout control information LI. Fig. 20 is an explanatory diagram showing an example of the correction level for each arrangement position specified in the layout control information LI in the third embodiment. FIG. 21 is an explanatory diagram schematically showing a file structure of a captured image file including captured image data GD and image processing control information GI. In addition, the arrangement position of the captured image data with respect to the decoration image data FD conceptually represents the state at the time of development on the image buffer, and the file structure of each file also conceptually represents the state stored in the memory.

The image processing implemented in this embodiment, for example, can be started when the memory card MC is installed in the personal computer 20, or when the digital still camera 10 is connected to the personal computer 20 via a communication cable, or can be started after The keyboard and the like are executed when image processing is instructed by the user.

When starting image processing, the personal computer 20 (CPU 200 ) acquires the selected decorative image data FD and the selected plurality of captured image data GD and temporarily stores them in the RAM 201 (step S200 ). The decoration image data FD can be selected, for example, on the digital still camera 10, or can be selected from the decoration image data prestored in the HDD 202 on the personal computer 20 via a keyboard, or Choose through the network. The selection of the captured image data GD may be performed, for example, on the digital still camera 10, or may be performed on the personal computer 20 via a keyboard or the like. In general, decorative image data FD to be used is selected (determined), and then a plurality of captured image data to be arranged at each arrangement position of the decorative image data FD is selected.

The decoration image data FD is, for example, image data of a photo frame, image data of a photo album (album), or data for decoration called explanatory data for a captured image. The decoration image data FD has the form shown in FIG. 18 when the image is output (when the image buffer is expanded), and has arrangement positions A to C for pasting the captured image data. The decoration image data FD is exchanged in the form of a decoration image file FF including the decoration image data FD and the layout control information L1. The decoration image file FF has, for example, the file structure shown in FIG. 19. The layout control information L1 specifies the arrangement position information (for example, coordinate information) where the captured image data GD is to be arranged, and also specifies the arrangement size for each arrangement position A to C. (resizing), the level of correction to the configured captured image data. The correction level is determined according to the placement position on the decoration image data FD and the size of the placement position area. For example, a higher correction level is prescribed for a placement position near the center of the decoration image data FD or a placement position with a larger placement position area.

Furthermore, α-channel data is described in the layout control information L1. The α-channel data are, for example, respective gradation values ( R, G, and B data values) are data for determining the transmittance of the image data on the lower layer side to the image data on the upper layer side. For example, if the R, G, and B data of the image data on the upper layer are applied in the form of a coefficient α, then the R, G, and B data of the image data on the lower layer are applied in the form of a coefficient (1 to α). When the value is 255, the image data of the lower layer side does not appear in the composite image (no see-through), and when the value is 0, the image data of the lower layer side completely appears in the composite image (see-through). By using any value within the range of 0 to 255, a semi-transparent decorative effect can be obtained.

The CPU 200 acquires the layout control information LI from the acquired decoration image file FF (step S210 ), analyzes each selected captured image data GD, and determines an analysis correction amount (step S220 ). Next, the procedure for determining the amount of analysis correction, that is, the amount of automatic image quality adjustment will be described.

The CPU 200 scans the captured image data GD in units of pixels to acquire image statistical values (image quality characteristic parameter values) representing characteristics of the captured image data GD. As image quality characteristic parameter values, for example, values of parameters such as contrast, sharpness, and brightness are obtained. For each image quality characteristic parameter, the personal computer 20 stores in HDD 202 a reference image quality parameter value as a reference in advance, and the CPU 200 eliminates or reduces the gap between each image quality characteristic parameter value obtained by analysis and the reference image quality parameter value. The method of deviation determines the correction amount for each image quality characteristic parameter value, that is, the analytical correction amount.

When determining the amount of analysis correction, when the captured image data GD is associated with the image processing control information GI, it may be implemented using the image processing control information GI. The image processing control information GI, for example, as shown in FIG. 21, may form one captured image file GF together with the captured image data GD. When the captured image data GD has a header unit, it may also be described in the header unit. The captured image data GD can be associated with the third associated data. When describing, as the image processing control information GI, the reduction degree of the deviation between each image quality characteristic parameter value and the reference image quality parameter value, that is, the application level of the automatic image quality adjustment amount, instead of the predetermined reduction degree, it is determined by the image The degree of reduction specified by the processing control information GI determines the amount of analysis correction. On the other hand, when a specific value of each image quality parameter is described as the image processing control information GI, the described value may be used as the correction amount. When the image processing control information GI is used, it can be used as an analysis correction amount reflecting the photographer's intention.

CPU 200 determines whether or not a correction level is specified in the acquired layout control information LI (step S230). Specifically, the layout control information LI is searched to determine whether there is a correction level specifying tag. When the CPU 200 determines that the correction level is specified in the acquired layout control information LI (YES in step S230), it corrects the analysis correction amount for each captured image data according to the predetermined correction level, and determines the correction correction amount (step S240 ).

In the third embodiment, for example, as shown in FIG. 20 , the correction level is specified for each arrangement position, and the correction correction amount of the captured image data for the arrangement position A is set to be 80% of the analysis correction amount, and the imaging correction amount for the arrangement position B is set to be 80%. The correction amount of the image data is 100% of the analysis correction amount, and the correction correction amount of the captured image data at the arrangement position C is 70% of the analysis correction amount. As can be seen from FIG. 18 , in the first embodiment, the arrangement position B is located in the center of the decoration image data LD and has the largest arrangement position area, which is an easily conspicuous arrangement position. Therefore, in the layout control information LI, the correction level for the placement position B is set to 100%, and the image quality adjustment level for the captured image data placed at the placement position B is set higher than that of the other placement positions A and C. As a result, the captured image data arranged at the arrangement position B becomes more conspicuous than the taken image data arranged at the other arrangement positions A and C. FIG.

The CPU 200 performs image quality adjustment processing on the captured image data GD using the determined correction amount (step S250 ). Image quality adjustment, for example, about each image quality parameter of shading, highlighting, lightness, contrast, color balance, memory color correction, color tone corresponding to the input level and output level of the RGB components of the additional captured image data GD Curve (S-curve) to implement. When image quality is adjusted using a tone curve, each correction correction amount for each image quality parameter is used to change one tone curve for each component of RGB. Specifically, in the tone curve, a point to which the correction amount is applied is experimentally determined for each image quality parameter, and by applying the correction amount, the passing point of the tone curve at the point is changed to change the input-output characteristic. Therefore, if the changed R, G, and B tone curves are applied to the captured image data GD, input-output conversion is performed on the RGB components of the captured image data GD, and captured image data GD with adjusted image quality is obtained. .

The acquisition of the analytical correction amount for each image quality and the image quality adjustment processing (automatic image quality adjustment processing) for correcting the correction amount are summarized, for example, as follows specifically. Also, the reference value refers to an image quality reference parameter value.

・For contrast, shadows, and highlights, shadow points and highlight points are detected from captured image data, an analysis correction amount is obtained from a reference value, and histogram expansion is performed using the correction amount. Also, the analytical correction amount is obtained from the luminance standard deviation, and the tone curve is changed (corrected) by the correction correction amount.

・For lightness, based on the luminance value calculated from each area divided into 14 image data, it is judged whether the image is dark (underexposed) or bright (overexposed), the analytical correction amount is obtained from the reference value, and the color tone is implemented by correcting the correction amount Curve correction.

・As for the color balance degree, the deviation of the color balance degree is analyzed from each histogram of the R component, G component, and B component of the image data, and the reference value for each RGB component is obtained from each histogram of the R component, G component, and B component. Each analysis correction amount is obtained, and color seepage is reduced by each correction correction amount. Also, when intentional color seepage (color seepage) is specified in the image quality adjustment information GC or image processing control information GI, it is preferable not to perform automatic adjustment of the color balance.

· Regarding chromaticity, analyze the chromaticity distribution of image data, determine the analysis correction amount based on the reference value, further determine the correction correction amount, and emphasize the chromaticity. Therefore, the lower the chromaticity of the image data, the higher the level of emphasis on chromaticity.

・For sharpness, analyze the frequency and edge intensity distribution of the image data, determine the application amount (analysis correction amount) of the unsharp mask (unsharp mask) based on the reference value, further determine the correction correction amount, and use the determined correction correction Amount (Apply Amount) to implement a blur mask for image quality adjustments. The reference value is determined based on the frequency distribution, and the reference value becomes smaller for high-frequency image data (landscapes, etc.), and becomes larger for low-frequency image data (persons, etc.). Also, the amount of application of the blur mask is related to the edge intensity distribution, and its application amount becomes larger for image data having blur characteristics, and the like.

When CPU 200 determines that the correction level is not specified in the acquired layout control information LI ("No" in step S230), the image quality adjustment process described above is performed using the previously determined analysis correction amount (step S260).

When the CPU 200 ends the image quality adjustment process using the determined correction correction amount (step S250) or the image quality adjustment process using the determined analysis correction amount (step S260), it synthesizes (superimposes) the decorative image data GD according to the layout control information LI , generate output image data (step S270).

Synthesis of the captured image data GD with respect to the decoration image data FD is performed, for example, as follows. The CPU 200 interprets the script file regarding the layout position and layout size described in the layout control information LI, determines the layout position and layout size of the captured image data with respect to the decoration image data FD according to the interpretation result, and determines the decoration based on the α channel data. The gradation value of the image data FD is used to synthesize (overlay) the two image data. The CPU 200 adjusts (reduces or enlarges) the size of each captured image data according to the arrangement size of each arrangement position described in the script file.

The synthesis process of the two images performed by the CPU 200 can be performed, for example, by adding the R, G, and B values of the captured image data by applying the value of the α-channel data described above to obtain the R, G, and B values of the output image data. implement. That is, by setting the α channel data to 0 with respect to the region where the captured image should appear in the output image (composited image), the decoration image data FD does not interfere with the playback of the captured image data GD, and the region where the captured image should appear in the output image In the area of the decoration image (decoration area, frame area), the alpha channel data is set to 255, and reproduction of the captured image is not allowed.

CPU 200 determines whether a user change request has been input from an input device such as a keyboard or a mouse (step S280 ), and when it determines that a user change request has not been input (NO in step S2800 ), proceeds to step S190 .

When the CPU 200 determines that a user change request has been input (YES in step S280), it selects the captured image data specified by the user and changes the arrangement position specified by the user, and executes the processing of steps S230 to S270. As a result, each user's preference can be reflected with respect to the captured image data arranged in the decorative image data and the arrangement position of the captured image data in the decorative image data.

CPU 200 outputs the output image data to the printer driver and display driver (step S290), and ends this processing routine. In the printer driver, RGB-CMYK color conversion processing using a lookup table or the like, halftone processing, and the like are performed, and output image data is output to the printer 30 as raster data to which a print control command is added, for example.

As described above, according to the personal computer 20 which is the image processing apparatus related to the third embodiment, it is possible to change the arrangement positions corresponding to the decoration image data FD according to the correction level specified in the layout control information LI. The correction amount of the captured image data GD above. Therefore, the degree of image quality adjustment of the captured image data GD can be changed according to each arrangement position using the layout control information LI, and various changes can be made to the appearance of the captured image data GD arranged at each arrangement position. As an aspect of changing the degree of image quality adjustment of the captured image data GD corresponding to each arrangement position, for example, it is an aspect to maximize the image quality (good appearance) of the conspicuous captured image data.

Generally, the conspicuous captured image data is arranged near the center of the decoration image data FD, and the arrangement size is also large. The conspicuous captured image data having such characteristics tends to highlight the quality of the image quality compared to other captured image data. From this point of view, it is also an advantage to increase the degree of image quality adjustment for the conspicuous captured image data. .

· Fourth embodiment:

Referring to Fig. 22 and Fig. 23, image processing performed in the personal computer according to the fourth embodiment will be described. Fig. 22 is a flowchart showing a processing procedure of image processing implemented in the personal computer according to the fourth embodiment. FIG. 23 is an explanatory diagram showing an example of correction amounts for each arrangement position specified in the layout control information LI in the fourth embodiment. In addition, since the configuration of the personal computer according to the fourth embodiment is the same as that of the personal computer 20 according to the first embodiment, the same reference numerals are attached and descriptions thereof are omitted.

Next, image processing performed in the personal computer 20 according to the fourth embodiment will be described.

The image processing carried out in this embodiment, for example, may also be started when the memory card MC is installed in the personal computer 20, or when the digital still camera 10 is connected to the personal computer 20 via a communication cable, or may be It is implemented when image processing is instructed by the user via the keyboard or the like.

When starting image processing, the personal computer 20 (CPU 200 ) acquires the selected decorative image data FD and the selected plurality of captured image data GD, and temporarily stores them in the RAM 201 (step S300 ). The decoration image data FD can be selected, for example, on the digital still camera 10, or can be selected from the decoration image data prestored in the HDD 202 on the personal computer 20 via a keyboard, or Choose through the network. In addition, selection of the captured image data GD may be performed, for example, on the digital still camera 10, or may be performed on the personal computer 20 via a keyboard or the like. Generally, decorative image data FD to be used is selected (determined), and then a plurality of captured image data to be arranged at each arrangement position of the decorative image data FD is selected.

The form of the decorative image data FD is as already described. In the fourth embodiment, the correction amount of each arrangement position AC specified in the layout control information LI is shown, for example, in FIG. 23 . The correction amount is determined according to the arrangement position on the decoration image data FD and the size of the arrangement position area. For example, a large correction amount is prescribed for an arrangement position near the center of the decoration image data FD or a arrangement position with a large arrangement position area. As already described, α channel data is described in the layout control information LI.

CPU 200 acquires layout control information LI from the acquired decoration image file FF (step S310), and determines whether or not a correction amount is specified in the acquired layout control information LI (step S320). Specifically, the layout control information LI is searched to determine whether there is a correction amount specification tag. When CPU 200 determines that the correction amount is specified in the acquired layout control information LI (YES in step S320 ), image quality processing is performed on each captured image data GD according to the predetermined correction amount.

In the fourth embodiment, for example, for the decorative image data FD having the arrangement positions shown in FIG. 18 , correction amounts are prescribed for each image quality adjustment parameter for each arrangement position as shown in FIG. 23 . In addition, in the example of FIG. 23 , the correction amount is specified in advance in an easy-to-understand sensory language corresponding to a numerical value, but it is obvious that it may be specified in a numerical value. For the captured image data at the location A, a standard correction amount is specified for contrast, lightness, chroma, and sharpness, and for the captured image data at location B, a strong correction amount is specified for the contrast, chroma, and sharpness. A standard correction amount is defined for lightness, standard correction amounts for contrast, chromaticity, and sharpness are defined for the captured image data at the arrangement position C, and a dark correction amount is defined for lightness.

As can be understood from FIG. 18 , the arrangement position B is located in the center of the decoration image data LD and has the largest arrangement position area, and is an easily conspicuous arrangement position. Therefore, in the layout control information LI, the correction amount for the arrangement position B is made the largest, and the correction amounts for the other arrangement positions A and C are made small. As a result, the captured image data arranged at the arrangement position B is made more conspicuous in terms of contrast, chromaticity, and sharpness compared to the captured image data arranged at the other arrangement positions A and C.

Image quality adjustment processing with a predetermined correction amount is basically performed using a tone curve as already described in the third embodiment.

When CPU 200 determines that the correction level is not specified in the acquired layout control information LI (NO in step S320 ), it does not perform image quality adjustment processing on the captured image data.

The CPU 200, when the image quality adjustment processing with the predetermined correction amount is completed (step S330), or when the image quality adjustment processing is not performed, proceeds to step S320 as it is, and synthesizes (superimposes) the decoration image data FD and The image data GD is captured to generate output image data (step S340).

Combination of the captured image data GD with respect to the decoration image data FD is carried out in accordance with the procedure described in the third embodiment in accordance with the layout control information LI. CPU 200 determines whether a user change request has been input from an input device such as a keyboard or a mouse (step S350), and if it determines that a user change request has not been input (step S350: NO), the process proceeds to step S360.

When the CPU 200 determines that a user change request has been input (YES in step S350), it selects the captured image data specified by the user and changes the arrangement position specified by the user, and executes the processing of steps S320 to S340. As a result, the preference of each user can be reflected with respect to the arrangement position of the captured image data arranged in the decoration image data and the taken image data in the decoration image data.

CPU 200 outputs the output image data to printer 30 (printer driver) and display 25 (step S360), and ends this processing routine.

As described above, according to the personal computer 20 which is the image processing apparatus related to the fourth embodiment, it is possible to carry out correction of each arrangement position arranged on the decorative image data FD in accordance with the correction amount specified in the layout control information LI. Image quality adjustment processing of the above captured image data GD. Therefore, the degree of image quality adjustment of the captured image data GD can be changed according to each arrangement position using the layout control information LI, and various changes can be made to the appearance of the captured image data GD arranged at each arrangement position. More specifically, by increasing the correction amount of at least one of the contrast, lightness, chroma, and sharpness of the conspicuous captured image data, the appearance of the output image of the conspicuous captured image data can be improved.

Generally, the conspicuous captured image data is arranged near the center of the decoration image data, and the arrangement size is also large. The conspicuous captured image data having such characteristics tends to make the difference in image quality more noticeable than other captured image data. From this point of view, it is also an advantage to increase the amount of correction for the conspicuous captured image data.

· Fifth embodiment:

The image processing performed in the personal computer according to the fifth embodiment will be described with reference to Fig. 24 to Fig. 26 . Fig. 24 is a flowchart showing a processing procedure of image processing implemented in the personal computer according to the fifth embodiment. FIG. 25 is an explanatory view showing the order and results of the determination of the priority for each arrangement position in the fifth embodiment. FIG. 26 is an explanatory diagram showing an example of using a plurality of decoration image data FD. In addition, since the configuration of the personal computer related to the fifth embodiment is the same as that of the personal computer 20 related to the first embodiment, the same reference numerals are attached and descriptions thereof are omitted.

Next, image processing performed in the personal computer 20 according to the fifth embodiment will be described.

The image processing carried out in this embodiment, for example, may also be started when the memory card MC is installed in the personal computer 20, or when the digital still camera 10 is connected to the personal computer 20 via a communication cable, or may be It is implemented when image processing is instructed by the user via the keyboard or the like.

When starting image processing, the personal computer 20 (CPU 200 ) acquires the selected decorative image data FD and the selected plurality of captured image data GD, and temporarily stores them in the RAM 201 (step S400 ). The decoration image data FD can be selected, for example, on the digital still camera 10, or can be selected from the decoration image data prestored in the HDD 202 on the personal computer 20 via a keyboard, or Choose through the network. The selection of the captured image data GD may be performed, for example, on the digital still camera 10, or may be performed on the personal computer 20 via a keyboard or the like. Generally, decorative image data FD to be used is selected (determined), and then a plurality of captured image data to be arranged at each arrangement position of the decorative image data FD is selected.

The form of the decorative image data FD is different from the above-mentioned form, and the correction level and correction amount are not specified in the layout control information LI, but the arrangement position, arrangement size, and α-channel data are described.

The CPU 200 acquires the layout control information LI from the acquired decoration image file FF (step S410), and determines whether to determine (acquire) the priority order for each arrangement position using the arrangement position and arrangement size described in the acquired layout control information LI (step S420). ). Specifically, as shown in the following formula (1), the absolute difference between the center of gravity of the arrangement position and the center of gravity of the printed page (or the entire decoration image data) is obtained,

Configuration position=|Center of gravity of configuration position-Center of gravity of printed page|(1)

In the present embodiment, the magnitude of the above-mentioned absolute difference is used as the main criterion for determining the order of priority using the arrangement size (area of the arrangement position). For example, for the decoration image data FD having the arrangement positions shown in FIG. 18, as shown in FIG. The priority of the remaining placement position C is 3, and the placement position C is at the same end as the placement position A, but its size is the smallest, so the priority order is 3. In addition, the priority may be set higher as the layout size increases, or the priority may be set higher as the layout position approaches the center of the decorative image data. This is because when the arrangement size is large and the arrangement position is at the center, it generally becomes a conspicuous image, and by forming an image quality with good appearance, the impression of the entire composite image composed of the decorative image and the arrangement image becomes good.

CPU 200 determines the correction level for each arrangement position as shown in FIG. 25 based on the acquired priority order, and performs image quality adjustment processing for each captured image data GD according to the determined correction level (step S430 ). The image quality adjustment processing using the determined correction level is basically performed using the tone curve as described in the third and fourth embodiments.

When the CPU 200 ends the image quality adjustment process applying the determined correction level (step S430), it synthesizes (superimposes) the decorative image data FD and the captured image data GD according to the layout control information LI to generate output image data (step S440).

Combination of the captured image data GD with respect to the decoration image data FD is carried out in accordance with the procedure described in the third embodiment in accordance with the layout control information LI. CPU 200 determines whether a user change request is input from an input device such as a keyboard or a mouse (step S450), and if it determines that a user change request is not input (step S450: No), the process proceeds to step S460.

When the CPU 200 determines that a user change request has been input (YES in step S450), it selects the captured image data specified by the user and changes the arrangement position specified by the user, and executes the processing of steps S420 to S440. As a result, the preference of each user can be reflected with respect to the arrangement position of the captured image data arranged in the decoration image data and the taken image data in the decoration image data.

CPU 200 outputs the output image data to printer 30 (printer driver) and display 25 (step S460), and ends this processing routine.

As described above, according to the personal computer 20 as the image processing apparatus related to the fifth embodiment, the order of priority of each arrangement position can be determined according to the arrangement position and arrangement size specified in the layout control information LI, and according to the order of priority, The correction level of the captured image data GD arranged at each arrangement position is determined, and image quality adjustment processing is performed. Therefore, the degree of image quality adjustment of the captured image data GD can be changed according to each arrangement position using the layout control information LI, and various changes can be made to the appearance of the captured image data GD arranged at each arrangement position. More specifically, by making the correction level for the largest captured image data larger than the correction level for other captured image data, the appearance of the output image of the largest captured image data can be improved.

Moreover, according to the method of this embodiment, as shown in FIG. 26 , when a plurality of captured image data GD is arranged for a plurality of decorative image data FD1 , FD2 , each arrangement of the plurality of decorative image data FD1 , FD2 can be determined. The priority of the location. Also, since the priority order of each arrangement position of the decoration image data FD1, FD2 can be determined based on the arrangement position and arrangement size (size) of each arrangement position of the plurality of decoration image data FD1, FD2, when there are a plurality of decoration images Also in the case of the data FD, the correction level can be relatively determined for each arrangement position.

In addition, the layout control information LI may predefine the order of priority with respect to each decoration image data FD1, FD2. In this case, it is also possible to skip the priority determination process and determine the correction level for each arrangement position. Also, when there are a plurality of decoration image data FD, the order of priority may be determined in the order described above using the arrangement position and the arrangement size.

As described above, the user determines the order of priority for each decoration image data FD via an input device such as a keyboard and a mouse not shown in the figure. In this case, it is possible to implement image processing reflecting user's preference.

Furthermore, in the fifth embodiment, although the arrangement size is used as the main reference, the arrangement position may also be used as the main reference. At this time, for example, the order of priority may be increased as the center of the decoration image data FD is approached.

·The sixth embodiment:

In the third to fifth embodiments described above, the correction level, correction amount, and order of priority for each arrangement position of the decorative image data FD are determined based on the layout control information LI, regardless of the correlation (influence) between the captured image data GD. ). In the sixth embodiment, it is also possible to reflect the analysis of the striking captured image data in the automatic image quality adjustment process (image quality adjustment process of analyzing the captured image data GD and determining the correction amount or correction level) for other captured image data GD. As a result, the image quality adjustment processing of the other captured image data and the image quality adjustment processing of the striking captured image data are linked.

For example, when emphasizing the contrast, it is also possible to add a predetermined weight to the luminance value (feature value) obtained by analyzing other captured image data and to the luminance value (feature value) obtained by analyzing the conspicuous captured image data to obtain The composite luminance value (feature value) is used to perform contrast adjustment on other captured image data using the obtained composite luminance value.

When the luminance value of the captured image data GD arranged at the arrangement position B is (YminB, YmaxB), the luminance value of the captured image data GD arranged at the arrangement position A is (YminA, YmaxA), and a weight of 1:1 is added. When synthesizing, we get

YminA'=(YminB+YminA)/2

YmaxA'=(YmaxB+YmaxA)/2

When the contrast is emphasized using the combined luminance values YminA' and YmaxA', the captured image data GD at the arrangement position A is emphasized due to the influence of the characteristics of the captured image data GD at the arrangement position B, so it becomes the same as the captured image data GD at the arrangement position B. The image data GD is blended captured image data.

In addition, any captured image data GD may be associated with each other using the weighting coefficients shown in FIG. 27 . FIG. 27 is an explanatory diagram showing an example of weighting coefficients for the captured image data GD arranged at each arrangement position of the decoration image data FD.

When the conspicuous captured image data GD is arranged at the arrangement position A (when the arrangement position A is the main arrangement position), the feature values of the captured image data GD arranged at the arrangement position A are replaced and arranged at the arrangement positions B and C The feature quantity of the captured image data GD on the above. That is, the feature amount of the captured image data GD arranged at the arrangement position A becomes the composite feature amount of the taken image data GD arranged at the arrangement positions B and C.

When the conspicuous captured image data GD is arranged at the arrangement position B (when the arrangement position B is the main arrangement position), the combined feature value of the captured image data GD arranged at the arrangement position A becomes 1:1. A value generated by analyzing the feature amount of the captured image data GD of the arrangement position A and the feature amount of the captured image data GD of the arrangement position B is proportionally combined. Also, the combined feature value of the captured image data GD arranged at the arrangement position C becomes the feature value of the captured image data GD at the arrangement position B.

When the conspicuous captured image data GD is arranged at the arrangement position C (when the arrangement position C is the main arrangement position), the combined feature value of the captured image data GD arranged at the arrangement position A becomes a ratio of 2:3. A value generated by analyzing the feature amount of the captured image data GD of the arrangement position A and the feature amount of the captured image data GD of the arrangement position B is proportionally combined. Also, the combined feature value of the captured image data GD arranged at the arrangement position B becomes the feature value of the captured image data GD at the arrangement position C.

According to the sixth embodiment, when the image quality adjustment process is performed on other captured image data, the analysis result (feature value) of other captured image data is used as the analysis result of the conspicuous captured image data to which a predetermined weight is added by synthesis. (feature amount) obtained analysis results, so it is possible to reconcile the image quality of striking captured image data and other captured image data. Therefore, each captured image data arranged in the decorative image data FD can be used as captured image data having image quality that is correlated with each other.

·Modification:

In the above-mentioned fourth and fifth embodiments, although the image quality adjustment processing based on the analysis result of the image data is not performed, it is also possible to implement the image quality adjustment process based on the analysis result of the image data as described in the third embodiment. Adjust processing.

· Other embodiments:

In the above-mentioned embodiments, the personal computer 20 is used as the image processing device to perform image processing, but in addition, for example, a stand-alone printer or a display device having an image processing function may be used as the image processing device. The image processing described above is carried out in the display device. In addition, the image processing described above can be realized as a printer driver, video driver, or image processing application program without the hardware configuration of an image processing device or the like. Here, the display device includes, for example, a CRT, a liquid crystal display, a projector, etc. that have an image quality adjustment function for image data and can display an image based on the image data GD whose image quality has been adjusted.

Furthermore, all or part of the image processing performed in the personal computer PC may be implemented in the digital still camera 10 . In this case, the image processing function described in the first to sixth embodiments is provided in an image data processing application such as a rendering application stored in the ROM of the digital still camera 10 or a printer driver. Print data including print control commands and print image data generated in the digital still camera 10 is supplied to the printer 30 via a cable or via a memory card MC. The printer 30 that receives the printing data forms a dot pattern on a printing medium according to the printing image data, and outputs an image. In addition, the digital still camera 10 may also supply output image data (image data on which image processing has been performed) to the personal computer 20 or the printer 30 . In this case, image data for printing including a control command for printing is generated in the personal computer 20 or the printer 30 .

In the above-mentioned embodiments, although image processing is implemented in the form of image processing software, that is, a computer program, it may be implemented by an image processing hardware circuit including logic circuits for implementing the above-mentioned processing (steps). In this case, the load on the CPU 200 can be reduced, and higher-speed image processing can be realized. The image processing hardware circuit can be installed, for example, as a circuit for the digital still camera 10 and the printer 30 , or as an add-in card for the personal computer 20 .

As mentioned above, the image processing apparatus, image processing method, and image processing program related to the present invention have been described based on the embodiments. However, the above-mentioned embodiments of the invention are only for facilitating understanding of the present invention, and do not limit the present invention. Of course, the present invention can be changed and improved without departing from the spirit of the present invention and the scope of the claims, and the present invention also includes equivalents thereof.

Claims (16)

1. an image processing apparatus is implemented image processing to the configuration image data that dispose with respect to the decorative picture data, comprising:

The configuration image data obtain parts, and it obtains described configuration image data;

The decorative picture data obtain parts, and it obtains described decorative picture data;

The layout control information obtains parts, it obtains the layout control information, this layout control information is related with the described decorative picture data that obtain, and regulation is with respect to allocation position, configuration sized and the picture quality adjustment information of the described configuration image data of described decorative picture data, and described picture quality adjustment information is stipulated the level of corrections to the configuration image data that disposed;

Characteristic quantity is obtained parts, and it resolves described configuration image data, and the image quality characteristics parameter to the expression characteristic relevant with the picture quality of configuration image data obtains characteristic quantity;

Correcting value decision parts, it is to eliminate or to reduce the described characteristic quantity of obtaining and to the mode of the deviation between the predefined fiducial value of described characteristic quantity, decision is to the correcting value of described configuration image data;

The picture quality adjustment component, it adopts the correcting value that is increased and decreased described decision by the described level of corrections of the described layout control information defined of obtaining, and the correcting value that is suitable for described increase and decrease is implemented picture quality adjustment processing to the described configuration image data that obtain; With

Output image data generates parts, and it generates output image data according to described layout control information from described configuration image data and the described decorative picture data that applied picture quality adjustment processing.

2. image processing apparatus according to claim 1 is characterized in that,

Described picture quality adjustment information regulation is to the control information of described configuration image data, to substitute the described level of corrections of regulation;

Described picture quality adjustment component adopts described control information to increase and decrease the correcting value of described decision.

3. image processing apparatus according to claim 2 is characterized in that,

Described decorative picture data are view data of the predetermined theme of expression;

To the control information of described configuration image data are corrected values that a plurality of picture qualities of being suitable for the predetermined theme of described decorative picture data are adjusted parameters.

4. image processing apparatus according to claim 1 is characterized in that,

Described decorative picture data are view data of the predetermined theme of expression;

The decision of described correcting value is a plurality of picture qualities relevant with the picture quality of described configuration image data to be adjusted parameter implement respectively;

Described level of corrections is adjusted the parameter separate provision to described a plurality of picture qualities, and is suitable for the predetermined theme of described decorative picture data.

5. image processing apparatus according to claim 1 is characterized in that,

The image processing control information of the image capture conditions when described configuration image data are handled with specify image is related;

The picture quality adjustment processing of being undertaken by described picture quality adjustment component to described configuration image data is preferentially to implement with described image processing control information.

6. image processing apparatus according to claim 1 is characterized in that,

The image processing control information of the image capture conditions when described configuration image data are handled with specify image is related;

The picture quality adjustment processing of being undertaken by described picture quality adjustment component to described configuration image data is preferentially to implement with described picture quality adjustment information.

7. image processing apparatus according to claim 1 is characterized in that,

The image processing control information of the image capture conditions when described configuration image data are handled with specify image is related;

Be to be suitable for the information of synthetic described image processing control information and described picture quality adjustment information and to implement by carry out the picture quality adjustment of described configuration image data is handled of described picture quality adjustment component.

8. image processing apparatus according to claim 1 is characterized in that,

Described decorative picture data have a plurality of allocation positions;

Described configuration image data obtain parts and obtain a plurality of described configuration image data;

Described layout control information is related with the described decorative picture data that obtain, and the allocation position of described a plurality of configuration image data of disposing with respect to the described decorative picture data with described a plurality of allocation positions of separate provision, configuration sized and to the picture quality adjustment information of the configuration image data that disposed;

It is that the described a plurality of configuration image data on each allocation position that is configured in described decorative picture data are implemented respectively that the employing of being undertaken by described picture quality adjustment component is handled by the picture quality adjustment of the described picture quality adjustment information of the described layout control information defined of obtaining;

The generation that is generated the described output image data that parts carry out by described output image data is, adopts according to described layout control information describedly to have applied that each configuration image data that the picture quality adjustment handles and described decorative picture data implement.

9. according to claim 1 or 8 described image processing apparatus, it is characterized in that,

Comprise the change parts, it is used to change the picture quality to described configuration image data that adopts described picture quality adjustment information to implement and adjusts result.

10. an image processing method is implemented image processing to the configuration image data that dispose with respect to the decorative picture data, wherein,

Obtain described configuration image data;

Obtain described decorative picture data;

Obtain the layout control information, this layout control information is related with the described decorative picture data that obtain, and regulation is with respect to allocation position, configuration sized and the picture quality adjustment information of the described configuration image data of described decorative picture data, and described picture quality adjustment information is stipulated the level of corrections to the configuration image data that disposed;

Resolve described configuration image data, the image quality characteristics parameter to the expression characteristic relevant with the picture quality of configuration image data obtains characteristic quantity;

To eliminate or to reduce the described characteristic quantity of obtaining and to the mode of the deviation between the predefined fiducial value of described characteristic quantity, decision is to the correcting value of described configuration image data;

Employing increases and decreases the correcting value of described decision by the described level of corrections of the described layout control information defined of obtaining, and the correcting value that is suitable for described increase and decrease is implemented the picture quality adjustment to the described configuration image data that obtain and handled;

According to described layout control information, generate output image data from described configuration image data and the described decorative picture data that applied picture quality adjustment processing.

11. image processing method according to claim 10 is characterized in that,

Obtain a plurality of described configuration image data;

Described layout control information is related with the described decorative picture data that obtain, and regulation is with respect to the allocation position of the described configuration image data of the described decorative picture data with described a plurality of allocation positions, configuration sized with to the picture quality adjustment information of the configuration image data that disposed;

It is that the described a plurality of configuration image data on each allocation position that is configured in described decorative picture data are implemented respectively that employing is handled by the picture quality adjustment of the described picture quality adjustment information of the described layout control information defined of obtaining;

The generation of described output image data is to adopt described each configuration image data and the described decorative picture data that applied picture quality adjustment processing to implement according to described layout control information.

12. an image processing apparatus is implemented image processing to the configuration image data that dispose with respect to the decorative picture data, comprising:

Configuration image data alternative pack, it is to described each allocation position of described decorative picture data, the described configuration image data that selection should be disposed;

Configuration image data parsing parts, each configuration image data that it resolves described selection obtain the image quality characteristics parameter of representing the characteristic relevant with the picture quality of configuration image data; With

The picture quality adjustment component, it obtains the layout control information, this layout control information regulation is with respect to the allocation position and the configuration sized of a plurality of configuration image data of described decorative picture data, and regulation is to the correcting value of the configuration image data of each allocation position, described correcting value is by at least one side's decision in described allocation position and the configuration sized, eliminate or the low value that subtracts the predefined benchmark image mass parameter of described image quality characteristics parameter according to described correcting value, and the deviation between the value of the described image quality characteristics parameter that obtains is implemented the picture quality adjustment to described each configuration image data of selecting; With

Output image data generates parts, and it adopts described applied each configuration image data and described decorative picture data that the picture quality adjustment is handled according to described layout control information, generates output image data.

13. image processing apparatus according to claim 12 is characterized in that,

Described correcting value is, according to the correcting value of the configuration image data that are configured in described decorative picture data central authorities greater than to the mode of the correcting value of the configuration image data in other position that is configured in described decorative picture data and set;

The picture quality adjustment of being undertaken by described picture quality adjustment component to the configuration image data is to implement by the minimizing degree that increases described deviation along with described correcting value.

14. image processing apparatus according to claim 12 is characterized in that,

Described correcting value is, according to the correcting value of the described configuration image data corresponding with the configuration sized of maximum greater than to the mode of the correcting value of other configuration image data and set;

The picture quality adjustment of being undertaken by described picture quality adjustment component to the configuration image data is to implement by the minimizing degree that increases described deviation along with described correcting value.

15. image processing apparatus according to claim 12 is characterized in that, further comprises the change parts, it is used to change the picture quality to described configuration image data of being undertaken by described picture quality adjustment component and adjusts result.

16. an image processing method is implemented image processing to the configuration image data that dispose with respect to the decorative picture data, wherein,

To described each allocation position of described decorative picture data, the described configuration image data that selection should be disposed;

Resolve each configuration image data of described selection, obtain the image quality characteristics parameter of the expression characteristic relevant with the picture quality of configuration image data;

Obtain the layout control information, described layout control information regulation is with respect to the allocation position and the configuration sized of a plurality of configuration image data of described decorative picture data, and regulation is to the correcting value of the configuration image data of each allocation position, described correcting value is by at least one side's decision in described allocation position and the configuration sized, eliminate or the low value that subtracts the predefined benchmark image mass parameter of described image quality characteristics parameter according to described correcting value, and the deviation between the value of the described image quality characteristics parameter that obtains is implemented the picture quality adjustment to described each configuration image data of selecting;

According to described layout control information, adopt described applied each configuration image data and described decorative picture data that the picture quality adjustment is handled, generate output image data.

Images