JPH08241466A - Dinning room adjustment device - Google Patents

Abstract

PURPOSE: To realize the dinning room adjustment device which uses ordinary tableware and has a high recognition performance by recognizing the picture of a plate, which is photographed by a photographing means, by a recognition means and determining the price of a dish based on the recognition result in accordance with the correspondence table between shapes of plates and dishes. CONSTITUTION: The adjustment device consists of a CCD camera 1, a signal converter 2, a picture monitor 3, an adjustment display device 7, a card reading adjustment device 8, and a computer apparatus 13. The CCD camera 1 photographs plates 11a, 11b, and 11c, and the signal converter 2 converts their pictures to digital picture data. A picture recognition device 4 performs binarizing picture processing of inputted picture data to recognize the shapes and dimensions of individual plates. A price converter 5 retrieves a plate recognition register table 6 based on inputted recognition data to determine the prices of dishes. The correspondence between various elements of dimensions of all plated and prices of dishes is preliminarily registered in the plate recognition register table 6.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a cafeteria settlement device. More specifically, it is a cafeteria settlement device that automatically pays for the food cooked by each person in an employee cafeteria or the like.

[0002]

2. Description of the Related Art A conventional example of a restaurant settlement device is disclosed in Japanese Patent Laid-Open No. 3-2
It is described in Japanese Patent No. 59397. In this conventional example, as shown in FIG. 7, the dish dishes 3a, 3b and 3c are preliminarily placed on the transport line 1 and color data adding means for attaching color data according to the price of the dish. Dish 3
Image processing means 11 for identifying color data of a, 3b and 3c
Then, the unit price data of the dish corresponding to the color data is stored in advance in the rate conversion table 12, and the unit price data is read from the rate conversion table 12 based on the color data identified by the image processing means 11 to calculate the total amount of the dish. It is provided with a charge settlement means 13 for controlling the fee, and a transmission processing means 14 for transmitting the total amount of money data calculated by the charge settlement means 13 or the total amount of money data including the charge of each dish, which is sent from the transmission processing means 14. The amount data is displayed on the display device 5 at the accounting place, and the accounting staff pays the amount according to the display.

[0003]

The conventional dining room settlement device as described above has the inconvenience that commercially available tableware cannot be used as it is because color data corresponding to the price of the dish must be added to the tableware in advance. In addition, an expensive color camera and color image processing device are required to identify the color, and misrecognition due to the deterioration of the color added to the tableware or the change of the color due to the ambient brightness or the light source color or the tableware is placed. Misrecognition occurs due to image deformation due to position, and
An accounting clerk is required to perform the settlement operation based on the fee displayed on the display device, and there is the inconvenience that the user has to wait until the accounting clerk finishes the settlement at the accounting location. There are various problems that the user may feel uneasy only by displaying the display.

The present invention has been made to solve the above problems, and one object thereof is to realize a cafeteria settlement apparatus which can use ordinary tableware. Another object of the present invention is to
It is to realize a cafeteria settlement device with high recognition performance for tableware.

Another object of the present invention is to realize a cafeteria settlement device which can use an inexpensive device for photographing and image processing of dishes. Another object of the present invention is to realize a self-service cafeteria settlement device that does not require an accounting staff.

Another object of the present invention is to realize a cafeteria settlement device that is kind to the user.

[0007]

[Means for Solving the Problems] A first means for solving the above problems is a table holding means for holding a table showing a correspondence relationship between table dimensions and dish prices, and an image capturing operation for taking dishes. Means, a recognition means for recognizing the dimensions of the tableware from the image obtained by the photographing means, and a table of the table holding means is searched based on the recognition result of the recognition means to obtain the price of the corresponding dish. A cafeteria settlement device, comprising: price search means; and settlement means for performing settlement based on a search result of the price search means.

A second means for solving the above-mentioned problems is a table holding means for holding a table showing a correspondence relationship between table dimensions and dish prices, a photographing means for photographing the dishes, and the photographing means. Recognition means for recognizing the dimensions of the tableware from the image obtained by, and registration means for registering the correspondence between the dimensions of the tableware recognized by the recognition means and the price of the dish in the table holding means, It comprises price search means for searching the table of the table holding means based on the recognition result of the recognition means to obtain the price of the corresponding dish, and settlement means for performing settlement based on the search result of the price search means. It is a cafeteria settlement device characterized by that.

A third means for solving the above-mentioned problems is a table holding means for holding a table showing a correspondence relationship between table dimensions and dish prices, a photographing means for photographing the dishes, and the photographing means. Recognition means for recognizing the dimensions of the tableware from the image obtained by the above; price search means for searching the table of the table holding means based on the recognition result of the recognition means to obtain the price of the corresponding dish; Settlement means for performing settlement based on the search result of the price search means,
Card processing means for operating the recognition means, the price search means and the settlement means upon reading the user card, and performing settlement processing on the user card upon completion of the operation of the settlement means. It is a cafeteria settlement device characterized by.

A fourth means for solving the above-mentioned problems is a table holding means for holding a table showing a correspondence relationship between table dimensions and dish prices, a photographing means for photographing the dishes, and the photographing means. Recognition means for recognizing the dimensions of the tableware from the image obtained by the above; price search means for searching the table of the table holding means based on the recognition result of the recognition means to obtain the price of the corresponding dish; Settlement means for performing settlement based on the search result of the price search means,
A cafeteria settlement device, comprising: a progress status display unit that displays a progress status of processing from photographing to settlement.

In any one of the first to fourth means for solving the above-mentioned problems, the dimension specifications of the tableware in the table held by the table holding means are at least an area, a perimeter, a major axis and a minor axis. It is preferable that it is present in order to increase the degree of recognition.

In any one of the first to fourth means for solving the above-mentioned problems, the recognizing means corrects the distortion of the image due to the position on the photographing screen photographed by the photographing means to measure the size of the tableware. It is preferable to recognize the specifications from the viewpoint of increasing the degree of recognition.

[0013]

In the first means for solving the problem, the recognition means recognizes the image of the tableware photographed by the photographing means, and the price search means searches the table holding means based on the recognition result to obtain the price of the dish. The cooking price is settled by the settlement means based on the obtained price.

In the second means for solving the problem, the recognition means recognizes the image of the tableware photographed by the photographing means, and the correspondence between the tableware and the price of the dish is registered in the table holding means based on the recognition result. When the settlement operation is performed, the price holding unit searches the table holding unit based on the image recognition result of the recognition unit to obtain the price of the dish, and the settlement unit setstles the dish price based on the obtained price.

In a third means for solving the problem, the recognition means starts recognition of the tableware image with the reading of the user card by the card processing means, and based on the recognition result, the price search means causes the table holding means to operate. The price of the dish is searched for and the price of the dish is settled by the settlement means based on the obtained price, and the user card is settled.

In a fourth means for solving the problem, the progress status display means displays the progress status of processing from photographing to settlement.

[0017]

Embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a block diagram showing the configuration of the apparatus of the embodiment of the present invention, FIG. 2 is a conceptual diagram of the apparatus of the embodiment of the present invention, and FIG. 3 is an external view of the apparatus of the embodiment of the present invention. In FIGS. 1, 2 and 3, 1 is a monochrome CCD camera, 2 is a signal converter, 3 is an image monitor, 4 is an image recognition device, 5 is a price conversion device, 6 is a recognition registration table for tableware, 7 Is a payment display device, 8 is a card reading payment device, 9 is a payment processing device, 1
Reference numeral 0 is a counting device.

11a, 11b and 11c are tableware, 12
Is a tray for dishes. For the tableware 11a, 11b, and 11c, the price of the dishes to be served is predetermined according to the shape and size of the tableware.

The dishes 11a, 11b and 11c and the tray 12 have a clear contrast with each other, for example, if the dishes 11a, 11b and 11c are light colors,
As the tray 12, a dark and non-reflective tray 12 is used.

Reference numeral 13 is a computer device including an image recognition device 4, a price conversion device 5, a tableware recognition registration table 6 and a settlement processing device 9. Reference numeral 14 denotes a housing in which a CCD camera 1, a signal converter 2, an image monitor 3, a settlement display 7, a card reading settlement device 8 and a computer device 13 are attached to form a settlement device 100 as a whole. There is.

The image monitor 3, the settlement display device 7 and the card reading settlement device 8 are mounted on the front surface of the housing 14. The housing 14 has a tableware 141 on the front surface. The upper surface of the table pedestal 141 is also colored in the same color as the tray 12 or a darker color than the tray 12, and is non-reflective.

The housing 14 has an eaves portion 142 protruding forward in the upper part of its front surface. The eaves 142 includes a tableware 14
A CCD camera 1 is installed so as to face the upper surface of 1.
The eaves portion 142 is also provided with a lighting device (not shown) for illuminating the tableware 141.

As shown in FIG. 4, the CCD camera 1 has a viewing angle capable of photographing the entire tray 12 on the table ware 141 at a time. The CCD camera 1 is an embodiment of the photographing means in the present invention. This shooting means can be for black and white,
It can be realized at low cost.

The CCD camera 1 photographs the dishes 11a, 11b and 11c on the tray 12 placed on the dish stand 141, and inputs the output signal to the signal converter 2. The signal converter 2 converts the output signal of the CCD camera 1 into a video display signal, for example, an NTSC signal, and supplies it to the image monitor 3 to display the video imaged by the CCD camera 1. The signal converter 2 also converts the output signal of the CCD camera 1 into digital image data and supplies it to the image recognition device 4.

The image recognition device 4 performs binarized image processing on the input image data. Due to the difference in contrast between the dishes 11a, 11b and 11c and the tray 12 and the tableware 141, the dishes 11a, 11b and 11
The image of c can be correctly binarized.

The image recognition device 4 further recognizes the shape and size of individual dishes for the binary image. Specifically, the contour of the binary image of the tableware is detected, the dimensions such as the area, circumference, major axis and minor axis of the figure formed by the contour are measured, and the values of those dimensions are recognized as recognition data. To the price conversion device 5. In this way, since the tableware recognition is performed using the measurement value for the binary image, a color image is not necessary, and a monochrome image is sufficient.

The image recognition device 4 is an embodiment of the recognition means in the present invention. Since this recognition means is suitable for monochrome images, it can be realized at low cost. The price conversion device 5 is
Based on the input recognition data, the table recognition registration table 6 is searched and the price of the dish is obtained. In the tableware recognition registration table 6, correspondences between the dimensions of all the tableware used in the cafeteria and the prices of the dishes are registered in advance. This tableware recognition registration table 6 is an embodiment of the table holding means in the present invention.

The price conversion device 5 uses the recognition data to
The degree of similarity with the registered tableware dimensions is calculated, and the price corresponding to the tableware with the highest degree of similarity is calculated. The similarity of tableware is calculated as follows. ar = absolute value (measured area-registered area); (1) cr = absolute value (measured circumference-registered circumference); (2) lr = absolute value (measured major axis-registered major axis); (3) sr = absolute Value (measured minor axis-registered minor axis); (4) as = (measured area-ar) / measured area; (5) if (as <0.0) as = 0.0; (6) cs = (measured (7) if (cs <0.0) cs = 0.0; (8) ls = (measured major axis-lr) / measured major axis; (9) if (ls <0) .0) ls = 0.0; (10) ss = (measured minor axis-sr) / measured minor axis; (11) if (ss <0.0) ss = 0.0; (12) Similarity = as * Cs * ls * ss; (13) The price conversion device 5 searches for the tableware having the highest value of the similarity given by the equation (13) and calculates the corresponding dish. Determine the rating. The price conversion device 5 is an embodiment of the price search means in the present invention. The retrieved price is input to the settlement processing device 9.

Searching by using the degree of similarity in this way increases the margin for variations in illumination, and also improves the degree of recognition for changes in the shape of the rectangular tableware due to the orientation or rotation of the rectangular tableware, thus improving reliability. It is extremely preferable in that it allows highly recognizable image recognition.

The settlement processing device 9 obtains the settlement amount and the total amount for each tableware according to the input search result, and displays them on the settlement display 7. The settlement processing device 9 is an embodiment of the settlement means in the present invention.

The settlement processing device 9 also performs settlement processing on the card inserted by the user through the card reading settlement device 8. The card read-out settlement device 8 processes, for example, a magnetic prepaid card (hereinafter simply referred to as a card), and deducts a charge from the usage balance to write a new balance. The card reading settlement device 8 is an embodiment of the card processing means in the present invention.

The settlement data of the settlement processing device 9 is, for example, L
It is sent to the aggregation processing device 10 via a communication line such as an AN (local area network), and is used by the aggregation processing device 10 for aggregation of sales, menus, number of users, etc., such as daily totals, monthly totals, etc. To be done.

The tableware is registered in the tableware recognition registration table 6 through the CCD camera 1. That is, the tableware to be registered is placed on the tableware 141 and the CCD camera 1
The image is recognized by the image recognition device 4, the area, the circumference, the major axis and the minor axis are measured, and the measured values of these dimension specifications are recognized along with the price of the dish corresponding to the tableware. Register in the registration table 6.

As a result, ordinary tableware can be used as it is without any modification.
In addition, new tableware can be easily additionally registered during operation of the settlement device 100. The CCD camera 1, the signal converter 2, and the image recognition device 4 at this time are an embodiment of the registration means in the present invention.

Since the tableware registration is performed by using the configuration used during actual operation as it is, image recognition and registration can be performed based on the image taken under the same conditions as during operation. Highly accurate image recognition becomes possible.

Further, due to the characteristics of the optical system of the CCD camera 1, even when the distortion amount of the image of the tableware is different between the central portion and the peripheral portion of the screen, the change amount depending on the position of the image of the actual tableware is measured and the correction coefficient is obtained. Then, the image recognition device 4 corrects the image at the time of operation with this coefficient, so that erroneous recognition based on the difference in the tableware position can be prevented.

The operation of the apparatus according to the embodiment of the present invention thus constructed is as follows. FIG. 5 shows a flow of using the cafeteria, and FIG. 6 shows a flow of operation of the apparatus according to the embodiment of the present invention.
As shown in FIG. 5, the cafeteria user takes a favorite dish in the tray provided (selection of dish) and eats at the table (
(Food), the payment is made by the payment device 100 of the embodiment of the present invention (payment), and the tray and the tableware are returned to the lower table (tableware return).

The charge settlement by the settlement device 100 of the embodiment of the present invention is performed according to the flow of FIG. In FIG. 6, the figure shown on the right side of each step of the flow is an example of an operation guide for the user displayed on the screen of the settlement indicator 7 and a figure for displaying the progress status for each step.
The settlement display 7 is an embodiment of the progress status display means in the present invention.

The first step 101 is a standby state. In this state, a figure of a person is displayed on the screen of the settlement display unit 7 to indicate a standby state. According to this display, the user places the tray 12 on which the tablewares 11a, 11b and 11c, which have finished eating, on the tableware table 141 (step 102), and inserts the card into the card reading settlement device 8 (step 103). As a result, the payment indicator 7 displays a graphic of the card reading payment device, indicating that the card is being read.

When the card is inserted, the settlement operation is started, and first, the tableware 11a, the CCD camera 1,
11b and 11c are photographed and tableware images are recorded (step 104). At this time, the image display device 3
The images of the taken dishes 11a, 11b and 11c are displayed on. Further, the settlement display 7 displays a graphic of a CCD camera and a computer, indicating that tableware images are being recorded.

Next, the image recognition device 4 binarizes the recorded image data, and the contour of the tableware is extracted based on the binarized image data (step 105). At this stage, the display on the settlement display 7 is changed to a graphic only for the computer, and it is displayed that the image is being processed by the computer.

Next, the image recognition device 4 measures the dimensions such as area, perimeter, major axis and minor axis based on the extracted contours of the tableware, and recognizes the shape of the tableware (step 106).

Next, the price conversion device 5 calculates the price of the dish by searching the table for table recognition recognition registration 6 based on the similarity given by the above equation (13) according to the shape recognition result of the dish. (Step 107).

Next, it is judged whether or not the price of the dishes has been calculated for all the tableware on the tray 12 (step 108). If NO, the process returns to step 106 and the shape recognition and the price of the remaining tableware are confirmed. Repeat the calculation.

During the processing of steps 106 to 108, the computer graphic is displayed on the settlement display unit 7 to indicate that the computer is processing data. When the prices of all the dishes have been calculated, the settlement processing device 9 displays the total amount and details of the dish on the settlement display 7 (step 109).

Next, the settlement processing device 9 drives the card reading settlement device 8 to perform settlement processing on the card inserted therein (step 110). During the settlement process for the card, the settlement display 7 displays a computer graphic together with the total amount and details of the dish.

When the settlement process is completed, the card is read out from the card reading settlement device 8 (step 111), and the settlement is completed (step 112). At this time, the image on the settlement display 7 is changed to a person image, and the user waiting state is displayed.

As described above, the self-service using the card automatically pays the meal fee, and the accounting staff and the like are not required. Further, the operation guide displayed on the adjustment display 7 and the progress status display make the adjustment device friendly to the user.

As the photographing means in the present invention,
Although the CCD camera shown in the embodiment is preferable in terms of compactness and high performance, the invention is not limited to this, and an image pickup tube type television camera or the like may be used as long as it can generate an electric signal based on a captured image.

The signal converter 2 may be omitted depending on the type of television camera. Further, the image recognition device 4 exemplifies the one in which the image data is subjected to the binarized image processing and the shape and the size of the individual tableware are recognized with respect to the binary image, but the multivalued image processing of three or more values is performed. ,
The shape and size of the individual tableware may be recognized for the image, or the shape and size of the individual tableware may be recognized for the halftone image.

The card used by the user is not limited to a prepaid card, but a credit card or an ID card.
(identification card) etc. are also acceptable. In addition to magnetic cards, optical cards and IC cards (integrated circui
t card) etc.

[0052]

As described above in detail, according to the present invention, table holding means for holding a table showing a correspondence relationship between table dimensions and dish prices, and a photographing means for photographing tableware. A recognition means for recognizing the dimensions of the tableware from the image obtained by the photographing means, and a price search for searching the table of the table holding means based on the recognition result of the recognition means to obtain the price of the corresponding dish Means and
By including the settlement means for performing settlement on the basis of the search result of the price search means, ordinary tableware can be used, the tableware recognition performance is high, and an inexpensive device can be used for shooting and image processing of the tableware. Can realize a cafeteria settlement device that can.

Further, according to the present invention, the table holding means for holding the table showing the correspondence relationship between the dimension specifications of the tableware and the price of the dish, the photographing means for photographing the tableware, and the photographing means are obtained. A recognition means for recognizing the dimensions of the tableware from the image; a registration means for registering the correspondence between the dimensions of the tableware and the price of the food recognized by the recognition means in the table holding means; By providing the price search means for searching the table of the table holding means based on the recognition result to obtain the price of the corresponding dish, and the settlement means for performing the settlement based on the search result of the price search means, the operation is performed. It is possible to realize a cafeteria settlement device that allows additional registration of new tableware at any time during the course.

Further, according to the present invention, the table holding means for holding the table showing the correspondence between the dimensions of the tableware and the price of the dishes, the photographing means for photographing the tableware, and the photographing means are provided. Recognition means for recognizing the dimensions of the tableware from the image, price search means for searching the table of the table holding means based on the recognition result of the recognition means to obtain the price of the corresponding dish, and the price search means. Settlement means for performing settlement on the basis of the retrieval result, and the recognition means, the price retrieval means, and the settlement means are actuated upon reading the user card, and the user card is actuated upon termination of the operation of the settlement means. By including the card processing means for performing the settlement processing in the above, it is possible to realize a self-service dining room settlement apparatus that does not require an accounting staff.

Further, according to the present invention, the table holding means for holding the table showing the correspondence between the dimensions of the tableware and the price of the dish, the photographing means for photographing the tableware, and the photographing means are obtained. The recognition means for recognizing the dimensions of the tableware from the image, the price search means for searching the table of the table holding means based on the recognition result of the recognition means to obtain the price of the corresponding dish, and the price search means By including the settlement means for performing settlement on the basis of the search result and the progress status display means for displaying the progress status of the processing from photographing to settlement, it is possible to realize a dining room settlement device that is kind to the user.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an apparatus according to an embodiment of the present invention.

FIG. 2 is a conceptual diagram of an apparatus according to an embodiment of the present invention.

FIG. 3 is an external view of an apparatus according to an embodiment of the present invention.

FIG. 4 is a diagram showing a shooting state of a CCD camera in the apparatus of the embodiment of the present invention.

FIG. 5 is a flow chart of the use of a dining room in which the device of the embodiment of the present invention is installed.

FIG. 6 is a flowchart showing the operation of the apparatus according to the embodiment of the present invention.

FIG. 7 is a block diagram of a conventional example.

[Explanation of symbols]

 1 CCD camera 2 signal converter 3 image monitor 4 image recognition device 5 price conversion device 6 table recognition registration table 7 settlement display 8 card reading settlement machine 9 settlement processing device 10 aggregation processing device 11a, 11b, 11c tableware 12 trays 13 Computer equipment 100 settlement device 14 housing 141 tableware 142 eaves

Claims (6)

[Claims] 1. A table holding means for holding a table showing a correspondence relationship between table dimensions and dish prices, an image capturing means for capturing an image of the table, and a dimension of the table based on an image obtained by the image capturing means. Recognizing means for recognizing the origin, price searching means for searching the table of the table holding means based on the recognition result of the recognizing means to obtain the price of the corresponding dish, and settlement based on the search result of the price searching means And a settlement means for performing the above. 2. A table holding means for holding a table showing a correspondence relationship between dimensions of tableware and prices of dishes, a photographing means for photographing tableware, and dimensions of tableware based on an image obtained by the photographing means. Recognition means for recognizing the origin, registration means for registering the correspondence relationship between the dimension specifications of the tableware and the price of the food recognized by the recognition means in the table holding means, and based on the recognition result of the recognition means A cafeteria settlement device comprising: a price search unit that searches a table of a table holding unit to obtain a price of a corresponding dish; and a settlement unit that performs settlement based on a search result of the price search unit. 3. A table holding means for holding a table showing a correspondence relationship between table dimensions and dish prices, an image capturing means for capturing an image of the table, and table dimensions based on an image obtained by the image capturing means. Recognizing means for recognizing the origin, price searching means for searching the table of the table holding means based on the recognition result of the recognizing means to obtain the price of the corresponding dish, and settlement based on the search result of the price searching means And a card processing for operating the recognition means, the price search means and the settlement means upon reading the user card, and subjecting the user card to settlement processing upon completion of the operation of the settlement means. A cafeteria settlement device, characterized by comprising: 4. A table holding means for holding a table showing a correspondence relationship between table dimensions and dish prices, a photographing means for photographing tableware, and table dimensions based on an image obtained by the photographing means. Recognizing means for recognizing the origin, price searching means for searching the table of the table holding means based on the recognition result of the recognizing means to obtain the price of the corresponding dish, and settlement based on the search result of the price searching means 2. A cafeteria settlement apparatus comprising: a settlement means for performing the above; and a progress status display means for displaying the progress status of processing from photographing to settlement. 5. The dimensions of the tableware held on the table held by the table holding means are at least the area, the circumference,
The cafeteria settlement device according to any one of claims 1 to 4, which has a long diameter and a short diameter. 6. The recognizing means is for recognizing the dimensions of the tableware by correcting the distortion of the image due to the position on the photographing screen photographed by the photographing means. The cafeteria settlement device described in 1.