JP2013011934A - Sales data processor, sales data processing system and program - Google Patents

Abstract

An object of the present invention is to identify a good customer at the time of registration of sales data and execute a process for the good customer without requiring the customer to perform a member registration procedure.
The camera unit section 2 constituting the ECR compares the image data photographed by the customer-side camera 25 with the contents of the face recognition data file to identify the customer, and refers to the customer database. Whether or not the customer is a good customer is determined based on the purchase record and visit record of the specific customer. If the customer is the good customer, a predetermined process is executed. For example, as predetermined processing for a good customer, notification data notifying the customer service method is displayed on the operator display unit 16, a coupon is issued from the printing unit 17, or an advertisement medium (receipt with advertisement) is issued. .
[Selection] Figure 1

Description

  The present invention relates to a sales data processing apparatus, a sales data processing system, and a program for registering sales data for each transaction.

In general, in a store, sales data processed by a sales data processing device such as an ECR (Electronic Cash Register) or POS (Point of sale) terminal is analyzed, and the attributes of the customer (purchaser) (shopping frequency, Repeat rate, gender, age group, etc.). For example, when analyzing a customer's shopping frequency, repeat rate, gender, age group, etc., the customer (member ID) is specified based on card data read from a previously issued member card and recorded as a purchase history. However, in customer analysis using membership cards as a medium, issues with membership cards and costs, as well as membership rates remain, and customer analysis is not possible for non-members. Can not.
Therefore, conventionally, a camera for photographing a customer's face is provided, and facial features are extracted from images captured by the camera, and the extracted result is compared with the contents of the customer database (facial feature point data). A technique is known in which a customer is specified and customer data (name, address, telephone number, etc.) associated with the customer is read from a database and displayed (see Patent Document 1).

JP 2001-325433 A

  However, even the technique of Patent Document 1 described above is intended for customers who have registered as members in advance, and anyone other than the members does not recognize the face and specify the customers.

  An object of the present invention is to identify a good customer at the time of registration of sales data and execute a process for the good customer without requesting a member registration procedure for the customer.

In order to solve the above-described problem, one aspect of the present invention is as follows.
A sales data processing device for registering sales data for each transaction,
Imaging means for photographing customers waiting for registration;
Customer identifying means for identifying the customer based on the image data of the customer photographed by the imaging means;
Customer data storage means for storing and managing at least each customer's actual data indicating purchase results or store visit results;
Discrimination means for discriminating whether or not the customer is a good customer based on the record data corresponding to the customer specified by the customer specifying means;
When it is determined by the determining means that the customer is a good customer, processing means for executing a predetermined process for the good customer;
A sales data processing apparatus characterized by comprising:

In order to solve the above-described problem, another aspect of the present invention provides:
A sales data processing system including a sales data processing device for registering sales data for each transaction and a management device for managing sales data,
The sales data processing device comprises an imaging means for photographing a customer waiting for registration,
The management device
Customer identifying means for identifying the customer based on the image data of the customer photographed by the imaging means;
Customer data storage means for storing and managing performance data showing at least one of the customer's purchase results and store visit results for each customer,
Discrimination means for discriminating whether or not the customer is a good customer based on the record data corresponding to the customer specified by the customer specifying means;
With
Furthermore, the sales data processing device comprises processing means for executing predetermined processing for the excellent customer when the determining means determines that the customer is a good customer.
This is a sales data processing system characterized by the above.

Furthermore, in order to solve the above-described problem, another aspect of the present invention provides:
Against the computer,
A function to register sales data for each transaction,
The ability to shoot customers waiting for registration,
A function for identifying the customer based on the image data of the photographed customer;
A function for storing and managing at least customer performance data indicating purchase results or store visit results for each customer,
A function of determining whether the customer is a good customer based on the performance data corresponding to the identified customer;
When it is determined that the customer is a good customer, a function for executing a predetermined process for the good customer;
It is a program for realizing.

  According to the present invention, it is possible to specify a good customer at the time of sales data registration and execute the process for the good customer without requesting the member registration procedure for the customer, thereby improving customer service and sales. Promotion is possible.

The block diagram which showed the basic component of ECR. The external appearance perspective view of the state which looked at ECR (ECR main-body unit part 1) from the front diagonal (customer side). The figure which illustrated the customer image of the registration queue image | photographed with the customer side camera 25. FIG. The figure which showed the file and database which were memorize | stored and managed by the camera unit part 2 side. The figure for demonstrating customer database Y3. The flowchart for demonstrating the registration process performed when mode switch MS is switched to the "registration (REG)" mode. 7 is a flowchart for explaining in detail the customer identification registration process (step A10 in FIG. 6). 7 is a flowchart for explaining receipt receipt processing (step A14 in FIG. 6) in detail. The block diagram which showed the sales data processing system provided with ECR100 applied as a sales data processing apparatus, and the management apparatus (server apparatus) 200 which is communication-connected to this ECR100 and manages sales data. The flowchart which showed the registration process performed by the ECR100 side. The flowchart which showed the operation | movement by the side of the server apparatus 200.

(First embodiment)
First, a first embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a block diagram showing basic components of an ECR (Electronic Cash Register) applied as a sales data processing apparatus.
This ECR (sales data processing apparatus) is separated into an ECR main unit 1 and a camera unit 2, and the ECR main unit 1 and the camera unit 2 are detachably connected via a cable 3. Has been. As a basic function (standard function) as the ECR, the ECR main unit 1 registers the input sales data for one transaction, and uses the denomination passed from the customer at the end of registration for one transaction. It has a sales data registration function that performs the appropriate type of tightening process. In this embodiment, the ECR main unit 1 further generates an event code according to various keys, drawer open / close, etc., and transfers the event code to the camera unit 2 as a journal record. It has a function to do.

  The camera unit 2 captures a customer waiting for registration (waiting for settlement), a camera function for photographing a person in charge (operator) and its operation status, and a customer image photographed by this camera function. And a customer attribute specifying function for specifying the customer's attributes (for example, gender and age group), and various functions are modularized. The camera unit 2 is detachably connected to the ECR main unit 1 via a cable 3 and can be freely replaced at any time due to a failure or the like. The ECR main unit 1 and the camera unit 2 cooperate to perform various processes as necessary.

  The ECR main unit 1 has a CPU 11 as a core and is a central processing unit that controls the overall operation of the ECR main unit 1 according to various programs. The storage unit 12 includes, for example, a storage medium such as a ROM, a RAM, a flash memory, and a drive system thereof, and a program for realizing the present embodiment according to an operation procedure illustrated in FIGS. Stores various applications, database, character font data, etc. The above-mentioned storage medium is not limited to a built-in storage medium provided in a fixed manner, and may be a removable external storage medium. Program / data can be transmitted from another device to a wired transmission line. Alternatively, it may be installed in a storage medium via a wireless transmission path, or accessed by using a server that stores and manages programs / data. The memory 13 is a work area for temporarily storing various data necessary for the operation of the ECR main unit 1 such as time measurement data and flag data.

  Further, the CPU 11 is connected with an operation unit 14, a scanner 15, an operator display unit 16, a printing unit 17, a drawer driving unit 18, and a COM port 19 as input / output peripheral devices via a bus line. The CPU 11 controls these operations according to the input / output program. The operation unit 14 has a keyboard on which various push button-type keys are arranged. Although not shown on the keyboard, there are ten keys, a registration key, a subtotal key, a lock key such as a cash / cash key, and the like. A mode switch MS is also provided.

  The mode switch MS is a rotary switch that switches various operation modes (program types) such as “registration (REG)”, “RF (return)”, and “Z (settlement)” according to the switching position. In a state where the CPU 11 is switched to the “registration (REG)” mode, the CPU 11 executes a registration process for displaying the input sales data, printing a receipt, and updating the total sales. When the closing key is pressed at the end of transaction registration, the drawer is released or a receipt is issued.

  The image scanner 15 has, for example, an image sensor (image sensor) such as a CCD or a CMOS, and reads by scanning a barcode or a two-dimensional code attached to the product at the time of scanning operation when registering the product. Thus, the CPU 11 analyzes the image data photographed by the image scanner 15 to decode the code data such as a barcode and specify the product. The operator display unit 16 displays data about money and products, messages, and the like for a person in charge (operator), and is configured by, for example, a liquid crystal display or an organic EL (Electro Luminescence) display. The printing unit 17 is, for example, a non-impact printer or a dot impact printer such as thermal transfer or inkjet, and prints a printed matter (for example, a receipt with a coupon). The drawer drive unit 18 controls the opening / closing of the drawer 18A according to a key operation. The COM port 19 is a serial port for connection with the camera unit unit 2.

  The camera unit 2 has a CPU 21 as a core, and is a central processing unit that controls the overall operation of the camera unit 2 according to various programs. The storage unit 22 includes, for example, a storage medium such as a ROM, a RAM, and a flash memory and a drive system thereof, and stores programs and various applications for realizing the present embodiment. The memory 23 is a work area for temporarily storing various data necessary for the operation of the camera unit 2.

  Also, the CPU 21 is connected with a customer display unit 24, a customer side camera 25, an operation side camera 26, a card interface unit 27, and a COM port 29 as input / output peripheral devices via a bus line. The CPU 21 controls these operations according to the program. The customer display unit 24 has its screen faced to the customer side for customers waiting for registration (waiting for payment), and is composed of, for example, a 7-segment LED (light emitting diode) and the like. , Display the amount of deposit, etc. numerically.

  The customer-side camera 25 is arranged close to the customer display unit 24 and shoots with the face of the customer waiting for registration as the center, and the operation-side camera 26 is the entire operation unit 14 and during operation. This is a surveillance camera that can photograph the operator's face and photograph the person in charge (operator) and the operation status thereof. Although details of the customer-side camera 25 and the operation-side camera 26 are not shown in the drawings, they have a lens unit, an image sensor, an A / D (analog / digital) conversion unit, and the like, and can capture moving images. The subject image from the lens unit is formed on an image sensor (CCD or CMOS), so that the subject can be photographed with high definition.

  The card interface unit 27 is inserted and connected to an SD card 28 as a recording medium, and various files to be described later are stored in the SD card 28. The camera unit 2 is provided with a lock (not shown) to prevent the SD card 28 inserted and connected to the card interface unit 27 from being stolen. For example, a dedicated key possessed by the person in charge is used. Then, the lock is opened and the SD card 28 is taken out. Further, the external recording medium is not limited to the SD card 28. The COM port 29 is a serial port for connection with the ECR main unit 1.

FIG. 2 is an external perspective view of the ECR (ECR main unit 1) configured as described above when viewed from the front oblique side (customer side).
On the upper surface of the ECR main unit 1, an operator display unit 16 is disposed, and a keyboard and a mode switch MS constituting the operation unit 104 are disposed. Further, a receipt issuing port (not shown) for taking out a receipt (for example, a receipt with a coupon) sent from the printing unit 107 is disposed on the upper surface of the ECR main unit 1.

  The camera unit unit 2 includes a housing 2A of the customer display unit 24 and a pole-shaped support member (supporting pole) 2B that supports the housing 2A. The support pole 20 </ b> B supports the housing 2 </ b> A of the customer display unit 24, and its lower end is fixed vertically on the back side of the ECR main unit 1. The upper end of the support pole 2B is mounted with a housing 2A of the customer display unit 24 so that the length of the housing 2A can be adjusted, and the housing 2A of the customer display unit 24 includes the support pole 2B. Can be rotated. That is, the height of the housing 2A and its orientation can be adjusted, and the height and orientation of the customer display unit 24 and the customer-side camera 25 can also be adjusted accordingly.

  As shown in FIG. 2, the customer-side camera 25 is disposed close to one end portion (left end portion in the figure) of the customer display unit 24 on the front surface of the housing 20A, and its shooting direction is waiting for registration. In the customer direction, the angle of view is within a range in which the customers in the registration queue can be photographed. FIG. 3 exemplifies a customer image in the registration queue taken by the customer-side camera 25, and shows a state in which the next customer is lined up behind the top customer. The camera unit 2 identifies customer attributes (gender, age group) by analyzing a customer image obtained by photographing the customer in the registration queue by the customer side camera 25, or the customer's past sales record (for example, In consideration of the total sales amount) and the store visit performance (for example, the number of visits), it is specified whether or not the customer is a good customer.

  FIG. 4 is a diagram showing files and databases provided on the camera unit unit 2 side. On the camera unit 2 side, a customer-side moving image file Y1, a face recognition data file Y2, a customer database Y3, and the like are stored and managed. The customer-side moving image file Y1 is a moving image file taken by the customer-side camera 25, and the recording date and time (time stamp) is sequentially stored with each file corresponding to each moving image file. The CPU 21 extracts and generates image data (still images) for one frame from the customer-side moving image file Y1 for customer identification.

  The face recognition data file Y2 is an image file for face recognition that is collated when a customer is identified based on image data extracted and generated for customer identification from the customer-side moving image file Y1. In addition to “use data (facial feature point data)”, an item “customer recognition output ID” is stored and managed. The “customer recognition output ID” is identification data for identifying a customer who has been recognized as a result of executing the process of recognizing the face based on the image taken by the customer side camera 25. The customer database Y3 is a file that stores and manages data related to each customer.

FIG. 5 is a diagram for explaining the customer database Y3.
The customer database Y3 is configured to store customer records having items of “customer recognition output ID”, “gender”, “age group”, “registration date”, “sales record”, “visit store record”, and so on. Yes. The “customer recognition output ID” is customer identification data for linking with the face recognition data file Y3. “Gender” and “Age” are data estimated by analyzing image data taken from customers. Gender and age are comprehensively determined based on hairstyle, makeup status, clothing, and wrinkle status. The layer is specified. Note that the identification of the gender and age group is a technique that is generally used in a technique such as a camera, and since the known technique is used in the present embodiment, the specific description thereof is omitted. It shall be.

  The “registration date” indicates the date when the customer record is registered, and the “registration date” is included in a part of the above-mentioned “customer recognition output ID”. For example, if the “registration date” is “January 15, 2010”, the “customer recognition output ID” is “20100115001”. The last three digits “001” indicate a serial number. “Sales result” indicates the total purchase amount of the customer that has been purchased, that is, the total sales amount (cumulative value). The “visit to store” indicates the number of visits (cumulative value) up to the present time when the customer visited the store. Here, on the camera unit 2 side, when “sales record” is a reference value (for example, 50,000 yen) or more or “visit store record” is a reference value (for example, 20 times) or more, a good customer I try to identify that. The “sales record” is not limited to the total sales amount, and may be the total number of sales, and the “visit store record” may be the store visit frequency or the store visit frequency.

Next, the operation concept of the ECR 1 in the first embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. In other words, in addition to the recording medium, an operation unique to the present embodiment can be executed using a program / data supplied externally via a transmission medium.
FIG. 6 is a flowchart showing an outline of the operation of the characteristic part of the present embodiment in the overall operation of the ECR. When the flow of FIG. 6 is exited, the main flow of the overall operation (not shown). Return to.

FIG. 6 is a flowchart for explaining a registration process executed when the mode switch MS is switched to the “registration (REG)” mode. The ECR main unit 1 performs various processes in cooperation with the camera unit 2 as necessary.
First, the CPU 11 of the ECR main unit 1 checks whether a registration operation for registering sales data has been performed (step A1), whether a subtotal key has been operated (step A8), and whether a closing key has been operated. (Step A11), or other keys are operated (step A16).

  Now, when a registration operation for registering sales data is performed, that is, a scanning operation is performed by the scanner 15 to read a barcode or the like from a product, or a product key or the like is operated after inputting the number of values of amount data Sometimes (YES in step A1), the process proceeds to the next step A2, and the ECR main unit 1 accesses the camera unit 2 side and checks whether the photographing operation of the customer camera 25 is stopped. If the customer-side camera 25 is stopped (YES in step A2), it is checked whether it is the first registration operation for one transaction (step A3). Now, when the first registration operation of one transaction is performed (YES in step A3), the “moving image file name” is set by generating the “moving image file name” and transferring it to the camera unit 2 side. Later (step A4), the customer-side camera 25 is activated to start a recording operation for sequentially recording the captured images (step A5). Then, the process proceeds to product registration processing (step A6).

  On the other hand, when the customer-side camera 25 is operating (NO in step A2), even if the customer-side camera 25 is stopped, it is not the first registration operation of one transaction (NO in step A3), the above-mentioned The moving image file name setting process (step A4) and the activation / recording process (step A5) of the customer camera 25 are skipped, and the process proceeds to a product registration process (step A6). In the product registration process, the input product name and unit are displayed on the operator display unit 16 and the customer display unit 24, or the contents (sales data) of the product total file and department total file (not shown) are displayed. The process of adding and updating the sales data this time is performed. In this case, the display data is transferred from the ECR main unit 1 to the camera unit 2 side so that the product name and unit are displayed on the customer display 24.

  When such a product registration process is performed, after the subtotal amount for one transaction is updated (step A7), the process returns to step A1 waiting for operation. Thereafter, the above-described operation is repeated each time a registration operation is performed. When the subtotal key is operated (YES in step A8), the subtotal amount is displayed on the operator display unit 16 and the customer display unit 24 (step A9). Then, after instructing the camera unit 2 to start the customer specific registration process (step A10), the process proceeds to step A1 waiting for operation.

FIG. 7 is a flowchart for explaining in detail the customer specific registration process (step A10 in FIG. 6) by the camera unit 2.
First, the CPU 21 of the camera unit 2 extracts an image for one frame from the current movie shooting (step B1), and extracts facial feature point data by analyzing the extracted image (still image). (Step B2). Then, the face recognition data file Y2 is searched based on the feature point data (step B3). As a result, whether the feature point data of the face extracted this time corresponds to the feature point data of the face of the person already registered in the face recognition data file Y2 (whether it matches characteristically), that is, registration If it corresponds to a registered person (YES in step B4), it is determined that the customer can be specified. Then, after acquiring the corresponding “face recognition output ID” from the face recognition data file Y2 (step B5), the process goes out of the flow of FIG.

  If it does not correspond to a registered person (NO in step B4), the above-mentioned extracted image (still image) is analyzed to estimate the gender and age group of the customer (step B6). Then, a “face recognition output ID” and a “registration date” are newly generated (step B7), and a new record including the “face recognition output ID”, “registration date”, “sex”, and “age group” is created. Generate (step B8), and register (additional registration) as a new customer in the customer database Y3 (step B9). Further, the facial feature point data is registered (added registration) as a new customer in the face recognition data file Y2 together with the “face recognition output ID” (step B10). Then, after performing notification processing (step B11) for displaying notification data (message) for notifying the operator that the customer has been additionally registered as a new customer (step B11), the flow goes out of the flow of FIG.

  On the other hand, when another key, for example, a correction key is operated in the registration process of FIG. 6 (YES in step A16 of FIG. 6), the correction process is executed as a process corresponding to the operation (step A17). ), The process returns to the above-described step A1 waiting for operation. Further, when a closing key such as a cash / deposit key is operated at the end of registration for one transaction (YES in step A11), the type of tightening process corresponding to the denomination passed from the customer (total for each transaction is calculated). Update processing) or in the case of cash transactions, the drawer is opened (step A12). Then, the customer database Y3 is searched based on the customer's “face recognition output ID” specified in the customer specification registration process (step A10) described above, and the sales amount for the current transaction is updated to the corresponding “sales record”. At the same time, “1” is added to the “visiting record” of the customer to update the value (step A13). Then, after executing the receipt issuing process (step A14), the operation of the customer side camera 25 is stopped (step A15). This completes the registration process for one transaction.

FIG. 8 is a flowchart for explaining the receipt issuing process (step A14 in FIG. 6) in detail.
The CPU 11 of the ECR main unit 1 searches the customer database Y3 based on the customer's “face recognition output ID” specified in the customer specification registration process (step A10 in FIG. 6) described above, and the corresponding “sales record”. , After reading and acquiring “visit to store” (step C1), the “sales record” is greater than or equal to a reference value (for example, 50,000 yen), or “visit to store” is a reference value (for example, 20 times) Whether this is the case is checked (step C2). If at least one of “visit store record” and “visit store record” is equal to or greater than the corresponding reference value (YES in step C2), the customer is identified as a good customer (step C3).

  Then, after displaying a customer service guide message indicating that the customer should be a good customer on the operator display unit 16 (step C4), the gender and age group of the customer specified as described above are acquired (step C5). ), Advertisement data prepared in advance corresponding to the gender and age group (for example, advertisement data of recommended products according to the gender and age group) is acquired (step C6). Here, after the printing unit 107 is driven, the sales data, deposits, and change for this transaction are printed on receipt, and the advertisement data for each gender and age group is printed on the receipt (step C7). And after printing a coupon at the end of a receipt (step C8), a receipt with a coupon is issued (step C9). On the other hand, if the customer who made the transaction this time is not a good customer (NO in step C2), the sales data, deposit and change for this transaction are printed on receipt (step C10), and then a receipt is issued (step C9). ).

  As described above, the camera unit unit 2 constituting the ECR in the first embodiment specifies the customer by comparing the image data photographed by the customer-side camera 25 with the contents of the face recognition data file Y2, With reference to the customer database Y3, it is determined whether or not the customer is a good customer based on the purchase record and visit record of the specific customer. If the customer is a good customer, the predetermined processing is executed. Even without requesting a membership registration procedure, it is possible to provide a service by identifying a good customer when registering sales data, and to improve customer service and promote sales. Note that, as a predetermined process for a good customer, a service that gives a privilege to a customer does not give a disadvantage to the customer even if the customer is not specified precisely.

  Since the notification data notifying the customer service method is displayed as the predetermined process for the excellent customer, it is possible to prevent the manner of greeting the excellent customer from being neglected.

  Since the coupon is issued as the predetermined process for the good customer, the good customer can enjoy the profit and know that he is treated as a good customer.

  Since the advertisement medium (receipt with advertisement) on which the advertisement data is printed is issued as the predetermined process for the excellent customer, it is possible to perform an appropriate advertisement targeting a customer with a high willingness to purchase.

  By analyzing the image data taken of the customer and inferring their gender and age group, we publish print media with print content according to this gender and age group, so it is effective to match the customer's attributes Advertising is possible.

  When the customer could not be specified, the image data was registered as a new customer in the face recognition data file Y2 and the customer database Y3, and the new customer was guided and displayed. In addition to being able to serve new customers, the operator is not required to perform any special registration work and can reduce the burden on the operator.

  The customer-side camera 25 is mounted on the customer display unit 24 visually recognized by the customer waiting for registration and is installed in a direction in which the face of the customer waiting for registration can be photographed face-to-face. It is possible to shoot and face recognition can be performed appropriately.

(Second Embodiment)
Hereinafter, a second embodiment of the present invention will be described with reference to FIGS.
In the above-described first embodiment, the case where the present invention is applied to an ECR alone has been shown. However, in the second embodiment, the present invention is applied to a sales data processing system in which the ECR and a management apparatus (server apparatus) are connected by communication. This is the case. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

FIG. 9 is a block diagram showing a sales data processing system.
The sales data processing system is a LAN system in which a plurality of ECRs 100 installed in a store are connected to a management device (server device) 200 via a LAN (private private line) 300. The system is connected to a sales data processing system of another affiliated store B via the Internet 400 and can communicate therewith. The configuration of the ECR 100 is basically the same as the configuration shown in FIG. 1, but in the second embodiment, a LAN communication unit that further transmits and receives data to and from the management device (server device) 200. 101.

  The management device (server device) 200 is a personal computer (PC), and the configuration thereof is not shown. However, in addition to the CPU, storage unit, display unit, and operation unit, data is transmitted to and received from the ECR 100. A LAN communication unit 201 is provided. In the first embodiment described above, the camera unit unit 2 side stores and manages the face recognition data file Y2 and the customer database Y3. However, in this second embodiment, the server device 200 side stores the face recognition data. The file Y2 and the customer database Y3 are stored and managed, and the face recognition process is performed on the server device 200 side.

FIG. 10 is a flowchart showing a registration process on the ECR 100 side, and the execution is started in response to a registration operation.
When the registration processing for one transaction is completed (step D1 in FIG. 10), the ECR 100 uses the server device 200 to store the sales data for one transaction and the customer image data extracted at the subtotal key operation timing as described above. (Step D2). Then, it is checked whether data is received from the server device 20, that is, whether data indicating that a new customer has been registered (step D3) or whether data related to a good customer has been received (step D5). If not received (NO in step D5), the sales data for one transaction is printed on receipt (step D10), and after the receipt is issued (step D9), the process exits the flow of FIG.

FIG. 11 is a flowchart showing the operation on the server device 200 side.
When the server apparatus 200 receives data from the ECR 100 in the reception waiting state, that is, receives sales data for one transaction and image data of the customer of the transaction (YES in step E1 in FIG. 11), the received customer image. The feature points of the face are extracted by analyzing the data (step E2). Then, the face recognition data file Y2 is searched based on the feature point data (step E3), and it is checked whether it corresponds to the person (customer) registered in the face recognition data file Y2 (step E4). If it corresponds to the registered person (YES in step E4), it is determined that the customer can be specified, and the corresponding “face recognition output ID” is obtained from the face recognition data file Y2. After (step E5), the process proceeds to the next step E12.

  If the customer does not correspond to the registered customer (NO in step E4), the sex and age group of the customer are estimated by image analysis (step E6). Then, “face recognition output ID” and “registration date” are newly generated (step E7), and a new record including the “face recognition output ID”, “registration date”, “gender”, and “age group” is created. It is generated (step E8) and registered as a new customer (additional registration) in the customer database Y3 (step E9). Further, the facial feature point data is registered (added registration) as a new customer in the face recognition data file Y2 together with the “face recognition output ID” (step E10). Then, after transmitting notification data (message) notifying that additional registration has been made as a new customer to the ECR 100 (step E11), the process proceeds to the next step E12.

  In this step E12, the customer database Y3 is searched, the sales amount for this transaction is updated to the corresponding “sales record”, and “1” is added to the “visit record” of the customer and the value is updated. Perform the process. If the “sales record” is less than the reference value and the “visit store record” is less than the reference value (NO in step E13), the process returns to the first step E1, but the “sales record”, “store visit record” If at least one of them is equal to or greater than the reference value (YES in step E13), the customer is identified as a good customer (step E14). After obtaining a customer service message indicating that a customer should be a good customer (step E15), the customer's gender and age group are estimated by image analysis (step E16). The prepared advertisement data (for example, advertisement data of recommended products according to gender and age group) is acquired (step E17). Coupon data is transmitted to the ECR 100 together with the customer service message and advertisement data acquired in this way (step E18), and then the process returns to the first step E1.

  On the other hand, when data indicating that a new customer has been registered is received from the server apparatus 200 on the ECR 100 side (step D3 in FIG. 10), a message indicating that the new customer has been registered is displayed on the operator display unit 16 as a guide ( Step D4). When data relating to a good customer is received (YES in step D5), the received customer service message is displayed on the operator display unit 16 (step D4), and advertisement data corresponding to the sex and age group of the customer is displayed. The receipt is printed together with the sales data, deposits and change for this transaction (step D7). And after printing a coupon at the end of a receipt (step D8), a receipt with a coupon is issued (step C9).

  As described above, in the second embodiment, the ECR 100 transmits image data to the server device 200 when a customer waiting for registration of sales data is photographed by the customer-side camera 25. The server device 200 And the content of the face recognition data file Y2 to identify the customer, refer to the customer database Y3 to determine whether or not the customer is a good customer based on the purchase record and visit record of the specific customer, If the customer is a good customer, data relating to the good customer is transmitted to the ECR 100, and the ECR 100 executes a predetermined process for the good customer. Even without requesting membership registration procedures for customers, it is possible to identify and provide excellent customers when registering sales data, and to improve customer service and sales. It is possible to achieve a promotion. Note that, as a predetermined process for a good customer, a service that gives a privilege to a customer does not give a disadvantage to the customer even if the customer is not specified precisely.

  In addition, the second embodiment basically has the same effects as the first embodiment. That is, the server device 200 transmits and displays notification data for notifying the operator of the customer service method on the ECR 100 side as a predetermined process for a good customer. It becomes possible to prevent. In addition, as a predetermined process for a good customer, the ECR 100 is instructed to issue a coupon, so that a good customer can enjoy profits and know that he is treated as a good customer. be able to. In addition, as a predetermined process for good customers, the ECR 100 is instructed to issue an advertising medium with printed advertising data (receipt with advertisement). Advertising is possible.

  In addition, since the server device 200 analyzes the image data obtained by photographing the customer and estimates the gender and age group, the ECR 100 side issues an advertising medium with print contents according to the gender and age group. Effective advertising that matches customer attributes is possible. Further, when the customer cannot be specified, the image data is registered as a new customer in the face recognition data file Y2 and the customer database Y3, and notification data indicating that the new customer is registered is sent to the ECR 100 side. Since the information is transmitted to the operator and displayed for guidance to the operator, it is possible for the operator to contact the new customer and to register the new customer without performing any special registration work.

  In the second embodiment described above, the server device 200 transmits a customer service guidance message, advertisement data, and coupon data as data relating to a good customer. However, the server device 200 is data that indicates that it is a good customer. May be transmitted only. In this case, on the ECR 100 side, a customer service message, advertisement data, and coupon data may be generated according to the instruction.

  In the second embodiment described above, the present invention is applied to a LAN system in which the ECR 100 and the server apparatus 200 are connected via a LAN (private private line) 300, but is inserted and connected to the card interface unit 27. The customer photographed image may be stored in the SD card 28, and the SD card 28 may be inserted and connected to a PC (management apparatus). That is, the customer photographed image may be supplied to the PC (management apparatus) side via a portable external storage medium such as the SD card 28. For example, the customer's photographed image may be collectively supplied to the PC side via the SD card 28 at the end of the business day. In this case, on the PC side, a customer is specified based on each photographed image, and whether or not the customer is a good customer is specified. The ECR 100 may perform predetermined processing at the next transaction when a good customer visits the store.

  Further, in each of the above-described embodiments, either a purchase record or a visit record is specified as a good customer on the condition that a purchase value or a visit result is a reference value or more. You may make it identify as a good customer to conditions.

  In the above-described embodiment, a receipt is used as an example of the printed material. However, the printed material is not limited to this, and may be a coupon, a receipt, or the like.

  Further, in each of the above-described embodiments, the customer is video-captured, and an image (still image) for one frame is extracted from the video file. However, the customer-captured image is not limited to a video and is static. An image may be taken. In each of the above-described embodiments, the ECR (sales data processing device) is separated into the ECR main unit 1 and the camera unit 2, but may be integrated. In the above-described embodiment, the sales data processing apparatus is applied to ECR. However, the sales data processing apparatus may be applied to a POS terminal connected to a private leased line.

  Further, the “apparatus” and “unit” shown in each of the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

The embodiment of the present invention has been described above. However, the present invention is not limited to this, and includes the invention described in the claims and the equivalent scope thereof.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
A sales data processing device for registering sales data for each transaction,
Imaging means for photographing customers waiting for registration;
Customer identifying means for identifying the customer based on the image data of the customer photographed by the imaging means;
Customer data storage means for storing and managing at least each customer's actual data indicating purchase results or store visit results;
Discrimination means for discriminating whether or not the customer is a good customer based on the record data corresponding to the customer specified by the customer specifying means;
When it is determined by the determining means that the customer is a good customer, processing means for executing a predetermined process for the good customer;
A sales data processing apparatus characterized by comprising:
(Claim 2)
The invention according to claim 2 is the sales data processing device according to claim 1,
The processing means executes a process of displaying notification data informing a customer service method as a predetermined process for the excellent customer.
This is a sales data processing apparatus characterized by the above.
(Claim 3)
The invention according to claim 3 is the sales data processing device according to claim 1 or 2,
It further comprises printing means for performing data printing,
The processing means executes a process for instructing the printing means to issue a coupon and issuing a coupon as a predetermined process for the excellent customer.
This is a sales data processing apparatus characterized by the above.
(Claim 4)
The invention according to claim 4 is the sales data processing device according to any one of claims 1 to 3,
It further comprises printing means for performing data printing,
The processing means executes a process of issuing an advertising medium by instructing the printing means to print advertisement data as a predetermined process for the excellent customer.
This is a sales data processing apparatus characterized by the above.
(Claim 5)
The invention according to claim 5 is the sales data processing device according to claim 4,
Based on the image data of the customer photographed by the imaging means, further comprising a guessing means for guessing at least one of the sex and age group of the customer,
The processing means, as a predetermined process for the excellent customer, issues an advertising medium of print contents according to the gender and age group estimated by the estimation means.
This is a sales data processing apparatus characterized by the above.
(Claim 6)
The invention according to claim 6 is the sales data processing device according to any one of claims 1 to 5,
A registration unit for registering the image data in the customer data storage unit as a new customer when the customer cannot be identified by the customer identification unit;
Notification means for notifying the sales data processing device that the customer is a new customer;
Further comprising
This is a sales data processing apparatus characterized by the above.
(Claim 7)
The invention according to claim 7 is the sales data processing device according to any one of claims 1 to 6,
The image pickup means is installed in a customer display unit that is visually recognized by a customer waiting for registration and is installed in a direction in which a face of the customer waiting for registration can be photographed face-to-face
This is a sales data processing apparatus.
(Claim 8)
The invention according to claim 8 provides:
A sales data processing system including a sales data processing device for registering sales data for each transaction and a management device for managing sales data,
The sales data processing device comprises an imaging means for photographing a customer waiting for registration,
The management device
Customer identifying means for identifying the customer based on the image data of the customer photographed by the imaging means;
Customer data storage means for storing and managing performance data showing at least one of the customer's purchase results and store visit results for each customer,
Discrimination means for discriminating whether or not the customer is a good customer based on the record data corresponding to the customer specified by the customer specifying means;
With
Furthermore, the sales data processing device comprises processing means for executing predetermined processing for the excellent customer when the determining means determines that the customer is a good customer.
This is a sales data processing system characterized by the above.
(Claim 9)
The invention according to claim 9 is the sales data processing system according to claim 8,
The processing means executes a process of displaying notification data of a customer service method as a predetermined process for the excellent customer.
This is a sales data processing system characterized by the above.
(Claim 10)
The invention according to claim 10 is the sales data processing system according to claim 8 or claim 9, wherein
The sales data processing apparatus further comprises a printing means for performing data printing,
The processing means executes a process for instructing the printing means to issue a coupon and issuing a coupon as a predetermined process for the excellent customer.
This is a sales data processing system characterized by the above.
(Claim 11)
Invention of Claim 11 is a sales data processing system in any one of Claims 8-10,
The sales data processing apparatus further comprises a printing means for performing data printing,
The processing means executes a process of issuing an advertising medium by instructing the printing means to print advertisement data as a predetermined process for the excellent customer.
This is a sales data processing system characterized by the above.
(Claim 12)
The invention according to claim 12 is the sales data processing system according to claim 11,
The management device further includes an estimation unit that estimates at least one of the sex and age group of the customer based on the image data of the customer taken by the imaging unit,
The processing means, as a predetermined process for the excellent customer, issues an advertising medium of print contents according to the gender and age group estimated by the estimation means.
This is a sales data processing system characterized by the above.
(Claim 13)
Invention of Claim 13 is a sales data processing system in any one of Claims 8-12,
The management device
A registration unit for registering the image data in the customer data storage unit as a new customer when the customer cannot be identified by the customer identification unit;
Notification means for notifying the sales data processing device that the customer is a new customer;
Further comprising
This is a sales data processing system characterized by the above.
(Claim 14)
The invention according to claim 14
Against the computer,
A function to register sales data for each transaction,
The ability to shoot customers waiting for registration,
A function for identifying the customer based on the image data of the photographed customer;
A function for storing and managing at least customer performance data indicating purchase results or store visit results for each customer,
A function of determining whether the customer is a good customer based on the performance data corresponding to the identified customer;
When it is determined that the customer is a good customer, a function for executing a predetermined process for the good customer;
It is a program for realizing.

1 ECR main unit 2 Camera unit 11, 21 CPU
DESCRIPTION OF SYMBOLS 12, 22 Memory | storage part 14 Operation part 15 Scanner 19, 29 COM port 24 Customer display part 25 Customer side camera 100 ECR
200 Server device Y1 Customer video file Y2 Face recognition data file Y3 Customer database

Claims (14)

A sales data processing device for registering sales data for each transaction,
Imaging means for photographing customers waiting for registration;
Customer identifying means for identifying the customer based on the image data of the customer photographed by the imaging means;
Customer data storage means for storing and managing at least each customer's actual data indicating purchase results or store visit results;
Discrimination means for discriminating whether or not the customer is a good customer based on the record data corresponding to the customer specified by the customer specifying means;
When it is determined by the determining means that the customer is a good customer, processing means for executing a predetermined process for the good customer;
A sales data processing apparatus characterized by comprising: The processing means executes a process of displaying notification data informing a customer service method as a predetermined process for the excellent customer.
The sales data processing apparatus according to claim 1, wherein the sales data processing apparatus is configured as described above. It further comprises printing means for performing data printing,
The processing means executes a process for instructing the printing means to issue a coupon and issuing a coupon as a predetermined process for the excellent customer.
3. The sales data processing apparatus according to claim 1, wherein the sales data processing apparatus is configured as described above. It further comprises printing means for performing data printing,
The processing means executes a process of issuing an advertising medium by instructing the printing means to print advertisement data as a predetermined process for the excellent customer.
4. The sales data processing apparatus according to claim 1, wherein the sales data processing apparatus is configured as described above. Based on the image data of the customer photographed by the imaging means, further comprising a guessing means for guessing at least one of the sex and age group of the customer,
The processing means, as a predetermined process for the excellent customer, issues an advertising medium of print contents according to the gender and age group estimated by the estimation means.
The sales data processing apparatus according to claim 4, wherein the sales data processing apparatus is configured as described above. A registration unit for registering the image data in the customer data storage unit as a new customer when the customer cannot be identified by the customer identification unit;
Notification means for notifying the sales data processing device that the customer is a new customer;
Further comprising
6. The sales data processing apparatus according to claim 1, wherein the sales data processing apparatus is configured as described above. The image pickup means is installed in a customer display unit that is visually recognized by a customer waiting for registration and is installed in a direction in which a face of the customer waiting for registration can be photographed face-to-face,
The sales data processing apparatus according to any one of claims 1 to 6, wherein A sales data processing system including a sales data processing device for registering sales data for each transaction and a management device for managing sales data,
The sales data processing device comprises an imaging means for photographing a customer waiting for registration,
The management device
Customer identifying means for identifying the customer based on the image data of the customer photographed by the imaging means;
Customer data storage means for storing and managing performance data showing at least one of the customer's purchase results and store visit results for each customer,
Discrimination means for discriminating whether or not the customer is a good customer based on the record data corresponding to the customer specified by the customer specifying means;
With
Furthermore, the sales data processing device comprises processing means for executing predetermined processing for the excellent customer when the determining means determines that the customer is a good customer.
A sales data processing system characterized by the above. The processing means executes a process of displaying notification data of a customer service method as a predetermined process for the excellent customer.
The sales data processing system according to claim 8, wherein the sales data processing system is configured as described above. The sales data processing apparatus further comprises a printing means for performing data printing,
The processing means executes a process for instructing the printing means to issue a coupon and issuing a coupon as a predetermined process for the excellent customer.
10. The sales data processing system according to claim 8, wherein the sales data processing system is configured as described above. The sales data processing apparatus further comprises a printing means for performing data printing,
The processing means executes a process of issuing an advertising medium by instructing the printing means to print advertisement data as a predetermined process for the excellent customer.
The sales data processing system according to any one of claims 8 to 10, wherein the sales data processing system is configured as described above. The management device further includes an estimation unit that estimates at least one of the sex and age group of the customer based on the image data of the customer taken by the imaging unit,
The processing means, as a predetermined process for the excellent customer, issues an advertising medium of print contents according to the gender and age group estimated by the estimation means.
The sales data processing system according to claim 11, which is configured as described above. The management device
A registration unit for registering the image data in the customer data storage unit as a new customer when the customer cannot be identified by the customer identification unit;
Notification means for notifying the sales data processing device that the customer is a new customer;
Further comprising
The sales data processing system according to any one of claims 8 to 12, wherein the sales data processing system is configured as described above. Against the computer,
A function to register sales data for each transaction,
The ability to shoot customers waiting for registration,
A function for identifying the customer based on the image data of the photographed customer;
A function for storing and managing at least customer performance data indicating purchase results or store visit results for each customer,
A function of determining whether the customer is a good customer based on the performance data corresponding to the identified customer;
When it is determined that the customer is a good customer, a function for executing a predetermined process for the good customer;
A program to realize

Images