CN109325800A - A kind of working method of supermarket's intelligent commodity shelf based on computer vision - Google Patents
A kind of working method of supermarket's intelligent commodity shelf based on computer vision Download PDFInfo
- Publication number
- CN109325800A CN109325800A CN201810984968.0A CN201810984968A CN109325800A CN 109325800 A CN109325800 A CN 109325800A CN 201810984968 A CN201810984968 A CN 201810984968A CN 109325800 A CN109325800 A CN 109325800A
- Authority
- CN
- China
- Prior art keywords
- supermarket
- module
- image
- bone
- identification module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000004438 eyesight Effects 0.000 title claims abstract description 12
- 238000000034 method Methods 0.000 title claims abstract description 11
- 210000000988 bone and bone Anatomy 0.000 claims abstract description 18
- 238000001514 detection method Methods 0.000 abstract description 3
- 230000004044 response Effects 0.000 abstract description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 238000010195 expression analysis Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000036651 mood Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0281—Customer communication at a business location, e.g. providing product or service information, consulting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/23—Recognition of whole body movements, e.g. for sport training
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Health & Medical Sciences (AREA)
- Strategic Management (AREA)
- Accounting & Taxation (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Entrepreneurship & Innovation (AREA)
- Game Theory and Decision Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Economics (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Social Psychology (AREA)
- Psychiatry (AREA)
- Image Analysis (AREA)
Abstract
A kind of working method of supermarket's intelligent commodity shelf based on computer vision, using following steps, step 1: image stream acquisition device is provided on each shelf, the view of current region is acquired by image stream acquisition device, acquired image stream is uploaded in identifying system, identifying system includes bone identification module, cargo identification module and face recognition module；Step 2: bone identification module identifies image stream by bone recognizer, judges the image that whether there is people in image, if it is, 3 are entered step, otherwise, return step 1；The present invention prejudges different user by the skeleton motion detection on supermarket shelves, for the intention of shopping, the timely thought of customer in response, in the experience of subsequent supermarket, be capable of intelligence identifies that client wants the thought that purchase compares commodity according to the action learning of customer.
Description
Technical field
The present invention relates to field of face identification, and in particular to a kind of work of supermarket's intelligent commodity shelf based on computer vision
Method.
Background technique
Skeleton identification is the computer vision study carried out based on human skeleton feature.Skeleton key point pair
In description human body attitude, prediction human body behavior is most important.Therefore skeleton critical point detection is that many computer visions are appointed
The basis of business.
Technology used at present:
Bone key point judgement based on deep learning, the action recognition then carried out.Existing technology is for supermarket
The scene of more people's multi-frequencies does not refine.The movement of the expression and customer that are not bound with recognition of face carries out deep learning
Judgement.
Recognition of face is a kind of biological identification technology for carrying out identification based on facial feature information of people.Face is to care for
The specific characteristic of visitor, for distinguishing different customers, camera is only individually recorded, after being compared from the background, only individually
The disengaging scene for handling customer, the shelf for being not bound with supermarket carry out motion analysis and Expression analysis.
Summary of the invention
In view of the deficiencies of the prior art, the present invention proposes a kind of work sides of supermarket's intelligent commodity shelf based on computer vision
Method, specific technical solution are as follows: a kind of working method of supermarket's intelligent commodity shelf based on computer vision, it is characterised in that:
Using following steps,
Step 1: being provided with image stream acquisition device on each shelf, current region is acquired by image stream acquisition device
View, acquired image stream is uploaded in identifying system, identifying system includes bone identification module, cargo identification module
And face recognition module；
Step 2: bone identification module identifies image stream by bone recognizer, judges to whether there is in image
The image of people, if it is, 3 are entered step, otherwise, return step 1；
Step 3: bone identification module carries out identification classification to the movement of people in image, judges whether the movement of people belongs to choosing
Picking object, if it is, 4 are entered step, otherwise, return step 2；
Step 4: face recognition module identifies face, and the face characteristic recognized is uploaded to processor module
In；
Step 5: the face characteristic recorded in the face characteristic and member database is compared processing module, and judgement should
The data of personnel, if it is, entering step 6, otherwise, return to step 2 with the presence or absence of in member database；
Step 6: coordinate of the cargo identification module by identification cargo on picture, it will the cargo data that member chooses is sent
To processing module；
Step 7: processing module recalls the corresponding shopper database of the member, it will the cargo data that member chooses is added to purchase
In object database；
Step 8: processing module judges on shelf according to the shelf location where current member with the presence or absence of shopper database
On cargo data, if it does, processing module issues prompt by the voice module that is mounted on shelf.
Further: the bone action recognition predicts human body attitude by skeleton key point.
Further: described image acquisition device is infrared camera.
The invention has the benefit that the present invention prejudges different use by the skeleton motion detection on supermarket shelves
Family, for the intention of shopping, the timely thought of customer in response, in the experience of subsequent supermarket, be capable of intelligence according to customer
Action learning identification client want purchase compare commodity thought.And supermarket's adjustment cargo is promoted to put, known according to face
Not Fen Xi supermarket's customer's mood, judge customer for the emotion index of commodity.Improve supermarket's scene and shopping experience, passes through face
The user that identification carries out client, which draws a portrait, to be generated, and when next customer does shopping again, intelligent commodity shelf can remind customer to want
Commodity, and then promoted supermarket commodity member's advertisement accurately launch, promote the use of big data.
Detailed description of the invention
Fig. 1 is work flow diagram of the invention.
Specific embodiment
The preferred embodiments of the present invention will be described in detail with reference to the accompanying drawing, so that advantages and features of the invention energy
It is easier to be readily appreciated by one skilled in the art, so as to make a clearer definition of the protection scope of the present invention.
A kind of working method of supermarket's intelligent commodity shelf based on computer vision as shown in Figure 1:, it is characterised in that:
Using following steps,
Step 1: being provided with image stream acquisition device on each shelf, current region is acquired by image stream acquisition device
View, acquired image stream is uploaded in identifying system, identifying system includes bone identification module, cargo identification module
And face recognition module；
Step 2: bone identification module identifies image stream by bone recognizer, judges to whether there is in image
The image of people, if it is, 3 are entered step, otherwise, return step 1；
Step 3: bone identification module carries out identification classification to the movement of people in image, judges whether the movement of people belongs to choosing
Picking object, if it is, 4 are entered step, otherwise, return step 2；
Step 4: face recognition module identifies face, and the face characteristic recognized is uploaded to processor module
In；
Step 5: the face characteristic recorded in the face characteristic and member database is compared processing module, and judgement should
The data of personnel, if it is, entering step 6, otherwise, return to step 2 with the presence or absence of in member database；
Step 6: coordinate of the cargo identification module by identification cargo on picture, it will the cargo data that member chooses is sent
To processing module；
Step 7: processing module recalls the corresponding shopper database of the member, it will the cargo data that member chooses is added to purchase
In object database；
Step 8: processing module judges on shelf according to the shelf location where current member with the presence or absence of shopper database
On cargo data, if it does, processing module issues prompt by the voice module that is mounted on shelf.
Claims (3)
1. a kind of working method of supermarket's intelligent commodity shelf based on computer vision, it is characterised in that:
Using following steps,
Step 1: being provided with image stream acquisition device on each shelf, the view of current region is acquired by image stream acquisition device
Figure, acquired image stream is uploaded in identifying system, identifying system includes bone identification module, cargo identification module and people
Face identification module；
Step 2: bone identification module identifies image stream by bone recognizer, judges in image with the presence or absence of people's
Image, if it is, 3 are entered step, otherwise, return step 1；
Step 3: bone identification module carries out identification classification to the movement of people in image, judges whether the movement of people belongs to selection goods
Object, if it is, 4 are entered step, otherwise, return step 2；
Step 4: face recognition module identifies face, and the face characteristic recognized is uploaded in processor module；
Step 5: the face characteristic recorded in the face characteristic and member database is compared processing module, judges the personnel
Data with the presence or absence of in member database, if it is, entering step 6, otherwise, return to step 2；
Step 6: coordinate of the cargo identification module by identification cargo on picture, it will the cargo data that member chooses is sent everywhere
Manage module；
Step 7: processing module recalls the corresponding shopper database of the member, it will the cargo data that member chooses is added to shopping number
According in library；
Step 8: processing module judges on shelf according to the shelf location where current member with the presence or absence of on shopper database
Cargo data, if it does, processing module issues prompt by the voice module being mounted on shelf.
2. a kind of working method of supermarket's intelligent commodity shelf based on computer vision according to claim 1, it is characterised in that:
The bone action recognition predicts human body attitude by skeleton key point.
3. a kind of working method of supermarket's intelligent commodity shelf based on computer vision according to claim 1, it is characterised in that:
Described image acquisition device is infrared camera.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810984968.0A CN109325800A (en) | 2018-08-28 | 2018-08-28 | A kind of working method of supermarket's intelligent commodity shelf based on computer vision |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810984968.0A CN109325800A (en) | 2018-08-28 | 2018-08-28 | A kind of working method of supermarket's intelligent commodity shelf based on computer vision |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109325800A true CN109325800A (en) | 2019-02-12 |
Family
ID=65264488
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810984968.0A Pending CN109325800A (en) | 2018-08-28 | 2018-08-28 | A kind of working method of supermarket's intelligent commodity shelf based on computer vision |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109325800A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112184331A (en) * | 2020-10-23 | 2021-01-05 | 北京爱笔科技有限公司 | People and goods association method and system |
| CN112684711A (en) * | 2020-12-24 | 2021-04-20 | 青岛理工大学 | Interactive identification method for human behavior and intention |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202662020U (en) * | 2012-05-21 | 2013-01-09 | 东芝泰格有限公司 | Information prompting system |
| US20150154449A1 (en) * | 2013-11-29 | 2015-06-04 | Fujitsu Limited | Method and apparatus for recognizing actions |
| CN105528056A (en) * | 2014-09-28 | 2016-04-27 | 广州新节奏智能科技有限公司 | Intelligent experience shopping apparatus and experience method thereof |
| CN106557791A (en) * | 2016-10-20 | 2017-04-05 | 徐州赛欧电子科技有限公司 | A kind of supermarket shopping management system and its method |
| CN107578291A (en) * | 2017-09-15 | 2018-01-12 | 泾县麦蓝网络技术服务有限公司 | A kind of goods delivery service providing method and system |
| CN107890243A (en) * | 2017-11-23 | 2018-04-10 | 上海量科电子科技有限公司 | Intelligent commodity shelf and its purchase system, purchase method |
| CN108009891A (en) * | 2017-12-15 | 2018-05-08 | 杨智勇 | System and shelf and information displaying method based on Rich Media's display of commodity information |
-
2018
- 2018-08-28 CN CN201810984968.0A patent/CN109325800A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202662020U (en) * | 2012-05-21 | 2013-01-09 | 东芝泰格有限公司 | Information prompting system |
| US20150154449A1 (en) * | 2013-11-29 | 2015-06-04 | Fujitsu Limited | Method and apparatus for recognizing actions |
| CN105528056A (en) * | 2014-09-28 | 2016-04-27 | 广州新节奏智能科技有限公司 | Intelligent experience shopping apparatus and experience method thereof |
| CN106557791A (en) * | 2016-10-20 | 2017-04-05 | 徐州赛欧电子科技有限公司 | A kind of supermarket shopping management system and its method |
| CN107578291A (en) * | 2017-09-15 | 2018-01-12 | 泾县麦蓝网络技术服务有限公司 | A kind of goods delivery service providing method and system |
| CN107890243A (en) * | 2017-11-23 | 2018-04-10 | 上海量科电子科技有限公司 | Intelligent commodity shelf and its purchase system, purchase method |
| CN108009891A (en) * | 2017-12-15 | 2018-05-08 | 杨智勇 | System and shelf and information displaying method based on Rich Media's display of commodity information |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112184331A (en) * | 2020-10-23 | 2021-01-05 | 北京爱笔科技有限公司 | People and goods association method and system |
| CN112684711A (en) * | 2020-12-24 | 2021-04-20 | 青岛理工大学 | Interactive identification method for human behavior and intention |
| CN112684711B (en) * | 2020-12-24 | 2022-10-11 | 青岛理工大学 | An Interactive Recognition Method of Human Behavior and Intention |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12023136B2 (en) | Method and system for abnormality detection | |
| US20220036055A1 (en) | Person identification systems and methods | |
| EP3651103A1 (en) | Device, system and method for providing service relating to advertising and product purchase by using artificial-intelligence technology | |
| US20170169297A1 (en) | Computer-vision-based group identification | |
| US20230058903A1 (en) | Customer Behavioural System | |
| Hasanuzzaman et al. | Monitoring activity of taking medicine by incorporating RFID and video analysis | |
| CN107392151A (en) | Face image various dimensions emotion judgement system and method based on neutral net | |
| CN109325800A (en) | A kind of working method of supermarket's intelligent commodity shelf based on computer vision | |
| CN110689389A (en) | Computer vision-based shopping list automatic maintenance method and device, storage medium and terminal | |
| Okamoto et al. | Classification of Pedestrian Behavior in a Shopping Mall based on LRF and Camera Observations. | |
| US20240265434A1 (en) | System and method for visually tracking persons and imputing demographic and sentiment data | |
| CN112950242B (en) | Information pushing method and device and electronic equipment | |
| Lamba et al. | Information retrieval from facial expression using voting to assert exigency | |
| Prabhu et al. | Real time multimodal emotion recognition system using facial landmarks and hand over face gestures | |
| WO2022175935A1 (en) | Method and system for visual analysis and assessment of customer interaction at a scene | |
| Shakyawar et al. | Eigenface method through through facial expression recognition | |
| CN112183691A (en) | Method, device and storage medium for commodity display | |
| Turner et al. | Describing people: An integrated framework for human attributes classification | |
| JP6573259B2 (en) | Attribute collection system by camera | |
| Zhao et al. | Octree segmentation based calling gesture recognition for elderly care robot | |
| Raju et al. | Predictive Analytics for Marketing and Sales of Products Using Smart Trolley with Automated Billing System in Shopping Malls Using LBPH and Faster R‐CNN | |
| Seint et al. | Behavior analysis for nursing home monitoring system | |
| Wimmer et al. | Recognizing facial expressions using model-based image interpretation | |
| Turner et al. | Describing People: An Integrated Framework | |
| Ju et al. | A new control owner switching system for multiple TV viewers via face recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 511458 room 1011, No.26, Jinlong Road, Nansha District, Guangzhou City, Guangdong Province (only for office use) Applicant after: Guangzhou yunconghonghuang Intelligent Technology Co., Ltd Address before: 511457 Room 1011, 26 Jinlong Road, Nansha District, Guangzhou City, Guangdong Province Applicant before: GUANGZHOU HONGHUANG INTELLIGENT TECHNOLOGY Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190212 |