[go: up one dir, main page]

CN108648314A - A kind of user's expression interaction method and system based on intelligent cloud lock - Google Patents

A kind of user's expression interaction method and system based on intelligent cloud lock Download PDF

Info

Publication number
CN108648314A
CN108648314A CN201810447320.XA CN201810447320A CN108648314A CN 108648314 A CN108648314 A CN 108648314A CN 201810447320 A CN201810447320 A CN 201810447320A CN 108648314 A CN108648314 A CN 108648314A
Authority
CN
China
Prior art keywords
expression
user
server
intelligent cloud
cloud lock
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810447320.XA
Other languages
Chinese (zh)
Other versions
CN108648314B (en
Inventor
周永联
马裕文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Hutlon Technology Co Ltd
Original Assignee
Guangdong Hutlon Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Hutlon Technology Co Ltd filed Critical Guangdong Hutlon Technology Co Ltd
Priority to CN201810447320.XA priority Critical patent/CN108648314B/en
Publication of CN108648314A publication Critical patent/CN108648314A/en
Application granted granted Critical
Publication of CN108648314B publication Critical patent/CN108648314B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00Individual registration on entry or exit
    • G07C9/00174Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00563Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174Facial expression recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephonic Communication Services (AREA)
  • Collating Specific Patterns (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The present invention relates to a kind of user's expression interaction method based on intelligent cloud lock, the intelligent cloud lock includes door lock, camera and display panel, and the intelligent cloud lock, which is realized by server with mobile terminal, to be connected, and is included the following steps:Step A, expression typing with pre-set;Step B, face are acquired and are matched;Step C, expression are interactive.The present invention uses the various expressions of all users in entire family as sample, by the expression for acquiring each kinsfolk, for user when entering progress expression interaction, the comparison object taken is exactly the expression of user, and such mode can promote the accuracy rate of expression judgement.After the expression of judgement user, by various humorous expression packets prevailing on network, expression interaction is carried out with user, interest is increased, and expression is various, avoids monotony.

Description

A kind of user's expression interaction method and system based on intelligent cloud lock
Technical field
The present invention relates to intelligent cloud lock technology fields, and in particular to a kind of user's expression interaction method based on intelligent cloud lock And system.
Background technology
With the development of science and technology, intelligent cloud lock enters more and more families.Intelligent cloud lock passes through recognition of face, iris The combination of one or more modes such as identification, bluetooth recognition, fingerprint recognition facilitates the unlocking process of user.However current Door lock is limited only to facilitate the effect of unlocking, carries out interaction with user, lacks the setting of hommization.
Invention content
It is an object of the invention to aiming at the deficiencies in the prior art, provide a kind of base increasing the interest unlocked In the user's expression interaction method and system of intelligent cloud lock.
For this purpose, the present invention uses following technical scheme:
A kind of user's expression interaction method based on intelligent cloud lock, the intelligent cloud lock includes door lock, camera and display Panel, the intelligent cloud lock, which is realized by server with mobile terminal, to be connected, and is included the following steps:
Step A, expression typing with pre-set;All users of the same family make different classes of expression respectively, described Camera acquire corresponding facial image and upload the server user's expression preset library record and analyze, the service Device fits corresponding facial characteristics, and self-defined according to facial characteristics to each facial characteristics generation expression group or user respectively Expression group is set;
Step B, face are acquired and are matched;When user opens the door, the facial image of camera acquisition user and from described User's expression is preset in library and filters out the facial image being consistent;
Step C, expression are interactive;Server reading expression group corresponding with the facial image filtered out, and from One or more expressions are randomly selected in the expression group to present on said display panel.
Further description, the expression in the expression group is with one or more in video, audio, picture, word The form of combination is shown.
Further description further includes that voice inquiry is interactive;If the server is unidentified to make expression to user, The display panel sends out voice by microphone, inquires the mood of user;What the display panel was answered by acquiring user Voice is uploaded to server, judges the voice content of user, and an immediate table is selected from the expression of typing Feelings group by display panel present and voice broadcast is interactive.
Further description further includes door lock interaction;According to user setting or server settings, the server according to Different expression control door locks makes the response of different response times and responsive state.
A kind of user's expression interaction systems based on intelligent cloud lock, the intelligent cloud lock includes door lock, camera and display Panel, the intelligent cloud lock, which is realized by server with mobile terminal, to be connected, including:
Expression typing and pre-set system;The face figure under all user's difference emotional states for acquiring the same family Picture and the user's expression for uploading to the server, which are preset in library, to be recorded, while corresponding for different Face image synthesis Expression group or user are according to the self-defined setting expression group of facial characteristics;
Face acquires and matching system;The facial image of user and pre- from user's expression is acquired when opening the door for user If filtering out the facial image being consistent in library;
Expression interaction systems;For reading the filtered out corresponding expression group of facial image from the server, And one or more expressions are randomly selected from the expression group and are presented on said display panel.
Further description, the expression in the expression group is with one or more in video, audio, picture, word The form of combination is shown.
Further description further includes voice inquiry interaction systems;It is made to user for the server to be unidentified When expression, controls the display panel and voice is sent out by microphone, inquire the mood of user, the language answered by acquiring user Tone uploading judges the voice content of user to server, and an immediate expression is selected from the expression of typing Group by display panel present and voice broadcast is interactive.
Further description further includes door lock interaction systems, is used for according to user's setting or server settings, according to not Same expression control door lock makes the response of different response times and responsive state.
Beneficial effects of the present invention:The various expressions of all users are every by acquiring as sample using in entire family The expression of a kinsfolk, for user when entering progress expression interaction, the comparison object taken is exactly the expression of user, this The mode of sample can promote the accuracy rate of expression judgement.After the expression of judgement user, by various wind prevailing on network The expression packet of interest carries out expression interaction with user, increases interest, and expression is various, avoid monotony.
Description of the drawings
Present invention will be further explained below with reference to the attached drawings and examples.
Fig. 1 is the flow chart of one embodiment of the present of invention.
Specific implementation mode
Technical solution to further illustrate the present invention below with reference to the accompanying drawings and specific embodiments.
As shown in Figure 1, a kind of user's expression interaction method based on intelligent cloud lock, the intelligent cloud lock includes door lock, takes the photograph As head and display panel, the intelligent cloud lock, which is realized by server with mobile terminal, to be connected, and is included the following steps:
Step A, expression typing with pre-set;All users of the same family make different classes of expression respectively, described Camera acquire corresponding facial image and upload the server user's expression preset library record and analyze, the service Device fits corresponding facial characteristics, and self-defined according to facial characteristics to each facial characteristics generation expression group or user respectively Expression group is set;
Step B, face are acquired and are matched;When user opens the door, the facial image of camera acquisition user and from described User's expression is preset in library and filters out the facial image being consistent;
Step C, expression are interactive;Server reading expression group corresponding with the facial image filtered out, and from One or more expressions are randomly selected in the expression group to present on said display panel.
The life stress of modern is increasing, and the intent of the present invention is to allow a common door opening action full of interest Taste adjusts the mood of user.First in view of facial expression recognition in the prior art is also based on a large amount of human face data The expression decision algorithm fitted, and the algorithm can might not accurately judge everyone emotional state, therefore it is straight here It connects and uses the various expressions of all users in entire family as sample, pass through indignation, detest, the evil for acquiring each kinsfolk Be afraid of, happy, amimia, grieved or surprised expression, the basic facial expression in daily life be included entirely within, user is entering When carrying out expression interaction, the comparison object taken is exactly the expression of user, and such mode can promote expression judgement Accuracy rate.After the expression of judgement user, by various humorous expression packets prevailing on network, it is mutual to carry out expression with user It is dynamic, interest is increased, and expression is various, avoided monotony.
Further description, the expression in the expression group is with one or more in video, audio, picture, word The form of combination is shown.
The expression figure of server settings is fitted by program, user set be with the hobby of user oneself as according to According to, the expression of the form of one or more combinations in video, audio, picture, word had both met the personal preference of user, The expression group wide variety that may be implemented under the permutation and combination of diversified forms is not dull.
Further description further includes that voice inquiry is interactive;If the server is unidentified to make expression to user, The display panel sends out voice by microphone, inquires the mood of user;What the display panel was answered by acquiring user Voice is uploaded to server, judges the voice content of user, and an immediate table is selected from the expression of typing Feelings group by display panel present and voice broadcast is interactive.
Because user when entering, can sometimes forget to make expression, namely when being identified as amimia, in order to continue to keep Intelligent cloud lock with the interaction of user, at this time can voice inquiry user mood, and then according to the identification to user's content, from Select that the dynamic expression figure of an immediate expression by display panel present and voice broadcast is mutual in the expression of typing It is dynamic.
Further description further includes door lock interaction;According to user setting or server settings, the server according to Different expression control door locks makes the response of different response times and responsive state.
For example the expression of user is identified as anger or sad, door lock can be opened at once, if the tag recognition of user is to open The heart or excitement, door lock can postpone to open or be closed rapidly after opening, then open again, increase the interest of enabling with this.
A kind of user's expression interaction systems based on intelligent cloud lock, the intelligent cloud lock includes door lock, camera and display Panel, the intelligent cloud lock, which is realized by server with mobile terminal, to be connected, including:
Expression typing and pre-set system;The face figure under all user's difference emotional states for acquiring the same family Picture and the user's expression for uploading to the server, which are preset in library, to be recorded, while corresponding for different Face image synthesis Expression group or user are according to the self-defined setting expression group of facial characteristics;
Face acquires and matching system;The facial image of user and pre- from user's expression is acquired when opening the door for user If filtering out the facial image being consistent in library;
Expression interaction systems;For reading the filtered out corresponding expression group of facial image from the server, And one or more expressions are randomly selected from the expression group and are presented on said display panel.
Further description, the expression in the expression group is with one or more in video, audio, picture, word The form of combination is shown.
Further description further includes voice inquiry interaction systems;It is made to user for the server to be unidentified When expression, controls the display panel and voice is sent out by microphone, inquire the mood of user, the language answered by acquiring user Tone uploading judges the voice content of user to server, and an immediate expression is selected from the expression of typing Group by display panel present and voice broadcast is interactive.
Further description further includes door lock interaction systems, is used for according to user's setting or server settings, according to not Same expression control door lock makes the response of different response times and responsive state.
The above content is only presently preferred embodiments of the present invention, for those of ordinary skill in the art, according to the present invention Thought, there will be changes in the specific implementation manner and application range, and the content of the present specification should not be construed as to the present invention Limitation.

Claims (8)

1. a kind of user's expression interaction method based on intelligent cloud lock, the intelligent cloud lock includes door lock, camera and display surface Plate, the intelligent cloud lock, which is realized by server with mobile terminal, to be connected, it is characterised in that:Include the following steps:
Step A, expression typing with pre-set;All users of the same family make different classes of expression, the camera shooting respectively The corresponding facial image of head acquisition and the user's expression for uploading the server are preset library and are recorded and analyzed, and the server is quasi- Corresponding facial characteristics is closed out, and expression group or user are generated according to the self-defined setting of facial characteristics to each facial characteristics respectively Expression group;
Step B, face are acquired and are matched;When user opens the door, the facial image of camera acquisition user and from the user Expression is preset in library and filters out the facial image being consistent;
Step C, expression are interactive;The server reads expression group corresponding with the facial image filtered out, and from described One or more expressions are randomly selected in expression group to present on said display panel.
2. a kind of user's expression interaction method based on intelligent cloud lock according to claim 1, it is characterised in that:The table Expression in feelings group is shown in the form of one or more combinations in video, audio, picture, word.
3. a kind of user's expression interaction method based on intelligent cloud lock according to claim 1, it is characterised in that:Further include Voice inquiry is interactive;If the server is unidentified to make expression to user, the display panel sends out language by microphone Sound inquires the mood of user;The display panel is uploaded to server by acquiring the voice that user answers, to the voice of user Content is judged, and selects an immediate expression group to carry out presentation and voice by display panel from the expression of typing It reports interactive.
4. a kind of user's expression interaction method based on intelligent cloud lock according to claim 1, it is characterised in that:Further include Door lock is interactive;According to user's setting or server settings, the server makes different sound according to different expression control door locks Between seasonable and the response of responsive state.
5. a kind of user's expression interaction systems based on intelligent cloud lock, the intelligent cloud lock includes door lock, camera and display surface Plate, the intelligent cloud lock, which is realized by server with mobile terminal, to be connected, it is characterised in that:Including:
Expression typing and pre-set system;The facial image under all user's difference emotional states for acquiring the same family is simultaneously It uploads in the default library of user's expression of the server and records, while being the different corresponding expressions of Face image synthesis Group or user are according to the self-defined setting expression group of facial characteristics;
Face acquires and matching system;The facial image of user is acquired when opening the door for user and presets library from user's expression In filter out the facial image being consistent;
Expression interaction systems;The facial image corresponding expression group filtered out for the reading from the server, and from One or more expressions are randomly selected in the expression group to present on said display panel.
6. a kind of user's expression interaction systems based on intelligent cloud lock according to claim 5, it is characterised in that:The table Expression in feelings group is shown in the form of one or more combinations in video, audio, picture, word.
7. a kind of user's expression interaction systems based on intelligent cloud lock according to claim 5, it is characterised in that:Further include Voice inquires interaction systems;For the server is unidentified make expression to user when, control the display panel and pass through wheat Gram wind sends out voice, inquires the mood of user, server is uploaded to by acquiring the voice that user answers, in the voice of user Appearance judged, and selects from the expression of typing that an immediate expression group by display panel present and voice is broadcast Report is interactive.
8. a kind of user's expression interaction systems based on intelligent cloud lock according to claim 5, it is characterised in that:Further include Door lock interaction systems, for according to user's setting or server settings, different responses to be made according to different expression control door locks The response of time and responsive state.
CN201810447320.XA 2018-05-11 2018-05-11 User expression interaction method and system based on intelligent cloud lock Active CN108648314B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810447320.XA CN108648314B (en) 2018-05-11 2018-05-11 User expression interaction method and system based on intelligent cloud lock

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810447320.XA CN108648314B (en) 2018-05-11 2018-05-11 User expression interaction method and system based on intelligent cloud lock

Publications (2)

Publication Number Publication Date
CN108648314A true CN108648314A (en) 2018-10-12
CN108648314B CN108648314B (en) 2020-11-06

Family

ID=63754519

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810447320.XA Active CN108648314B (en) 2018-05-11 2018-05-11 User expression interaction method and system based on intelligent cloud lock

Country Status (1)

Country Link
CN (1) CN108648314B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111429632A (en) * 2020-03-11 2020-07-17 四川花间阁文化传媒有限责任公司 Emergent management and control of epidemic prevention two-sided wisdom door equipment and system
CN111429630A (en) * 2020-03-11 2020-07-17 四川花间阁文化传媒有限责任公司 One set of epidemic prevention emergency management and control door clothing system and equipment
CN114468520A (en) * 2022-01-20 2022-05-13 上海妮晓博实业有限公司 a smart backpack

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102346898A (en) * 2010-09-20 2012-02-08 微软公司 Automatic customized advertisement generation system
CN102645968A (en) * 2011-02-17 2012-08-22 中兴通讯股份有限公司 Communication terminal and man-machine interaction method
CN102890776A (en) * 2011-07-21 2013-01-23 爱国者电子科技(天津)有限公司 Method for searching emoticons through facial expression
CN103324100A (en) * 2013-05-02 2013-09-25 郭海锋 Emotion vehicle-mounted robot driven by information
CN103778360A (en) * 2012-10-26 2014-05-07 华为技术有限公司 Face unlocking method and device based on motion analysis
CN104268963A (en) * 2014-08-06 2015-01-07 成都百威讯科技有限责任公司 Intelligent door lock system, intelligent door lock and intelligent alarm door
CN104777910A (en) * 2015-04-23 2015-07-15 福州大学 Method and system for applying expression recognition to display device
CN104980558A (en) * 2014-04-01 2015-10-14 中国移动通信集团公司 Information processing method and device, cell phone pet client, and mobile terminal
CN105354902A (en) * 2015-11-10 2016-02-24 深圳市商汤科技有限公司 Security management method and system based on face identification
CN105797376A (en) * 2014-12-31 2016-07-27 深圳市亿思达科技集团有限公司 Method and terminal for controlling role model behavior according to expression of user
JP2017014806A (en) * 2015-07-01 2017-01-19 アイフォーコム株式会社 Smiling-face interlocking control system
CN106951876A (en) * 2017-03-27 2017-07-14 北京品恩科技股份有限公司 A kind of three-dimensional portrait synthesis recognition system
CN107317927A (en) * 2017-06-22 2017-11-03 深圳市沃特沃德股份有限公司 With the method and intelligent terminal of user interaction

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102346898A (en) * 2010-09-20 2012-02-08 微软公司 Automatic customized advertisement generation system
CN102645968A (en) * 2011-02-17 2012-08-22 中兴通讯股份有限公司 Communication terminal and man-machine interaction method
CN102890776A (en) * 2011-07-21 2013-01-23 爱国者电子科技(天津)有限公司 Method for searching emoticons through facial expression
CN103778360A (en) * 2012-10-26 2014-05-07 华为技术有限公司 Face unlocking method and device based on motion analysis
CN103324100A (en) * 2013-05-02 2013-09-25 郭海锋 Emotion vehicle-mounted robot driven by information
CN104980558A (en) * 2014-04-01 2015-10-14 中国移动通信集团公司 Information processing method and device, cell phone pet client, and mobile terminal
CN104268963A (en) * 2014-08-06 2015-01-07 成都百威讯科技有限责任公司 Intelligent door lock system, intelligent door lock and intelligent alarm door
CN105797376A (en) * 2014-12-31 2016-07-27 深圳市亿思达科技集团有限公司 Method and terminal for controlling role model behavior according to expression of user
CN104777910A (en) * 2015-04-23 2015-07-15 福州大学 Method and system for applying expression recognition to display device
JP2017014806A (en) * 2015-07-01 2017-01-19 アイフォーコム株式会社 Smiling-face interlocking control system
CN105354902A (en) * 2015-11-10 2016-02-24 深圳市商汤科技有限公司 Security management method and system based on face identification
CN106951876A (en) * 2017-03-27 2017-07-14 北京品恩科技股份有限公司 A kind of three-dimensional portrait synthesis recognition system
CN107317927A (en) * 2017-06-22 2017-11-03 深圳市沃特沃德股份有限公司 With the method and intelligent terminal of user interaction

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111429632A (en) * 2020-03-11 2020-07-17 四川花间阁文化传媒有限责任公司 Emergent management and control of epidemic prevention two-sided wisdom door equipment and system
CN111429630A (en) * 2020-03-11 2020-07-17 四川花间阁文化传媒有限责任公司 One set of epidemic prevention emergency management and control door clothing system and equipment
CN114468520A (en) * 2022-01-20 2022-05-13 上海妮晓博实业有限公司 a smart backpack

Also Published As

Publication number Publication date
CN108648314B (en) 2020-11-06

Similar Documents

Publication Publication Date Title
CN110519617B (en) Video comment processing method and device, computer equipment and storage medium
CN105204357B (en) The contextual model method of adjustment and device of intelligent home device
CN103024521B (en) Program screening method, program screening system and television with program screening system
CN102946491B (en) Method and system for automatically adjusting wallpaper according to user mood
US20230171122A1 (en) Assistive control of network-connected devices
WO2020224126A1 (en) Facial recognition-based adaptive adjustment method, system and readable storage medium
US7373301B2 (en) Method for detecting emotions from speech using speaker identification
US10942563B2 (en) Prediction of the attention of an audience during a presentation
CN108648314A (en) A kind of user's expression interaction method and system based on intelligent cloud lock
CN107272607A (en) A kind of intelligent home control system and method
DE112017002335T5 (en) Set multiple streams
CN106886162A (en) The method of smart home management and its robot device
US20150180993A1 (en) Information management method
CN106886170A (en) The control method of household electrical appliance, system and audio amplifier
US10015385B2 (en) Enhancing video conferences
CN111149172B (en) Emotion management method, device and computer-readable storage medium
EP3257043A1 (en) Speaker recognition in multimedia system
US10984795B2 (en) Electronic apparatus and operation method thereof
CN109451356A (en) A kind of intelligent mobile robot, automatic order method, device and chip
CN102257566A (en) Method and system for adapting communications
WO2017143951A1 (en) Expression feedback method and smart robot
CN118338492B (en) Intelligent lighting control system, method and storage medium based on environmental atmosphere adjustment
CN109215688A (en) With scene audio processing method, device, computer readable storage medium and system
CN109976703A (en) Guide illustration method, computer readable storage medium and cooking equipment
CN113537090A (en) A smart home lighting control method, device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 528244 Guangdong province Lishui Town Nanhai District Foshan City Industrial Park East of Dongtai Road No. 1

Applicant after: Guangdong Huitailong Technology Co.,Ltd.

Address before: 528244 Guangdong province Lishui Town Nanhai District Foshan City Industrial Park East of Dongtai Road No. 1

Applicant before: GUANGDONG HUTLON TECHNOLOGY Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant