CN106909907A - A kind of video communication sentiment analysis accessory system - Google Patents
A kind of video communication sentiment analysis accessory system Download PDFInfo
- Publication number
- CN106909907A CN106909907A CN201710130150.8A CN201710130150A CN106909907A CN 106909907 A CN106909907 A CN 106909907A CN 201710130150 A CN201710130150 A CN 201710130150A CN 106909907 A CN106909907 A CN 106909907A
- Authority
- CN
- China
- Prior art keywords
- module
- analysis
- people
- analysis module
- mood
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 94
- 230000006854 communication Effects 0.000 title claims abstract description 32
- 238000004891 communication Methods 0.000 title claims abstract description 22
- 230000036651 mood Effects 0.000 claims abstract description 29
- 230000008859 change Effects 0.000 claims abstract description 21
- 238000012545 processing Methods 0.000 claims abstract description 8
- 230000003542 behavioural effect Effects 0.000 claims description 9
- 238000000034 method Methods 0.000 claims description 6
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000006073 displacement reaction Methods 0.000 claims description 3
- 230000002996 emotional effect Effects 0.000 claims description 3
- 238000010195 expression analysis Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 claims description 3
- 238000010223 real-time analysis Methods 0.000 claims description 3
- 230000014509 gene expression Effects 0.000 abstract description 15
- 230000008451 emotion Effects 0.000 abstract description 5
- 230000008901 benefit Effects 0.000 abstract description 2
- 238000005516 engineering process Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008450 motivation Effects 0.000 description 1
- 238000005211 surface analysis Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
- G06V40/176—Dynamic expression
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/94—Hardware or software architectures specially adapted for image or video understanding
- G06V10/95—Hardware or software architectures specially adapted for image or video understanding structured as a network, e.g. client-server architectures
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The present invention provides a kind of video communication sentiment analysis accessory system, it includes video image identification module, color analysis module, pixels statisticses module, characteristic point analysis module, MBM, database, mood analysis module, Emotive advisory module, good friend's module for managing files and big data processing module, connect into Video chat software, video image is intercepted from the chat window in Video chat software, Treatment Analysis are carried out to image by big data using the auxiliary of the webserver, set up micro- expression shape change and behavior dynamic of people face mould type analysis patient, so as to the emotion for analyzing chatting object changes, the present invention provide system have can assistant analysis chatting object emotion change, promote to improve the advantage for exchanging efficiency.
Description
Technical field
The invention belongs to information-based communication technique field, more particularly to a kind of video communication sentiment analysis accessory system.
Background technology
With the development of the network technology, video communication is increasingly popularized, and increasing field uses video communication method,
Including aspects such as Internet chat, video conference, remote teaching.Video communication has furthered interpersonal distance, if regarding
It will be seen that the emotion of more other side, psychological activity will substantially reduce exchange misunderstanding, promote person to person in the middle of frequency communication process
Between exchange.
Recognition of face, is that the facial feature information based on people carries out a kind of biological identification technology of identification.With shooting
Machine or camera image or video flowing of the collection containing face, and automatic detect and track face in the picture, and then to detection
To face carry out a series of correlation techniques of face, generally also referred to as Identification of Images, face recognition.
Micro- expression, is psychology noun.People see heart impression expression to other side by doing some expressions, are done in people
Different expressions between, or in certain expression, face's meeting " leakage " goes out other information." micro- expression " is most short by sustainable 1/25
Second, although a subconscious expression may be only lasted in a flash, but this characteristic, it is easy to expose mood.When face is doing
During certain expression, these duration extremely short expression can flash across suddenly, and express opposite mood sometimes." micro- table
Feelings " flash across, and the people and observer that typically even clear-headed work is expressed one's feelings are detectable.In experiment, only 10% people examines
Feel.Compared with it is intended to know the expression made, " micro- expression " can more embody people really impression and motivation.
People face recognize on the basis of enter pedestrian's surface analysis in conjunction with " micro- expression ", using computer high speed catch and
Computing capability can preferably recognize and analyze micro- expression shape change of people, such that it is able to judge the mood of analysis object, for example
Whether glad, sad, painful, disappointed, excited etc..
The content of the invention
Based on the deficiencies in the prior art, the present invention provides a kind of video communication sentiment analysis accessory system, its bag
Include video image identification module, color analysis module, pixels statisticses module, characteristic point analysis module, MBM, database,
Mood analysis module, Emotive advisory module, good friend's module for managing files and big data processing module, connect soft into Video chat
Part, video image is intercepted from the chat window in Video chat software, using the auxiliary of the webserver by big data to figure
As carrying out Treatment Analysis, micro- expression shape change and behavior dynamic of people face mould type analysis patient are set up, so as to analyze chatting object
Emotion change, the system that the present invention is provided have can the change of assistant analysis chatting object emotion, promote to improve exchange efficiency
Advantage.
A kind of video communication sentiment analysis accessory system, it includes video image identification module, color analysis module, pixel
Statistical module, characteristic point analysis module, MBM, database, mood analysis module, Emotive advisory module, good friend's archives pipe
Reason module and big data processing module；
Video image identification module is linked into video communication software, the video image in interception video communication software, and will be regarded
Frequency image transmitting to color analysis module, the feedback result adjustment capturing picture according to color analysis module；
Color analysis module receives the image that is truncated to of video image identification module, analyzes the color parameter of image, according to figure
The scope in people face is judged as color change, people face position video image identification module is fed back into, and people face positional information is sent out
It is sent to pixels statisticses module；
Pixelation is carried out after the positional information of pixels statisticses module recipient face to people face location drawing picture, with reference to database people's region feature
Data carry out the identification of pixels statisticses people face to image pixel；
Characteristic point analysis module is divided according to micro- expressive features in the people face result combination database of pixels statisticses module analysis
Analysis, definition people's region feature point；
The analysis result of pixels statisticses module and characteristic point analysis module is combined generation people's surface model by MBM, and in model
Upper feature point for calibration, according to the real-time analysis and regulation characteristic point position of characteristic point analysis module, recording feature point change in location position
Move；
Mood analysis module more changes displacement according to the characteristic point position on people's surface model, call micro- expressive features in database and
Psychological behavioral Characteristic analyzes the change of personage's mood and mood；
Emotive advisory module is linked into video communication software, and the analysis result of mood analysis module is transformed into text information, and
Result is shown in communication picture in barrage form；
Good friend's module for managing files calls data from storage module, and arrangement is classified as communication object emotional change and the spy of good friend's grade
A relation for change is levied, individuation archives, the individual mood result of auxiliary mood analysis module analysis are generated；
Big data processing module is connected to Internet Server, gathers internet data and assists color analysis module, pixel to unite
Meter module and characteristic point analysis module carry out corresponding big data analytical calculation, and storehouse information is updated the data according to analysis result.
Wherein, also there are described analysis accessory system minutes to manage logging modle, minutes management record mould
Root tuber sends meeting deduction and notifies according to the default the time of meeting to participant, and record stored session is regarded in conference process
Frequently.
Wherein, described mood analysis module includes micro- Expression analysis module and behavioural analysis module.
Wherein, described database includes people's region feature database, micro- expressive features database and Psychological behavioral Characteristic number
According to storehouse.
Wherein, described database includes local data base and internet data storehouse.
Specific embodiment
With reference to specific embodiment, the invention will be further described.
A kind of video communication sentiment analysis accessory system, it includes video image identification module, color analysis module, pixel
Statistical module, characteristic point analysis module, MBM, database, mood analysis module, Emotive advisory module, good friend's archives pipe
Reason module and big data processing module；
Video image identification module is linked into video communication software, the video image in interception video communication software, and will be regarded
Frequency image transmitting to color analysis module, the feedback result adjustment capturing picture according to color analysis module；
Color analysis module receives the image that is truncated to of video image identification module, analyzes the color parameter of image, according to figure
The scope in people face is judged as color change, people face position video image identification module is fed back into, and people face positional information is sent out
It is sent to pixels statisticses module；
Pixelation is carried out after the positional information of pixels statisticses module recipient face to people face location drawing picture, with reference to database people's region feature
Data carry out the identification of pixels statisticses people face to image pixel；
Characteristic point analysis module is divided according to micro- expressive features in the people face result combination database of pixels statisticses module analysis
Analysis, definition people's region feature point；
The analysis result of pixels statisticses module and characteristic point analysis module is combined generation people's surface model by MBM, and in model
Upper feature point for calibration, according to the real-time analysis and regulation characteristic point position of characteristic point analysis module, recording feature point change in location position
Move；
Mood analysis module more changes displacement according to the characteristic point position on people's surface model, call micro- expressive features in database and
Psychological behavioral Characteristic analyzes the change of personage's mood and mood；
Emotive advisory module is linked into video communication software, and the analysis result of mood analysis module is transformed into text information, and
Result is shown in communication picture in barrage form；
Good friend's module for managing files calls data from storage module, and arrangement is classified as communication object emotional change and the spy of good friend's grade
A relation for change is levied, individuation archives, the individual mood result of auxiliary mood analysis module analysis are generated；
Big data processing module is connected to Internet Server, gathers internet data and assists color analysis module, pixel to unite
Meter module and characteristic point analysis module carry out corresponding big data analytical calculation, and storehouse information is updated the data according to analysis result.
As the presently preferred embodiments, also there are described analysis accessory system minutes to manage logging modle, minutes
Management logging modle sends meeting deduction and notifies according to the default the time of meeting to participant, and storage is recorded in conference process
Deposit TV news.
As the presently preferred embodiments, described mood analysis module includes micro- Expression analysis module and behavioural analysis module.
As the presently preferred embodiments, described database includes people's region feature database, micro- expressive features database and psychology
Behavioral characteristic database.
As the presently preferred embodiments, described database includes local data base and internet data storehouse.
Embodiment described above only expresses one embodiment of the present invention, and its description is more specific and detailed, but simultaneously
Therefore the limitation to the scope of the claims of the present invention can not be interpreted as.It should be pointed out that for one of ordinary skill in the art
For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to guarantor of the invention
Shield scope.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (5)
1. a kind of video communication sentiment analysis accessory system, it is characterised in that it includes video image identification module, color analysis
It is module, pixels statisticses module, characteristic point analysis module, MBM, database, mood analysis module, Emotive advisory module, good
Friendly module for managing files and big data processing module；
Video image identification module is linked into video communication software, the video image in interception video communication software, and will be regarded
Frequency image transmitting to color analysis module, the feedback result adjustment capturing picture according to color analysis module；
Color analysis module receives the image that is truncated to of video image identification module, analyzes the color parameter of image, according to figure
The scope in people face is judged as color change, people face position video image identification module is fed back into, and people face positional information is sent out
It is sent to pixels statisticses module；
Pixelation is carried out after the positional information of pixels statisticses module recipient face to people face location drawing picture, with reference to database people's region feature
Data carry out the identification of pixels statisticses people face to image pixel；
Characteristic point analysis module is divided according to micro- expressive features in the people face result combination database of pixels statisticses module analysis
Analysis, definition people's region feature point；
The analysis result of pixels statisticses module and characteristic point analysis module is combined generation people's surface model by MBM, and in model
Upper feature point for calibration, according to the real-time analysis and regulation characteristic point position of characteristic point analysis module, recording feature point change in location position
Move；
Mood analysis module more changes displacement according to the characteristic point position on people's surface model, call micro- expressive features in database and
Psychological behavioral Characteristic analyzes the change of personage's mood and mood；
Emotive advisory module is linked into video communication software, and the analysis result of mood analysis module is transformed into text information, and
Result is shown in communication picture in barrage form；
Good friend's module for managing files calls data from storage module, and arrangement is classified as communication object emotional change and the spy of good friend's grade
A relation for change is levied, individuation archives, the individual mood result of auxiliary mood analysis module analysis are generated；
Big data processing module is connected to Internet Server, gathers internet data and assists color analysis module, pixel to unite
Meter module and characteristic point analysis module carry out corresponding big data analytical calculation, and storehouse information is updated the data according to analysis result.
2. video communication sentiment analysis accessory system according to claim 1, it is characterised in that described analysis auxiliary system
Also there are system minutes to manage logging modle, and minutes manage logging modle according to the default the time of meeting to participant
Send meeting deduction to notify, and stored session video is recorded in conference process.
3. video communication sentiment analysis accessory system according to claim 1, it is characterised in that described mood analysis mould
Block includes micro- Expression analysis module and behavioural analysis module.
4. video communication sentiment analysis accessory system according to claim 1, it is characterised in that described database includes
People's region feature database, micro- expressive features database and Psychological behavioral Characteristic database.
5. video communication sentiment analysis accessory system according to claim 1, it is characterised in that described database includes
Local data base and internet data storehouse.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710130150.8A CN106909907A (en) | 2017-03-07 | 2017-03-07 | A kind of video communication sentiment analysis accessory system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710130150.8A CN106909907A (en) | 2017-03-07 | 2017-03-07 | A kind of video communication sentiment analysis accessory system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106909907A true CN106909907A (en) | 2017-06-30 |
Family
ID=59185993
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710130150.8A Pending CN106909907A (en) | 2017-03-07 | 2017-03-07 | A kind of video communication sentiment analysis accessory system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106909907A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107862598A (en) * | 2017-09-30 | 2018-03-30 | 平安普惠企业管理有限公司 | Long-range the interview measures and procedures for the examination and approval, server and readable storage medium storing program for executing |
| CN108549483A (en) * | 2018-03-30 | 2018-09-18 | 京东方科技集团股份有限公司 | A kind of control method and control system of intelligence picture frame |
| CN109446907A (en) * | 2018-09-26 | 2019-03-08 | 百度在线网络技术（北京）有限公司 | A kind of method, apparatus of Video chat, equipment and computer storage medium |
| CN109474845A (en) * | 2018-09-14 | 2019-03-15 | 咪咕音乐有限公司 | Bullet screen control method, bullet screen processing server and computer readable storage medium |
| CN110414465A (en) * | 2019-08-05 | 2019-11-05 | 北京深醒科技有限公司 | A kind of sentiment analysis method of video communication |
| CN112487904A (en) * | 2020-11-23 | 2021-03-12 | 成都尽知致远科技有限公司 | Video image processing method and system based on big data analysis |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103488293A (en) * | 2013-09-12 | 2014-01-01 | 北京航空航天大学 | Man-machine motion interaction system and method based on expression recognition |
| CN103714130A (en) * | 2013-12-12 | 2014-04-09 | 深圳先进技术研究院 | Video recommendation system and method thereof |
| CN104601870A (en) * | 2015-02-15 | 2015-05-06 | 广东欧珀移动通信有限公司 | Rotating camera shooting method and mobile terminal |
| CN105069318A (en) * | 2015-09-12 | 2015-11-18 | 宁波江东泓源工业设计有限公司 | Emotion analysis method |
| CN105847735A (en) * | 2016-03-30 | 2016-08-10 | 宁波三博电子科技有限公司 | Face recognition-based instant pop-up screen video communication method and system |
| CN105913038A (en) * | 2016-04-26 | 2016-08-31 | 哈尔滨工业大学深圳研究生院 | A video-based dynamic micro-expression recognition method |
-
2017
- 2017-03-07 CN CN201710130150.8A patent/CN106909907A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103488293A (en) * | 2013-09-12 | 2014-01-01 | 北京航空航天大学 | Man-machine motion interaction system and method based on expression recognition |
| CN103714130A (en) * | 2013-12-12 | 2014-04-09 | 深圳先进技术研究院 | Video recommendation system and method thereof |
| CN104601870A (en) * | 2015-02-15 | 2015-05-06 | 广东欧珀移动通信有限公司 | Rotating camera shooting method and mobile terminal |
| CN105069318A (en) * | 2015-09-12 | 2015-11-18 | 宁波江东泓源工业设计有限公司 | Emotion analysis method |
| CN105847735A (en) * | 2016-03-30 | 2016-08-10 | 宁波三博电子科技有限公司 | Face recognition-based instant pop-up screen video communication method and system |
| CN105913038A (en) * | 2016-04-26 | 2016-08-31 | 哈尔滨工业大学深圳研究生院 | A video-based dynamic micro-expression recognition method |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107862598A (en) * | 2017-09-30 | 2018-03-30 | 平安普惠企业管理有限公司 | Long-range the interview measures and procedures for the examination and approval, server and readable storage medium storing program for executing |
| CN108549483A (en) * | 2018-03-30 | 2018-09-18 | 京东方科技集团股份有限公司 | A kind of control method and control system of intelligence picture frame |
| CN108549483B (en) * | 2018-03-30 | 2020-08-18 | 京东方科技集团股份有限公司 | Control method and control system of intelligent picture frame |
| US11455036B2 (en) | 2018-03-30 | 2022-09-27 | Beijing Boe Technology Development Co., Ltd. | Control method of iGallery, control system of iGallery, and computer readable storage medium |
| CN109474845A (en) * | 2018-09-14 | 2019-03-15 | 咪咕音乐有限公司 | Bullet screen control method, bullet screen processing server and computer readable storage medium |
| CN109474845B (en) * | 2018-09-14 | 2021-11-16 | 咪咕音乐有限公司 | Bullet screen control method, bullet screen processing server and computer readable storage medium |
| CN109446907A (en) * | 2018-09-26 | 2019-03-08 | 百度在线网络技术（北京）有限公司 | A kind of method, apparatus of Video chat, equipment and computer storage medium |
| CN110414465A (en) * | 2019-08-05 | 2019-11-05 | 北京深醒科技有限公司 | A kind of sentiment analysis method of video communication |
| CN110414465B (en) * | 2019-08-05 | 2023-11-10 | 北京深醒科技有限公司 | Emotion analysis method for video communication |
| CN112487904A (en) * | 2020-11-23 | 2021-03-12 | 成都尽知致远科技有限公司 | Video image processing method and system based on big data analysis |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106909907A (en) | A kind of video communication sentiment analysis accessory system | |
| Dolhansky et al. | The deepfake detection challenge (dfdc) preview dataset | |
| Kong et al. | Detect and locate: Exposing face manipulation by semantic-and noise-level telltales | |
| Mittal et al. | Emoticon: Context-aware multimodal emotion recognition using frege's principle | |
| WO2019000777A1 (en) | Internet-based face beautification system | |
| US20180308114A1 (en) | Method, device and system for evaluating product recommendation degree | |
| CN112347941B (en) | Motion video collection intelligent generation and distribution method based on 5G MEC | |
| Nguyen et al. | Multimodal analysis of body communication cues in employment interviews | |
| TW201327449A (en) | Social system and method for bringing virtual social network into real life | |
| CN104410911A (en) | Video emotion tagging-based method for assisting identification of facial expression | |
| Sharma et al. | Audio-visual automatic group affect analysis | |
| US9706168B1 (en) | Room conferencing system with heat map annotation of documents | |
| Chen et al. | A region group adaptive attention model for subtle expression recognition | |
| CN111970471A (en) | Participant scoring method, device, equipment and medium based on video conference | |
| CN113965550B (en) | Intelligent Interactive Remote Assisted Video System | |
| CN104765951A (en) | Multimedia medical recording assembly and data access method | |
| WO2022262098A1 (en) | Video emotion semantic analysis method based on graph neural network | |
| US20210295186A1 (en) | Computer-implemented system and method for collecting feedback | |
| CN106920074A (en) | A kind of remote interview method with psychological auxiliary judgment | |
| CN106886770A (en) | A kind of video communication sentiment analysis householder method | |
| Shang et al. | Protecting real-time video chat against fake facial videos generated by face reenactment | |
| Huang et al. | Research on learning state based on students’ attitude and emotion in class learning | |
| CN106910048A (en) | A kind of remote interview system with psychological auxiliary judgment | |
| CN109376694A (en) | A kind of real-time face biopsy method based on image procossing | |
| CN111163366B (en) | Video processing method and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170630 |
|
| WD01 | Invention patent application deemed withdrawn after publication |