CN106909907A - A kind of video communication sentiment analysis accessory system - Google Patents
A kind of video communication sentiment analysis accessory system Download PDFInfo
- Publication number
- CN106909907A CN106909907A CN201710130150.8A CN201710130150A CN106909907A CN 106909907 A CN106909907 A CN 106909907A CN 201710130150 A CN201710130150 A CN 201710130150A CN 106909907 A CN106909907 A CN 106909907A
- Authority
- CN
- China
- Prior art keywords
- module
- analysis
- people
- analysis module
- mood
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
- G06V40/176—Dynamic expression
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/94—Hardware or software architectures specially adapted for image or video understanding
- G06V10/95—Hardware or software architectures specially adapted for image or video understanding structured as a network, e.g. client-server architectures
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The present invention provides a kind of video communication sentiment analysis accessory system, it includes video image identification module, color analysis module, pixels statisticses module, characteristic point analysis module, MBM, database, mood analysis module, Emotive advisory module, good friend's module for managing files and big data processing module, connect into Video chat software, video image is intercepted from the chat window in Video chat software, Treatment Analysis are carried out to image by big data using the auxiliary of the webserver, set up micro- expression shape change and behavior dynamic of people face mould type analysis patient, so as to the emotion for analyzing chatting object changes, the present invention provide system have can assistant analysis chatting object emotion change, promote to improve the advantage for exchanging efficiency.
Description
Technical field
The invention belongs to information-based communication technique field, more particularly to a kind of video communication sentiment analysis accessory system.
Background technology
With the development of the network technology, video communication is increasingly popularized, and increasing field uses video communication method,
Including aspects such as Internet chat, video conference, remote teaching.Video communication has furthered interpersonal distance, if regarding
It will be seen that the emotion of more other side, psychological activity will substantially reduce exchange misunderstanding, promote person to person in the middle of frequency communication process
Between exchange.
Recognition of face, is that the facial feature information based on people carries out a kind of biological identification technology of identification.With shooting
Machine or camera image or video flowing of the collection containing face, and automatic detect and track face in the picture, and then to detection
To face carry out a series of correlation techniques of face, generally also referred to as Identification of Images, face recognition.
Micro- expression, is psychology noun.People see heart impression expression to other side by doing some expressions, are done in people
Different expressions between, or in certain expression, face's meeting " leakage " goes out other information." micro- expression " is most short by sustainable 1/25
Second, although a subconscious expression may be only lasted in a flash, but this characteristic, it is easy to expose mood.When face is doing
During certain expression, these duration extremely short expression can flash across suddenly, and express opposite mood sometimes." micro- table
Feelings " flash across, and the people and observer that typically even clear-headed work is expressed one's feelings are detectable.In experiment, only 10% people examines
Feel.Compared with it is intended to know the expression made, " micro- expression " can more embody people really impression and motivation.
People face recognize on the basis of enter pedestrian's surface analysis in conjunction with " micro- expression ", using computer high speed catch and
Computing capability can preferably recognize and analyze micro- expression shape change of people, such that it is able to judge the mood of analysis object, for example
Whether glad, sad, painful, disappointed, excited etc..
The content of the invention
Based on the deficiencies in the prior art, the present invention provides a kind of video communication sentiment analysis accessory system, its bag
Include video image identification module, color analysis module, pixels statisticses module, characteristic point analysis module, MBM, database,
Mood analysis module, Emotive advisory module, good friend's module for managing files and big data processing module, connect soft into Video chat
Part, video image is intercepted from the chat window in Video chat software, using the auxiliary of the webserver by big data to figure
As carrying out Treatment Analysis, micro- expression shape change and behavior dynamic of people face mould type analysis patient are set up, so as to analyze chatting object
Emotion change, the system that the present invention is provided have can the change of assistant analysis chatting object emotion, promote to improve exchange efficiency
Advantage.
A kind of video communication sentiment analysis accessory system, it includes video image identification module, color analysis module, pixel
Statistical module, characteristic point analysis module, MBM, database, mood analysis module, Emotive advisory module, good friend's archives pipe
Reason module and big data processing module；
Video image identification module is linked into video communication software, the video image in interception video communication software, and will be regarded
Frequency image transmitting to color analysis module, the feedback result adjustment capturing picture according to color analysis module；
Color analysis module receives the image that is truncated to of video image identification module, analyzes the color parameter of image, according to figure
The scope in people face is judged as color change, people face position video image identification module is fed back into, and people face positional information is sent out
It is sent to pixels statisticses module；
Pixelation is carried out after the positional information of pixels statisticses module recipient face to people face location drawing picture, with reference to database people's region feature
Data carry out the identification of pixels statisticses people face to image pixel；
Characteristic point analysis module is divided according to micro- expressive features in the people face result combination database of pixels statisticses module analysis
Analysis, definition people's region feature point；
The analysis result of pixels statisticses module and characteristic point analysis module is combined generation people's surface model by MBM, and in model
Upper feature point for calibration, according to the real-time analysis and regulation characteristic point position of characteristic point analysis module, recording feature point change in location position
Move；
Mood analysis module more changes displacement according to the characteristic point position on people's surface model, call micro- expressive features in database and
Psychological behavioral Characteristic analyzes the change of personage's mood and mood；
Emotive advisory module is linked into video communication software, and the analysis result of mood analysis module is transformed into text information, and
Result is shown in communication picture in barrage form；
Good friend's module for managing files calls data from storage module, and arrangement is classified as communication object emotional change and the spy of good friend's grade
A relation for change is levied, individuation archives, the individual mood result of auxiliary mood analysis module analysis are generated；
Big data processing module is connected to Internet Server, gathers internet data and assists color analysis module, pixel to unite
Meter module and characteristic point analysis module carry out corresponding big data analytical calculation, and storehouse information is updated the data according to analysis result.
Wherein, also there are described analysis accessory system minutes to manage logging modle, minutes management record mould
Root tuber sends meeting deduction and notifies according to the default the time of meeting to participant, and record stored session is regarded in conference process
Frequently.
Wherein, described mood analysis module includes micro- Expression analysis module and behavioural analysis module.
Wherein, described database includes people's region feature database, micro- expressive features database and Psychological behavioral Characteristic number
According to storehouse.
Wherein, described database includes local data base and internet data storehouse.
Specific embodiment
With reference to specific embodiment, the invention will be further described.
A kind of video communication sentiment analysis accessory system, it includes video image identification module, color analysis module, pixel
Statistical module, characteristic point analysis module, MBM, database, mood analysis module, Emotive advisory module, good friend's archives pipe
Reason module and big data processing module；
Video image identification module is linked into video communication software, the video image in interception video communication software, and will be regarded
Frequency image transmitting to color analysis module, the feedback result adjustment capturing picture according to color analysis module；
Color analysis module receives the image that is truncated to of video image identification module, analyzes the color parameter of image, according to figure
The scope in people face is judged as color change, people face position video image identification module is fed back into, and people face positional information is sent out
It is sent to pixels statisticses module；
Pixelation is carried out after the positional information of pixels statisticses module recipient face to people face location drawing picture, with reference to database people's region feature
Data carry out the identification of pixels statisticses people face to image pixel；
Characteristic point analysis module is divided according to micro- expressive features in the people face result combination database of pixels statisticses module analysis
Analysis, definition people's region feature point；
The analysis result of pixels statisticses module and characteristic point analysis module is combined generation people's surface model by MBM, and in model
Upper feature point for calibration, according to the real-time analysis and regulation characteristic point position of characteristic point analysis module, recording feature point change in location position
Move；
Mood analysis module more changes displacement according to the characteristic point position on people's surface model, call micro- expressive features in database and
Psychological behavioral Characteristic analyzes the change of personage's mood and mood；
Emotive advisory module is linked into video communication software, and the analysis result of mood analysis module is transformed into text information, and
Result is shown in communication picture in barrage form；
Good friend's module for managing files calls data from storage module, and arrangement is classified as communication object emotional change and the spy of good friend's grade
A relation for change is levied, individuation archives, the individual mood result of auxiliary mood analysis module analysis are generated；
Big data processing module is connected to Internet Server, gathers internet data and assists color analysis module, pixel to unite
Meter module and characteristic point analysis module carry out corresponding big data analytical calculation, and storehouse information is updated the data according to analysis result.
As the presently preferred embodiments, also there are described analysis accessory system minutes to manage logging modle, minutes
Management logging modle sends meeting deduction and notifies according to the default the time of meeting to participant, and storage is recorded in conference process
Deposit TV news.
As the presently preferred embodiments, described mood analysis module includes micro- Expression analysis module and behavioural analysis module.
As the presently preferred embodiments, described database includes people's region feature database, micro- expressive features database and psychology
Behavioral characteristic database.
As the presently preferred embodiments, described database includes local data base and internet data storehouse.
Embodiment described above only expresses one embodiment of the present invention, and its description is more specific and detailed, but simultaneously
Therefore the limitation to the scope of the claims of the present invention can not be interpreted as.It should be pointed out that for one of ordinary skill in the art
For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to guarantor of the invention
Shield scope.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (5)
1. a kind of video communication sentiment analysis accessory system, it is characterised in that it includes video image identification module, color analysis
It is module, pixels statisticses module, characteristic point analysis module, MBM, database, mood analysis module, Emotive advisory module, good
Friendly module for managing files and big data processing module；
Video image identification module is linked into video communication software, the video image in interception video communication software, and will be regarded
Frequency image transmitting to color analysis module, the feedback result adjustment capturing picture according to color analysis module；
Color analysis module receives the image that is truncated to of video image identification module, analyzes the color parameter of image, according to figure
The scope in people face is judged as color change, people face position video image identification module is fed back into, and people face positional information is sent out
It is sent to pixels statisticses module；
Pixelation is carried out after the positional information of pixels statisticses module recipient face to people face location drawing picture, with reference to database people's region feature
Data carry out the identification of pixels statisticses people face to image pixel；
Characteristic point analysis module is divided according to micro- expressive features in the people face result combination database of pixels statisticses module analysis
Analysis, definition people's region feature point；
The analysis result of pixels statisticses module and characteristic point analysis module is combined generation people's surface model by MBM, and in model
Upper feature point for calibration, according to the real-time analysis and regulation characteristic point position of characteristic point analysis module, recording feature point change in location position
Move；
Mood analysis module more changes displacement according to the characteristic point position on people's surface model, call micro- expressive features in database and
Psychological behavioral Characteristic analyzes the change of personage's mood and mood；
Emotive advisory module is linked into video communication software, and the analysis result of mood analysis module is transformed into text information, and
Result is shown in communication picture in barrage form；
Good friend's module for managing files calls data from storage module, and arrangement is classified as communication object emotional change and the spy of good friend's grade
A relation for change is levied, individuation archives, the individual mood result of auxiliary mood analysis module analysis are generated；
Big data processing module is connected to Internet Server, gathers internet data and assists color analysis module, pixel to unite
Meter module and characteristic point analysis module carry out corresponding big data analytical calculation, and storehouse information is updated the data according to analysis result.
2. video communication sentiment analysis accessory system according to claim 1, it is characterised in that described analysis auxiliary system
Also there are system minutes to manage logging modle, and minutes manage logging modle according to the default the time of meeting to participant
Send meeting deduction to notify, and stored session video is recorded in conference process.
3. video communication sentiment analysis accessory system according to claim 1, it is characterised in that described mood analysis mould
Block includes micro- Expression analysis module and behavioural analysis module.
4. video communication sentiment analysis accessory system according to claim 1, it is characterised in that described database includes
People's region feature database, micro- expressive features database and Psychological behavioral Characteristic database.
5. video communication sentiment analysis accessory system according to claim 1, it is characterised in that described database includes
Local data base and internet data storehouse.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710130150.8A CN106909907A (en) | 2017-03-07 | 2017-03-07 | A kind of video communication sentiment analysis accessory system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710130150.8A CN106909907A (en) | 2017-03-07 | 2017-03-07 | A kind of video communication sentiment analysis accessory system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106909907A true CN106909907A (en) | 2017-06-30 |
Family
ID=59185993
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710130150.8A Pending CN106909907A (en) | 2017-03-07 | 2017-03-07 | A kind of video communication sentiment analysis accessory system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106909907A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107862598A (en) * | 2017-09-30 | 2018-03-30 | 平安普惠企业管理有限公司 | Long-range the interview measures and procedures for the examination and approval, server and readable storage medium storing program for executing |
| CN108549483A (en) * | 2018-03-30 | 2018-09-18 | 京东方科技集团股份有限公司 | A kind of control method and control system of intelligence picture frame |
| CN109446907A (en) * | 2018-09-26 | 2019-03-08 | 百度在线网络技术（北京）有限公司 | A kind of method, apparatus of Video chat, equipment and computer storage medium |
| CN109474845A (en) * | 2018-09-14 | 2019-03-15 | 咪咕音乐有限公司 | Bullet screen control method, bullet screen processing server and computer readable storage medium |
| CN110414465A (en) * | 2019-08-05 | 2019-11-05 | 北京深醒科技有限公司 | A kind of sentiment analysis method of video communication |
| CN112487904A (en) * | 2020-11-23 | 2021-03-12 | 成都尽知致远科技有限公司 | Video image processing method and system based on big data analysis |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103488293A (en) * | 2013-09-12 | 2014-01-01 | 北京航空航天大学 | Man-machine motion interaction system and method based on expression recognition |
| CN103714130A (en) * | 2013-12-12 | 2014-04-09 | 深圳先进技术研究院 | Video recommendation system and method thereof |
| CN104601870A (en) * | 2015-02-15 | 2015-05-06 | 广东欧珀移动通信有限公司 | Rotating camera shooting method and mobile terminal |
| CN105069318A (en) * | 2015-09-12 | 2015-11-18 | 宁波江东泓源工业设计有限公司 | Emotion analysis method |
| CN105847735A (en) * | 2016-03-30 | 2016-08-10 | 宁波三博电子科技有限公司 | Face recognition-based instant pop-up screen video communication method and system |
| CN105913038A (en) * | 2016-04-26 | 2016-08-31 | 哈尔滨工业大学深圳研究生院 | Video based dynamic microexpression identification method |
-
2017
- 2017-03-07 CN CN201710130150.8A patent/CN106909907A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103488293A (en) * | 2013-09-12 | 2014-01-01 | 北京航空航天大学 | Man-machine motion interaction system and method based on expression recognition |
| CN103714130A (en) * | 2013-12-12 | 2014-04-09 | 深圳先进技术研究院 | Video recommendation system and method thereof |
| CN104601870A (en) * | 2015-02-15 | 2015-05-06 | 广东欧珀移动通信有限公司 | Rotating camera shooting method and mobile terminal |
| CN105069318A (en) * | 2015-09-12 | 2015-11-18 | 宁波江东泓源工业设计有限公司 | Emotion analysis method |
| CN105847735A (en) * | 2016-03-30 | 2016-08-10 | 宁波三博电子科技有限公司 | Face recognition-based instant pop-up screen video communication method and system |
| CN105913038A (en) * | 2016-04-26 | 2016-08-31 | 哈尔滨工业大学深圳研究生院 | Video based dynamic microexpression identification method |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107862598A (en) * | 2017-09-30 | 2018-03-30 | 平安普惠企业管理有限公司 | Long-range the interview measures and procedures for the examination and approval, server and readable storage medium storing program for executing |
| CN108549483A (en) * | 2018-03-30 | 2018-09-18 | 京东方科技集团股份有限公司 | A kind of control method and control system of intelligence picture frame |
| CN108549483B (en) * | 2018-03-30 | 2020-08-18 | 京东方科技集团股份有限公司 | Control method and control system of intelligent picture frame |
| US11455036B2 (en) | 2018-03-30 | 2022-09-27 | Beijing Boe Technology Development Co., Ltd. | Control method of iGallery, control system of iGallery, and computer readable storage medium |
| CN109474845A (en) * | 2018-09-14 | 2019-03-15 | 咪咕音乐有限公司 | Bullet screen control method, bullet screen processing server and computer readable storage medium |
| CN109474845B (en) * | 2018-09-14 | 2021-11-16 | 咪咕音乐有限公司 | Bullet screen control method, bullet screen processing server and computer readable storage medium |
| CN109446907A (en) * | 2018-09-26 | 2019-03-08 | 百度在线网络技术（北京）有限公司 | A kind of method, apparatus of Video chat, equipment and computer storage medium |
| CN110414465A (en) * | 2019-08-05 | 2019-11-05 | 北京深醒科技有限公司 | A kind of sentiment analysis method of video communication |
| CN110414465B (en) * | 2019-08-05 | 2023-11-10 | 北京深醒科技有限公司 | Emotion analysis method for video communication |
| CN112487904A (en) * | 2020-11-23 | 2021-03-12 | 成都尽知致远科技有限公司 | Video image processing method and system based on big data analysis |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106909907A (en) | A kind of video communication sentiment analysis accessory system | |
| WO2019000777A1 (en) | Internet-based face beautification system | |
| Kong et al. | Detect and locate: Exposing face manipulation by semantic-and noise-level telltales | |
| US9691184B2 (en) | Methods and systems for generating and joining shared experience | |
| Yan et al. | For micro-expression recognition: Database and suggestions | |
| US7889073B2 (en) | Laugh detector and system and method for tracking an emotional response to a media presentation | |
| TWI482108B (en) | To bring virtual social networks into real-life social systems and methods | |
| CN107197384A (en) | The multi-modal exchange method of virtual robot and system applied to net cast platform | |
| CN106919922A (en) | A kind of anti-cheating Distant Evaluation System | |
| Nguyen et al. | Multimodal analysis of body communication cues in employment interviews | |
| CN106060470B (en) | Video monitoring method and system | |
| Guerini et al. | Exploring image virality in google plus | |
| CN103679147A (en) | Method and device for identifying model of mobile phone | |
| CN112347941A (en) | Motion video collection intelligent generation and distribution method based on 5G MEC | |
| Mou et al. | Automatic recognition of emotions and membership in group videos | |
| CN106920074A (en) | A kind of remote interview method with psychological auxiliary judgment | |
| CN104765951A (en) | Multimedia medical recording assembly and data access method | |
| CN106886770A (en) | A kind of video communication sentiment analysis householder method | |
| Bhattacharya et al. | The unobtrusive group interaction (UGI) corpus | |
| US20140214846A1 (en) | Methods and systems of dynamic content analysis | |
| Saito et al. | Classification of spontaneous and posed smiles by photo-reflective sensors embedded with smart eyewear | |
| Dunbar et al. | Automated methods to examine nonverbal synchrony in dyads | |
| CN109376694A (en) | A kind of real-time face biopsy method based on image procossing | |
| CN106910048A (en) | A kind of remote interview system with psychological auxiliary judgment | |
| CN106919924A (en) | A kind of mood analysis system based on the identification of people face |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170630 |
|
| WD01 | Invention patent application deemed withdrawn after publication |