CN109068109A - A kind of real-time method and system for grasping child's mood - Google Patents
A kind of real-time method and system for grasping child's mood Download PDFInfo
- Publication number
- CN109068109A CN109068109A CN201811149952.4A CN201811149952A CN109068109A CN 109068109 A CN109068109 A CN 109068109A CN 201811149952 A CN201811149952 A CN 201811149952A CN 109068109 A CN109068109 A CN 109068109A
- Authority
- CN
- China
- Prior art keywords
- child
- channel
- video feeds
- video
- user terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Abstract
The present invention discloses a kind of method and system for grasping child's mood in real time, and the method comprising the steps of: S1: panorama web camera carries out sound detection to the child's pictorial information and audio-frequency information of acquisition；S2: carrying out face image processing to child's pictorial information, obtain child's face information, judge whether there is abnormal emotion through children's Emotion identification module, and an abnormal picture is pushed if having to user terminal；S3: signal analysis and processing, screening storage laugh channel and crying channel are carried out to child's audio-frequency information；In the step S3, to laugh channel, the first video feeds of certain time length is acquired, while grabbing an expression picture, the first video feeds and expression picture are pushed to user terminal；To crying channel, the second video feeds of certain time length are acquired, the second video feeds and expression picture are pushed to user terminal.The present invention can be comprehensive discovery child real-time emotion performance, for child grow up healthy and sound have very big value.
Description
Technical field
The present invention relates to intelligent internet of things technical field, in particular to one kind grasps the method for child's mood in real time and is
System.
Background technique
Child, especially age before academic year (first grade of primary school) child, express it is also unintelligible, it is de- when going out with adult
From that can have biggish security risk after adult's sight, especially in places such as market, recreation ground, wave wave ponds, so urgently
It needs to research and develop a kind of technology and Real-time Feedback is accomplished to the mood of child.
There is the video camera of detection crying application scenarios to be pushed to mobile phone after video camera detects crying at present
APP or intelligent wearable device prompting message.
This application scenarios have only done algorithm process to crying, do not process the various characteristic synchronizations of child, such as:
The facial expression of child, the candid photograph for the expressions such as laughter is happy, sad, abnormal solve more scene process such as child's crying, laugh
The emotional change etc. for being concerned about child in real time is realized in the realization of scheme, is helped the growth for guiding child happy and healthy and be can record
The happy pleasant fine video pictures scene of lower child, generates the time hourglass etc. of child's growth.
Summary of the invention
In view of the problems of the existing technology, the present invention provides a kind of method and system for grasping child's mood in real time.
To achieve the above object, the specific technical solution of the present invention is as follows:
A kind of real-time method for grasping child's mood, comprising steps of
S1: panorama web camera carries out sound detection to the child's pictorial information and audio-frequency information of acquisition, when not detecting
When to sound, S2 is entered step, when detecting sound, then enters step S3；
S2: face image processing is carried out to child's pictorial information, child's face information is obtained, through children's Emotion identification module
Abnormal emotion is judged whether there is, an abnormal picture is pushed if having to user terminal；
S3: signal analysis and processing, screening storage laugh channel and crying channel are carried out to child's audio-frequency information；
In the step S3, to laugh channel, the first video feeds of certain time length are acquired, while grabbing an expression figure
First video feeds and expression picture are pushed to user terminal by piece；
To crying channel, the second video feeds of certain time length are acquired, the second video feeds and expression picture are pushed to
User terminal.
As a preferred embodiment of the invention, this method further includes step S4:
Extract the first video feeds, the second video feeds, expression of the accumulation storage inside laugh channel and crying channel
Some or all of in picture, time hourglass video is generated.
As a preferred embodiment of the invention, the user terminal is selected from cell phone application end and/or intelligent wearable device.
The present invention also provides a kind of systems for grasping child's mood in real time, comprising:
Panorama web camera, for acquiring child's pictorial information, audio-frequency information and video information；
Children's Emotion identification program, is integrated in panorama web camera comprising face image processing module, children's mood
Anomalous identification module, audio processing modules, video processing module, child's pictorial information obtain small through face image processing module
Child's face information judges whether there is abnormal emotion through children's Emotion identification module, and an abnormal picture is pushed if having to user
Terminal；
The audio processing modules be used for child's audio-frequency information carry out signal analysis and processing, screening storage laugh channel and
Crying channel；
It is adopted when the first video feeds of acquisition certain time length, crying channel when the video processing module is used for laugh channel
Second video feeds of collection certain time length are pushed to user terminal.
As a preferred embodiment of the invention, which further includes a time hourglass module, for extracting laugh channel
With some or all of in the first video feeds, the second video feeds, expression picture of the accumulation storage inside crying channel, give birth to
At time hourglass video.
As a preferred embodiment of the invention, the user terminal is selected from cell phone application end and/or intelligent wearable device.
Using technical solution of the present invention, have the advantages that
(1), the real-time emotion performance of discovery child that can be comprehensive, such as abnormal expression, happy expression, crying, laugh
Etc. multiple performance.Existing child is substantially nurse or family old man looks after, as parent, can observe in real time recognize it is small
Emotion expression in child's developmental process preferably goes education and guidance child, and growing up healthy and sound for child has very big valence
Value；
(2), it can be used for commercial scene or household scene, healthy growth and various dimensions managing children mood for child
It provides a great help, and commercialization can bring biggish commercial value to take in；
(3), the human cost of public place of entertainment staff is reduced, and input cost is low.
Detailed description of the invention
Fig. 1 is the work flow diagram of the method for the present invention；
Fig. 2 is the composition block diagram of present system.
Specific embodiment
Below in conjunction with the drawings and specific embodiments, the present invention is further described.
Referring to Fig.1, a kind of method for grasping child's mood in real time of the present invention, comprising steps of
S1: panorama web camera carries out sound detection to the child's pictorial information and audio-frequency information of acquisition, when not detecting
When to sound, S2 is entered step, when detecting sound, then enters step S3.
S2: face image processing is carried out to child's pictorial information, child's face information is obtained, through children's Emotion identification module
Abnormal emotion is judged whether there is, an abnormal picture is pushed if having to user terminal.
Wherein, specifically include:
Step S201: face image processing is carried out to child's pictorial information, obtains child's face information；
Step S202: children's Emotion identification module judges whether there is abnormal emotion
Step S203: have and then push an abnormal picture to user terminal.
S3: signal analysis and processing, screening storage laugh channel and crying channel are carried out to child's audio-frequency information；
In the step S3, to laugh channel, the first video feeds of certain time length are acquired, while grabbing an expression figure
First video feeds and expression picture are pushed to user terminal by piece；
To crying channel, the second video feeds of certain time length are acquired, the second video feeds and expression picture are pushed to
User terminal.
Wherein, specifically include:
Step S301: signal analysis and processing, screening storage laugh channel and crying channel are carried out to child's audio-frequency information；
Step S302: to laugh channel, acquiring the first video feeds of certain time length, while grabbing an expression picture,
First video feeds and expression picture are pushed to user terminal；
Step S303: to crying channel, the second video feeds of certain time length are acquired, by the second video feeds and expression figure
Piece is pushed to user terminal.
S4: the first video feeds, the second video feeds, table of the accumulation storage inside laugh channel and crying channel are extracted
Some or all of in feelings picture, time hourglass video is generated.
In the above method, the user terminal is selected from cell phone application end and/or intelligent wearable device.
The present invention also provides a kind of systems for grasping child's mood in real time, comprising:
Panorama web camera 101, for acquiring child's pictorial information, audio-frequency information and video information；
Children's Emotion identification program 102, is integrated in panorama web camera comprising face image processing module 102a,
Children's abnormal feeling identification module 102b, audio processing modules 102c, video processing module 102d, child's pictorial information is through face
Image processing module 102a obtains child's face information, judges whether there is abnormal emotion through children's Emotion identification module 102b, if
Have and then pushes an abnormal picture to user terminal 103；
The audio processing modules 103 are used to carry out child's audio-frequency information signal analysis and processing, and screening storage laugh is logical
Road and crying channel；
The video processing module 104 is used for the first video feeds of acquisition certain time length, crying channel when laugh channel
When acquisition certain time length the second video feeds be pushed to user terminal 103.
In the present invention, which can also include a time hourglass module 104, for extracting laugh channel and crying channel
Some or all of in the first video feeds, the second video feeds, expression picture of accumulating storage of the inside, time hourglass is generated
Video.
In the present invention, the user terminal is selected from cell phone application end and/or intelligent wearable device.
The working principle of the invention:
(1), panorama web camera 101 is passed through into network configuration to APP (such as bluetooth distribution, AP distribution, gateway first
Deng), all very mature applications at present of this technology, in order to it is subsequent by the crying video of the camera supervised child arrived,
The information such as laugh video, abnormal expression picture, candid photograph feature smiling face picture are pushed to user mobile phone APP end in real time, this push is also
Can be by equipment synchronous bindings such as intelligence wearing etc., message not only pushes cell phone application, synchronized push intelligent wearable device.It allows
User recognizes child's mood, the mood of various dimensions managing children at the first time, and guidance child grows up healthy and sound.It is especially commercial
Scene, when child is when children's play place is freely played, whens video camera detects child's exception expression and crying etc., in real time
Staff or parent are reminded, child will not feel helpless in grievance, while the manpower of crew numbers can be reduced
Cost input；
(2), be based on artificial intelligence system, this system, that is, children's Emotion identification program 102, it would be desirable to be able to identify audio signal and
Vision signal, processing facial image algorithm etc..When video camera does not detect sound, by the children's feelings for being integrated in video camera
Thread identifying system, the mood performance that whole day monitors child is countenance variation.When detecting abnormal expression, system is i.e. certainly
Dynamic label.
(3), face image processing module 102a, this module is integrated in children's Emotion identification program, when panorama network shooting
When machine 101 and children's Emotion identification program 102 monitor the abnormal expression of child, face image processing module 102a is again to being
The picture of system label processes, and further detects whether this picture is abnormal expression picture, passes through intelligent camera and the end APP
It handles this information and reminds parent in real time, this exception expression picture is pushed to parent/staff；
(4), this is analyzed when panorama web camera 101 has detected audio signal based on audio processing modules 102c
Audio signal is crying audio either laugh audio, is divided into two channel acquisition storages, the two channels are handled respectively.This sound
Frequency module needs are high-precision to identify crying or laugh signal.
(5), be based on video integration processing module 102d, two channels of audio signal in combination with video frequency signal processing,
To have be pushed to user within video intercepting 10 seconds of crying or laugh, for laugh audio, it is also necessary to face image processing module
102a processing, grabs out a candid photograph feature smiling face and is pushed to parent, records the happy moment of child's growth.This resource is used
In commercial, can also be used as the value-added service of product, (such as feature smiling face photo can be with to obtain additional commercial value
Certain price of fixing a price is sold to parent etc.)；
(6), time sandglass function, the function of selectively being used for user.When the resource recorded, video resource, picture
When resource is enough, time hourglass can be generated by intelligent AI, all resources are compressed into tens seconds videos, facilitate the guarantor of user
It deposits and shares, generate interesting and memorable video resource.
The above description is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all at this
Under the inventive concept of invention, using equivalent structure transformation made by description of the invention and accompanying drawing content, or directly/use indirectly
It is included in other related technical areas in scope of patent protection of the invention.
Claims (6)
1. a kind of method for grasping child's mood in real time, which is characterized in that comprising steps of
S1: panorama web camera carries out sound detection to the child's pictorial information and audio-frequency information of acquisition, when sound is not detected
When sound, S2 is entered step, when detecting sound, then enters step S3；
S2: face image processing is carried out to child's pictorial information, obtains child's face information, is judged through children's Emotion identification module
Whether there is abnormal emotion, an abnormal picture is pushed if having to user terminal；
S3: signal analysis and processing, screening storage laugh channel and crying channel are carried out to child's audio-frequency information；
In the step S3, to laugh channel, the first video feeds of certain time length are acquired, while grabbing an expression picture,
First video feeds and expression picture are pushed to user terminal；
To crying channel, the second video feeds of certain time length are acquired, the second video feeds and expression picture are pushed to user
Terminal.
2. the real-time method for grasping child's mood according to claim 1, which is characterized in that this method further includes step
S4:
Extract the first video feeds, the second video feeds, expression picture of the accumulation storage inside laugh channel and crying channel
Some or all of in, generate time hourglass video.
3. the real-time method for grasping child's mood according to claim 1 or 2, which is characterized in that the user terminal choosing
From cell phone application end and/or intelligent wearable device.
4. a kind of system for grasping child's mood in real time characterized by comprising
Panorama web camera, for acquiring child's pictorial information, audio-frequency information and video information；
Children's Emotion identification program, is integrated in panorama web camera comprising face image processing module, children's abnormal feeling
Identification module, audio processing modules, video processing module, child's pictorial information obtain child people through face image processing module
Face information judges whether there is abnormal emotion through children's Emotion identification module, and an abnormal picture is pushed if having to user terminal；
The audio processing modules are used to carry out child's audio-frequency information signal analysis and processing, screening storage laugh channel and crying
Channel；
One is acquired when the first video feeds of acquisition certain time length, crying channel when the video processing module is used for laugh channel
The second long video feeds of timing are pushed to user terminal.
5. the real-time system for grasping child's mood according to claim 4, which is characterized in that the system further includes a time
Hourglass module, for extract the first video feeds of the accumulation storage inside laugh channel and crying channel, the second video feeds,
Some or all of in expression picture, time hourglass video is generated.
6. the real-time system for grasping child's mood according to claim 4 or 5, which is characterized in that the user terminal choosing
From cell phone application end and/or intelligent wearable device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811149952.4A CN109068109A (en) | 2018-09-29 | 2018-09-29 | A kind of real-time method and system for grasping child's mood |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811149952.4A CN109068109A (en) | 2018-09-29 | 2018-09-29 | A kind of real-time method and system for grasping child's mood |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109068109A true CN109068109A (en) | 2018-12-21 |
Family
ID=64767047
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811149952.4A Pending CN109068109A (en) | 2018-09-29 | 2018-09-29 | A kind of real-time method and system for grasping child's mood |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109068109A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110460809A (en) * | 2019-07-05 | 2019-11-15 | 苏宁智能终端有限公司 | A kind of vagitus method for detecting, device and intelligent camera head apparatus |
| CN111416934A (en) * | 2020-03-16 | 2020-07-14 | 南昌航空大学 | Facial expression acquisition method and system based on functional music intervention |
| CN116489475A (en) * | 2019-12-31 | 2023-07-25 | 武汉星巡智能科技有限公司 | Video editing method, device, equipment and storage medium based on interesting expression |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050201565A1 (en) * | 2004-03-15 | 2005-09-15 | Samsung Electronics Co., Ltd. | Apparatus for providing sound effects according to an image and method thereof |
| CN105718921A (en) * | 2016-02-29 | 2016-06-29 | 深圳前海勇艺达机器人有限公司 | Method capable of realizing robot intelligent emotion recording |
| CN106027936A (en) * | 2016-07-19 | 2016-10-12 | 姚前 | Video recording method and device |
| CN106372604A (en) * | 2016-08-31 | 2017-02-01 | 北京光年无限科技有限公司 | Intelligent robot negative emotion detection method and system |
| CN206620218U (en) * | 2017-04-20 | 2017-11-07 | 深圳声联网科技有限公司 | Voice recognition monitor recording device |
-
2018
- 2018-09-29 CN CN201811149952.4A patent/CN109068109A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050201565A1 (en) * | 2004-03-15 | 2005-09-15 | Samsung Electronics Co., Ltd. | Apparatus for providing sound effects according to an image and method thereof |
| CN105718921A (en) * | 2016-02-29 | 2016-06-29 | 深圳前海勇艺达机器人有限公司 | Method capable of realizing robot intelligent emotion recording |
| CN106027936A (en) * | 2016-07-19 | 2016-10-12 | 姚前 | Video recording method and device |
| CN106372604A (en) * | 2016-08-31 | 2017-02-01 | 北京光年无限科技有限公司 | Intelligent robot negative emotion detection method and system |
| CN206620218U (en) * | 2017-04-20 | 2017-11-07 | 深圳声联网科技有限公司 | Voice recognition monitor recording device |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110460809A (en) * | 2019-07-05 | 2019-11-15 | 苏宁智能终端有限公司 | A kind of vagitus method for detecting, device and intelligent camera head apparatus |
| CN116489475A (en) * | 2019-12-31 | 2023-07-25 | 武汉星巡智能科技有限公司 | Video editing method, device, equipment and storage medium based on interesting expression |
| CN111416934A (en) * | 2020-03-16 | 2020-07-14 | 南昌航空大学 | Facial expression acquisition method and system based on functional music intervention |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109068109A (en) | A kind of real-time method and system for grasping child's mood | |
| CN102710991B (en) | Messaging device, information processing method and program | |
| US10178291B2 (en) | Obtaining information from an environment of a user of a wearable camera system | |
| Mehmood et al. | Divide-and-conquer based summarization framework for extracting affective video content | |
| CN110263613A (en) | Monitor video processing method and processing device | |
| CN110705482A (en) | Personnel behavior alarm prompt system based on video AI intelligent analysis | |
| CN104581062A (en) | Video monitoring method and system capable of realizing identity information and video linkage | |
| CN101783889A (en) | Real-time matting and video monitoring and collecting method | |
| CN205121478U (en) | Prevent near -sighted smart machine and system | |
| CN104284234B (en) | Multiple terminal rooms share the method and system of synchronous images | |
| US20180270454A1 (en) | Video monitoring method and device | |
| CN108898079A (en) | A kind of monitoring method and device, storage medium, camera terminal | |
| CN103248855A (en) | Fixed seat-based lesson recording system, video processing device and lesson recording method | |
| CN110378323A (en) | Method and apparatus for handling video | |
| CN106610997B (en) | People information processing method, apparatus and system | |
| CN204968035U (en) | Long -range hearing system | |
| CN112989950A (en) | Violent video recognition system oriented to multi-mode feature semantic correlation features | |
| CN105760807A (en) | Reminding device and reminding method for wonderful sports events | |
| CN103780808A (en) | Content acquisition apparatus and storage medium | |
| US20190008466A1 (en) | Life log utilization system, life log utilization method, and recording medium | |
| US20200285668A1 (en) | Emotional Experience Metadata on Recorded Images | |
| CN112750518A (en) | Conversation (inquiry) method based on psychological behavior characteristic recognition | |
| WO2017045068A1 (en) | Methods and apparatus for information capture and presentation | |
| CN104993986A (en) | Multimedia control system suitable for infants and special populations | |
| CN208337765U (en) | Management system on duty |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181221 |