CN103019369A - Electronic device and method for playing documents based on facial expressions - Google Patents
Electronic device and method for playing documents based on facial expressions Download PDFInfo
- Publication number
- CN103019369A CN103019369A CN2011102856925A CN201110285692A CN103019369A CN 103019369 A CN103019369 A CN 103019369A CN 2011102856925 A CN2011102856925 A CN 2011102856925A CN 201110285692 A CN201110285692 A CN 201110285692A CN 103019369 A CN103019369 A CN 103019369A
- Authority
- CN
- China
- Prior art keywords
- document
- countenance
- image
- face
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides an electronic device and an electronic method for playing documents based on facial expressions of a user. The electronic device comprises a camera unit and a memory unit, wherein at least one facial expression and document setting information corresponding to the facial expression are stored in the memory unit. The electronic device further comprises a camera control module, an image judging module, a facial expression recognizing module, a document acquisition module and a document playing module, wherein a preset number of images of a front face are continuously shot by the camera unit under the control of the camera control module in response to the starting operation of the user; one clear facial image is chosen from the preset number of shot facial images by the image judging module; the facial expression of the clear facial image is recognized by the facial expression recognizing module; whether the document setting information corresponding to the facial expression exists in the memory unit or not is recognized by the document acquisition module, and when the document setting information exists, a document corresponding to the document setting information corresponding to the facial expression is acquired by the document acquisition module; and the acquired document is played by the document playing module. With the electronic device provided by the invention, certain interaction is built between the electronic device and the facial expression of the user.
Description
Technical field
The present invention relates to a kind of electronic installation and method of playing document based on countenance.
Background technology
Existing electronic installation such as panel computer, mobile phone etc., all is that the input command that receives the user starts corresponding program or operates accordingly.Yet above-mentioned this input command according to the user is opened corresponding its demonstration result who produces of program and all can be predicted, and has therefore just caused these electronic installations to use relatively more dull and dull.
Summary of the invention
Fundamental purpose of the present invention is to provide a kind of electronic installation and method of playing document based on countenance, and it is play according to the random generation broadcast document of user's countenance, substitutes existing electronic installation with this and uses dull and dull problem.
The invention provides a kind of electronic installation of playing document based on user's countenance, this electronic installation comprises that one takes unit and a storage unit, this is taken the unit and is used for filmed image, store document setup information corresponding at least one countenance and each countenance in this storage unit, this electronic installation also includes: the control module of taking pictures, be used for response user's start operation, the image of face that continuous shooting the place ahead one predetermined quantity in unit is opened is taken in control; One image judge module is used for opening the true image of face clearly of image of face from this predetermined quantity of taking; One Expression Recognition module is used for identifying this clearly countenance of image of face; One document acquisition module is used for recognition memory cell and whether has document setup information corresponding to this countenance, when existing, obtains document corresponding to document setup information corresponding to this countenance; And a document playing module, be used for playing accessed document.
The present invention also provides a kind of electronic installation to play the method for document based on user's countenance, this electronic installation comprises that one takes unit and a storage unit, this is taken the unit and is used for filmed image, store document setup information corresponding at least one countenance and each countenance in this storage unit, the method may further comprise the steps: response user's start operation, and the image of face that continuous shooting the place ahead one predetermined quantity in unit is opened is taken in control; Open from this predetermined quantity of taking and to obtain a clearly image of face the image of face; Identify this clearly countenance of image of face; Whether have one or more Doctypes corresponding to this countenance in the recognition memory cell, when existing, obtain document corresponding to document setup information corresponding to this countenance; And accessed document corresponding to document setup information of broadcast.
Electronic installation and the method for playing document based on user's countenance of the present invention, user's countenance selects corresponding document to play automatically during by recognition start-up, thereby so that produce certain interaction between electronic installation and the user, avoid dull and dull under the prior art.
Description of drawings
Fig. 1 is a kind of hardware structure diagram of playing the electronic installation of document based on countenance.
Fig. 2 is a kind of electronic installation is play document based on countenance method schematic diagram.
The main element symbol description
| |
1 |
| |
10 |
| Take the |
30 |
| |
20 |
| The control module of taking pictures | 101 |
| The |
102 |
| The |
103 |
| The |
104 |
| The |
105 |
| |
106 |
| |
107 |
| The |
108 |
| |
40 |
Following embodiment further specifies the present invention in connection with above-mentioned accompanying drawing.
Embodiment
Fig. 1 is a kind of hardware structure diagram of playing the electronic installation 1 of document based on user's countenance.This electronic installation 1 comprises a processing unit 10, shooting unit 30 and a storage unit 20.This is taken unit 30 and is used for filmed image.Store document setup information corresponding at least one countenance and each countenance in this storage unit 20.In the present embodiment, the document configuration information can be the type of one or more documents, also can be one or more particular document.The document can be song, picture, video etc.The type of this song can include allusion, jazz, rural area etc.The type of this picture can include landscape, beauty, name car etc.The type of this video can include humour, funny, cheerful and light-hearted etc.
This processing unit 10 comprises the control module 101 of taking pictures, an image judge module 102, an Expression Recognition module 103, a document acquisition module 104 and a document playing module 105.
This control module 101 of taking pictures is used for control and takes the image of face that unit 30 continuous shooting the place ahead one predetermined quantities are opened.In the present embodiment, this shooting unit 30 is a camera.
This image judge module 102 is used for opening image of face from this predetermined quantity of taking and obtains a clearly image of face.In the present embodiment, this image judge module 102 is for judging its sharpness according to the profile of face in each image of face, and when the face mask of an image of face was complete, then definite this image of face was clearly.
This Expression Recognition module 103 is used for identifying this clearly countenance of image of face.In the present embodiment, this Expression Recognition module 103 by analyze this clearly the face feature of image of face identify current countenance.In other embodiments, this Expression Recognition module 103 also can be utilized other the current countenance of technology identification.Wherein, countenance comprise happily, depressed, dejected, angry, sad etc.
The document acquisition module 104 is used for recognition memory cell 20 and whether has document setup information corresponding to this countenance, if exist, then obtains document corresponding to document setup information corresponding to this countenance.In the present embodiment, the document acquisition module 104 is for obtaining document corresponding to document setup information corresponding to this countenance, be specially in the present invention the document that obtains under one or more Doctypes, or for obtaining one or more particular document corresponding to this countenance.
The document playing module 105 is used for playing accessed document.For example, the active user feels blue, the image of face that unit 30 continuous shooting the place ahead one predetermined quantities are opened is taken in these control module 101 controls of taking pictures, this image judge module 102 is opened obtain the user that claps the image of face one clearly image of face from this predetermined quantity of taking, the countenance that this Expression Recognition module 103 identifies current image of face is indignation, the document acquisition module 104 obtains the type of the one or more documents corresponding with the indignation expression automatically from storage unit 20, the document is song and picture, the type of this song is light music, the type of this picture is wild beauty, then document playing module 105 is selected a song and is selected picture to play from the wild beauty picture from light music, thus the user's that releives pressure.
Further, when document acquisition module 104 identifies this countenance in storage unit 20 during without corresponding Doctype, this control module 101 of taking pictures also is used for control and takes the unit is taken the user again after 30 1 schedule times image of face.
Further, this processing unit 10 also comprises resets module 106, and this resets countenance and corresponding document setup information thereof that module 106 is used for resetting according to user's input storage unit 20.
Further, this electronic installation 1 also comprises a flashlamp 40, this processing unit 10 also comprises a detecting module 107 and a light control module 108, this detecting module 107 was used for before shooting unit 30 carries out filming image, the light that detecting is extraneous, this light control module 108 is used for judging whether the extraneous light of detecting module 107 detectings is sufficient, and this control module 101 of taking pictures also is used for starting flashlamp 40 when extraneous insufficient light.
Fig. 2 is a kind of electronic installation 1 is play document based on countenance method schematic diagram.
These control module 101 response users' that take pictures start operation (step S601).
Whether the extraneous light of this detecting module 107 detectings not enough (step S602).
When extraneous insufficient light, open flashlamp (step S603).
When the external world was bright and clear, the image of face (step S604) that unit 30 continuous shooting the place ahead one predetermined quantities are opened was taken in these control module 101 controls of taking pictures.
This image judge module 102 is opened from the predetermined quantity of taking and is obtained a clearly image of face (step S605) the image of face.
This Expression Recognition module 103 is identified this clearly countenance of image of face (step S606).
Whether the document acquisition module 104 these countenances of identification exist corresponding document setup information (step S607) in storage unit 20.
When there is not corresponding document setup information in this countenance in storage unit 20, return step S604.
When there was corresponding document setup information in this countenance in storage unit 20, the document playing module 105 was play corresponding document under document setup information corresponding to this countenance.(step S608).
Claims (16)
1. electronic installation of playing document based on user's countenance, this electronic installation comprises that one takes unit and a storage unit, this is taken the unit and is used for filmed image, store document setup information corresponding at least one countenance and each countenance in this storage unit, it is characterized in that: this electronic installation also includes:
One control module of taking pictures is used for response user's start operation, and the image of face that continuous shooting the place ahead one predetermined quantity in unit is opened is taken in control;
One image judge module is used for opening the true image of face clearly of image of face from this predetermined quantity of taking;
One Expression Recognition module is used for identifying this clearly countenance of image of face;
One document acquisition module is used for recognition memory cell and whether has document setup information corresponding to this countenance, when existing, obtains document corresponding to document setup information corresponding to this countenance; And
One document playing module is used for playing accessed document.
2. the electronic installation of playing document based on user's countenance as claimed in claim 1, it is characterized in that, this clear image of face deterministic process is: this image judge module is judged its sharpness according to the profile of face in each image of face, and when the face mask of an image of face is complete, determine that this image of face is clearly.
3. the electronic installation of playing document based on user's countenance as claimed in claim 1, it is characterized in that: the document is song, picture, video or wherein any one combination.
4. the electronic installation of playing document based on user's countenance as claimed in claim 1, it is characterized in that: the document configuration information is for one or more Doctypes or is one or more particular document, the document acquisition module is for obtaining the document under one or more Doctypes corresponding to this countenance, or for obtaining one or more particular document corresponding to this countenance.
5. the electronic installation of playing document based on user's countenance as claimed in claim 1, it is characterized in that: when the countenance that recognizes in storage unit during without corresponding Doctype, this control module of taking pictures also is used for control and takes the unit is taken the user again after one schedule time image of face.
6. the electronic installation of playing document based on user's countenance as claimed in claim 1, it is characterized in that: this electronic installation also comprises resets module, and this resets countenance and corresponding document setup information thereof that module is used for resetting according to user's input storage unit.
7. the electronic installation of playing document based on user's countenance as claimed in claim 1 is characterized in that: this Expression Recognition module is to identify current countenance for analyzing clearly the face feature of image of face.
8. the electronic installation of playing document based on user's countenance as claimed in claim 1, it is characterized in that: go back electronic installation and also comprise a flashlamp, a detecting module and a light control module, this detecting module was used for before the shooting unit carries out filming image, the light that detecting is extraneous, this light control module is used for judging whether the extraneous light of detecting module detecting is sufficient, this control module of taking pictures also is used for starting flashlamp when extraneous insufficient light.
9. an electronic installation is play the method for document based on user's countenance, this electronic installation comprises that one takes unit and a storage unit, this is taken the unit and is used for filmed image, store document setup information corresponding at least one countenance and each countenance in this storage unit, it is characterized in that: the method may further comprise the steps:
Response user's start operation, the image of face that continuous shooting the place ahead one predetermined quantity in unit is opened is taken in control;
Open from this predetermined quantity of taking and to obtain a clearly image of face the image of face;
Identify this clearly countenance of image of face;
Whether have one or more Doctypes corresponding to this countenance in the recognition memory cell, when existing, obtain document corresponding to document setup information corresponding to this countenance; And
Play accessed document corresponding to document setup information.
10. method as claimed in claim 9, it is characterized in that: should from this predetermined quantity of taking open judge the image of face the user that claps clearly an image of face step be specially: the profile according to face in each image of face is judged its sharpness, and when the face mask of an image of face is complete, determine that this image of face is clearly.
11. method as claimed in claim 9 is characterized in that: the document is song, picture, video or wherein any one combination.
12. method as claimed in claim 9 is characterized in that: also comprise step:
When the countenance that recognizes in storage unit during without corresponding Doctype, the unit is taken the user again after one schedule time image of face is taken in control.
13. method as claimed in claim 9 is characterized in that: also comprise step:
Reset countenance and corresponding document setup information thereof in the storage unit according to user's input.
14. method as claimed in claim 9 is characterized in that: this identifies clearly that the countenance step of image of face is specially: analyze clearly the face feature of image of face and identify current countenance.
15. method as claimed in claim 9 is characterized in that: the method also comprises step:
The extraneous light of detecting before filmed image; And
When the insufficient light in the external world, start flashlamp.
16. method as claimed in claim 9, it is characterized in that: the document configuration information is for one or more Doctypes or is one or more particular document, this step of obtaining document corresponding to document setup information corresponding to countenance is specially: obtain the document under one or more Doctypes corresponding to this countenance, or for obtaining one or more particular document corresponding to this countenance.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011102856925A CN103019369A (en) | 2011-09-23 | 2011-09-23 | Electronic device and method for playing documents based on facial expressions |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011102856925A CN103019369A (en) | 2011-09-23 | 2011-09-23 | Electronic device and method for playing documents based on facial expressions |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103019369A true CN103019369A (en) | 2013-04-03 |
Family
ID=47968054
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011102856925A Pending CN103019369A (en) | 2011-09-23 | 2011-09-23 | Electronic device and method for playing documents based on facial expressions |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103019369A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103826160A (en) * | 2014-01-09 | 2014-05-28 | 广州三星通信技术研究有限公司 | Method and device for obtaining video information, and method and device for playing video |
| CN103824059A (en) * | 2014-02-28 | 2014-05-28 | 东南大学 | Facial expression recognition method based on video image sequence |
| CN104077043A (en) * | 2013-08-09 | 2014-10-01 | 苏州天鸣信息科技有限公司 | Image recognition running device and method thereof |
| CN104899251A (en) * | 2015-05-08 | 2015-09-09 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN106503630A (en) * | 2016-10-08 | 2017-03-15 | 广东小天才科技有限公司 | A kind of expression sending method, equipment and system |
| CN107317927A (en) * | 2017-06-22 | 2017-11-03 | 深圳市沃特沃德股份有限公司 | With the method and intelligent terminal of user interaction |
| CN111782052A (en) * | 2020-07-13 | 2020-10-16 | 湖北亿咖通科技有限公司 | Man-machine interaction method in vehicle |
| CN111835984A (en) * | 2020-07-24 | 2020-10-27 | 中国平安人寿保险股份有限公司 | Intelligent light supplementing method and device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201289739Y (en) * | 2008-11-18 | 2009-08-12 | 天津三星电子有限公司 | Remote control video player capable of automatically recognizing expression |
| TW200935865A (en) * | 2008-02-12 | 2009-08-16 | Wistron Corp | Mobile phone and method for controlling the same |
| CN101593465A (en) * | 2009-07-06 | 2009-12-02 | 北京派瑞根科技开发有限公司 | Electronics with expression shape change is drawn |
| CN101674363A (en) * | 2009-09-23 | 2010-03-17 | 中兴通讯股份有限公司 | Mobile equipment and talking method |
| US20100149365A1 (en) * | 2008-12-12 | 2010-06-17 | Casio Computer Co., Ltd. | Image capturing apparatus, face area detecting method and program recording medium |
| CN101836219A (en) * | 2007-11-01 | 2010-09-15 | 索尼爱立信移动通讯有限公司 | Generating music playlist based on facial expression |
| TWM402934U (en) * | 2010-11-29 | 2011-05-01 | Oriental Inst Tech | Electric monitor and image processing unit thereof |
-
2011
- 2011-09-23 CN CN2011102856925A patent/CN103019369A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101836219A (en) * | 2007-11-01 | 2010-09-15 | 索尼爱立信移动通讯有限公司 | Generating music playlist based on facial expression |
| TW200935865A (en) * | 2008-02-12 | 2009-08-16 | Wistron Corp | Mobile phone and method for controlling the same |
| CN201289739Y (en) * | 2008-11-18 | 2009-08-12 | 天津三星电子有限公司 | Remote control video player capable of automatically recognizing expression |
| US20100149365A1 (en) * | 2008-12-12 | 2010-06-17 | Casio Computer Co., Ltd. | Image capturing apparatus, face area detecting method and program recording medium |
| CN101593465A (en) * | 2009-07-06 | 2009-12-02 | 北京派瑞根科技开发有限公司 | Electronics with expression shape change is drawn |
| CN101674363A (en) * | 2009-09-23 | 2010-03-17 | 中兴通讯股份有限公司 | Mobile equipment and talking method |
| TWM402934U (en) * | 2010-11-29 | 2011-05-01 | Oriental Inst Tech | Electric monitor and image processing unit thereof |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104077043A (en) * | 2013-08-09 | 2014-10-01 | 苏州天鸣信息科技有限公司 | Image recognition running device and method thereof |
| CN103826160A (en) * | 2014-01-09 | 2014-05-28 | 广州三星通信技术研究有限公司 | Method and device for obtaining video information, and method and device for playing video |
| CN103824059A (en) * | 2014-02-28 | 2014-05-28 | 东南大学 | Facial expression recognition method based on video image sequence |
| CN103824059B (en) * | 2014-02-28 | 2017-02-15 | 东南大学 | Facial expression recognition method based on video image sequence |
| CN104899251A (en) * | 2015-05-08 | 2015-09-09 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN104899251B (en) * | 2015-05-08 | 2019-04-26 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN106503630A (en) * | 2016-10-08 | 2017-03-15 | 广东小天才科技有限公司 | A kind of expression sending method, equipment and system |
| CN107317927A (en) * | 2017-06-22 | 2017-11-03 | 深圳市沃特沃德股份有限公司 | With the method and intelligent terminal of user interaction |
| CN111782052A (en) * | 2020-07-13 | 2020-10-16 | 湖北亿咖通科技有限公司 | Man-machine interaction method in vehicle |
| CN111782052B (en) * | 2020-07-13 | 2021-11-26 | 湖北亿咖通科技有限公司 | Man-machine interaction method in vehicle |
| CN111835984A (en) * | 2020-07-24 | 2020-10-27 | 中国平安人寿保险股份有限公司 | Intelligent light supplementing method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103019369A (en) | Electronic device and method for playing documents based on facial expressions | |
| CN105975560B (en) | Question searching method and device of intelligent equipment | |
| CN102946491B (en) | Method and system for automatically adjusting wallpaper according to user mood | |
| CN105404863B (en) | Character features recognition methods and system | |
| CN110519636B (en) | Voice information playing method and device, computer equipment and storage medium | |
| CN107871001B (en) | Audio playing method and device, storage medium and electronic equipment | |
| CN103167230A (en) | Electronic equipment and method controlling shooting according to gestures thereof | |
| CN107702273B (en) | Air conditioner control method and device | |
| CN112653902B (en) | Speaker recognition method and device and electronic equipment | |
| CN109274999A (en) | A kind of video playing control method, device, equipment and medium | |
| CN112188267B (en) | Video playing method, device and equipment and computer storage medium | |
| CN111723746A (en) | Scene recognition model generation method, system, platform, device and medium | |
| CN113099297B (en) | Method and device for generating click video, electronic equipment and storage medium | |
| JP2021034003A (en) | Human object recognition method, apparatus, electronic device, storage medium, and program | |
| CN109101931A (en) | A kind of scene recognition method, scene Recognition device and terminal device | |
| US9706168B1 (en) | Room conferencing system with heat map annotation of documents | |
| US20230368461A1 (en) | Method and apparatus for processing action of virtual object, and storage medium | |
| CN105791661A (en) | Shooting system and method | |
| CN105528080A (en) | Method and device for controlling mobile terminal | |
| CN109034242B (en) | Grading method, device and system of image processing algorithm | |
| CN106657785A (en) | Camera operation control method and camera operation control device | |
| US11889127B2 (en) | Live video interaction method and apparatus, and computer device | |
| WO2019015411A1 (en) | Screen recording method and apparatus, and electronic device | |
| CN112887615A (en) | Shooting method and device | |
| CN103984415B (en) | A kind of information processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130403 |