CN101753850A - Emotive image processing device and image processing method - Google Patents

Emotive image processing device and image processing method Download PDF

Info

Publication number
CN101753850A
CN101753850A CN200810178958A CN200810178958A CN101753850A CN 101753850 A CN101753850 A CN 101753850A CN 200810178958 A CN200810178958 A CN 200810178958A CN 200810178958 A CN200810178958 A CN 200810178958A CN 101753850 A CN101753850 A CN 101753850A
Authority
CN
China
Prior art keywords
image
image data
control signal
expression
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN200810178958A
Other languages
Chinese (zh)
Other versions
CN101753850B (en
Inventor
蔡昭宗
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Altek Corp
Original Assignee
Altek Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Altek Corp filed Critical Altek Corp
Priority to CN2008101789584A priority Critical patent/CN101753850B/en
Publication of CN101753850A publication Critical patent/CN101753850A/en
Application granted granted Critical
Publication of CN101753850B publication Critical patent/CN101753850B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses an emotive image processing device and an image processing method which comprises a shutter button, an image acquisition unit, an expression data base, an expression analysis unit and an image processing unit, wherein the shutter button respectively generates a first control signal and a second control signal according to different pressed phases; the image acquisition unit is used for sensing image data while receiving the first control signal, sending out an expression analysis command and acquiring the image data while receiving the second control signal; the expression data base is used for storing expressive feature information and a corresponding image processing procedure; the expression analysis unit is used for receiving the expression analysis command to identify facial features in the image data and determine the expressive feature information corresponding to the facial features; and the image processing unit is used for executing the image processing procedure according to the determined expressive feature information to process the image data acquired by the image acquisition unit.

Description

The image processor of emotion formula and image treatment method
Technical field
The present invention is about a kind of device and method of image processing, particularly a kind of device and method of image being done the image processing of special processing.
Background technology
In multimedia environment, image has become the considerable instrument of information representation, yet the processing of the image part of capture (particularly) but is the market that belongs to highly-specialised always, common people are difficult to have an opportunity use, this mainly is because capture equipment all is quite expensive system, is not that general masses can afford.Several years up to date, because the progress of electronics, optical technology, digital image acquisition equipment (as image scanner, digital camera etc.) entered into the individualized market of low price, just is subjected to consumer and dealer's attention gradually.
Digital camera is in conjunction with the emerging product of optics, precision optical machinery and electronics technology, it utilizes Charged Coupled Device (CCD) video conversion that camera lens is obtained to become digital image signal, processing by electronic circuit is stored in digital image signal in the Storage Media, as disk sheet, discs or IC memory card.On the other hand, image also can manifest (as TV or monitor) immediately on various displays, utilizes function again with the editor that makes various images, modification etc., and is quite convenient and save time economical.
Most on the market now digital camera all can dispose LCD, and wherein LCD can be shown to photographer with what comes into a driver's in advance and watches before pick-up image, with the what comes into a driver's zone that provides photographer to select desire to take.In addition, LCD also can show various acquisition parameters to photographer's reference, for example photosensitivity, white balance, exposure compensating, photoflash lamp keying, focusing state or the like.After photographer presses the shutter shooting, also can be by seeing captured achievement on the LCD at once.For photographer, the display of digital camera provides much function easily, can make photographer obtain the best effect when taking pictures.
Yet arriving along with multimedia era, user often digit expected phase function provides more kinds of brand-new different special functions, to bring the user different pleasantly surprised and impressions, one of Consideration when wherein the IPF of digital camera is not to use the person to buy product yet.
Therefore, how to provide a kind of image processor and method, become one of researcher's problem to be solved.
Summary of the invention
In view of above problem, the invention provides a kind of image processor and image treatment method of emotion formula, emotional reactions that can be current according to the person taken picture, digital camera institute picked image data are carried out special image processing, increasing the function of present image processing, and then promote the competitive advantage of product.
The invention discloses a kind of image processor of emotion formula, include:
One shutter release button according to the difference in its stage that is pressed, produces one first control signal and one second control signal respectively;
One image acquisition unit, in order to sensing and acquisition one image data, when receiving this first control signal, this image data of sensing, and send an expression analysis instruction, and when receiving this second control signal, capture this image data;
One expression database stores a plurality of expressive features information, and the pairing a plurality of special-effect image processing programs of these expressive features information;
One expression analytic unit, receive this expression analysis instruction, with at least one face feature in this image data of this image acquisition unit institute sensing of identification, and search this expression database, to confirm these expressive features information of these face feature correspondences according to these face features; And
One image process unit according to these expressive features information that this expression analytic unit is confirmed, is carried out these special-effect image processing programs, to handle this image data that this image acquisition unit is captured.
This stage of being pressed include to shutter release button half that should first control signal by state and to shutter release button that should second control signal entirely by state.
These special-effect image processing program packages contain adjusts tone, additional frame or collocation music.
The image processor of described emotion formula includes:
One memory cell is in order to store this image data that this image acquisition unit captures; And
One display unit is in order to show this image data after this image process unit is handled.
The invention also discloses a kind of image treatment method of emotion formula, include the following step:
One image processor is provided, and it comprises an at least one shutter release button and an image acquisition unit;
Partly push this shutter release button producing one first control signal, and when producing this first control signal, by this image acquisition unit sensing one image data;
One expression analytic unit is provided in this image processor, and its this image data to this image acquisition unit institute sensing carries out an expression routine analyzer, to obtain at least one face feature;
Provide an expression database to give this expression analytic unit, make this expression analytic unit according to these face features in this expression database lookup and then confirm at least one expressive features information of these face feature correspondences;
Determine at least one special-effect image processing program according to these expressive features information;
One image process unit is provided, and it is to carry out these special-effect image processing programs, to handle this image data that this image acquisition unit is captured; And
Further push this shutter release button entirely when producing one second control signal, this image data after output is handled in this shutter release button.
These expressive features packets of information contain smiling face, anger, sobbing, reach scaring.
These special-effect image processing program packages contain adjusts tone, additional frame or collocation music.
Utilize the image processor and the image treatment method of this emotion formula, owing to people's countenance (particularly eyes and face) can be along with emotional reactions change, therefore the shape of eyes and the face by the identification person taken picture, can tell the current emotional reactions of person taken picture, and then the control figure camera carries out special image processing to institute's picked image data, use the function that increases present image processing, and then promote the competitive advantage of product.
Description of drawings
Fig. 1 is the system block diagrams of the image processor of emotion formula of the present invention;
Fig. 2 is the schematic diagram of concordance list of the present invention;
Fig. 3 is the flow chart of steps of the image treatment method of emotion formula of the present invention.
Wherein, Reference numeral:
10 shutter release buttons, 20 image acquisition units
30 expression databases, 31 concordance lists
40 expression analytic units, 50 image process units
60 memory cell, 70 display units
The image processor of 100 emotion formulas
Embodiment
The image processor of emotion formula disclosed according to the present invention, can be applicable on image input equipments such as digital camera, network camera, and can be built in mobile computer, PDA, digital frame, mobile phone etc. and have in the electronic installation of operation-interface, so that being provided, the user operates relevant function.Yet accompanying drawing only provides reference and explanation usefulness, is not in order to restriction the present invention.
Please refer to Fig. 1, be the system block diagrams of the image processor of emotion formula of the present invention.As shown in Figure 1, the image processor 100 of emotion formula of the present invention includes shutter release button 10, image acquisition unit 20, expression database 30, expression analytic unit 40, image process unit 50, memory cell 60 and display unit 70.
Shutter release button 10 can be made of switch module (not shown) and switching circuit.Shutter release button 10 according to its distinguished by the difference in user's the stage of pushing to have half by with entirely by state, and produce first control signal and second control signal respectively.Wherein half press state, and the state of pressing entirely is corresponding to second control signal corresponding to first control signal.For instance, when taking pictures, when the person of taking pictures presses shutter release button 10, be to carry out expression routine analyzer of the present invention and focusing automatically partly, and be to take pictures by state entirely by state.
Image acquisition unit 20 is connected with shutter release button 10.Image acquisition unit 20 is in order to sensing image, and the pick-up image data.Image acquisition unit 20 when receiving first control signal, the sensing image data, and send one the expression analysis instruction.Image acquisition unit 20 when receiving second control signal, pick-up image data then, and image data is stored in the memory cell 60.Wherein image acquisition unit 20 can for example be (as CCD by the optical lens module of digital camera, photoelectricity sensing module; Charge-CoupledDevice or CMOS; Complementary Metal-Oxide Semiconductor) with digital imagery application of logic circuit module (ASIC; Application Specific Integrated Circuit) constitutes.
Expression database 30 stores a plurality of expressive features information, and the pairing a plurality of special-effect image processing programs of each expressive features information.Wherein special-effect image processing program can include adjustment tone, additional frame and collocation music.Each expressive features information in the expression database 30 and the corresponding relation of a plurality of special-effect image processing programs can for example be to realize with concordance list.
Please refer to Fig. 2, be the schematic diagram of concordance list of the present invention.As shown in Figure 2, record expressions such as smiling face, anger, sobbing and scaring in the concordance list 31, and default respectively its corresponding special-effect image processing program is: (1) red color tone+3; Green hue+2; Blue cast+1; (2) red color tone+1; Green hue+3; Blue cast+2; (3) red color tone+1; Green hue+2; Blue cast+3; (4) red color tone+3; Green hue+1; Blue cast+0; Additional frame.In addition, the user also can adjust the setup parameter of concordance list 31 voluntarily.
Expression analytic unit 40 is connected with image acquisition unit 20, expression database 30 respectively.Expression analytic unit 40 is in order to receiving the expression analysis instruction, with at least one face feature in the image data of 20 sensings of identification image acquisition unit (for example, a people or a plurality of people's eyes, and face).If wherein a plurality of people's emotional reactions are not simultaneously, then can most identical emotional reactions decisions carry out which kind of special-effect image processing program, perhaps, can also the identical emotional reactions decision of minority carry out which kind of special-effect image processing program.
The identification of face feature can realize by people's face detection algorithm, described people's face detection algorithm has comprised the acquisition of image processing technique and characteristic value, and wherein image processing technique has comprised area dividing (RegionDivision), Fuzzy Processing (Blur), rim detection (Edge Detection) and approaches (EdgeApproximation) with the edge.The target of characteristic value acquisition has comprised the characteristic value of eyes, wherein the characteristic value of eyes is to be used as the position of eyes with the canthus coordinate, and cooperates above-mentioned image processing technique to determine the position of eyes in the image of face, calculates the characteristic vector value again.The characteristic value of face is to be used as the position of face with the coordinate of the corners of the mouth, and cooperates above-mentioned image processing technique to determine the position of face in the image of face, calculates the characteristic vector value again.Owing to people's countenance (particularly eyes and face) can be along with emotional reactions change.Therefore, the shape of eyes and face by the identification person taken picture distinguishablely goes out the current emotional reactions of person taken picture.Expression analytic unit 40 is searched expression database 30 according to each face feature, to confirm each expressive features information of each face feature correspondence.
Image process unit 50 is connected with expression analytic unit 40.Each expressive features information that image process unit 50 is confirmed according to expression analytic unit 40, (for example carry out each special-effect image processing program, readjust the tonal scale of image data according to the setup parameter in the concordance list 31, perhaps, the adventitious sound music file is to image data, during with the image data after opening processing, play the adventitious sound music file simultaneously), to handle image acquisition unit 20 picked image data.Image process unit 50 can for example be a central processing unit.
Memory cell 60 is connected with image process unit 50.Memory cell 60 is in order to store 20 picked image data of image acquisition unit.Wherein memory cell 60 can for example be internal memory or hard disk.
Display unit 70 is connected with image process unit 50.Image data after display unit 70 is handled in order to show image processing unit 50.Wherein display unit 70 can for example be a LCD.
Please refer to Fig. 3, be the flow chart of steps of the image treatment method of emotion formula of the present invention.As shown in Figure 3, emotion formula image treatment method of the present invention includes the following step:
At first, provide an image processor, it comprises an at least one shutter release button and an image acquisition unit (step 200).Partly push shutter release button producing first control signal, and when producing first control signal, by image acquisition unit sensing one image data (step 210).First control signal is half to produce during by state corresponding to shutter release button.Wherein image acquisition unit is made of with digital imagery application of logic circuit module (ASIC) the optical lens module of digital camera, photoelectricity sensing module (CCD or CMOS).
Then, provide an expression analytic unit in image processor, its image data to image acquisition unit institute sensing carries out an expression routine analyzer, to obtain at least one face feature (step 220).The routine analyzer of wherein expressing one's feelings can utilize people's face detection algorithm to realize, and face feature includes a people or a plurality of people's eyes, and face.
Provide an expression database to give the expression analytic unit, order expression analytic unit according to each face feature in the expression database lookup and then confirm at least one expressive features information (step 230) of each face feature correspondence.The database storage of wherein expressing one's feelings has a plurality of expressive features information, and the concordance list of the pairing a plurality of special-effect image processing programs of each expressive features information.
Determine at least one special-effect image processing program (step 240) according to each expressive features information, wherein the expressive features packets of information contains expressions such as smiling face, anger, sobbing and scaring, and special-effect image processing program package contains adjustment tone, additional frame or collocation music, for example, readjust the tonal scale of image data according to the setup parameter in the concordance list, perhaps, the adventitious sound music file is to image data, during with the image data after opening processing, play the adventitious sound music file simultaneously.
An image process unit is provided, and its analysis result according to the expression analytic unit is carried out each special-effect image processing program, to handle image acquisition unit institute's picked image data (step 250).Image process unit can for example be a central processing unit.
Further push shutter release button entirely when producing second control signal, the image data (step 260) after image process unit output is handled in shutter release button.Second control signal produces for entirely by state the time corresponding to shutter release button.Image process unit can export the image data after handling to memory cell and store, and exports display unit to and shows with/image data after maybe will handling.
Comprehensive the above, the image processor of emotion formula of the present invention and image treatment method, owing to people's countenance (particularly eyes and face) can be along with emotional reactions change, therefore the shape of eyes and the face by the identification person taken picture, can tell the current emotional reactions of person taken picture, and then the control figure camera carries out special image processing to institute's picked image data, increasing the function of present image processing, and then promotes the competitive advantage of product.

Claims (7)

1. plant the image processor of emotion formula, it is characterized in that, include:
One shutter release button according to the difference in its stage that is pressed, produces one first control signal and one second control signal respectively;
One image acquisition unit, in order to sensing and acquisition one image data, when receiving this first control signal, this image data of sensing, and send an expression analysis instruction, and when receiving this second control signal, capture this image data;
One expression database stores a plurality of expressive features information, and the pairing a plurality of special-effect image processing programs of these expressive features information;
One expression analytic unit, receive this expression analysis instruction, with at least one face feature in this image data of this image acquisition unit institute sensing of identification, and search this expression database, to confirm these expressive features information of these face feature correspondences according to these face features; And
One image process unit according to these expressive features information that this expression analytic unit is confirmed, is carried out these special-effect image processing programs, to handle this image data that this image acquisition unit is captured.
2. the image processor of emotion formula as claimed in claim 1 is characterized in that, this stage of being pressed include to shutter release button half that should first control signal by state and to shutter release button that should second control signal entirely by state.
3. the image processor of emotion formula as claimed in claim 1 is characterized in that, these special-effect image processing program packages contain adjusts tone, additional frame or collocation music.
4. the image processor of emotion formula as claimed in claim 1 is characterized in that, includes:
One memory cell is in order to store this image data that this image acquisition unit captures; And
One display unit is in order to show this image data after this image process unit is handled.
5. the image treatment method of an emotion formula is characterized in that, includes the following step:
One image processor is provided, and it comprises an at least one shutter release button and an image acquisition unit;
Partly push this shutter release button producing one first control signal, and when producing this first control signal, by this image acquisition unit sensing one image data;
One expression analytic unit is provided in this image processor, and its this image data to this image acquisition unit institute sensing carries out an expression routine analyzer, to obtain at least one face feature;
Provide an expression database to give this expression analytic unit, make this expression analytic unit according to these face features in this expression database lookup and then confirm at least one expressive features information of these face feature correspondences;
Determine at least one special-effect image processing program according to these expressive features information;
One image process unit is provided, and it is to carry out these special-effect image processing programs, to handle this image data that this image acquisition unit is captured; And
Further push this shutter release button entirely when producing one second control signal, this image data after output is handled in this shutter release button.
6. the image treatment method of emotion formula as claimed in claim 5 is characterized in that, these expressive features packets of information contain smiling face, anger, sobbing, reach scaring.
7. the image treatment method of emotion formula as claimed in claim 5 is characterized in that, these special-effect image processing program packages contain adjusts tone, additional frame or collocation music.
CN2008101789584A 2008-12-03 2008-12-03 Emotive image processing device and image processing method Expired - Fee Related CN101753850B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2008101789584A CN101753850B (en) 2008-12-03 2008-12-03 Emotive image processing device and image processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2008101789584A CN101753850B (en) 2008-12-03 2008-12-03 Emotive image processing device and image processing method

Publications (2)

Publication Number Publication Date
CN101753850A true CN101753850A (en) 2010-06-23
CN101753850B CN101753850B (en) 2011-06-15

Family

ID=42480151

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2008101789584A Expired - Fee Related CN101753850B (en) 2008-12-03 2008-12-03 Emotive image processing device and image processing method

Country Status (1)

Country Link
CN (1) CN101753850B (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103763476A (en) * 2014-02-20 2014-04-30 北京百纳威尔科技有限公司 Shooting parameter setting method and device
CN105744145A (en) * 2014-12-22 2016-07-06 卡西欧计算机株式会社 Image creation method and image creation apparatus
CN105791946A (en) * 2016-03-15 2016-07-20 腾讯科技（深圳）有限公司 Image display effect adjusting method and apparatus
CN105812666A (en) * 2016-03-30 2016-07-27 上海斐讯数据通信技术有限公司 Shooting method of intelligent terminal and intelligent terminal
CN106023067A (en) * 2016-05-17 2016-10-12 珠海市魅族科技有限公司 Image processing method and device
CN106133773A (en) * 2014-03-25 2016-11-16 南洋理工大学 The Computerized method rewarded for automatization client and system
CN107308637A (en) * 2016-04-27 2017-11-03 宝凯电子企业股份有限公司 Game machine with image data judging function
CN108540716A (en) * 2018-03-29 2018-09-14 广东欧珀移动通信有限公司 Image processing method, device, electronic equipment and computer readable storage medium
CN108537749A (en) * 2018-03-29 2018-09-14 广东欧珀移动通信有限公司 Image processing method, device, mobile terminal and computer readable storage medium
CN109192079A (en) * 2018-10-09 2019-01-11 解宝龙 A kind of starry sky multimedia information display system and method
WO2019037217A1 (en) * 2017-08-25 2019-02-28 歌尔科技有限公司 Camera assembly and social networking system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006115406A (en) * 2004-10-18 2006-04-27 Omron Corp Imaging apparatus
CN1885307A (en) * 2005-06-20 2006-12-27 英华达(上海)电子有限公司 Recognition and processing combined method for human face region in digital photographic image

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103763476A (en) * 2014-02-20 2014-04-30 北京百纳威尔科技有限公司 Shooting parameter setting method and device
CN106133773A (en) * 2014-03-25 2016-11-16 南洋理工大学 The Computerized method rewarded for automatization client and system
CN105744145A (en) * 2014-12-22 2016-07-06 卡西欧计算机株式会社 Image creation method and image creation apparatus
CN105791946A (en) * 2016-03-15 2016-07-20 腾讯科技（深圳）有限公司 Image display effect adjusting method and apparatus
CN105812666A (en) * 2016-03-30 2016-07-27 上海斐讯数据通信技术有限公司 Shooting method of intelligent terminal and intelligent terminal
CN107308637A (en) * 2016-04-27 2017-11-03 宝凯电子企业股份有限公司 Game machine with image data judging function
CN106023067A (en) * 2016-05-17 2016-10-12 珠海市魅族科技有限公司 Image processing method and device
WO2019037217A1 (en) * 2017-08-25 2019-02-28 歌尔科技有限公司 Camera assembly and social networking system
CN108540716A (en) * 2018-03-29 2018-09-14 广东欧珀移动通信有限公司 Image processing method, device, electronic equipment and computer readable storage medium
CN108537749A (en) * 2018-03-29 2018-09-14 广东欧珀移动通信有限公司 Image processing method, device, mobile terminal and computer readable storage medium
CN109192079A (en) * 2018-10-09 2019-01-11 解宝龙 A kind of starry sky multimedia information display system and method

Also Published As

Publication number Publication date
CN101753850B (en) 2011-06-15

Similar Documents

Publication Publication Date Title
CN101753850B (en) Emotive image processing device and image processing method
CN103971090B (en) Image processing apparatus, image capture apparatus and image processing method
CN101621628B (en) Photographic apparatus, setting method of photography conditions, and recording medium
CN101325658B (en) Imaging device, imaging method and computer program
CN101605208B (en) Image processing apparatus, imaging apparatus, image processing method
CN101600054B (en) Camera, and camera control method
JP5313037B2 (en) Electronic camera, image processing apparatus, and image processing method
US10171803B2 (en) Image capturing apparatus, calibration method, and non-transitory computer-readable medium for calculating parameter for a point image restoration process
CN105704369B (en) A kind of information processing method and device, electronic equipment
US8582891B2 (en) Method and apparatus for guiding user with suitable composition, and digital photographing apparatus
US8760551B2 (en) Systems and methods for image capturing based on user interest
US20150201143A1 (en) Image-processing device and method, and image pickup device
CN101378458A (en) Digital photographing apparatus and method using face recognition function
CN101310519A (en) Imaging device, display control method, and program
CN101188677A (en) Imaging apparatus, image processing apparatus, image processing method and computer program for execute the method
US20100123804A1 (en) Emotion-based image processing apparatus and image processing method
CN1812478B (en) Image pickup apparatus and control method of the apparatus
CN110213502A (en) Image processing method, device, storage medium and electronic equipment
CN106134189A (en) Image processing apparatus, camera head, image processing method and program
WO2021066565A1 (en) Image processing method and electronic device supporting the same
CN104349047A (en) Image photographing apparatus and photographing method thereof
CN101945220A (en) Special effect processing method of digital image
JP5374231B2 (en) Imaging device
JP2009290819A (en) Photographing device, photography control program, and image reproducing device and image reproducing program
JP5808056B2 (en) Imaging apparatus, imaging control program, image reproduction apparatus, and image reproduction control program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20110615

Termination date: 20141203

EXPY Termination of patent right or utility model