CN104115160A - A method and apparatus for creating and displaying a face sketch avatar - Google Patents
A method and apparatus for creating and displaying a face sketch avatar Download PDFInfo
- Publication number
- CN104115160A CN104115160A CN201180076398.1A CN201180076398A CN104115160A CN 104115160 A CN104115160 A CN 104115160A CN 201180076398 A CN201180076398 A CN 201180076398A CN 104115160 A CN104115160 A CN 104115160A
- Authority
- CN
- China
- Prior art keywords
- face
- sketch map
- image
- feature points
- facial feature
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/157—Conference systems defining a virtual conference space and using avatars or agents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/80—2D [Two Dimensional] animation, e.g. using sprites
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
A method, apparatus and computer program product are provided for creating a face sketch avatar. The face sketch avatar may be defined by correlating a sketch of a face to a plurality of facial feature points on an image of the same face. The face sketch avatar may be modified to mimic subsequent images or video image of the face based on the changing location of the facial feature points on the subsequent images and the correlation between the face sketch avatar and the facial feature points. The face sketch avatar may be provided during a communications session so as to provide for video communications.
Description
Technical field
Example embodiment of the present invention mainly relates to video communication and relates more specifically to a kind ofly for creating and show method, device and the computer program of face's sketch map incarnation, and this face sketch map incarnation is imitated the individual movement that participates in video communication.
Background technology
Real-time video communication verified improve alternatively only by voice communication in many ways between communication time useful.Video conference allows take over party to see countenance and body language, therefore allow them to infer extra senses and feel to devote in dialogue.
Although this communication means is useful, many communication facilitiess are not for providing the required framework of real-time video meeting with efficient way.The user of mobile device specifically may be without enough bandwidth to support video conference, and the mobile device with enough bandwidth only has other application of sacrifice could support video conference.Or they can provide the weakened low quality video of benefit that makes video conference.In addition, without abundant bandwidth with support video conference mobile device user simply their data of rationing use and the massive band width of not wishing to use video conference generally to need.Similarly, the video conference on mobile device will consume battery, therefore may shorten dialogue or reduce the service time between charging.
Except the resource consumption of restriction video conference practicality, some users can also feel that video conference invades their privacy.For example user may not want that the position of revealing to the opposing party or user have them and do not want the concrete physical features by TV conference shared at them.In these cases, video conference can provide than the more information of the information of hope, and user can preference retain certain level of anonymity in communication period.
Summary of the invention
Therefore provide a kind of for creating and show method, device and the computer program of face's sketch map incarnation that the communication period with the opposing party is utilized.By using face's sketch map incarnation, user can reduce bandwidth that all videos meeting needs and maintain level of anonymity providing in the communication session of more inputs of voice communication only.
In one embodiment, provide a kind of for creating the method for face's sketch map incarnation of the crucial facial feature points association on can the first image of Yu face.Drop on diacritical point in the facial feature points He face on natural curve can be on the first image of face identified and can be used for following the tracks of movement and the countenance of face in successive image.The method also can comprise the sketch map that receives face.In one embodiment, user can provide Freehandhand-drawing sketch map on user's face.The method of an embodiment comprises that reception defines the input of the sketch map of face, then slightly changes sketch map to gather sketch map to aim at facial feature points.Alternatively, in another embodiment, the method can comprise the sketch map that creates face based on facial feature points.No matter sketch map is provided or manufactured from facial feature points by user, once sketch map is aimed at facial feature points, is based upon the correlativity between face's sketch map and the facial feature points on the first image to create face's sketch map incarnation.In addition, the method of an embodiment comprises the second image that receives same face, and on the second image, be identified at least one subset of the same face unique point identifying on the first image, and the correlativity of the facial feature points on the facial feature points based on the second image and face's sketch map incarnation and original image is revised face's sketch map incarnation.Therefore, can change face's sketch map incarnation with facial feature points the reposition on image aim at.Thereby this method allows to repeat this process alternative in the video conference of communication period is provided, because take over party can check that the opposing party's the incarnation that dialogue changes that runs through moves and countenance to imitate the opposing party's head.It is a kind of for receiving alternatively the image of face and making image wait shown method in the sketch map of face to be supplied that another embodiment provides.This embodiment can be configured to need one or two users to permit before showing image.
In another embodiment, a kind of device is provided, this device comprise at least one processor with comprising at least one storer of computer program code at least one storer and computer program code be configured to a plurality of facial feature points on the first image to processor together Shi Gai device identification face, receive the sketch map of face and make sketch map with the first image on facial feature points relevant so that establishment face sketch map incarnation.At least one storer also can be configured to make this device to provide variable face incarnation sketch map so that imitation the opposing party's head moves and countenance in the communication period with the opposing party together with processor with computer program code.
In another embodiment, provide a kind of computer program that comprises at least one non-transient computer-readable recording medium, at least one non-transient computer-readable recording medium has the computer executable program code instruction of storage therein.Computer executable program code instruction comprises for identifying a plurality of facial feature points on the first image of face, receiving the sketch map of face and make sketch map relevant so that the code instructions of establishment face sketch map incarnation with the facial feature points on the first image.Computer executable program code instruction also can provide variable face incarnation sketch map and move and countenance to imitate the opposing party's head in the communication period with the opposing party.
In more another embodiment, a kind of device is provided, this device comprise device for identifying a plurality of facial feature points on the first image of face, for receive face sketch map device and for making sketch map relevant to create the device of face's sketch map incarnation to the facial feature points on the first image.Another embodiment provides a kind of and comprises that for the communication period with the opposing party, changing face's sketch map incarnation along with the image modification of face moves the device with countenance to imitate the opposing party's head.
Accompanying drawing explanation
By general word, describe some example embodiment of the present invention like this, below with reference to the accompanying drawings, accompanying drawing may not be drawn in proportion, and in the accompanying drawings:
Fig. 1 is the schematically illustrating via the system of a plurality of mobile terminals of network service that comprise that can support example embodiment of the present invention;
Fig. 2 can be specialized and can be configured to implement by mobile terminal the block diagram of the device of example embodiment of the present invention;
Fig. 3 is the process flow diagram that illustrates the operation of carrying out according to one embodiment of present invention;
The sign of Fig. 4 diagram a plurality of facial feature points according to one example embodiment;
The sketch map of the face on Fig. 5 diagram image that overlays on face according to one example embodiment;
Face's sketch map incarnation that Fig. 6 diagram creates according to one example embodiment; And
Fig. 7 illustrates face's sketch map incarnation that example according to an embodiment of the invention creates, and this face's sketch map incarnation change of the image based on face changes with respect to face's sketch map incarnation of Fig. 6.
Embodiment
Now below with reference to more of the present invention shown in it, but be not that the accompanying drawing of all embodiment is described some embodiments of the present invention more completely.In fact, various embodiment of the present invention can should not be construed as limited to many multi-form realizations the embodiment setting forth here; In fact, provide these embodiment to make present disclosure to meet suitable legal requiremnt.The full piece of writing of similar label refers to similar key element.As used herein, term " data ", " content ", " information " and similar term can be used to refer to interchangeably for the data that can transmit according to embodiments of the invention, receive and/or store.Therefore, use any such term should not be considered as limiting Spirit Essence and the scope of embodiments of the invention.
In addition, as used herein, term ' circuit arrangement ' refers to (a) only circuit realization (for example realization in analogue means and/or digital means) of hardware; (b) combination of circuit and computer program, this computer program comprises software and/or the firmware instructions of storing on one or more computer-readable memory, and these circuit are worked so that install execution one or more function described herein together with computer program; And (c) following circuit, as the part such as microprocessor or microprocessor, even if software or firmware do not exist physically, these circuit still need this software or firmware for operation.This definition of ' circuit arrangement ' is applicable to here, is included in all uses to this term in any claim.As another example, as used herein, term ' circuit arrangement ' also comprises following realization, and this realization comprises one or more processor and/or its (one or more) part and bundled software and/or firmware.As another example, term ' circuit arrangement ' also for example comprises as used herein for the base band integrated circuit of mobile phone or application processor integrated circuit or at the similar integrated circuit of server, cellular network device, other network equipment and/or other computing equipment.
As defined here, " computer-readable recording medium " that refer to physical storage medium (for example volatibility or non-volatile memory devices) can be different from " the computer-readable transmission medium " that refers to electromagnetic signal.
As described below, provide a kind of for creating and show method, device and the computer program of the face's sketch map incarnation changing according to the change of the image of face.In this regard, the method of an example embodiment, device and computer program can utilize face's sketch map incarnation to move at session diagram countenance and head with the opposing party's communication period, and do not introduce the same band requirement of video conference demand.The method of an exemplary embodiment of the present invention, device and computer program also can allow than the secret of the secret increase of video conference, therefore attract to seek the user of certain level of anonymity in their communication period with the opposing party.In addition, the method for an example embodiment, device and computer program can be for pastimes, thereby allow user that their face's sketch map incarnation is shown mutually.This can especially allow tens years old person and children feel interesting but also can be subject to the liking of user at any age.
With reference to Fig. 1, this system can comprise and is configured to the subscriber equipment 10 of communicating by letter with subscriber equipment 11 by network 15, such as wireless or cable network or its any combination of any type.Alternatively, the subscriber equipment 10,11 of another embodiment direct communication and do not depend on network 15 mutually.Subscriber equipment 10 and 11 can be any equipment that can catch or receive image.For example subscriber equipment 10 can be mobile terminal and can form or comprise device 25 by installing as shown in Figure 2 25 according to the ratio of embodiments of the invention configurations as described below.Yet be to be understood that mobile terminal only illustrates the class subscriber equipment that can be benefited from embodiments of the invention, therefore should not be considered as limiting the scope of embodiments of the invention.Like this, although permitted eurypalynous mobile terminal, such as the communication system of mobile phone, mobile TV, game station, laptop computer, camera, tablet computers, wearable device, video recorder, audio/video player or aforementioned every any combination and other type can easily be used various embodiment of the present invention, comprised that other subscriber equipment of fixing (non-moving) electronic equipment also can use some example embodiment.Subscriber equipment 10 and 11 can be as described below by for example comprising that the communication network of transmitter and receiver communicates by letter with network 15.
Referring now to Fig. 2, for creating with the device 25 that shows face's sketch map incarnation, can comprise processor 20, communication interface 24, user interface 22 and memory devices 26 or communicate by letter with them.As described below and as indicated in the dotted line in Fig. 2, install 25 and also can comprise alternatively camera 28 or other image capture device in being embodied in the embodiment of subscriber equipment 10 at some embodiment, such as device 25.
In certain embodiments, processor 20 (and/or auxiliary processor 20 or otherwise coprocessor or any other treatment circuit associated with processor 20) can be communicated by letter with memory devices 26 via the bus of transmission of information between the parts at device 25.Memory devices 26 can for example comprise one or more volatibility and/or nonvolatile memory.In other words, for example memory devices 26 can be the electronic storage device (for example computer-readable recording medium) that comprises door, and these doors are configured to store machine (for example computing equipment, such as processor 20) can retrievable data (position).Memory devices 26 can be configured to storage for making this device can carry out according to one example embodiment the information of various functions, data, content, application, instruction etc.For example memory devices 26 can be configured to the input data of buffering for being processed by processor 20.Additionally or alternatively, memory devices 26 can be configured to the instruction of storage for being carried out by processor 20.
Device 25 can be user terminal (for example mobile terminal 10) or the communication facilities that is configured to use an exemplary embodiment of the present invention in certain embodiments.Yet in certain embodiments, device 25 can be embodied as to chip or chipset.In other words, device 25 can comprise one or more physical package (for example chip), and this one or more physical package comprises for example, material, parts and/or wiring on construction package (substrate).The physical strength of the component circuitry device that construction package can be provided for comprising thereon, size saving and/or electric interaction restriction.Therefore device 25 can be configured to realize one embodiment of the present of invention on one single chip or as single " SOC (system on a chip) " in some cases.Like this, in some cases, chip or chipset can be configured for carrying out the device of one or more operation, and this one or more operation is used for providing function described herein.
Can specialize processor 20 with a plurality of different modes.For example processor 20 can be embodied as to various hardware handles devices, such as coprocessor, microprocessor, controller, digital signal processor (DSP), have or without the processing unit of subsidiary DSP or one or more hardware handles device in various other processing circuit unit, these other processing circuit units comprise integrated circuit, as such as ASIC (special IC), FPGA (field programmable gate array), micro controller unit (MCU), hardware accelerator, special purpose computer chip etc.Like this, in certain embodiments, processor 20 can comprise one or more processing core that is configured to independent execution.Polycaryon processor can be realized multiprocessing in single physical encapsulation.Additionally or alternatively, processor 20 can comprise via bus by concatenated configuration for realizing independent one or more processor of carrying out instruction, streamline and/or multithreading.Device 25 is being embodied as in this embodiment of mobile terminal, and processor 20 can be specialized by the processor of mobile terminal.
In an example embodiment, processor 20 can be configured to store in execute store equipment 26 or otherwise addressable instruction of processor 20.Alternatively or additionally, processor 20 can be configured to carry out the function of hard coded.Like this, no matter be by hardware or software approach or combine to configure by it, processor 20 can represent (for example in circuit arrangement, physically specializing) can be in correspondingly being configured the entity of executable operations according to one embodiment of present invention.Therefore such as when processor 20 being embodied as to ASIC, FPGA etc., processor 20 can be for carrying out the hardware of operation described herein, concrete configuration.Alternatively, as another example, when processor 20 is embodied as to the actuator of software instruction, instruction can concrete configuration processor 20 to carry out algorithm described herein and/or operation when carrying out instruction.Yet in some cases, processor 20 can be the processor of concrete equipment (for example mobile terminal or network entity), this equipment is configured to use one embodiment of the present of invention by the further configuration processor 20 of instruction, and these instructions are used for carrying out algorithm described herein and/or operation.Processor 20 can comprise clock, ALU (ALU) and logic gate and other parts of the operation that is configured to support processor 20.
Simultaneously, communication interface 24 can be any device of specializing in the combination of hardware or hardware and software, such as equipment or circuit arrangement, this device is configured to from/to receiving with device 25 networks of communicate by letter 14 and/or any miscellaneous equipment or module and/or transmitting data.In this regard, communication interface 24 can for example comprise an antenna (or a plurality of antenna) and support hardware and/or the software of communicating by letter with cordless communication network for realizing.Additionally or alternatively, communication interface 24 can comprise for docking with antenna to cause via antenna transmission signal or processing the circuit arrangement receiving via the signal of antenna reception.In some environment, wire communication can alternatively be supported or also support to communication interface 24.Like this, for example communication interface 24 can comprise for supporting via cable, Digital Subscriber Line (DSL), USB (universal serial bus) (USB) or other machine-processed communication modem and/or other hardware/software.
In at some embodiment, such as device 25 examples of being specialized by subscriber equipment 10, device 25 can comprise user interface 22, and this user interface can communicate by letter with processor 20 again to receive the indication of user's input and/or cause to user provides visual, audible, mechanical or other output.Like this, user interface 22 can for example comprise keyboard, mouse, operating rod, display, touch screen, touch area, soft key, microphone, loudspeaker or other I/O mechanism.Alternatively or additionally, processor 20 can comprise be configured to control one or more user interface section, as the user interface circuit device of at least some functions such as loudspeaker, ringer, microphone, display etc.Processor 20 and/or the user interface circuit device that comprises processor 20 can be configured to by for example, controlling one or more function of one or more user interface section at the computer program instructions (software and/or firmware) of the upper storage of the addressable storer of processor 20 (such as memory devices 26 etc.).
At some embodiment, such as device 25 is in subscriber equipment 10 pre-ferred embodiment, device 25 can comprise camera 28 or other image capture device that is configured to catch the image that comprises video image.Yet in other embodiments, device 25 can not comprise camera 28.Alternatively, image can provide by memory devices 26 or via communication interface 24.
Referring now to Fig. 3, according to an example embodiment general introduction, be used for creating the operation of face's sketch map incarnation.With regard to this point and as described below, the operation of Fig. 3 can be carried out and by mobile terminal, be carried out in one embodiment by device 25.Device 25 can comprise for as operate as shown in 30 receive the device of the image of face, such as camera 28, processor 20, communication interface 24 etc.As shown in operation 31, this device comprises for identifying the device of the facial feature points on the image of face, such as camera 28, processor 20 etc.Can identify in various manners facial feature points, and can identify and comprise the facial feature points that drops on natural curve and a plurality of different facial feature points of the diacritical point in face.Facial feature points can comprise auxiliary definition eyes, eyebrow, nose and face profile position facial feature points, but also can comprise the point that defines any other face feature.The example of the facial feature points of placing on the image of face can be seen by the dot matrix on the image in Fig. 4.
Device 25 also can comprise for as operate as shown in 32 receive the device of the sketch map of face, such as processor 20, user interface 22 etc.In this regard, the image that can be received sketch map of face can be the identical image of the identified facial feature points of face.User can utilize user interface 22 with by with indication face feature, such as the such mode in position of the profile of eyes, nose, mouth and face is drawn to provide in input sketch map is provided on image.In this regard, the image of face can be shown by user interface, and then user can for example utilize touch panel screen, mouse or other user interface mechanisms to sketch the contours on a plurality of features of face.Sketch map alternatively the previous drafting from memory devices 26 access of the image of face sketch map or via communication interface 24, provide.The example of the sketch map of having drawn on the image of face is provided in Fig. 5.
With reference to operation 33, in one embodiment, device 25 can comprise for sketch map is gathered with the device aimed at of facial feature points on the images with in operation 31 signs, such as processor 20 etc.This is gathered can comprise device 25, such as processor 20 is changed sketch map slightly from its original state, thereby the line of sketch map directly drops on the facial feature points on image, aim at thus the facial feature points of sketch map and identical image from face.If have gather after, device 25 also can comprise for making the relevant so that device of establishment face sketch map incarnation of the facial feature points of sketch map and identical image from face, such as processor 20 etc.In this regard, can be relevant by sketch map and the facial feature points of the corresponding point Lai Shi face on the sketch map of each facial feature points in associated a plurality of facial feature points and face.The example face sketch map incarnation that the process of description shown in Figure 6 produces.
In one embodiment, device 25 can comprise device for face's sketch map incarnation is provided during the communication session with the opposing party, such as communication interface 24, processor 20 etc.See the operation 35 of Fig. 3.In this regard, communication session can be the simple version of video session, wherein between in many ways, sets up voice communication and by providing face's sketch map incarnation to come complementing video to communicate by letter.Face's sketch map incarnation can be shown by the opposing party, provide thus the visual information about user's head position and countenance.Although the each party of communication session can provide face's sketch map incarnation to the opposing party, but the method for an embodiment, device and computer program are without such reciprocity, and replace, the either party of communication session can to the opposing party face's sketch map incarnation is provided and face's sketch map incarnation of not receiving the opposing party in return.
In certain embodiments, device 25 can comprise for such as in operation 36, receive face additional, such as the device of successive image, such as communication interface 24, processor 20 etc.Like this, by the specific device 25 of subscriber equipment 10, can be configured to detect or determine whether to receive the appended drawings picture of face.In the example of appended drawings picture that receives face, this appended drawings picture can by camera 28 or other image capture device be caught or receive via communication interface 24.Source regardless of the appended drawings picture of face, can provide image to processor 20.The device 25 of this embodiment also can comprise for the appended drawings in face looks like to be identified at least subset of the facial feature points identifying in original image in operation 31 identify in one embodiment the device of all facial feature points, such as processor 20, camera 28 etc.See operation 37.After this sign of facial feature points, device 25 can comprise for as operate 34 make device that the reposition of face's sketch map incarnation based on facial feature points and the correlativity between sketch map and original image revise defining, such as processor 20 etc.See operation 38.In this regard, processor 20 can determine that the position of the corresponding facial feature points of original and appended drawings picture changes.Position based on corresponding facial feature points changes, and processor 20 can make face's sketch map incarnation similarly revise by the point that sign is relevant to corresponding facial feature points in operation in face's sketch map incarnation, the position that then change of the position based on facial feature points from original image to appended drawings picture revised Gai Dian face sketch map incarnation.
For example, facial feature points can define the left comer of individual mouth.In original image, this facial feature points can be identified, then relevant to the point on the sketch map of face, the left comer of this point identification mouth.In appended drawings picture, can identify the facial feature points of the left comer of definition mouth, and the position that can determine this facial feature points is from original image to additional image modification.Like this, the point corresponding with the left comer of mouth that can identify face's sketch map incarnation, and can be with corresponding facial feature points in position the same way from original image to additional image modification change the position of this point of face's sketch map incarnation.
After revising face's sketch map incarnation, can during communication session, provide face's sketch map incarnation of modification.Like this, face's sketch map incarnation can provide to the opposing party of communication session the incarnation of renewal, and the incarnation of this renewal imitates during the process of communication session that head moves and countenance.Therefore, the modification of face's sketch map incarnation can not only allow the opposing party interested but also can provide face's visual cues that sketch map incarnation is providing and catching to the opposing party.
The successive image of same face can receive, allow thus repetitive operation 35,36,37 and 38 by device 25.Can provide image series by the form of video image.Appended drawings picture or video image can by camera 28 or other image capture device be caught, from memory devices 26, be retrieved or received via communication interface 24.Source regardless of appended drawings picture, during communication session, to the opposing party, provide variable face sketch map incarnation can be of value to the opposing party, this opposing party can check the sender of face's sketch map incarnation variable facial expressions or body language, provide with respect to the only communication of the improvement of voice communication thus.
As described above, Fig. 3 diagram is according to the process flow diagram of the device 25 of example embodiment of the present invention, method and computer program product.By understanding the various devices associated with the execution of software that comprises one or more computer program instructions, such as hardware, firmware, processor, circuit arrangement and/or miscellaneous equipment can each piece of implementing procedure figure and the combinations of the piece in process flow diagram.For example computer program instructions can be specialized one or more process in process described above.In this regard, the computer program instructions of specializing process described above can be stored and be carried out by the processor 20 of device 25 by the memory devices 26 of specializing the device 25 of one embodiment of the present of invention.As will be understood by those, can for example, to computing machine or other programmable device (hardware), above load any such computer program instructions to produce machine, thereby gained computing machine or other programmable device are realized the function of appointment in the piece of process flow diagram.Also can in computer-readable memory, store these computer program instructions, this computer-readable memory can guide computing machine or other programmable device with ad hoc fashion work, thereby the instruction of storing in computer-readable memory produces manufacture, the execution of this manufacture is implemented in the function of appointment in the piece of process flow diagram.Computer program instructions also can be loaded on computing machine or other programmable device so that series operates in and on computing machine or other programmable device, be performed to produce computer-implemented process, thereby the instruction of carrying out on computing machine or other programmable device is provided for being implemented in the operation of the function of appointment in the piece of process flow diagram.
Thereby, the piece support of process flow diagram for carry out appointed function device combination and for carrying out the combination of the operation of appointed function.Also can be by carrying out the computer system based on specialized hardware of appointed function or being realized by the combination of specialized hardware and computer instruction by understanding one or more piece of process flow diagram and the combination of the piece in process flow diagram.
In certain embodiments, can revise or further some operation in extended operation.In addition, in certain embodiments, can comprise additional can selection operation.Can carry out the modification of above operation, interpolation or expansion in any order and in any combination.
Can in various scenes, utilize the method, device 25 and computer program.In one embodiment, user can create face's sketch map incarnation and watch it imitate user as the movement of successive image or Video Image Capturing and body language.In another embodiment, the one side or both of intercommunication can provide face's sketch map incarnation to provide at least certain visual situation to communication session to the opposing party mutually.In addition, the face's sketch map incarnation of in many ways can utilizing of any number participates in communication session.These communication types can include but not limited to Conference Calling and Online class.
Technician in the instruction presenting from description and associated drawings above in field that be benefited, that relate in these inventions is by of the present invention many modifications of expecting setting forth here and other embodiment.Therefore by understanding the present invention, will be not limited to disclosed specific embodiment and revise with other embodiment and be intended to be contained in the scope of claims.In addition, although describe above and associated drawings is described example embodiment in the situation of some example combination of unit and/or function, should be familiar with that alternative can provide the various combination of unit and/or function and the scope that do not depart from claims.In this regard, for example also as can be some claims in claims set forth, imagine from the above unit of clearly describing and/or function and combine different unit and/or function combination.Although use concrete term here, only on general and describing significance and not use them for the object of restriction.
Claims (20)
1. a method, comprising:
With a plurality of facial feature points on the first image of processor flag face;
Receive the sketch map of described face; And
Make described sketch map relevant to create face's sketch map incarnation to the described facial feature points on described the first image.
2. method according to claim 1, the described sketch map that wherein receives described face comprises and receives the input that the sketch map to being superimposed upon on described first image of described face defines, and wherein said method also comprises and gathers described sketch map to aim at the described facial feature points on described the first image.
3. method according to claim 1, the described sketch map that wherein receives described face comprises that described facial feature points on described the first image that utilizes described face is to define the described sketch map of described face.
4. according to the method described in the arbitrary claim in claim 1-3, also comprise:
Receive the second image of described face;
Identify on described the second image, on described the first image at least one subset of the identified described facial feature points going out; And
The correlativity of the described facial feature points on the described facial feature points based on described the second image and described face sketch map incarnation and described the second image is revised described face sketch map incarnation.
5. method according to claim 4, also comprises:
Described face sketch map incarnation is provided during the communication session between at least two sides; And
Run through described communication session and repeat described reception, sign and modification.
6. method according to claim 4, the described modification of wherein said face sketch map incarnation comprises that the head that imitates user moves and countenance.
7. according to the method described in the arbitrary claim in claim 1-6, also comprise:
Receive the described image of described face, and make the described image of described face shown before the described sketch map that receives described face.
8. a device, comprises at least one processor and at least one storer that comprises computer program code, and described at least one storer is configured to make described device at least together with described processor with described computer program code:
A plurality of facial feature points on the first image of sign face;
Receive the sketch map of described face; And
Make described sketch map relevant to create face's sketch map incarnation to the described facial feature points on described the first image.
9. device according to claim 8, the input that wherein said at least one storer and described computer program code are also configured to make described device to define by the sketch map receiving being superimposed upon on described first image of described face together with described processor receives the described sketch map of described face; And gather described sketch map to aim at the described facial feature points on described the first image.
10. device according to claim 8, wherein said at least one storer and described computer program code are also configured to make described device by utilizing the described facial feature points on described first image of described face to receive the described sketch map of described face to define the described sketch map of described face together with described processor.
Device described in arbitrary claim in 11. according to Claim 8-10, wherein said at least one storer is also configured to make described device together with described processor with described computer program code:
Receive the second image of described face;
Identify on described the second image, on described the first image at least one subset of the identified described facial feature points going out; And
The correlativity of the described facial feature points on the described facial feature points based on described the second image and described face sketch map incarnation and described the second image is revised described face sketch map incarnation.
12. devices according to claim 11, wherein said at least one storer is also configured to make described device together with described processor with described computer program code:
Described face sketch map incarnation is provided during the communication session between at least two sides; And
Run through described communication session and repeat described reception, sign and modification.
13. devices according to claim 11, wherein said at least one storer and described computer program code are also configured to make described device to move with countenance and revise described face sketch map incarnation by imitating user's head together with described processor.
Device described in arbitrary claim in 14. according to Claim 8-14, wherein said at least one storer is also configured to make described device together with described processor with described computer program code:
Receive the described image of described face; And
Make the described image of described face shown before the described sketch map that receives described face.
15. 1 kinds of computer programs that comprise at least one non-transient computer-readable recording medium, described at least one non-transient computer-readable recording medium has the computer executable program code instruction of storage therein, and described computer executable program code instruction comprises the code instructions for following operation:
A plurality of facial feature points on the first image of sign face;
Receive the sketch map of described face; And
Make described sketch map relevant to create face's sketch map incarnation to the described facial feature points on described the first image.
16. computer programs according to claim 15, wherein for receiving the described code instructions of the described sketch map of described face, comprise the code instructions of the input that the sketch map for receiving being superimposed upon on described first image of described face defines, and wherein said computer executable program code instruction comprises for gathering the code instructions of described sketch map to aim at the described facial feature points on described the first image.
17. computer programs according to claim 15, wherein comprise for utilizing described facial feature points on described first image of described face to define the code instructions of the described sketch map of described face for receiving the described code instructions of the described sketch map of described face.
18. according to the computer program described in the arbitrary claim in claim 15-17, and wherein said computer executable program code instruction comprises the code instructions for following operation:
Receive the second image of described face;
Identify on described the second image, on described the first image at least one subset of the identified described facial feature points going out; And
The correlativity of the described facial feature points on the described facial feature points based on described the second image and described face sketch map incarnation and described the second image is revised described face sketch map incarnation.
19. computer programs according to claim 18, wherein said computer executable program code instruction comprises the code instructions for following operation:
Described face sketch map incarnation is provided during the communication session between at least two sides; And
Run through described communication session and repeat described reception, sign and modification.
20. computer programs according to claim 18, wherein comprise for imitating user's head and move the code instructions with countenance for revising the described code instructions of described face sketch map incarnation.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2011/084202 WO2013091157A1 (en) | 2011-12-19 | 2011-12-19 | A method and apparatus for creating and displaying a face sketch avatar |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104115160A true CN104115160A (en) | 2014-10-22 |
Family
ID=48667620
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201180076398.1A Pending CN104115160A (en) | 2011-12-19 | 2011-12-19 | A method and apparatus for creating and displaying a face sketch avatar |
Country Status (3)
| Country | Link |
|---|---|
| CN (1) | CN104115160A (en) |
| TW (1) | TW201342259A (en) |
| WO (1) | WO2013091157A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110852292B (en) * | 2019-11-18 | 2022-02-01 | 南京邮电大学 | Sketch face recognition method based on cross-modal multi-task depth measurement learning |
| GB2606344A (en) * | 2021-04-28 | 2022-11-09 | Sony Interactive Entertainment Europe Ltd | Computer-implemented method and system for generating visual adjustment in a computer-implemented interactive entertainment environment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0689362A2 (en) * | 1994-06-21 | 1995-12-27 | AT&T Corp. | Sound-synchronised video system |
| CN1532775A (en) * | 2003-03-19 | 2004-09-29 | ���µ�����ҵ��ʽ���� | Visuable telephone terminal |
| CN101051392A (en) * | 2006-04-04 | 2007-10-10 | 罗技欧洲公司 | Real-time automatic facial feature replacement |
| KR20090007909A (en) * | 2007-07-16 | 2009-01-21 | 연세대학교 산학협력단 | Method and apparatus for creating caricature video |
| CN102157007A (en) * | 2011-04-11 | 2011-08-17 | 北京中星微电子有限公司 | Performance-driven method and device for producing face animation |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100201689A1 (en) * | 2009-02-09 | 2010-08-12 | Nokia Corporation | Method, apparatus and computer program product for interactive sketch template creation, alteration, and use |
-
2011
- 2011-12-19 CN CN201180076398.1A patent/CN104115160A/en active Pending
- 2011-12-19 WO PCT/CN2011/084202 patent/WO2013091157A1/en active Application Filing
-
2012
- 2012-12-19 TW TW101148376A patent/TW201342259A/en unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0689362A2 (en) * | 1994-06-21 | 1995-12-27 | AT&T Corp. | Sound-synchronised video system |
| CN1532775A (en) * | 2003-03-19 | 2004-09-29 | ���µ�����ҵ��ʽ���� | Visuable telephone terminal |
| CN101051392A (en) * | 2006-04-04 | 2007-10-10 | 罗技欧洲公司 | Real-time automatic facial feature replacement |
| KR20090007909A (en) * | 2007-07-16 | 2009-01-21 | 연세대학교 산학협력단 | Method and apparatus for creating caricature video |
| CN102157007A (en) * | 2011-04-11 | 2011-08-17 | 北京中星微电子有限公司 | Performance-driven method and device for producing face animation |
Non-Patent Citations (1)
| Title |
|---|
| H.W.KANG ET AL.: "Interactive Sketch Generation", 《THE VISUAL COMPUTER》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201342259A (en) | 2013-10-16 |
| WO2013091157A1 (en) | 2013-06-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107247548B (en) | Method for displaying image, image processing method and device | |
| US8893054B2 (en) | Devices, systems, and methods for conveying gesture commands | |
| CN108681436A (en) | Image quality parameter adjusting method, device, terminal and storage medium | |
| CN103384874A (en) | Superimposed annotation output | |
| CN110400251A (en) | Method for processing video frequency, device, terminal device and storage medium | |
| CN106233240A (en) | Text input on interactive display | |
| US9613444B2 (en) | Information input display device and information input display method | |
| KR102614263B1 (en) | Interaction methods and apparatus, electronic devices and computer-readable storage media | |
| CN104050040B (en) | Media-playback workload scheduler | |
| CN114518817B (en) | Display method, electronic device and storage medium | |
| CN105320262A (en) | Method and apparatus for operating computer and mobile phone in virtual world and glasses thereof | |
| CN103999096A (en) | Reduced image quality for video data background regions | |
| US11456887B1 (en) | Virtual meeting facilitator | |
| US20160154777A1 (en) | Device and method for outputting response | |
| CN112528936B (en) | Video sequence arrangement method, device, electronic equipment and storage medium | |
| CN107079065A (en) | Phone board device | |
| CN114219892A (en) | Intelligent driving method of three-dimensional model | |
| CN104115160A (en) | A method and apparatus for creating and displaying a face sketch avatar | |
| CN114902258A (en) | Communication support system and communication support program | |
| CN114885199B (en) | Real-time interaction method, device, electronic equipment, storage medium and system | |
| CN116129534A (en) | Image living body detection method and device, storage medium and electronic equipment | |
| CN110941977A (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN104035560A (en) | Human-computer real-time interaction method based on camera | |
| CN104040501A (en) | Display controller interrupt register | |
| CN114401439A (en) | Dance video generation method, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20160202 Address after: Espoo, Finland Applicant after: Technology Co., Ltd. of Nokia Address before: Espoo, Finland Applicant before: Nokia Oyj |
|
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20141022 |