CN104780339A - Method and electronic equipment for loading expression effect animation in instant video - Google Patents

Method and electronic equipment for loading expression effect animation in instant video Download PDF

Info

Publication number
CN104780339A
CN104780339A CN201510181435.5A CN201510181435A CN104780339A CN 104780339 A CN104780339 A CN 104780339A CN 201510181435 A CN201510181435 A CN 201510181435A CN 104780339 A CN104780339 A CN 104780339A
Authority
CN
China
Prior art keywords
special efficacy
described
expression
efficacy animation
expression special
Prior art date
Application number
CN201510181435.5A
Other languages
Chinese (zh)
Inventor
武俊敏
Original Assignee
美国掌赢信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 美国掌赢信息科技有限公司 filed Critical 美国掌赢信息科技有限公司
Priority to CN201510181435.5A priority Critical patent/CN104780339A/en
Publication of CN104780339A publication Critical patent/CN104780339A/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/36Image preprocessing, i.e. processing the image information without deciding about the identity of the image
    • G06K9/46Extraction of features or characteristics of the image
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working

Abstract

The invention discloses a method and electronic equipment for loading expression effect animation in an instant video, and belongs to the field of videos. The method comprises the following steps: distinguishing the expressions in frames of the instant video, and generating a distinguishing result; according to the distinguishing result, obtaining the expression effect animation which needs to be loaded; determining the loading position of the expression effect animation in the instant video; sending the expression effect animation and the loading position to other electric equipment; therefore, the individualized requirements of a user on instant video conversation are satisfied, the interaction form of the video is increased, and the user experience is improved.

Description

Expression special efficacy animation loading method in a kind of instant video and electronic equipment

Technical field

The present invention relates to video field, the expression special efficacy animation loading method particularly in a kind of instant video and electronic equipment.

Background technology

Present user can carry out video conversation by the video capability of electronic equipment, but in video call process, user both sides can only see the background of the other side and video by video frame.Make in video call process, video representation is single, and user is difficult to add the interactive special efficacy animation of expression by simple mode in video calling, so need now to provide a kind of simple effective method that can add expression special efficacy to face in video.

Because prior art does not provide a kind of simple effective method that can add expression special efficacy to face in video, make in instant video, to add expression special efficacy animation in real time, thus can not meet user in video call process, carry out interactive demand, Consumer's Experience effect is low.

Summary of the invention

In order to meet user to the diversified demand of instant video, improving Consumer's Experience effect, embodiments providing the expression special efficacy animation loading method in a kind of instant video and electronic equipment.Described technical scheme is as follows:

First aspect, provide the expression special efficacy animation loading method in a kind of instant video, described method comprises:

Identify the human face expression in instant video frame, generate recognition result;

According to described recognition result, obtain the expression special efficacy animation that will load;

Determine the loading position of described expression special efficacy animation in instant frame of video;

Send described expression special efficacy animation and described loading position to other electronic equipments.

In conjunction with first aspect, in the implementation that the first is possible, the human face expression in described identification instant video frame comprises:

Obtain the face details parameter in instant video frame;

According to described face details parameter, obtain the human face expression in current instant video frame.

In conjunction with the first possible implementation of first aspect, in the implementation that the second is possible, described according to described recognition result, obtain the expression special efficacy animation that will load and comprise:

According to described human face expression, obtain the expression special efficacy animation corresponding with described human face expression.

In conjunction with the implementation that the first or the second of first aspect are possible, in the implementation that the third is possible, describedly determine that the loading position of described expression special efficacy animation in instant frame of video comprises:

According to the face details parameter in described instant video frame, obtain the loading position of described expression special efficacy animation in instant frame of video.

In conjunction with the third possible implementation of first aspect, in the 4th kind of possible implementation, described method also comprises:

According to described loading position, load described expression special efficacy animation, and the instant video frame after display loading expression special efficacy animation.

In conjunction with the 4th kind of possible implementation of first aspect, in the 5th kind of possible implementation, described method also comprises:

Obtain the elimination instruction of user's input;

Delete the special efficacy animation indicated by described elimination instruction;

Described elimination instruction is sent to other electronic equipments described.

Second aspect, provides a kind of electronic equipment, and described electronic equipment comprises:

Identification module, for identifying the human face expression in instant video frame, generates recognition result;

Acquisition module, for according to described recognition result, obtains the expression special efficacy animation that will load;

Determination module, for determining the loading position of described expression special efficacy animation in instant frame of video;

Sending module, for sending described expression special efficacy animation and described loading position to other electronic equipments.

Load-on module, for according to described loading position, loads described expression special efficacy animation;

Display module, for showing the described instant video frame loaded after expression special efficacy animation.

In conjunction with second aspect, in the implementation that the first is possible, described identification module specifically for:

Obtain the face details parameter in instant video frame;

According to described face details parameter, obtain the human face expression in current instant video frame.

In conjunction with the first possible implementation of second aspect, in the implementation that the second is possible, described acquisition module specifically for:

According to described human face expression, obtain the expression special efficacy animation corresponding with described human face expression.

In conjunction with the implementation that the first or the second of second aspect are possible, in the implementation that the third is possible, described acquisition module also specifically for:

According to the face details parameter in described instant video frame, obtain the loading position of described expression special efficacy animation in instant frame of video.

In conjunction with second aspect, in the 4th kind of possible implementation,

Described equipment also comprises receiver module, for obtaining the elimination instruction of user's input;

Described equipment also comprises removing module, for deleting the special efficacy animation indicated by described elimination instruction;

Described sending module is also for sending described elimination instruction to other electronic equipments described.

The third aspect, provide a kind of electronic equipment, the processor comprising video input module, Video Output Modules, sending module, receiver module, memory and be connected with described video input module, described Video Output Modules, described sending module, described receiver module and described memory, wherein, described memory stores batch processing code, described processor, for calling the program code stored in described memory, performs following operation:

Identify the human face expression in instant video, generate recognition result;

According to described recognition result, obtain the expression special efficacy animation that will load;

Determine the loading position of described expression special efficacy animation in instant frame of video;

Control sending module and send described expression special efficacy animation and described loading position to other electronic equipments;

Wherein, described processor calls the program code stored in described memory and also receives instant video frame for controlling video input module.

In conjunction with the third aspect, in the implementation that the first is possible, described processor, for calling the program code stored in described memory, performs following operation:

Obtain the face details parameter in instant video;

According to described face details parameter, obtain the human face expression in current instant video frame.

In conjunction with the first possible implementation of the third aspect, in the implementation that the second is possible, described processor, for calling the program code stored in described memory, performs following operation:

According to described human face expression, obtain the expression special efficacy animation corresponding with described human face expression.

In conjunction with the implementation that the first or the second of the third aspect are possible, in the implementation that the third is possible, described processor, for calling the program code stored in described memory, performs following operation:

According to the face details parameter in described instant video frame, obtain the loading position of described expression special efficacy animation in instant frame of video.

In conjunction with the third possible implementation of the third aspect, the 4th kind of possible implementation, described processor, for calling the program code stored in described memory, performs following operation:

According to described loading position, load described expression special efficacy animation, and control the instant video frame after Video Output Modules display loading expression special efficacy animation.

In conjunction with the 4th kind of possible implementation of the third aspect, the 5th kind of possible implementation, described processor, for calling the program code stored in described memory, performs following operation:

Control the elimination instruction that receiver module obtains user's input;

Delete the special efficacy animation indicated by described elimination instruction;

Control sending module and send described elimination instruction to other electronic equipments described.

Fourth aspect, provide a kind of expression Special display effect method in instant video, described method comprises:

Obtain expression special efficacy animation and loading position;

Described expression special efficacy animation is loaded on described loading position, and shows the instant video frame after described loading expression special efficacy animation;

Wherein, described loading position is determined in current video frame, and described expression special efficacy animation obtains by carrying out the human face expression in instant video frame identifying.

In conjunction with fourth aspect, in the implementation that the first is possible, described method also comprises:

Receive the elimination instruction that other electronic equipments send;

Delete the special efficacy animation indicated by described elimination instruction.

5th aspect, provides a kind of electronic equipment, and described electronic equipment comprises:

Receiver module, for receiving expression special efficacy animation and the loading position of the transmission of other electronic equipments;

Load-on module, for being loaded on described loading position by described expression special efficacy animation;

Display module, for showing the described instant video frame loaded after expression special efficacy animation;

Wherein, described loading position is determined in current video frame, and described expression special efficacy animation obtains by carrying out the human face expression in instant video frame identifying.

In conjunction with the 5th aspect, in the implementation that the first is possible,

Described receiver module is also for receiving the elimination instruction that other electronic equipments described send;

Described load-on module is also for deleting the special efficacy animation indicated by described elimination instruction.

6th aspect, provide a kind of electronic equipment, the processor comprising Video Output Modules, transmission/reception module, memory and be connected with described Video Output Modules, described transmission/reception module and described memory, wherein, described memory stores batch processing code, described processor, for calling the program code stored in described memory, performs following operation:

Receive expression special efficacy animation and the loading position of the transmission of other electronic equipments;

Described expression special efficacy animation is loaded on described loading position, and controls the instant video frame after Video Output Modules display described loading expression special efficacy animation;

Wherein, described loading position is determined in current video frame, and described expression special efficacy animation obtains by carrying out the human face expression in instant video frame identifying.

In conjunction with the 6th aspect, in the implementation that the first is possible, described processor, for calling the program code stored in described memory, performs following operation:

Receive the elimination instruction that other electronic equipments described send;

Delete the special efficacy animation indicated by described elimination instruction.

Embodiments provide the expression special efficacy animation loading method in a kind of instant video and electronic equipment.Comprise: identify the human face expression in instant video frame, generate recognition result; According to recognition result, obtain the expression special efficacy animation that will load; Determine the loading position of expression special efficacy animation in instant frame of video; Transmission expression special efficacy animation and loading position are to other electronic equipments.According to the method that the embodiment of the present invention provides, by identifying the human face expression in instant video frame, generate recognition result, according to recognition result, the expression special efficacy animation of acquisition is loaded on the loading position in instant video, achieves and carry out the loading of expression special efficacy in instant video, meet user and carry out interactive demand by loading expression special efficacy animation in video calling, add video interactive form, improve Consumer's Experience; On the other hand, by determine the loading position corresponding with expression special efficacy animation in current video frame after, expression special efficacy animation is loaded on the loading position in instant video, thus it is more accurate that expression special efficacy animation is loaded in video, improves Consumer's Experience; Meanwhile, make to load expression special efficacy animation and can follow the movement of personage's head portrait and constantly identify this position, make expression special efficacy animation can follow the change of personage and change accordingly, improve Consumer's Experience; In addition, by identifying the human face expression in instant video frame, recognition result is generated, obtain the expression special efficacy animation that will load according to recognition result, carry out automatically loading expression special efficacy animation, compared with the mode of manual loading, simplify operating procedure, improve Consumer's Experience.

Accompanying drawing explanation

In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, below the accompanying drawing used required in describing embodiment is briefly described, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.

Fig. 1 is the expression special efficacy loading method flow chart in a kind of instant video of providing of the embodiment of the present invention;

Fig. 2 is the expression special efficacy loading method flow chart in a kind of instant video of providing of the embodiment of the present invention;

Fig. 3 is a kind of instant video interface change schematic diagram that the embodiment of the present invention provides;

Fig. 4 is a kind of instant video interface change schematic diagram that the embodiment of the present invention provides;

Fig. 5 is the expression special efficacy loading method flow chart in a kind of instant video of providing of the embodiment of the present invention;

Fig. 6 is a kind of electronic devices structure schematic diagram that the embodiment of the present invention provides;

Fig. 7 is a kind of electronic devices structure schematic diagram that the embodiment of the present invention provides;

Fig. 8 is a kind of electronic devices structure schematic diagram that the embodiment of the present invention provides;

Fig. 9 is a kind of electronic devices structure schematic diagram that the embodiment of the present invention provides.

Embodiment

For making the object, technical solutions and advantages of the present invention clearly, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.

The embodiment of the present invention has carried the expression special efficacy animation loading method in a kind of instant video, the method is applied in a kind of interactive system, this interactive system at least comprises two electronic equipments, instant video communication can be carried out by working procedure between these two electronic equipments, wherein, this electronic equipment can be smart mobile phone (SmartPhone), can be panel computer (Tablet Computer), can also be other electronic equipments, the embodiment of the present invention be limited concrete electronic equipment.Electronic equipment at least comprises video input module and video display module, and video input module can comprise camera, and video display module can comprise display screen.

Directly can carry out instant video between these at least two electronic equipments mutual, can pass through bluetooth, the radio connection such as WiFi connect, and also can be connected by connection device, and this connection device comprises router etc.; These at least two electronic equipments can also carry out instant video alternately by server, and this server can be the server of application program.

In addition, the method that the embodiment of the present invention provides can also be applied to and a kind ofly only include in the interactive system of electronic equipment and user, wherein, electronic equipment at least comprises video input module and video display module, video input module can comprise camera, video display module can comprise display screen, and at least can run instant video program in electronic equipment.The present invention is that embodiment can also comprise other application scenarioss, and the embodiment of the present invention is not limited concrete application scenarios.It should be noted that in embodiments of the present invention, expression special efficacy animation obtains by carrying out identifying to the personage's expression in instant video.

Embodiment one

Embodiments provide the expression special efficacy animation loading method in a kind of instant video, shown in Figure 1, method flow comprises:

101, identify the human face expression in instant video frame, generate recognition result.

Concrete, obtain the face details parameter in instant video frame;

According to face details parameter, obtain the human face expression in current instant video frame.

102, according to recognition result, the expression special efficacy animation that will load is obtained.

Concrete, according to human face expression, obtain the expression special efficacy animation corresponding with human face expression.

103, the loading position of expression special efficacy animation in instant frame of video is determined.

Concrete, according to the face details parameter in instant video frame, obtain the loading position of expression special efficacy animation in instant frame of video.

104, transmission expression special efficacy animation and loading position are to other electronic equipments.

Optionally, method also comprises:

According to loading position, load expression special efficacy animation, and the instant video frame after display loading expression special efficacy animation.

Optionally, method also comprises:

Obtain the elimination instruction of user's input;

Delete the special efficacy animation eliminated indicated by instruction;

Send to other electronic equipments and eliminate instruction.

Embodiments provide the expression special efficacy loading method in a kind of instant video, by identifying the human face expression in instant video frame, generate recognition result, according to recognition result, the expression special efficacy animation of acquisition is loaded on the loading position in instant video, achieves and carry out the loading of expression special efficacy in instant video, meet user and carry out interactive demand by loading expression special efficacy animation in video calling, add video interactive form, improve Consumer's Experience; On the other hand, by determine the loading position corresponding with expression special efficacy animation in current video frame after, expression special efficacy animation is loaded on the loading position in instant video, thus it is more accurate that expression special efficacy animation is loaded in video, improves Consumer's Experience; Meanwhile, make to load expression special efficacy animation and can follow the movement of personage's head portrait and constantly identify this position, make expression special efficacy animation can follow the change of personage and change accordingly, improve Consumer's Experience; In addition, by identifying the human face expression in instant video frame, recognition result is generated, obtain the expression special efficacy animation that will load according to recognition result, carry out automatically loading expression special efficacy animation, compared with the mode of manual loading, simplify operating procedure, improve Consumer's Experience.

Embodiment two

Embodiments provide the expression special efficacy animation loading method in a kind of instant video, shown in Figure 2, method flow comprises:

201, the face details parameter in instant video frame is obtained.

Concrete, because the expression of face is determined by face details, so, this face details parameter is for describing the profile of face details, face details at least comprises eye, mouth, eyebrow and nose, in addition, can also comprise other face details, the embodiment of the present invention is not limited concrete face details.

Wherein, this human face characteristic point parameter is determined by this face minutia point coordinates and the textural characteristics point coordinates corresponding with this face details.

Thus by face minutia point coordinates and the textural characteristics point coordinates determination face details parameter corresponding with this face details.

In addition, this face minutia parameter can also comprise this characteristic point in the yardstick and the direction that at least comprise vector indicated in face face, and can also comprise other, the embodiment of the present invention is not limited concrete face minutia parameter.

Optionally, near each characteristic point, obtain texture characteristic points, texture characteristic points is used for uniquely determining characteristic point, and texture characteristic points does not change with the change of light, angle etc.

The embodiment of the present invention is by determining that textural characteristics carrys out face details, because texture characteristic points describes characteristic point region, so texture characteristic points may be used for uniquely determining characteristic point, make the face minutia parameter determining describing human face expression according to characteristic point and texture characteristic points, thus can ensure that characteristic point in instant video and fact characteristic point are in same position, ensure that the identification quality of image detail, thus improve the reliability obtaining face details parameter.

It should be noted that, can by default extraction model or extraction algorithm, characteristic point and texture characteristic points is extracted from face, in addition, can also be by other means, from face, extract characteristic point and texture characteristic points, the embodiment of the present invention is not limited concrete extraction model, extraction algorithm and extracting mode.

202, according to face details parameter, the human face expression in current instant video frame is obtained.

Concrete, according to face details parameter, obtain and face details parameter characteristic of correspondence vector, according to this characteristic vector, obtain the human face expression in instant video frame, this process can be:

A, according at least one face details parameter, obtain at least one characteristic point coordinate for describing this at least one face details parameter and at least one textural characteristics point coordinates;

B, according at least one characteristic point coordinate of this face and at least one textural characteristics point coordinates, obtain at least one characteristic point of face in instant video frame and current pose matrix corresponding at least one texture characteristic points;

C, be standard attitude matrix by current pose matrix rotation, obtain at least one the characteristic point coordinate under standard attitude matrix and at least one textural characteristics point coordinates;

D, according at least one the characteristic point coordinate under standard attitude matrix and at least one textural characteristics point coordinates, to generate and at least one face details parameter characteristic of correspondence point vector.

E, by this characteristic point vector input preset algorithm, obtain the human face expression of result of calculation display;

The human face expression of this result of calculation display is the recognition result generated.

In addition, also obtain the human face expression in current instant video frame by other means, the embodiment of the present invention is not limited concrete mode.

It should be noted that, step 201 to step 202 realizes identifying the human face expression in instant video frame, generate the process of recognition result, except the mode of said process, this process can also be realized by other means, the embodiment of the present invention is to the human face expression in concrete identification instant video frame, and the process generating recognition result is not limited.

The embodiment of the present invention by obtaining at least one characteristic point and at least one texture characteristic points in standard attitude matrix, thus eliminate the impact of the extraneous factor such as illumination, angle on instant video face, make the characteristic point of acquisition and texture characteristic points more be added with comparativity, make to obtain expression special efficacy animation by the expression identified in instant video more accurate.

203, according to human face expression, the expression special efficacy animation corresponding with human face expression is obtained.

Concrete, according to human face expression, obtain and prestore the expression special efficacy animation corresponding with this human face expression.

Exemplary, if human face expression is " smile ", then obtain the expression special efficacy animation corresponding with " smile " prestored; If human face expression is " laughing heartily ", then obtains the expression special efficacy animation corresponding with " laughing heartily " prestored, in addition, the expression special efficacy animation corresponding with other human face expressions can also be comprised, will not enumerate herein.

It should be noted that, step 203 is according to recognition result, and obtain the process of the expression special efficacy animation that will load, in addition, can also realize this process by other means, the embodiment of the present invention is not limited concrete mode.

Optionally, can also obtain with the similarity of the human face expression special efficacy animation prestored special efficacy animation of expressing one's feelings by obtaining this human face expression.

Concrete, if this human face expression is more than or equal to predetermined threshold value with the similarity of the human face expression special efficacy animation prestored, then determine that the human face expression special efficacy animation that this prestores is corresponding with this human face expression; If be less than predetermined threshold value, then determine not corresponding with this human face expression human face expression special efficacy animation prestored, then terminate.

The embodiment of the present invention can determine with the similarity of the human face expression special efficacy animation prestored the expression special efficacy animation that this human face expression is corresponding by obtaining human face expression, thus improve the efficiency of the acquisition of expression special efficacy animation, avoid owing to not having and the expression special efficacy animation that meets completely of some human face expression and the situation that cannot obtain, improve Consumer's Experience effect.

Optionally, can also comprise to user's display reminding information, this information for showing the failure of loading expression special efficacy animation with the form of word to user, or can show to user by other means, and the embodiment of the present invention is not limited concrete mode.

204, the loading position of expression special efficacy animation in instant frame of video is determined.

Concrete, because face details parameter determines by this characteristic point coordinate with to the textural characteristics point coordinates of this Feature point correspondence, so, by face minutia parameter, determine the coordinate in instant frame of video of face details, thus according to the coordinate of this face details in instant frame of video, obtain the loading position of expression special efficacy animation in instant frame of video.

Wherein, the acquisition process of face minutia point coordinates is identical with the process described in step 201, is or else repeated herein,

During by obtaining the face details for describing this human face expression, by obtaining face details parameter acquiring face details, and obtain face details parameter by face minutia point coordinates and textural characteristics point coordinates and determine, so determine the coordinate of face details while determining face details parameter, thus make the mode obtaining loading position more accurately succinct, do not need again to obtain and determine, this coordinate can be used for determining expressing one's feelings the loading position of special efficacy animation, improve Consumer's Experience, decrease operating procedure.

205, transmission expression special efficacy animation and loading position are to other electronic equipments.

Concrete, expression special efficacy animation and loading position are sent to and carry out other mutual electronic equipments of instant video with this electronic equipment, this message can be loaded in the transparent transmission message between this electronic equipment and other electronic equipments, realize expression special efficacy animation and loading position data to be sent to the process of carrying out other mutual electronic equipments of instant video with this electronic equipment by this transparent transmission message, this expression special efficacy animation and loading position data can be the characteristic parameter of express one's feelings special efficacy animation and loading position, can also be the instruction of expression special efficacy animation and the instruction of loading position characteristic parameter.

Optionally, the load instructions of this expression special efficacy animation and loading position can also be sent to and carry out other mutual electronic equipments of instant video with this electronic equipment, maybe the load instructions of this expression special efficacy animation and loading position are forwarded to other electronic equipments through server.

Wherein, the load instructions data of expression special efficacy animation are uniquely corresponding with expression special efficacy animation.

By sending expression special efficacy animation instructions and the instruction of loading position characteristic parameter, compared to transmission expression special efficacy animation itself, shared by special efficacy instruction, internal memory is less, and transmission speed is faster, so, other mutual electronic equipments of instant video or server can be carried out by the load instructions of this expression special efficacy animation and loading position being sent to this electronic equipment, improving synchronism and the efficiency of the loading of expression special efficacy, improving Consumer's Experience.

Optionally, method also comprises

206, according to loading position, expression special efficacy animation is loaded, and the instant video frame after display loading expression special efficacy animation.

Concrete, electronic equipment is expressed one's feelings according to the expression special efficacy that user triggers after load instructions, and electronic equipment will identify that the expression special efficacy animation obtained is loaded on loading position.

The load instructions that electronic equipment triggers according to user, carry out expression special efficacy animation to be loaded on loading position at the load-on module of self, meanwhile, by transparent transmission message the expression special efficacy animation of loading and the characteristic parameter of loading position can be sent to and carry out other mutual electronic equipments of instant video with this electronic equipment.

Optionally, server is according to the characteristic parameter of load instructions and loading position, expression special efficacy animation is loaded on loading position, again the video of the expression special efficacy animation of this loading is sent to the electronic equipment carrying out video interactive, and makes this expression special efficacy animation of display screen display at electronic equipment.

Owing to can be performed the step of special efficacy loading by server, perform the step loading special efficacy compared to electronic equipment, which can save system resource and the process resource of electronic equipment.

Simultaneously, expression special efficacy animation is loaded by server, because server can store all special effects data, so used server to carry out the loading of special effects data, compare the loading being carried out special effects data by electronic equipment, under the scene of the non-storage area special effects data of electronic equipment, save storage resources and the Internet resources of electronic equipment.

Optionally, method also comprises:

207, the elimination instruction of user's input is obtained.

Concrete, electronic equipment obtains the elimination instruction of user's input by the receiver module of self, and can also obtain the elimination instruction of user's input by other means, the mode of the embodiment of the present invention to the elimination instruction that concrete acquisition user inputs is not limited.

Wherein, elimination instruction is used to indicate the expression special efficacy animation that user will eliminate.

User by clicking the elimination icon in video clip, can click the special efficacy animation that will eliminate and eliminating.

In addition, user can also by clicking the function key triggering elimination instruction having and return function, and the embodiment of the present invention is not limited concrete icon and icon position.

208, the special efficacy animation eliminated indicated by instruction is deleted.

Concrete, delete this special effects data corresponding to expression special efficacy animation shown in elimination instruction.

By according to the instruction eliminating instruction, eliminate special efficacy animation, thus user can be eliminated the expression special efficacy animation loaded or cancel, meet the individual demand of user further, improve user-interaction experience.

209, elimination instruction is sent to other electronic equipments.

Concrete, electronic equipment sends elimination instruction by the sending module of self to other electronic equipments, and can also send to other electronic equipments by other means and eliminate instruction, the embodiment of the present invention is not limited concrete mode.

Method provided by the present invention is further understood in order to make those skilled in the art, expression special efficacy animation loading method in a kind of instant video provided the embodiment of the present invention below in conjunction with accompanying drawing is further described, with reference to shown in Fig. 3, suppose that the expression of active user is for angry, after the expression being identified as active user is anger, angry multipair expression special efficacy animation of answering is loaded in the instant video interface shown in the 1st frame in figure 3, with this expression special efficacy animation continue frame number be that 5 frames are described, in figure 3, after identifying that the expression of active user is anger in instant video frame before the 1st frame and the 1st frame, to the expression animation special efficacy that five instant video frames after the 1st frame load, and after the 6th frame, return to the instant video interface not loading expression special efficacy animation as shown in the 1st frame.

Optionally, can also with reference to shown in Fig. 4, suppose that the expression of carrying out the mutual user of instant video with active user is shy, the expression being identified as this user be shy after, the expression special efficacy animation of shy correspondence is loaded in the instant video interface shown in the 1st frame in the diagram, with this expression special efficacy animation continue frame number be that 4 frames are described, in the diagram, identify in instant video frame before the 1st frame and the 1st frame the expression of active user be shy after, to the expression animation special efficacy that five instant video frames after the 1st frame load, and after the 5th frame, return to the instant video interface not loading expression special efficacy animation as shown in the 1st frame.

It should be noted that, in instant video interactive process, suppose that the user processing instant video mutual is respectively first user and the second user, if identify, the expression of first user is angry, then the instant video interface shown by electronic equipment of the second user can be as shown in Figure 3, first user is by clicking the small video window in the upper right corner, instant video interface shown in the 1st frame in Fig. 3, after the user realized in instant video interface switches, the instant video interface shown by the electronic equipment of first user also can be as shown in Figure 3; Under part scene, if identify, the expression of first user is angry, identify that the expression of the second user is shy, then the instant video interface shown by electronic equipment of the second user can as shown in Figure 3, and the instant video interface shown by the electronic equipment of first user can be as shown in Figure 4.

The invention provides the expression special efficacy loading method in a kind of instant video, by identifying the human face expression in instant video frame, generate recognition result, according to recognition result, the expression special efficacy animation of acquisition is loaded on the loading position in instant video, achieves and carry out the loading of expression special efficacy in instant video, meet user and carry out interactive demand by loading expression special efficacy animation in video calling, add video interactive form, improve Consumer's Experience; On the other hand, by determine the loading position corresponding with expression special efficacy animation in current video frame after, expression special efficacy animation is loaded on the loading position in instant video, thus it is more accurate that expression special efficacy animation is loaded in video, improves Consumer's Experience; Meanwhile, make to load expression special efficacy animation and can follow the movement of personage's head portrait and constantly identify this position, make expression special efficacy animation can follow the change of personage and change accordingly, improve Consumer's Experience; In addition, by identifying the human face expression in instant video frame, recognition result is generated, obtain the expression special efficacy animation that will load according to recognition result, carry out automatically loading expression special efficacy animation, compared with the mode of manual loading, simplify operating procedure, improve Consumer's Experience.In addition, the embodiment of the present invention is by determining that textural characteristics carrys out face details, because texture characteristic points describes characteristic point region, so texture characteristic points may be used for uniquely determining characteristic point, make the face minutia parameter determining describing human face expression according to characteristic point and texture characteristic points, thus can ensure that characteristic point in instant video and fact characteristic point are in same position, ensure that the identification quality of image detail, thus improve the reliability obtaining face details parameter.Simultaneously, the embodiment of the present invention by obtaining at least one characteristic point and at least one texture characteristic points in standard attitude matrix, thus eliminate the impact of the extraneous factor such as illumination, angle on instant video face, make the characteristic point of acquisition and texture characteristic points more be added with comparativity, make to obtain expression special efficacy animation by the expression identified in instant video more accurate.In addition, the embodiment of the present invention can determine with the similarity of the human face expression special efficacy animation prestored the expression special efficacy animation that this human face expression is corresponding by obtaining human face expression, thus improve the efficiency of the acquisition of expression special efficacy animation, avoid owing to not having and the expression special efficacy animation that meets completely of some human face expression and the situation that cannot obtain, improve Consumer's Experience effect.Simultaneously, when the embodiment of the present invention is by obtaining the face details for describing this human face expression, by obtaining face details parameter acquiring face details, and obtain face details parameter by face minutia point coordinates and textural characteristics point coordinates and determine, so, so determine the coordinate of face details while determining face details parameter, thus make the mode obtaining loading position more accurately succinct, do not need again to obtain and determine, this coordinate can be used for determining expressing one's feelings the loading position of special efficacy animation, improve Consumer's Experience, decrease operating procedure.Simultaneously, the embodiment of the present invention is by sending expression special efficacy animation instructions and the instruction of loading position characteristic parameter, compared to transmission expression special efficacy animation itself, shared by special efficacy instruction, internal memory is less, and transmission speed is faster, so, other mutual electronic equipments of instant video or server can be carried out by the load instructions of this expression special efficacy animation and loading position being sent to this electronic equipment, improve synchronism and the efficiency of the loading of expression special efficacy, improve Consumer's Experience.Simultaneously, expression special efficacy animation is loaded by server, because server can store all special effects data, so used server to carry out the loading of special effects data, compare the loading being carried out special effects data by electronic equipment, under the scene of the non-storage area special effects data of electronic equipment, save storage resources and the Internet resources of electronic equipment.In addition, the embodiment of the present invention, by according to the instruction eliminating instruction, is eliminated special efficacy animation, thus user can be eliminated the expression special efficacy animation loaded or cancel, meet the individual demand of user further, improve user-interaction experience.

Embodiment three

Embodiments provide a kind of expression Special display effect method in instant video, shown in Figure 5, method flow comprises:

501, expression special efficacy animation and the loading position of the transmission of other electronic equipments is received.

Concrete, electronic equipment can receive expression special efficacy animation and the loading position of the transmission of other electronic equipments, also after this electronic equipment obtains expression special efficacy animation and loading position according to the human face expression in instant video frame, then this expression special efficacy animation and loading position can be obtained.

502, expression special efficacy animation is loaded on loading position, and the instant video after display loading expression special efficacy animation.

Wherein, loading position is other electronic equipments according to after determining in current video frame, be sent to this electronic equipment again, expression special efficacy animation is other electronic equipments by after to carry out identification acquisition to the human face expression in instant video frame, then is sent to this electronic equipment.

Optionally, if electronic equipment sends expression special efficacy animation load instructions and loading position, then can also comprise:

601, expression special efficacy animation instructions and the loading position of electronic equipment transmission is received.

Concrete, this step is identical with step 301, is or else repeated herein.

602, according to this expression special efficacy animation instructions, judge whether this electronic equipment stores this special efficacy animation indicated by expression special efficacy animation instructions, if store this special efficacy animation indicated by expression special efficacy animation instructions, then perform step 603; If do not store, then perform step 604.

Concrete, can be contrasted by multiple expression special efficacy animation instructions that this expression special efficacy animation instructions and this electronic equipment are prestored, judge whether this electronic equipment stores this special efficacy indicated by expression special efficacy animation instructions, and the embodiment of the present invention is not limited concrete judgment mode.

603, the expression special efficacy animation indicated by this expression special efficacy animation instructions is loaded on the loading position determined.

Concrete, this step is identical with step 302, is or else repeated herein.

604, download the special efficacy animation indicated by this expression special efficacy animation instructions from server, and after step 604, perform step 603.

Concrete, the embodiment of the present invention is not limited concrete downloading process.

Because expression special efficacy animation can be downloaded from server, thus decrease electronic equipment and server owing to needing to store the memory space of a large amount of special efficacy animations and at substantial, thus improve Consumer's Experience, accelerate transmission speed.

Embodiments provide a kind of expression Special display effect method in instant video, by identifying the human face expression in instant video frame, generate recognition result, according to recognition result, the expression special efficacy animation of acquisition is loaded on the loading position in instant video, achieves and carry out the loading of expression special efficacy in instant video, meet user and carry out interactive demand by loading expression special efficacy animation in video calling, add video interactive form, improve Consumer's Experience; On the other hand, by determine the loading position corresponding with expression special efficacy animation in current video frame after, expression special efficacy animation is loaded on the loading position in instant video, thus it is more accurate that expression special efficacy animation is loaded in video, improves Consumer's Experience; Meanwhile, make to load expression special efficacy animation and can follow the movement of personage's head portrait and constantly identify this position, make expression special efficacy animation can follow the change of personage and change accordingly, improve Consumer's Experience; In addition, by identifying the human face expression in instant video frame, recognition result is generated, obtain the expression special efficacy animation that will load according to recognition result, carry out automatically loading expression special efficacy animation, compared with the mode of manual loading, simplify operating procedure, improve Consumer's Experience.

Embodiment four

Embodiments provide a kind of electronic equipment 6, shown in Figure 6, electronic equipment 6 comprises:

Identification module 61, for identifying the human face expression in instant video frame, generates recognition result;

Acquisition module 62, for according to recognition result, obtains the expression special efficacy animation that will load;

Determination module 63, for determining the loading position of expression special efficacy animation in instant frame of video;

Sending module 64, for send expression special efficacy animation and loading position to other electronic equipments.

Load-on module 65, for according to loading position, loads expression special efficacy animation;

Display module 66, for showing the instant video after loading expression special efficacy animation.

Optionally, identification module 61 specifically for:

Obtain the face details parameter in instant video frame;

According to face details parameter, obtain the human face expression in current instant video frame.

Optionally, acquisition module 62 specifically for:

According to human face expression, obtain the expression special efficacy animation corresponding with human face expression.

Optionally, acquisition module 63 also specifically for:

According to the face details parameter in instant video frame, obtain the loading position of expression special efficacy animation in instant frame of video.

Optionally,

Equipment also comprises acquisition module, for obtaining the elimination instruction of user's input;

Equipment also comprises removing module, for deleting the special efficacy animation eliminated indicated by instruction;

Sending module 64 also eliminates instruction for sending to other electronic equipments.

Embodiments provide a kind of electronic equipment, by identifying the human face expression in instant video frame, generate recognition result, according to recognition result, the expression special efficacy animation of acquisition is loaded on the loading position in instant video, achieves and carry out the loading of expression special efficacy in instant video, meet user and carry out interactive demand by loading expression special efficacy animation in video calling, add video interactive form, improve Consumer's Experience; On the other hand, by determine the loading position corresponding with expression special efficacy animation in current video frame after, expression special efficacy animation is loaded on the loading position in instant video, thus it is more accurate that expression special efficacy animation is loaded in video, improves Consumer's Experience; Meanwhile, make to load expression special efficacy animation and can follow the movement of personage's head portrait and constantly identify this position, make expression special efficacy animation can follow the change of personage and change accordingly, improve Consumer's Experience; In addition, by identifying the human face expression in instant video frame, recognition result is generated, obtain the expression special efficacy animation that will load according to recognition result, carry out automatically loading expression special efficacy animation, compared with the mode of manual loading, simplify operating procedure, improve Consumer's Experience.

Embodiment five

Embodiments provide a kind of electronic equipment 7, shown in Figure 7, comprise: video input module 71, Video Output Modules 72, sending module 73, receiver module 74, memory 75 and the processor 76 be connected with video input module 71, Video Output Modules 72, sending module 73, receiver module 74 and memory 75, wherein, memory 75 stores batch processing code, processor 76, for calling the program code stored in memory 75, performs following operation:

Identify the human face expression in instant video frame, generate recognition result;

According to recognition result, obtain the expression special efficacy animation that will load;

Determine the loading position of expression special efficacy animation in instant frame of video;

Control sending module 73 transmission expression special efficacy animation and loading position are to other electronic equipments;

Wherein, processor 76 calls the program code stored in memory 75 and also receives instant video frame for controlling video input module 71.

Optionally, processor 76, for calling the program code stored in memory 75, performs following operation:

Obtain the face details parameter in instant video frame;

According to face details parameter, obtain the human face expression in current instant video frame.

Optionally, processor 76, for calling the program code stored in memory 75, performs following operation:

According to human face expression, obtain the expression special efficacy animation corresponding with human face expression.

Optionally, processor 76, for calling the program code stored in memory 75, performs following operation:

According to the face details parameter in instant video frame, obtain the loading position of expression special efficacy animation in instant frame of video.

Optionally, processor 76, for calling the program code stored in memory 75, performs following operation:

According to loading position, load expression special efficacy animation, and control the instant video frame after Video Output Modules 72 display loading expression special efficacy animation.

Optionally, processor 76, for calling the program code stored in memory 75, performs following operation:

Control the elimination instruction that receiver module 74 obtains user's input;

Delete the special efficacy animation eliminated indicated by instruction;

Control sending module 73 and send elimination instruction to other electronic equipments.

Embodiments provide a kind of electronic equipment, by identifying the human face expression in instant video frame, generate recognition result, according to recognition result, the expression special efficacy animation of acquisition is loaded on the loading position in instant video, achieves and carry out the loading of expression special efficacy in instant video, meet user and carry out interactive demand by loading expression special efficacy animation in video calling, add video interactive form, improve Consumer's Experience; On the other hand, by determine the loading position corresponding with expression special efficacy animation in current video frame after, expression special efficacy animation is loaded on the loading position in instant video, thus it is more accurate that expression special efficacy animation is loaded in video, improves Consumer's Experience; Meanwhile, make to load expression special efficacy animation and can follow the movement of personage's head portrait and constantly identify this position, make expression special efficacy animation can follow the change of personage and change accordingly, improve Consumer's Experience; In addition, by identifying the human face expression in instant video frame, recognition result is generated, obtain the expression special efficacy animation that will load according to recognition result, carry out automatically loading expression special efficacy animation, compared with the mode of manual loading, simplify operating procedure, improve Consumer's Experience.

Embodiment six

Embodiments provide a kind of electronic equipment 8, shown in Figure 8, electronic equipment 6 comprises:

Receiver module 81, for receiving expression special efficacy animation and the loading position of the transmission of other electronic equipments;

Load-on module 82, for being loaded on loading position by expression special efficacy animation;

Display module 83, for showing the instant video frame after loading expression special efficacy animation;

Wherein, loading position is other electronic equipments according to after determining in current video frame, be sent to this electronic equipment again, expression special efficacy animation is other electronic equipments by after to carry out identification acquisition to the human face expression in instant video frame, then is sent to this electronic equipment.

Optionally, electronic equipment 8 also comprises:

Described receiver module is also for receiving the elimination instruction that other electronic equipments send;

Described load-on module is also for deleting the special efficacy animation indicated by described elimination instruction.

Embodiments provide a kind of electronic equipment, by identifying the human face expression in instant video frame, generate recognition result, according to recognition result, the expression special efficacy animation of acquisition is loaded on the loading position in instant video, achieves and carry out the loading of expression special efficacy in instant video, meet user and carry out interactive demand by loading expression special efficacy animation in video calling, add video interactive form, improve Consumer's Experience; On the other hand, by determine the loading position corresponding with expression special efficacy animation in current video frame after, expression special efficacy animation is loaded on the loading position in instant video, thus it is more accurate that expression special efficacy animation is loaded in video, improves Consumer's Experience; Meanwhile, make to load expression special efficacy animation and can follow the movement of personage's head portrait and constantly identify this position, make expression special efficacy animation can follow the change of personage and change accordingly, improve Consumer's Experience; In addition, by identifying the human face expression in instant video frame, recognition result is generated, obtain the expression special efficacy animation that will load according to recognition result, carry out automatically loading expression special efficacy animation, compared with the mode of manual loading, simplify operating procedure, improve Consumer's Experience.

Embodiment seven

Embodiments provide a kind of electronic equipment, shown in Figure 9, the processor 94 comprising Video Output Modules 91, transmission/reception module 92, memory 93 and be connected with Video Output Modules 91, transmission/reception module 92 and memory 93, wherein, memory 93 stores batch processing code, processor 94, for calling the program code stored in memory 93, performs following operation:

Receive expression special efficacy animation and the loading position of the transmission of other electronic equipments;

Expression special efficacy animation is loaded on loading position, and controls the instant video frame after Video Output Modules 91 display loading expression special efficacy animation;

Wherein, loading position is other electronic equipments according to after determining in current video frame, be sent to this electronic equipment again, expression special efficacy animation is other electronic equipments by after to carry out identification acquisition to the human face expression in instant video frame, then is sent to this electronic equipment.

Optionally, processor 94, for calling the program code stored in memory 93, performs following operation:

Receive the elimination instruction that other electronic equipments send;

Delete the special efficacy animation indicated by described elimination instruction.

Embodiments provide the special efficacy loading method in a kind of instant video, by identifying the human face expression in instant video frame, generate recognition result, according to recognition result, the expression special efficacy animation of acquisition is loaded on the loading position in instant video, achieves and carry out the loading of expression special efficacy in instant video, meet user and carry out interactive demand by loading expression special efficacy animation in video calling, add video interactive form, improve Consumer's Experience; On the other hand, by determine the loading position corresponding with expression special efficacy animation in current video frame after, expression special efficacy animation is loaded on the loading position in instant video, thus it is more accurate that expression special efficacy animation is loaded in video, improves Consumer's Experience; Meanwhile, make to load expression special efficacy animation and can follow the movement of personage's head portrait and constantly identify this position, make expression special efficacy animation can follow the change of personage and change accordingly, improve Consumer's Experience; In addition, by identifying the human face expression in instant video frame, recognition result is generated, obtain the expression special efficacy animation that will load according to recognition result, carry out automatically loading expression special efficacy animation, compared with the mode of manual loading, simplify operating procedure, improve Consumer's Experience.

It should be noted that: the electronic equipment that above-described embodiment provides is when triggering the expression special efficacy loading method in instant video, only be illustrated with the division of above-mentioned each functional module, in practical application, can distribute as required and by above-mentioned functions and be completed by different functional modules, internal structure by electronic equipment is divided into different functional modules, to complete all or part of function described above.In addition, the expression special efficacy animation loading method embodiment in the electronic equipment that above-described embodiment provides and instant video belongs to same design, and its specific implementation process refers to embodiment of the method, repeats no more here.

One of ordinary skill in the art will appreciate that all or part of step realizing above-described embodiment can have been come by hardware, the hardware that also can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, the above-mentioned storage medium mentioned can be read-only memory, disk or CD etc.

The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (10)

1. the expression special efficacy animation loading method in instant video, it is characterized in that, described method comprises:
Identify the human face expression in instant video frame, generate recognition result;
According to described recognition result, obtain the expression special efficacy animation that will load;
Determine the loading position of described expression special efficacy animation in instant frame of video;
Send described expression special efficacy animation and described loading position to other electronic equipments.
2. method according to claim 1, is characterized in that, the human face expression in described identification instant video frame comprises:
Obtain the face details parameter in instant video frame;
According to described face details parameter, obtain the human face expression in current instant video frame.
3. method according to claim 2, is characterized in that, described according to described recognition result, obtains the expression special efficacy animation that will load and comprises:
According to described human face expression, obtain the expression special efficacy animation corresponding with described human face expression.
4. according to the method in claim 2 or 3, it is characterized in that, describedly determine that the loading position of described expression special efficacy animation in instant frame of video comprises:
According to the face details parameter in described instant video frame, obtain the loading position of described expression special efficacy animation in instant frame of video.
5. method according to claim 4, is characterized in that, described method also comprises:
According to described loading position, load described expression special efficacy animation, and the instant video frame after display loading expression special efficacy animation.
6. method according to claim 5, is characterized in that, described method also comprises:
Obtain the elimination instruction of user's input;
Delete the special efficacy animation indicated by described elimination instruction;
Described elimination instruction is sent to other electronic equipments described.
7. an electronic equipment, is characterized in that, described electronic equipment comprises:
Identification module, for identifying the human face expression in instant video frame, generates recognition result;
Acquisition module, for according to described recognition result, obtains the expression special efficacy animation that will load;
Determination module, for determining the loading position of described expression special efficacy animation in instant frame of video;
Sending module, for sending described expression special efficacy animation and described loading position to other electronic equipments;
Load-on module, for according to described loading position, loads described expression special efficacy animation;
Display module, for showing the described instant video frame loaded after expression special efficacy animation.
8. the expression Special display effect method in instant video, it is characterized in that, described method comprises:
Receive expression special efficacy animation and the loading position of the transmission of other electronic equipments;
Described expression special efficacy animation is loaded on described loading position, and shows the instant video frame after described loading expression special efficacy animation;
Wherein, described loading position is determined in current video frame, and described expression special efficacy animation obtains by carrying out the human face expression in instant video frame identifying.
9. method according to claim 8, is characterized in that, described method also comprises:
Receive the elimination instruction that other electronic equipments described send;
Delete the special efficacy animation indicated by described elimination instruction.
10. an electronic equipment, is characterized in that, described electronic equipment comprises:
Receiver module, for receiving expression special efficacy animation and the loading position of the transmission of other electronic equipments;
Load-on module, for being loaded on described loading position by described expression special efficacy animation;
Display module, for showing the described instant video frame loaded after expression special efficacy animation;
Wherein, described loading position is determined in current video frame, and described expression special efficacy animation obtains by carrying out the human face expression in instant video frame identifying.
CN201510181435.5A 2015-04-16 2015-04-16 Method and electronic equipment for loading expression effect animation in instant video CN104780339A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510181435.5A CN104780339A (en) 2015-04-16 2015-04-16 Method and electronic equipment for loading expression effect animation in instant video

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510181435.5A CN104780339A (en) 2015-04-16 2015-04-16 Method and electronic equipment for loading expression effect animation in instant video
PCT/CN2016/079116 WO2016165615A1 (en) 2015-04-16 2016-04-13 Expression specific animation loading method in real-time video and electronic device

Publications (1)

Publication Number Publication Date
CN104780339A true CN104780339A (en) 2015-07-15

Family

ID=53621551

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510181435.5A CN104780339A (en) 2015-04-16 2015-04-16 Method and electronic equipment for loading expression effect animation in instant video

Country Status (2)

Country Link
CN (1) CN104780339A (en)
WO (1) WO2016165615A1 (en)

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105068748A (en) * 2015-08-12 2015-11-18 上海影随网络科技有限公司 User interface interaction method in camera real-time picture of intelligent touch screen equipment
CN105407313A (en) * 2015-10-28 2016-03-16 掌赢信息科技(上海)有限公司 Video calling method, equipment and system
CN105451029A (en) * 2015-12-02 2016-03-30 广州华多网络科技有限公司 Video image processing method and device
CN105578110A (en) * 2015-11-19 2016-05-11 掌赢信息科技(上海)有限公司 Video call method, device and system
CN105812699A (en) * 2016-03-18 2016-07-27 联想(北京)有限公司 Method for generating dynamic pictures and electronic device
CN105847734A (en) * 2016-03-30 2016-08-10 宁波三博电子科技有限公司 Face recognition-based video communication method and system
CN105847735A (en) * 2016-03-30 2016-08-10 宁波三博电子科技有限公司 Face recognition-based instant pop-up screen video communication method and system
CN105872442A (en) * 2016-03-30 2016-08-17 宁波三博电子科技有限公司 Instant bullet screen gift giving method and instant bullet screen gift giving system based on face recognition
CN105898182A (en) * 2016-03-30 2016-08-24 宁波三博电子科技有限公司 Bullet screen song-requesting method and system based on face identification
WO2016165615A1 (en) * 2015-04-16 2016-10-20 美国掌赢信息科技有限公司 Expression specific animation loading method in real-time video and electronic device
CN106060572A (en) * 2016-06-08 2016-10-26 乐视控股(北京)有限公司 Video playing method and device
CN106331526A (en) * 2016-08-30 2017-01-11 北京奇艺世纪科技有限公司 Spliced animation generating and playing method and device
CN106331880A (en) * 2016-09-09 2017-01-11 腾讯科技(深圳)有限公司 Information processing method and information processing system
CN106373170A (en) * 2016-08-31 2017-02-01 北京云图微动科技有限公司 Video making method and video making device
WO2017084483A1 (en) * 2015-11-17 2017-05-26 腾讯科技(深圳)有限公司 Video call method and device
CN106778706A (en) * 2017-02-08 2017-05-31 康梅 A kind of real-time mask video display method based on Expression Recognition
CN106804007A (en) * 2017-03-20 2017-06-06 合网络技术(北京)有限公司 The method of Auto-matching special efficacy, system and equipment in a kind of network direct broadcasting
CN107071580A (en) * 2017-03-20 2017-08-18 北京潘达互娱科技有限公司 Data processing method and device
CN107071330A (en) * 2017-02-28 2017-08-18 维沃移动通信有限公司 A kind of interactive method of video calling and mobile terminal
CN107124658A (en) * 2017-05-02 2017-09-01 北京小米移动软件有限公司 Net cast method and device
CN107318054A (en) * 2016-04-26 2017-11-03 富泰华工业(深圳)有限公司 Audio-visual automated processing system and method
CN107592474A (en) * 2017-09-14 2018-01-16 光锐恒宇(北京)科技有限公司 A kind of image processing method and device
CN107657652A (en) * 2017-09-11 2018-02-02 广东欧珀移动通信有限公司 Image processing method and device
CN107911643A (en) * 2017-11-30 2018-04-13 维沃移动通信有限公司 Show the method and apparatus of scene special effect in a kind of video communication
CN107948667A (en) * 2017-12-05 2018-04-20 广州酷狗计算机科技有限公司 The method and apparatus that special display effect is added in live video
CN108076370A (en) * 2017-02-13 2018-05-25 北京市商汤科技开发有限公司 Information transferring method, device and electronic equipment
CN108200373A (en) * 2017-12-29 2018-06-22 珠海市君天电子科技有限公司 Image processing method, device, electronic equipment and medium
WO2018153284A1 (en) * 2017-02-21 2018-08-30 腾讯科技(深圳)有限公司 Video processing method, terminal and storage medium

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003037826A (en) * 2001-07-23 2003-02-07 Alpine Electronics Inc Substitute image display and tv phone apparatus
CN201066884Y (en) * 2007-05-16 2008-05-28 北京思比科微电子技术有限公司 A device for realizing dynamic image processing
KR20080057030A (en) * 2006-12-19 2008-06-24 엘지전자 주식회사 Apparatus and method for image communication inserting emoticon
CN101247482A (en) * 2007-05-16 2008-08-20 北京思比科微电子技术有限公司 Method and device for implementing dynamic image processing
US20100134588A1 (en) * 2008-12-01 2010-06-03 Samsung Electronics Co., Ltd. Method and apparatus for providing animation effect on video telephony call
CN101877056A (en) * 2009-12-21 2010-11-03 北京中星微电子有限公司 Facial expression recognition method and system, and training method and system of expression classifier
KR20110025720A (en) * 2009-09-05 2011-03-11 에스케이텔레콤 주식회사 Method for video call based on an avatar and system, apparatus thereof
KR20110030223A (en) * 2009-09-17 2011-03-23 엘지전자 주식회사 Mobile terminal and control method thereof
CN102055912A (en) * 2009-10-29 2011-05-11 北京中星微电子有限公司 Video application system, video special effect processing system and method
CN102271241A (en) * 2011-09-02 2011-12-07 北京邮电大学 An image communication method and system for facial / action recognition based on
US20120069028A1 (en) * 2010-09-20 2012-03-22 Yahoo! Inc. Real-time animations of emoticons using facial recognition during a video chat
CN102455898A (en) * 2010-10-29 2012-05-16 张明 Cartoon expression based auxiliary entertainment system for video chatting
CN102638658A (en) * 2012-03-01 2012-08-15 盛乐信息技术(上海)有限公司 Method and system for editing audio-video
KR20120120858A (en) * 2011-04-25 2012-11-02 강준규 Service and method for video call, server and terminal thereof
KR20130096983A (en) * 2012-02-23 2013-09-02 삼성전자주식회사 Method and apparatus for processing video information including face
CN103297742A (en) * 2012-02-27 2013-09-11 联想(北京)有限公司 Data processing method, microprocessor, communication terminal and server
CN103369288A (en) * 2012-03-29 2013-10-23 深圳市腾讯计算机系统有限公司 Instant communication method based on network video and system thereof

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7379071B2 (en) * 2003-10-14 2008-05-27 Microsoft Corporation Geometry-driven feature point-based image synthesis
CN101287093B (en) * 2008-05-30 2010-06-09 北京中星微电子有限公司 Method for adding special effect in video communication and video customer terminal
US9747495B2 (en) * 2012-03-06 2017-08-29 Adobe Systems Incorporated Systems and methods for creating and distributing modifiable animated video messages
CN104780339A (en) * 2015-04-16 2015-07-15 美国掌赢信息科技有限公司 Method and electronic equipment for loading expression effect animation in instant video

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003037826A (en) * 2001-07-23 2003-02-07 Alpine Electronics Inc Substitute image display and tv phone apparatus
KR20080057030A (en) * 2006-12-19 2008-06-24 엘지전자 주식회사 Apparatus and method for image communication inserting emoticon
CN201066884Y (en) * 2007-05-16 2008-05-28 北京思比科微电子技术有限公司 A device for realizing dynamic image processing
CN101247482A (en) * 2007-05-16 2008-08-20 北京思比科微电子技术有限公司 Method and device for implementing dynamic image processing
US20100134588A1 (en) * 2008-12-01 2010-06-03 Samsung Electronics Co., Ltd. Method and apparatus for providing animation effect on video telephony call
KR20110025720A (en) * 2009-09-05 2011-03-11 에스케이텔레콤 주식회사 Method for video call based on an avatar and system, apparatus thereof
KR20110030223A (en) * 2009-09-17 2011-03-23 엘지전자 주식회사 Mobile terminal and control method thereof
CN102055912A (en) * 2009-10-29 2011-05-11 北京中星微电子有限公司 Video application system, video special effect processing system and method
CN101877056A (en) * 2009-12-21 2010-11-03 北京中星微电子有限公司 Facial expression recognition method and system, and training method and system of expression classifier
US20120069028A1 (en) * 2010-09-20 2012-03-22 Yahoo! Inc. Real-time animations of emoticons using facial recognition during a video chat
CN102455898A (en) * 2010-10-29 2012-05-16 张明 Cartoon expression based auxiliary entertainment system for video chatting
KR20120120858A (en) * 2011-04-25 2012-11-02 강준규 Service and method for video call, server and terminal thereof
CN102271241A (en) * 2011-09-02 2011-12-07 北京邮电大学 An image communication method and system for facial / action recognition based on
KR20130096983A (en) * 2012-02-23 2013-09-02 삼성전자주식회사 Method and apparatus for processing video information including face
CN103297742A (en) * 2012-02-27 2013-09-11 联想(北京)有限公司 Data processing method, microprocessor, communication terminal and server
CN102638658A (en) * 2012-03-01 2012-08-15 盛乐信息技术(上海)有限公司 Method and system for editing audio-video
CN103369288A (en) * 2012-03-29 2013-10-23 深圳市腾讯计算机系统有限公司 Instant communication method based on network video and system thereof

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016165615A1 (en) * 2015-04-16 2016-10-20 美国掌赢信息科技有限公司 Expression specific animation loading method in real-time video and electronic device
CN105068748A (en) * 2015-08-12 2015-11-18 上海影随网络科技有限公司 User interface interaction method in camera real-time picture of intelligent touch screen equipment
CN105407313A (en) * 2015-10-28 2016-03-16 掌赢信息科技(上海)有限公司 Video calling method, equipment and system
US10218937B2 (en) 2015-11-17 2019-02-26 Tencent Technology (Shenzhen) Company Limited Video calling method and apparatus
WO2017084483A1 (en) * 2015-11-17 2017-05-26 腾讯科技(深圳)有限公司 Video call method and device
CN105578110B (en) * 2015-11-19 2019-03-19 掌赢信息科技(上海)有限公司 A kind of video call method
CN105578110A (en) * 2015-11-19 2016-05-11 掌赢信息科技(上海)有限公司 Video call method, device and system
CN105451029A (en) * 2015-12-02 2016-03-30 广州华多网络科技有限公司 Video image processing method and device
CN105812699A (en) * 2016-03-18 2016-07-27 联想(北京)有限公司 Method for generating dynamic pictures and electronic device
CN105812699B (en) * 2016-03-18 2019-06-25 联想(北京)有限公司 A kind of generation dynamic picture method and electronic equipment
CN105898182A (en) * 2016-03-30 2016-08-24 宁波三博电子科技有限公司 Bullet screen song-requesting method and system based on face identification
CN105872442A (en) * 2016-03-30 2016-08-17 宁波三博电子科技有限公司 Instant bullet screen gift giving method and instant bullet screen gift giving system based on face recognition
CN105847735A (en) * 2016-03-30 2016-08-10 宁波三博电子科技有限公司 Face recognition-based instant pop-up screen video communication method and system
CN105847734A (en) * 2016-03-30 2016-08-10 宁波三博电子科技有限公司 Face recognition-based video communication method and system
CN107318054A (en) * 2016-04-26 2017-11-03 富泰华工业(深圳)有限公司 Audio-visual automated processing system and method
CN106060572A (en) * 2016-06-08 2016-10-26 乐视控股(北京)有限公司 Video playing method and device
CN106331526A (en) * 2016-08-30 2017-01-11 北京奇艺世纪科技有限公司 Spliced animation generating and playing method and device
CN106331526B (en) * 2016-08-30 2019-11-15 北京奇艺世纪科技有限公司 A kind of splicing animation producing, playback method and device
CN106373170A (en) * 2016-08-31 2017-02-01 北京云图微动科技有限公司 Video making method and video making device
CN106331880A (en) * 2016-09-09 2017-01-11 腾讯科技(深圳)有限公司 Information processing method and information processing system
CN106778706A (en) * 2017-02-08 2017-05-31 康梅 A kind of real-time mask video display method based on Expression Recognition
CN108076370A (en) * 2017-02-13 2018-05-25 北京市商汤科技开发有限公司 Information transferring method, device and electronic equipment
WO2018153284A1 (en) * 2017-02-21 2018-08-30 腾讯科技(深圳)有限公司 Video processing method, terminal and storage medium
CN107071330A (en) * 2017-02-28 2017-08-18 维沃移动通信有限公司 A kind of interactive method of video calling and mobile terminal
CN106804007A (en) * 2017-03-20 2017-06-06 合网络技术(北京)有限公司 The method of Auto-matching special efficacy, system and equipment in a kind of network direct broadcasting
CN107071580A (en) * 2017-03-20 2017-08-18 北京潘达互娱科技有限公司 Data processing method and device
CN107124658A (en) * 2017-05-02 2017-09-01 北京小米移动软件有限公司 Net cast method and device
CN107124658B (en) * 2017-05-02 2019-10-11 北京小米移动软件有限公司 Net cast method and device
CN107657652A (en) * 2017-09-11 2018-02-02 广东欧珀移动通信有限公司 Image processing method and device
CN107592474A (en) * 2017-09-14 2018-01-16 光锐恒宇(北京)科技有限公司 A kind of image processing method and device
CN107911643A (en) * 2017-11-30 2018-04-13 维沃移动通信有限公司 Show the method and apparatus of scene special effect in a kind of video communication
CN107948667A (en) * 2017-12-05 2018-04-20 广州酷狗计算机科技有限公司 The method and apparatus that special display effect is added in live video
CN108200373A (en) * 2017-12-29 2018-06-22 珠海市君天电子科技有限公司 Image processing method, device, electronic equipment and medium

Also Published As

Publication number Publication date
WO2016165615A1 (en) 2016-10-20

Similar Documents

Publication Publication Date Title
Betancourt et al. The evolution of first person vision methods: A survey
US20170111615A1 (en) Communication using avatar
US20170111614A1 (en) Communication using interactive avatars
CN104508684A (en) Setting an operating-system color using a photograph
US20150244916A1 (en) Electronic device and control method of the same
CN104811787A (en) Game video recording method and game video recording device
TW201719567A (en) System and method for avatar management and selection
CN103916589B (en) Method for running video camera and its electronic equipment
WO2016101883A1 (en) Method for face beautification in real-time video and electronic equipment
KR20140039430A (en) Equipment and method for providing a service for sharing a drawing screen between mobile devices and mobile device for the same
US20090262136A1 (en) Methods, Systems, and Products for Transforming and Rendering Media Data
WO2013061505A1 (en) Image processing apparatus, method and computer program product
US8970656B2 (en) Static and dynamic video calling avatars
EP2701152B1 (en) Media object browsing in a collaborative window, mobile client editing, augmented reality rendering.
EP1981254A2 (en) Communication control device and communication terminal
JP2015520881A (en) Drawing method, apparatus, and terminal
JP2016531362A (en) Skin color adjustment method, skin color adjustment device, program, and recording medium
CN105139470A (en) Checking-in method, device and system based on face recognition
CN104488258A (en) Method and apparatus for dual camera shutter
CN105549858B (en) A kind of display methods and user terminal
CN104780458A (en) Method and electronic equipment for loading effects in instant video
CN104780338A (en) Method and electronic equipment for loading expression effect animation in instant video
CN104750450A (en) File sharing method in IM (Instant Messaging) and terminal
WO2013165674A1 (en) Segmentation of 3d point clouds for dense 3d modeling
US20130097535A1 (en) Interaction method, apparatus and terminal for syncretic communication

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20150715