CN109858215A - Resource acquisition, sharing, processing method, device, storage medium and equipment - Google Patents

Resource acquisition, sharing, processing method, device, storage medium and equipment Download PDF

Info

Publication number
CN109858215A
CN109858215A CN201711243183.XA CN201711243183A CN109858215A CN 109858215 A CN109858215 A CN 109858215A CN 201711243183 A CN201711243183 A CN 201711243183A CN 109858215 A CN109858215 A CN 109858215A
Authority
CN
China
Prior art keywords
resource
image
expression
facial expression
facial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201711243183.XA
Other languages
Chinese (zh)
Other versions
CN109858215B (en
Inventor
谢英媛
赵松
汪大伟
蓝中第
管静娴
王坤鹏
吴婷
王子健
伍家灶
高舜东
王雷
孙华昱
胡文灿
謝方鈞
王超
李思华
余立
梁汉熙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201711243183.XA priority Critical patent/CN109858215B/en
Publication of CN109858215A publication Critical patent/CN109858215A/en
Application granted granted Critical
Publication of CN109858215B publication Critical patent/CN109858215B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The present invention relates to a kind of resource acquisition, sharing, processing method, device, storage medium and equipment, which includes: the reception resource sharing message in social session;In response to the resource sharing message, controls multiple facial expression images and successively pass through the specified region in session interface;The session interface corresponds to the social session;It obtains each facial expression image and passes through the facial image accordingly acquired when the session interface;Determine the matching result between each facial expression image and the facial image accordingly acquired;Determine that expression matches iterated integral according to the corresponding matching result of the multiple facial expression image;By the matched share of iterated integral is matched with the expression, resource is obtained from resource corresponding to the resource sharing message.Scheme provided by the present application greatly improves the antagonism to plug-in user.

Description

Resource acquisition, sharing, processing method, device, storage medium and equipment
Technical field
The present invention relates to field of computer technology, more particularly to a kind of resource acquisition, sharing, processing method, device, deposit Storage media and equipment.
Background technique
Resource, including virtual objects and physical item, virtual objects such as account numerical value, integral or electronics coupons Deng.The owner of resource can be shared resource by social networks, only passed through by the user of sharing resource and simply clicked Operation can get the resource of the sharing.For example the numerical value resource in virtual red packet can be obtained by clicking virtual red packet.
However, at present simple clicking operation come by way of obtaining resource, it is easy to be cracked by plug-in, the behaviour of user Make speed to be difficult to be equal to computer always, when plug-in number of users is more than resource quantity, resource moment can be plug-in User obtains, and real user is substantially hopeless to get resource.Therefore resource is obtained by simple clicking operation at present Mode to fight plug-in ability too poor, need to improve.
Summary of the invention
Based on this, it is necessary to for fighting plug-in ability by way of obtaining resource simple clicking operation at present Too poor problem provides a kind of resource acquisition, sharing, processing method, device, storage medium and equipment.
A kind of resource acquiring method, comprising:
Resource sharing message is received in social session;
In response to the resource sharing message, controls multiple facial expression images and successively pass through the specified region in session interface; The session interface corresponds to the social session;
It obtains each facial expression image and passes through the facial image accordingly acquired when the session interface;
Determine the matching result between each facial expression image and the facial image accordingly acquired;
Determine that expression matches iterated integral according to the corresponding matching result of the multiple facial expression image;
By the matched share of iterated integral is matched with the expression, obtained from resource corresponding to the resource sharing message Resource.
A kind of resource acquisition device, comprising:
Receiving module, for receiving resource sharing message in social session;
Control module, for controlling multiple facial expression images and successively passing through session interface in response to the resource sharing message In specified region;The session interface corresponds to the social session;
Image collection module, for obtaining the face figure accordingly acquired when each facial expression image passes through the session interface Picture;
Determining module, for determining each facial expression image and the corresponding matching result between the facial image that acquires;Root Determine that expression matches iterated integral according to the corresponding matching result of the multiple facial expression image;
Source obtaining module matches the matched share of iterated integral with the expression for pressing, from the resource sharing message Resource is obtained in corresponding resource.
A kind of computer readable storage medium is stored with computer program on the computer readable storage medium, described When computer program is executed by processor, so that the processor executes following steps:
Resource sharing message is received in social session;
In response to the resource sharing message, controls multiple facial expression images and successively pass through the specified region in session interface; The session interface corresponds to the social session;
It obtains each facial expression image and passes through the facial image accordingly acquired when the session interface;
Determine the matching result between each facial expression image and the facial image accordingly acquired;
Determine that expression matches iterated integral according to the corresponding matching result of the multiple facial expression image;
By the matched share of iterated integral is matched with the expression, obtained from resource corresponding to the resource sharing message Resource.
A kind of computer equipment, including memory and processor store computer program, the meter in the memory When calculation machine program is executed by the processor, so that the processor executes following steps:
Resource sharing message is received in social session;
In response to the resource sharing message, controls multiple facial expression images and successively pass through the specified region in session interface; The session interface corresponds to the social session;
It obtains each facial expression image and passes through the facial image accordingly acquired when the session interface;
Determine the matching result between each facial expression image and the facial image accordingly acquired;
Determine that expression matches iterated integral according to the corresponding matching result of the multiple facial expression image;
By the matched share of iterated integral is matched with the expression, obtained from resource corresponding to the resource sharing message Resource.
Above-mentioned resource acquiring method, device, storage medium and computer equipment successively pass through meeting using multiple facial expression images The dynamic control mode in the specified region in interface is talked about, acquires facial image and the current facial expression image for passing through session interface in real time It is matched, determines that expression matches iterated integral further according to the corresponding matching result of multiple facial expression images, thus according to expression Accumulative point of matching to obtain resource.General family cooperation is needed to complete living body faces Image Acquisition, and real-time perfoming expression in this way Match to share the mode of resource, greatly improves the antagonism to plug-in user.
A kind of resource sharing method, comprising:
Showing resource, which is shared, in the session interface corresponding to social session matches posting port;
Resource to be shared is configured with posting port by the resource sharing, generates corresponding resource sharing message;
The resource sharing message is sent to the target terminal for participating in the social session;The resource sharing message is used In indicating that the target terminal matches the matched share of iterated integral according to expression, the resource corresponding to the resource sharing message Middle acquisition resource;The expression matches iterated integral, is to specify multiple facial expression images in region respectively according in process session interface It is determined with the matching result between the facial image that accordingly acquires;
Receive the video data and corresponding facial expression image associated data that the target terminal is synchronized;
According to the facial expression image associated data, facial expression image associated with the video data is obtained;
In the session interface, the video data and the associated facial expression image are rendered.
A kind of resource sharing device, comprising:
Display module is shared for showing resource in the session interface corresponding to social session and matches posting port;
Generation module generates corresponding resource for configuring resource to be shared with posting port by the resource sharing Share message;
Sending module, for sending the resource sharing message to the target terminal for participating in the social session;The money Message is shared in source, is used to indicate the target terminal according to expression and matches the matched share of iterated integral, disappears from the resource sharing Resource is obtained in the corresponding resource of breath;The expression matches iterated integral, is according to by specifying the more of region in session interface What a facial expression image was respectively determined with the matching result between the facial image that accordingly acquires;
Receiving module, for receiving the video data and corresponding facial expression image incidence number that the target terminal is synchronized According to;
Module is obtained, for obtaining expression associated with the video data according to the facial expression image associated data Image;
Rendering module, for rendering the video data and the associated facial expression image in the session interface.
A kind of computer readable storage medium is stored with computer program on the computer readable storage medium, described When computer program is executed by processor, so that the processor executes following steps:
Showing resource, which is shared, in the session interface corresponding to social session matches posting port;
Resource to be shared is configured with posting port by the resource sharing, generates corresponding resource sharing message;
The resource sharing message is sent to the target terminal for participating in the social session;The resource sharing message is used In indicating that the target terminal matches the matched share of iterated integral according to expression, the resource corresponding to the resource sharing message Middle acquisition resource;The expression matches iterated integral, is to specify multiple facial expression images in region respectively according in process session interface It is determined with the matching result between the facial image that accordingly acquires;
Receive the video data and corresponding facial expression image associated data that the target terminal is synchronized;
According to the facial expression image associated data, facial expression image associated with the video data is obtained;
In the session interface, the video data and the associated facial expression image are rendered.
A kind of computer equipment, including memory and processor store computer program, the meter in the memory When calculation machine program is executed by the processor, so that the processor executes following steps:
Showing resource, which is shared, in the session interface corresponding to social session matches posting port;
Resource to be shared is configured with posting port by the resource sharing, generates corresponding resource sharing message;
The resource sharing message is sent to the target terminal for participating in the social session;The resource sharing message is used In indicating that the target terminal matches the matched share of iterated integral according to expression, the resource corresponding to the resource sharing message Middle acquisition resource;The expression matches iterated integral, is to specify multiple facial expression images in region respectively according in process session interface It is determined with the matching result between the facial image that accordingly acquires;
Receive the video data and corresponding facial expression image associated data that the target terminal is synchronized;
According to the facial expression image associated data, facial expression image associated with the video data is obtained;
In the session interface, the video data and the associated facial expression image are rendered.
Above-mentioned resource sharing method, device, storage medium and computer equipment disappear sending resource sharing to target terminal After breath, instruction target terminal matches accumulative expression by facial expression image and matches iterated integral, and then obtains resource, and receives target end Hold the video data sent and associated facial expression image associated data, render video data and expression figure in session interface Picture obtains the process of resource to show target terminal by expression matching way.General family cooperation is needed to complete living body people in this way Face image acquiring, and real-time perfoming expression matches to share the mode of resource, greatly improves the confrontation for fighting plug-in user Ability.
A kind of method for processing resource, comprising:
The expression matching that terminal is sent is obtained to start to request;
Start request in response to expression matching and returns to expression matching configuration information to the terminal;The expression matching Configuration information is used to indicate the terminal according to the multiple facial expression images of expression matching configuration information control and successively passes through session Specified region in interface, and the matching result between the facial image according to each facial expression image and accordingly acquired determines expression With iterated integral;
Receive the resource acquisition request for the carrying expression matching iterated integral that the terminal is sent;
It is requested in response to the resource acquisition, matches the matched share of iterated integral with the expression for the terminal distribution Resource.
A kind of resource processing unit, comprising:
Module is obtained, the expression matching for obtaining terminal transmission starts to request;
Feedback module returns to expression matching with confidence to the terminal for starting request in response to expression matching Breath;The expression matching configuration information is used to indicate the terminal according to the expression matching configuration information and controls multiple expressions Image successively passes through the specified region in session interface, and between the facial image according to each facial expression image and accordingly acquired Determine that expression matches iterated integral with result;
Receiving module, for receiving the resource acquisition request for the carrying expression matching iterated integral that the terminal is sent;
Distribution module matches accumulation with the expression for the terminal distribution for requesting in response to the resource acquisition Divide the resource of matched share.
A kind of computer readable storage medium is stored with computer program on the computer readable storage medium, described When computer program is executed by processor, so that the processor executes following steps:
The expression matching that terminal is sent is obtained to start to request;
Start request in response to expression matching and returns to expression matching configuration information to the terminal;The expression matching Configuration information is used to indicate the terminal according to the multiple facial expression images of expression matching configuration information control and successively passes through session Specified region in interface, and the matching result between the facial image according to each facial expression image and accordingly acquired determines expression With iterated integral;
Receive the resource acquisition request for the carrying expression matching iterated integral that the terminal is sent;
It is requested in response to the resource acquisition, matches the matched share of iterated integral with the expression for the terminal distribution Resource.
A kind of computer equipment, including memory and processor store computer program, the meter in the memory When calculation machine program is executed by the processor, so that the processor executes following steps:
The expression matching that terminal is sent is obtained to start to request;
Start request in response to expression matching and returns to expression matching configuration information to the terminal;The expression matching Configuration information is used to indicate the terminal according to the multiple facial expression images of expression matching configuration information control and successively passes through session Specified region in interface, and the matching result between the facial image according to each facial expression image and accordingly acquired determines expression With iterated integral;
Receive the resource acquisition request for the carrying expression matching iterated integral that the terminal is sent;
It is requested in response to the resource acquisition, matches the matched share of iterated integral with the expression for the terminal distribution Resource.
Above-mentioned method for processing resource, device, storage medium and computer equipment, in the expression matching for receiving terminal transmission Feed back expression matching configuration information after starting request so that terminal according to expression matching configuration information control multiple facial expression images according to The secondary specified region by session interface, and the matching result between the facial image according to each facial expression image and accordingly acquired It determines that expression matches iterated integral, and then iterated integral is matched to obtain resource according to expression.General family cooperation is needed to complete to live in this way Body man face image acquiring, and real-time perfoming expression matches to share the mode of resource, greatly improves the plug-in user's of confrontation Antagonism.
Detailed description of the invention
Fig. 1 is the applied environment figure of resource acquiring method in one embodiment;
Fig. 2 is the flow diagram of resource sharing method in one embodiment;
Fig. 3 A is the interface schematic diagram that multiple facial expression images successively pass through session interface in one embodiment;
Fig. 3 B is the interface schematic diagram that multiple facial expression images successively pass through session interface in another embodiment;
Fig. 4 is shown as interface schematic diagram when suspension windows for session social in one embodiment;
Interface schematic diagram when Fig. 5 is playing resource sharing animation in one embodiment;
Fig. 6 is interface schematic diagram when playing countdown animation in one embodiment;
Fig. 7 is interface schematic diagram when playing countdown animation in another embodiment;
Fig. 8 is interface schematic diagram when playing countdown animation in another embodiment;
Fig. 9 is interface schematic diagram when playing countdown animation in another embodiment;
Figure 10 is the interface schematic diagram that prompt bubble is shown in one embodiment;
Figure 11 is the schematic diagram at session interface in one embodiment;
Figure 12 is interface schematic diagram when exporting the first multi-medium data in one embodiment;
Figure 13 is interface schematic diagram when exporting the second multi-medium data in one embodiment;
Figure 14 is interface schematic diagram when exporting third multi-medium data in one embodiment;
Figure 15 is interface schematic diagram when exporting four multi-medium datas in one embodiment;
Figure 16 is the first schematic diagram for sharing result displaying template in one embodiment;
Figure 17 is the schematic diagram that result shows template in one embodiment;
Figure 18 is the schematic diagram that result shows template in another embodiment;
Figure 19 is the schematic diagram that result shows template in another embodiment;
Figure 20 is the interface schematic diagram for getting message in one embodiment by message container showing resource.
Figure 21 is that showing resource obtains the interface schematic diagram for terminating picture in one embodiment;
Figure 22 is the flow diagram of resource sharing method in one embodiment;
Figure 23 A is the interface schematic diagram at session interface in another embodiment;
Figure 23 B is the interface schematic diagram at session interface in another embodiment;
Figure 24 is the schematic diagram that resource sharing configures the page in one embodiment;
Figure 25 is the interface schematic diagram that playing resource shares when initiating animation in one embodiment;
The schematic diagram at session interface when Figure 26 A is group session in one embodiment;
The schematic diagram at session interface when Figure 26 B is group session in another embodiment;
Figure 27 is the interface schematic diagram that showing resource shares overtime picture in one embodiment;
Figure 28 is the flow diagram of method for processing resource in one embodiment;
Figure 29 is the timing diagram interacted between terminal and server in one embodiment;
Figure 30 is the function structure chart of resource acquisition device in one embodiment;
Figure 31 is the function structure chart of resource acquisition device in another embodiment;
Figure 32 is the function structure chart of resource sharing device in one embodiment;
Figure 33 is the function structure chart of resource sharing device in another embodiment;
Figure 34 is the function structure chart of resource processing unit in one embodiment;
Figure 35 is the internal structure chart of computer equipment in one embodiment;
Figure 36 is the internal structure chart of computer equipment in one embodiment.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and It is not used in the restriction present invention.
Fig. 1 is the applied environment figure of resource acquiring method in one embodiment.Referring to Fig.1, the resource acquiring method application In resource acquisition system.The resource acquisition system includes terminal 110 and server 120.Wherein, terminal 110 includes at least first Terminal 111 and second terminal 112.First terminal 111 is used to send resource sharing message, second terminal 112 to second terminal 112 For executing the resource acquiring method.Second terminal 112 can also be used for sending resource sharing message to first terminal 111, by the One terminal 111 executes the resource acquiring method.In one embodiment, resource sharing method and method for processing resource are available In application environment shown in FIG. 1.Terminal 110 is for executing resource sharing method, and server 120 is for executing resource processing side Method.Terminal 110 specifically can be terminal console or mobile terminal, and mobile terminal specifically can be with mobile phone, tablet computer, notebook electricity At least one of brain etc..Server 120 specifically can be independent server, be also possible to multiple independent server compositions Server cluster.
It is appreciated that term " first " used in the present invention, " second " etc. can be used to describe various elements herein, But these elements should not be limited by these terms.These terms are only used to distinguish the first element from the other element.Citing comes It says, first terminal and second terminal both terminal, but it is not same terminal.
Fig. 2 is the flow diagram of resource acquiring method in one embodiment.The present embodiment is mainly applied in this way First terminal 111 in above-mentioned Fig. 1 illustrates.Referring to Fig. 2, which specifically comprises the following steps:
S202 receives resource sharing message in social session.
Wherein, social session is the interactive process carried out between at least one member and other members.It can pass through between user Social account carries out party words after logging in social application.Social session can be message session, voice based on message container Session or video session etc..
Resource sharing message is to share the message generated after resource by the promoter of resource sharing.Resource sharing message is used for Triggering obtains the movement of resource.Specifically, resource sharing message may include matching configuration data for obtaining the expression of resource, Allow first terminal to match configuration data according to the expression and obtains resource.Expression for obtaining resource matches configuration data It is data required for obtaining resource to be shared, may include resource identification, resource to be shared is gone out for unique identification;? It may include user identifier, for identifying the user for initiating resource sharing message;It can also include the approach for obtaining resource, use Resource is obtained in realizing.
Resource sharing message also can be only the message of notification type, for notifying first terminal obtains money according to which kind of mode Source, and the expression matching configuration data specifically needed when obtaining resource can be obtained by first terminal from server, Huo Zhecun Storage is in first server local.Resource sharing message such as expression red packet message.
Resource is the article that ownership can be obtained by network, including at least one of virtual objects and physical item, Virtual objects include at least one of account numerical value, virtual image product, virtual card, game article and ideal money, Physical item can be the article with actual form that can be arbitrarily possessed by user, for example, electronic product, toy, craftwork or Person's signature photo etc..
Specifically, first terminal can receive and pass through when the first user identifier by currently logging in carries out social session Participate in the resource sharing message that the second user mark of the social activity session is sent.Wherein, the first user identifier and second user mark Know and participates in same social session.First user identifier is to indicate the unique identification of the first user using first terminal, and second uses Family mark is the unique identification for indicating the second user using second terminal.Second user can be one or more than one, phase The second user mark answered can be one or more than one.It, can also be with that is, the social activity session can be double session It is group session.In one embodiment, the first user identifier and second user mark just can be carried out resource there are when friend relation Share sending and receiving for message.For example, user A and user B be when through social application progress video session, user A The resource sharing message of user B initiation can be received in the video session.
S204 controls multiple facial expression images and successively passes through the specified region in session interface in response to resource sharing message; The corresponding social session in session interface.
Wherein, facial expression image is the image for reflecting expressive features.Facial expression image such as smile facial expression image or surprised table Feelings image etc..Session interface is human-computer interaction interface corresponding to social session.Voice when the such as voice conversation of session interface Video calling interface when call interface or video session etc..Specified region in session interface be pre-set size not More than the region of session interface dimensions.
In the present embodiment, the shape and size in region are specified to be not construed as limiting this.The specified region can be rule Polygonal region is also possible to irregular closed area.Moreover, the path that facial expression image passes through from session interface is not also made It limits.Facial expression image can since the boundary for specifying region from a certain position move, and be moved to the specified region Boundary in cancel display behind another position, by the specified region in session interface.Wherein, the movement of facial expression image Path can be straight line path, be also possible to dog leg path, can also be curved path.
In one embodiment, each facial expression image by specified region can be the expression that first terminal randomly selects Image.That is, can be respectively different facial expression images by multiple facial expression images in specified region, it can also be repetition and go out Existing facial expression image.For example, first terminal can control facial expression image A, facial expression image B and facial expression image C successively by referring to Determine region, also can control facial expression image A, facial expression image A and facial expression image A successively by specified region.
In one embodiment, first terminal can control movement speed of the facial expression image by specified region when.For example, the One terminal can control multiple facial expression images according to identical speed successively at the uniform velocity by the specified region in session interface;First eventually End also can control multiple facial expression images respectively according to different speed successively at the uniform velocity by the specified region in session interface;First Terminal can also control multiple facial expression images, and successively speed change passes through the specified region in session interface.It illustrates, it is assumed that pass through The quantity of the facial expression image in the specified region in session interface is 10, and first terminal can control each in preceding 3 facial expression images Facial expression image is by specifying region in 3 seconds, and each facial expression image is in 2 seconds by specified area in remaining 7 facial expression images Domain.
Specifically, after first terminal receives resource sharing message in social session, it may be in response to the resource sharing and disappear Breath matches configuration data according to the expression locally defaulted, multiple facial expression images is successively arbitrarily chosen from facial expression image library, and control It makes this multiple facial expression image and successively passes through the specified region in session interface.Wherein, the expression matching configuration data of default can wrap Quantity and each facial expression image by the facial expression image in the specified region in session interface are included by the finger in session interface Move mode etc. when determining region.
In one embodiment, first terminal can also obtain the matching of the expression for obtaining resource from resource sharing message Configuration data matches configuration data according to the expression and successively arbitrarily chooses multiple facial expression images from facial expression image library, and controls This multiple facial expression image successively passes through the specified region in session interface.
In one embodiment, after first terminal receives resource sharing message in social session, it may be in response to the money Message is shared in source, sends expression matching to server and starts to request, and receives the expression matching configuration information of server return, root Multiple facial expression images are successively arbitrarily chosen from facial expression image library according to expression matching configuration data, and control this multiple expression figure As successively by the specified region in session interface.
In one embodiment, first terminal successively arbitrarily chooses the process of multiple facial expression images from facial expression image library, It can all choose and finish before control facial expression image is by the specified region in session interface;It is also possible to each in control Before facial expression image is by the specified region in session interface, the current expression figure for preparing control is arbitrarily chosen from facial expression image library Picture.
For example, Fig. 3 A and Fig. 3 B respectively illustrate the interface signal that multiple facial expression images successively pass through session interface Figure.It include the multiple facial expression images for successively passing through session interface: facial expression image 311A, facial expression image in the interface with reference to Fig. 3 A 312A and facial expression image 313A.It include the multiple facial expression images for successively passing through session interface: expression figure in the interface with reference to Fig. 3 B As 311B, facial expression image 312B and facial expression image 313B.
S206 obtains each facial expression image and passes through the facial image accordingly acquired when session interface.
Wherein, facial image is to acquire the image that living body faces obtain by camera.Specifically, first terminal can call Built-in or external connection camera acquires facial image when each facial expression image passes through session interface, to obtain To the facial image for corresponding to the acquisition of each facial expression image.
In one embodiment, first terminal is when receiving resource sharing message, can detect it is built in first terminal or Whether the camera of person's external connection is in the open state.If camera is in the open state, prepare controlling multiple expressions Image calls camera acquisition facial image when successively passing through session interface.If camera is not in open state, in session Prompting message is shown in interface, the prompting message is for prompting user to open camera.Wherein, prompting message can pass through bubble shape Formula is shown.
S208 determines the matching result between each facial expression image and the facial image accordingly acquired.
It is understood that the process of first terminal acquisition facial image is the process of continuous collecting, then collecting Facial image be human face image sequence.
Wherein, matching result is for reflecting facial image and facial expression image matching degree.Matching result may include basic Match and exactly match the result of two kinds of matching degrees.Basic matching list face image of leting others have a look at is matched with facial expression image, but matching degree It is lower.Exact matching indicates that facial image is matched with facial expression image, and matching degree is higher.In the present embodiment, matching result It specifically can be hit results.Hit results indicate whether facial image hits facial expression image.Hit results may also comprise substantially Hit and completely hit.
In one embodiment, first terminal can when often collecting a frame facial image, by the facial image of acquisition with The current facial expression image by the specified region in session interface is matched, and matching result is obtained.Specifically, first terminal has Body can calculate the similarity score between expressive features corresponding to the face characteristic and facial expression image of facial image, according to calculating Similarity score section belonging to the similarity score arrived, determines the matching result between facial image and facial expression image.
For example, when similarity score is lower than the first default similarity score, the corresponding matching for indicating that it fails to match As a result, when similarity score reaches the first default similarity score, the corresponding matching result for indicating successful match.Further Ground, it is corresponding to indicate basic when similarity score reaches the first default similarity score, and is lower than the second default similarity score Matched matching result.When similarity score reaches the second default similarity score, the corresponding matching result for indicating exact matching.
Such as, it is assumed that the codomain of similarity score is [0,100], and the first default similarity score is 80, the second default phase It is 90 like degree score value.So when similarity score [0,80) when, the corresponding matching result for indicating that it fails to match;Similarity score [80,90) when, it is corresponding to indicate substantially matched matching result;Similarity score is corresponding to indicate complete at [90,100] The matching result matched.
In one embodiment, for each frame facial expression image, which can also passed through session by first terminal The each frame facial image acquired when specified region in interface, is matched with the facial expression image, and will be highest similar Spend matching result corresponding to score value, the matching result as the facial expression image.
In one embodiment, when the facial image of acquisition and the current either table by the specified region in session interface When the matching result of feelings image indicates that it fails to match, first terminal then continues the facial image for acquiring next frame and current warp The facial expression image in the specified region crossed in session interface is matched, until the facial image of acquisition passes through session interface with current In specified region any facial expression image matching result indicate successful match when, then determine that the facial expression image is hit, no The facial expression image is matched again, and continues the facial image for acquiring next frame and currently passes through specified in session interface Other facial expression images in region are matched.
For example, referring again to Fig. 3 A, it is assumed that first terminal is when collecting facial image f1, session interface such as Fig. 3 A institute Show, then first terminal can facial expression image 311A, facial expression image 312A, facial expression image 313A be matched respectively by f1.If It fails to match, and facial expression image 311A, facial expression image 312A and facial expression image 313A then continue to acquire still in session interface Next frame facial image f2 matched respectively with facial expression image 311A, facial expression image 312A and facial expression image 313A.If this When f1 and facial expression image 312A successful match, then then no longer f2 and facial expression image 312A is carried out when being matched using f2 Match, is only matched with facial expression image 311A and facial expression image 313A.
In one embodiment, first terminal can be when often collecting a frame facial image, can also be by the face figure of acquisition Picture is matched with the facial expression image for currently entering specified region earliest in the facial expression image in specified region, obtains matching knot Fruit.When matching result indicates that it fails to match, then continue to match the facial image that next frame acquires with the facial expression image, Until when matching result indicates that successful match or the facial expression image leave specified region, then the face figure that next frame is acquired As being matched with the next frame facial expression image of the facial expression image.
For example, referring again to Fig. 3 A, it is assumed that first terminal is when collecting facial image f1, session interface such as Fig. 3 A institute Show, then first terminal can match f1 with facial expression image 311A.If it fails to match, and facial expression image 311A, expression figure As 312A and facial expression image 313A still in session interface, then continue the next frame facial image f2 that will be acquired respectively with expression figure As 311A is matched.If f1 and facial expression image 311A successful match at this time, when carrying out expression matching using f2, by f2 with Facial expression image 312A is matched.Alternatively, when it fails to match with facial expression image 311A by f1, and facial expression image 311A leaves specified area Domain matches f2 with facial expression image 312A then when carrying out expression matching using f2.
S210 determines that expression matches iterated integral according to the corresponding matching result of multiple facial expression images.
Wherein, expression matching iterated integral is to add up the corresponding expression of each facial expression image to match the score value got.Expression Partition is to reflect the quantized values of facial expression image and facial image matching degree.Expression matching point higher expression facial image and table The matching degree of feelings image is higher.
Specifically, first terminal can successively obtain the corresponding matching of each facial expression image in carrying out expression matching process As a result, judging that the matching result indicates whether successful match when often obtaining the corresponding expression matching result of a facial expression image.If Matching result indicates successful match, then adds up the matching point of expression corresponding to the matching result.If matching result indicates that matching is lost It loses, does not then add up the matching point of expression corresponding to the matching result.
Wherein, the matching point of expression corresponding to matching result can be face characteristic and the facial expression image institute of facial image Similarity score between corresponding expressive features.For example, the similarity score of facial image A and facial expression image B are 85, then face Image A is matched with expression corresponding to the matching result of facial expression image B is divided into 85.The matching point of expression corresponding to matching result, It is also possible to pre-set numerical value corresponding with similarity score section.For example, preset similarity score section [80, 90) numerical value corresponding to is 80, and numerical value corresponding to similarity score section [90,100] is 100.So, facial image A with The similarity score 85 of facial expression image B fall in section [80,90) in, then facial image A and facial expression image B matching result institute it is right The expression matching answered is divided into 80.
S212 obtains money by the matched share of iterated integral is matched with expression from resource corresponding to resource sharing message Source.
Specifically, the user identifier currently logged in can be matched iterated integral with expression and be sent to server by first terminal.Clothes For business device after getting expression matching iterated integral, inquiry expression matches total score, and expression matching iterated integral is calculated and accounts for expression The accounting of total score is matched, determining further according to the accounting should distribute in resource corresponding to resource sharing message to the user identifier Resource share.Wherein, expression matching total score is accessible highest expression matching point when theoretically carrying out expression matching Summation.
For example, the expression matching accumulation of user A is divided into 800, it is 1080 that expression, which matches total score, then expression matching iterated integral accounts for The accounting that expression matches total score is 800/1080, and server can be by 800/1080 distribution of resource corresponding to resource sharing message To user A.
In one embodiment, the calculative strategy of expression matching point can be arranged in terminal in advance, so that actually carrying out expression The summation of accessible highest expression matching point is less than accessible highest expression when theoretically carrying out expression matching when matching The summation of partition.Share resource corresponding to resource sharing message can between at least two users.
In one embodiment, if resource is the resource distributed by numerical value, such as virtual red packet or virtual card, then Server can be transferred in value account corresponding to user identifier when distributing resource for user identifier.Value account includes existing Golden account and gift token account, value account may be provided on bank server or Third-party payment server.If resource is to step on Remember the resource got, such as physical item, then server can recorde resource and user marks when distributing resource for user identifier The corresponding relationship of knowledge, to indicate relative users to the ownership of the resource, to provide resource subsequently through other way.
In one embodiment, when social session is group session, that is to say, that participate in the use that the social activity session is passed through When the quantity more than two of family mark, which is resource-sharing group message, participates in user's mark of the social activity session Knowing logged in terminal may be in response to resource-sharing group's message, controls multiple facial expression images and successively passes through in session interface Specified region is obtained from resource corresponding to resource sharing group's message to match the matched share of iterated integral according to expression Resource.Wherein, expression matches iterated integral, is according to by specifying multiple facial expression images in region in session interface respectively and accordingly What the matching result between the facial image of acquisition determined.
Specifically, when the terminal that the user identifier for participating in the social activity session is logged in is both responsive to resource-sharing group's message When obtaining resource from resource corresponding to resource sharing group's message, server can receive the expression matching accumulation that each terminal uploads Point, the summation of each expression matching iterated integral received is calculated, accounts for calculating according still further to the expression matching iterated integral that each terminal uploads The accounting of obtained summation, accordingly determining in resource corresponding to resource sharing group message further according to each accounting should distribute to each The share of the resource of terminal.
For example, user A, B and C participate in social session jointly, the expression matching accumulation of user A is divided into 800, the table of user B Feelings matching accumulation is divided into 600, and the expression matching accumulation of user B is divided into 1000.Then the summation of each expression matching iterated integral is 800+ 600+1000=2400, server can be by 800/2400 distribution of resource corresponding to resource sharing message to user A, by resource Share 600/2400 distribution of resource corresponding to message to user B, by 1000/ of resource corresponding to resource sharing message 2400 distribute to user C.
Server can also be by resource corresponding to resource sharing message according to the user identifier quantity equal part for participating in session, clothes Business device can be again after getting the expression matching iterated integral of terminal upload, and inquiry expression matches total score, and expression is calculated The accounting of expression matching total score, resource corresponding to the resource sharing message after equal part is determined further according to the accounting are accounted for iterated integral In should distribute to the share of the resource of the user identifier.Resource remaining after sharing can be returned to by server initiates resource point Enjoy the user identifier that message is passed through.
For example, user A, B and C participate in social session jointly, the expression matching accumulation of user A is divided into 800, the table of user B Feelings matching accumulation is divided into 600, and the expression matching accumulation of user B is divided into 1000, and it is 1080 that expression, which matches total score,.Then server can incite somebody to action 800/ (1080*3) of resource corresponding to resource sharing message is distributed to user A, by resource corresponding to resource sharing message 600/ (1080*3) distribution to user B, by 1000/ (1080*3) distribution of resource corresponding to resource sharing message to user C。
In one embodiment, when the certain customers for participating in the social activity session identify logged in terminal in response to the resource When shared group's message obtains resource from resource corresponding to resource sharing group's message, server can receive the table that each terminal uploads Feelings match iterated integral, calculate the summation of each expression matching iterated integral received, match according still further to the expression that each terminal uploads tired Integral accounts for the accounting for the summation being calculated, and accordingly determines in resource corresponding to resource sharing group message and answers further according to each accounting When the share of the resource of distribution to each terminal.
It is understood that when the terminal logged in there is only a user identifier in response to resource-sharing group message from When obtaining resource in resource corresponding to resource sharing group's message, server matches tired according to expression corresponding to the user identifier The accounting that integral accounts for expression matching total score is that the user identifier distributes resource, so that money corresponding to resource sharing group's message Source can share between at least two users.
For example, user A, B and C participate in social session jointly, but only A shares resource, the expression of user A with B participation It is divided into 800 with accumulation, the expression matching accumulation of user B is divided into 600.Then the summation of each expression matching iterated integral is 800+600= 1400, server can be by 800/1400 distribution of resource corresponding to resource sharing message to user A, by resource sharing message institute The 600/1400 of corresponding resource is distributed to user B.
Server can also be by resource corresponding to resource sharing message according to the user identifier quantity equal part for participating in session, clothes Business device can be again after getting the expression matching iterated integral of terminal upload, and inquiry expression matches total score, and expression is calculated The accounting of expression matching total score, resource corresponding to the resource sharing message after equal part is determined further according to the accounting are accounted for iterated integral In should distribute to the share of the resource of the user identifier.Resource remaining after sharing can be returned to by server initiates resource point Enjoy the user identifier that message is passed through.
For example, user A, B and C participate in social session jointly, but only A shares resource, the expression of user A with B participation It is divided into 800 with accumulation, the expression matching accumulation of user B is divided into 600, and it is 1080 that expression, which matches total score,.Then server can be by resource 800/ (1080*3) for sharing resource corresponding to message is distributed to user A, by resource corresponding to resource sharing message 600/ (1080*3) is distributed to user B.Above-mentioned resource acquiring method is successively passed through in session interface using multiple facial expression images The dynamic control mode in specified region acquires facial image in real time and is matched with current by the facial expression image at session interface, Determine that expression matches iterated integral further according to the corresponding matching result of multiple facial expression images, thus according to accumulative point of expression matching To obtain resource.General family cooperation is needed to complete living body faces Image Acquisition in this way, and the matching of real-time perfoming expression provides to share The mode in source greatly improves the antagonism to plug-in user.
In one embodiment, the resource acquiring method further include: when social session is shown as suspension windows, in response to Resource sharing message showing resource in suspension windows shares prompt picture;Obtain the display mode switching for corresponding to session interface Instruction;In response to display mode switching command, the session interface of full screen display is switched to.Above-mentioned steps can be held before S204 Row.
Wherein, suspension windows are the windows that can customize display position and display size.View layer begins where suspension windows It is eventually top-level visual figure layer.Suspension windows can be rectangle, can also be round or irregular shape.Resource sharing prompt picture is to use It may participate in the picture of resource sharing in prompt.Resource sharing prompt picture can be static images and be also possible to dynamic picture.It is aobvious The mode switching command of showing is the computer program for switching session interface display mode.
Specifically, for first terminal after receiving resource sharing message, whether detectable social activity session is shown as suspended window Mouthful.If social session is shown as suspension windows, showing resource shares prompt picture in suspension windows, to remind user that can join With resource sharing.The also detectable predefined trigger action corresponding to session interface of first terminal, is detecting triggering behaviour As when trigger corresponding display mode switching command.Trigger action can be the operation to control in session interface, such as to control The touch control operation of part or cursor clicking operation etc..Trigger action is also possible to the clicking operation to predefined physical button, Shake operation or phonetic order etc..Further, when first terminal detects the display mode switching corresponding to session interface When instruction, in response to display mode switching command, the session changing interface that suspension windows are shown is more to control to full frame displaying A facial expression image successively passes through the specified region in the session interface of full frame displaying.
Wherein, when resource sharing prompt picture is static images, first terminal can the prompt of the Dynamic Display resource sharing Picture.For example, rotating resource sharing prompt picture within the scope of certain angle realizes jitter effect.First terminal can also shown Resource sharing prompts picture, triggering native physical vibration, to prompt user to participate in resource sharing.
Further, if in preset duration, correspondence is not detected after showing resource sharing prompt picture in first terminal Display mode switching command in session interface, then revocation token resource sharing prompts picture.
For example, Fig. 4 shows interface schematic diagram when social session in one embodiment is shown as suspension windows.Ginseng Fig. 4 is examined, which includes that suspension windows 410 and first terminal are opened up in suspension windows 410 after receiving resource sharing message The showing resource shown shares prompt picture 411.
In the present embodiment, after receiving resource sharing message, judge whether social session is shown as suspension windows, When social session is shown as suspension windows, it is believed that user is carrying out other operations, then the showing resource point in suspension windows Prompt picture is enjoyed to prompt user to participate in resource sharing, and only when session changing interface is actively full screen display by user Just carry out subsequent process resource access, avoid user cooperate not in time and voluntarily control facial expression image it is mobile and caused by It deposits resource and shows the waste of resource.But also other operations that can be currently carried out to avoid terminal local, it realizes that user is anti-and beats Disturb function.
In one embodiment, S204 includes: the session interface corresponding to social session in response to resource sharing message Middle playing resource shares animation;At the end of resource sharing animation play, continue to play countdown animation;It is broadcast in countdown animation After putting, start to play background audio, and control multiple facial expression images and successively pass through the specified region in session interface.
Wherein, resource sharing animation is for reflecting the animation that may participate in resource sharing.Animation is that a series of images frame connects The dynamic menu to be formed is put in continued broadcasting.Countdown animation is the animation for carrying out countdown.Resource sharing animation and countdown are dynamic Picture may include image data, may also comprise audio data.
Specifically, first terminal may be in response to resource sharing message, resource sharing animation be obtained, by the resource sharing animation It is played in the session interface corresponding to social session.First terminal can obtain countdown animation again, and in resource sharing animation At the end of broadcasting, continue the broadcasting countdown animation.First terminal can also randomly select background audio in background audio library, After countdown animation play, start to play the background audio, and controls multiple facial expression images and successively pass through in session interface Specified region.
In one embodiment, first terminal may be in response to resource sharing message to server send expression matching start to ask It asks.Server receive the expression matching start request when, expression matching configuration information can be obtained, by the expression match configure Information feeds back to first terminal.First terminal is to according to expression matching configuration information session interface corresponding to social session Middle playing resource shares animation, at the end of resource sharing animation play, continues to play countdown animation, broadcast in countdown animation After putting, start to play background audio, and control multiple facial expression images and successively pass through the specified region in session interface.
Wherein, expression matching configuration information may include resource sharing animation or resource sharing animation mark, may also comprise Perhaps countdown animation mark may also include background audio or background audio mark to countdown animation, may also include expression figure Picture or facial expression image mark.
In one embodiment, the resource sharing animation, countdown animation and background audio of broadcasting can be resource point It enjoys what message originator was specified by resource sharing message, is also possible to what first terminal was chosen according to user instructions, it can be with It is that server is specified by expression matching configuration information.
In one embodiment, when playing countdown animation, countdown animated show prompt bubble is also corresponded to, it should Prompting bubble includes resource acquisition guidance information.The resource acquisition guidance information carries out resource acquisition for prompting the user on how.
For example, Fig. 5 shows interface schematic diagram when playing resource in one embodiment shares animation.It, should with reference to Fig. 5 Interface includes the picture frame 510 to form resource sharing animation.Fig. 6 shows interface when playing countdown animation in one embodiment Schematic diagram.Fig. 7 also shows that interface schematic diagram when playing countdown animation in one embodiment.Fig. 8 also shows that one embodiment Interface schematic diagram when middle broadcasting countdown animation.Fig. 9 also shows that interface when playing countdown animation in one embodiment shows It is intended to.
In above-described embodiment, animation and countdown animation are shared by playing resource, time has been reserved for user, has made It is more efficient to obtain the subsequent process that acquisition resource is matched according to expression.Moreover, it is local can also the period complete with server it Between interaction, guarantee according to expression match obtain resource process go on smoothly.
In one embodiment, resource sharing method further include: opened from the first facial expression image in multiple facial expression images From when beginning mobile after preset duration, when the matching result expression between first facial expression image and the facial image accordingly acquired matches mistake When losing, then facial expression image is chosen in the facial expression image that passes through from session interface;Facial expression image displaying corresponding to selection mentions Show bubble, prompting bubble includes facial expressions and acts guidance information;Control prompt bubble follows the facial expression image synchronizing moving of selection.
Wherein, preset duration is the pre-set waiting time for showing prompt bubble.Such as 3 seconds etc..Prompting bubble is For carrying the interface assembly of data.Specifically, first terminal starts in the first facial expression image controlled in multiple facial expression images Start timing when mobile, when timing duration reaches preset duration, and does not collect yet and the matched face figure of first facial expression image When picture, then facial expression image is chosen in the facial expression image that passes through from session interface, the facial expression image displaying corresponding to selection mentions Show bubble, and show facial expressions and acts guidance information in the prompt bubble, to guide user to do corresponding facial expressions and acts.First eventually End can also be when the facial expression image that control is chosen be mobile, and control prompt bubble follows the facial expression image synchronizing moving of selection.
For example, Figure 10 shows the interface schematic diagram for showing prompt bubble in one embodiment.With reference to Figure 10, first Terminal in 3s, does not collect and the matched facial image of facial expression image 1001 from starting to control the movement of facial expression image 1001 When, it can correspond to and show prompt bubble 1002 with facial expression image 1001, and control prompt bubble 1002 and follow facial expression image 1001 same Moved further.
In one embodiment, facial expression image is chosen in the facial expression image that first terminal passes through from session interface, it can To be to randomly select facial expression image, facial expression image can also be selected according to pre-set selection strategy.Pre-set selection Strategy can be the next frame facial expression image for choosing first facial expression image.Preset duration can be adjusted according to actual scene.
In above-described embodiment, guides user to be matched according to expression by prompt bubble and obtain resource, avoid user not The waste of memory source caused by learning in the case where resource acquisition mode and display resource, ensure that the suitable of process resource access Benefit carries out.
In one embodiment, S204 includes: to control multiple facial expression images from session interface in response to resource sharing message In successively end position into session interface is mobile for initial position.
Wherein, initial position is that facial expression image starts mobile position.End position is that facial expression image terminates mobile position It sets.Specifically, first terminal can determine initial position and end position in session interface, then control multiple facial expression images from true Fixed original position is successively to movement at determining end position.First terminal can facial expression image reach end position when, Cancel and shows the facial expression image.For example, the interface further includes the finishing line for indicating end position referring again to Fig. 3 A (B) 320A(B)。
Wherein, first terminal can determine in session interface according to the expression matching configuration information obtained from server Beginning position and end position;Initial position and end position can also be determined in session interface according to resource sharing message;May be used also According to the expression matching configuration information being locally stored, initial position and end position are determined in session interface.
In the present embodiment, by determining initial position and final position, facial expression image is controlled in two determining positions It is moved between setting, avoids facial expression image random movement bring uncontrollability, improved and acquisition resource is matched by expression The practicability of mode.
In one embodiment, it obtains each facial expression image and passes through the facial image accordingly acquired when session interface, comprising: Currently by choosing closest to end position in session interface the and failed facial expression image for being matched to facial image Facial expression image is as focus facial expression image;Obtain the facial image that focus facial expression image accordingly acquires.Determine each facial expression image With the matching result between the facial image that accordingly acquires, comprising: determine between focus facial expression image and the facial image accordingly acquired Matching result;When matching result indicates successful match, return currently by session interface and be matched to people not successfully In the facial expression image of face image, choose closest to end position facial expression image as focus facial expression image the step of, until most The latter facial expression image reaches at end position.
Wherein, focus facial expression image is for carrying out matched facial expression image with the facial image of acquisition.Specifically, first Terminal is controlling multiple facial expression images from when successively the end position into session interface is mobile the initial position in session interface, Can be first using first facial expression image as focus facial expression image, and the facial image of acquisition is matched with focus facial expression image frame by frame, When the facial image of acquisition and the matching result of focus facial expression image indicate successful match, by the focus expression of successful match The next frame facial expression image of image continues to acquire facial image and new focus facial expression image as new focus facial expression image It is matched;Alternatively, reaching the facial image of end position and acquisition and of focus facial expression image until focus facial expression image When indicating that it fails to match with result, the next frame facial expression image of the focus facial expression image of end position will be reached as new coke Point facial expression image, and continue acquisition facial image and matched with new focus facial expression image;And so on, to the last one Facial expression image reaches at end position.
In this way, the matching result between each facial expression image and the facial image accordingly acquired can be obtained in first terminal.Its In, the matching result between each facial expression image and the facial image accordingly acquired, with last in the facial image that accordingly acquires Subject to matching result corresponding to frame.For example, facial expression image A is with first frame facial image f1, it fails to match, with first frame Facial image f2 successful match, then be subject to the matching result of the second frame.
In one embodiment, first terminal is also settable when focus facial expression image and the continuous multiple frames face accordingly acquired When matching result between image indicates successful match, just return currently by session interface and be matched to people not successfully In the facial expression image of face image, choose closest to end position facial expression image as focus facial expression image the step of, until most The latter facial expression image reaches at end position.The matched accuracy of expression is improved in this way.
In one embodiment, first terminal can show that facial expression image matches progress by progress bar at session interface.Tool Body, first terminal can have already passed through number and the facial expression image total number of the facial expression image at session interface to show progress.
In above-described embodiment, by determining focus facial expression image, when carrying out images match every time, only by the face of acquisition Image is matched with focus facial expression image, improves expression matching efficiency.
In one embodiment, resource acquiring method further include: add focus mark for focus facial expression image.Work as matching When as a result indicating successful match, the resource acquiring method further include: the focus mark of focus facial expression image is updated to hit mark Note.
Wherein, the facial expression image for carrying focus mark indicates that the facial expression image is focus facial expression image.Focus mark is used for Prompt user's first terminal currently carries out the matched object of expression, and then user is guided to make table corresponding with focus facial expression image Feelings movement.The facial expression image for carrying hit label indicates facial expression image successful match.Hit label is for having prompted user Matched successful facial expression image, and then user is guided to no longer need to make facial expressions and acts corresponding with the facial expression image.
Specifically, first terminal adds focus mark after choosing focus facial expression image for the focus facial expression image, to draw It leads user and makes facial expressions and acts corresponding with focus facial expression image, and between collected facial image and focus facial expression image When matching result indicates successful match, the focus mark of focus facial expression image is updated to hit label, to prompt user's table Feelings image successful match, no longer needs to make facial expressions and acts corresponding with the facial expression image.
Wherein, focus mark and hit label are different label.Label is for by target object and other homogeneous objects It is distinguished.In the present embodiment, can be by adding animation effect to facial expression image, or facial expression image is highlighted, or Facial expression image is distinguished color and the realizations label addition such as shows by person.
In one embodiment, terminal can also increase the display size of focus facial expression image, so that focus facial expression image The amplification of other facial expression images is different to show.User's first terminal can be prompted currently to carry out the matched object of expression in this way, in turn Guidance user makes facial expressions and acts corresponding with focus facial expression image.
For example, Figure 11 shows the schematic diagram at session interface in one embodiment.With reference to Figure 11, which includes table Feelings image 1101, for facial expression image 1101 add focus mark 1102, facial expression image 1103 and be facial expression image 1103 add Hit label 1104.
In the present embodiment, expression matching process is correctly participated in by focus mark and hit label guidance user, so that The subsequent process for matching acquisition resource according to expression is more efficient.
In one embodiment, when matching result indicate successful match when, the resource acquiring method further include: obtain with With the corresponding expression matching point of result;When expression matching point reaches the first matching point threshold value and the not up to second matching point threshold value When, export the first multi-medium data;When expression matching point reaches the second matching point threshold value, output is different from the first multimedia number According to the second multi-medium data;Wherein, the first multi-medium data and the second multi-medium data indicate successful match.
Wherein, multi-medium data is the data for exporting in expression successful match.Multi-medium data may include text At least one of data, image data or audio data.Image data may include dynamic picture data or static images Data.In the present embodiment, different expressions matching point can respectively correspond different multi-medium datas.
Specifically, for each facial expression image by session interface, first terminal is passing through meeting in the facial expression image When talking about interface, when the facial image of acquisition and the matching result of the facial expression image indicate successful match, then determining at this time should be defeated Multi-medium data out.
Further, first terminal can continue to obtain the corresponding expression matching point of the matching result, by expression matching point It is compared with a second matching point threshold value.When expression matching point divides threshold value lower than the second matching, the first multimedia number is obtained According to and export, when expression matching point reaches the second matching point threshold value, obtain the second multi-medium data and simultaneously export.Wherein, One multi-medium data specifically can be picture and " Cool " corresponding audio including " Cool " printed words.Second multi-medium data It specifically can be picture and " Perfect " corresponding audio including " Perfect " printed words.
For example, Figure 12 shows interface schematic diagram when exporting the first multi-medium data in one embodiment.With reference to Figure 12, the expression matching point corresponding with the facial image successful match of acquisition and matching result of facial expression image 1201 in the interface When reaching the first matching point threshold value and being not up to the second matching point threshold value, the first multi-medium data 1202 is exported.Figure 13 shows one Interface schematic diagram when the second multi-medium data is exported in a embodiment.With reference to Figure 13, in the interface facial expression image 1301 with adopt When the corresponding expression matching point of the facial image successful match and matching result of collection reaches the second matching point threshold value, output second Multi-medium data 1302.
In one embodiment, resource acquiring method further include: when the corresponding matching result of continuous multiple facial expression images When indicating successful match, then third multi-medium data is exported;Third multi-medium data indicates the success of expression continuous coupling.
Specifically, first terminal can record the matching result when often obtaining the matching result of an expression successful match It is more then to obtain third when continuously the corresponding matching result of multiple facial expression images indicates successful match for corresponding facial expression image Media data simultaneously exports.Wherein continuous multiple facial expression images are at least three facial expression images.Wherein, third multi-medium data is specific It can be the picture including " in n times company " printed words and corresponding audio " in n times company ".N indicates the successful number of continuous coupling.
For example, Figure 14 shows interface schematic diagram when exporting third multi-medium data in one embodiment.With reference to Figure 14, facial expression image 1401 and the facial image successful match of acquisition and be the successful third table of continuous coupling in the interface When feelings image, third multi-medium data 1402 is exported.
In one embodiment, the matching point of expression corresponding to matching result is pre-set and similarity score area Between corresponding numerical value.Similarity score is that the face characteristic of facial image is similar between expressive features corresponding to facial expression image The quantized values of degree.When similarity score is at the first score value section, corresponding expression matching is divided into zero, when similarity score exists When the second score value section, the matching of corresponding expression is divided into the first numerical value, corresponding when similarity score is at third score value section Expression matching is divided into second value.Wherein, between the first score value section, the second score value section and third score value section without intersection, And union is the codomain of similarity score.For example, the first score value section be [0,80), the second score value section be [80,90), third Score value section is [90,100].First numerical value is 80, second value 100.
Further, when continuously the corresponding matching result of multiple facial expression images indicates successful match, from third Start with result, when obtaining the similarity score of matching result at the second score value section, expression corresponding to the matching result Matching is divided into third value.When obtaining the similarity score of matching result at third score value section, corresponding to the matching result Expression matching be divided into the 4th numerical value.Third value is 90, and the 4th numerical value is 110.
For example, corresponding matching result is " Cool ", and " Cool " is right when similarity score is at the second score value section The expression matching answered is divided into 80.When similarity score is at third score value section, corresponding matching result is " Perfect ", " Perfect " corresponding expression matching is divided into 100.When continuously for " Cool " either " Perfect " three times or more than three times when, " Cool " corresponding expression matching is divided into 90, and " Perfect " corresponding expression matching is divided into 110.
In one embodiment, for the last one facial expression image in multiple facial expression images by session interface, when When matching result expression between the facial expression image and the facial image of acquisition is matched into, the 5th multi-medium data is exported.Wherein, Five multi-medium datas specifically can be picture and " Excellent " corresponding audio including " Excellent " printed words.With reference to Figure 14, the interface further include the 5th multi-medium data 1403.Further, corresponding to the matching result of the expression successful match Expression matching is divided into second value, and when the facial expression image is the matching result of continuous multiple successful match, matching result institute Corresponding expression matching is divided into the 4th numerical value.
For example, working as similarity for the last one facial expression image in multiple facial expression images by session interface For score value at the second score value section or third score value section, corresponding matching result is " Excellent ", " Excellent " Corresponding expression matching is divided into 100.When continuously for " Cool " either " Perfect " three times or more than three times when, " Excellent " corresponding expression matching is divided into 110.
In one embodiment, the resource acquiring method further include: when focus facial expression image is moved at end position, And matching result indicates when it fails to match, then exports the 4th multi-medium data;4th multi-medium data indicates that it fails to match.It is above-mentioned Step can the matching result between the facial image for determining focus facial expression image and accordingly acquiring the step of after execute.
Specifically, first terminal is moved at end position and focus facial expression image and acquisition in focus facial expression image When the matching result of facial image indicates that it fails to match, then obtains the 4th multi-medium data and export.Wherein, the 4th multimedia Data specifically can be picture and " Miss " corresponding audio including " Miss " printed words.
For example, Figure 15 shows interface schematic diagram when exporting four multi-medium datas in one embodiment.With reference to Figure 15, facial expression image 1501 is moved at end position and matches output when failing with the facial image of acquisition in the interface 4th multi-medium data 1502.
In above-described embodiment, by exporting multi-medium data, user is participated in into the matched score of expression with visual pattern It shows indirectly, the participation of user can be improved, and then improve the practicability of resource acquiring method.
In one embodiment, first terminal can will also control multiple facial expression images successively pass through it is specified in session interface The process in region is recorded as video.Specifically, terminal can control first facial expression image since initial position in session interface Start to record when mobile, until the last one facial expression image stops when being moved to end position in session interface.The view wherein recorded Frequency includes video call data and facial expression image related data, and facial expression image related data includes the mobile display number of facial expression image The multi-medium data etc. exported accordingly and in expression matching process.The video of recording can be stored in local by first terminal, can Get user triggering check instruction after play the video.It is social that the video of recording can be also sent to participation by first terminal The corresponding terminal of the other users mark of session so that these terminals get relative users triggering check instruction after broadcast Put the video.
In one embodiment, resource acquiring method further include: divide threshold when expression matching iterated integral reaches preset cumulative When value, obtains first and share result displaying template, and the share that will acquire resource is filled to first and shared in result displaying template It is shown;When expression matching iterated integral is not up to preset cumulative point threshold value, obtains second and share result displaying template, and will The share for obtaining resource, which is filled into the second sharing result displaying template, to be shown.
Wherein, expression matching iterated integral is higher, indicates that the facial expression image of successful match is more, then retrievable resource It is more.Share result and show template, is for showing the template for sharing result.Share result and shows that template may include default text This.Different sharing results shows that the pre-set text that template includes is different.For example, the first sharing result shows that template includes pre- If text is " good severity!Prove to be expression great master!", the second sharing result shows that the pre-set text that template includes is " to connect again again It is strict!".Preset cumulative point threshold value is pre-set expression matching iterated integral cut off value, specifically can be expression matching total score Half.
Specifically, first terminal obtains currently available expression matching after multiple facial expression images pass through session interface Expression matching iterated integral is compared by iterated integral with preset cumulative point threshold value.When expression matching iterated integral reaches preset cumulative When dividing threshold value, obtains first and share result displaying template, and the share that will acquire resource fills to first and shares result displaying mould It is shown in version;When expression matching iterated integral is not up to preset cumulative point threshold value, obtains second and shares result displaying template, And the share that will acquire resource is filled into the second sharing result displaying template and is shown.
In one embodiment, expression can also be matched iterated integral and expression matching total score and filled to sharing by first terminal As a result it shows in template.
For example, Figure 16 shows the schematic diagram that the first sharing result in one embodiment shows template.With reference to Figure 16, The interface includes that expression matching iterated integral 1601, expression matching total score 1602, pre-set text 1603 and the user of user's acquisition obtain The share 1604 of the resource taken.
In one embodiment, when the non-real-name authentication of the first user identifier for logging in first terminal, first terminal can be obtained It takes and shows template with the result under the scene, show that template provides real-name authentication entrance in the result, it is real to guide user to carry out Resource is got after name certification.Figure 17 shows the signals that the result under real-name authentication scene non-in one embodiment shows template Figure.
In one embodiment, when the first user identifier for logging in first terminal, which does not meet resource, gets condition, first Terminal, which can be obtained, shows template with the result under the scene, shows that template shows guidance information in the result, eventually with guidance first End checks that resource gets message in message container, and the trigger action by getting message to resource obtains resource.Figure 18 shows The schematic diagram that the result under policy requirements scene shows template is gone out in one embodiment not meeting.Wherein, resource neck is not met It takes condition to can be user and do not meet resource and get policy or user and does not agree to that resource gets agreement etc..
In one embodiment, when first terminal connect exception with server, first terminal can obtain under the scene Result show template, the result show template show guidance information, to guide first terminal to check money in message container Message is got in source, and the trigger action by getting message to resource obtains resource.Figure 19 shows network in one embodiment Result under abnormal scene shows the schematic diagram of template.
It is understood that in non-real-name authentication, not meeting resource and getting condition and first terminal and connect with server Under abnormal scene, the share for not showing in template and obtaining resource is as a result shown.
In above-described embodiment, the resource that template is obtained with visual pattern displaying user is shown by result, to realize Convey more useful information amounts.
In one embodiment, resource acquiring method further include: for each facial expression image, when the facial expression image and phase When matching result between the facial image that should be acquired indicates successful match, expression corresponding to the matching result by successful match Partition is uploaded to server, so that expression matching iterated integral is got in the accumulative expression matching received of server.When in suspension After passing expression matching point, the resource for receiving server feedback gets message;Showing resource is led in the message container of social session Take message;Message, which is got, according to resource gets resource;The resource got is to match iterated integral according to the expression added up on server Distribution obtains from resource corresponding to resource sharing message.Above-mentioned steps can execute after S208.
Specifically, the matching result for each facial expression image, between the facial image when the facial expression image and accordingly acquired When indicating successful match, first terminal can the matching point of expression corresponding to the matching result by successful match be uploaded to server, So that expression matching iterated integral is got in the accumulative expression matching received of server.First terminal can also be in locally accumulative expression Expression matching iterated integral is got in matching, and when being accumulated by new expression matching iterated integral every time, by currently available table Feelings matching iterated integral is uploaded to server, so that the expression matching iterated integral stored on server real-time update server.
Further, after first terminal stops to upload expression matching point to server, server can be anti-to first terminal Feedback resource gets message.First terminal can get message by showing resource in the message container of social session, and be led according to resource Message is taken to get resource.The resource wherein got is that iterated integral is matched according to the expression added up on server from resource sharing message Distribution obtains in corresponding resource.Figure 20 shows in one embodiment and gets message by message container showing resource Interface schematic diagram.The interface includes that message container 2001 and the resource shown in message container 2001 get message 2002.
For example, user A is stopping to upload expression matching timesharing, the expression matching accumulation on server is divided into 200, expression It is 1080 with total score, then the accounting that expression matching iterated integral accounts for expression matching total score is 200/1080, and server can be by resource point Enjoy resource corresponding to message 200/1080 is distributed to user A.
Wherein, stop to upload expression matching point, expression is not matched there is also facial expression image to be stopped uploading expression The case where partition.For example, current social activity session switches to running background or first terminal receives tranquil phone, Huo Zhehui Talking about connection disconnection etc. of the showing interface between suspension windows or first terminal and server can all cause to stop to upload expression Partition.
In the present embodiment, it provides at the processing resource allocation matched by expression when the process for obtaining resource is interrupted Reason mode improves the fault-tolerance in process resource access.
In one embodiment, S208 includes: to obtain the corresponding face template of the facial expression image for each facial expression image Feature;For each facial expression image, the face characteristic of the facial image accordingly acquired is determined;Calculate face template feature and face Similarity between feature;Matching result between determining each facial expression image according to similarity and the facial image that accordingly acquires.
Wherein, face template is characterized in the face characteristic of face template image.There is corresponding people in each facial expression image Face template image, the face characteristic of the corresponding face template image of facial expression image are that the corresponding face template of facial expression image is special Sign.The corresponding face template image of facial expression image is that living body is made and being acquired with after facial expressions and acts corresponding to the facial expression image Image.
Expression corresponding to facial expression image is such as: smiling face's (partly opening one's mouth, two are all opened), positive face of opening one's mouth, side face of opening one's mouth (left side), Side face of opening one's mouth (right side), the positive face (left side) closed one's eyes, positive face (right side) of closing one's eyes, eye closing (left side) of opening one's mouth, eye closing (right side) of opening one's mouth, nod and (bow) with And nod and (face upward head) etc..
In one embodiment, face template feature includes face template local feature.Face characteristic includes face part Feature.Calculate the similarity between face template feature and face characteristic, comprising: calculate face template local feature and face part The first similarity between feature.Matching knot between determining each facial expression image according to similarity and the facial image that accordingly acquires Fruit, comprising: according to the first similarity and the weight of face local feature, determine each facial expression image and the face figure that accordingly acquires Matching result as between.
Wherein, face template local feature is the feature of face template image local.For example eye feature or mouth are special Sign etc..First terminal can carry out characteristic point label to face template image (facial image) based on face detection labeling algorithm.It is special Sign point specifically can be the characteristic point of face facial area in image.Face detection labeling algorithm can be customized as needed, such as It can be ASM (Active Shape Model active shape model) algorithm, AAM (outside Active Appreance Model active See model) algorithm or cascade regression algorithm etc..The face detection markup model that first terminal can be completed using training, by face Template image (facial image) inputs in face detection markup model, the face template image (face after obtaining characteristic point label Image) and the corresponding coordinate of each characteristic point.
In the present embodiment, face local feature can be the shape feature that Partial Feature point surrounds.Such as eye feature, It can be the shape feature that eye portion characteristic point surrounds.
Specifically, first terminal obtains that the facial expression image is multipair to answer when being intended to match facial expression image with facial image Face template image, it is special that reflection expression is extracted from the face template image according to the distribution of the characteristic point of the face template image The face template local feature of the regional area of sign.First terminal carries out characteristic point label to facial image again, and extracts reflection The face local feature of the regional area of expressive features calculates the similarity of face template local feature and face local feature, Obtain similarity score.
In one embodiment, face template local feature includes multiple characteristics, and face local feature also includes more A characteristic.First terminal can calculate separately the similarity between corresponding characteristic, further according to each similarity and each similar The weight calculation for spending corresponding characteristic obtains similarity score, to obtain facial expression image and corresponding according to similarity score Matching result between the facial image of acquisition.
For example, for smiling face's image, mouth is in half state and eyes are all in opening state.At this point, mouth Feature, left eye feature and right eye feature are all face local features.The mouth feature of facial image can be calculated in first terminal With the similarity A1 of the mouth feature of face template image corresponding to smiling face's image, the left eye feature of facial image and smiling face's figure As the similarity A2 of the left eye feature of corresponding face template image, corresponding to the right eye feature and smiling face's image of facial image Face template image right eye feature similarity A3.Wherein, the weight of mouth feature is k1, and the weight of left eye feature is K2, the weight of right eye feature is k3, then the similarity score of facial image and smiley image is k1*A1+k2*A2+k2*A3.
In the present embodiment, similarity calculation only is carried out to the local feature of reflection expressive features, it can be to a certain degree The upper accuracy for guaranteeing similarity calculation, and the efficiency of similarity calculation can be improved.
In one embodiment, face template feature further includes face template posture feature.Face characteristic includes face appearance State feature.The resource acquiring method further include: calculate the second similarity between face template posture feature and human face posture feature. According to the first similarity and the weight of face local feature, between each facial expression image and the facial image accordingly acquired is determined With result, comprising: according to the weight of the first similarity, the weight of face local feature, the second similarity and human face posture feature, Determine the matching result between each facial expression image and the facial image accordingly acquired.
Wherein, face template posture feature is face template image septum reset rotation angle.For example, facial expression image is corresponding Expression is when opening one's mouth side face (left side), and face deflects certain angle to the left.
Specifically, first terminal obtains that the facial expression image is multipair to answer when being intended to match facial expression image with facial image Face template image, it is special that reflection expression is extracted from the face template image according to the distribution of the characteristic point of the face template image The face template local feature of the regional area of sign, and extract the face rotation angle of the face template image.First terminal is again Characteristic point label is carried out to facial image, and extracts face local feature and the face rotation of the regional area of reflection expressive features Angle, then calculate separately the similarity and two face rotation angles of face template local feature and face local feature Similarity.First terminal obtains similarity point further according to the weight calculation of each similarity and the corresponding characteristic of each similarity Value, thus the matching result between obtaining facial expression image according to similarity score and the facial image that accordingly acquires.
For example, mouth is in open configuration and face when the corresponding expression of facial expression image is to open one's mouth side face (left side) Certain angle is deflected to the left.At this point, mouth is characterized in face local feature, it further include human face posture feature.First terminal can be counted Calculate the similarity A1 of the mouth feature of face template image corresponding to the mouth feature for obtaining facial image and smiling face's image, people The similarity of the face template posture feature of face template image corresponding to the human face posture feature and facial expression image of face image A2.Wherein, the weight of mouth feature is k1, and the weight of human face posture feature is k2, then the phase of facial image and facial expression image It is k1*A1+k2*A2 like degree score value.
It is understood that since the eyes of different user, mouth size itself have different, the table that may be made Feelings have deviation with face template face, for opening eyes, magnifying the expressions such as mouth.When open eyes in facial image, the degree of opening one's mouth is much larger than Also think to hit expression, i.e. successful match when face template image.
In the present embodiment, the similarity calculation to human face posture is increased, so that expression matching is with more acurrate.
In above-described embodiment, by the way that the face characteristic of facial image face template feature corresponding with facial expression image is carried out Similarity calculation obtains matching result according to similarity again, improves the matched accuracy of expression.
In one embodiment, it when first terminal controls multiple expression figures successively behind session interface, does not acquire yet When to facial image matched with any one facial expression image in this multiple facial expression image, then first terminal can not get money Source.At this point, first terminal, which can obtain resource acquisition, to be terminated picture and shows.Figure 21 shows showing resource in one embodiment and obtains Take the interface schematic diagram for terminating picture.
Figure 22 is the flow diagram of resource sharing method in one embodiment.The present embodiment is mainly applied in this way Second terminal 112 in above-mentioned Fig. 1 illustrates.Referring to Figure 22, which specifically comprises the following steps:
S2202, showing resource, which is shared, in the session interface corresponding to social session matches posting port.
Specifically, second terminal showing resource can be shared and match posting port in the session interface corresponding to social session.Money Source, which is shared, configures the page into resource sharing for triggering with posting port, to complete necessity configuration to resource sharing.Resource point Enjoying can be indicated with merging with the form of icon, hyperlink or button.
For example, second terminal can in conversation page as shown in fig. 23 a display session toolbar, and in session work Have showing resource in column to share with posting port 2301.Aroused by resource sharing with posting port 2301 and is shown as shown in fig. 23b Second level toolbar shows in second level toolbar and jumps entrance 2303.And it is jumped to as shown in figure 24 by jumping entrance 2303 Resource sharing configure the page.
Wherein, second terminal can correspond to resource sharing and show prompt bubble with posting port, and show in prompt bubble Entrance prompt information.
In one embodiment, second terminal can the application version corresponding to the device model of present terminal, social session When this meets resource sharing condition, just showing resource is shared and matches posting port in the session interface corresponding to social session.
In one embodiment, when carrying out social session, whether detectable local downloads resource sharing is matched second terminal File is set, is not downloaded such as, then triggers downloading resource sharing configuration file.Completion, resource are not downloaded in resource sharing configuration file Share and cancel logical response (ash is set) with posting port, triggering resource sharing matches posting port, prompts " downloading resource sharing configuration File please tries again later ".After the completion of the downloading of resource sharing configuration file, resource sharing is (bright with posting port unlatching logical response It is aobvious).If the target terminal resource sharing for participating in social session does not download completion with posting port, triggering resource sharing matches posting port, Then prompt " other side's resource sharing configuration file does not download completion, can not carry out resource sharing ".
In one embodiment, when the target terminal for participating in social session is carrying out resource sharing or resource acquisition, then Resource sharing cancels logical response with posting port (ash is set).
S2204 configures resource to be shared with posting port by resource sharing, generates corresponding resource sharing message.
Specifically, second terminal detection acts on the predefined operation of resource sharing message arrangement entrance, if detecting The predefined operation then enters resource sharing and configures the page.The resource sharing configuration page can be floating layers or window Form.Predefined operation such as single-click operation, double click operation, slide or multi-point touch operation etc..
Second terminal can be in share resource sharing configuration page setup resource sharing mode and share resource.Wherein, divide The share for enjoying resource customized can be arranged, and can also default share.First terminal shows toggle control, and user clicks the switching control Part then triggers switching command, and first terminal changes another resource share into according to the switching command, for example, change into " 8.88 " or " 2.88 " etc..
Second terminal can enter the payment page, obtain data needed for resource is shared in payment, thus according to data needed for paying Generate payment request, and by the payment request be sent to server perhaps Third-party payment platform by server or third party The paymate processes payment request, and payment result is returned to second terminal.
S2206 sends resource sharing message to the target terminal for participating in social session;Resource sharing message, is used to indicate Target terminal matches the matched share of iterated integral according to expression, obtains resource from resource corresponding to resource sharing message;Table Feelings match iterated integral, be according to by specify in session interface multiple facial expression images in region respectively with the face figure that accordingly acquires What the matching result as between determined.
Specifically, second terminal is after sending resource sharing message to the target terminal for participating in social session, playing resource Share and initiates animation.Figure 25 shows interface schematic diagram when playing resource in one embodiment shares initiation animation.
In one embodiment, after sending resource sharing message, whether detectable target terminal is opened is taken the photograph second terminal As head.If detecting, target terminal does not open camera, in session showing interface prompting message, and cancels after certain time length Display.The prompting message concretely " reminds other side to open camera, to make expression neck red packet ".
In one embodiment, whether second terminal after sending resource sharing message, will by also detectable target terminal Words showing interface is suspension windows.If detect target terminal by session showing interface be suspension windows, in the exhibition of session interface Show prompting message, and cancels display after certain time length.The prompting message concretely " remind other side return to video pictures rob it is red Packet ".
S2208 receives video data and corresponding facial expression image associated data that target terminal is synchronized.
Wherein, facial expression image associated data can be the mark and display data or facial expression image itself of facial expression image And display data.Display data include the label etc. of the display position and carrying in session interface of facial expression image.
Specifically, target terminal controls multiple facial expression images and successively passes through session circle after receiving resource sharing message Specified region in face, and the video data of current social session and corresponding facial expression image associated data are synchronized to second Terminal, so that second terminal can be with the display picture of simultaneous display target terminal.
In one embodiment, facial expression image associated data further includes facial expression image in the session interface of target terminal When mobile, the multi-medium data of target terminal output.
In one embodiment, the resource acquisition that second terminal also receives target terminal transmission starts to notify, and falls to count When animation mark and background audio mark, in local session interface playing resource share initiate animation at the end of, continue It plays countdown animation and identifies corresponding countdown animation, after countdown animation play, start to play background sound frequency marking Know corresponding background audio, and receives video data and corresponding facial expression image associated data that target terminal is synchronized.
In one embodiment, when second terminal is after sending resource sharing message certain time length, target end is not received When the resource acquisition that end is sent starts notice, then the resource sharing time-out picture as shown in figure 27 in session showing interface.
S2210 obtains facial expression image associated with video data according to facial expression image associated data.
Specifically, in facial expression image associated data include facial expression image mark mark when, second terminal can be in local According to identifier lookup facial expression image corresponding with the mark.
S2212, in session interface, render video data and associated facial expression image.
In one embodiment, when the social activity session is double session, the quantity of target terminal is only one.At this point, Second terminal can be directly in session interface, render video data and associated facial expression image, with simultaneous display target terminal Display picture.In one embodiment, when the social activity session is group session, the quantity of target terminal is more than one.At this point, Session boundary division can be multiple regions by second terminal, render video corresponding to different target terminal respectively in each region Data and associated facial expression image, with the display picture of each target terminal of simultaneous display.Second terminal can be in Display on the same screen A picture full screen display is selected in multiple pictures.
Second terminal can also select a target terminal from each target terminal, render video counts corresponding to the target terminal According to associated facial expression image, with the display picture of the simultaneous display target terminal.
It is understood that second terminal is after sending resource sharing message to the target terminal for participating in social session, The matched share of iterated integral can be matched according to expression, obtain resource from resource corresponding to resource sharing message.Namely It says, second terminal can also render the video data of this terminal and associated facial expression image in a region of division, The video data and associated facial expression image that only render this terminal may be selected.
The schematic diagram at session interface when Figure 26 A shows group session in one embodiment.With reference to Figure 26 A, it is assumed that participate in money The number of users that source is shared is 9, then is 9 regions by session boundary division, and it is right to render different user institute respectively in each region The video data and associated facial expression image answered.Session interface shows when Figure 26 B shows group session in another embodiment It is intended to.With reference to Figure 26 A, second terminal shows the user list for participating in resource sharing in session interface, from the user list A user is selected, and then shows video data corresponding to the user and associated facial expression image.
Above-mentioned resource sharing method, after sending resource sharing message to target terminal, instruction target terminal passes through expression The accumulative expression of images match matches iterated integral, and then obtains resource, and receives the video data of target terminal transmission and be associated Facial expression image associated data, render video data and facial expression image in session interface, to show that target terminal passes through expression The process of matching way acquisition resource.General family cooperation is needed to complete living body faces Image Acquisition, and real-time perfoming expression in this way It matches to share the mode of resource, greatly improves the antagonism for fighting plug-in user.
In one embodiment, S2208 includes: the sequence of frames of video and sequence of frames of video for receiving target terminal and being synchronized In each corresponding facial expression image associated data of video frame.S2210 includes: to obtain corresponding view according to each facial expression image associated data The associated facial expression image of frequency frame.S2212 includes: to play each video frame in sequence of frames of video frame by frame in session interface; It is synchronous to render the currently playing associated facial expression image of video frame when playing video frame frame by frame.
Specifically, target terminal obtains current sessions interface when the multiple facial expression images of control move in session interface Middle facial expression image associated data and current video frame correspondence are sent to second terminal, so that second terminal is often receiving frame view When frequency frame, synchronizes and receive corresponding facial expression image associated data.Second terminal can play frame by frame in session interface in this way The video frame received, and when playing video frame frame by frame, it is synchronous to render the currently playing associated facial expression image of video frame, It realizes and shows picture synchronization with target terminal.
In the present embodiment, good in network state by facial expression image associated data and video frame corresponding transmission frame by frame Under the conditions of, improve the real-time of picture synchronization.
In one embodiment, second terminal also can receive the video that target terminal is sent, which is recorded by target terminal The process that system controls the specified region that multiple facial expression images successively pass through in session interface obtains.In this way, second terminal can basis Instruction is checked in user's triggering, plays the video that each target terminal is sent, and passes through acquisition facial image to reproduce each target terminal Add up expression with facial expression image matching to match point to obtain the process of resource.
In one embodiment, resource sharing method further include: obtain active period;Within active period, The show activity entrance in session interface;Resource to be shared is configured by active ingress, generates corresponding resource sharing message.
Specifically, active period is the period that quick portal generation resource sharing message can be used.Active period It can be indicated by movable time started and activity end time.Second terminal directly can read active period from local, It can be from server pull active period.
Further, second terminal can be when current time be more than or equal to the movable time started, show activity entrance, and When current time is greater than the activity end time, terminate the displaying to active ingress.Active ingress is directly entered resource for triggering Share the configuration page, to complete necessity configuration to resource sharing message.Active ingress can use icon, hyperlink or button Form indicate.For example, referring again to Figure 23 A, second terminal can in conversation page as shown in fig. 23 a active ingress 2302, and resource sharing as of fig. 24 is jumped directly to by the active ingress 2302 and configures the page.
In the present embodiment, disappeared by providing quick entrance progress resource distribution in active period with generating resource sharing Breath, improves resource sharing efficiency.
In one embodiment, resource sharing method further include: it receives the expression that target terminal is sent and matches iterated integral, and The share for the resource that target terminal is obtained from resource corresponding to resource sharing message;When expression matching iterated integral reaches default When iterated integral threshold value, obtain first share result show template, and by share fill to first share result show template in into Row is shown;It when expression matching iterated integral is not up to preset cumulative point threshold value, obtains second and shares result and show template, and by part Volume is filled into the second sharing result displaying template and is shown.
Specifically, target terminal obtains currently available expression matching after multiple facial expression images pass through session interface The share of expression matching iterated integral and the resource obtained from resource corresponding to resource sharing message is sent to the by iterated integral Two terminals.Expression matching iterated integral is compared by second terminal with preset cumulative point threshold value.When expression matching iterated integral reaches When preset cumulative divides threshold value, obtains first and share result displaying template, and the share that will acquire resource fills to first and shares knot Fruit shows in template and is shown;When expression matching iterated integral is not up to preset cumulative point threshold value, obtains second and share result Show template, and the share that will acquire resource is filled into the second sharing result displaying template and is shown.
In one embodiment, expression can also be matched iterated integral and expression matching total score and filled to sharing by first terminal As a result it shows in template.
In above-described embodiment, the resource that template is obtained with visual pattern displaying user is shown by result, to realize Convey more useful information amounts.
In one embodiment, resource sharing method further include: showing resource is shared in the message container of social session Message;Detection acts on the operation of resource sharing message;According to remaining in resource corresponding to operation acquisition resource sharing message Resource.
Wherein, message container is to accommodate the figure layer of produced message in social session.Specifically, target terminal is according to table Feelings match the matched share of iterated integral, and after obtaining resource in resource corresponding to resource sharing message, second terminal can be in society It intersects showing resource in the message container of words and shares message, and detect the operation for acting on resource sharing message, further according to operation Obtain remaining resource in resource corresponding to resource sharing message.
In the present embodiment, the way of recycling for not sharing resource is provided, the waste of resource is avoided.
Figure 28 is the flow diagram of method for processing resource in one embodiment.The present embodiment is mainly applied in this way Server 120 in above-mentioned Fig. 1 illustrates.Referring to Figure 28, which specifically comprises the following steps:
S2802 obtains the expression matching that terminal is sent and starts to request.
Wherein, it is for requesting to start to carry out request of the expression matching to obtain resource that expression matching, which starts request,.First Terminal can send expression matching to server and start to request after receiving resource sharing message.
S2804 starts request in response to expression matching and returns to expression matching configuration information to terminal;Confidence is matched in expression matching Breath is used to indicate terminal and controls multiple facial expression images according to expression matching configuration information and successively passes through the specified area in session interface Domain, and determine that expression matches iterated integral according to the matching result between each facial expression image and the facial image accordingly acquired.
In one embodiment, when terminal after sending expression matching and starting request in certain time length to receive server The expression matching configuration information of return then determines network connection time-out.Terminal can by bubble prompt, " network be different at session interface Often, resource sharing can not be participated in ", and notify resource sharing message originator, so that resource sharing message originator corresponding One terminal prompts " Network Abnormal, can not carry out resource sharing, and resource will retract after 24 hours " by bubble at session interface.
S2806 receives the resource acquisition request for the carrying expression matching iterated integral that terminal is sent.
S2808 is requested in response to resource acquisition, matches the resource of the matched share of iterated integral with expression for terminal distribution.
Specifically, the user identifier currently logged in can be matched iterated integral with expression and be sent to server by first terminal.Clothes For business device after getting expression matching iterated integral, inquiry expression matches total score, and expression matching iterated integral is calculated and accounts for expression The accounting of total score is matched, determining further according to the accounting should distribute in resource corresponding to resource sharing message to the user identifier Resource share.Wherein, expression matching total score is accessible highest expression matching point when theoretically carrying out expression matching Summation.
For example, the expression matching accumulation of user A is divided into 800, it is 1080 that expression, which matches total score, then expression matching iterated integral accounts for The accounting that expression matches total score is 800/1080, and server can be by 800/1080 distribution of resource corresponding to resource sharing message To user A.
It is understood that resource acquisition may include that resource allocation and resource provide two stages.Resource allocation and resource Granting can be realized by same server, can also be realized by different servers.When being realized by two servers, distribution After server matches the resource of the matched share of iterated integral for terminal distribution with expression, terminal is again to the resource service of storage resource Resource is provided in device request, and the resource that distribution server is terminal distribution is issued to terminal again by Resource Server.
Above-mentioned method for processing resource, the feedback expression matching configuration after the expression matching for receiving terminal transmission starts request Information, so that terminal, which controls multiple facial expression images according to expression matching configuration information, successively passes through the specified area in session interface Domain, and determine that expression matches iterated integral according to the matching result between each facial expression image and the facial image accordingly acquired, in turn Iterated integral is matched according to expression to obtain resource.Need the cooperation of general family to complete living body faces Image Acquisition in this way, and in real time into Row expression matches to share the mode of resource, greatly improves the antagonism for fighting plug-in user.
In one embodiment, method for processing resource further include: receive the expression matching point that terminal successively reports;It is accumulative Expression matching iterated integral is got in each expression matching;When detecting terminal aborts upload expression matching timesharing, according to current accumulative Obtain expression matching iterated integral matched share determine the resource to be allocated to terminal;It gets and disappears to terminal down distributing resource Breath, resource, which gets message and is used to indicate terminal, gets the resource to be allocated to terminal.
Specifically, the matching result for each facial expression image, between the facial image when the facial expression image and accordingly acquired When indicating successful match, first terminal can the matching point of expression corresponding to the matching result by successful match be uploaded to server, So that expression matching iterated integral is got in the accumulative expression matching received of server.First terminal can also be in locally accumulative expression Expression matching iterated integral is got in matching, and when being accumulated by new expression matching iterated integral every time, by currently available table Feelings matching iterated integral is uploaded to server, so that the expression matching iterated integral stored on server real-time update server.
Further, after first terminal stops to upload expression matching point to server, server can be anti-to first terminal Feedback resource gets message.First terminal can get message by showing resource in the message container of social session, and be led according to resource Message is taken to get resource.The resource wherein got is that iterated integral is matched according to the expression added up on server from resource sharing message Distribution obtains in corresponding resource.
In the present embodiment, it provides at the processing resource allocation matched by expression when the process for obtaining resource is interrupted Reason mode improves the fault-tolerance in process resource access.
Figure 29 shows the timing diagram interacted between terminal and server in one embodiment.With reference to Figure 29, this when program process It is related to resource sharing terminal, resource acquisition terminal, distribution server and Resource Server.Resource sharing terminal is in social session institute Showing resource, which is shared, in corresponding session interface matches posting port, configures resource to be shared with posting port by resource sharing, raw At corresponding resource sharing message, resource sharing message is sent to the resource acquisition terminal for participating in the social session.
After resource acquisition terminal receives resource sharing message in social session, expression matching is sent to distribution server Start to request.Distribution server starts request in response to expression matching and returns to expression matching configuration information to resource acquisition terminal. Resource acquisition terminal sends resource acquisition to resource sharing terminal further according to expression matching configuration information and starts to notify, and plays money Animation is shared in source, and then continues to play countdown animation after resource sharing animation.Resource sharing terminal is receiving money After source acquisition starts notice, i.e., playing resource, which is shared, initiates animation, continues to play after resource sharing initiates animation and count When animation.
Resource acquisition terminal starts to control multiple facial expression images from session interface after countdown animation play Successively the end position into the session interface is mobile for initial position, and to resource sharing terminal synchronizing video data and accordingly Facial expression image associated data so that resource acquisition terminal is synchronous with resource sharing terminal display.
Resource acquisition terminal can be currently by session interface the and failed facial expression image for being matched to facial image In, the facial expression image closest to end position is chosen as focus facial expression image, obtains the people that focus facial expression image accordingly acquires Face image determines the matching result between focus facial expression image and the facial image accordingly acquired, when matching result expression When with success, return it is described currently by the session interface and not successfully be matched to facial image facial expression image in, The step of facial expression image of the closest end position is as focus facial expression image is chosen, to the last a facial expression image arrives Up at the end position.Resource acquisition terminal determines that expression matches further according to the corresponding matching result of multiple facial expression images Iterated integral.
Resource acquisition terminal can for each facial expression image, between the facial image when the facial expression image and accordingly acquired When indicating successful match with result, the matching point of expression corresponding to the matching result by successful match is uploaded to server, so that Expression matching iterated integral is got in the accumulative expression matching received of server.
Resource acquisition terminal sends the resource acquisition request for carrying expression matching iterated integral, distribution service to distribution server Device, which is then issued to Resource Server transmission, shares result displaying template notice, and Resource Server will share result again and show under template It is sent to resource acquisition terminal.Distribution server is then the money that resource acquisition terminal distribution matches the matched share of iterated integral with expression Source.
Resource acquisition terminal sends resource to Resource Server again and gets request, to get distribution server as resource acquisition The resource of terminal distribution, and template is shown in the sharing result that session showing interface is filled with resource share, and is synchronized to resource Share terminal display.
It should be understood that although each step in the flow chart of the various embodiments described above is successively shown according to the instruction of arrow Show, but these steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly state otherwise herein, this There is no stringent sequences to limit for the execution of a little steps, these steps can execute in other order.Moreover, above-mentioned each implementation At least part step in example may include that perhaps these sub-steps of multiple stages or stage be not necessarily for multiple sub-steps It is to execute completion in synchronization, but can execute at different times, the execution sequence in these sub-steps or stage It is not necessarily and successively carries out, but can be at least part wheel of the sub-step or stage of other steps or other steps Stream alternately executes.
As shown in figure 30, in one embodiment, a kind of resource acquisition device 3000 is provided.Referring to Figure 30, the resource Acquisition device 3000 includes: receiving module 3001, control module 3002, image collection module 3003, determining module 3004 and money Source obtains module 3005.
Receiving module 3001, for receiving resource sharing message in social session.
Control module 3002, for controlling multiple facial expression images and successively passing through session interface in response to resource sharing message In specified region;The corresponding social session in session interface.
Image collection module 3003, for obtaining the face figure accordingly acquired when each facial expression image passes through session interface Picture.
Determining module 3004, for determining each facial expression image and the corresponding matching result between the facial image that acquires;Root Determine that expression matches iterated integral according to the corresponding matching result of multiple facial expression images.
Source obtaining module 3005 matches the matched share of iterated integral with expression for pressing, and from resource sharing message, institute is right Resource is obtained in the resource answered.
Above-mentioned resource acquisition device 3000 successively passes through the dynamic of the specified region in session interface using multiple facial expression images State control mode acquires facial image and is matched with current by the facial expression image at session interface, in real time further according to multiple tables The corresponding matching result of feelings image determines that expression matches iterated integral, to add up to divide according to expression matching to obtain resource. General family cooperation is needed to complete living body faces Image Acquisition in this way, and real-time perfoming expression matches to share the mode of resource, pole The earth improves the antagonism to plug-in user.
In one embodiment, resource acquisition device 3000 further include: switching module 3006.
Switching module 3006, for being suspended in response to resource sharing message when social session is shown as suspension windows Showing resource shares prompt picture in window;Obtain the display mode switching command for corresponding to session interface;In response to display side Formula switching command switches to the session interface of full screen display.
In one embodiment, control module 3002 is also used in response to resource sharing message, corresponding to social session Session interface in playing resource share animation;At the end of resource sharing animation play, continue to play countdown animation;It is falling After timing animation play, start to play background audio, and control the finger that multiple facial expression images successively pass through in session interface Determine region.
In one embodiment, resource acquisition device 3000 further include: cue module 3007.
Cue module 3007, for the preset duration since being moved the first facial expression image in multiple facial expression images Afterwards, when the matching result between the facial image acquired when first facial expression image and accordingly indicates that it fails to match, then from session circle Facial expression image is chosen in the facial expression image passed through in face;Facial expression image corresponding to selection shows prompt bubble, prompts bubble packet Include facial expressions and acts guidance information;Control prompt bubble follows the facial expression image synchronizing moving of selection.
In one embodiment, control module 3002 is also used to control multiple facial expression images in response to resource sharing message From the initial position in session interface, successively the end position into session interface is mobile.
In one embodiment, image collection module 3003 be also used to currently by session interface and failed It is fitted in the facial expression image of facial image, chooses the facial expression image closest to end position as focus facial expression image;It obtains burnt The facial image that point facial expression image accordingly acquires.Determining module 3004 is also used to the people for determining focus facial expression image with accordingly acquiring Matching result between face image;When matching result indicates successful match, return currently by session interface and failed It is matched in the facial expression image of facial image, chooses step of the facial expression image as focus facial expression image closest to end position Suddenly, to the last a facial expression image reaches at end position.
In one embodiment, determining module 3004 is also used to add focus mark for focus facial expression image;When matching is tied When fruit indicates successful match, the focus mark of focus facial expression image is updated to hit label.
In one embodiment, resource acquisition device 3000 further include: multi-medium data output module 3008.
Multi-medium data output module 3008, for obtaining expression matching point corresponding with matching result;When expression matches When point reaching the first matching point threshold value and the not up to second matching point threshold value, the first multi-medium data is exported;When expression matching point When reaching the second matching point threshold value, output is different from the second multi-medium data of the first multi-medium data;Wherein, the first multimedia Data and the second multi-medium data indicate successful match.
In one embodiment, multi-medium data output module 3008 is also used to when continuous corresponding of multiple facial expression images When indicating successful match with result, then third multi-medium data is exported;Third multi-medium data indicate expression continuous coupling at Function.
In one embodiment, multi-medium data output module 3008 is also used to be moved to stop bits when focus facial expression image It sets place and matching result indicates when it fails to match, then export the 4th multi-medium data;4th multi-medium data indicates that matching is lost It loses.
In one embodiment, resource acquisition device 3000 further include: result display module 3009.
As a result display module 3009, for obtaining first point when expression matching iterated integral reaches preset cumulative point threshold value It enjoys result and shows template, and the share that will acquire resource is filled into the first sharing result displaying template and is shown;Work as expression When matching iterated integral is not up to preset cumulative point threshold value, obtains second and share result displaying template, and will acquire the share of resource Filling shows in template to the second sharing result and is shown.
As shown in figure 31, in one embodiment, resource acquisition device 3000 further include: switching module 3006, prompt mould Block 3007, multi-medium data output module 3008, result display module 3009, uploading module 3010 and interruption processing module 3011。
Uploading module 3010, for for each facial expression image, between the facial image when the facial expression image and accordingly acquired Matching result when indicating successful match, the matching point of expression corresponding to the matching result by successful match is uploaded to server, So that expression matching iterated integral is got in the accumulative expression matching received of server;
Interruption processing module 3011, for after stopping to upload expression matching point, the resource for receiving server feedback to be got Message;Showing resource gets message in the message container of social session;Message, which is got, according to resource gets resource;The money got Source is to distribute to obtain from resource corresponding to resource sharing message according to the expression matching iterated integral added up on server.
In one embodiment, determining module 3004 is also used to that it is corresponding to obtain the facial expression image for each facial expression image Face template feature;For each facial expression image, the face characteristic of the facial image accordingly acquired is determined;Calculate face template Similarity between feature and face characteristic;Between determining each facial expression image according to similarity and the facial image that accordingly acquires With result.
In one embodiment, face template feature includes face template local feature;Face characteristic includes face part Feature.Determining module 3004 is also used to calculate the first similarity between face template local feature and face local feature;According to The weight of first similarity and face local feature determines the matching knot between each facial expression image and the facial image accordingly acquired Fruit.
In one embodiment, face template feature further includes face template posture feature;Face characteristic includes face appearance State feature.Determining module 3004 is also used to: calculating the second similarity between face template posture feature and human face posture feature;It presses According to the weight of the first similarity, the weight of face local feature, the second similarity and human face posture feature, each expression figure is determined Matching result between picture and the facial image accordingly acquired.
As shown in figure 32, in one embodiment, a kind of resource sharing device 3200 is provided.Referring to Figure 32, the resource Sharing apparatus 3200 includes: display module 3201, generation module 3202, sending module 3203, receiving module 3204, obtains module 3205 and rendering module 3206.
Display module 3201 is shared for showing resource in the session interface corresponding to social session and matches posting port.
Generation module 3202 generates corresponding resource for configuring resource to be shared with posting port by resource sharing Share message.
Sending module 3203, for sending resource sharing message to the target terminal for participating in social session;Resource sharing disappears Breath is used to indicate target terminal according to expression and matches the matched share of iterated integral, from resource corresponding to resource sharing message Obtain resource;Expression matches iterated integral, is according to by specifying multiple facial expression images in region in session interface respectively and accordingly What the matching result between the facial image of acquisition determined.
Receiving module 3204, for receiving the video data and corresponding facial expression image incidence number that target terminal is synchronized According to.
Module 3205 is obtained, for obtaining facial expression image associated with video data according to facial expression image associated data.
Rendering module 3206 is used for render video data and associated facial expression image in session interface.
Above-mentioned resource sharing device 3200, after sending resource sharing message to target terminal, instruction target terminal passes through Facial expression image matches accumulative expression and matches iterated integral, and then obtains resource, and receives the video data and phase of target terminal transmission Associated facial expression image associated data, render video data and facial expression image in session interface, to show that target terminal passes through The process of expression matching way acquisition resource.General family cooperation is needed to complete living body faces Image Acquisition, and real-time perfoming in this way Expression matches to share the mode of resource, greatly improves the antagonism for fighting plug-in user.
In one embodiment, receiving module 3204 is also used to receive the sequence of frames of video that target terminal is synchronized, and view Each corresponding facial expression image associated data of video frame in frequency frame sequence.Module 3205 is obtained to be also used to be associated with according to each facial expression image Data obtain the associated facial expression image of corresponding video frame.Rendering module 3206 is also used to each video in sequence of frames of video Frame plays frame by frame in session interface;It is synchronous to render the currently playing associated table of video frame when playing video frame frame by frame Feelings image.
In one embodiment, generation module 3202 is also used to obtain active period;Within active period, in meeting Talk about show activity entrance in interface;Resource to be shared is configured by active ingress, generates corresponding resource sharing message.
In one embodiment, rendering module 3206 is also used to receive the expression matching iterated integral of target terminal transmission, and The share for the resource that target terminal is obtained from resource corresponding to resource sharing message;When expression matching iterated integral reaches default When iterated integral threshold value, obtain first share result show template, and by share fill to first share result show template in into Row is shown;It when expression matching iterated integral is not up to preset cumulative point threshold value, obtains second and shares result and show template, and by part Volume is filled into the second sharing result displaying template and is shown.
As shown in figure 33, in one embodiment, resource sharing device 3200 further include: resource reclaim module 3207
Resource reclaim module 3207, for the showing resource sharing message in the message container of social session;Detection effect In the operation of resource sharing message;According to remaining resource in resource corresponding to operation acquisition resource sharing message.
As shown in figure 34, in one embodiment, a kind of resource processing unit 3400 is provided.Referring to Figure 34, the resource Processing unit 3400 includes: to obtain module 3401, feedback module 3402, receiving module 3403 and distribution module 3404.
Module 3401 is obtained, the expression matching for obtaining terminal transmission starts to request.
Feedback module 3402 returns to expression matching configuration information to terminal for starting request in response to expression matching;Table Feelings matching configuration information is used to indicate terminal according to the multiple facial expression images of expression matching configuration information control and successively passes through session circle Specified region in face, and determine that expression matches according to the matching result between each facial expression image and the facial image accordingly acquired Iterated integral.
Receiving module 3403, the resource acquisition request of the carrying expression matching iterated integral for receiving terminal transmission.
It is matched with expression to match iterated integral for terminal distribution for requesting in response to resource acquisition for distribution module 3404 The resource of share.
Above-mentioned resource processing unit 3400, the feedback expression matching after the expression matching for receiving terminal transmission starts request Configuration information, so that terminal, which controls multiple facial expression images according to expression matching configuration information, successively passes through specifying in session interface Region, and determine that expression matches iterated integral according to the matching result between each facial expression image and the facial image accordingly acquired, into And iterated integral is matched according to expression to obtain resource.General family cooperation is needed to complete living body faces Image Acquisition in this way, and in real time Expression matching is carried out to share the mode of resource, greatly improves the antagonism for fighting plug-in user.
In one embodiment, distribution module 3404 is also used to receive the expression matching point that terminal successively reports;It is accumulative each Expression matching iterated integral is got in expression matching;When detecting terminal aborts upload expression matching timesharing, add up according to current To expression matching iterated integral matched share determine the resource to be allocated to terminal;Message is got to terminal down distributing resource, Resource, which gets message and is used to indicate terminal, gets the resource to be allocated to terminal.
Figure 35 shows the internal structure chart of computer equipment in one embodiment.The computer equipment specifically can be figure Terminal 110 in 1.As shown in figure 35, which includes processor, the memory, network connected by system bus Interface, input equipment and display screen.Wherein, memory includes non-volatile memory medium and built-in storage.The computer equipment Non-volatile memory medium be stored with operating system, can also be stored with computer program, which is held by processor When row, may make processor realize resource acquisition sharing method.Computer program can also be stored in the built-in storage, the meter When calculation machine program is executed by processor, may make processor execution resources obtain sharing method.The display screen of computer equipment can To be liquid crystal display or electric ink display screen etc., input unit can be the touch layer covered on display screen, can also be with It is the key being arranged on computer equipment shell, trace ball or Trackpad, is also possible to external keyboard, Trackpad or mouse Deng.It will be understood by those skilled in the art that structure shown in Figure 35, only part-structure relevant to application scheme Block diagram, does not constitute the restriction for the computer equipment being applied thereon to application scheme, and specific computer equipment can be with Including than more or fewer components as shown in the figure, perhaps combining certain components or with different component layouts.
Figure 36 shows the internal structure chart of computer equipment in one embodiment.The computer equipment specifically can be figure Server 120 in 1.As shown in figure 36, which includes processor, memory and the net connected by system bus Network interface.Wherein, memory includes non-volatile memory medium and built-in storage.The non-volatile memories of the computer equipment are situated between Matter is stored with operating system, can also be stored with computer program, when which is executed by processor, may make processor Realize method for processing resource.Computer program can also be stored in the built-in storage, when which is executed by processor, It may make processor execution resources processing method.It will be understood by those skilled in the art that structure shown in Figure 36, only with The block diagram of the relevant part-structure of application scheme, does not constitute the computer equipment being applied thereon to application scheme Limit, specific computer equipment may include than more or fewer components as shown in the figure, perhaps combine certain components or With different component layouts.
In one embodiment, resource acquisition device provided by the present application, resource sharing device and resource processing unit It can be implemented as a kind of form of computer program, computer program can be in the computer equipment as shown in Figure 35 or Figure 36 Operation, the non-volatile memory medium of computer equipment can store composition resource acquisition device, resource sharing device and resource Each program module of processing unit, for example, receiving module 3001, control module 3002, image collection module shown in Figure 30 3003, determining module 3004 and source obtaining module 3005 etc..The computer program of each program module composition makes processor Execute the resource acquiring method, resource sharing method and resource processing side of each embodiment of the application described in this specification Step in method.
For example, computer equipment shown in Figure 35 can pass through the reception in resource acquisition device 3000 as shown in figure 30 Module 3001, for receiving resource sharing message in social session.By control module 3002 in response to resource sharing message, It controls multiple facial expression images and successively passes through the specified region in session interface;The corresponding social session in session interface.It is obtained by image Modulus block 3003 obtains each facial expression image and passes through the facial image accordingly acquired when session interface.It is true by determining module 3004 Matching result between fixed each facial expression image and the facial image accordingly acquired;According to the corresponding matching of multiple facial expression images As a result determine that expression matches iterated integral.By source obtaining module 3005 by the matched share of iterated integral is matched with expression, from money Source, which is shared in resource corresponding to message, obtains resource.
Computer equipment shown in Figure 35 can also pass through the displaying mould in resource sharing device 3200 as shown in figure 32 Block 3201 in the session interface corresponding to social session showing resource share match posting port.Generation module 3202 passes through resource point It enjoys and configures resource to be shared with posting port, generate corresponding resource sharing message.Sending module 3203 is to participating in social session Target terminal send resource sharing message;Resource sharing message is used to indicate target terminal according to expression and matches iterated integral The share matched obtains resource from resource corresponding to resource sharing message;Expression matches iterated integral, is according to by session circle Multiple facial expression images in region are specified respectively to determine with the matching result between the facial image that accordingly acquires in face.Receiving module The video data and corresponding facial expression image associated data that 3204 reception target terminals are synchronized.Module 3205 is obtained according to expression Image associated data obtains facial expression image associated with video data.Rendering module 3206 is in session interface, render video Data and associated facial expression image.
Computer equipment shown in Figure 36 can also pass through the acquisition mould in resource processing unit 3400 as shown in figure 34 Block 3401 obtains the expression matching that terminal is sent and starts to request.Feedback module 3402 starts request to terminal in response to expression matching Return to expression matching configuration information;It is more according to the control of expression matching configuration information to be used to indicate terminal for expression matching configuration information A facial expression image successively passes through the specified region in session interface, and according to each facial expression image and the facial image that accordingly acquires Between matching result determine expression match iterated integral.Receiving module 3403 receives the carrying expression matching iterated integral that terminal is sent Resource acquisition request.Distribution module 3404 is requested in response to resource acquisition, and it is matched with expression to match iterated integral for terminal distribution The resource of share.
In one embodiment, a kind of computer readable storage medium is provided, is deposited on the computer readable storage medium Computer program is contained, when which is executed by processor, so that processor executes following steps: in social session Receive resource sharing message;In response to resource sharing message, controls multiple facial expression images and successively pass through specifying in session interface Region;The corresponding social session in session interface;It obtains each facial expression image and passes through the facial image accordingly acquired when session interface;Really Matching result between fixed each facial expression image and the facial image accordingly acquired;According to the corresponding matching of multiple facial expression images As a result determine that expression matches iterated integral;By matching the matched share of iterated integral with expression, the money corresponding to the resource sharing message Resource is obtained in source.
In one embodiment, when which is executed by processor, processor is also made to execute following steps: when When social session is shown as suspension windows, in response to resource sharing message, showing resource shares prompt picture in suspension windows; Obtain the display mode switching command for corresponding to session interface;In response to display mode switching command, full screen display is switched to Session interface.
In one embodiment, in response to resource sharing message, multiple facial expression images is controlled and are successively passed through in session interface Specified region, comprising: in response to resource sharing message, playing resource is shared dynamic in the session interface corresponding to social session It draws;At the end of resource sharing animation play, continue to play countdown animation;After countdown animation play, start to broadcast Background audio is put, and controls multiple facial expression images and successively passes through the specified region in session interface.
In one embodiment, when which is executed by processor, so that processor executes following steps: certainly more From when first facial expression image in a facial expression image starts mobile after preset duration, when first facial expression image and the people that accordingly acquires When matching result between face image indicates that it fails to match, then expression figure is chosen in the facial expression image that passes through from session interface Picture;Facial expression image corresponding to selection shows prompt bubble, and prompting bubble includes facial expressions and acts guidance information;Control prompt bubble Follow the facial expression image synchronizing moving of selection.
In one embodiment, in response to resource sharing message, multiple facial expression images is controlled and are successively passed through in session interface Specified region, comprising: in response to resource sharing message, control multiple facial expression images from the initial position in session interface successively End position into session interface is mobile.
In one embodiment, it obtains each facial expression image and passes through the facial image accordingly acquired when session interface, comprising: Currently by choosing closest to end position in session interface the and failed facial expression image for being matched to facial image Facial expression image is as focus facial expression image;Obtain the facial image that focus facial expression image accordingly acquires.Determine each facial expression image With the matching result between the facial image that accordingly acquires, comprising: determine between focus facial expression image and the facial image accordingly acquired Matching result;When matching result indicates successful match, return currently by session interface and be matched to people not successfully In the facial expression image of face image, choose closest to end position facial expression image as focus facial expression image the step of, until most The latter facial expression image reaches at end position.
In one embodiment, when which is executed by processor, processor is also made to execute following steps: for Focus facial expression image adds focus mark;When matching result indicates successful match, method further include: by focus facial expression image Focus mark is updated to hit label.
In one embodiment, when which is executed by processor, also makes processor execute following steps: obtaining Take expression matching point corresponding with matching result;When expression matching point reaches the first matching point threshold value and the not up to second matching When dividing threshold value, the first multi-medium data is exported;When expression matching point reaches the second matching point threshold value, output is different from more than first Second multi-medium data of media data;Wherein, the first multi-medium data and the second multi-medium data indicate successful match.
In one embodiment, when which is executed by processor, processor is also made to execute following steps: when When continuously the corresponding matching result of multiple facial expression images indicates successful match, then third multi-medium data is exported;The more matchmakers of third The success of volume representation expression continuous coupling.
In one embodiment, when which is executed by processor, processor is also made to execute following steps: when When focus facial expression image is moved at end position and matching result indicates that it fails to match, then the 4th multi-medium data is exported;The Four multi-medium datas indicate that it fails to match.
In one embodiment, when which is executed by processor, so that processor executes following steps: working as table When feelings matching iterated integral reaches preset cumulative point threshold value, obtains first and share result displaying template, and will acquire the share of resource Filling shows in template to the first sharing result and is shown;When expression matching iterated integral is not up to preset cumulative point threshold value, It obtains second and shares result displaying template, and the share that will acquire resource is filled into the second sharing result displaying template and opened up Show.
In one embodiment, when which is executed by processor, processor is also made to execute following steps: right It, will when the matching result between the facial image when the facial expression image and accordingly acquired indicates successful match in each facial expression image The matching point of expression corresponding to the matching result of successful match is uploaded to server, so that the accumulative expression received of server Partition obtains expression matching iterated integral.When the computer program is executed by processor, processor is also made to execute following steps: when Stop after uploading expression matching point, the resource for receiving server feedback gets message;It is shown in the message container of social session Resource gets message;Message, which is got, according to resource gets resource;The resource got is according to the expression matching added up on server Iterated integral, which is distributed from resource corresponding to resource sharing message, to be obtained.
In one embodiment, the matching result between each facial expression image and the facial image accordingly acquired is determined, comprising: For each facial expression image, the corresponding face template feature of the facial expression image is obtained;For each facial expression image, determination is accordingly adopted The face characteristic of the facial image of collection;Calculate the similarity between face template feature and face characteristic;It is determined according to similarity every Matching result between a facial expression image and the facial image accordingly acquired.
In one embodiment, face template feature includes face template local feature;Face characteristic includes face part Feature.Calculate the similarity between face template feature and face characteristic, comprising: calculate face template local feature and face part The first similarity between feature.Matching knot between determining each facial expression image according to similarity and the facial image that accordingly acquires Fruit, comprising: according to the first similarity and the weight of face local feature, determine each facial expression image and the face figure that accordingly acquires Matching result as between.
In one embodiment, face template feature further includes face template posture feature;Face characteristic includes face appearance State feature.When the computer program is executed by processor, processor is also made to execute following steps: it is special to calculate face template posture The second similarity between human face posture feature of seeking peace.According to the first similarity and the weight of face local feature, each table is determined Matching result between feelings image and the facial image accordingly acquired, comprising: according to the first similarity, the power of face local feature The weight of weight, the second similarity and human face posture feature determines between each facial expression image and the facial image accordingly acquired With result.
Above-mentioned storage medium successively passes through the kinetic controlling equation in the specified region in session interface using multiple facial expression images Formula acquires facial image in real time and is matched with current by the facial expression image at session interface, each further according to multiple facial expression images Self-corresponding matching result determines that expression matches iterated integral, to add up to divide according to expression matching to obtain resource.It needs in this way Living body faces Image Acquisition is completed in general family cooperation, and real-time perfoming expression matches to share the mode of resource, greatlys improve To the antagonism of plug-in user.
In one embodiment, a kind of computer equipment, including memory and processor are provided, is stored in memory Computer program, when computer program is executed by processor, so that processor executes following steps: receiving money in social session Share message in source;In response to resource sharing message, controls multiple facial expression images and successively pass through the specified region in session interface;Meeting Talk about the corresponding social session in interface;It obtains each facial expression image and passes through the facial image accordingly acquired when session interface;It determines each Matching result between facial expression image and the facial image accordingly acquired;It is true according to the corresponding matching result of multiple facial expression images Determine expression matching iterated integral;By the matched share of iterated integral is matched with expression, obtained from resource corresponding to resource sharing message Take resource.
In one embodiment, when which is executed by processor, processor is also made to execute following steps: when When social session is shown as suspension windows, in response to resource sharing message, showing resource shares prompt picture in suspension windows; Obtain the display mode switching command for corresponding to session interface;In response to display mode switching command, full screen display is switched to Session interface.
In one embodiment, in response to resource sharing message, multiple facial expression images is controlled and are successively passed through in session interface Specified region, comprising: in response to resource sharing message, playing resource is shared dynamic in the session interface corresponding to social session It draws;At the end of resource sharing animation play, continue to play countdown animation;After countdown animation play, start to broadcast Background audio is put, and controls multiple facial expression images and successively passes through the specified region in session interface.
In one embodiment, when which is executed by processor, so that processor executes following steps: certainly more From when first facial expression image in a facial expression image starts mobile after preset duration, when first facial expression image and the people that accordingly acquires When matching result between face image indicates that it fails to match, then expression figure is chosen in the facial expression image that passes through from session interface Picture;Facial expression image corresponding to selection shows prompt bubble, and prompting bubble includes facial expressions and acts guidance information;Control prompt bubble Follow the facial expression image synchronizing moving of selection.
In one embodiment, in response to resource sharing message, multiple facial expression images is controlled and are successively passed through in session interface Specified region, comprising: in response to resource sharing message, control multiple facial expression images from the initial position in session interface successively End position into session interface is mobile.
In one embodiment, it obtains each facial expression image and passes through the facial image accordingly acquired when session interface, comprising: Currently by choosing closest to end position in session interface the and failed facial expression image for being matched to facial image Facial expression image is as focus facial expression image;Obtain the facial image that focus facial expression image accordingly acquires.Determine each facial expression image With the matching result between the facial image that accordingly acquires, comprising: determine between focus facial expression image and the facial image accordingly acquired Matching result;When matching result indicates successful match, return currently by session interface and be matched to people not successfully In the facial expression image of face image, choose closest to end position facial expression image as focus facial expression image the step of, until most The latter facial expression image reaches at end position.
In one embodiment, when which is executed by processor, processor is also made to execute following steps: for Focus facial expression image adds focus mark;When matching result indicates successful match, method further include: by focus facial expression image Focus mark is updated to hit label.
In one embodiment, when which is executed by processor, also makes processor execute following steps: obtaining Take expression matching point corresponding with matching result;When expression matching point reaches the first matching point threshold value and the not up to second matching When dividing threshold value, the first multi-medium data is exported;When expression matching point reaches the second matching point threshold value, output is different from more than first Second multi-medium data of media data;Wherein, the first multi-medium data and the second multi-medium data indicate successful match.
In one embodiment, when which is executed by processor, processor is also made to execute following steps: when When continuously the corresponding matching result of multiple facial expression images indicates successful match, then third multi-medium data is exported;The more matchmakers of third The success of volume representation expression continuous coupling.
In one embodiment, when which is executed by processor, processor is also made to execute following steps: when When focus facial expression image is moved at end position and matching result indicates that it fails to match, then the 4th multi-medium data is exported;The Four multi-medium datas indicate that it fails to match.
In one embodiment, when which is executed by processor, so that processor executes following steps: working as table When feelings matching iterated integral reaches preset cumulative point threshold value, obtains first and share result displaying template, and will acquire the share of resource Filling shows in template to the first sharing result and is shown;When expression matching iterated integral is not up to preset cumulative point threshold value, It obtains second and shares result displaying template, and the share that will acquire resource is filled into the second sharing result displaying template and opened up Show.
In one embodiment, when which is executed by processor, processor is also made to execute following steps: right It, will when the matching result between the facial image when the facial expression image and accordingly acquired indicates successful match in each facial expression image The matching point of expression corresponding to the matching result of successful match is uploaded to server, so that the accumulative expression received of server Partition obtains expression matching iterated integral.When the computer program is executed by processor, processor is also made to execute following steps: when Stop after uploading expression matching point, the resource for receiving server feedback gets message;It is shown in the message container of social session Resource gets message;Message, which is got, according to resource gets resource;The resource got is according to the expression matching added up on server Iterated integral, which is distributed from resource corresponding to resource sharing message, to be obtained.
In one embodiment, the matching result between each facial expression image and the facial image accordingly acquired is determined, comprising: For each facial expression image, the corresponding face template feature of the facial expression image is obtained;For each facial expression image, determination is accordingly adopted The face characteristic of the facial image of collection;Calculate the similarity between face template feature and face characteristic;It is determined according to similarity every Matching result between a facial expression image and the facial image accordingly acquired.
In one embodiment, face template feature includes face template local feature;Face characteristic includes face part Feature.Calculate the similarity between face template feature and face characteristic, comprising: calculate face template local feature and face part The first similarity between feature.Matching knot between determining each facial expression image according to similarity and the facial image that accordingly acquires Fruit, comprising: according to the first similarity and the weight of face local feature, determine each facial expression image and the face figure that accordingly acquires Matching result as between.
In one embodiment, face template feature further includes face template posture feature;Face characteristic includes face appearance State feature.When the computer program is executed by processor, processor is also made to execute following steps: it is special to calculate face template posture The second similarity between human face posture feature of seeking peace.According to the first similarity and the weight of face local feature, each table is determined Matching result between feelings image and the facial image accordingly acquired, comprising: according to the first similarity, the power of face local feature The weight of weight, the second similarity and human face posture feature determines between each facial expression image and the facial image accordingly acquired With result.
Above-mentioned computer equipment successively passes through the dynamic control in the specified region in session interface using multiple facial expression images Mode acquires facial image and is matched with current by the facial expression image at session interface, in real time further according to multiple facial expression images Corresponding matching result determines that expression matches iterated integral, to add up to divide according to expression matching to obtain resource.It needs in this way General family cooperation is wanted to complete living body faces Image Acquisition, and real-time perfoming expression matches to share the mode of resource, greatly mentions The high antagonism to plug-in user.
In one embodiment, a kind of computer readable storage medium is provided, is deposited on the computer readable storage medium Computer program is contained, when which is executed by processor, so that processor executes following steps: in social session institute Showing resource, which is shared, in corresponding session interface matches posting port;Resource to be shared is configured with posting port by resource sharing, it is raw At corresponding resource sharing message;Resource sharing message is sent to the target terminal for participating in social session;Resource sharing message is used The matched share of iterated integral is matched according to expression in instruction target terminal, money is obtained from resource corresponding to resource sharing message Source;Expression matches iterated integral, be according to by specify in session interface multiple facial expression images in region respectively with accordingly acquire What the matching result between facial image determined;Receive video data and corresponding facial expression image incidence number that target terminal is synchronized According to;According to facial expression image associated data, facial expression image associated with video data is obtained;In session interface, render video Data and associated facial expression image.
In one embodiment, the video data and corresponding facial expression image associated data that target terminal is synchronized are received, It include: to receive each corresponding facial expression image association of video frame in the sequence of frames of video and sequence of frames of video that target terminal is synchronized Data.According to facial expression image associated data, facial expression image associated with video data is obtained, comprising: according to each facial expression image Associated data obtains the associated facial expression image of corresponding video frame.In session interface, render video data and associated table Feelings image, comprising: play each video frame in sequence of frames of video frame by frame in session interface;When playing video frame frame by frame, It is synchronous to render the currently playing associated facial expression image of video frame.
In one embodiment, when which is executed by processor, so that processor executes following steps: obtaining Active period;Within active period, the show activity entrance in session interface;It is configured by active ingress to be shared Resource generates corresponding resource sharing message.
In one embodiment, when which is executed by processor, so that processor executes following steps: receiving The expression matching iterated integral that target terminal is sent and the resource that target terminal is obtained from resource corresponding to resource sharing message Share;It when expression matching iterated integral reaches preset cumulative point threshold value, obtains first and shares result and show template, and by share Filling shows in template to the first sharing result and is shown;When expression matching iterated integral is not up to preset cumulative point threshold value, It obtains second and shares result displaying template, and share is filled into the second sharing result displaying template and is shown.
In one embodiment, when which is executed by processor, so that processor executes following steps: in society It intersects showing resource in the message container of words and shares message;Detection acts on the operation of resource sharing message;It is obtained according to operation Remaining resource in resource corresponding to resource sharing message.
Above-mentioned storage medium, after sending resource sharing message to target terminal, instruction target terminal passes through facial expression image It matches accumulative expression and matches iterated integral, and then obtain resource, and receive the video data and associated table of target terminal transmission Feelings image associated data, render video data and facial expression image in session interface, to show that target terminal is matched by expression Mode obtains the process of resource.General family cooperation is needed to complete living body faces Image Acquisition in this way, and real-time perfoming expression matches Share the mode of resource, greatly improves the antagonism for fighting plug-in user.
In one embodiment, a kind of computer equipment, including memory and processor are provided, is stored in memory Computer program, when computer program is executed by processor, so that processor executes following steps: corresponding to social session Showing resource, which is shared, in session interface matches posting port;Resource to be shared is configured with posting port by resource sharing, generates and corresponds to Resource sharing message;Resource sharing message is sent to the target terminal for participating in social session;Resource sharing message, is used to indicate Target terminal matches the matched share of iterated integral according to expression, obtains resource from resource corresponding to resource sharing message;Table Feelings match iterated integral, be according to by specify in session interface multiple facial expression images in region respectively with the face figure that accordingly acquires What the matching result as between determined;Receive the video data and corresponding facial expression image associated data that target terminal is synchronized;Root According to facial expression image associated data, facial expression image associated with video data is obtained;In session interface, render video data and Associated facial expression image.
In one embodiment, the video data and corresponding facial expression image associated data that target terminal is synchronized are received, It include: to receive each corresponding facial expression image association of video frame in the sequence of frames of video and sequence of frames of video that target terminal is synchronized Data.According to facial expression image associated data, facial expression image associated with video data is obtained, comprising: according to each facial expression image Associated data obtains the associated facial expression image of corresponding video frame.In session interface, render video data and associated table Feelings image, comprising: play each video frame in sequence of frames of video frame by frame in session interface;When playing video frame frame by frame, It is synchronous to render the currently playing associated facial expression image of video frame.
In one embodiment, when which is executed by processor, so that processor executes following steps: obtaining Active period;Within active period, the show activity entrance in session interface;It is configured by active ingress to be shared Resource generates corresponding resource sharing message.
In one embodiment, when which is executed by processor, so that processor executes following steps: receiving The expression matching iterated integral that target terminal is sent and the resource that target terminal is obtained from resource corresponding to resource sharing message Share;It when expression matching iterated integral reaches preset cumulative point threshold value, obtains first and shares result and show template, and by share Filling shows in template to the first sharing result and is shown;When expression matching iterated integral is not up to preset cumulative point threshold value, It obtains second and shares result displaying template, and share is filled into the second sharing result displaying template and is shown.
In one embodiment, when which is executed by processor, so that processor executes following steps: in society It intersects showing resource in the message container of words and shares message;Detection acts on the operation of resource sharing message;It is obtained according to operation Remaining resource in resource corresponding to resource sharing message.
Above-mentioned computer equipment, after sending resource sharing message to target terminal, instruction target terminal passes through expression figure Iterated integral is matched as matching accumulative expression, and then obtains resource, and receives the video data of target terminal transmission and associated Facial expression image associated data, render video data and facial expression image in session interface, to show that target terminal passes through expression The process of resource is obtained with mode.General family cooperation is needed to complete living body faces Image Acquisition, and real-time perfoming expression in this way Match the antagonism for greatly improving to share the mode of resource and fighting plug-in user.
In one embodiment, a kind of computer readable storage medium is provided, is deposited on the computer readable storage medium Computer program is contained, when which is executed by processor, so that processor executes following steps: obtaining terminal and send Expression matching start to request;Start request in response to expression matching and returns to expression matching configuration information to terminal;Expression matching Configuration information is used to indicate terminal and controls multiple facial expression images according to expression matching configuration information and successively passes through in session interface Specified region, and determine that expression matches accumulation according to the matching result between each facial expression image and the facial image accordingly acquired Point;Receive the resource acquisition request for the carrying expression matching iterated integral that terminal is sent;It is requested in response to resource acquisition, for terminal point With the resource for matching the matched share of iterated integral with expression.
In one embodiment, when which is executed by processor, so that processor executes following steps: receiving The expression matching point that terminal successively reports;Add up each expression matching and gets expression matching iterated integral;When detecting terminal aborts It uploads expression and matches timesharing, determined according to the matched share of expression matching iterated integral institute being currently accumulated by be allocated to terminal Resource;Message is got to terminal down distributing resource, and resource, which gets message and is used to indicate terminal, gets the resource to be allocated to terminal.
Above-mentioned storage medium, feedback expression matching is with confidence after the expression matching for receiving terminal transmission starts request Breath, so that terminal, which controls multiple facial expression images according to expression matching configuration information, successively passes through the specified region in session interface, And determine that expression matches iterated integral, and then basis according to the matching result between each facial expression image and the facial image accordingly acquired Expression matches iterated integral to obtain resource.General family cooperation is needed to complete living body faces Image Acquisition, and real-time perfoming table in this way Feelings match to share the mode of resource, greatly improve the antagonism for fighting plug-in user.
In one embodiment, a kind of computer equipment, including memory and processor are provided, is stored in memory Computer program, when computer program is executed by processor, so that processor executes following steps: obtaining the expression that terminal is sent Matching starts to request;Start request in response to expression matching and returns to expression matching configuration information to terminal;Confidence is matched in expression matching Breath is used to indicate terminal and controls multiple facial expression images according to expression matching configuration information and successively passes through the specified area in session interface Domain, and determine that expression matches iterated integral according to the matching result between each facial expression image and the facial image accordingly acquired;It receives The resource acquisition request for the carrying expression matching iterated integral that terminal is sent;It is requested in response to resource acquisition, is terminal distribution and table The resource of the feelings matching matched share of iterated integral.
In one embodiment, when which is executed by processor, so that processor executes following steps: receiving The expression matching point that terminal successively reports;Add up each expression matching and gets expression matching iterated integral;When detecting terminal aborts It uploads expression and matches timesharing, determined according to the matched share of expression matching iterated integral institute being currently accumulated by be allocated to terminal Resource;Message is got to terminal down distributing resource, and resource, which gets message and is used to indicate terminal, gets the resource to be allocated to terminal.
Above-mentioned computer equipment, feedback expression matching is with confidence after the expression matching for receiving terminal transmission starts request Breath, so that terminal, which controls multiple facial expression images according to expression matching configuration information, successively passes through the specified region in session interface, And determine that expression matches iterated integral, and then basis according to the matching result between each facial expression image and the facial image accordingly acquired Expression matches iterated integral to obtain resource.General family cooperation is needed to complete living body faces Image Acquisition, and real-time perfoming table in this way Feelings match to share the mode of resource, greatly improve the antagonism for fighting plug-in user.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with Relevant hardware is instructed to complete by computer program, the program can be stored in a non-volatile computer and can be read In storage medium, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, provided herein Each embodiment used in any reference to memory, storage, database or other media, may each comprise non-volatile And/or volatile memory.Nonvolatile memory may include that read-only memory (ROM), programming ROM (PROM), electricity can be compiled Journey ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms, such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) directly RAM (RDRAM), straight Connect memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance Shield all should be considered as described in this specification.
Only several embodiments of the present invention are expressed for above embodiments, and the description thereof is more specific and detailed, but can not Therefore limitations on the scope of the patent of the present invention are interpreted as.It should be pointed out that for those of ordinary skill in the art, Without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to protection model of the invention It encloses.Therefore, the scope of protection of the patent of the invention shall be subject to the appended claims.

Claims (30)

1. a kind of resource acquiring method, comprising:
Resource sharing message is received in social session;
In response to the resource sharing message, controls multiple facial expression images and successively pass through the specified region in session interface;It is described Session interface corresponds to the social session;
It obtains each facial expression image and passes through the facial image accordingly acquired when the session interface;
Determine the matching result between each facial expression image and the facial image accordingly acquired;
Determine that expression matches iterated integral according to the corresponding matching result of the multiple facial expression image;
By the matched share of iterated integral is matched with the expression, money is obtained from resource corresponding to the resource sharing message Source.
2. the method according to claim 1, wherein the method also includes:
When the social session is shown as suspension windows, shown in the suspension windows in response to the resource sharing message Resource sharing prompts picture;
Obtain the display mode switching command for corresponding to the session interface;
In response to the display mode switching command, the session interface of full screen display is switched to.
3. control is multiple the method according to claim 1, wherein described in response to the resource sharing message Facial expression image successively passes through the specified region in session interface, comprising:
In response to the resource sharing message, playing resource shares animation in the session interface corresponding to the social session;
At the end of the resource sharing animation play, continue to play countdown animation;
After the countdown animation play, start to play background audio, and controls multiple facial expression images and successively pass through meeting Talk about the specified region in interface.
4. the method according to claim 1, wherein the method also includes:
Since being moved the first facial expression image in the multiple facial expression image after preset duration, when the first expression figure When matching result between picture and the facial image accordingly acquired indicates that it fails to match, then
Facial expression image is chosen in the facial expression image passed through from the session interface;
The facial expression image corresponding to selection shows prompt bubble, and the prompt bubble includes facial expressions and acts guidance information;
Control the facial expression image synchronizing moving that the prompt bubble follows selection.
5. control is multiple the method according to claim 1, wherein described in response to the resource sharing message Facial expression image successively passes through the specified region in session interface, comprising:
In response to the resource sharing message, multiple facial expression images are controlled from the initial position in session interface successively to the meeting The end position talked about in interface is mobile.
6. according to the method described in claim 5, it is characterized in that, described obtain each facial expression image by the session interface The facial image of Shi Xiangying acquisition, comprising:
Currently by choosing closest to institute in the session interface the and failed facial expression image for being matched to facial image The facial expression image of end position is stated as focus facial expression image;
Obtain the facial image that the focus facial expression image accordingly acquires;
Matching result between the determination each facial expression image and the facial image accordingly acquired, comprising:
Determine the matching result between the focus facial expression image and the facial image accordingly acquired;
When the matching result indicates successful match, return it is described currently pass through the session interface and failed It is fitted in the facial expression image of facial image, chooses step of the facial expression image of the closest end position as focus facial expression image Suddenly, to the last a facial expression image reaches at the end position.
7. according to the method described in claim 6, it is characterized in that, the method also includes:
Focus mark is added for the focus facial expression image;
When the matching result indicates successful match, the method also includes:
The focus mark of the focus facial expression image is updated to hit label.
8. according to the method described in claim 6, it is characterized in that, when the matching result indicate successful match when, the side Method further include:
Obtain expression matching point corresponding with the matching result;
When expression matching point reaches the first matching point threshold value and the not up to second matching point threshold value, more than first matchmaker is exported Volume data;
When expression matching point reaches the second matching point threshold value, output is different from more than the second of first multi-medium data Media data;
Wherein, first multi-medium data and second multi-medium data indicate successful match.
9. according to the method described in claim 6, it is characterized in that, the method also includes:
When continuously the corresponding matching result of multiple facial expression images indicates successful match, then third multi-medium data is exported;Institute Stating third multi-medium data indicates the success of expression continuous coupling.
10. according to the method described in claim 6, it is characterized in that, the method also includes:
It is when the focus facial expression image is moved at the end position and the matching result indicates that it fails to match, then defeated 4th multi-medium data out;4th multi-medium data indicates that it fails to match.
11. the method according to claim 1, wherein the method also includes:
When expression matching iterated integral reaches preset cumulative point threshold value, obtains first and share result displaying template, and will obtain It takes the share of resource to fill into the first sharing result displaying template to be shown;
When expression matching iterated integral is not up to preset cumulative point threshold value, obtains second and share result displaying template, and will The share for obtaining resource, which is filled into the second sharing result displaying template, to be shown.
12. the method according to claim 1, wherein the method also includes:
For each facial expression image, the matching result between the facial image when the facial expression image and accordingly acquired indicates successful match When, the matching point of expression corresponding to the matching result by successful match is uploaded to server, receives so that the server is accumulative To expression matching get expression matching iterated integral;
The method also includes:
After stopping to upload expression matching point, the resource for receiving the server feedback gets message;
Show that the resource gets message in the message container of the social session;
Message, which is got, according to the resource gets resource;The resource got is according to the expression added up on the server Matching iterated integral, which is distributed from resource corresponding to the resource sharing message, to be obtained.
13. according to claim 1-5, method described in any one of 7-12, which is characterized in that determination each expression Matching result between image and the facial image accordingly acquired, comprising:
For each facial expression image, the corresponding face template feature of the facial expression image is obtained;
For each facial expression image, the face characteristic of the facial image accordingly acquired is determined;
Calculate the similarity between the face template feature and the face characteristic;
Matching result between determining each facial expression image according to the similarity and the facial image that accordingly acquires.
14. according to the method for claim 13, which is characterized in that the face template feature includes that face template part is special Sign;The face characteristic includes face local feature;
The similarity calculated between the face template feature and the face characteristic, comprising:
Calculate the first similarity between the face template local feature and the face local feature;
Matching result between the facial image for determining each facial expression image according to the similarity and accordingly acquiring, comprising:
According to first similarity and the weight of the face local feature, each facial expression image is determined and the people that accordingly acquires Matching result between face image.
15. according to the method for claim 14, which is characterized in that the face template feature further includes face template posture Feature;The face characteristic includes human face posture feature;
The method also includes:
Calculate the second similarity between the face template posture feature and the human face posture feature;
It is described according to first similarity and the weight of the face local feature, determine each facial expression image and corresponding acquisition Facial image between matching result, comprising:
It is special according to first similarity, the weight of the face local feature, second similarity and the human face posture The weight of sign determines the matching result between each facial expression image and the facial image accordingly acquired.
16. a kind of resource sharing method, comprising:
Showing resource, which is shared, in the session interface corresponding to social session matches posting port;
Resource to be shared is configured with posting port by the resource sharing, generates corresponding resource sharing message;
The resource sharing message is sent to the target terminal for participating in the social session;The resource sharing message, for referring to Show that the target terminal matches the matched share of iterated integral according to expression, is obtained from resource corresponding to the resource sharing message Take resource;The expression matches iterated integral, be according to by specified in session interface multiple facial expression images in region respectively with phase What the matching result between the facial image that should be acquired determined;
Receive the video data and corresponding facial expression image associated data that the target terminal is synchronized;
According to the facial expression image associated data, facial expression image associated with the video data is obtained;
In the session interface, the video data and the associated facial expression image are rendered.
17. according to the method for claim 16, which is characterized in that the video counts for receiving the target terminal and being synchronized According to corresponding facial expression image associated data, comprising:
Receive each corresponding expression figure of video frame in the sequence of frames of video and the sequence of frames of video that the target terminal is synchronized As associated data;
It is described according to the facial expression image associated data, obtain facial expression image associated with the video data, comprising:
According to each facial expression image associated data, the associated facial expression image of corresponding video frame is obtained;
It is described in the session interface, render the video data and the associated facial expression image, comprising:
Each video frame in the sequence of frames of video is played frame by frame in the session interface;
It is synchronous to render the currently playing associated facial expression image of video frame when playing video frame frame by frame.
18. according to the method for claim 16, which is characterized in that the method also includes:
Obtain active period;
Within the active period, the show activity entrance in the session interface;
Resource to be shared is configured by the active ingress, generates corresponding resource sharing message.
19. according to the method for claim 16, which is characterized in that the method also includes:
Expression matching iterated integral and the target terminal for receiving the target terminal transmission are right from the resource sharing message institute The share of the resource obtained in the resource answered;
It when expression matching iterated integral reaches preset cumulative point threshold value, obtains first and shares result and show template, and by institute State share fill to it is described first sharing result show template in be shown;
When expression matching iterated integral is not up to preset cumulative point threshold value, obtains second and share result displaying template, and will The share is filled into the second sharing result displaying template and is shown.
20. according to the method for claim 19, which is characterized in that the method also includes:
The resource sharing message is shown in the message container of the social session;
Detection acts on the operation of the resource sharing message;
According to remaining resource in resource corresponding to the operation acquisition resource sharing message.
21. a kind of method for processing resource, comprising:
The expression matching that terminal is sent is obtained to start to request;
Start request in response to expression matching and returns to expression matching configuration information to the terminal;The expression matching configuration Information is used to indicate the terminal according to the multiple facial expression images of expression matching configuration information control and successively passes through session interface In specified region, and it is tired according to the matching result between each facial expression image and the facial image accordingly acquired to determine that expression matches Integral;
Receive the resource acquisition request for the carrying expression matching iterated integral that the terminal is sent;
It is requested in response to the resource acquisition, matches the money of the matched share of iterated integral with the expression for the terminal distribution Source.
22. according to the method for claim 21, which is characterized in that the method also includes:
Receive the expression matching point that the terminal successively reports;
Add up each expression matching and gets expression matching iterated integral;
When detecting the terminal aborts upload expression matching timesharing, according to the expression matching iterated integral institute being currently accumulated by The share matched determines the resource of the terminal;
Get message to the terminal down distributing resource, the resource get message be used to indicate the terminal get it is to be allocated to institute State the resource of terminal.
23. a kind of resource acquisition device, comprising:
Receiving module, for receiving resource sharing message in social session;
Control module, for controlling multiple facial expression images and successively passing through in session interface in response to the resource sharing message Specified region;The session interface corresponds to the social session;
Image collection module, for obtaining the facial image accordingly acquired when each facial expression image passes through the session interface;
Determining module, for determining each facial expression image and the corresponding matching result between the facial image that acquires;According to institute It states the corresponding matching result of multiple facial expression images and determines that expression matches iterated integral;
Source obtaining module matches the matched share of iterated integral with the expression for pressing, right from the resource sharing message institute Resource is obtained in the resource answered.
24. device according to claim 23, which is characterized in that described device further include:
Cue module, after the preset duration since being moved the first facial expression image in the multiple facial expression image, when When matching result between the first facial expression image and the facial image accordingly acquired indicates that it fails to match, then from the session Facial expression image is chosen in the facial expression image passed through in interface;The facial expression image corresponding to selection shows prompt bubble, described Prompting bubble includes facial expressions and acts guidance information;Control the facial expression image synchronizing moving that the prompt bubble follows selection.
25. device according to claim 23, which is characterized in that described device further include:
As a result display module, for obtaining first and sharing knot when expression matching iterated integral reaches preset cumulative point threshold value Fruit shows template, and the share that will acquire resource is filled into the first sharing result displaying template and is shown;When described When expression matching iterated integral is not up to preset cumulative point threshold value, obtains second and share result displaying template, and will acquire resource Share is filled into the second sharing result displaying template and is shown.
26. device according to claim 23, which is characterized in that described device further include:
Uploading module, the matching knot for for each facial expression image, between the facial image when the facial expression image and accordingly acquired When fruit indicates successful match, the matching point of expression corresponding to the matching result by successful match is uploaded to server, so that described Expression matching iterated integral is got in the accumulative expression matching received of server;
Interruption processing module, for after stopping to upload expression matching point, the resource for receiving the server feedback to get message; Show that the resource gets message in the message container of the social session;Message, which is got, according to the resource gets resource; The resource got is that iterated integral is matched according to the expression added up on the server corresponding to the resource sharing message Resource in distribution obtain.
27. a kind of resource sharing device, comprising:
Display module is shared for showing resource in the session interface corresponding to social session and matches posting port;
Generation module generates corresponding resource sharing for configuring resource to be shared with posting port by the resource sharing Message;
Sending module, for sending the resource sharing message to the target terminal for participating in the social session;The resource point Message is enjoyed, the target terminal is used to indicate according to expression and matches the matched share of iterated integral, from the resource sharing message institute Resource is obtained in corresponding resource;The expression matches iterated integral, is according to multiple tables by specifying region in session interface What feelings image was respectively determined with the matching result between the facial image that accordingly acquires;
Receiving module, for receiving the video data and corresponding facial expression image associated data that the target terminal is synchronized;
Module is obtained, for obtaining facial expression image associated with the video data according to the facial expression image associated data;
Rendering module, for rendering the video data and the associated facial expression image in the session interface.
28. a kind of resource processing unit, comprising:
Module is obtained, the expression matching for obtaining terminal transmission starts to request;
Feedback module returns to expression matching configuration information to the terminal for starting request in response to expression matching;Institute State expression matching configuration information, be used to indicate the terminal according to the expression matching configuration information control multiple facial expression images according to The secondary specified region by session interface, and the matching result between the facial image according to each facial expression image and accordingly acquired Determine that expression matches iterated integral;
Receiving module, for receiving the resource acquisition request for the carrying expression matching iterated integral that the terminal is sent;
Distribution module matches iterated integral with the expression for the terminal distribution for requesting in response to the resource acquisition The resource for the share matched.
29. a kind of computer readable storage medium, computer program, the meter are stored on the computer readable storage medium When calculation machine program is executed by processor, so that the processor executes the method as described in any one of claim 1 to 22 Step.
30. a kind of computer equipment, including memory and processor, computer program, the meter are stored in the memory When calculation machine program is executed by the processor, so that the processor executes the side as described in any one of claim 1 to 22 The step of method.
CN201711243183.XA 2017-11-30 2017-11-30 Resource obtaining, sharing and processing method, device, storage medium and equipment Active CN109858215B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711243183.XA CN109858215B (en) 2017-11-30 2017-11-30 Resource obtaining, sharing and processing method, device, storage medium and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711243183.XA CN109858215B (en) 2017-11-30 2017-11-30 Resource obtaining, sharing and processing method, device, storage medium and equipment

Publications (2)

Publication Number Publication Date
CN109858215A true CN109858215A (en) 2019-06-07
CN109858215B CN109858215B (en) 2022-05-17

Family

ID=66888782

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711243183.XA Active CN109858215B (en) 2017-11-30 2017-11-30 Resource obtaining, sharing and processing method, device, storage medium and equipment

Country Status (1)

Country Link
CN (1) CN109858215B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110399836A (en) * 2019-07-25 2019-11-01 深圳智慧林网络科技有限公司 User emotion recognition methods, device and computer readable storage medium
CN110555374A (en) * 2019-07-25 2019-12-10 深圳壹账通智能科技有限公司 resource sharing method and device, computer equipment and storage medium
CN110619513A (en) * 2019-09-11 2019-12-27 腾讯科技(深圳)有限公司 Electronic resource obtaining method, electronic resource distributing method and related equipment
CN111626253A (en) * 2020-06-02 2020-09-04 上海商汤智能科技有限公司 Expression detection method and device, electronic equipment and storage medium
CN112035754A (en) * 2020-11-02 2020-12-04 北京梦知网科技有限公司 Trademark retrieval method and device, electronic equipment and storage medium
CN112684889A (en) * 2020-12-29 2021-04-20 上海掌门科技有限公司 User interaction method and device
WO2021083112A1 (en) * 2019-10-31 2021-05-06 维沃移动通信有限公司 Information sharing method and electronic device
CN112819453A (en) * 2021-02-10 2021-05-18 成都九天玄鸟科技有限公司 Man-machine interaction method, electronic equipment and system based on red packet
CN113127825A (en) * 2021-04-27 2021-07-16 北京百度网讯科技有限公司 Access right verification method and device
CN113891134A (en) * 2021-01-29 2022-01-04 北京字跳网络技术有限公司 Red packet interaction method and device, computer equipment and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102509053A (en) * 2011-11-23 2012-06-20 唐辉 Authentication and authorization method, processor, equipment and mobile terminal
CN103778360A (en) * 2012-10-26 2014-05-07 华为技术有限公司 Face unlocking method and device based on motion analysis
CN105389117A (en) * 2015-12-07 2016-03-09 腾讯科技(深圳)有限公司 Resource acquiring method and apparatus and resource processing method, apparatus and system
US20170118079A1 (en) * 2015-10-24 2017-04-27 International Business Machines Corporation Provisioning computer resources to a geographical location based on facial recognition
CN106920092A (en) * 2016-12-23 2017-07-04 阿里巴巴集团控股有限公司 A kind of virtual resource allocation method, client and server

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102509053A (en) * 2011-11-23 2012-06-20 唐辉 Authentication and authorization method, processor, equipment and mobile terminal
CN103778360A (en) * 2012-10-26 2014-05-07 华为技术有限公司 Face unlocking method and device based on motion analysis
US20170118079A1 (en) * 2015-10-24 2017-04-27 International Business Machines Corporation Provisioning computer resources to a geographical location based on facial recognition
CN105389117A (en) * 2015-12-07 2016-03-09 腾讯科技(深圳)有限公司 Resource acquiring method and apparatus and resource processing method, apparatus and system
CN106920092A (en) * 2016-12-23 2017-07-04 阿里巴巴集团控股有限公司 A kind of virtual resource allocation method, client and server

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110555374A (en) * 2019-07-25 2019-12-10 深圳壹账通智能科技有限公司 resource sharing method and device, computer equipment and storage medium
WO2021012742A1 (en) * 2019-07-25 2021-01-28 深圳壹账通智能科技有限公司 Resource sharing method and apparatus, computer device, and storage medium
CN110399836A (en) * 2019-07-25 2019-11-01 深圳智慧林网络科技有限公司 User emotion recognition methods, device and computer readable storage medium
CN110619513A (en) * 2019-09-11 2019-12-27 腾讯科技(深圳)有限公司 Electronic resource obtaining method, electronic resource distributing method and related equipment
WO2021083112A1 (en) * 2019-10-31 2021-05-06 维沃移动通信有限公司 Information sharing method and electronic device
CN111626253A (en) * 2020-06-02 2020-09-04 上海商汤智能科技有限公司 Expression detection method and device, electronic equipment and storage medium
CN112035754A (en) * 2020-11-02 2020-12-04 北京梦知网科技有限公司 Trademark retrieval method and device, electronic equipment and storage medium
CN112684889A (en) * 2020-12-29 2021-04-20 上海掌门科技有限公司 User interaction method and device
CN113891134A (en) * 2021-01-29 2022-01-04 北京字跳网络技术有限公司 Red packet interaction method and device, computer equipment and readable storage medium
WO2022161183A1 (en) * 2021-01-29 2022-08-04 北京字跳网络技术有限公司 Resource interaction method and apparatus, computer device, and readable storage medium
CN112819453A (en) * 2021-02-10 2021-05-18 成都九天玄鸟科技有限公司 Man-machine interaction method, electronic equipment and system based on red packet
CN113127825A (en) * 2021-04-27 2021-07-16 北京百度网讯科技有限公司 Access right verification method and device
CN113127825B (en) * 2021-04-27 2023-11-10 北京百度网讯科技有限公司 Access right verification method and device

Also Published As

Publication number Publication date
CN109858215B (en) 2022-05-17

Similar Documents

Publication Publication Date Title
CN109858215A (en) Resource acquisition, sharing, processing method, device, storage medium and equipment
CN104935980B (en) Interactive information processing method, client and service platform
CN113329234B (en) Live broadcast interaction method and related equipment
CN109743335A (en) Interactive system, server, client and exchange method
CN110351284A (en) Resource sharing method, resource sharing device, storage medium and equipment
US11083966B2 (en) Method and apparatus for displaying virtual pet, terminal, and storage medium
CN108847226A (en) The agency managed in human-computer dialogue participates in
CN104519124B (en) A kind of distribution method and device of virtual resource
CN109691054A (en) Animation user identifier
CN110457104A (en) Multi-player real time communication user interface
CN108108012A (en) Information interacting method and device
CN107168619A (en) User-generated content treating method and apparatus
TW202009682A (en) Interactive method and device based on augmented reality
CN110366032A (en) Video data handling procedure, device and video broadcasting method, device
CN111652601B (en) Virtual article issuing and receiving method and device
CN105847874A (en) Live broadcasting device and live broadcasting terminal
CN109254650A (en) A kind of man-machine interaction method and device
CN106105172A (en) Highlight the video messaging do not checked
CN109428859A (en) A kind of synchronized communication method, terminal and server
CN112818420B (en) Social session method, device, terminal and medium
CN109660854A (en) Video recommendation method, device, equipment and storage medium
CN113379876A (en) Animation data processing method, animation data processing device, computer equipment and storage medium
CN106134135A (en) Transfer operation
CN107645555A (en) A kind of recommendation method, server and computer-readable recording medium
CN110380860A (en) Shared resource data processing method and equipment based on block chain intelligence contract

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant