CN106658035A - Dynamic display method and device for special effect gift - Google Patents
Dynamic display method and device for special effect gift Download PDFInfo
- Publication number
- CN106658035A CN106658035A CN201611127828.9A CN201611127828A CN106658035A CN 106658035 A CN106658035 A CN 106658035A CN 201611127828 A CN201611127828 A CN 201611127828A CN 106658035 A CN106658035 A CN 106658035A
- Authority
- CN
- China
- Prior art keywords
- special efficacy
- facial characteristics
- area
- live
- efficacy present
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Abstract
The invention discloses a dynamic display method and a dynamic display device for a special effect gift, applied to the field of live-broadcasting. The method comprises the steps of when a special effect gift identifier from a live-broadcasting server is received, acquiring a first video picture from a live-broadcasting video in a live-broadcasting room where a first live-broadcasting client is currently located, and acquiring the target special effect gift indicated by the special effect gift identifier; recognizing a first target face feature area from the first video picture; and when the first live-broadcasting client is in a live-broadcasting process of the currently located live-broadcasting room, adding the target special effect gift on the first target face feature area. According to the method and the device provided by the invention, the target special effect gift is dynamically and continuously displayed along with the face feature area in the live-broadcasting video, the display effect of the special effect gift is more active, and thus stronger interaction is achieved between a user and an anchor.
Description
Technical field
The present invention relates to live field, more particularly to a kind of special efficacy present Dynamic Display method and device.
Background technology
With the development of network communication, increasing user selects to be made friends and entertained by the network platform, these nets
Network platform includes one-to-one platform of chatting with friends, main broadcaster chatroom platform, forum's dating site etc., wherein, one-to-one chat is handed over
Friendly platform and main broadcaster chatroom platform due to can real-time video exchange, more favored by user.
In order to increase the use stickiness of platform user, each live video platform often provides the abundant gift that can be given
Thing, it is interactive between user so as to increase in live video, but, existing gifts are to give gift in public screen display
Thing and then disappearance, it is unrelated with the picture of live video, cause the presentation single effect of gifts during live video, present
Time is short.
The content of the invention
In view of the above problems, a kind of special efficacy present Dynamic Display method and device is embodiments provided, target is made
The facial characteristics area that special efficacy present is followed the trail of in live video enters Mobile state, persistently presents, and realizes the display effect of special efficacy present more
Vividly.
In a first aspect, embodiments providing a kind of special efficacy present Dynamic Display method, the first live visitor is applied to
Family end, the special efficacy present Dynamic Display method includes：
Receive from direct broadcast server special efficacy present identify when, be currently located direct broadcasting room from the described first live client
Live video in obtain the first video pictures, and obtain the special efficacy present and identify indicated target special efficacy present；
First object facial characteristics area is identified from first video pictures；
In live video process of the described first live client in direct broadcasting room is currently located, in the first object face
Add the target special efficacy present on portion characteristic area.
Preferably, described to receive before the special efficacy present mark of direct broadcast server described, methods described also includes：
Detect that the viewing user in the described first live client gives operation for what the target special efficacy present was performed；
If detect it is described give operation, send the special efficacy present mark with the current institute of the described first live client
Identify to the direct broadcast server in the direct broadcasting room of direct broadcasting room so that the direct broadcast server is identified according to the direct broadcasting room, to
The first live client is currently located direct broadcasting room and sends the special efficacy present mark.
Preferably, it is currently located direct broadcasting room in the transmission special efficacy present mark and the described first live client
Before direct broadcasting room is identified to the direct broadcast server, methods described also includes：
For the selection operation of the target special efficacy present, the selection operation is used for from multiple the detection viewing user
The target special efficacy present is determined in special efficacy present；
If detecting the selection operation, it is currently located in the live video of direct broadcasting room from the described first live client
Obtain the second video pictures；
The second target face characteristic area is identified from second video pictures；
During live video, the target special efficacy present is added in preset time period in second target face
On characteristic area.
Preferably, it is described that first object facial characteristics area is identified from first video pictures, including：
Initialization picture identifier；
Facial characteristics area array is identified from first video pictures by the picture identifier；
The facial characteristics area of maximum region is traveled through out from facial characteristics area array；
The facial characteristics area adjustment size of the maximum region is extremely matched with the original size of first video pictures
Afterwards, as the first object facial characteristics area.
Preferably, facial characteristics area array includes M facial characteristics area, in the array from the facial characteristics area
The facial characteristics area of maximum region is traveled through out, including：
S1：First facial characteristic area is extracted from facial characteristics area array be defined as the maximum face of current rectangle perimeter value
Portion characteristic area；
S2：M facial characteristics area is extracted from facial characteristics area array, the square in the m facial characteristics area is calculated
Shape perimeter value, m takes successively 2 to M；
S3：Judge the rectangular perimeter value in the m facial characteristics area whether more than current rectangle perimeter value maximum
The rectangular perimeter value in facial characteristics area, if it is, performing S4, otherwise performs S5；
S4：The m facial characteristics area is assigned to into the maximum facial characteristics area of the current rectangle perimeter value；
S5：Judge whether that traversal terminates, if it is, determining that the maximum facial characteristics area of the current rectangle perimeter value is institute
State the facial characteristics area of maximum region, otherwise return to step S2.
Preferably, it is described to add the target special efficacy present in the facial characteristics area, including：
Initialization UI image views；
The target special efficacy present is loaded in the UI image views；
Judge whether the first object facial characteristics area matches with the target special efficacy present；
If it does, adding the target special efficacy present in the first object facial characteristics area.
Second aspect, embodiments provides a kind of special efficacy present Dynamic Display device, is applied to the first live visitor
Family end, described device includes：
First picture acquiring unit is straight from described first when the special efficacy present for receiving from direct broadcast server is identified
Broadcast client and be currently located in the live video of direct broadcasting room and obtain the first video pictures, and obtain the special efficacy present and identify institute
The target special efficacy present of sign；
First facial recognition unit, for identifying first object facial characteristics area from first video pictures；
Special efficacy adding device, for the live video mistake in the described first live client in direct broadcasting room is currently located
Journey, adds the target special efficacy present in the first object facial characteristics area.
Preferably, described device also includes：
Operation detector unit is given, for detecting that the viewing user in the described first live client is special for the target
What effect present was performed gives operation；
Mark transmitting element, if for detect it is described give operation, send the special efficacy present mark with described the
Broadcast client always and be currently located the direct broadcasting room of direct broadcasting room and identify to the direct broadcast server so that the direct broadcast server according to
The direct broadcasting room mark, is currently located direct broadcasting room and sends the special efficacy present mark to the described first live client.
Preferably, described device also includes：
Selection operation detector unit, for detecting selection operation of the viewing user for the target special efficacy present,
The selection operation is used to determine the target special efficacy present from multiple special efficacy presents；
Second picture acquiring unit, if for detecting the selection operation, it is current from the described first live client
The second video pictures are obtained in the live video of place direct broadcasting room；
Second face recognition unit, for identifying the second target face characteristic area from second video pictures；
Special efficacy preview unit, for during live video, adding the target special efficacy present in preset time period
On the second target face characteristic area.
Preferably, it is described from first facial recognition unit, including：
Initialization subelement, for initializing picture identifier；
Feature array recognizes subelement, and facial characteristics is identified from first video pictures by the picture identifier
Area's array；
Traversal subelement, for traveling through out the facial characteristics area of maximum region from facial characteristics area array；
Adjustment unit, for by the facial characteristics area of the maximum region adjustment size to first video pictures
After original size matching, as the first object facial characteristics area.
Preferably, facial characteristics area array includes M facial characteristics area, the traversal subelement, specifically for holding
Row following steps：
S1：First facial characteristic area is extracted from facial characteristics area array be defined as the maximum face of current rectangle perimeter value
Portion characteristic area；
S2：M facial characteristics area is extracted from facial characteristics area array, the square in the m facial characteristics area is calculated
Shape perimeter value, m takes successively 2 to M；
S3：Judge the rectangular perimeter value in the m facial characteristics area whether more than current rectangle perimeter value maximum
The rectangular perimeter value in facial characteristics area, if it is, performing S4, otherwise performs S5；
S4：The m facial characteristics area is assigned to into the maximum facial characteristics area of the current rectangle perimeter value；
S5：Judge whether that traversal terminates, if it is, determining that the maximum facial characteristics area of the current rectangle perimeter value is institute
State the facial characteristics area of maximum region, otherwise return to step S2.
Preferably, the special efficacy adding device, specifically for：
Initialization UI image views；
The target special efficacy present is loaded in the UI image views；
Judge whether the first object facial characteristics area matches with the target special efficacy present；
If it does, adding the target special efficacy present in the first object facial characteristics area.
One or more technical schemes provided in an embodiment of the present invention, at least realize following technique effect or advantage：
When identifying by the special efficacy present received from direct broadcast server, from the first live client direct broadcasting room is currently located
Live video in obtain the first video pictures, and obtain special efficacy present and identify indicated target special efficacy present；From first
First object facial characteristics area is identified in video pictures；Regard in being currently located the live of direct broadcasting room in the first live client
Frequency process, adds target special efficacy present in first object facial characteristics area.Dynamic follows the trail of the facial characteristics in live video
Area is changed position, the facial characteristics area that target special efficacy present is followed the trail of in live video entered Mobile state, persistently presented, and realizes
The display effect of special efficacy present is more lively, and then makes interactive higher between user and main broadcaster.
Description of the drawings
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
The accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are only this
Inventive embodiment, for those of ordinary skill in the art, on the premise of not paying creative work, can be with basis
The accompanying drawing of offer obtains other accompanying drawings.
Fig. 1 is the flow chart of special efficacy present Dynamic Display method provided in an embodiment of the present invention；
Fig. 2 is the flow chart that first object facial characteristics area is identified in the embodiment of the present invention；
Fig. 3 is the flow chart in the facial characteristics area that maximum region is traveled through out in the embodiment of the present invention；
Fig. 4 is the flow chart for adding target special efficacy present in the embodiment of the present invention in first object facial characteristics area；
Fig. 5 is the function unit figure of special efficacy present Dynamic Display method in the embodiment of the present invention.
Specific embodiment
To make purpose, technical scheme and the advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
The a part of embodiment of the present invention, rather than the embodiment of whole.Based on the embodiment in the present invention, those of ordinary skill in the art
The every other embodiment obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
A kind of special efficacy present Dynamic Display method is embodiments provided, the first live client is applied to, first
Live client can be specifically personal computer, mobile terminal, Pad (panel computer), the first live client and live clothes
Business device is in network connection, and the first live client is in the multiple live client in direct broadcasting room.
With reference to shown in Fig. 1, special efficacy present Dynamic Display method provided in an embodiment of the present invention, including：
S101, receive from direct broadcast server special efficacy present identify when, be currently located from the first live client live
Between live video in obtain the first video pictures, and obtain special efficacy present and identify indicated target special efficacy present；
S102, identify from the first video pictures first object facial characteristics area；
S103, the live video process in the first live client in direct broadcasting room is currently located, in first object face
Add target special efficacy present on characteristic area.
In embodiments of the present invention, target special efficacy present can be dynamic special efficacy picture, or static special efficacy picture.
With reference to Fig. 1, each step of special efficacy present Dynamic Display method provided in an embodiment of the present invention is carried out in detail
Thin description：
First, S101 is performed：Receive from direct broadcast server special efficacy present identify when, it is current from the first live client
The first video pictures are obtained in the live video of place direct broadcasting room, and obtains special efficacy present and identify indicated target special efficacy gift
Thing.
In one embodiment, the special efficacy present of direct broadcast server is designated the first live client and is currently located direct broadcasting room
Live client is sent to direct broadcast server.
The embodiment of the present invention is sent to direct broadcast server and is described with the first live client, and process is as follows：Detection the
The viewing user in client is broadcast always and gives operation for what target special efficacy present was performed, if detect giving operation, send out
The direct broadcasting room that the special efficacy present mark of target special efficacy present is currently located direct broadcasting room with the first live client is sent to identify to live
Server so that direct broadcast server is identified according to direct broadcasting room, is currently located direct broadcasting room and sends special efficacy gift to the first live client
Thing is identified.Specifically so that direct broadcast server determines that the first live client is currently located direct broadcasting room according to direct broadcasting room mark, enters
And all live client for being currently located direct broadcasting room to the first live client sends the special efficacy present mark of target special efficacy present
Know.
In an alternative embodiment of the invention：With reference to previous embodiment, if detect giving operation, also send execution and give
The ID of the viewing user of operation is to direct broadcast server so that direct broadcast server is currently located live to the first live client
Between all live client send and characterize viewing user and give the message of target special efficacy present.
Further, the embodiment of the present invention additionally provides the technical scheme that preview is carried out to target special efficacy present.Specifically
Embodiment is as follows：
For the selection operation of target special efficacy present, selection operation is used for true from multiple special efficacy presents detection viewing user
Make target special efficacy present；If detecting selection operation, from the first live client the live video of direct broadcasting room is currently located
The second video pictures of middle acquisition；The second target face characteristic area is identified from the second video pictures；During live video,
During the live video of preset time period, addition target special efficacy present is on the second target face characteristic area.Specifically, in advance
If the time period could be arranged to 1～60 second, such as, preset time period is set to 1 second, 2 seconds, 3 seconds, 4 seconds, 5 seconds.So as to short
Preview dynamic effect of the time to target special efficacy present.
In one embodiment, selection operation is decomposed into the expansion for successively performing and operates and choose operation, then corresponding, specifically
Determine that the embodiment of target special efficacy present is as follows from multiple special efficacy presents：
Viewing user is detected in the first live client for during the expansion operation of special efficacy present button, launching special efficacy
Present panel.Then, the picture address of each special efficacy present is asked to direct broadcast server, or each is asked to direct broadcast server
The address of special efficacy picture and the address of each corresponding thumbnail of special efficacy picture.Reinitialize special effect graph piece panel, based on live
Each special efficacy picture that server is returned, or address and the corresponding contracting of special efficacy picture of the special efficacy picture of direct broadcast server return
The address of sketch map, the button in the multiple special efficacy presents of middle special effect graph piece panels show.
In one embodiment, the picture address of each special efficacy present is asked to direct broadcast server, or to direct broadcast server
Ask the time period of the address of each special efficacy picture and the address of each corresponding thumbnail of special efficacy picture, show loading animation.
Viewing user is detected in the first live client for the target special efficacy present in multiple special efficacy present buttons
When choosing operation of button, the inquiry in the present table data of the first live client whether there is target special efficacy present, such as
Fruit does not have, and target special efficacy present is downloaded to local to direct broadcast server request, if it does, from the first live client directly
Determine target special efficacy present.
S102, identify from the first video pictures first object facial characteristics area.
In specific implementation process, first object facial characteristics is identified from the first video pictures by picture identifier
Area.Specifically, with reference to shown in Fig. 2, first object facial characteristics area is identified from the first video pictures by picture identifier
Implementation process include S1021～S1024.
S1021, initialization picture identifier.
Create a picture identifier for including face recognition module：CIDetector, using recognition of face type
CIDetectorTypeFace initializes picture identifier.
S1022, facial characteristics area array is identified from the first video pictures by picture identifier.
Specifically, it is currently located in the live video of direct broadcasting room that to obtain the first video pictures incoming from the first live client
Picture identifier, after being identified to the first video pictures in picture identifier, returns the facial characteristics array for identifying：
CIFaceFeatureArray。
In one embodiment, the behaviour for identifying facial characteristics area array is performed in face recognition module using asynchronous system
Make, it is to avoid performing the operation of identification facial characteristics area array can block the situation of main thread, therefore not interfere with live.Specifically
Process of realizing be：
The operation of identification facial characteristics area array is added in a multithreading queue to be carried out, in multithreading queue successively
Return implementing result.Return implementing result during, if the sequence number of current implementing result less than upper one return hold
The sequence number of row result, just abandons current implementing result.Otherwise return as effective implementing result, each of return is effective
Implementing result constitutes facial characteristics area array.
S1023, the facial characteristics area for traveling through out from facial characteristics area array maximum region.
In one embodiment, it is special as the face of maximum region by traveling through out the maximum facial characteristics area of rectangular perimeter value
Levy area.Below, include M facial characteristics area for facial characteristics area array, be given from facial characteristics area array time with reference to Fig. 3
Go through out the embodiment in the facial characteristics area of maximum region：
S1：First facial characteristic area is extracted from facial characteristics area array be defined as the maximum face spy of current rectangle perimeter value
Levy area.
Specifically, in S1, the maximum facial characteristics area of current rectangle perimeter value is labeled as
ChooseFacePerimeter, obtains the rectangular area boundary of first facial characteristic area, calculates the rectangle of first facial characteristic area
The rectangular perimeter value of area boundary：When initial, rectangular perimeter value=the first in the maximum facial characteristics area of current rectangle perimeter value
The facial characteristics of facial characteristics width C GRectGetWidth (chooseBounds) the * first facials characteristic area in facial characteristics area
Height CGRectGetHeight (chooseBounds), then performs S2.
S2：M facial characteristics area is extracted from facial characteristics area array, the rectangular perimeter value in m facial characteristics area is calculated,
M takes successively 2 to M.
Specifically, m facial characteristics area is labeled as currentFaceFeature, obtains the rectangle in m facial characteristics area
Area boundary, calculates the rectangular perimeter value of the rectangular area boundary of m facial characteristics：The rectangular perimeter value in m facial characteristics area
Facial characteristics width e ctGetWidth (bounds) * in CGFloat currentFacePerimeter=m facial characteristics area
Facial characteristics height CGRectGetHeight (bounds) in m facial characteristics area.
S3：Judge whether maximum more than the current rectangle perimeter value facial characteristics of the rectangular perimeter value in m facial characteristics area
The rectangular perimeter value in area, if it is, performing S4, otherwise performs S5.
S4：M facial characteristics area is assigned to into the maximum facial characteristics area of current rectangle perimeter value.Specifically,
ChooseFaceFeature=currentFacePerimeter.
S5：Judge whether that traversal terminates, if it is, performing S6：Determine the maximum facial characteristics area of current rectangle perimeter value
For the facial characteristics area of maximum region, otherwise return to step S2 continues to take out next facial characteristics area, until traversal terminates.
S1024, the facial characteristics area of maximum region is carried out size adjusting to original size with the first video pictures
After matching somebody with somebody, as first object facial characteristics area.
Specifically, scaled size during picture identifier incoming according to the first video pictures, to the maximum region for identifying
Facial characteristics area scaled in proportion.Specifically, N times is reduced during the incoming picture identifier of the first video pictures, N is whole
Number, then N times of the facial characteristics area amplification of the maximum region to identifying.Amplify N times during the incoming picture of the first video pictures, then it is right
The facial characteristics area of the maximum region for identifying reduces N times.So that returning to the facial characteristics area of the maximum region for identifying
Meet original scale.
It should be noted that identify from the second video pictures the embodiment of the second target face characteristic area with from the
Identify that the embodiment in first object facial characteristics area is similar in one video pictures, it is succinct for specification, repeat no more.
After S102, S103 is then performed：In live video of the first live client in direct broadcasting room is currently located
Process, adds target special efficacy present in first object facial characteristics area.
Specifically, with reference to shown in Fig. 4, target special efficacy gift is added in first object facial characteristics area as follows
Thing：
S1031, initialization UI image views；
S1032, in UI image views loaded targets special efficacy presents；
S1033, judge whether first object facial characteristics area matches with target special efficacy present, if it does, performing
S1034, otherwise terminates；
S1034：Add target special efficacy present in first object facial characteristics area.
It should be noted that adding the embodiment of target special efficacy present on the second target face characteristic area and first
The embodiment for adding target special efficacy present on target face characteristic area is similar, succinct for specification, repeats no more herein.
Based on same inventive concept, a kind of special efficacy present Dynamic Display device is embodiments provided, be applied to
Client is broadcast always, and with reference to shown in Fig. 5, special efficacy present Dynamic Display device provided in an embodiment of the present invention includes：
First picture acquiring unit 201, when the special efficacy present for receiving from direct broadcast server is identified, from described first
Live client is currently located in the live video of direct broadcasting room and obtains the first video pictures, and obtains the special efficacy present mark
The target special efficacy present for being indicated；
First facial recognition unit 202, for identifying first object facial characteristics area from first video pictures；
Special efficacy adding device 203, for the live video in the described first live client in direct broadcasting room is currently located
Process, adds the target special efficacy present in the first object facial characteristics area.
Preferably, described device also includes：
Operation detector unit is given, for detecting that the viewing user in the described first live client is special for the target
What effect present was performed gives operation；
Mark transmitting element, if for detect it is described give operation, send the special efficacy present mark with described the
Broadcast client always and be currently located the direct broadcasting room of direct broadcasting room and identify to the direct broadcast server so that the direct broadcast server according to
The direct broadcasting room mark, is currently located direct broadcasting room and sends the special efficacy present mark to the described first live client.
Preferably, described device also includes：
Selection operation detector unit, for detecting selection operation of the viewing user for the target special efficacy present,
The selection operation is used to determine the target special efficacy present from multiple special efficacy presents；
Second picture acquiring unit, if for detecting the selection operation, it is current from the described first live client
The second video pictures are obtained in the live video of place direct broadcasting room；
Second face recognition unit, for identifying the second target face characteristic area from second video pictures；
Special efficacy preview unit, for during live video, adding the target special efficacy present in preset time period
On the second target face characteristic area.
Preferably, it is described from first facial recognition unit 202, including：
Initialization subelement, for initializing picture identifier；
Feature array recognizes subelement, and facial characteristics is identified from first video pictures by the picture identifier
Area's array；
Traversal subelement, for traveling through out the facial characteristics area of maximum region from facial characteristics area array；
Adjustment unit, for by the facial characteristics area of the maximum region adjustment size to first video pictures
After original size matching, as the first object facial characteristics area.
Preferably, facial characteristics area array includes M facial characteristics area, the traversal subelement, specifically for holding
Row following steps：
S1：First facial characteristic area is extracted from facial characteristics area array be defined as the maximum face of current rectangle perimeter value
Portion characteristic area；
S2：M facial characteristics area is extracted from facial characteristics area array, the square in the m facial characteristics area is calculated
Shape perimeter value, m takes successively 2 to M；
S3：Judge the rectangular perimeter value in the m facial characteristics area whether more than current rectangle perimeter value maximum
The rectangular perimeter value in facial characteristics area, if it is, performing S4, otherwise performs S5；
S4：The m facial characteristics area is assigned to into the maximum facial characteristics area of the current rectangle perimeter value；
S5：Judge whether that traversal terminates, if it is, determining that the maximum facial characteristics area of the current rectangle perimeter value is institute
State the facial characteristics area of maximum region, otherwise return to step S2.
Preferably, the special efficacy adding device 203, specifically for：
Initialization UI image views；
The target special efficacy present is loaded in the UI image views；
Judge whether the first object facial characteristics area matches with the target special efficacy present；
If it does, adding the target special efficacy present in the first object facial characteristics area.
Special efficacy present Dynamic Display device in the present embodiment is the device for implementing aforementioned special efficacy present Dynamic Display method,
Pump art person personnel know special efficacy present dynamic in the present embodiment according to aforementioned special efficacy present Dynamic Display embodiment of the method
The implementation detail of exhibiting device and deformation, it is succinct for specification, repeat no more herein.
The embodiment of the present invention at least realizes following technique effect or advantage：
When identifying by the special efficacy present received from direct broadcast server, from the first live client direct broadcasting room is currently located
Live video in obtain the first video pictures, and obtain special efficacy present and identify indicated target special efficacy present；From first
First object facial characteristics area is identified in video pictures；Regard in being currently located the live of direct broadcasting room in the first live client
Frequency process, adds target special efficacy present in first object facial characteristics area.Dynamic follows the trail of the facial characteristics in live video
Area is changed position, and more lively illustrates present to viewing user, and then makes interactive higher between user and main broadcaster.
Provided herein algorithm and display be not inherently related to any certain computer, virtual system or miscellaneous equipment.
Various general-purpose systems can also be used together based on teaching in this.According to each description above, construct this kind of system and want
The structure asked is obvious.Additionally, the present invention is also not for any certain programmed language.It is understood that, it is possible to use it is each
The content that programming language realizes invention described herein is planted, and the description done to language-specific above is to disclose this
The preferred forms of invention.
In specification mentioned herein, a large amount of details are illustrated.It is to be appreciated, however, that the enforcement of the present invention
Example can be put into practice in the case of without these details.In some instances, known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this description.
Similarly, it will be appreciated that in order to simplify the disclosure and help understand one or more in each inventive aspect, exist
Above in the description of the exemplary embodiment of the present invention, each feature of the present invention is grouped together into single enforcement sometimes
In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention：I.e. required guarantor
The more features of feature that the application claims ratio of shield is expressly recited in each claim.More precisely, such as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following specific embodiment are expressly incorporated in the specific embodiment, wherein each claim itself
All as the separate embodiments of the present invention.
Those skilled in the art are appreciated that can be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more equipment different from the embodiment.Can be the module or list in embodiment
Unit or component are combined into a module or unit or component, and can be divided in addition multiple submodule or subelement or
Sub-component.In addition at least some in such feature and/or process or unit is excluded each other, can adopt any
Combine to all features disclosed in this specification (including adjoint claim, summary and accompanying drawing) and so disclosed
Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification is (including adjoint power
Profit is required, summary and accompanying drawing) disclosed in each feature can it is identical by offers, be equal to or the alternative features of similar purpose carry out generation
Replace.
Although additionally, it will be appreciated by those of skill in the art that some embodiments described herein include other embodiments
In included some features rather than further feature, but the combination of the feature of different embodiments means in of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment required for protection appoint
One of meaning can in any combination mode using.
The present invention all parts embodiment can be realized with hardware, or with one or more processor operation
Software module realize, or with combinations thereof realization.It will be understood by those of skill in the art that can use in practice
Microprocessor or digital signal processor (DSP) are taken the photograph realizing intelligent camera system according to embodiments of the present invention and network
As some or all functions of some or all parts in head.The present invention is also implemented as being retouched here for performing
Some or all equipment of the method stated or system program (such as computer program and computer program).So
Realization the present invention program can store on a computer-readable medium, or can have one or more signal shape
Formula.Such signal can be downloaded from internet website and obtained, or be provided on carrier signal, or with any other shape
Formula is provided.
It should be noted that the various embodiments described above the present invention will be described rather than limits the invention, and
Those skilled in the art can design without departing from the scope of the appended claims alternative embodiment.In claim
In, any reference symbol between bracket should not be configured to limitations on claims.Word "comprising" is not excluded for
There is element not listed in the claims or step.Word "a" or "an" before element does not exclude the presence of many
Individual such element.The present invention can be by means of the hardware for including some different elements and by means of properly programmed calculating
Machine is realizing.If in the unit claim for listing dry systems, several in these systems can be by same
Hardware branch is embodying.Word first, second and third use do not indicate that any order.These words can be explained
For title.
Claims (10)
1. a kind of special efficacy present Dynamic Display method, is applied to the first live client, it is characterised in that the special efficacy present is moved
State methods of exhibiting includes：
Receive from direct broadcast server special efficacy present identify when, be currently located the straight of direct broadcasting room from the described first live client
Broadcast and obtain in video the first video pictures, and obtain the special efficacy present and identify indicated target special efficacy present；
First object facial characteristics area is identified from first video pictures；
In live video process of the described first live client in direct broadcasting room is currently located, in first object face spy
Levy and add in area the target special efficacy present.
2. special efficacy present Dynamic Display method as claimed in claim 1, it is characterised in that it is described in the reception from live
Before the special efficacy present mark of server, methods described also includes：
Detect that the viewing user in the described first live client gives operation for what the target special efficacy present was performed；
If giving operation described in detecting, send the special efficacy present mark and the described first live client is currently located directly
Direct broadcasting room between broadcasting is identified to the direct broadcast server so that the direct broadcast server is identified according to the direct broadcasting room, to described
First live client is currently located direct broadcasting room and sends the special efficacy present mark.
3. special efficacy present Dynamic Display method as claimed in claim 1, it is characterised in that send the special efficacy present described
Mark and the described first live client are currently located before the direct broadcasting room of direct broadcasting room identified to the direct broadcast server, the side
Method also includes：
, for the selection operation of the target special efficacy present, the selection operation is for from multiple special efficacys for the detection viewing user
The target special efficacy present is determined in present；
If detecting the selection operation, it is currently located in the live video of direct broadcasting room from the described first live client and obtains
Second video pictures；
The second target face characteristic area is identified from second video pictures；
During the live video of preset time period, add the target special efficacy present in the second target face characteristic area
On.
4. the special efficacy present Dynamic Display method as described in arbitrary in claim 1-3, it is characterised in that described from described first
First object facial characteristics area is identified in video pictures, including：
Initialization picture identifier；
Facial characteristics area array is identified from first video pictures by the picture identifier；
The facial characteristics area of maximum region is traveled through out from facial characteristics area array；
By the facial characteristics area adjustment size of the maximum region to after matching with the original size of first video pictures, make
For the first object facial characteristics area.
5. special efficacy present Dynamic Display method as claimed in claim 4, it is characterised in that facial characteristics area array includes
M facial characteristics area, travels through out the facial characteristics area of maximum region in the array from the facial characteristics area, including：
S1：First facial characteristic area is extracted from facial characteristics area array be defined as the maximum face spy of current rectangle perimeter value
Levy area；
S2：M facial characteristics area is extracted from facial characteristics area array, the rectangle week in the m facial characteristics area is calculated
Long value, m takes successively 2 to M；
S3：Judge whether maximum more than the current rectangle perimeter value face of the rectangular perimeter value in the m facial characteristics area
The rectangular perimeter value of characteristic area, if it is, performing S4, otherwise performs S5；
S4：The m facial characteristics area is assigned to into the maximum facial characteristics area of the current rectangle perimeter value；
S5：Judge whether that traversal terminates, if it is, determining the maximum facial characteristics area of the current rectangle perimeter value for described in most
The facial characteristics area in big region, otherwise return to step S2.
6. special efficacy present Dynamic Display method as claimed in claim 1, it is characterised in that described in the facial characteristics area
Add the target special efficacy present, including：
Initialization UI image views；
The target special efficacy present is loaded in the UI image views；
Judge whether the first object facial characteristics area matches with the target special efficacy present；
If it does, adding the target special efficacy present in the first object facial characteristics area.
7. a kind of special efficacy present Dynamic Display device, is applied to the first live client, it is characterised in that described device includes：
First picture acquiring unit, when the special efficacy present for receiving from direct broadcast server is identified, from the described first live visitor
Family end is currently located in the live video of direct broadcasting room and obtains the first video pictures, and the acquisition special efficacy present is indicated
Target special efficacy present；
First facial recognition unit, for identifying first object facial characteristics area from first video pictures；
Special efficacy adding device, for being in the live video process for being currently located direct broadcasting room in the described first live client,
Add the target special efficacy present in the first object facial characteristics area.
8. special efficacy present Dynamic Display device as claimed in claim 7, it is characterised in that described device also includes：
Operation detector unit is given, for detecting that the viewing user in the described first live client is directed to the target special efficacy gift
What thing was performed gives operation；
Mark transmitting element, if for detect it is described give operation, send the special efficacy present mark straight with described first
Broadcast client and be currently located the direct broadcasting room of direct broadcasting room and identify to the direct broadcast server so that the direct broadcast server is according to described
Direct broadcasting room is identified, and is currently located direct broadcasting room to the described first live client and is sent the special efficacy present mark.
9. special efficacy present Dynamic Display device as claimed in claim 7, it is characterised in that described device also includes：
Selection operation detector unit, it is described for detecting selection operation of the viewing user for the target special efficacy present
Selection operation is used to determine the target special efficacy present from multiple special efficacy presents；
Second picture acquiring unit, if for detecting the selection operation, be currently located from the described first live client
The second video pictures are obtained in the live video of direct broadcasting room；
Second face recognition unit, for identifying the second target face characteristic area from second video pictures；
Special efficacy preview unit, for during live video, adding the target special efficacy present in preset time period in institute
State on the second target face characteristic area.
10. the special efficacy present Dynamic Display device as described in arbitrary in claim 7-9, it is characterised in that described from the first face
Portion's recognition unit, including：
Initialization subelement, for initializing picture identifier；
Feature array recognizes subelement, and facial characteristics area number is identified from first video pictures by the picture identifier
Group；
Traversal subelement, for traveling through out the facial characteristics area of maximum region from facial characteristics area array；
Adjustment unit, for the facial characteristics area of maximum region adjustment size is extremely original with first video pictures
After size matching, as the first object facial characteristics area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611127828.9A CN106658035A (en) | 2016-12-09 | 2016-12-09 | Dynamic display method and device for special effect gift |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611127828.9A CN106658035A (en) | 2016-12-09 | 2016-12-09 | Dynamic display method and device for special effect gift |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106658035A true CN106658035A (en) | 2017-05-10 |
Family
ID=58825781
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611127828.9A Pending CN106658035A (en) | 2016-12-09 | 2016-12-09 | Dynamic display method and device for special effect gift |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106658035A (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107277632A (en) * | 2017-05-12 | 2017-10-20 | 武汉斗鱼网络科技有限公司 | A kind of method and apparatus for showing virtual present animation |
| CN107438200A (en) * | 2017-09-08 | 2017-12-05 | 广州酷狗计算机科技有限公司 | The method and apparatus of direct broadcasting room present displaying |
| CN107888965A (en) * | 2017-11-29 | 2018-04-06 | 广州酷狗计算机科技有限公司 | Image present methods of exhibiting and device, terminal, system, storage medium |
| CN107911738A (en) * | 2017-11-30 | 2018-04-13 | 广州酷狗计算机科技有限公司 | A kind of method and apparatus for making expression present |
| CN108156503A (en) * | 2017-12-14 | 2018-06-12 | 北京奇艺世纪科技有限公司 | A kind of method and device for generating present |
| CN108228835A (en) * | 2018-01-04 | 2018-06-29 | 百度在线网络技术（北京）有限公司 | For handling the method and apparatus of video |
| CN108322802A (en) * | 2017-12-29 | 2018-07-24 | 广州市百果园信息技术有限公司 | Stick picture disposing method, computer readable storage medium and the terminal of video image |
| CN108717701A (en) * | 2018-05-24 | 2018-10-30 | 北京金山安全软件有限公司 | Method, device, electronic equipment and medium for manufacturing special effect of movie ghost |
| CN109191544A (en) * | 2018-08-21 | 2019-01-11 | 北京潘达互娱科技有限公司 | A kind of paster present methods of exhibiting, device, electronic equipment and storage medium |
| CN110536151A (en) * | 2019-09-11 | 2019-12-03 | 广州华多网络科技有限公司 | The synthetic method and device of virtual present special efficacy, live broadcast system |
| CN110933454A (en) * | 2019-12-06 | 2020-03-27 | 广州酷狗计算机科技有限公司 | Method, device, equipment and storage medium for processing live broadcast budding gift |
| CN110933452A (en) * | 2019-12-02 | 2020-03-27 | 广州酷狗计算机科技有限公司 | Method and device for displaying lovely face gift and storage medium |
| CN111225226A (en) * | 2019-12-31 | 2020-06-02 | 广州华多网络科技有限公司 | Interactive method, electronic equipment and device for presenting virtual gift |
| WO2021047420A1 (en) * | 2019-09-11 | 2021-03-18 | 广州华多网络科技有限公司 | Virtual gift special effect rendering method and apparatus, and live streaming system |
| WO2021047094A1 (en) * | 2019-09-11 | 2021-03-18 | 广州华多网络科技有限公司 | Virtual gift special effect processing method and apparatus, and live streaming system |
| WO2021109652A1 (en) * | 2019-12-06 | 2021-06-10 | 广州华多网络科技有限公司 | Method and apparatus for giving character virtual gift, device, and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105116920A (en) * | 2015-07-07 | 2015-12-02 | 百度在线网络技术（北京）有限公司 | Intelligent robot tracking method and apparatus based on artificial intelligence and intelligent robot |
| CN105334963A (en) * | 2015-10-29 | 2016-02-17 | 广州华多网络科技有限公司 | Method and system for displaying virtual article |
| CN105406974A (en) * | 2015-12-15 | 2016-03-16 | 武汉斗鱼网络科技有限公司 | Method and system for increasing popularity value in chat room |
| CN105872442A (en) * | 2016-03-30 | 2016-08-17 | 宁波三博电子科技有限公司 | Instant bullet screen gift giving method and instant bullet screen gift giving system based on face recognition |
| CN106028136A (en) * | 2016-05-30 | 2016-10-12 | 北京奇艺世纪科技有限公司 | Image processing method and device |
| CN106101736A (en) * | 2016-06-28 | 2016-11-09 | 广州华多网络科技有限公司 | The methods of exhibiting of a kind of virtual present and system |
| CN106210855A (en) * | 2016-07-11 | 2016-12-07 | 网易（杭州）网络有限公司 | Object displaying method and device |
-
2016
- 2016-12-09 CN CN201611127828.9A patent/CN106658035A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105116920A (en) * | 2015-07-07 | 2015-12-02 | 百度在线网络技术（北京）有限公司 | Intelligent robot tracking method and apparatus based on artificial intelligence and intelligent robot |
| CN105334963A (en) * | 2015-10-29 | 2016-02-17 | 广州华多网络科技有限公司 | Method and system for displaying virtual article |
| CN105406974A (en) * | 2015-12-15 | 2016-03-16 | 武汉斗鱼网络科技有限公司 | Method and system for increasing popularity value in chat room |
| CN105872442A (en) * | 2016-03-30 | 2016-08-17 | 宁波三博电子科技有限公司 | Instant bullet screen gift giving method and instant bullet screen gift giving system based on face recognition |
| CN106028136A (en) * | 2016-05-30 | 2016-10-12 | 北京奇艺世纪科技有限公司 | Image processing method and device |
| CN106101736A (en) * | 2016-06-28 | 2016-11-09 | 广州华多网络科技有限公司 | The methods of exhibiting of a kind of virtual present and system |
| CN106210855A (en) * | 2016-07-11 | 2016-12-07 | 网易（杭州）网络有限公司 | Object displaying method and device |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107277632A (en) * | 2017-05-12 | 2017-10-20 | 武汉斗鱼网络科技有限公司 | A kind of method and apparatus for showing virtual present animation |
| CN107277632B (en) * | 2017-05-12 | 2020-08-04 | 武汉斗鱼网络科技有限公司 | Method and equipment for displaying virtual gift animation |
| CN107438200A (en) * | 2017-09-08 | 2017-12-05 | 广州酷狗计算机科技有限公司 | The method and apparatus of direct broadcasting room present displaying |
| CN107888965A (en) * | 2017-11-29 | 2018-04-06 | 广州酷狗计算机科技有限公司 | Image present methods of exhibiting and device, terminal, system, storage medium |
| CN107911738A (en) * | 2017-11-30 | 2018-04-13 | 广州酷狗计算机科技有限公司 | A kind of method and apparatus for making expression present |
| CN108156503A (en) * | 2017-12-14 | 2018-06-12 | 北京奇艺世纪科技有限公司 | A kind of method and device for generating present |
| CN108156503B (en) * | 2017-12-14 | 2020-05-01 | 北京奇艺世纪科技有限公司 | Method and device for generating gift |
| CN108322802A (en) * | 2017-12-29 | 2018-07-24 | 广州市百果园信息技术有限公司 | Stick picture disposing method, computer readable storage medium and the terminal of video image |
| CN108228835B (en) * | 2018-01-04 | 2019-08-09 | 百度在线网络技术（北京）有限公司 | Method and apparatus for handling video |
| CN108228835A (en) * | 2018-01-04 | 2018-06-29 | 百度在线网络技术（北京）有限公司 | For handling the method and apparatus of video |
| US11902694B2 (en) | 2018-05-24 | 2024-02-13 | Jupiter Palace Pte. Ltd. | Method and apparatus for making ghosting special effect for movie, and electronic device and medium |
| CN108717701A (en) * | 2018-05-24 | 2018-10-30 | 北京金山安全软件有限公司 | Method, device, electronic equipment and medium for manufacturing special effect of movie ghost |
| CN108717701B (en) * | 2018-05-24 | 2021-03-02 | 北京乐蜜科技有限责任公司 | Method, device, electronic equipment and medium for manufacturing special effect of movie ghost |
| CN109191544A (en) * | 2018-08-21 | 2019-01-11 | 北京潘达互娱科技有限公司 | A kind of paster present methods of exhibiting, device, electronic equipment and storage medium |
| WO2021047420A1 (en) * | 2019-09-11 | 2021-03-18 | 广州华多网络科技有限公司 | Virtual gift special effect rendering method and apparatus, and live streaming system |
| WO2021047430A1 (en) * | 2019-09-11 | 2021-03-18 | 广州华多网络科技有限公司 | Virtual gift special effect synthesis method and apparatus, and live streaming system |
| WO2021047094A1 (en) * | 2019-09-11 | 2021-03-18 | 广州华多网络科技有限公司 | Virtual gift special effect processing method and apparatus, and live streaming system |
| CN110536151B (en) * | 2019-09-11 | 2021-11-19 | 广州方硅信息技术有限公司 | Virtual gift special effect synthesis method and device and live broadcast system |
| CN110536151A (en) * | 2019-09-11 | 2019-12-03 | 广州华多网络科技有限公司 | The synthetic method and device of virtual present special efficacy, live broadcast system |
| CN110933452A (en) * | 2019-12-02 | 2020-03-27 | 广州酷狗计算机科技有限公司 | Method and device for displaying lovely face gift and storage medium |
| CN110933454A (en) * | 2019-12-06 | 2020-03-27 | 广州酷狗计算机科技有限公司 | Method, device, equipment and storage medium for processing live broadcast budding gift |
| WO2021109652A1 (en) * | 2019-12-06 | 2021-06-10 | 广州华多网络科技有限公司 | Method and apparatus for giving character virtual gift, device, and storage medium |
| CN110933454B (en) * | 2019-12-06 | 2021-11-02 | 广州酷狗计算机科技有限公司 | Method, device, equipment and storage medium for processing live broadcast budding gift |
| CN111225226A (en) * | 2019-12-31 | 2020-06-02 | 广州华多网络科技有限公司 | Interactive method, electronic equipment and device for presenting virtual gift |
| CN111225226B (en) * | 2019-12-31 | 2021-09-07 | 广州方硅信息技术有限公司 | Interactive method, electronic equipment and device for presenting virtual gift |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106658035A (en) | Dynamic display method and device for special effect gift | |
| CN108156507B (en) | Virtual article presenting method, device and storage medium | |
| TWI669634B (en) | Method and device for assigning virtual objects based on augmented reality | |
| CN108391153B (en) | Virtual gift display method and device and electronic equipment | |
| CN105933783B (en) | A kind of playback method of barrage, device and terminal device | |
| CN103079092B (en) | Obtain the method and apparatus of people information in video | |
| CN110830735B (en) | Video generation method and device, computer equipment and storage medium | |
| CN107743262B (en) | Bullet screen display method and device | |
| CN104850370B (en) | The method and device of order information is shown in background display area domain | |
| CN109166058A (en) | A kind of customization information of real estate recommended method and system | |
| CN105916051A (en) | Content recommendation method and device | |
| CN106201246A (en) | Page layout processing method and processing device | |
| CN109754329B (en) | Electronic resource processing method, terminal, server and storage medium | |
| CN110099284A (en) | A kind of generation method fast made a speech, device and server | |
| CN109660854A (en) | Video recommendation method, device, equipment and storage medium | |
| CN111479119A (en) | Method, device and system for collecting feedback information in live broadcast and storage medium | |
| CN103268405A (en) | Method, device and system for acquiring game information | |
| CN107197355A (en) | Barrage display methods and device | |
| CN105828167A (en) | Screen-shot sharing method and device | |
| CN109361954A (en) | Method for recording, device, storage medium and the electronic device of video resource | |
| CN113784156A (en) | Live broadcast method and device, electronic equipment and storage medium | |
| CN113596574A (en) | Video processing method, video processing apparatus, electronic device, and readable storage medium | |
| US20200012651A1 (en) | Communication terminal, content server, content recommendation system, control device, and control method | |
| CN114449301B (en) | Item sending method, item sending device, electronic equipment and computer-readable storage medium | |
| KR101943554B1 (en) | Method and server for providing sports game information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |
|
| RJ01 | Rejection of invention patent application after publication |