CN106303662A

CN106303662A - Image processing method in net cast and device

Info

Publication number: CN106303662A
Application number: CN201610763148.XA
Authority: CN
Inventors: 黄丽如; 程广; 陈伟; 肖媛
Original assignee: Netease Hangzhou Network Co Ltd
Current assignee: Netease Hangzhou Network Co Ltd
Priority date: 2016-08-29
Filing date: 2016-08-29
Publication date: 2017-01-04
Anticipated expiration: 2036-08-29
Also published as: CN106303662B

Abstract

The invention discloses the image processing method in a kind of net cast and device.Wherein, the method comprises determining that object is triggered and is illustrated in net cast；Whether monitoring predetermined condition meets；Video streaming image when predetermined condition meets, during acquisition current video is live；Obtain the object images of object；Synthesize to major general's video streaming image with object images.The present invention solves the technical problem that cannot accurately acquire the image comprising video streaming image and object images in prior art.

Description

Image processing method in net cast and device

Technical field

The present invention relates to image processing field, in particular to the image processing method in a kind of net cast and dress Put.

Background technology

In existing society, universal and popular along with network direct broadcasting platform and net cast, user can pass through network Live platform watches the singing provided by net cast person (such as, network main broadcaster, the most referred to as main broadcaster) or dancing etc. Entertainment.User, during viewing programme televised live, can express master by the way of giving virtual specially good effect present That broadcasts likes.Main broadcaster is receiving the moment of gorgeous brilliant virtual present specially good effect, the most pleasantly surprised but also unexpected god that anchor sheet reveals It is dazzling that feelings are often the most beautiful and uniqueness, and benefactor as the arrival at this beautiful a moment and obtain high gratification With honor sense.

Generally, due to the time of present Special display effect is shorter, but in this relatively short period of time, the expression of main broadcaster is with dynamic Also it is transient.Therefore, in order to preserve the expression action of gorgeous specially good effect and main broadcaster that time, main broadcaster and user simultaneously The method shooting computer screen often through screenshot capture or mobile phone realizes capturing.But, in main broadcaster side, either more than Which kind of candid photograph mode all can make main broadcaster take sb's mind off sth because of extra operation, cause main broadcaster's expression when being photographed and Action cannot be accomplished the most natural and put in place.In user side, user cannot accurately catch again main broadcaster when capturing and specially good effect is all That time during good state, the special effect play time is shorter in addition, and main broadcaster and user have little time to prepare and reaction, and that is gorgeous Specially good effect just has finished on.Even if user captures gorgeous specially good effect, as some other factors (such as, sectional drawing softwares The problem such as shake when improper use, mobile phone photograph are not successfully focused or take pictures) and cause the picture material captured fuzzy, coarse And it is not perfect.Further, even if user has really captured gorgeous perfect a moment, share if not carrying out photo, that Other users still cannot see and share a moment of this gorgeous beauty, thus cannot accomplish beautiful moment persistence and Show-and-tell.

For above-mentioned problem, effective solution is the most not yet proposed.

Summary of the invention

Embodiments provide the image processing method in a kind of net cast and device, at least to solve existing skill Art cannot accurately acquire the technical problem of the image comprising video streaming image and object images.

An aspect according to embodiments of the present invention, it is provided that the image processing method in a kind of net cast, including: really Determine object be triggered and be illustrated in net cast；Whether monitoring predetermined condition meets；When described predetermined condition meets, obtain Video streaming image in presently described net cast；Obtain the object images of described object；To video streaming image described in major general with Described object images synthesizes.

Further, described predetermined condition at least includes one below: the gesture that in described net cast, user makes with The similarity of prearranged gesture is more than or equal to predetermined similarity；Described in described net cast, the facial image of user is with described The image scaled of net cast is in preset range.

Further, if described predetermined condition includes: the gesture that described in described net cast, user makes is pre-with described Determine the similarity of gesture more than or equal to described predetermined similarity, then determining that described object is triggered and to be illustrated in video straight After broadcasting, described method also includes: show described prearranged gesture to described user.

Further, meet if not monitoring described predetermined condition in the first predetermined amount of time, then described first pre- It is the most satisfied that the section of fixing time finish time is considered as predetermined condition.

Further, after determining that object is triggered and is illustrated in net cast, show that first falls to described user Timing, wherein, described first countdown corresponds to described first predetermined amount of time.

Further, described first predetermined amount of time is the displaying time of described object.

Further, after determining that object is triggered and is illustrated in net cast, described method also includes: to user Showing the second countdown, wherein, described predetermined condition is that the second predetermined amount of time terminates, and described second countdown is corresponding to described Second predetermined amount of time.

Further, described second predetermined amount of time is that described object shows that start time shows best effective to described object Fruit goes out now.

Further, the video streaming image in the presently described net cast of described acquisition and the described object of described acquisition is right As image includes: obtain video streaming image and the sectional drawing of described object images described in current video broadcast window, wherein, described Video playback window is used for live described video flowing and described object.

Further, carry out synthesis to video streaming image described in major general and described object images to include: the institute that will get State video streaming image to zoom in and out according to the first preset ratio；The object images of the described object got is preset according to second Ratio zooms in and out；Described video streaming image and described object images after scaling to major general synthesize.

Another aspect according to embodiments of the present invention, additionally provides the image processing apparatus in a kind of net cast, including: Determine module, be used for determining that object is triggered and is illustrated in net cast；Monitoring modular, is used for monitoring predetermined condition the fullest Foot；First acquisition module, for when described predetermined condition meets, obtains the video streaming image in presently described net cast； Second acquisition module, for obtaining the object images of described object；Synthesis module, for video streaming image described in major general and institute State object images to synthesize.

Further, described device also includes: the first display module, for including in described predetermined condition: described video The similarity of the gesture that user described in live makes and described prearranged gesture is more than or equal to the feelings of described predetermined similarity Under condition, and after determining that described object is triggered and is illustrated in net cast, show described prearranged gesture to described user.

Further, described device also includes: the second display module, for determining that object is triggered and is illustrated in video After in live, showing the first countdown to described user, wherein, described first countdown corresponds to described first scheduled time Section.

Further, described device also includes: the 3rd display module, for determining that object is triggered and is illustrated in video After in live, displaying to the user that the second countdown, wherein, described predetermined condition is that the second predetermined amount of time terminates, described Two countdowns correspond to described second predetermined amount of time.

Further, described first acquisition module and described second acquisition module include: acquiring unit, are used for obtaining currently Video streaming image described in video playback window and the sectional drawing of described object images, wherein, described video playback window is for straight Broadcast described video flowing and described object.

Further, described synthesis module includes: the first unit for scaling, for will the described video streaming image that get by Zoom in and out according to the first preset ratio；Second unit for scaling, for the object images of described object that will get according to second Preset ratio zooms in and out；Synthesis unit, described video streaming image and described object images after scaling to major general are entered Row synthesis.

In embodiments of the present invention, employing determines that object is triggered and is illustrated in net cast；Touching in predetermined condition Giving, obtain video streaming image corresponding with described predetermined condition in described net cast, wherein, described predetermined condition is in institute State appearance during object is demonstrated；Obtain the object images of the described object corresponding with described predetermined condition；To major general Described video streaming image and described object images carry out the mode synthesized, and by under the triggering of predetermined condition, obtain video straight Broadcast middle video streaming image, and obtain the object images corresponding with predetermined condition, then, object images and video streaming image are carried out Synthesis, obtains comprising the image of object and main broadcaster, relative in prior art, obtains the mode of picture by the way of candid photograph, Reach the purpose of the video streaming image that accurate acquisition comprises object images, it is achieved thereby that improve acquisition to comprise object images The technique effect of video streaming image, and then solve prior art cannot accurately acquire and comprise video streaming image and object The technical problem of the image of image.

Accompanying drawing explanation

Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the part of the application, this Bright schematic description and description is used for explaining the present invention, is not intended that inappropriate limitation of the present invention.In the accompanying drawings:

Fig. 1 is the flow chart of the image processing method in a kind of net cast according to embodiments of the present invention；

Fig. 2 is the schematic diagram of the image processing apparatus in a kind of net cast according to embodiments of the present invention；

Fig. 3 is the schematic diagram of the image processing apparatus in another kind of net cast according to embodiments of the present invention；

Fig. 4 is the schematic diagram that a kind of main broadcaster's end video flowing according to embodiments of the present invention receives unit；

Fig. 5 is the schematic diagram that a kind of viewer end video flowing according to embodiments of the present invention receives unit；

Fig. 6 is the schematic diagram of a kind of present specially good effect administrative unit according to embodiments of the present invention；

Fig. 7 is the schematic diagram of a kind of specially good effect animation display unit according to embodiments of the present invention；

Fig. 8 is the schematic diagram of a kind of photo synthesis unit according to embodiments of the present invention；

Fig. 9 is the schematic diagram of a kind of photo another embodiment of synthesis unit according to embodiments of the present invention；And

Figure 10 is the schematic diagram of a kind of photo later stage processing unit according to embodiments of the present invention.

Detailed description of the invention

In order to make those skilled in the art be more fully understood that the present invention program, below in conjunction with in the embodiment of the present invention Accompanying drawing, is clearly and completely described the technical scheme in the embodiment of the present invention, it is clear that described embodiment is only The embodiment of a present invention part rather than whole embodiments.Based on the embodiment in the present invention, ordinary skill people The every other embodiment that member is obtained under not making creative work premise, all should belong to the model of present invention protection Enclose.

It should be noted that term " first " in description and claims of this specification and above-mentioned accompanying drawing, " Two " it is etc. for distinguishing similar object, without being used for describing specific order or precedence.Should be appreciated that so use Data can exchange in the appropriate case, in order to embodiments of the invention described herein can with except here diagram or Order beyond those described is implemented.Additionally, term " includes " and " having " and their any deformation, it is intended that cover Cover non-exclusive comprising, such as, contain series of steps or the process of unit, method, system, product or equipment are not necessarily limited to Those steps clearly listed or unit, but can include the most clearly listing or for these processes, method, product Or intrinsic other step of equipment or unit.

According to embodiments of the present invention, it is provided that the embodiment of the image processing method in a kind of net cast, explanation is needed , can hold in the computer system of such as one group of computer executable instructions in the step shown in the flow chart of accompanying drawing OK, and, although show logical order in flow charts, but in some cases, can be to be different from order herein Step shown or described by execution.

Fig. 1 is the flow chart of the image processing method in a kind of net cast according to embodiments of the present invention, such as Fig. 1 institute Showing, the method comprises the steps:

Step S102, determines that object is triggered and is illustrated in net cast.

Image processing method in the net cast that the embodiment of the present invention provides can apply at network direct broadcasting platform or Net cast platform.If applied in network direct broadcasting platform, then the video flowing during main broadcaster is live will be in one or more sights Playing out in many terminals, wherein, above-mentioned object can be the specially good effect animation of virtual present.

In embodiments of the present invention, when spectators give virtual present to main broadcaster, if the virtual present that spectators give is full The condition that foot is different, then different specially good effect animations will be triggered.Such as, virtual present " lollipop ", when the stick that spectators give The quantity of sugar is when being 10, then specially good effect animation can be a sparkling lollipop, the lollipop given as spectators When quantity is 60, then specially good effect animation can be a large amount of lollipops very unexpectedly.Therefore, in embodiments of the present invention, when When the virtual present that spectators give reaches specially good effect trigger condition, it is determined that the specially good effect animation of virtual present (that is, above-mentioned object) quilt Trigger, and show in net cast.

Step S104, whether monitoring predetermined condition meets.

In embodiments of the present invention, after determining that object is triggered and is illustrated in net cast, main broadcaster can be with Correspondingly gesture or expression is made with object.But, in order to ensure that in following step S110, the image of synthesis comprises object Best illustrated effect, and the optimal gesture of main broadcaster or most preferably express one's feelings, therefore, in embodiments of the present invention, can set in advance Putting predetermined condition, wherein, above-mentioned predetermined condition at least includes one below: gesture that in net cast, user makes and predetermined hand The similarity of gesture is more than or equal to predetermined similarity；The facial image of user and the image scaled of net cast in net cast In preset range.Then, when predetermined condition meets, perform following step S106, regarding during i.e. acquisition current video is live Frequently stream picture.

Step S106, the video streaming image when predetermined condition meets, during acquisition current video is live.

In embodiments of the present invention, after object (that is, specially good effect animation) is triggered, main broadcaster's client judges whether to meet Predetermined condition, if meeting predetermined condition, then obtains the video streaming image in current time net cast, and performs step S108, i.e. obtains the object images of object.

Step S108, obtains the object images of object.

Step S110, synthesizes to major general's video streaming image with object images.

In embodiments of the present invention, main broadcaster's client, can be by video after getting object images and video streaming image Stream picture and object images synthesize, and synthesize a pictures, and are preserved by the picture of synthesis.Figure after composition In Xiang, comprise the best illustrated effect of object, and the optimal gesture of main broadcaster or optimal expression etc..

In embodiments of the present invention, by under the triggering of predetermined condition, obtain video streaming image in net cast, and obtain Take the object images corresponding with predetermined condition, then, object images and video streaming image synthesized, obtain comprising object and The image of main broadcaster, relative in prior art, obtains the mode of picture by the way of candid photograph, reached accurate acquisition comprise right As the purpose of the video streaming image of image, it is achieved thereby that improve the technology effect obtaining the video streaming image comprising object images Really, and then solve and prior art cannot accurately acquire the technology of the image comprising video streaming image and object images ask Topic.

By the description in step S104, in embodiments of the present invention, predetermined condition at least includes one below: regard The gesture that the most live middle user makes is more than or equal to predetermined similarity with the similarity of prearranged gesture；And in net cast The facial image of user and the image scaled of net cast are in preset range.

It is to say, above-mentioned predetermined condition can be: the gesture that in net cast, user makes is similar to prearranged gesture Degree is more than or equal to predetermined similarity, it is also possible to for: the image ratio of the facial image of user and net cast in net cast Example is in preset range, it is also possible to for: the gesture that in net cast, user makes and prearranged gesture similarity more than or etc. In predetermined similarity, and the facial image of user and the image scaled of net cast group in preset range in net cast Close, will be introduced with regard to above-mentioned three kinds of situations below.

The gesture that in situation one, net cast, user makes is similar more than or equal to predetermined to the similarity of prearranged gesture Degree.

Main broadcaster's client after determining that object is triggered, and object be illustrated in video playback window, main broadcaster client End can obtain the video streaming image in net cast, i.e. obtains each video frame images；Then, it is determined that in net cast whether The gesture that user makes occurs, that is, determine whether the gesture that user makes in each video frame images.Wherein, exist Determine in the case of the gesture that user makes occurs in net cast, calculate the gesture and prearranged gesture determining that user makes Similarity, and judge that whether the similarity that calculates is more than or equal to presetting similarity.If it is judged that the phase calculated Like degree more than or equal to presetting similarity, it is determined that meet predetermined condition, then, the video of current time net cast is obtained Stream picture and object images.Finally, the video streaming image got and object images are synthesized, the figure after being synthesized Sheet.

In situation two, net cast, the facial image of user and the image scaled of net cast are in preset range.

Main broadcaster's client is determining that object is triggered, and after object is illustrated in the window of net cast, main broadcaster Client can obtain the video streaming image in net cast, i.e. obtains each video frame images；Then, it is determined that in net cast Whether the image scaled of facial image and the net cast of the user occurred is in preset range, that is, in each frame of video Determine whether the predetermined facial image of user.Wherein, determine facial image that user occurs in net cast with In the case of the image scaled of net cast is in preset range, determines and meet predetermined condition.Wherein, user in net cast Facial image is less than or equal to the first ratio value with the image scaled of net cast, and more than the second ratio value.

Preferably, in embodiments of the present invention, the first ratio value is chosen for 2/3, and the second ratio value is chosen for 1/100.This Time, it is understood that the image 2/3 being not more than in net cast for the facial image shared region in video area, and not Less than the image in net cast 1/100.It is to say, when judging that facial image meets above-mentioned condition, determine detection To meeting predetermined condition, now, the facial image got is clear head portrait.

Pre-conditioned by above-mentioned two, if meeting above-mentioned predetermined condition, i.e. get face figure clearly Picture, or get normal gesture, then directly can obtain from net cast and comprise normal gesture or face clearly The video streaming image of image.As got facial image clearly the most simultaneously, or get normal gesture, then need At the end of countdown, from net cast stream, obtain video streaming image.Wherein, countdown will be carried out in the following embodiments in detail Introduction.

It should be noted that in embodiments of the present invention, above-mentioned predetermined condition in addition to above-mentioned situation one and situation two, Also including another situation, wherein, this situation is: the gesture that in net cast, user makes is big with the similarity of prearranged gesture In or equal to predetermined similarity, and in net cast the facial image of user and the image scaled of net cast at predetermined model In enclosing.

In the case, main broadcaster's client is determining that object is triggered, and object is illustrated in video playback window it After, main broadcaster's client can obtain the video streaming image in net cast, i.e. obtains each video frame images；Then, it is determined that regard Whether the gesture that user makes occurs, that is, determine whether what user made in each video frame images in the most live Gesture.Wherein, in the case of determining the gesture that user makes occurs in net cast, calculate and determine the hands that user makes Gesture and the similarity of prearranged gesture, and judge that whether the similarity calculated is more than or equal to presetting similarity.

Further, if it is judged that the similarity calculated is more than or equal to presetting similarity, it is determined that video is straight Broadcast and the image scaled of the facial image of user and net cast occurs whether in preset range.Wherein, appearance is being determined In the case of the facial image of user and the image scaled of net cast are in preset range, determine and meet above-mentioned predetermined condition.

It should be noted that in embodiments of the present invention, object is being shown after video playback window, it is also possible to sentence Whether disconnected display object in video playback window meets picture synthesis condition, wherein, if meeting picture synthesis condition, then Obtain video streaming image corresponding with predetermined condition in net cast, and obtain the object images corresponding with predetermined condition.Such as, It is assumed that user send the specially good effect animation of 66 lollipops to main broadcaster, when there being a large amount of stick the most very unexpectedly in video playback window During sugar, then meet the synthesis condition of picture；It is assumed, however, that, user send the specially good effect animation of 10 lollipops, if in video playback Dress mouth only shows a sparkling lollipop, is then unsatisfactory for the synthesis condition of picture, then when specially good effect queue being detected When the specially good effect that the middle next one will be play is " lollipop the most very unexpectedly " the specially good effect animation meeting picture synthesis condition, then Obtain video streaming image corresponding with predetermined condition in net cast, and obtain the object images corresponding with predetermined condition, and will The image got synthesizes.

In another optional embodiment of the present invention, if predetermined condition includes: described in net cast, user makes The similarity of gesture and prearranged gesture more than or equal to predetermined similarity, then determining that object is triggered and is illustrated in video After in live, method also includes: display to the user that described prearranged gesture.

Specifically, if predetermined condition includes condition: gesture that user described in net cast makes and prearranged gesture Similarity more than or equal to predetermined similarity, then when the picture synthesizing specially good effect animation is activated, first, can be in gesture Property data base is specified and selects or randomly choose a gesture, and point out main broadcaster to show corresponding gesture and preparation is taken pictures. Such as, main broadcaster A receives a specially good effect present " may you be hapy and prosperous " (that is, object), then while specially good effect animation triggers, main broadcaster A Client selection will be specified from gesture feature database to embrace boxer's gesture (that is, prearranged gesture), and the video in main broadcaster side broadcasts The lower section putting window shows a cartoon prompting icon embracing fist action, and prompting main broadcaster A shows response gesture.

In an optional embodiment of the present invention, if it is full not monitor predetermined condition in the first predetermined amount of time Foot, then be considered as predetermined condition in the first predetermined amount of time finish time the most satisfied, wherein, when first time period is the displaying of object Between.Specifically, in embodiments of the present invention, if at the end of the displaying time of object, do not monitor predetermined condition and meet, then The moment terminated the displaying time at object obtains the video streaming image in net cast and the object images of object.

Alternatively, after determining that object is triggered and is illustrated in net cast, it is also possible to display to the user that first falls Timing, wherein, the first countdown corresponds to the first predetermined amount of time.

Such as, main broadcaster A receives a specially good effect present " may you be hapy and prosperous " (that is, object), then be triggered at specially good effect animation Meanwhile, the client of main broadcaster A will specify selection to embrace boxer's gesture (that is, prearranged gesture) from gesture feature database, and main broadcaster The lower section of the video playback window of side shows a cartoon prompting icon embracing fist action, and prompting main broadcaster A shows response gesture.So After, the first countdown is shown in main broadcaster side, and before the first countdown terminates, to face and gesture in the image of net cast It is identified, that is, before the displaying time of object terminates, face and gesture in the image of net cast are identified, Wherein, the first countdown is for pointing out main broadcaster the identification having carried out facial image and gesture.

By foregoing description, predetermined condition in the above-described embodiments be gesture that in net cast, user makes with The similarity of prearranged gesture is more than or equal to predetermined similarity, or the facial image of user and net cast in net cast Image scaled in preset range.In addition, predetermined condition can also be the moment that the second predetermined amount of time terminates.The most just It is to say, after determining that object is triggered and is illustrated in net cast, also includes: display to the user that the second countdown, wherein, Predetermined condition is that the second predetermined amount of time terminates, and the second countdown corresponds to the second predetermined amount of time.Alternatively, above-mentioned second pre- The section of fixing time is that object shows that start time to object shows that optimum efficiency goes out now.

In alternative embodiment of the present invention, can obtain in net cast before video streaming image and object images, Arranging display the second countdown, wherein, the timing time of the second countdown is the second predetermined amount of time.When the second countdown terminates Time, in the moment that the i.e. second predetermined amount of time terminates, determine that predetermined condition meets, now, obtain the video in net cast at that time Stream picture and object images.It should be noted that, in embodiments of the present invention, when the second predetermined amount of time is the beginning that object is shown Carve the moment occurred to object displaying optimum efficiency, that is, the moment that object starts to show is to optimum frame in video stream file Show the moment, wherein, optimum frame comprises the best illustrated effect of main broadcaster and object.

Wherein, obtain the moment that the second countdown terminates, obtain current video live in video streaming image and obtain right The object images of elephant includes: obtaining video streaming image and the sectional drawing of object images in current video broadcast window, wherein, video is broadcast Put window for live video stream and described object.

Specifically, when the second predetermined amount of time terminates, from video playback window, obtain video streaming image, and same Time the specially good effect animation (that is, object) play is intercepted and captured.Then, by the video streaming image got and the broadcasting of intercepting and capturing Specially good effect animation synthesize, the picture after being synthesized.

In another optional embodiment of the present invention, carry out synthesis bag to major general's video streaming image and object images Include: the video streaming image got is zoomed in and out according to the first preset ratio, and corresponding with predetermined condition by get Object images zooms in and out according to the second preset ratio, and then, video streaming image and object images after scaling to major general are entered Row synthesis.

If the size of the picture after final synthesis is PictureSize (pw, ph), then needing will be from net cast In size VideoSize (vw, vh) of video streaming image that gets zoom in and out according to the first preset ratio, wherein, scaling Size afterwards is the size of the picture after final synthesis, is then plotted on painting canvas.First preset ratio includes that width contracts Put than with height pantograph ratio, wherein, width pantograph ratio is: kw=pw/vw, and highly pantograph ratio is: kh=ph/vh.

It should be noted that generally, in order to keep image undistorted, width pantograph ratio and length scale ratio should Identical, that is, kw=kh.If under special circumstances, when causing width pantograph ratio and length scale ratio to differ, for ensureing institute Some picture materials can zoom in the picture after finally synthesizing, then need use both smaller value as scaling because of Son, that is, the pantograph ratio now chosen is: k=min (kw, kh).When video streaming image being zoomed in and out according to pantograph ratio, The size of the video streaming image become throughout one's life is: DestVideoSize (vw '=vw*k, vh '=vh*k).

After video streaming image drawn by painting canvas, it is possible to rendered object image (that is, special effect graph picture) successively.Object diagram The drafting effect of picture two kinds, i.e. type of effect 1 and type of effect 2, wherein, the interpolation of type of effect 1 and type of effect 2 is based on The positional information of object images: EffectRect (x, y, w, h).

Type of effect 1: the i.e. object images of type of effect 1 covers whole video streaming image, now, the position letter of object images Breath is: and EffectRect (0,0, w, h).Now, object images can obtain, by zoom factor k2, the object diagram being more suitable for Picture, it may be assumed that and EffectRect ' (0,0, w ', h ')=EffectRect (0,0, w, h) * k2.

Type of effect 2: type of effect 2 ad-hoc location during that is object images is in video streaming image.First from video image Scope that middle acquisition object images shows and positional information, it may be assumed that EffectRect ' (x ', y ', w ', h ').But, due to this position Confidence breath and indication range are that relatively primitive video streaming image obtains, it is therefore desirable to first believed above-mentioned this position got Breath and indication range are changed in the following manner, it may be assumed that EffectRect " and (x ", y ", w " and, h ")=EffectRect ' (x ', y’,w’,h’)*k.Then, by original size EffectSize of object images, (w, h) according to non-uniform zoom factor k3 (α, β) Zooming in and out, after scaling, the size of object images is: EffectSize " (w ", h ")=EffectSize (w, h) * k3 (α, β).Finally, (x ", y ") position of painting canvas is drawn effect.

The embodiment of the present invention additionally provides the image processing apparatus in a kind of net cast, at the image in this net cast Reason device is mainly used in performing the image processing method in the net cast that embodiment of the present invention foregoing is provided, the most right Image processing apparatus in the net cast that the embodiment of the present invention is provided does concrete introduction.

Fig. 2 is the schematic diagram of the image processing apparatus in a kind of net cast according to embodiments of the present invention, such as Fig. 2 institute Show, the image processing apparatus in this net cast mainly include determining module 21, monitoring modular the 23, first acquisition module 25, Two acquisition modules 27 and synthesis module 29, wherein:

Determine module, be used for determining that object is triggered and is illustrated in net cast；

Monitoring modular, is used for monitoring whether predetermined condition meets.

In embodiments of the present invention, after determining that object is triggered and is illustrated in net cast, main broadcaster can be with Correspondingly gesture or expression is made with object.But, in order to ensure in lower synthesis module that the image of synthesis comprises object Good bandwagon effect, and the optimal gesture of main broadcaster or most preferably express one's feelings, therefore, in embodiments of the present invention, can pre-set Predetermined condition, wherein, above-mentioned predetermined condition at least includes one below: gesture that in net cast, user makes and prearranged gesture Similarity more than or equal to predetermined similarity；In net cast, the facial image of user and the image scaled of net cast exist In preset range.Then, when predetermined condition meets, by following first acquisition module acquisition current video video in live Stream picture.

First acquisition module, for the video streaming image when predetermined condition meets, during acquisition current video is live.

In embodiments of the present invention, after object (that is, specially good effect animation) is triggered, main broadcaster's client judges whether to meet Predetermined condition, if meeting predetermined condition, then obtains the video streaming image in current time net cast, and performs step S108, i.e. obtains the object images of object.Second acquisition module, for obtaining the object images corresponding with predetermined condition；

Synthesis module, for synthesizing to major general's video streaming image with object images.

Alternatively, predetermined condition at least includes one below: the gesture that in net cast, user makes and prearranged gesture Similarity is more than or equal to predetermined similarity；In net cast, the facial image of user and the image scaled of net cast are in advance In the range of Ding.

Alternatively, device also includes: the first display module, for including in predetermined condition: in net cast, user makes The similarity of gesture and prearranged gesture more than or equal in the case of predetermined similarity, and determining that object is triggered and opens up After showing in net cast, display to the user that prearranged gesture.

Alternatively, meet if not monitoring predetermined condition in the first predetermined amount of time, then tie at the first predetermined amount of time It is the most satisfied that the bundle moment is considered as predetermined condition.

Alternatively, device also includes: the second display module, for determining that object is triggered and is illustrated in net cast Afterwards, displaying to the user that the first countdown, wherein, the first countdown corresponds to the first predetermined amount of time.

Alternatively, the first predetermined amount of time is the displaying time of object.

Alternatively, device also includes: the 3rd display module, for determining that object is triggered and is illustrated in net cast Afterwards, displaying to the user that the second countdown, wherein, predetermined condition is that the second predetermined amount of time terminates, and the second countdown corresponds to Second predetermined amount of time.

Alternatively, the second predetermined amount of time is that object shows that start time to object shows that optimum efficiency goes out now.

Alternatively, the first acquisition module and the second acquisition module include: acquiring unit, are used for obtaining current video and play window Video streaming image and the sectional drawing of object images in Kou, wherein, video playback window is used for live video stream and object；

Alternatively, synthesis module includes: the first unit for scaling, for being preset according to first by the video streaming image got Ratio zooms in and out；Second unit for scaling, for contracting the object images of the object got according to the second preset ratio Put；Synthesis unit, video streaming image and object images after scaling to major general synthesize.

Fig. 3 is the schematic diagram of the image processing apparatus in another kind of net cast according to embodiments of the present invention, such as Fig. 3 institute Showing, the image processing apparatus in the net cast that the embodiment of the present invention provides includes: video flowing receives unit 301, specially good effect management Unit 302, specially good effect animation display unit 303, photo synthesis unit 304 and photo later stage processing unit 305, wherein:

Video flowing receives unit 301, is used for receiving video streaming image, and provides video streaming image acquisition interface to regard to obtain Frequently stream picture.Video flowing receives unit and uses different processing modes to carry out the process of video flowing at main broadcaster's end with viewer end, main Broadcast end video flowing reception unit will be described in detail in the fig. 4 embodiment, and viewer end video flowing reception unit will be at Fig. 5 Embodiment in be described in detail.

Specially good effect administrative unit 302, for receiving the virtual present data that the spectators of webserver distribution give to main broadcaster, And the management essential information of present and special-effect information, and start gift when the virtual present given meets the condition showing specially good effect Thing FX Module, triggers present specially good effect.

Specially good effect animation display unit 303, for synthetic video stream picture and object images, and by the image shows after synthesis To main broadcaster and spectators.Specially good effect animation display unit comprises time control unit, specially good effect pretreatment unit, Special display effect unit and spy Effect end unit, the effect for time control unit, specially good effect pretreatment unit, Special display effect unit and specially good effect end unit will It is described in detail in the following embodiments.

Photo synthesis unit 304, for receiving the video streaming image got in unit and from present spy from video flowing The present special effect graph picture (that is, object images) that effect administrative unit gets processes and synthesizes, and generates main broadcaster's special video effect and shines Sheet.Wherein, photo synthesis unit comprises countdown unit, face and gesture identification unit, video image acquiring unit, special effect graph As acquiring unit and photograph image synthesis unit, the effect of concrete each unit will describe in detail in the following embodiments.

Alternatively, photo synthesis unit 304 directly can obtain with specially good effect synthesis unit from video under given conditions Take the view data of synthesis.Now photo synthesis unit will include countdown unit, composograph acquiring unit and composograph Processing unit.Details will be described in detail in the implementing procedure figure of Fig. 7.

Photo later stage processing unit 305, for collecting, manage and show the photo of user；In users from networks server Obtain the photo of current anchor and be illustrated in specific the window's position.User can also look at these photos, and affiliated main broadcaster is also Can check and manage these photos.

Fig. 4 is the schematic diagram that a kind of main broadcaster's end video flowing according to embodiments of the present invention receives unit, as shown in Figure 4, main Broadcast end video flowing and receive unit for gathering the Video stream information of main broadcaster's end, and export the Video stream information of main broadcaster's end.

Specifically, main broadcaster's end video flowing reception unit includes:

Camera device 401, connects the computer of main broadcaster's end by USB port, is gathered the video flowing of main broadcaster by this equipment Information, generates video data and exports video flowing collecting unit.

Video flowing collecting unit 402, when video flowing collecting unit acts on main broadcaster's end, will realize following two functions:

Function 1: use existing video capture technology, is converted to video by the video data collected from camera device Recognizable and the accessible video mapped file of live platform software.

Function 2: transmit for the ease of network, uses major video coding techniques, video mapped file is carried out video volume Generate the video stream file of rtmp form after Ma, and be sent on the webserver 403 in this, as output, in order to be supplied to see Many end subscribers obtain the video stream data of main broadcaster.

The webserver 403, receives the video stream data of the rtmp form uploaded by main broadcaster's end, carries out of short duration to these data Store and realize video data distribution function, in order to being supplied to the video data that viewer end user obtains and downloads main broadcaster.

Main broadcaster's end video reception unit 404, receives the video mapped file data from the output of video flowing collecting unit, should Video mapped file data are shown in the video playback window of net cast software of the machine with the form of original video stream, with Just it is supplied to main broadcaster and carries out video preview.

Fig. 5 is the schematic diagram that a kind of viewer end video flowing according to embodiments of the present invention receives unit, as it is shown in figure 5, see Many end video reception unit are for gathering the Video stream information of viewer end, and export the Video stream information of viewer end.

Specifically, viewer end video reception unit includes:

Video flowing collecting unit 501, is same unit with the video flowing collecting unit 402 in Fig. 4, video flowing collecting unit 501 for gathering video stream data from main broadcaster's end, and is submitted to the webserver 502.

The webserver 502, is same unit with the webserver 403 in Fig. 4, and the webserver 502 is used for receiving The video stream data of the rtmp form uploaded by main broadcaster's end, and these data are carried out of short duration storage and realizes video stream data distribution Function, in order to be supplied to the video stream data that viewer end user obtains and downloads main broadcaster.

Viewer end video flowing receive unit 503, using the webserver 502 distribution rtmp form video stream data as Input, is decoded video stream data processing, and after the decoding process, the video stream data after decoding is deposited in and is In system Memory Mapping File, then, use existing video display technology, in the video playback of the net cast software of viewer end The video stream data that in window, display obtains.

Fig. 6 is the schematic diagram of a kind of present specially good effect administrative unit according to embodiments of the present invention, as shown in Figure 6, specially good effect pipe Reason unit comprises: present gives unit 601, specially good effect animation unit 602 and specially good effect animation adjustment unit 603, wherein:

Unit 601 given by present, clicks on using spectators and gives the behavior of virtual present as input, exports user in the window The information of gifts, when the virtual present given meets different conditions, triggers different animation effects, when spectators give Virtual present when reaching specially good effect trigger condition, start specially good effect animation unit.

Specially good effect animation unit 602, according to the information of spectators' gifts, obtains the specially good effect specified in the webserver and moves Picture information.In general, the present that specially good effect animation and spectators give is closely bound up.If giving specially good effect present " lollipop " Reaching certain condition (such as, the quantity of lollipop is 10), now, in video playback window, the specially good effect animation of display may It it is a sparkling lollipop；But, if giving specially good effect present " lollipop " to reach certain condition (such as, lollipop Quantity be 66), now, specially good effect animation will be a large amount of lollipops the most very unexpectedly, and the most different virtual presents is reaching During different condition, different specially good effect animation effects will be triggered.

Specially good effect animation adjustment unit 603, after triggering at specially good effect animation, in the case of ensureing that video cartoon is distortionless The display size of specially good effect animation, display position, playback rate etc. are carried out just successive step, and the specially good effect animation after adjusting is sent out Deliver to specially good effect animation display unit 302 shows.

Fig. 7 is the schematic diagram of a kind of specially good effect animation display unit according to embodiments of the present invention, as it is shown in fig. 7, specially good effect is moved Picture display unit comprises: specially good effect pretreatment unit 701, time control unit 702, Special display effect unit 703 and specially good effect terminate list Unit 704, wherein:

Specially good effect pretreatment unit 701 for obtaining special-effect information from the webserver, and according to monitor resolution, regard Frequently the positional information of broadcast window and video area information adjust the size and location of specially good effect animation.

Such as, certain specially good effect animation is " flower is around main broadcaster ", then the specially good effect animation of " flower " is accomplished by occurring in and regards The surrounding in frequency domain can be only achieved around effect；The most such as certain specially good effect animation is " accumulated snow on Christmas ", then " accumulated snow " specially good effect is moved Picture is accomplished by occurring in below video area and can be only achieved accumulated snow effect.But, under the display that resolution is bigger, due to video Broadcast window becomes big, and therefore the size of flower and accumulated snow also can become big；And under the display that resolution is less, owing to video is broadcast Putting window to diminish, therefore the size of flower and accumulated snow also can diminish.I.e. under different monitor resolutions, the size of specially good effect animation Can be different, it is therefore desirable to need to stretch or reduction operation to original specially good effect animation size.

Further, can be with the movement of video playback window due to video playback window position in indicator screen Mobile.Such as, video playback window is carried out forms by user and pulls, carry out window stretching or forms zoom operations and carry out During window maximized operation such as grade, if the most playing specially good effect animation, then be accomplished by its position in indicator screen Put and adjust in real time.

Specifically, so that video playback window is when being stretched or reduce, specially good effect animation is undistorted, needs spy The size of effect animation is adjusted.Assume video stream data display size in video playback window be videoSize (vw, Vh), wherein, vw is video playback window width value, and vh is video playback window height value；The original size of certain specially good effect animation For effectSize (ew, eh), wherein, ew is the original width value of specially good effect animation, and eh is the original height value of specially good effect animation.Warp The size of specially good effect animation after specially good effect pretreatment unit processes and adjusts is: effectSizeDest (edw, edh), its In, edw is the width value after specially good effect animation adjusts, and edh is the height value after specially good effect animation adjusts, after this specially good effect animation adjusts Size and video playback window there is relation, this relation can obtain from specially good effect administrative unit 302.It is assumed that after Tiao Zhenging Size and video playback window between proportionate relationship can be: effectSizeDest (edw, edh)=videoSize (vw,vh)*ρ(ρw,ρh).It is assumed that specially good effect animation zoom factor is σ (σ w, σ h), zoom factor can be obtained according to aforementioned proportion relation σ (σ w, σ h)=videoSize (vw, vh) * ρ (ρ w, ρ h)/effectSize (ew, eh), then specially good effect animation will be according to this contracting Put the factor and be adjusted to target sizes, complete the adjustment to specially good effect animation size.

Further, so that specially good effect animation occurs on regional location correct in video playback window, therefore, need The position of specially good effect animation is adjusted.In embodiments of the present invention, can according to the coordinate position of video playback window and The coordinate position of video playback window, arranges the home position point that 4 specially good effect animations are likely to occur, they respectively: origin1 (that is, the window upper left corner, room of net cast platform), origin2 (that is, the window center, room of net cast platform), (that is, net cast software video plays window to origin3 (that is, the net cast software video broadcast window upper left corner) and origin4 Mouth center).

In embodiments of the present invention, each specially good effect animation can comprise a relative skew set according to self size Value offsize (ox, oy), this value manually adjusts the position of specially good effect animation for fine arts personnel.It is assumed that the room of net cast platform Between the size of window be roomSize (rw, rh), the position of the relative room window of video playback window be videoPos (vx, Vy), video playback window size is videoSize (vw, vh), now, just can calculate correspondence according to 4 home position points The synthesising position effectPos (ex, ey) of specially good effect animation, specific as follows:

Origin1: specially good effect synthesising position is positioned at the upper left corner in room, then effectPos (ex, ey)=offsize (ox, oy)。

Origin2: specially good effect synthesising position is positioned at the center in room, and effectPos (ex, ey)=offsize (ox, oy)+ roomSize(rw,rh)/2。

Origin3: specially good effect synthesising position relative video offsets, and effectPos (ex, ey)=offsize (ox, oy)+ videoPos(vx,vy)。

Origin4: specially good effect synthesising position relative video offsets, and effectPos (ex, ey)=offsize (ox, oy)+ (videoPos(vx,vy)+videoSize(vw,vh)/2)。

Time control unit 702, after specially good effect animation is triggered, all specially good effects are entered according to the time order and function order being triggered Row is queued up, and enters in specially good effect animation queue, and special display effect animation successively under the control of time quantum.Time control unit For triggering the display of specially good effect, and control the duration of Special display effect.When specially good effect animation finishes playing, specially good effect knot will be called Shu Danyuan 704 carries out resource reclaim and internal memory release.Further, time control unit, will after starting Special display effect unit Judge whether this specially good effect animation meets the synthesis condition of photo, if meeting the synthesis condition of photo, then send activation instruction to Photo synthesis unit 304.It is assumed that user send the specially good effect animation of 66 lollipops to main broadcaster, big when having in video playback window When measuring lollipop very unexpectedly, then meet the synthesis condition of picture；The specially good effect of 10 lollipops is sent to move it is assumed, however, that set Drawing, if only showing a sparkling lollipop in video playback dress mouth, being then unsatisfactory for the synthesis condition of picture, then When detecting that in specially good effect queue, the next specially good effect that will play is " the stick the most very unexpectedly meeting picture synthesis condition Sugar " specially good effect animation time, then obtain video streaming image corresponding with predetermined condition in net cast, and obtain corresponding with predetermined condition Object images, and the figure got is synthesized.

Special display effect unit 703, using the output of specially good effect pretreatment unit 701 as input, in the control of time control unit Under system, above video stream data, special display effect animation.

Specially good effect end unit 704, is used for terminating and closing specially good effect animation, and reclaims the resource that specially good effect animation uses, and Resetting specially good effect animated state, the broadcasting for next specially good effect is prepared.

Fig. 8 is the schematic diagram of a kind of photo synthesis unit according to embodiments of the present invention, as shown in Figure 8, is being embodied as In, photo synthesis unit comprises: gesture feature database 801, gesture motion reminding unit 802, countdown unit 803, face With gesture identification unit 804, video image acquiring unit 805, specially good effect image acquisition unit 806 and photograph image synthesis unit 807, wherein:

In embodiments of the present invention, the time point of picture synthesis will determine image content whether arrive " the most beautiful by success " candid photograph " A moment ", and calculate the time point at the most U.S. a moment, will be obtained by calculating with lower unit:

Gesture feature database 801, the cartoon prompting icon of characteristic and corresponding gesture for depositing various gesture, Including but not limited to various actions and gesture, such as, the various popular gestures such as boxer's gesture, yeah gesture, love gesture are embraced.

When photo synthesis unit is activated, first initiation gesture action reminding unit 802, this unit can be at gesture feature Data base specifies and selects or randomly choose a gesture, and point out main broadcaster to show corresponding gesture and preparation is taken pictures.Such as, Main broadcaster A receives a virtual present " may you be hapy and prosperous " that can trigger to take pictures, then while specially good effect animation triggers, gesture motion Reminding unit can specify selection to embrace boxer's gesture from gesture feature database, and shows one armful below main broadcaster's side video region The cartoon prompting icon of fist action, prompting main broadcaster shows response gesture.

When photo synthesis unit is activated, it is also possible to by countdown unit 803, facial image and main broadcaster's gesture are set Recognition time.Such as, carry out facial image and main broadcaster's gesture identification when countdown starts, after countdown terminates, close people Face image and the identification of main broadcaster's gesture.

Face and gesture identification unit 804, for before countdown unit terminates, to the face figure in video stream data The gesture motion of picture and main broadcaster detects and identifies.

Specifically, in embodiments of the present invention, when the gesture of facial image and main broadcaster is identified, it is with frame of video Being identified for unit, facial image and main broadcaster's gesture in the most each frame of video are identified, when recognizing facial image Ratio is more visible, or when the Similarity value of the gesture of main broadcaster and prearranged gesture meets predetermined Similarity value, returns facial image The action coding of data and main broadcaster's gesture.Wherein, the packet of the facial image scope containing face place rectangle, eyes, nose, Lip, ear is relative to the rectangular extent of face rectangle.Assume that successfully recognizing both hands forefinger thumb is combined into a cardioid pattern Love gesture, then return gesture motion coding 1.

Video image acquiring unit 805, obtains real-time video stream picture for receiving from video flowing unit.And judge people Whether face image is predetermined facial image, wherein, when judging that facial image is predetermined facial image, i.e. and facial image place Face rectangle shared region in video area is not more than the 2/3 of video area, not less than video area 1/100 time, it is judged that For predetermined facial image, i.e. clear head portrait.

Therefore, in embodiments of the present invention, if recognize clearly facial image and get normal gesture coding, Then directly can obtain video streaming image from video flowing.Without getting above-mentioned information simultaneously, then need in countdown At the end of, from video flowing obtain video streaming image, wherein, the video streaming image that video image acquiring unit gets for without The image of specially good effect animation information.

Specially good effect image acquisition unit 806, for obtaining the image letter of the specially good effect animation of storage from present information database Breath, then, according to the image information acquisition special effect graph picture of specially good effect animation (that is, above-mentioned object images).

It should be noted that in present example, special effect graph picture has multiple source, specifically includes that

1, the picture file being stored on the webserver, in needing to download this document from the webserver and be loaded into In depositing.

2, specially good effect animation frame describes, and special effect graph picture obtains corresponding frame as special effect graph picture from specially good effect animation.

Photograph image synthesis unit 807, for synthesizing final photo by video streaming image and special effect graph picture.If it is final The size of the picture after synthesis is PictureSize (pw, ph), then need the video flowing that will get from net cast Size VideoSize (vw, vh) of image zooms in and out according to the first preset ratio, and wherein, the size after scaling is final The size of the picture after synthesis, is then plotted on painting canvas.First preset ratio includes width pantograph ratio and height pantograph ratio, Wherein, width pantograph ratio is: kw=pw/vw, highly pantograph ratio be: kh=ph/vh.

Fig. 9 is the schematic diagram of a kind of photo another embodiment of synthesis unit according to embodiments of the present invention, as it is shown in figure 9, In another specific embodiment, the another kind of implementation of image synthesis includes: countdown unit 901, composograph obtain single Unit 902 and composograph processing unit 903, wherein:

Countdown unit 901, is same unit with the countdown unit in Fig. 8.Specifically, when showing at specially good effect animation Time on video playback window, the appointment time that can set specially good effect animation is the moment taken pictures, and the description of this time point is permissible Obtain from specially good effect present unit, the generally displaying time of best results frame in specially good effect animation.Countdown unit herein means fixed Front the 3 of time point～5s start, and show count down information in video playback window, to point out main broadcaster and the user will be in terms of Time terminate after will take pictures, and at the end of countdown start composograph acquiring unit.

Composograph acquiring unit 902, for acquisition video streaming image and special effect graph picture from video playback window (i.e., Object).This unit directly can obtain the sectional drawing of video playback window from video playback window, and will play simultaneously Specially good effect animation is intercepted and captured, and the specially good effect animation now intercepted and captured is the optimum frame in setting.Herein, composograph acquiring unit gets Image has comprised video streaming image and the special effect graph picture of main broadcaster's end.

Composograph processing unit 903, for the image of synthesis graphics processing unit synthesis is zoomed in and out process, processes The size finally needed.

Figure 10 is the schematic diagram of a kind of photo later stage processing unit according to embodiments of the present invention, as shown in Figure 10, photo Later stage processing unit includes: photo upload unit 1001, the webserver 1002 and photo display unit 1003, wherein:

Photo upload unit 1001 is for uploading to the picture of synthesis in the webserver.

The webserver 1002, for receiving the photo that photo upload unit 1001 is uploaded, and stores photo, and Inquiry and download service are provided.

Photo display unit 1003, for obtaining the picture letter of the current anchor stored from the webserver 1002 Breath, and be shown.User can also browse all photos of this main broadcaster, and main broadcaster can also be carried out while browsing photo Delete and photo is grouped.

To sum up, in embodiments of the present invention, it is provided that the image processing method in a kind of net cast and device, the method Enable to, while of short duration present specially good effect occurs, can automatically be obtained by the identification of facial image and gesture with device And preserve optimum attitude and the photo of optimal specially good effect of main broadcaster, thus allow main broadcaster and spectators after specially good effect photo preserves and shows Can aftertaste, judge that splendid moment at that time.

Further, image processing method and device in the net cast that the embodiment of the present invention provides can be applicable to tradition During real-time video is live, and without net cast flow process and video stream data are modified.

Further, owing to without being modified net cast flow process and video stream data, therefore, the present invention provides Technical scheme achieves high durability and transplantability, and all without making too much, amendment just can be very for the most any audio/video player system Load assembly of the invention easily and carry out Real-time Special Effect photo generation based on video image synthesis.

The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.

In the above embodiment of the present invention, the description to each embodiment all emphasizes particularly on different fields, and does not has in certain embodiment The part described in detail, may refer to the associated description of other embodiments.

In several embodiments provided herein, it should be understood that disclosed technology contents, can be passed through other Mode realizes.Wherein, device embodiment described above is only schematically, the division of the most described unit, Ke Yiwei A kind of logic function divides, actual can have when realizing other dividing mode, the most multiple unit or assembly can in conjunction with or Person is desirably integrated into another system, or some features can be ignored, or does not performs.Another point, shown or discussed is mutual Between coupling direct-coupling or communication connection can be the INDIRECT COUPLING by some interfaces, unit or module or communication link Connect, can be being electrical or other form.

The described unit illustrated as separating component can be or may not be physically separate, shows as unit The parts shown can be or may not be physical location, i.e. may be located at a place, or can also be distributed to multiple On unit.Some or all of unit therein can be selected according to the actual needs to realize the purpose of the present embodiment scheme.

It addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it is also possible to It is that unit is individually physically present, it is also possible to two or more unit are integrated in a unit.Above-mentioned integrated list Unit both can realize to use the form of hardware, it would however also be possible to employ the form of SFU software functional unit realizes.

If described integrated unit realizes and as independent production marketing or use using the form of SFU software functional unit Time, can be stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially The part that in other words prior art contributed or this technical scheme completely or partially can be with the form of software product Embodying, this computer software product is stored in a storage medium, including some instructions with so that a computer Equipment (can be for personal computer, server or the network equipment etc.) perform the whole of method described in each embodiment of the present invention or Part steps.And aforesaid storage medium includes: USB flash disk, read only memory (ROM, Read-Only Memory), random access memory are deposited Reservoir (RAM, Random Access Memory), portable hard drive, magnetic disc or CD etc. are various can store program code Medium.

The above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For Yuan, under the premise without departing from the principles of the invention, it is also possible to make some improvements and modifications, these improvements and modifications also should It is considered as protection scope of the present invention.

Claims

1. the image processing method in a net cast, it is characterised in that including:

Determine that object is triggered and is illustrated in net cast；

Whether monitoring predetermined condition meets；

When described predetermined condition meets, obtain the video streaming image in presently described net cast；

Obtain the object images of described object；

Synthesize to video streaming image described in major general with described object images.

Method the most according to claim 1, it is characterised in that described predetermined condition at least includes one below:

The gesture that in described net cast, user makes is more than or equal to predetermined similarity with the similarity of prearranged gesture；

The image scaled of the facial image of user described in described net cast and described net cast is in preset range.

Method the most according to claim 2, it is characterised in that if described predetermined condition includes: institute in described net cast State gesture that user the makes similarity with described prearranged gesture more than or equal to described predetermined similarity, then determine described After object is triggered and is illustrated in net cast, described method also includes: show described prearranged gesture to described user.

Method the most according to claim 2, it is characterised in that if not monitoring described predetermined in the first predetermined amount of time Condition meets, then be considered as predetermined condition in described first predetermined amount of time finish time the most satisfied.

Method the most according to claim 4, it is characterised in that described method also includes:

After determining that object is triggered and is illustrated in net cast, show the first countdown to described user, wherein, described First countdown corresponds to described first predetermined amount of time.

Method the most according to claim 4, it is characterised in that when described first predetermined amount of time is the displaying of described object Between.

Method the most according to claim 1, it is characterised in that determining that object is triggered and is illustrated in net cast it After, described method also includes:

Displaying to the user that the second countdown, wherein, described predetermined condition is that the second predetermined amount of time terminates, described second countdown Corresponding to described second predetermined amount of time.

Method the most according to claim 7, it is characterised in that described second predetermined amount of time is that the displaying of described object starts Moment to described object shows that optimum efficiency goes out now.

Method the most according to claim 7, it is characterised in that the video flow graph in the presently described net cast of described acquisition The object images of picture and the described object of described acquisition includes:

Obtaining video streaming image and the sectional drawing of described object images described in current video broadcast window, wherein, described video is broadcast Put window for live described video flowing and described object.

Method the most according to claim 1, it is characterised in that to video streaming image described in major general and described object images Carry out synthesis to include:

The described video streaming image got is zoomed in and out according to the first preset ratio；

The object images of the described object got is zoomed in and out according to the second preset ratio；

Described video streaming image and described object images after scaling to major general synthesize.

Image processing apparatus in 11. 1 kinds of net casts, it is characterised in that including:

Monitoring modular, is used for monitoring whether predetermined condition meets；

First acquisition module, for when described predetermined condition meets, obtains the video streaming image in presently described net cast；

Second acquisition module, for obtaining the object images of described object；

Synthesis module, for synthesizing to video streaming image described in major general with described object images.

12. devices according to claim 11, it is characterised in that described predetermined condition at least includes one below:

13. devices according to claim 12, it is characterised in that described device also includes: the first display module, are used for Described predetermined condition includes: the similarity of the gesture that described in described net cast, user makes and described prearranged gesture more than or In the case of person is equal to described predetermined similarity, and after determining that described object is triggered and is illustrated in net cast, to Described user shows described prearranged gesture.

14. devices according to claim 12, it is characterised in that if not monitoring described pre-in the first predetermined amount of time Fixed condition meets, then be considered as predetermined condition in described first predetermined amount of time finish time the most satisfied.

15. devices according to claim 14, it is characterised in that described device also includes:

Second display module, for after determining that object is triggered and is illustrated in net cast, shows the to described user One countdown, wherein, described first countdown corresponds to described first predetermined amount of time.

16. devices according to claim 14, it is characterised in that described first predetermined amount of time is the displaying of described object Time.

17. devices according to claim 11, it is characterised in that described device also includes:

3rd display module, for after determining that object is triggered and is illustrated in net cast, displays to the user that second falls Timing, wherein, described predetermined condition is that the second predetermined amount of time terminates, and described second countdown is corresponding to the described second pre-timing Between section.

18. devices according to claim 17, it is characterised in that described second predetermined amount of time is that the displaying of described object is opened Moment beginning to described object shows that optimum efficiency goes out now.

19. devices according to claim 17, it is characterised in that described first acquisition module and described second acquisition module Including:

Acquiring unit, for obtaining video streaming image described in current video broadcast window and the sectional drawing of described object images, its In, described video playback window is used for live described video flowing and described object.

20. devices according to claim 11, it is characterised in that described synthesis module includes:

First unit for scaling, for zooming in and out the described video streaming image got according to the first preset ratio；

Second unit for scaling, for zooming in and out the object images of the described object got according to the second preset ratio；

Synthesis unit, described video streaming image and described object images after scaling to major general synthesize.