CN108769825A - The implementation method and device of live streaming - Google Patents
The implementation method and device of live streaming Download PDFInfo
- Publication number
- CN108769825A CN108769825A CN201810646507.2A CN201810646507A CN108769825A CN 108769825 A CN108769825 A CN 108769825A CN 201810646507 A CN201810646507 A CN 201810646507A CN 108769825 A CN108769825 A CN 108769825A
- Authority
- CN
- China
- Prior art keywords
- rule
- beautification
- live streaming
- adjustment
- adjusted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000003860 storage Methods 0.000 claims description 19
- 230000015654 memory Effects 0.000 claims description 14
- 210000001061 forehead Anatomy 0.000 claims description 8
- 230000006870 function Effects 0.000 description 35
- 230000008859 change Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 238000004590 computer program Methods 0.000 description 6
- 208000029152 Small face Diseases 0.000 description 4
- 210000004709 eyebrow Anatomy 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 239000003337 fertilizer Substances 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000006641 stabilisation Effects 0.000 description 2
- 238000011105 stabilization Methods 0.000 description 2
- 230000002087 whitening effect Effects 0.000 description 2
- 210000004209 hair Anatomy 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses the implementation method of live streaming and device, the method includes：During live streaming, the video flowing of acquisition is beautified by preset beautification rule, by the video stream after beautification to direct broadcast server；Judge whether live state meets live streaming regularization condition, be, the beautification rule is adjusted.By during live streaming, the video flowing of acquisition is beautified by preset beautification rule, the mode of video stream to direct broadcast server after beautification will be realized to the demands such as the U.S. face of main broadcaster, further through judging whether live state meets live streaming regularization condition, it is that ensure that the stability of beautification to the mode that beautification rule is adjusted.It that is, providing a kind of means for improving and quality being broadcast live, while can also ensure stability, the demand of live streaming user be met, but also viewer can obtain small, the smooth viewing experience that rises and falls.
Description
Technical field
The present invention relates to network direct broadcasting fields, and in particular to the implementation method and device of live streaming.
Background technology
Network direct broadcasting has become popular interaction mode at present, and the mode for becoming main broadcaster is very simple, usually logical
The user for being registered as live streaming application is crossed, the equipment such as mobile phone can be utilized to be broadcast live after by certification.What is be broadcast live is main
Form or net cast, attract the mode of user also not depend solely on live content itself, also rely more heavily on live streaming
Using the function that can be provided, thus how by it is technical improvement come attract user concern be problem to be solved.
Invention content
In view of the above problems, it is proposed that the present invention overcoming the above problem in order to provide one kind or solves at least partly
State the implementation method and device of the live streaming of problem.
One side according to the present invention provides a kind of implementation method of live streaming, including：
During live streaming, the video flowing of acquisition is beautified by preset beautification rule, by the video flowing after beautification
It is sent to direct broadcast server；
Judge whether live state meets live streaming regularization condition, be, the beautification rule is adjusted.
Optionally, the beautification rule includes as follows one or more：
Shape of face adjustment rule, nose type adjustment rule, lip adjustment rule, chin adjustment rule, forehead adjustment rule, eye distance
Adjustment rule, camber adjustment rule, canthus adjustment rule and colour of skin adjustment rule.
Optionally, described to judge whether live state meets live streaming regularization condition and include：
Obtain the resource service condition of live streaming terminal；
Judged whether to meet live streaming regularization condition according to the resource service condition of acquisition and preset resource threshold.
Optionally, the beautification rule has multiple priority levels；It is described to the beautification rule be adjusted including：
The minimum beautification rule of removal priority level from preset beautification rule, and/or retain priority level higher than pre-
If the beautification rule of rank.
Optionally, described to judge whether live state meets live streaming regularization condition, it is to be adjusted to the beautification rule
It is whole to further include：
First one or more objective functions of live streaming application are adjusted, whether still to judge the live state after adjustment
It meets live streaming regularization condition, is adjusted to the beautification rule.
Optionally, the objective function includes video flowing acquisition function and/or present displaying function.
Optionally, described pair live streaming application one or more objective functions be adjusted including：
The acquisition frame rate of video flowing is reduced to adjusted value by current value；
Wherein, there are one the adjusted values or multiple, when the adjusted value has multiple, the acquisition frame rate of video flowing is dropped
Down to the adjusted value with current value difference minimum.
Optionally, described pair live streaming application one or more objective functions be adjusted including：
By the showroom of present every increasing to adjusted value by current value；
Wherein, there are one the adjusted values or multiple, when the adjusted value has multiple, by the showroom of present every increase
To the adjusted value with current value difference minimum.
Another aspect according to the present invention provides a kind of realization device of live streaming, including：
Beautify unit, is suitable for during live streaming, the video flowing of acquisition is beautified by preset beautification rule, it will be beautiful
Video stream after change is to direct broadcast server；
Adjustment unit is then to be carried out to beautification rule suitable for judging whether live state meets live streaming regularization condition
Adjustment.
Optionally, the beautification rule includes as follows one or more：
Shape of face adjustment rule, nose type adjustment rule, lip adjustment rule, chin adjustment rule, forehead adjustment rule, eye distance
Adjustment rule, camber adjustment rule, canthus adjustment rule and colour of skin adjustment rule.
Optionally, the adjustment unit is suitable for obtaining the resource service condition of live streaming terminal；It is used according to the resource of acquisition
Situation and preset resource threshold judge whether to meet live streaming regularization condition.
Optionally, the beautification rule has multiple priority levels；
The adjustment unit is suitable for the beautification rule that removal priority level is minimum from preset beautification rule, and/or protects
Stay beautification rule of the priority level higher than pre-set level.
Optionally, the adjustment unit judges suitable for being first adjusted to one or more objective functions of live streaming application
Whether the live state after adjustment still meets live streaming regularization condition, is, is adjusted to the beautification rule.
Optionally, the objective function includes video flowing acquisition function and/or present displaying function.
Optionally, the adjustment unit, suitable for the acquisition frame rate of video flowing is reduced to adjusted value by current value；Wherein,
The adjusted value there are one or it is multiple, when the adjusted value has multiple, the acquisition frame rate of video flowing is reduced to and current value
The adjusted value of difference minimum.
Optionally, the adjustment unit, suitable for by the showroom of present every increasing to adjusted value by current value；Wherein, institute
State adjusted value there are one or it is multiple, when the adjusted value has multiple, by the showroom of present every increasing to and current value difference
Minimum adjusted value.
Another aspect according to the present invention provides a kind of intelligent terminal, including：Processor；And it is arranged to store
The memory of computer executable instructions, the executable instruction make the processor execute such as any of the above-described institute when executed
The method stated.
According to the present invention in another aspect, providing a kind of computer readable storage medium, wherein it is described computer-readable
The one or more programs of storage medium storage, one or more of programs when being executed by a processor, are realized as any of the above-described
The method.
It can be seen from the above, technical scheme of the present invention, by the way that during live streaming, preset U.S. is pressed to the video flowing of acquisition
Change rule to be beautified, the U.S. face etc. that the mode of video stream to direct broadcast server after beautification is realized to main broadcaster is needed
It asks, further through judging whether live state meets live streaming regularization condition, is, the mode being adjusted to beautification rule ensure that
The stability of beautification.It that is, providing a kind of means for improving and quality being broadcast live, while can also ensure stability, meet
The demand of live streaming user, but also viewer can obtain small, the smooth viewing experience that rises and falls.
Above description is only the general introduction of technical solution of the present invention, in order to better understand the technical means of the present invention,
And can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can
It is clearer and more comprehensible, below the special specific implementation mode for lifting the present invention.
Description of the drawings
By reading the detailed description of hereafter preferred embodiment, various other advantages and benefit are common for this field
Technical staff will become clear.Attached drawing only for the purpose of illustrating preferred embodiments, and is not considered as to the present invention
Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings：
Fig. 1 shows a kind of flow diagram of the implementation method of live streaming according to an embodiment of the invention；
Fig. 2 shows a kind of structural schematic diagrams of the realization device of live streaming according to an embodiment of the invention；
Fig. 3 shows the structural schematic diagram of intelligent terminal according to an embodiment of the invention；
Fig. 4 shows the structural schematic diagram of computer readable storage medium according to an embodiment of the invention.
Specific implementation mode
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Completely it is communicated to those skilled in the art.
Fig. 1 shows a kind of flow diagram of the implementation method of live streaming according to an embodiment of the invention.Such as Fig. 1 institutes
Show, this method includes：
Step S110 is beautified the video flowing of acquisition by preset beautification rule, during live streaming after beautification
Video stream to direct broadcast server.
In the present embodiment, the mode beautified to image with reference to the application such as U.S. face camera, is applied to live scene,
U.S. face can be carried out to main broadcaster, is replaced etc. processing to background, and user is attracted to pay close attention to main broadcaster.
However, also bringing along some problems in this way；For example, the application such as U.S. face camera is often only needed to individual or several figures
As being handled, and the beautification for live video stream then needs to handle continuous multiple image.It is undoubtedly in this way and disappears
A large amount of computing resource is consumed, and many main broadcasters select to be broadcast live with mobile phone, such resource cannot meet live streaming demand, instead
Live streaming quality can be reduced.Therefore, it is handled, can specifically be executed as follows for such situation in the present embodiment
Step.
Step S120, judges whether live state meets live streaming regularization condition, is, is adjusted to beautification rule.
In this way, by being adjusted to beautification rule, certain balance can be sought in performance and beautification quality, ensured
The quality of live video stream avoids generating situations such as interim card is fuzzy.
As it can be seen that method shown in FIG. 1, by during live streaming, to the video flowing of acquisition by preset beautification it is regular into
The mode of video stream to direct broadcast server after beautification will be realized the demands such as the U.S. face of main broadcaster by row beautification, further through
Judge whether live state meets live streaming regularization condition, be, the stabilization of beautification is ensure that the mode that beautification rule is adjusted
Property.It that is, providing a kind of means for improving and quality being broadcast live, while can also ensure stability, meet live streaming user
Demand, but also viewer can obtain small, the smooth viewing experience that rises and falls.
In one embodiment of the invention, in the above method, beautification rule includes as follows one or more：Shape of face tune
Whole rule, nose type adjustment rule, lip adjustment rule, chin adjustment rule, forehead adjustment rule, eye distance adjustment rule, camber
Adjustment rule, canthus adjustment rule and colour of skin adjustment rule.
Examples of some beautification rules are given in the present embodiment, such as user thinks oneself there is baby's fertilizer, it can be with
Carry out thin face；Think that face is integrally bigger than normal, small face can be beautified into；Eye distance is turned down, eyebrow is repaiied it is thin etc..These beautification rules can
Being realized based on face recognition algorithms, for example, identifying several characteristic points of face, carried out based on these characteristic points beautiful
Change.
In one embodiment of the invention, in the above method, judge whether live state meets live streaming regularization condition packet
It includes：Obtain the resource service condition of live streaming terminal；Judged whether according to the resource service condition of acquisition and preset resource threshold
Meet live streaming regularization condition.
Here resource can be the hardware resources such as CPU, memory, GPU, and specific resource service condition can be a tool
The numerical value of body, such as occupy 100M memories；Can also be occupancy, such as the occupancy of CPU reaches 90%.It needs especially to say
Bright, resource service condition here can the aggregate resource service condition of terminal be broadcast live, rather than application is broadcast live to straight
The resource service condition of terminal is broadcast, because usually live streaming application can not interfere the operation of other application, it is of course also possible at interface
Middle prompt user closes unnecessary other application.
Specifically, resource threshold can be that live streaming application is preset, can also be that main broadcaster voluntarily adjusts.
In one embodiment of the invention, in the above method, beautification rule has multiple priority levels；To beautification rule into
Row adjusts：The minimum beautification rule of removal priority level from preset beautification rule, and/or retain priority level and be higher than
The beautification rule of pre-set level.
Just think, if user such as has selected small face, has plucked eyebrows at the beautification rule, if that will all removals of beautification rule,
It is exactly no longer to handle video flowing, then consequence is exactly to watch user to find that the face of main broadcaster becomes larger suddenly, this is serious shadow
User experience is rung, the loss for being difficult to retrieve all is caused to main broadcaster and viewing user.Therefore, beautification rule can be divided into multiple
Priority level can only remove the minimum U.S. of priority level if user has selected multiple priority levels in each adjustment
Change rule.
And if user has only selected a kind of beautification rule, or after repeatedly adjusting, a kind of only remaining beautification
The priority level of rule, these beautification rules is again very high, if be adjusted to it, it may appear that above-mentioned to seriously affect user experience
The case where, beautification rule can not be adjusted in this case, that is, retain beautification of the priority level higher than pre-set level and advise
Then.
In one embodiment of the invention, in the above method, judge whether live state meets live streaming regularization condition, be
Then beautification rule is adjusted and further includes：First one or more objective functions of live streaming application are adjusted, judge to adjust
Whether live state afterwards still meets live streaming regularization condition, is, is adjusted to beautification rule.
Some main broadcasters more look at beautification demand sometimes, in this case, are directly adjusted to beautification rule, real
The wish of user is violated on border, it is therefore desirable to which seeking other can ensure that the mode that stability is broadcast live in the present embodiment can
It is realized in a manner of applying other functions by adjusting live streaming, it is specifically, in one embodiment of the invention, above-mentioned
In method, objective function includes video flowing acquisition function and/or present displaying function.
Video flowing acquisition can undoubtedly consume a large amount of computing resources, and one is easy ignored point and is, the displaying of present needs
It to be rendered using GPU, it can be considered to be adjusted to present displaying function, reduce the consumption of GPU, it thus can be with
Certain resource is saved for beautifying to video flowing.The specific example of two adjustment is shown below.
In one embodiment of the invention, in the above method, one or more objective functions of live streaming application are carried out
Adjustment includes：The acquisition frame rate of video flowing is reduced to adjusted value by current value；Wherein, there are one adjusted values or multiple, work as tune
When whole value has multiple, the acquisition frame rate of video flowing is reduced to the adjusted value with current value difference minimum.
For example, multiple shelves are arranged for acquisition frame rate, acquisition frame rate is respectively 25 frames/second, 20 frames/second, 15 frames/second and 10
Frame/second.When reducing frame per second, acquisition frame rate is reduced to 20 frames/second, 15 frames/second and 10 frames/second by 25 frames/second successively.If
It reduces and once just no longer meets live streaming regularization condition, then there is no need to reduce again；If still meeting live streaming regularization condition, just
It needs to be adjusted again.
Similarly, in one embodiment of the invention, in the above method, to one or more target work(of live streaming application
Can be adjusted including：By the showroom of present every increasing to adjusted value by current value；It is wherein, there are one adjusted values or multiple,
When adjusted value has it is multiple when, by the showroom of present every increasing to the adjusted value with current value difference minimum.For example, will for example
Showroom gradually increases to 5 seconds, 10 seconds etc. every by 1 second.
The specific implementation example being once broadcast live is shown below：The small red opening live streaming application of main broadcaster, before first having carried out
Phase is arranged, it is desirable to which, to oneself carrying out three kinds of thin face, whitening, canthus angulation change beautifications, acquisition frame rate is set as 25 frames/second, gift
Object showroom is divided into 1 second.Preset resource threshold is that GPU occupancy reaches 90%.After setting, it is small it is red proceed by it is straight
It broadcasts, viewing number at the beginning is seldom, and live streaming is very smooth.With the increase of live streaming time, viewing number is more and more, object of giving a present
People it is also more and more.Due to the long-play of application, the increase of resource consumption is also brought, GPU occupancy has reached 90%,
Live streaming regularization condition is triggered, first the acquisition frame rate of video flowing is reduced at this time, is being reduced to 10 frames/after the second, GPU is occupied
It is down to 85%, is no longer adjusted at this time.With live streaming time sustainable growth, adjustment is a dynamic process, subsequently due to
It cannot be further continued for reducing frame per second, then using increasing present showroom by the way of, both ensure that main broadcaster will appreciate which is watched
User and main broadcaster have carried out interaction, to give one's regards to it, also reduce resource consumption really.If above-mentioned adjustment all has reached pole
After limit, it is also necessary to be adjusted, then can be first no longer adjusted to canthus angle, turn off whitening function.Due to thin
The priority level of face is higher, cannot close, and main broadcaster's optimization can be prompted to have reached the limit, and live streaming matter may be reduced by continuing live streaming
Amount.It is small red at this time it is contemplated that closing direct broadcasting room is rested.
Fig. 2 shows a kind of structural schematic diagrams of the realization device of live streaming according to an embodiment of the invention.Such as Fig. 2 institutes
Show, the realization device 200 of live streaming includes：
Beautify unit 210, be suitable for during live streaming, the video flowing of acquisition is beautified by preset beautification rule,
By the video stream after beautification to direct broadcast server.
In the present embodiment, the mode beautified to image with reference to the application such as U.S. face camera, is applied to live scene,
U.S. face can be carried out to main broadcaster, is replaced etc. processing to background, and user is attracted to pay close attention to main broadcaster.
However, also bringing along some problems in this way；For example, the application such as U.S. face camera is often only needed to individual or several figures
As being handled, and the beautification for live video stream then needs to handle continuous multiple image.It is undoubtedly in this way and disappears
A large amount of computing resource is consumed, and many main broadcasters select to be broadcast live with mobile phone, such resource cannot meet live streaming demand, instead
Live streaming quality can be reduced.Therefore, it is handled in the present embodiment for such situation, it specifically can be single by adjustment
Member 220 executes following steps.
Adjustment unit 220 suitable for judging whether live state meets live streaming regularization condition is adjusted to beautification rule
It is whole.
In this way, by being adjusted to beautification rule, certain balance can be sought in performance and beautification quality, ensured
The quality of live video stream avoids generating situations such as interim card is fuzzy.
As it can be seen that device shown in Fig. 2, by during live streaming, to the video flowing of acquisition by preset beautification it is regular into
The mode of video stream to direct broadcast server after beautification will be realized the demands such as the U.S. face of main broadcaster by row beautification, further through
Judge whether live state meets live streaming regularization condition, be, the stabilization of beautification is ensure that the mode that beautification rule is adjusted
Property.It that is, providing a kind of means for improving and quality being broadcast live, while can also ensure stability, meet live streaming user
Demand, but also viewer can obtain small, the smooth viewing experience that rises and falls.
In one embodiment of the invention, in above-mentioned apparatus, beautification rule includes as follows one or more：Shape of face tune
Whole rule, nose type adjustment rule, lip adjustment rule, chin adjustment rule, forehead adjustment rule, eye distance adjustment rule, camber
Adjustment rule, canthus adjustment rule and colour of skin adjustment rule.
Examples of some beautification rules are given in the present embodiment, such as user thinks oneself there is baby's fertilizer, it can be with
Carry out thin face；Think that face is integrally bigger than normal, small face can be beautified into；Eye distance is turned down, eyebrow is repaiied it is thin etc..These beautification rules can
Being realized based on face recognition algorithms, for example, identifying several characteristic points of face, carried out based on these characteristic points beautiful
Change.
In one embodiment of the invention, in above-mentioned apparatus, adjustment unit 220 is suitable for obtaining the resource of live streaming terminal
Service condition；Judged whether to meet live streaming regularization condition according to the resource service condition of acquisition and preset resource threshold.
Here resource can be the hardware resources such as CPU, memory, GPU, and specific resource service condition can be a tool
The numerical value of body, such as occupy 100M memories；Can also be occupancy, such as the occupancy of CPU reaches 90%.It needs especially to say
Bright, resource service condition here can the aggregate resource service condition of terminal be broadcast live, rather than application is broadcast live to straight
The resource service condition of terminal is broadcast, because usually live streaming application can not interfere the operation of other application, it is of course also possible at interface
Middle prompt user closes unnecessary other application.
Specifically, resource threshold can be that live streaming application is preset, can also be that main broadcaster voluntarily adjusts.
In one embodiment of the invention, in above-mentioned apparatus, beautification rule has multiple priority levels；Adjustment unit 220,
The beautification rule minimum suitable for the removal priority level from preset beautification rule, and/or retain priority level and be higher than default grade
Other beautification rule.
Just think, if user such as has selected small face, has plucked eyebrows at the beautification rule, if that will all removals of beautification rule,
It is exactly no longer to handle video flowing, then consequence is exactly to watch user to find that the face of main broadcaster becomes larger suddenly, this is serious shadow
User experience is rung, the loss for being difficult to retrieve all is caused to main broadcaster and viewing user.Therefore, beautification rule can be divided into multiple
Priority level can only remove the minimum U.S. of priority level if user has selected multiple priority levels in each adjustment
Change rule.
And if user has only selected a kind of beautification rule, or after repeatedly adjusting, a kind of only remaining beautification
The priority level of rule, these beautification rules is again very high, if be adjusted to it, it may appear that above-mentioned to seriously affect user experience
The case where, beautification rule can not be adjusted in this case, that is, retain beautification of the priority level higher than pre-set level and advise
Then.
In one embodiment of the invention, in above-mentioned apparatus, adjustment unit 220 is suitable for first to one of live streaming application
Or multiple objective functions are adjusted, and judge whether the live state after adjustment still meets live streaming regularization condition, are then to U.S.
Change rule to be adjusted.
Some main broadcasters more look at beautification demand sometimes, in this case, are directly adjusted to beautification rule, real
The wish of user is violated on border, it is therefore desirable to which seeking other can ensure that the mode that stability is broadcast live in the present embodiment can
It is realized in a manner of applying other functions by adjusting live streaming, it is specifically, in one embodiment of the invention, above-mentioned
In device, objective function includes video flowing acquisition function and/or present displaying function.
Video flowing acquisition can undoubtedly consume a large amount of computing resources, and one is easy ignored point and is, the displaying of present needs
It to be rendered using GPU, it can be considered to be adjusted to present displaying function, reduce the consumption of GPU, it thus can be with
Certain resource is saved for beautifying to video flowing.The specific example of two adjustment is shown below.
In one embodiment of the invention, in above-mentioned apparatus, adjustment unit 220 is suitable for the acquisition frame rate of video flowing
Adjusted value is reduced to by current value；Wherein, adjusted value there are one or it is multiple, when adjusted value has it is multiple when, by the acquisition of video flowing
Frame per second is reduced to the adjusted value with current value difference minimum.
For example, multiple shelves are arranged for acquisition frame rate, acquisition frame rate is respectively 25 frames/second, 20 frames/second, 15 frames/second and 10
Frame/second.When reducing frame per second, acquisition frame rate is reduced to 20 frames/second, 15 frames/second and 10 frames/second by 25 frames/second successively.If
It reduces and once just no longer meets live streaming regularization condition, then there is no need to reduce again；If still meeting live streaming regularization condition, just
It needs to be adjusted again.
Similarly, in one embodiment of the invention, in above-mentioned apparatus, adjustment unit 220 is suitable for the displaying of present
Interval increases to adjusted value by current value；Wherein, adjusted value there are one or it is multiple, when adjusted value has it is multiple when, by the exhibition of present
Show that interval increases to the adjusted value with current value difference minimum.For example, by showroom such as every by gradually increase within 1 second 5 seconds,
10 seconds etc..
In conclusion technical scheme of the present invention, by the way that during live streaming, preset beautification is pressed to the video flowing of acquisition
Rule is beautified, and the mode of video stream to direct broadcast server after beautification will be realized to the demands such as the U.S. face of main broadcaster,
Further through judging whether live state meets live streaming regularization condition, it is that the mode being adjusted to beautification rule ensure that beautification
Stability.It that is, providing a kind of means for improving and quality being broadcast live, while can also ensure stability, meet straight
The demand of broadcasting user, but also viewer can obtain small, the smooth viewing experience that rises and falls.
It should be noted that：
Algorithm and display be not inherently related to any certain computer, virtual bench or miscellaneous equipment provided herein.
Various fexible units can also be used together with teaching based on this.As described above, it constructs required by this kind of device
Structure be obvious.In addition, the present invention is not also directed to any certain programmed language.It should be understood that can utilize various
Programming language realizes the content of invention described herein, and the description done above to language-specific is to disclose this hair
Bright preferred forms.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention
Example can be put into practice without these specific details.In some instances, well known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this description.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of each inventive aspect,
Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention：It is i.e. required to protect
Shield the present invention claims the more features of feature than being expressly recited in each claim.More precisely, as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following specific implementation mode are expressly incorporated in the specific implementation mode, wherein each claim itself
All as a separate embodiment of the present invention.
Those skilled in the art, which are appreciated that, to carry out adaptively the module in the equipment in embodiment
Change and they are arranged in the one or more equipment different from the embodiment.It can be the module or list in embodiment
Member or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement or
Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it may be used any
Combination is disclosed to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so to appoint
Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification (including adjoint power
Profit requires, abstract and attached drawing) disclosed in each feature can be by providing the alternative features of identical, equivalent or similar purpose come generation
It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included certain features rather than other feature, but the combination of the feature of different embodiments means in of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
One of meaning mode can use in any combination.
The all parts embodiment of the present invention can be with hardware realization, or to run on one or more processors
Software module realize, or realized with combination thereof.It will be understood by those of skill in the art that can use in practice
Some in the realization device of microprocessor or digital signal processor (DSP) to realize live streaming according to the ... of the embodiment of the present invention
Or some or all functions of whole components.The present invention is also implemented as one for executing method as described herein
Partly or completely equipment or program of device (for example, computer program and computer program product).Such realization is originally
The program of invention can may be stored on the computer-readable medium, or can be with the form of one or more signal.In this way
Signal can download and obtain from internet website, either provide on carrier signal or provide in any other forms.
For example, Fig. 3 shows the structural schematic diagram of intelligent terminal according to an embodiment of the invention.The intelligent terminal packet
It includes processor 310 and is arranged to the memory 320 of storage computer executable instructions (computer readable program code).Storage
Device 320 can be such as flash memory, EEPROM (electrically erasable programmable read-only memory), EPROM, hard disk or ROM etc
Electronic memory.Memory 320 has computer-readable program of the storage for executing any method and step in the above method
The memory space 330 of code 331.For example, the memory space 330 for storing computer readable program code may include difference
For realizing each computer readable program code 331 of the various steps in above method.Computer readable program code
331 can read or be written to the production of this one or more computer program from one or more computer program product
In product.These computer program products include such as hard disk, and the program code of compact-disc (CD), storage card or floppy disk etc carries
Body.Such computer program product is usually the computer readable storage medium described in such as Fig. 4.Fig. 4 is shown according to this
A kind of structural schematic diagram of the computer readable storage medium of invention one embodiment.The computer readable storage medium 400 is deposited
The computer readable program code 331 for executing steps of a method in accordance with the invention is contained, it can be by the place of intelligent terminal 300
It manages device 310 to read, when computer readable program code 331 is run by intelligent terminal 300, the intelligent terminal 300 is caused to execute
Each step in method described above, specifically, the computer-readable journey of the computer-readable recording medium storage
Sequence code 331 can execute method shown in any of the above-described embodiment.Computer readable program code 331 can be with appropriate shape
Formula is compressed.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and ability
Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims,
Any reference mark between bracket should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not
Element or step listed in the claims.Word "a" or "an" before element does not exclude the presence of multiple such
Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real
It is existing.In the unit claims listing several devices, several in these devices can be by the same hardware branch
To embody.The use of word first, second, and third does not indicate that any sequence.These words can be explained and be run after fame
Claim.
Embodiment of the invention discloses that A1, a kind of implementation method of live streaming, including：
During live streaming, the video flowing of acquisition is beautified by preset beautification rule, by the video flowing after beautification
It is sent to direct broadcast server；
Judge whether live state meets live streaming regularization condition, be, the beautification rule is adjusted.
A2, the method as described in A1, wherein the beautification rule includes as follows one or more：
Shape of face adjustment rule, nose type adjustment rule, lip adjustment rule, chin adjustment rule, forehead adjustment rule, eye distance
Adjustment rule, camber adjustment rule, canthus adjustment rule and colour of skin adjustment rule.
A3, the method as described in A1, wherein described to judge whether live state meets live streaming regularization condition and include：
Obtain the resource service condition of live streaming terminal；
Judged whether to meet live streaming regularization condition according to the resource service condition of acquisition and preset resource threshold.
A4, the method as described in A1, wherein the beautification rule has multiple priority levels；It is described regular to the beautification
Be adjusted including：
The minimum beautification rule of removal priority level from preset beautification rule, and/or retain priority level higher than pre-
If the beautification rule of rank.
A5, the method as described in A1, wherein it is described to judge whether live state meets live streaming regularization condition, it is then to institute
It states beautification rule and is adjusted and further include：
First one or more objective functions of live streaming application are adjusted, whether still to judge the live state after adjustment
It meets live streaming regularization condition, is adjusted to the beautification rule.
A6, the method as described in A5, wherein the objective function includes video flowing acquisition function and/or present displaying work(
Energy.
A7, the method as described in A6, wherein one or more objective functions of described pair of live streaming application are adjusted packet
It includes：
The acquisition frame rate of video flowing is reduced to adjusted value by current value；
Wherein, there are one the adjusted values or multiple, when the adjusted value has multiple, the acquisition frame rate of video flowing is dropped
Down to the adjusted value with current value difference minimum.
A8, the method as described in A6, wherein one or more objective functions of described pair of live streaming application are adjusted packet
It includes：
By the showroom of present every increasing to adjusted value by current value；
Wherein, there are one the adjusted values or multiple, when the adjusted value has multiple, by the showroom of present every increase
To the adjusted value with current value difference minimum.
The embodiment of the present invention also discloses B9, a kind of realization device of live streaming, including：
Beautify unit, is suitable for during live streaming, the video flowing of acquisition is beautified by preset beautification rule, it will be beautiful
Video stream after change is to direct broadcast server；
Adjustment unit is then to be carried out to beautification rule suitable for judging whether live state meets live streaming regularization condition
Adjustment.
B10, the device as described in B9, wherein the beautification rule includes as follows one or more：
Shape of face adjustment rule, nose type adjustment rule, lip adjustment rule, chin adjustment rule, forehead adjustment rule, eye distance
Adjustment rule, camber adjustment rule, canthus adjustment rule and colour of skin adjustment rule.
B11, the device as described in B9, wherein
The adjustment unit is suitable for obtaining the resource service condition of live streaming terminal；According to the resource service condition of acquisition and
Preset resource threshold judges whether to meet live streaming regularization condition.
B12, the device as described in B9, wherein the beautification rule has multiple priority levels；
The adjustment unit is suitable for the beautification rule that removal priority level is minimum from preset beautification rule, and/or protects
Stay beautification rule of the priority level higher than pre-set level.
B13, the device as described in B9, wherein
The adjustment unit, suitable for being first adjusted to one or more objective functions of live streaming application, after judging adjustment
Live state whether still meet live streaming regularization condition, be to be adjusted to the beautification rule.
B14, the device as described in B13, wherein the objective function includes video flowing acquisition function and/or present displaying
Function.
B15, the device as described in B14, wherein
The adjustment unit, suitable for the acquisition frame rate of video flowing is reduced to adjusted value by current value；Wherein, the adjustment
There are one values or multiple, when the adjusted value has multiple, the acquisition frame rate of video flowing is reduced to and current value difference is minimum
Adjusted value.
B16, the device as described in B14, wherein
The adjustment unit, suitable for by the showroom of present every increasing to adjusted value by current value；Wherein, the adjusted value
There are one or it is multiple, when the adjusted value has multiple, by the showroom of present every increasing to the tune with current value difference minimum
Whole value.
The embodiment of the present invention also discloses C17, a kind of intelligent terminal, wherein the intelligent terminal includes：Processor；With
And it is arranged to the memory of storage computer executable instructions, the executable instruction when executed holds the processor
Method of the row as described in any one of A1-A8.
The embodiment of the present invention also discloses D18, a kind of computer readable storage medium, wherein described computer-readable
The one or more programs of storage medium storage, one or more of programs when being executed by a processor, are realized as appointed in A1-A8
Method described in one.
Claims (10)
1. a kind of implementation method of live streaming, including：
During live streaming, the video flowing of acquisition is beautified by preset beautification rule, by the video stream after beautification
To direct broadcast server；
Judge whether live state meets live streaming regularization condition, be, the beautification rule is adjusted.
2. the method for claim 1, wherein the beautification rule includes as follows one or more：
Shape of face adjustment rule, nose type adjustment rule, lip adjustment rule, chin adjustment rule, forehead adjustment rule, eye distance adjustment
Rule, camber adjustment rule, canthus adjustment rule and colour of skin adjustment rule.
3. the method for claim 1, wherein described judge whether live state meets live streaming regularization condition and include：
Obtain the resource service condition of live streaming terminal；
Judged whether to meet live streaming regularization condition according to the resource service condition of acquisition and preset resource threshold.
4. the method for claim 1, wherein the beautification rule has multiple priority levels；It is described that the beautification is advised
Then be adjusted including：
The minimum beautification rule of removal priority level from preset beautification rule, and/or retain priority level and be higher than default grade
Other beautification rule.
5. a kind of realization device of live streaming, including：
Beautify unit, is suitable for during live streaming, the video flowing of acquisition is beautified by preset beautification rule, after beautification
Video stream to direct broadcast server；
Adjustment unit suitable for judging whether live state meets live streaming regularization condition is adjusted to the beautification rule.
6. device as claimed in claim 5, wherein the beautification rule includes as follows one or more：
Shape of face adjustment rule, nose type adjustment rule, lip adjustment rule, chin adjustment rule, forehead adjustment rule, eye distance adjustment
Rule, camber adjustment rule, canthus adjustment rule and colour of skin adjustment rule.
7. device as claimed in claim 5, wherein
The adjustment unit is suitable for obtaining the resource service condition of live streaming terminal；According to the resource service condition of acquisition and preset
Resource threshold judge whether meet live streaming regularization condition.
8. device as claimed in claim 5, wherein the beautification rule has multiple priority levels；
The adjustment unit is suitable for the beautification rule that removal priority level is minimum from preset beautification rule, and/or retains excellent
First it is superior to the beautification rule of pre-set level.
9. a kind of intelligent terminal, wherein the intelligent terminal includes：Processor；And it is arranged to the executable finger of storage computer
The memory of order, the executable instruction make the processor execute as described in any one of claim 1-4 when executed
Method.
10. a kind of computer readable storage medium, wherein the computer-readable recording medium storage one or more program,
One or more of programs when being executed by a processor, realize the method as described in any one of claim 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810646507.2A CN108769825B (en) | 2018-06-21 | 2018-06-21 | Method and device for realizing live broadcast |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810646507.2A CN108769825B (en) | 2018-06-21 | 2018-06-21 | Method and device for realizing live broadcast |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108769825A true CN108769825A (en) | 2018-11-06 |
| CN108769825B CN108769825B (en) | 2020-11-06 |
Family
ID=63976176
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810646507.2A Active CN108769825B (en) | 2018-06-21 | 2018-06-21 | Method and device for realizing live broadcast |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108769825B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109474833A (en) * | 2018-11-28 | 2019-03-15 | 广州华多网络科技有限公司 | A kind of method of network direct broadcasting, relevant apparatus and system |
| CN113225572A (en) * | 2021-03-31 | 2021-08-06 | 北京达佳互联信息技术有限公司 | Method, device and system for displaying page elements in live broadcast room |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2874404A1 (en) * | 2013-11-15 | 2015-05-20 | LG Electronics, Inc. | Video display device and method for operating the same |
| US20150281789A1 (en) * | 2012-11-02 | 2015-10-01 | Koninklijke Philips N.V. | Communicating media related messages |
| CN106028138A (en) * | 2016-07-22 | 2016-10-12 | 乐视控股（北京）有限公司 | Live broadcast video processing method and device |
| CN106375789A (en) * | 2016-09-05 | 2017-02-01 | 腾讯科技（深圳）有限公司 | Media live broadcast method and device |
| CN106792034A (en) * | 2017-02-10 | 2017-05-31 | 深圳创维－Rgb电子有限公司 | Live method and mobile terminal is carried out based on mobile terminal |
| CN107147782A (en) * | 2017-04-27 | 2017-09-08 | 北京酷我科技有限公司 | A kind of method of the live recording of mobile phone |
| CN107295423A (en) * | 2016-04-05 | 2017-10-24 | 南京微特喜网络科技有限公司 | A kind of adaptive coding and transmission method live for mobile terminal video |
| CN107398072A (en) * | 2017-07-24 | 2017-11-28 | 腾讯科技（深圳）有限公司 | The display methods and device of game picture |
| CN107622234A (en) * | 2017-09-12 | 2018-01-23 | 广州酷狗计算机科技有限公司 | It is a kind of to show the method and apparatus for sprouting face present |
-
2018
- 2018-06-21 CN CN201810646507.2A patent/CN108769825B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150281789A1 (en) * | 2012-11-02 | 2015-10-01 | Koninklijke Philips N.V. | Communicating media related messages |
| EP2874404A1 (en) * | 2013-11-15 | 2015-05-20 | LG Electronics, Inc. | Video display device and method for operating the same |
| CN107295423A (en) * | 2016-04-05 | 2017-10-24 | 南京微特喜网络科技有限公司 | A kind of adaptive coding and transmission method live for mobile terminal video |
| CN106028138A (en) * | 2016-07-22 | 2016-10-12 | 乐视控股（北京）有限公司 | Live broadcast video processing method and device |
| CN106375789A (en) * | 2016-09-05 | 2017-02-01 | 腾讯科技（深圳）有限公司 | Media live broadcast method and device |
| CN106792034A (en) * | 2017-02-10 | 2017-05-31 | 深圳创维－Rgb电子有限公司 | Live method and mobile terminal is carried out based on mobile terminal |
| CN107147782A (en) * | 2017-04-27 | 2017-09-08 | 北京酷我科技有限公司 | A kind of method of the live recording of mobile phone |
| CN107398072A (en) * | 2017-07-24 | 2017-11-28 | 腾讯科技（深圳）有限公司 | The display methods and device of game picture |
| CN107622234A (en) * | 2017-09-12 | 2018-01-23 | 广州酷狗计算机科技有限公司 | It is a kind of to show the method and apparatus for sprouting face present |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109474833A (en) * | 2018-11-28 | 2019-03-15 | 广州华多网络科技有限公司 | A kind of method of network direct broadcasting, relevant apparatus and system |
| CN113225572A (en) * | 2021-03-31 | 2021-08-06 | 北京达佳互联信息技术有限公司 | Method, device and system for displaying page elements in live broadcast room |
| CN113225572B (en) * | 2021-03-31 | 2023-08-08 | 北京达佳互联信息技术有限公司 | Page element display method, device and system of live broadcasting room |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108769825B (en) | 2020-11-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106504278B (en) | High dynamic range tone mapping | |
| Rahman et al. | Retinex processing for automatic image enhancement | |
| CN109040576A (en) | The method and system of camera control and image procossing with the window based on multiframe counted for image data | |
| CN106303354B (en) | Face special effect recommendation method and electronic equipment | |
| US9953462B2 (en) | Augmented reality skin manager | |
| CN104517272B (en) | A kind of image enchancing method and device | |
| CN109427317A (en) | Screen brightness control method, device, terminal and computer readable storage medium | |
| CN104346136A (en) | Method and device for picture processing | |
| CN108769825A (en) | The implementation method and device of live streaming | |
| US10778932B2 (en) | User-specific video frame brightness filter | |
| CN106156240A (en) | Information processing method, information processor and subscriber equipment | |
| CN108765352B (en) | Image processing method and electronic device | |
| CN112887694B (en) | Video playing method, device and equipment and readable storage medium | |
| US20190053607A1 (en) | Electronic apparatus and method for providing makeup trial information thereof | |
| CN110110778A (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| CN112785488A (en) | Image processing method and device, storage medium and terminal | |
| EP3993383A1 (en) | Method and device for adjusting image quality, and readable storage medium | |
| CN106548763A (en) | A kind of method for displaying image and device and terminal | |
| CN108447026A (en) | Acquisition methods, terminal and the computer readable storage medium of U.S. face parameter attribute value | |
| US20200186764A1 (en) | Color-specific video frame brightness filter | |
| CN107786865B (en) | A kind for the treatment of method and apparatus of video frame | |
| CN109215031A (en) | The weighting guiding filtering depth of field rendering method extracted based on saliency | |
| CN114885212B (en) | Video generation method and device, storage medium and electronic equipment | |
| CN106558023B (en) | Medical image adjusting method and device | |
| CN110069641A (en) | Image processing method, device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |