CN108769825B - Method and device for realizing live broadcast - Google Patents
Method and device for realizing live broadcast Download PDFInfo
- Publication number
- CN108769825B CN108769825B CN201810646507.2A CN201810646507A CN108769825B CN 108769825 B CN108769825 B CN 108769825B CN 201810646507 A CN201810646507 A CN 201810646507A CN 108769825 B CN108769825 B CN 108769825B
- Authority
- CN
- China
- Prior art keywords
- live broadcast
- rule
- adjustment
- adjusting
- beautification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Abstract
The invention discloses a method and a device for realizing live broadcast, wherein the method comprises the following steps: in the live broadcast process, beautifying the collected video stream according to a preset beautifying rule, and sending the beautified video stream to a live broadcast server; and judging whether the live broadcast state meets live broadcast adjusting conditions or not, and if so, adjusting the beautifying rules. The acquired video stream is beautified according to the preset beautification rule in the live broadcast process, the beautified video stream is sent to the live broadcast server, the requirements of the main broadcast on beauty and the like are met, and the beautification stability is ensured by judging whether the live broadcast state meets the live broadcast adjustment condition or not and adjusting the beautification rule if the beautification rule meets the live broadcast adjustment condition. That is to say, provide a means of improving live broadcast quality, can also guarantee stability simultaneously, satisfied live broadcast user's demand, also make the viewer can obtain the little, smooth viewing experience of fluctuation.
Description
Technical Field
The invention relates to the field of network live broadcast, in particular to a live broadcast realization method and a live broadcast realization device.
Background
Currently, network live broadcasting has become a very popular interactive mode, a mode of becoming a main broadcast is very simple, and a user who becomes a live broadcast application through registration can use a mobile phone and other equipment to carry out live broadcast after authentication. The main form of live broadcasting is video live broadcasting, and the way of attracting users does not depend on the live broadcasting content itself, but also depends on the functions provided by the live broadcasting application, so how to attract the attention of users through technical improvement is a problem to be solved.
Disclosure of Invention
In view of the above, the present invention is proposed to provide a live broadcast implementation method and apparatus that overcomes or at least partially solves the above problems.
According to an aspect of the present invention, a method for implementing live broadcasting is provided, including:
in the live broadcast process, beautifying the collected video stream according to a preset beautifying rule, and sending the beautified video stream to a live broadcast server;
and judging whether the live broadcast state meets live broadcast adjusting conditions or not, and if so, adjusting the beautifying rules.
Optionally, the beautification rules include one or more of:
a face shape adjustment rule, a nose shape adjustment rule, a lip adjustment rule, a chin adjustment rule, a forehead adjustment rule, an eye distance adjustment rule, an eyebrow shape adjustment rule, an canthus adjustment rule, and a skin color adjustment rule.
Optionally, the determining whether the live broadcast state meets the live broadcast adjustment condition includes:
acquiring the resource use condition of a live broadcast terminal;
and judging whether the live broadcast adjustment condition is met according to the acquired resource use condition and a preset resource threshold value.
Optionally, the beautification rules have a plurality of priority levels; the adjusting the beautification rule comprises:
and removing the beautification rule with the lowest priority level from the preset beautification rules, and/or keeping the beautification rules with the priority levels higher than the preset level.
Optionally, the determining whether the live broadcast state meets a live broadcast adjustment condition, if yes, adjusting the beautification rule further includes:
firstly, one or more target functions of the live broadcast application are adjusted, whether the adjusted live broadcast state still meets the live broadcast adjustment condition is judged, and if yes, the beautification rule is adjusted.
Optionally, the target function comprises a video stream capture function and/or a gift presentation function.
Optionally, the adjusting one or more target functions of the live application includes:
reducing the acquisition frame rate of the video stream from a current value to an adjustment value;
and when the number of the adjustment values is multiple, reducing the acquisition frame rate of the video stream to the adjustment value with the minimum difference value with the current value.
Optionally, the adjusting one or more target functions of the live application includes:
increasing the presentation interval of the gift from the current value to the adjusted value;
wherein, the adjustment value has one or more, when there are a plurality of adjustment values, the display interval of the gift is increased to the adjustment value with the minimum difference with the current value.
According to another aspect of the present invention, there is provided a live broadcast implementing apparatus, including:
the beautifying unit is suitable for beautifying the collected video stream according to a preset beautifying rule in the live broadcast process and sending the beautified video stream to a live broadcast server;
and the adjusting unit is suitable for judging whether the live broadcast state meets the live broadcast adjusting condition or not, and if so, adjusting the beautifying rule.
Optionally, the beautification rules include one or more of:
a face shape adjustment rule, a nose shape adjustment rule, a lip adjustment rule, a chin adjustment rule, a forehead adjustment rule, an eye distance adjustment rule, an eyebrow shape adjustment rule, an canthus adjustment rule, and a skin color adjustment rule.
Optionally, the adjusting unit is adapted to obtain a resource usage of the live terminal; and judging whether the live broadcast adjustment condition is met according to the acquired resource use condition and a preset resource threshold value.
Optionally, the beautification rules have a plurality of priority levels;
the adjusting unit is suitable for removing the beautifying rule with the lowest priority level from the preset beautifying rules and/or reserving the beautifying rules with the priority levels higher than the preset levels.
Optionally, the adjusting unit is adapted to adjust one or more target functions of the live broadcast application, determine whether the adjusted live broadcast state still meets a live broadcast adjustment condition, and adjust the beautification rule if the adjusted live broadcast state still meets the live broadcast adjustment condition.
Optionally, the target function comprises a video stream capture function and/or a gift presentation function.
Optionally, the adjusting unit is adapted to reduce the acquisition frame rate of the video stream from a current value to an adjusted value; and when the number of the adjustment values is multiple, reducing the acquisition frame rate of the video stream to the adjustment value with the minimum difference value with the current value.
Optionally, the adjusting unit is adapted to increase the presentation interval of the gift from the current value to the adjusted value; wherein, the adjustment value has one or more, when there are a plurality of adjustment values, the display interval of the gift is increased to the adjustment value with the minimum difference with the current value.
According to still another aspect of the present invention, there is provided an intelligent terminal including: a processor; and a memory arranged to store computer executable instructions that, when executed, cause the processor to perform a method as any one of the above.
According to a further aspect of the invention, there is provided a computer readable storage medium, wherein the computer readable storage medium stores one or more programs which, when executed by a processor, implement a method as any one of the above.
According to the technical scheme, the acquired video stream is beautified according to the preset beautification rule in the live broadcast process, the beautified video stream is sent to the live broadcast server, the requirements of the anchor on beautifying and the like are met, and the beautification stability is ensured by judging whether the live broadcast state meets the live broadcast adjustment condition or not and adjusting the beautification rule if the beautification rule meets the live broadcast adjustment condition. That is to say, provide a means of improving live broadcast quality, can also guarantee stability simultaneously, satisfied live broadcast user's demand, also make the viewer can obtain the little, smooth viewing experience of fluctuation.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 shows a flow diagram of a method for implementing live broadcast according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a live broadcast implementation apparatus according to an embodiment of the present invention;
FIG. 3 shows a schematic structural diagram of an intelligent terminal according to one embodiment of the invention;
fig. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Fig. 1 shows a flow diagram of a method for implementing live broadcasting according to an embodiment of the present invention. As shown in fig. 1, the method includes:
and S110, in the live broadcast process, beautifying the acquired video stream according to a preset beautifying rule, and sending the beautified video stream to a live broadcast server.
In this embodiment, a way of beautifying an image by using an application such as a beauty camera is referred to, and the method is applied to a live broadcast scene, so that the processes of beautifying the appearance of a main broadcast, replacing a background and the like can be performed, and a user is attracted to pay attention to the main broadcast.
However, this also causes problems; for example, applications such as beauty cameras often need to process only a single or a few images, while beautifying live video streams requires processing of consecutive multi-frame images. Undoubtedly, a large amount of computing resources are consumed, and many anchor broadcasters choose to use mobile phones for live broadcasting, so that the resources cannot meet the live broadcasting requirement, and the live broadcasting quality is reduced. Therefore, processing is performed for such a case in the present embodiment, and specifically, the following steps may be performed.
And step S120, judging whether the live broadcast state meets the live broadcast adjusting condition, if so, adjusting the beautifying rule.
Therefore, by adjusting the beautification rules, certain balance can be found out on performance and beautification quality, the quality of the live video stream is ensured, and the situations of blockage, blur and the like are avoided.
It can be seen that, in the method shown in fig. 1, the acquired video stream is beautified according to the preset beautification rule in the live broadcast process, so that the beautified video stream is sent to the live broadcast server, and the needs of the anchor for beautifying the face and the like are met, and the beautification stability is ensured by adjusting the beautification rule by judging whether the live broadcast state meets the live broadcast adjustment condition. That is to say, provide a means of improving live broadcast quality, can also guarantee stability simultaneously, satisfied live broadcast user's demand, also make the viewer can obtain the little, smooth viewing experience of fluctuation.
In an embodiment of the present invention, in the method, the beautification rules include one or more of: a face shape adjustment rule, a nose shape adjustment rule, a lip adjustment rule, a chin adjustment rule, a forehead adjustment rule, an eye distance adjustment rule, an eyebrow shape adjustment rule, an canthus adjustment rule, and a skin color adjustment rule.
In the embodiment, some examples of beautifying rules are given, for example, a user feels that the user is fat and can lean the face; the whole face is large, and the face can be beautified into a small face; narrowing the eye distance, thinning the eyebrows, and the like. These beautification rules may be implemented based on a face recognition algorithm, for example, to recognize a number of feature points of a face, and beautify based on these feature points.
In an embodiment of the present invention, the determining whether the live broadcasting state meets the live broadcasting adjustment condition includes: acquiring the resource use condition of a live broadcast terminal; and judging whether the live broadcast adjustment condition is met according to the acquired resource use condition and a preset resource threshold value.
The resource may be hardware resources such as a CPU, a memory, and a GPU, and the specific resource usage may be a specific numerical value, for example, 100M of memory is occupied; or may be an occupancy rate, for example, the occupancy rate of the CPU reaches 90%. It should be noted that the resource usage here may be the total resource usage of the live terminal, and is not the resource usage of the live terminal by the live application, because the live application cannot interfere with the running of other applications, and of course, the user may also be prompted to close unnecessary other applications in the interface.
Specifically, the resource threshold may be preset by the live application or may be self-adjusted by the anchor.
In one embodiment of the present invention, the method wherein the beautification rules have a plurality of priority levels; adjusting the beautification rules comprises: and removing the beautification rule with the lowest priority level from the preset beautification rules, and/or keeping the beautification rules with the priority levels higher than the preset level.
Trying to think, if the user selects beautifying rules such as small face and eyebrow trimming, then if the beautifying rules are all removed, that is, the video stream is not processed any more, then the result is that the watching user finds that the face of the anchor becomes large suddenly, which seriously affects the user experience and causes irreparable loss to both the anchor and the watching user. Therefore, the beautification rules can be divided into a plurality of priority levels, and if a user selects the priority levels, only the beautification rule with the lowest priority level can be removed in each adjustment.
If the user only selects one beautifying rule or only one beautifying rule remains after multiple adjustments, the priority level of the beautifying rules is very high, and if the beautifying rules are adjusted, the situation that the user experience is seriously influenced can occur, and under the situation, the beautifying rules can not be adjusted, namely the beautifying rules with the priority level higher than the preset level are reserved.
In an embodiment of the present invention, in the method, determining whether the live broadcast state meets a live broadcast adjustment condition, if yes, adjusting the beautification rule further includes: firstly, one or more target functions of the live broadcast application are adjusted, whether the adjusted live broadcast state still meets the live broadcast adjustment condition is judged, and if yes, the beautification rule is adjusted.
Some anchor broadcasters look more at the beautification requirement sometimes, and in such a case, the beautification rules are directly adjusted, which is actually contrary to the will of the user, so that other ways that can ensure the stability of the live broadcast need to be sought.
The video stream collection undoubtedly consumes a large amount of computing resources, and one point that is easily ignored is that the display of the gift needs to be rendered by using the GPU, so that adjustment of the gift display function can be considered, the consumption of the GPU is reduced, and thus certain resources can be saved for beautifying the video stream. Two specific examples of adjustments are given below.
In an embodiment of the present invention, in the method, adjusting one or more target functions of the live application includes: reducing the acquisition frame rate of the video stream from a current value to an adjustment value; and when a plurality of adjustment values are provided, reducing the acquisition frame rate of the video stream to the adjustment value with the minimum difference value with the current value.
For example, a plurality of frames are set for the acquisition frame rates of 25 frames/second, 20 frames/second, 15 frames/second, and 10 frames/second, respectively. When the frame rate is reduced, the acquisition frame rate is reduced to 20 frames/second, 15 frames/second and 10 frames/second from 25 frames/second in sequence. If the live broadcast adjustment condition is not met any more after the live broadcast is reduced once, the live broadcast adjustment condition does not need to be reduced any more; if the live broadcast adjustment condition is still met, the adjustment is needed.
Similarly, in an embodiment of the present invention, the adjusting one or more target functions of the live application in the method includes: increasing the presentation interval of the gift from the current value to the adjusted value; and when the adjustment value is multiple, the display interval of the gift is increased to the adjustment value with the minimum difference value with the current value. For example, the presentation interval, for example, is gradually increased from 1 second to 5 seconds, 10 seconds, etc.
A specific implementation example of live broadcast is given below: the live broadcast application is opened by the anchor broadcast in a small red state, the early-stage setting is firstly carried out, three beautification modes of face thinning, whitening and canthus angle changing are hopefully carried out on the live broadcast application, the acquisition frame rate is set to be 25 frames/second, and the gift display interval is 1 second. The preset resource threshold is that the GPU occupies 90 percent. After the setting is finished, the live broadcast starts in red, the number of people watching at the beginning is small, and the live broadcast is smooth. With the increase of the live broadcast time, the number of people watching the live broadcast is more and more, and the number of people sending gifts is also more and more. Due to the fact that the application runs for a long time, resource consumption is increased, the GPU occupation reaches 90%, a live broadcast adjusting condition is triggered, the acquisition frame rate of the video stream is reduced at the moment, after the acquisition frame rate is reduced to 10 frames/second, the GPU occupation is reduced to 85%, and adjustment is not conducted at the moment. As the live time continues to increase, the adjustment is a dynamic process, and subsequently, as the frame rate cannot be reduced any more, the manner of increasing the gift display interval is adopted, so that the anchor can know which watching users interact with the anchor to make a love to the anchor, and the resource consumption is also reduced really. If the adjustment is needed after the adjustment reaches the limit, the angle of the canthus can not be adjusted and then the whitening function is closed. Because the priority level of the face thinning is higher and the face thinning cannot be closed, the anchor optimization can be prompted to reach the limit, and the quality of live broadcast can be reduced by continuing live broadcast. The reddish dots may then be considered to have a break off the live room.
Fig. 2 is a schematic structural diagram illustrating an apparatus for implementing live broadcasting according to an embodiment of the present invention. As shown in fig. 2, the apparatus 200 for implementing live broadcasting includes:
and the beautifying unit 210 is suitable for beautifying the acquired video stream according to a preset beautifying rule in the live broadcast process and sending the beautified video stream to a live broadcast server.
In this embodiment, a way of beautifying an image by using an application such as a beauty camera is referred to, and the method is applied to a live broadcast scene, so that the processes of beautifying the appearance of a main broadcast, replacing a background and the like can be performed, and a user is attracted to pay attention to the main broadcast.
However, this also causes problems; for example, applications such as beauty cameras often need to process only a single or a few images, while beautifying live video streams requires processing of consecutive multi-frame images. Undoubtedly, a large amount of computing resources are consumed, and many anchor broadcasters choose to use mobile phones for live broadcasting, so that the resources cannot meet the live broadcasting requirement, and the live broadcasting quality is reduced. Therefore, in the present embodiment, processing is performed for such a case, and specifically, the following steps may be performed by the adjustment unit 220.
The adjusting unit 220 is adapted to determine whether the live broadcast status satisfies a live broadcast adjusting condition, and if so, adjust the beautification rule.
Therefore, by adjusting the beautification rules, certain balance can be found out on performance and beautification quality, the quality of the live video stream is ensured, and the situations of blockage, blur and the like are avoided.
It can be seen that, in the device shown in fig. 2, the acquired video stream is beautified according to the preset beautification rule in the live broadcast process, so that the beautified video stream is sent to the live broadcast server, and the needs of the anchor such as beauty are met, and the beautification stability is ensured by judging whether the live broadcast state meets the live broadcast adjustment condition, and if so, adjusting the beautification rule. That is to say, provide a means of improving live broadcast quality, can also guarantee stability simultaneously, satisfied live broadcast user's demand, also make the viewer can obtain the little, smooth viewing experience of fluctuation.
In an embodiment of the present invention, in the above apparatus, the beautification rules include one or more of: a face shape adjustment rule, a nose shape adjustment rule, a lip adjustment rule, a chin adjustment rule, a forehead adjustment rule, an eye distance adjustment rule, an eyebrow shape adjustment rule, an canthus adjustment rule, and a skin color adjustment rule.
In the embodiment, some examples of beautifying rules are given, for example, a user feels that the user is fat and can lean the face; the whole face is large, and the face can be beautified into a small face; narrowing the eye distance, thinning the eyebrows, and the like. These beautification rules may be implemented based on a face recognition algorithm, for example, to recognize a number of feature points of a face, and beautify based on these feature points.
In an embodiment of the present invention, in the apparatus, the adjusting unit 220 is adapted to obtain a resource usage of the live broadcast terminal; and judging whether the live broadcast adjustment condition is met according to the acquired resource use condition and a preset resource threshold value.
The resource may be hardware resources such as a CPU, a memory, and a GPU, and the specific resource usage may be a specific numerical value, for example, 100M of memory is occupied; or may be an occupancy rate, for example, the occupancy rate of the CPU reaches 90%. It should be noted that the resource usage here may be the total resource usage of the live terminal, and is not the resource usage of the live terminal by the live application, because the live application cannot interfere with the running of other applications, and of course, the user may also be prompted to close unnecessary other applications in the interface.
Specifically, the resource threshold may be preset by the live application or may be self-adjusted by the anchor.
In one embodiment of the present invention, the apparatus wherein the beautification rules have a plurality of priority levels; an adjusting unit 220 adapted to remove the beautification rule with the lowest priority level from the preset beautification rules and/or retain the beautification rules with the priority level higher than the preset level.
Trying to think, if the user selects beautifying rules such as small face and eyebrow trimming, then if the beautifying rules are all removed, that is, the video stream is not processed any more, then the result is that the watching user finds that the face of the anchor becomes large suddenly, which seriously affects the user experience and causes irreparable loss to both the anchor and the watching user. Therefore, the beautification rules can be divided into a plurality of priority levels, and if a user selects the priority levels, only the beautification rule with the lowest priority level can be removed in each adjustment.
If the user only selects one beautifying rule or only one beautifying rule remains after multiple adjustments, the priority level of the beautifying rules is very high, and if the beautifying rules are adjusted, the situation that the user experience is seriously influenced can occur, and under the situation, the beautifying rules can not be adjusted, namely the beautifying rules with the priority level higher than the preset level are reserved.
In an embodiment of the present invention, in the above apparatus, the adjusting unit 220 is adapted to adjust one or more target functions of the live broadcast application, determine whether the adjusted live broadcast status still satisfies the live broadcast adjusting condition, and adjust the beautification rule if the adjusted live broadcast status still satisfies the live broadcast adjusting condition.
Some anchor broadcasters look more at the beautification requirement sometimes, and in such a case, the beautification rules are directly adjusted, which is actually contrary to the will of the user, so that other ways that can ensure the stability of the live broadcast need to be sought.
The video stream collection undoubtedly consumes a large amount of computing resources, and one point that is easily ignored is that the display of the gift needs to be rendered by using the GPU, so that adjustment of the gift display function can be considered, the consumption of the GPU is reduced, and thus certain resources can be saved for beautifying the video stream. Two specific examples of adjustments are given below.
In an embodiment of the present invention, in the above apparatus, the adjusting unit 220 is adapted to reduce the frame rate of video stream acquisition from a current value to an adjusted value; and when a plurality of adjustment values are provided, reducing the acquisition frame rate of the video stream to the adjustment value with the minimum difference value with the current value.
For example, a plurality of frames are set for the acquisition frame rates of 25 frames/second, 20 frames/second, 15 frames/second, and 10 frames/second, respectively. When the frame rate is reduced, the acquisition frame rate is reduced to 20 frames/second, 15 frames/second and 10 frames/second from 25 frames/second in sequence. If the live broadcast adjustment condition is not met any more after the live broadcast is reduced once, the live broadcast adjustment condition does not need to be reduced any more; if the live broadcast adjustment condition is still met, the adjustment is needed.
Similarly, in an embodiment of the present invention, in the above apparatus, the adjusting unit 220 is adapted to increase the display interval of the gift from the current value to the adjusted value; and when the adjustment value is multiple, the display interval of the gift is increased to the adjustment value with the minimum difference value with the current value. For example, the presentation interval, for example, is gradually increased from 1 second to 5 seconds, 10 seconds, etc.
In summary, in the technical scheme of the present invention, the collected video stream is beautified according to the preset beautification rule in the live broadcast process, so that the beautified video stream is sent to the live broadcast server, thereby meeting the requirements of the anchor on beauty and the like, and the beautification stability is ensured by adjusting the beautification rule by judging whether the live broadcast state meets the live broadcast adjustment condition. That is to say, provide a means of improving live broadcast quality, can also guarantee stability simultaneously, satisfied live broadcast user's demand, also make the viewer can obtain the little, smooth viewing experience of fluctuation.
It should be noted that:
the algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose devices may be used with the teachings herein. The required structure for constructing such a device will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components in a live enabled device according to embodiments of the present invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
For example, fig. 3 shows a schematic structural diagram of an intelligent terminal according to an embodiment of the present invention. The intelligent terminal comprises a processor 310 and a memory 320 arranged to store computer executable instructions (computer readable program code). The memory 320 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. The memory 320 has a storage space 330 storing computer readable program code 331 for performing any of the method steps described above. For example, the storage space 330 for storing the computer readable program code may comprise respective computer readable program codes 331 for respectively implementing various steps in the above method. The computer readable program code 331 may be read from or written to one or more computer program products. These computer program products comprise a program code carrier such as a hard disk, a Compact Disc (CD), a memory card or a floppy disk. Such a computer program product is typically a computer readable storage medium such as described in fig. 4. Fig. 4 shows a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention. The computer readable storage medium 400 stores computer readable program code 331 for performing the steps of the method according to the present invention, which is readable by the processor 310 of the smart terminal 300 and when the computer readable program code 331 is executed by the smart terminal 300, causes the smart terminal 300 to perform the steps of the method described above, and in particular, the computer readable program code 331 stored by the computer readable storage medium may perform the method shown in any of the embodiments described above. The computer readable program code 331 may be compressed in a suitable form.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
The embodiment of the invention discloses A1 and a live broadcast implementation method, which comprises the following steps:
in the live broadcast process, beautifying the collected video stream according to a preset beautifying rule, and sending the beautified video stream to a live broadcast server;
and judging whether the live broadcast state meets live broadcast adjusting conditions or not, and if so, adjusting the beautifying rules.
A2, the method of A1, wherein the beautification rules include one or more of:
a face shape adjustment rule, a nose shape adjustment rule, a lip adjustment rule, a chin adjustment rule, a forehead adjustment rule, an eye distance adjustment rule, an eyebrow shape adjustment rule, an canthus adjustment rule, and a skin color adjustment rule.
A3, the method as in a1, wherein the determining whether the live broadcast state meets the live broadcast adjustment condition includes:
acquiring the resource use condition of a live broadcast terminal;
and judging whether the live broadcast adjustment condition is met according to the acquired resource use condition and a preset resource threshold value.
A4, the method of A1, wherein the beautification rules have a plurality of priority levels; the adjusting the beautification rule comprises:
and removing the beautification rule with the lowest priority level from the preset beautification rules, and/or keeping the beautification rules with the priority levels higher than the preset level.
A5, the method as in a1, wherein the determining whether the live broadcast status meets live broadcast adjustment conditions, if yes, adjusting the beautification rule further includes:
firstly, one or more target functions of the live broadcast application are adjusted, whether the adjusted live broadcast state still meets the live broadcast adjustment condition is judged, and if yes, the beautification rule is adjusted.
A6, the method as recited in a5, wherein the target function comprises a video stream capture function and/or a gift presentation function.
A7, the method as in A6, wherein the adjusting one or more target functions of a live application comprises:
reducing the acquisition frame rate of the video stream from a current value to an adjustment value;
and when the number of the adjustment values is multiple, reducing the acquisition frame rate of the video stream to the adjustment value with the minimum difference value with the current value.
A8, the method as in A6, wherein the adjusting one or more target functions of a live application comprises:
increasing the presentation interval of the gift from the current value to the adjusted value;
wherein, the adjustment value has one or more, when there are a plurality of adjustment values, the display interval of the gift is increased to the adjustment value with the minimum difference with the current value.
The embodiment of the invention also discloses B9 and a device for realizing live broadcast, which comprises:
the beautifying unit is suitable for beautifying the collected video stream according to a preset beautifying rule in the live broadcast process and sending the beautified video stream to a live broadcast server;
and the adjusting unit is suitable for judging whether the live broadcast state meets the live broadcast adjusting condition or not, and if so, adjusting the beautifying rule.
B10, the apparatus of B9, wherein the beautification rules include one or more of:
a face shape adjustment rule, a nose shape adjustment rule, a lip adjustment rule, a chin adjustment rule, a forehead adjustment rule, an eye distance adjustment rule, an eyebrow shape adjustment rule, an canthus adjustment rule, and a skin color adjustment rule.
B11, the device of B9, wherein,
the adjusting unit is suitable for acquiring the resource use condition of the live broadcast terminal; and judging whether the live broadcast adjustment condition is met according to the acquired resource use condition and a preset resource threshold value.
B12, the apparatus as in B9, wherein the beautification rules have a plurality of priority levels;
the adjusting unit is suitable for removing the beautifying rule with the lowest priority level from the preset beautifying rules and/or reserving the beautifying rules with the priority levels higher than the preset levels.
B13, the device of B9, wherein,
the adjusting unit is suitable for adjusting one or more target functions of the live broadcast application, judging whether the adjusted live broadcast state still meets the live broadcast adjusting condition, and if so, adjusting the beautification rule.
B14, the apparatus as in B13, wherein the target function comprises a video stream capture function and/or a gift presentation function.
B15, the device of B14, wherein,
the adjusting unit is suitable for reducing the acquisition frame rate of the video stream from a current value to an adjusting value; and when the number of the adjustment values is multiple, reducing the acquisition frame rate of the video stream to the adjustment value with the minimum difference value with the current value.
B16, the device of B14, wherein,
the adjusting unit is suitable for increasing the display interval of the gift to an adjusting value from a current value; wherein, the adjustment value has one or more, when there are a plurality of adjustment values, the display interval of the gift is increased to the adjustment value with the minimum difference with the current value.
The embodiment of the invention also discloses C17 and an intelligent terminal, wherein the intelligent terminal comprises: a processor; and a memory arranged to store computer executable instructions that, when executed, cause the processor to perform the method of any one of a 1-A8.
Embodiments of the invention also disclose D18, a computer readable storage medium, wherein the computer readable storage medium stores one or more programs which, when executed by a processor, implement the method as any one of a1-a 8.
Claims (14)
1. A method for realizing live broadcast comprises the following steps:
in the live broadcast process, beautifying the collected video stream according to a preset beautifying rule, and sending the beautified video stream to a live broadcast server;
judging whether the live broadcast state meets live broadcast adjusting conditions or not, and if so, adjusting the beautification rule;
wherein the beautification rules include one or more of:
a face shape adjustment rule, a nose shape adjustment rule, a lip adjustment rule, a chin adjustment rule, a forehead adjustment rule, an eye distance adjustment rule, an eyebrow shape adjustment rule, an canthus adjustment rule, and a skin color adjustment rule;
the judging whether the live broadcast state meets the live broadcast adjusting condition, if so, adjusting the beautifying rule further comprises:
firstly, one or more target functions of the live broadcast application are adjusted, whether the adjusted live broadcast state still meets the live broadcast adjustment condition is judged, and if yes, the beautification rule is adjusted.
2. The method of claim 1, wherein the determining whether the live status satisfies a live adjustment condition comprises:
acquiring the resource use condition of a live broadcast terminal;
and judging whether the live broadcast adjustment condition is met according to the acquired resource use condition and a preset resource threshold value.
3. The method of claim 1, wherein the beautification rules have a plurality of priority levels; the adjusting the beautification rule comprises:
and removing the beautification rule with the lowest priority level from the preset beautification rules, and/or keeping the beautification rules with the priority levels higher than the preset level.
4. The method of claim 3, wherein the target function comprises a video stream capture function and/or a gift presentation function.
5. The method of claim 4, wherein the adjusting one or more target functions of a live application comprises:
reducing the acquisition frame rate of the video stream from a current value to an adjustment value;
and when the number of the adjustment values is multiple, reducing the acquisition frame rate of the video stream to the adjustment value with the minimum difference value with the current value.
6. The method of claim 4, wherein the adjusting one or more target functions of a live application comprises:
increasing the presentation interval of the gift from the current value to the adjusted value;
wherein, the adjustment value has one or more, when there are a plurality of adjustment values, the display interval of the gift is increased to the adjustment value with the minimum difference with the current value.
7. An apparatus for implementing live broadcasting, comprising:
the beautifying unit is suitable for beautifying the collected video stream according to a preset beautifying rule in the live broadcast process and sending the beautified video stream to a live broadcast server;
the adjusting unit is suitable for judging whether the live broadcast state meets live broadcast adjusting conditions or not, and if so, adjusting the beautifying rules;
wherein the beautification rules include one or more of:
a face shape adjustment rule, a nose shape adjustment rule, a lip adjustment rule, a chin adjustment rule, a forehead adjustment rule, an eye distance adjustment rule, an eyebrow shape adjustment rule, an canthus adjustment rule, and a skin color adjustment rule;
the adjusting unit is suitable for adjusting one or more target functions of the live broadcast application, judging whether the adjusted live broadcast state still meets the live broadcast adjusting condition, and if so, adjusting the beautification rule.
8. The apparatus of claim 7, wherein,
the adjusting unit is suitable for acquiring the resource use condition of the live broadcast terminal; and judging whether the live broadcast adjustment condition is met according to the acquired resource use condition and a preset resource threshold value.
9. The apparatus of claim 7, wherein the beautification rules have a plurality of priority levels;
the adjusting unit is suitable for removing the beautifying rule with the lowest priority level from the preset beautifying rules and/or reserving the beautifying rules with the priority levels higher than the preset levels.
10. The apparatus of claim 9, wherein the target function comprises a video stream capture function and/or a gift presentation function.
11. The apparatus of claim 10, wherein,
the adjusting unit is suitable for reducing the acquisition frame rate of the video stream from a current value to an adjusting value; and when the number of the adjustment values is multiple, reducing the acquisition frame rate of the video stream to the adjustment value with the minimum difference value with the current value.
12. The apparatus of claim 10, wherein,
the adjusting unit is suitable for increasing the display interval of the gift to an adjusting value from a current value; wherein, the adjustment value has one or more, when there are a plurality of adjustment values, the display interval of the gift is increased to the adjustment value with the minimum difference with the current value.
13. An intelligent terminal, wherein, this intelligent terminal includes: a processor; and a memory arranged to store computer-executable instructions that, when executed, cause the processor to perform the method of any one of claims 1-6.
14. A computer readable storage medium, wherein the computer readable storage medium stores one or more programs which, when executed by a processor, implement the method of any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810646507.2A CN108769825B (en) | 2018-06-21 | 2018-06-21 | Method and device for realizing live broadcast |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810646507.2A CN108769825B (en) | 2018-06-21 | 2018-06-21 | Method and device for realizing live broadcast |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108769825A CN108769825A (en) | 2018-11-06 |
| CN108769825B true CN108769825B (en) | 2020-11-06 |
Family
ID=63976176
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810646507.2A Active CN108769825B (en) | 2018-06-21 | 2018-06-21 | Method and device for realizing live broadcast |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108769825B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109474833B (en) * | 2018-11-28 | 2020-11-27 | 广州华多网络科技有限公司 | Network live broadcast method, related device and system |
| CN113225572B (en) * | 2021-03-31 | 2023-08-08 | 北京达佳互联信息技术有限公司 | Page element display method, device and system of live broadcasting room |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2874404A1 (en) * | 2013-11-15 | 2015-05-20 | LG Electronics, Inc. | Video display device and method for operating the same |
| CN106028138A (en) * | 2016-07-22 | 2016-10-12 | 乐视控股（北京）有限公司 | Live broadcast video processing method and device |
| CN106375789A (en) * | 2016-09-05 | 2017-02-01 | 腾讯科技（深圳）有限公司 | Media live broadcast method and device |
| CN106792034A (en) * | 2017-02-10 | 2017-05-31 | 深圳创维－Rgb电子有限公司 | Live method and mobile terminal is carried out based on mobile terminal |
| CN107398072A (en) * | 2017-07-24 | 2017-11-28 | 腾讯科技（深圳）有限公司 | The display methods and device of game picture |
| CN107622234A (en) * | 2017-09-12 | 2018-01-23 | 广州酷狗计算机科技有限公司 | It is a kind of to show the method and apparatus for sprouting face present |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014068416A1 (en) * | 2012-11-02 | 2014-05-08 | Koninklijke Philips N.V. | Communicating media related messages |
| CN107295423B (en) * | 2016-04-05 | 2020-11-10 | 南京微特喜网络科技有限公司 | Self-adaptive coding and transmission method for mobile terminal video live broadcast |
| CN107147782B (en) * | 2017-04-27 | 2020-05-19 | 北京酷我科技有限公司 | Method for recording live broadcast of mobile phone |
-
2018
- 2018-06-21 CN CN201810646507.2A patent/CN108769825B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2874404A1 (en) * | 2013-11-15 | 2015-05-20 | LG Electronics, Inc. | Video display device and method for operating the same |
| CN106028138A (en) * | 2016-07-22 | 2016-10-12 | 乐视控股（北京）有限公司 | Live broadcast video processing method and device |
| CN106375789A (en) * | 2016-09-05 | 2017-02-01 | 腾讯科技（深圳）有限公司 | Media live broadcast method and device |
| CN106792034A (en) * | 2017-02-10 | 2017-05-31 | 深圳创维－Rgb电子有限公司 | Live method and mobile terminal is carried out based on mobile terminal |
| CN107398072A (en) * | 2017-07-24 | 2017-11-28 | 腾讯科技（深圳）有限公司 | The display methods and device of game picture |
| CN107622234A (en) * | 2017-09-12 | 2018-01-23 | 广州酷狗计算机科技有限公司 | It is a kind of to show the method and apparatus for sprouting face present |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108769825A (en) | 2018-11-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106303354B (en) | Face special effect recommendation method and electronic equipment | |
| US20190057723A1 (en) | Visualization of image themes based on image content | |
| CN109961453B (en) | Image processing method, device and equipment | |
| CN109729405B (en) | Video processing method and device, electronic equipment and storage medium | |
| CN109639982A (en) | A kind of image denoising method, device, storage medium and terminal | |
| CN109302628B (en) | Live broadcast-based face processing method, device, equipment and storage medium | |
| CN109040576A (en) | The method and system of camera control and image procossing with the window based on multiframe counted for image data | |
| CN112840376A (en) | Image processing method, device and equipment | |
| CN105898583B (en) | Image recommendation method and electronic equipment | |
| CN106507021A (en) | Method for processing video frequency and terminal device | |
| CN108109161B (en) | Video data real-time processing method and device based on self-adaptive threshold segmentation | |
| US20170286745A1 (en) | Electronic device and screen adjusting method based on condition of user's eye | |
| CN108769825B (en) | Method and device for realizing live broadcast | |
| CN111405339B (en) | Split screen display method, electronic equipment and storage medium | |
| CN108055581A (en) | Method, smart television and the storage medium of dynamic play TV programme | |
| US20160359937A1 (en) | Contextual video content adaptation based on target device | |
| CN112822550A (en) | Television terminal adjusting method and device and television terminal | |
| CN113709560B (en) | Video editing method, device, equipment and storage medium | |
| CN112785488A (en) | Image processing method and device, storage medium and terminal | |
| CN112887694B (en) | Video playing method, device and equipment and readable storage medium | |
| US11756506B2 (en) | Method and device for adjusting image quality, and readable storage medium | |
| CN113613030A (en) | Live broadcast control method and system and computer readable storage medium | |
| CN109788311B (en) | Character replacement method, electronic device, and storage medium | |
| CN111383289A (en) | Image processing method, image processing device, terminal equipment and computer readable storage medium | |
| CN113691737B (en) | Video shooting method and device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |