CN113613030A - Live broadcast control method and system and computer readable storage medium - Google Patents
Live broadcast control method and system and computer readable storage medium Download PDFInfo
- Publication number
- CN113613030A CN113613030A CN202110961325.6A CN202110961325A CN113613030A CN 113613030 A CN113613030 A CN 113613030A CN 202110961325 A CN202110961325 A CN 202110961325A CN 113613030 A CN113613030 A CN 113613030A
- Authority
- CN
- China
- Prior art keywords
- live broadcast
- zoom
- live
- zooming
- video data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
Abstract
The invention discloses a live broadcast control method, a system and a computer readable storage medium, wherein the method comprises the following steps: receiving a picture zooming adjustment request sent by a live client, wherein the picture zooming adjustment request comprises a target zooming multiple used for adjusting a camera; and acquiring live broadcast video data through the camera at the target zoom multiple, and sending the live broadcast video data to the live broadcast client. By zooming control of the camera, free zooming control of a live broadcast picture is achieved, the personalized requirement of online users for watching live broadcasts is met, and watching experience is improved.
Description
Technical Field
The present invention relates to the field of video data processing, and in particular, to a live broadcast control method, system, and computer-readable storage medium.
Background
When the user travels online, the user can watch the landscape from different angles on the viewing platform, and can also enjoy the scenery of the scenic spot by zooming the remote landscape through the telescope. For online users, the landscape can be watched through the existing landscape live broadcast platform, but the landscape live broadcast platform can only provide live broadcast pictures with fixed visual angles, the live broadcast pictures of the landscape cannot be subjected to zoom control, the zooming capability of the camera is insufficient, the omnibearing multi-visual-angle landscape live broadcast watching experience cannot be provided, different zooming requirements of multiple users cannot be met, and the online landscape watching experience of the users is poor.
Disclosure of Invention
In view of the defects in the prior art, the present application provides a live broadcast control method, system and computer-readable storage medium, which implement zoom control of a user on a live broadcast picture, better meet the demand of the user for watching live broadcast on line, and improve user experience.
In a first aspect, the present application provides a live broadcast control method, which is applied to a live broadcast server, and the method includes:
receiving a picture zooming adjustment request sent by a live client, wherein the picture zooming adjustment request comprises a target zooming multiple used for adjusting a camera;
responding to the image zooming adjustment request, and adjusting the current zooming multiple of the camera to the target zooming multiple;
acquiring live broadcast video data through a camera at the target zoom multiple;
and sending the live video data to the live client.
Optionally, the method further includes:
determining the zoom multiple range of the camera according to the shooting configuration parameters of the camera;
acquiring initial live video data through a camera at an initial zoom multiple, and determining the attribute type of the initial live video data;
determining a default zoom multiple matched with the attribute type from the zoom multiple range;
adjusting the camera from the initial zoom factor to the default zoom factor.
Optionally, the method further includes:
and sending the zoom multiple range, the default zoom multiple and the live video data to a live client.
Optionally, the determining a default zoom multiple matching the attribute type from the zoom multiple range includes:
sequentially adjusting the zoom multiples of the cameras from small to large according to each zoom multiple in the zoom multiple range, and acquiring corresponding test video data through the cameras at each zoom multiple;
taking the zoom multiple corresponding to the test video data meeting the preset definition in each test video data as a critical zoom multiple;
determining a sub zoom multiple range smaller than the critical zoom multiple from the zoom multiple range;
selecting any zoom factor from the sub zoom factor range as the default zoom factor.
Optionally, the receiving a picture scaling adjustment request sent by a live broadcast client includes:
receiving a reservation queuing request sent by the live broadcast client;
and determining the reservation control time of the live broadcast client according to the reservation queuing request, and receiving the picture zooming adjustment request within the reservation control time.
In a second aspect, the present application provides a live broadcast control method, which is applied to a live broadcast client, and the method includes:
generating a picture zooming adjustment request according to user input operation, wherein the picture zooming adjustment request comprises a target zooming multiple for adjusting the camera;
sending the picture zooming adjustment request to a live broadcast server;
and acquiring live broadcast video data from the live broadcast server, wherein the live broadcast video data is acquired by the camera at the target zoom multiple.
Optionally, before generating the screen zoom adjustment request according to the user input operation, the method further includes:
receiving a zoom multiple range and a default zoom multiple sent by the live broadcast server;
displaying the zoom multiple range and the default zoom multiple on a playing interface corresponding to the live video data;
and detecting the user input operation on the playing interface, wherein the user input operation is used for determining the target zoom multiple from the zoom multiple range.
Optionally, the user input operation includes a user reservation operation and a user adjustment operation;
the generating of the screen zoom adjustment request according to the user input operation includes:
generating a reservation queuing request according to the user reservation operation, and sending the reservation queuing request to the live broadcast server;
receiving reservation control time sent by the live broadcast server;
and generating the screen zooming adjustment request according to the user adjustment operation within the reserved control time.
Optionally, the method further includes: determining a digital zoom multiple range of the live broadcast client;
selecting a target digital zoom multiple within the digital zoom multiple range to adjust the live video data to obtain the live video data after digital zoom;
performing picture enhancement processing on the live video data subjected to digital zooming by adopting a time domain picture quality enhancement processing mode and/or a spatial domain picture quality enhancement processing mode;
and displaying the live video data subjected to the picture enhancement processing and subjected to the digital zooming on a playing interface of the live client.
In a third aspect, the present application provides a live broadcast control system, which includes a live broadcast server and a live broadcast client;
the live broadcast client is used for generating a picture zooming adjustment request according to user input operation and sending the picture zooming adjustment request to the live broadcast server, wherein the picture zooming adjustment request comprises a target zooming multiple for adjusting the camera;
the live broadcast server is used for receiving a picture zooming adjustment request sent by the live broadcast client, responding to the picture zooming adjustment request, adjusting the current zooming multiple of the camera to the target zooming multiple, acquiring live broadcast video data through the camera at the target zooming multiple, and sending the live broadcast video data to the live broadcast client;
and the live broadcast client is also used for acquiring the live broadcast video data from the live broadcast server.
In a fourth aspect, the present application provides a computer-readable storage medium comprising: which stores a computer program that, when run on a processor, performs any of the live control methods described above.
The application provides a live broadcast control method, a live broadcast control system and a computer readable storage medium, which are used for receiving a picture zooming adjustment request sent by a live broadcast client, wherein the picture zooming adjustment request comprises a target zooming multiple of a camera; responding to the image zooming adjustment request, and adjusting the current zooming multiple of the camera to the target zooming multiple; acquiring live broadcast video data through a camera at the target zoom multiple; and sending the live video data to the live client. By zooming control of the camera, free zooming control of live broadcast pictures is realized, the personalized requirement of online users for watching live broadcasts is met, and the online experience of watching live broadcasts is improved.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings required to be used in the embodiments will be briefly described below, and it should be understood that the following drawings only illustrate some embodiments of the present invention, and therefore should not be considered as limiting the scope of the present invention. Like components are numbered similarly in the various figures.
Fig. 1 shows a flow diagram of a live broadcast control method applied to a live broadcast server;
fig. 2 is a flow chart illustrating a live control method applied to a live client;
fig. 3 shows an interaction diagram among a camera, a live broadcast server and a live broadcast terminal;
fig. 4 shows a flow chart applied to a live control system.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
Hereinafter, the terms "including", "having", and their derivatives, which may be used in various embodiments of the present invention, are only intended to indicate specific features, numbers, steps, operations, elements, components, or combinations of the foregoing, and should not be construed as first excluding the existence of, or adding to, one or more other features, numbers, steps, operations, elements, components, or combinations of the foregoing.
Furthermore, the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not to be construed as indicating or implying relative importance.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which various embodiments of the present invention belong. The terms (such as those defined in commonly used dictionaries) should be interpreted as having a meaning that is consistent with their contextual meaning in the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein in various embodiments of the present invention.
Example 1
The embodiment of the application provides a live broadcast control method.
The following describes the live broadcast control method with reference to fig. 1 and 3.
The live broadcast control method provided in the embodiment of the present application is applied to the live broadcast server 100 in fig. 3, and as shown in fig. 1, the method includes:
s101, receiving a picture zooming adjustment request sent by a live client, wherein the picture zooming adjustment request comprises a target zooming multiple for adjusting a camera;
the live broadcast client may be the live broadcast client 200 in fig. 3, where the live broadcast client 200 sends a request for zoom adjustment of a picture to the live broadcast server 100, and the request for zoom adjustment of a live broadcast picture is made, where the zoom adjustment is optical zooming of the camera 300 shot in the live broadcast, and a user sends a request to control a shooting zoom multiple of the camera 300. The target zoom factor is the viewing factor that the user wants to adjust to. The live client 200 is a mobile terminal for watching live broadcast. The number of the live broadcast clients 200 is not limited, and the requirements of multiple users on zoom multiple control of the camera 300 can be met in sequence.
S102, responding to the image zooming adjustment request, and adjusting the current zooming multiple of the camera to the target zooming multiple;
specifically, the live broadcast server 100 responds to a screen zoom adjustment request sent by the live broadcast client 200, and adjusts the live broadcast video screen to a zoom display effect that the user wants to achieve. For example, a user live broadcasts on the line to watch landscape scenery, and when traveling off the line, the user can realize the overlook effect by means of the telescope, in this embodiment, the user changes the zoom factor of the camera 300 in the live broadcasts on the line, so as to realize the zoom-zoom shooting of remote scenery, and also realize the overlook effect of the remote scenery.
S103, acquiring live broadcast video data through the camera at the target zoom multiple;
and adjusting the camera to the zoom multiple by the live broadcast server to shoot according to the target zoom multiple which the user wants to adjust, and live broadcasting the shot content by adopting the zoom multiple. The live video data refers to video content shot by a camera in real time.
S104, sending the live video data to the live client.
In the prior art, the user can enjoy the live view on line only by the experience of viewing the live view on line, and can send a zoom adjustment request according to the needs of the user, and the live view video frame is adjusted to the display effect capable of meeting the watching needs of the user, so that the personalized needs of live watching are realized, and the experience of watching the live view is improved.
In a specific embodiment, the method further comprises:
determining the zoom multiple range of the camera according to the shooting configuration parameters of the camera;
acquiring initial live video data through a camera at an initial zoom multiple, and determining the attribute type of the initial live video data;
determining a default zoom multiple matched with the attribute type from the zoom multiple range;
adjusting the camera from the initial zoom factor to the default zoom factor.
Specifically, the shooting configuration parameters of the camera include: resolution of the camera, night vision capability, panoramic capability, zoom capability. The present embodiment has a requirement for the hardware capability of the camera, i.e., the resolution in the shooting configuration parameters thereof is not lower than 720P. The zoom multiple range of the camera is determined according to the shooting configuration parameters of the camera, and the specific zoom multiple range can be determined in advance according to the hardware capability of the applied camera. And determining the zoom multiple range of the camera, and enabling a user to select the zoom multiple range which can be reached by the camera. The camera can be selected according to the actual shooting requirement.
Secondly, determining the attribute type of the live video according to the initial live video data shot by the camera initially, wherein the attribute type is preset according to the actual shooting requirement, such as landscape live broadcast, city live broadcast and the like. And providing a default zoom multiple of the camera within the zoom multiple range of the camera for different attribute types. And then adjusting the zoom multiple of the camera to be a default zoom multiple so that the camera presents a live video picture with better effect for a live client when the camera initially presents the live picture or the live picture is not controlled by a user.
In addition, the live broadcast server also sends the zoom multiple range, the default zoom multiple and the live broadcast video data to a live broadcast client. Specifically, the live broadcast server sends a zoom multiple range, a default zoom multiple of the current live broadcast video and a live broadcast picture of live broadcast video data to the live broadcast client, wherein the zoom multiple range comprises a plurality of zoom multiples which can be selected by the live broadcast client.
In a specific embodiment, the determining a default zoom multiple matching the attribute type from the zoom multiple range includes:
sequentially adjusting the zoom multiples of the cameras from small to large according to each zoom multiple in the zoom multiple range, and acquiring corresponding test video data through the cameras at each zoom multiple;
taking the zoom multiple corresponding to the test video data meeting the preset definition in each test video data as a critical zoom multiple;
determining a sub zoom multiple range smaller than the critical zoom multiple from the zoom multiple range;
selecting any zoom factor from the sub zoom factor range as the default zoom factor.
For example, if a city street is to be live broadcast, privacy scenes such as face images and license plates exist in the street, and in order to prevent privacy leakage, a default zoom multiple matching the privacy scene is selected from the zoom multiple range.
For example, if the zoom factor range is 1X to 8X, the zoom factors are adjusted from small to large according to 1X, 2X, 3X, 4X, 5X, 6X, 7X, and 8X, and the preset definition zoom factor in each test video data is 6X, and 6X is taken as the critical zoom factor.
Determining a sub zoom multiple range smaller than the critical zoom multiple in the zoom multiple range of the camera, for example, the zoom multiple corresponding to one camera is 1X to 8X, and when it is detected that the critical zoom multiple is 4X, the value of the sub zoom multiple range is greater than or equal to 1X and smaller than 4X. The method comprises the steps of determining that the privacy information in the test video reaches the preset definition corresponding to the degree capable of being seen clearly, wherein the multiple corresponding to the preset definition is the maximum zooming multiple capable of amplifying the privacy information, and the preset definition can be obtained in advance according to the shooting parameter configuration test of the camera.
In actual operation, the fuzzy processing can also be carried out on scenes or characters needing privacy processing. The method and the device realize privacy protection of the live broadcast picture, and can filter some picture contents irrelevant to the live broadcast content, thereby bringing better viewing experience for users.
In a specific embodiment, the receiving a screen zoom adjustment request sent by a live client includes:
receiving a reservation queuing request sent by the live broadcast client;
and determining the reservation control time of the live broadcast client according to the reservation queuing request, and receiving the picture zooming adjustment request within the reservation control time.
Specifically, in this embodiment, before receiving a screen scaling adjustment request sent by a live broadcast client, first, a reservation of the live broadcast client is received, and a user waits for control of screen scaling in sequence at the client in a reservation queue manner. When the current user is queued, the control time of the screen zooming request of the current user is limited, and the limitation of the control time can reduce unnecessary time waste and can well utilize live video data. During live broadcasting, in the reserved control time, a user can send a picture zooming adjustment request through a live broadcasting client to adjust a live broadcasting video picture. In addition, the number of times that the user can send the screen zooming adjustment request through live broadcasting is limited, for example, the screen zooming adjustment request can be sent only once in the process of live broadcasting, so that malicious control is reduced. The reservation control time and the reservation times can be set according to actual requirements.
In this embodiment 1, a picture scaling adjustment request sent by a live client is received, where the picture scaling adjustment request includes a target zoom multiple of a camera; responding to the image zooming adjustment request, and adjusting the current zooming multiple of the camera to the target zooming multiple; and acquiring live broadcast video data through the camera at the target zoom multiple. By zooming control of the camera, free zooming control of live broadcast pictures is realized, the personalized requirement of online users for watching live broadcasts is met, and the online experience of watching live broadcasts is improved.
Example 2
The embodiment of the application also provides another live broadcast control method.
The following describes the live broadcast control method with reference to fig. 2 and 3.
In this embodiment, the live broadcast control method is applied to a live broadcast client, as shown in fig. 2, the method includes:
s201, generating a picture zooming adjustment request according to user input operation, wherein the picture zooming adjustment request comprises a target zooming multiple for adjusting the camera;
s202, sending the picture scaling adjustment request to a live broadcast server;
s203, live broadcast video data are obtained from the live broadcast server, and the live broadcast video data are obtained by the camera at the target zoom multiple.
Specifically, the live broadcast client 200 generates a screen zoom adjustment request according to a screen zoom adjustment operation input by a user in a live broadcast screen option of the live broadcast client. After the frame scaling adjustment request is sent to the live broadcast server 100, the live broadcast server 100 controls the camera 300 according to the frame scaling adjustment request, controls the camera 300 to acquire a live broadcast frame, and sends the live broadcast frame to the live broadcast client 200. Then the live video data obtained by the camera 300 at the target zoom multiple can be obtained. For a detailed description, refer to the implementation steps of the live broadcast server in embodiment 1, and are not described herein again to avoid repetition.
In a specific embodiment, before generating the screen zoom adjustment request according to the user input operation, the method further includes:
receiving a zoom multiple range and a default zoom multiple sent by the live broadcast server;
displaying the zoom multiple range and the default zoom multiple on a playing interface corresponding to the live video data;
and detecting the user input operation on the playing interface, wherein the user input operation is used for determining the target zoom multiple from the zoom multiple range.
As shown in fig. 3, an interaction diagram of a live server and a live client is shown. The live broadcast client 200 receives the zoom multiple range and the default zoom multiple of the live broadcast server 100, and displays the zoom multiple range and the default zoom multiple on the play interface. Displayed to the live client 200 for the user to know the current zoom status and to provide control zoom factor range selections. The user selects the target zoom multiple within the zoom multiple range, the live broadcast client receives the user input operation of selecting the target zoom multiple, and the zoom multiple control of the live broadcast camera 300 is realized through the user input operation, so that the zoom control of the live broadcast picture is realized.
The display form can be set individually.
In a specific embodiment, the user input operation includes a user reservation operation and a user adjustment operation;
the generating of the screen zoom adjustment request according to the user input operation includes:
generating a reservation queuing request according to the user reservation operation, and sending the reservation queuing request to the live broadcast server;
receiving reservation control time sent by the live broadcast server;
and generating the screen zooming adjustment request according to the user adjustment operation within the reserved control time.
As shown in fig. 3, in the interaction between the live broadcast client 200 and the live broadcast server 100, at the live broadcast client 200, the user first performs reservation queuing to initiate a user reservation operation, and after the reservation queuing is successful, a screen zoom adjustment request can be initiated, and similarly, in the live broadcast client 200, the screen zoom request control time of the current user is limited, and the limitation of the control time can reduce unnecessary time waste, and can make good use of live broadcast video data, corresponding to the content of embodiment 1. During live broadcasting, in the reserved control time, a user can initiate a picture zooming adjustment request to adjust a live video picture. In addition, the number of times the user can initiate the screen zoom adjustment request is limited, so that malicious control is reduced. The reservation control time and the reservation times can be set according to actual requirements.
In a specific embodiment, the method further comprises: determining a digital zoom multiple range of the live broadcast client;
selecting a target digital zoom multiple within the digital zoom multiple range to adjust the live video data to obtain the live video data after digital zoom;
performing picture enhancement processing on the live video data subjected to digital zooming by adopting a time domain picture quality enhancement processing mode and/or a spatial domain picture quality enhancement processing mode;
and displaying the live video data subjected to the picture enhancement processing and subjected to the digital zooming on a playing interface of the live client.
In addition, this embodiment further provides an adjusting means for digital zooming of a live broadcast frame, where a live broadcast client can select adjustment of digital zooming after adjustment of an optical zoom multiple of a camera, and a larger zoom adjustment space is provided by combination of optical zooming and digital zooming, for example: the maximum resolution of the camera is 720p, 1080p, 2K and 4K, and the zoom factor of the corresponding picture finally presented to the user is 1X-2X, 1X-4X, 1X-6X and 1X-8X. The combination of optical zooming and digital zooming improves the viewing experience of live videos and better meets the requirements of users.
Specifically, after the zoom multiple of the camera is changed, image quality loss of the live video is compensated, so that a better live video image is presented, and the user experience is improved. The spatial domain image quality enhancement includes, but is not limited to, an image super-resolution technique, a video noise reduction technique, and a sharpening technique.
The spatial domain image quality enhancement technique will be further described below. The image Super-Resolution technology (Tencent Super Resolution TSR) is a technology for performing picture Super-Resolution by adopting a deep neural network, and under the algorithm processing of the deep neural network, a fuzzy picture can be changed into a very clear picture by identifying the content and the outline of the picture and reconstructing the details and the local characteristics of the picture in a high-definition manner, so that a good visual effect is achieved.
The video denoising technology is an algorithm for denoising based on a spatial domain, namely denoising a single image, and solving the problem of video noise based on the actual requirements of video processing by adopting an image denoising algorithm, such as region judgment, for example, denoising algorithms with different performances and the like. Sharpening technology: high-frequency components of the image are compensated and increased, so that the ground object boundary, the region edge, the line, the texture feature, the fine structure feature and the like in the image are clearer and clearer.
The selection of the specific image super-resolution technology, the video denoising technology and the sharpening technology can set the algorithm according to the actual requirement of video processing. Other techniques for enhancing image quality processing may be selected as desired.
In addition, in the temporal image quality enhancement processing method, image quality is improved by processing a plurality of frames, and in the daytime or live broadcast with high brightness, live broadcast video is overlaid with extracted screen frames mainly for live broadcast shooting of still scenery. The specific optional mode is as follows: judging the brightness of the live video; if the brightness of the live video exceeds the maximum brightness threshold value, acquiring a picture frame of the live video according to a preset time interval, and replacing the live video in the corresponding preset time interval with the picture frame. Therefore, the screen blockage is avoided, and the display of the live broadcast picture quality is enhanced.
And under the condition that the live broadcast is at night or the brightness is low, if the brightness of the live broadcast video is lower than a minimum brightness threshold value, acquiring a plurality of picture frames of the live broadcast video according to a preset time interval, and synthesizing the live broadcast video according to the picture frames. And the live video is synthesized by adopting the frame, so that the brightness of the picture and the picture quality display are improved.
In this embodiment, human eyes can recognize 24 frames of images in 4ms, the value of the preset time interval can be within 4ms, and correspondingly, the number of the selected frames can be set to be within 24 frames corresponding to the 24 frames that can be recognized by human eyes. In particular, it is set according to the actual requirements.
This embodiment 2 presents a zoom effect on a user interface of a live client, a user of the live client can initiate a zoom adjustment request on a live server, adjust a live video frame through zoom control on a live camera, and simultaneously adjust digital zoom after an optical zoom multiple of the camera is adjusted, so that a larger zoom adjustment space is provided by combining optical zoom and digital zoom. Meanwhile, the image quality enhancement processing enables the display effect of the zoomed picture to be better, and brings better immersive appreciation experience for users.
In addition, the user interface presents the zooming effect of the picture, for example, the enlarged picture is presented, which may be a style of directly presenting the enlarged picture, or some effects may be added, for example, a border of a telescope is added, and the picture presents a telescope window effect.
Example 3
The embodiment of the application provides a live broadcast control system, which comprises a live broadcast server and a live broadcast client;
the live broadcast client is used for generating a picture zooming adjustment request according to user input operation and sending the picture zooming adjustment request to the live broadcast server, wherein the picture zooming adjustment request comprises a target zooming multiple for adjusting the camera;
the live broadcast server is used for receiving a picture zooming adjustment request sent by the live broadcast client, responding to the picture zooming adjustment request, adjusting the current zooming multiple of the camera to the target zooming multiple, acquiring live broadcast video data through the camera at the target zooming multiple, and sending the live broadcast video data to the live broadcast client;
and the live broadcast client is also used for acquiring the live broadcast video data from the live broadcast server. As shown in fig. 4, the following steps are executed by the live control system in this embodiment: s301, the live broadcast client generates a picture zooming adjustment request according to user input operation, and sends the picture zooming adjustment request to the live broadcast server, wherein the picture zooming adjustment request comprises a target zooming multiple for adjusting a camera; s302, the live broadcast server receives a picture zooming adjustment request sent by the live broadcast client, responds to the picture zooming adjustment request, adjusts the current zooming multiple of the camera to the target zooming multiple, obtains live broadcast video data through the camera at the target zooming multiple, and sends the live broadcast video data to the live broadcast client; s303, the live broadcast client acquires the live broadcast video data from the live broadcast server. The free zooming control of the live broadcast picture is realized through the interaction of the server and the client, the personalized requirement of a user on watching live broadcast on line is met, and the experience of watching live broadcast on line is improved.
For specific implementation steps, reference may be made to the description related to the live broadcast control method provided in embodiments 1 and 2, and details are not described herein in order to avoid repetition.
Example 4
An embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and when the computer program runs on a processor, the computer program executes the live broadcast control method provided in embodiment 1 or embodiment 2.
For specific implementation steps, reference may be made to the related descriptions of the live broadcast control methods provided in embodiments 1 and 2, and details are not described herein in order to avoid repetition.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative and, for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, each functional module or unit in each embodiment of the present invention may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention or a part of the technical solution that contributes to the prior art in essence can be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a smart phone, a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention.
Claims (10)
1. A live broadcast control method, characterized in that the method comprises:
receiving a picture zooming adjustment request sent by a live client, wherein the picture zooming adjustment request comprises a target zooming multiple used for adjusting a camera;
responding to the image zooming adjustment request, and adjusting the current zooming multiple of the camera to the target zooming multiple;
acquiring live broadcast video data through a camera at the target zoom multiple;
and sending the live video data to the live client.
2. The method of claim 1, further comprising:
determining the zoom multiple range of the camera according to the shooting configuration parameters of the camera;
acquiring initial live video data through a camera at an initial zoom multiple, and determining the attribute type of the initial live video data;
determining a default zoom multiple matched with the attribute type from the zoom multiple range;
adjusting the camera from the initial zoom factor to the default zoom factor.
3. The method of claim 2, wherein said determining a default zoom factor from the zoom factor range that matches the attribute type comprises:
sequentially adjusting the zoom multiples of the cameras from small to large according to each zoom multiple in the zoom multiple range, and acquiring corresponding test video data through the cameras at each zoom multiple;
taking the zoom multiple corresponding to the test video data meeting the preset definition in each test video data as a critical zoom multiple;
determining a sub zoom multiple range smaller than the critical zoom multiple from the zoom multiple range;
selecting any zoom factor from the sub zoom factor range as the default zoom factor.
4. The method of claim 1, wherein receiving a screen zoom adjustment request sent by a live client comprises:
receiving a reservation queuing request sent by the live broadcast client;
and determining the reservation control time of the live broadcast client according to the reservation queuing request, and receiving the picture zooming adjustment request within the reservation control time.
5. A live broadcast control method, characterized in that the method comprises:
generating a picture zooming adjustment request according to user input operation, wherein the picture zooming adjustment request comprises a target zooming multiple for adjusting the camera;
sending the picture zooming adjustment request to a live broadcast server;
and acquiring live broadcast video data from the live broadcast server, wherein the live broadcast video data is acquired by the camera at the target zoom multiple.
6. The method according to claim 5, wherein before generating the screen zoom adjustment request according to the user input operation, the method further comprises:
receiving a zoom multiple range and a default zoom multiple sent by the live broadcast server;
displaying the zoom multiple range and the default zoom multiple on a playing interface corresponding to the live video data;
and detecting the user input operation on the playing interface, wherein the user input operation is used for determining the target zoom multiple from the zoom multiple range.
7. The method of claim 5, wherein the user input operation comprises a user reservation operation and a user adjustment operation;
the generating of the screen zoom adjustment request according to the user input operation includes:
generating a reservation queuing request according to the user reservation operation, and sending the reservation queuing request to the live broadcast server;
receiving reservation control time sent by the live broadcast server;
and generating the screen zooming adjustment request according to the user adjustment operation within the reserved control time.
8. The method of claim 5, further comprising: determining a digital zoom multiple range of the live broadcast client;
selecting a target digital zoom multiple within the digital zoom multiple range to adjust the live video data to obtain the live video data after digital zoom;
performing picture enhancement processing on the live video data subjected to digital zooming by adopting a time domain picture quality enhancement processing mode and/or a spatial domain picture quality enhancement processing mode;
and displaying the live video data subjected to the picture enhancement processing and subjected to the digital zooming on a playing interface of the live client.
9. A live broadcast control system is characterized by comprising a live broadcast server and a live broadcast client;
the live broadcast client is used for generating a picture zooming adjustment request according to user input operation and sending the picture zooming adjustment request to the live broadcast server, wherein the picture zooming adjustment request comprises a target zooming multiple for adjusting the camera;
the live broadcast server is used for receiving a picture zooming adjustment request sent by the live broadcast client, responding to the picture zooming adjustment request, adjusting the current zooming multiple of the camera to the target zooming multiple, acquiring live broadcast video data through the camera at the target zooming multiple, and sending the live broadcast video data to the live broadcast client;
and the live broadcast client is also used for acquiring the live broadcast video data from the live broadcast server.
10. A computer-readable storage medium, characterized in that it stores a computer program which, when run on a processor, performs the live control method of any of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110961325.6A CN113613030A (en) | 2021-08-20 | 2021-08-20 | Live broadcast control method and system and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110961325.6A CN113613030A (en) | 2021-08-20 | 2021-08-20 | Live broadcast control method and system and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113613030A true CN113613030A (en) | 2021-11-05 |
Family
ID=78309038
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110961325.6A Pending CN113613030A (en) | 2021-08-20 | 2021-08-20 | Live broadcast control method and system and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113613030A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114339291A (en) * | 2021-12-31 | 2022-04-12 | 杭州当虹科技股份有限公司 | Method for zooming and playing streaming media video |
| CN114885180A (en) * | 2022-07-11 | 2022-08-09 | 成都秦川物联网科技股份有限公司 | Smart city public landscape live broadcast control method and Internet of things system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030210329A1 (en) * | 2001-11-08 | 2003-11-13 | Aagaard Kenneth Joseph | Video system and methods for operating a video system |
| US20080092172A1 (en) * | 2006-09-29 | 2008-04-17 | Guo Katherine H | Method and apparatus for a zooming feature for mobile video service |
| CN106470343A (en) * | 2016-09-29 | 2017-03-01 | 广州华多网络科技有限公司 | Live video stream long-range control method and device |
| KR20170138145A (en) * | 2016-06-07 | 2017-12-15 | 엘지전자 주식회사 | Display device and operating method thereof |
| CN108040285A (en) * | 2017-11-15 | 2018-05-15 | 上海掌门科技有限公司 | Net cast picture adjusting method, computer equipment and storage medium |
| US20190364303A1 (en) * | 2018-05-22 | 2019-11-28 | Beijing Baidu Netcom Science Technology Co., Ltd. | Live broadcast processing method, apparatus, device, and storage medium |
| CN112770050A (en) * | 2020-12-31 | 2021-05-07 | Oppo广东移动通信有限公司 | Video display method and device, computer readable medium and electronic equipment |
-
2021
- 2021-08-20 CN CN202110961325.6A patent/CN113613030A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030210329A1 (en) * | 2001-11-08 | 2003-11-13 | Aagaard Kenneth Joseph | Video system and methods for operating a video system |
| US20080092172A1 (en) * | 2006-09-29 | 2008-04-17 | Guo Katherine H | Method and apparatus for a zooming feature for mobile video service |
| KR20170138145A (en) * | 2016-06-07 | 2017-12-15 | 엘지전자 주식회사 | Display device and operating method thereof |
| CN106470343A (en) * | 2016-09-29 | 2017-03-01 | 广州华多网络科技有限公司 | Live video stream long-range control method and device |
| WO2018059352A1 (en) * | 2016-09-29 | 2018-04-05 | 广州华多网络科技有限公司 | Remote control method and apparatus for live video stream |
| CN108040285A (en) * | 2017-11-15 | 2018-05-15 | 上海掌门科技有限公司 | Net cast picture adjusting method, computer equipment and storage medium |
| US20190364303A1 (en) * | 2018-05-22 | 2019-11-28 | Beijing Baidu Netcom Science Technology Co., Ltd. | Live broadcast processing method, apparatus, device, and storage medium |
| CN112770050A (en) * | 2020-12-31 | 2021-05-07 | Oppo广东移动通信有限公司 | Video display method and device, computer readable medium and electronic equipment |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114339291A (en) * | 2021-12-31 | 2022-04-12 | 杭州当虹科技股份有限公司 | Method for zooming and playing streaming media video |
| CN114885180A (en) * | 2022-07-11 | 2022-08-09 | 成都秦川物联网科技股份有限公司 | Smart city public landscape live broadcast control method and Internet of things system |
| US11765403B1 (en) | 2022-07-11 | 2023-09-19 | Chengdu Qinchuan Iot Technology Co., Ltd. | Methods and internet of things systems for controlling public landscape live broadcast in smart cities |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101864059B1 (en) | Mobile terminal and shooting method thereof | |
| US7773099B2 (en) | Context aware image conversion method and playback system | |
| JP6753405B2 (en) | Information processing device and information processing method | |
| CN108184165B (en) | Video playing method, electronic device and computer readable storage medium | |
| CN107948733B (en) | Video image processing method and device and electronic equipment | |
| CN113613030A (en) | Live broadcast control method and system and computer readable storage medium | |
| JP2010041336A (en) | Image processing unit and image processing method | |
| US20100085420A1 (en) | Image processing apparatus and method | |
| WO2022033485A1 (en) | Video processing method and electronic device | |
| JP2008288767A (en) | Information processor, method, and program | |
| CN111405339B (en) | Split screen display method, electronic equipment and storage medium | |
| CN106470313B (en) | Image generation system and image generation method | |
| CN112532808A (en) | Image processing method and device and electronic equipment | |
| CN113747240A (en) | Video processing method, apparatus, storage medium, and program product | |
| US20170280090A1 (en) | Binocular display and method for displaying images | |
| US20130342712A1 (en) | Photographing control apparatus and photographing control method | |
| JP2009100186A (en) | Image quality adjusting device, imaging quality adjustment method, and program | |
| JP5599063B2 (en) | Display control apparatus, display control method, and program | |
| CN111147883A (en) | Live broadcast method and device, head-mounted display equipment and readable storage medium | |
| US11622099B2 (en) | Information-processing apparatus, method of processing information, and program | |
| JP2012173683A (en) | Display control device, information display apparatus, and display control method | |
| JP2018506106A (en) | Apparatus and method for generating extrapolated images using recursive hierarchical processing | |
| KR102108246B1 (en) | Method and apparatus for providing video in potable device | |
| CN113691737B (en) | Video shooting method and device and storage medium | |
| US20120219264A1 (en) | Image processing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |