CN111193937B - Live video data processing method, device, equipment and medium - Google Patents
Live video data processing method, device, equipment and medium Download PDFInfo
- Publication number
- CN111193937B CN111193937B CN202010040281.9A CN202010040281A CN111193937B CN 111193937 B CN111193937 B CN 111193937B CN 202010040281 A CN202010040281 A CN 202010040281A CN 111193937 B CN111193937 B CN 111193937B
- Authority
- CN
- China
- Prior art keywords
- video data
- area
- live video
- coordinate information
- live
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
Abstract
The invention discloses a method and a device for processing live video data, wherein the method comprises the following steps: receiving a request of live video data, wherein the request comprises area coordinate information of live video; acquiring live broadcast video data based on the area coordinate information; and pushing the acquired live video data to a video playing client. According to the technical scheme, the video data corresponding to the area requested to be watched are used as live video data and sent to the video playing client, the problems of bandwidth waste and coding and decoding resource waste caused by the fact that redundant video data are transmitted between the server and the client are solved, ultra-high-definition videos with hundred million-level pixels are used as video sources, the live video of any area specified by the user with the resolution ratio and the specified area is sent to the user, the video playing client can watch the high-definition videos of any area rapidly and in real time, and the satisfaction degree of user experience is improved.
Description
Technical Field
The present invention relates to the field of live broadcast technologies, and in particular, to a method, an apparatus, a device, and a medium for processing live broadcast video data.
Background
Video/movie systems have become the most influential mass media in the current information-based society. In a traditional video/movie system, a viewer can only passively accept the view angle selection or the shot switching of a photographer or a director, so that the viewer lacks the autonomy requirement for watching a live video in the watching process, and a client cannot see a detailed video in any area of a panoramic video image.
At present, a billion-pixel-level video breaks through the limit of human visual information capture, revolutionary multi-scale ultrahigh-resolution video capture can be realized, a wide space capture range and high spatial resolution are met, however, the billion-level pixel video is converted into a low-resolution client to be played, on one hand, the video quality is easily lost, and the client still cannot see the detail video of any area of a panoramic video image; on the other hand, the problem of bandwidth and coding and decoding resource waste caused by transmission of the super-large video and redundant video data is also caused.
Disclosure of Invention
In order to solve the technical problem, the present invention provides a method and an apparatus for processing live video data.
According to a first aspect of the present invention, there is provided a method for processing live video data, which is applicable to a server, and includes:
receiving a request of live video data, wherein the request comprises area coordinate information of live video;
acquiring live broadcast video data based on the area coordinate information;
and pushing the acquired live video data to a video playing client.
The above method may also have the following features:
the acquiring of the live video data based on the area coordinate information includes: extracting the region coordinate information, wherein the region coordinate information comprises a reference coordinate point, a region width and a region height based on the reference coordinate point;
and taking the video data corresponding to the area determined by the reference coordinate point, the area width and the area height as live video data.
The above method may also have the following features:
an acquisition canvas, comprising:
acquiring frame video data of multiple paths of acquisition equipment at the same time, and generating canvas for all the frame video data according to a preset rule, wherein the canvas comprises hundred million-level pixel image data.
The above method may also have the following features:
the acquiring of the live video data based on the area coordinate information includes: determining the position relation of pictures corresponding to all the frame video data under the same coordinate system;
and determining an area corresponding to the area coordinate information in the canvas, and taking video data corresponding to the area corresponding to the determined area coordinate information as live video data.
The above method may also have the following features:
the acquiring of the live video data based on the area coordinate information includes:
determining the position relation of the pictures of the multi-channel acquisition equipment under the same coordinate system;
and determining video data corresponding to the area coordinate information according to the determined position relation of the pictures of the multi-channel acquisition equipment, and taking the video data corresponding to the determined area coordinate information as live video data.
The above method may also have the following features:
further comprising obtaining the live time period information,
the acquiring of the live video data based on the area coordinate information includes: and acquiring live broadcast video data in the live broadcast time interval information based on the region coordinate information.
The above method may also have the following features:
further comprising: the request comprises the resolution of the video playing client;
the step of pushing the acquired live video data to the video playing client comprises the following steps: and converting the acquired live video data according to the resolution ratio and then sending the converted live video data to a video playing client.
According to a second aspect of the present invention, there is provided a live video data transmission apparatus, adapted to a server, comprising:
a receiving module: receiving a request for live video data, wherein the request comprises region coordinate information of live video;
an acquisition module: the system is used for acquiring live video data based on the area coordinate information;
a pushing module: and the system is used for pushing the acquired live video data to the video playing client.
An acquisition module: the system is also used for extracting area coordinate information, wherein the area coordinate information comprises a reference coordinate point, an area width and an area height based on the reference coordinate point; and taking the video data corresponding to the area determined by the reference coordinate point, the area width and the area height as live video data.
The above device may also have the following features:
an acquisition module: the multi-channel acquisition equipment is also used for acquiring frame video data of the multi-channel acquisition equipment at the same time, and generating canvas for all the frame video data according to a preset rule, wherein the canvas comprises hundred million-level pixel image data.
The above device may also have the following features:
an acquisition module: the video processing device is also used for determining the position relation of pictures corresponding to all the frame video data under the same coordinate system; and determining an area corresponding to the area coordinate information in the canvas, and taking video data corresponding to the area corresponding to the determined area coordinate information as live video data.
The above device may also have the following features:
an acquisition module: the multi-channel acquisition equipment is also used for determining the position relation of the multi-channel acquisition equipment in the same coordinate system;
and determining video data corresponding to the area coordinate information according to the determined position relation of the multi-channel acquisition equipment, and taking the video data corresponding to the determined area coordinate information as live video data.
The above device may also have the following features:
an acquisition module: the system is also used for acquiring the live broadcast time interval information;
a pushing module: and the live video data in the area coordinate information in the live time period information is also acquired.
The above device may also have the following features:
a receiving module: the system is also used for receiving the resolution of the video playing client;
a pushing module: and the system is also used for converting the live video data according to the resolution ratio and then sending the converted live video data to the video playing client.
According to a third aspect of the invention, there is provided a computer device comprising a processor for implementing the steps of the above method when executing a computer program stored in a memory.
According to a fourth aspect of the invention, a computer-readable storage medium is provided, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.
According to the method and the device for processing the live video data, the server takes the video data corresponding to the area requested to be watched by the video playing client as the live video data, and other video data outside the area do not need to be sent to the video playing client, so that the problems of bandwidth waste and coding and decoding resource waste caused by transmission of redundant video data between the server and the client are solved; the ultrahigh-definition video with hundred million-level pixels is used as a video source, the resolution (such as 4K or 8K) specified by a user and the live video in any specified area are sent to the user, so that the video playing client can quickly and real-timely view the high-definition video in any area, the user can view the high-quality detail video of any local picture, the user can observe a target area in the panoramic video picture more far and more comprehensively, and the satisfaction degree of user experience is improved.
Other characteristic features and advantages of the invention will become apparent from the following description of exemplary embodiments, which is to be read in connection with the accompanying drawings.
Drawings
Fig. 1 is a flowchart illustrating a processing method of live video data according to a first embodiment of the present invention;
fig. 2 is a flowchart illustrating a processing method of live video data according to a second embodiment of the present invention;
FIG. 3 illustrates a diagram of determining a region in a canvas to which region coordinate information corresponds;
fig. 4 is a flowchart illustrating a processing method of live video data according to a third embodiment of the present invention;
FIG. 5 is a block diagram illustrating a transmission apparatus of live video data in accordance with an exemplary embodiment;
FIG. 6 is a block diagram illustrating a computer device according to an example embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
Example one
Fig. 1 is a flowchart illustrating a method for processing live video data according to a first embodiment of the present invention.
As shown in fig. 1, the method for processing live video data, executed by a server side, includes:
102, acquiring live broadcast video data based on the area coordinate information;
and 103, pushing the acquired live video data to a video playing client.
In the embodiment, the server sends the video data corresponding to the area requested to be watched by the video playing client as live video data to the video playing client, and other video data outside the area do not need to be sent to the video playing client, so that the problems of bandwidth waste and coding and decoding resource waste caused by transmission of redundant video data between the server and the client are solved; meanwhile, the requirement that the client sends different area coordinate information is met, and the requirement that a user designates a watching area and freely switches a live broadcast view angle mode to watch live broadcast video is met.
The video playing client can be a computer end, a mobile phone end, a flat plate end, VR glasses and the like.
In step 101, a server may establish a connection relationship with a plurality of video playing clients, the server receives a request for live video data of the video playing clients, the request may be received through an HTTP protocol, the request includes area coordinate information of live video requested to be watched by the video playing clients, the area coordinate information is different area coordinate information sent by the video playing clients in real time, and the server returns live video data according to the received area coordinate information to watch different live video areas.
Further, the step 102 of acquiring live video data based on the area coordinate information includes:
extracting region coordinate information, wherein the region coordinate information comprises a reference coordinate point, a region width and a region height based on the reference coordinate point; and taking the video data corresponding to the area determined by the reference coordinate point, the area width and the area height as live video data.
Specifically, for example, the video playing client sends area coordinate information (x, y, w, h) to request to view an area, where (x, y) represents the upper left-hand coordinates of the area in the panoramic video image converted into the same coordinate system, w is the horizontal range of the viewing area in the normalized coordinate system of the panoramic video image, i.e., the area width, and h is the vertical range of the viewing area in the normalized coordinate system of the panoramic video image, i.e., the area height, determines a rectangular area according to the area coordinate information (x, y, w, h), and takes the video data corresponding to the determined rectangular area as live video data.
Further, the method further comprises: and acquiring live broadcast period information, wherein the live broadcast period information can be time period information appointed by a user in a request, and when the user does not appoint the time period information, a time point of receiving the request is taken as a starting time, and a time point of disconnecting the video playing client from the server is taken as an end time and recorded as the live broadcast period information.
Acquiring live video data based on the region coordinate information in step 102 includes: and acquiring live broadcast video data in the live broadcast time interval information based on the region coordinate information.
The method further comprises the following steps: the request comprises the resolution of the video playing client;
further, in step 103, pushing the acquired live video data to the video playing client includes: and converting the acquired live video data according to the resolution ratio and then sending the converted live video data to a video playing client.
In this embodiment, the resolution of each client may be different, and the server may perform encoding according to the resolution requested by the client, and send the encoded data to the corresponding client, so that the client can view the encoded data at the specified resolution.
Example two
Fig. 2 is a flowchart illustrating a processing method of live video data according to a second embodiment of the present invention.
As shown in fig. 2, the method for processing live video data includes:
Giga-pixel image data is image data of several hundred million or even billion pixels in resolution.
Specifically, the canvas in step 202 is to decode frame video data encoded at the same time and received by the server from multiple capturing devices (for example, array cameras), calibrate the cameras through an overlapping area between adjacent cameras, and splice the frame video data into a panoramic video image after unifying colors, for example, by using transformation of position coordinates, splicing and fusion of pictures according to a predetermined rule, or to shoot a scene video for a wide-angle camera array and generate a panoramic video image through a splicing algorithm, where the panoramic video image is a hundred million-level pixel image.
The array camera is characterized in that a certain number of cameras form an array, the array comprises a wide-angle camera serving as a reference and a plurality of telephoto camera arrays which are responsible for shooting high-resolution detail videos in a specific area, and the array camera solves the technical problem that the traditional camera cannot capture panoramic ultra-high definition image data. The server can splice and fuse the high-resolution detail videos shot by the array type cameras to obtain panoramic video images with hundred million-level pixels.
In the embodiment, the acquisition equipment encodes the acquired data at the same moment and sends the encoded data to the server, the server receives all video data and then performs synchronous decoding, the synchronously decoded frame video data are spliced into the canvas of the panoramic video image with hundred million-level pixels, the server obtains the video data corresponding to the area which the client wants to see from the canvas of the panoramic video image according to the area coordinate information sent by the client, and then the video data is converted and sent to the user according to the specified resolution, so that the ultrahigh-definition video with hundred million-level pixels is used as a video source, the specified resolution (such as 4K or 8K) of the user and the live video of any specified area are sent to the user, the user can see any local detail image picture in the panoramic video image, and the important requirement of the user for capturing all details of the picture is met.
FIG. 3 illustrates a diagram of determining a region in a canvas to which region coordinate information corresponds.
As shown in fig. 3, the obtained canvas of the panoramic video image exists in the server, and is a complete video canvas composed of the frames of the multi-channel capture device, the canvas coordinates are converted, the position relationship of the frames corresponding to all the frame video data is determined in the same coordinate system, specifically, the coordinate information of the canvas is converted, the canvas coordinates can be customized, the upper left corner coordinate of the canvas is defined as (0, 0), the upper right corner coordinate of the canvas is defined as (1, 0), the lower left corner coordinate of the canvas is defined as (0, 1), the lower right corner coordinate of the canvas is defined as (1, 1), after the canvas coordinates are converted into the normalized coordinate system, the position relationship of the frames corresponding to all the frame video data is determined, for example, the area coordinate information requested to be watched by the video playing client is (0.18, 0.30, 0.49, 0.50), wherein (0.18, 0.30) is the coordinate of the point a, 0.49 is the area width, and 0.50 is the area height, the rectangular area determined and corresponding to the three parameters in the coordinate system represents an area which a video playing client wants to see, and the video data corresponding to the area is used as live video data.
EXAMPLE III
Fig. 4 is a flowchart illustrating a method for processing live video data according to a third embodiment of the present invention.
As shown in fig. 4, the method for processing live video data includes:
and step 404, converting the live video data according to the resolution ratio and then sending the converted live video data to the video playing client.
Step 402 may specifically define that the coordinates of the upper left corner of the picture of the acquired panoramic video image are (0, 0), the coordinates of the upper right corner are (1, 0), the coordinates of the lower left corner are (0, 1), and the coordinates of the lower right corner are (1, 1), and after converting into the same coordinate system, the server determines the relative position relationship of the pictures of each acquisition device (such as an array camera) according to the coordinate system, determines the acquisition device according to the relative position relationship of the pictures of each acquisition device, and further determines the multiple paths of acquisition devices covered by the area requested to be watched by the video playing client.
The server can determine the acquisition equipment covered by the area and the watching area of each acquisition equipment according to the position relation of the pictures of each path of acquisition equipment through the received area coordinate information, cuts the watching area of each acquisition equipment, fuses and splices the cut videos into video data, and then determines the video data as the video data corresponding to the area coordinate information.
In the embodiment, under the same coordinate system, according to the position relationship of the picture of each acquisition device in the picture of the panoramic video image, according to the regional coordinate information of the viewing region requested by the video playing client, the acquisition device covered by the rectangular region determined by the regional coordinate information and the viewing region covered by the acquisition device are determined, each viewing region is cut and then fused and spliced into the video data corresponding to the regional coordinate information, the video data is converted into the resolution requested by the video playing client, and the resolution is encoded and packaged and then sent to the video playing client, so that the canvas for generating the panoramic video image in the server is not needed, and the load of the server can be reduced.
Fig. 5 is a block diagram illustrating a live video data transmission apparatus according to the present invention;
as shown in fig. 5, the apparatus 500 for transmitting live video data, adapted to a server, includes: a receiving module 501, an obtaining module 502 and a pushing module 503;
the receiving module 501: the system comprises a request for receiving live video data, wherein the request comprises area coordinate information of live video;
the obtaining module 502: the system comprises a video acquisition module, a video display module and a video display module, wherein the video acquisition module is used for acquiring live video data based on regional coordinate information;
the pushing module 503: and the system is used for pushing the acquired live video data to the video playing client.
Further, the obtaining module 502: the system is also used for extracting area coordinate information, wherein the area coordinate information comprises a reference coordinate point, an area width and an area height based on the reference coordinate point; and taking the video data corresponding to the area determined by the reference coordinate point, the area width and the area height as live video data.
Further, the obtaining module 502: the multi-channel acquisition equipment is also used for acquiring frame video data of the multi-channel acquisition equipment at the same time, and generating canvas for all the frame video data according to a preset rule, wherein the canvas comprises hundred million-level pixel image data.
Further, the obtaining module 502: the video processing device is also used for determining the position relation of pictures corresponding to all the frame video data under the same coordinate system; and determining an area corresponding to the area coordinate information in the canvas, and taking video data corresponding to the area corresponding to the determined area coordinate information as live video data.
Further, the obtaining module 502: the multi-channel acquisition equipment is also used for determining the position relation of the multi-channel acquisition equipment in the same coordinate system;
and determining video data corresponding to the area coordinate information according to the determined position relation of the multi-channel acquisition equipment, and taking the video data corresponding to the determined area coordinate information as live video data.
Further, the obtaining module 502: the system is also used for acquiring the live broadcast time interval information;
the pushing module 503: and the live video data in the area coordinate information in the live time period information is also acquired.
Further, the receiving module 501: the system is also used for receiving the resolution of the video playing client;
the pushing module 503: and the system is also used for converting the live video data according to the resolution ratio and then sending the converted live video data to the video playing client.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the storage medium, and when the computer program is executed by a processor, the computer program implements the steps of the method.
The embodiment of the present invention further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, and when the processor executes the computer program, the steps of the method are implemented.
FIG. 6 is a block diagram illustrating a computer device 600 according to an example embodiment. For example, the computer device 600 may be provided as a server. Referring to fig. 6, the computer device 600 includes a processor 601, and the number of processors may be set to one or more as necessary. The computer device 600 further comprises a memory 602 for storing instructions, e.g. application programs, executable by the processor 601. The number of the memories can be set to be one or more according to needs, and the number of the applications stored in the memories can be one or more. The processor 601 is configured to execute instructions to perform the above-described method.
The method and the device for processing the live video data have the following beneficial effects:
1. the server only sends the video data corresponding to the area of the video playing client appointed to watch the live video to the video playing client as the live video data, and other video data outside the area do not need to be sent, so that the problems of bandwidth waste and coding and decoding resource waste caused by transmission of redundant video data between the server and the client are solved;
2. the requirement that a video playing client sends different area coordinate information to realize that a user designates a watching area and freely switches a live broadcast visual angle mode to watch live broadcast video is met;
3. the ultrahigh-definition video with hundred million-level pixels is used as a video source, so that a user can see any local detail image picture in a panoramic video image, and the important requirement of capturing all details of the picture by the user is met.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus (device), or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied in the medium. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, including, but not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the computer, and the like. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.
The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that an article or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such article or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of additional like elements in the article or device comprising the element.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, it is intended that the present invention also encompass such modifications and variations.
Claims (7)
1. A processing method of live video data is suitable for a server, and is characterized by comprising the following steps:
receiving a request of live video data, wherein the request comprises area coordinate information of live video;
acquiring live broadcast video data based on the area coordinate information;
pushing the acquired live video data to a video playing client;
the acquiring of the live video data based on the area coordinate information includes:
determining the position relation of the pictures of the multi-channel acquisition equipment under the same coordinate system;
determining video data corresponding to the area coordinate information according to the determined position relation of the pictures of the multi-channel acquisition equipment, and taking the video data corresponding to the determined area coordinate information as live video data;
extracting the region coordinate information, wherein the region coordinate information comprises a reference coordinate point, a region width and a region height based on the reference coordinate point;
taking the video data corresponding to the area determined by the reference coordinate point, the area width and the area height as live video data;
the canvas is obtained and used as the drawing data,
the obtaining canvas comprises:
acquiring frame video data of multiple paths of acquisition equipment at the same time, and generating canvas for all the frame video data according to a preset rule, wherein the canvas comprises hundred million-level pixel image data.
2. The method for processing live video data according to claim 1, wherein the acquiring live video data based on the area coordinate information includes:
determining the position relation of pictures corresponding to all the frame video data under the same coordinate system;
and determining an area corresponding to the area coordinate information in the canvas, and taking video data corresponding to the area corresponding to the determined area coordinate information as live video data.
3. The method of processing live video data of claim 1, further comprising obtaining live slot information,
the acquiring of the live video data based on the area coordinate information includes: and acquiring live broadcast video data in the live broadcast time interval information based on the region coordinate information.
4. The method of processing live video data of claim 1, further comprising: the request comprises the resolution of the video playing client;
the step of pushing the acquired live video data to the video playing client comprises the following steps: and converting the acquired live video data according to the resolution ratio and then sending the converted live video data to a video playing client.
5. A live video data transmission apparatus adapted to a server, comprising:
a receiving module: receiving a request for live video data, wherein the request comprises region coordinate information of live video;
an acquisition module: the system is used for acquiring live video data based on the area coordinate information;
a pushing module: the system comprises a video playing client, a video server and a video server, wherein the video playing client is used for acquiring live video data;
the acquisition module: the multi-channel acquisition equipment is also used for determining the position relation of the multi-channel acquisition equipment in the same coordinate system;
determining video data corresponding to the area coordinate information according to the determined position relation of the multi-channel acquisition equipment, and taking the video data corresponding to the determined area coordinate information as live video data;
the acquisition module: the system is also used for extracting area coordinate information, wherein the area coordinate information comprises a reference coordinate point, an area width and an area height based on the reference coordinate point; taking video data corresponding to the area determined by the reference coordinate point, the area width and the area height as live video data;
the acquisition module: the multi-channel acquisition equipment is also used for acquiring frame video data of the multi-channel acquisition equipment at the same time, and generating canvas for all the frame video data according to a preset rule, wherein the canvas comprises hundred million-level pixel image data.
6. A computer arrangement, characterized in that the computer arrangement comprises a processor for implementing the steps of the method according to any one of claims 1 to 4 when executing a computer program stored in a memory.
7. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010040281.9A CN111193937B (en) | 2020-01-15 | 2020-01-15 | Live video data processing method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010040281.9A CN111193937B (en) | 2020-01-15 | 2020-01-15 | Live video data processing method, device, equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111193937A CN111193937A (en) | 2020-05-22 |
| CN111193937B true CN111193937B (en) | 2022-05-13 |
Family
ID=70710064
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010040281.9A Active CN111193937B (en) | 2020-01-15 | 2020-01-15 | Live video data processing method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111193937B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111738923A (en) * | 2020-06-19 | 2020-10-02 | 京东方科技集团股份有限公司 | Image processing method, apparatus and storage medium |
| CN111698520A (en) * | 2020-06-24 | 2020-09-22 | 北京奇艺世纪科技有限公司 | Multi-view video playing method, device, terminal and storage medium |
| CN114071228A (en) * | 2021-09-28 | 2022-02-18 | 浙江预策科技有限公司 | Real-time information superposition method and device, electronic device and storage medium |
| CN113891112B (en) * | 2021-09-29 | 2023-12-05 | 北京拙河科技有限公司 | Live broadcasting method, device, medium and equipment of billion pixel video |
| CN113905256B (en) * | 2021-12-10 | 2022-04-12 | 北京拙河科技有限公司 | Video data processing method, device and system supporting interactive watching |
| CN114422813A (en) * | 2021-12-30 | 2022-04-29 | 中国电信股份有限公司 | VR live video splicing and displaying method, device, equipment and storage medium |
| CN115314750B (en) * | 2022-08-10 | 2023-09-29 | 润博全景文旅科技有限公司 | Video playing method, device and equipment |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007189357A (en) * | 2006-01-11 | 2007-07-26 | Matsushita Electric Ind Co Ltd | Device and method for distributing arbitrary-viewpoint video |
| EP2774043A4 (en) * | 2011-11-04 | 2015-03-25 | Peekaboo Corp | Method and system for remote video monitoring and remote video broadcast |
| US9686467B2 (en) * | 2014-08-15 | 2017-06-20 | Sony Corporation | Panoramic video |
| CN105828206A (en) * | 2016-03-22 | 2016-08-03 | 乐视网信息技术（北京）股份有限公司 | Multi-video on-demand method and device |
| CN106604042A (en) * | 2016-12-22 | 2017-04-26 | Tcl集团股份有限公司 | Panorama webcasting system and panorama webcasting method based on cloud server |
| CN107197139B (en) * | 2017-04-13 | 2020-05-15 | 深圳一电航空技术有限公司 | Data processing method of panoramic camera |
| CN108259921B (en) * | 2018-02-08 | 2020-06-16 | 青岛一舍科技有限公司 | Multi-angle live broadcast system based on scene switching and switching method |
| CN109302618A (en) * | 2018-11-27 | 2019-02-01 | 网易（杭州）网络有限公司 | Live streaming picture rendering method, device and storage medium in mobile terminal |
-
2020
- 2020-01-15 CN CN202010040281.9A patent/CN111193937B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111193937A (en) | 2020-05-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111193937B (en) | Live video data processing method, device, equipment and medium | |
| CN111225228B (en) | Video live broadcast method, device, equipment and medium | |
| KR100828358B1 (en) | Method and apparatus for converting display mode of video, and computer readable medium thereof | |
| JP5328082B2 (en) | Video transmission and reception method and apparatus, and transmission stream structure thereof | |
| US20180098131A1 (en) | Apparatus and methods for adaptive bit-rate streaming of 360 video | |
| US11539983B2 (en) | Virtual reality video transmission method, client device and server | |
| CN112468832A (en) | Billion-level pixel panoramic video live broadcast method, device, medium and equipment | |
| CN107592549B (en) | Panoramic video playing and photographing system based on two-way communication | |
| KR20140030111A (en) | Pseudo-3d forced perspective methods and devices | |
| CN109587478B (en) | Media information processing method and device | |
| CN113099245A (en) | Panoramic video live broadcast method, system and computer readable storage medium | |
| CN111601151A (en) | Method, device, medium and equipment for reviewing hundred million-level pixel video | |
| CN111614975A (en) | Method, device, medium and equipment for playing hundred million-level pixel video | |
| CN113891111B (en) | Live broadcasting method, device, medium and equipment of billion pixel video | |
| CN107707830B (en) | Panoramic video playing and photographing system based on one-way communication | |
| US20220053127A1 (en) | Image Processing Method, Apparatus and System, Network Device, Terminal and Storage Medium | |
| CN110351492B (en) | Video data processing method, device and medium | |
| US20200213631A1 (en) | Transmission system for multi-channel image, control method therefor, and multi-channel image playback method and apparatus | |
| CN114449303A (en) | Live broadcast picture generation method and device, storage medium and electronic device | |
| CA3057924A1 (en) | System and method to optimize the size of a video recording or video transmission by identifying and recording a region of interest in a higher definition than the rest of the image that is saved or transmitted in a lower definition format | |
| EP2852149A1 (en) | Method and apparatus for generation, processing and delivery of 3D video | |
| CN114040184A (en) | Image display method, system, storage medium and computer program product | |
| CN113949884A (en) | Multi-view video data processing method, device and storage medium | |
| KR100940209B1 (en) | Method and apparatus for converting display mode of video, and computer readable medium thereof | |
| US20190313151A1 (en) | Streaming-technology based video data processing method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211110 Address after: 518000 409, Yuanhua complex building, 51 Liyuan Road, merchants street, Nanshan District, Shenzhen, Guangdong Applicant after: Shenzhen zhuohe Technology Co., Ltd Address before: No. 2501-1, 25 / F, block D, Tsinghua Tongfang science and technology building, No. 1 courtyard, Wangzhuang Road, Haidian District, Beijing 100083 Applicant before: Beijing zhuohe Technology Co., Ltd |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |