CN115580738A - High-resolution video display method, device and system based on-demand transmission - Google Patents
High-resolution video display method, device and system based on-demand transmission Download PDFInfo
- Publication number
- CN115580738A CN115580738A CN202210164439.2A CN202210164439A CN115580738A CN 115580738 A CN115580738 A CN 115580738A CN 202210164439 A CN202210164439 A CN 202210164439A CN 115580738 A CN115580738 A CN 115580738A
- Authority
- CN
- China
- Prior art keywords
- video
- block
- playing
- video data
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2385—Channel allocation; Bandwidth allocation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Abstract
The invention provides a high-resolution video display method, equipment and system based on-demand transmission, and belongs to the technical field of video transmission and processing. The method comprises the steps of down-sampling, performing coding compression after blocking, playing a video, receiving an extended playing operation of a user when the video is played, determining an extended playing area, determining a minimum coverage area containing the extended playing area in original video data, transmitting block original video data corresponding to the minimum coverage area to a client, covering the extended playing area with the block video data, performing video display, and the like. The video display system is connected with a video source server and comprises a client resolution acquisition module, a down-sampling module, a video blocking module, a blocking coding module, a blocking transmission module, an extended play operation identification module, an original covering blocking request module and a decoding play module. The on-demand transmission method provided by the invention can reduce the requirement on network transmission bandwidth under the condition of not reducing user experience.
Description
Technical Field
The invention provides a high-resolution video display method, equipment and system based on-demand transmission, and belongs to the technical field of video transmission and processing.
Background
In service applications such as panoramic video display, a video source often has high definition and a large visual field range, and the resolution of the video generally reaches two 4K or 8K, and is continuously improved to improve the visual experience of a user.
High definition video results in the need for a very high bandwidth communication network between the server and the client if the complete video is provided directly from the server to the client while such video is live or on demand. High bandwidth communication networks are expensive both in availability and usage, and therefore this approach is difficult to commercialize on a large scale.
It has been retrieved that US patent publication US11159776B2 proposes a method and system for 16K panoramic video streaming on mobile devices that can transform quickly and losslessly any irregularly shaped viewport of a 16K panoramic video frame (which may be a 360 ° video frame) into a rectangular 8K frame. This edge-side transcoding enables clients to process only 8K video content instead of 16K.
Chinese patent CN108156484B then proposes an adaptive rate allocation system that divides panoramic video into segments or tiles and assigns a priority to each tile or segment based on input from a user client device (e.g., a viewport for the field of view). The adaptive rate allocation system streams each tile or segment to the user client devices according to adaptive rate allocation, which maximizes bandwidth efficiency and video quality. In this way, the adaptive rate allocation system delivers higher quality content to areas in the panoramic video that the user is currently viewing/most likely viewing.
However, none of the above prior art technologies can reduce the requirement for network transmission bandwidth without reducing user experience.
Disclosure of Invention
To solve the above technical problem, the present invention provides a method and a system for on-demand transmission of high-resolution video presentation, a computer device implementing the method, and a storage medium.
In a first aspect of the present invention, a method for on-demand delivery of high-resolution video presentation is presented, the method comprising:
s110: acquiring original video data of a first resolution ratio, and performing downsampling to obtain basic video data of a second resolution ratio;
s120: performing coding compression after the basic video data is partitioned;
s130: transmitting the video after the coding compression to a client for playing;
s140: receiving an expanded playing operation of a user when playing a video;
s150: determining an expanded playing area based on the expanded playing operation;
s160: determining pixel-level coordinates of the expanded playing area in original video data and basic video data based on the position information of the expanded playing area;
s170: determining a minimum coverage area containing the expanded playing area in the original video data based on the pixel-level coordinates;
s180: transmitting the block original video data corresponding to the minimum coverage area to the client;
s190: and covering the block video data on the expanded playing area and then performing video display.
Further, in step S120, an independent coding algorithm is adopted for each block, and the block video data after each block performs coding compression includes block position information and block timestamp information.
The step S130 includes:
receiving each encoded and compressed block video data;
and according to the block position information and the block time stamp information of each piece of coded and compressed block video data, decoding the coded and compressed block video data with the same block time stamp information, splicing the decoded block video data according to the block position information, and then playing the spliced block video data at a client.
The extended play operation in step S140 is an operation of viewing details of a picture, and includes enlarging the picture, and moving the picture up and down and left and right in an enlarged state.
To further save bandwidth, the step S180 includes:
compressing the block original video data and transmitting the compressed block original video data to the client;
the step S190 includes:
the client side decodes all the original video data of the blocks and then splices the original video data to form a covering picture;
and covering the extended playing area with the covering picture.
Meanwhile, in order to satisfy the further focusing of the client target region of interest, the step S190 further includes:
cutting out an area of interest from the overlay;
and covering the region of interest with the expanded playing region.
The technical scheme of the invention can be automatically realized by computer equipment or a system based on computer program instructions.
Accordingly, in a second aspect of the present invention, an on-demand high resolution video presentation system is provided, the video presentation system being coupled to a video source server.
In terms of program module structure, the system includes:
the client resolution acquisition module is used for acquiring the playing parameters of the video player supported by the client;
the down-sampling module is used for down-sampling the original high-resolution video to obtain basic video data of a second resolution;
specifically, the second resolution is determined by the playing parameters of the video player supported by the client.
The video blocking module is used for blocking the basic video to obtain a plurality of blocked basic videos;
the block encoding module is used for performing compression encoding on each block basic video to obtain a plurality of compression basic video blocks;
the block transmission module is used for transmitting each compressed basic video block to the decoding playing module of the client;
the decoding playing module receives all compressed basic video blocks and then executes decoding playing at the client;
the extended play operation identification module is used for identifying whether an extended play operation exists at the current client side, and when the extended play operation exists, determining an extended play area based on the extended play operation;
the original covering and blocking request module is used for determining pixel-level coordinates of the extended playing area in the original high-resolution video and the basic video data based on the position information of the extended playing area, and then requesting block original video data corresponding to the minimum covering area of the extended playing area in the original high-resolution video from the video source server;
and the decoding playing module receives the block original video data to cover the expanded playing area and then performs video display.
In a third aspect, based on the system of the second aspect, the invention provides an on-demand high-resolution video presentation apparatus, which includes the on-demand high-resolution video presentation system.
Specifically, the device may be a visualization client, where the visualization client includes a processor and a storage medium storing computer-executable instructions, and the client executes the executable instructions through the processor to implement the on-demand high-resolution video presentation method according to the first aspect.
The present invention can also be realized as a computer medium having stored thereon computer program instructions, which, when executed, implement the method for on-demand high resolution video presentation according to the first aspect.
The present invention may also be embodied as a computer program product loaded on a computer storage medium, where the program is executed by a processor, so as to implement the above-mentioned method for displaying high-resolution video on demand.
Compared with the prior art, the method and the system have the advantages that the functions of playing different areas of the high-definition original video picture according to needs by matching the client and the server are realized, the requirement on network transmission bandwidth is reduced under the condition of not reducing user experience, and the popularity is very strong.
Further advantages of the invention will be apparent in the detailed description section in conjunction with the drawings attached hereto.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flowchart illustrating the overall steps of a method for on-demand delivery of high-resolution video presentation, in accordance with one embodiment of the present invention;
FIG. 2 is a schematic diagram of a coordinate representation of the location information of the tiles of the method of FIG. 1;
FIG. 3 (a) is a basic video playback page;
FIG. 3 (b) is a page effect on a direct magnified display of interest in the underlying video;
FIG. 4 shows the page effect of the amplified display of interest in the base video after the technical solution of the present invention is adopted;
FIG. 5 is a schematic diagram of the coordinate positions of the region of interest in the original video and the base video;
6 (a) -6 (b) are schematic diagrams of the extended area coverage of the region of interest;
FIG. 7 is a schematic diagram illustrating control of data flow during execution of the method of FIG. 1;
fig. 8 is a schematic diagram of inserting time stamps and position stamps when encoding is performed on a single block video;
FIG. 9 is a block architecture diagram of a high-resolution video-on-demand presentation system that performs the method described in FIG. 1.
Detailed Description
The invention is further described with reference to the following drawings and detailed description.
Referring to fig. 1, fig. 1 is a flowchart illustrating the overall steps of a method for presenting a high-resolution video for transmission on demand according to an embodiment of the present invention.
The overall process steps illustrated in fig. 1 include steps S110 to S190, and each step is specifically implemented as follows:
s110: acquiring original video data of a first resolution ratio, and performing downsampling to obtain basic video data of a second resolution ratio;
s120: performing coding compression after partitioning the basic video data;
s130: transmitting the video after the coding compression to a client for playing;
s140: receiving an expanded playing operation of a user when playing a video;
s150: determining an expanded playing area based on the expanded playing operation;
s160: determining pixel-level coordinates of the expanded playing area in the original video data and the basic video data based on the position information of the expanded playing area;
s170: determining a minimum coverage area containing the expanded playing area in original video data based on the pixel-level coordinates;
s180: transmitting the block original video data corresponding to the minimum coverage area to the client;
s190: and covering the block video data in the expanded playing area and then displaying the video.
Hereinafter, each step will be specifically and schematically described with reference to specific examples.
In step S110, the second resolution is determined by the playing parameters of the video player supported by the client.
As an example, the raw video data of the first resolution is high definition video up to two 4K or 8K resolutions, while having a large field of view.
And (3) downsampling an original video picture, wherein the size resolution of the video picture obtained after downsampling is not more than the highest resolution of a terminal used by a user, for example, when the user watches a video by using a high-definition television, the resolution after downsampling is preferably not more than 1920x1080. We refer to the video at this resolution as the base video that matches the class of terminals, hereinafter referred to as base video.
In more instances where multiple terminals are viewing the video, multiple resolutions may need to be downsampled to match different minimum resolutions for different terminals.
For example, the original picture resolution is 7680x4320, and we choose the lowest resolution to be 1920x1080.
Next, in S120, the base video data is partitioned and then encoded and compressed.
Blocking the base video may be considered as performing gridding segmentation on the base video, including horizontal segmentation, vertical segmentation, and gridding vertical and horizontal stripe segmentation.
In one embodiment, the terminal is capable of decoding no less than 4 blocks of video simultaneously. For example, the maximum decoding capability of the terminal is 4 1920x1080, each block size cannot be larger than 1920x1080.
In addition, in order to solve the problem of uneven boundary transition between picture blocks caused by video coding and decoding, an overlapping area must be arranged between the block pictures, and a server side must be capable of accurately describing the overlapping area and informing the client side of the overlapping area.
The image blocking information must contain enough information to ensure that the blocked video pictures can be recombined according to the information, for example, as follows:
assuming that the original image resolution is 7680x4320, the original image is firstly divided into 10x10 blocks, each block has a size of 768x432, and then each block is respectively expanded to the four sides by 8 pixels, so that 100 blocks with a size of 784x448 are obtained, and the size of the whole image becomes 7696x4336 due to edge expansion. We record the image blocking information as follows:
based on the above description, we can easily obtain the blocking manner of the image and the size of each block.
The above is only an example of the gridding blocking mode, and for the horizontal or vertical blocking mode, we can write similar blocking description information.
Each video picture area obtained by blocking is independently coded, and a coding algorithm can adopt a standard algorithm (such as H264, H265, MPEG-2 and the like) or a self-defined algorithm. It is not within the scope of the present invention to discuss which video encoding algorithm is used, nor is the present invention limited thereto.
As a further improvement, in step S120, an independent coding algorithm is adopted for each partition, and the partitioned video data after each partition performs coding compression includes partition position information and partition time stamp information.
That is, in the present embodiment, the encoded output data includes, in addition to the encoded data, position information of the block in the entire picture, and time stamp information of each frame of the picture. This information will be used for later video reconstruction.
The location information may be represented in a variety of forms. For example in the form of block coordinates.
Taking fig. 2 as an example, the coordinates of the position of the upper left block are (0, 0), and the coordinates of the lower right block are (7, 4).
The coordinate representation is only one of the representation methods, and other representation methods may be adopted as long as the position of the block in the complete screen can be accurately described.
In addition, the data output by encoding also includes the time stamp information of each frame, and the time stamp information requires that the sub-pictures of each block in the same picture have the same time stamp information. The accuracy of the time stamp must be sufficient to distinguish between pictures at different times. For example in milliseconds, microseconds, or nanoseconds, or in 1/90000 seconds as is commonly used in video transmission systems, etc.
Step S130 is executed next, that is, the encoded and compressed video is transmitted to the client for playing.
Specifically, in this step, the basic video encoding data, the video blocking information, and the encoding data of each block video are transmitted to the client in response to a request from the client, and may be used for video playing.
In the transmission process, basic video and picture block description information are transmitted, and then video data after each video block is coded is transmitted as required according to a request of a client. The base video includes time stamp information, and the block video data includes position information of the block video data in the entire picture and time stamp information of each frame.
Therefore, the step S130 includes:
receiving each encoded and compressed block video data;
and according to the block position information and the block timestamp information of each piece of coded and compressed block video data, decoding the coded and compressed block video data with the same block timestamp information, splicing the decoded block video data according to the block position information, and then playing the spliced block video data at the client.
The transport channel and transport protocol may take many forms, such as MPEG2-TS, RTP, webSocket, etc., and the present invention is not limited thereto.
Specifically, the client requests the server for picture block information, and the information obtained in the step of video block encoding of the server is sent to the client;
the client requests the basic video data from the server, the server sends the basic video data, the client receives the video data and decodes the video data, and the decoded video pictures are played according to the timestamps.
However, when the client decodes and plays the base video, a panoramic picture is presented in front of the user, as shown in fig. 3 (a), and the picture is actually a video picture adapted to the terminal screen, and the resolution of the picture is not higher than that of the original video picture, so that the details of the original video picture cannot be sufficiently presented.
In order for the client to view the details of the original video frame, the client must take some actions to request the server. For example, if the screen is enlarged, and the screen is moved up and down, left and right in the enlarged state, the screen display is blurred in the base video by the direct enlarged display, as shown in fig. 3 (b).
At this point, the method continues with the steps of:
s140: receiving an expanded playing operation of a user when playing a video;
s150: determining an extended play area based on the extended play operation
S160: determining pixel-level coordinates of the expanded playing area in the original video data and the basic video data based on the position information of the expanded playing area;
s170: determining a minimum coverage area containing the extended playing area in the original video data based on the pixel-level coordinates;
s180: transmitting the block original video data corresponding to the minimum coverage area to the client;
s190: and covering the block video data in the expanded playing area and then performing video display, thereby obtaining the video display page shown in fig. 4.
Specifically, the step S180 includes:
compressing the block original video data and transmitting the compressed block original video data to the client;
the step S190 includes:
the client side decodes all the original video data of the blocks and then splices the original video data to form a covering picture;
and covering the extended playing area with the covering picture.
The step S190 further includes:
cutting out an area of interest from the overlay picture;
and covering the extended playing area with the region of interest.
Next, the detailed principles of performing steps S140-S190 will be described in detail.
As described above, the reason for receiving the extended play operation of the user when playing the video is that the client must take some operations to send a request to the server in order to enable the client to view details of the original video image. For example, an operation of enlarging a screen, moving the screen up and down and left and right in an enlarged state, and the like.
In either case, the view details are viewed, which requires the server to transmit the original video to the client. In order to save transmission bandwidth and reduce the requirement on the processing capacity of the client, the on-demand transmission method is adopted to realize the process. In short, the original video picture of which area needs to be displayed by the client is transmitted to the picture of which area, and other areas which do not need to be displayed are not transmitted to the client. To achieve this goal, the present embodiment designs the following interaction process:
the technical description of the interactive process is divided into a server and a client. The invention only describes the working principle and does not restrict the concrete equipment forms of the server and the client. The server may be a server or a dedicated hardware device. The client can be a mobile phone, a television or a PC.
Suppose all video pictures are represented in normalized coordinates with the coordinate at the top left of the picture as the origin and the coordinate at the bottom right as (1.0 ).
1. The area (called the region of interest) of the picture to be played on the terminal screen in the original video picture is determined, and the pixel-level coordinates of the area in the original video and the basic video picture are obtained.
As shown in FIG. 5, let the coordinates of the upper left corner and the lower right corner of the region of interest be (0.2 ) and (0.36, 0.29), respectively. Then its pixel coordinates in the upper left and lower right corners of the original picture are (1536, 864) and (2765, 1253), respectively. The pixel coordinates of the upper left corner and the lower right corner in the base video picture are (384, 216) and (691, 313), respectively.
2. The basic video picture of the region of interest (fig. 3 (a)) is played on the terminal screen, and since the screen resolution (1920 x 1080) is higher than the actual resolution of the basic video in the selected region, the picture of the basic video in the region needs to be digitally enlarged so as to adapt to the screen size. The picture is blurred, and much details cannot be seen. As shown in fig. 3 (b).
3. The positions of the minimum blocks in the original video picture which can completely cover the region of interest are calculated, and the positions are called covering blocks. As shown in fig. 6 (a), the light region is a region of interest, and the dark region is a block. And records the relative coordinate positions of the selected area in the area consisting of the overlay tiles (i.e., x1, y1, x2, y2 in fig. 6 (b)).
4. The client requests the video data covering the block from the server.
5. And the server side sends the data covering the blocks to the client side.
6. The client decodes all the video data covering the tiles and stitches them into one rectangular picture (as shown in the dark part of fig. 6 (b)). In this process, it is ensured that the timestamps of all the blocked pictures that are spliced to the same picture are the same.
7. The client cuts out the region of interest from the spliced picture, and overlays this region on the basic video playing picture (i.e., the picture in fig. 3 (b)) described in step 2 of this section, and presents the basic video playing picture to the client screen. As shown in fig. 4. The image definition is greatly improved than the original image definition, and the image details are fully displayed.
Through the steps, the function of playing different areas of the original high-definition video picture on demand by matching the client and the server is realized.
Specific data flow process of the above process referring to fig. 7, fig. 7 is a schematic diagram of data flow transmission control during execution of the method shown in fig. 1.
In fig. 7, the solid line part is the control data stream of steps S110-S130, and the dotted line part shows the control data stream of steps S140-S190, i.e. the dotted line part is optional and is only executed when detecting the extended play operation of the user when playing the video.
Step S120 performs coding compression after the basic video data is partitioned.
In specific implementation, an independent coding algorithm is adopted for each block, and the block video data after each block performs coding compression comprises block position information and block timestamp information. Fig. 8 is a schematic diagram of inserting time stamps and position stamps when encoding is performed on a single block video.
The technical scheme of the invention can be automatically realized by computer equipment based on computer program instructions.
Referring to fig. 9, fig. 9 is a block architecture diagram of a high-resolution video presentation system that performs the method described in fig. 1 for transmission on demand.
FIG. 9 illustrates an on-demand high resolution video presentation system connected to a video source server.
The system comprises:
the client resolution acquisition module is used for acquiring the playing parameters of the video player supported by the client;
the down-sampling module is used for down-sampling the original high-resolution video to obtain basic video data of a second resolution;
the video blocking module is used for blocking the basic video to obtain a plurality of blocked basic videos;
the block encoding module is used for performing compression encoding on each block basic video to obtain a plurality of compression basic video blocks;
the block transmission module is used for transmitting each compressed basic video block to the decoding playing module of the client;
the decoding playing module receives all compressed basic video blocks and then executes decoding playing at the client;
the extended playing operation identification module is used for identifying whether the current client has extended playing operation or not, and when the extended playing operation exists, determining an extended playing area based on the extended playing operation;
the original covering blocking request module is used for determining pixel-level coordinates of the extended playing area in original high-resolution video and basic video data based on the position information of the extended playing area and then requesting block original video data corresponding to the minimum covering area of the extended playing area in the original high-resolution video from the video source server;
and the decoding playing module receives the original video data of the block to cover the expanded playing area and then performs video display.
Specifically, the block original video data is compressed and then transmitted to the client;
the client side decodes all the original video data of the blocks and then splices the original video data to form a covering picture;
and covering the extended playing area with the covering picture.
The second resolution is determined by the playing parameters of the video player supported by the client.
As an example, the original video data of the first resolution is a high definition video up to two 4K or 8K resolutions while having a large field of view.
The original video picture is down-sampled, the size resolution of the video picture obtained after down-sampling does not exceed the highest resolution of a terminal used by a user, for example, when the user watches a video by using a high-definition television, the resolution after down-sampling is preferably not more than 1920x1080. We refer to the video at this resolution as the base video that matches this class of terminals, hereinafter referred to as base video.
In more instances where multiple terminals are viewing the video, multiple resolutions may need to be downsampled to match different minimum resolutions for different terminals.
In hardware implementation, the present invention provides a transmission-on-demand high resolution video presentation apparatus, which includes the aforementioned transmission-on-demand high resolution video presentation system.
Specifically, the device may be a visualization client, where the visualization client includes a processor and a storage medium storing computer executable instructions, and the client executes the executable instructions through the processor to implement the method for displaying a high-resolution video transmitted on demand according to the first aspect.
The present invention can also be realized as a computer medium having stored thereon computer program instructions for executing the program instructions to implement the method for on-demand transmission of high-resolution video presentation according to the first aspect.
The present invention may also be embodied as a computer program product, which is loaded into a computer storage medium and executed by a processor to implement the method for on-demand delivery of high-resolution video presentation.
The invention realizes the function of playing different areas of the high-definition original video picture on demand by matching the client and the server, reduces the requirement on network transmission bandwidth under the condition of not reducing user experience, and has strong popularity.
Finally, it should be noted that: although the present invention has been described in detail with reference to the above embodiments, it should be understood by those skilled in the art that: modifications and equivalents may be made to the embodiments of the invention without departing from the spirit and scope of the invention, which is to be covered by the claims.
Claims (10)
1. A method for on-demand delivery of high resolution video presentation, the method comprising:
s110: acquiring original video data of a first resolution ratio, and performing downsampling to obtain basic video data of a second resolution ratio;
s120: performing coding compression after partitioning the basic video data;
s130: transmitting the video after the coding compression to a client for playing;
s140: receiving an expanded playing operation of a user when playing a video;
s150: determining an expanded playing area based on the expanded playing operation;
s160: determining pixel-level coordinates of the expanded playing area in original video data and basic video data based on the position information of the expanded playing area;
s170: determining a minimum coverage area containing the expanded playing area in the original video data based on the pixel-level coordinates;
s180: transmitting the block original video data corresponding to the minimum coverage area to the client;
s190: and covering the block video data on the expanded playing area and then performing video display.
2. A method for on-demand high resolution video presentation as claimed in claim 1,
in step S120, an independent coding algorithm is adopted for each block, and the block video data after each block performs coding compression includes block position information and block timestamp information.
3. A method for on-demand delivery of high-resolution video presentation as claimed in claim 2,
the step S130 includes:
receiving each encoded and compressed block video data;
and according to the block position information and the block timestamp information of each piece of coded and compressed block video data, decoding the coded and compressed block video data with the same block timestamp information, splicing the decoded block video data according to the block position information, and then playing the spliced block video data at the client.
4. A method for on-demand delivery of high-resolution video presentation as claimed in claim 1,
the expanding play operation in step S140 includes moving the magnified picture up, down, left, and right under the magnified state.
5. A method for on-demand high resolution video presentation as claimed in claim 1,
the step S180 includes:
compressing the block original video data and transmitting the compressed block original video data to the client;
the step S190 includes:
the client side decodes all the original video data of the blocks and then splices the original video data to form a covering picture;
and covering the extended playing area with the covering picture.
6. The method for on-demand high resolution video presentation of claim 5,
the step S190 further includes:
cutting out an area of interest from the overlay picture;
and covering the extended playing area with the region of interest.
7. An on-demand high resolution video presentation system, the video presentation system coupled to a video source server, the system comprising:
the client resolution acquisition module is used for acquiring the playing parameters of the video player supported by the client;
the down-sampling module is used for down-sampling the original high-resolution video to obtain basic video data of a second resolution;
the video blocking module is used for blocking the basic video to obtain a plurality of blocked basic videos;
the block encoding module is used for performing compression encoding on each block basic video to obtain a plurality of compression basic video blocks;
the block transmission module is used for transmitting each compressed basic video block to the decoding and playing module of the client;
the decoding playing module receives all compressed basic video blocks and then executes decoding playing at the client; the extended playing operation identification module is used for identifying whether the current client has extended playing operation or not, and when the extended playing operation exists, determining an extended playing area based on the extended playing operation;
the original covering blocking request module is used for determining pixel-level coordinates of the extended playing area in original high-resolution video and basic video data based on the position information of the extended playing area and then requesting block original video data corresponding to the minimum covering area of the extended playing area in the original high-resolution video from the video source server;
and the decoding playing module receives the block original video data to display the video after covering the expanded playing area.
8. An on-demand high resolution video presentation system as claimed in claim 7, wherein:
the second resolution is determined by the playing parameters of the video player supported by the client.
9. A transmission-on-demand high resolution video presentation apparatus comprising a transmission-on-demand high resolution video presentation system as claimed in claim 7 or 8.
10. A visualization client comprising a processor and a storage medium storing computer-executable instructions, the client implementing a method for on-demand delivery of high-resolution video presentation as claimed in any one of claims 1 to 6 by execution of the executable instructions by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210164439.2A CN115580738B (en) | 2022-02-23 | 2022-02-23 | High-resolution video display method, device and system for on-demand transmission |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210164439.2A CN115580738B (en) | 2022-02-23 | 2022-02-23 | High-resolution video display method, device and system for on-demand transmission |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115580738A true CN115580738A (en) | 2023-01-06 |
| CN115580738B CN115580738B (en) | 2023-09-19 |
Family
ID=84579171
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210164439.2A Active CN115580738B (en) | 2022-02-23 | 2022-02-23 | High-resolution video display method, device and system for on-demand transmission |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115580738B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116828154A (en) * | 2023-07-14 | 2023-09-29 | 湖南中医药大学第一附属医院((中医临床研究所)) | Remote video monitoring system |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104933704A (en) * | 2015-05-28 | 2015-09-23 | 西安算筹信息科技有限公司 | Three-dimensional scanning method and system |
| CN104954769A (en) * | 2015-06-15 | 2015-09-30 | 中国科学院自动化研究所 | Immersion type ultra-high-definition video processing system and method |
| CN106658011A (en) * | 2016-12-09 | 2017-05-10 | 深圳市云宙多媒体技术有限公司 | Panoramic video coding and decoding methods and devices |
| CN107087212A (en) * | 2017-05-09 | 2017-08-22 | 杭州码全信息科技有限公司 | The interactive panoramic video transcoding and player method and system encoded based on spatial scalable |
| US20170302719A1 (en) * | 2016-04-18 | 2017-10-19 | Qualcomm Incorporated | Methods and systems for auto-zoom based adaptive video streaming |
| CN107369134A (en) * | 2017-06-12 | 2017-11-21 | 上海斐讯数据通信技术有限公司 | A kind of image recovery method of blurred picture |
| CN111402126A (en) * | 2020-02-15 | 2020-07-10 | 北京中科晶上科技股份有限公司 | Video super-resolution method and system based on blocks |
| CN111553224A (en) * | 2020-04-21 | 2020-08-18 | 中国电子科技集团公司第五十四研究所 | Large remote sensing image block distribution method |
| CN111711859A (en) * | 2020-06-28 | 2020-09-25 | 北京奇艺世纪科技有限公司 | Video image processing method, system and terminal equipment |
| CN113905256A (en) * | 2021-12-10 | 2022-01-07 | 北京拙河科技有限公司 | Video data processing method, device and system supporting interactive watching |
-
2022
- 2022-02-23 CN CN202210164439.2A patent/CN115580738B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104933704A (en) * | 2015-05-28 | 2015-09-23 | 西安算筹信息科技有限公司 | Three-dimensional scanning method and system |
| CN104954769A (en) * | 2015-06-15 | 2015-09-30 | 中国科学院自动化研究所 | Immersion type ultra-high-definition video processing system and method |
| US20170302719A1 (en) * | 2016-04-18 | 2017-10-19 | Qualcomm Incorporated | Methods and systems for auto-zoom based adaptive video streaming |
| CN106658011A (en) * | 2016-12-09 | 2017-05-10 | 深圳市云宙多媒体技术有限公司 | Panoramic video coding and decoding methods and devices |
| CN107087212A (en) * | 2017-05-09 | 2017-08-22 | 杭州码全信息科技有限公司 | The interactive panoramic video transcoding and player method and system encoded based on spatial scalable |
| CN107369134A (en) * | 2017-06-12 | 2017-11-21 | 上海斐讯数据通信技术有限公司 | A kind of image recovery method of blurred picture |
| CN111402126A (en) * | 2020-02-15 | 2020-07-10 | 北京中科晶上科技股份有限公司 | Video super-resolution method and system based on blocks |
| CN111553224A (en) * | 2020-04-21 | 2020-08-18 | 中国电子科技集团公司第五十四研究所 | Large remote sensing image block distribution method |
| CN111711859A (en) * | 2020-06-28 | 2020-09-25 | 北京奇艺世纪科技有限公司 | Video image processing method, system and terminal equipment |
| CN113905256A (en) * | 2021-12-10 | 2022-01-07 | 北京拙河科技有限公司 | Video data processing method, device and system supporting interactive watching |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116828154A (en) * | 2023-07-14 | 2023-09-29 | 湖南中医药大学第一附属医院((中医临床研究所)) | Remote video monitoring system |
| CN116828154B (en) * | 2023-07-14 | 2024-04-02 | 湖南中医药大学第一附属医院((中医临床研究所)) | Remote video monitoring system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115580738B (en) | 2023-09-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7271849B2 (en) | Method and apparatus for encoding video content | |
| US8155202B2 (en) | System and method for encoding scrolling raster images | |
| CN109983500B (en) | Flat panel projection of reprojected panoramic video pictures for rendering by an application | |
| US10672102B2 (en) | Conversion and pre-processing of spherical video for streaming and rendering | |
| US7145947B2 (en) | Video data processing apparatus and method, data distributing apparatus and method, data receiving apparatus and method, storage medium, and computer program | |
| US9414065B2 (en) | Dynamic image distribution system, dynamic image distribution method and dynamic image distribution program | |
| US20020021353A1 (en) | Streaming panoramic video | |
| US20110229106A1 (en) | System for playback of ultra high resolution video using multiple displays | |
| US20170272777A1 (en) | Manipulating sub-pictures of a compressed video signal | |
| US10958950B2 (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
| CN111711859A (en) | Video image processing method, system and terminal equipment | |
| KR20170091323A (en) | Image Display Apparatus, Driving Method of Image Display Apparatus, and Computer Readable Recording Medium | |
| US9226003B2 (en) | Method for transmitting video signals from an application on a server over an IP network to a client device | |
| US8854435B2 (en) | Viewpoint navigation | |
| CN115580738B (en) | High-resolution video display method, device and system for on-demand transmission | |
| US20220053127A1 (en) | Image Processing Method, Apparatus and System, Network Device, Terminal and Storage Medium | |
| US20200213631A1 (en) | Transmission system for multi-channel image, control method therefor, and multi-channel image playback method and apparatus | |
| CN117291810B (en) | Video frame processing method, device, equipment and storage medium | |
| US20220343457A1 (en) | Rank information in immersive media processing | |
| CN117676274A (en) | Video processing method, device and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |