CN115580738B - High-resolution video display method, device and system for on-demand transmission - Google Patents
High-resolution video display method, device and system for on-demand transmission Download PDFInfo
- Publication number
- CN115580738B CN115580738B CN202210164439.2A CN202210164439A CN115580738B CN 115580738 B CN115580738 B CN 115580738B CN 202210164439 A CN202210164439 A CN 202210164439A CN 115580738 B CN115580738 B CN 115580738B
- Authority
- CN
- China
- Prior art keywords
- video
- block
- video data
- playing
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2385—Channel allocation; Bandwidth allocation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Abstract
The invention provides a high-resolution video display method, equipment and a system for on-demand transmission, and belongs to the technical field of video transmission and processing. The method comprises the steps of downsampling, executing coding compression after blocking, playing video, receiving expansion playing operation of a user when playing the video, determining an expansion playing area, determining a minimum coverage area containing the expansion playing area in original video data, transmitting block original video data corresponding to the minimum coverage area to a client, covering the expansion playing area with the block video data, and then performing video display. The video display system is connected with the video source server and comprises a client resolution acquisition module, a downsampling module, a video blocking module, a blocking coding module, a blocking transmission module, an expansion playing operation identification module, an original coverage blocking request module and a decoding playing module. The on-demand transmission method provided by the invention can reduce the requirement on network transmission bandwidth under the condition of not reducing user experience.
Description
Technical Field
The invention provides a high-resolution video display method, equipment and a system for on-demand transmission, and belongs to the technical field of video transmission and processing.
Background
In service applications such as panoramic video display, video sources often have very high definition and very large visual field range, and the resolution of the video generally reaches two 4K or 8K, and is continuously improved, so that the visual experience of users is improved.
High definition video results in a very high bandwidth communication network between such video live or on demand if the full video is provided directly from the server to the client. High bandwidth communication networks are costly, both in terms of availability and usage costs, and thus this approach is difficult to commercialize on a large scale.
By way of retrieval, U.S. patent publication US11159776B2 proposes a method and system for 16K panoramic video streaming on a mobile device that can quickly and losslessly convert any irregularly shaped viewport of a 16K panoramic video frame (which may be a 360 ° video frame) into a rectangular 8K frame. This edge-side transcoding enables clients to process only 8K, rather than 16K video content.
Chinese patent CN108156484B proposes an adaptive rate distribution system to divide the panoramic video into segments or tiles and assign a priority to each tile or segment based on input from a user client device (e.g., a viewport of a field of view). The adaptive rate allocation system streams each tile or segment to the user client device according to the adaptive rate allocation, which maximizes bandwidth efficiency and video quality. In this way, the adaptive rate distribution system delivers higher quality content to areas in the panoramic video that the user is currently viewing/most likely to view.
However, none of the above prior art can achieve a reduction in the network transmission bandwidth without reducing the user experience.
Disclosure of Invention
In order to solve the technical problems, the invention provides a high-resolution video display method and a system for on-demand transmission, and computer equipment and a storage medium for realizing the method.
In a first aspect of the present invention, a high resolution video presentation method for on-demand transmission is presented, the method comprising:
s110: acquiring original video data with a first resolution ratio, and downsampling to obtain basic video data with a second resolution ratio;
s120: performing coding compression after the basic video data are partitioned;
s130: transmitting the encoded and compressed video to a client for playing;
s140: receiving expansion playing operation of a user when playing a video;
s150: determining an extended play area based on the extended play operation;
s160: determining pixel-level coordinates of the extended play area in the original video data and the basic video data based on the position information of the extended play area;
s170: determining a minimum coverage area containing the extended play area in the original video data based on the pixel level coordinates;
s180: transmitting the block original video data corresponding to the minimum coverage area to the client;
s190: and covering the block video data with the expanded playing area and then performing video display.
Further, in the step S120, an independent encoding algorithm is adopted for each block, and the block video data after each block is encoded and compressed includes block position information and block time stamp information.
The step S130 includes:
receiving each encoded compressed block video data;
and decoding the encoded and compressed segmented video data with the same segmented time stamp information according to the segmented position information and the segmented time stamp information of each encoded and compressed segmented video data, and splicing the decoded segmented video data according to the segmented position information and then playing the segmented video data at the client.
The expanding and playing operation in step S140 is an operation for viewing details of the picture, and includes zooming in the picture, and moving the picture up and down, left and right in the zoomed-in state.
To further save bandwidth, the step S180 includes:
compressing the block original video data and transmitting the compressed block original video data to the client;
the step S190 includes:
the client decodes the original video data of all the blocks and then splices the original video data to form a coverage picture;
and covering the extended playing area by the covering picture.
Meanwhile, to meet the further focusing of the target region of interest of the client, the step S190 further includes:
cutting out a region of interest from the overlay picture;
and covering the interested area with the expanded playing area.
The technical scheme of the invention can be realized by computer equipment or a system based on computer program instruction automation.
Accordingly, in a second aspect of the present invention, there is provided a video on demand high resolution video presentation system, the video presentation system being connected to a video source server.
On a program module structure, the system includes:
the client resolution acquisition module is used for acquiring play parameters of a video player supported by the client;
the downsampling module is used for downsampling the original high-resolution video to obtain basic video data with a second resolution;
specifically, the second resolution is determined by the playing parameters of the video player supported by the client.
The video blocking module is used for blocking the basic video to obtain a plurality of blocked basic videos;
the block coding module is used for performing compression coding on each block basic video to obtain a plurality of compressed basic video blocks;
the block transmission module is used for transmitting each compressed basic video block to the decoding playing module of the client;
the decoding and playing module receives all the compressed basic video blocks and then executes decoding and playing on the client;
the expansion play operation identification module is used for identifying whether expansion play operation exists in the current client, and determining an expansion play area based on the expansion play operation when the expansion play operation exists;
the original coverage blocking request module is used for requesting the original high-resolution video to the video source server after determining pixel-level coordinates of the extended play area in the original high-resolution video and the basic video data based on the position information of the extended play area, wherein the original high-resolution video comprises block original video data corresponding to the minimum coverage area of the extended play area;
and the decoding and playing module receives the block original video data, covers the expansion playing area and then displays the video.
In a third aspect, based on the system of the second aspect, the present invention provides, in a hardware implementation, a high-resolution video presentation device for on-demand transmission, where the device includes a high-resolution video presentation system for on-demand transmission as described above.
Specifically, the device may be a visual client, where the visual client includes a processor and a storage medium storing computer executable instructions, and the client executes the executable instructions by using the processor to implement the on-demand high-resolution video display method according to the first aspect.
The present invention may also be implemented as a computer medium having stored thereon computer program instructions for executing the program instructions to implement a transmission-on-demand high resolution video presentation method according to the first aspect.
The present invention can also be embodied in a computer program product, which is loaded onto a computer storage medium, and the program is executed by a processor, thereby implementing a high resolution video presentation method of on-demand transmission as described above.
Compared with the prior art, the method and the device realize the functions of matching the client and the server and playing different areas of the original video picture with high definition as required, and reduce the requirement on network transmission bandwidth under the condition of not reducing user experience, thereby having strong popularity.
Further advantages of the invention will be further elaborated in the description section of the embodiments in connection with the drawings.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a general flow chart of a high resolution video presentation method of on-demand transmission according to one embodiment of the present invention;
FIG. 2 is a schematic diagram of a method for representing coordinates of the location information of a block in the method shown in FIG. 1;
FIG. 3 (a) is a base video playback page;
FIG. 3 (b) is a page effect for direct enlarged display of interest in the base video;
FIG. 4 shows the effect of the page on the amplified display of interest in the base video after the technical scheme of the invention is adopted;
FIG. 5 is a schematic diagram of the coordinate locations of a region of interest in an original video and a base video;
fig. 6 (a) -6 (b) are schematic diagrams of extended area coverage areas of a region of interest;
FIG. 7 is a schematic diagram of data flow control during execution of the method of FIG. 1;
FIG. 8 is a schematic diagram of the insertion of time stamps and position stamps when encoding a single block video;
fig. 9 is a block diagram of a high resolution video presentation system that performs the on-demand transmission of the method of fig. 1.
Detailed Description
The invention will be further described with reference to the drawings and detailed description.
Referring to fig. 1, fig. 1 is an overall flowchart of a high resolution video presentation method for on-demand transmission according to one embodiment of the present invention.
The overall flow steps described in fig. 1 include S110-S190, and each step is specifically implemented as follows:
s110: acquiring original video data of a first resolution ratio, and downsampling to obtain basic video data of a second resolution ratio;
s120: performing coding compression after the basic video data are partitioned;
s130: transmitting the encoded and compressed video to a client for playing;
s140: receiving expansion playing operation of a user when playing a video;
s150: determining an extended play area based on the extended play operation;
s160: determining pixel-level coordinates of the extended play area in the original video data and the basic video data based on the position information of the extended play area;
s170: determining a minimum coverage area containing the extended play area in the original video data based on the pixel level coordinates;
s180: transmitting the block original video data corresponding to the minimum coverage area to the client;
s190: and covering the block video data with the expanded playing area and then performing video display.
The individual steps are described in detail below in connection with specific examples.
In the step S110, the second resolution is determined by a playing parameter of the video player supported by the client.
As an example, the original video data of the first resolution is a high definition video up to two 4K or 8K resolutions while having a large field of view.
And downsampling the original video picture, wherein the size resolution of the downsampled video picture is not more than the highest resolution of a terminal used by a user, for example, the user watches the video by using a high-definition television, and the downsampled resolution is preferably not more than 1920x1080. We call this resolution video the base video that matches the terminals of this type, hereinafter referred to as base video.
In more instances, where multiple terminals view video, multiple resolutions may need to be downsampled to match different minimum resolutions for different terminals.
For example, the original picture resolution is 7680x4320, and we choose the lowest resolution to be 1920x1080.
Next, in S120, the base video data is segmented and then encoded and compressed.
Partitioning the base video may be considered as meshing the base video, including horizontal splitting, vertical splitting, and meshing the crossbar splitting.
In one embodiment, the terminal is capable of decoding not less than 4 partitioned videos simultaneously. For example, the maximum decoding capability of the terminal is 4 1920x1080, then each partition size cannot be greater than 1920x1080.
In addition, in order to solve the problem of unsmooth boundary transition between picture blocks caused by video encoding and decoding, an overlapping region must exist between the block pictures, and the server must be able to accurately describe the overlapping region and inform the client of the overlapping region.
The image blocking information must contain enough information to ensure that the blocked video pictures can be recombined based on this information, for example as follows:
assuming that the resolution of the original image is 7680x4320, the original image is firstly divided into 10x10 blocks, the size of each block is 768x432, then each block is respectively expanded by 8 pixels to the periphery, and then 100 blocks with the size of 784x448 are obtained, and the whole image is changed into 7696x4336 due to edge expansion. We record the image blocking information as follows:
based on the above description, we can easily get the blocking manner of the image and the size of each block.
The above only exemplifies the grid-based partitioning approach, and for horizontal or vertical partitioning, we can write similar partitioning description information.
Each video picture area obtained by the blocking is independently encoded, and the encoding algorithm can adopt a standard algorithm (such as H264, H265, MPEG-2 and the like) or a custom algorithm. What video coding algorithm is employed is not within the scope of the present invention, nor is the present invention limited thereto.
As a further improvement, in the step S120, an independent encoding algorithm is adopted for each block, and the block video data after encoding compression is performed for each block includes block position information and block time stamp information.
That is, in this embodiment, the data to be encoded and output contains, in addition to the data obtained after encoding, the position information of the block in the entire picture and the time stamp information of each frame of picture. This information will be used for later video reorganization.
The location information may be represented in various forms. For example in the form of block coordinates.
Taking fig. 2 as an example, the position coordinates of the upper left corner block are (0, 0), and the coordinates of the lower right corner block are (7, 4).
The coordinate representation is only one of the representation methods, and other representation methods are also possible as long as the position of the block in the complete picture can be accurately described.
In addition, the data to be encoded and output also contains time stamp information of each frame, and the time stamp information requires that sub-pictures of each block in the same picture have the same time stamp information. The accuracy of the time stamps must be sufficient to distinguish between pictures at different moments. For example in milliseconds, microseconds, or nanoseconds, or in 1/90000 seconds, etc., as is commonly used in video transmission systems.
Step S130 is executed, namely, the encoded and compressed video is transmitted to the client for playing.
Specifically, the step is to transmit the basic video coding data, the video block information and the coding data of each block video to the client at the request of the client, so that the video can be played.
In the transmission process, the basic video and the picture block description information are transmitted firstly, and then video data after the video block coding is transmitted according to the requirement of a client side according to the requirement. The base video contains time stamp information, and the block video data contains position information of the base video in the whole picture and time stamp information of each frame.
Thus, the step S130 includes:
receiving each encoded compressed block video data;
and decoding the encoded and compressed segmented video data with the same segmented time stamp information according to the segmented position information and the segmented time stamp information of each encoded and compressed segmented video data, and splicing the decoded segmented video data according to the segmented position information and then playing the segmented video data at the client.
The transport channels and transport protocols may take a variety of forms, such as MPEG2-TS, RTP, webSocket, etc., and the present invention is not limited in this regard.
Specifically, the client requests the picture block information from the server, and the information obtained in the video block coding step of the server is sent to the client;
the client requests the basic video data from the server, the server sends the basic video data, the client receives the video data, decodes the video data, and plays the decoded video pictures according to the time stamp.
However, when the client decodes and plays the base video, a panoramic picture is presented to the user, as shown in fig. 3 (a), which is actually a video picture adapted to the terminal screen, and the resolution of the picture is not higher than that of the original video picture, so that the details of the original video picture cannot be fully presented.
In order for a client to view details of the original video frame, the client must take some action to make a request to the server. For example, when the screen is enlarged, the screen is moved up, down, left, and right in the enlarged state, and the screen display is blurred in the base video due to the direct enlarged display, as shown in fig. 3 (b).
At this point, the method continues with the following steps:
s140: receiving expansion playing operation of a user when playing a video;
s150: based on the extended play operation, an extended play area is determined
S160: determining pixel-level coordinates of the extended play area in the original video data and the basic video data based on the position information of the extended play area;
s170: determining a minimum coverage area containing the extended playing area in the original video data based on the pixel-level coordinates;
s180: transmitting the block original video data corresponding to the minimum coverage area to the client;
s190: and covering the expanded playing area with the block video data and then performing video display so as to obtain the video display page shown in fig. 4.
Specifically, the step S180 includes:
compressing the block original video data and transmitting the compressed block original video data to the client;
the step S190 includes:
the client decodes the original video data of all the blocks and then splices the original video data to form a coverage picture;
and covering the extended playing area by the covering picture.
The step S190 further includes:
cutting out a region of interest from the overlay picture;
and covering the interested area with the expanded playing area.
Next, the detailed principle of performing steps S140-S190 will be specifically described.
As described above, the step of receiving the extended play operation of the user when playing the video is to enable the client to watch the details of the original video frame, and the client must take some operations to send a request to the server. For example, an operation of zooming in on a screen, moving up, down, left, right, etc. in an enlarged state.
Whichever is done, in order to view the picture details, this requires the server to be able to transmit the original video picture to the client. To save transmission bandwidth and reduce the demands on client processing power, we implement this process with transmission on demand. In short, the client transmits the picture of which region as the original video picture of which region needs to be displayed, and other regions which do not need to be displayed are not transmitted to the client. To achieve this objective, the present embodiment designs the following interaction procedure:
the technical description of the interaction process is divided into a server and a client. The invention only describes the working principle, and does not restrict the specific equipment forms of the server side and the client side. The server may be a server or a dedicated hardware device. The client may be a cell phone, a television or a PC.
Assuming that all video pictures are represented in normalized coordinates, the upper left corner coordinates of the picture are the origin and the lower right corner is (1.0 ).
1. The region of the picture to be played on the terminal screen in the original video picture (called the region of interest) is determined, and the pixel-level coordinates of the region in the original video and the base video picture are obtained.
As shown in fig. 5, the upper left and lower right corner coordinates of the region of interest are set to (0.2) and (0.36,0.29), respectively. Then its upper left and lower right pixel coordinates in the original picture are (1536,864) and (2765, 1253), respectively. The upper left and lower right pixel coordinates in the base video picture are (384,216) and (691,313), respectively.
2. The base video picture of the region of interest is played on the terminal screen (fig. 3 (a)), and since the screen resolution (1920 x 1080) is now higher than the actual resolution of the base video in the selected region, it is necessary to digitally enlarge the picture of the base video in that region, thereby adapting the screen size. The picture is blurred at this time and many details cannot be seen. As shown in fig. 3 (b).
3. The locations of the least tiles in the original video picture that can completely cover the region of interest are calculated, i call them coverage tiles. As shown in fig. 6 (a), the light areas are regions of interest and the dark areas are tiles. And the relative coordinate positions of the selected regions in the region of the overlay sub-block (i.e., x1, y1, x2, y2 in fig. 6 (b)) are recorded.
4. The client requests the video data covering the block from the server.
5. And the server side sends the data of the coverage block to the client side.
6. The client decodes all the video data covering the tiles and concatenates them into one rectangular picture (as shown in the dark part of fig. 6 (b)). In this process, it is ensured that the time stamps of all the blocked pictures spliced to the same picture are identical.
7. The client cuts out the interested area from the spliced picture, covers the basic video playing picture (i.e. the picture in fig. 3 (b)) described in step 2 of this section, and presents the area to the client screen. As shown in fig. 4. The definition of the picture is greatly improved than the original picture, and the picture details are fully displayed.
Through the steps, the functions of playing different areas of the original video picture with high definition on demand by matching the client side with the server side are realized.
Specific data flow Cheng Canjian of the above procedure fig. 7, fig. 7 is a schematic diagram of data flow transmission control during execution of the method of fig. 1.
In fig. 7, the solid line portion is the control data flow of steps S110-S130, and the dotted line portion shows the control data flow of steps S140-S190, i.e. the dotted line portion is optional, and only when the extended play operation of the user is detected while playing the video is performed.
Step S120 performs encoding compression after the base video data is partitioned.
In specific implementation, an independent encoding algorithm is adopted for each block, and the block video data after each block is encoded and compressed includes block position information and block timestamp information. Fig. 8 is a schematic diagram of inserting a time stamp and a position stamp when encoding is performed on a single block video.
The technical scheme of the invention can be realized by computer equipment based on computer program instruction automation.
Referring to fig. 9, fig. 9 is a block architecture diagram of a high resolution video presentation system that performs on-demand transmission of the method described in fig. 1.
Fig. 9 illustrates a high resolution video presentation system for on-demand transmission, the video presentation system being connected to a video source server.
The system comprises:
the client resolution acquisition module is used for acquiring play parameters of a video player supported by the client;
the downsampling module is used for downsampling the original high-resolution video to obtain basic video data with a second resolution;
the video blocking module is used for blocking the basic video to obtain a plurality of blocked basic videos;
the block coding module is used for performing compression coding on each block basic video to obtain a plurality of compressed basic video blocks;
the block transmission module is used for transmitting each compressed basic video block to the decoding playing module of the client;
the decoding and playing module receives all the compressed basic video blocks and then executes decoding and playing on the client;
the expansion play operation identification module is used for identifying whether expansion play operation exists in the current client, and determining an expansion play area based on the expansion play operation when the expansion play operation exists;
the original coverage blocking request module is used for requesting the original high-resolution video to the video source server after determining pixel-level coordinates of the extended play area in the original high-resolution video and the basic video data based on the position information of the extended play area, wherein the original high-resolution video comprises block original video data corresponding to the minimum coverage area of the extended play area;
and the decoding and playing module receives the block original video data, covers the expansion playing area and then displays the video.
Specifically, the block original video data is compressed and then transmitted to the client;
the client decodes the original video data of all the blocks and then splices the original video data to form a coverage picture;
and covering the extended playing area by the covering picture.
The second resolution is determined by playback parameters of a video player supported by the client.
As an example, the original video data of the first resolution is a high definition video up to two 4K or 8K resolutions while having a large field of view.
And downsampling the original video picture, wherein the size resolution of the downsampled video picture is not more than the highest resolution of a terminal used by a user, for example, the user watches the video by using a high-definition television, and the downsampled resolution is preferably not more than 1920x1080. We call this resolution video the base video that matches the terminals of this type, hereinafter referred to as base video.
In more instances, where multiple terminals view video, multiple resolutions may need to be downsampled to match different minimum resolutions for different terminals.
In a hardware implementation, the present invention provides a high-resolution video presentation device for on-demand transmission, the device comprising a high-resolution video presentation system for on-demand transmission as described above.
Specifically, the device may be a visual client, where the visual client includes a processor and a storage medium storing computer executable instructions, and the client executes the executable instructions by using the processor to implement the on-demand high-resolution video display method according to the first aspect.
The present invention may also be implemented as a computer medium having stored thereon computer program instructions for executing the program instructions to implement a transmission-on-demand high resolution video presentation method according to the first aspect.
The present invention can also be embodied in a computer program product, which is loaded onto a computer storage medium, and the program is executed by a processor, thereby implementing a high resolution video presentation method of on-demand transmission as described above.
The invention realizes the functions of matching the client and the server and playing different areas of the original video picture with high definition as required, and reduces the requirement on network transmission bandwidth without reducing user experience, thereby having strong popularity.
Finally, it should be noted that: the above embodiments are only for illustrating the technical aspects of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the above embodiments, it should be understood by those of ordinary skill in the art that: modifications and equivalents may be made to the specific embodiments of the invention without departing from the spirit and scope of the invention, which is intended to be covered by the claims.
Claims (4)
1. A high resolution video presentation method for on-demand transmission, the method comprising:
s110: acquiring original video data with a first resolution ratio, and downsampling to obtain basic video data with a second resolution ratio;
s120: partitioning the base video data; each video picture area obtained by the partitioning is independently coded by adopting an independent coding algorithm; the block video data after each block is coded and compressed comprises block position information and block timestamp information;
s130: transmitting the basic video coding data, the picture block description information and the coding data of each block video to a client for playing;
the picture block description information comprises block height and block width of each block and the number of pixels of each block extending to the periphery; the number of pixels extending to the periphery of each block comprises a left extension width number, a right extension width number, an upward extension width number and a downward extension width number of each block;
s140: receiving expansion playing operation of a user when playing a video;
s150: determining an extended play area based on the extended play operation;
s160: determining pixel-level coordinates of the extended play area in the original video data and the basic video data based on the position information of the extended play area;
s170: determining a minimum coverage area containing the extended play area in the original video data based on the pixel level coordinates; s180: transmitting the block original video data corresponding to the minimum coverage area to the client;
s190: covering the block video data with the expanded playing area and then performing video display;
the step S180 includes:
compressing the block original video data and transmitting the compressed block original video data to the client;
the step S190 includes:
the client decodes the original video data of all the blocks and then splices the original video data to form a coverage picture;
cutting out a region of interest from the overlay picture;
and covering the interested area with the expanded playing area.
2. A high resolution video presentation on demand method as claimed in claim 1, wherein,
the step S130 includes:
receiving each encoded compressed block video data;
and decoding the encoded and compressed segmented video data with the same segmented time stamp information according to the segmented position information and the segmented time stamp information of each encoded and compressed segmented video data, and splicing the decoded segmented video data according to the segmented position information and then playing the segmented video data at the client.
3. A high resolution video presentation on demand method as claimed in claim 1, wherein,
the expanding playing operation in step S140 includes zooming in the picture, and moving the picture up and down, left and right in the zoomed-in state.
4. A visualization client comprising a processor and a storage medium storing computer-executable instructions,
the client executes the executable instructions via the processor to implement a high resolution video presentation on demand method as claimed in any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210164439.2A CN115580738B (en) | 2022-02-23 | 2022-02-23 | High-resolution video display method, device and system for on-demand transmission |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210164439.2A CN115580738B (en) | 2022-02-23 | 2022-02-23 | High-resolution video display method, device and system for on-demand transmission |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115580738A CN115580738A (en) | 2023-01-06 |
| CN115580738B true CN115580738B (en) | 2023-09-19 |
Family
ID=84579171
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210164439.2A Active CN115580738B (en) | 2022-02-23 | 2022-02-23 | High-resolution video display method, device and system for on-demand transmission |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115580738B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116828154B (en) * | 2023-07-14 | 2024-04-02 | 湖南中医药大学第一附属医院((中医临床研究所)) | Remote video monitoring system |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104933704A (en) * | 2015-05-28 | 2015-09-23 | 西安算筹信息科技有限公司 | Three-dimensional scanning method and system |
| CN104954769A (en) * | 2015-06-15 | 2015-09-30 | 中国科学院自动化研究所 | Immersion type ultra-high-definition video processing system and method |
| CN106658011A (en) * | 2016-12-09 | 2017-05-10 | 深圳市云宙多媒体技术有限公司 | Panoramic video coding and decoding methods and devices |
| CN107087212A (en) * | 2017-05-09 | 2017-08-22 | 杭州码全信息科技有限公司 | The interactive panoramic video transcoding and player method and system encoded based on spatial scalable |
| CN107369134A (en) * | 2017-06-12 | 2017-11-21 | 上海斐讯数据通信技术有限公司 | A kind of image recovery method of blurred picture |
| CN111402126A (en) * | 2020-02-15 | 2020-07-10 | 北京中科晶上科技股份有限公司 | Video super-resolution method and system based on blocks |
| CN111553224A (en) * | 2020-04-21 | 2020-08-18 | 中国电子科技集团公司第五十四研究所 | Large remote sensing image block distribution method |
| CN111711859A (en) * | 2020-06-28 | 2020-09-25 | 北京奇艺世纪科技有限公司 | Video image processing method, system and terminal equipment |
| CN113905256A (en) * | 2021-12-10 | 2022-01-07 | 北京拙河科技有限公司 | Video data processing method, device and system supporting interactive watching |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10313417B2 (en) * | 2016-04-18 | 2019-06-04 | Qualcomm Incorporated | Methods and systems for auto-zoom based adaptive video streaming |
-
2022
- 2022-02-23 CN CN202210164439.2A patent/CN115580738B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104933704A (en) * | 2015-05-28 | 2015-09-23 | 西安算筹信息科技有限公司 | Three-dimensional scanning method and system |
| CN104954769A (en) * | 2015-06-15 | 2015-09-30 | 中国科学院自动化研究所 | Immersion type ultra-high-definition video processing system and method |
| CN106658011A (en) * | 2016-12-09 | 2017-05-10 | 深圳市云宙多媒体技术有限公司 | Panoramic video coding and decoding methods and devices |
| CN107087212A (en) * | 2017-05-09 | 2017-08-22 | 杭州码全信息科技有限公司 | The interactive panoramic video transcoding and player method and system encoded based on spatial scalable |
| CN107369134A (en) * | 2017-06-12 | 2017-11-21 | 上海斐讯数据通信技术有限公司 | A kind of image recovery method of blurred picture |
| CN111402126A (en) * | 2020-02-15 | 2020-07-10 | 北京中科晶上科技股份有限公司 | Video super-resolution method and system based on blocks |
| CN111553224A (en) * | 2020-04-21 | 2020-08-18 | 中国电子科技集团公司第五十四研究所 | Large remote sensing image block distribution method |
| CN111711859A (en) * | 2020-06-28 | 2020-09-25 | 北京奇艺世纪科技有限公司 | Video image processing method, system and terminal equipment |
| CN113905256A (en) * | 2021-12-10 | 2022-01-07 | 北京拙河科技有限公司 | Video data processing method, device and system supporting interactive watching |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115580738A (en) | 2023-01-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180192063A1 (en) | Method and System for Virtual Reality (VR) Video Transcode By Extracting Residual From Different Resolutions | |
| CN109983500B (en) | Flat panel projection of reprojected panoramic video pictures for rendering by an application | |
| US9363542B2 (en) | Techniques to provide an enhanced video replay | |
| US20020021353A1 (en) | Streaming panoramic video | |
| US10672102B2 (en) | Conversion and pre-processing of spherical video for streaming and rendering | |
| US9756328B2 (en) | System, terminal, and method for dynamically adjusting video | |
| US8831108B2 (en) | Low latency rate control system and method | |
| US20040086186A1 (en) | Information providing system and method, information supplying apparatus and method, recording medium, and program | |
| US20050253969A1 (en) | Method and apparatus for encoding video content | |
| CN1486537A (en) | Receiver apparatus, mobile terminal, and receiving system | |
| RU2718118C2 (en) | Information processing device and information processing method | |
| EP3434021B1 (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
| KR20170091323A (en) | Image Display Apparatus, Driving Method of Image Display Apparatus, and Computer Readable Recording Medium | |
| CN115580738B (en) | High-resolution video display method, device and system for on-demand transmission | |
| US20030011714A1 (en) | System and method for transmitting program data including immersive content | |
| CN110933461B (en) | Image processing method, device, system, network equipment, terminal and storage medium | |
| EP1719342B1 (en) | Method of visualizing a large still picture on a small-size display. | |
| CN111726598B (en) | Image processing method and device | |
| US20200184709A1 (en) | Dynamic rendering of low frequency objects in a virtual reality system | |
| CN114513702B (en) | Web-based block panoramic video processing method, system and storage medium | |
| KR20050065611A (en) | Manipulating sub-pictures of a compressed video signal | |
| CN117291810B (en) | Video frame processing method, device, equipment and storage medium | |
| JP2005341093A (en) | Contents adaptating apparatus, contents adaptation system, and contents adaptation method | |
| US20220343457A1 (en) | Rank information in immersive media processing | |
| CN117676274A (en) | Video processing method, device and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |