CN111614975B - Hundred million-level pixel video playing method, device, medium and equipment - Google Patents
Hundred million-level pixel video playing method, device, medium and equipment Download PDFInfo
- Publication number
- CN111614975B CN111614975B CN202010381871.8A CN202010381871A CN111614975B CN 111614975 B CN111614975 B CN 111614975B CN 202010381871 A CN202010381871 A CN 202010381871A CN 111614975 B CN111614975 B CN 111614975B
- Authority
- CN
- China
- Prior art keywords
- video
- image processing
- videos
- processing device
- hundred million
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000009877 rendering Methods 0.000 claims abstract description 25
- 230000008569 process Effects 0.000 claims abstract description 12
- 238000004590 computer program Methods 0.000 claims description 14
- 238000003860 storage Methods 0.000 claims description 8
- 238000009826 distribution Methods 0.000 claims description 3
- 238000004806 packaging method and process Methods 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 26
- 230000006870 function Effects 0.000 description 7
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Television Signal Processing For Recording (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a method, a device, a medium and equipment for playing hundred million-level pixel videos. The method comprises the following steps: distributing multi-channel videos of hundred million-level pixel videos to M image processing devices for processing according to a preset rule, wherein each image processing device processes 1 or more specified channels of videos; when a playing request of a client is received, each image processing device decodes a specified video, renders the decoded video image, and sends the rendered image to a first image processing device; and the first image processing device splices the rendered images, encodes the spliced images, packages the spliced images into a video stream, and sends the video stream to a client, wherein M is an integer greater than or equal to 2. The multi-display card is used for decoding and rendering multi-channel videos in hundred million-level pixel videos, and therefore display of hundred million-level and more than one billion-level pixel videos can be achieved. The video card can render the video without additional transmission, and the performance requirement on transmission and the bus loss are reduced.
Description
Technical Field
The invention relates to the field of video playing, in particular to a method, a device, a medium and equipment for playing hundred million-level pixel video.
Background
In the related art, the hundred million-level pixel video is shot by an array camera composed of a plurality of ultra-high-definition cameras, and the array camera comprises an array composed of a plurality of long-focus cameras and is responsible for shooting high-resolution detail video of a specific area. When playing, the video pictures shot by a plurality of tele cameras need to be decoded, but in the prior art, no matter the decoding capability of the graphics card or the central processing unit is limited, when the number of tele cameras exceeds the decoding capability of a single graphics card or the central processing unit, how to decode and render so many video pictures of the cameras becomes an urgent problem to be solved.
Disclosure of Invention
To solve the above-described problems, the present invention provides a method, apparatus, medium, and device for video playback with giga-level pixels.
According to a first aspect of the embodiments of the present disclosure, there is provided a method for playing a hundred million-level pixel video, applied to a server, including:
distributing multi-channel videos of hundred million-level pixel videos to M image processing devices for processing according to a preset rule, wherein each image processing device processes 1 or more designated videos;
when a playing request of a client is received, each image processing device decodes a specified video, renders the decoded video image, and sends the rendered image to a first image processing device;
and the first image processing device splices the rendered images, encodes the spliced images, encapsulates the spliced images into a video stream, and sends the video stream to the client, wherein M is an integer greater than or equal to 2.
Further comprising determining a first image processing means,
the determining the first image processing apparatus includes: designating the image processing apparatus as a first image processing apparatus; alternatively, the first and second liquid crystal display panels may be,
selecting the image processing apparatus with the highest image processing capability as the first image processing apparatus from the M image processing apparatuses.
When the play request does not include the target area, each image processing device decodes the specified video, and rendering the decoded video image comprises: and the image processing device decodes the specified video and places the decoded video image in a corresponding area in the original picture of the hundred million-level pixel video, wherein the video area is rendered into a video picture, and the non-video area is rendered into a single color.
When the play request includes a target area, each image processing apparatus decodes a specified video, and rendering the decoded video image includes: and the image processing device decodes the specified video in the target area, cuts the decoded video picture according to the target area, places the cut video picture in a corresponding area in the target area, renders the video area in the target area into a video picture, and renders the non-video area in the target area into a single color.
The image processing device comprises a display card and/or a central processor.
According to a second aspect of the embodiments of the present disclosure, there is provided a hundred million-level pixel video playing apparatus applied to a server, including:
the distribution module is used for distributing multi-channel videos of hundred million-level pixel videos to the M image processing devices for processing according to a preset rule, and each image processing device processes 1 or more specified channels of videos;
the decoding module is used for decoding the appointed video by each image processing device when receiving the playing request of the client, rendering the decoded video image and sending the rendered image to the first image processing device;
and the coding module is used for splicing the rendered images by the first image processing device, coding the spliced images, packaging the spliced images into a video stream, and sending the video stream to a client, wherein M is an integer greater than or equal to 2.
Further comprising:
a first image processing device determination module to determine a first image processing device, the determining the first image processing device comprising: designating the image processing apparatus as a first image processing apparatus; alternatively, the image processing apparatus with the highest image processing capability among the N image processing apparatuses is selected as the first image processing apparatus.
According to a third aspect of embodiments of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program which, when executed, implements the steps of a method for hundred million pixel video playback.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a computer device comprising a processor, a memory, and a computer program stored on the memory, the processor implementing the steps of the method for video playback with hundred million pixels when executing the computer program.
By the aid of the hundred million-level pixel video playing method, multiple display cards are used for decoding and rendering multiple paths of videos in the hundred million-level pixel videos, the display cards on the server can be easily expanded to 8 or even 10, the display cards have good expansibility, and the hundred million-level or more than one billion-level pixel videos can be played. In addition, the core function of the video card is video rendering, the decoded data is directly placed in a video memory, the video can be rendered without additional transmission, and the performance requirement on transmission and bus loss are reduced.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention. In the drawings, like reference numerals are used to indicate like elements. The drawings in the following description are directed to some, but not all embodiments of the invention. For a person skilled in the art, other figures can be derived from these figures without inventive effort.
FIG. 1 is a flow diagram illustrating a method for hundred million pixel video playback in accordance with one illustrative embodiment.
Fig. 2 is a diagram of an original picture of a giga-pel video shown in accordance with an exemplary embodiment.
FIG. 3 is a schematic diagram illustrating rendering of a gigapixel video raw picture in accordance with an example embodiment.
Fig. 4 is a schematic diagram illustrating selection of a target area in an original picture of a giga-level pixel video according to an example embodiment.
FIG. 5 is a schematic diagram illustrating rendering of a region screen according to an example embodiment.
FIG. 6 is a schematic diagram illustrating rendering of a region screen according to an example embodiment.
FIG. 7 is a diagram illustrating a stitched image according to an exemplary embodiment.
FIG. 8 is a block diagram illustrating a hundred million pixel video playback device in accordance with one illustrative embodiment.
FIG. 9 is a block diagram illustrating a hundred million pixel video playback device in accordance with an exemplary embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The hundred million-level pixel video is shot by an array camera composed of a plurality of ultra-high-definition cameras, the array camera is an array composed of a plurality of long-focus cameras, and each long-focus camera is responsible for shooting high-resolution detail video of a specific area. Therefore, the hundred million pixel video is also an array video consisting of multiple paths of videos, and the multiple paths of videos are spliced according to a specific sequence to display a complete hundred million pixel video picture. When a hundred million-level pixel video needs to be played, video pictures shot by a plurality of tele cameras need to be decoded, and a single display card or a central processor has limited decoding capability and cannot simultaneously decode and render so many videos.
To solve the above problems, a method for video playback with hundred million pixels is provided.
FIG. 1 is a flow diagram illustrating a method for hundred million pixel video playback in accordance with an exemplary embodiment. Referring to fig. 1, the method for playing the hundred million-level pixel video is applied to the server side, and includes:
in step S11, multiple paths of video of hundred million-level pixel video are distributed to M image processing devices for processing according to a preset rule, and each image processing device processes a designated 1 path or multiple paths of video. Wherein M is an integer of 2 or more.
In step S12, when receiving a play request from the client, each image processing apparatus decodes the specified video, renders the decoded video image, and sends the rendered image to the first image processing apparatus.
And step S13, the first image processing device splices the rendered images, encodes and encapsulates the spliced images into a video stream, and sends the video stream to the client.
In the embodiment of the disclosure, when the client sends a request for playing the hundred million-level pixel video to the server as needed, the client may request to play all pictures of the hundred million-level pixel video, or may request to play part of the pictures in the hundred million-level pixel video. When the video picture requested to be played only comprises one video, one image processing device can be randomly selected to decode the related video, and a corresponding video file is generated after rendering. However, when the video picture requested to be played includes more than two videos, even all videos including hundred million-pixel videos, decoding and rendering of the multiple videos will exceed the processing capability of a single image processing device, resulting in longer processing time or processing failure, which affects the viewing of the client. In step S11, according to the number of image processing devices specifically configured by the server and the number of multi-path videos included in the hundred million-level pixel videos, the multi-path videos of the hundred million-level pixel videos are distributed to M image processing devices for processing according to a preset rule, wherein M is an integer greater than or equal to 2. The image processing device can be a display card or a central processing unit. For example, taking an image processing apparatus as a graphics card as an example, assuming that a server configures 6 graphics cards, when an array of hundred million-level pixel videos is composed of 18 videos including 3 rows and 6 columns, it may be specified that 3 videos of each column are processed by one graphics card, and each graphics card only processes the specified 3 videos and does not process other videos. The specific rule is determined according to actual conditions, and the number of videos processed by each video card may be the same or different, which is not limited herein.
In one embodiment, the image processing device is a graphics card. Because a server in the prior art usually has only 1 or 2 central processors, when the video to be played includes multiple paths of videos, even if the videos are distributed according to the method, the processing capacity of the central processors is still exceeded. Therefore, the display card is selected as the image processing device, the number of the display cards on the server can be easily expanded to 8 or even 10, and the expansibility of the display card is better. And the video card has a core function of video rendering, and the decoded data is directly placed in a video memory, so that the video can be rendered without additional transmission, and the performance requirement on transmission and the bus loss are reduced.
In step S12, when receiving a playback request from the client, each image processing apparatus decodes the specified video, renders the decoded video image, and sends the rendered image to the first image processing apparatus.
The multiple image processing devices decode and render the multiple videos simultaneously, so that each image processing device can process one or multiple videos in the processing capacity of the image processing device, the video decoding and rendering speed is increased, and the user experience is improved.
In one embodiment, when the playback request does not include the target area, that is, requests playback of all videos included in the hundred million-level pixel videos, each image processing apparatus decodes the specified video, and rendering the decoded video images includes: the image processing device decodes the specified video and places the decoded video image in a corresponding area in an original picture of the hundred million-level pixel video, wherein the video area is rendered into a video picture, and the non-video area is rendered into a single color. When the playing request is to play all videos of the hundred million-level pixel videos, each image processing device decodes the appointed multiple paths of videos. Fig. 2 is a diagram illustrating an original picture of a giga-level pixel video in accordance with an example embodiment. Referring to fig. 2, an original picture of a one hundred million level pixel video includes 12 paths of video composed of 3 rows and 4 columns. Assume that the server has two image processing apparatuses, 6 out of the first two columns of videos out of 12 videos are designated to be processed by the image processing apparatus 1, and 6 out of the last two columns of videos out of 12 videos are designated to be processed by the image processing apparatus 2. The corresponding image processing device 1 decodes 6 paths of videos in the first two specified rows of videos, and places the decoded video images in corresponding areas in original pictures of hundred million-level pixel videos, wherein the video areas are rendered into video pictures, and the non-video areas are rendered into single colors. FIG. 3 is a schematic diagram illustrating rendering of a hundred million pixels video raw picture according to an example embodiment. Referring to fig. 3, after the image processing apparatus 1 decodes 6 videos in the first two specified columns of videos, the decoded video images are placed in corresponding areas in an original picture of a hundred million-level pixel video, where the original picture area includes a video area and a non-video area, the video area is rendered as a video picture, the non-video area is rendered as a single pure color, and herein, the non-video area is rendered as black.
In one embodiment, when the play request includes the target area, each image processing apparatus decodes the specified video, and rendering the decoded video image includes: the image processing device decodes the appointed video in the target area, cuts the decoded video picture according to the target area, places the cut video picture in the corresponding area in the target area, renders the video area in the target area as a video picture, and renders the non-video area in the target area as a single color. When the playing request comprises the target area, namely the client selects an interested image area in the hundred million pixel video image according to the interest of the client, each image processing device decodes the specified video in the target area, cuts the image of the decoded video according to the target area, places the cut video image in the corresponding area in the target area, renders the video area in the target area into a video image, and renders the non-video area in the target area into a single color. FIG. 4 is a schematic diagram illustrating the selection of a target region in an original picture of a hundred million pixels video according to an example embodiment. Referring to fig. 4, when the customer selects the target area of interest, the target area is shown as 5 in the figure.
Assume that the server has two image processing apparatuses, 6 out of the first two columns of videos out of 12 videos are designated to be processed by the image processing apparatus 1, and 6 out of the last two columns of videos out of 12 videos are designated to be processed by the image processing apparatus 2. As can be seen from fig. 4, the target area includes 4 videos, which are 1, 2, 3, and 4 in the figure. The 4 paths of video already designated to be processed by the image processing apparatus 1 are designated videos of the image processing apparatus 1, so that the image processing apparatus 1 decodes the designated 4 paths of video in the target area, crops the picture of the decoded video according to the target area, and places the cropped 4 video images in the corresponding area in the target area, that is, renders the 4 video images according to the position relationship in the original picture.
Assuming that the server has 4 image processing apparatuses, 3 out of the first list of videos among 12 routes of videos are designated to be processed by the image processing apparatus 1, and 3 out of the second list of videos among 12 routes of videos are designated to be processed by the image processing apparatus 2. When the client selects the target area in fig. 4, the target area includes 4 videos, which are 1, 2, 3, and 4 in the figure. The videos 1 and 2 are designated videos of the image processing device 1, the videos 3 and 4 are designated videos of the image processing device 2, and after the designated videos 1 and 2 are decoded, the images of the decoded videos 1 and 2 are cut according to the target area, and the cut video images are placed in corresponding areas in the target area for rendering. FIG. 5 is a schematic diagram illustrating rendering of a region screen according to an example embodiment. Referring to fig. 5, after the image processing apparatus 1 places the clipped video image in the corresponding area in the target area, a part of the target area is a video area, and a part of the target area is a non-video area, the video area is rendered as a video screen, and the non-video area is rendered as black. For the image processing device 2, after decoding the specified videos 3 and 4, the pictures of the decoded videos 3 and 4 are cut according to the target area, and the cut video images are placed in the corresponding areas in the target area for rendering. FIG. 6 is a schematic diagram illustrating rendering of a region screen according to an example embodiment. Referring to fig. 6, a video area in a picture is rendered as a video picture, and a non-video area is rendered as black. Comparing fig. 5 and fig. 6, it can be seen that, in the rendered picture, the video picture corresponds to the actual video position of the video in the target area.
In step S13, the first image processing apparatus splices the rendered images, encodes the spliced images, encapsulates the encoded images into a video stream, and sends the video stream to the client. Because the rendered image comprises a video image and a non-video image, and the position of the video image in the rendered image corresponds to the actual position, the rendered image can be spliced into a complete image only by superposing the rendered image and cutting off the non-video image in the image. For example, in the two rendered images shown in fig. 5 and fig. 6, the two rendered images are overlapped together and the non-video picture in the images is cut, so that the two rendered images can be spliced into a complete picture consistent with the target area. Of course, before the rendered image is sent to the first image processing device, the non-video pictures in the rendered image may be cut off, the video pictures and the corresponding coordinates are sent to the first image processing device, and the first image processing device splices the plurality of video pictures according to the corresponding coordinates to form a complete picture. FIG. 7 is a diagram illustrating a stitched image according to an exemplary embodiment. Referring to fig. 7, fig. 7 is an image corresponding to a target area. And encoding the spliced images, packaging the images into a video stream, and sending the video stream to the client, so that the client can obtain the video of the interested area.
In an embodiment, the method for playing the hundred million-level pixel video further comprises determining a first image processing device, wherein the first image processing device is used for splicing and encoding the rendered images. Determining the first image processing apparatus includes: designating the image processing apparatus as a first image processing apparatus; alternatively, the image processing apparatus with the highest image processing capability among the M image processing apparatuses is selected as the first image processing apparatus. Taking an image processing device as a graphics card, for example, a server is configured with 4 graphics cards, when a hundred million-level pixel video including 12 channels of videos shown in fig. 2 needs to be played, 3 channels of videos in each column are allocated to one graphics card to be processed, 4 graphics cards are used for decoding and rendering 3 channels of videos, the server needs to determine one graphics card as an encoding graphics card, and when the server determines the encoding graphics card, the server can uniformly schedule 4 graphics cards according to the actual use condition of each graphics card, so that the encoding capability of the 4 graphics cards is fully utilized, the resource utilization is maximized, and the performance of the whole system can also be improved. If the target area requested to be played by the client only comprises 2 paths of videos, the two video cards can process the 2 paths of videos, and one of the remaining two video cards is appointed to be used as a coding video card, so that the image processing speed is increased, and the customer experience is improved.
Through the above description, the method for playing the pixel video in the giga-level mode in the application uses the multiple display cards to decode and render multiple channels of video in the pixel video in the giga-level mode, and since the display cards on the server can be easily expanded to 8 or even 10, the display cards have good expansibility, and can play the pixel video in the giga-level or even more than one billion level. In addition, the core function of the video card is video rendering, the decoded data is directly placed in a video memory, the video can be rendered without additional transmission, and the performance requirement on transmission and bus loss are reduced.
FIG. 8 is a block diagram illustrating a hundred million pixel video playback device in accordance with an exemplary embodiment. Referring to fig. 8, the video playback apparatus with hundred million pixels is applied to a server, and includes an allocation module 801, a decoding module 802, and an encoding module 803.
The distribution module 801 is configured to distribute multiple channels of video of hundred million pixel videos to M image processing devices for processing according to a preset rule, wherein each image processing device processes a specified 1 channel or multiple channels of video. Wherein M is an integer of 2 or more.
The decoding module 802 is configured to, when receiving a play request from a client, decode a specified video by each image processing apparatus, render the decoded video image, and send the rendered image to the first image processing apparatus.
The encoding module 803 is configured to enable the first image processing apparatus to splice the rendered images, encode the spliced images, encapsulate the encoded images into a video stream, and send the video stream to the client.
FIG. 9 is a block diagram illustrating a hundred million pixel video playback device in accordance with an exemplary embodiment. Referring to fig. 9, the giga-pixel video playback apparatus further includes a first image processing apparatus determination module 901.
The first image processing apparatus determining module 901 is configured to determine a first image processing apparatus, the determining the first image processing apparatus including: designating the image processing apparatus as a first image processing apparatus; alternatively, the image processing apparatus with the highest image processing capability among the N image processing apparatuses is selected as the first image processing apparatus.
The above-described aspects may be implemented individually or in various combinations, and such variations are within the scope of the present invention.
As will be appreciated by one skilled in the art, the embodiments herein may be provided as a method, apparatus (device), or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied in the medium. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, including, but not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the computer, and the like. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.
The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices) and computer program products according to embodiments herein. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein.
In this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that an article or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such article or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of additional like elements in the article or device comprising the element.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
Claims (8)
1. A method for playing a hundred million-level pixel video is applied to a server side, and is characterized by comprising the following steps:
distributing multi-channel videos of hundred million-level pixel videos to M image processing devices for processing according to a preset rule, wherein each image processing device processes 1 or more specified channels of videos;
when a playing request of a client is received, each image processing device decodes a specified video, renders the decoded video image, and sends the rendered image to a first image processing device;
the first image processing device splices the rendered images, encodes the spliced images, packages the spliced images into a video stream, and sends the video stream to a client, wherein M is an integer greater than or equal to 2;
when the play request includes a target area, each image processing apparatus decodes a specified video, and rendering the decoded video image includes: and the image processing device decodes the specified video in the target area, cuts the decoded video picture according to the target area, places the cut video picture in a corresponding area in the target area, renders the video area in the target area into a video picture, and renders the non-video area in the target area into a single color.
2. The method for hundred million pixels video playback of claim 1, further comprising determining a first image processing means,
the determining the first image processing apparatus includes: designating the image processing apparatus as a first image processing apparatus; alternatively, the first and second electrodes may be,
selecting the image processing apparatus with the highest image processing capability as the first image processing apparatus from the M image processing apparatuses.
3. The method of one hundred million pixel video playback of claim 1, wherein when the playback request does not include a target area, each image processing apparatus decodes a specified video, and rendering the decoded video image comprises: and the image processing device decodes the specified video and places the decoded video image in a corresponding area in the original picture of the hundred million-level pixel video, wherein the video area is rendered into a video picture, and the non-video area is rendered into a single color.
4. The method for displaying megapixel video according to claim 1, wherein said image processing device comprises a video card and/or a central processing unit.
5. A hundred million-level pixel video playing device is applied to a server side and is characterized by comprising the following components:
the distribution module is used for distributing multi-channel videos of hundred million-level pixel videos to the M image processing devices for processing according to a preset rule, and each image processing device processes 1 or more specified channels of videos;
the decoding module is used for decoding the appointed video by each image processing device when receiving the playing request of the client, rendering the decoded video image and sending the rendered image to the first image processing device;
and the coding module is used for splicing the rendered images by the first image processing device, coding the spliced images, packaging the spliced images into a video stream, and sending the video stream to a client, wherein M is an integer greater than or equal to 2.
6. The hundred million-pel video playing device of claim 5, further comprising:
a first image processing device determination module for determining a first image processing device, the determining the first image processing device comprising: designating the image processing apparatus as a first image processing apparatus; alternatively, the image processing apparatus with the highest image processing capability among the M image processing apparatuses is selected as the first image processing apparatus.
7. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed, carries out the steps of the method according to any one of claims 1-4.
8. A computer arrangement comprising a processor, a memory and a computer program stored on the memory, characterized in that the processor, when executing the computer program, carries out the steps of the method according to any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010381871.8A CN111614975B (en) | 2020-05-08 | 2020-05-08 | Hundred million-level pixel video playing method, device, medium and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010381871.8A CN111614975B (en) | 2020-05-08 | 2020-05-08 | Hundred million-level pixel video playing method, device, medium and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111614975A CN111614975A (en) | 2020-09-01 |
| CN111614975B true CN111614975B (en) | 2022-07-12 |
Family
ID=72201813
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010381871.8A Active CN111614975B (en) | 2020-05-08 | 2020-05-08 | Hundred million-level pixel video playing method, device, medium and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111614975B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112272312A (en) * | 2020-11-05 | 2021-01-26 | 深圳市爱剪辑科技有限公司 | Video stitching processing method and system |
| CN113891111B (en) * | 2021-09-29 | 2023-11-21 | 北京拙河科技有限公司 | Live broadcasting method, device, medium and equipment of billion pixel video |
| CN114363530B (en) * | 2022-01-18 | 2022-08-30 | 北京拙河科技有限公司 | Cloud video monitoring method and monitoring platform based on hundred million-level pixel equipment |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102036043A (en) * | 2010-12-15 | 2011-04-27 | 成都市华为赛门铁克科技有限公司 | Video data processing method and device as well as video monitoring system |
| WO2015197815A1 (en) * | 2014-06-27 | 2015-12-30 | Koninklijke Kpn N.V. | Determining a region of interest on the basis of a hevc-tiled video stream |
| US10694192B2 (en) * | 2014-06-27 | 2020-06-23 | Koninklijke Kpn N.V. | HEVC-tiled video streaming |
| GB2530751A (en) * | 2014-09-30 | 2016-04-06 | Sony Corp | Video data encoding and decoding |
| JP6884856B2 (en) * | 2016-09-26 | 2021-06-09 | ドルビー ラボラトリーズ ライセンシング コーポレイション | Streaming of video data based on content |
| CN109996115A (en) * | 2017-12-29 | 2019-07-09 | 深圳华侨城卡乐技术有限公司 | Video broadcasting method, storage medium and player based on multiwindow rendering |
| CN108366288A (en) * | 2018-03-01 | 2018-08-03 | 厦门普杰信息科技有限公司 | A kind of efficient decoding and playback method and system for HD video |
| CN109120939B (en) * | 2018-07-16 | 2021-04-06 | 北京奇艺世纪科技有限公司 | Video App decoding method and device |
| CN110381267B (en) * | 2019-08-21 | 2021-08-20 | 成都索贝数码科技股份有限公司 | Method for realizing large-format multilayer real-time editing based on intra-frame segmentation clustering |
-
2020
- 2020-05-08 CN CN202010381871.8A patent/CN111614975B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111614975A (en) | 2020-09-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111614975B (en) | Hundred million-level pixel video playing method, device, medium and equipment | |
| CN105915937B (en) | Panoramic video playing method and device | |
| US9485493B2 (en) | Method and system for displaying multi-viewpoint images and non-transitory computer readable storage medium thereof | |
| CN111193937A (en) | Processing method, device, equipment and medium for live video data | |
| US9712835B2 (en) | Video encoding system and method | |
| CN104301769B (en) | Method, terminal device and the server of image is presented | |
| JP6707267B2 (en) | Video playback method and apparatus, and computer-readable storage medium | |
| CN108063976A (en) | A kind of method for processing video frequency and device | |
| CN111225228B (en) | Video live broadcast method, device, equipment and medium | |
| CN113891111B (en) | Live broadcasting method, device, medium and equipment of billion pixel video | |
| CN111601151A (en) | Method, device, medium and equipment for reviewing hundred million-level pixel video | |
| CN104822070A (en) | Multi-video-stream playing method and device thereof | |
| CN108337574A (en) | A kind of flow-medium transmission method and device, system, server, terminal | |
| CN110913278A (en) | Video playing method, display terminal and storage medium | |
| US20140359668A1 (en) | Method, electronic device, and computer program product | |
| US20220053127A1 (en) | Image Processing Method, Apparatus and System, Network Device, Terminal and Storage Medium | |
| CN111083504B (en) | Interaction method, device and equipment | |
| CN107484004B (en) | Video processing method and device | |
| CN112204960A (en) | Method of transmitting three-dimensional 360-degree video data, display apparatus using the same, and video storage apparatus using the same | |
| US20200213631A1 (en) | Transmission system for multi-channel image, control method therefor, and multi-channel image playback method and apparatus | |
| CN113497963B (en) | Video processing method, device and equipment | |
| US11157146B2 (en) | Display apparatus and control method thereof for providing preview content | |
| CN102811342A (en) | Video profile cut control method, device and system | |
| CN114567806A (en) | Cross-page switching method and system | |
| US11134236B2 (en) | Image processing device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211102 Address after: 518000 409, Yuanhua complex building, 51 Liyuan Road, merchants street, Nanshan District, Shenzhen, Guangdong Applicant after: Shenzhen zhuohe Technology Co.,Ltd. Address before: 100083 no.2501-1, 25th floor, block D, Tsinghua Tongfang science and technology building, No.1 courtyard, Wangzhuang Road, Haidian District, Beijing Applicant before: Beijing Zhuohe Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |