CN108040260B - Watching method, system and server of high-definition panoramic video under C/S architecture - Google Patents
Watching method, system and server of high-definition panoramic video under C/S architecture Download PDFInfo
- Publication number
- CN108040260B CN108040260B CN201711329394.5A CN201711329394A CN108040260B CN 108040260 B CN108040260 B CN 108040260B CN 201711329394 A CN201711329394 A CN 201711329394A CN 108040260 B CN108040260 B CN 108040260B
- Authority
- CN
- China
- Prior art keywords
- picture
- plane
- terminal equipment
- server
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440245—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
Abstract
The invention provides a method and a system for watching a high-definition panoramic video under a C/S architecture, a terminal and a server, wherein the method comprises the following steps: the processing server acquires the panoramic video stream from the streaming media server and acquires the view angle information from the terminal equipment; selecting a partial video stream corresponding to the view information from the panoramic video stream; and pushing the partial video stream to the terminal device; the user terminal receives a part of the video stream from the processing server; decoding the partial video stream to obtain video pictures; carrying out planarization processing on the video picture to obtain a plane picture; and displaying the planar picture. The invention can enable the existing terminal equipment with limited processing capacity to watch the high-definition video, save the bandwidth of a wireless network and improve the user experience.
Description
Technical Field
The invention relates to the technical field of computers, in particular to an image processing device, and specifically relates to a method and a system for watching a high-definition panoramic video under a client/server (C/S) architecture, and a server.
Background
In recent years, with the development and progress of computer information technology and image processing technology, the living standard of people is increasingly improved. The understanding of things is not limited to the complicated description and introduction, but is raised to the level of restoring the original appearance of objective things. Because the panoramic video can be the original appearance of an all-round objective object, compared with a single visual angle image, the panoramic video can provide a viewer with an immersive feeling, and therefore the panoramic video has great value and advantages of the panoramic video in more and more fields.
Currently, terminal devices (e.g., head-mounted visual devices, set-top boxes, mobile terminals, computers, etc.) mainly acquire panoramic video streams through a client/server (C/S) architecture, and there are two ways for terminal devices to acquire video streams: one is an online mode, that is, a terminal device requests a server at the front end for a panoramic video stream, the server pushes the panoramic video stream to the terminal device through a network, and the terminal device simultaneously decodes and plays the received panoramic video stream; the other mode is an off-line mode, and the terminal equipment starts decoding and playing after downloading the complete panoramic video file. In the above two modes, the terminal device needs to project the decoded video picture onto a spherical surface, select a corresponding area picture according to the current view angle and view field of the user, project the area picture onto a plane again, and then display the area picture on a screen for the user to watch.
In the process, the server pushes the video streams of all the visual angles to the terminal equipment through the network, and the terminal equipment decodes the video streams. Firstly, the transmission of video streams of all views needs to occupy a large network bandwidth, and meanwhile, terminal equipment is required to have a large-resolution video decoding capability. Taking 4K panoramic video as an example, a network bandwidth of about 40Mbps is required, and a terminal device is also required to be able to decode video with a resolution of 4K. Current terminal equipment does not have this capability. In the case of high-definition video display (for example, video resolution is 8K or more), the existing terminal device is more dust-resistant. Due to the fact that the data processing capacity of the terminal device is low, the high-definition panoramic video cannot be clearly and smoothly watched, immersive experience is difficult to bring to users, and the factors greatly limit the development and popularization of the panoramic video.
Therefore, how to watch high-definition panoramic video images by using the existing terminal equipment is a long-standing problem that needs to be solved by those skilled in the art.
Disclosure of Invention
In view of this, the technical problem to be solved by the present invention is to provide a method, a system, a terminal and a server for watching a high definition panoramic video under a C/S architecture, so as to solve the problem that the existing terminal device cannot be used to watch a high definition panoramic video image.
In order to solve the above technical problem, a first technical solution of the present invention is to provide a method for watching a high definition panoramic video under a C/S architecture, including:
the processing server acquires the panoramic video stream from the streaming media server and acquires the view angle information from the terminal equipment; selecting a partial video stream corresponding to the view information from the panoramic video stream; and pushing the partial video stream to the terminal device;
the user terminal receives a part of the video stream from the processing server; decoding the partial video stream to obtain video pictures; carrying out planarization processing on the video picture to obtain a plane picture; and displaying the planar picture.
The second technical scheme of the invention is to provide a method for watching high-definition panoramic video under a C/S architecture, which comprises the following steps:
the processing server acquires the panoramic video stream from the streaming media server and acquires the view angle information from the terminal equipment; selecting a partial video stream corresponding to the view information from the panoramic video stream; decoding the partial video stream to obtain a video picture; carrying out planarization processing on the video picture to obtain a plane picture; the plane picture is coded, and the coded plane picture is pushed to the terminal equipment;
the terminal equipment receives the plane picture from the processing server; and decoding the plane picture and displaying.
The third technical scheme of the invention is to provide a system for watching high-definition panoramic video under a C/S architecture, which comprises the following steps:
the system comprises a video source, a streaming media server connected with the video source, a processing server connected with the streaming media server, and terminal equipment connected with the processing server;
wherein, the video source is used for providing closed pictures;
the streaming media server is used for coding the closed picture into a panoramic video stream;
the processing server is used for selecting a part of video streams corresponding to the view angle information from the panoramic video streams and pushing the part of video streams to the terminal equipment;
the terminal device is used for decoding and displaying the part of the video stream after planarization processing.
The fourth technical scheme of the invention is to provide a system for watching high-definition panoramic video under a C/S architecture, which comprises the following steps:
the system comprises a video source, a streaming media server connected with the video source, a processing server connected with the streaming media server, and terminal equipment connected with the processing server;
wherein, the video source is used for providing closed pictures;
the streaming media server is used for coding the closed picture into a panoramic video stream;
the processing server is used for selecting a part of video stream corresponding to the view information from the panoramic video stream, and decoding the part of video stream to obtain a video picture; carrying out planarization processing on the video picture to obtain a plane picture; coding the plane picture, and pushing the coded plane picture to the terminal equipment;
the terminal equipment is used for decoding the plane picture and then displaying the plane picture.
The fifth technical scheme of the invention is to provide a method for watching high-definition panoramic video under a C/S architecture, which comprises the following steps:
the processing server acquires a closed picture from the video source; dividing the closed picture into a plurality of area pictures, wherein different area pictures cover different view angle ranges; pushing the area pictures to a streaming media server;
the streaming media server acquires a plurality of area pictures from the processing server and acquires visual angle information from the terminal equipment, wherein different area pictures cover different visual angle ranges; selecting a corresponding area picture from the plurality of area pictures according to the visual angle information, coding the corresponding area picture, and pushing the coded area picture to the terminal equipment;
the terminal equipment receives the area picture from the streaming media server; carrying out planarization treatment on the area picture so as to obtain a plane picture; and displaying the planar picture.
The sixth technical scheme of the invention is to provide a method for watching high-definition panoramic video under a C/S architecture, which comprises the following steps:
the processing server acquires a closed picture from the video source; dividing the closed picture into a plurality of area pictures, wherein different area pictures cover different view angle ranges; carrying out planarization treatment on the area picture to obtain a plane picture; sending the plane picture to a streaming media server;
the streaming media server acquires a plurality of plane pictures from the processing server and acquires visual angle information from the terminal equipment, wherein different plane pictures cover different visual angle ranges; selecting a corresponding plane picture from the plurality of plane pictures according to the visual angle information, coding the corresponding plane picture, and pushing the coded plane picture to the terminal equipment;
and the terminal equipment is used for receiving and displaying the plane picture.
The seventh technical scheme of the invention is to provide a system for watching high-definition panoramic video under a C/S architecture, which comprises the following steps:
the system comprises a video source, a processing server connected with the video source, a streaming media server connected with the processing server, and terminal equipment connected with the streaming media server;
wherein, the video source is used for providing closed pictures;
the processing server is used for dividing the closed picture into a plurality of regional pictures covering different view angle ranges;
the streaming media server is used for selecting a corresponding area picture from the multiple area pictures according to the view angle information of the terminal equipment, coding the corresponding area picture and pushing the coded area picture to the terminal equipment;
and the terminal equipment is used for carrying out display after the area picture is subjected to planarization treatment.
The eighth technical solution of the present invention is to provide a system for watching a high definition panoramic video under a C/S architecture, comprising:
the system comprises a video source, a processing server connected with the video source, a streaming media server connected with the processing server, and terminal equipment connected with the streaming media server;
wherein, the video source is used for providing closed pictures;
the processing server is used for dividing the closed picture into a plurality of area pictures covering different view angle ranges, and then flattening the area pictures into plane pictures;
the streaming media server is used for selecting a corresponding plane picture from a plurality of plane pictures according to the visual angle information of the terminal equipment, coding the corresponding plane picture and pushing the coded plane picture to the terminal equipment;
and the terminal equipment is used for receiving and displaying the plane picture.
According to the above embodiments of the present invention, the method and system for watching high definition panoramic video under C/S architecture at least have the following advantages: the selection of video stream or the segmentation of closed picture, the decoding and planarization treatment of partial video stream or the planarization treatment of regional picture are completed by the processing server, thereby greatly reducing the data processing amount of the terminal equipment, leading the existing terminal equipment with limited processing capability to watch high-definition video and improving the user experience.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the invention and together with the description, serve to explain the principles of the invention.
FIG. 1 is a flowchart of a first embodiment of a method for viewing a high definition panoramic video from a C/S architecture described on a processing server side according to the present invention;
FIG. 2 is a flowchart of a second embodiment of a method for viewing a high definition panoramic video from a C/S architecture described in the processing server side according to the present invention;
FIG. 3 is a schematic block diagram of a first embodiment of a processing server for viewing high definition panoramic video according to the C/S architecture of the present invention;
FIG. 4 is a schematic block diagram of a second embodiment of a processing server for viewing high definition panoramic video according to the C/S architecture of the present invention;
fig. 5 is a flowchart of a first embodiment of a method for viewing a high-definition panoramic video from a C/S architecture described on a terminal device side according to the present invention;
fig. 6 is a schematic block diagram of a first embodiment of a terminal device for watching a high-definition panoramic video under a C/S architecture according to the present invention;
FIG. 7 is a schematic structural diagram of a system for watching high definition panoramic video according to a first embodiment of the present invention;
FIG. 8 is a flowchart of a third embodiment of a method for viewing a high definition panoramic video from a C/S architecture described on a processing server side according to the present invention;
FIG. 9 is a schematic block diagram of a third embodiment of a processing server for viewing high definition panoramic video according to the C/S architecture of the present invention;
FIG. 10 is a flowchart of a first embodiment of a method for viewing a high definition panoramic video from a C/S architecture described on a streaming server side according to the present invention;
FIG. 11 is a schematic block diagram of a first embodiment of a streaming media server for watching high definition panoramic video according to the C/S architecture of the present invention;
fig. 12 is a flowchart of a second embodiment of a method for viewing a high-definition panoramic video from a C/S architecture described on the terminal device side according to the present invention;
fig. 13 is a schematic block diagram of a second embodiment of a terminal device for watching a high-definition panoramic video under the C/S architecture of the present invention;
fig. 14 is a schematic structural diagram of a second embodiment of a system for watching high-definition panoramic video under the C/S architecture of the present invention.
Detailed Description
For the purpose of promoting a clear understanding of the objects, aspects and advantages of the embodiments of the invention, reference will now be made to the drawings and detailed description, wherein there are shown in the drawings and described in detail, various modifications of the embodiments described herein, and other embodiments of the invention will be apparent to those skilled in the art.
The exemplary embodiments of the present invention and the description thereof are provided to explain the present invention and not to limit the present invention. Additionally, the same or similar numbered elements/components used in the drawings and the embodiments are used to represent the same or similar parts.
As used herein, the terms "first," "second," …, etc., do not denote any order or sequence, nor are they used to limit the present invention, but rather are used to distinguish one element from another or from another element or operation described in the same technical language.
With respect to directional terminology used herein, for example: up, down, left, right, front or rear, etc., are simply directions with reference to the drawings. Accordingly, the directional terminology used is intended to be illustrative and is not intended to be limiting of the present teachings.
As used herein, the terms "comprising," "including," "having," "containing," and the like are open-ended terms that mean including, but not limited to.
As used herein, "and/or" includes any and all combinations of the described items.
As used herein, the terms "substantially", "about" and the like are used to modify any slight variation in quantity or error that does not alter the nature of the variation. Generally, the range of slight variations or errors modified by such terms may be 20% in some embodiments, 10% in some embodiments, 5% in some embodiments, or other values. It should be understood by those skilled in the art that the aforementioned values can be adjusted according to actual needs, and are not limited thereto.
Certain words used to describe the present application are discussed below or elsewhere in this specification to provide additional guidance to those skilled in the art in describing the present application.
Fig. 1 is a flowchart of a first embodiment of a method for viewing a high definition panoramic video from a C/S architecture described in the processing server side of the present invention, where the method shown in fig. 1 includes:
step 101: and acquiring the panoramic video stream from the streaming media server, and acquiring the view angle information from the terminal equipment. Wherein the streaming server obtains a closed picture (the closed picture includes but is not limited to a spherical picture or a cubic picture) from the video source, and the streaming server encodes the closed picture into a full-scene video stream. An orientation sensor, for example, a nine-axis sensor (a three-axis acceleration sensor, a three-axis gyroscope, and a three-axis magnetometer) is installed in the terminal device, and the angle-of-view information of the terminal device can be acquired. The terminal equipment comprises head-mounted visual equipment, a set top box, a computer, a mobile terminal and the like.
Step 102: selecting a partial video stream corresponding to the view information from the panoramic video stream.
Step 103: and pushing the partial video stream to the terminal equipment. Therefore, the display is performed on the terminal equipment, and the visual experience of a user is met.
In the embodiment, the processing server selects and pushes part of the video stream to the terminal device according to the visual angle information of the terminal device, and the terminal device only decodes and displays part of the video stream, so that the data processing amount of the terminal device is greatly reduced, the high-definition panoramic video can be watched by using the existing terminal device with limited processing capacity, and the user experience is improved.
Fig. 2 is a flowchart of a second embodiment of the method for viewing a high-definition panoramic video from a C/S architecture described in the processing server side according to the present invention. Specifically, before the step 103 pushes the partial video stream to the terminal device, the method further includes:
step 103-1, decoding part of the video stream to obtain a video picture;
and 103-2, carrying out planarization processing on the video picture obtained in the step 103-1 to obtain a plane picture, namely projecting the video picture onto the plane to obtain the plane picture.
The step 103 is further to perform encoding processing on the planar picture obtained in the step 103-2, and push the encoded planar picture to the terminal device.
In this embodiment, the processing server decodes and planarizes a part of the video stream, and pushes a planar picture obtained after processing to the terminal device, so that the picture is more natural when a user watches the terminal device, and the user experience is further improved.
Fig. 3 is a schematic block diagram of a first embodiment of a processing server for viewing high-definition panoramic video under the C/S architecture of the present invention, and the processing server shown in fig. 3 can be applied to the method shown in fig. 1.
Specifically, the processing server includes: an obtaining unit 301, configured to obtain a panoramic video stream from a streaming media server, and obtain view angle information from a terminal device; a selecting unit 302 for selecting a partial video stream corresponding to the view information from a panoramic video stream; and a pushing unit 303 for pushing the partial video stream to a terminal device.
In this embodiment, the processing server only provides a part of the panoramic video stream to the terminal device according to the viewing angle information, so that the data processing amount of the terminal device is greatly reduced, the high-definition panoramic video can be watched by using the existing terminal device with limited processing capability, and the user experience is improved.
Fig. 4 is a schematic block diagram of a second embodiment of a processing server for viewing high-definition panoramic video according to the C/S architecture of the present invention, and the processing server shown in fig. 4 can be applied to the method shown in fig. 2.
Specifically, the processing server further includes: a decoding unit 304 and a planarization unit 305. The decoding unit 304 is configured to perform decoding processing on a portion of the video stream to obtain a video picture; the planarization unit 305 is configured to perform planarization processing on the video frame to obtain a planar frame, and in detail, the planarization unit 305 is specifically configured to project the video frame into the planar frame to complete the planarization processing. The pushing unit 303 is further configured to perform encoding processing on the planar picture, and push the encoded planar picture to the terminal device.
According to the embodiment, the data processing amount of the terminal equipment can be greatly reduced, so that when a user watches the terminal equipment, the picture is more natural, and the user experience is further improved.
Fig. 5 is a flowchart of a first embodiment of a method for viewing a high-definition panoramic video from a C/S architecture described on a terminal device side according to the present invention. Specifically, the method comprises the following steps:
In specific implementation, if the processing server performs decoding and planarization processing on a part of the video stream, the terminal device only needs to acquire and display a flat screen.
Based on the same inventive concept, the present invention further provides a terminal device for watching high definition panoramic video under a C/S architecture, as shown in fig. 6, the terminal device includes:
a receiving unit 601, configured to receive a partial video stream from a processing server;
a decoding unit 602, configured to decode the partial video stream to obtain a video picture;
a planarization unit 603 configured to perform planarization processing on the video picture to obtain a planar picture; and
a display unit 604, configured to display the flat screen.
In a specific implementation, if the processing server performs decoding and planarization processing on a part of the video stream, the terminal device may not include a planarization unit.
Fig. 7 is a schematic structural diagram of a system for watching high-definition panoramic video according to a C/S architecture of the present invention. Specifically, the system comprises: the system comprises a video source 701, a streaming media server 702 connected with the video source 701, a processing server 703 connected with the streaming media server 702, and a terminal device 704 connected with the processing server 703.
The video source 701 is used for providing a closed picture; the streaming media server 702 is used to encode the closed picture into a panoramic video stream; the processing server 703 is configured to obtain view information from the terminal device 704, obtain a panoramic video stream from the streaming server 702, and select a part of video streams corresponding to the view information from the panoramic video stream to push to the terminal device 704; the terminal device 704 is configured to receive a portion of the video stream from the processing server 703, decode and planarize the video stream, and display the video stream. The terminal device 704 may be connected to the processing server 703 by wire or wirelessly.
In a further embodiment, the processing server selects a part of the video stream corresponding to the view information, and performs decoding and projection (planarization) processing on the part of the video stream, so that the terminal device only needs to perform image display.
The embodiment can greatly reduce the data processing amount of the terminal equipment, and the high-definition panoramic video can be watched by using the existing terminal equipment with limited processing capacity. In addition, the processing server is in wireless connection with the terminal equipment, so that the data volume transmitted to the terminal equipment is small, and the wireless network bandwidth is saved.
Fig. 8 is a flowchart of a third embodiment of the method for viewing a high-definition panoramic video from a C/S architecture described in the processing server side. In this embodiment, the processing server directly processes the closed picture acquired from the video source, which can save processing resources of the streaming media server, and specifically, the method includes:
step 801: a closed picture is acquired from a video source. The closed picture may be uncoded or coded data, if the closed picture is coded data, the coded closed picture needs to be decoded, otherwise, the data format of the closed picture may or may not be a predetermined format, and if the format of the closed picture does not meet the requirement, transcoding is also needed.
Step 802: and dividing the closed picture into a plurality of regional pictures, wherein each regional picture is a video slice, each video slice covers a certain visual angle range, all the video slices are added to completely cover all the visual angles, and no repeated region exists between the video slices.
Step 803: and pushing the plurality of area pictures to the streaming media server so that the streaming media server pushes the corresponding area pictures to the terminal equipment according to the view angle information of the terminal equipment, wherein the corresponding area pictures refer to the area pictures which are suitable for the view angle currently watched by the user.
Further, before the step of pushing the plurality of area pictures to the streaming media server in step 803, the method further includes: and carrying out planarization processing on the area picture to obtain a plane picture so that the streaming media server pushes the corresponding plane picture to the terminal equipment according to the view angle information of the terminal equipment.
In this embodiment, the processing server performs main digital image processing, which can greatly reduce the data processing amount of the streaming media server and the terminal device, so that the existing terminal device with limited processing capability can watch the high-definition panoramic video, and improve the user experience. After the regional picture is projected into a plane picture, the picture is more natural and more accords with the watching habit of a user.
Fig. 9 is a schematic block diagram of a third embodiment of a processing server for watching a high-definition panoramic video in a C/S architecture according to a specific embodiment of the present invention. Specifically, the processing server includes:
an acquiring unit 901 configured to acquire a closed picture from a video source; if the format of the closed picture does not meet the requirement, transcoding is required;
a dividing unit 902, configured to divide the closed frame into a plurality of area frames, where different area frames cover different viewing angle ranges; and
the pushing unit 903 is configured to push a plurality of area pictures to a streaming media server, so that the streaming media server pushes the corresponding area pictures to a terminal device according to view information of the terminal device.
Further, the processing server further includes: a planarization unit 904, configured to perform planarization processing on the area picture to obtain a planar picture, so that the streaming media server pushes the corresponding planar picture to the terminal device according to the view information of the terminal device.
The processing server provided by the embodiment performs main digital image processing work, and can greatly reduce the data processing amount of the streaming media server and the terminal equipment, so that the existing terminal equipment with limited processing capacity can watch high-definition panoramic video, and the user experience is improved. After the regional picture is projected into a plane picture, the picture is more natural, the watching habit of a user is better met, and the user experience is enhanced.
Fig. 10 is a flowchart of a first embodiment of a method for viewing a high-definition panoramic video from a C/S architecture described in the streaming server side in the present invention, which is used in cooperation with the method described in fig. 8, and specifically includes:
1001, acquiring a plurality of area pictures from a processing server, and acquiring view angle information from a terminal device, wherein different area pictures cover different view angle ranges; and
and 1003, coding the corresponding area picture and pushing the picture to the terminal equipment.
Further, if the processing server performs the planarization process on the area screen, step 1001 is to acquire a plurality of plane screens from the processing server, step 1002 is to select a corresponding plane screen from the plane screens according to the view information and push the selected plane screen to the terminal device, and step 1003 is to perform the encoding process on the corresponding plane screen and then push the selected plane screen to the terminal device.
In a specific implementation, a dedicated processing server may be provided to perform the processing of steps 1001 and 1002 instead of the streaming server.
Based on the same inventive concept, as shown in fig. 11, a streaming media server corresponding to the method of fig. 10 is further provided, and specifically, the streaming media server includes:
an acquisition unit 1101 configured to acquire a plurality of area screens from a processing server, wherein different area screens cover different viewing angle ranges, and acquire viewing angle information from a terminal device; and
a selecting unit 1102, configured to select a corresponding area picture from the area pictures according to the view information;
and an encoding unit 1103, configured to perform encoding processing on the corresponding region picture and then push the region picture to the terminal device.
Further, if the processing server performs planarization processing on the area picture, the acquisition unit acquires a plurality of plane pictures from the processing server, the selection unit selects a corresponding plane picture from the plane pictures according to the view information, and the coding unit performs coding processing on the corresponding plane picture and then pushes the plane picture to the terminal device.
Fig. 12 is a flowchart of a second embodiment of a method for viewing a high definition panoramic video from a C/S architecture described in the terminal device side in the present invention, which is used in cooperation with the methods shown in fig. 8 and 10, and specifically includes:
Further, if the streaming media server obtains the flat screen from the processing server, step 1201 above receives the flat screen from the streaming media server, and step 1203 is directly executed by skipping step 1202.
Based on the same inventive concept, as shown in fig. 13, there is also provided a terminal device corresponding to the method of fig. 12, specifically, the terminal device includes:
a receiving unit 1301, configured to receive an area picture from a streaming server;
a planarization unit 1302 for projecting the area picture into a planar picture; and
and a display unit 1303 configured to display the planar picture.
Further, if the streaming server acquires a flat screen from the processing server, the terminal device may not include the flattening unit.
Fig. 14 is a schematic structural diagram of a second embodiment of a system for watching a high-definition panoramic video under a C/S architecture according to an embodiment of the present invention, specifically, the system includes: a video source 1401, a processing server 1402 connected to said video source 1401, a streaming server 1403 connected to said processing server 1402, and a terminal device 1404 connected to said streaming server 1403. Wherein the video source 1401 is used for providing closed pictures; the processing server 1402 is configured to divide the closed frame into a plurality of regional frames covering different viewing angle ranges; the streaming media server 1403 is configured to obtain a plurality of area pictures from the processing server 1402, obtain view information of the terminal device from the terminal device 1404, select a corresponding area picture from the plurality of area pictures according to the view information of the terminal device 1404, perform coding processing on the corresponding area picture, and push the coded area picture to the terminal device 1404; the terminal device 1404 is configured to receive the area picture from the streaming server 1403, planarize it, and display it. The terminal device 1404 is connected to the streaming server 1403 by wire or wirelessly.
Further, the processing server 1402, in addition to dividing the closed frame into a plurality of area frames covering different viewing angle ranges, performs planarization processing on the area frames to obtain a plurality of plane frames, pushes the plurality of plane frames to the streaming media server, and the streaming media server selects a corresponding plane frame from the plurality of plane frames according to the viewing angle information of the terminal device to push the corresponding plane frame to the terminal device.
In this embodiment, the processing server is disposed between the video source and the streaming media server, so that data processing amounts of the streaming media server and the terminal device can be greatly reduced, the existing terminal device with limited processing capability can watch the high-definition panoramic video, and user experience is improved. After the regional picture is projected into a plane picture, the picture is more natural, the watching habit of a user is better met, and the user experience is enhanced.
In addition, the streaming media server and the terminal equipment can be in wireless connection, so that the data volume transmitted to the terminal equipment is small (only the current regional picture watched by the user), the wireless network bandwidth is saved, the picture can be timely changed when the user turns, and the user cannot feel uncomfortable.
The embodiments of the invention described above may be implemented in various hardware, software code, or combinations of both. For example, an embodiment of the present invention may also be program code for executing the above method in a Digital Signal Processor (DSP). The invention may also relate to a variety of functions performed by a computer processor, digital signal processor, microprocessor, or Field Programmable Gate Array (FPGA). The processor described above may be configured according to the present invention to perform certain tasks by executing machine-readable software code or firmware code that defines certain methods disclosed herein. Software code or firmware code may be developed in different programming languages and in different formats or forms. Software code may also be compiled for different target platforms. However, the different code styles, types, and languages of software code and other types of configuration code that perform tasks in accordance with the present invention do not depart from the spirit and scope of the present invention.
The foregoing is merely an illustrative embodiment of the present invention, and any equivalent changes and modifications made by those skilled in the art without departing from the spirit and principle of the present invention should fall within the protection scope of the present invention.
Claims (8)
1. A method for watching high-definition panoramic video under a C/S architecture is characterized by comprising the following steps:
acquiring a panoramic video stream from a streaming media server, and acquiring view angle information from terminal equipment; the streaming media server is used for encoding closed pictures provided by a video source into a panoramic video stream;
selecting a partial video stream corresponding to the view information from the panoramic video stream;
decoding the partial video stream to obtain a video picture;
carrying out planarization processing on the video picture to obtain a plane picture; and
and coding the plane picture, and pushing the coded plane picture to the terminal equipment.
2. A processing server for watching high-definition panoramic video under a C/S architecture is characterized by comprising:
the system comprises an acquisition unit, a display unit and a display unit, wherein the acquisition unit is used for acquiring a panoramic video stream from a streaming media server and acquiring view angle information from terminal equipment; the streaming media server is used for encoding closed pictures provided by a video source into a panoramic video stream;
a selecting unit configured to select a partial video stream corresponding to the view information from the panoramic video stream; and
a decoding unit, configured to perform decoding processing on the partial video stream to obtain a video picture,
a planarization unit for performing planarization processing on the video picture to obtain a planar picture,
and the pushing unit is used for coding the planar picture and pushing the coded planar picture to the terminal equipment.
3. A system for watching high-definition panoramic video under a C/S architecture is characterized by comprising: a video source, a streaming server connected to the video source, a processing server according to claim 2 connected to the streaming server, and a terminal device connected to the processing server,
wherein, the video source is used for providing closed pictures;
the streaming media server is used for coding the closed picture into a panoramic video stream;
the processing server is used for selecting a partial video stream corresponding to the view angle information from the panoramic video stream; decoding the partial video stream to obtain a video picture; carrying out planarization processing on the video picture to obtain a plane picture; coding the plane picture, and pushing the coded plane picture to the terminal equipment;
the terminal equipment is used for decoding the plane picture and then displaying the plane picture.
4. A method for watching high-definition panoramic video under a C/S architecture is characterized by comprising the following steps:
acquiring a closed picture from a video source;
dividing the closed picture into a plurality of area pictures, wherein different area pictures cover different view angle ranges;
carrying out planarization treatment on the area picture to obtain a plane picture;
and sending the plane picture to a streaming media server so that the streaming media server pushes the corresponding plane picture to the terminal equipment according to the visual angle information of the terminal equipment.
5. A processing server for watching high-definition panoramic video under a C/S architecture is characterized by comprising:
the acquisition unit is used for acquiring a closed picture from a video source;
a dividing unit, configured to divide the closed picture into a plurality of area pictures, where different area pictures cover different viewing angle ranges; and
a planarization unit, for performing planarization processing on the area picture to obtain a plane picture;
and the pushing unit is used for pushing the plane picture to a streaming media server so that the streaming media server can push the corresponding plane picture to the terminal equipment according to the visual angle information of the terminal equipment.
6. A method for watching high-definition panoramic video under a C/S architecture is characterized by comprising the following steps:
acquiring a plurality of plane pictures from a processing server and acquiring view angle information from terminal equipment, wherein different plane pictures cover different view angle ranges; and
selecting a corresponding plane picture from a plurality of plane pictures according to the visual angle information;
and coding the corresponding plane picture and pushing the coded plane picture to the terminal equipment.
7. A streaming media server for watching high-definition panoramic video under a C/S architecture is characterized by comprising:
the system comprises an acquisition unit, a processing unit and a display unit, wherein the acquisition unit is used for acquiring a plurality of plane pictures from a processing server and acquiring visual angle information from terminal equipment, and different plane pictures cover different visual angle ranges; and
the selection unit is used for selecting a corresponding plane picture from a plurality of plane pictures according to the visual angle information;
and the coding unit is used for coding the corresponding plane picture and then pushing the plane picture to the terminal equipment.
8. A system for watching high-definition panoramic video under a C/S architecture is characterized by comprising: a video source, a processing server according to claim 5 connected to the video source, a streaming server according to claim 7 connected to the processing server, and a terminal device connected to the streaming server,
wherein, the video source is used for providing closed pictures;
the processing server is used for dividing the closed picture into a plurality of area pictures covering different view angle ranges, and then flattening the area pictures into plane pictures;
the streaming media server is used for selecting a corresponding plane picture from a plurality of plane pictures according to the visual angle information of the terminal equipment, coding the corresponding plane picture and pushing the coded plane picture to the terminal equipment;
and the terminal equipment is used for receiving and displaying the plane picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711329394.5A CN108040260B (en) | 2017-12-13 | 2017-12-13 | Watching method, system and server of high-definition panoramic video under C/S architecture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711329394.5A CN108040260B (en) | 2017-12-13 | 2017-12-13 | Watching method, system and server of high-definition panoramic video under C/S architecture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108040260A CN108040260A (en) | 2018-05-15 |
| CN108040260B true CN108040260B (en) | 2020-09-18 |
Family
ID=62102278
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711329394.5A Active CN108040260B (en) | 2017-12-13 | 2017-12-13 | Watching method, system and server of high-definition panoramic video under C/S architecture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108040260B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110798707B (en) * | 2018-08-02 | 2023-06-16 | 华为技术有限公司 | Method, client and server for transmitting media data |
| CN111083395A (en) * | 2019-12-27 | 2020-04-28 | 卓望数码技术（深圳）有限公司 | Panoramic video processing method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104602129A (en) * | 2015-01-27 | 2015-05-06 | 三星电子（中国）研发中心 | Playing method and system of interactive multi-view video |
| CN105812759A (en) * | 2016-04-15 | 2016-07-27 | 杭州当虹科技有限公司 | Planar projection method and coding method of 360-degree panoramic video |
| CN105916060A (en) * | 2016-04-26 | 2016-08-31 | 乐视控股（北京）有限公司 | Method, apparatus and system for transmitting data |
| CN106162139A (en) * | 2016-08-04 | 2016-11-23 | 微鲸科技有限公司 | Coded method, video output device, coding/decoding method and video play device |
| CN106385587A (en) * | 2016-09-14 | 2017-02-08 | 三星电子（中国）研发中心 | Method, device and system for sharing virtual reality view angle |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9324184B2 (en) * | 2011-12-14 | 2016-04-26 | Microsoft Technology Licensing, Llc | Image three-dimensional (3D) modeling |
| CN103731630B (en) * | 2012-10-16 | 2019-01-11 | 华为技术有限公司 | A kind of video monitoring method, equipment and system |
-
2017
- 2017-12-13 CN CN201711329394.5A patent/CN108040260B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104602129A (en) * | 2015-01-27 | 2015-05-06 | 三星电子（中国）研发中心 | Playing method and system of interactive multi-view video |
| CN105812759A (en) * | 2016-04-15 | 2016-07-27 | 杭州当虹科技有限公司 | Planar projection method and coding method of 360-degree panoramic video |
| CN105916060A (en) * | 2016-04-26 | 2016-08-31 | 乐视控股（北京）有限公司 | Method, apparatus and system for transmitting data |
| CN106162139A (en) * | 2016-08-04 | 2016-11-23 | 微鲸科技有限公司 | Coded method, video output device, coding/decoding method and video play device |
| CN106385587A (en) * | 2016-09-14 | 2017-02-08 | 三星电子（中国）研发中心 | Method, device and system for sharing virtual reality view angle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108040260A (en) | 2018-05-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102294098B1 (en) | Apparatus and method for providing and displaying content | |
| US11075974B2 (en) | Video data processing method and apparatus | |
| CN109074678B (en) | Information processing method and device | |
| JP2018525852A (en) | Spherical video streaming | |
| CN108965929B (en) | Video information presentation method, video information presentation client and video information presentation device | |
| WO2018093851A1 (en) | Suggested viewport indication for panoramic video | |
| KR20180029344A (en) | Method and apparatus for delivering and playbacking content in virtual reality system | |
| CN109218755B (en) | Media data processing method and device | |
| TWI735552B (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
| CN108040260B (en) | Watching method, system and server of high-definition panoramic video under C/S architecture | |
| CN110933461B (en) | Image processing method, device, system, network equipment, terminal and storage medium | |
| US20240119660A1 (en) | Methods for transmitting and rendering a 3d scene, method for generating patches, and corresponding devices and computer programs | |
| CN107959861B (en) | Data processing method, related equipment and system | |
| CN112423108B (en) | Method and device for processing code stream, first terminal, second terminal and storage medium | |
| CN113194326A (en) | Panoramic live broadcast method and device, computer equipment and computer readable storage medium | |
| CN108271084B (en) | Information processing method and device | |
| CN111937043B (en) | Associating file format objects with dynamic adaptive streaming over hypertext transfer protocol (DASH) objects | |
| CN111937043A (en) | Associating file format objects with dynamic adaptive streaming over hypertext transfer protocol (DASH) objects |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: No. 2, Hongyang Road, Tianning District, Changzhou, Jiangsu Province, Jiangsu Applicant after: Jiangsu shiboyun Information Technology Co., Ltd Address before: 100085, Beijing, Haidian District, 5 East Road, Beijing, Mongolia hi tech building, block B, two Applicant before: BEIJING SUPER DIGITAL TV TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20180515 Assignee: Beijing shiboyun Information Technology Co.,Ltd. Assignor: Jiangsu shiboyun Information Technology Co., Ltd Contract record no.: X2021110000011 Denomination of invention: Viewing method, system and server of HD panoramic video based on C / S architecture Granted publication date: 20200918 License type: Common License Record date: 20210323 |
|
| EE01 | Entry into force of recordation of patent licensing contract |