CN108040260A - The viewing method and system of high definition panorama video, terminal and server under C/S frameworks - Google Patents
The viewing method and system of high definition panorama video, terminal and server under C/S frameworks Download PDFInfo
- Publication number
- CN108040260A CN108040260A CN201711329394.5A CN201711329394A CN108040260A CN 108040260 A CN108040260 A CN 108040260A CN 201711329394 A CN201711329394 A CN 201711329394A CN 108040260 A CN108040260 A CN 108040260A
- Authority
- CN
- China
- Prior art keywords
- picture
- terminal device
- video
- flat
- streaming media
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 238000012545 processing Methods 0.000 claims abstract description 126
- 230000008569 process Effects 0.000 claims description 26
- 230000000007 visual effect Effects 0.000 claims description 19
- 238000010586 diagram Methods 0.000 description 12
- 230000008901 benefit Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 206010052143 Ocular discomfort Diseases 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440245—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention provides the viewing method and system of high definition panorama video, terminal and server under a kind of C/S frameworks, wherein, method includes：Processing server obtains panoramic video stream from streaming media server, and obtains Viewing-angle information from terminal device；From the partial video stream of the corresponding Viewing-angle information of panoramic video stream selection；And the partial video stream is pushed into the terminal device；User terminal is from processing server receiving portion video flowing；Decode the partial video stream and obtain video pictures；The video pictures are planarized with processing and obtains Flat-picture；And the display Flat-picture.The present invention can make the limited existing terminal device viewing high definition video of disposal ability, save wireless network bandwidth, improve user experience.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of image processing equipment, is exactly specifically a kind of visitor
The viewing method and system, server of high definition panorama video under family end/server (C/S) framework.
Background technology
In recent years, making constant progress with computer information technology and image processing techniques, lives with people
Horizontal increasingly lifting.People are not only residing within cumbersome word elaboration and are introducing above for the understanding of things, but
Rise in the aspect of reduction objective things style.Since panoramic video can be with the original face of comprehensive objective things
Looks, compared with single visual angle image, can give beholder therefore, panoramic video is more and more with sensation on the spot in person
The immense value and advantage of its own are given play in field.
At present, terminal device (for example, wear-type visual device, set-top box, mobile terminal, computer etc.) mainly passes through visitor
Family end/server (C/S) framework obtains panoramic video stream, mode of the terminal device there are two kinds of acquisition video flowings：One kind be
Panoramic video stream is passed through network push by the server request panoramic video stream of line mode, i.e. terminal device forward end, server
To terminal device, terminal device carries out decoding broadcasting to receiving panoramic video stream at the same time；Another way is offline mode, eventually
End equipment just starts decoding broadcasting after downloading complete panoramic video file.Both the above mode, terminal device needs will solution
Video pictures after code project to sphere, and according to user's current visual angle and visual field, select corresponding regional display, and by area
Domain picture projects to plane again, is then shown to user's viewing on the screen.
In above process, server is set by the video flowing at whole visual angles by network push to terminal device by terminal
It is standby to be decoded.The video streaming at visual angles whole first needs to take larger network bandwidth, while requires terminal device to have
There is the video decoding capability of big resolution ratio., it is necessary to the network bandwidth of about 40Mbps by taking 4K panoramic videos as an example, while also require
Terminal device can decoding resolution be 4K video.Current terminal device does not have this ability.For HD video
Show the situation of (such as video resolution is more than 8K), existing terminal device is even more too far behind to catch up.Due to the number of terminal device
It is relatively low according to disposal ability, high-definition full views video can not be watched to clear and smooth, it is difficult to bring immersion to experience to user, this
A little factors greatly define the development and popularization of panoramic video.
Therefore, how to be those skilled in the art using existing terminal device viewing high-definition full-view video image
The problem of long-term urgent need to resolve.
The content of the invention
In view of this, the technical problem to be solved in the present invention is to provide viewing high definition panorama video under a kind of C/S frameworks
Method and system, terminal and server, solve can not utilize existing terminal device viewing high-definition full views video image
The problem of.
In order to solve the above-mentioned technical problem, the first technical solution of the invention watches high definition to provide under a kind of C/S frameworks
The method of panoramic video, including：
Processing server obtains panoramic video stream from streaming media server, and obtains Viewing-angle information from terminal device；From institute
State the partial video stream of the corresponding Viewing-angle information of panoramic video stream selection；And the partial video stream is pushed into the end
End equipment；
User terminal is from processing server receiving portion video flowing；Decode the partial video stream and obtain video pictures；It is right
The video pictures are planarized processing and obtain Flat-picture；And the display Flat-picture.
Second technical solution of the invention is to provide a kind of method that high definition panorama video is watched under C/S frameworks, including：
Processing server obtains panoramic video stream from streaming media server, and obtains Viewing-angle information from terminal device；From institute
State the partial video stream of the corresponding Viewing-angle information of panoramic video stream selection；Decoding process acquisition is carried out to the partial video stream
Video pictures；The video pictures are planarized with processing and obtains Flat-picture；And the Flat-picture is encoded
Processing, the terminal device is pushed to by the Flat-picture after coding；
Terminal device is from processing server receiving plane picture；Shown after decoding Flat-picture.
3rd technical solution of the invention is to provide the system that high definition panorama video is watched under a kind of C/S frameworks, including：
Video source, the streaming media server being connected with the video source, the processing clothes being connected with the streaming media server
Business device, and the terminal device being connected with the processing server；
Wherein, the video source is used to provide closing picture；
The streaming media server is used for the picture coding of closing into panoramic video stream；
The processing server is used for the partial video stream push that corresponding Viewing-angle information is selected from the panoramic video stream
To the terminal device；
The terminal device is used to decode the partial video stream, show after planarization process.
4th technical solution of the invention is to provide the system that high definition panorama video is watched under a kind of C/S frameworks, including：
Video source, the streaming media server being connected with the video source, the processing clothes being connected with the streaming media server
Business device, and the terminal device being connected with the processing server；
Wherein, the video source is used to provide closing picture；
The streaming media server is used for the picture coding of closing into panoramic video stream；
The processing server is used for the partial video stream that corresponding Viewing-angle information is selected from the panoramic video stream, to institute
State partial video stream and carry out decoding process acquisition video pictures；The video pictures are planarized with processing and obtains plane picture
Face；Coded treatment is carried out to the Flat-picture, the Flat-picture after coding is pushed into the terminal device；
The terminal device is used to after decoding Flat-picture show.
5th technical solution of the invention is to provide a kind of method that high definition panorama video is watched under C/S frameworks, including：
Processing server obtains closing picture from video source；The closing picture is divided into multiple regions picture, wherein,
The different regional displays covers different angulars field of view；Multiple regional displays are pushed to streaming media server；
Streaming media server obtains multiple regions picture from processing server, and obtains Viewing-angle information from terminal device, its
In, the different regional displays covers different angulars field of view；And according to the Viewing-angle information from multiple regions picture
Respective regions picture is selected, terminal device is pushed to after carrying out coded treatment to respective regions picture；
Terminal device is from streaming media server receiving area picture；Processing is planarized to the regional display, so that
Obtain Flat-picture；And the display Flat-picture.
6th technical solution of the invention is to provide a kind of method that high definition panorama video is watched under C/S frameworks, including：
Processing server obtains closing picture from video source；The closing picture is divided into multiple regions picture, wherein,
The different regional displays covers different angulars field of view；Processing is planarized to the regional display and obtains plane picture
Face；The Flat-picture is sent to streaming media server；
Streaming media server obtains multiple Flat-pictures from processing server, and obtains Viewing-angle information from terminal device, its
In, the different Flat-pictures covers different angulars field of view；And according to the Viewing-angle information from multiple Flat-pictures
Respective planes picture is selected, terminal device is pushed to after carrying out coded treatment to respective planes picture；
Terminal device is used to receive and show the Flat-picture.
7th technical solution of the invention is to provide the system that high definition panorama video is watched under a kind of C/S frameworks, including：
Video source, the processing server being connected with the video source, the streaming media service being connected with the processing server
Device, and the terminal device being connected with the streaming media server；
Wherein, the video source is used to provide closing picture；
The processing server is used for the regional display that the closing picture is divided into multiple covering different visual angles scopes；
The streaming media server is used to select phase from multiple regions picture according to the Viewing-angle information of the terminal device
Regional display is answered, the terminal device is pushed to after carrying out coded treatment to respective regions picture；
The terminal device is used to be shown after the regional display planarization process.
8th technical solution of the invention is to provide the system that high definition panorama video is watched under a kind of C/S frameworks, including：
Video source, the processing server being connected with the video source, the streaming media service being connected with the processing server
Device, and the terminal device being connected with the streaming media server；
Wherein, the video source is used to provide closing picture；
The processing server is used for the regional display that the closing picture is divided into multiple covering different visual angles scopes,
Again by the regional display planarization process into Flat-picture；
The streaming media server is used to select phase from multiple Flat-pictures according to the Viewing-angle information of the terminal device
Flat-picture is answered, the terminal device is pushed to after carrying out coded treatment to respective planes picture；
The terminal device is used to receive and show the Flat-picture.
Above-mentioned embodiment according to the present invention is understood, the method for high definition panorama video is watched under C/S frameworks and is
System at least has the advantages that：The selection of video flowing or segmentation, the decoding and planarization of partial video stream for closing picture
The planarization process of processing or regional display is completed by processing server, significantly reduces the data processing of terminal device
Amount so that the limited existing terminal device of disposal ability can watch high definition video, user experience be improved, due to terminal
Equipment and streaming media server wireless connection, while wireless network bandwidth can be saved.
It is to be understood that above-mentioned general description and detailed description below are merely illustrative and illustrative, it is not
Can the limitation scope of the invention to be advocated.
Brief description of the drawings
Following appended attached drawing is the part for specification of the present invention, it depicts example embodiments of the present invention, institute
Attached drawing is used for illustrating the principle of the present invention together with the description of specification.
Fig. 1 is the implementation for the method that the present invention watches high definition panorama video under the C/S frameworks of processing server side description
The flow chart of example one；
Fig. 2 is the implementation for the method that the present invention watches high definition panorama video under the C/S frameworks of processing server side description
The flow chart of example two；
Fig. 3 is the schematic block diagram of the embodiment one for the processing server that high definition panorama video is watched under C/S frameworks of the present invention；
Fig. 4 is the schematic block diagram of the embodiment two for the processing server that high definition panorama video is watched under C/S frameworks of the present invention；
Fig. 5 is the embodiment for the method that the present invention watches high definition panorama video under the C/S frameworks of terminal equipment side description
One flow chart；
Fig. 6 is the schematic block diagram of the embodiment one for the terminal device that high definition panorama video is watched under C/S frameworks of the present invention；
Fig. 7 is the structure diagram of the embodiment one for the system that high definition panorama video is watched under C/S frameworks of the present invention；
Fig. 8 is the implementation for the method that the present invention watches high definition panorama video under the C/S frameworks of processing server side description
The flow chart of example three；
Fig. 9 is the schematic block diagram of the embodiment three for the processing server that high definition panorama video is watched under C/S frameworks of the present invention；
Figure 10 is the reality for the method that the present invention watches high definition panorama video under the C/S frameworks of streaming media server side description
Apply the flow chart of example one；
Figure 11 is the schematic block of the embodiment one for the streaming media server that high definition panorama video is watched under C/S frameworks of the present invention
Figure；
Figure 12 is the embodiment for the method that the present invention watches high definition panorama video under the C/S frameworks of terminal equipment side description
Two flow chart；
Figure 13 is the schematic block diagram of the embodiment two for the terminal device that high definition panorama video is watched under C/S frameworks of the present invention；
Figure 14 is the structure diagram of the embodiment two for the system that high definition panorama video is watched under C/S frameworks of the present invention.
Embodiment
For the purpose, technical scheme and advantage of the embodiment of the present invention are more clearly understood, below will with attached drawing and in detail
Narration clearly illustrates the spirit of disclosed content, and any skilled artisan is understanding present invention
After embodiment, when the technology that can be taught by present invention, it is changed and modifies, its essence without departing from present invention
God and scope.
The schematic description and description of the present invention is used to explain the present invention, but not as a limitation of the invention.
In addition, element/component of the same or like label used in drawings and the embodiments is for representing same or like portion
Point.
On " first " used herein, " second " ... etc., not especially censure the meaning of order or cis-position,
Be not used to limit the present invention, its only for distinguish with constructed term description element or operation.
On direction term used herein, such as：Upper and lower, left and right, front or rear etc., are only the sides of refer to the attached drawing
To.Therefore, the direction term used is intended to be illustrative and not intended to limit this creation.
It is open term, i.e., on "comprising" used herein, " comprising ", " having ", " containing " etc.
Mean including but not limited to.
On it is used herein " and/or ", include the things any or all combination.
On term used herein " substantially ", " about " etc., to modify it is any can be with the quantity or mistake of microvariations
Difference, but this slight variations or error can't change its essence.In general, microvariations that such term is modified or error
Scope in some embodiments can be 20%, in some embodiments can be 10%, can be in some embodiments 5% or its
His numerical value.It will be understood by those skilled in the art that the foregoing numerical value referred to can be adjusted according to actual demand, it is not limited thereto.
It is some to describe the word of the application by it is lower or this specification other places discuss, to provide art technology
Personnel's guiding extra in relation to the description of the present application.
Fig. 1 is the implementation for the method that the present invention watches high definition panorama video under the C/S frameworks of processing server side description
The flow chart of example one, this method as shown in Figure 1 include：
Step 101：Panoramic video stream is obtained from streaming media server, and Viewing-angle information is obtained from terminal device.Wherein, flow
Media server obtains closing picture (closing picture includes but not limited to spherical picture or cube picture) from video source, flows matchmaker
Body server will close picture coding into panoramic video stream.Aspect sensor is installed, for example, nine axle sensors in terminal device
(3-axis acceleration sensor, three-axis gyroscope and three axis magnetometers), can obtain the Viewing-angle information of terminal device.Terminal device
Including wear-type visual device, set-top box, computer and mobile terminal etc..
Step 102：From the partial video stream of the corresponding Viewing-angle information of panoramic video stream selection.
Step 103：The partial video stream is pushed into the terminal device.To be shown on the terminal device,
Meet the visual experience of user.
In the present embodiment, by processing server according to the Viewing-angle information selected section pushing video streaming of terminal device to terminal
Equipment, terminal device only carry out decoding to partial video stream and show, greatly reduce the data processing amount of terminal device, utilize place
The limited existing terminal device of reason ability can watch high-definition full views video, improve user experience.
Fig. 2 is the implementation for the method that the present invention watches high definition panorama video under the C/S frameworks of processing server side description
The flow chart of example two, present embodiment can allow picture more natural.Specifically, partial video stream is pushed to end by step 103
Before end equipment, further include：
Step 103-1, carries out decoding process to partial video stream and obtains video pictures；
The step 103-1 video pictures obtained are planarized processing and obtain Flat-picture, will regarded by step 103-2
Frequency image projection in plane so as to obtaining Flat-picture.
Flat-picture of the above-mentioned steps 103 further to be obtained to step 103-2 carries out coded treatment, will be flat after coding
Face picture pushes to terminal device.
In the present embodiment, partial video stream is decoded by processing server and planarization process, will be obtained after processing
Flat-picture be pushed to terminal device so that user watch when, picture is more naturally, further improve user experience.
Fig. 3 is the schematic block diagram of the embodiment one for the processing server that high definition panorama video is watched under C/S frameworks of the present invention,
Processing server shown in Fig. 3 can be applied in the method shown in Fig. 1.
Specifically, the processing server includes：Acquiring unit 301, for obtaining panoramic video stream from streaming media server,
And obtain Viewing-angle information from terminal device；Selecting unit 302, for corresponding to the portion of the Viewing-angle information from panoramic video stream selection
Divide video flowing；And push unit 303, for the partial video stream to be pushed to terminal device.
In the present embodiment, part panoramic video stream is only supplied to terminal device, pole by processing server according to Viewing-angle information
The big data processing amount for reducing terminal device, it is complete to may be viewed by fine definition using the limited existing terminal device of disposal ability
Scape video, improves user experience.
Fig. 4 is the schematic block diagram of the embodiment two for the processing server that high definition panorama video is watched under C/S frameworks of the present invention,
Processing server shown in Fig. 4 may be used in the method shown in Fig. 2.
Specifically, processing server further includes：Decoding unit 304 and planarization unit 305.Wherein, decoding unit 304,
Video pictures are obtained for carrying out decoding process to partial video stream；Unit 305 is planarized to be used to carry out the video pictures
Planarization process obtains Flat-picture, and specifically, planarization unit 305 is specifically used for the video pictures projecting into plane
Picture is so as to complete planarization process.Push unit 303 is further used for carrying out coded treatment to Flat-picture, by coded treatment
Flat-picture afterwards is pushed to terminal device.
The present embodiment can greatly reduce the data processing amount of terminal device so that when user watches, picture is more certainly
So, user experience is further improved.
Fig. 5 is the embodiment for the method that the present invention watches high definition panorama video under the C/S frameworks of terminal equipment side description
One flow chart.Specifically, including：
Step 501, from processing server receiving portion video flowing；
Step 502, decode the partial video stream and obtain video pictures；
Step 503, the video pictures are planarized with processing and obtain Flat-picture；And
Step 504, the Flat-picture is shown.
When it is implemented, if processing server has carried out decoding and planarization process to partial video stream, terminal is set
It is standby only to need to obtain simultaneously display plane picture.
Based on same inventive concept, the present invention also provides the terminal device that high definition panorama video is watched under a kind of C/S frameworks,
As shown in fig. 6, the terminal device includes：
Receiving unit 601, for from processing server receiving portion video flowing；
Decoding unit 602, video pictures are obtained for decoding the partial video stream；
Unit 603 is planarized, Flat-picture is obtained for the video pictures to be planarized with processing；And
Display unit 604, for showing the Flat-picture.
When it is implemented, if processing server has carried out decoding and planarization process to partial video stream, terminal is set
It is standby to may not include planarization unit.
Fig. 7 is the structure diagram of the embodiment one for the system that high definition panorama video is watched under C/S frameworks of the present invention.Specifically
, which includes：Video source 701, the streaming media server 702 being connected with the video source 701 and the streaming media service
The processing server 703 that device 702 connects, and the terminal device 704 being connected with the processing server 703.
Wherein, video source 701 is used to provide closing picture；Streaming media server 702 is used to help closing picture coding
Scape video flowing；Processing server 703 is used to obtain Viewing-angle information from terminal device 704, and panorama is obtained from streaming media server 702
Video flowing, selects the partial video stream of corresponding Viewing-angle information to be pushed to terminal device 704 from panoramic video stream；Terminal device
704 are used for from 703 receiving portion video flowing of processing server, it is decoded and planarization process after show.Wherein,
Terminal device 704 can be connected by wired or wireless way with processing server 703.
In further embodiment, processing server is in addition to the corresponding partial video stream of selection Viewing-angle information, also to part
Video flowing is decoded and is projected (planarization) processing, and terminal device only carries out picture and shows.
The present embodiment can greatly reduce the data processing amount of terminal device, utilize the existing terminal that disposal ability is limited
Equipment may be viewed by high-definition full views video.Further, since processing server and terminal device wireless connection, are conveyed to terminal
The data volume of equipment is small, saves wireless network bandwidth.
Fig. 8 is the implementation for the method that the present invention watches high definition panorama video under the C/S frameworks of processing server side description
The flow chart of example three.The present embodiment processing server is directly handled the closing picture obtained from video source, can be saved
The process resource of streaming media server, specifically, this method includes：
Step 801：Closing picture is obtained from video source.Wherein, closing picture be probably it is uncoded or coding after number
According to if the data after coding, closing picture that need to be to coding carries out decoding process, in addition, the data format of closing picture can
Can be that predetermined format may not also be predetermined format, if the form of closing picture is undesirable, it is also necessary to carry out transcoding.
Step 802：The closing picture is divided into multiple regions picture, wherein, each regional display is a video
Piece, each piece of video cover certain angular field of view, and all piece of video add up and completely cover whole visual angles, nothing between piece of video
Repeat region.
Step 803：Multiple regions picture is pushed to streaming media server, so that streaming media server is according to terminal device
Viewing-angle information corresponding regional display is pushed to terminal device, wherein, corresponding regional display refers to current with user
The regional display being just adapted in viewing visual angle.
Further, before the step of multiple regions picture is pushed to streaming media server by above-mentioned steps 803, also wrap
Include：Processing is planarized to regional display and obtains Flat-picture, so that streaming media server is believed according to the visual angle of terminal device
Corresponding Flat-picture is pushed to terminal device by breath.
In the present embodiment, processing server carries out main Digital Image Processing work, can greatly reduce Streaming Media clothes
The data processing amount of business device and terminal device so that the limited existing terminal device of disposal ability can watch high-definition full views
Video, improves user experience.After regional display is projected into Flat-picture, picture is more naturally, more meet the viewing of user
Custom.
Fig. 9 is the processing service that high definition panorama video is watched under a kind of C/S frameworks that the specific embodiment of the invention provides
The schematic block diagram of the embodiment three of device.Specifically, processing server includes：
Acquiring unit 901, for obtaining closing picture from video source；If the form for closing picture is undesirable, need
Carry out transcoding；
Cutting unit 902, for closing picture to be divided into multiple regions picture, wherein, the different regional displays cover
Cover different angulars field of view；And
Push unit 903, for multiple regions picture to be pushed to streaming media server, so as to the streaming media server
The corresponding regional display is pushed to by the terminal device according to the Viewing-angle information of terminal device.
Further, which further includes：Unit 904 is planarized, for carrying out plane to the regional display
Change processing and obtain Flat-picture, so that the streaming media server will the corresponding plane according to the Viewing-angle information of terminal device
Picture is pushed to the terminal device.
Processing server provided in this embodiment has carried out main Digital Image Processing work, can greatly reduce stream matchmaker
The data processing amount of body server and terminal device so that the limited existing terminal device of disposal ability can watch fine definition
Panoramic video, improves user experience.After regional display is projected into Flat-picture, picture is more naturally, more meet user's
Viewing custom, strengthens user experience.
Figure 10 is the reality for the method that the present invention watches high definition panorama video under the C/S frameworks of streaming media server side description
The flow chart of example one is applied, is used cooperatively with Fig. 8 the methods, specifically, including：
Step 1001, multiple regions picture is obtained from processing server, and Viewing-angle information is obtained from terminal device, wherein,
The different regional displays covers different angulars field of view；And
Step 1002, respective regions picture is selected from multiple regional displays according to the Viewing-angle information；
Step 1003, terminal device is pushed to after carrying out coded treatment to respective regions picture.
Further, if processing server has carried out regional display planarization process, above-mentioned steps 1001 are from
Manage server and obtain multiple Flat-pictures, above-mentioned steps 1002 are to select respective planes to draw from Flat-picture according to Viewing-angle information
Face is pushed to terminal device, and above-mentioned steps 1003 are to be pushed to terminal device after carrying out coded treatment to respective planes picture.
When it is implemented, a dedicated processes server generation can be also set to carry out above-mentioned steps for above-mentioned streaming media server
1001 and 1002 processing.
Based on same inventive concept, as shown in figure 11, also provide with the corresponding streaming media server of Figure 10 methods, specifically
, which includes：
Acquiring unit 1101, for obtaining multiple regions picture from processing server, and obtains visual angle letter from terminal device
Breath, wherein, the different regional displays covers different angulars field of view；And
Selecting unit 1102, for being selected respective regions to draw from multiple regional displays according to the Viewing-angle information
Face；
Coding unit 1103, for being pushed to terminal device after carrying out coded treatment to respective regions picture.
Further, if processing server has carried out regional display planarization process, acquiring unit is serviced from processing
Device obtains multiple Flat-pictures, and selecting unit selects respective planes picture, coding unit according to Viewing-angle information from Flat-picture
Terminal device is pushed to after carrying out coded treatment to respective planes picture.
Figure 12 is the embodiment for the method that the present invention watches high definition panorama video under the C/S frameworks of terminal equipment side description
Two flow chart, is used cooperatively with Fig. 8 and Figure 10 the methods, specifically, including：
Step 1201, from streaming media server receiving area picture；
Step 1202, processing is planarized to the regional display, so as to obtain Flat-picture；And
Step 1203, the Flat-picture is shown.
Further, if what streaming media server obtained from processing server is Flat-picture, above-mentioned steps 1201 are
From streaming media server receiving plane picture, skip step 1202 and directly perform step 1203.
Based on same inventive concept, as shown in figure 13, also provide with the corresponding terminal device of Figure 12 methods, specifically,
The terminal device includes：
Receiving unit 1301, for from streaming media server receiving area picture；
Unit 1302 is planarized, for the regional display to be projected into Flat-picture；And
Display unit 1303, for showing the Flat-picture.
Further, if what streaming media server obtained from processing server is Flat-picture, terminal device can not
Including planarizing unit.
Figure 14 is the reality for the system that high definition panorama video is watched under a kind of C/S frameworks that the specific embodiment of the invention provides
The structure diagram of example two is applied, specifically, the system includes：Video source 1401, the processing being connected with the video source 1401 clothes
Business device 1402, the streaming media server 1403 that is connected with the processing server 1402, and with the streaming media server
The terminal device 1404 of 1403 connections.Wherein, the video source 1401 is used to provide closing picture；The processing server 1402
For the closing picture to be divided into the regional display of multiple covering different visual angles scopes；The streaming media server 1403 is used
In obtaining multiple regions picture from processing server 1402, the Viewing-angle information of terminal device is obtained from terminal device 1404, according to
The Viewing-angle information of the terminal device 1404 selects respective regions picture from multiple regional displays, to respective regions picture
The terminal device 1404 is pushed to after carrying out coded treatment；The terminal device 1404 is used for from the streaming media server
1403 receiving area pictures, show after processing is planarized to it.Wherein, terminal device 1404 passes through wired or wireless way
It is connected with streaming media server 1403.
Further, processing server 1402 is divided into multiple regions for covering different visual angles scopes except will close picture
Outside picture, regional display is also planarized processing and obtains multiple Flat-pictures, multiple Flat-pictures are pushed to Streaming Media
Server, from multiple Flat-pictures selects respective planes picture to push away by streaming media server according to the Viewing-angle information of terminal device
Give terminal device.
In the present embodiment, processing server is arranged between video source and streaming media server, can greatly reduce stream
The data processing amount of media server and terminal device so that the limited existing terminal device of disposal ability can watch high-resolution
Panoramic video is spent, improves user experience.After regional display is projected into Flat-picture, picture is more naturally, more meet user
Viewing custom, strengthen user experience.
Further, since streaming media server can be wireless with terminal device, the data volume for being conveyed to terminal device is small
(being only the currently watched regional display of user), saves wireless network bandwidth, and when user turns to, picture can convert in time, use
Family will not produce visual discomfort.
The above-mentioned embodiment of the present invention can be implemented in various hardware, Software Coding or both combination.For example, this hair
Bright embodiment, which is alternatively in data signal processor (Digital Signal Processor, DSP), performs the above method
Program code.The present invention can also refer to computer processor, digital signal processor, microprocessor or field-programmable gate array
Arrange the multiple functions that (Field Programmable Gate Array, FPGA) is performed.Above-mentioned processing can be configured according to the present invention
Device performs particular task, it defines the machine-readable software code for the ad hoc approach that the present invention discloses or firmware generation by performing
Code is completed.Software code or firmware code can be developed into different program languages and different forms or form.Or
Different target platform composing software codes.However, software code and the other types configuration generation of task are performed according to the present invention
Different code pattern, type and the language of code do not depart from spirit and scope of the invention.
The foregoing is merely the schematical embodiment of the present invention, before the design of the present invention and principle is not departed from
Put, the equivalent variations and modification that any those skilled in the art is made, should all belong to the scope of protection of the invention.
Claims (15)
1. the method for high definition panorama video is watched under a kind of C/S frameworks, it is characterised in that this method includes：
Panoramic video stream is obtained from streaming media server, and Viewing-angle information is obtained from terminal device；
From the partial video stream of the corresponding Viewing-angle information of panoramic video stream selection；And
The partial video stream is pushed into the terminal device.
2. the method for high definition panorama video is watched under C/S frameworks as claimed in claim 1, it is characterised in that by the part
Before pushing video streaming to the step of terminal device, this method further includes：
Decoding process is carried out to the partial video stream and obtains video pictures；
The video pictures are planarized with processing and obtains Flat-picture；And
Coded treatment is carried out to the Flat-picture, the Flat-picture after coding is pushed into the terminal device.
3. the processing server of high definition panorama video is watched under a kind of C/S frameworks, it is characterised in that the processing server includes：
Acquiring unit, for obtaining panoramic video stream from streaming media server, and obtains Viewing-angle information from terminal device；
Selecting unit, for the partial video stream from the corresponding Viewing-angle information of panoramic video stream selection；And
Push unit, for the partial video stream to be pushed to the terminal device.
4. the processing server of high definition panorama video is watched under C/S frameworks as claimed in claim 3, it is characterised in that at this
Reason server further includes：
Decoding unit, video pictures are obtained for carrying out decoding process to the partial video stream,
Unit is planarized, Flat-picture is obtained for the video pictures to be planarized with processing,
The push unit is additionally operable to carry out coded treatment to the Flat-picture, and the Flat-picture after coded treatment is pushed to
The terminal device.
5. the system of high definition panorama video is watched under a kind of C/S frameworks, it is characterised in that the system includes：Video source, with it is described
The streaming media server of video source connection, the processing server as claimed in claim 4 being connected with the streaming media server,
And the terminal device being connected with the processing server,
Wherein, the video source is used to provide closing picture；
The streaming media server is used for the picture coding of closing into panoramic video stream；
The processing server is used for the partial video stream that corresponding Viewing-angle information is selected from the panoramic video stream；To the portion
Divide video flowing to carry out decoding process and obtain video pictures；The video pictures are planarized with processing and obtains Flat-picture；It is right
The Flat-picture carries out coded treatment, and the Flat-picture after coded treatment is pushed to the terminal device；
The terminal device is used to after carrying out decoding process to Flat-picture show.
6. the method for high definition panorama video is watched under a kind of C/S frameworks, it is characterised in that this method includes：
Closing picture is obtained from video source；
The closing picture is divided into multiple regions picture, wherein, the different regional displays covers different visual angle models
Enclose；
Multiple regional displays are pushed to streaming media server, so as to the streaming media server regarding according to terminal device
The corresponding regional display is pushed to the terminal device by angle information.
7. the method for high definition panorama video is watched under C/S frameworks as claimed in claim 6, it is characterised in that will be multiple described
Regional display was pushed to before the step of streaming media server, and this method includes：
Processing is planarized to the regional display and obtains Flat-picture；
It is further that the Flat-picture is sent to Streaming Media clothes that multiple regional displays are pushed to streaming media server
Business device, so that corresponding Flat-picture is pushed to the terminal by the streaming media server according to the Viewing-angle information of terminal device
Equipment.
8. the processing server of high definition panorama video is watched under a kind of C/S frameworks, it is characterised in that the processing server includes：
Acquiring unit, for obtaining closing picture from video source；
Cutting unit, for the closing picture to be divided into multiple regions picture, wherein, the different regional display coverings are not
Same angular field of view；And
Push unit, for multiple regional displays to be pushed to streaming media server, so as to the streaming media server root
The corresponding regional display is pushed to the terminal device according to the Viewing-angle information of terminal device.
9. the processing server of high definition panorama video is watched under C/S frameworks as claimed in claim 8, it is characterised in that at this
Reason server further includes：
Unit is planarized, Flat-picture is obtained for being planarized processing to the regional display；
The push unit is used to the Flat-picture being pushed to streaming media server, so as to the streaming media server according to
Corresponding Flat-picture is pushed to the terminal device by the Viewing-angle information of terminal device.
10. the method for high definition panorama video is watched under a kind of C/S frameworks, it is characterised in that this method includes：
Multiple regions picture is obtained from processing server, and Viewing-angle information is obtained from terminal device, wherein, the different regions
Picture covers different angulars field of view；And
Respective regions picture is selected from multiple regions picture according to the Viewing-angle information；
Terminal device is pushed to after carrying out coded treatment to respective regions picture.
11. the streaming media server of high definition panorama video is watched under a kind of C/S frameworks, it is characterised in that the streaming media server
Including：
Acquiring unit, for obtaining multiple regions picture from processing server, and obtains Viewing-angle information from terminal device, wherein,
The different regional displays covers different angulars field of view；And
Selecting unit, for selecting respective regions picture from multiple regions picture according to the Viewing-angle information；
Coding unit, for being pushed to terminal device after carrying out coded treatment to respective regions picture.
12. the system of high definition panorama video is watched under a kind of C/S frameworks, it is characterised in that the system includes：Video source and institute
State video source connection processing server as claimed in claim 8, be connected with the processing server such as claim 11
The streaming media server, and the terminal device being connected with the streaming media server,
Wherein, the video source is used to provide closing picture；
The processing server is used for the regional display that the closing picture is divided into multiple covering different visual angles scopes；
The streaming media server is used to select respective area from multiple regions picture according to the Viewing-angle information of the terminal device
Domain picture, the terminal device is pushed to after carrying out coded treatment to respective regions picture；
The terminal device is used to be shown after the regional display planarization process.
13. the method for high definition panorama video is watched under a kind of C/S frameworks, it is characterised in that this method includes：
Multiple Flat-pictures are obtained from processing server, and Viewing-angle information is obtained from terminal device, wherein, the different planes
Picture covers different angulars field of view；And
Respective planes picture is selected from multiple Flat-pictures according to the Viewing-angle information；
Terminal device is pushed to after carrying out coded treatment to respective planes picture.
14. the streaming media server of high definition panorama video is watched under a kind of C/S frameworks, it is characterised in that the streaming media server
Including：
Acquiring unit, for obtaining multiple Flat-pictures from processing server, and obtains Viewing-angle information from terminal device, wherein,
The different Flat-pictures covers different angulars field of view；And
Selecting unit, for selecting respective planes picture from multiple Flat-pictures according to the Viewing-angle information；
Coding unit, for being pushed to terminal device after carrying out coded treatment to respective planes picture.
15. the system of high definition panorama video is watched under a kind of C/S frameworks, it is characterised in that the system includes：Video source and institute
State video source connection processing server as claimed in claim 9, be connected with the processing server such as claim 14
The streaming media server, and the terminal device being connected with the streaming media server,
Wherein, the video source is used to provide closing picture；
The processing server is used for the regional display that the closing picture is divided into multiple covering different visual angles scopes, then will
The regional display planarization process is into Flat-picture；
The streaming media server is used to be selected from multiple Flat-pictures according to the Viewing-angle information of the terminal device accordingly flat
Face picture, the terminal device is pushed to after carrying out coded treatment to respective planes picture；
The terminal device is used to receive and show the Flat-picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711329394.5A CN108040260B (en) | 2017-12-13 | 2017-12-13 | Watching method, system and server of high-definition panoramic video under C/S architecture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711329394.5A CN108040260B (en) | 2017-12-13 | 2017-12-13 | Watching method, system and server of high-definition panoramic video under C/S architecture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108040260A true CN108040260A (en) | 2018-05-15 |
| CN108040260B CN108040260B (en) | 2020-09-18 |
Family
ID=62102278
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711329394.5A Active CN108040260B (en) | 2017-12-13 | 2017-12-13 | Watching method, system and server of high-definition panoramic video under C/S architecture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108040260B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020024373A1 (en) * | 2018-08-02 | 2020-02-06 | 华为技术有限公司 | Media data transmission method, client and server |
| CN111083395A (en) * | 2019-12-27 | 2020-04-28 | 卓望数码技术（深圳）有限公司 | Panoramic video processing method and system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130155047A1 (en) * | 2011-12-14 | 2013-06-20 | Microsoft Corporation | Image three-dimensional (3d) modeling |
| CN104602129A (en) * | 2015-01-27 | 2015-05-06 | 三星电子（中国）研发中心 | Playing method and system of interactive multi-view video |
| US20150222797A1 (en) * | 2012-10-16 | 2015-08-06 | Huawei Technologies Co., Ltd. | Video Surveillance Method, Device, and System |
| CN105812759A (en) * | 2016-04-15 | 2016-07-27 | 杭州当虹科技有限公司 | Planar projection method and coding method of 360-degree panoramic video |
| CN105916060A (en) * | 2016-04-26 | 2016-08-31 | 乐视控股（北京）有限公司 | Method, apparatus and system for transmitting data |
| CN106162139A (en) * | 2016-08-04 | 2016-11-23 | 微鲸科技有限公司 | Coded method, video output device, coding/decoding method and video play device |
| CN106385587A (en) * | 2016-09-14 | 2017-02-08 | 三星电子（中国）研发中心 | Method, device and system for sharing virtual reality view angle |
-
2017
- 2017-12-13 CN CN201711329394.5A patent/CN108040260B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130155047A1 (en) * | 2011-12-14 | 2013-06-20 | Microsoft Corporation | Image three-dimensional (3d) modeling |
| US20150222797A1 (en) * | 2012-10-16 | 2015-08-06 | Huawei Technologies Co., Ltd. | Video Surveillance Method, Device, and System |
| CN104602129A (en) * | 2015-01-27 | 2015-05-06 | 三星电子（中国）研发中心 | Playing method and system of interactive multi-view video |
| CN105812759A (en) * | 2016-04-15 | 2016-07-27 | 杭州当虹科技有限公司 | Planar projection method and coding method of 360-degree panoramic video |
| CN105916060A (en) * | 2016-04-26 | 2016-08-31 | 乐视控股（北京）有限公司 | Method, apparatus and system for transmitting data |
| CN106162139A (en) * | 2016-08-04 | 2016-11-23 | 微鲸科技有限公司 | Coded method, video output device, coding/decoding method and video play device |
| CN106385587A (en) * | 2016-09-14 | 2017-02-08 | 三星电子（中国）研发中心 | Method, device and system for sharing virtual reality view angle |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020024373A1 (en) * | 2018-08-02 | 2020-02-06 | 华为技术有限公司 | Media data transmission method, client and server |
| CN110798707A (en) * | 2018-08-02 | 2020-02-14 | 华为技术有限公司 | Method, client and server for transmitting media data |
| US11368729B2 (en) | 2018-08-02 | 2022-06-21 | Huawei Technologies Co., Ltd. | Media data transmission method, client, and server |
| CN111083395A (en) * | 2019-12-27 | 2020-04-28 | 卓望数码技术（深圳）有限公司 | Panoramic video processing method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108040260B (en) | 2020-09-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108111851B (en) | Deblocking filtering method and terminal | |
| EP4287637A1 (en) | Information processing method and apparatus | |
| US7852368B2 (en) | Method and apparatus for composing images during video communications | |
| US10681272B2 (en) | Device for providing realistic media image | |
| KR102067694B1 (en) | Processing panoramic pictures | |
| CN106101741A (en) | Internet video live broadcasting platform is watched the method and system of panoramic video | |
| US8854415B2 (en) | Motion responsive video capture during a video conference | |
| CN105657494A (en) | Virtual cinema and implementation method thereof | |
| EP3434021B1 (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
| CN107945101A (en) | Image processing method and device | |
| CN114581566A (en) | Animation special effect generation method, device, equipment and medium | |
| CN110827380A (en) | Image rendering method and device, electronic equipment and computer readable medium | |
| CN107454434A (en) | Virtual reality net cast method and video playing terminal | |
| CN108040260A (en) | The viewing method and system of high definition panorama video, terminal and server under C/S frameworks | |
| CN114979652A (en) | Video processing method and device, electronic equipment and storage medium | |
| CN111667438A (en) | Video reconstruction method, system, device and computer readable storage medium | |
| CN112672131A (en) | Panoramic video image display method and display equipment | |
| CN114445600A (en) | Method, device and equipment for displaying special effect prop and storage medium | |
| JP6005847B2 (en) | Adaptive filtering for scalable video coding | |
| CN112533005B (en) | Interaction method and system for VR video slow live broadcast | |
| CN111930233A (en) | Panoramic video image display method and display equipment | |
| CN116248889A (en) | Image encoding and decoding method and device and electronic equipment | |
| CN115272132A (en) | Image processing method, device, equipment and storage medium | |
| CN112004065B (en) | Video display method, display device and storage medium | |
| CN112423108B (en) | Method and device for processing code stream, first terminal, second terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: No. 2, Hongyang Road, Tianning District, Changzhou, Jiangsu Province, Jiangsu Applicant after: Jiangsu shiboyun Information Technology Co., Ltd Address before: 100085, Beijing, Haidian District, 5 East Road, Beijing, Mongolia hi tech building, block B, two Applicant before: BEIJING SUPER DIGITAL TV TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20180515 Assignee: Beijing shiboyun Information Technology Co.,Ltd. Assignor: Jiangsu shiboyun Information Technology Co., Ltd Contract record no.: X2021110000011 Denomination of invention: Viewing method, system and server of HD panoramic video based on C / S architecture Granted publication date: 20200918 License type: Common License Record date: 20210323 |
|
| EE01 | Entry into force of recordation of patent licensing contract |