WO2018103384A1 - 一种360度全景视频的播放方法、装置及系统 - Google Patents

一种360度全景视频的播放方法、装置及系统 Download PDF

Info

Publication number
WO2018103384A1
WO2018103384A1 PCT/CN2017/099542 CN2017099542W WO2018103384A1 WO 2018103384 A1 WO2018103384 A1 WO 2018103384A1 CN 2017099542 W CN2017099542 W CN 2017099542W WO 2018103384 A1 WO2018103384 A1 WO 2018103384A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
content
angular ranges
positioning information
information
Prior art date
Application number
PCT/CN2017/099542
Other languages
English (en)
French (fr)
Inventor
颜国雄
别晓辉
段小军
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP17878392.4A priority Critical patent/EP3534616A1/en
Priority to EP21167359.5A priority patent/EP3913924B1/en
Publication of WO2018103384A1 publication Critical patent/WO2018103384A1/zh
Priority to US16/434,387 priority patent/US11184646B2/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H04N21/25841—Management of client data involving the geographical location of the client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Definitions

  • the present application relates to the field of image technologies, and in particular, to a method, device, and system for playing 360-degree panoramic video.
  • 360-degree panoramic video With the popularization of terminals such as smartphones, tablets, smart TVs and VR/AR, 360-degree panoramic video has also become popular.
  • the 360-degree panorama is a flat image generated by mapping the surrounding scenes in a geometric relationship. It can fully display all the real images in the horizontal 360-degree sphere, giving a 3D stereoscopic feeling.
  • the 360-degree panoramic video information based on the 360-degree panorama is comprehensive, interactive, and widely used.
  • the video player interaction mode is designed based on the plane scene.
  • the user can only watch the video content within one angle range at the same time.
  • the user can drag the 360 degree panoramic video screen through the mouse in the video playing interface, and when browsing to the video content of interest, the mouse dragging action can be paused to watch the current video playing.
  • the video content played by the interface is designed based on the plane scene.
  • Some 360-degree panoramic videos also provide viewpoint information, and the user can switch the playback angle range to the angle range corresponding to the viewpoint information by clicking the viewpoint information, and watch the video content within the angle range corresponding to the viewpoint information, if the video content is If the content is not of interest to the user, the user needs to click the viewpoint information again, and switch the playback angle range again until the user views the content of interest.
  • Embodiments of the present invention provide a method, device, and system for playing 360-degree panoramic video, which can improve the efficiency of a user switching a range of playback angles, thereby improving user experience.
  • an embodiment of the present invention provides a method for playing a 360-degree panoramic video.
  • the method includes: a video player receiving a search instruction, where the search instruction is used to indicate that the video player displays a positioning of a 360-degree panoramic video being played.
  • the information includes the description information of the playing content of the plurality of angular ranges of the 360-degree panoramic video, and is used by the user to determine the playing content of the multiple angular ranges according to the description information of the playing content of the multiple angular ranges; the video The player displays the positioning information according to the search instruction; the video player receives a switching instruction, and the switching instruction is used to indicate that the video player ranges the playback angle of the 360-degree panoramic video from the current
  • the range of angles in which the playback content is located is switched to a first range of angles, the first range of angles being an angle range selected by the user in the plurality of range of angles; the video player according to the switching instruction of the 360-segment panoramic video
  • the playback angle range is switched from the range of angles in which the current playback content is located to the first range of angles.
  • the video player can display the positioning information to the user when receiving the search instruction, and the positioning information includes the playing content of the multiple angular ranges of the 360-degree panoramic video.
  • the description information enables the user to determine the playing content of the plurality of angular ranges according to the description information of the playing content of the plurality of angular ranges, and directly receives the 360-degree panoramic video playing angle after receiving the switching instruction input by the user
  • the range is switched from the range of angles of the current playback content to the first range of angles, that is, the current range of playback angles can be directly switched to the first range of angles of the playback content that the user is interested in, without the user having to drag by mouse
  • the 360-degree panoramic video screen selects the range of playback angles of interest, and does not need to switch the playback angle range to each viewpoint one by one, and selects the playback angle range by browsing the playback content, thereby improving the efficiency of the user switching the playback angle range.
  • the video player displays the positioning information according to the search instruction, including: the video player superimposing the positioning information on the current playing content according to the searching instruction.
  • the user can view the positioning information without suspending the current playing content.
  • the method before the video player receives the lookup instruction, the method further includes: the video player acquiring the positioning information.
  • the description information of the playing content of the plurality of angular ranges includes image information of the playing content of each of the plurality of angular ranges; the video player acquires the positioning information, including: the video playing And performing angular segmentation on the 360-degree panoramic video, and determining playing content of the multiple angular ranges; the video player performs image processing on the playing content of the plurality of angular ranges, and acquires an image of the playing content of each angular range Information to get the location information.
  • the video player obtains the positioning information, including: the video player receiving the positioning information sent by the video server.
  • an embodiment of the present invention provides a method for playing a 360-degree panoramic video, where the method includes: acquiring, by a video server, positioning information of a 360-degree panoramic video, where the positioning information includes playing of multiple angular ranges of the 360-degree panoramic video.
  • the content description information is used by the user to determine the play content of the multiple angle ranges according to the description information of the play content of the multiple angle ranges; the video server sends the positioning information to the video player, so that the video player is playing During the 360-degree panoramic video, the positioning information is displayed to the user for the user to select a range of playback angles of the 360-degree panoramic video.
  • the video server can acquire the positioning information, and send the positioning information to the video player, so that the video player plays the 360-degree panoramic video. Display the location information to the user. Since the positioning information includes description information of the playing content of the plurality of angular ranges of the 360-degree panoramic video, when the video player displays the positioning information to the user, The user can understand the playing content of the multiple angular ranges according to the description information of the playing content of the multiple angular ranges, and directly select the angular range corresponding to the playing content of interest to switch, that is, the user can set the current playing angle range.
  • the video server can obtain the positioning information of the 360-degree panoramic video and send it to the video player, so that the modified video player can play the 360-degree panoramic video to the user. Displaying the positioning information, so that the user can determine the playing content of the multiple angular ranges according to the description information of the playing content of the multiple angular ranges of the 360-degree panoramic video included in the positioning information, and select the playing of the 360-degree panoramic video.
  • the angle allows the user to select each viewing angle in turn to select what they want to see.
  • the description information of the playing content of the plurality of angular ranges includes the image information of the playing content of each angular range
  • the video server acquires the positioning information of the 360-degree panoramic video to be played, including: the video server And performing angular segmentation on the 360-degree panoramic video, and determining the playing content of the multiple angular ranges; the video server performs image processing on the playing content of the multiple angular ranges, and acquires image information of the playing content of each angular range, To get the positioning information.
  • the description information of the playing content of the plurality of angular ranges includes the viewing statistics of the playing content of each angular range
  • the video server acquires the positioning information of the 360-degree panoramic video to be played, including: the video The server performs angular range division on the 360-degree panoramic video; the video server collects viewing statistics of the played content of each angular range to obtain the positioning information.
  • an embodiment of the present invention provides a video player, including: a receiving unit, configured to receive a search instruction, where the search instruction is used to instruct a display unit to display positioning information of a 360-degree panoramic video being played, where the positioning information includes The description information of the playing content of the plurality of angular ranges of the 360-degree panoramic video is used by the user to determine the playing content of the multiple angular ranges according to the description information of the playing content of the multiple angular ranges; the display unit is configured to The search instruction received by the receiving unit displays the positioning information; the receiving unit is further configured to receive a switching instruction, where the switching instruction is used to instruct the switching unit to select a playback angle range of the 360-segment panoramic video from a current playback content The range is switched to a first angle range, the first angle range is an angle range selected by the user in the plurality of angle ranges; the switching unit is configured to: the 360 segment panoramic video according to the switching instruction received by the receiving unit The playback angle range is switched from
  • the display unit is specifically configured to superimpose and display the positioning information on the current playing content according to the searching instruction.
  • the description information of the playing content of the plurality of angular ranges includes the image information of the playing content of each of the plurality of angular ranges; the acquiring unit is specifically configured to perform the angle on the 360-degree panoramic video. And dividing the range, and determining the playing content of the plurality of angular ranges, performing image processing on the playing content of the plurality of angular ranges, and acquiring image information of the playing content of each angular range to obtain the positioning information.
  • the video player further includes an obtaining unit, configured to acquire the positioning information before the receiving unit receives the lookup instruction.
  • the acquiring unit is specifically configured to receive positioning information sent by the video server.
  • an embodiment of the present invention provides a video server, including:
  • An obtaining unit configured to acquire positioning information of a 360-degree panoramic video, where the positioning information includes description information of the playing content of the multiple angular ranges of the 360-degree panoramic video, and is used by the user according to the description information of the playing content of the multiple angular ranges Knowing the playing content of the multiple angle ranges; the sending unit is configured to send the positioning information to the video player, so that the video player displays the positioning information to the user during the playing of the 360-degree panoramic video for The user selects the range of playback angles of the 360-degree panoramic video.
  • the description information of the playing content of the plurality of angular ranges includes image information of the playing content of each angular range
  • the acquiring unit is specifically configured to perform angular range division on the 360-degree panoramic video, and determine the multiple The content of the range of angles is subjected to image processing on the content of the plurality of angular ranges, and image information of the played content of each angle range is obtained to obtain the positioning information.
  • the description information of the playing content of the multiple angular ranges includes the viewing statistics of the playing content of each angular range
  • the acquiring unit is specifically configured to perform angular range division on the 360-degree panoramic video, and statistics The viewing statistics of the playback content for each angular range to obtain the positioning information.
  • the description information of the playback content of the plurality of angular ranges includes: image information of the playback content of each of the plurality of angular ranges, and/ Or viewing statistics for the content of each angle range.
  • an embodiment of the present invention provides a video player, where the video player can implement the functions performed by the video player in the method embodiment of the first aspect, and the function can be implemented by using hardware.
  • the corresponding software implementation is performed by hardware.
  • the hardware or software includes one or more modules corresponding to the above functions.
  • the video player includes a processor and a transceiver configured to support the video player to perform the corresponding functions of the above methods.
  • the transceiver is used to support communication between the video player and other network elements.
  • the video player can also include a memory for coupling with the processor that holds the program instructions and data necessary for the video player.
  • an embodiment of the present invention provides a readable medium, including computer execution instructions, when the processor of the video player executes the computer to execute an instruction, the video player performs the first aspect or the first aspect as described above.
  • the embodiment of the present invention provides a video server, where the video server can implement the functions performed by the video server in the method embodiment of the second aspect, and the functions may be implemented by hardware or by hardware.
  • the hardware or software includes one or more modules corresponding to the above functions.
  • the video server includes a processor and a transceiver configured to support the video server to perform the corresponding functions in the above methods.
  • the transceiver is used to support the video service Communication between the device and other network elements.
  • the video server can also include a memory for coupling with the processor that holds the program instructions and data necessary for the video server.
  • an embodiment of the present invention provides a readable medium, including computer execution instructions, when the processor of the video server executes the computer execution instruction, the video server performs any of the foregoing second aspect or the second aspect.
  • the ninth aspect provides a video playing system, comprising: the video player according to any one of the third aspect or the third aspect, the fourth aspect or the fourth aspect a video server as described in any of the possible designs; or a video player as described in the fifth aspect or any of the possible aspects of the fifth aspect, as in the seventh aspect or the seventh aspect Any of the possible designs described in the video server.
  • FIG. 1 is a block diagram of a video playing system according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram 1 of a video server according to an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram 1 of a video player according to an embodiment of the present disclosure.
  • 4a is a flowchart 1 of a method for playing a 360-degree panoramic video according to an embodiment of the present invention
  • FIG. 4b is a second flowchart of a method for playing a 360-degree panoramic video according to an embodiment of the present invention
  • FIG. 5 is a schematic diagram of a manner of displaying positioning information according to an embodiment of the present disclosure.
  • 6a is a schematic diagram 1 of a manner of presenting positioning information according to an embodiment of the present invention.
  • FIG. 6b is a schematic diagram 2 of a manner of presenting positioning information according to an embodiment of the present disclosure
  • FIG. 6c is a schematic diagram 3 of a manner of presenting positioning information according to an embodiment of the present disclosure.
  • FIG. 6 is a schematic diagram 4 of a manner of presenting positioning information according to an embodiment of the present disclosure
  • FIG. 7 is an interaction diagram of a method for acquiring location information according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of a coding manner of positioning information according to an embodiment of the present disclosure.
  • 9A is a schematic structural diagram 2 of a video player according to an embodiment of the present invention.
  • 9B is a schematic structural diagram 3 of a video player according to an embodiment of the present invention.
  • 9C is a schematic structural diagram 4 of a video player according to an embodiment of the present invention.
  • 10A is a schematic structural diagram 2 of a video server according to an embodiment of the present invention.
  • FIG. 10B is a schematic structural diagram 3 of a video server according to an embodiment of the present disclosure.
  • FIG. 10C is a schematic structural diagram 4 of a video server according to an embodiment of the present invention.
  • system and “network” are used interchangeably herein.
  • the term “and” is merely an association relationship describing an associated object, indicating that there may be three relationships, for example, A and B, which may indicate that A exists separately, A and B exist simultaneously, and B exists separately.
  • the character "/" in this article generally indicates that the contextual object is an "or" relationship.
  • the method for playing a 360-degree panoramic video can be applied to a video playing system as shown in FIG. 1 , including a video server and a video player, where the video server is a video source for providing 360 panoramic video to a video player.
  • the video player is a device for playing the 360-degree panoramic video.
  • the video player may be a terminal that can play 360-degree panoramic video, such as a smart phone, a smart TV, a computer, a VR device, and an AR device.
  • a video server includes a video source, a video encoder, and an output interface.
  • the output interface can include a modem and/or a transmitter.
  • Video sources include video capture devices (eg, video cameras), video archives containing previously captured video data, video input interfaces for receiving video data from video content providers, and/or computer graphics systems for generating video data. , or a combination of the above video data sources.
  • the video source is used to provide video data of a 360-degree panoramic video to be played.
  • the video encoder can encode video data from a video source.
  • the video server can send the encoded video data to the video player through the output interface.
  • the encoded video data can also be stored on a storage medium or file server for access by the video player, and the video player can decode and play the acquired encoded video data.
  • a video player includes an input interface, a video decoder, and a display device.
  • the input interface includes a receiver and/or a modem.
  • the input interface is used to receive the encoded video data sent by the video server.
  • the video decoder is configured to decode the encoded video data received by the input interface to obtain the decoded video data.
  • the display device is for displaying the decoded video data.
  • the display device may include various display devices such as a liquid crystal display (LCD), a plasma display, an Organic Light-Emitting Diode (OLED) display, or other types of display devices.
  • LCD liquid crystal display
  • OLED Organic Light-Emitting Diode
  • the video encoder shown in FIG. 2 and the video decoder shown in FIG. 3 may each be one or more microprocessors, digital signal processors (DSPs), and application specific integrated circuits (Application- Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA), discrete logic, hardware, or any combination thereof. If the technology is implemented partially or wholly in software, the device may store the instructions of the software in a suitable non-transitory computer readable storage medium, and the instructions in the hardware may be executed using one or more processors to perform the techniques of the present invention. . Any of the foregoing (including hardware, software, a combination of hardware and software, etc.) can be considered one or more processors. Both the video encoder and the video decoder may be included in one or more encoders or decoders, any of which may be integrated into portions of a combined codec decoder (CODEC) in other devices.
  • CDEC combined codec decoder
  • the embodiment of the present invention provides a method for playing a 360-degree panoramic video, and the method may include:
  • the video player receives a search instruction, where the search instruction is used to indicate that the video player is displaying
  • the positioning information of the 360-degree panoramic video that is played the positioning information includes description information of the playing content of the multiple angular ranges of the 360-degree panoramic video, and is used by the user to determine the multiple according to the description information of the playing content of the multiple angular ranges.
  • the range of playback content is used to indicate that the video player is displaying.
  • the 360-degree panoramic video may be divided into an angular range, for example, every 60 degrees is divided into an angular range, that is, the 360-degree panoramic video is divided into six angular ranges, and the six angular ranges are played.
  • the content constitutes the 360 degree panoramic video.
  • the description information of the playback content of the plurality of angular ranges includes: image information of the playback content of each of the plurality of angular ranges, and/or viewing statistics of the playback content of each angular range .
  • the image information of the playback content of the angular range is used to describe a specific image of the playback content of the angular range.
  • the image information may describe whether the playback content of the angular range is a foreground image or a background image, and whether there is a character, an animal, and/or Or an item, whether it is a moving picture or a still picture, a complex texture image, or a simple texture image. If the playback content of the range of angles has characters, animals, and/or articles, the image information may further include enclosure information of the person, animal, and/or article, and the like.
  • the image information may also be information describing the importance of the image of the playback content of the range of angles, that is, the score of the image of the playback content of the angle range may be calculated according to a preset weight coefficient, and the content of the angle range is represented by the score. The importance of the image.
  • the playback content of the range of angles has characters, animals, and/or articles, or when the playback content of the range of angles is a foreground image, or when the playback content of the range of angles is a moving image, the playback content of the range of angles
  • the weight coefficient of the angle range is 1.0; when the content of the angle range is a still picture, the weighting coefficient of the content of the angle range is 0.8; when the content of the angle range is the background image, the content of the range of the playing content
  • the weight coefficient is 0.2 or the like.
  • the viewing statistics of the playback content of the angle range may represent the number of people who select each angle range when viewing the 360-degree panoramic video by multiple users. It can be understood that the more people watching the content of a certain angle range, the more people can The more exciting the content of the playback of the range of angles is, for example, the content of the content is hot content, so that the viewing statistics of the playback content of each angle range can be provided, so that the user can select an angle range with a larger number of viewers as the playback angle. range.
  • the description information of the playing content of each angle range enables the user to quickly understand the playing content of each angle range, so that the playing angle range can be selected according to the playing content of interest.
  • the user can input a search command to find the playback angle of the content of interest when the 360-degree panoramic video is played to any progress, and switch the playback angle.
  • the video player displays the positioning information according to the search instruction.
  • the video player may superimpose the positioning information on the current playing content according to the searching instruction.
  • the positioning information may be displayed in a part of the playing interface, where the area may be at any position of the playing interface, for example, in the middle of the playing interface, or in the middle and lower of the playing interface, or in the lower right And so on, the embodiment of the present invention is not limited.
  • the current play content of the play interface of the video player may be paused or played.
  • the positioning information is superimposed and displayed on the current playing content.
  • the video player can present the positioning information in various manners, for example, by using text, a chart, a compass image, or a thumbnail.
  • the video player receives a search instruction input by the user, and at this time, the image information of the content of the 360-degree panoramic video in the range of 0° to 60° is a character.
  • the viewing statistics are 162; the image information of the playback content in the range of 60 ° to 120 ° is Item/foreground/still/complex, viewing statistics is 131; image information of playback content in the range of 120° to 180° is character/foreground/sports/complex, viewing statistics is 186; in 180° to 240°
  • the angular range of the playback content of the image information is animal/background/still/simple, the viewing statistics are 158; the image information of the playback content in the range of 240° to 300° is character/background/still/complex, viewing statistics
  • the number is 112; the image information of the playback content in the range of 300° to 360° is other/background/still/simple, and the viewing statistic is 78.
  • the manner in which the positioning information of the 360-degree panoramic video is presented will be exemplarily described below with reference to FIGS. 6
  • the positioning information When the positioning information is presented in a graphical manner, the positioning information includes image information and viewing statistics of the playback content of each angular range, and the positioning information may be a cylindrical statistical chart as shown in FIG. 6a.
  • the viewing statistics are represented by the column chart, and the image information of the playing content of each angle range can be marked in the corresponding position by the text description, if the positioning information of the 360-degree panoramic video does not include the playing content of each angle range
  • the image information can be marked without corresponding text description.
  • the positioning information includes image information and viewing statistics of the playback content of each angular range, and the positioning information may be as shown in (1) in FIG. 6b.
  • Compass image in the ring of the compass image, each angular extent corresponds to a portion of the ring, by marking the corresponding text description in the corresponding portion of the ring to characterize the image information of the playback content of the corresponding angular range, and
  • the relative sizes of the viewing statistics corresponding to the six angular ranges are characterized by different colors, and the corresponding portions of the ring are filled with corresponding colors to represent the relative sizes of the viewing statistics corresponding to the six angular ranges, for example, red indicates viewing.
  • the statistic is the most.
  • a part of the angle range of 120° to 180° is filled with red, and green indicates that the viewing statistics are the least, as shown in Fig. 6b (1).
  • a part of the angular range of 300° to 360° is filled with green. Therefore, the user can determine by color which angle range of the playback content has the most viewing statistics.
  • the positioning information may be a compass image as shown in (2) in FIG. 6b, and the corresponding portion of the ring is filled with a corresponding color to represent 6
  • the positioning information may be a compass image as shown in (3) in FIG. 6b, by marking the corresponding text description in the corresponding part of the ring To characterize the image information of the playback content of the corresponding angular range.
  • each angle range corresponds to the image information and/or the viewing statistics of the playing content.
  • the positioning information includes the playing content of each angle range.
  • the image information and the viewing statistics may be a list of words as shown in Figure 6c.
  • the positioning information may be superimposed and displayed on the current playing content in a translucent manner.
  • the positioning information includes image information of the playback content of each angular range, and the positioning information may be a complete panoramic thumbnail as shown in (1) in FIG. 6d;
  • the positioning information can also be simplified as shown in (2) of FIG. 6d, and the thumbnails of important images (such as characters, animals, foreground images, etc.) are retained, and the memory occupied by the thumbnails can be reduced by simplifying the background. Size, save memory resources; the positioning information can also be further simplified as shown in (3) of Figure 6d, only to retain thumbnails of important images (such as people, animals, foreground images, etc.), thereby further reducing The size of the memory occupied by the thumbnails further saves memory resources.
  • the video player receives a switching instruction, where the switching instruction is used to instruct the video player to switch a playback angle of the 360-segment panoramic video from an angle range in which the current playback content is located to a first angular range, where the first angular range is An angular range selected for the user in the plurality of angular ranges.
  • the user can input a switching instruction by clicking a position corresponding to the first angular range in the positioning information, and after receiving the switching instruction, the video player can determine the user's hope according to the position of the detected switching instruction.
  • the first angular range of the switching is which angular range in the positioning information.
  • the user when the user wishes to switch the range of the playback angle to an angle range of 180° to 240°, the user can click on the red of the compass image as shown in (1) in FIG. 6b.
  • the angle range of the first angle range of 180° to 240° can be determined according to the position where the switching command is detected.
  • the video player switches the playback angle range of the 360-segment panoramic video from the range of the current playback content to the first angular range according to the switching instruction.
  • the video player can display the positioning information to the user when receiving the search instruction, and the positioning information includes multiple of the 360-degree panoramic video.
  • Descriptive information of the playback content of the range of angles so that the user can determine the content of the plurality of angular ranges according to the description information of the playback content of the plurality of angular ranges, and directly receive the 360 degrees after receiving the switching instruction input by the user
  • the playback angle range of the panoramic video is switched from the range of the current playback content to the first angular range, that is, the current playback angle range can be directly switched to the first angular range having the playback content of the user, without the need
  • the user selects the range of the playback angle of interest by dragging the 360-degree panoramic video through the mouse, and does not need to switch the playback angle range to each viewpoint one by one, and selects the playback angle range by browsing the playback content, thereby improving the user's switching play
  • the method further includes:
  • the video player acquires the positioning information.
  • the embodiment of the present invention provides two methods for obtaining positioning information.
  • the first method for obtaining positioning information is that the video server obtains the positioning information by performing a series of processing on the 360-degree panoramic video, and sends the positioning information.
  • the second way to obtain the positioning information is that the video player directly performs a series of processing on the 360-degree panoramic video to obtain the positioning information.
  • the first method for obtaining the positioning information may be as shown in FIG. 7.
  • the foregoing S100 may be specifically implemented by the steps shown in FIG. 7.
  • the first type Ways to get location information include:
  • S100a and the video server acquire positioning information of the 360-degree panoramic video.
  • the video server may first perform angular range division on the 360-degree panoramic video to determine the playing content of the multiple angular ranges. Then, when the positioning information includes image information of the playing content of each angular range, the video server performs image processing on the playing content of the plurality of angular ranges, and acquires image information of the playing content of each angular range to obtain the positioning. information.
  • the image processing of the playback content of the plurality of angular ranges may include, by using a significant detection algorithm, a foreground and background separation algorithm, a person detection algorithm, an item detection algorithm, an animal detection algorithm, and the like, for each angle
  • a significant detection algorithm a foreground and background separation algorithm
  • a person detection algorithm a person detection algorithm
  • an item detection algorithm a person detection algorithm
  • an animal detection algorithm a person detection algorithm
  • an animal detection algorithm an animal detection algorithm
  • the screen is a screen image with a complex texture or a simple texture image, and the screen information is directly used as image information.
  • the score of the played content of each angle range may be calculated according to a preset weight coefficient by numerical calculation, and the calculated score is determined as image information.
  • the video server may count the viewing statistics of the playing content of each angular range to obtain the positioning information. For example, after adding one user to watch the 360-degree panoramic video, the video server updates the viewing statistics of the playing content of each angle range, and sends the updated viewing statistics as positioning information to the next added one. A video player requesting to play the 360-degree panoramic video.
  • the video server sends the positioning information to the video player.
  • the video server can separately send the positioning information to the video player, that is, the video stream information of the 360-degree panoramic video and the positioning information are separately sent to the video player.
  • the video server may also encode the positioning information into the video stream information of the 360-degree panoramic video, and send the video stream information to the video player together with the video stream information of the 360-degree panoramic video.
  • the 360-degree panoramic video includes video stream information, subtitle stream information, and audio stream information
  • the video stream information includes source metadata and descriptive information.
  • the video server may add an interest information to the video stream information to encode the positioning information in the information of interest.
  • the positioning information can be obtained when the data stream information is decoded.
  • the video player may further adopt the second method for acquiring the positioning information.
  • the positioning information is obtained autonomously, that is, the video player divides the angular range of the 360-degree panoramic video, determines the playing content of the multiple angular ranges, and then performs image processing on the playing content of the multiple angular ranges, and acquires each The image information of the content is played in an angular range to obtain the positioning information.
  • the video player performs image processing on the playback content of the plurality of angular ranges, acquires image information of the playback content of each angular range, and performs image processing on the playback content of the plurality of angular ranges by the video server.
  • the image information of the playback content of each angle range is obtained in the same manner, and will not be described here.
  • each network element such as a video server and a video player, etc.
  • each network element includes hardware structures and/or software modules corresponding to the execution of the respective functions.
  • the present invention can be implemented in a combination of hardware or hardware and computer software in combination with the elements and algorithm steps of the various examples described in the embodiments disclosed herein. Whether a function is implemented in hardware or computer software to drive hardware depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.
  • the embodiment of the present invention may divide a function module of a video server, a video player, and the like according to the foregoing method example.
  • each function module may be divided according to each function, or two or more functions may be integrated into one processing module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of the module in the embodiment of the present invention is schematic, and is only a logical function division, and the actual implementation may have another division manner.
  • FIG. 9A shows a possible structural diagram of a video player involved in the foregoing embodiment, where the video player includes: an acquiring unit, a receiving unit, a display unit, and Switch unit.
  • the obtaining unit is configured to support the video player to perform the process S100 in FIG. 4b
  • the receiving unit is configured to support the video player to perform the processes S101 and S103 in FIGS. 4a and 4b, and to perform the process S100b in FIG. 7
  • the display unit The supporting video player performs the process S102 of Figures 4a and 4b
  • the switching unit is for supporting the video player to perform the process S104 of Figures 4a and 4b. All the related content of the steps involved in the foregoing method embodiments may be referred to the functional descriptions of the corresponding functional modules, and details are not described herein again.
  • FIG. 9B shows a possible structural diagram of the video player involved in the above embodiment.
  • the video player includes a processing module 900 and a communication module 901.
  • the processing module 900 is configured to control and manage the actions of the video player.
  • the processing module 900 is configured to support the video player to perform the processes S101-S104 in FIG. 4a, and the processes S100-S104 in FIG. 4b, in FIG. Process S100b, and/or other processes for the techniques described herein.
  • Communication module 901 is used to support communication between the video player and other network entities, such as communication with the functional modules or network entities shown in FIG.
  • the video player may also include a storage module 902 for storing program code and data of the video player.
  • the processing module 900 can be a processor or a controller, such as a central processing unit (CPU), a general purpose processor, a DSP, an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component, or Any combination thereof. It is possible to implement or carry out the various illustrative logical blocks, modules and circuits described in connection with the present disclosure.
  • the processor may also be a combination of computing functions, for example, including one or more microprocessor combinations, a combination of a DSP and a microprocessor, and the like.
  • the communication module 901 can be a transceiver, a transceiver circuit, a communication interface, or the like.
  • the storage module 902 can be a memory.
  • the video player according to the embodiment of the present invention may be the video player shown in FIG. 9C.
  • the video player includes a processor 910, a communication interface 911, a memory 912, and a bus 913.
  • the communication interface 911, the processor 910, and the memory 912 are connected to each other through a bus 913.
  • the bus 913 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. Wait. Total Lines can be divided into address bus, data bus, control bus, and so on. For ease of representation, only one thick line is shown in Figure 9C, but it does not mean that there is only one bus or one type of bus.
  • PCI Peripheral Component Interconnect
  • EISA Extended Industry Standard Architecture
  • FIG. 10A shows a possible structural diagram of a video server involved in the foregoing embodiment, where the video server includes: an obtaining unit and a sending unit.
  • the obtaining unit is configured to support the video server to execute the process S100a in FIG. 7;
  • the sending unit is configured to support the video server to execute the process S100b in FIG. 7. All the related content of the steps involved in the foregoing method embodiments may be referred to the functional descriptions of the corresponding functional modules, and details are not described herein again.
  • FIG. 10B shows a possible structural diagram of the video server involved in the above embodiment.
  • the video server includes a processing module 1000 and a communication module 1001.
  • the processing module 1000 is for controlling management of the actions of the video server.
  • the processing module 1000 is configured to support the video server to perform processes S100a and S100b as in FIG. 7, and/or other processes for the techniques described herein.
  • the communication module 1001 is for supporting communication between the video server and other network entities, such as communication with the functional modules or network entities shown in FIG.
  • the video server may also include a storage module 1002 for storing program code and data of the video server.
  • the processing module 1000 can be a processor or a controller, such as a CPU, a general purpose processor, a DSP, an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. It is possible to implement or carry out the various illustrative logical blocks, modules and circuits described in connection with the present disclosure.
  • the processor may also be a combination of computing functions, for example, including one or more microprocessor combinations, a combination of a DSP and a microprocessor, and the like.
  • the communication module 1001 may be a communication interface, a transceiver circuit or a transceiver, or the like.
  • the storage module 1002 can be a memory.
  • the video server When the processing module 1000 is a processor, the communication module 1001 is a communication interface, and the storage module 1002 is a memory, the video server according to the embodiment of the present invention may be the video server shown in FIG. 10C.
  • the video server includes a processor 1010, a communication interface 1011, a memory 1012, and a bus 1013.
  • the communication interface 1011, the processor 1010, and the memory 1012 are connected to each other through a bus 1010.
  • the bus 1013 may be a PCI bus or an EISA bus.
  • the bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 10C, but it does not mean that there is only one bus or one type of bus.
  • the steps of a method or algorithm described in connection with the present disclosure may be implemented in a hardware, or may be implemented by a processor executing software instructions.
  • the software instructions may be composed of corresponding software modules, which may be stored in a random access memory (RAM), a flash memory, a read only memory (ROM), an erasable programmable read only memory ( Erasable Programmable ROM (EPROM), electrically erasable programmable read only memory (EEPROM), registers, hard disk, removable hard disk, compact disk read only (CD-ROM) or any other form of storage medium known in the art.
  • An exemplary storage medium is coupled to the processor to enable the processor to read information from, and write information to, the storage medium.
  • the storage medium can also be an integral part of the processor.
  • the processor and the storage medium can be located in an ASIC. Additionally, the ASIC can be located in a core network interface device.
  • the processor and the storage medium may also exist as discrete components in the core network interface device.
  • the embodiment further provides a storage medium, including computer execution instructions, when the processor of the video player executes the computer to execute an instruction, the video player performs 360 degrees as described above in FIG. 4a or 4b. How to play panoramic video.
  • the storage medium can include the memory 912.
  • the embodiment further provides another storage medium, including computer execution instructions, when the processor of the video server executes the computer execution instruction, the video server performs the 360 degree panoramic video playing method as described above in FIG. .
  • the storage medium can include the memory 1012.
  • the embodiment of the present invention provides a video playing system, which can be as shown in FIG. 1, including a video player as shown in FIG. 9A, 9B or 9C, and a video server as shown in FIG. 10A, 10B or 10C.
  • the video player can display the positioning information to the user when receiving the search instruction, and the positioning information includes description information of the playing content of the plurality of angular ranges of the 360-degree panoramic video, so that the user can play according to the multiple angular ranges.
  • the description information of the content determines the playing content of the plurality of angular ranges, and after receiving the switching instruction input by the user, directly switches the playing angle range of the 360-degree panoramic video from the angular range in which the current playing content is located to the first angle Range, that is, the current playback angle range can be directly switched to the first angle range having the playback content of interest to the user, without the user having to drag the 360 degree panoramic video screen by the mouse to select the playback angle range of interest. It is also unnecessary to switch the playback angle range to each viewpoint one by one, and select the playback angle range by browsing the playback content, thereby improving the efficiency of the user switching the playback angle range.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the modules or units is only a logical function division.
  • there may be another division manner for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including a plurality of instructions for causing a computer device (which may be a personal computer, a server, Either a network device or the like) or a processor performs all or part of the steps of the method described in various embodiments of the invention.
  • the storage medium is a non-transitory medium, including: a flash memory, a mobile hard disk, a read only memory, a random access memory, a magnetic disk, or an optical disk, and the like, which can store program code.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the modules or units is only a logical function division.
  • there may be another division manner for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • a computer readable storage medium A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to perform all or part of the steps of the methods described in various embodiments of the present application.
  • the foregoing storage medium includes: a flash memory, a mobile hard disk, a read only memory, a random access memory, a magnetic disk, or an optical disk, and the like, which can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Graphics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明实施例提供一种360度全景视频的播放方法、装置及系统，涉及图像技术领域，能够提高用户切换播放角度的效率。该方法包括：视频播放器接收查找指令，并根据查找指令显示该视频播放器显示正在播放的360度全景视频的定位信息，该定位信息包括该360度全景视频的多个角度范围的播放内容的描述信息，用于用户根据该多个角度范围的播放内容的描述信息确定该多个角度范围的播放内容；接收切换指令，根据该切换指令将该360段全景视频的播放角度范围从该当前的播放内容所在的角度范围切换到该第一角度范围，该第一角度范围为该多个角度范围中的用户选择的一个角度范围。

Description

一种360度全景视频的播放方法、装置及系统
本申请要求于2016年12月07日提交中国专利局、申请号为201611118333.X、申请名称为“一种360度全景视频的播放方法、装置及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及图像技术领域，尤其涉及一种360度全景视频的播放方法、装置及系统。
背景技术
随着智能手机、平板电脑、智能电视和VR/AR等终端的普及使用，360度全景视频也逐渐普及。360度全景是通过对周围景象以一种几何关系进行映射生成的平面图片，能够全面的展示水平360度的球型范围内的所有真实影像，给人以3D立体的空间感觉。基于360度全景图制作而成的360度全景视频信息量全，交互性好，应用广泛。
目前，视频播放器交互方式都是基于平面场景设计的，用户在观看360度全景视频时，同一时间只能观看一个角度范围内的视频内容。当用户需要选择感兴趣的视频内容时，用户可以在视频播放界面通过鼠标拖动360度全景视频的画面，当浏览到感兴趣的视频内容时，即可暂停鼠标拖动动作，观看当前视频播放界面播放的视频内容。有的360度全景视频还提供视点信息，用户可以通过点击视点信息，将播放角度范围切换到该视点信息对应的角度范围，观看该视点信息对应的角度范围内的视频内容，若该视频内容并不是用户感兴趣的内容，则需要用户重新点击视点信息，再次切换播放角度范围直至用户观看到感兴趣的内容为止。
然而，无论是通过鼠标拖动360度全景视频的画面来选择感兴趣的播放角度范围，还是通过逐一播放各个角度范围的播放内容，来选择播放角度范围，都需要用户进行大量的操作，导致用户切换播放角度范围的效率低下。
发明内容
本发明的实施例提供一种360度全景视频的播放方法、装置及系统，能够提高用户切换播放角度范围的效率，从而提高用户体验。
为达到上述目的，本发明的实施例采用如下技术方案：
第一方面，本发明实施例提供一种360度全景视频的播放方法，该方法包括：视频播放器接收查找指令，该查找指令用于指示该视频播放器显示正在播放的360度全景视频的定位信息，该定位信息包括该360度全景视频的多个角度范围的播放内容的描述信息，用于用户根据该多个角度范围的播放内容的描述信息确定该多个角度范围的播放内容；该视频播放器根据该查找指令显示该定位信息；该视频播放器接收切换指令，该切换指令用于指示该视频播放器将该360度全景视频的播放角度范围从当前 的播放内容所在的角度范围切换到第一角度范围，该第一角度范围为该多个角度范围中的该用户选择的一个角度范围；该视频播放器根据该切换指令将该360段全景视频的播放角度范围从该当前的播放内容所在的角度范围切换到该第一角度范围。
基于本发明实施例提供的360度全景视频的播放方法，视频播放器能够在接收到查找指令时，向用户显示该定位信息，该定位信息包括该360度全景视频的多个角度范围的播放内容的描述信息，使得用户能够根据该多个角度范围的播放内容的描述信息确定该多个角度范围的播放内容，并在接收到用户输入的切换指令后，直接将该360度全景视频的播放角度范围从当前的播放内容所在的角度范围切换到第一角度范围，即可以将当前的播放角度范围直接切换到具有该用户感兴趣的播放内容的第一角度范围，而无需该用户通过鼠标拖动360度全景视频的画面来选择感兴趣的播放角度范围，也无需逐一将播放角度范围切换到每个视点，通过浏览播放内容来选择播放角度范围，从而提高了用户切换播放角度范围的效率。
在一种可能的设计中，视频播放器根据查找指令显示定位信息，包括：该视频播放器根据该查找指令，将该定位信息叠加显示在该当前的播放内容上。
在这种可能的设计中，通过将该定位信息叠加显示在该当前的播放内容上，使得用户可以在不暂停该当前的播放内容的基础上，查看定位信息。
在一种可能的设计中，视频播放器接收查找指令之前，该方法还包括：该视频播放器获取定位信息。
在一种可能的设计中，多个角度范围的播放内容的描述信息包括该多个角度范围中的每个角度范围的播放内容的图像信息；该视频播放器获取定位信息，包括：该视频播放器对该360度全景视频进行角度范围划分，并确定该多个角度范围的播放内容；该视频播放器对该多个角度范围的播放内容进行图像处理，获取每个角度范围的播放内容的图像信息，以得到该定位信息。
在该可能的设计中，提出了一种由视频播放器自主获取定位信息的方式，能够避免增加视频播放器与视频服务器之间用于信息传输的带宽。
在一种可能的设计中，视频播放器获取定位信息，包括：该视频播放器接收视频服务器发送的该定位信息。
在该可能的设计中，提出了一种由视频服务器提供定位信息的方式，能够避免视频播放器的功耗。
第二方面，本发明实施例提供一种360度全景视频的播放方法，该方法包括：视频服务器获取360度全景视频的定位信息，该定位信息包括该360度全景视频的多个角度范围的播放内容的描述信息，用于用户根据该多个角度范围的播放内容的描述信息确定该多个角度范围的播放内容；该视频服务器向视频播放器发送该定位信息，以使得该视频播放器在播放该360度全景视频的过程中，向用户显示该定位信息，以供用户选择该360度全景视频的播放角度范围。
基于本发明实施例提供的360度全景视频的播放方法，视频服务器能够获取定位信息，并将该定位信息发送至视频播放器，以使得该视频播放器在播放该360度全景视频的过程中，向用户显示该定位信息。由于该定位信息包括该360度全景视频的多个角度范围的播放内容的描述信息，因此，当该视频播放器向用户显示该定位信息时， 用户能够根据该多个角度范围的播放内容的描述信息了解该多个角度范围的播放内容，并直接选择感兴趣的播放内容所对应的角度范围进行切换，即使得用户可以将当前的播放角度范围直接切换到具有该用户感兴趣的播放内容的角度范围，而无需通过鼠标拖动画面来选择感兴趣的播放角度范围，也无需逐一将播放角度范围切换到每个视点，通过观看播放内容来选择播放角度范围，从而提高了用户切换播放角度范围的效率。
基于本发明实施例提供的视频播放方法，视频服务器能够获取360度全景视频的定位信息，并发送至视频播放器，以使得改视频播放器能够在播放该360度全景视频的过程中，向用户显示该定位信息，从而用户可以根据该定位信息中包括的该360度全景视频的多个角度范围的播放内容的描述信息确定该多个角度范围的播放内容，并选择该360度全景视频的播放角度，使得用户无需依次观看每个播放角度来选择想看的。
在一种可能的设计中，多个角度范围的播放内容的描述信息包括每个角度范围的播放内容的图像信息，该视频服务器获取待播放的360度全景视频的定位信息，包括：该视频服务器对该360度全景视频进行角度范围划分，并确定该多个角度范围的播放内容；该视频服务器对该多个角度范围的播放内容进行图像处理，获取每个角度范围的播放内容的图像信息，以得到该定位信息。
在一种可能的设计中，多个角度范围的播放内容的描述信息包括每个角度范围的播放内容的观看统计数，该视频服务器获取待播放的360度全景视频的定位信息，包括：该视频服务器对该360度全景视频进行角度范围划分；该视频服务器统计每个角度范围的播放内容的观看统计数，以得到该定位信息。
第三方面，本发明实施例提供一种视频播放器，包括：接收单元，用于接收查找指令，该查找指令用于指示显示单元显示正在播放的360度全景视频的定位信息，该定位信息包括该360度全景视频的多个角度范围的播放内容的描述信息，用于用户根据该多个角度范围的播放内容的描述信息确定该多个角度范围的播放内容；该显示单元，用于根据该接收单元接收到的该查找指令显示该定位信息；该接收单元，还用于接收切换指令，该切换指令用于指示切换单元将该360段全景视频的播放角度范围从当前的播放内容所在的角度范围切换到第一角度范围，该第一角度范围为该多个角度范围中的该用户选择的一个角度范围；该切换单元，用于根据该接收单元接收的该切换指令将该360段全景视频的播放角度范围从该当前的播放内容所在的角度范围切换到该第一角度范围。
在一种可能的设计中，显示单元，具体用于根据查找指令，将定位信息叠加显示在当前的播放内容上。
在一种可能的设计中，多个角度范围的播放内容的描述信息包括该多个角度范围中的每个角度范围的播放内容的图像信息；获取单元，具体用于对360度全景视频进行角度范围划分，并确定该多个角度范围的播放内容，对该多个角度范围的播放内容进行图像处理，获取每个角度范围的播放内容的图像信息，以得到该定位信息。
在一种可能的设计中，视频播放器还包括获取单元，该获取单元，用于在接收单元接收查找指令之前，获取所述定位信息。
在一种可能的设计中，获取单元，具体用于接收视频服务器发送的定位信息。
本发明实施例提供的视频播放器的技术效果可以参见上述第一方面或一方面的各个可选方式的技术效果，此处不再赘述。
第四方面，本发明实施例提供一种视频服务器，包括：
获取单元，用于获取360度全景视频的定位信息，该定位信息包括该360度全景视频的多个角度范围的播放内容的描述信息，用于用户根据该多个角度范围的播放内容的描述信息了解该多个角度范围的播放内容；发送单元，用于向视频播放器发送该定位信息，以使得该视频播放器在播放该360度全景视频的过程中，向用户显示该定位信息，以供用户选择该360度全景视频的播放角度范围。
在一种可能的设计中，多个角度范围的播放内容的描述信息包括每个角度范围的播放内容的图像信息，获取单元，具体用于对360度全景视频进行角度范围划分，并确定该多个角度范围的播放内容，对该多个角度范围的播放内容进行图像处理，获取每个角度范围的播放内容的图像信息，以得到该定位信息。
在一种可能的设计中，多个角度范围的播放内容的描述信息包括每个角度范围的播放内容的观看统计数，该获取单元，具体用于对该360度全景视频进行角度范围划分，统计每个角度范围的播放内容的观看统计数，以得到该定位信息。
本发明实施例提供的视频服务器的技术效果可以参见上述第二方面或第二方面的各个可选方式的技术效果，此处不再赘述。
结合上述第一方面至第四方面，在一种可能的设计中，多个角度范围的播放内容的描述信息包括：该多个角度范围中的每个角度范围的播放内容的图像信息，和/或每个角度范围的播放内容的观看统计数。
第五方面，本发明实施例提供了一种视频播放器，该视频播放器可以实现上述第一方面所涉及方法实施例中视频播放器所执行的功能，所述功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。所述硬件或软件包括一个或多个上述功能相应的模块。
在一种可能的设计中，该视频播放器的结构中包括处理器和收发器，该处理器被配置为支持该视频播放器执行上述方法中相应的功能。该收发器用于支持该视频播放器与其他网元之间的通信。该视频播放器还可以包括存储器，该存储器用于与处理器耦合，其保存该视频播放器必要的程序指令和数据。
第六方面，本发明实施例提供一种可读介质，包括计算机执行指令，当视频播放器的处理器执行所述计算机执行指令时，所述视频播放器执行如上述第一方面或第一方面的任意一种实现方式中所述的360度全景视频的播放方法。
本发明实施例提供的视频播放器的技术效果可以参见上述第一方面或第一方面的各个可选方式的技术效果，此处不再赘述。
第七方面，本发明实施例提供了一种视频服务器，该视频服务器可以实现上述第二方面所涉及方法实施例中视频服务器所执行的功能，所述功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。所述硬件或软件包括一个或多个上述功能相应的模块。
在一种可能的设计中，该视频服务器的结构中包括处理器和收发器，该处理器被配置为支持该视频服务器执行上述方法中相应的功能。该收发器用于支持该视频服务 器与其他网元之间的通信。该视频服务器还可以包括存储器，该存储器用于与处理器耦合，其保存该视频服务器必要的程序指令和数据。
第八方面，本发明实施例提供一种可读介质，包括计算机执行指令，当视频服务器的处理器执行所述计算机执行指令时，所述视频服务器执行如上述第二方面或第二方面的任意一种实现方式中所述的360度全景视频的播放方法。
本发明实施例提供的视频服务器的技术效果可以参见上述第二方面或第二方面的各个可选方式的技术效果，此处不再赘述。
第九方面，本发明实施例提供一种视频播放系统，包括:如第三方面或第三四方面中的任一种可能的设计中所述的视频播放器、如第四方面或第四方面中的任一种可能的设计中所述的视频服务器；或者，如第五方面或第五方面中的任一种可能的设计中所述的视频播放器、如第七方面或第七方面中的任一种可能的设计中所述的视频服务器。
附图说明
图1为本发明实施例提供的视频播放系统的框图；
图2为本发明实施例提供的一种视频服务器的结构示意图一；
图3为本发明实施例提供的一种视频播放器的结构示意图一；
图4a为本发明实施例提供的一种360度全景视频的播放方法的流程图一；
图4b为本发明实施例提供的一种360度全景视频的播放方法的流程图二；
图5为本发明实施例提供的一种定位信息的显示方式的示意图；
图6a为本发明实施例提供的一种定位信息的呈现方式的示意图一；
图6b为本发明实施例提供的一种定位信息的呈现方式的示意图二；
图6c为本发明实施例提供的一种定位信息的呈现方式的示意图三；
图6d为本发明实施例提供的一种定位信息的呈现方式的示意图四；
图7为本发明实施例提供的一种定位信息的获取方法的交互图；
图8为本发明实施例提供的一种定位信息的编码方式的示意图；
图9A为本发明实施例提供的一种视频播放器的结构示意图二；
图9B为本发明实施例提供的一种视频播放器的结构示意图三；
图9C为本发明实施例提供的一种视频播放器的结构示意图四；
图10A为本发明实施例提供的一种视频服务器的结构示意图二；
图10B为本发明实施例提供的一种视频服务器的结构示意图三；
图10C为本发明实施例提供的一种视频服务器的结构示意图四。
具体实施方式
值得说明的是，本文中术语“系统”和“网络”在本文中常被可互换使用。本文中术语“和”，仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，本文中字符“/”，一般表示前后关联对象是一种“或”的关系。
当本发明实施例提及“第一”、“第二”、“第三”或者“第四”等序数词时， 除非根据上下文其确实表达顺序之意，否则应当理解为仅仅是起区分之用。此外，术语“包括”和“具有”以及它们任何变形，意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元，而是可选地还包括没有列出的步骤或单元，或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。
本发明实施例提供的360度全景视频的播放方法可以应用于如图1所示的视频播放系统，包括视频服务器和视频播放器，视频服务器是用于向视频播放器提供360全景视频的视频源，视频播放器是用于播放该360度全景视频的设备。其中，视频播放器可以是智能手机、智能电视、电脑、VR设备以及AR设备等可以播放360度全景视频的终端。
如图2所示，为本发明实施例提供的一种视频服务器，包括视频源、视频编码器及输出接口。在一些实例中，该输出接口可以包括调制解调器和/或发射器。视频源包括视频俘获装置(例如，视频相机)、含有先前俘获的视频数据的视频存档、用于从视频内容提供者接收视频数据的视频输入接口，和/或用于产生视频数据的计算机图形系统，或上述视频数据源的组合。该视频源用于提供待播放的360度全景视频的视频数据。
视频编码器可编码来自视频源的视频数据。视频服务器可以通过该输出接口将编码后的视频数据发送至视频播放器。编码后的视频数据还可存储于存储媒体或文件服务器上以供视频播放器存取，并且视频播放器可以将获取的编码后的视频数据进行解码以及播放。
如图3所示，一种视频播放器，包括输入接口、视频解码器及显示装置。在一些实例中，输入接口包括接收器和/或调制解调器。输入接口用于接收视频服务器发送的编码后的视频数据。视频解码器用于对输入接口接收到的编码后的视频数据进行解码，获取解码后的视频数据。显示装置用于显示解码后的视频数据。显示装置可包括多种显示装置，例如液晶显示器(Liquid Crystal Display，LCD)、等离子体显示器、有机发光二极管(Organic Light-Emitting Diode，OLED)显示器或其它类型的显示装置。
其中，如图2所示的视频编码器和如图3所示的视频解码器均可以为一个或多个微处理器、数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(Application-Specific Integrated Circuit，ASIC)、现场可编程门阵列(Field Programmable Gate Array，FPGA)、离散逻辑、硬件或其任何组合。如果技术部分地或者全部以软件实施，则装置可将软件的指令存储于合适的非瞬时计算机可读存储媒体中，且可使用一个或多个处理器执行硬件中的指令以执行本发明的技术。可将前述各者中的任一者(包括硬件、软件、硬件与软件的组合等)视为一个或多个处理器。视频编码器及视频解码器均可包括于一个或多个编码器或解码器中，其中的任一者可整合为其它装置中的组合式编解码器(Coder Decoder，CODEC)的部分。
基于如图1所示的视频播放系统，如图4a所示，本发明实施例提供一种360度全景视频的播放方法，该方法可以包括：
S101、该视频播放器接收查找指令，该查找指令用于指示该视频播放器显示正在 播放的360度全景视频的定位信息，该定位信息包括该360度全景视频的多个角度范围的播放内容的描述信息，用于用户根据该多个角度范围的播放内容的描述信息确定该多个角度范围的播放内容。
在本发明实施例中，可以将360度全景视频进行角度范围的划分，例如，每60度划分为一个角度范围，即将该360度全景视频划分为6个角度范围，该6个角度范围的播放内容构成该360度全景视频。
在一个示例中，该多个角度范围的播放内容的描述信息包括：该多个角度范围中的每个角度范围的播放内容的图像信息，和/或每个角度范围的播放内容的观看统计数。
其中，角度范围的播放内容的图像信息用于描述该角度范围的播放内容的具体图像，例如，该图像信息可以描述该角度范围的播放内容为前景图像还是背景图像，是否具有人物、动物和/或物品，是运动的画面还是静止的画面、是纹理复杂的图像还是纹理简单的图像等。若该角度范围的播放内容有人物、动物和/或物品，则该图像信息还可以包括该人物、动物和/或物品的包围框信息等。
该图像信息还可以是描述该角度范围的播放内容的图像的重要性的信息，即可以按照预设的权重系数计算该角度范围的播放内容的图像的分数，通过分数表征该角度范围的播放内容的图像的重要性。例如，当角度范围的播放内容有人物、动物和/或者物品时，或者该角度范围的播放内容为前景图像时，或者当该角度范围的播放内容是运动的画面时，该角度范围的播放内容的权重系数为1.0；当该角度范围的播放内容为静止的画面时，该角度范围的播放内容的权重系数为0.8；当该角度范围的播放内容为背景图像时，该角度范围的播放内容的权重系数为0.2等。
角度范围的播放内容的观看统计数可以表征在多用户观看该360度全景视频时，选择观看每个角度范围的人数，可以理解的是，观看某个角度范围的播放内容的人数越多，可以表征该角度范围的播放内容越精彩(例如该播放内容为热点内容)，因此可以通过提供每个角度范围的播放内容的观看统计数，以使得用户可以选择观看人数较多的角度范围作为播放角度范围。
在本发明实施例中，通过每个角度范围的播放内容的描述信息，使得用户可以快速了解每个角度范围的播放内容，从而可以根据感兴趣的播放内容选择播放角度范围。
可以理解的是，在该360度全景视频的播放过程中，用户可以在该360度全景视频播放到任意进度时，输入查找指令，以查找感兴趣的内容的播放角度，进行播放角度的切换。
S102、该视频播放器根据该查找指令显示该定位信息。
可选的，该视频播放器可以根据该查找指令，将该定位信息叠加显示在该当前的播放内容上。
示例性的，可以将该定位信息显示在播放界面的一部分区域中，该区域可以处于该播放界面的任意位置，例如，处于该播放界面的中间，或者处于该播放界面的中下方，或者右下方等，对此本发明实施例不做限制。
需要说明的是，该视频播放器在接收到该查找指令时，该视频播放器的播放界面当前的播放内容可以暂停播放，也可以继续播放。示例性的，如图5所示，在播放界面的中下方，该定位信息叠加显示在该当前的播放内容上。
进一步的，在本发明实施例中，视频播放器可以采用多种方式呈现定位信息，例如，可以通过文字、图表、罗盘图像或者缩略图等方式进行呈现。
下面将结合一个示例，对定位信息的呈现方式进行示例性的说明。
假设，该360度全景视频播放到某一播放进度时，视频播放器接收到用户输入的查找指令，此时该360度全景视频在0°～60°的角度范围的播放内容的图像信息为人物/前景/运动/复杂(即表示具有人物，为前景图像、是运动的画面以及为纹理复杂的图像)，观看统计数为162；在60°～120°的角度范围的播放内容的图像信息为物品/前景/静止/复杂，观看统计数为131；在120°～180°的角度范围的播放内容的图像信息为人物/前景/运动/复杂，观看统计数为186；在180°～240°的角度范围的播放内容的图像信息为动物/背景/静止/简单，观看统计数为158；在240°～300°的角度范围的播放内容的图像信息为人物/背景/静止/复杂，观看统计数为112；在300°～360°的角度范围的播放内容的图像信息为其他/背景/静止/简单，观看统计数为78。下面结合图6a-6d对该360度全景视频的定位信息的呈现方式进行示例性的说明。
当采用图表的方式呈现该定位信息时，示例性的，该定位信息包括每个角度范围的播放内容的图像信息和观看统计数，该定位信息可以为如图6a所示的柱形统计图，通过柱形统计图表征观看统计数，并且可以将每个角度范围的播放内容的图像信息通过文字描述标注在对应的位置，若该360度全景视频的定位信息不包括每个角度范围的播放内容的图像信息，则可以不标注对应的文字描述。
当采用罗盘图像的方式呈现该定位信息时，示例性的，该定位信息包括每个角度范围的播放内容的图像信息和观看统计数，该定位信息可以为如图6b中的(1)所示的罗盘图像，在该罗盘图像的环形中，每个角度范围对应该环形的一部分，通过将对应的文字描述标注在该环形的对应部分，以表征对应的角度范围的播放内容的图像信息，并将该6个角度范围对应的观看统计数的相对大小通过不同的颜色表征，用对应的颜色填充该环形的对应部分，以表征6个角度范围对应的观看统计数的相对大小，例如红色表示观看统计数最多，在如图6b中的(1)所示的环形中，120°～180°的角度范围所对应的一部分通过红色填充，绿色表示观看统计数最少，在如图6b中的(1)所示的环形中，300°～360°的角度范围所对应的一部分通过绿色填充。因此，用户可以通过颜色确定哪个角度范围的播放内容的观看统计数最多。
若该定位信息包括每个角度范围的播放内容的观看统计数，则该定位信息可以为如图6b中的(2)所示的罗盘图像，通过对应的颜色填充环形的对应部分，以表征6个角度范围对应的观看统计数的相对大小。
若该定位信息包括每个角度范围的播放内容的图像信息，则该定位信息可以为如图6b中的(3)所示的罗盘图像，在通过将对应的文字描述标注在该环形的对应部分，以表征对应的角度范围的播放内容的图像信息。
当采用文字呈现该定位信息时，可以直接以文字描述每个角度范围与播放内容的图像信息和/或观看统计数的对应关系，示例性的，若该定位信息包括每个角度范围的播放内容的图像信息和观看统计数，则该定位信息可以为如图6c所示的文字列表。
可以理解的是，若采用上述三种方式呈现该定位信息，则该定位信息在显示时还可以以半透明的方式叠加显示在该当前的播放内容上。
当采用缩略图的方式呈现该定位信息时，该定位信息包括每个角度范围的播放内容的图像信息，该定位信息可以为如图6d中的(1)所示的完整的全景缩略图；该定位信息也可以为如图6d中的(2)所示的将背景进行简化，保留重要图像(如人物、动物、前景图像等)的缩略图，通过简化背景可以减小缩略图所占内存的大小，节省内存资源；该定位信息也可以为如图6d中的(3)所示的经过进一步简化，仅在保留重要图像(如人物、动物、前景图像等)的缩略图，从而进一步减小缩略图的所占内存的大小，即进一步节省内存资源。
S103、该视频播放器接收切换指令，该切换指令用于指示该视频播放器将该360段全景视频的播放角度从当前的播放内容所在的角度范围切换到第一角度范围，该第一角度范围为该多个角度范围中的用户选择的一个角度范围。
在一个示例中，用户通过点击该定位信息中第一角度范围对应的位置，即可输入切换指令，该视频播放器接收到该切换指令后，即可根据该检测到切换指令的位置确定用户希望切换的第一角度范围为该定位信息中的哪个角度范围。
例如，假设该定位信息通过罗盘图像的方式呈现，那么当用户希望将播放角度范围切换到180°～240°的角度范围时，用户可以点击如图6b中的(1)所示罗盘图像的红色区域或者点击180°～240°的角度范围对应的文字描述输入切换指令，从而，当视频播放器从该罗盘图像的红色区域或者180°～240°的角度范围对应的文字描述所在区域检测到切换指令后，即可根据检测到切换指令的位置确定第一角度范围为180°～240°的角度范围。
S104、该视频播放器根据该切换指令将该360段全景视频的播放角度范围从该当前的播放内容所在的角度范围切换到该第一角度范围。
值得说明的是，基于本发明实施例提供的360度全景视频的播放方法，视频播放器能够在接收到查找指令时，向用户显示该定位信息，该定位信息包括该360度全景视频的多个角度范围的播放内容的描述信息，使得用户能够根据该多个角度范围的播放内容的描述信息确定该多个角度范围的播放内容，并在接收到用户输入的切换指令后，直接将该360度全景视频的播放角度范围从当前的播放内容所在的角度范围切换到第一角度范围，即可以将当前的播放角度范围直接切换到具有该用户感兴趣的播放内容的第一角度范围，而无需该用户通过鼠标拖动360度全景视频的画面来选择感兴趣的播放角度范围，也无需逐一将播放角度范围切换到每个视点，通过浏览播放内容来选择播放角度范围，从而提高了用户切换播放角度范围的效率。
进一步的，基于图4a，如图4b所示，在上述S101之前，该方法还包括：
S100、视频播放器获取该定位信息。
具体的，本发明实施例提供两种获取定位信息的方式，第一种获取定位信息的方式是由视频服务器通过对360度全景视频进行一系列处理后得到该定位信息，并将该定位信息发送至视频播放器，第二种获取定位信息的方式是由视频播放器直接对360度全景视频进行一系列处理以得到该定位信息。
示例性的，第一种获取定位信息的方式可以如图7所示，当采用第一种获取定位信息的方式时，上述S100具体可以通过如图7所示步骤实现，具体的，第一种获取定位信息的方式包括：
S100a、视频服务器获取360度全景视频的定位信息。
在一个示例中，该视频服务器需要获取该360度全景视频的定位信息时，该视频服务器可以先对该360度全景视频进行角度范围划分，确定该多个角度范围的播放内容。然后，当定位信息包括每个角度范围的播放内容的图像信息时，该视频服务器对该多个角度范围的播放内容进行图像处理，获取每个角度范围的播放内容的图像信息，以得到该定位信息。
其中，对该多个角度范围的播放内容进行图像处理可以包括，通过显著检测算法、前景与背景分离算法、人物检测算法、物品检测算法、动物检测算法等各种图像处理算法，对每个角度范围的播放内容所包括的每一帧或者每几帧图像进行处理，确定每个角度范围的播放内容为前景图像还是背景图像，是否具有人物、动物和/或者物品，是运动的画面还是静止的画面、是纹理复杂的图像还是纹理简单的图像等画面信息，并将画面信息直接作为图像信息。
可选的，在确定画面信息后，还可以通过数值计算，按照预设的权重系数，计算每个角度范围的播放内容的分数，并将计算所得的分数确定为图像信息。
当该定位信息包括每个角度范围的播放内容的观看统计数时，该视频服务器可以统计每个角度范围的播放内容的观看统计数，以得到该定位信息。例如，该视频服务器每增加一个用户观看该360度全景视频后，更新一次每个角度范围的播放内容的观看统计数，并将更新后的观看统计数作为定位信息，发送至下一个新增的请求播放该360度全景视频的视频播放器。
S100b、该视频服务器向视频播放器发送该定位信息。
在一个示例中，该视频服务器可以单独向视频播放器发送该定位信息，即将该360度全景视频的视频流信息和该定位信息分别发送至视频播放器。
可选的，该视频服务器也可以将该定位信息编码到该360度全景视频的视频流信息中，同该360度全景视频的视频流信息一起发送至该视频播放器。
示例性的，如图8所示，该360度全景视频包括视频流信息、字幕流信息和音频流信息，视频流信息包括来源元数据(source metadata)和描述性信息(descriptive information)。此时，该视频服务器可以在该视频流信息中增加一项感兴趣的信息(interest information)，以将该定位信息编码在该感兴趣的信息中。
当该视频播放器接收到该360度全景视频的视频流信息时，即可在解码该数据流信息时，获取到该定位信息。
可选的，当该多个角度范围的播放内容的描述信息包括该多个角度范围中的每个角度范围的播放内容的图像信息时，该视频播放器还可以采用第二种获取定位信息的方式，自主获取该定位信息，即该视频播放器对该360度全景视频进行角度范围划分，确定该多个角度范围的播放内容，然后对该多个角度范围的播放内容进行图像处理，获取每个角度范围的播放内容的图像信息，以得到该定位信息。
其中，该视频播放器对该多个角度范围的播放内容进行图像处理，获取每个角度范围的播放内容的图像信息的方式和上述该视频服务器对该多个角度范围的播放内容进行图像处理，获取每个角度范围的播放内容的图像信息的方式相同，此处不再赘述。
上述主要从各个网元之间交互的角度对本发明实施例提供的方案进行了介绍。可以理解的是，各个网元，例如视频服务器和视频播放器等为了实现上述功能，其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，本发明能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本发明的范围。
本发明实施例可以根据上述方法示例对视频服务器和视频播放器等进行功能模块的划分，例如，可以对应各个功能划分各个功能模块，也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。需要说明的是，本发明实施例中对模块的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。
在采用对应各个功能划分各个功能模块的情况下，图9A示出了上述实施例中所涉及的视频播放器的一种可能的结构示意图，视频播放器包括：获取单元、接收单元、显示单元和切换单元。其中，获取单元用于支持视频播放器执行如图4b中的过程S100；接收单元用于支持视频播放器执行图4a和4b中的过程S101和S103，以及执行图7中的过程S100b；显示单元用于支持视频播放器执行图4a和4b中的过程S102；切换单元用于支持视频播放器执行图4a和4b中的过程S104。其中，上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述，在此不再赘述。
在采用集成的单元的情况下，图9B示出了上述实施例中所涉及的视频播放器的一种可能的结构示意图。视频播放器包括：处理模块900和通信模块901。处理模块900用于对视频播放器的动作进行控制管理，例如，处理模块900用于支持视频播放器执行图4a中的过程S101-S104，和图4b中的过程S100-S104，图7中的过程S100b，和/或用于本文所描述的技术的其它过程。通信模块901用于支持视频播放器与其他网络实体的通信，例如与图1示出的功能模块或网络实体之间的通信。视频播放器还可以包括存储模块902，用于存储视频播放器的程序代码和数据。
其中，处理模块900可以是处理器或控制器，例如可以是中央处理器(Central Processing Unit，CPU)，通用处理器，DSP，ASIC，FPGA或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本发明公开内容所描述的各种示例性的逻辑方框，模块和电路。所述处理器也可以是实现计算功能的组合，例如包含一个或多个微处理器组合，DSP和微处理器的组合等等。通信模块901可以是收发器、收发电路或通信接口等。存储模块902可以是存储器。
当处理模块900为处理器，通信模块901为通信接口，存储模块902为存储器时，本发明实施例所涉及的视频播放器可以为图9C所示的视频播放器。
参阅图9C所示，该视频播放器包括：处理器910、通信接口911、存储器912以及总线913。其中，通信接口911、处理器910以及存储器912通过总线913相互连接；总线913可以是外设部件互连标准(Peripheral Component Interconnect，PCI)总线或扩展工业标准结构(Extended Industry Standard Architecture，EISA)总线等。所述总 线可以分为地址总线、数据总线、控制总线等。为便于表示，图9C中仅用一条粗线表示，但并不表示仅有一根总线或一种类型的总线。
在采用对应各个功能划分各个功能模块的情况下，图10A示出了上述实施例中所涉及的视频服务器的一种可能的结构示意图，视频服务器包括：获取单元和发送单元。获取单元用于支持视频服务器执行如图7中的过程S100a；发送单元用于支持视频服务器执行如图7中的过程S100b。其中，上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述，在此不再赘述。
在采用集成的单元的情况下，图10B示出了上述实施例中所涉及的视频服务器的一种可能的结构示意图。视频服务器包括：处理模块1000和通信模块1001。处理模块1000用于对视频服务器的动作进行控制管理，例如，处理模块1000用于支持视频服务器执行如图7中的过程S100a和S100b，和/或用于本文所描述的技术的其它过程。通信模块1001用于支持视频服务器与其他网络实体的通信，例如与图1示出的功能模块或网络实体之间的通信。视频服务器还可以包括存储模块1002，用于存储视频服务器的程序代码和数据。
其中，处理模块1000可以是处理器或控制器，例如可以是CPU，通用处理器，DSP，ASIC，FPGA或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本发明公开内容所描述的各种示例性的逻辑方框，模块和电路。所述处理器也可以是实现计算功能的组合，例如包含一个或多个微处理器组合，DSP和微处理器的组合等等。通信模块1001可以是通信接口、收发电路或收发器等。存储模块1002可以是存储器。
当处理模块1000为处理器，通信模块1001为通信接口，存储模块1002为存储器时，本发明实施例所涉及的视频服务器可以为图10C所示的视频服务器。
参阅图10C所示，该视频服务器包括：处理器1010、通信接口1011、存储器1012以及总线1013。其中，通信接口1011、处理器1010以及存储器1012通过总线1010相互连接；总线1013可以是PCI总线或EISA总线等。所述总线可以分为地址总线、数据总线、控制总线等。为便于表示，图10C中仅用一条粗线表示，但并不表示仅有一根总线或一种类型的总线。
结合本发明公开内容所描述的方法或者算法的步骤可以硬件的方式来实现，也可以是由处理器执行软件指令的方式来实现。软件指令可以由相应的软件模块组成，软件模块可以被存放于随机存取存储器(Random Access Memory，RAM)、闪存、只读存储器(Read Only Memory，ROM)、可擦除可编程只读存储器(Erasable Programmable ROM，EPROM)、电可擦可编程只读存储器(Electrically EPROM，EEPROM)、寄存器、硬盘、移动硬盘、只读光盘(CD-ROM)或者本领域熟知的任何其它形式的存储介质中。一种示例性的存储介质耦合至处理器，从而使处理器能够从该存储介质读取信息，且可向该存储介质写入信息。当然，存储介质也可以是处理器的组成部分。处理器和存储介质可以位于ASIC中。另外，该ASIC可以位于核心网接口设备中。当然，处理器和存储介质也可以作为分立组件存在于核心网接口设备中。
本实施例还提供一种存储介质，包括计算机执行指令，当视频播放器的处理器执行所述计算机执行指令时，所述视频播放器执行如上述如图4a或图4b所述的360度 全景视频的播放方法。该存储介质可以包括所述存储器912。
本实施例还提供另一种存储介质，包括计算机执行指令，当视频服务器的处理器执行所述计算机执行指令时，所述视频服务器执行如上述如图7所述的360度全景视频的播放方法。该存储介质可以包括所述存储器1012。
本发明实施例提供一种视频播放系统，可以如图1所示，包括如图9A、9B或9C所示的视频播放器，和如图10A、10B或10C所示的视频服务器。
视频播放器能够在接收到查找指令时，向用户显示该定位信息，该定位信息包括该360度全景视频的多个角度范围的播放内容的描述信息，使得用户能够根据该多个角度范围的播放内容的描述信息确定该多个角度范围的播放内容，并在接收到用户输入的切换指令后，直接将该360度全景视频的播放角度范围从当前的播放内容所在的角度范围切换到第一角度范围，即可以将当前的播放角度范围直接切换到具有该用户感兴趣的播放内容的第一角度范围，而无需该用户通过鼠标拖动360度全景视频的画面来选择感兴趣的播放角度范围，也无需逐一将播放角度范围切换到每个视点，通过浏览播放内容来选择播放角度范围，从而提高了用户切换播放角度范围的效率。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统，装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述模块或单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)或处理器执行本发明各个实施例所述方法的全部或部分步骤。所述存储介质是非短暂性(英文：non-transitory)介质，包括：快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应所述以权利要求的保护范围为准。
通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统，装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述模块或单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何在本申请揭露的技术范围内的变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (21)

  1. 一种360度全景视频的播放方法，其特征在于，所述方法包括：
    视频播放器接收查找指令，所述查找指令用于指示所述视频播放器显示正在播放的360度全景视频的定位信息，所述定位信息包括所述360度全景视频的多个角度范围的播放内容的描述信息，用于用户根据所述多个角度范围的播放内容的描述信息确定所述多个角度范围的播放内容；
    所述视频播放器根据所述查找指令显示所述定位信息；
    所述视频播放器接收切换指令，所述切换指令用于指示所述视频播放器将所述360度全景视频的播放角度范围从当前的播放内容所在的角度范围切换到第一角度范围，所述第一角度范围为所述多个角度范围中的所述用户选择的一个角度范围；
    所述视频播放器根据所述切换指令将所述360段全景视频的播放角度范围从所述当前的播放内容所在的角度范围切换到所述第一角度范围。
  2. 根据权利要求1所述的方法，其特征在于，所述视频播放器根据所述查找指令显示所述定位信息，包括：
    所述视频播放器根据所述查找指令，将所述定位信息叠加显示在所述当前的播放内容上。
  3. 根据权利要求1或2所述的方法，其特征在于，所述多个角度范围的播放内容的描述信息包括：所述多个角度范围中的每个角度范围的播放内容的图像信息，和/或所述每个角度范围的播放内容的观看统计数。
  4. 根据权利要求1-3任一项所述的方法，其特征在于，所述视频播放器接收查找指令之前，所述方法还包括：
    所述视频播放器获取所述定位信息。
  5. 根据权利要求4所述的方法，其特征在于，所述视频播放器获取所述定位信息，包括：
    所述视频播放器接收视频服务器发送的所述定位信息。
  6. 根据权利要求4所述的方法，其特征在于，所述多个角度范围的播放内容的描述信息包括所述多个角度范围中的每个角度范围的播放内容的图像信息；
    所述视频播放器获取所述定位信息，包括：
    所述视频播放器对所述360度全景视频进行角度范围划分，并确定所述多个角度范围的播放内容；
    所述视频播放器对所述多个角度范围的播放内容进行图像处理，获取所述每个角度范围的播放内容的图像信息，以得到所述定位信息。
  7. 一种360度全景视频的播放方法，其特征在于，所述方法包括：
    视频服务器获取360度全景视频的定位信息，所述定位信息包括所述360度全景视频的多个角度范围的播放内容的描述信息，用于用户根据所述多个角度范围的播放内容的描述信息确定所述多个角度范围的播放内容；
    所述视频服务器向视频播放器发送所述定位信息，以使得所述视频播放器在播放所述360度全景视频的过程中，向用户显示所述定位信息，以供用户选择所述360度全景视频的播放角度范围。
  8. 根据权利要求7所述的方法，其特征在于，所述多个角度范围的播放内容的描述信息包括：所述多个角度范围中的每个角度范围的播放内容的图像信息，和/或所述每个角度范围的播放内容的观看统计数。
  9. 根据权利要求8所述的方法，其特征在于，所述多个角度范围的播放内容的描述信息包括所述每个角度范围的播放内容的图像信息，
    所述视频服务器获取待播放的360度全景视频的定位信息，包括：
    所述视频服务器对所述360度全景视频进行角度范围划分，并确定所述多个角度范围的播放内容；
    所述视频服务器对所述多个角度范围的播放内容进行图像处理，获取所述每个角度范围的播放内容的图像信息，以得到所述定位信息。
  10. 根据权利要求8或9所述的方法，其特征在于，所述多个角度范围的播放内容的描述信息包括所述每个角度范围的播放内容的观看统计数，
    所述视频服务器获取待播放的360度全景视频的定位信息，包括：
    所述视频服务器对所述360度全景视频进行角度范围划分；
    所述视频服务器统计所述每个角度范围的播放内容的观看统计数，以得到所述定位信息。
  11. 一种视频播放器，其特征在于，包括：
    接收单元，用于接收查找指令，所述查找指令用于指示显示单元显示正在播放的360度全景视频的定位信息，所述定位信息包括所述360度全景视频的多个角度范围的播放内容的描述信息，用于用户根据所述多个角度范围的播放内容的描述信息确定所述多个角度范围的播放内容；
    所述显示单元，用于根据所述接收单元接收到的所述查找指令显示所述定位信息；
    所述接收单元，还用于接收切换指令，所述切换指令用于指示切换单元将所述360段全景视频的播放角度范围从当前的播放内容所在的角度范围切换到第一角度范围，所述第一角度范围为所述多个角度范围中的所述用户选择的一个角度范围；
    所述切换单元，用于根据所述接收单元接收的所述切换指令将所述360段全景视频的播放角度范围从所述当前的播放内容所在的角度范围切换到所述第一角度范围。
  12. 根据权利要求11所述的视频播放器，其特征在于，
    所述显示单元，具体用于根据所述查找指令，将所述定位信息叠加显示在所述当前的播放内容上。
  13. 根据权利要求11或12所述的视频播放器，其特征在于，所述多个角度范围的播放内容的描述信息包括：所述多个角度范围中的每个角度范围的播放内容的图像信息，和/或所述每个角度范围的播放内容的观看统计数。
  14. 根据权利要求11-13任一项所述的视频播放器，其特征在于，所述视频播放器还包括获取单元，
    所述获取单元，用于在所述接收单元接收查找指令之前，获取所述定位信息。
  15. 根据权利要求14所述的视频播放器，其特征在于，
    所述获取单元，具体用于接收视频服务器发送的所述定位信息。
  16. 根据权利要求14所述的视频播放器，其特征在于，所述多个角度范围的播放 内容的描述信息包括所述多个角度范围中的每个角度范围的播放内容的图像信息；
    所述获取单元，具体用于对所述360度全景视频进行角度范围划分，并确定所述多个角度范围的播放内容，对所述多个角度范围的播放内容进行图像处理，获取所述每个角度范围的播放内容的图像信息，以得到所述定位信息。
  17. 一种视频服务器，其特征在于，包括：
    获取单元，用于获取360度全景视频的定位信息，所述定位信息包括所述360度全景视频的多个角度范围的播放内容的描述信息，用于用户根据所述多个角度范围的播放内容的描述信息确定所述多个角度范围的播放内容；
    发送单元，用于向视频播放器发送所述定位信息，以使得所述视频播放器在播放所述360度全景视频的过程中，向用户显示所述定位信息，以供用户选择所述360度全景视频的播放角度范围。
  18. 根据权利要求17所述的视频服务器，其特征在于，所述多个角度范围的播放内容的描述信息包括：所述多个角度范围中的每个角度范围的播放内容的图像信息，和/或所述每个角度范围的播放内容的观看统计数。
  19. 根据权利要求18所述的视频服务器，其特征在于，所述多个角度范围的播放内容的描述信息包括所述每个角度范围的播放内容的图像信息，
    所述获取单元，具体用于对所述360度全景视频进行角度范围划分，并确定所述多个角度范围的播放内容，对所述多个角度范围的播放内容进行图像处理，获取所述每个角度范围的播放内容的图像信息，以得到所述定位信息。
  20. 根据权利要求18或19所述的视频服务器，其特征在于，所述多个角度范围的播放内容的描述信息包括所述每个角度范围的播放内容的观看统计数，
    所述获取单元，具体用于对所述360度全景视频进行角度范围划分，统计所述每个角度范围的播放内容的观看统计数，以得到所述定位信息。
  21. 一种视频播放系统，其特征在于，包括:
    如上述权利要求11-16任一项所述的视频播放器，和如上述权利要求17-20任一项所述的视频服务器。
PCT/CN2017/099542 2016-12-07 2017-08-29 一种360度全景视频的播放方法、装置及系统 WO2018103384A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP17878392.4A EP3534616A1 (en) 2016-12-07 2017-08-29 Method, device and system for playing 360 degree panoramic video
EP21167359.5A EP3913924B1 (en) 2016-12-07 2017-08-29 360-degree panoramic video playing method, apparatus, and system
US16/434,387 US11184646B2 (en) 2016-12-07 2019-06-07 360-degree panoramic video playing method, apparatus, and system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611118333.XA CN108174265B (zh) 2016-12-07 2016-12-07 一种360度全景视频的播放方法、装置及系统
CN201611118333.X 2016-12-07

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/434,387 Continuation US11184646B2 (en) 2016-12-07 2019-06-07 360-degree panoramic video playing method, apparatus, and system

Publications (1)

Publication Number Publication Date
WO2018103384A1 true WO2018103384A1 (zh) 2018-06-14

Family

ID=62491877

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/099542 WO2018103384A1 (zh) 2016-12-07 2017-08-29 一种360度全景视频的播放方法、装置及系统

Country Status (4)

Country Link
US (1) US11184646B2 (zh)
EP (2) EP3913924B1 (zh)
CN (1) CN108174265B (zh)
WO (1) WO2018103384A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113794936A (zh) * 2021-09-09 2021-12-14 北京字节跳动网络技术有限公司 一种精彩瞬间生成方法、装置、系统、设备和介质

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10887653B2 (en) * 2016-09-26 2021-01-05 Cyberlink Corp. Systems and methods for performing distributed playback of 360-degree video in a plurality of viewing windows
CN108833929A (zh) * 2018-06-26 2018-11-16 曜宇航空科技（上海）有限公司 一种全景视频的播放方法和播放系统
CN110308849A (zh) * 2019-06-20 2019-10-08 浙江开奇科技有限公司 基于全景视频影像的显示控制方法及移动终端
CN111641871A (zh) * 2020-05-29 2020-09-08 广州华多网络科技有限公司 直播视频的展示方法、装置、终端和可读存储介质
CN113709542B (zh) * 2020-10-09 2023-09-19 天翼数字生活科技有限公司 一种交互式全景视频播放的方法和系统
CN112866669B (zh) * 2021-01-15 2023-09-15 聚好看科技股份有限公司 一种数据切换时间确定方法及设备
CN113014943A (zh) * 2021-03-03 2021-06-22 上海七牛信息技术有限公司 一种视频播放方法、视频播放器及视频直播系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101082926A (zh) * 2007-07-03 2007-12-05 浙江大学 一种用于跨媒体数字城市景区建模方法
CN103795976A (zh) * 2013-12-30 2014-05-14 北京正安融翰技术有限公司 一种全时空立体可视化方法
CN104010225A (zh) * 2014-06-20 2014-08-27 合一网络技术(北京)有限公司 显示全景视频的方法和系统
CN104602129A (zh) * 2015-01-27 2015-05-06 三星电子（中国）研发中心 互动式多视角视频的播放方法及系统
CN106127680A (zh) * 2016-06-29 2016-11-16 深圳市优象计算技术有限公司 一种720度全景视频快速浏览方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102833525A (zh) 2012-07-19 2012-12-19 中国人民解放军国防科学技术大学 一种360度全景视频的浏览操作方法
CN102945563B (zh) 2012-09-26 2017-05-24 天津游奕科技有限公司 一种全景视频的展示与交互系统及方法
WO2015134537A1 (en) * 2014-03-04 2015-09-11 Gopro, Inc. Generation of video based on spherical content
CN106162204A (zh) * 2016-07-06 2016-11-23 传线网络科技（上海）有限公司 全景视频生成、播放方法、装置及系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101082926A (zh) * 2007-07-03 2007-12-05 浙江大学 一种用于跨媒体数字城市景区建模方法
CN103795976A (zh) * 2013-12-30 2014-05-14 北京正安融翰技术有限公司 一种全时空立体可视化方法
CN104010225A (zh) * 2014-06-20 2014-08-27 合一网络技术(北京)有限公司 显示全景视频的方法和系统
CN104602129A (zh) * 2015-01-27 2015-05-06 三星电子（中国）研发中心 互动式多视角视频的播放方法及系统
CN106127680A (zh) * 2016-06-29 2016-11-16 深圳市优象计算技术有限公司 一种720度全景视频快速浏览方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3534616A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113794936A (zh) * 2021-09-09 2021-12-14 北京字节跳动网络技术有限公司 一种精彩瞬间生成方法、装置、系统、设备和介质

Also Published As

Publication number Publication date
CN108174265B (zh) 2019-11-29
EP3913924B1 (en) 2024-01-31
EP3534616A4 (en) 2019-09-04
US11184646B2 (en) 2021-11-23
US20190289337A1 (en) 2019-09-19
EP3913924A1 (en) 2021-11-24
CN108174265A (zh) 2018-06-15
EP3534616A1 (en) 2019-09-04

Similar Documents

Publication Publication Date Title
WO2018103384A1 (zh) 一种360度全景视频的播放方法、装置及系统
US11303881B2 (en) Method and client for playing back panoramic video
EP3533025B1 (en) Virtual reality experience sharing
CN107888987B (zh) 一种全景视频播放方法及装置
US10897646B2 (en) Video stream transmission method and related device and system
US20180310010A1 (en) Method and apparatus for delivery of streamed panoramic images
WO2014052437A1 (en) Encoding images using a 3d mesh of polygons and corresponding textures
KR20190121867A (ko) 가상 현실 미디어 컨텐츠의 패키징 및 스트리밍을 위한 방법 및 장치
US11463718B2 (en) Image compression method and image decompression method
WO2019007120A1 (zh) 一种媒体数据的处理方法和装置
KR102566276B1 (ko) 원격 단말을 위한 몰입형 원격 회의 및 텔레프레즌스를 위한 오버레이 처리용 파라미터
US11223662B2 (en) Method, system, and non-transitory computer readable record medium for enhancing video quality of video call
US11438731B2 (en) Method and apparatus for incorporating location awareness in media content
CN107438203B (zh) 用于建立和接收清单的方法、网络设备及终端
US10593122B1 (en) Mirroring edge pixels
US11922561B2 (en) Methods and systems for implementing scene descriptions using derived visual tracks
CN111885417B (zh) Vr视频播放方法、装置、设备以及存储介质
JP7447266B2 (ja) ボリュメトリック画像データに関するビューの符号化及び復号
CN111367598B (zh) 动作指令的处理方法、装置、电子设备及计算机可读存储介质
JP7419529B2 (ja) 遠隔端末のための没入型テレカンファレンス及びテレプレゼンスのインタラクティブオーバーレイ処理
CN111200759B (zh) 一种全景视频的播放控制方法、装置、终端及存储介质
WO2023031890A1 (en) Context based adaptable video cropping
JP2023507586A (ja) ３ｄｏｆ構成要素からの６ｄｏｆコンテンツを符号化、復号化、及びレンダリングするための方法及び装置
CN111448544A (zh) 沉浸式虚拟环境中的动画化视角的选择

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17878392

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2017878392

Country of ref document: EP

Effective date: 20190601

NENP Non-entry into the national phase

Ref country code: DE