WO2019041179A1 - Vr视频播放处理方法及设备 - Google Patents

Vr视频播放处理方法及设备 Download PDF

Info

Publication number
WO2019041179A1
WO2019041179A1 PCT/CN2017/099724 CN2017099724W WO2019041179A1 WO 2019041179 A1 WO2019041179 A1 WO 2019041179A1 CN 2017099724 W CN2017099724 W CN 2017099724W WO 2019041179 A1 WO2019041179 A1 WO 2019041179A1
Authority
WO
WIPO (PCT)
Prior art keywords
time period
video
current time
segment
video segment
Prior art date
Application number
PCT/CN2017/099724
Other languages
English (en)
French (fr)
Inventor
马志斌
贾伟杰
赵其勇
王斌
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2017/099724 priority Critical patent/WO2019041179A1/zh
Publication of WO2019041179A1 publication Critical patent/WO2019041179A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof

Definitions

  • the present application relates to the field of video processing technologies, and in particular, to a virtual reality (VR) video playback processing method and device.
  • VR virtual reality
  • a Field of View (FOV) transmission mode is proposed.
  • the 360 panoramic VR video is pre-divided into dozens of video segments in a segmentation view direction, and each video segment provides clear video data in a field of view range and low definition video data in a non-field of view.
  • the VR terminal downloads and plays the video segment corresponding to the user's viewing direction in the order of the time period.
  • the VR video playback process is generally performed in the following manner: during the video segmentation process of the current time period, when the user views When the direction changes to a certain extent, the video segment corresponding to the changed user view direction is downloaded in the next time period, and the video segment corresponding to the changed user view direction is played after the video segment playback of the current time period is completed. .
  • the embodiment of the present invention provides a VR video playback processing method and device, which are used to solve the problems of low definition and blurred ambiguity when a user views a VR video in the prior art.
  • a virtual reality VR video playback processing method includes:
  • the video segment of the first slice view direction of the target time period is downloaded according to the play progress of the video segment of the current time period;
  • the target time period includes the current time a video segment of the current time period is a video segment of a second slice view direction; or a next time period of the current time period;
  • the first fragment viewing angle direction of the target time period is downloaded according to the playing progress of the video segment of the current time period.
  • Video segmentation, the target time period includes the current time period or a next time period of the current time period
  • the video segment of the current time period is a video segment of the second slice view direction, according to the video of the current time period
  • the playback progress of the slice is switched to the video segment of the first slice view direction of the target time period for playing, and the video segmentation in the second slice view direction of the current time period is played, according to the current time period.
  • the progress of the video segmentation download the video segment of the current segment or the first segment of the next segment of the viewing angle, and must be in the After the video segmentation in the second segment view direction of the previous time period is completed, the video segment of the first slice view direction in the next time period is played, which reduces the first score that the user does not match the direction of the user's viewing angle.
  • the time of video segmentation in the direction of the viewing angle improves the clarity of the user when viewing the VR video and improves the user experience.
  • the video segmentation in the first slice view direction of the target time period is downloaded according to the playback progress of the video segment of the current time period, including:
  • the video segment of the first segment viewing angle direction of the current time period is downloaded.
  • the method further includes:
  • determining that the video of the first slice view direction needs to be downloaded Fragmentation including:
  • the VR video playback processing method provided by the first aspect avoids unnecessary downloading of the video fragments in the direction of the first fragmentation view when the direction of the user's view is quickly rotated through the field of view of the first slice view.
  • the video segmentation in the first slice view direction of the target time period is performed according to the play progress of the video segment of the current time period, including:
  • the VR video playback processing method provided by the first aspect can implement pre-downloading of video fragments in the first fragmentation view direction of the target time period, thereby reducing the peak rate and RTT of the communication network carrying the VR video data transmission. Delayed requirements.
  • the video segmentation according to the current time period The playing progress, playing the video segment of the first segment viewing angle direction of the target time period.
  • the VR video playback processing method provided by the first aspect avoids unnecessary playback of video segments in the first slice view direction when the user view direction rapidly transits the field of view of the first slice view.
  • the playing progress of the video segment according to the current time period is switched to the first segment viewing angle direction of the target time period.
  • the video Before the video is played, it also includes:
  • Video shards are played, including:
  • the video segment of the first segment viewing angle direction of the target time period is switched to play with the picture group GOP as the switching granularity.
  • the target time period is the next time period of the current time period
  • the switching to the first time of the target time period according to the playing progress of the video segment of the current time period The video segments in the direction of the slice are played, including:
  • the video segment of the first segmentation view direction of the target time period is switched for playing.
  • the application provides a virtual reality VR terminal, where the VR terminal includes:
  • a downloading module configured to download a video segment of a first segment viewing angle direction of the target time period according to a playback progress of the video segment of the current time period when determining that the video segment of the first segment viewing direction needs to be downloaded;
  • the time period includes the current time period or the next time period of the current time period, and the video segment of the current time period is a video segment of the second slice view direction;
  • a playing module configured to switch to a video segment of the first segment viewing angle direction of the target time period for playing according to a playing progress of the video segment of the current time period.
  • the download module is specifically configured to:
  • the video segment of the first segment viewing angle direction of the current time period is downloaded.
  • the downloading module is further configured to determine that the user needs to download the first view when the user's viewing angle falls within a first preset threshold range centered on the first segment viewing angle direction. Video segmentation in the direction of a slice of view.
  • the downloading module determines that the first fragment needs to be downloaded when the user's viewing angle falls within a first predetermined threshold range centered on the first fragment viewing angle direction.
  • Video segmentation in the direction of view including:
  • the playing module is specifically configured to: when the user viewing angle falls within a second preset threshold range centered on the first patch viewing direction, according to the current Playing the progress of the video segment of the time period, switching to the video segment of the first segment viewing angle direction of the target time period for playing,
  • the first preset threshold is greater than the second preset threshold.
  • the playing module is specifically configured to: when the direction of the user's viewing angle falls within a second preset threshold range centered on the first viewing angle direction and the duration of the falling is greater than or When it is equal to the second preset duration, according to the playback progress of the video segment of the current time period, the video segment of the first slice view direction of the target time period is switched for playing.
  • the playing module according to the playing progress of the video segment of the current time period, is switched to the video segment of the first segment viewing angle direction of the target time period for playing, specifically:
  • the playing module switches to the first segment of the target time period according to the playing progress of the video segment of the current time period.
  • the video segmentation in the view direction is played, including:
  • the video segment of the first segment viewing angle direction of the target time period is switched to play with the picture group GOP as the switching granularity.
  • the playing module switches to the target time period according to the playing progress of the video segment of the current time period.
  • the video segmentation in the direction of the first slice is played, specifically including:
  • the video segment of the first segmentation view direction of the target time period is switched for playing.
  • the application provides a virtual reality VR terminal, including: a processor and a memory;
  • the memory is configured to store instructions for executing the memory stored instructions
  • the VR terminal is configured to perform the method provided by the first aspect described above when the processor executes the instructions stored by the memory.
  • the present application further provides a storage medium comprising: a readable storage medium and a computer program, the computer program being used to implement the method provided by the first aspect.
  • the present application also provides a program product comprising a computer program (ie, an execution instruction), the computer program being stored in a readable storage medium.
  • a computer program ie, an execution instruction
  • At least one processor of the VR terminal can read the computer program from a readable storage medium, and the at least one processor executes the computer program such that the VR terminal implements the method provided by the first aspect above.
  • FIG. 1 is a schematic diagram of an application scenario of an embodiment of the present application
  • FIG. 2 is a flowchart of a VR video playback processing method according to an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of a user view angle falling within a first preset range centered on a first slice view direction according to an embodiment of the present disclosure
  • 4A is a schematic diagram of video fragmentation in a second slice view direction of a current time period according to an embodiment of the present disclosure
  • FIG. 4B is a schematic diagram 1 of video segmentation in a first slice view direction of a current time period according to an embodiment of the present application.
  • 4C is a schematic diagram 1 of video segmentation in a first slice view direction of a next time period according to an embodiment of the present disclosure
  • 4D is a second schematic diagram of video segmentation in a first slice view direction of a current time period according to an embodiment of the present disclosure
  • FIG. 4E is a second schematic diagram of video segmentation in a first slice view direction of a next time period according to an embodiment of the present application.
  • FIG. 4F is a schematic diagram of video segmentation in a second slice view direction of a next time period according to an embodiment of the present application.
  • FIG. 5A is a flowchart of a VR video playback processing method according to another embodiment of the present application.
  • FIG. 5B is a schematic diagram of a download triggering interval in which a user's viewing angle direction falls within a first segment viewing angle direction according to an embodiment of the present disclosure
  • FIG. 6 is a schematic diagram of relationship between a first preset progress and a third preset progress according to an embodiment of the present application
  • FIG. 7 is a schematic diagram of a user view angle falling within a second preset range centered on a first slice view direction according to an embodiment of the present disclosure
  • FIG. 8 is a schematic diagram of a relationship between a first preset threshold and a second preset threshold according to an embodiment of the present disclosure
  • FIG. 9 is a schematic diagram of relationship between a first preset progress, a second preset progress, and a third preset progress according to an embodiment of the present application.
  • FIG. 10A is a flowchart of a VR video playback processing method according to another embodiment of the present application.
  • FIG. 10B is a schematic diagram of a play triggering interval in which a user's viewing angle direction falls within a first segment viewing angle direction according to an embodiment of the present disclosure
  • FIG. 11 is a schematic diagram of downloading and playing video clips in the prior art
  • FIG. 12 is a schematic diagram of downloading and playing video clips according to an embodiment of the present disclosure.
  • FIG. 13 is a schematic structural diagram 1 of a VR terminal according to an embodiment of the present disclosure.
  • FIG. 14 is a schematic structural diagram 2 of a VR terminal according to an embodiment of the present disclosure.
  • FIG. 1 is a schematic diagram of an application scenario according to an embodiment of the present application.
  • the application scenario of the embodiment of the present application may include: a VR terminal and a VR server, and the VR video is transmitted between the VR terminal and the VR server based on the FOV transmission mode.
  • the VR terminal and the VR server can communicate through a communication network, such as a fourth generation (4Generation, 4G) communication network, and a fifth generation communication network (5Generation, 5G network).
  • 4G fourth generation
  • 5G network fifth generation communication network
  • the 360 panoramic VR video is pre-divided into dozens of video segments according to the slice viewing angle direction, and each video segment provides clear video data in the field of view range, providing low in the non-field of view range. Sharpness video data.
  • the VR terminal downloads and plays the video segment corresponding to the user's viewing direction in the order of the time period.
  • the direction of the slice view angle in the present application may refer to an angle bisector direction of the view angle used when dividing the video slice according to the view direction of the 360 panoramic VR video, and the user view direction may refer to the user watching the VR.
  • the angle bisector of the angle of view of the video The video segment corresponding to the user view direction may be regarded as a video segment of the slice view direction matched by the user view direction.
  • the segment viewing angle direction matched by the user viewing angle may be regarded as the segment viewing angle direction closest to the user viewing direction.
  • the VR data acquired by the VR terminal from the VR server is not all of the video fragments in the fragment view direction corresponding to the user view direction, but a short time in the video segment of the slice view direction. , That is, the video segmentation of the slice viewing direction in one period.
  • the terminal first acquires the 0th second (ie, the first) of the VR video from the VR server - the slice view direction A of the 2nd second.
  • the video slice is played, and then the video slice of the slice view direction A of the second second to the fourth second is played, and then the video slice of the slice view direction A of the fourth to sixth seconds is acquired for playing, ... ....
  • FIG. 2 is a flowchart of a VR video playback processing method according to an embodiment of the present application.
  • the method in this embodiment may be performed by a VR terminal. As shown in FIG. 2, the method in this embodiment may include:
  • step 201 when it is determined that the video segment of the first segment view direction is to be downloaded, the video segment of the first segment view direction of the target time period is downloaded according to the play progress of the video segment of the current time period; the target time period includes The current time period or the next time period of the current time period, the video segment of the current time period is a video segment of the second slice view direction.
  • the video segment of the current time segment is the video segment of the second segment view direction
  • the video segment of the first slice view direction is downloaded.
  • the change needs to be switched from playing the video segment of the second slice view direction to playing the video slice of the first slice view direction.
  • the first segment viewing angle direction and the second segment viewing angle direction are different segment viewing angle directions.
  • the video slice of the first slice view direction of the next time period of the current time period is directly downloaded.
  • the video segment of the first segment view direction of the current time period is downloaded according to the playback progress of the video segment of the current time period, or the video segment of the first slice view direction of the next time period of the current time period is downloaded. sheet.
  • the playing progress of the video segment of the current time period may be compared with the preset progress, and determining whether the target time period is the current time period or the next time period of the current time period.
  • the downloading the video segment of the first segment view direction of the target time period according to the play progress of the video segment of the current time period includes: determining whether the play progress of the video segment of the current time period is greater than Or equal to the first preset progress; when the playing progress of the video segment of the current time period is greater than or equal to the first preset progress, downloading the video of the first segment viewing angle direction of the next time period of the current time period
  • the video slice of the first slice view direction of the current time period is downloaded when the play progress of the video segment of the current time period is less than the first preset progress.
  • the video segment of the first segment view direction of the current time period is downloaded; when the video segment play progress of the current time period is greater than or equal to 30%, the current download is downloaded. Video segmentation of the first slice view direction of the next time period of the time period.
  • the video fragment of the first fragmentation view direction of the download target period may be: the VR terminal sends a video fragment for requesting the first fragmentation view direction of the target period to the VR server. Downloading a request, the server returns a video segment of the first fragmentation view direction of the target time period to the VR terminal according to the download request of the VR terminal, thereby implementing downloading the first slice perspective of the target time period Video segmentation of the direction.
  • the method further includes the step of determining that the video slice of the first slice view direction needs to be downloaded.
  • the video segment that needs to download the first slice view direction is determined when the user view direction falls within a first preset threshold range centered on the first slice view direction.
  • the direction of the user's viewing angle in FIG. 3 falls within the first predetermined range centered on the direction of the first segment viewing angle.
  • the first preset threshold range centered on the first slice view direction may be included in the field of view of the first slice view.
  • the first preset threshold range centered on the direction of the first slice viewing angle can be understood as the The download trigger interval of the video segment in the direction of the slice.
  • the user view direction may also be considered to fall into the The duration of the first predetermined threshold range in which the first slice viewing direction is centered. Specifically, when the user view angle falls within a first preset threshold range centered on the first slice view direction and the drop duration is greater than or equal to the first preset duration, it is determined that the first need to be downloaded. Video segmentation in the direction of the sliced view.
  • the angle bisector direction (Orientation_Initial) of the angle of view provided by the first video segment of the VR video is used as a reference, and the direction of the slice is increased in a clockwise direction (for example,
  • the first segment viewing angle direction or the second segment viewing angle direction may be recorded as a relative angle between the segment viewing angle direction and the Orientation_Initial
  • the user viewing angle may be recorded as a relative angle between the user viewing angle direction and the Orientation_Initial.
  • the first slice view angle can be regarded as the view direction of the right side of the second slice view direction
  • the video slice of the first slice view direction of the current time period can be as shown in FIG. 4B, and the first time of the next time period of the current time period.
  • the video segmentation of the slice viewing angle direction may be as shown in FIG.
  • FIG. 4C when the user's viewing angle is rotated counterclockwise by a certain amplitude, it is determined that the video segment of the first segment viewing angle direction needs to be downloaded, and the first segment viewing angle direction may be regarded as the first
  • the video segment of the first slice view direction of the current time period may be as shown in FIG. 4D
  • the video slice of the first slice view direction of the next time period of the current time period may be as shown in FIG. 4E.
  • Figure 4F shows. It can be seen that the video fragments that can be downloaded in the state shown in FIG. 4A can be divided into five categories of FIG. 4B to FIG. 4F. It should be noted that in FIG. 4A to FIG. 4F, the first segment viewing angle direction is adjacent to the second viewing angle direction as an example.
  • the method may specifically include:
  • Step 501 The angle of the angle of the viewing angle provided by the first video segment (Orientation_Initial) is used as a reference to monitor the angle of change of the user's viewing angle direction ( ⁇ Orietation_U), clockwise rotation is recorded as a positive value, and counterclockwise is recorded as a negative value. .
  • the orientation angle of the slice and the direction of the user's perspective may be recorded in a clockwise increment manner with reference to Orientation_Initial.
  • the user viewing angle change angle can be recorded as a positive value.
  • the user viewing angle change angle can be recorded as a negative value.
  • Step 502 Determine whether the direction of the user's viewing angle is clockwise or counterclockwise.
  • ⁇ Orietation_U is a positive value or a negative value.
  • it indicates a clockwise rotation
  • it is a negative value it indicates a counterclockwise rotation.
  • step 503 is performed
  • step 504 is performed.
  • Step 503 Determine whether the direction of the user's viewing angle falls within the download triggering interval of the left first viewing angle direction.
  • the direction of the first slice viewing angle can be regarded as any point on the left side of the Orientation_Initial The direction of the viewing angle. Specifically, as shown in FIG. 5B, it may be determined whether Orientation_X-Offset_D ⁇ 360- ⁇ Orietation_U ⁇ Orientation_X+Offset_D is satisfied, wherein Orientation_X represents the first slice viewing angle direction, specifically may be referenced by Orientation_Initial, clockwise by Orientation_Initial The angle to the direction between the direction of the first slice viewing angle, Offset_D represents the first preset threshold.
  • step 505 is performed; when it is determined that the user view direction does not fall into the download trigger interval of the left first slice view direction, step 509 is performed.
  • Step 504 Determine whether the direction of the user's viewing angle falls within a download triggering interval of the right first slice viewing angle direction.
  • the direction of the first slice viewing angle may be regarded as the direction of any slice viewing angle on the right side of the Orientation_Initial. Specifically, as shown in FIG. 5B, it may be determined whether Orientation_X-Offset_D ⁇ ⁇ Orietation_U ⁇ Orientation_X+Offset_D is satisfied, wherein Orientation_X represents the first slice view direction, specifically, may be referenced by Orientation_Initial, and clockwise direction by Orientation_Initial
  • the angle between the direction of the first slice viewing angle, Offset_D represents the first preset threshold.
  • Step 505 Determine whether the duration of the user view direction continuously in the download trigger interval is greater than or equal to the first preset duration.
  • step 506 when the user view direction is continuously greater than or equal to the first preset threshold in the download trigger interval, step 506 is performed; when the user view direction continuously exceeds the first preset threshold in the download trigger interval, the step is performed. 509.
  • Step 506 Determine whether the playing progress of the video segment of the current time period is greater than or equal to the first preset progress.
  • step 507 when the playing progress of the video segment of the current time period is greater than or equal to the first preset progress, step 507 is performed; when the playing progress of the video segment of the current time period is less than the first preset progress, step 515 is performed. .
  • Step 507 Determine whether the current time period is the last time period of the entire VR video.
  • step 507 since the current time period is the last time period of the entire VR video, there is no next time period of the current time period, so in order to ensure the reliability and stability of the process, step 507 is performed.
  • step 508 is performed; when the current time period is not the last time period of the entire video, step 513 is performed.
  • Step 508 Determine whether the entire VR video ends playing.
  • step 501 when the entire VR video playback ends, the process ends; when the entire VR video playback is not finished, the process returns to step 501.
  • Step 509 Determine whether the playback progress of the video segment of the current time period is greater than or equal to the third preset progress.
  • step 510 when the playing progress of the video segment of the current time period is greater than or equal to the third preset progress, step 510 is performed; when the playing progress of the video segment of the current time period is less than the third preset progress, the process returns to step 501.
  • the relationship between the first preset progress and the third preset progress may be as shown in FIG. 6 .
  • Step 510 Determine whether the current time period is the last time period of the entire VR video.
  • step 508 when the current time period is the last time period of the entire VR video, step 508 is performed; when the current time period is not the last time period of the entire VR video, step 511 is performed.
  • Step 511 Determine whether a first download request for requesting a video segment of the second slice view direction of the next time period has been issued.
  • step 512 when the first download request has been issued, the process returns to step 501; when the first download request is not issued, step 512 is performed.
  • Step 512 Send the first download request to a VR server.
  • step 512 specifically, the VR terminal sends a first download request to the VR server according to a Media Presentation Description (MPD).
  • MPD Media Presentation Description
  • Step 513 Determine whether a second download request for requesting a video segment of the first slice view direction of the next time period has been issued.
  • step 513 when the second download request has been issued, the process returns to step 501; when the second download request is not issued, step 513 is performed.
  • Step 514 Send the second download request to the VR server.
  • step 513 specifically, the VR terminal sends a second download request to the VR server according to the MPD media description file. After the execution of step 513, the process returns to step 501.
  • Step 515 Determine whether a third download request for requesting video fragments of the first slice view direction of the current time period has been issued.
  • step 516 when the third download request has been issued, the process returns to step 501; when the third download request is not issued, step 516 is performed.
  • Step 516 Send the third download request to the VR server.
  • the VR terminal sends a third download request to the VR server according to the MPD media description file.
  • the process returns to step 501.
  • Step 202 Switch to a video segment of the first segment viewing angle direction of the target time period for playing according to the playing progress of the video segment of the current time period.
  • step 202 may be specifically: after the video segment of the current time period is played, switching to the first slice of the target time period.
  • the video segment of the view direction is played.
  • step 202 may specifically stop playing the video segment of the current time period, and from the first slice view direction of the target time period.
  • the playback progress of the video slice starts to play.
  • the VR video is compressed by the video coding technology
  • Bidirectionally predicted picture (B) frame is mainly three types of coded frames: an intra-coded picture (I) frame, a predictive-coded picture (P) frame, and a bidirectional predictive coding.
  • the I frame represents a key frame, and only the information of the frame is used for encoding;
  • the P frame represents the difference between the frame and a previous key frame (or P frame), and the P frame uses the previous I frame or P frame.
  • the motion prediction method is used for inter-prediction coding;
  • the B frame represents the difference between the current frame and the preceding and succeeding frames, and provides the highest compression ratio.
  • the B frame requires both the previous image frame (I frame or P frame), and also needs to be later.
  • the image frame (P frame) is subjected to inter-frame bidirectional predictive coding by motion prediction.
  • the step 202 may further include a condition for triggering playing of the video segment of the first slice viewing direction.
  • the step 202 may be specifically: when the user view angle falls within a second preset threshold range centered on the first slice view direction, according to the play progress of the video segment of the current time period, switch to Said The video slice of the first slice viewing direction of the target period is played.
  • the direction of the user's viewing angle falls within a second predetermined threshold range centered on the direction of the first slice viewing angle.
  • the second preset threshold range centered on the first slice viewing angle may be included in the field of view of the first slice view.
  • the second preset threshold range centered on the direction of the first slice viewing angle may be understood as a play triggering interval of the video segment in the first slice view direction.
  • the relationship between the first preset threshold and the second preset threshold may be as shown in FIG. 8.
  • the user's viewing angle when the direction of the user's viewing angle changes, the user's viewing angle first falls within a first preset threshold range centered on the first segment viewing angle direction, thereby triggering the first segment viewing angle of the target time period. Downloading of the video segment of the direction; when the user's viewing direction continues to change toward the same direction, the user's viewing angle may fall within a second preset threshold range centered on the first segment viewing angle direction, thereby triggering the target time period
  • the first slice is played in the direction of the video segment.
  • the advantage of this is that pre-downloading of video segments in the direction of the first slice view of the target time period can be achieved, thereby reducing the peak rate and round-trip delay of the communication network carrying the VR video data transmission (Round-Trip Time) , RTT); at the same time, it also avoids the need to further wait for the video slice download of the first slice view direction when determining the video slice that should play the first slice view direction, resulting in low VR video clarity.
  • the ambiguous problem has improved the user experience.
  • the first preset threshold and the second preset threshold may also be equal, and the purpose of pre-downloading cannot be achieved when they are equal.
  • the user view direction may also be considered to fall into the The duration of the second predetermined viewing angle range in which the first segment viewing angle direction is centered.
  • the step 202 may be specifically performed when the user view angle falls within a second preset threshold range centered on the first slice view direction and the drop duration is greater than or equal to the second preset duration.
  • the playing progress of the video segment of the current time period is switched, and the video segment of the first segment viewing angle direction of the target time period is switched for playing.
  • the first preset duration and the second preset duration may or may not be equal. In this embodiment, the relationship between the first preset duration and the second preset duration is not limited.
  • the method further includes: determining whether the playing progress of the video segment of the current time period is less than a second preset progress; and when the playing progress of the video segment of the current time period is less than the second preset progress, performing the The playing progress of the video segment of the current time period is switched to the step of playing the video segment of the first segment viewing angle direction of the target time period for playing.
  • the relationship between the first preset progress, the second preset progress, and the third preset progress may be as shown in FIG. 9 .
  • the method may specifically include:
  • Step 1001 The angle of the angle of the viewing angle provided by the first video segment (Orientation_Initial) is used as a reference to monitor the angle of change of the user's viewing angle ( ⁇ Orietation_U). Clockwise rotation is recorded as a positive value and counterclockwise as a negative value.
  • the orientation angle of the slice and the direction of the user's perspective may be recorded in a clockwise increment manner with reference to Orientation_Initial.
  • the user viewing angle change angle can be recorded as a positive value.
  • the user viewing angle change angle can be recorded as a negative value.
  • Step 1002 Determine whether the user's viewing angle is clockwise or counterclockwise.
  • ⁇ Orietation_U is a positive value or a negative value.
  • it indicates a clockwise rotation
  • it is a negative value it indicates a counterclockwise rotation.
  • step 1003 is performed
  • step 1004 is performed.
  • Step 1003 Determine whether the user's viewing angle direction falls within a playback triggering interval of the left first viewing angle direction.
  • the direction of the first slice viewing angle may be regarded as the direction of any slice viewing angle on the left side of the Orientation_Initial.
  • Orientation_X-Offset_H ⁇ 360- ⁇ Orietation_U ⁇ Orientation_X+Offset_H it may be determined whether Orientation_X-Offset_H ⁇ 360- ⁇ Orietation_U ⁇ Orientation_X+Offset_H is satisfied, wherein Orientation_X indicates the direction of the first slice view angle, specifically may be referenced by Orientation_Initial, clockwise by Orientation_Initial
  • the angle to the angle between the direction of the first slice viewing angle, Offset_H represents the second preset threshold.
  • Step 1004 Determine whether the direction of the user's viewing angle falls within a playing triggering interval of the right first viewing direction.
  • the direction of the first slice viewing angle may be regarded as the direction of any slice viewing angle on the right side of the Orientation_Initial. Specifically, as shown in FIG. 10B, it may be determined whether Orientation_X-Offset_H ⁇ ⁇ Orietation_U ⁇ Orientation_X+Offset_H is satisfied, wherein Orientation_X indicates the first slice view direction, specifically may be referenced by Orientation_Initial, and clockwise direction by Orientation_Initial
  • the angle between the direction of the first slice viewing angle, Offset_H represents the second preset threshold.
  • Step 1005 Determine whether the duration of the user view direction continuously in the play trigger interval is greater than or equal to the second preset duration.
  • the step 1006 when the duration of the user's viewing angle is greater than or equal to the first preset threshold, the step 1006 is performed; when the duration of the user's viewing direction is less than the first preset threshold, the step is performed. 1010.
  • Step 1006 Determine whether the playback progress of the video segment of the current time period is greater than or equal to the second preset progress.
  • step 1007 when the playing progress of the video segment of the current time period is greater than or equal to the second preset progress, step 1007 is performed; when the playing progress of the video segment of the current time period is less than the second preset progress, step 1013 is performed.
  • Step 1007 Determine whether the video segment of the current time period is played.
  • step 1008 when the video segmentation of the current time period is completed, step 1008 is performed; when the video segment of the current time period is not played, the process returns to step 1001.
  • Step 1008 Determine whether the entire VR video ends playing.
  • step 1009 when the entire VR video playback is not finished, step 1009 is performed; when the entire VR video playback ends, it ends.
  • Step 1009 Switch to the video segment of the first segment view direction of the next time period for playing.
  • step 1009 the process returns to step 1001.
  • Step 1010 Determine whether the video segment of the current time period is played.
  • step 1011 when the video segmentation of the current time period is completed, step 1011 is performed; when the video segment of the current time period is not played, the process returns to step 1001.
  • Step 1011 Determine whether the entire VR video ends playing.
  • step 1012 when the entire VR video playback is not finished, step 1012 is performed; when the entire VR video playback ends, it ends.
  • Step 1012 Switch to the video segment of the second slice view direction of the next time period for playing.
  • step 1012 the process returns to step 1001.
  • Step 1013 The GOP is used as the switching granularity, and the video fragment of the first fragmentation view direction of the current time period is switched for playing.
  • step 1013 the process returns to step 1001.
  • FIG. 11 is a schematic diagram of downloading and playing video clips in the prior art
  • FIG. 12 is a schematic diagram of downloading and playing video clips according to an embodiment of the present application.
  • FIG. 11 in the prior art, in the process of video segmentation of the slice view direction direction number 1 (ie, the second slice view direction) of the play period number 9, when the user's view angle changes to a certain extent Downloading the video segment of the segment view direction direction number 2 (ie, the first slice view direction) of the slot number 10, and after the video segment of the segment view direction direction number 1 of the slot number 9 is played, the play slot number is completed. Video segmentation of numbered 2 in the slice view direction of 10. As shown in FIG.
  • the download trigger condition and/or the play trigger condition may include only the user view direction falling into the download trigger interval, or may also include the fall time
  • the slice view direction number of the download slot number 9 2 ie, the first slice viewing angle direction
  • the present application reduces the duration of the video segmentation of the second slice viewing direction that the user does not match the direction of the viewing angle, and improves the clarity of the user watching the VR video, and solves the problem.
  • the problem of low definition and ambiguity when the user views the VR video In the prior art, the problem of low definition and ambiguity when the user views the VR video.
  • the pre-download can be implemented in the embodiment of the present application, thereby reducing the requirement of the peak rate and the RTT delay of the communication network carrying the VR video data transmission.
  • the video segment of the first slice view direction of the target time period is downloaded according to the play progress of the video segment of the current time period
  • the target time period includes the current time period or the next time period of the current time period
  • the video segment of the current time period is a video segment of the second slice view direction, according to the play progress of the video segment of the current time period
  • FIG. 13 is a schematic structural diagram 1 of a VR terminal according to an embodiment of the present disclosure.
  • the VR terminal of this embodiment may include: a downloading module 1301, configured to download a target according to a playback progress of a video segment of a current time period when determining that a video segment of a first slice view direction needs to be downloaded. a video segment of the first slice view direction of the time period; the target time period includes the current time period or a next time period of the current time period, and the video segment of the current time period is a video score of the second slice view direction
  • the playing module 1302 is configured to switch to the video segment of the first segment viewing angle direction of the target time period for playing according to the playing progress of the video segment of the current time period.
  • the downloading module 1301 is configured to: determine whether the playing progress of the video segment of the current time period is greater than or equal to the first preset progress; and when the playing progress of the video segment of the current time period is greater than or equal to When the first preset progress is described, the video segment of the first segment view direction of the next time period of the current time period is downloaded; when the play progress of the video segment of the current time period is less than the first preset progress And downloading the video segment of the first segment viewing angle direction of the current time period.
  • the downloading module 1301 is further configured to: when the user view angle falls within a first preset threshold range centered on the first slice view direction, determine that the first slice view direction needs to be downloaded. Video fragmentation.
  • the downloading module 1301 determines that the video segment of the first segment view direction needs to be downloaded when the user view angle falls within a first preset threshold range centered on the first slice view direction. Specifically, including:
  • the playing module 1302 is specifically configured to: when the user view angle falls within a second preset threshold range centered on the first slice view direction, according to the video segment of the current time period Playing the progress, switching to the video segment of the first segment view direction of the target period for playing, the first preset threshold is greater than the second preset threshold.
  • the play module 1302 is specifically configured to: when the user view direction falls within a second preset threshold range centered on the first slice view direction and the drop duration is greater than or equal to the second pre- When the duration is set, according to the playing progress of the video segment of the current time period, the video segment of the first segment viewing angle direction of the target time period is switched for playing.
  • the playing module 1302 according to the playing progress of the video segment of the current time period, switching to the video segment of the first segment viewing angle direction of the target time period for playing, specifically:
  • the playing module 1302 switches to the video segmentation in the first slice view direction of the target time period according to the play progress of the video segment of the current time period. Play, specifically:
  • the video segment of the first segment viewing angle direction of the target time period is switched to play with the picture group GOP as the switching granularity.
  • the playing module 1302 switches to the first fragment viewing angle direction of the target time period according to the playing progress of the video segment of the current time period.
  • Video clips are played, including:
  • the video segment of the first segmentation view direction of the target time period is switched for playing.
  • the base station provided in this embodiment may be used to perform the technical solution of any of the foregoing method embodiments, and the implementation principle and the technical effect are similar to the method embodiments, and details are not described herein again.
  • FIG. 14 is a schematic structural diagram 2 of a VR terminal according to an embodiment of the present disclosure.
  • the VR terminal of this embodiment may include: a processor 1401 and a memory 1402.
  • the memory 1402 is used to store instructions, and the processor 1401 is configured to execute instructions stored in the memory 1402.
  • the VR terminal is configured to complete the following method:
  • the video segment of the first slice view direction of the target time period is downloaded according to the play progress of the video segment of the current time period;
  • the target time period includes the current time a video segment of the current time period is a video segment of a second slice view direction; or a next time period of the current time period;
  • the downloading the video fragment of the first fragmentation view direction of the target time period according to the playing progress of the video segment of the current time period includes:
  • the video segment of the first segment viewing angle direction of the current time period is downloaded.
  • the method further includes:
  • the user view angle falls into a first preset threshold value centered on the first slice view direction During the enclosing process, it is determined that the video segment of the first segment viewing direction needs to be downloaded, including:
  • the playing according to the playing progress of the video segment of the current time period, playing the video segment of the first segment viewing angle direction of the target time period, including:
  • the play station when the user view angle falls within a second preset threshold range centered on the first slice view direction, according to the play progress of the video segment of the current time period, the play station
  • the video segmentation of the first slice perspective direction of the target time period includes:
  • the video segmentation according to the current time period The playing progress, playing the video segment of the first segment viewing angle direction of the target time period.
  • the target time period is the current time period
  • switching to a video segment of the first segment viewing angle direction of the target time period for playing Previously it also included:
  • the target time period is the current time period
  • switching to a video segment of the first segment viewing angle direction of the target time period for playing include:
  • the video segment of the first segment viewing angle direction of the target time period is switched to play with the picture group GOP as the switching granularity.
  • the video is switched to the video of the first segment viewing angle direction of the target time period according to the playing progress of the video segment of the current time period.
  • Fragmentation for playback including:
  • the video segment of the first segmentation view direction of the target time period is switched for playing.
  • the present application further provides a storage medium, comprising: a readable storage medium and a computer program, which is used to implement the VR video playback processing method provided by any of the foregoing embodiments shown in FIG. 2 to FIG.
  • the application also provides a program product comprising a computer program (ie, an execution instruction) stored in a readable storage medium.
  • a computer program ie, an execution instruction
  • At least one processor of the VR terminal can read the computer program from a readable storage medium, and the at least one processor executes the computer program such that the VR terminal implements the VR video provided by any of the foregoing embodiments shown in FIG. 2-12 Play processing method.
  • the memory may include a high-speed RAM memory, and may also include a non-volatile memory NVM, such as at least one disk memory, in which various programs may be stored in the memory.
  • the various processing functions are completed and the method steps of the embodiment are implemented.
  • the processor can be a central processing unit (English: Central Processing Unit, CPU for short), or other general-purpose processor, digital signal processor (English: Digital Signal Processor, referred to as DSP), ASIC (English: Application Specific Integrated Circuit (ASIC), etc.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the steps of the method disclosed in connection with the present application may be directly embodied by hardware processor execution or by a combination of hardware and software modules in a processor.
  • All or part of the steps of implementing the above method embodiments may be performed by hardware associated with the program instructions.
  • the aforementioned program can be stored in a readable memory.
  • the steps including the foregoing method embodiments are performed; and the foregoing memory (storage medium) includes: read-only memory (English: read-only memory, abbreviation: ROM), RAM, flash memory, hard disk, Solid state drive, magnetic tape (English: magnetic tape), floppy disk (English: floppy disk), optical disc (English: optical disc) and any combination thereof.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本申请实施例提供一种VR视频播放处理方法及设备，该方法包括：在确定需要下载第一分片视角方向的视频分片时，根据当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片；所述目标时段包括所述当前时段或者所述当前时段的下一时段，所述当前时段的视频分片为第二分片视角方向的视频分片；根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。本申请提高了用户观看VR视频时的清晰度，提高了用户体验。

Description

VR视频播放处理方法及设备 技术领域
本申请涉及视频处理技术领域，尤其涉及一种虚拟现实(Virtual Reality，VR)视频播放处理方法及设备。
背景技术
由于用户观看VR视频时，能够产生身临其境的感受，因此越来越多的人选择使用VR终端观看VR视频。
现有技术中，为了减小VR终端播放VR视频时的流量消耗，提出了视场(Field of View，FOV)传输模式。具体的，将360全景VR视频按分片视角方向预先分为几十个视频分片，且每个视频分片在视场范围内提供清晰视频数据，在非视场范围提供低清晰度视频数据。在用户使用VR终端观看VR视频时，VR终端按照时段先后顺序下载并播放与用户视角方向对应的视频分片。由于用户在使用VR终端观看VR视频时，用户视角方向并不是固定不变的，现有技术中通常采用如下方式进行VR视频的播放处理：在播放当前时段的视频分片过程中，当用户视角方向变化一定程度时，下载下一时段与变化后的用户视角方向对应的视频分片，并在当前时段的视频分片播放完成之后播放下一时段与变化后的用户视角方向对应的视频分片。
但是，现有技术中，存在用户观看VR视频时清晰度低、模糊不清等问题。
发明内容
本申请实施例提供一种VR视频播放处理方法及设备，用以解决现有技术中用户观看VR视频时清晰度低、模糊不清等问题。
第一方面，本申请实施例一种虚拟现实VR视频播放处理方法，包括：
在确定需要下载第一分片视角方向的视频分片时，根据当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片；所述目标时段包括所述当前时段或者所述当前时段的下一时段，所述当前时段的视频分片为第二分片视角方向的视频分片；
根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
通过第一方面提供的VR视频播放处理方法，在确定需要下载第一分片视角方向的视频分片时，根据当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片，所述目标时段包括所述当前时段或者所述当前时段的下一时段，所述当前时段的视频分片为第二分片视角方向的视频分片，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，实现了在播放当前时段的第二分片视角方向的视频分片的过程中，根据当前时段的视频分片的播放进度，下载当前时段或下一时段的第一分片视角方向的视频分片，与必须在当 前时段的第二分片视角方向的视频分片播放完毕之后，再播放下一时段的第一分片视角方向的视频分片相比，减少了用户观看与其用户视角方向不匹配的第一分片视角方向的视频分片的时间，提高了用户观看VR视频时的清晰度，提高了用户体验。
在一种可能实现的设计中，所述根据所述当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片，包括：
判断所述当前时段的视频分片的播放进度是否大于或等于第一预设进度；
当所述当前时段的视频分片的播放进度大于或等于所述第一预设进度时，下载所述当前时段的下一时段的第一分片视角方向的视频分片；
当所述当前时段的视频分片的播放进度小于所述第一预设进度时，下载所述当前时段的第一分片视角方向的视频分片。
在一种可能实现的设计中，所述方法还包括：
当用户视角落入以所述第一分片视角方向为中心的第一预设阈值范围内，确定需要下载所述第一分片视角方向的视频分片。
在一种可能实现的设计中，所述当用户视角落入以所述第一分片视角方向为中心的第一预设阈值范围内时，确定需要下载所述第一分片视角方向的视频分片，包括：
当所述用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内且落入时长大于或等于第一预设时长时，确定需要下载所述第一分片视角方向的视频分片。
通过第一方面提供的VR视频播放处理方法，避免了用户视角方向快速转过第一分片视角的视场范围时对第一分片视角方向的视频分片的不必要下载。
在一种可能实现的设计中，所述根据所述当前时段的视频分片的播放进度，播放所述目标时段的第一分片视角方向的视频分片，包括：
当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内时，根据所述当前时段的视频分片的播放进度，播放所述目标时段的第一分片视角方向的视频分片，所述第一预设阈值大于所述第二预设阈值。
通过第一方面提供的VR视频播放处理方法，可以实现对目标时段的第一分片视角方向的视频分片的预先下载，从而降低了对承载VR视频数据传输的通信网络的峰值速率和RTT时延的要求。
在一种可能实现的设计中，所述当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内时，根据所述当前时段的视频分片的播放进度，播放所述目标时段的第一分片视角方向的视频分片，包括：
当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内且落入时长大于或等于第二预设时长时，根据所述当前时段的视频分片的播放进度，播放所述目标时段的第一分片视角方向的视频分片。
通过第一方面提供的VR视频播放处理方法，避免了用户视角方向快速转过第一分片视角的视场范围时对第一分片视角方向的视频分片的不必要播放。
在一种可能实现的设计中，当所述目标时段是所述当前时段时，所述根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放之前，还包括：
判断所述当前时段的视频分片的播放进度是否小于第二预设进度；
当所述当前时段的视频分片的播放进度小于所述第二预设进度时，执行根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放的步骤。
在一种可能实现的设计中，当所述目标时段是所述当前时段时，所述根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，包括：
根据所述当前时段的视频分片的播放进度，以画面组GOP为切换粒度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
在一种可能实现的设计中，当所述目标时段是所述当前时段的下一时段时，所述根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，包括：
当所述当前时段的视频分片播放完毕之后，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
第二方面，本申请提供一种虚拟现实VR终端，所述VR终端包括：
下载模块，用于在确定需要下载第一分片视角方向的视频分片时，根据当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片；所述目标时段包括所述当前时段或者所述当前时段的下一时段，所述当前时段的视频分片为第二分片视角方向的视频分片；
播放模块，用于根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
在一种可能实现的设计中，所述下载模块，具体用于：
判断所述当前时段的视频分片的播放进度是否大于或等于第一预设进度；
当所述当前时段的视频分片的播放进度大于或等于所述第一预设进度时，下载所述当前时段的下一时段的第一分片视角方向的视频分片；
当所述当前时段的视频分片的播放进度小于所述第一预设进度时，下载所述当前时段的第一分片视角方向的视频分片。
在一种可能实现的设计中，所述下载模块，还用于当用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内时，确定需要下载所述第一分片视角方向的视频分片。
在一种可能实现的设计中，所述下载模块，当用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内时，确定需要下载所述第一分片视角方向的视频分片，具体包括：
当所述用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内且落入时长大于或等于第一预设时长时，确定需要下载所述第一分片视角方向的视频分片。
在一种可能实现的设计中，所述播放模块，具体用于当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内时，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，所述 第一预设阈值大于所述第二预设阈值。
在一种可能实现的设计中，所述播放模块，具体用于当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内且落入时长大于或等于第二预设时长时，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
在一种可能实现的设计中，所述播放模块，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，具体包括：
判断所述当前时段的视频分片的播放进度是否小于第二预设进度；
当所述当前时段的视频分片的播放进度小于所述第二预设进度时，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
在一种可能实现的设计中，当所述目标时段是所述当前时段时，所述播放模块，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，具体包括：
根据所述当前时段的视频分片的播放进度，以画面组GOP为切换粒度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
在一种可能实现的设计中，当所述目标时段是所述当前时段的下一时段时，所述播放模块，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，具体包括：
当所述当前时段的视频分片播放完毕之后，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
第三方面，本申请提供一种虚拟现实VR终端，包括：处理器和存储器；
所述存储器用于存储指令，所述处理器用于执行所述存储器存储的指令，当处理器执行所述存储器存储的指令时，所述VR终端用于完成上述第一方面提供的方法。
第四方面，本申请还提供一种存储介质，包括：可读存储介质和计算机程序，所述计算机程序用于实现上述第一方面提供的方法。
第五方面，本申请还提供一种程序产品，该程序产品包括计算机程序(即执行指令)，该计算机程序存储在可读存储介质中。VR终端的至少一个处理器可以从可读存储介质读取该计算机程序，至少一个处理器执行该计算机程序使得VR终端实施上述第一方面提供的方法。
附图说明
图1为本申请实施例的应用场景示意图；
图2为本申请一实施例提供的VR视频播放处理方法的流程图；
图3为本申请实施例提供的用户视角方向落入以第一分片视角方向为中心的第一预设范围内的示意图；
图4A为本申请实施例提供的当前时段的第二分片视角方向的视频分片的示意图；
图4B为本申请实施例提供的当前时段的第一分片视角方向的视频分片的示意图一；
图4C为本申请实施例提供的下一时段的第一分片视角方向的视频分片的示意图一；
图4D为本申请实施例提供的当前时段的第一分片视角方向的视频分片的示意图二；
图4E为本申请实施例提供的下一时段的第一分片视角方向的视频分片的示意图二；
图4F为本申请实施例提供的下一时段的第二分片视角方向的视频分片的示意图；
图5A为本申请另一实施例提供的VR视频播放处理方法的流程图；
图5B为本申请实施例提供的用户视角方向落入第一分片视角方向的下载触发区间的示意图；
图6为本申请实施例提供的第一预设进度与第三预设进度的关系示意图；
图7为本申请实施例提供的用户视角方向落入以第一分片视角方向为中心的第二预设范围内的示意图；
图8为本申请实施例提供的第一预设阈值与第二预设阈值的关系示意图；
图9为本申请实施例提供的第一预设进度、第二预设进度和第三预设进度的关系示意图；
图10A为本申请又一实施例提供的VR视频播放处理方法的流程图；
图10B为本申请实施例提供的用户视角方向落入第一分片视角方向的播放触发区间的示意图；
图11为现有技术中视频分片的下载播放示意图；
图12为本申请实施例提供的视频分片的下载播放示意图；
图13为本申请实施例提供的VR终端的结构示意图一；
图14为本申请实施例提供的VR终端的结构示意图二。
具体实施方式
图1为本申请实施例的应用场景示意图。本申请实施例的应用场景可以包括：VR终端和VR服务器，且VR终端与VR服务器之间基于FOV传输模式进行VR视频的传输。其中，VR终端与VR服务器之间可以通过通信网络，例如第四代(4Generation，4G)通信网络、第五代通信网络(5Generation，5G网络)进行通信。对于FOV传输模式，具体的，将360全景VR视频按分片视角方向预先分为几十个视频分片，且每个视频分片在视场范围内提供清晰视频数据，在非视场范围提供低清晰度视频数据。在用户使用VR终端观看VR视频时，VR终端按照时段先后顺序下载并播放与用户视角方向对应的视频分片。需要说明的是，本申请中分片视角方向可以是指在对360全景VR视频根据视角方向划分视频分片时所使用的视角的角等分线方向，用户视角方向可以是指用户在观看VR视频时的视角的角等分线方向。用户视角方向对应的视频分片可以认为是用户视角方向所匹配的分片视角方向的视频分片。其中，用户视角方向匹配的分片视角方向可以认为是与用户视角方向最接近的分片视角方向。
具体的，VR终端从VR服务器一次获取到的VR数据并不是与用户视角方向对应的分片视角方向的视频分片的全部，而是该分片视角方向的视频分片在时间上的一小段， 即一个时段的该分片视角方向的视频分片。例如，假设用户视角方向未发生变化，用户视角方向与分片视角方向A对应，则终端先从VR服务器获取VR视频第0秒(即，最开始)-第2秒的分片视角方向A的视频分片进行播放，再获取第2秒-第4秒的分片视角方向A的视频分片进行播放，再获取第4-第6秒的分片视角方向A的视频分片进行播放，……。
图2为本申请一实施例提供的VR视频播放处理方法的流程图。本实施例的方法可以由VR终端来执行，如图2所示，本实施例的方法可以包括：
步骤201、在确定需要下载第一分片视角方向的视频分片时，根据当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片；所述目标时段包括所述当前时段或者所述当前时段的下一时段，所述当前时段的视频分片为第二分片视角方向的视频分片。
本步骤中，当前时段的视频分片为第二分片视角方向的视频分片，而下载的是第一分片视角方向的视频分片，可以看出，本实施例主要针对用户视角方向发生变化需要由播放第二分片视角方向的视频分片切换为播放第一分片视角方向的视频分片的场景。其中，第一分片视角方向与第二分片视角方向为不同的分片视角方向。现有技术中，在确定需要下载第一分片视角方向的视频分片时，直接下载当前时段的下一时段的第一分片视角方向的视频分片。而本步骤中，根据当前时段的视频分片的播放进度，下载当前时段的第一分片视角方向的视频分片，或者，下载当前时段的下一时段的第一分片视角方向的视频分片。具体的，可以将当前时段的视频分片的播放进度与预设进度进行比较，决定目标时段是当前时段还是当前时段的下一时段。可选的，所述根据所述当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片，包括：判断所述当前时段的视频分片的播放进度是否大于或等于第一预设进度；当所述当前时段的视频分片的播放进度大于或等于所述第一预设进度时，下载所述当前时段的下一时段的第一分片视角方向的视频分片；当所述当前时段的视频分片的播放进度小于所述第一预设进度时，下载所述当前时段的第一分片视角方向的视频分片。例如，当当前时段的视频分片播放进度不到30％时，下载当前时段的第一分片视角方向的视频分片；当当前时段的视频分片播放进度大于或等于30％时，下载当前时段的下一时段的第一分片视角方向的视频分片。
可选的，所述下载目标时段的第一分片视角方向的视频分片，具体可以为：VR终端向VR服务器发送用于请求所述目标时段的第一分片视角方向的视频分片的下载请求，所述服务器根据所述VR终端的下载请求将所述目标时段的第一分片视角方向的视频分片返回给所述VR终端，从而实现下载所述目标时段的第一分片视角方向的视频分片。
可选的，步骤201之前还可以包括确定需要下载所述第一分片视角方向的视频分片的步骤。具体可以为当用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内，确定需要下载所述第一分片视角方向的视频分片。例如，图3中用户视角方向落入了以第一分片视角方向为中心的第一预设范围内。需要说明的是，以所述第一分片视角方向为中心的第一预设阈值范围可以包括在所述第一分片视角的视场范围内。上述以所述第一分片视角方向为中心的第一预设阈值范围可以理解为所述第 一分片视角方向的视频分片的下载触发区间。
为了避免用户视角方向快速转过第一分片视角的视场范围时对第一分片视角方向的视频分片的不必要下载，进一步可选的，还可以考量用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围的时长。具体的，当所述用户视角落入以所述第一分片视角方向为中心的第一预设阈值范围内且落入时长大于或等于第一预设时长时，确定需要下载所述第一分片视角方向的视频分片。
可选的，在具体实现时，以VR视频的第一个视频分片提供的视角的角等分线方向(Orientation_Initial)为参考，按照顺时针方向递增的方式，某一分片视角方向(例如，第一分片视角方向或第二分片视角方向)可以记为该分片视角方向与Orientation_Initial之间的相对角度，用户视角方向可以记为该用户视角方向与Orientation_Initial之间的相对角度。
如图4A所示，在播放当前时段的第二分片视角方向的视频分片的过程中：当用户视角方向顺时针转动一定幅度时，确定需要下载第一分片视角方向的视频分片，且第一分片视角方向可以认为是第二分片视角方向右侧的视角方向，当前时段的第一分片视角方向的视频分片可以如图4B，当前时段的下一时段的第一分片视角方向的视频分片可以如图4C所示；当用户视角方向逆时针转动一定幅度时，确定需要下载第一分片视角方向的视频分片，且第一分片视角方向可以认为是第二分片视角方向左侧的视角方向，当前时段的第一分片视角方向的视频分片可以如图4D，当前时段的下一时段的第一分片视角方向的视频分片可以如图4E所示；当用户视角方向转动幅度较小时，确定需要下载第二视角方向的视频分片，当前时段的下一时段的第二视角方向的视频分片可以如图4F所示。可以看出，在如图4A所示的状态下可以下载的视频分片可以分为图4B-图4F五类。需要说明的是图4A-图4F中以第一分片视角方向与第二视角方向相邻为例。
以下，在播放当前时段的视频分片的过程中，如何进行下载处理提供一种可选的实现方式。如图5A所示，具体可以包括：
步骤501、以第一个视频分片提供的视角的角等分线方向(Orientation_Initial)为参考，监测用户视角方向变化角度(△Orietation_U)，顺时针转动记为正值，逆时针记为负值。
本步骤中，具体的，可以以Orientation_Initial为参考，按照顺时针方向递增的方式记录分片视角方向和用户视角方向。当用户视角方向相对于Orientation_Initial顺时针转动时，用户视角方向变化角度可以记为正值，当用户视角方向相对于Orientation_Initial逆时针转动时，用户视角方向变化角度可以记为负值。
步骤502、判断用户视角方向是顺时针转动还是逆时针转动。
本步骤中，具体的可以判断△Orietation_U是正值还是负值，当为正值时说明是顺时针转动，当为负值时说明是逆时针转动。当确定用户视角方向逆时针转动时，执行步骤503，当确定用户视角方向顺时针转动时，执行步骤504。
步骤503、判断用户视角方向是否落入左侧第一分片视角方向的下载触发区间。
本步骤中，所述第一分片视角方向可以认为Orientation_Initial左侧的任一分 片视角方向。具体的，如图5B所示，可以通过判断是否满足Orientation_X-Offset_D≤360-△Orietation_U≤Orientation_X+Offset_D，其中，Orientation_X表示第一分片视角方向，具体可以为以Orientation_Initial参考，由Orientation_Initial沿顺时针方向至第一分片视角方向之间的角度，Offset_D表示第一预设阈值。当确定用户视角落入左侧第一分片视角方向的下载触发区间时，执行步骤505；当确定用户视角方向未落入左侧第一分片视角方向的下载触发区间时，执行步骤509。
步骤504、判断用户视角方向是否落入右侧第一分片视角方向的下载触发区间。
本步骤中，所述第一分片视角方向可以认为是Orientation_Initial右侧的任一分片视角方向。具体的，如图5B所示，可以通过判断是否满足Orientation_X-Offset_D≤△Orietation_U≤Orientation_X+Offset_D，其中，Orientation_X表示第一分片视角方向，具体可以为以Orientation_Initial参考，由Orientation_Initial沿顺时针方向至第一分片视角方向之间的角度，Offset_D表示第一预设阈值。当确定用户视角落入右侧第一分片视角方向的下载触发区间时，执行步骤505；当确定用户视角方向未落入右侧第一分片视角方向的下载触发区间时，执行步骤509。
步骤505、判断用户视角方向连续在下载触发区间的时长是否大于或等于第一预设时长。
本步骤中，当用户视角方向连续在下载触发区间的时长大于或等于第一预设阈值时，执行步骤506；当用户视角方向连续在下载触发区间的时长小于第一预设阈值时，执行步骤509。
步骤506、判断当前时段的视频分片的播放进度是否大于或等于第一预设进度。
本步骤中，当当前时段的视频分片的播放进度是大于或等于第一预设进度时，执行步骤507；当当前时段的视频分片的播放进度小于第一预设进度时，执行步骤515。
步骤507、判断当前时段是否为整个VR视频的最后一个时段。
本步骤中，由于当当前时段为整个VR视频的最后一个时段时，不存在当前时段的下一时段，因此为了确保流程的可靠性和稳定性，执行步骤507。当当前时段为整个VR视频的最后一个时段时，执行步骤508；当当前时段不为整个视频的最后一个时段时，执行步骤513。
步骤508、判断整个VR视频是否播放结束。
本步骤中，当整个VR视频播放结束时，结束；当整个VR视频播放未结束时，返回步骤501。
步骤509、判断当前时段的视频分片的播放进度是否大于或等于第三预设进度。
本步骤中，当当前时段的视频分片的播放进度大于或等于第三预设进度时，执行步骤510；当当前时段的视频分片的播放进度小于第三预设进度时，返回步骤501。可选的，关于第一预设进度与第三预设进度的关系可以如图6所示。
步骤510、判断当前时段是否为整个VR视频的最后一个时段。
本步骤中，当当前时段为整个VR视频的最后一个时段时，执行步骤508；当当前时段不为整个VR视频的最后一个时段时，执行步骤511。
步骤511、判断是否已经发出用于请求下一时段的第二分片视角方向的视频分片的第一下载请求。
本步骤中，当已经发出用于第一下载请求时，返回步骤501；当未发出用于第一下载请求时，执行步骤512。
步骤512、向VR服务器发送所述第一下载请求。
本步骤中，具体的，VR终端根据媒体演示描述(Media Presentation Description，MPD)，向所述VR服务器发送第一下载请求。步骤512执行完之后，返回步骤501。
步骤513、判断是否已经发出用于请求下一时段的第一分片视角方向的视频分片的第二下载请求。
本步骤中，当已经发出用于第二下载请求时，返回步骤501；当未发出用于第二下载请求时，执行步骤513。
步骤514、向VR服务器发送所述第二下载请求。
本步骤中，具体的，VR终端根据MPD媒体描述文件，向所述VR服务器发送第二下载请求。步骤513执行完之后，返回步骤501。
步骤515、判断是否已经发出用于请求当前时段的第一分片视角方向的视频分片的第三下载请求。
本步骤中，当已经发出用于第三下载请求时，返回步骤501；当未发出用于第三下载请求时，执行步骤516。
步骤516、向VR服务器发送所述第三下载请求。
本步骤中，具体的，VR终端根据MPD媒体描述文件，向所述VR服务器发送第三下载请求。步骤516执行完之后，返回步骤501。
步骤202、根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
本步骤中，具体的，当所述目标时段是当前时段的下一时段时，步骤202具体可以为当所述当前时段的视频分片播放完毕之后，切换至所述目标时段的第一分片视角方向的视频分片进行播放；当所述目标时段是当前时段时，步骤202具体可以为停止所述当前时段的视频分片的播放，并从所述目标时段的第一分片视角方向的视频分片的所述播放进度开始进行播放。可选的，当VR视频采用视频编码技术压缩时，主要有三种编码帧：帧内编码图像(Intra-coded picture，I)帧、预测编码图像(Predictive-coded Picture，P)帧、双向预测编码图像(Bidirectionally predicted picture，B)帧。其中，I帧表示关键帧，只利用本帧的信息进行编码；P帧表示的是这一帧跟之前的一个关键帧(或P帧)的差别，P帧利用之前的I帧或P帧，采用运动预测的方式进行帧间预测编码；B帧表示的是本帧与前后帧的差别，提供最高的压缩比，B帧既需要之前的图像帧(I帧或P帧)，也需要后来的图像帧(P帧)，采用运动预测的方式进行帧间双向预测编码。可以看出，在VR视频采用视频编码技术压缩场景下，当由播放当前时段的视频分片切换至目标时段的第一分片视角方向的视频偏偏进行分片播放时，为了确保能够正确解码P帧和B帧，需要以图像组(Group of picture，GOP)为切换粒度。其中，GOP指两个I帧之间的图像。
可选的，步骤202中还可以包括触发播放所述第一分片视角方向的视频分片的条件。具体的，步骤202具体可以为当用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内时，根据所述当前时段的视频分片的播放进度，切换至所述 目标时段的第一分片视角方向的视频分片进行播放。例如，图7中，用户视角方向落入了以第一分片视角方向为中心的第二预设阈值范围内。需要说明的是，以所述第一分片视角方向为中心的第二预设阈值范围可以包括在所述第一分片视角的视场范围内。上述以所述第一分片视角方向为中心的第二预设阈值范围可以理解为所述第一分片视角方向的视频分片的播放触发区间。
可选的，第一预设阈值与第二预设阈值的关系可以如图8所示。如图8所示，当用户视角方向发生变化时，用户视角方向首先落入以所述第一分片视角方向为中心的第一预设阈值范围内，从而触发目标时段的第一分片视角方向的视频分片的下载；当用户视角方向继续朝着同一方向变化时，用户视角方向会落入以所述第一分片视角方向为中心的第二预设阈值范围内，从而触发目标时段的第一分片视角方向的视频分片的播放。这样做的好处是，可以实现对目标时段的第一分片视角方向的视频分片的预先下载，从而降低了对承载VR视频数据传输的通信网络的峰值速率和往返时延(Round-Trip Time，RTT)的要求；同时，也避免了在确定应该播放第一分片视角方向的视频分片时，需要进一步等待第一分片视角方向的视频分片下载，而导致VR视频清晰度低、模糊不清的问题，提高了用户体验。需要说明的是，第一预设阈值与第二预设阈值也可以相等，当相等时不能实现预先下载的目的。
为了避免用户视角方向快速转过第一分片视角的视场范围时对第一分片视角方向的视频分片的不必要播放，进一步可选的，还可以考量用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围的时长。具体的，步骤202具体可以为当所述用户视角落入以所述第一分片视角方向为中心的第二预设阈值范围内且落入时长大于或等于第二预设时长时，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。需要说明的是，第一预设时长与第二预设时长可以相等，也可以不相等。本实施例中对第一预设时长与第二预设时长的关系并不作限制。
可选的，当所述目标时段是所述当前时段时，所述根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放之前，还包括：判断所述当前时段的视频分片的播放进度是否小于第二预设进度；当所述当前时段的视频分片的播放进度小于所述第二预设进度时，执行根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放的步骤。
进一步可选的，当所述当前时段的视频分片的播放进度大于或等于所述第二预设进度时，当所述当前时段的视频分片播放完毕之后，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
可选的，上述第一预设进度、第二预设进度、第三预设进度的关系可以如图9所示。
以下，在播放当前时段的视频分片的过程中，如何进行播放处理提供一种可选的实现方式。如图10A所示，具体可以包括：
步骤1001、以第一个视频分片提供的视角的角等分线方向(Orientation_Initial)为参考，监测用户视角方向变化角度(△Orietation_U)， 顺时针转动记为正值，逆时针记为负值。
本步骤中，具体的，可以以Orientation_Initial为参考，按照顺时针方向递增的方式记录分片视角方向和用户视角方向。当用户视角方向相对于Orientation_Initial顺时针转动时，用户视角方向变化角度可以记为正值，当用户视角方向相对于Orientation_Initial逆时针转动时，用户视角方向变化角度可以记为负值。
步骤1002、判断用户视角方向是顺时针转动还是逆时针转动。
本步骤中，具体的可以判断△Orietation_U是正值还是负值，当为正值时说明是顺时针转动，当为负值时说明是逆时针转动。当确定用户视角方向逆时针转动时，执行步骤1003，当确定用户视角方向顺时针转动时，执行步骤1004。
步骤1003、判断用户视角方向是否落入左侧第一分片视角方向的播放触发区间。
本步骤中，所述第一分片视角方向可以认为是Orientation_Initial左侧的任一分片视角方向。具体的，如图10B所示，可以通过判断是否满足Orientation_X-Offset_H≤360-△Orietation_U≤Orientation_X+Offset_H，其中Orientation_X，表示第一分片视角方向，具体可以为以Orientation_Initial参考，由Orientation_Initial沿顺时针方向至第一分片视角方向之间的角度，Offset_H表示第二预设阈值。当确定用户视角落入左侧第一分片视角方向的播放触发区间时，执行步骤1005；当确定用户视角方向未落入左侧第一分片视角方向的播放触发区间时，执行步骤1010。
步骤1004、判断用户视角方向是否落入右侧第一分片视角方向的播放触发区间。
本步骤中，所述第一分片视角方向可以认为是Orientation_Initial右侧的任一分片视角方向。具体的，如图10B所示，可以通过判断是否满足Orientation_X-Offset_H≤△Orietation_U≤Orientation_X+Offset_H，其中，Orientation_X表示第一分片视角方向，具体可以为以Orientation_Initial参考，由Orientation_Initial沿顺时针方向至第一分片视角方向之间的角度，Offset_H表示第二预设阈值。当确定用户视角落入右侧第一分片视角方向的播放触发区间时，执行步骤1005；当确定用户视角方向未落入右侧第一分片视角方向的播放触发区间时，执行步骤1010。
步骤1005、判断用户视角方向连续在播放触发区间的时长是否大于或等于第二预设时长。
本步骤中，当用户视角方向连续在播放触发区间的时长大于或等于第一预设阈值时，执行步骤1006；当用户视角方向连续在播放触发区间的时长小于第一预设阈值时，执行步骤1010。
步骤1006、判断当前时段的视频分片的播放进度是否大于或等于第二预设进度。
本步骤中，当当前时段的视频分片的播放进度大于或等于第二预设进度时，执行步骤1007；当当前时段的视频分片的播放进度小于第二预设进度时，执行步骤1013。
步骤1007、判断当前时段的视频分片是否播放完毕。
本步骤中，当当前时段的视频分片播放完毕时，执行步骤1008；当当前时段的视频分片未播放完毕时，返回步骤1001。
步骤1008、判断整个VR视频是否播放结束。
本步骤中，当整个VR视频播放未结束时，执行步骤1009；当整个VR视频播放结束时，结束。
步骤1009、切换到下一时段的第一分片视角方向的视频分片进行播放。
需要说明的是，步骤1009执行完之后，返回步骤1001。
步骤1010、判断当前时段的视频分片是否播放完毕。
本步骤中，当当前时段的视频分片播放完毕时，执行步骤1011；当当前时段的视频分片未播放完毕时，返回步骤1001。
步骤1011、判断整个VR视频是否播放结束。
本步骤中，当整个VR视频播放未结束时，执行步骤1012；当整个VR视频播放结束时，结束。
步骤1012、切换到下一时段的第二分片视角方向的视频分片进行播放。
需要说明的是，步骤1012执行完之后，返回步骤1001。
步骤1013、以GOP为切换粒度，切换到当前时段的第一分片视角方向的视频分片进行播放。
需要说明的是，步骤1013执行完之后，返回步骤1001。
图11为现有技术中视频分片的下载播放示意图，图12为本申请实施例提供的视频分片的下载播放示意图。如图11所示，现有技术中，在播放时段编号9的分片视角方向编号1(即，第二分片视角方向)的视频分片的过程中，当用户视角方向变化到一定程度时，下载时段编号10的分片视角方向编号2(即，第一分片视角方向)的视频分片，并在时段编号9的分片视角方向编号1的视频分片播放完毕之后，播放时段编号10的分片视角方向编号2的视频分片。如图12所示，本申请实施例中，在播放时段编号9的分片视角方向编号1(即，第二分片视角方向)的视频分片的过程中，当用户视角方向变化满足下载触发条件和播放触发条件(这里，下载触发条件和/或播放触发条件可以只包括用户视角方向落入下载触发区间，或者，还可以包括落入时长)时，下载时段编号9的分片视角方向编号2(即，第一分片视角方向)的视频分片，在时段编号9的分片视角方向编号1的视频分片未播放完毕时，切换至时段编号9的分片视角方向编号2的视频分片进行播放，并在时段编号9的视频分片编号2的视频分片播放完毕之后，播放时段编号10的视频分片编号2的视频分片。因此，可以看出，本申请与现有技术相比，减少了用户观看与其视角方向不匹配的第二分片视角方向的视频分片的时长，提高了用户观看VR视频的清晰度，解决了现有技术中用户观看VR视频时清晰度低、模糊不清的问题。
另外，如图12所示，本申请实施例中，在播放时段编号5的分片视角方向编号1(即，第二分片视角方向)的视频分片的过程中，当用户视角方向变化满足下载触发条件时，下载时段编号5的分片视角方向编号2(即，第一分片视角方向)的视频分片，但是由于不满足用户视角方向变化不满足播放触发条件，因此不对时段编号5的分片视角方向编号2的视频分片进行播放。可以看出，本申请实施例中可以实现预先下载，从而降低了对承载VR视频数据传输的通信网络的峰值速率和RTT时延的要求。同时，也避免了在确定应该播放第一分片视角方向的视频分片时，需要进一步等待第 一分片视角方向的视频分片下载，而导致用户观看VR视频时清晰度低、模糊不清的问题，提高了用户观看VR视频时的清晰度，提高了用户体验。
本实施例中，通过在确定需要下载第一分片视角方向的视频分片时，根据当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片，所述目标时段包括所述当前时段或者所述当前时段的下一时段，所述当前时段的视频分片为第二分片视角方向的视频分片，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，实现了在播放当前时段的第二分片视角方向的视频分片的过程中，根据当前时段的视频分片的播放进度，下载当前时段或下一时段的第一分片视角方向的视频分片，与必须在当前时段的第二分片视角方向的视频分片播放完毕之后，再播放下一时段的第一分片视角方向的视频分片相比，减少了用户观看与其用户视角方向不匹配的第一分片视角方向的视频分片的时间，提高了用户观看VR视频时的清晰度，提高了用户体验。
图13为本申请实施例提供的VR终端的结构示意图一。如图13所示，本实施例的VR终端可以包括：下载模块1301，用于在确定需要下载第一分片视角方向的视频分片时，根据当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片；所述目标时段包括所述当前时段或者所述当前时段的下一时段，所述当前时段的视频分片为第二分片视角方向的视频分片；播放模块1302，用于根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
可选的，下载模块1301，具体用于：判断所述当前时段的视频分片的播放进度是否大于或等于第一预设进度；当所述当前时段的视频分片的播放进度大于或等于所述第一预设进度时，下载所述当前时段的下一时段的第一分片视角方向的视频分片；当所述当前时段的视频分片的播放进度小于所述第一预设进度时，下载所述当前时段的第一分片视角方向的视频分片。
可选的，下载模块1301，还用于当用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内时，确定需要下载所述第一分片视角方向的视频分片。
可选的，下载模块1301，当用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内时，确定需要下载所述第一分片视角方向的视频分片，具体包括：
当所述用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内且落入时长大于或等于第一预设时长时，确定需要下载所述第一分片视角方向的视频分片。
可选的，播放模块1302，具体用于当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内时，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，所述第一预设阈值大于所述第二预设阈值。
进一步，可选的，播放模块1302，具体用于当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内且落入时长大于或等于第二预设时长时，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
可选的，播放模块1302，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，具体包括：
判断所述当前时段的视频分片的播放进度是否小于第二预设进度；
当所述当前时段的视频分片的播放进度小于所述第二预设进度时，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
可选的，当所述目标时段是所述当前时段时，播放模块1302，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，具体包括：
根据所述当前时段的视频分片的播放进度，以画面组GOP为切换粒度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
可选的，当所述目标时段是所述当前时段的下一时段时，播放模块1302，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，具体包括：
当所述当前时段的视频分片播放完毕之后，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
本实施例中提供的基站，可以用于执行前述任一方法实施例的技术方案，其实现原理和技术效果与方法实施例类似，在此不再赘述。
图14为本申请实施例提供的VR终端的结构示意图二。如图14所示，本实施例的VR终端可以包括：处理器1401和存储器1402。存储器1402用于存储指令，处理器1401用于执行存储器1402存储的指令，当处理器1401执行存储器1402存储的指令时，VR终端用于完成如下方法：
在确定需要下载第一分片视角方向的视频分片时，根据当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片；所述目标时段包括所述当前时段或者所述当前时段的下一时段，所述当前时段的视频分片为第二分片视角方向的视频分片；
根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
可选的，所述根据所述当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片，包括：
判断所述当前时段的视频分片的播放进度是否大于或等于第一预设进度；
当所述当前时段的视频分片的播放进度大于或等于所述第一预设进度时，下载所述当前时段的下一时段的第一分片视角方向的视频分片；
当所述当前时段的视频分片的播放进度小于所述第一预设进度时，下载所述当前时段的第一分片视角方向的视频分片。
可选的，所述方法还包括：
当用户视角落入以所述第一分片视角方向为中心的第一预设阈值范围内，确定需要下载所述第一分片视角方向的视频分片。
可选的，所述当用户视角落入以所述第一分片视角方向为中心的第一预设阈值范 围内时，确定需要下载所述第一分片视角方向的视频分片，包括：
当所述用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内且落入时长大于或等于第一预设时长时，确定需要下载所述第一分片视角方向的视频分片。
可选的，所述根据所述当前时段的视频分片的播放进度，播放所述目标时段的第一分片视角方向的视频分片，包括：
当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内时，根据所述当前时段的视频分片的播放进度，播放所述目标时段的第一分片视角方向的视频分片。
可选的，所述当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内时，根据所述当前时段的视频分片的播放进度，播放所述目标时段的第一分片视角方向的视频分片，包括：
当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内且落入时长大于或等于第二预设时长时，根据所述当前时段的视频分片的播放进度，播放所述目标时段的第一分片视角方向的视频分片。
可选的，当所述目标时段是所述当前时段时，所述根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放之前，还包括：
判断所述当前时段的视频分片的播放进度是否小于第二预设进度；
当所述当前时段的视频分片的播放进度小于所述第二预设进度时，执行根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放的步骤。
可选的，当所述目标时段是所述当前时段时，所述根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，包括：
根据所述当前时段的视频分片的播放进度，以画面组GOP为切换粒度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
可选的，当所述目标时段是所述当前时段的下一时段时，所述根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，包括：
当所述当前时段的视频分片播放完毕之后，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
本申请还提供一种存储介质，包括：可读存储介质和计算机程序，所述计算机程序用于实现前述图2-图12所示实施例中任一实施例提供的VR视频播放处理方法。
本申请还提供一种程序产品，该程序产品包括计算机程序(即执行指令)，该计算机程序存储在可读存储介质中。VR终端的至少一个处理器可以从可读存储介质读取该计算机程序，至少一个处理器执行该计算机程序使得VR终端实施前述图2-图12所示实施例中任一实施例提供的VR视频播放处理方法。
上述VR终端的具体实现中，应理解，存储器可能包含高速RAM存储器，也可能还包括非易失性存储NVM，例如至少一个磁盘存储器，存储器中可以存储各种程序，用 于完成各种处理功能以及实现本实施例的方法步骤。处理器可以是中央处理单元(英文：Central Processing Unit，简称：CPU)，还可以是其他通用处理器、数字信号处理器(英文：Digital Signal Processor，简称：DSP)、专用集成电路(英文：Application Specific Integrated Circuit，简称：ASIC)等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请所公开的方法的步骤可以直接体现为硬件处理器执行完成，或者用处理器中的硬件及软件模块组合执行完成。
实现上述各方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成。前述的程序可以存储于一可读取存储器中。该程序在执行时，执行包括上述各方法实施例的步骤；而前述的存储器(存储介质)包括：只读存储器(英文：read-only memory，缩写：ROM)、RAM、快闪存储器、硬盘、固态硬盘、磁带(英文：magnetic tape)、软盘(英文：floppy disk)、光盘(英文：optical disc)及其任意组合。

Claims (19)

  1. 一种虚拟现实VR视频播放处理方法，其特征在于，所述方法包括：
    在确定需要下载第一分片视角方向的视频分片时，根据当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片；所述目标时段包括所述当前时段或者所述当前时段的下一时段，所述当前时段的视频分片为第二分片视角方向的视频分片；
    根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
  2. 根据权利要求1所述的方法，其特征在于，所述根据所述当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片，包括：
    判断所述当前时段的视频分片的播放进度是否大于或等于第一预设进度；
    当所述当前时段的视频分片的播放进度大于或等于所述第一预设进度时，下载所述当前时段的下一时段的第一分片视角方向的视频分片；
    当所述当前时段的视频分片的播放进度小于所述第一预设进度时，下载所述当前时段的第一分片视角方向的视频分片。
  3. 根据权利要求1或2所述方法，其特征在于，所述方法还包括：
    当用户视角落入以所述第一分片视角方向为中心的第一预设阈值范围内，确定需要下载所述第一分片视角方向的视频分片。
  4. 根据权利要求3所述的方法，其特征在于，所述当用户视角落入以所述第一分片视角方向为中心的第一预设阈值范围内时，确定需要下载所述第一分片视角方向的视频分片，包括：
    当所述用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内且落入时长大于或等于第一预设时长时，确定需要下载所述第一分片视角方向的视频分片。
  5. 根据权利要求3或4所述的方法，其特征在于，所述根据所述当前时段的视频分片的播放进度，播放所述目标时段的第一分片视角方向的视频分片，包括：
    当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内时，根据所述当前时段的视频分片的播放进度，播放所述目标时段的第一分片视角方向的视频分片，所述第一预设阈值大于所述第二预设阈值。
  6. 根据权利要求5所述的方法，其特征在于，所述当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内时，根据所述当前时段的视频分片的播放进度，播放所述目标时段的第一分片视角方向的视频分片，包括：
    当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内且落入时长大于或等于第二预设时长时，根据所述当前时段的视频分片的播放进度，播放所述目标时段的第一分片视角方向的视频分片。
  7. 根据权利要求1-6任一项所述的方法，其特征在于，当所述目标时段是所述当前时段时，所述根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放之前，还包括：
    判断所述当前时段的视频分片的播放进度是否小于第二预设进度；
    当所述当前时段的视频分片的播放进度小于所述第二预设进度时，执行根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放的步骤。
  8. 根据权利要求1-7任一项所述的方法，其特征在于，当所述目标时段是所述当前时段时，所述根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，包括：
    根据所述当前时段的视频分片的播放进度，以画面组GOP为切换粒度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
  9. 根据权利要求1-7任一项所述的方法，其特征在于，当所述目标时段是所述当前时段的下一时段时，所述根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，包括：
    当所述当前时段的视频分片播放完毕之后，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
  10. 一种虚拟现实VR终端，其特征在于，所述VR终端包括：
    下载模块，用于在确定需要下载第一分片视角方向的视频分片时，根据当前时段的视频分片的播放进度，下载目标时段的第一分片视角方向的视频分片；所述目标时段包括所述当前时段或者所述当前时段的下一时段，所述当前时段的视频分片为第二分片视角方向的视频分片；
    播放模块，用于根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
  11. 根据权利要求10所述的VR终端，其特征在于，所述下载模块，具体用于：
    判断所述当前时段的视频分片的播放进度是否大于或等于第一预设进度；
    当所述当前时段的视频分片的播放进度大于或等于所述第一预设进度时，下载所述当前时段的下一时段的第一分片视角方向的视频分片；
    当所述当前时段的视频分片的播放进度小于所述第一预设进度时，下载所述当前时段的第一分片视角方向的视频分片。
  12. 根据权利要求10或11所述的VR终端，其特征在于，所述下载模块，还用于当用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内时，确定需要下载所述第一分片视角方向的视频分片。
  13. 根据权利要求12所述的VR终端，其特征在于，所述下载模块，当用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内时，确定需要下载所述第一分片视角方向的视频分片，具体包括：
    当所述用户视角方向落入以所述第一分片视角方向为中心的第一预设阈值范围内且落入时长大于或等于第一预设时长时，确定需要下载所述第一分片视角方向的视频分片。
  14. 根据权利要求12或13所述的VR终端，其特征在于，所述播放模块，具体用于当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内时，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角 方向的视频分片进行播放，所述第一预设阈值大于所述第二预设阈值。
  15. 根据权利要求14所述的VR终端，其特征在于，所述播放模块，具体用于当所述用户视角方向落入以所述第一分片视角方向为中心的第二预设阈值范围内且落入时长大于或等于第二预设时长时，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
  16. 根据权利要求10-15任一项所述的VR终端，其特征在于，所述播放模块，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，具体包括：
    判断所述当前时段的视频分片的播放进度是否小于第二预设进度；
    当所述当前时段的视频分片的播放进度小于所述第二预设进度时，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
  17. 根据权利要求10-16任一项所述的VR终端，其特征在于，当所述目标时段是所述当前时段时，所述播放模块，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，具体包括：
    根据所述当前时段的视频分片的播放进度，以画面组GOP为切换粒度，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
  18. 根据权利要求10-16任一项所述的VR终端，其特征在于，当所述目标时段是所述当前时段的下一时段时，所述播放模块，根据所述当前时段的视频分片的播放进度，切换至所述目标时段的第一分片视角方向的视频分片进行播放，具体包括：
    当所述当前时段的视频分片播放完毕之后，切换至所述目标时段的第一分片视角方向的视频分片进行播放。
  19. 一种虚拟现实VR终端，其特征在于，包括：处理器和存储器；
    所述存储器用于存储指令，所述处理器用于执行所述存储器存储的指令，当处理器执行所述存储器存储的指令时，所述VR终端用于完成如权利要求1至9任一项所述的方法。
PCT/CN2017/099724 2017-08-30 2017-08-30 Vr视频播放处理方法及设备 WO2019041179A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/099724 WO2019041179A1 (zh) 2017-08-30 2017-08-30 Vr视频播放处理方法及设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/099724 WO2019041179A1 (zh) 2017-08-30 2017-08-30 Vr视频播放处理方法及设备

Publications (1)

Publication Number Publication Date
WO2019041179A1 true WO2019041179A1 (zh) 2019-03-07

Family

ID=65524658

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/099724 WO2019041179A1 (zh) 2017-08-30 2017-08-30 Vr视频播放处理方法及设备

Country Status (1)

Country Link
WO (1) WO2019041179A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022111554A1 (zh) * 2020-11-30 2022-06-02 华为技术有限公司 一种视角切换方法及装置

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150249813A1 (en) * 2014-03-03 2015-09-03 Next3D, Inc. Methods and apparatus for streaming content
CN105791882A (zh) * 2016-03-22 2016-07-20 腾讯科技（深圳）有限公司 视频编码方法及装置
CN105915937A (zh) * 2016-05-10 2016-08-31 上海乐相科技有限公司 一种全景视频播放方法及设备
CN105979239A (zh) * 2016-04-28 2016-09-28 乐视控股（北京）有限公司 虚拟现实终端及其视频的显示方法和装置
CN106060570A (zh) * 2016-06-30 2016-10-26 北京奇艺世纪科技有限公司 一种全景视频图像播放、编码方法及装置
CN106791794A (zh) * 2016-12-30 2017-05-31 重庆卓美华视光电有限公司 一种显示设备、图像处理方法及装置
CN107037873A (zh) * 2016-10-09 2017-08-11 深圳市金立通信设备有限公司 一种虚拟现实主界面的显示方法及终端

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150249813A1 (en) * 2014-03-03 2015-09-03 Next3D, Inc. Methods and apparatus for streaming content
CN105791882A (zh) * 2016-03-22 2016-07-20 腾讯科技（深圳）有限公司 视频编码方法及装置
CN105979239A (zh) * 2016-04-28 2016-09-28 乐视控股（北京）有限公司 虚拟现实终端及其视频的显示方法和装置
CN105915937A (zh) * 2016-05-10 2016-08-31 上海乐相科技有限公司 一种全景视频播放方法及设备
CN106060570A (zh) * 2016-06-30 2016-10-26 北京奇艺世纪科技有限公司 一种全景视频图像播放、编码方法及装置
CN107037873A (zh) * 2016-10-09 2017-08-11 深圳市金立通信设备有限公司 一种虚拟现实主界面的显示方法及终端
CN106791794A (zh) * 2016-12-30 2017-05-31 重庆卓美华视光电有限公司 一种显示设备、图像处理方法及装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022111554A1 (zh) * 2020-11-30 2022-06-02 华为技术有限公司 一种视角切换方法及装置

Similar Documents

Publication Publication Date Title
EP3606082B1 (en) Panoramic video playback method and client terminal
JP7110234B2 (ja) ビデオ再生方法、デバイス、およびシステム
WO2023024834A1 (zh) 一种游戏数据处理方法、装置及存储介质
CA2965484C (en) Adaptive bitrate streaming latency reduction
US10712771B2 (en) System and method for synchronized playback of streaming digital content
CN110636346B (zh) 一种码率自适应切换方法、装置、电子设备及存储介质
CN107566918B (zh) 一种视频分发场景下的低延时取流秒开方法
WO2019170073A1 (zh) 媒体播放
CN110582012B (zh) 视频切换方法、视频处理方法、装置及存储介质
US11438645B2 (en) Media information processing method, related device, and computer storage medium
TW201119400A (en) System and method for selecting a video encoding format based on feedback data
WO2022111554A1 (zh) 一种视角切换方法及装置
CN109218739B (zh) 视频流的视角切换方法、装置、设备和计算机存储介质
CN111447455A (zh) 直播视频流回放处理方法、装置及计算设备
CN109348279A (zh) 一种推流方法、装置、设备及存储介质
CN111726657A (zh) 直播视频的播放处理方法、装置及服务器
WO2012151217A1 (en) L-cut stream startup
CN108307248B (zh) 视频播放方法、装置、计算设备及存储介质
US10057654B2 (en) Selection and alignment of video segments for adaptive streaming
EP2034733A2 (en) Content reproduction
US9356981B2 (en) Streaming content over a network
WO2019041179A1 (zh) Vr视频播放处理方法及设备
US10356159B1 (en) Enabling playback and request of partial media fragments
JP2023171661A (ja) タイルベースの没入型ビデオをエンコードするためのエンコーダおよび方法
US10313759B1 (en) Enabling playback and request of partial media fragments

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17923501

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17923501

Country of ref document: EP

Kind code of ref document: A1