CN115297351A

CN115297351A - Panoramic video playing method and device, storage medium and electronic equipment

Info

Publication number: CN115297351A
Application number: CN202210928945.4A
Authority: CN
Inventors: 张傲阳; 孙黎阳; 何伟; 马茜
Original assignee: Douyin Vision Co Ltd; Lemon Inc Cayman Island
Current assignee: Douyin Vision Co Ltd; Lemon Inc Cayman Island
Priority date: 2022-08-03
Filing date: 2022-08-03
Publication date: 2022-11-04
Anticipated expiration: 2042-08-03
Also published as: CN115297351B

Abstract

The embodiment of the disclosure provides a panoramic video playing method, a panoramic video playing device, a storage medium and electronic equipment. The method comprises the following steps: determining a viewing angle offset of the reset viewing angle relative to the initial default viewing angle in case a viewing angle resetting operation is detected; in the video playing process of the reset visual angle, a video to be played and a rotation vector of the current visual angle relative to the reset visual angle are obtained, the video to be played is processed based on the visual angle offset and the rotation vector, a playing video corresponding to the current visual angle is determined, and the playing video is played. By carrying out offset processing on the obtained panoramic video, the video playing at any visual angle can be supported, and the flexibility of video playing and video watching is improved.

Description

Panoramic video playing method and device, storage medium and electronic equipment

Technical Field

The present disclosure relates to video data processing technologies, and in particular, to a panoramic video playing method and apparatus, a storage medium, and an electronic device.

Background

Viewing panoramic video typically requires professional head-mounted equipment to render the video. The headset is calibrated for viewing angle when it is powered on. After calibration, the origin position is determined, and during the process that the user watches VR (Virtual Reality) video, the video is played based on the origin position and the head twisting direction of the user.

However, the current head-mounted device has poor flexibility after calibration, and cannot support video playing of a user in any posture.

Disclosure of Invention

The disclosure provides a panoramic video playing method, a panoramic video playing device, a storage medium and an electronic device, so as to realize resetting of any visual angle in the playing process of a panoramic video.

In a first aspect, an embodiment of the present disclosure provides a method for playing a panoramic video, including:

determining a viewing angle offset of the reset viewing angle relative to the initial default viewing angle in case a viewing angle resetting operation is detected;

in the video playing process of the reset visual angle, a video to be played and a rotation vector of the current visual angle relative to the reset visual angle are obtained, the video to be played is processed based on the visual angle offset and the rotation vector, a played video corresponding to the current visual angle is determined, and the played video is played.

In a second aspect, an embodiment of the present disclosure further provides a panoramic video playing apparatus, including:

a view offset determination module for determining a view offset of the reset view relative to the initial default view upon detection of a view reset operation;

and the video playing module is used for acquiring a video to be played and a rotation vector of the current visual angle relative to the reset visual angle in the video playing process of the reset visual angle, processing the video to be played based on the visual angle offset and the rotation vector, determining a played video corresponding to the current visual angle, and playing the video.

In a third aspect, an embodiment of the present disclosure further provides an electronic device, where the electronic device includes:

one or more processors;

a storage device to store one or more programs,

when executed by the one or more processors, the one or more programs cause the one or more processors to implement a panoramic video playback method as provided by any embodiment of the present disclosure.

In a fourth aspect, the embodiments of the present disclosure further provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the panoramic video playing method provided in any of the embodiments of the present disclosure.

According to the embodiment of the disclosure, the resetting operation of any angle of the visual angle can be carried out at any time according to the user requirement by detecting the resetting operation of the visual angle, and the visual angle offset of the reset visual angle relative to the initial default visual angle is determined under the condition that the resetting operation of the visual angle input by the user is detected, so that the panoramic video at the initial default visual angle can be converted into the panoramic video at the reset visual angle. And the panoramic video can be played under the condition of resetting the visual angle by storing the visual angle offset. And after finishing the visual angle resetting, continuously playing the panoramic video, and in the process of the panoramic video, carrying out offset processing on each video frame in the panoramic video through the stored visual angle offset so as to carry out video display under the coordinate system where the visual angle is reset. In the video acquisition process, the panoramic video at the initial default visual angle is acquired, a video storage device or devices such as a server and a cloud are not required to be improved, secondary development cost is saved, the acquired panoramic video is subjected to offset processing locally on a wearable device or a control device, video playing at any visual angle can be supported, and the flexibility of video playing and video watching is improved.

Drawings

The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and components are not necessarily drawn to scale.

Fig. 1 is a schematic flowchart of a panoramic video playing method according to an embodiment of the present disclosure;

FIG. 2 is a schematic diagram of an application scenario of an embodiment of the present disclosure;

fig. 3 is a flow chart illustrating a viewing angle resetting process according to an embodiment of the disclosure;

fig. 4 is a schematic flow chart of a view prediction process provided by an embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of a panoramic video playing apparatus according to an embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.

It should be understood that the various steps recited in method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.

It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.

It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.

The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.

Fig. 1 is a schematic flowchart of a panoramic video playing method provided by an embodiment of the present disclosure, where the embodiment of the present disclosure is applicable to a situation where a viewing angle is reset during a playing process of a panoramic video, and the method may be executed by a panoramic video playing apparatus, where the apparatus may be implemented in a form of software and/or hardware, and optionally, implemented by an electronic device such as a VR device. Referring to fig. 2, fig. 2 is a schematic view of an application scenario of the embodiment of the present disclosure. The user watches the panoramic video by wearing the head-mounted device, after the head-mounted device in fig. 2 is calibrated, the front direction shown by the human eyes is the positive direction, and the yaw angle yaw, the pitch angle pitch and the roll angle roll at this time are all 0, that is, the original point position of the head rotation. In this embodiment, the initial calibration angle of view of the head-mounted device may be determined as an initial default angle of view, and based on the initial default angle of view, angle of view resetting at any angle may be performed, and the panoramic video may be played at the reset angle of view.

As shown in fig. 1, the method includes:

s110, in case that the view angle resetting operation is detected, determining a view angle offset amount of the reset view angle with respect to the initial default view angle.

S120, in the video playing process of the reset visual angle, obtaining a video to be played and a rotation vector of the current visual angle relative to the reset visual angle, processing the video to be played based on the visual angle offset and the rotation vector, determining a playing video corresponding to the current visual angle, and playing.

In this embodiment, in the playing process of the panoramic video, the viewing angle resetting operation is detected, and the viewing angle resetting is performed in response to the viewing angle resetting operation. The viewing angle resetting operation may be input by the user, and the input method of the viewing angle resetting operation is not limited. In some embodiments, the viewing angle resetting operation may be input in the form of a key, and for example, a viewing angle resetting key is provided on the head-mounted device or a control device associated with the head-mounted device, where the control device may be an electronic device such as a handle associated with the head-mounted device, and the electronic device is electrically or communicatively connected with the head-mounted device, which is not limited thereto. And inputting the visual angle resetting operation when the visual angle resetting key is detected to be pressed. The processor provided in the head-mounted device or the control device performs the angle-of-view resetting by detecting the angle-of-view resetting operation. In some embodiments, the viewing angle resetting operation may be input by means of gesture collection, for example, a camera is disposed on the head-mounted device or the control device, track information of a preset part of the wearing user is collected, for example, the preset part may include, but is not limited to, a hand, and in a case that the detected track information matches with the preset viewing angle resetting track, it is determined that the viewing angle resetting operation input by the user is detected, wherein the viewing angle resetting track may be preset, and different applying resetting tracks may be preset by different wearers. In some embodiments, the view angle resetting operation may be detected by means of voice capture. For example, a voice collecting device, such as a microphone or a speaker, may be used in the head-mounted device or the control device to collect voice information of the wearing user, and determine that the viewing angle resetting operation is detected in a case that a preset viewing angle resetting keyword is included in the voice information.

In some embodiments, the wearing user may input the viewing angle resetting operation after adjusting the viewing angle, for example, after the user changes from a sitting posture to a supine posture, the viewing angle resetting operation is input through a key, a gesture, or a voice, and accordingly, in the case that the viewing angle resetting key is detected, the head-mounted device or the control device determines the currently detected viewing angle as the resetting viewing angle, that is, a new origin position of the panoramic video playing, and plays the panoramic video based on the new origin position.

In some embodiments, the wearing user may input the viewing angle resetting operation when there is an adjustment requirement, and adjust the viewing angle by adjusting the posture after the data resetting operation is input, for example, when the wearing user stays in a certain posture in a stable state, the viewing angle corresponding to the stable state is the resetting viewing angle. Correspondingly, the wearable device or the control device acquires the visual angle data of the wearable user in real time after detecting the visual angle resetting operation, and determines that the visual angle data is the reset visual angle under the condition that the holding time of any visual angle data is longer than the preset time. Optionally, after the angle of view is determined to be reset, a prompt may be made, for example, in the form of outputting voice or vibrating, which is convenient for the wearing user to determine the accuracy of the angle of view to be reset. Accordingly, the wearing user may input the viewing angle resetting operation again to reset the viewing angle again when it is determined that the angle of view resetting is not accurate according to the prompt, which is not limited.

In some embodiments, the viewing angle resetting operation includes a reset triggering operation and a determination operation of resetting the viewing angle. The resetting triggering operation is used for triggering the head-mounted equipment to carry out the visual angle resetting state, and the visual angle resetting determining operation is used for determining the resetting visual angle. For example, in the playing process of the panoramic video, when the wearing user has a viewing angle resetting requirement, a resetting trigger operation may be input, and after the wearing user determines a new viewing angle by adjusting the gesture, a determination operation for resetting the viewing angle may be input. Accordingly, the head-mounted device or the control device enters the viewing angle resetting state when the resetting triggering operation is detected, and can detect the current viewing angle as the resetting viewing angle when the determining operation of the resetting viewing angle is detected.

In this embodiment, the input modes of the reset triggering operation and the determination operation of the reset viewing angle are not limited, and may be one or more of a voice input mode, a gesture input mode, or a key input mode, for example. For example, the reset trigger operation may be an odd number of pressing operations on the view angle reset key, and the determination operation on the reset view angle may be an even number of pressing operations on the view angle reset key; for example, the reset trigger operation may be a double-click operation on the view angle reset key, and the determination operation on the reset view angle may be a single-click operation on the view angle reset key. For example, the reset triggering operation and the determination operation of the reset visual angle may be gesture input operations of different tracks; for example, the reset triggering operation and the determination operation of the reset perspective may be a voice input operation including different keywords, which is not limited thereto.

It should be noted that, in the time period between the reset triggering operation and the determination operation of the reset view angle, the playing of the panoramic video may be stopped, and the panoramic video continues to be played when the view angle reset is completed; in the time period between the reset triggering operation and the determination operation of the reset visual angle, the panoramic video can be normally played, and the non-interference visual angle reset of the panoramic video is realized.

In some embodiments, the panoramic video playing device is provided with a viewing angle resetting key, where the setting position of the viewing angle resetting key is not limited, and the viewing angle resetting key may be configured on a wearable device of the panoramic video playing device or on a control device such as a handle.

Optionally, detecting a view angle resetting operation includes: and under the condition that the preset triggering operation of the visual angle resetting key is detected, determining the visual angle corresponding to the triggering moment of the visual angle resetting key as the resetting visual angle. A view offset is determined based on the determined reset view and the initial default view. Wherein the initial default viewing angle may be an original viewing angle after calibration of the head-mounted device. Accordingly, a view angle offset of the reset view angle relative to the initial default view angle may be determined based on the initial default view angle and the reset view angle. Illustratively, an initial coordinate system may be constructed based on initializing a default view angle, a reset coordinate system may be created based on a reset application, and a view angle offset may be determined based on the initial coordinate system and the reset coordinate system. In some embodiments, corresponding position coordinates in the initial coordinate system and the reset coordinate system can be determined, and a view angle offset can be determined from at least one set of corresponding coordinates, the view angle offset can convert data in the initial coordinate system to data in the reset coordinate system. In some embodiments, the viewing angle offset may be in a matrix form, which is not limited.

Optionally, detecting a view angle resetting operation includes: entering a visual angle resetting state under the condition that a first trigger operation of the visual angle resetting key is detected; and under the condition that the second trigger operation of the visual angle reset key is detected, determining the visual angle corresponding to the second trigger operation moment as a reset visual angle. The first trigger operation and the second trigger operation may be the same or different, for example, both the first trigger operation and the second trigger operation may be a single pressing operation on the view angle resetting key; for example, the first trigger operation may be a single pressing operation on the view angle resetting key, the second trigger operation may be a double pressing operation on the view angle resetting key, and specific operation forms of the first trigger operation and the second trigger operation are not limited.

In this embodiment, the viewing angle before and after the viewing angle resetting state can be accurately detected by performing the triggering operation on the viewing angle resetting button twice, and the viewing angle offset can be determined based on the viewing angle before and after the viewing angle resetting state. For example, the offset amount of the viewing angle before and after the viewing angle resetting state may be determined as the offset amount of the resetting viewing angle with respect to the initial default viewing angle. Optionally, the viewing angle offset is determined based on corresponding coordinates of the viewing angles before and after the viewing angle resetting state, for example, by means of data fitting.

Optionally, determining a viewing angle offset of the reset viewing angle from the initial default viewing angle comprises: acquiring a first rotation vector of the reset front view angle relative to the initial default view angle and a second rotation vector of the reset rear view angle relative to the initial default view angle; determining a view offset of a reset view relative to an initial default view based on the first rotation vector and the second rotation vector. Specifically, in an initial coordinate system where the initial default view angle is located, the reset previous view angle is determined according to the head coordinate at the detection time of the first trigger operation, and the first rotation vector is determined based on the head coordinate at the detection time of the first trigger operation relative to the origin coordinate. And determining a reset rear view angle according to the head coordinate at the detection moment of the second trigger operation, and determining a second rotation vector based on the head coordinate and the origin coordinate at the detection moment of the second trigger operation. A view offset may be determined based on the first rotation vector and the second rotation vector.

In some embodiments, the viewing angle offset may be determined in a quaternion manner. And determining a first rotation vector in a quaternion form and a second rotation vector in a quaternion form, respectively representing coordinate positions before and after resetting, and determining the view angle offset based on quaternions corresponding to the view angles before and after resetting. In some embodiments, the view offset may be given by multiplying the second rotation vector by the first rotation vector raised to the negative power.

In some embodiments, determining a view offset of a reset view from an initial default view based on the first rotation vector and the second rotation vector comprises: and transmitting the first rotation vector and the second rotation vector into a coordinate conversion interface to obtain the visual angle offset output by the coordinate conversion interface. The coordinate conversion interface may be capable of calling a coordinate conversion rule, and inputting the first rotation vector and the second rotation vector into the coordinate conversion rule to obtain the view angle offset corresponding to the first rotation vector and the second rotation vector. Here, the coordinate conversion rule is not limited, and the coordinate conversion rule may be set in advance to determine the viewing angle offset amount based on the first rotation vector and the second rotation vector. For example, the coordinate conversion rule may be a quaternion-based coordinate conversion rule.

On the basis of the above embodiment, the viewing angle resetting operation includes a single-dimensional resetting operation and a multi-dimensional resetting operation; the single-dimension resetting operation is used for resetting the viewing angle in any dimension, for example, resetting the viewing angle in any dimension of yaw, pitch and roll. In some embodiments, in the case that a one-dimensional resetting operation is detected, a dimension for resetting is determined, and the view angle data after the dimension is reset is determined, and the view angle resetting of the dimension is performed. Specifically, the posture change of the wearing user may be detected, and the changed dimension and the viewing angle data after the dimension is changed may be determined. It should be noted that, in the case of a single-dimensional perspective reset, a change in the perspective of multiple dimensions is detected, and a prompt message may be generated to prompt the user whether to perform the multi-dimensional perspective reset or prompt the user to select a dimension to perform the reset.

The single-dimensional reset operation may be input in the form of a key, voice, gesture, and the like, which is not limited herein. Optionally, different dimensions may correspond to different dimension resetting operations, for example, the resetting key corresponding to each dimension may be preset, and the resetting operation of the dimension is determined to be detected when the resetting key of any dimension is triggered. In the case that a resetting operation of any dimension is detected, by detecting a head coordinate change of a wearing user, the single-dimension angle of view data for resetting is determined to perform the angle of view resetting of the dimension. Optionally, determining a viewing angle offset of the reset viewing angle from the initial default viewing angle comprises: in a single-dimension resetting state, determining a view angle offset formed by a single resetting dimension in a resetting view angle relative to an initial default view angle; the view angle offset may be analyzed in a quaternion manner, or determined through a coordinate conversion interface, which is not limited to this. In the process of determining the view angle offset, offset data corresponding to the dimension which is not reset can be set as a preset value in advance, so that undetermined data in the view angle offset can be reduced, and the calculation amount can be reduced.

The multidimensional resetting operation is used for triggering the resetting of yaw, pitch and roll in at least one dimension, and the multidimensional resetting operation can be input based on voice, keys or gestures, and the like, which is not limited to this. In some embodiments, a single-dimension reset key and a multi-dimension reset key are respectively arranged on the head-mounted device or the control device, wherein the single-dimension reset key can be one or more. And under the condition that the multi-dimensional resetting key is triggered, detecting multi-dimensional resetting operation, detecting the view angle data of each dimension, and determining the resetting view angle. And determining a viewing angle offset based on the reset front viewing angle and the reset rear viewing angle.

Optionally, determining a viewing angle offset of the reset viewing angle from the initial default viewing angle comprises: in a multi-dimensional reset state, a view angle offset of each reset dimension of the reset view angles relative to an initial default view angle is determined. The process of determining the view offset is not described in detail here.

In this embodiment, by detecting the single-dimensional resetting operation and the multi-dimensional resetting operation, the single-dimensional resetting and the multi-dimensional resetting of a targeted viewing angle can be realized, the viewing angle resetting of different requirements of a user is met, and the playing of the panoramic video in any posture is supported.

On the basis of the embodiment, after the visual angle offset of the reset visual angle relative to the initial default visual angle is determined, the visual angle offset of the reset visual angle relative to the initial default visual angle is stored, and the visual angle offset is stored, so that the visual angle offset can be called in real time to convert the video to be played in the playing process of the subsequent panoramic video, the video suitable for the reset visual angle can be obtained, a user can conveniently and normally watch the panoramic video after the visual angle is reset, and the influence of posture change is avoided.

On the basis of the above embodiments, during the playing of the panoramic video, there may be multiple times of view angle resetting, such as a first reset view angle converted from an initial default view angle to a first pose, a second reset view angle converted from the first reset view angle of the first pose to a second pose, and so on. The number of viewing angle resetting is not limited herein. In each view resetting process, determining the view angle offset of the reset view angle relative to the initial default view angle, and replacing the view angle offset of the previous reset view angle based on the view angle offset of the reset view angle relative to the initial default view angle after determining the view angle offset of the reset view angle relative to the initial default view angle, and storing. By replacing the visual angle offset of the previous reset visual angle, the problem of disordered panoramic video conversion when a plurality of visual angle offsets are stored is solved. Optionally, a storage field of the view angle offset is preset, after determining the view angle offset of the reset view angle relative to the initial default view angle, it may be determined whether the storage field is empty, if the storage field is empty, the determined view angle offset is directly stored in the storage field, and if the storage field is not empty, the view angle offset stored in the storage field is replaced based on the determined view angle offset, so as to perform conversion processing on the subsequent panoramic video based on the updated video offset, and ensure normal playing of the panoramic video.

And after the visual angle is reset, playing the panoramic video under the reset visual angle. Specifically, the panoramic video may be obtained from a server or a local cache, and the panoramic video is the panoramic video at the initial default viewing angle. The method comprises the steps of acquiring current head coordinates under the condition that a current visual angle is an initial default visual angle, determining a rotation vector of the current head coordinates relative to an original point position under the initial default visual angle based on the current head coordinates, determining a video area displayed to a wearing user in the panoramic video based on the rotation vector, and rendering the video area.

Under the condition that the current visual angle is the reset visual angle, based on the visual angle offset corresponding to the reset visual angle, the obtained panoramic video is subjected to offset processing based on the time offset, the panoramic video under the coordinate system where the reset visual angle is located is obtained, the current head coordinate is obtained, based on the current head coordinate, under the coordinate system where the reset visual angle is located, the current rotation vector of the reset origin coordinate is determined, the video area displayed to a wearing user in the panoramic video is determined based on the rotation vector, and the video area is rendered.

According to the technical scheme, the angle of view can be reset at any angle at any time according to user requirements by detecting the angle of view resetting operation, the angle of view offset of the reset angle of view relative to the initial default angle of view is determined under the condition that the angle of view resetting operation input by a user is detected, and the panoramic video at the initial default angle of view can be converted into the panoramic video at the reset angle of view. And the panoramic video can be played under the condition of resetting the visual angle by storing the visual angle offset. And after finishing the visual angle resetting, continuously playing the panoramic video, and in the process of the panoramic video, carrying out offset processing on each video frame in the panoramic video through the stored visual angle offset so as to carry out video display under the coordinate system where the visual angle is reset. In the video acquisition process, the panoramic video at the initial default visual angle is acquired, a video storage device or devices such as a server and a cloud are not required to be improved, secondary development cost is saved, the acquired panoramic video is subjected to offset processing locally on a wearable device or a control device, video playing at any visual angle can be supported, and the flexibility of video playing and video watching is improved.

On the basis of the above embodiments, in the playing process of the panoramic video, by detecting the coordinates of the head of the user, the rotation of the angle of the panoramic video can be realized, for example, when the head of the user faces to the front of the corresponding posture of the initial default viewing angle/the reset viewing angle, the video area corresponding to the positive direction in the panoramic video is displayed, and when the head of the user rotates to any direction, correspondingly, the video area corresponding to the rotation angle in the panoramic video is displayed, for example, rotates by 180 degrees, and the video area corresponding to the negative direction in the panoramic video is displayed. Since the panoramic video frame includes video data of 360 degrees in each dimension, the amount of each video frame data is large. In this embodiment, the video area corresponding to the view angle can be acquired based on the predicted view angle by predicting the view angle at the next time, so that the acquired data amount is reduced, the video area at the next time can be acquired in advance, and the video playing process is prevented from being blocked.

The view prediction at the next time depends on the historical view information of the user. In the process of resetting the visual angle, the rotation track of the head of the user comprises a track formed by posture change corresponding to the resetting of the visual angle, and the association degree of the rotation track with the video content and the historical track before the resetting of the visual angle is low. Based on the above technical problem, in this embodiment, different view prediction rules are set, and view prediction is performed in the view resetting state and the non-view resetting state, so as to improve the precision of view prediction.

The method further comprises the following steps: in the visual angle resetting process, calling a first visual angle prediction rule to predict the visual angle at the next moment; after the visual angle is reset, calling a second visual angle prediction rule to predict the visual angle at the next moment; after the view angle is predicted, a data request of the next moment is carried out based on the predicted view angle, and the requested video is played after being received. The first view prediction rule and the second view prediction rule may be preset and are correspondingly provided with status identifiers, for example, the first view prediction rule is provided with a reset status identifier, and the second view prediction module is provided with a non-reset status identifier. And under the condition that the visual angle resetting operation is detected, determining that the visual angle is in a visual angle resetting state, calling a first visual angle prediction rule to perform visual angle prediction, and after the visual angle resetting is completed, calling a second visual angle resetting rule to perform visual angle prediction. The completion of the viewing angle resetting may be after a preset time period of the viewing angle resetting operation is detected, or may be after the determination of the resetting viewing angle, which is not limited thereto. In the embodiment, the visual angle prediction is performed in different states by setting different visual angle prediction rules, so that the visual angle prediction accuracy is improved, and the interference of a head track formed by visual angle adjustment on the visual angle prediction in the visual angle resetting process is avoided.

And acquiring a video area displayed at the next moment through the predicted view angle of the next moment, wherein the video area is a video area corresponding to the predicted view angle. Only the video area corresponding to the predicted visual angle is obtained, the obtained data volume is retrieved, the obtaining efficiency is accelerated, the video data are obtained in a targeted mode, and the obtaining of invalid video data is reduced; the video area for displaying is obtained in advance, and the video playing process is prevented from being blocked.

In some embodiments, the first view prediction rule may be a pre-processing rule including pre-processing the acquired data and a view prediction rule including applying a view prediction to the pre-processed data. Correspondingly, calling a first view prediction rule to perform view prediction at the next moment, including: abnormal point detection is carried out on a head coordinate set of an associated time interval of the view angle resetting operation; and performing visual angle prediction processing on the coordinate set before operation, the coordinate set after operation and the historical viewing hot point coordinate after abnormal point processing based on the first visual angle prediction model to obtain a predicted visual angle after visual angle resetting operation.

In this embodiment, in the non-view angle resetting state, that is, in the case where the view angle is determined, the change of the head coordinate of the wearing user is used to adjust the viewing angle of the panoramic video; in the viewing angle resetting state, changes in head coordinates of the wearing user, including changes in head coordinates during determination of viewing angle resetting, have reduced association with the viewing angle of the panoramic video. Correspondingly, in the view angle resetting state, the head coordinates with poor relevance are removed through the preprocessing rule of the collected data, namely abnormal points in the head coordinate set are removed, and the interference of the change of the head coordinates caused by the view angle resetting is reduced.

In some embodiments, the abnormal point in the head coordinate set may be a head coordinate between an input time including a view angle resetting operation and a determination time of a resetting view angle, wherein the resetting view angle may be determined based on the determination operation of the resetting view angle, or a determination may be made based on a view angle dwell time threshold, which is not limited thereto. And determining the head coordinate between the input moment of the visual angle resetting operation and the determination moment of the reset visual angle as an abnormal point, and rejecting the abnormal point.

In some embodiments, the performing outlier detection on the set of head coordinates of the associated time interval of the view angle reset operation comprises: and inputting the head coordinate group of the associated time interval of the visual angle resetting operation into a detection filtering model, and determining abnormal coordinates. The associated time interval of the viewing angle resetting operation may include a first time period before the viewing angle resetting operation and/or a second time period after the viewing angle resetting operation, wherein durations of the first time period and the second time period may be preset, which is not limited herein. For example, in a case where the viewing angle resetting operation is input after the head of the wearing user is rotated to the direction of resetting the viewing angle, the associated time interval of the viewing angle resetting operation may be a first time period before the viewing angle resetting operation; in a case where the head of the wearing user rotates to the direction of the reset angle of view after the angle of view reset operation is input, the associated time interval of the angle of view reset operation may be a second time period after the angle of view reset operation.

And calling a preset detection filtering model, and inputting the head coordinate set of the associated time interval of the visual angle resetting operation into the detection filtering model to obtain an output result of the model, wherein the output result can be a screened abnormal point, namely an abnormal coordinate. In some embodiments, the processing manner of the abnormal point may include filtering the abnormal point, that is, eliminating the abnormal coordinate from the head coordinate set of the associated time interval of the view resetting operation, so as to reduce interference of the abnormal point on view prediction and improve accuracy of view prediction. In some embodiments, the manner of processing the abnormal point may include dividing a head coordinate set of an associated time interval of the view angle resetting operation into a pre-operation coordinate set and a post-operation coordinate set based on the detected abnormal coordinates, for example, dividing the head coordinate set according to a timestamp of the abnormal coordinates, and illustratively, dividing the head coordinate set into the pre-operation coordinate set and the post-operation coordinate set based on a timestamp of the last abnormal coordinates, the pre-operation coordinate set including coordinate data between a start time of the associated time interval and a timestamp of the last abnormal coordinates, and the post-operation coordinate set including coordinate data between the timestamp of the last abnormal coordinates and an end time of the associated time interval. Illustratively, the first abnormal coordinate is divided into a pre-operation coordinate set and a post-operation coordinate set based on the timestamp of the first abnormal coordinate, the pre-operation coordinate set includes coordinate data from a start time of the associated time interval to a time before the timestamp of the first abnormal coordinate, and the post-operation coordinate set includes coordinate data from the timestamp of the first abnormal coordinate to an end time of the associated time interval.

Correspondingly, the view prediction may be performed by calling the first view prediction model to perform view prediction processing on the filtered pre-operation coordinate set, the filtered post-operation coordinate set, and the historical viewing hotspot coordinate, so as to obtain a predicted view after the view resetting operation. Optionally, the historical viewing hotspot coordinates may be hotspot coordinates in a historical viewing video frame; alternatively, the historical viewing hotspot coordinates may be hotspot coordinates in a video region of the historical viewing. The hot spot coordinates are pre-marked in each video frame in the panoramic video.

Before the view resetting operation is input and after the view resetting is completed, a non-view resetting state in which view prediction can be performed based on the second view prediction rule is in place. There is no outlier in the non-view reset state, and there is no need to perform outlier filtering on the head coordinate set. Optionally, the invoking a second view prediction rule to perform view prediction at the next time includes: and acquiring a coordinate set in a preset time period before the current moment and a historical viewing hot spot coordinate, and performing viewing angle prediction processing on the coordinate set in the preset time period and the historical viewing hot spot coordinate based on a second viewing angle prediction model to obtain a predicted viewing angle.

It should be noted that the first perspective prediction model and the second perspective prediction model may be machine learning models such as neural network models, and the model types and structures of the first perspective prediction model and the second perspective prediction model are not limited. The first view prediction model may be obtained by training sample data acquired in the view resetting process, and the second time prediction model may be obtained by training sample data sampled in the non-view resetting process.

According to the technical scheme, different visual angle prediction rules are set for the visual angle resetting process and the non-visual angle resetting process, visual angle prediction is respectively carried out on the visual angle resetting process and the non-visual angle resetting process, the accuracy of visual angle prediction is improved, video data to be played can be conveniently acquired based on the predicted visual angle, and data blockage in the video playing process is avoided.

On the basis of the above embodiments, the embodiments of the present disclosure also provide a preferred example of a panoramic video playing method. Referring to fig. 3 and fig. 4, fig. 3 is a schematic flowchart of a view resetting process provided in the disclosed embodiment, and fig. 4 is a schematic flowchart of a view predicting process provided in the disclosed embodiment. When a view angle resetting operation (namely, a reset operation) is detected, a rotation vector yb (namely, a first rotation vector) under a default coordinate system at the time of the reset operation is acquired, a rotation vector ya (namely, a second rotation vector) under the default coordinate system at the time of the reset operation is acquired, the first rotation vector and the second rotation vector are transmitted into a coordinate transformation interface, and coordinate transformation is performed on transmitted data based on the coordinate transformation interface to obtain a view angle offset.

Exemplarily, coordinate conversion can be realized through a coordinate conversion mode of a quaternion, a view angle offset q obtained through calculation can be converted into any Euler angle relative to the coordinate conversion based on the Euler angle, a rotation sequence is required to be fixed relative to the conversion mode of the Euler angle, and the quaternion conversion mode has better applicability and flexibility. Illustratively, reset operations are entered at the direction of view angle A (x _1, y _1, z _1, w _1), and then by changing the pose, enabling the headset to be turned, a reset view angle B (x _2, y _2, z _2, w _2) is acquired, where both views A and B are rotation vectors in a default coordinate system relative to the wearing device. And calculating the view angle offset of the view angle B relative to the view angle A in a new coordinate system through a coordinate conversion interface. According to the quaternion rotation multiplication relation, the visual angle offset is q = A ^-1 *B。

After the view angle resetting is completed, the transmitted new coordinates are transmitted into the coordinate conversion interface, relative coordinates in a new coordinate system, namely a relative rotation vector yb in the new coordinate system, are obtained, and the relative coordinates are output to the view angle prediction module and the like to perform subsequent playing operation. Specifically, after the obtained panoramic video is subjected to offset processing by the view angle offset, a video area to be played is determined in the offset panoramic video based on the relative rotation vector yb in the new coordinate system, and the determined video area is rendered and played in the wearable device.

The visual angle prediction depends on the historical visual angle information of a wearing user, the turning direction of the user can shake abnormally before and after the visual angle is reset, the user needs to turn to a new visual angle direction before the visual angle is reset, the association degree of the rotation track and the video content and the previous turning rule is low in the rotation process, the watching angle of the user is changed after the visual angle is reset, the video content and the video content before being reset are discontinuous, and the situation of rapid rotation of the head can occur.

In view of the above problem, referring to fig. 4, in the case where the reset operation is detected, a timestamp of the reset operation is recorded, and the coordinate set is truncated by an outlier detection filtering algorithm (e.g., a detection filtering model) for the head rotation coordinate set before the reset operation. And inputting the coordinate set before the reset, the coordinate set after the reset and the hot spot coordinates of historical viewing of the user as input into a new viewing angle prediction model (such as a first viewing angle prediction model) for viewing angle prediction, and outputting a prediction result after the reset.

Through the change of the rotating coordinate after the visual angle resetting operation, the modules such as the video rendering and the like are insensitive to the visual angle resetting, the influence of the visual angle resetting on other playing modules is solved, the decoupling of the modules such as the visual angle resetting and the video rendering is realized, and the flexibility of the panoramic video playing is increased.

Fig. 5 is a schematic structural diagram of a panoramic video playing apparatus provided in an embodiment of the present disclosure, and as shown in fig. 5, the apparatus includes: a view offset determination module 210 and a video playback module 220.

A view offset determination module 210, configured to determine, in a case that a view resetting operation is detected, a view offset of the reset view from the initial default view;

the video playing module 220 is configured to, in a video playing process of resetting a view angle, acquire a video to be played and a rotation vector of a current view angle relative to the reset view angle, process the video to be played based on the view angle offset and the rotation vector, determine a played video corresponding to the current view angle, and play the video.

According to the technical scheme, the angle of view can be reset at any angle at any time according to user requirements by detecting the angle of view resetting operation, and the angle of view offset of the reset angle of view relative to the initial default angle of view is determined under the condition that the angle of view resetting operation input by a user is detected, so that the panoramic video at the initial default angle of view can be converted into the panoramic video at the reset angle of view. And the panoramic video can be played under the condition of resetting the visual angle by storing the visual angle offset. And after finishing the visual angle resetting, continuously playing the panoramic video, and in the process of the panoramic video, carrying out offset processing on each video frame in the panoramic video through the stored visual angle offset so as to carry out video display under the coordinate system where the visual angle is reset. In the video acquisition process, the panoramic video at the initial default visual angle is acquired, a video storage device or devices such as a server and a cloud are not required to be improved, secondary development cost is saved, the acquired panoramic video is subjected to offset processing locally on a wearable device or a control device, video playing at any visual angle can be supported, and the flexibility of video playing and video watching is improved.

On the basis of the above embodiment, optionally, the view angle offset determining module 210 includes:

a rotation vector acquisition unit for acquiring a first rotation vector of the reset front view angle with respect to the initial default view angle and a second rotation vector of the reset rear view angle with respect to the initial default view angle;

a view offset determination unit to determine a view offset of a reset view from an initial default view based on the first rotation vector and the second rotation vector.

Optionally, the viewing angle offset determining unit is configured to:

and transmitting the first rotation vector and the second rotation vector into a coordinate conversion interface to obtain the visual angle offset output by the coordinate conversion interface.

On the basis of the foregoing embodiment, optionally, the apparatus further includes:

a view offset storage module to store a view offset of a reset view from an initial default view after determining the view offset of the reset view from the initial default view; alternatively, the first and second electrodes may be,

and the view offset updating module is used for replacing the view offset of the previous reset view based on the view offset of the reset view relative to the initial default view after determining the view offset of the reset view relative to the initial default view, and storing the view offset.

On the basis of the above embodiment, optionally, the viewing angle resetting operation includes a resetting triggering operation and a viewing angle resetting determination operation.

On the basis of the above embodiment, optionally, a view angle resetting key is arranged on the panoramic video playing device;

the device also includes:

the reset operation detection module is used for entering a visual angle reset state under the condition that the first trigger operation of the visual angle reset key is detected; and under the condition that the second trigger operation of the visual angle reset key is detected, determining the visual angle corresponding to the second trigger operation moment as a reset visual angle.

On the basis of the foregoing embodiment, optionally, the view angle resetting operation includes a single-dimensional resetting operation and a multi-dimensional resetting operation;

view offset determination module 210 is configured to:

in a single-dimension reset state, determining a view angle offset formed by a single reset dimension in a reset view angle relative to an initial default view angle;

in a multi-dimensional reset state, a view angle offset of each reset dimension of the reset view angles relative to an initial default view angle is determined.

On the basis of the above embodiment, optionally, the apparatus further includes:

the first visual angle prediction module is used for calling a first visual angle prediction rule to carry out visual angle prediction at the next moment in the visual angle resetting process; and (c) a second step of,

the second visual angle prediction module is used for calling a second visual angle prediction rule to predict the visual angle at the next moment after the visual angle is reset;

after the view angle is predicted, performing data request at the next moment based on the predicted view angle, and playing the requested video after receiving the requested video;

on the basis of the foregoing embodiment, optionally, the first view prediction module includes:

the abnormal point filtering unit is used for detecting abnormal points of a head coordinate set of a relevant time interval of the view angle resetting operation;

and the prediction unit is used for carrying out visual angle prediction processing on the coordinate set before operation, the coordinate set after operation and the historical viewing hot point coordinate after the abnormal point processing based on the first visual angle prediction model to obtain a predicted visual angle after visual angle resetting operation.

Optionally, the outlier filtering unit is configured to:

inputting the head coordinate set of the associated time interval of the visual angle resetting operation into a detection filtering model, and determining abnormal coordinates;

filtering the abnormal coordinates in a head coordinate set of an associated time interval of a view angle resetting operation.

The panoramic video playing device provided by the embodiment of the disclosure can execute the panoramic video playing method provided by any embodiment of the disclosure, and has corresponding functional modules and beneficial effects of the execution method.

It should be noted that, the units and modules included in the apparatus are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only used for distinguishing one functional unit from another, and are not used for limiting the protection scope of the embodiments of the present disclosure.

Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. Referring now to fig. 6, a schematic diagram of an electronic device (e.g., the terminal device or the server in fig. 6) 500 suitable for implementing embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

As shown in fig. 6, electronic device 500 may include a processing means (e.g., central processing unit, graphics processor, etc.) 501 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM) 502 or a program loaded from a storage means 508 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data necessary for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504. An editing/output (I/O) interface 505 is also connected to bus 504.

Generally, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 507 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; storage devices 508 including, for example, magnetic tape, hard disk, etc.; and a communication device 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 6 illustrates an electronic device 500 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or installed from the storage means 508, or installed from the ROM 502. The computer program performs the above-described functions defined in the methods of the embodiments of the present disclosure when executed by the processing device 501.

The electronic device provided by the embodiment of the present disclosure and the panoramic video playing method provided by the above embodiment belong to the same inventive concept, and the technical details that are not described in detail in the embodiment can be referred to the above embodiment, and the embodiment and the above embodiment have the same beneficial effects.

The disclosed embodiments provide a computer storage medium on which a computer program is stored, where the program, when executed by a processor, implements the panoramic video playing method provided by the above embodiments.

It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.

The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to:

the computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: determining a viewing angle offset of the reset viewing angle relative to the initial default viewing angle in case a viewing angle resetting operation is detected; in the video playing process of the reset visual angle, a video to be played and a rotation vector of the current visual angle relative to the reset visual angle are obtained, the video to be played is processed based on the visual angle offset and the rotation vector, a playing video corresponding to the current visual angle is determined, and the playing video is played.

Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of a unit does not in some cases constitute a limitation of the unit itself, for example, the first retrieving unit may also be described as a "unit for retrieving at least two internet protocol addresses".

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), complex Programmable Logic Devices (CPLDs), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

At the conclusion of this detailed description, all matter which is claimed to be protected in the claims is to be repeated as follows: "C (B)

According to one or more embodiments of the present disclosure, [ example one ] there is provided a panoramic video playback method, including:

determining a view angle offset of the reset view angle relative to an initial default view angle in case a view angle resetting operation is detected;

in the video playing process of resetting the visual angle, acquiring a video to be played and a rotation vector of the current visual angle relative to the resetting visual angle, processing the video to be played based on the visual angle offset and the rotation vector, determining a playing video corresponding to the current visual angle, and playing the video

According to one or more embodiments of the present disclosure, [ example two ] there is provided a panoramic video playback method, further comprising:

the determining a view angle offset of the reset view angle relative to the initial default view angle comprises: acquiring a first rotation vector of the reset front view angle relative to the initial default view angle and a second rotation vector of the reset rear view angle relative to the initial default view angle; determining a view offset of a reset view relative to an initial default view based on the first rotation vector and the second rotation vector.

According to one or more embodiments of the present disclosure, [ example three ] there is provided a panoramic video playing method, further comprising:

determining a view offset of a reset view relative to an initial default view based on the first rotation vector and the second rotation vector, comprising: and transmitting the first rotation vector and the second rotation vector into a coordinate conversion interface to obtain the visual angle offset output by the coordinate conversion interface.

According to one or more embodiments of the present disclosure, [ example four ] there is provided a panoramic video playback method, further comprising:

after determining the viewing angle offset of the reset viewing angle relative to the initial default viewing angle, further comprising: storing a view offset of the reset view relative to an initial default view; or replacing the view angle offset of the previous reset view angle based on the view angle offset of the reset view angle relative to the initial default view angle, and storing the view angle offset.

According to one or more embodiments of the present disclosure, [ example five ] there is provided a panoramic video playback method, further comprising:

the viewing angle resetting operation includes a resetting triggering operation and a viewing angle resetting determining operation.

According to one or more embodiments of the present disclosure, [ example six ] there is provided a panoramic video playback method, further comprising:

a visual angle resetting key is arranged on the panoramic video playing equipment;

the detecting a view angle resetting operation includes: entering a visual angle resetting state under the condition that a first triggering operation of the visual angle resetting key is detected; and under the condition that the second trigger operation of the visual angle reset key is detected, determining the visual angle corresponding to the second trigger operation moment as a reset visual angle.

According to one or more embodiments of the present disclosure, [ example seven ] there is provided a panoramic video playback method, further comprising:

the view angle resetting operation comprises a single-dimension resetting operation and a multi-dimension resetting operation;

the determining a view angle offset of the reset view angle relative to the initial default view angle comprises: in a single-dimension reset state, determining a view angle offset formed by a single reset dimension in a reset view angle relative to an initial default view angle; in a multi-dimensional reset state, a view angle offset of each reset dimension of the reset view angles relative to an initial default view angle is determined.

According to one or more embodiments of the present disclosure, [ example eight ] there is provided a panoramic video playback method, further comprising:

the method further comprises the following steps: in the visual angle resetting process, calling a first visual angle prediction rule to predict the visual angle at the next moment; after the visual angle is reset, calling a second visual angle prediction rule to predict the visual angle at the next moment; after the view angle is predicted, a data request of the next moment is carried out based on the predicted view angle, and the requested video is played after being received.

According to one or more embodiments of the present disclosure, [ example nine ] there is provided a panoramic video playback method, further comprising:

the invoking of the first view prediction rule to perform view prediction at the next time includes: abnormal point detection is carried out on a head coordinate set of an associated time interval of the view angle resetting operation; and performing visual angle prediction processing on the coordinate group before operation, the coordinate group after operation and the historical viewing hot point coordinate after the abnormal point processing based on the first visual angle prediction model to obtain a predicted visual angle after visual angle resetting operation.

According to one or more embodiments of the present disclosure, [ example ten ] there is provided a panoramic video playback method, further comprising:

the abnormal point detection of the head coordinate set of the associated time interval of the view angle resetting operation includes: inputting the head coordinate set of the associated time interval of the visual angle resetting operation into a detection filtering model, and determining abnormal coordinates; and filtering the abnormal coordinates in the head coordinate set of the associated time interval of the view angle resetting operation.

According to one or more embodiments of the present disclosure, [ example eleven ] there is provided a panoramic video playback apparatus including:

and the video playing module is used for acquiring a video to be played and a rotation vector of the current visual angle relative to the reset visual angle in the video playing process of the reset visual angle, processing the video to be played based on the visual angle offset and the rotation vector, determining a playing video corresponding to the current visual angle, and playing.

The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A panoramic video playing method is characterized by comprising the following steps:

in the video playing process of the reset visual angle, a video to be played and a rotation vector of the current visual angle relative to the reset visual angle are obtained, the video to be played is processed based on the visual angle offset and the rotation vector, a playing video corresponding to the current visual angle is determined, and the playing video is played.

2. The method of claim 1, wherein determining a view offset of the reset view from the initial default view comprises:

acquiring a first rotation vector of the reset front view angle relative to the initial default view angle and a second rotation vector of the reset rear view angle relative to the initial default view angle;

determining a view offset of a reset view relative to an initial default view based on the first rotation vector and the second rotation vector.

3. The method of claim 2, wherein determining a view offset of a reset view from an initial default view based on the first rotation vector and the second rotation vector comprises:

4. The method of claim 1, after determining a view offset of the reset view from the initial default view, further comprising:

storing a view offset of the reset view relative to an initial default view; alternatively, the first and second electrodes may be,

and replacing the view angle offset of the previous reset view angle based on the view angle offset of the reset view angle relative to the initial default view angle, and storing.

5. The method of claim 1, wherein the perspective reset operation comprises a reset trigger operation and a reset perspective determination operation.

6. The method according to claim 5, wherein a view angle resetting button is arranged on the panoramic video playing device;

the detecting a view angle resetting operation includes:

entering a visual angle resetting state under the condition that a first triggering operation of the visual angle resetting key is detected;

and under the condition that the second trigger operation of the visual angle reset key is detected, determining the visual angle corresponding to the second trigger operation moment as a reset visual angle.

7. The method of claim 1, wherein the view angle resetting operations comprise a single-dimensional resetting operation and a multi-dimensional resetting operation;

the determining a view angle offset of the reset view angle relative to the initial default view angle comprises:

in a single-dimension resetting state, determining a view angle offset formed by a single resetting dimension in a resetting view angle relative to an initial default view angle;

8. The method of claim 1, further comprising:

in the visual angle resetting process, calling a first visual angle prediction rule to predict the visual angle at the next moment; and the number of the first and second groups,

after the visual angle is reset, calling a second visual angle prediction rule to predict the visual angle at the next moment;

after the view angle is predicted, a data request of the next moment is carried out based on the predicted view angle, and the requested video is played after being received.

9. The method of claim 8, wherein invoking the first view prediction rule for view prediction at the next time comprises:

abnormal point detection is carried out on a head coordinate set of an associated time interval of the view angle resetting operation;

and performing visual angle prediction processing on the coordinate group before operation, the coordinate group after operation and the historical viewing hot point coordinate after the abnormal point processing based on the first visual angle prediction model to obtain a predicted visual angle after visual angle resetting operation.

10. The method of claim 9, wherein the detecting abnormal points of the head coordinate set of the associated time interval of the view angle resetting operation comprises:

and inputting the head coordinate set of the associated time interval of the visual angle resetting operation into a detection filtering model, and determining abnormal coordinates.

11. A panoramic video playback apparatus, comprising:

12. An electronic device, characterized in that the electronic device comprises:

one or more processors;

a storage device for storing one or more programs,

when executed by the one or more processors, cause the one or more processors to implement the panoramic video playback method of any of claims 1-11.

13. A storage medium containing computer executable instructions for performing the panoramic video playback method of any of claims 1-11 when executed by a computer processor.