WO2017096876A1 - 全景视频的调整方法、装置及移动终端 - Google Patents

全景视频的调整方法、装置及移动终端 Download PDF

Info

Publication number
WO2017096876A1
WO2017096876A1 PCT/CN2016/089240 CN2016089240W WO2017096876A1 WO 2017096876 A1 WO2017096876 A1 WO 2017096876A1 CN 2016089240 W CN2016089240 W CN 2016089240W WO 2017096876 A1 WO2017096876 A1 WO 2017096876A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile terminal
axis
angle
gravity
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/089240
Other languages
English (en)
French (fr)
Inventor
崔世旺
王英杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Le Holdings Beijing Co Ltd
LeTV Information Technology Beijing Co Ltd
Original Assignee
Le Holdings Beijing Co Ltd
LeTV Information Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Le Holdings Beijing Co Ltd, LeTV Information Technology Beijing Co Ltd filed Critical Le Holdings Beijing Co Ltd
Priority to US15/245,048 priority Critical patent/US20170169546A1/en
Publication of WO2017096876A1 publication Critical patent/WO2017096876A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/60—Rotation of whole images or parts thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681—Motion detection
    • H04N23/6812—Motion detection based on additional sensors, e.g. acceleration sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/06—Topological mapping of higher dimensional structures onto lower dimensional surfaces
    • G06T3/073—Transforming surfaces of revolution to planar images, e.g. cylindrical surfaces to planar images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Definitions

  • the present invention relates to the field of mobile terminal technologies, and in particular, to a method, an apparatus, and a mobile terminal for adjusting a panoramic video.
  • the mobile terminal plays the panoramic video
  • the user can adjust the perspective of the panoramic video playback screen according to the touch operation of the mobile terminal or rotate the mobile terminal, and the user uses a virtual reality (VR) device, when the user turns the head,
  • VR virtual reality
  • the gyroscope of the VR device will perceive the rotation and adjust the viewing angle to achieve an immersive feeling.
  • the display screen of the panoramic video is tilted with the tilt of the mobile terminal, the display image cannot be maintained horizontally, and the user is more accustomed to the horizontal viewing angle, and is not accustomed to following the movement of the mobile terminal to adjust the viewing angle, the user Poor experience
  • the embodiment of the invention provides a method and a device for adjusting a panoramic video and a mobile terminal, which are used to solve the problem that when the existing mobile terminal plays the panoramic video, the display screen is tilted with the tilt of the mobile terminal, and the user experience is poor.
  • the embodiment of the invention provides a method for adjusting a panoramic video, which is applied to a mobile terminal, and includes:
  • the angle ⁇ is an angle of the direction of the gravity sensing parameter rotated clockwise to a negative axis of the x-axis; wherein the positive axis direction of the x-axis is a direction in which the center of gravity o is perpendicular to the long side of the mobile terminal and is emitted upward
  • the positive-axis direction of the y-axis is the direction in which the center of gravity o is perpendicular to the wide side of the mobile terminal and is emitted toward the upper portion of the mobile terminal;
  • the positive-axis direction of the z-axis is the direction in which the center of gravity o is emitted toward the direction in which the front surface of the mobile terminal faces
  • the positive axis directions of the x, y, and z axes are determined by the direction in which the front side of the mobile terminal faces the user and the upper portion of the mobile terminal is located
  • the panoramic model of the panoramic video is rotated counterclockwise by a with respect to the negative axis of the x-axis such that the picture of the panoramic video remains horizontal.
  • the embodiment of the present invention further provides a device for adjusting a panoramic video, which is applied to a mobile terminal, and the adjusting device includes:
  • An acquiring module configured to acquire a gravity sensing parameter of the mobile terminal
  • a calculation module configured to calculate an angle ⁇ between a direction of the gravity sensing parameter and a negative axis of the x-axis of the mobile terminal, where the angle ⁇ is a clockwise rotation of the direction of the gravity sensing parameter to the x-axis The angle of the negative axis; wherein the positive axis direction of the x-axis is the direction in which the center of gravity o is perpendicular to the long side of the mobile terminal and is emitted upward; the direction of the positive axis of the y-axis is the center of gravity o moving perpendicular to the wide side of the mobile terminal and moving The direction in which the upper portion of the terminal emits; the positive axis direction of the z-axis is the direction in which the center of gravity o is emitted toward the direction in which the front surface of the mobile terminal faces, and the positive axis directions of the x, y, and z axes are the front faces of the mobile terminal Determining the direction of the user when the upper
  • a rotation module for rotating the panoramic model of the panoramic video counterclockwise by a with respect to the negative axis of the x-axis such that the picture of the panoramic video remains horizontal.
  • an embodiment of the present invention further provides a mobile terminal, where the mobile terminal has the foregoing apparatus.
  • An embodiment of the present invention provides an electronic device, including: one or more processors; a memory for storing processor-executable instructions; wherein the processor is configured to:
  • the angle ⁇ is an angle of a direction in which the gravity sensing parameter rotates clockwise to a negative axis of the x-axis;
  • the positive axis direction of the x-axis is the direction in which the center of gravity o is perpendicular to the long side of the mobile terminal and is emitted upward;
  • the direction of the positive axis of the y-axis is the center of gravity o perpendicular to the wide side of the mobile terminal and is emitted to the upper portion of the mobile terminal.
  • the positive axis direction of the z-axis is the direction in which the center of gravity o is emitted toward the direction in which the front surface of the mobile terminal faces, and the positive-axis directions of the x, y, and z-axes face the user with the front side of the mobile terminal and the mobile terminal
  • the direction of the upper part is determined on the right side;
  • the panoramic model of the panoramic video is rotated counterclockwise by a with respect to the negative axis of the x-axis such that the picture of the panoramic video remains horizontal.
  • the embodiment of the present invention provides a computer readable medium, wherein the computer readable medium may store a program, and when the program is executed, the first aspect of the embodiment of the present invention may provide a part of each implementation manner of the panoramic video adjustment method. All steps.
  • the method and device for adjusting the panoramic video provided by the present invention, after the mobile terminal plays the panoramic video, can keep the picture of the panoramic video horizontal regardless of whether the mobile terminal rotates or not, and avoid the user changing the viewing angle with the tilt of the mobile terminal. , improved user experience.
  • FIG. 1 is a flowchart of steps of a method for adjusting a panoramic video according to Embodiment 1 of the present invention
  • FIG. 2 is a schematic diagram of xyz coordinates of a mobile terminal according to Embodiment 1 of the present invention
  • FIG. 3 is a schematic diagram showing the angle ⁇ between the direction of the gravity-induced acceleration g and the negative axis of the x-axis of the mobile terminal in the first embodiment of the present invention
  • 4(1) to 4(4) are schematic diagrams showing four states of a mobile terminal according to Embodiment 1 of the present invention.
  • FIG. 5 is a schematic structural diagram of a device for adjusting a panoramic video according to Embodiment 2 of the present invention.
  • Figure 6 is a schematic block diagram of an electronic device for performing a method in accordance with an embodiment of the present invention.
  • Fig. 7 schematically shows a storage unit for holding or carrying program code implementing a method according to an embodiment of the invention.
  • the method for adjusting the panoramic video according to the first embodiment of the present invention is applied to the mobile terminal.
  • the mobile terminal in the embodiment of the present invention may be a smart mobile terminal, for example, a smart phone, a tablet computer, or the like.
  • FIG. 1 a flow chart of steps of a method for adjusting a panoramic video in Embodiment 1 of the present invention is shown.
  • Step 100 Acquire a gravity sensing parameter of the mobile terminal.
  • the gravity sensing parameter may be a gravity sensing acceleration g, and the gravity sensing acceleration g may be obtained by a gravity sensing sensor of the mobile terminal.
  • the relevant sensor parameter can also be obtained according to the relevant sensor of the mobile terminal.
  • the gravity sensing parameter in the embodiment of the present invention is one of the sensor parameters.
  • Step 102 Calculate an angle ⁇ between a direction of the gravity sensing parameter and a negative axis of the x-axis of the mobile terminal.
  • the front panel of the mobile terminal has a rectangular shape, and the long side of the front panel is the long side of the mobile terminal, that is, the L side in FIG. 2; the wide side of the front panel is the wide side of the mobile terminal, that is, the W side in FIG. 2; Mobile end The high side of the end is perpendicular to the xoy plane, not shown in FIG.
  • the angle ⁇ between the direction of the gravity-induced acceleration g and the negative axis of the x-axis of the mobile terminal is as shown in FIG. 3, and the angle ⁇ is the angle of the direction of the gravitational acceleration g clockwise to the negative axis of the x-axis.
  • the positive axis direction of the x-axis is the direction in which the center of gravity o is perpendicular to the long side (L) of the mobile terminal and is emitted upward;
  • the direction of the positive axis of the y-axis is the center of gravity o perpendicular to the wide side (W) of the mobile terminal and The direction in which the upper portion of the mobile terminal emits;
  • the positive axis direction of the z-axis is the direction in which the center of gravity o is emitted toward the direction in which the front surface of the mobile terminal faces.
  • the above-mentioned determination of the positive axis directions of the x, y, and z axes is determined in the direction in which the front side of the mobile terminal faces the user and the upper portion of the mobile terminal is located on the right side, as shown in FIG. 2 .
  • the x, y, and z axes rotate correspondingly, but maintain a positional relationship with respect to the mobile terminal.
  • the step 102 may be:
  • the components of the gravitational inductive acceleration g on the x-axis, the y-axis, and the z-axis are determined to be g x , g y , g z , respectively .
  • Step 104 rotating the panoramic model of the panoramic video counterclockwise by a with respect to the negative axis of the x-axis such that the picture of the panoramic video remains horizontal.
  • the mobile terminal plays the panoramic video, regardless of the state of the mobile terminal, it can be compensated by the angle ⁇ .
  • the specific compensation process is as shown in step 104 above.
  • the state of the mobile terminal can also be determined according to the angle ⁇ .
  • the state of the mobile terminal can be divided into four situations, namely a horizontal horizontal screen state, a positive vertical screen state, a reverse horizontal screen state, and an inverted vertical screen state.
  • the mobile terminal when the angle ⁇ satisfies 315° ⁇ 360°, or 0 ⁇ 45°, the mobile terminal is in a landscape orientation state, as shown in FIG. 4(1); when the clip is When the angle ⁇ satisfies 45° ⁇ 135°, the mobile terminal is in a positive vertical screen state as shown in FIG. 4(2); when the angle ⁇ satisfies 135° ⁇ 225°, the movement The terminal is in a reverse horizontal screen state, as shown in FIG. 4 (3); when the angle ⁇ satisfies 225° ⁇ 315°, the mobile terminal is in an anti-vertical state, as shown in FIG. 4(4). .
  • determining an adjustment parameter of the panoramic video After determining the state of the mobile terminal, determining an adjustment parameter of the panoramic video according to a state of the mobile terminal, specifically, when the mobile terminal is in a landscape orientation state, determining that the adjustment parameter of the panoramic video is (+ ⁇ x, + ⁇ y); when the mobile terminal is in a positive vertical screen state, determining an adjustment parameter of the panoramic video is (- ⁇ y, + ⁇ x); when the mobile terminal is in a reverse landscape state, determining the The adjustment parameter of the panoramic video is (- ⁇ x, - ⁇ y); when the mobile terminal is in the anti-vertical state, it is determined that the adjustment parameter of the panoramic video is (+ ⁇ y, - ⁇ x).
  • ⁇ x is a displacement of the center of gravity of the mobile terminal along the x-axis with a change of state of the mobile terminal;
  • ⁇ y is a center of gravity of the mobile terminal o accompanied by a state change of the mobile terminal The displacement on the y-axis.
  • the adjustment direction of the panoramic model of the panoramic video is determined according to the obtained adjustment parameters.
  • the so-called panoramic model is a real-time data model with three-dimensional manipulation capability that is established after processing by using the collected discrete image or continuous video as the basic data. Users can make forward, backward, turn, 360-degree look and other operations in this model, just like entering a space.
  • the technical solution in the embodiment of the present invention acquires the gravity sensing parameter of the mobile terminal after the mobile terminal plays the panoramic video, and calculates the direction of the gravity sensing parameter and the negative axis of the x-axis of the mobile terminal.
  • the angle ⁇ relative to the negative axis of the x-axis, rotates the panoramic model of the panoramic video counterclockwise by ⁇ , so that the picture of the panoramic video remains horizontal, preventing the user from changing with the tilt of the mobile terminal. Change the perspective to improve the user experience.
  • the adjustment direction of the panoramic model is determined by the determined adjustment parameter, and the traditional panoramic video playing process is solved. The problem that occurs in the operation is reversed.
  • a device for adjusting panoramic video according to the second embodiment of the present invention is applied to a mobile terminal.
  • the mobile terminal in the embodiment of the present invention is used to play a panoramic video, and may be a smart mobile terminal, for example, a smart phone, a tablet computer, or the like.
  • the adjusting device may include: an obtaining module 20, a calculating module 22, and a rotating module 24.
  • the obtaining module 20 is configured to acquire a gravity sensing parameter of the mobile terminal.
  • the calculation module 22 is configured to calculate an angle ⁇ between a direction of the gravity sensing parameter and a negative axis of the x-axis of the mobile terminal, where the angle ⁇ is a clockwise rotation of the direction of the gravity sensing parameter to the x-axis The angle of the negative axis.
  • the positive axis direction of the x-axis is the direction in which the center of gravity o is perpendicular to the long side of the mobile terminal and is emitted upward;
  • the direction of the positive axis of the y-axis is the center of gravity o perpendicular to the wide side of the mobile terminal and is emitted to the upper portion of the mobile terminal.
  • the positive axis direction of the z-axis is the direction in which the center of gravity o is emitted toward the direction in which the front surface of the mobile terminal faces, and the positive-axis directions of the x, y, and z-axes face the user with the front side of the mobile terminal and the mobile terminal
  • the direction of the upper part is determined on the right side.
  • the rotation module 24 is configured to rotate the panoramic model of the panoramic video counterclockwise by a with respect to the negative axis of the x-axis such that the picture of the panoramic video remains horizontal.
  • the adjusting device may further include: a state determining module, configured to: after the calculating module 22 calculates an angle ⁇ between a direction of the gravity sensing parameter and a negative axis of the x-axis of the mobile terminal, according to the angle ⁇ determines the state of the mobile terminal.
  • a state determining module configured to: after the calculating module 22 calculates an angle ⁇ between a direction of the gravity sensing parameter and a negative axis of the x-axis of the mobile terminal, according to the angle ⁇ determines the state of the mobile terminal.
  • State determination module when the angle ⁇ satisfies 315 When ° ⁇ 360°, or 0 ⁇ 45°, it is determined that the mobile terminal is in a horizontal screen state; when the angle ⁇ satisfies 45° ⁇ 135°, it is determined that the mobile terminal is in positive a vertical screen state; when the angle ⁇ satisfies 135° ⁇ 225°, determining that the mobile terminal is in a reverse landscape state; when the angle ⁇ satisfies 225° ⁇ 315°, determining the The mobile terminal is in an anti-vertical state.
  • the adjusting device may further include: a parameter determining module, configured to determine, according to the state of the mobile terminal, an adjustment parameter of the panoramic video after the state determining module determines the state of the mobile terminal according to the angle ⁇ .
  • the parameter determining module determines that the adjustment parameter of the panoramic video is (+ ⁇ x, + ⁇ y) when the mobile terminal is in a landscape orientation state; and determines the panorama when the mobile terminal is in a positive vertical screen state.
  • the adjustment parameter of the video is (- ⁇ y, + ⁇ x); when the mobile terminal is in the reverse landscape state, determining that the adjustment parameter of the panoramic video is (- ⁇ x, - ⁇ y); when the mobile terminal is in the reverse In the screen state, the adjustment parameter of the panoramic video is determined to be (+ ⁇ y, - ⁇ x).
  • ⁇ x is a displacement of the center of gravity of the mobile terminal along the x-axis with a change of state of the mobile terminal;
  • ⁇ y is a center of gravity of the mobile terminal o accompanied by a state change of the mobile terminal The displacement on the y-axis.
  • the technical solution in the embodiment of the present invention acquires the gravity sensing parameter of the mobile terminal after the mobile terminal plays the panoramic video, and calculates the direction of the gravity sensing parameter and the negative axis of the x-axis of the mobile terminal.
  • the angle ⁇ relative to the negative axis of the x-axis, rotates the panoramic model of the panoramic video counterclockwise by ⁇ , so that the picture of the panoramic video is kept horizontal, avoiding the user changing the angle of view with the tilt of the mobile terminal, thereby improving the user experience.
  • the adjustment direction of the panoramic model is determined by the determined adjustment parameter, and the traditional panoramic video playing process is solved. The problem that occurs in the operation is reversed.
  • the embodiment of the invention further provides a mobile terminal, which comprises the apparatus for adjusting panoramic video in the above embodiment.
  • the adjustment device and mobile terminal embodiments described above are merely illustrative, wherein the The units described for the separate components may or may not be physically separate, and the components displayed as the units may or may not be physical units, ie may be located in one place, or may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.
  • the various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof.
  • a microprocessor or digital signal processor may be used in practice to implement some or all of the functionality of some or all of the components of an electronic device in accordance with embodiments of the present invention.
  • the invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein.
  • a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.
  • Figure 6 illustrates an electronic device in which an embodiment of the invention may be implemented.
  • the electronic device conventionally includes a processor 610 and a computer program product or computer readable medium in the form of a memory 620.
  • the memory 620 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM.
  • Memory 620 has a memory space 630 for program code 631 for performing any of the method steps described above.
  • the storage space 630 of the program code may include various program codes 631 for implementing various steps in the above methods, respectively.
  • the program code can be read from or written to one or more computer program products.
  • Such computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks.
  • Such a computer program product is typically a portable or fixed storage unit as described with reference to FIG.
  • the storage unit may have a storage section, a storage space, and the like arranged similarly to the storage 620 in the electronic device of FIG.
  • the program code can be compressed, for example, in an appropriate form.
  • the storage unit includes computer readable code 631', ie, code that can be read by a processor, such as 610, that when executed by an electronic device causes the electronic device to perform each of the methods described above step.
  • the electronic device described in the present disclosure may be a variety of handheld terminal devices, such as cell phones, personal digital assistants (PDAs), etc., and thus the scope of protection of the present disclosure should not be limited to a particular type of electronic device.
  • PDAs personal digital assistants
  • the method according to the present disclosure may also be implemented as a computer program executed by a CPU, which may be stored in a computer readable storage medium.
  • the above-described functions defined in the method of the present disclosure are performed when the computer program is executed by the CPU.
  • the method steps and system units described above may also be implemented with a controller and a computer readable storage medium for storing a computer program that causes the controller to implement the steps or unit functions described above.
  • DSPs digital signal processors
  • ASIC dedicated Integrated circuit
  • FPGA field programmable gate array
  • a general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine.
  • the processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
  • a software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
  • An exemplary storage medium is coupled to the processor, such that the processor can read information from or write information to the storage medium.
  • the storage medium can be integrated with a processor.
  • the processor and the storage medium can reside in an ASIC.
  • the ASIC can reside in the user terminal.
  • the processor and the storage medium may reside as discrete components in the user terminal.
  • the functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted as one or more instructions or code on a computer readable medium.
  • Computer readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one location to another.
  • a storage medium may be any available media that can be accessed by a general purpose or special purpose computer.
  • the computer readable medium may comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage device, disk storage device or other magnetic storage device, or may be used to carry or store a form of instructions Or the required program code of the data structure and any other medium that can be accessed by a general purpose or special purpose computer or a general purpose or special purpose processor. Also, any connection is properly termed a computer-readable medium.
  • a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technology such as infrared, radio, and microwave is used to transmit software from a website, server, or other remote source
  • the coaxial line Cables, fiber optic cables, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are all included in the definition of the medium.
  • a magnetic disk and an optical disk include a compact disk (CD), a laser disk, an optical disk, a digital versatile disk (DVD), a floppy disk, a Blu-ray disk, in which a disk generally reproduces data magnetically, and the optical disk optically reproduces data using a laser. . Combinations of the above should also be included within the scope of computer readable media.
  • a person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium.
  • the storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Devices (AREA)

Abstract

一种全景视频的调整方法、装置及移动终端，其中，所述方法应用于移动终端，所述方法包括：获取移动终端的重力感应参数（100）；计算重力感应参数的方向与移动终端的x轴的负轴的夹角α（102），夹角α为重力感应参数的方向沿顺时针旋转到x轴的负轴的角度；相对于x轴的负轴将全景视频的全景模型逆时针旋转α以使得全景视频的画面保持水平（104）。通过上述的方法，全景视频的画面可以始终保持水平，避免用户随着移动终端的倾斜而改变视角，提高了用户体验。

Description

全景视频的调整方法、装置及移动终端
本申请要求在2015年12月11日提交中国专利局、申请号为201510921118.2、发明名称为“全景视频的调整方法、装置及移动终端”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及移动终端技术领域，尤其涉及一种全景视频的调整方法、装置及移动终端。
背景技术
随着智能手机和平板电脑等移动终端的高速增长，带动了移动视频应用的发展，同时全景视频源数量的增加和虚拟现实设备的出现，使得全景视频的播放越来越普及。移动终端播放全景视频时，用户可以根据移动终端的触摸操作或旋转移动终端来调整全景视频播放画面的视角，用户使用头戴式虚拟现实(Virtual Reality，VR)设备，当用户转动头部时，VR设备的陀螺仪会感知到转动，对应调整视角达到身临其境的感觉
目前，在移动终端上观看全景视频时，全景视频的显示画面会随着移动终端的倾斜而倾斜，显示画面不能保持水平，而用户更习惯水平视角，不习惯跟随移动终端转动而调整视角，用户体验差
发明内容
本发明实施例提供一种全景视频的调整方法、装置及移动终端，用以解决的现有的移动终端播放全景视频时，显示画面随着移动终端的倾斜而倾斜，用户体验差的问题。
本发明实施例提供一种全景视频的调整方法，应用于移动终端，包括：
获取所述移动终端的重力感应参数；
计算所述重力感应参数的方向与所述移动终端的x轴的负轴的夹角α， 所述夹角α为所述重力感应参数的方向沿顺时针旋转到x轴的负轴的角度；其中，x轴的正轴方向为重心o向垂直于移动终端的长边并向上发射的方向；y轴的正轴方向为重心o向垂直于移动终端的宽边并向移动终端的上部发射的方向；z轴的正轴方向为重心o朝向移动终端的正面所面对的方向发射的方向，所述x，y，z轴的正轴方向均是以移动终端的正面面对用户且移动终端的上部位于右方时的方向确定的；
相对于所述x轴的负轴将所述全景视频的全景模型逆时针旋转α以使得全景视频的画面保持水平。
相应地，本发明实施例还提供一种全景视频的调整装置，应用于移动终端，所述调整装置包括：
获取模块，用于获取所述移动终端的重力感应参数；
计算模块，用于计算所述重力感应参数的方向与所述移动终端的x轴的负轴的夹角α，所述夹角α为所述重力感应参数的方向沿顺时针旋转到x轴的负轴的角度；其中，x轴的正轴方向为重心o向垂直于移动终端的长边并向上发射的方向；y轴的正轴方向为重心o向垂直于移动终端的宽边并向移动终端的上部发射的方向；z轴的正轴方向为重心o朝向移动终端的正面所面对的方向发射的方向，所述x，y，z轴的正轴方向均是以移动终端的正面面对用户且移动终端的上部位于右方时的方向确定的；
旋转模块，用于相对于所述x轴的负轴将所述全景视频的全景模型逆时针旋转α以使得全景视频的画面保持水平。
相应地，本发明实施例还提供一种移动终端，所述移动终端具有如上所述的装置。
本发明实施例提供一种电子设备，所述电子设备包括：一个或多个处理器；用于存储处理器可执行指令的存储器；其中，所述处理器被配置为：
获取所述移动终端的重力感应参数；
计算所述重力感应参数的方向与所述移动终端的x轴的负轴的夹角α，所述夹角α为所述重力感应参数的方向沿顺时针旋转到x轴的负轴的角度；其中，x轴的正轴方向为重心o向垂直于移动终端的长边并向上发射的方向；y轴的正轴方向为重心o向垂直于移动终端的宽边并向移动终端的上部发射的方向；z轴的正轴方向为重心o朝向移动终端的正面所面对的方向发射的方向，所述x，y，z轴的正轴方向均是以移动终端的正面面对用户且移动终端的上部位于右方时的方向确定的；
相对于所述x轴的负轴将所述全景视频的全景模型逆时针旋转α以使得全景视频的画面保持水平。
本发明实施例提供一种计算机可读介质，其中该计算机可读介质可存储有程序，该程序执行时可实现本发明实施例第一方面提供上述全景视频调整方法的各实现方式中的部分或全部步骤。
本发明提供的全景视频的调整方法、装置及移动终端，在移动终端播放全景视频之后，无论移动终端是否旋转，均可以使得全景视频的画面保持水平，避免用户随着移动终端的倾斜而改变视角，提高了用户体验。
附图说明
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例中所需要使用的附图作一简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本发明实施例一中的一种全景视频的调整方法的步骤流程图；
图2为本发明实施例一中的移动终端的xyz坐标的示意图；
图3为本发明实施例一中的重力感应加速度g的方向与移动终端的x轴负轴的夹角α的示意图；
图4(1)～图4(4)为本发明实施例一中的移动终端的四种状态的示意图；
图5为本发明实施例二中的一种全景视频的调整装置的结构示意图。
图6示意性地示出了用于执行根据本发明实施例的方法的电子设备的框图；以及
图7示意性地示出了用于保持或者携带实现根据本发明实施例的方法的程序代码的存储单元。
具体实施方式
为使本发明的目的、技术方案和优点更加清楚，下面将结合本发明中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
实施例一
详细介绍本发明实施例一提出的一种全景视频的调整方法，应用于移动终端，本发明实施例中的移动终端可以为智能移动终端，例如，智能手机、平板电脑等。
参照图1，示出了本发明实施例一中的一种全景视频的调整方法的步骤流程图。
步骤100，获取所述移动终端的重力感应参数。
本发明实施例中，所述重力感应参数可以为重力感应加速度g，所述重力感应加速度g可以通过所述移动终端的重力感应传感器测量获得。
除获取重力感应参数之外，还可以根据移动终端的相关传感器获得相关的传感器参数，本发明实施例中的重力感应参数为传感器参数中的其中一种。
步骤102，计算所述重力感应参数的方向与所述移动终端的x轴的负轴的夹角α。
其中，移动终端的正面板为长方形状，正面板的长边为移动终端的长边，即图2中L边；正面板的宽边为移动终端的宽边，即图2中的W边；移动终 端的高边垂直于xoy平面，在图2中未示出。重力感应加速度g的方向与移动终端的x轴负轴的夹角α如图3所示，夹角α为重力加速度g的方向沿顺时针旋转到x轴的负轴的角度。其中，x轴的正轴方向为重心o向垂直于移动终端的长边(L)并向上发射的方向；y轴的正轴方向为重心o向垂直于移动终端的宽边(W)并向移动终端的上部发射的方向；z轴的正轴方向为重心o朝向移动终端的正面所面对的方向发射的方向。上述确定x，y，z轴的正轴方向均是以移动终端的正面面对用户且移动终端的上部位于右方时的方向确定的，如图2所示。当移动终端旋转时，x、y、z轴相应旋转，但是保持相对于移动终端的位置关系。
具体地，所述步骤102可以为：
确定重力感应加速度g在x轴、y轴和z轴的分量分别为gx、gy、gz。
当gx＜0且gy≥0时，
Figure PCTCN2016089240-appb-000001
当gx≥0且gy≥0时，
Figure PCTCN2016089240-appb-000002
当gx≥0且gy＜0时，
Figure PCTCN2016089240-appb-000003
当gx＜0且gy＜0时，
Figure PCTCN2016089240-appb-000004
步骤104，相对于所述x轴的负轴将所述全景视频的全景模型逆时针旋转α以使得全景视频的画面保持水平。
当移动终端播放全景视频时，无论移动终端处于何种状态，均可以通过夹角α进行补偿。具体补偿过程如上述步骤104。
在本发明的一个优选的实施例中，当用户在移动终端上观看全景视频时，若需要通过手势操作或者移动终端的陀螺仪对全景视频的视角进行调整，则需要执行以下过程：
在上述步骤102之后，还可以根据所述夹角α确定所述移动终端的状态。
所述移动终端的状态可以分为四种情况，分别为正横屏状态、正竖屏状态、反横屏状态和反竖屏状态。
具体地，当所述夹角α满足315°＜α≤360°，或0≤α≤45°时，所述移动终端处于正横屏状态，如图4(1)所示；当所述夹角α满足45°＜α≤135°时，所述移动终端处于正竖屏状态，如图4(2)所示；当所述夹角α满足135°＜α≤225°时，所述移动终端处于反横屏状态，如图4(3)所示；当所述夹角α满足225°＜α≤315°时，所述移动终端处于反竖屏状态，如图4(4)所示。
在确定移动终端的状态之后，根据所述移动终端的状态确定所述全景视频的调整参数，具体地，当所述移动终端处于正横屏状态时，确定所述全景视频的调整参数为(+Δx，+Δy)；当所述移动终端处于正竖屏状态时，确定所述全景视频的调整参数为(-Δy，+Δx)；当所述移动终端处于反横屏状态时，确定所述全景视频的调整参数为(-Δx，-Δy)；当所述移动终端处于反竖屏状态时，确定所述全景视频的调整参数为(+Δy，-Δx)。
其中，所述Δx为所述移动终端的重心o伴随移动终端的状态改变而在所述x轴上的位移；所述Δy为所述移动终端的重心o伴随移动终端的状态改变而在所述y轴上的位移。
根据得到的调整参数确定全景视频的全景模型的调整方向。所谓全景模型是利用采集的离散图像或连续的视频作为基础数据，经过处理后建立起的具有三维操纵能力的实景数据模型。用户可以在这个模型中进行前进、后退、转弯、360度环视等操作，就如同进入了一个空间一样。
综上所述，本发明实施例中的技术方案，在移动终端播放全景视频之后，获取移动终端的重力感应参数，计算所述重力感应参数的方向与所述移动终端的x轴的负轴的夹角α，相对于x轴的负轴将全景视频的全景模型逆时针旋转α，使得全景视频的画面保持水平，避免用户随着移动终端的倾斜而改 变视角，提高了用户体验。
而且，在全景视频的画面保持水平之后，若用户通过触摸操作或者移动终端的陀螺仪调整全景视频的视角，则利用确定得到的调整参数确定全景模型的调整方向，解决了传统的全景视频播放过程中出现的操作颠倒的问题。
实施例二
详细介绍本发明实施例二提出的一种全景视频的调整装置，应用于移动终端。
参照图5，示出了本发明实施例二中的一种全景视频的调整装置的结构示意图。本发明实施例中的移动终端用于播放全景视频，可以为智能移动终端，例如，智能手机、平板电脑等。
所述调整装置可以包括：获取模块20、计算模块22和旋转模块24。
下面分别详细介绍各模块的功能以及各模块之间的关系。
获取模块20，用于获取所述移动终端的重力感应参数。
计算模块22，用于计算所述重力感应参数的方向与所述移动终端的x轴的负轴的夹角α，所述夹角α为所述重力感应参数的方向沿顺时针旋转到x轴的负轴的角度。其中，x轴的正轴方向为重心o向垂直于移动终端的长边并向上发射的方向；y轴的正轴方向为重心o向垂直于移动终端的宽边并向移动终端的上部发射的方向；z轴的正轴方向为重心o朝向移动终端的正面所面对的方向发射的方向，所述x，y，z轴的正轴方向均是以移动终端的正面面对用户且移动终端的上部位于右方时的方向确定的。
旋转模块24，用于相对于所述x轴的负轴将所述全景视频的全景模型逆时针旋转α以使得全景视频的画面保持水平。
所述调整装置还可以包括：状态确定模块，用于在所述计算模块22计算所述重力感应参数的方向与所述移动终端的x轴的负轴的夹角α之后，根据所述夹角α确定所述移动终端的状态。状态确定模块当所述夹角α满足315 °＜α≤360°，或0≤α≤45°时，确定所述移动终端处于正横屏状态；当所述夹角α满足45°＜α≤135°时，确定所述移动终端处于正竖屏状态；当所述夹角α满足135°＜α≤225°时，确定所述移动终端处于反横屏状态；当所述夹角α满足225°＜α≤315°时，确定所述移动终端处于反竖屏状态。
所述调整装置还可以包括：参数确定模块，用于在所述状态确定模块根据所述夹角α确定所述移动终端的状态之后，根据所述移动终端的状态确定所述全景视频的调整参数。所述参数确定模块当所述移动终端处于正横屏状态时，确定所述全景视频的调整参数为(+Δx，+Δy)；当所述移动终端处于正竖屏状态时，确定所述全景视频的调整参数为(-Δy，+Δx)；当所述移动终端处于反横屏状态时，确定所述全景视频的调整参数为(-Δx，-Δy)；当所述移动终端处于反竖屏状态时，确定所述全景视频的调整参数为(+Δy，-Δx)。
其中，所述Δx为所述移动终端的重心o伴随移动终端的状态改变而在所述x轴上的位移；所述Δy为所述移动终端的重心o伴随移动终端的状态改变而在所述y轴上的位移。
综上所述，本发明实施例中的技术方案，在移动终端播放全景视频之后，获取移动终端的重力感应参数，计算所述重力感应参数的方向与所述移动终端的x轴的负轴的夹角α，相对于x轴的负轴将全景视频的全景模型逆时针旋转α，使得全景视频的画面保持水平，避免用户随着移动终端的倾斜而改变视角，提高了用户体验。
而且，在全景视频的画面保持水平之后，若用户通过触摸操作或者移动终端的陀螺仪调整全景视频的视角，则利用确定得到的调整参数确定全景模型的调整方向，解决了传统的全景视频播放过程中出现的操作颠倒的问题。
本发明实施例还提供了一种移动终端，包括上述实施例中的全景视频的调整装置。
以上所描述的调整装置和移动终端实施例仅仅是示意性的，其中所述作 为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下，即可以理解并实施。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件。基于这样的理解，上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。
本发明的各个部件实施例可以以硬件实现，或者以在一个或者多个处理器上运行的软件模块实现，或者以它们的组合实现。本领域的技术人员应当理解，可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本发明实施例的电子设备中的一些或者全部部件的一些或者全部功能。本发明还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如，计算机程序和计算机程序产品)。这样的实现本发明的程序可以存储在计算机可读介质上，或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到，或者在载体信号上提供，或者以任何其他形式提供。
例如，图6示出了可以实现根据本发明实施例的电子设备。该电子设备传统上包括处理器610和以存储器620形式的计算机程序产品或者计算机可读介质。存储器620可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。存储器620具有用于执行上述方法中的任何方法步骤的程序代码631的存储空间630。例如，用于 程序代码的存储空间630可以包括分别用于实现上面的方法中的各种步骤的各个程序代码631。这些程序代码可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。这些计算机程序产品包括诸如硬盘，紧致盘(CD)、存储卡或者软盘之类的程序代码载体。这样的计算机程序产品通常为如参考图7所述的便携式或者固定存储单元。该存储单元可以具有与图6的电子设备中的存储器620类似布置的存储段、存储空间等。程序代码可以例如以适当形式进行压缩。通常，存储单元包括计算机可读代码631’，即可以由例如诸如610之类的处理器读取的代码，这些代码当由电子设备运行时，导致该电子设备执行上面所描述的方法中的各个步骤。
此外，典型地，本公开所述的电子设备可为各种手持终端设备，例如手机、个人数字助理(PDA)等，因此本公开的保护范围不应限定为某种特定类型的电子设备。
此外，根据本公开的方法还可以被实现为由CPU执行的计算机程序，该计算机程序可以存储在计算机可读存储介质中。在该计算机程序被CPU执行时，执行本公开的方法中限定的上述功能。
此外，上述方法步骤以及系统单元也可以利用控制器以及用于存储使得控制器实现上述步骤或单元功能的计算机程序的计算机可读存储介质实现。
本领域技术人员还将明白的是，结合这里的公开所描述的各种示例性逻辑块、模块、电路和算法步骤可以被实现为电子硬件、计算机软件或两者的组合。为了清楚地说明硬件和软件的这种可互换性，已经就各种示意性组件、方块、模块、电路和步骤的功能对其进行了一般性的描述。这种功能是被实现为软件还是被实现为硬件取决于具体应用以及施加给整个系统的设计约束。本领域技术人员可以针对每种具体应用以各种方式来实现所述的功能，但是这种实现决定不应被解释为导致脱离本公开的范围。
结合这里的公开所描述的各种示例性逻辑块、模块和电路可以利用被设计成用于执行这里所述功能的下列部件来实现或执行：通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或其它可编程逻辑器件、分立门或晶体管逻辑、分立的硬件组件或者这些部 件的任何组合。通用处理器可以是微处理器，但是可替换地，处理器可以是任何传统处理器、控制器、微控制器或状态机。处理器也可以被实现为计算设备的组合，例如，DSP和微处理器的组合、多个微处理器、一个或多个微处理器结合DSP核、或任何其它这种配置。
结合这里的公开所描述的方法或算法的步骤可以直接包含在硬件中、由处理器执行的软件模块中或这两者的组合中。软件模块可以驻留在RAM存储器、快闪存储器、ROM存储器、EPROM存储器、EEPROM存储器、寄存器、硬盘、可移动盘、CD-ROM、或本领域已知的任何其它形式的存储介质中。示例性的存储介质被耦合到处理器，使得处理器能够从该存储介质中读取信息或向该存储介质写入信息。在一个替换方案中，所述存储介质可以与处理器集成在一起。处理器和存储介质可以驻留在ASIC中。ASIC可以驻留在用户终端中。在一个替换方案中，处理器和存储介质可以作为分立组件驻留在用户终端中。
在一个或多个示例性设计中，所述功能可以在硬件、软件、固件或其任意组合中实现。如果在软件中实现，则可以将所述功能作为一个或多个指令或代码存储在计算机可读介质上或通过计算机可读介质来传送。计算机可读介质包括计算机存储介质和通信介质，该通信介质包括有助于将计算机程序从一个位置传送到另一个位置的任何介质。存储介质可以是能够被通用或专用计算机访问的任何可用介质。作为例子而非限制性的，该计算机可读介质可以包括RAM、ROM、EEPROM、CD-ROM或其它光盘存储设备、磁盘存储设备或其它磁性存储设备，或者是可以用于携带或存储形式为指令或数据结构的所需程序代码并且能够被通用或专用计算机或者通用或专用处理器访问的任何其它介质。此外，任何连接都可以适当地称为计算机可读介质。例如，如果使用同轴线缆、光纤线缆、双绞线、数字用户线路(DSL)或诸如红外线、无线电和微波的无线技术来从网站、服务器或其它远程源发送软件，则上述同轴线缆、光纤线缆、双绞线、DSL或诸如红外先、无线电和微波的无线技术均包括在介质的定义。如这里所使用的，磁盘和光盘包括压缩盘(CD)、激光盘、光盘、数字多功能盘(DVD)、软盘、蓝光盘，其中磁盘通常磁性地再现数据，而光盘利用激光光学地再现数据。上述内容的组合也应当包括在计算机可读介质的范围内。
公开的示例性实施例，但是应当注公开的示例性实施例，但是应当注意，在不背离权利要求限定的本公开的范围的前提下，可以进行多种改变和修改。根据这里描述的公开实施例的方法权利要求的功能、步骤和/或动作不需以任何特定顺序执行。此外，尽管本公开的元素可以以个体形式描述或要求，但是也可以设想多个，除非明确限制为单数。
应当理解的是，在本文中使用的，除非上下文清楚地支持例外情况，单数形式“一个”(“a”、“an”、“the”)旨在也包括复数形式。还应当理解的是，在本文中使用的“和/或”是指包括一个或者一个以上相关联地列出的项目的任意和所有可能组合。
上述本公开实施例序号仅仅为了描述，不代表实施例的优劣。
本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成，也可以通过程序来指令相关的硬件完成，所述的程序可以存储于一种计算机可读存储介质中，上述提到的存储介质可以是只读存储器，磁盘或光盘等。
最后应说明的是：以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。

Claims (15)

  1. 一种全景视频的调整方法，其特征在于，应用于移动终端，包括：
    获取所述移动终端的重力感应参数；
    计算所述重力感应参数的方向与所述移动终端的x轴的负轴的夹角α，所述夹角α为所述重力感应参数的方向沿顺时针旋转到x轴的负轴的角度；其中，x轴的正轴方向为重心o向垂直于移动终端的长边并向上发射的方向；y轴的正轴方向为重心o向垂直于移动终端的宽边并向移动终端的上部发射的方向；z轴的正轴方向为重心o朝向移动终端的正面所面对的方向发射的方向，所述x，y，z轴的正轴方向均是以移动终端的正面面对用户且移动终端的上部位于右方时的方向确定的；
    相对于所述x轴的负轴将所述全景视频的全景模型逆时针旋转α以使得全景视频的画面保持水平。
  2. 根据权利要求1所述的方法，其特征在于，所述计算所述重力感应参数的方向与所述移动终端的x轴的负轴的夹角α，包括：
    确定重力感应参数分别在所述x轴、y轴和z轴的分量；所述重力感应参数为重力感应加速度g；
    其中，重力感应加速度g在x轴、y轴和z轴的分量分别为gx、gy、gz。
    当gx＜0且gy≥0时，
    Figure PCTCN2016089240-appb-100001
    当gx≥0且gy≥0时，
    Figure PCTCN2016089240-appb-100002
    当gx≥0且gy＜0时，
    Figure PCTCN2016089240-appb-100003
    当gx＜0且gy＜0时，
    Figure PCTCN2016089240-appb-100004
  3. 根据权利要求1所述的方法，其特征在于，在所述计算所述重力感应参数的方向与所述移动终端的x轴的负轴的夹角α之后，所述方法还包括：
    根据所述夹角α确定所述移动终端的状态。
  4. 根据权利要求3所述的方法，其特征在于，所述根据所述夹角α确定所述移动终端的状态，包括：
    当所述夹角α满足315°＜α≤360°，或0≤α≤45°时，所述移动终端处于正横屏状态；
    当所述夹角α满足45°＜α≤135°时，所述移动终端处于正竖屏状态；
    当所述夹角α满足135°＜α≤225°时，所述移动终端处于反横屏状态；
    当所述夹角α满足225°＜α≤315°时，所述移动终端处于反竖屏状态。
  5. 根据权利要求4所述的方法，其特征在于，在所述根据所述夹角α确定所述移动终端的状态之后，所述方法还包括：
    根据所述移动终端的状态确定所述全景视频的调整参数。
  6. 根据权利要求5所述的方法，其特征在于，所述根据所述移动终端的状态确定所述全景视频的调整参数，包括：
    当所述移动终端处于正横屏状态时，确定所述全景视频的调整参数为(+Δx，+Δy)；
    当所述移动终端处于正竖屏状态时，确定所述全景视频的调整参数为(-Δy，+Δx)；
    当所述移动终端处于反横屏状态时，确定所述全景视频的调整参数为(-Δx，-Δy)；
    当所述移动终端处于反竖屏状态时，确定所述全景视频的调整参数为(+Δy，-Δx)；
    其中，所述Δx为所述移动终端的重心o伴随移动终端的状态改变而在所述x轴上的位移；所述Δy为所述移动终端的重心o伴随移动终端的状态改变而在所述y轴上的位移。
  7. 一种全景视频的调整装置，其特征在于，应用于移动终端，所述调整装置包括：
    获取模块，用于获取所述移动终端的重力感应参数；
    计算模块，用于计算所述重力感应参数的方向与所述移动终端的x轴的负轴的夹角α，所述夹角α为所述重力感应参数的方向沿顺时针旋转到x轴的负轴的角度；其中，x轴的正轴方向为重心o向垂直于移动终端的长边并向上发射的方向；y轴的正轴方向为重心o向垂直于移动终端的宽边并向移动终端的上部发射的方向；z轴的正轴方向为重心o朝向移动终端的正面所面对的方向发射的方向，所述x，y，z轴的正轴方向均是以移动终端的正面面对用户且移动终端的上部位于右方时的方向确定的；
    旋转模块，用于相对于所述x轴的负轴将所述全景视频的全景模型逆时针旋转α以使得全景视频的画面保持水平。
  8. 根据权利要求7所述的装置，其特征在于，所述计算模块确定重力感应参数分别在所述x轴、y轴和z轴的分量；利用所述分量计算所述夹角α；所述重力感应参数为重力感应加速度g；
    其中，重力感应加速度g在x轴、y轴和z轴的分量分别为gx、gy、gz。
    当gx＜0且gy≥0时，
    Figure PCTCN2016089240-appb-100005
    当gx≥0且gy≥0时，
    Figure PCTCN2016089240-appb-100006
    当gx≥0且gy＜0时，
    Figure PCTCN2016089240-appb-100007
    当gx＜0且gy＜0时，
    Figure PCTCN2016089240-appb-100008
  9. 根据权利要求7所述的装置，其特征在于，还包括：
    状态确定模块，用于在所述计算模块计算所述重力感应参数的方向与所 述移动终端的x轴的负轴的夹角α之后，根据所述夹角α确定所述移动终端的状态。
  10. 根据权利要求9所述的装置，其特征在于，所述状态确定模块当所述夹角α满足315°＜α≤360°，或0≤α≤45°时，确定所述移动终端处于正横屏状态；当所述夹角α满足45°＜α≤135°时，确定所述移动终端处于正竖屏状态；当所述夹角α满足135°＜α≤225°时，确定所述移动终端处于反横屏状态；当所述夹角α满足225°＜α≤315°时，确定所述移动终端处于反竖屏状态。
  11. 根据权利要求10所述的装置，其特征在于，还包括：
    参数确定模块，用于在所述状态确定模块根据所述夹角α确定所述移动终端的状态之后，根据所述移动终端的状态确定所述全景视频的调整参数。
  12. 根据权利要求11所述的装置，其特征在于，所述参数确定模块当所述移动终端处于正横屏状态时，确定所述全景视频的调整参数为(+Δx，+Δy)；当所述移动终端处于正竖屏状态时，确定所述全景视频的调整参数为(-Δy，+Δx)；当所述移动终端处于反横屏状态时，确定所述全景视频的调整参数为(-Δx，-Δy)；当所述移动终端处于反竖屏状态时，确定所述全景视频的调整参数为(+Δy，-Δx)；
    其中，所述Δx为所述移动终端的重心o伴随移动终端的状态改变而在所述x轴上的位移；所述Δy为所述移动终端的重心o伴随移动终端的状态改变而在所述y轴上的位移。
  13. 一种移动终端，其特征在于，所述移动终端具有如权利要求7-12所述的装置。
  14. 一种电子设备，其特征在于，所述电子设备包括：
    一个或多个处理器；
    用于存储处理器可执行指令的存储器；
    其中，所述处理器被配置为：
    获取所述电子设备的重力感应参数；
    计算所述重力感应参数的方向与所述电子设备的x轴的负轴的夹角α，所述夹角α为所述重力感应参数的方向沿顺时针旋转到x轴的负轴的角度；其中，x轴的正轴方向为重心o向垂直于电子设备的长边并向上发射的方向；y轴的正轴方向为重心o向垂直于电子设备的宽边并向电子设备的上部发射的方向；z轴的正轴方向为重心o朝向电子设备的正面所面对的方向发射的方向，所述x，y，z轴的正轴方向均是以电子设备的正面面对用户且电子设备的上部位于右方时的方向确定的；
    相对于所述x轴的负轴将所述全景视频的全景模型逆时针旋转α以使得全景视频的画面保持水平。
  15. 一种计算机可读介质，其中所述计算机存储介质存储有程序，该程序执行时可实现如权利要求1-6中任一项所述的方法。
PCT/CN2016/089240 2015-12-11 2016-07-07 全景视频的调整方法、装置及移动终端 Ceased WO2017096876A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/245,048 US20170169546A1 (en) 2015-12-11 2016-08-23 Method and electronic device for adjusting panoramic video

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510921118.2A CN105975172A (zh) 2015-12-11 2015-12-11 全景视频的调整方法、装置及移动终端
CN201510921118.2 2015-12-11

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/245,048 Continuation US20170169546A1 (en) 2015-12-11 2016-08-23 Method and electronic device for adjusting panoramic video

Publications (1)

Publication Number Publication Date
WO2017096876A1 true WO2017096876A1 (zh) 2017-06-15

Family

ID=56988380

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/089240 Ceased WO2017096876A1 (zh) 2015-12-11 2016-07-07 全景视频的调整方法、装置及移动终端

Country Status (3)

Country Link
US (1) US20170169546A1 (zh)
CN (1) CN105975172A (zh)
WO (1) WO2017096876A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106507094B (zh) * 2016-10-31 2019-01-04 北京疯景科技有限公司 校正全景视频显示视角的方法及装置
CN106534827B (zh) * 2016-12-19 2018-03-02 暴风集团股份有限公司 基于用户视角播放全景视频的方法及系统
CN107168691A (zh) * 2017-03-30 2017-09-15 武汉斗鱼网络科技有限公司 一种视频屏幕旋转方法和装置
CN111954003A (zh) * 2019-05-17 2020-11-17 阿里巴巴集团控股有限公司 全景视频播放方法以及装置
CN112015316A (zh) * 2019-12-17 2020-12-01 点真互联网科技(上海)有限公司 全景图片展示及调整方法、系统、设备和存储介质
CN112464383B (zh) * 2020-12-08 2023-07-18 安徽江淮汽车集团股份有限公司 传动轴结构及其调节方法以及汽车和存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638656A (zh) * 2012-04-18 2012-08-15 青岛海信移动通信技术股份有限公司 一种视频图像处理方法及装置
CN103581560A (zh) * 2013-11-01 2014-02-12 广东欧珀移动通信有限公司 一种移动终端的拍照处理方法和系统
CN103873693A (zh) * 2014-03-24 2014-06-18 惠州Tcl移动通信有限公司 根据重力加速度自动校正照片拍摄角度的方法及移动终端
US20150042556A1 (en) * 2013-01-11 2015-02-12 Dongguan Goldex Communication Technology Co., Ltd. Method for controlling rotation of screen picture of terminal, and terminal

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006217478A (ja) * 2005-02-07 2006-08-17 Sony Ericsson Mobilecommunications Japan Inc 画像撮影装置及び画像撮影方法
CN102695034A (zh) * 2012-05-30 2012-09-26 青岛海信移动通信技术股份有限公司 在可视通话中调整视频图像在对端显示的方法及装置
CN104021585B (zh) * 2014-06-09 2017-04-26 苏州明日吉辰软件研发有限公司 基于真实场景的三维展示方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638656A (zh) * 2012-04-18 2012-08-15 青岛海信移动通信技术股份有限公司 一种视频图像处理方法及装置
US20150042556A1 (en) * 2013-01-11 2015-02-12 Dongguan Goldex Communication Technology Co., Ltd. Method for controlling rotation of screen picture of terminal, and terminal
CN103581560A (zh) * 2013-11-01 2014-02-12 广东欧珀移动通信有限公司 一种移动终端的拍照处理方法和系统
CN103873693A (zh) * 2014-03-24 2014-06-18 惠州Tcl移动通信有限公司 根据重力加速度自动校正照片拍摄角度的方法及移动终端

Also Published As

Publication number Publication date
US20170169546A1 (en) 2017-06-15
CN105975172A (zh) 2016-09-28

Similar Documents

Publication Publication Date Title
CN110495166B (zh) 一种计算机实现的方法、计算装置以及可读存储介质
CN113806036B (zh) 虚拟内容的输出
US9972134B2 (en) Adaptive smoothing based on user focus on a target object
US10037626B2 (en) Interaction with virtual objects based on determined restrictions
WO2017096876A1 (zh) 全景视频的调整方法、装置及移动终端
US9996953B2 (en) Three-dimensional annotation facing
JP6408019B2 (ja) 画像デバイスにおける写真構図および位置ガイダンス
JP5269972B2 (ja) 電子機器及び三次元モデル生成支援方法
CN112286343A (zh) 定位追踪方法、平台及头戴显示系统
US10969949B2 (en) Information display device, information display method and information display program
US10264186B2 (en) Dynamic control of camera resources in a device with multiple displays
US8826191B1 (en) Zooming while page turning in document
US20140071349A1 (en) Method, apparatus, and computer program product for changing a viewing angle of a video image
US20140354784A1 (en) Shooting method for three dimensional modeling and electronic device supporting the same
WO2019192061A1 (zh) 图形码的识别及生成方法、装置及计算机可读存储介质
CN110677586A (zh) 图像显示方法、图像显示装置及移动终端
CN104580967A (zh) 一种基于便携式投影仪的地图投影方法和用于投影的装置
WO2021073204A1 (zh) 对象的显示方法、装置、电子设备及计算机可读存储介质
US20150029351A1 (en) Display method, image capturing method and electronic device
CN109472873B (zh) 三维模型的生成方法、装置、硬件装置
US20230161848A1 (en) Manipulation of a persistent display of shared content
US20170302863A1 (en) Spatial detection devices and systems
CN110070600B (zh) 三维模型的生成方法、装置、硬件装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16872076

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16872076

Country of ref document: EP

Kind code of ref document: A1