WO2016107063A1 - 一种多摄像头终端的3d文件制作、播放方法及装置 - Google Patents

一种多摄像头终端的3d文件制作、播放方法及装置 Download PDF

Info

Publication number
WO2016107063A1
WO2016107063A1 PCT/CN2015/080328 CN2015080328W WO2016107063A1 WO 2016107063 A1 WO2016107063 A1 WO 2016107063A1 CN 2015080328 W CN2015080328 W CN 2015080328W WO 2016107063 A1 WO2016107063 A1 WO 2016107063A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
terminal
images
playback
angle
Prior art date
Application number
PCT/CN2015/080328
Other languages
English (en)
French (fr)
Inventor
高秀文
吴炽强
Original Assignee
宇龙计算机通信科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宇龙计算机通信科技(深圳)有限公司 filed Critical 宇龙计算机通信科技(深圳)有限公司
Publication of WO2016107063A1 publication Critical patent/WO2016107063A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof

Definitions

  • the present invention relates to the field of communications, and in particular, to a 3D file creation and playing method and apparatus for a multi-camera terminal.
  • 3D (three-dimensiona, three-dimensional graphics) display technology is becoming more and more mature, and 3D display of mobile terminal or smart TV can be realized by chromatic aberration 3D technology, shutter 3D technology and polarized 3D technology.
  • Current 3D displays generally employ a method of displaying the same 3D content based on different viewer perspectives, such that when the viewer's eyes move relative to the position of the playback device, or if the playback device changes relative to the viewer's position, For example, when a user views a 3D video through a mobile terminal, the user's location moves or the user rotates the terminal, which may cause a distortion or unclearness of the screen viewed by the user due to a change in the user's perspective, affecting the user experience.
  • the invention provides a 3D file creation and playing method and device for a multi-camera terminal, which is used to solve the problem that the relative position of the playback terminal and the viewer changes during the playback of the 3D file in the prior art, and the screen viewed by the user is distorted. Clear question.
  • a method for fabricating a 3D file of a multi-camera terminal includes: capturing a plurality of pairs of images using a first camera and a second camera of the terminal; and determining a playback angle corresponding to each pair of images in the plurality of pairs of images, A plurality of pairs of images are sequentially stored in accordance with the size of the playback angle of each pair of images to obtain a three-dimensional graphics 3D file.
  • using the two cameras of the terminal to capture a plurality of pairs of images comprising: capturing a plurality of pairs of images at equal position shooting angles based on the current shooting object at the same position; determining corresponding playback of each pair of images in the plurality of pairs of images
  • the viewing angle stores a plurality of pairs of images in order of the size of the playback angle of each pair of images, including: determining a shooting angle of view of the image as a viewing angle of the image, and sequentially storing the images according to the size of the shooting angle of the image.
  • the two cameras of the terminal are used to capture multiple pairs of images, including: shooting at different positions based on the current framing object, and obtaining multiple pairs of images; determining a playback angle corresponding to each image in the plurality of pairs of images, according to the playback angle of each pair of images
  • the size sequence sequentially stores a plurality of pairs of images, including: prescribing a pair of images in a pair of images to have a normal viewing angle, taking a plurality of viewing angles on both sides of the positive viewing angle, and agreeing on images corresponding to the plurality of viewing angles, according to the viewing angle of the image.
  • the size of the order stores the image.
  • a method for playing a 3D file includes: playing a 3D image according to a correspondence between a pre-stored 3D image and a playback angle; and detecting a change in a relative position of the human eye and the terminal before detecting the terminal At the time, the 3D image to be played is determined according to the change relationship of the relative positions, and the determined 3D image is played.
  • determining the currently played 3D image according to the change relationship of the relative position including: when detecting the movement of the human eye before the terminal relative to the terminal, according to The direction of movement of the human eye determines the currently playing 3D image.
  • determining the currently played 3D image according to the moving direction of the human eye includes: acquiring the left eye of the terminal and the positive angle of the right eye corresponding to the terminal a first difference and a second difference; determining a moving direction of the current human eye relative to the terminal according to the magnitude relationship of the first difference and the second difference, determining a viewing angle of the image to be played according to the moving direction; according to the to-be-played
  • the angle of view of the image is called from the image correspondingly stored in advance according to the playback angle of view, and the called image is played.
  • determining the currently played 3D image according to the change relationship of the relative position including: when detecting that the terminal rotates, determining the to-be-received angle according to the terminal rotation
  • the playback angle corresponding to the playback image is called, and the corresponding image is called from the image correspondingly stored in accordance with the playback perspective according to the playback perspective of the image to be played, and the called image is played.
  • the shooting module includes: a shooting module, configured to capture a plurality of pairs of images at a same position based on a current shooting object at an equal shooting angle; the storage module is configured to determine a shooting angle of the image as a viewing angle of the image, according to the image The size of the shooting angle of view is stored in order.
  • the shooting module comprises: a shooting module, configured to perform shooting at different positions based on the current framing object, and obtain a plurality of pairs of images; the storage module is configured to stipulate that a pair of playing angles of the pair of images is a positive viewing angle, A plurality of playback angles are taken on both sides of the viewing angle, and images corresponding to the plurality of playback angles are agreed, and the images are sequentially stored according to the size of the playback perspective of the images.
  • a 3D file playback apparatus including: a playback module, configured to play a 3D image according to a correspondence between a pre-stored 3D image and a playback perspective; and a determining module, configured to detect the terminal before When the relative position of the human eye and the terminal changes, the 3D image to be played is determined according to the change relationship of the relative position, and the determined 3D image is played.
  • the determining module is configured to determine the currently played 3D image according to the moving direction of the human eye when detecting the movement of the human eye relative to the terminal before the terminal.
  • the determining module includes: an acquiring unit, configured to acquire a first difference and a second difference between a left eye of the terminal and a positive view of the right eye and the terminal; and a determining unit, configured to use, according to the first difference, Determining a magnitude relationship of the second difference, determining a moving direction of the current human eye relative to the terminal, determining a viewing angle of the image to be played according to the moving direction; and calling the corresponding image from the image correspondingly stored according to the playback viewing angle according to the perspective of the image to be played. And play the called image.
  • the determining module is configured to: when detecting that the terminal rotates, determine a play angle corresponding to the image to be played according to the angle of rotation of the terminal, and call the corresponding image from the image correspondingly stored according to the play angle according to the play perspective of the image to be played. And play the called image.
  • the 3D images are sequentially stored according to the size of the playback viewing angle, so that the images in the created 3D file can be played according to the playback angle of view, and then, when the 3D file is played, the viewing can be performed according to the viewing angle.
  • the change of the relative position of the terminal and the terminal adjusts the currently played 3D image. Therefore, even when the position of the viewer and the terminal changes, the 3D file can be played according to the viewing angle of the viewer, ensuring the viewer and the viewer.
  • FIG. 1 is a flowchart of a method for creating a 3D file according to Embodiment 1 of the present invention
  • FIG. 2 is a flowchart of a 3D file playing method according to Embodiment 2 of the present invention.
  • FIG. 3 is a schematic diagram showing changes in relative positions of a human eye and a terminal when the terminal is fixed and the human eye moves in the second embodiment of the present invention
  • FIG. 4 is a schematic diagram of capturing a 3D image at different positions in Embodiment 3 of the present invention.
  • Figure 5 is a block diagram showing the structure of a 3D file creating apparatus according to a fourth embodiment of the present invention.
  • Fig. 6 is a block diagram showing the structure of a 3D file playback apparatus according to a fifth embodiment of the present invention.
  • FIG. 1 is a flowchart of a method for creating a 3D file of a multi-camera terminal according to Embodiment 1 of the present invention. As shown in FIG. 1, the method includes the following steps:
  • Step 101 The first camera and the second camera of the terminal are used to capture multiple pairs of images.
  • the difference in shooting angle between the two cameras is equal to the difference in viewing angle between the two eyes.
  • two or more groups may be used. a camera to shoot;
  • the two cameras of the terminal may preferably be located on the same side of the terminal, for example, two side-by-side cameras that may be the rear side of the mobile terminal, or two cameras that are side by side on other photographing devices.
  • Step 102 Determine a playback angle corresponding to each pair of images in the plurality of pairs of images, and store the plurality of pairs of images in order of the size of the playback perspective of each pair of images to obtain a three-dimensional graphics 3D file.
  • a plurality of pairs of images are sequentially stored according to the size of the playback view angle of each pair of images, that is, corresponding to the size of the playback view angle of each pair of images, each pair of images is sequentially stored, and each pair of images corresponds to a playback angle.
  • the play angle corresponding to each pair of images is an angle of a view angle at which the pair of images is played when the 3D file is played.
  • Method 1 shooting multiple pairs of images at the same position based on the current shooting object at the same angle of shooting; determining a playing angle corresponding to each pair of images in the pair of images, storing a plurality of pairs of images in order of the size of the playing angle of each pair of images, including: The photographing angle of view of the image is determined as the playback angle of view of the image, and the images are stored in order of the size of the photographing angle of view of the image.
  • Method 2 based on the framing object, shooting at different positions, obtaining a plurality of pairs of images; determining a playback angle corresponding to each image in the plurality of pairs of images, storing a plurality of pairs of images in order of the size of the playback perspective of each pair of images, including:
  • the playback angle of the pair of images is a positive viewing angle, and a plurality of playback viewing angles are taken on both sides of the positive viewing angle, and images corresponding to the plurality of playback viewing angles are agreed, and the images are sequentially stored according to the size of the playback viewing angle of the image.
  • the embodiment provides a method for playing a 3D file.
  • the method can be used to play the 3D file created in the manner of the first embodiment. Therefore, the storage manner of the image based on the 3D file can be the same as that of the first embodiment.
  • FIG. 2 is a flowchart of a 3D file playing method according to Embodiment 2 of the present invention. As shown in FIG. 2, the method includes the following steps:
  • Step 201 Play a 3D image according to a correspondence between a pre-stored 3D image and a playback angle of view;
  • the 3D image in this embodiment may be an image produced in accordance with the 3D image producing method in the above-described Embodiment 1. Therefore, the 3D image here may be stored in advance according to the size relationship of the specified playback angle of view, and the specific storage manner may be saved after the 3D image is captured in the above Embodiment 1.
  • the storage method is the same and will not be described here.
  • this step 201 when the image is played, the corresponding image is called according to the angle of view corresponding to the image for playing.
  • Step 202 When it is detected that the relative position of the human eye and the terminal before the terminal changes, the 3D image to be played is determined according to the change relationship of the relative position, and the determined 3D image is played.
  • the change of the relative position of the terminal and the front human eye of the terminal may specifically include: a relative position change caused by the movement of the viewer before the terminal relative to the movement of the terminal, or a change of the relative position caused by the movement or rotation of the terminal itself.
  • the playback of the 3D file is as follows:
  • determining the currently played 3D image according to the change relationship of the relative position including: when detecting the movement of the human eye before the terminal relative to the terminal, according to The moving direction of the human eye determines the currently playing 3D image.
  • the step of determining the currently played 3D image according to the moving direction of the human eye may specifically include the following processing.
  • the moving direction determines the angle of view of the image to be played according to the moving direction; calls the corresponding image from the image correspondingly stored in advance according to the playing angle according to the angle of view of the image to be played, and plays the called image.
  • determining the currently played 3D image according to the change relationship of the relative position including: when detecting that the terminal rotates, determining the to-be-received angle according to the terminal rotation
  • the playback angle corresponding to the playback image is called, and the corresponding image is called from the image correspondingly stored in accordance with the playback perspective according to the playback perspective of the image to be played, and the called image is played.
  • the measurement of the viewing angle (ie, the viewing angle) of the user may be specifically performed in the following two manners:
  • a and B are the left and right eyes of the front viewer of the terminal
  • a 1 and B 1 are the images formed by the left and right eyes on the camera sensor
  • d is the focal length of the camera
  • L is the distance between the left eye image point and the central axis of the camera
  • R is the right The distance from the eye point to the center axis of the camera.
  • the focal length of the camera d terminal itself can be known
  • L, R is calculated by the terminal background software, and then the difference ⁇ L, ⁇ R between the left and right eyes and the positive viewing angle is obtained by solving the inverse trigonometric function.
  • the terminal gyro When the viewer's human eye is fixed in front of the terminal and the terminal moves, the terminal gyro automatically perceives the terminal rotation angle to obtain the user viewing angle (angle of view) ⁇ ( ⁇ with sign).
  • the background calls a certain pair of images corresponding to the viewing angle according to the user's viewing angle (viewing angle) ⁇ according to the previous corresponding rule, and displays the 3D image on the display screen, thereby realizing different viewing angles to display different 3D content.
  • This embodiment uses a specific example to elaborate the 3D file creation method and the modulation method:
  • the two left and right cameras of the terminal simultaneously take two photos or video files (P L1 , P R1 ), wherein the difference in viewing angle between the two cameras is equal to the difference in viewing angle between the two eyes;
  • FIG. 4 is a schematic diagram of taking a 3D image at different positions according to Embodiment 3 of the present invention. As shown in FIG. 4, two cameras C and D of the terminal respectively photograph the object at different positions to obtain (P R1 , P L1 ). ), (P R2 , P L2 ) and (P R3 , P L3 ) three pairs of images.
  • the obtained image may be modulated by any of the following methods:
  • the picture content of the captured (P Ln , P Rn ) picture is modulated by red and blue light, respectively.
  • the content of the P Ln picture that is, the image content captured by the left camera is modulated with red light
  • the content of the P Rn picture that is, the image taken by the right camera is modulated with red light
  • the modulated picture is merged into one picture
  • the receiving end can use a pair of red and blue glasses to receive the corresponding picture to view.
  • the image in the time slot is sent (P Ln , P Rn ), the receiving end uses the active LCD (Liquid Crystal Display) shutter glasses, and the timing is alternately switched by the transmitting end.
  • the left and right eyes of the left and right eyes allow the two images seen by the left and right eyes to be integrated into the viewer's brain to realize 3D image display.
  • the time interval of the alternating time interval T is: (t0 ⁇ 0.02s).
  • the images in the captured (P Ln , P Rn ) are respectively modulated into polarized light of different angles and simultaneously transmitted, and the viewer at the receiving end wears polarized glasses corresponding to the polarization angles of the left and right eyes. After filtering separately, different images seen by the viewer's left and right eyes are integrated into the brain to realize 3D image display.
  • FIG. 5 is a structural block diagram of a 3D file creation device according to Embodiment 4 of the present invention.
  • the device 50 may specifically include
  • the imaging module 51 is configured to capture a plurality of pairs of images by using the first camera and the second camera of the terminal.
  • the difference in shooting angle between the two cameras The angle of view difference between the eyes and the eyes of the person is equal; specifically, two or more groups may be used for shooting, and the storage module 52 is configured to determine a playback angle corresponding to each pair of images in the pair of images, according to the size of the playback angle of each pair of images. Store multiple pairs of images in sequence to get 3D graphics 3D files.
  • the photographing module 51 may specifically include: a photographing module, configured to photograph a plurality of pairs of images at a same position based on a current photographing object at an equal difference photographing angle; and a storage module configured to determine a photographing angle of view of the image as a view angle of the image, The images are stored in order of size of the angle of view of the image.
  • the photographing module 51 may specifically include: the photographing module is configured to perform photographing at different positions based on the current viewfinder object to obtain a plurality of pairs of images; and the storage module is configured to: appoint a pair of play angles of the plurality of pairs of images as a positive view A plurality of playback angles are taken on both sides of the positive viewing angle, and images corresponding to the plurality of playback angles are agreed, and the images are sequentially stored according to the size of the playback perspective of the images.
  • FIG. 6 is a structural block diagram of a 3D file playback apparatus according to Embodiment 5 of the present invention.
  • the apparatus 60 includes the following components: a playback module 61, configured to play according to a correspondence between a pre-stored 3D image and a playback perspective.
  • the 3D image determining module 62 is configured to determine a 3D image to be played according to a change relationship of the relative position when the relative position of the human eye and the terminal before the terminal is changed, and play the determined 3D image.
  • the determining module 62 is specifically configured to determine the currently played 3D image according to the moving direction of the human eye when detecting the movement of the human eye relative to the terminal before the terminal.
  • the determining module 62 may specifically include: an acquiring unit, configured to acquire a first difference and a second difference between a left eye of the terminal and a positive view of the right eye and the terminal; and a determining unit, configured to be used according to the first Determining a magnitude relationship between the difference and the second difference, determining a moving direction of the current human eye relative to the terminal, determining a viewing angle of the image to be played according to the moving direction; and selecting an image corresponding to the playback angle according to the viewing angle of the image to be played. Call the corresponding image and play the called image.
  • the determining module 62 is specifically configured to: when detecting that the terminal rotates, determine a play angle corresponding to the image to be played according to the angle of rotation of the terminal, according to a playback perspective of the image to be played.
  • the corresponding image is called from the image correspondingly stored in advance according to the playback angle, and the called image is played.
  • the 3D images are sequentially stored according to the size of the playback viewing angle, so that the images in the created 3D file can be played according to the playback angle of view, and then, when the 3D file is played, the viewing can be performed according to the viewing angle.
  • the relative position of the terminal and the terminal are changed, and the currently played 3D image is adjusted. Therefore, even when the position of the viewer and the terminal changes, the 3D file can be played according to the viewing angle of the viewer, and the different viewing angles are displayed differently.
  • the purpose of the 3D picture content ensures the clarity of the picture when the position of the viewer and the terminal changes, so that the user can view different image effects at different viewing angles, thereby improving the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

本发明提供一种多摄像头终端的3D文件制作、播放方法及装置，用以解决现有技术中在3D文件播放过程中，播放终端与观看者相对位置发生改变时导致用户观看到的画面出现扭曲不清晰的问题，其中，多摄像头终端的3D文件制作方法包括：使用终端的第一摄像头以及第二摄像头拍摄多对图像；确定多对图像中各对图像对应的播放视角，按照各对图像的播放视角的大小顺序存储多对图像，得到三维图形3D文件，该方案实现了不同视角显示不同3D画面内容的目的。

Description

一种多摄像头终端的3D文件制作、播放方法及装置
本申请要求于2014年12月31日提交中国专利局，申请号为CN 201410856590.8、发明名称为“一种多摄像头终端的3D文件制作、播放方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及通讯领域，特别是涉及一种多摄像头终端的3D文件制作、播放方法及装置。
背景技术
目前，3D(three-dimensiona，三维图形)显示技术日趋成熟，色差式3D技术、快门式3D技术以及偏光式3D技术等都可实现移动终端或智能电视的3D显示。目前的3D显示一般是采用基于不同的观看者视角显示同一3D内容的方式，这样，在观看者的眼睛相对于播放设备的位置发生移动，或者播放设备相对与观看者的位置发生变化的情况下，例如，用户通过移动终端观看3D视频时，用户位置移动或用户旋转终端的情况，会导致由于用户视角发生变化，导致用户观看到的画面会出现扭曲、不清晰的情况，影响用户体验。
发明内容
本发明提供一种多摄像头终端的3D文件制作、播放方法及装置，用以解决现有技术中在3D文件播放过程中，播放终端与观看者相对位置发生改变导致用户观看到的画面出现扭曲不清晰的问题。
根据本发明的一个方面，提供了一种多摄像头终端的3D文件制作方法，包括：使用终端的第一摄像头以及第二摄像头拍摄多对图像；确定多对图像中各对图像对应的播放视角，按照各对图像的播放视角的大小顺序存储多对图像，得到三维图形3D文件。
其中，使用终端的两个摄像头拍摄多对图像，包括：在同一位置基于当前拍摄对象以等差拍摄视角拍摄多对图像；确定多对图像中各对图像对应的播放 视角，按照各对图像的播放视角的大小顺序存储多对图像，包括：将图像的拍摄视角确定为图像的播放视角，按照图像的拍摄视角的大小顺序存储图像。
其中，使用终端的两个摄像头拍摄多对图像，包括：基于当前取景对象，在不同位置进行拍摄，得到多对图像；确定多对图像中各图像对应的播放视角，按照各对图像的播放视角的大小顺序存储多对图像，包括：约定多对图像中的一对的播放视角为正视角，在正视角两侧取多个播放视角，约定多个播放视角对应的图像，按照图像的播放视角的大小顺序存储图像。
根据本发明的又一个方面，提供了一种3D文件播放方法，包括：按照预先存储的3D图像与播放视角的对应关系播放3D图像；当检测出终端前的人眼与终端的相对位置发生变化时，根据相对位置的变化关系，确定待播放的3D图像，并播放确定出的3D图像。
其中，当检测出终端前的人眼与终端的相对位置发生变化时，根据相对位置的变化关系，确定当前播放的3D图像，包括：当检测出终端前的人眼相对终端的移动时，根据人眼的移动方向，确定当前播放的3D图像。
其中，当检测出终端前的人眼的相对终端的移动时，根据人眼的移动方向，确定当前播放的3D图像，包括：获取终端前人的左眼以及右眼与终端对应的正视角的第一差值以及第二差值；根据第一差值以及第二差值的大小关系，确定当前人眼相对于终端的移动方向，根据该移动方向确定待播放图像的视角；根据待播放的图像的视角从预先按照播放视角对应存储的图像中调用对应图像，并播放调用的图像。
其中，当检测出终端前的人眼与终端的相对位置发生变化时，根据相对位置的变化关系，确定当前播放的3D图像，包括：当检测出终端发生转动时，根据终端转动的角度确定待播放图像对应的播放视角，根据待播放图像的播放视角从预先按照播放视角对应存储的图像中调用对应图像，并播放调用的图像。
根据本发明的再一方面，还提供了一种多摄像头终端的3D文件制作装置，包括：拍摄模块，用于使用终端的第一摄像头以及第二摄像头拍摄多对图像；存储模块，用于确定多对图像中各对图像对应的播放视角，按照各对图像的播放视角的大小顺序存储多对图像，得到三维图形3D文件。
其中，上述拍摄模块，包括：拍摄模块用于，在同一位置基于当前拍摄对象以等差拍摄视角拍摄多对图像；存储模块用于，将图像的拍摄视角确定为图像的播放视角，按照图像的拍摄视角的大小顺序存储图像。
其中，拍摄模块，包括：拍摄模块用于，基于当前取景对象，在不同位置进行拍摄，得到多对图像；存储模块用于，约定多对图像中的一对的播放视角为正视角，在正视角两侧取多个播放视角，约定多个播放视角对应的图像，按照图像的播放视角的大小顺序存储图像。
根据本发明的还一方面，提供了一种3D文件播放装置，包括：播放模块，用于按照预先存储的3D图像与播放视角的对应关系播放3D图像；确定模块，用于当检测出终端前的人眼与终端的相对位置发生变化时，根据相对位置的变化关系，确定待播放的3D图像，并播放确定出的3D图像。
其中，上述确定模块，用于当检测出终端前的人眼相对终端的移动时，根据人眼的移动方向，确定当前播放的3D图像。
其中，上述确定模块包括：获取单元，用于获取终端前人的左眼以及右眼与终端对应的正视角的第一差值以及第二差值；确定单元，用于根据第一差值以及第二差值的大小关系，确定当前人眼相对于终端的移动方向，根据该移动方向确定待播放图像的视角；根据待播放的图像的视角从预先按照播放视角对应存储的图像中调用对应图像，并播放调用的图像。
其中，上述确定模块用于，当检测出终端发生转动时，根据终端转动的角度确定待播放图像对应的播放视角，根据待播放图像的播放视角从预先按照播放视角对应存储的图像中调用对应图像，并播放调用的图像。
本发明的技术方案在制作3D文件时，将3D图像按照其播放视角的大小顺序存储，使得制作的3D文件中的图像可以按照播放视角来进行播放，进而，在播放3D文件时，可以根据观看者与终端相对位置的变化，调整当前播放的3D图像，因此，即使在观看者与终端的位置发生变化时，也可以根据观看者的观看视角来进行3D文件的播放，保证了在观看者与终端的位置发生变化时画面的清晰度，同时，使得用户在不同的观看角度可以观看到不同的图像效果，提高了用户体验。
附图说明
图1是本发明实施例1的3D文件制作方法的流程图；
图2是本发明实施例2的3D文件播放方法的流程图；
图3是本发明实施例2中当终端固定不动人眼移动时，人眼与终端相对位置变化的示意图；
图4为本发明实施例3中在不同位置拍摄3D图像的示意图；
图5是本发明实施例4的3D文件制作装置的结构框图；
图6是本发明实施例5的3D文件播放装置的结构框图。
具体实施方式
为了解决现有技术在3D文件播放过程中，播放终端与观看者相对位置发生改变导致用户观看到的画面出现扭曲不清晰的问题，本发明提供了一种3D文件制作、播放方法及装置，以下结合附图以及实施例，对本发明进行进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不限定本发明。
实施例1
图1是本发明实施例1的多摄像头终端的3D文件制作方法的流程图，如图1所示，该方法包括以下步骤：
步骤101：使用终端的第一摄像头以及第二摄像头拍摄多对图像，优选的，拍摄时，两个摄像头之间的拍摄视角差与人两眼的视角差相等，优选的，可以采用两组多个摄像头进行拍摄；
在该步骤中终端的两个摄像头优选的可以位于终端的同一侧，例如，可以是移动终端的后侧的两个并排的摄像头，也可以是其他拍摄设备上的并排的两个摄像头。
步骤102：确定多对图像中各对图像对应的播放视角，按照各对图像的播放视角的大小顺序存储多对图像，得到三维图形3D文件。
在该步骤102中，按照各对图像的播放视角的大小顺序存储多对图像，即，对应于每对图像的播放视角的大小，按照顺序存储各对图像，每对图像对应于一个播放视角，其中，各对图像对应的播放视角，即为播放3D文件时播放该对图像的视角的角度。
在上述步骤101以及102的基础上，具体可以采用以下两种方式拍摄并存储3D文件：
方式一：在同一位置基于当前拍摄对象以等差拍摄视角拍摄多对图像；确定多对图像中各对图像对应的播放视角，按照各对图像的播放视角的大小顺序存储多对图像，包括：将图像的拍摄视角确定为图像的播放视角，按照图像的拍摄视角的大小顺序存储图像。
方式二：基于取景对象，在不同位置进行拍摄，得到多对图像；确定多对图像中各图像对应的播放视角，按照各对图像的播放视角的大小顺序存储多对图像，包括：约定多对图像中的一对的播放视角为正视角，在正视角两侧取多个播放视角，约定多个播放视角对应的图像，按照图像的播放视角的大小顺序存储图像。
实施例2
本实施例提供一种3D文件播放方法，该方法可以用于播放上述实施例1的方式制作的3D文件，所以，基于3D文件中的图像的存储方式可以与上述实施例1的存储方式相同。
图2是本发明实施例2的3D文件播放方法的流程图，如图2所示，该方法包括如下步骤：
步骤201：按照预先存储的3D图像与播放视角的对应关系播放3D图像；
由于该实施例中的3D图像可以是按照上述实施例1中的3D图像制作方法制作得到的图像。故，此处的3D图像可以是预先按照指定的播放视角的大小关系顺序存储，具体存储方式可以与上述实施例1中的拍摄3D图像后的存 储方式相同，此处不再赘述。在该步骤201中，播放图像时，根据图像对应的视角来调用对应的图像进行播放。
步骤202：当检测出终端前的人眼与终端的相对位置发生变化时，根据相对位置的变化关系，确定待播放的3D图像，并播放确定出的3D图像。
其中，终端与终端前人眼的相对位置的变化具体可以包括：终端前的观看者相对于终端作出移动引起的相对位置改变，或终端自身发生移动或旋转而引起的相对位置的改变，这两种情况下，对3D文件的播放处理如下所述：
其中，当检测出终端前的人眼与终端的相对位置发生变化时，根据相对位置的变化关系，确定当前播放的3D图像，包括：当检测出终端前的人眼相对终端的移动时，根据人眼的移动方向，确定当前播放的3D图像，其中，当检测出终端前的人眼的相对终端的移动时，根据人眼的移动方向，确定当前播放的3D图像的步骤具体可以包括如下处理：获取终端前人的左眼以及右眼与终端对应的正视角的第一差值以及第二差值；根据第一差值以及第二差值的大小关系，确定当前人眼相对于终端的移动方向，根据该移动方向确定待播放图像的视角；根据待播放的图像的视角从预先按照播放视角对应存储的图像中调用对应图像，并播放调用的图像。
其中，当检测出终端前的人眼与终端的相对位置发生变化时，根据相对位置的变化关系，确定当前播放的3D图像，包括：当检测出终端发生转动时，根据终端转动的角度确定待播放图像对应的播放视角，根据待播放图像的播放视角从预先按照播放视角对应存储的图像中调用对应图像，并播放调用的图像。
本实施例中，用户观看角度(即视角)的测量具体可以采用以下两种方式：
当终端固定不动，人眼移动时，人眼在终端的前摄像头成像画面中相对位置改变，如图3所示：
其中A、B为终端前观看者的左右眼，A1、B1为左右眼在摄像头传感器上 成的像，d为摄像头焦距，L为左眼像点与摄像头中心轴的距离，R为右眼像点到摄像头中心轴距离。摄像头的焦距d终端自身可知，L、R通过终端后台软件计算得出，再通过求解反三角函数得出左右眼与正视角的差值δL、δR。当δL〉δR时，判断出人眼左移，定义此时视角差为正值；相应的，当δL〈δR时定义视角差为负值。并定义用户观看视角δ＝(δL+δR)÷2。
当终端前观看者人眼固定不动，终端移动时，终端陀螺仪自动感知终端旋转角度获得用户观看角度(视角)δ(δ带正负号)。
在发生上述两种情况后，3D文件的播放：
后台根据用户观看角度(视角)δ按前面对应规则调用与观看角度相对应的某对图像，并在显示屏幕上显示3D画面，从而实现不同视角显示不同3D内容。
实施例3
本实施例以一个具体的实例来对3D文件制作方法以及调制方法进行详细的阐述：
一、不同视角3D画面内容制作、调制
a、终端的左右两个摄像头同时拍摄两份照片或视频文件(PL1，PR1)，其中，两摄像头拍摄视角差跟人两眼视角差相等；
b、在不同时间或不同位置条件下重复a过程拍摄多份照片或视频文件(PLn，PRn)，其中n＝2、3、4……，该步骤中，在不同位置或在同一位置不同时间的拍摄方式具体可以参考实施例1中的两种拍摄方式，此处不再赘述。
c、约定拍摄得到的文件(PLm，PRm)对应正视角，其中m＝(n+1)/2；文件(PLm+1，PRm+1)对应视角为1度，文件(PLm-1，PRm-1)对应视角为-1度，文件(PLm+2，PRm+2)对应视角为2度，文件(PLm-2，PRm-2)对应视角为-2度，以此类推，然后按照视角的大小顺序对应保存(PLn，PRn)文件(n＝1、2、3、4……)。
图4为本发明实施例3中采用在不同位置拍摄3D图像的示意图，如图4所示，终端的两个摄像头C、D分别在不同位置对拍摄对象进行拍摄，得到(PR1，PL1)、(PR2，PL2)以及(PR3，PL3)三对图像。
二、对保存的图像进行调制
在按照上述的方式拍摄并存储图像后，具体可以采用以下任意一种方式对得到的图像进行调制：
A、基于色差式3D技术方式，对拍摄得到的(PLn，PRn)画面内容分别用红、蓝光调制。对其中PLn画面内容，即左侧摄像头拍摄的图像内容用红光调制；对其中PRn画面内容，即右侧摄像头拍摄的图像内容用红光调制；然后将调制后的画面合并成一幅画面，接收端使用一副红蓝色差眼镜相应接收画面即可进行观看。
B、基于快门式3D技术方式，分时隙发送(PLn，PRn)中的图像，接收端使用主动式LCD(Liquid Crystal Display，液晶显示器)快门眼镜，用发送端同步的时序交替开关眼境左眼和右眼，使左右眼看到的两幅图像在观看者大脑中融合成一体来实现3D画面显示。其中，交替时间间隔T时间段取值为：(t0<0.02s)。
C、基于偏振式3D技术方式，把拍摄得到的(PLn，PRn)中的图像分别调制成不同角度的偏振光同时发送，在接收端的观看者配戴左右眼偏振角相对应的偏振眼镜，分别滤光后，观看者的左右眼看到的不同画面在大脑中融合成一体实现3D画面显示。
实施例4
本实施例提供一种3D文件制作装置，该装置用于实现上述3D制作方法，图5是本发明实施例4的3D文件制作装置的结构框图，如图5所示，该装置50具体可以包括如下组成部分：拍摄模块51，用于使用终端的第一摄像头以及第二摄像头拍摄多对图像，优选的，拍摄时，两个摄像头之间的拍摄视角差 与人两眼的视角差相等；具体的，可以是采用两组多个进行拍摄，存储模块52，用于确定多对图像中各对图像对应的播放视角，按照各对图像的播放视角的大小顺序存储多对图像，得到三维图形3D文件。
其中，上述拍摄模块51，具体可以包括：拍摄模块用于，在同一位置基于当前拍摄对象以等差拍摄视角拍摄多对图像；存储模块用于，将图像的拍摄视角确定为图像的播放视角，按照图像的拍摄视角的大小顺序存储图像。
其中，拍摄模块51，具体可以包括：拍摄模块用于，基于当前取景对象，在不同位置进行拍摄，得到多对图像；存储模块用于，约定多对图像中的一对的播放视角为正视角，在正视角两侧取多个播放视角，约定多个播放视角对应的图像，按照图像的播放视角的大小顺序存储图像。
实施例5
图6是本发明实施例5的3D文件播放装置的结构框图，如图6所示，该装置60包括以下组成部分：播放模块61，用于按照预先存储的3D图像与播放视角的对应关系播放3D图像；确定模块62，用于当检测出终端前的人眼与终端的相对位置发生变化时，根据相对位置的变化关系，确定待播放的3D图像，并播放确定出的3D图像。
其中，上述确定模块62具体可以用于当检测出终端前的人眼相对终端的移动时，根据人眼的移动方向，确定当前播放的3D图像。
其中，上述确定模块62具体可以包括：获取单元，用于获取终端前人的左眼以及右眼与终端对应的正视角的第一差值以及第二差值；确定单元，用于根据第一差值以及第二差值的大小关系，确定当前人眼相对于终端的移动方向，根据该移动方向确定待播放图像的视角；根据待播放的图像的视角从预先按照播放视角对应存储的图像中调用对应图像，并播放调用的图像。
其中，上述确定模块62具体可以用于，当检测出终端发生转动时，根据终端转动的角度确定待播放图像对应的播放视角，根据待播放图像的播放视角 从预先按照播放视角对应存储的图像中调用对应图像，并播放调用的图像。
本发明的技术方案在制作3D文件时，将3D图像按照其播放视角的大小顺序存储，使得制作的3D文件中的图像可以按照播放视角来进行播放，进而，在播放3D文件时，可以根据观看者与终端相对位置的变化，调整当前播放的3D图像，因此，即使在观看者与终端的位置发生变化时，也可以根据观看者的观看视角来进行3D文件的播放，实现了不同视角显示不同3D画面内容的目的，保证了在观看者与终端的位置发生变化时画面的清晰度，使得用户在不同观看角度可以观看不同图像效果，提高了用户体验。
尽管为示例目的，已经公开了本发明的优选实施例，本领域的技术人员将意识到各种改进、增加和取代也是可能的，因此，本发明的范围应当不限于上述实施例。

Claims (14)

  1. 一种多摄像头终端的3D文件制作方法，其特征在于，包括：
    使用终端的第一摄像头以及第二摄像头拍摄多对图像；
    确定所述多对图像中各对图像对应的播放视角，按照各对图像的播放视角的大小顺序存储所述多对图像，得到三维图形3D文件。
  2. 如权利要求1所述的方法，其特征在于，所述使用终端的两个摄像头拍摄多对图像，包括：
    在同一位置基于当前拍摄对象以等差拍摄视角拍摄多对图像；
    所述确定所述多对图像中各对图像对应的播放视角，按照各对图像的播放视角的大小顺序存储所述多对图像，包括：
    将图像的拍摄视角确定为图像的播放视角，按照图像的拍摄视角的大小顺序存储所述图像。
  3. 如权利要求1所述的方法，其特征在于，所述使用终端的两个摄像头拍摄多对图像，包括：
    基于当前取景对象，在不同位置进行拍摄，得到多对图像；
    所述确定所述多对图像中各图像对应的播放视角，按照各对图像的播放视角的大小顺序存储所述多对图像，包括：
    约定所述多对图像中的一对的播放视角为正视角，在正视角两侧取多个播放视角，约定所述多个播放视角对应的图像，按照图像的播放视角的大小顺序存储所述图像。
  4. 一种3D文件播放方法，其特征在于，包括：
    按照预先存储的3D图像与播放视角的对应关系播放3D图像；
    当检测出终端前的人眼与终端的相对位置发生变化时，根据所述相对位置的变化关系，确定待播放的3D图像，并播放确定出的3D图像。
  5. 如权利要求4所述的方法，其特征在于，所述当检测出终端前的人眼 与终端的相对位置发生变化时，根据所述相对位置的变化关系，确定当前播放的3D图像，包括：
    当检测出终端前的人眼相对终端的移动时，根据人眼的移动方向，确定当前播放的3D图像。
  6. 如权利要求5所述的方法，其特征在于，所述当检测出终端前的人眼的相对终端的移动时，根据人眼的移动方向，确定当前播放的3D图像，包括：
    获取终端前人的左眼以及右眼与终端对应的正视角的第一差值以及第二差值；
    根据第一差值以及第二差值的大小关系，确定当前人眼相对于终端的移动方向，根据该移动方向确定待播放图像的视角；
    根据待播放的图像的视角从预先按照播放视角对应存储的图像中调用对应图像，并播放调用的图像。
  7. 如权利要求4所述的方法，其特征在于，当检测出终端前的人眼与终端的相对位置发生变化时，根据所述相对位置的变化关系，确定当前播放的3D图像，包括：
    当检测出终端发生转动时，根据终端转动的角度确定待播放图像对应的播放视角，根据待播放图像的播放视角从预先按照播放视角对应存储的图像中调用对应图像，并播放调用的图像。
  8. 一种多摄像头终端的3D文件制作装置，其特征在于，包括：
    拍摄模块，用于使用终端的第一摄像头以及第二摄像头拍摄多对图像；
    存储模块，用于确定所述多对图像中各对图像对应的播放视角，按照各对图像的播放视角的大小顺序存储所述多对图像，得到三维图形3D文件。
  9. 如权利要求8所述的装置，其特征在于，所述拍摄模块，包括：
    拍摄模块用于，在同一位置基于当前拍摄对象以等差拍摄视角拍摄多对图像；
    存储模块用于，将图像的拍摄视角确定为图像的播放视角，按照图像的拍摄视角的大小顺序存储所述图像。
  10. 如权利要求8所述的装置，其特征在于，所述拍摄模块，包括：
    所述拍摄模块用于，基于当前取景对象，在不同位置进行拍摄，得到多对图像；
    所述存储模块用于，约定所述多对图像中的一对的播放视角为正视角，在正视角两侧取多个播放视角，约定所述多个播放视角对应的图像，按照图像的播放视角的大小顺序存储所述图像。
  11. 一种3D文件播放装置，其特征在于，包括：
    播放模块，用于按照预先存储的3D图像与播放视角的对应关系播放3D图像；
    确定模块，用于当检测出终端前的人眼与终端的相对位置发生变化时，根据所述相对位置的变化关系，确定待播放的3D图像，并播放确定出的3D图像。
  12. 如权利要求11所述的装置，其特征在于，所述确定模块，用于当检测出终端前的人眼相对终端的移动时，根据人眼的移动方向，确定当前播放的3D图像。
  13. 如权利要求12所述的装置，其特征在于，所述确定模块包括：
    获取单元，用于获取终端前人的左眼以及右眼与终端对应的正视角的第一差值以及第二差值；
    确定单元，用于根据第一差值以及第二差值的大小关系，确定当前人眼相对于终端的移动方向，根据该移动方向确定待播放图像的视角；
    根据待播放的图像的视角从预先按照播放视角对应存储的图像中调用对应图像，并播放调用的图像。
  14. 如权利要求11所述的装置，其特征在于，所述确定模块用于，当检 测出终端发生转动时，根据终端转动的角度确定待播放图像对应的播放视角，根据待播放图像的播放视角从预先按照播放视角对应存储的图像中调用对应图像，并播放调用的图像。
PCT/CN2015/080328 2014-12-31 2015-05-29 一种多摄像头终端的3d文件制作、播放方法及装置 WO2016107063A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410856590.8A CN104506841A (zh) 2014-12-31 2014-12-31 一种多摄像头终端的3d文件制作、播放方法及装置
CN201410856590.8 2014-12-31

Publications (1)

Publication Number Publication Date
WO2016107063A1 true WO2016107063A1 (zh) 2016-07-07

Family

ID=52948554

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/080328 WO2016107063A1 (zh) 2014-12-31 2015-05-29 一种多摄像头终端的3d文件制作、播放方法及装置

Country Status (2)

Country Link
CN (1) CN104506841A (zh)
WO (1) WO2016107063A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104506841A (zh) * 2014-12-31 2015-04-08 宇龙计算机通信科技(深圳)有限公司 一种多摄像头终端的3d文件制作、播放方法及装置
CN105120251A (zh) 2015-08-19 2015-12-02 京东方科技集团股份有限公司 一种3d场景展示方法及装置
CN105812708A (zh) * 2016-03-18 2016-07-27 严俊涛 视频通话方法及系统
CN107318008A (zh) * 2016-04-27 2017-11-03 深圳看到科技有限公司 全景视频播放方法及播放装置
CN107844190B (zh) * 2016-09-20 2020-11-06 腾讯科技（深圳）有限公司 基于虚拟现实vr设备的图像展示方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101072366A (zh) * 2007-05-24 2007-11-14 上海大学 基于光场和双目视觉技术的自由立体显示系统和方法
CN104010179A (zh) * 2014-06-12 2014-08-27 山东大学 基于立体多画的多用户聚类与视点计算系统及方法
CN104185985A (zh) * 2012-03-30 2014-12-03 富士胶片株式会社 拍摄装置、方法、存储介质以及程序
CN104506841A (zh) * 2014-12-31 2015-04-08 宇龙计算机通信科技(深圳)有限公司 一种多摄像头终端的3d文件制作、播放方法及装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101582959A (zh) * 2008-05-15 2009-11-18 财团法人工业技术研究院 智能型多视角数字显示系统及显示方法
CN101900564A (zh) * 2010-07-21 2010-12-01 宇龙计算机通信科技(深圳)有限公司 一种动态视角的导航方法、终端、服务器及系统
CN101950550B (zh) * 2010-09-28 2013-05-29 冠捷显示科技（厦门）有限公司 基于观看者视角显示不同角度画面的显示装置
KR101784316B1 (ko) * 2011-05-31 2017-10-12 삼성전자주식회사 멀티 앵글 방송 서비스 제공 방법 및 이를 적용한 디스플레이 장치, 모바일 기기

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101072366A (zh) * 2007-05-24 2007-11-14 上海大学 基于光场和双目视觉技术的自由立体显示系统和方法
CN104185985A (zh) * 2012-03-30 2014-12-03 富士胶片株式会社 拍摄装置、方法、存储介质以及程序
CN104010179A (zh) * 2014-06-12 2014-08-27 山东大学 基于立体多画的多用户聚类与视点计算系统及方法
CN104506841A (zh) * 2014-12-31 2015-04-08 宇龙计算机通信科技(深圳)有限公司 一种多摄像头终端的3d文件制作、播放方法及装置

Also Published As

Publication number Publication date
CN104506841A (zh) 2015-04-08

Similar Documents

Publication Publication Date Title
US9066083B2 (en) Single lens 2D/3D digital camera
WO2016107063A1 (zh) 一种多摄像头终端的3d文件制作、播放方法及装置
RU2531557C2 (ru) Формирователь стереоскоических изображений (варианты)
JP2018522510A (ja) ３ｄ及び／又は２ｄ高品質ビデオ撮影、写真撮影、自撮り録画用のカメラシステム及び非電気的３ｄ／マルチビデオ及び静止フレームビューアーと一体化される多目的携帯機器ケース／カバー
SE0501995L (sv) Digital stereo camera/digital stereo video camera, 3- dimentional display, 3-dimensional projector, and printer and stereo viewer
JP5420075B2 (ja) 立体画像再生装置、その視差調整方法、視差調整プログラム、及び撮影装置
JP5905585B2 (ja) ステレオ映像に基づく映像処理システム
US10582184B2 (en) Instantaneous 180-degree 3D recording and playback systems
WO2014119965A1 (ko) 사이드 바이 사이드 스테레오 영상 촬영 방법 및 이를 위한 단안식 카메라
JP2006333400A (ja) 立体視画像生成装置及び立体視画像生成プログラム
CN203941346U (zh) 一种3d显示系统
JP2012015818A (ja) 立体画像表示装置及び表示方法
JP2011211488A (ja) 画像処理装置および方法並びにプログラム
CN106534831A (zh) 立体视频拍摄方法及用户终端
JPH09224265A (ja) 立体視画像記録方法並びに装置
JP5725159B2 (ja) 測定装置、立体画像表示装置及び測定方法
US20120154808A1 (en) Method for detecting the optimum viewing distance of three-dimensional display
JP2012015820A (ja) 立体映像表示装置及び立体映像表示方法
JP2011211754A (ja) 画像処理装置および方法並びにプログラム
KR101375648B1 (ko) 모바일 단말을 위한 입체영상 제공장치 및 그 방법
US20100164945A1 (en) Digital photo frame and method for displaying photos in digital photo frame
WO2011114767A1 (ja) 立体画像表示装置、立体画像撮像装置、テレビジョン受像機、遊技装置、記録媒体および立体画像の伝送方法
Izmantoko et al. Implementation of anaglyph method for stereo microscope image display
CN108833902A (zh) 一种通过串流实现普通屏幕显示3d图像的方法
TWI446097B (zh) 立體動態影像的形成方法及立體動態影像擷取裝置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15874755

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 27/11/17)

122 Ep: pct application non-entry in european phase

Ref document number: 15874755

Country of ref document: EP

Kind code of ref document: A1