WO2018028048A1 - Virtual reality content generation method and apparatus - Google Patents

Virtual reality content generation method and apparatus Download PDF

Info

Publication number
WO2018028048A1
WO2018028048A1 PCT/CN2016/102276 CN2016102276W WO2018028048A1 WO 2018028048 A1 WO2018028048 A1 WO 2018028048A1 CN 2016102276 W CN2016102276 W CN 2016102276W WO 2018028048 A1 WO2018028048 A1 WO 2018028048A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
video information
virtual reality
camera array
drone
Prior art date
Application number
PCT/CN2016/102276
Other languages
French (fr)
Chinese (zh)
Inventor
郝祁
兰功金
欧泽彬
Original Assignee
南方科技大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 南方科技大学 filed Critical 南方科技大学
Publication of WO2018028048A1 publication Critical patent/WO2018028048A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals

Definitions

  • the present application relates to virtual reality technology, for example, to a virtual reality content generation method and apparatus.
  • the current mainstream virtual reality content production methods mainly include three-dimensional (3D) modeling methods and panoramic video shooting methods.
  • the method of 3D modeling is: firstly establishing a 3D virtual reality scene model, and then making virtual reality content according to the 3D model.
  • the virtual reality content in the related art is mainly implemented by 3D modeling and post-rendering methods, such as common roller coaster virtual reality content.
  • the panoramic video shooting method is: complete the panoramic video shooting of the virtual reality scene through the professional ground panoramic video shooting device and the shooting team, and then convert the panoramic video into virtual reality content.
  • the establishment of the virtual reality scene 3D model requires a large number of professional modeling personnel to spend a lot of time, often requires a team to complete, resulting in high production costs, limited production speed, complex production
  • the method also leads to limited virtual reality content that can be presented to users in the related art, which largely limits the further development of the virtual reality industry.
  • the method of panoramic video shooting requires professional panoramic video ground shooting equipment and later panoramic video production technology to finally generate virtual reality content.
  • This method also requires a large number of human and material resources for professional production teams, and the applicable scenes are limited. It is difficult to work on professional ground video shooting equipment in areas with complex terrain.
  • the virtual reality production method is inefficient.
  • related technology Intra-operative virtual reality content production methods require professional equipment and technology, high production cost, low production efficiency, and restrictions on the choice of virtual reality scenes.
  • the present application provides a virtual reality content generation method and apparatus, which makes the virtual reality content use simple in the production process, high in production efficiency, and the production difficulty and the production cost are significantly reduced, and the selection of the virtual reality scene is no longer limited. .
  • the embodiment of the present application provides a virtual reality content generating method, including:
  • the planar panoramic video is mapped to a spherical panoramic video, and the spherical panoramic video is output.
  • the following before acquiring multi-angle video information through the camera array carried by the drone, the following includes:
  • the multi-angle video information is saved to the memory.
  • the stitching the video information of different angles into a flat panoramic video includes:
  • the video information of the different angles is video-synchronized according to the synchronization feature signal, and the video information of different angles after the video synchronization is spliced into a planar panoramic video, where the synchronization feature signal includes a synchronization noise signal.
  • the camera array carried by the drone and the drone it also includes:
  • the camera array comprises six camera devices.
  • the embodiment of the present application further provides a virtual reality content generating apparatus, including:
  • a video information acquiring module configured to acquire multi-angle video information by a camera array carried by the drone, the camera array comprising at least five camera devices, wherein each camera device is configured to complete video capture of a corresponding angle of view to obtain different Angle of video information;
  • planar panoramic splicing module configured to splicing the video information of the different angles into a flat panoramic video
  • a spherical panoramic mapping module configured to map the planar panoramic video to a spherical panoramic video and output the spherical panoramic video.
  • it also includes:
  • a boot module that is set to activate a camera array carried by the drone and the drone;
  • a storage module configured to save the multi-angle video information into the memory.
  • the plane panoramic splicing module is configured to:
  • the video information of the different angles is video-synchronized according to the synchronization feature signal, and the video information of different angles after the video synchronization is spliced into a planar panoramic video, where the synchronization feature signal includes a synchronization noise signal.
  • it also includes:
  • a synchronization feature signal determining module is configured to receive or set a synchronization feature signal.
  • the camera array comprises six camera devices.
  • the embodiment of the present application further provides a non-transitory storage medium, where computer executable instructions are set, and the computer executable instructions are configured to execute the virtual reality content generating method according to any one of the embodiments of the present application. .
  • the embodiment of the present application further provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program When the instruction is executed by the computer, the computer is caused to execute the virtual reality content generating method according to any one of the embodiments of the present application.
  • an embodiment of the present application further provides an electronic device, including at least one processor and a memory communicatively coupled to the at least one processor, the memory for storing instructions executable by the at least one processor And when the instruction is executed by the at least one processor, causing the at least one processor to execute the virtual reality content generating method according to any one of the embodiments of the present application.
  • the present application acquires multi-angle video information by a camera array carried by a drone, the camera array includes at least five imaging devices, wherein each camera device is configured to complete video capture of a corresponding viewing angle to obtain video information of different angles;
  • the video information of the different angles is spliced into a planar panoramic video;
  • the planar panoramic video is mapped to a spherical panoramic video, and the spherical panoramic video is output, and the virtual reality content manufacturing method in the related art needs professional equipment and
  • the technology, the high production cost, the low production efficiency, and the limitation of the selection of the virtual reality scene make the virtual reality content use simple equipment in the production process, the production efficiency is high, the production difficulty and the production cost are significantly reduced, and the virtual The selection of realistic scenes is no longer limited.
  • FIG. 1 is a flowchart of a method for generating a virtual reality content according to Embodiment 1 of the present application
  • FIG. 2 is a flowchart of a method for generating virtual reality content according to Embodiment 2 of the present application
  • FIG. 3 is a structural diagram of a virtual reality content generating apparatus according to Embodiment 3 of the present application.
  • Embodiment 1 is a flowchart of a method for generating a virtual reality content according to Embodiment 1 of the present application. This embodiment may be applicable to a method for creating virtual reality content. The method may be performed by a computing device, such as a desktop computer or a notebook computer, and includes the following steps. :
  • Step 101 Acquire multi-angle video information by using a camera array mounted on the drone.
  • the camera array comprises at least five camera devices, wherein each camera device is configured to complete video capture of a corresponding angle of view to obtain video information of different angles.
  • the camera array is composed of a plurality of camera devices and components for fixing the camera device.
  • the camera array is mounted under the drone, and the plurality of camera devices installed simultaneously perform video along with the flight of the drone.
  • Shooting of information Exemplarily, when five camera devices are included in the camera array, the camera array may have a structural shape of a pentahedron shape, wherein each camera device is mounted in one of the pentahedrons and acquires a position facing the face. The video of the area.
  • the camera array includes at least five imaging devices, and the more video information of various angles acquired with the increase of the imaging device, is more conducive to the splicing of subsequent video information, and at the same time, the splicing effect of the video information can be improved, and the number of imaging devices is increased.
  • the adaptability setting can be different according to different scenarios, and is not limited by this embodiment.
  • the multi-angle video information acquired by the unmanned aerial vehicle camera array overcomes the limited problem of the virtual reality content scene when it is selected. With the development of the drone technology, the stability of the drone flight and the complex flight The adaptability of the environment has further improved the application prospects of this program.
  • Step 102 splicing the video information of different angles into a flat panoramic video.
  • the video information of each angle is spliced into a planar panoramic video. Since the flat panoramic video contains video information of various angles, it includes panoramic virtual reality content. In the solution, at least five camera devices are selected to shoot different angles, so as to ensure that the video information content has sufficient and uniform overlapping portions at each angle for the splicing in this step.
  • the frame images at the same time in the video information of the respective angles may be respectively selected, and the consecutive frame images are separately spliced to finally obtain the planar panoramic video.
  • the step of splicing and obtaining the planar panoramic video includes: calibration of the camera, sensor image distortion correction, image projection transformation, matching point selection, and brightness and color equalization processing.
  • the video information splicing software can be used for splicing to obtain a planar panoramic video.
  • the solution only needs to input the video information of each angle to obtain the final planar panoramic video, which is simple and easy.
  • Step 103 Map the planar panoramic video to a spherical panoramic video, and output the spherical panoramic video.
  • the corresponding spherical panoramic video is obtained through a flat panoramic video by using a spherical panoramic video production software such as Unity3D.
  • the spherical panoramic video can be used as a virtual reality content for subsequent virtual reality application.
  • the multi-angle video information is acquired by the camera array carried by the drone, the camera array includes at least five imaging devices, wherein each camera device is configured to complete video shooting of the corresponding viewing angle to obtain different Angle video information; splicing the video information of different angles into a planar panoramic video; mapping the planar panoramic video to a spherical panoramic video, and outputting the spherical panoramic video, and solving the related art virtual reality content manufacturing method Requires professional equipment and technology, high production cost, low production efficiency, and restrictions on the choice of virtual reality scenes, making the virtual reality content use simple in the production process, high production efficiency and difficulty in making The cost of the work is significantly reduced, and the selection of virtual reality scenes is no longer limited.
  • the method before acquiring multi-angle video information through the camera array mounted on the drone, the method further includes: starting a camera array mounted on the drone and the drone; acquiring more through the camera array mounted on the drone After the video information of the angle, the method further includes: saving the multi-angle video information into the memory.
  • the drone is started by the ground remote controller or the ground terminal control device to start the flight, and the camera array mounted on the drone is controlled to start acquiring the video image, and the acquired video information is saved into the memory as the original data.
  • the video information of different angles may be stored in the memory of the respective camera device, or the video information of all different angles may be uniformly stored in the same memory.
  • FIG. 2 is a flowchart of a method for generating a virtual reality content according to a second embodiment of the present application.
  • a method for performing planar panoramic video splicing using a synchronization feature signal is provided.
  • Step 201 Acquire multi-angle video information by using a camera array mounted on the drone.
  • Step 202 Perform video synchronization on the video information of different angles according to the synchronization feature signal, and splicing the video information of different angles after the video synchronization into a planar panoramic video.
  • the video information obtained by each camera device needs to be synchronized to determine that the video information is spliced to obtain a planar panoramic video at the same time point.
  • the video information of the different angles is video-synchronized according to the synchronization feature signal, which can conveniently solve the synchronization problem of the video information in the splicing process.
  • the synchronization feature signal includes a synchronous noise signal.
  • a noise can be generated by the generator, and the noise is used as a synchronization feature signal.
  • Step 203 Map the planar panoramic video to a spherical panoramic video, and output the spherical panoramic video.
  • the multi-angle video information is acquired by the camera array carried by the drone, the camera array includes at least five imaging devices, wherein each camera device is configured to complete video shooting of the corresponding viewing angle to obtain different The video information of the angle; the video information of the different angles is video-synchronized according to the synchronization feature signal, and the video information of different angles after the video synchronization is spliced into a planar panoramic video, wherein the synchronization feature signal includes a synchronous noise signal;
  • the planar panoramic video is mapped into a spherical panoramic video, and the spherical panoramic video is output, which solves the related art in the virtual reality content production method, which requires professional equipment and technology, high production cost, low production efficiency, and selection of virtual reality scenes.
  • There is a limitation problem which makes the virtual reality content use equipment in the production process simple, the production efficiency is high, the production difficulty and the production cost are significantly reduced, and the selection of the virtual reality scene is no longer limited.
  • the method further includes: receiving or setting a synchronization feature signal.
  • the synchronization feature signal may be a noise signal externally provided or emitted, or may be a synchronization feature signal set at a fixed time point.
  • the camera array includes six camera devices.
  • the virtual reality content can be better displayed, and the device cost and installation cost are low.
  • FIG. 3 is a structural diagram of a virtual reality content generating apparatus according to Embodiment 3 of the present application, including:
  • the video information acquisition module 1 is configured to acquire a multi-angle view through a camera array mounted on the drone Frequency information, the camera array includes at least five camera devices, wherein each camera device is configured to complete video capture of a corresponding viewing angle to obtain video information of different angles;
  • the planar panoramic splicing module 2 is configured to splicing the video information of the different angles into a flat panoramic video
  • the spherical panoramic mapping module 3 is configured to map the planar panoramic video to a spherical panoramic video and output the spherical panoramic video.
  • the multi-angle video information is acquired by the camera array carried by the drone, the camera array includes at least five imaging devices, wherein each camera device is configured to complete video shooting of the corresponding viewing angle to obtain different Angle video information; splicing the video information of different angles into a planar panoramic video; mapping the planar panoramic video to a spherical panoramic video, and outputting the spherical panoramic video, and solving the related art virtual reality content manufacturing method Requires professional equipment and technology, high production cost, low production efficiency, and limited restrictions on the choice of virtual reality scenes, making the virtual reality content use simple equipment in the production process, high production efficiency, and difficulty in production and production cost. Lowering also makes the selection of virtual reality scenes no longer limited.
  • the method further includes: a startup module, configured to start a camera array mounted on the drone and the drone; and a storage module configured to save the multi-angle video information into the memory.
  • the planar panoramic splicing module 2 is configured to: perform video synchronization on the video information of different angles according to the synchronization feature signal, and splicing the video information of different angles after the video synchronization into a planar panoramic video.
  • the synchronization feature signal includes a synchronous noise signal.
  • the method further includes: a synchronization feature signal determining module configured to receive or set a synchronization feature signal.
  • the camera array includes six imaging devices.
  • the above product can perform the method provided by any embodiment of the present application, and has the corresponding functional modules and beneficial effects of the execution method.
  • the embodiment of the present application further provides a non-transitory storage medium, which is stored with computer executable instructions, and the computer executable instructions are configured to execute the virtual reality content generating method according to any one of the embodiments of the present application.
  • the embodiment of the present application further provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer
  • the computer is caused to execute the virtual reality content generating method according to any one of the embodiments of the present application.
  • the embodiment of the present application further provides an electronic device, where the electronic device includes: one or more processors and a memory.
  • the electronic device may further include: an input device and an output device.
  • the processor, memory, input device, and output device in the electronic device can be connected by a bus or other means.
  • the memory is a non-volatile computer readable storage medium for storing non-volatile software programs, non-volatile computer executable programs, and modules, the processor running a non-volatile software program stored in the memory , instructions and modules to perform various functional applications of the server and data processing, that is, to implement a virtual reality content generation method.
  • the embodiment of the present application provides a virtual reality content generating method and device.
  • the device makes the virtual reality content used in the manufacturing process simple, the production efficiency is high, the manufacturing difficulty and the manufacturing cost are significantly reduced, and the virtual reality scene is also selected. No longer restricted.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Processing Or Creating Images (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A method and an apparatus for generating a virtual reality content, the method comprising: acquiring multi-angle video information by means of a camera array mounted on an unmanned aerial vehicle, the camera array comprising at least five camera devices, wherein each camera device is configured to capture a video at a corresponding viewing angle so as to obtain video information from various angles; splicing the video information from various angles into a planar panoramic video; and, mapping the planar panoramic video into a spherical panoramic video, and outputting the spherical panoramic video.

Description

虚拟现实内容生成方法和装置Virtual reality content generation method and device 技术领域Technical field
本申请涉及虚拟现实技术，例如涉及一种虚拟现实内容生成方法和装置。The present application relates to virtual reality technology, for example, to a virtual reality content generation method and apparatus.
背景技术Background technique
随时科技的发展，虚拟现实技术越来越成熟，应用领域也越来越广泛。With the development of technology at any time, virtual reality technology is becoming more and more mature, and the application fields are becoming more and more extensive.
在虚拟现实领域中，有限且昂贵的虚拟现实内容是当前制约虚拟现实发展的主要原因。现行主流的虚拟现实内容制作方法，主要包括三维(three dimensional，3D)建模的方法和全景视频拍摄方法。其中，3D建模的方法为：首先建立3D虚拟现实场景模型，然后根据3D模型制作虚拟现实内容。相关技术中的虚拟现实内容主要采用3D建模以及后期渲染的方法完成，如常见的过山车虚拟现实内容等。全景视频拍摄方法为：通过专业的地面全景视频拍摄设备及拍摄团队完成虚拟现实场景的全景视频拍摄，然后把全景视频转换成虚拟现实内容。In the field of virtual reality, limited and expensive virtual reality content is the main reason for restricting the development of virtual reality. The current mainstream virtual reality content production methods mainly include three-dimensional (3D) modeling methods and panoramic video shooting methods. The method of 3D modeling is: firstly establishing a 3D virtual reality scene model, and then making virtual reality content according to the 3D model. The virtual reality content in the related art is mainly implemented by 3D modeling and post-rendering methods, such as common roller coaster virtual reality content. The panoramic video shooting method is: complete the panoramic video shooting of the virtual reality scene through the professional ground panoramic video shooting device and the shooting team, and then convert the panoramic video into virtual reality content.
在3D建模方法中，虚拟现实场景3D模型的建立需要大量的专业建模人员耗费大量的时间，往往需要一个团队才能完成，由此导致了制作成本高，制作速度有限的问题，复杂的制作方法也导致了相关技术中只有有限的虚拟现实内容可以呈现给用户，很大程度上限制了虚拟现实产业的进一步发展壮大。而全景视频拍摄的方法需要专业的全景视频地面拍摄设备以及后期的全景视频制作技术，最终才能生成虚拟现实内容。这种方法同样需要专业的制作团队耗费大量的人力物力，且适用的场景有限，对于地形复杂的地区专业的地面视频拍摄设备很难开展工作。同时，该虚拟现实制作方法效率很低。综上所述，相关技 术中的虚拟现实内容制作方法需要专业的设备和技术，制作成本高，制作效率低，而且对虚拟现实场景的选择存在限制。In the 3D modeling method, the establishment of the virtual reality scene 3D model requires a large number of professional modeling personnel to spend a lot of time, often requires a team to complete, resulting in high production costs, limited production speed, complex production The method also leads to limited virtual reality content that can be presented to users in the related art, which largely limits the further development of the virtual reality industry. The method of panoramic video shooting requires professional panoramic video ground shooting equipment and later panoramic video production technology to finally generate virtual reality content. This method also requires a large number of human and material resources for professional production teams, and the applicable scenes are limited. It is difficult to work on professional ground video shooting equipment in areas with complex terrain. At the same time, the virtual reality production method is inefficient. In summary, related technology Intra-operative virtual reality content production methods require professional equipment and technology, high production cost, low production efficiency, and restrictions on the choice of virtual reality scenes.
发明内容Summary of the invention
本申请提供了一种虚拟现实内容生成方法和装置，使得虚拟现实内容在制作过程中使用的设备简单，制作效率高且制作难度和制作成本显著降低，也使虚拟现实场景的选取不再受限。The present application provides a virtual reality content generation method and apparatus, which makes the virtual reality content use simple in the production process, high in production efficiency, and the production difficulty and the production cost are significantly reduced, and the selection of the virtual reality scene is no longer limited. .
第一方面，本申请实施例提供了一种虚拟现实内容生成方法，包括：In a first aspect, the embodiment of the present application provides a virtual reality content generating method, including:
通过无人机搭载的相机阵列获取多角度的视频信息，所述相机阵列包括至少五个摄像装置，其中，每个摄像装置设置为完成对应视角的视频拍摄以得到不同角度的视频信息；Obtaining multi-angle video information by a camera array carried by a drone, the camera array comprising at least five camera devices, wherein each camera device is configured to complete video capture of a corresponding angle of view to obtain video information of different angles;
将所述不同角度的视频信息拼接成平面全景视频；以及Splicing the different angles of video information into a flat panoramic video;
将所述平面全景视频映射为球面全景视频，并输出所述球面全景视频。The planar panoramic video is mapped to a spherical panoramic video, and the spherical panoramic video is output.
可选的，通过无人机搭载的相机阵列获取多角度的视频信息之前，还包括：Optionally, before acquiring multi-angle video information through the camera array carried by the drone, the following includes:
启动无人机和无人机搭载的相机阵列；以及Launching a camera array mounted on drones and drones;
通过无人机搭载的相机阵列获取多角度的视频信息之后，还包括：After acquiring multi-angle video information through the camera array carried by the drone, it also includes:
保存所述多角度的视频信息至存储器中。The multi-angle video information is saved to the memory.
可选的，将所述不同角度的视频信息拼接成平面全景视频包括：Optionally, the stitching the video information of different angles into a flat panoramic video includes:
根据同步特征信号将所述不同角度的视频信息进行视频同步，将视频同步后的不同角度的视频信息拼接成平面全景视频，所述同步特征信号包括同步噪声信号。The video information of the different angles is video-synchronized according to the synchronization feature signal, and the video information of different angles after the video synchronization is spliced into a planar panoramic video, where the synchronization feature signal includes a synchronization noise signal.
可选的，在启动无人机和无人机搭载的相机阵列之后，还包括： Optionally, after starting the camera array carried by the drone and the drone, it also includes:
接收或设置同步特征信号。Receive or set the sync feature signal.
可选的，所述相机阵列包括六个摄像装置。Optionally, the camera array comprises six camera devices.
第二方面，本申请实施例还提供了一种虚拟现实内容生成装置，包括：In a second aspect, the embodiment of the present application further provides a virtual reality content generating apparatus, including:
视频信息获取模块，设置为通过无人机搭载的相机阵列获取多角度的视频信息，所述相机阵列包括至少五个摄像装置，其中，每个摄像装置设置为完成对应视角的视频拍摄以得到不同角度的视频信息；a video information acquiring module configured to acquire multi-angle video information by a camera array carried by the drone, the camera array comprising at least five camera devices, wherein each camera device is configured to complete video capture of a corresponding angle of view to obtain different Angle of video information;
平面全景拼接模块，设置为将所述不同角度的视频信息拼接成平面全景视频：以及a planar panoramic splicing module configured to splicing the video information of the different angles into a flat panoramic video: and
球面全景映射模块，设置为将所述平面全景视频映射为球面全景视频，并输出所述球面全景视频。A spherical panoramic mapping module configured to map the planar panoramic video to a spherical panoramic video and output the spherical panoramic video.
可选的，还包括：Optionally, it also includes:
启动模块，设置为启动无人机和无人机搭载的相机阵列；以及a boot module that is set to activate a camera array carried by the drone and the drone;
存储模块，设置为保存所述多角度的视频信息至存储器中。a storage module configured to save the multi-angle video information into the memory.
可选的，所述平面全景拼接模块设置为：Optionally, the plane panoramic splicing module is configured to:
根据同步特征信号将所述不同角度的视频信息进行视频同步，将视频同步后的不同角度的视频信息拼接成平面全景视频，所述同步特征信号包括同步噪声信号。The video information of the different angles is video-synchronized according to the synchronization feature signal, and the video information of different angles after the video synchronization is spliced into a planar panoramic video, where the synchronization feature signal includes a synchronization noise signal.
可选的，还包括：Optionally, it also includes:
同步特征信号确定模块，设置为接收或设置同步特征信号。A synchronization feature signal determining module is configured to receive or set a synchronization feature signal.
可选的，所述相机阵列包括六个摄像装置。Optionally, the camera array comprises six camera devices.
第三方面，本申请实施例还提供了一种非暂态存储介质，存储有计算机可执行指令，所述计算机可执行指令设置为执行本申请实施例任一项所述的虚拟现实内容生成方法。 In a third aspect, the embodiment of the present application further provides a non-transitory storage medium, where computer executable instructions are set, and the computer executable instructions are configured to execute the virtual reality content generating method according to any one of the embodiments of the present application. .
第四方面，本申请实施例还提供了一种计算机程序产品，所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算机程序，所述计算机程序包括程序指令，当所述程序指令被计算机执行时，使所述计算机执行本申请实施例任一项所述的虚拟现实内容生成方法。第五方面，本申请实施例还提供一种电子设备，包括至少一个处理器和与所述至少一个处理器通信连接的存储器，所述存储器用于存储可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行时，使所述至少一个处理器执行本申请实施例任一项所述的虚拟现实内容生成方法。In a fourth aspect, the embodiment of the present application further provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program When the instruction is executed by the computer, the computer is caused to execute the virtual reality content generating method according to any one of the embodiments of the present application. In a fifth aspect, an embodiment of the present application further provides an electronic device, including at least one processor and a memory communicatively coupled to the at least one processor, the memory for storing instructions executable by the at least one processor And when the instruction is executed by the at least one processor, causing the at least one processor to execute the virtual reality content generating method according to any one of the embodiments of the present application.
本申请通过无人机搭载的相机阵列获取多角度的视频信息，所述相机阵列包括至少五个摄像装置，其中，每个摄像装置设置为完成对应视角的视频拍摄以得到不同角度的视频信息；将所述不同角度的视频信息拼接成平面全景视频；将所述平面全景视频映射为球面全景视频，并输出所述球面全景视频，解决了相关技术中的虚拟现实内容制作方法需要专业的设备和技术，制作成本高，制作效率低，而且对虚拟现实场景的选择存在限制的问题，使得虚拟现实内容在制作过程中使用的设备简单，制作效率高且制作难度和制作成本显著降低，也使虚拟现实场景的选取不再受限。The present application acquires multi-angle video information by a camera array carried by a drone, the camera array includes at least five imaging devices, wherein each camera device is configured to complete video capture of a corresponding viewing angle to obtain video information of different angles; The video information of the different angles is spliced into a planar panoramic video; the planar panoramic video is mapped to a spherical panoramic video, and the spherical panoramic video is output, and the virtual reality content manufacturing method in the related art needs professional equipment and The technology, the high production cost, the low production efficiency, and the limitation of the selection of the virtual reality scene make the virtual reality content use simple equipment in the production process, the production efficiency is high, the production difficulty and the production cost are significantly reduced, and the virtual The selection of realistic scenes is no longer limited.
附图说明DRAWINGS
图1为本申请实施例一提供的虚拟现实内容生成方法的流程图；1 is a flowchart of a method for generating a virtual reality content according to Embodiment 1 of the present application;
图2为本申请实施例二提供的虚拟现实内容生成方法的流程图；2 is a flowchart of a method for generating virtual reality content according to Embodiment 2 of the present application;
图3为本申请实施例三提供的虚拟现实内容生成装置的结构图。FIG. 3 is a structural diagram of a virtual reality content generating apparatus according to Embodiment 3 of the present application.
具体实施方式 detailed description
下面结合附图和实施例对本申请作详细说明。可以理解的是，此处所描述的可选实施例仅仅用于解释本申请，而非对本申请的限定。为了便于描述，附图中仅示出了与本申请相关的部分而非全部结构。在不冲突的情况下，以下实施例和实施例中的特征可以相互组合。The present application will be described in detail below with reference to the accompanying drawings and embodiments. It is to be understood that the alternative embodiments described herein are merely illustrative of the application and are not intended to be limiting. For the convenience of description, only some but not all of the structures related to the present application are shown in the drawings. The features of the following embodiments and embodiments may be combined with each other without conflict.
实施例一Embodiment 1
图1为本申请实施例一提供的虚拟现实内容生成方法的流程图，本实施例可适用于制作虚拟现实内容的情况，该方法可以由计算设备如台式机、笔记本电脑来执行，包括如下步骤：1 is a flowchart of a method for generating a virtual reality content according to Embodiment 1 of the present application. This embodiment may be applicable to a method for creating virtual reality content. The method may be performed by a computing device, such as a desktop computer or a notebook computer, and includes the following steps. :
步骤101、通过无人机搭载的相机阵列获取多角度的视频信息。Step 101: Acquire multi-angle video information by using a camera array mounted on the drone.
其中，该相机阵列包括至少五个摄像装置，其中，每个摄像装置设置为完成对应视角的视频拍摄以得到不同角度的视频信息。相机阵列由多个摄像装置和用于固定该摄像装置的部件组成，示例性的，该相机阵列挂载在无人机下方，随着无人机的飞行，安装的多个摄像装置同时进行视频信息的拍摄。示例性的，当相机阵列中包含五个摄像装置时，该相机阵列的结构形状可以是五面体形状，其中每个摄像装置安装在五面体中的一个面中，并获取该面所朝向的位置区域的视频画面。Wherein, the camera array comprises at least five camera devices, wherein each camera device is configured to complete video capture of a corresponding angle of view to obtain video information of different angles. The camera array is composed of a plurality of camera devices and components for fixing the camera device. Illustratively, the camera array is mounted under the drone, and the plurality of camera devices installed simultaneously perform video along with the flight of the drone. Shooting of information. Exemplarily, when five camera devices are included in the camera array, the camera array may have a structural shape of a pentahedron shape, wherein each camera device is mounted in one of the pentahedrons and acquires a position facing the face. The video of the area.
本方案中，该相机阵列包括至少五个摄像装置，随着摄像装置的增加获取的各个角度的视频信息越多，更加利于后续视频信息的拼接，同时可提高视频信息的拼接效果，摄像装置数量可根据不同场景不同需求适应性设置，不受本实施例限制。本步骤中，通过无人机搭载相机阵列获取多角度的视频信息克服了虚拟现实内容场景在选取时的受限问题，随着无人机技术的发展无人机飞行的稳定性和对复杂飞行环境的适应性，更加提高了本方案的应用前景。In the solution, the camera array includes at least five imaging devices, and the more video information of various angles acquired with the increase of the imaging device, is more conducive to the splicing of subsequent video information, and at the same time, the splicing effect of the video information can be improved, and the number of imaging devices is increased. The adaptability setting can be different according to different scenarios, and is not limited by this embodiment. In this step, the multi-angle video information acquired by the unmanned aerial vehicle camera array overcomes the limited problem of the virtual reality content scene when it is selected. With the development of the drone technology, the stability of the drone flight and the complex flight The adaptability of the environment has further improved the application prospects of this program.
步骤102、将所述不同角度的视频信息拼接成平面全景视频。 Step 102: splicing the video information of different angles into a flat panoramic video.
当在步骤101中通过无人机搭载的相机阵列获取多角度的视频信息后，本步骤中，将各个角度的视频信息拼接成平面全景视频。由于该平面全景视频包含了各个角度的视频信息，故包含了全景的虚拟现实内容。本方案中，选取至少五个摄像装置对不同角度进行拍摄，目的在于保证各个角度下视频信息内容具有足够的、均匀的重合部分以用于本步骤中的拼接。After the multi-angle video information is acquired by the camera array carried by the drone in step 101, in this step, the video information of each angle is spliced into a planar panoramic video. Since the flat panoramic video contains video information of various angles, it includes panoramic virtual reality content. In the solution, at least five camera devices are selected to shoot different angles, so as to ensure that the video information content has sufficient and uniform overlapping portions at each angle for the splicing in this step.
示例性的，在视频信息拼接过程中，可分别选取各个角度的视频信息中在同一时刻的帧画面，将连续的帧画面分别进行拼接以最终得到平面全景视频。可选的，拼接得到平面全景视频的步骤依次包括：摄相装置的标定、传感器图像畸变校正、图像的投影变换、匹配点选取以及亮度与颜色的均衡处理等。For example, in the process of splicing the video information, the frame images at the same time in the video information of the respective angles may be respectively selected, and the consecutive frame images are separately spliced to finally obtain the planar panoramic video. Optionally, the step of splicing and obtaining the planar panoramic video includes: calibration of the camera, sensor image distortion correction, image projection transformation, matching point selection, and brightness and color equalization processing.
可选的，可通过视频信息拼接软件进行拼接以得到平面全景视频，该方案仅需输入各个角度的视频信息即可得到最终的平面全景视频，简单易行。Optionally, the video information splicing software can be used for splicing to obtain a planar panoramic video. The solution only needs to input the video information of each angle to obtain the final planar panoramic video, which is simple and easy.
步骤103、将所述平面全景视频映射为球面全景视频，并输出所述球面全景视频。Step 103: Map the planar panoramic video to a spherical panoramic video, and output the spherical panoramic video.
可选的，通过使用球面全景视频制作软件，如Unity3D通过平面全景视频得到对应的球面全景视频。其中，该球面全景视频作为虚拟现实内容可用于后续虚拟现实应用的制作。Optionally, the corresponding spherical panoramic video is obtained through a flat panoramic video by using a spherical panoramic video production software such as Unity3D. The spherical panoramic video can be used as a virtual reality content for subsequent virtual reality application.
本实施例的技术方案，通过无人机搭载的相机阵列获取多角度的视频信息，所述相机阵列包括至少五个摄像装置，其中，每个摄像装置设置为完成对应视角的视频拍摄以得到不同角度的视频信息；将所述不同角度的视频信息拼接成平面全景视频；将所述平面全景视频映射为球面全景视频，并输出所述球面全景视频，解决了相关技术中的虚拟现实内容制作方法需要专业的设备和技术，制作成本高，制作效率低，而且对虚拟现实场景的选择存在限制的问题，使得虚拟现实内容在制作过程中使用的设备简单，制作效率高且制作难度和制 作成本显著降低，也使虚拟现实场景的选取不再受限。In the technical solution of the embodiment, the multi-angle video information is acquired by the camera array carried by the drone, the camera array includes at least five imaging devices, wherein each camera device is configured to complete video shooting of the corresponding viewing angle to obtain different Angle video information; splicing the video information of different angles into a planar panoramic video; mapping the planar panoramic video to a spherical panoramic video, and outputting the spherical panoramic video, and solving the related art virtual reality content manufacturing method Requires professional equipment and technology, high production cost, low production efficiency, and restrictions on the choice of virtual reality scenes, making the virtual reality content use simple in the production process, high production efficiency and difficulty in making The cost of the work is significantly reduced, and the selection of virtual reality scenes is no longer limited.
在上述技术方案的基础上，通过无人机搭载的相机阵列获取多角度的视频信息之前，还包括：启动无人机和无人机搭载的相机阵列；通过无人机搭载的相机阵列获取多角度的视频信息之后，还包括：保存所述多角度的视频信息至存储器中。示例性的，通过地面遥控器或地面终端控制设备启动无人机开始飞行，同时控制无人机搭载的相机阵列开始获取视频图像，并将获取到的视频信息保存至存储器中作为原始数据用于后续虚拟现实内容的生成。示例性的，不同角度的视频信息可分别存储在各自摄像装置的存储器中，还可以是将所有不同角度的视频信息统一存储在同一存储器中。Based on the above technical solution, before acquiring multi-angle video information through the camera array mounted on the drone, the method further includes: starting a camera array mounted on the drone and the drone; acquiring more through the camera array mounted on the drone After the video information of the angle, the method further includes: saving the multi-angle video information into the memory. Exemplarily, the drone is started by the ground remote controller or the ground terminal control device to start the flight, and the camera array mounted on the drone is controlled to start acquiring the video image, and the acquired video information is saved into the memory as the original data. Subsequent generation of virtual reality content. Exemplarily, the video information of different angles may be stored in the memory of the respective camera device, or the video information of all different angles may be uniformly stored in the same memory.
实施例二Embodiment 2
图2为本申请实施例二提供的虚拟现实内容生成方法的流程图，本实施例在实施例一的基础上，给出了一种使用同步特征信号进行平面全景视频拼接的方法，包括：2 is a flowchart of a method for generating a virtual reality content according to a second embodiment of the present application. On the basis of the first embodiment, a method for performing planar panoramic video splicing using a synchronization feature signal is provided.
步骤201、通过无人机搭载的相机阵列获取多角度的视频信息。Step 201: Acquire multi-angle video information by using a camera array mounted on the drone.
步骤202、根据同步特征信号将所述不同角度的视频信息进行视频同步，将视频同步后的不同角度的视频信息拼接成平面全景视频。Step 202: Perform video synchronization on the video information of different angles according to the synchronization feature signal, and splicing the video information of different angles after the video synchronization into a planar panoramic video.
其中，在视频信息拼接过程中需要对各个摄像装置得到的视频信息进行同步以确定在同一时间点的情况下对各个视频信息进行拼接以得到平面全景视频。本步骤中，根据同步特征信号将所述不同角度的视频信息进行视频同步，可以方便的解决拼接过程中视频信息的同步问题，示例性的，该同步特征信号包括同步噪声信号。可选的，当无人机搭载相机阵列获取多角度的视频信息时，可通过发生器制造一噪声，将该噪声作为同步特征信号。 In the video information splicing process, the video information obtained by each camera device needs to be synchronized to determine that the video information is spliced to obtain a planar panoramic video at the same time point. In this step, the video information of the different angles is video-synchronized according to the synchronization feature signal, which can conveniently solve the synchronization problem of the video information in the splicing process. Illustratively, the synchronization feature signal includes a synchronous noise signal. Optionally, when the drone is equipped with the camera array to acquire multi-angle video information, a noise can be generated by the generator, and the noise is used as a synchronization feature signal.
步骤203、将所述平面全景视频映射为球面全景视频，并输出所述球面全景视频。Step 203: Map the planar panoramic video to a spherical panoramic video, and output the spherical panoramic video.
本实施例的技术方案，通过无人机搭载的相机阵列获取多角度的视频信息，所述相机阵列包括至少五个摄像装置，其中，每个摄像装置设置为完成对应视角的视频拍摄以得到不同角度的视频信息；根据同步特征信号将所述不同角度的视频信息进行视频同步，将视频同步后的不同角度的视频信息拼接成平面全景视频，所述同步特征信号包括同步噪声信号；将所述平面全景视频映射为球面全景视频，并输出所述球面全景视频，解决了相关技术中的虚拟现实内容制作方法需要专业的设备和技术，制作成本高，制作效率低，而且对虚拟现实场景的选择存在限制的问题，使得虚拟现实内容在制作过程中使用的设备简单，制作效率高且制作难度和制作成本显著降低，也使虚拟现实场景的选取不再受限。In the technical solution of the embodiment, the multi-angle video information is acquired by the camera array carried by the drone, the camera array includes at least five imaging devices, wherein each camera device is configured to complete video shooting of the corresponding viewing angle to obtain different The video information of the angle; the video information of the different angles is video-synchronized according to the synchronization feature signal, and the video information of different angles after the video synchronization is spliced into a planar panoramic video, wherein the synchronization feature signal includes a synchronous noise signal; The planar panoramic video is mapped into a spherical panoramic video, and the spherical panoramic video is output, which solves the related art in the virtual reality content production method, which requires professional equipment and technology, high production cost, low production efficiency, and selection of virtual reality scenes. There is a limitation problem, which makes the virtual reality content use equipment in the production process simple, the production efficiency is high, the production difficulty and the production cost are significantly reduced, and the selection of the virtual reality scene is no longer limited.
在上述各个实施例的基础上，在启动无人机和无人机搭载的相机阵列之后，还包括：接收或设置同步特征信号。该同步特征信号可以是外部提供或发出的噪音信号，还可以是自身设置的在固定时间点处的同步特征信号。Based on the foregoing various embodiments, after starting the camera array carried by the drone and the drone, the method further includes: receiving or setting a synchronization feature signal. The synchronization feature signal may be a noise signal externally provided or emitted, or may be a synchronization feature signal set at a fixed time point.
在上述各个实施例的基础上，所述相机阵列包括六个摄像装置。当采用六个摄像装置时可以较好的对虚拟现实内容进行展示，同时器件成本和安装成本较低。Based on the various embodiments described above, the camera array includes six camera devices. When six camera devices are used, the virtual reality content can be better displayed, and the device cost and installation cost are low.
实施例三 Embodiment 3
图3所示为本申请实施例三提供的虚拟现实内容生成装置的结构图，包括：FIG. 3 is a structural diagram of a virtual reality content generating apparatus according to Embodiment 3 of the present application, including:
视频信息获取模块1，设置为通过无人机搭载的相机阵列获取多角度的视 频信息，所述相机阵列包括至少五个摄像装置，其中，每个摄像装置设置为完成对应视角的视频拍摄以得到不同角度的视频信息；The video information acquisition module 1 is configured to acquire a multi-angle view through a camera array mounted on the drone Frequency information, the camera array includes at least five camera devices, wherein each camera device is configured to complete video capture of a corresponding viewing angle to obtain video information of different angles;
平面全景拼接模块2，设置为将所述不同角度的视频信息拼接成平面全景视频；The planar panoramic splicing module 2 is configured to splicing the video information of the different angles into a flat panoramic video;
球面全景映射模块3，设置为将所述平面全景视频映射为球面全景视频，并输出所述球面全景视频。The spherical panoramic mapping module 3 is configured to map the planar panoramic video to a spherical panoramic video and output the spherical panoramic video.
本实施例的技术方案，通过无人机搭载的相机阵列获取多角度的视频信息，所述相机阵列包括至少五个摄像装置，其中，每个摄像装置设置为完成对应视角的视频拍摄以得到不同角度的视频信息；将所述不同角度的视频信息拼接成平面全景视频；将所述平面全景视频映射为球面全景视频，并输出所述球面全景视频，解决了相关技术中的虚拟现实内容制作方法需要专业的设备和技术，制作成本高，制作效率低，而且对虚拟现实场景的选择存在限制的问题，使得虚拟现实内容在制作过程中使用的设备简单，制作效率高且制作难度和制作成本显著降低，也使虚拟现实场景的选取不再受限。In the technical solution of the embodiment, the multi-angle video information is acquired by the camera array carried by the drone, the camera array includes at least five imaging devices, wherein each camera device is configured to complete video shooting of the corresponding viewing angle to obtain different Angle video information; splicing the video information of different angles into a planar panoramic video; mapping the planar panoramic video to a spherical panoramic video, and outputting the spherical panoramic video, and solving the related art virtual reality content manufacturing method Requires professional equipment and technology, high production cost, low production efficiency, and limited restrictions on the choice of virtual reality scenes, making the virtual reality content use simple equipment in the production process, high production efficiency, and difficulty in production and production cost. Lowering also makes the selection of virtual reality scenes no longer limited.
在上述技术方案的基础上，还包括：启动模块，设置为启动无人机和无人机搭载的相机阵列；存储模块，设置为保存所述多角度的视频信息至存储器中。In addition to the above technical solution, the method further includes: a startup module, configured to start a camera array mounted on the drone and the drone; and a storage module configured to save the multi-angle video information into the memory.
在上述技术方案的基础上，所述平面全景拼接模块2设置为：根据同步特征信号将所述不同角度的视频信息进行视频同步，将视频同步后的不同角度的视频信息拼接成平面全景视频，所述同步特征信号包括同步噪声信号。On the basis of the foregoing technical solution, the planar panoramic splicing module 2 is configured to: perform video synchronization on the video information of different angles according to the synchronization feature signal, and splicing the video information of different angles after the video synchronization into a planar panoramic video. The synchronization feature signal includes a synchronous noise signal.
在上述技术方案的基础上，还包括：同步特征信号确定模块，设置为接收或设置同步特征信号。Based on the foregoing technical solution, the method further includes: a synchronization feature signal determining module configured to receive or set a synchronization feature signal.
在上述技术方案的基础上，所述相机阵列包括六个摄像装置。 Based on the above technical solution, the camera array includes six imaging devices.
上述产品可执行本申请任意实施例所提供的方法，具备执行方法相应的功能模块和有益效果。The above product can perform the method provided by any embodiment of the present application, and has the corresponding functional modules and beneficial effects of the execution method.
本申请实施例还提供了一种非暂态存储介质，存储有计算机可执行指令，所述计算机可执行指令设置为执行本申请实施例任一项所述的虚拟现实内容生成方法。The embodiment of the present application further provides a non-transitory storage medium, which is stored with computer executable instructions, and the computer executable instructions are configured to execute the virtual reality content generating method according to any one of the embodiments of the present application.
本申请实施例还提供了一种计算机程序产品，所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算机程序，所述计算机程序包括程序指令，当所述程序指令被计算机执行时，使所述计算机执行本申请实施例任一项所述的虚拟现实内容生成方法。The embodiment of the present application further provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer The computer is caused to execute the virtual reality content generating method according to any one of the embodiments of the present application.
本申请实施例还提供了一种电子设备，该电子设备包括：一个或多个处理器以及存储器。The embodiment of the present application further provides an electronic device, where the electronic device includes: one or more processors and a memory.
电子设备还可以包括：输入装置和输出装置。The electronic device may further include: an input device and an output device.
电子设备中的处理器、存储器、输入装置和输出装置可以通过总线或者其他方式连接。The processor, memory, input device, and output device in the electronic device can be connected by a bus or other means.
存储器作为一种非易失性计算机可读存储介质，可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块，处理器通过运行存储在存储器中的非易失性软件程序、指令以及模块，从而执行服务器的各种功能应用以及数据处理，即实现虚拟现实内容生成方法。The memory is a non-volatile computer readable storage medium for storing non-volatile software programs, non-volatile computer executable programs, and modules, the processor running a non-volatile software program stored in the memory , instructions and modules to perform various functional applications of the server and data processing, that is, to implement a virtual reality content generation method.
注意，上述仅为本申请的可选实施例及所运用技术原理。本领域技术人员会理解，本申请可以为这里所述的可选实施例，对本领域技术人员来说能够进行各种变化、重新调整和替代而不会脱离本申请的保护范围。因此，虽然通过以上实施例对本申请进行了较为详细的说明，但是本申请不仅仅限于以上实施例，在不脱离本申请构思的情况下，还可以包括更多其他等效实施例，而本申 请的范围由所附的权利要求范围决定。Note that the above are only optional embodiments of the present application and the technical principles applied thereto. Those skilled in the art will appreciate that the present application is susceptible to various modifications, adaptations and substitutions of the present invention without departing from the scope of the invention. Therefore, although the present application has been described in detail by the above embodiments, the present application is not limited to the above embodiments, and other equivalent embodiments may be included without departing from the concept of the present application. The scope of the claims is determined by the scope of the appended claims.
工业实用性Industrial applicability
本申请实施例提供了一种虚拟现实内容生成方法和装置，本方案使得虚拟现实内容在制作过程中使用的设备简单，制作效率高且制作难度和制作成本显著降低，也使虚拟现实场景的选取不再受限。 The embodiment of the present application provides a virtual reality content generating method and device. The device makes the virtual reality content used in the manufacturing process simple, the production efficiency is high, the manufacturing difficulty and the manufacturing cost are significantly reduced, and the virtual reality scene is also selected. No longer restricted.

Claims (13)

  1. 一种虚拟现实内容生成方法，包括：A method for generating virtual reality content, comprising:
    通过无人机搭载的相机阵列获取多角度的视频信息，所述相机阵列包括至少五个摄像装置，其中，每个摄像装置设置为完成对应视角的视频拍摄以得到不同角度的视频信息；Obtaining multi-angle video information by a camera array carried by a drone, the camera array comprising at least five camera devices, wherein each camera device is configured to complete video capture of a corresponding angle of view to obtain video information of different angles;
    将所述不同角度的视频信息拼接成平面全景视频；以及Splicing the different angles of video information into a flat panoramic video;
    将所述平面全景视频映射为球面全景视频，并输出所述球面全景视频。The planar panoramic video is mapped to a spherical panoramic video, and the spherical panoramic video is output.
  2. 根据权利要求1所述的方法，通过无人机搭载的相机阵列获取多角度的视频信息之前，还包括：The method of claim 1, before acquiring the multi-angle video information by the camera array carried by the drone, further comprising:
    启动无人机和无人机搭载的相机阵列；以及Launching a camera array mounted on drones and drones;
    通过无人机搭载的相机阵列获取多角度的视频信息之后，还包括：After acquiring multi-angle video information through the camera array carried by the drone, it also includes:
    保存所述多角度的视频信息至存储器中。The multi-angle video information is saved to the memory.
  3. 根据权利要求2所述的方法，其中，将所述不同角度的视频信息拼接成平面全景视频包括：The method of claim 2, wherein splicing the different angles of video information into a planar panoramic video comprises:
    根据同步特征信号将所述不同角度的视频信息进行视频同步，将视频同步后的不同角度的视频信息拼接成平面全景视频，所述同步特征信号包括同步噪声信号。The video information of the different angles is video-synchronized according to the synchronization feature signal, and the video information of different angles after the video synchronization is spliced into a planar panoramic video, where the synchronization feature signal includes a synchronization noise signal.
  4. 根据权利要求3所述的方法，在启动无人机和无人机搭载的相机阵列之后，还包括：The method of claim 3, after starting the camera array carried by the drone and the drone, further comprising:
    接收或设置同步特征信号。Receive or set the sync feature signal.
  5. 根据权利要求1-4中任一项所述的方法，其中，所述相机阵列包括六个摄像装置。The method of any of claims 1-4, wherein the camera array comprises six camera devices.
  6. 一种虚拟现实内容生成装置，包括：A virtual reality content generating apparatus includes:
    视频信息获取模块，设置为通过无人机搭载的相机阵列获取多角度的视频 信息，所述相机阵列包括至少五个摄像装置，其中，每个摄像装置设置为完成对应视角的视频拍摄以得到不同角度的视频信息；Video information acquisition module, configured to acquire multi-angle video through a camera array mounted on the drone Information, the camera array includes at least five camera devices, wherein each camera device is configured to complete video capture of a corresponding viewing angle to obtain video information of different angles;
    平面全景拼接模块，设置为将所述不同角度的视频信息拼接成平面全景视频；以及a planar panoramic splicing module configured to splicing the video information of the different angles into a flat panoramic video;
    球面全景映射模块，设置为将所述平面全景视频映射为球面全景视频，并输出所述球面全景视频。A spherical panoramic mapping module configured to map the planar panoramic video to a spherical panoramic video and output the spherical panoramic video.
  7. 根据权利要求6所述的装置，还包括：The apparatus of claim 6 further comprising:
    启动模块，设置为启动无人机和无人机搭载的相机阵列；以及a boot module that is set to activate a camera array carried by the drone and the drone;
    存储模块，设置为保存所述多角度的视频信息至存储器中。a storage module configured to save the multi-angle video information into the memory.
  8. 根据权利要求7所述的装置，其中，所述平面全景拼接模块设置为：The apparatus of claim 7, wherein the planar panoramic splicing module is configured to:
    根据同步特征信号将所述不同角度的视频信息进行视频同步，将视频同步后的不同角度的视频信息拼接成平面全景视频，所述同步特征信号包括同步噪声信号。The video information of the different angles is video-synchronized according to the synchronization feature signal, and the video information of different angles after the video synchronization is spliced into a planar panoramic video, where the synchronization feature signal includes a synchronization noise signal.
  9. 根据权利要求8所述的装置，还包括：The apparatus of claim 8 further comprising:
    同步特征信号确定模块，设置为接收或设置同步特征信号。A synchronization feature signal determining module is configured to receive or set a synchronization feature signal.
  10. 根据权利要求6-9中任一项所述的装置，其中，所述相机阵列包括六个摄像装置。The apparatus of any of claims 6-9, wherein the camera array comprises six camera devices.
  11. 一种非暂态存储介质，存储有计算机可执行指令，所述计算机可执行指令设置为执行权利要求1至5任一项所述的虚拟现实内容生成方法。A non-transitory storage medium storing computer executable instructions, the computer executable instructions being arranged to perform the virtual reality content generation method of any one of claims 1 to 5.
  12. 一种计算机程序产品，所述计算机程序产品包括存储在非暂态计算机可读存储介质上的计算机程序，所述计算机程序包括程序指令，当所述程序指令被计算机执行时，使所述计算机执行权利要求1至5任一项所述的虚拟现实内容生成方法。A computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions that, when executed by a computer, cause the computer to execute The virtual reality content generating method according to any one of claims 1 to 5.
  13. 一种电子设备，包括至少一个处理器和与所述至少一个处理器通信连接的存储器，所述存储器用于存储可被所述至少一个处理器执行的指令，所述 指令被所述至少一个处理器执行时，使所述至少一个处理器执行权利要求1至5任一项所述的虚拟现实内容生成方法。 An electronic device comprising at least one processor and a memory communicatively coupled to the at least one processor, the memory for storing instructions executable by the at least one processor, The instructions, when executed by the at least one processor, cause the at least one processor to execute the virtual reality content generating method of any one of claims 1 to 5.
PCT/CN2016/102276 2016-08-12 2016-10-17 Virtual reality content generation method and apparatus WO2018028048A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610663492.1A CN106303497A (en) 2016-08-12 2016-08-12 A kind of virtual reality content generating method and device
CN201610663492.1 2016-08-12

Publications (1)

Publication Number Publication Date
WO2018028048A1 true WO2018028048A1 (en) 2018-02-15

Family

ID=57669494

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/102276 WO2018028048A1 (en) 2016-08-12 2016-10-17 Virtual reality content generation method and apparatus

Country Status (2)

Country Link
CN (1) CN106303497A (en)
WO (1) WO2018028048A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109040601A (en) * 2018-09-05 2018-12-18 清华-伯克利深圳学院筹备办公室 A kind of multiple dimensioned non-structured 1,000,000,000 pixel VR panoramic shooting system
CN114827749A (en) * 2022-04-21 2022-07-29 应急管理部天津消防研究所 Method for seamless switching and playing of multi-view panoramic video

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110786008A (en) * 2018-07-25 2020-02-11 深圳市大疆创新科技有限公司 Method for shooting image and mobile platform
CN109389042A (en) * 2018-09-07 2019-02-26 百度在线网络技术（北京）有限公司 Assist method, equipment, unmanned equipment and the readable storage medium storing program for executing driven
CN109389056B (en) * 2018-09-21 2020-05-26 北京航空航天大学 Space-based multi-view-angle collaborative track surrounding environment detection method
CN109769104B (en) * 2018-10-26 2021-02-05 江苏四友信息技术有限公司 Unmanned aerial vehicle panoramic image transmission method and device
CN112616018B (en) * 2020-12-15 2022-03-11 深圳市普汇智联科技有限公司 Stackable panoramic video real-time splicing method
CN116605262B (en) * 2023-07-07 2024-04-05 中国铁道科学研究院集团有限公司电子计算技术研究所 Beyond-sight safety early warning method and system for train operation

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100060793A1 (en) * 2008-09-07 2010-03-11 Sportvu Ltd. Method and system for fusing video streams
CN101963751A (en) * 2010-08-19 2011-02-02 西北工业大学 Device and method for acquiring high-resolution full-scene image in high dynamic range in real time
US20110149093A1 (en) * 2009-12-18 2011-06-23 Electronics And Telecommunications Research Instit Method and apparatus for automatic control of multiple cameras
CN103607568A (en) * 2013-11-20 2014-02-26 深圳先进技术研究院 Stereo street scene video projection method and system
CN104103081A (en) * 2014-07-14 2014-10-15 西安电子科技大学 Virtual multi-camera target tracking video material generation method
CN104519314A (en) * 2013-12-25 2015-04-15 柳州桂通科技有限公司 Quick acquisition method of panoramic information of accident site
CN105163158A (en) * 2015-08-05 2015-12-16 北京奇艺世纪科技有限公司 Image processing method and device
CN105704501A (en) * 2016-02-06 2016-06-22 普宙飞行器科技（深圳）有限公司 Unmanned plane panorama video-based virtual reality live broadcast system
CN105791810A (en) * 2016-04-27 2016-07-20 深圳市高巨创新科技开发有限公司 Virtual stereo display method and device

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101136022A (en) * 2006-09-01 2008-03-05 李筑 Panorama manufacturing and displaying system of resource information
CN101146231A (en) * 2007-07-03 2008-03-19 浙江大学 Method for generating panoramic video according to multi-visual angle video stream
CN101877767A (en) * 2009-04-30 2010-11-03 爱国者全景(北京)网络科技发展有限公司 Method and system for generating three-dimensional panoramic continuous video through six-channel video source
CN101938605A (en) * 2009-06-30 2011-01-05 爱国者全景(北京)网络科技发展有限公司 Method for generating panoramic video
CN101938599A (en) * 2009-06-30 2011-01-05 爱国者全景(北京)网络科技发展有限公司 Method for generating interactive dynamic panoramic image
US9407904B2 (en) * 2013-05-01 2016-08-02 Legend3D, Inc. Method for creating 3D virtual reality from 2D images
CN202814399U (en) * 2012-09-27 2013-03-20 王桥生 System available for stereo image aerial device
CN103973944A (en) * 2013-02-06 2014-08-06 深圳市振华微电子有限公司 Hemispherical omnidirectional imaging device and hemispherical omnidirectional imaging method
CN103309444A (en) * 2013-03-14 2013-09-18 江南大学 Kinect-based intelligent panoramic display method
CN103543831A (en) * 2013-10-25 2014-01-29 梁权富 Head-mounted panoramic player
CN105635551B (en) * 2014-10-29 2019-03-26 浙江大华技术股份有限公司 A kind of ball-shaped camera generates the method and ball-shaped camera of panoramic picture
CN104616342B (en) * 2015-02-06 2017-07-25 北京明兰网络科技有限公司 The method for mutually conversing of sequence frame and panorama
CN205263655U (en) * 2015-08-03 2016-05-25 余江 A system, Unmanned vehicles and ground satellite station for automatic generation panoramic photograph
CN105045279A (en) * 2015-08-03 2015-11-11 余江 System and method for automatically generating panorama photographs through aerial photography of unmanned aerial aircraft
CN105809729B (en) * 2016-03-04 2019-04-26 深圳华强数码电影有限公司 A kind of spherical panorama rendering method of virtual scene

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100060793A1 (en) * 2008-09-07 2010-03-11 Sportvu Ltd. Method and system for fusing video streams
US20110149093A1 (en) * 2009-12-18 2011-06-23 Electronics And Telecommunications Research Instit Method and apparatus for automatic control of multiple cameras
CN101963751A (en) * 2010-08-19 2011-02-02 西北工业大学 Device and method for acquiring high-resolution full-scene image in high dynamic range in real time
CN103607568A (en) * 2013-11-20 2014-02-26 深圳先进技术研究院 Stereo street scene video projection method and system
CN104519314A (en) * 2013-12-25 2015-04-15 柳州桂通科技有限公司 Quick acquisition method of panoramic information of accident site
CN104103081A (en) * 2014-07-14 2014-10-15 西安电子科技大学 Virtual multi-camera target tracking video material generation method
CN105163158A (en) * 2015-08-05 2015-12-16 北京奇艺世纪科技有限公司 Image processing method and device
CN105704501A (en) * 2016-02-06 2016-06-22 普宙飞行器科技（深圳）有限公司 Unmanned plane panorama video-based virtual reality live broadcast system
CN105791810A (en) * 2016-04-27 2016-07-20 深圳市高巨创新科技开发有限公司 Virtual stereo display method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109040601A (en) * 2018-09-05 2018-12-18 清华-伯克利深圳学院筹备办公室 A kind of multiple dimensioned non-structured 1,000,000,000 pixel VR panoramic shooting system
CN114827749A (en) * 2022-04-21 2022-07-29 应急管理部天津消防研究所 Method for seamless switching and playing of multi-view panoramic video

Also Published As

Publication number Publication date
CN106303497A (en) 2017-01-04

Similar Documents

Publication Publication Date Title
WO2018028048A1 (en) Virtual reality content generation method and apparatus
US10275898B1 (en) Wedge-based light-field video capture
CN110675483B (en) Dense vision SLAM-based rapid reconstruction method for three-dimensional map of unmanned aerial vehicle
US10477117B2 (en) Digital camera with audio, visual and motion analysis
WO2019085022A1 (en) Generation method and device for optical field 3d display unit image
CN106558103A (en) Augmented reality image processing system and augmented reality image processing method
US9697581B2 (en) Image processing apparatus and image processing method
CN110610546B (en) Video picture display method, device, terminal and storage medium
WO2022141294A1 (en) Simulation test method and system, simulator, storage medium, and program product
WO2018133757A1 (en) Method and device for rendering scene, and storage medium
CN112367426A (en) Virtual object display method and device, storage medium and electronic equipment
CN108399634B (en) RGB-D data generation method and device based on cloud computing
JP2019045991A (en) Generation device, generation method and program
WO2017092432A1 (en) Method, device, and system for virtual reality interaction
CN108648141A (en) A kind of image split-joint method and device
WO2022142908A1 (en) Three-dimensional model generation method, xr device and storage medium
WO2020071849A1 (en) Method for producing detailed 360 image by using actual measurement depth information
JP2021152935A (en) Information visualization system, information visualization method, and program
WO2022160406A1 (en) Implementation method and system for internet of things practical training system based on augmented reality technology
CN115002345B (en) Image correction method, device, electronic equipment and storage medium
CN110837297B (en) Information processing method and AR equipment
JP3631117B2 (en) Video processing apparatus and method, and storage medium
JP6967150B2 (en) Learning device, image generator, learning method, image generation method and program
CN108769524B (en) Aerial 720-degree aerial photography panoramic comparison method for unmanned aerial vehicle
CN114452646A (en) Virtual object perspective processing method and device and computer equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16912502

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16912502

Country of ref document: EP

Kind code of ref document: A1