WO2017143756A1

WO2017143756A1 - Method and system for recording and playing panoramic video in real time

Info

Publication number: WO2017143756A1
Application number: PCT/CN2016/097635
Authority: WO
Inventors: 姜文杰; 刘靖康
Original assignee: 深圳岚锋创视网络科技有限公司
Priority date: 2016-02-24
Filing date: 2016-08-31
Publication date: 2017-08-31
Also published as: CN107124618A

Abstract

A system and method for recording and playing a panoramic video in real time. Data from a sound card (1) and a plurality of cameras (2) is stored in a memory (3). A processor (4) obtains the data of the sound card (1) from the memory (3), and transfers the data to an audio encoder (5). The processor (4) obtains the data of the plurality of cameras (2) from the memory (3), and transfers the data to a plurality of picture decoders (6). The audio encoder (5) encodes the data of the sound card (1) to obtain an audio data stream. A picture decoder (6) corresponding to each camera decodes image data of a corresponding camera to obtain image data of each camera. The processor (4) synthesizes the decoded image data from the plurality of cameras (2), and transmits the synthesized image data to a video encoder (7) to obtain a video data stream. The processor (4) synthesizes the audio data stream and the video data stream to generate a playable multimedia file. In this way, it is unnecessary to use a plurality of cameras, so that costs are reduced and a spliced panoramic video can be watched in real time.

Description

Real-time panoramic video recording and broadcasting method and system

Technical field

[0001] The present invention relates to a video recording and broadcasting method and system, and in particular to a method and system for realizing panoramic video recording and broadcasting.

Background technique

[0002] At present, a common panoramic camera generally consists of a plurality of lenses, and the panoramic camera stores the videos captured by the multiple lenses separately, and then exports them to a computer for synthesizing the panoramic video. At present, the panoramic video recording and broadcasting system adopts the methods of pre-shooting and post-synthesis, and has the disadvantages of high shooting cost, complicated deployment, and long post-production cycle.

The present invention aims to provide a method and system for realizing panoramic video recording and broadcasting to solve the problems and defects of the current panoramic video recording and broadcasting system.

technical problem

[0004] The present invention aims to provide a method and system for realizing panoramic video recording and broadcasting, and reducing the cost of the peer can also effectively view the stitched panoramic video, thereby solving the problems and defects of the current panoramic video recording and broadcasting system. s solution

Technical solution

[0005] One embodiment of the present invention provides a real panoramic video recording system including a sound card, a plurality of cameras, a memory, a processor, an audio encoder, a plurality of picture decoders, and a video encoder, from a sound card and The data of the plurality of cameras is stored in the memory, the processor acquires the data from the sound card from the memory and transmits it to the audio encoder, and the processor acquires data from the plurality of cameras from the memory and transmits the data to the plurality of pictures. The decoder, the audio encoder encodes the data from the sound card to obtain an audio data stream, and the corresponding picture decoder of each camera decodes the picture data of the corresponding camera to obtain image data of each camera, and the processor synthesizes decoding from multiple cameras. The subsequent image data is sent to the video encoder to obtain a video data stream, and the processor combines the audio data stream from the audio encoder and the video data stream from the video encoder to form a playable multimedia file. . According to the above-mentioned one embodiment of the present invention, a video system for playing a video in which the multimedia file that can be played is a file in the MP4 format.

According to one embodiment of the present invention, there is provided a real panoramic video recording and broadcasting system, wherein each of the plurality of cameras and the plurality of picture decoders is two, and each camera corresponds to one picture decoder.

According to the above-described one embodiment of the present invention, a plurality of cameras are all fisheye lenses, and the fisheye images respectively captured are stored in a memory.

Another embodiment of the present invention provides a method for video recording and broadcasting of a panoramic video, which includes the following steps.

[0010] collecting sound card data and encoding the sound card data to obtain an audio data stream;

[0011] collecting data from a plurality of cameras, decoding data of each camera, obtaining image data of each camera, synthesizing decoded image data from a plurality of cameras, and sending the synthesized image data to an encoder to obtain video data. Flow;

[0012] Combining the audio data stream and the video data stream to form a playable multimedia file.

[0013] According to another embodiment of the present invention, a live panoramic video recording and broadcasting method, wherein a playable multimedia file is a file in an MP4 format.

According to another embodiment of the present invention, there is provided a real panoramic video recording and broadcasting method, wherein each of the plurality of cameras and the plurality of picture decoders is two, and each camera corresponds to one picture decoder.

[0015] According to another embodiment of the present invention, a panoramic video recording and broadcasting method is provided, wherein a plurality of cameras are fisheye lenses, and respective fisheye images captured are stored in a memory.

[0016] Yet another embodiment of the present invention provides a real panoramic video recording and broadcasting system including a plurality of cameras, a memory, a processor, a plurality of picture decoders, and a video encoder, and data from a plurality of cameras is stored in In the memory device, the processor acquires data from the plurality of cameras from the memory device and transmits the data to the plurality of picture decoders, and the corresponding picture decoder of each camera decodes the picture data of the corresponding camera to obtain image data of each camera. The processor synthesizes the decoded image data from the plurality of cameras and sends the synthesized image data to a video encoder to obtain a video data stream, and the processor encapsulates the video data stream from the video encoder into a playable multimedia file.

[0017] According to still another embodiment of the present invention, an integrated panoramic video recording and broadcasting system, wherein the playable multimedia file is a file in an MP4 format. [0018] According to still another embodiment of the present invention, a real panoramic video recording and broadcasting system, wherein a plurality of cameras and a plurality of picture decoders are respectively two, each camera corresponds to one picture decoder.

According to still another embodiment of the present invention, a panoramic video recording and broadcasting system is provided, wherein a plurality of cameras are fisheye lenses, and respective fisheye images captured are stored in a memory.

[0020] Still another embodiment of the present invention provides a method for video recording and broadcasting of a panoramic video, which includes the following steps.

[0021] collecting data from a plurality of cameras, decoding data of each camera, obtaining image data of each camera, synthesizing decoded image data from a plurality of cameras, and sending the synthesized image data to an encoder to obtain video data. Flow;

[0022] Encapsulating a video data stream from a video encoder into a playable multimedia file.

[0023] According to still another embodiment of the present invention, a live panoramic video recording and broadcasting method, wherein a playable multimedia file is a file in an MP4 format.

According to still another embodiment of the present invention, there is provided a real panoramic video recording and broadcasting method, wherein each of the plurality of cameras and the plurality of picture decoders is two, and each camera corresponds to one picture decoder.

[0025] According to still another embodiment of the present invention, a panoramic video recording and broadcasting method is provided, wherein a plurality of cameras are fisheye lenses, and respective fisheye images captured are stored in a memory.

Advantageous effects of the invention

Beneficial effect

[0026] The advantage of the integrated panoramic video recording and broadcasting method of the present invention is that: since the image data of the plurality of cameras and the audio data from the sound card can be collected and integrated, the audio data stream and the video data stream are synthesized. The multimedia panorama file is played, so there is no need to reduce the cost of multiple cameras, and the panoramic video can be viewed.

Brief description of the drawing

DRAWINGS

[0027] The disclosure of the present invention will become more readily apparent with reference to the drawings. It is to be understood by those skilled in the art that these drawings are only intended to illustrate the technical solutions of the present invention and are not intended to limit the scope of the invention.

[0028] In the figure: 1 shows a real panoramic video recording system in accordance with one embodiment of the present invention.

2 shows a real panoramic video recording and broadcasting method according to an embodiment of the present invention.

Embodiments of the invention

[0021] The accompanying drawings, which are set forth to illustrate, illustrate,, In order to teach the technical solution of the present invention, some conventional aspects have been simplified or omitted. Those skilled in the art will appreciate that variations or alternatives derived from these embodiments are intended to fall within the scope of the invention. Those skilled in the art will appreciate that the features described below can be combined in various ways to form multiple variations of the invention. Therefore, the invention is not limited to the alternative embodiments described below, but only by the claims and their equivalents.

1 shows a real panoramic video recording and broadcasting system according to an embodiment of the present invention. As shown in FIG. 1, a real panoramic video recording system according to the present invention includes a sound card 1, a plurality of cameras 2, a memory 3, a processor 4, an audio encoder 5, a plurality of picture decoders 6, and a video encoder 7. The data from the sound card 1 and the plurality of cameras 2 are stored in the memory 3, the processor 4 acquires data from the sound card 1 from the memory 3 and transmits it to the audio encoder 5, and the processor 4 acquires from the memory 3 The data of the plurality of cameras 2 is transmitted to a plurality of picture decoders 6, and the audio encoder 5 encodes the sound card data to obtain an audio data stream, and the corresponding picture decoder 6 of each camera decodes the picture data of the corresponding camera to obtain each Image data of the cameras, the processor 4 synthesizes the decoded image data from the plurality of cameras and sends the synthesized image data to the video encoder 7 to obtain a video data stream, and the processor 4 streams the audio data from the audio encoder 5. The video data streams from video encoder 7 are combined to form a playable multimedia file.

2 shows a real panoramic video recording and broadcasting method according to an embodiment of the present invention. As shown in FIG. 2, a real panoramic video recording and broadcasting method according to an embodiment of the present invention includes the following steps:

[0034] Step 100: The actual panoramic video recording and broadcasting method begins;

[0035] Step 110: collecting sound card data and encoding the sound card data to obtain an audio data stream;

[0036] Step 120: Collect data from a plurality of cameras, decode data of each camera, obtain image data of each camera, synthesize decoded image data from multiple cameras, and send the combined image data to the encoder Obtaining a video data stream;

[0037] Step 130: synthesizing the audio data stream and the video data stream to form a playable multimedia file; [0038] Step 140: The actual panoramic video recording and broadcasting method ends.

[0039] In one embodiment of the invention, the playable multimedia file is a file in MP4 format. It should be noted that those skilled in the art can use playable multimedia files in other formats, and this will also be within the scope of the present invention.

[0040] In one embodiment of the invention, collecting data from a plurality of cameras refers to collecting data from two cameras. In one embodiment of the invention, the plurality of cameras are all fisheye lenses, and the respective fisheye images taken are stored in the memory. It should be noted that a fisheye camera of other trees may be employed by those skilled in the art, and this will also be within the scope of the present invention.

[0041] Yet another embodiment of the present invention provides a real panoramic video recording and broadcasting system including a plurality of cameras 2, a memory 3, a processor 4, a plurality of picture decoders 6 and a video encoder 7, from a plurality of The data of the camera 2 is stored in the memory 3, and the processor 4 acquires data from a plurality of cameras from the memory and transmits them to the plurality of picture decoders 6, and the corresponding picture decoder of each camera decodes the picture data of the corresponding camera. Obtaining image data of each camera, the processor 4 synthesizes the decoded image data from the plurality of cameras and sends the synthesized image data to the video encoder 7 to obtain a video data stream, and the processor 6 outputs the video data from the video encoder. The video data stream is encapsulated into a playable multimedia file.

[0042] According to still another embodiment of the present invention, an integrated panoramic video recording and broadcasting system is provided, wherein the playable multimedia file is a file in an MP4 format.

According to still another embodiment of the present invention, there is provided a real panoramic video recording and broadcasting system, wherein each of the plurality of cameras and the plurality of picture decoders is two, and each camera corresponds to one picture decoder.

According to still another embodiment of the present invention, a panoramic video recording and broadcasting system is provided, wherein a plurality of camera heads are fisheye lenses, and respective fisheye images captured are stored in a memory.

[0045] Still another embodiment of the present invention provides a method for video recording and broadcasting of a panoramic video, which includes the following steps.

[0046] Step 1: collecting data from a plurality of cameras, decoding data of each camera, obtaining image data of each camera, synthesizing decoded image data from a plurality of cameras, and sending the synthesized image data to the encoder Get the video data stream; and

[0047] Step 2: Encapsulate the video data stream from the video encoder into a playable multimedia file.

[0048] According to still another embodiment of the present invention, a panoramic video recording and broadcasting method is provided, wherein more The media file is a file in MP4 format.

According to still another embodiment of the present invention, there is provided a real panoramic video recording and broadcasting method, wherein each of the plurality of cameras and the plurality of picture decoders is two, and each of the cameras corresponds to one picture decoder.

According to still another embodiment of the present invention, a panoramic video recording and broadcasting method is provided, wherein a plurality of cameras are fisheye lenses, and respective fisheye images captured are stored in a memory.

[0051] The advantage of the integrated panoramic video recording and broadcasting method of the present invention is that: since the image data of the plurality of cameras and the audio data from the sound card can be collected and integrated, the audio data stream and the video data stream are synthesized. The multimedia panorama file is played, so there is no need to reduce the cost of multiple cameras, and the panoramic video can be viewed.

Claims

Claim

[Claim 1] A real panoramic video recording and broadcasting system, comprising: a sound card, a plurality of cameras, a memory, a processor, an audio encoder, a plurality of picture decoders, and a video encoder, from a sound card and The data of the camera is stored in the memory, the processor acquires the data from the sound card from the memory and transmits it to the audio encoder, and the processor acquires data from the plurality of cameras from the memory and transmits the data to the plurality of pictures. The audio encoder encodes the data from the sound card to obtain an audio data stream, and the corresponding picture decoder of each camera decodes the picture data of the corresponding camera to obtain image data of each camera, and the processor synthesizes the decoded data from the plurality of cameras. The image data is sent to the video encoder to obtain a video data stream, and the processor combines the audio data stream from the audio encoder with the video data stream from the video encoder to form a playable multimedia file.

[Claim 2] The system according to claim 1, wherein the playable multimedia file is a file in MP4 format.

[Claim 3] The system according to claim 1, wherein each of the plurality of cameras and the plurality of picture decoders is two, and each of the cameras corresponds to one picture decoder.

[Clave 4] The system according to claim 1, wherein the plurality of cameras are fisheye lenses, and the fisheye images taken by the respective ones are stored in the memory.

[Claim 5] A real panoramic video recording and broadcasting method, comprising the following steps:

Acquiring sound card data and encoding the sound card data to obtain an audio data stream;

Collecting data from a plurality of cameras, decoding data of each camera, obtaining image data of each camera, synthesizing decoded image data from a plurality of cameras, and sending the combined image data to an encoder to obtain a video data stream;

The audio data stream and the video data stream are combined to form a playable multimedia file.

[Claim 6] The method according to claim 5, wherein the playable multimedia file is a file in MP4 format.

[Clave 7] The method according to claim 5, wherein each of the plurality of cameras and the plurality of picture decoders is two, and each of the cameras corresponds to one picture decoder.

[Claim 8] The method according to claim 5, wherein the plurality of cameras are fisheye lenses, The fisheye images taken by each are stored in the memory.

An integrated panoramic video recording and broadcasting system, comprising: a plurality of cameras, a memory, a processor, a plurality of picture decoders and a video encoder, data from a plurality of cameras is stored in a memory, the processor is The memory acquires data from multiple cameras and transmits it to multiple picture decoders. The corresponding picture decoder of each camera decodes the picture data of the corresponding camera to obtain image data of each camera, and the processor synthesizes from multiple cameras. The decoded image data is sent to the video encoder to obtain a video data stream, and the processor encapsulates the video data stream from the video encoder into a playable multimedia file.

The system of claim 9, wherein the playable multimedia file is a file in MP4 format.

The system according to claim 9, wherein each of the plurality of cameras and the plurality of picture decoders is two, and each of the cameras corresponds to a picture decoder.

The system according to claim 9, wherein the plurality of cameras are fisheye lenses, and the fisheye images taken by the respective ones are stored in the memory.

A real panoramic video recording and broadcasting method, comprising the following steps:

The video data stream from the video encoder is packaged into a playable multimedia file.

The method according to claim 13, wherein the playable multimedia file is a file in MP4 format.

The method according to claim 13, wherein each of the plurality of cameras and the plurality of picture decoders is two, and each of the cameras corresponds to a picture decoder.

The method according to claim 13, wherein the plurality of cameras are fisheye lenses, and the fisheye images taken by the respective ones are stored in the memory.