WO2018094866A1

WO2018094866A1 - Unmanned aerial vehicle-based method for live broadcast of panorama, and terminal

Info

Publication number: WO2018094866A1
Application number: PCT/CN2017/071411
Authority: WO
Inventors: 刘均; 宋朝忠; 欧阳张鹏
Original assignee: 深圳市元征科技股份有限公司
Priority date: 2016-11-25
Filing date: 2017-01-17
Publication date: 2018-05-31
Also published as: CN106657733A

Abstract

Provided in an embodiment of the present invention are an unmanned aerial vehicle-based method for live broadcast of a panorama, and a terminal. The unmanned aerial vehicle comprises M cameras. The cameras are installed at a cradle head supporting adjustment of orientations and/or depression and elevation angles. The method comprises: receiving images of a subject captured at different viewing angles by the M cameras of the unmanned aerial vehicle following the object, the images captured at different viewing angles comprising images captured in different orientations and/or at different depression and elevation angles; seamlessly stitching the images captured at different viewing angles to generate a corresponding panoramic image for live broadcast; and pushing the panoramic image for live broadcast to a corresponding live broadcast client to be displayed. The embodiment of the present invention can realize live broadcast of panoramas in various orientations and at different angles.

Description

Panoramic live broadcast method and terminal based on drone

[0001] Technical Field

[0002] The present invention relates to the field of terminal technologies, and in particular, to a panoramic live broadcast method and terminal based on a drone.

BACKGROUND

[0004] With the continuous development of network technology, the application of network technology has now spread to all aspects of social life. Once it was only able to watch live programs through TV, it is now possible to watch live broadcasts through the Internet, which is convenient for people's lives.

[0005] The current live program is usually obtained by shooting with a personal shoulder camera, or in a large scene, such as a football field, by a plurality of fixed cameras, and then selecting different ones according to needs. The camera captures the live broadcast; the live broadcast effect is too single, and the angle of the live broadcast is fixed. The user cannot operate the live broadcast according to the perspective that he wants to watch. The live broadcast is not good and the user experience is poor.

SUMMARY OF THE INVENTION

The technical problem to be solved by the embodiments of the present invention is to provide a panoramic live broadcast method and a terminal based on a drone, which can realize multi-directional and multi-angle panoramic live broadcast and improve the flexibility of the live broadcast picture.

In one aspect, the embodiment of the present invention provides a method for panoramic live broadcast based on a drone, wherein the drone includes M cameras, and the M cameras are installed in a support orientation and/or On the gimbal of the pitch angle adjustment, the method includes:

[0009] receiving M cameras in the drone to follow a shooting picture of different viewing angles collected by the shooting object, where the shooting pictures of different viewing angles include shooting pictures with different orientations and/or elevation angles;

[0010] seamlessly stitching the captured images of different viewing angles to generate a corresponding panoramic live broadcast screen;

[0011] pushing the panoramic live broadcast screen to the corresponding live broadcast client to play the panoramic live broadcast screen.

[0012] Optionally, the seamlessly splicing the captured images of the different viewing angles to generate a corresponding panoramic live broadcast image includes:

[0013] seamlessly splicing the captured images of different viewing angles according to the set parallel display mode or the master-slave display mode to obtain a combined panoramic live broadcast screen; And [0014] collecting the synthesized panoramic live broadcast image by using a dynamic rate adaptive technology, and performing encoding processing on the collected panoramic live broadcast screen to obtain a coded panoramic live broadcast screen.

[0015] Optionally, the parallel display manner includes a display manner arranged side by side in a horizontal direction, or a display manner arranged side by side in a vertical direction; the master-slave display manner includes a picture-in-picture manner.

[0016] Optionally, the seamlessly splicing the captured images of the different viewing angles to generate a corresponding panoramic live broadcast image includes:

[0017] three-dimensional reconstruction of the captured images of the different viewing angles according to the set frequency to generate a corresponding panoramic live broadcast image of the captured object in three-dimensional space;

And [0018] encoding and optimizing a format of the panoramic live picture of the captured object in a three-dimensional space to obtain a coded panoramic live picture.

[0019] Optionally, the method further includes:

[0020] When the photographing screen transmitted by any one or more of the M cameras is not received, corresponding prompt information is generated to prompt the corresponding camera to malfunction.

[0021] In another aspect, the embodiment of the present invention further provides a terminal, where the terminal includes:

[0022] a receiving module, configured to receive, by the M cameras on the drone, a shooting picture of different angles of view acquired by the shooting object, where the shooting pictures of different viewing angles include shooting pictures of different orientations and/or elevation angles;

The drone includes M cameras, and the M camera portions are mounted on a pan/tilt that supports azimuth and/or pitch angle adjustment;

[0023] a generating module, configured to seamlessly splicing the captured images of different views to generate a corresponding panoramic video;

[0024] The push module is configured to push the panoramic live broadcast screen to the corresponding live broadcast client to play the panoramic live broadcast screen.

[0025] wherein optionally,

[0026] The generating module is specifically configured to seamlessly splicing the shooting images of different viewing angles according to the set parallel display mode or the master-slave display mode, to obtain a combined panoramic live broadcast screen;

[0027] The generating module is further configured to collect the synthesized panoramic live broadcast screen by using a dynamic rate adaptive technology, and perform encoding processing on the collected panoramic live broadcast screen to obtain The encoded panoramic live view. Optionally, the parallel display manner includes a display manner arranged side by side in a horizontal direction or a display manner arranged side by side in a vertical direction; the master-slave display manner includes a picture-in-picture manner.

[0029] wherein optionally,

[0030] The generating module is configured to perform three-dimensional reconstruction on the captured images of the different viewing angles according to a set frequency, to generate a corresponding panoramic live broadcast image of the captured object in a three-dimensional space;

[0031] The generating module is further configured to perform coding and optimization on a panoramic live picture of the captured object in a three-dimensional space, to obtain a coded panoramic live broadcast picture.

[0032] wherein optionally,

[0033] The generating module is further configured to: when the receiving frame sent by any one or more of the M cameras is not received, generate corresponding prompt information to prompt the corresponding camera to malfunction.

[0034] Embodiments of the present invention may follow a shooting picture of different viewing angles acquired by a shooting object by receiving M cameras mounted on the drone, and the shooting pictures of different viewing angles include shooting pictures with different orientations and/or elevation angles. The M cameras are partially mounted on the pan/tilt of the drone that supports the azimuth and/or elevation adjustment, and then seamlessly splicing the captured images of the different views to generate a corresponding panoramic live view. Finally, the panoramic live broadcast screen is pushed to the corresponding live broadcast client to play the panoramic live broadcast screen; thus, the multi-directional or multi-angle panoramic live broadcast can be realized, and the flexibility of the live broadcast screen is improved.

BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the prior art description will be briefly described below, and obviously, in the following description The drawings are only some of the embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any creative work.

1 is a schematic flow chart of a method for panoramic live broadcast based on a drone according to an embodiment of the present invention;

2 is a schematic flow chart of another method for panoramic live broadcast based on a drone according to an embodiment of the present invention;

3 is a schematic structural diagram of a terminal according to an embodiment of the present invention;

4 is a schematic structural diagram of another terminal according to an embodiment of the present invention.

DETAILED DESCRIPTION

[0042] In order to enable a person skilled in the art to better understand the solution of the present invention, the following will be incorporated in the embodiment of the present invention. The drawings illustrate the technical solutions in the embodiments of the present invention clearly and completely. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without departing from the inventive scope are intended to fall within the scope of the invention.

[0043] The terms "first", "second" and "third" (if present) and the like in the specification and claims of the present invention and the above drawings are used to distinguish different objects, and are not intended to describe specific order. Moreover, the terms "comprising" and variations thereof are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that comprises a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units not listed, or, optionally, Other steps or units inherent to these processes, methods, products or equipment.

1 is a schematic flowchart of a method for a live broadcast of a drone based on a drone according to an embodiment of the present invention. The method of the embodiment of the present invention can be applied to, for example, a smart phone, a tablet, and a smart wearable device. In a terminal with a communication network function, it can be specifically implemented by a processor of these terminals. The method of an embodiment of the invention further comprises the following steps.

[0045] S101. The M cameras installed by the receiving drone follow the shooting images of different viewing angles collected by the shooting object, and the shooting images of the different viewing angles include shooting images of different orientations and/or elevation angles, and the M cameras. Partially mounted on the head of the drone that supports azimuth and/or pitch angle adjustment.

[0046] In the embodiment of the present invention, the user can install a fixed camera with a fixed azimuth and a fixed angle (ie, the shooting angle is not adjustable) on the drone, and can also pass the gimbal (pTZ controller) on the drone. The mobile camera can be adjusted by installing some orientations and/or shooting angles (ie, pitch angles). The number of the fixed camera and the moving camera can be one or more. When the number of the fixed camera and the moving camera exceeds two, The fixed camera and the mobile camera may refer to the same camera or different cameras, which are not limited in the embodiment of the present invention.

[0047] The user can operate the drone to make a follow-up of the photographed object as the photographed object moves, that is, by using a plurality of cameras mounted on the drone, here set For M, M is a positive integer, M is an integer greater than or equal to 1. When M is 1吋, then this camera can be selected as a mobile camera to be installed on the drone through a pan/tilt or pan/tilt controller. When M is a positive integer greater than 1, you can arbitrarily choose to install some fixed cameras and some mobile cameras on the drone. The embodiment of the invention is not limited.

[0048] The M cameras can follow the flight dynamics of the drone to take a photographing object (such as a person) that needs to be photographed, and optionally the M cameras can also communicate by wire/wireless communication (such as data). Line, WIFI, Bluetooth, etc.) The M cameras are sent to the corresponding terminals with the different viewing angles (ie different orientations and/or different pitch angles) captured by the subject. The terminal receives a shooting picture of different angles of view collected by the M cameras on the drone and the captured object.

[0049] The terminal may include an Internet device such as a smart phone (such as an Android mobile phone, an IOS mobile phone, etc.), a personal computer, a tablet computer, a palmtop computer, a mobile Internet device (MID, Mobile Internet Devices), or a wearable smart device, and the present invention The embodiment is not limited.

[0050] S102. Seamlessly stitch the captured images of different viewing angles to generate a corresponding panoramic live broadcast screen.

In the embodiment of the present invention, the terminal may analyze the captured images of different views obtained above, and then seamlessly splicing/synthesizing to generate a corresponding panoramic live view.

[0052] Optionally, the seamlessly splicing the captured images of the different viewing angles to generate a corresponding panoramic live broadcast image includes:

[0053] seamlessly splicing the live images of the different viewing angles according to the set parallel display mode or the master-slave display mode to obtain a combined panoramic live broadcast screen;

And [0054] collecting the synthesized panoramic live broadcast image by using a dynamic rate adaptive technology, and performing encoding processing on the collected panoramic live broadcast screen to obtain a coded panoramic live broadcast screen.

[0055] As a possible implementation manner of the embodiment of the present invention, the terminal may rearrange the shooting pictures of the different viewing angles according to the set parallel sorting display manner or the master-slave sorting display manner, and perform no Splicing or splicing to obtain a synthesized panoramic live broadcast screen; further, the terminal may further perform sampling and collecting the synthesized panoramic live broadcast screen by using dynamic rate adaptive technology, and then set the collected panoramic live broadcast screen. Encoding/compression processing of the format to obtain a coded panoramic live view. It should be understood that in order to ensure the security of the transmission without losing frames, some video streams are usually encoded and transmitted, which reduces the occupation of bandwidth resources and ensures the security of the transmitted data.

[0056] Optionally, the parallel display manner includes a display manner arranged side by side in a horizontal direction, or a display manner arranged side by side in a vertical direction; the master-slave display manner includes a picture-in-picture manner.

[0057] It should be understood that the parallel sort display manner of the embodiment of the present invention may refer to performing in a horizontal direction. The arrangement of the left and right screens may be arranged in a vertical direction, or alternatively, the arrangement of any structure or pattern in the set direction (arbitrary direction). Display method. The master-slave sorting display mode may be a sorting display manner according to a picture-in-picture display, or a layer overlay/coverage, or another sorting display manner, which is not limited in the embodiment of the present invention.

[0058] Optionally, the seamlessly splicing the captured images of the different viewing angles to generate a corresponding panoramic live broadcast image includes:

[0059] performing three-dimensional reconstruction on the captured images of the different viewing angles according to the set frequency to generate a corresponding panoramic live broadcast image of the captured object in three-dimensional space;

And [0060] encoding and optimizing a set format of the panoramic live picture of the captured object in a three-dimensional space, and obtaining a coded panoramic live picture.

[0061] As another possible implementation manner of the embodiment of the present invention, the terminal may perform three-dimensional reconstruction on the captured images of the different viewing angles according to the set operating frequency (ie, the set frequency) to generate The panoramic live view of the three-dimensional (ie, three-dimensional space) makes the user more realistic and interesting; and the terminal can encode and optimize the formed three-dimensional panoramic live broadcast image (such as removing the edge). Angle, or lower resolution picture/stream, etc.) Get the encoded panoramic live view.

[0062] S103. Push the panoramic live broadcast screen to the corresponding live broadcast client to play the panoramic live broadcast screen.

[0063] In the embodiment of the present invention, after the terminal obtains the encoded panoramic live broadcast image, or obtains the seamless seamless stitching to obtain the panoramic live broadcast screen, the terminal may directly convert the encoded panoramic live broadcast screen or directly display the panoramic live broadcast screen. Sending to the corresponding live broadcast client or viewer client through the network, so that after the client receives the encoded panoramic live broadcast screen, it first decodes the corresponding panoramic live broadcast screen, and then plays the same on the client side. The panoramic live broadcast screen; or the client receives the unencoded panoramic live broadcast screen, then the panoramic live broadcast screen can be directly played.

[0064] Optionally, the method further includes:

[0065] When the photographing screen transmitted by any one or more of the M cameras is not received, corresponding prompt information is generated to prompt the corresponding camera to malfunction. [0066] The terminal may detect that the terminal does not receive one or more of the M cameras to capture and send the captured image, and the terminal may generate corresponding prompt information to prompt the user to view the corresponding camera. Not a malfunction or damage.

[0067] Embodiments of the present invention may follow a shooting image of different viewing angles acquired by a shooting object by receiving M cameras mounted on the drone, and the shooting images of the different viewing angles include shooting images of different orientations and/or elevation angles. The M cameras are partially mounted on the pan/tilt of the drone that supports the azimuth and/or elevation adjustment, and then seamlessly splicing the captured images of the different views to generate a corresponding panoramic live view. Finally, the panoramic live broadcast screen is pushed to the corresponding live broadcast client to play the panoramic live broadcast screen; thus, the multi-directional or multi-angle panoramic live broadcast can be realized, and the flexibility of the live broadcast screen is improved.

2 is a schematic flowchart of another method for a live broadcast of a drone based on an embodiment of the present invention. The method of the embodiment of the present invention can be applied to, for example, a smart phone, a tablet, and a smart wearable. In a terminal with a communication network function, such as a device, the processor of these terminals can be specifically implemented. The method of an embodiment of the invention further comprises the following steps.

[0069] S201. The M cameras in the receiving drone follow the shooting images of different viewing angles collected by the shooting object, and the shooting images of the different viewing angles include shooting images of different orientations and/or elevation angles.

[0070] S202, seamlessly splicing the captured images of different viewing angles according to the set parallel display mode or the master-slave display mode, to obtain a combined panoramic live broadcast screen; wherein the parallel display manner includes horizontal directions The display mode of the side-by-side arrangement, or the display mode arranged side by side in the vertical direction; the master-slave display mode includes a picture-in-picture mode.

[0071] S203. Collect the synthesized panoramic live broadcast screen by using a dynamic rate adaptive technology, and perform encoding processing on the collected panoramic live broadcast screen to obtain a coded panoramic live broadcast screen.

[0072] S204. Perform three-dimensional reconstruction on the captured images of the different viewing angles according to the set frequency to generate a corresponding panoramic live broadcast image of the captured object in a three-dimensional space.

[0073] S205. Perform coding and optimization on a panoramic live picture of the captured object in a three-dimensional space to obtain a coded panoramic live broadcast picture.

[0074] It should be noted that the above steps S202-S203 and the above steps S204-S205 are parallel solutions, the terminal The execution of one of the solution steps can be arbitrarily selected, and the steps of the embodiments of the present invention are limited.

[0075] S206. Push the panoramic live broadcast screen to the corresponding live broadcast client to play the panoramic live broadcast screen.

[0076] S207. When the photographing screen sent by any one or more of the M cameras is not received, corresponding prompt information is generated to prompt the corresponding camera to malfunction.

[0077] Embodiments of the present invention may follow a shooting image of different viewing angles acquired by a shooting object by receiving M cameras mounted on the drone, and the shooting images of the different viewing angles include shooting images of different orientations and/or elevation angles. The M cameras are partially mounted on the pan/tilt of the drone that supports the azimuth and/or elevation adjustment, and then seamlessly splicing the captured images of the different views to generate a corresponding panoramic live view. Finally, the panoramic live broadcast screen is pushed to the corresponding live broadcast client to play the panoramic live broadcast screen; thus, the multi-directional or multi-angle panoramic live broadcast can be realized, and the flexibility of the live broadcast screen is improved.

3 is a schematic structural diagram of a terminal according to an embodiment of the present invention. The terminal 3 of the embodiment of the present invention includes:

[0079] The receiving module 30 is configured to receive a shooting image of different angles of view captured by the M cameras on the drone, and the shooting images of the different viewing angles include shooting images of different orientations and/or elevation angles; The drone includes M cameras, and the M camera portions are mounted on a pan/tilt that supports azimuth and/or pitch angle adjustment;

[0080] a generating module 31, configured to seamlessly splicing the captured images of the different viewing angles to generate a corresponding panoramic live broadcast screen;

[0081] The push module 32 is configured to push the panoramic live broadcast screen to the corresponding live broadcast client to play the panoramic live broadcast screen.

[0082] wherein optionally,

[0083] The generating module 31 is specifically configured to seamlessly splicing the shooting images of the different viewing angles according to the set parallel display mode or the master-slave display mode, to obtain a combined panoramic live broadcast screen;

[0084] The generating module 31 is further configured to collect the synthesized panoramic live broadcast screen by using a dynamic rate adaptive technology, and perform encoding processing on the collected panoramic live broadcast screen, Get the encoded panoramic live view. Optionally, the parallel display manner includes a display manner arranged side by side in a horizontal direction or a display manner arranged side by side in a vertical direction; the master-slave display manner includes a picture-in-picture manner.

[0086] wherein optionally,

[0087] The generating module 31 is configured to perform three-dimensional reconstruction on the captured images of the different viewing angles according to a set frequency, to generate a corresponding panoramic live broadcast image of the captured object in a three-dimensional space;

[0088] The generating module 31 is further configured to perform encoding and optimization on a panoramic live view of the captured object in a three-dimensional space to obtain a coded panoramic live broadcast screen.

[0089] wherein optionally,

[0090] The generating module 31 is further configured to: when the receiving frame sent by any one or more of the M cameras is not received, generate corresponding prompt information to prompt that the corresponding camera is faulty.

For a specific implementation of the various modules involved in the embodiments of the present invention, reference may be made to the description of related functional modules or implementation steps in the corresponding embodiments in FIG. 1 to FIG. 2, and details are not described herein.

[0092] Embodiments of the present invention may follow a shooting picture of different viewing angles acquired by a shooting object by receiving M cameras mounted on the drone, and the shooting pictures of different viewing angles include shooting pictures of different orientations and/or elevation angles. The M cameras are partially mounted on the pan/tilt of the drone that supports the azimuth and/or elevation adjustment, and then seamlessly splicing the captured images of the different views to generate a corresponding panoramic live view. Finally, the panoramic live broadcast screen is pushed to the corresponding live broadcast client to play the panoramic live broadcast screen; thus, the multi-directional or multi-angle panoramic live broadcast can be realized, and the flexibility of the live broadcast screen is improved.

4 is a schematic structural diagram of a terminal according to an embodiment of the present invention. The terminal may be a device with a communication network function, such as a smart phone, a tablet computer, or an intelligent wearable device. As shown in FIG. 4, the terminal in the embodiment of the present invention may include a display screen, a button, a speaker, a pickup, and the like. And further comprising: at least one bus 501, at least one processor 502 connected to the bus 501, and at least one memory 503 connected to the bus 501, a communication device 505 implementing a communication function, and a power supply device 504 for powering each power consumption module of the terminal. .

[0094] The processor 502 can call the code stored in the memory 503 to perform related functions through the bus 501, where the memory 503 includes an operating system and a data transfer application.

[0095] The processor 502 is configured to: [0096] The M cameras in the receiving drone follow the shooting images of different viewing angles acquired by the shooting object, and the shooting images of the different viewing angles include shooting images with different orientations and/or elevation angles;

[0097] seamlessly stitching the captured images of different viewing angles to generate a corresponding panoramic live broadcast screen;

[0098] pushing the panoramic live broadcast screen to the corresponding live broadcast client to play the panoramic live broadcast screen; [0099] wherein the drone includes M cameras, and the M camera portions are installed at Supports azimuth and/or pitch angle adjustment on the gimbal.

[0100] Further optionally, the processor 502 is specifically configured to:

[0101] seamlessly splicing the captured images of different viewing angles according to the set parallel display mode or the master-slave display mode to obtain a combined panoramic live broadcast screen;

And [0102] collecting the synthesized panoramic live broadcast image by using a dynamic rate adaptive technology, and performing encoding processing on the collected panoramic live broadcast screen to obtain a coded panoramic live broadcast screen.

[0103] Further optionally, the parallel display manner includes a display manner arranged side by side in a horizontal direction or a display manner arranged side by side in a vertical direction; the master-slave display manner includes a picture-in-picture manner.

[0104] Further optionally, the processor 502 is specifically configured to:

[0105] three-dimensionally reconstructing the captured images of the different viewing angles according to the set frequency to generate a corresponding panoramic live broadcast image of the captured object in three-dimensional space;

[0106] The format and encoding of the panoramic live picture of the captured object in the three-dimensional space are encoded, and the encoded panoramic live picture is obtained.

[0107] Further optionally, the processor 502 is further configured to:

[0108] When the photographing screen transmitted by any one or more of the M cameras is not received, corresponding prompt information is generated to prompt the corresponding camera to malfunction.

[0109] The embodiment of the present invention can follow the shooting pictures of different viewing angles collected by the shooting object by receiving M cameras mounted on the drone, and the shooting pictures of different viewing angles include shooting pictures with different orientations and/or elevation angles. The M cameras are partially mounted on the pan/tilt of the drone that supports the azimuth and/or elevation adjustment, and then seamlessly splicing the captured images of the different views to generate a corresponding panoramic live view. Finally, the panoramic live broadcast screen is pushed to the corresponding live broadcast client to play the panoramic live broadcast screen; thus, the multi-directional or multi-angle panoramic live broadcast can be realized, and the flexibility of the live broadcast screen is improved. [0110] The embodiment of the present invention further provides a computer storage medium, wherein the computer storage medium may store a program, where the program execution includes some or all of the drone-based panoramic live broadcast method described in the foregoing method embodiment. step.

[0111] It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present invention is not subject to the described action sequence. The limitation is that, in accordance with the present invention, certain steps may be performed in other orders or in the same manner. In the following, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

[0112] In the above embodiments, the descriptions of the various embodiments are different, and the details that are not detailed in an embodiment can be referred to the related descriptions of other embodiments.

[0113] In the several embodiments provided by the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division, and the actual implementation may have another division manner, for example, multiple units or components may be combined or may be Integration into another system, or some features can be ignored, or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical or otherwise.

[0114] The unit described as a separate component may or may not be physically distributed. The component displayed as a unit may or may not be a physical unit, that is, may be located in one place, or may be distributed to multiple On the network unit. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented either in the form of hardware or in the form of a software functional unit.

[0116] The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention contributes in essence or to the prior art or all or part of the technical solution. It may be embodied in the form of a software product stored in a storage medium, comprising instructions for causing a computer device (which may be a personal computer, server or network device, etc.) to perform the embodiments of the present invention. All or part of the steps of the method. The foregoing storage medium includes: a USB flash drive, a read only memory (ROM, Read-Only)

Memory, Random Access Memory (RAM), removable hard disk, disk or optical disk, and other media that can store program code.

The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that The technical solutions described in the embodiments are modified, or some of the technical features are equivalently substituted; and the modifications or substitutions do not deviate from the scope of the technical solutions of the embodiments of the present invention.

technical problem

Problem solution

Advantageous effects of the invention

Claims

Claim

[Attachment 1] A UAV-based panoramic live broadcast method, wherein the UAV includes M cameras, and the M cameras are installed in a cloud supporting azimuth and/or elevation adjustment On the stage, the method includes:

Receiving, by the M cameras in the drone, a shooting picture of different viewing angles acquired by the shooting object, wherein the shooting pictures of different viewing angles include shooting pictures of different orientations and/or elevation angles;

Seamlessly splicing the captured images of different viewing angles to generate a corresponding panoramic live broadcast screen, and pushing the panoramic live broadcast screen to a corresponding live broadcast client to play the panoramic live broadcast screen.

[Claim 2] The method according to claim 1, wherein the seamlessly splicing the captured images of the different viewing angles to generate a corresponding panoramic live video comprises:

According to the set parallel display mode or the master-slave display mode, the shooting pictures of the different viewing angles are seamlessly spliced to obtain a combined panoramic live broadcast screen;

The synthesized panoramic live broadcast picture is collected by using a dynamic rate adaptive technology, and the collected panoramic live broadcast picture is subjected to a formatted encoding process to obtain a coded panoramic live broadcast picture.

[Claim 3] The method according to claim 2, wherein the parallel display mode includes a display manner arranged side by side in the horizontal direction, or a display manner arranged side by side in the vertical direction; The display mode includes the picture-in-picture method.

[Claim 4] The method according to claim 1, wherein the seamlessly splicing the captured pictures of the different viewing angles to generate corresponding panoramic live pictures includes:

Performing three-dimensional reconstruction on the captured images of the different viewing angles according to the set frequency to generate a corresponding panoramic live broadcast image of the captured object in three-dimensional space; The format and encoding of the panoramic live picture in the three-dimensional space of the captured object are encoded and optimized, and the encoded panoramic live picture is obtained.

[Claim 5] The method according to any one of claims 1 to 4, wherein the method further comprises:

When the shooting picture transmitted by any one or more of the M cameras is not received, corresponding prompt information is generated to prompt the corresponding camera to malfunction.

[Claim 6] The terminal, wherein the terminal includes:

a receiving module, configured to receive, by the M cameras on the drone, a shooting image of different viewing angles acquired by the shooting object, where the shooting images of different viewing angles include shooting images of different orientations and/or elevation angles; The machine includes M cameras, and the M camera portions are mounted on a gimbal that supports azimuth and/or elevation adjustment;

a generating module, configured to seamlessly splicing the captured pictures of different views to generate a corresponding panoramic live picture;

The push module is configured to push the panoramic live broadcast screen to the corresponding live broadcast client to play the panoramic live broadcast screen.

[Claim 7] The terminal according to claim 6, wherein

The generating module is specifically configured to seamlessly splicing the shooting images of the different viewing angles according to the set parallel display mode or the master-slave display mode to obtain a combined panoramic live broadcast screen;

The generating module is further configured to collect the synthesized panoramic live video by using a dynamic rate adaptive technology, and perform encoding processing on the collected panoramic live video to obtain a coded Panoramic live view.

[Claim 8] The terminal according to claim 7, wherein the parallel display mode includes a display manner arranged side by side in the horizontal direction, or a display manner arranged side by side in the vertical direction The master-slave display mode includes a picture-in-picture mode.

[Claim 9] The terminal according to claim 6, wherein:

The generating module is specifically configured to perform three-dimensional reconstruction on the captured images of the different viewing angles according to a set frequency to generate a corresponding panoramic live broadcast image of the captured object in a three-dimensional space;

The generating module is further configured to perform coding and optimization on a panoramic live picture of the captured object in a three-dimensional space to obtain a coded panoramic live broadcast picture.

[Claim 10] The terminal according to any one of claims 6-9, wherein

The generating module is further configured to: when the photographing screen sent by any one or more of the M cameras is not received, generate corresponding prompt information to prompt the corresponding camera to malfunction.

[Claim 11] A terminal, comprising: a communication device, a power supply device, a memory, and a processor, wherein the processor is configured to perform the method according to any one of claims 1-5 .