CN108924590B - Video playing and photographing system - Google Patents
Video playing and photographing system Download PDFInfo
- Publication number
- CN108924590B CN108924590B CN201810681020.8A CN201810681020A CN108924590B CN 108924590 B CN108924590 B CN 108924590B CN 201810681020 A CN201810681020 A CN 201810681020A CN 108924590 B CN108924590 B CN 108924590B
- Authority
- CN
- China
- Prior art keywords
- image
- video
- server
- data
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/18502—Airborne stations
- H04B7/18506—Communications with or from aircraft, i.e. aeronautical mobile service
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
- H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
Abstract
The invention provides a video playing and photographing system. The system comprises a live broadcast end and an on-demand end; the live broadcast end comprises an unmanned aerial vehicle, remote control equipment and a first server; the onboard image transmission module transmits video/image information shot by the camera in real time to the remote control equipment as live broadcast data; the remote control equipment processes the live broadcast data and sends the live broadcast data to the first server; the on-demand terminal comprises a second server, on-demand data are stored in the second server in advance, and the on-demand data comprise a plurality of panoramic video files with different resolutions corresponding to each of a plurality of high-definition video sources and a high-resolution panoramic image frame sequence acquired from each high-definition video source and serve as candidate image sequences of the on-demand image data; the second server acquires the corresponding on-demand data according to the data type requested by the data request instruction of the user side. The technology can realize that multiple panoramic videos are shared by multiple users, and multi-angle high-definition shooting and high-definition short video recording are carried out when the panoramic videos are watched.
Description
Technical Field
The invention relates to an information processing technology, in particular to a video playing and photographing system.
Background
Aerial photography is also called aerial photography or aerial photography, and is used for shooting and shooting the earth landform, urban landscape, people and the like in the air. At present, unmanned aerial vehicles are widely used in military affairs, traffic construction, hydraulic engineering, ecological research, television columns, artistic photography and the like. In recent years, the network live broadcast technology has been developed to some extent. The mobile live broadcast technology is a communication technology developed by combining a mobile communication technology and a network live broadcast technology, and realizes live broadcast and sharing of information such as videos and images by means of a mobile terminal (a mobile phone, a tablet personal computer and the like).
The video and the image shot by the unmanned aerial vehicle live broadcast can be sent to the ground end for watching through wireless communication. However, the transmission of videos/images of existing unmanned aerial vehicles is usually in a point-to-point manner, and the video/image information can only be watched by individuals, and cannot be shared by multiple users.
Disclosure of Invention
The following presents a simplified summary of the invention in order to provide a basic understanding of some aspects of the invention. It should be understood that this summary is not an exhaustive overview of the invention. It is not intended to determine the key or critical elements of the present invention, nor is it intended to limit the scope of the present invention. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is discussed later.
In view of this, the present invention provides a video playing and photographing system, so as to at least solve the problem that the transmission of the video/image aerial-photographed by the existing unmanned aerial vehicle is usually in a point-to-point manner, and the video/image information can only be watched by individuals but not shared by multiple users.
According to one aspect of the invention, a video playing and photographing system is provided, which comprises a live broadcast end and a live broadcast end; the live broadcast end comprises an unmanned aerial vehicle, remote control equipment and a first server, wherein the unmanned aerial vehicle comprises an airborne control module, an airborne image transmission module, a cloud deck and a camera mounted on the cloud deck, and the unmanned aerial vehicle adjusts the shooting angle and the direction of the camera through the cloud deck; the onboard image transmission module is used for sending video/image information shot by the camera in real time to the remote control equipment as live broadcast data; the remote control equipment is provided with a ground image transmission module and is used for receiving live broadcast data from the airborne image transmission module, and the remote control equipment is used for processing the live broadcast data and sending the processed live broadcast data to the first server; the on-demand terminal comprises a second server, on-demand data are stored in the second server in advance, and the on-demand data comprise a plurality of panoramic video files with different resolutions corresponding to each of a plurality of high-definition video sources and a high-resolution panoramic image frame sequence acquired from each high-definition video source and serve as candidate image sequences of the on-demand image data; the second server is used for acquiring the corresponding on-demand data according to the data type requested by the data request instruction when receiving at least one data request instruction from one or more user terminals.
Further, the second server is provided with a user management module, and the user management module is used for receiving the identity authentication request from the user side, performing identity authentication on the corresponding user side based on the identity authentication request, and sending authentication success information to the corresponding user side after the authentication is successful so as to establish data connection with the user side.
Further, the plurality of different resolution panoramic video files corresponding to each of the plurality of high definition video sources comprises: and generating N panoramic video files with different resolutions by performing secondary encoding on each high-definition video source in the plurality of high-definition video sources for N times, wherein N is an integer greater than 1.
Further, the second server is adapted to: when at least one data request instruction from one or more user terminals is received, determining the type of data requested by the data request instruction for each data request instruction; if the requested data type is the on-demand panoramic video data, sending the stored URL address of the panoramic video file matched with the resolution contained in the instruction to the user side; if the requested data type is the on-demand image data, acquiring a corresponding photographed picture and sending the photographed picture to the user side; and if the requested data type is the on-demand short video data, acquiring the corresponding short video and sending the short video to the user side.
Further, when the requested data type is the on-demand image data, the second server acquires the corresponding photographed picture by: acquiring time information and attitude information carried in a data request instruction sent by the user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment; selecting a frame of panoramic image from the stored high-resolution panoramic image frame sequence as a candidate image, wherein the frame of panoramic image is a frame of image corresponding to the current frame of the on-demand panoramic video watched by the user side in time; capturing a screenshot of which the direction corresponds to the posture information carried in the instruction in the selected candidate image; and taking the screenshot as a photographed picture and storing the photographed picture under an account corresponding to the user side for final preview and downloading of the user.
Further, when the requested data type is the on-demand image data, the second server acquires the corresponding photographed picture by: acquiring time information and attitude information carried in a data request instruction sent by the user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment; selecting a frame corresponding to the current frame of the video in time and images of a plurality of frames before and after the frame from a stored high-resolution panoramic image frame sequence for fusion, and taking a fused enhanced image as a candidate image; capturing a screenshot of which the direction corresponds to the posture information carried in the instruction in the selected candidate image; and taking the screenshot as a photographed picture and storing the photographed picture under an account corresponding to the user side for final preview and downloading of the user.
Further, when the requested data type is the on-demand image data, the second server acquires the corresponding photographed picture by: acquiring time information and attitude information carried in a data request instruction sent by the user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment; selecting a frame corresponding to the current frame of the watched on-demand panoramic video in time and images of a plurality of frames before and after the frame from the stored high-resolution panoramic image frame sequence as candidate images; capturing screenshots, the directions of which correspond to the posture information carried in the instruction, in each frame of candidate panoramic image aiming at the selected plurality of frames of candidate images; and fusing the plurality of captured screenshots, and storing the fused enhanced image as a photographed image under an account corresponding to the user side for final preview and downloading of the user.
Further, for a selected candidate image, the second server is adapted to obtain a screenshot in the candidate image by: remapping the panoramic image onto a spherical surface, wherein the spherical surface is a corresponding panoramic mapping spherical surface generated by taking the side edge of a plane rectangular picture corresponding to the panoramic image as a spherical semi-circular arc, and mapping the plane rectangular picture onto the panoramic mapping spherical surface; determining a user view angle according to the posture information of the corresponding user equipment; searching spherical graphics to be cut on the panoramic mapping spherical surface according to the user visual angle to cut; and mapping the clipped spherical graph into a rectangular picture.
Further, the second server stores a preset corresponding relation between the attitude angle and the pixel point coordinates of the panoramic image in advance, and after the user attitude information is obtained, the pixel point coordinates of the panoramic image are directly determined according to the preset corresponding relation so as to obtain the screenshot picture.
Further, setting a frame sequence of the high-resolution panoramic image to have M frame sequences, and setting each frame sequence to have N frames of images, so that M-N frames of images are shared; when each frame image of the high-resolution panoramic video file is stored, the second server is suitable for fusing the nth frame image and a frames of images before and after the nth frame image, taking the fused image as a super-resolution enhanced image of the nth frame image, and storing M frames of super-resolution enhanced images corresponding to M frames of images, wherein N is 1,2, … and M is N; the candidate image is a super-resolution enhanced image corresponding to the current frame of the on-demand panoramic video watched by the user in time.
Further, when the requested data type is on-demand short video data, the second server obtains the corresponding short video by: acquiring time period information and attitude information carried in a data request instruction sent by a user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment; selecting a part or all of frame panoramic images or super-resolution enhanced images corresponding to the time period from the stored high-resolution panoramic image frame sequence as candidate images according to the time period information; capturing screenshots, the directions of which correspond to the posture information carried in the instruction, in each frame of candidate panoramic image aiming at the selected plurality of frames of candidate images; and coding video files of all the intercepted screenshots according to a time sequence and storing the video files under an account corresponding to the user side for final preview and downloading of the user.
Further, the second server is further configured to: receiving a reservation request instruction sent by a user side, and feeding back reservation success information and reservation success time period information to the corresponding user side; sending appointment arrival time reminding information to a corresponding user side by the appointment starting time or the preset time in advance; after the live broadcast starting information input by the user is obtained, the live broadcast video/image data output by the remote control equipment is forwarded to the user side, wherein the live broadcast video data can be forwarded to the user side through the first server.
Further, the first server and the second server may be integrally provided, or may be provided independently of each other.
Further, in a case where the first server and the second server are provided independently of each other, the first server includes, for example: the stream media server or the video encoder is suitable for receiving live video data sent by the remote control equipment, recoding the live video data, directly establishing connection between a user who successfully reserves live broadcast and the remote control equipment, and pushing the stream to a corresponding user side through a video transmission protocol.
Further, the second server is further configured to: receiving an unmanned aerial vehicle control instruction from a user side, and judging the authority of the user side: if the user side has the authority, receiving the unmanned aerial vehicle control instruction to allow the user side to correspondingly control the unmanned aerial vehicle; and if the user has no authority, rejecting the unmanned aerial vehicle control instruction.
Further, when receiving a video/image data request instruction, a live broadcast reservation request instruction or an unmanned aerial vehicle control instruction from a user side, the second server first determines whether the instruction includes paid information, and establishes a data connection with the user side when the instruction includes the paid information.
Further, one or more user terminals are also included; each user side includes: the first sending module is used for sending a live broadcast reservation request to the first server or the second server; the second sending module is used for sending a request for acquiring the live broadcast data to the first server or the second server; the third sending module is used for sending the video-on-demand request to the second server; the fourth sending module is used for sending a photographing request in the video-on-demand to the second server, wherein the photographing request comprises the posture information of the needed photo; the fifth sending module is used for sending the unmanned aerial vehicle control instruction to the second server; the first receiving module is used for receiving and displaying the information whether the server successfully reserves and the time slot information of successful reservation sent by the server after the first sending module sends the live broadcast reservation request information to the corresponding server; the second receiving module is used for receiving and displaying the live video sent by the second server or the first server; the third receiving module is used for receiving and displaying the video-on-demand sent by the second server; the fourth receiving module is used for receiving and displaying the pictures sent by the second server; and a transmission module.
Further, the user equipment corresponding to the user side is a smart phone or a tablet computer.
Further, the system comprises a plurality of live terminals.
The invention discloses a video playing and photographing system, which provides a video playing and photographing system, and has the following functions: 1) multiple panoramic videos are shared by multiple users, and multi-angle high-definition shooting and high-definition short videos are recorded when the panoramic videos are watched; 2) a user watches live broadcast video and takes pictures in real time based on an appointment request; 3) the user controls unmanned aerial vehicle in real time and changes the shooting angle when watching the live broadcast, and the experience is enhanced.
In the invention, the server does not send the live video/image information of the unmanned aerial vehicle to each user terminal in real time, but transmits the live video/image information based on the reservation request of the user terminal, and the mode can reduce the network delay in the live broadcasting process of the server; in order to utilize the existing remote control equipment to carry out data communication with the server, namely, the existing remote controller does not have the functions of the remote controller in the scheme, in order to not transform the remote controller per se, the Android development board can also execute corresponding functions to carry out instruction transfer service, and therefore the existing remote control equipment can be directly utilized to realize the functions of the invention; in order to save the system hardware cost and make the transmission of the live video data faster than the forwarding through the server with common performance, a streaming media server or a video encoder can be added to realize the forwarding of the live video stream independently from the server.
In addition, the picture obtained by the user photographing in the on-demand panoramic video playing is a non-panoramic picture intercepted in the panoramic image with ultrahigh resolution generated by performing super-resolution fusion on the panoramic image frame with the same video source as the on-demand panoramic video according to the gesture of the user playing equipment, and the picture is higher in definition than the picture intercepted in the current frame of the on-demand panoramic video with low resolution; and because the on-demand panoramic video data and the on-demand image data are generated by the same high-definition video source, the data processing is simpler, more convenient and more easily obtained by applying the existing video source data.
In addition, the user can watch the live video of unmanned aerial vehicle, obtain the picture after the reservation is broadcast successfully, can also control the different positions of unmanned aerial vehicle, enjoy controlling unmanned aerial vehicle's enjoyment, and change and shoot the angle, has improved interactive and user experience of amusement.
These and other advantages of the present invention will become more apparent from the following detailed description of the preferred embodiments of the present invention, taken in conjunction with the accompanying drawings.
Drawings
The invention may be better understood by referring to the following description in conjunction with the accompanying drawings, in which like reference numerals are used throughout the figures to indicate like or similar parts. The accompanying drawings, which are incorporated in and form a part of this specification, illustrate preferred embodiments of the present invention and, together with the detailed description, serve to further explain the principles and advantages of the invention. In the drawings:
FIG. 1 is a block diagram schematically illustrating one example of a video playback and photography system of the present invention;
fig. 2 is a schematic diagram illustrating a possible structure of a user terminal.
Skilled artisans appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help improve the understanding of the embodiments of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described hereinafter with reference to the accompanying drawings. In the interest of clarity and conciseness, not all features of an actual implementation are described in the specification. It will of course be appreciated that in the development of any such actual embodiment, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which will vary from one implementation to another. Moreover, it will be appreciated that such a development effort might be complex and time-consuming, but would nevertheless be a routine undertaking for those of ordinary skill in the art having the benefit of this disclosure.
It should be noted that, in order to avoid obscuring the present invention with unnecessary details, only the device structures and/or processing steps closely related to the solution according to the present invention are shown in the drawings, and other details not so relevant to the present invention are omitted.
The embodiment of the invention provides a video playing and photographing system, which comprises a live broadcast end and a live broadcast end, wherein the live broadcast end is connected with the live broadcast end; the live broadcast end comprises an unmanned aerial vehicle, remote control equipment and a first server, wherein the unmanned aerial vehicle comprises an airborne control module, an airborne image transmission module, a cloud deck and a camera mounted on the cloud deck, and the unmanned aerial vehicle adjusts the shooting angle and the direction of the camera through the cloud deck; the onboard image transmission module is used for sending video/image information shot by the camera in real time to the remote control equipment as live broadcast data; the remote control equipment is provided with a ground image transmission module and is used for receiving live broadcast data from the airborne image transmission module, and the remote control equipment is used for processing the live broadcast data and sending the processed live broadcast data to the first server; the on-demand terminal comprises a second server, on-demand data are stored in the second server in advance, and the on-demand data comprise a plurality of panoramic video files with different resolutions corresponding to each of a plurality of high-definition video sources and a high-resolution panoramic image frame sequence acquired from each high-definition video source and serve as candidate image sequences of the on-demand image data; the second server is used for acquiring the corresponding on-demand data according to the data type requested by the data request instruction when receiving at least one data request instruction from one or more user terminals.
Fig. 1 is a block diagram illustrating an example of a video playback and photographing system according to the present invention.
As shown in fig. 1, in this example, the system comprises a live end 10 and an on-demand end 20.
Wherein, live end 10 includes unmanned aerial vehicle 11, remote control equipment 12 and first server 13.
Unmanned aerial vehicle 11 includes that machine carries control module, machine carries picture to pass module, cloud platform and installs in the wide angle camera of cloud platform. Unmanned aerial vehicle 11 accessible cloud platform adjusts wide angle camera's shooting angle position. In addition, the onboard rendering module may send video/image information captured in real time by the wide-angle camera to the remote control device 12 as live data. Wherein, airborne control module is suitable for control unmanned aerial vehicle's flight.
The remote control device 12 is provided with a ground map transmission module, the ground map transmission module can receive live broadcast data from the onboard map transmission module, and the remote control device 12 can process (for example, output) the live broadcast data and send the live broadcast data to the first server 13.
As shown in fig. 1, the on-demand terminal 20 mainly includes a second server 21, and on-demand data may be stored in the second server 21 in advance, where the on-demand data includes, for example, a plurality of panoramic video files with different resolutions corresponding to each of a plurality of high-definition video sources and a high-resolution panoramic image frame sequence acquired from each high-definition video source as candidate image sequences of the on-demand image data.
In other words, the on-demand data is obtained by:
the method comprises the steps of obtaining a plurality of high-definition video sources in advance, and carrying out secondary coding on each high-definition video source for multiple times (such as N times), so as to generate a plurality of (N) panoramic video files with different resolutions, wherein N is an integer greater than 1. Further, for each high definition video source, a sequence of high resolution panoramic image frames is acquired therefrom as a candidate image sequence for the on-demand image data.
For example, a high definition video source is a panoramic video file with a resolution of 8K, and the video file with a resolution of 720P, 960P or 1080P is generated through recompression coding, and the candidate image sequence of the on-demand image data is a sequence of panoramic image frames with a resolution of 8K.
When receiving at least one data request command from one or more clients, the second server 21 may obtain the corresponding on-demand data according to the data type requested by the data request command.
According to the embodiment of the present invention, the second server 21 is provided with a user management module, and the user management module is configured to receive an identity authentication request from a user side, perform identity authentication on the corresponding user side based on the identity authentication request, and send authentication success information to the corresponding user side after the authentication is successful so as to establish data connection with the user side.
Further, the first server 13 and the second server 21 may be provided with respective processing modules, storage modules, transmission modules, and the like.
According to the embodiment of the present invention, when receiving at least one data request command from one or more user terminals, for each data request command, the second server 21 may first determine the data type requested by the data request command, which is divided into three cases.
In the first case, if the requested data type is on-demand panoramic video data, the second server 21 may send the URL address of the stored panoramic video file matching the resolution contained in the instruction to the user terminal.
In the second case, if the requested data type is on-demand image data (the request instruction is sent when the on-demand panoramic video data is obtained), the second server 21 may obtain the corresponding photographed picture and send the photographed picture to the user terminal.
In the third case, if the requested data type is on-demand short video data (the request command is sent when on-demand panoramic video data is obtained), the second server 21 may obtain the corresponding short video and send the short video to the user end.
According to an embodiment of the present invention, when the requested data type is on-demand image data, the second server 21 may obtain the corresponding photographed picture by: acquiring time information and attitude information carried in a data request instruction sent by the user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment; selecting a frame of panoramic image from the stored high-resolution panoramic image frame sequence as a candidate image, wherein the frame of panoramic image is a frame of image corresponding to the current frame of the on-demand panoramic video watched by the user side in time; for the selected candidate image, capturing a screenshot of which the direction corresponds to the posture information carried in the instruction in the candidate image (wherein the size of the screenshot is a preset value, and the preset value can be set according to an empirical value or can be set according to a screen size parameter included in the instruction); and taking the screenshot as a photographed picture and storing the photographed picture under an account corresponding to the user side for final preview and downloading of the user.
Where high resolution is relative to low resolution video, for example, a video-on-demand panoramic video watched by a user is 1080p resolution, then its corresponding high resolution panoramic image frame sequence is 2k or 4k or 8k, etc.
In addition, the on-demand panoramic video watched by the user side is one of a plurality of pre-stored panoramic video files with different resolutions, because different users may have different resolutions of the watched videos according to different devices.
Alternatively, when the requested data type is the on-demand image data, the second server 21 may obtain the corresponding photographed picture by: acquiring time information and attitude information carried in a data request instruction sent by the user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment; selecting a frame corresponding to the current frame of the video in time and images of a plurality of frames before and after the frame from a stored high-resolution panoramic image frame sequence for fusion, and taking a fused enhanced image as a candidate image; for the selected candidate image, capturing a screenshot of which the direction corresponds to the posture information carried in the instruction in the candidate image (wherein the size of the screenshot is a preset value, and the preset value can be set according to an empirical value or can be set according to a screen size parameter included in the instruction); and taking the screenshot as a photographed picture and storing the photographed picture under an account corresponding to the user side for final preview and downloading of the user.
In addition, in order to reduce the processing time for acquiring the photographed picture by the server, the screenshot can be firstly followed by the fusion, that is: when the requested data type is the on-demand image data, the second server 21 may further acquire the corresponding photographed picture by: acquiring time information and attitude information carried in a data request instruction sent by the user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment; selecting a frame corresponding to the current frame of the watched on-demand panoramic video in time and images of a plurality of frames before and after the frame from the stored high-resolution panoramic image frame sequence as candidate images; capturing screenshots, the directions of which correspond to the posture information carried in the instruction, in each frame of candidate panoramic image aiming at the selected plurality of frames of candidate images; and fusing the plurality of captured screenshots, and storing the fused enhanced image as a photographed image under an account corresponding to the user side for final preview and downloading of the user.
According to an embodiment of the present invention, for a selected candidate image, the second server 21 may obtain a screenshot in the candidate image by: remapping the panoramic image (the plane rectangular picture) to a spherical surface, namely generating a corresponding panoramic mapping spherical surface by taking the side edge of the plane rectangular picture as a spherical semicircular arc, and mapping the plane rectangular picture to the panoramic mapping spherical surface; determining a user view angle according to the posture information of the corresponding user equipment; searching spherical graphics to be cut on the panoramic mapping spherical surface according to the user visual angle to cut; and mapping the clipped spherical graph into a rectangular picture.
In addition, in order to reduce the processing time of the server for processing the screenshot, the second server 21 may also pre-store a predetermined corresponding relationship between the attitude angle and the pixel coordinates of the panoramic image, and directly determine the pixel coordinates of the panoramic image according to the predetermined corresponding relationship after acquiring the user attitude information, so as to obtain the screenshot picture. For example, the mapping relationship in the screenshot process may be stored in advance in the following manner: the user attitude angle change range is 360 degrees in the horizontal direction and 180 degrees in the vertical direction, a unit of 0.1 degree or less precision is taken as one attitude angle unit, the corresponding relation between the attitude angle and the panoramic spherical pixel point coordinate is established according to the preset size of the screenshot, the corresponding relation between the spherical pixel point coordinate and the panoramic image (plane rectangular picture) pixel point coordinate is established according to the known projection relation, and finally the corresponding relation between the attitude angle and the panoramic image pixel point coordinate is established. And when the server acquires the user posture information, the server directly finds the pixel point coordinates of the panoramic image according to the corresponding relation, and the screenshot picture can be quickly acquired.
In one example, in order to further increase the response speed of the server in response to the user data request, the image fusion process may be processed and stored in advance, that is, when each frame of image of the high-resolution panoramic video file is stored, the following processing is performed: setting a high-resolution panoramic image frame sequence to have M frame sequences, and setting each frame sequence to have N frames of images, so that M x N frames of images are shared; when each frame image of the high-resolution panoramic video file is stored, the second server 21 is adapted to fuse the nth frame image and a frames before and after the nth frame image, use the fused image as a super-resolution enhanced image of the nth frame image, and store M × N super-resolution enhanced images corresponding to M × N frame images, where N is 1,2, …, and M × N; the candidate image is a super-resolution enhanced image corresponding to the current frame of the on-demand panoramic video watched by the user in time. Thus, the spatial resolution of the image can be further improved by the above image fusion processing.
According to an embodiment of the present invention, when the requested data type is on-demand short video data, the second server 21 may obtain the corresponding short video by, for example: acquiring time period information and attitude information carried in a data request instruction sent by a user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment; selecting a partial or whole frame panoramic image (or super-resolution enhanced image) corresponding to the time period from the stored high-resolution panoramic image frame sequence according to the time period information as a candidate image; capturing screenshots, the directions of which correspond to the posture information carried in the instruction, in each frame of candidate panoramic image aiming at the selected plurality of frames of candidate images; and coding video files of all the intercepted screenshots according to a time sequence and storing the video files under an account corresponding to the user side for final preview and downloading of the user.
According to the embodiment of the invention, the server does not send the live video/image data of the unmanned aerial vehicle to each user terminal in real time, but transmits the live video/image data based on the reservation request of the user terminal, so that the network delay in the live broadcasting process of the server can be reduced. For example, the second server 21 may receive a reservation request instruction sent by the user terminal, and after receiving the reservation request instruction, feed back information on whether the reservation is successful and information on a time period in which the reservation is successful to the corresponding user terminal; sending a reservation arrival time reminding message to a corresponding user side when the reservation starting time is up or the preset time is advanced (if the reservation starting time is 21:00, a reminder can be sent to the user side when the reservation starting time is 21:00 or five minutes is advanced, namely 20: 55); after the live broadcast starting information input by the user is obtained, the live broadcast video/image data output by the remote control equipment is forwarded to the user side, wherein the live broadcast video data can be forwarded to the user side through the first server.
According to the embodiment of the invention, the first server and the second server can be integrated into a whole or can be independent from each other.
According to an embodiment of the present invention, in a case where the first server and the second server are provided independently of each other, the first server may include, for example: the stream media server or the video encoder can receive live video data sent by the remote control equipment and re-encode the live video data, directly establishes connection between a user who successfully reserves live broadcast and the remote control equipment, and pushes the live broadcast to a corresponding user side through a video transmission protocol.
Therefore, a user who successfully reserves live broadcast does not need to forward the live broadcast video through the second server, but directly establishes connection with the remote control equipment through the streaming media server or the video encoder, receives and re-encodes the live broadcast video data sent by the remote control equipment, and pushes the live broadcast video data to a user side through a video transmission protocol (such as RTSP/RTMP), so that the hardware cost of a system can be saved, the pressure of the second server is reduced, and the transmission of the live broadcast video data is quicker than the transmission through a server with common performance.
In addition, according to the embodiment of the present invention, the second server 21 may further receive an unmanned aerial vehicle control instruction from the user side, and perform permission determination on the user side: if the user side has the authority, receiving the unmanned aerial vehicle control instruction to allow the user side to correspondingly control the unmanned aerial vehicle; and if the user has no authority, rejecting the unmanned aerial vehicle control instruction. After receiving the command requesting to control the drone (i.e., the drone control command), the second server 21 sends the control command to the drone through the remote control device, and the drone executes a corresponding action according to the control command.
It should be noted that the unmanned aerial vehicle control command may be provided in a variety of forms, so as to control different portions of the unmanned aerial vehicle, for example, one type of control command controls the azimuth angle of the pan/tilt head, another type of control command controls the pitch angle of the pan/tilt head, and another type of control command controls the flying height of the unmanned aerial vehicle.
In addition, when receiving a video/image data request instruction, a live broadcast reservation request instruction, or an unmanned aerial vehicle control instruction from a user side, the second server 21 may first determine whether the instruction includes paid information, and establish a data connection with the user side when the instruction includes paid information. Wherein the paid information is obtained, for example, by means of online payment.
In the above-described example, the video playing and photographing system does not include a user terminal. In some examples, the video playing and photographing system may also include a user terminal. For example, the video playing and photographing system includes one or more user terminals in addition to the live terminal 10 and the on-demand terminal 20.
Each user terminal has, for example, the structure shown in fig. 2. As shown in fig. 2, each user terminal includes a first sending module 31, a second sending module 32, a third sending module 33, a fourth sending module 34, a fifth sending module 35, a first receiving module 41, a second receiving module 42, a third receiving module 43, a fourth receiving module 44, and a transmission module 45. The transmission module 45 is used for data communication with the server, and may be a local area network wifi module, for example.
The first sending module 31 is configured to send a live broadcast reservation request to the second server 21; the second sending module 32 is configured to send a request for obtaining live broadcast data to the first server 13 or the second server 21; the third sending module 33 is configured to send the video-on-demand request to the second server 21; the fourth sending module 34 is configured to send a photo taking request in the video-on-demand to the second server 21, where the photo taking request includes the posture information of the required photo, and for example, the current posture information of the user terminal may be obtained by a user through a touch screen operation mode or a gyroscope integrated in the user equipment; and the fifth sending module 35 is configured to send the drone control instruction to the second server 21.
In addition, the first receiving module 41 is configured to receive and display information about whether the server successfully reserves and time slot information about the successful reservation, which are sent by the server, after the first sending module 31 sends the live broadcast reservation request information to the corresponding server; the second receiving module 42 is configured to receive and display a live video sent by the first server 13 or the second server 21; the third receiving module 43 is configured to receive and display the video-on-demand sent by the second server 21; the fourth receiving module 44 is configured to receive and display the picture sent by the second server 21.
The user device corresponding to the user side is, for example, a smart phone or a tablet computer.
Thus, after establishing communication connection with the second server 21, the user can select to watch a plurality of groups of panoramic videos stored in the second server, can take pictures to obtain pictures at any angle in watching the panoramic videos, and can select to watch live videos in an appointment mode; after the user successfully reserves live broadcast, the user can watch the aerial live video shot by the unmanned aerial vehicle and acquire the picture shot in real time through connecting the first server, and different parts of the unmanned aerial vehicle can be controlled in real time.
In addition, when this system was used in the scenic spot, can set up a plurality of live broadcast ends, and each sight spot all disposes one set of unmanned aerial vehicle, remote control equipment and first server 13 promptly, and a plurality of live broadcast ends are with a plurality of live broadcast video stream transmission to same total server in the scenic spot, and the different live broadcast video of different sight spots of multi-user's optional reservation are watched.
In addition, according to the embodiment of the present invention, in order to enable data communication between the existing remote control device and the server, the system may further include an Android development board connected to the remote control device and the server (the first server and/or the second server) to implement a relay service of the instruction, where the development board may be integrated in the remote control device.
In summary, the present application provides the following solutions:
the video playing and photographing system is characterized by comprising a live broadcasting end and a live broadcasting end;
the live broadcast end comprises an unmanned aerial vehicle, remote control equipment and a first server,
the unmanned aerial vehicle comprises an airborne control module, an airborne image transmission module, a holder and a camera mounted on the holder, and the unmanned aerial vehicle adjusts the shooting angle and the direction of the camera through the holder; the onboard image transmission module is used for sending video/image information shot by the camera in real time to the remote control equipment as live broadcast data;
the remote control equipment is provided with a ground image transmission module and is used for receiving live broadcast data from the airborne image transmission module, and the remote control equipment is used for processing the live broadcast data and sending the live broadcast data to the first server;
the on-demand terminal comprises a second server, on-demand data are stored in the second server in advance, and the on-demand data comprise a plurality of panoramic video files with different resolutions corresponding to each of a plurality of high-definition video sources and a high-resolution panoramic image frame sequence acquired from each high-definition video source and serve as candidate image sequences of the on-demand image data;
and the second server is used for acquiring the corresponding on-demand data according to the data type requested by the data request instruction when receiving at least one data request instruction from one or more user terminals.
Scheme 2. the video playing and photographing system according to scheme 1 is characterized in that the first server and the second server are integrally arranged.
Scheme 3. the video playing and photographing system according to scheme 1, wherein the first server and the second server are independently configured.
Scheme 4. the video playing and photographing system according to scheme 3, wherein the first server comprises: and the streaming media server or the video encoder is suitable for receiving and re-encoding the live video data sent by the remote control equipment, directly establishing connection between the user who successfully reserves the live broadcast and the remote control equipment, and pushing the stream to the corresponding user side through a video transmission protocol.
Scheme 5. the video playing and photographing system according to any of the schemes 1 to 4, characterized in that the system comprises a plurality of live terminals.
Scheme 6. the video playing and photographing system according to any of the schemes 1 to 5, wherein the second server is adapted to:
when at least one data request instruction from one or more user terminals is received, determining the type of data requested by the data request instruction for each data request instruction;
if the requested data type is the on-demand panoramic video data, sending the stored URL address of the panoramic video file matched with the resolution contained in the instruction to the user side;
if the requested data type is the on-demand image data, acquiring a corresponding photographed picture and sending the photographed picture to the user side;
and if the requested data type is the on-demand short video data, acquiring the corresponding short video and sending the short video to the user side.
Scheme 7. the video playing and photographing system according to scheme 6, wherein when the requested data type is on-demand image data, the second server obtains the corresponding photographed picture by:
acquiring time information and attitude information carried in a data request instruction sent by the user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment;
selecting a frame of panoramic image from the stored high-resolution panoramic image frame sequence as a candidate image, wherein the frame of panoramic image is a frame of image corresponding to the current frame of the on-demand panoramic video watched by the user side in time;
capturing a screenshot of which the direction corresponds to the posture information carried in the instruction in the selected candidate image;
and taking the screenshot as a photographed picture and storing the photographed picture under an account corresponding to the user side for final preview and downloading of the user.
Scheme 8. the video playing and photographing system according to scheme 6, wherein when the requested data type is on-demand image data, the second server obtains the corresponding photographed picture by:
acquiring time information and attitude information carried in a data request instruction sent by the user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment;
selecting a frame corresponding to the current frame of the video in time and images of a plurality of frames before and after the frame from a stored high-resolution panoramic image frame sequence for fusion, and taking a fused enhanced image as a candidate image;
capturing a screenshot of which the direction corresponds to the posture information carried in the instruction in the selected candidate image;
and taking the screenshot as a photographed picture and storing the photographed picture under an account corresponding to the user side for final preview and downloading of the user.
Scheme 9. the video playing and photographing system according to scheme 6, wherein when the requested data type is on-demand image data, the second server obtains the corresponding photographed picture by:
acquiring time information and attitude information carried in a data request instruction sent by the user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment;
selecting a frame corresponding to the current frame of the watched on-demand panoramic video in time and images of a plurality of frames before and after the frame from the stored high-resolution panoramic image frame sequence as candidate images;
capturing screenshots, the directions of which correspond to the posture information carried in the instruction, in each frame of candidate panoramic image aiming at the selected plurality of frames of candidate images;
and fusing the plurality of captured screenshots, and storing the fused enhanced image as a photographed image under an account corresponding to the user side for final preview and downloading of the user.
remapping the panoramic image onto a spherical surface, wherein the spherical surface is a corresponding panoramic mapping spherical surface generated by taking the side edge of a plane rectangular picture corresponding to the panoramic image as a spherical semi-circular arc, and mapping the plane rectangular picture onto the panoramic mapping spherical surface; determining a user view angle according to the posture information of the corresponding user equipment; searching spherical graphics to be cut on the panoramic mapping spherical surface according to the user visual angle to cut; and mapping the clipped spherical graph into a rectangular picture.
The video playing and photographing system according to any one of the schemes 7 to 9, wherein the second server stores a predetermined correspondence between the attitude angle and the pixel coordinates of the panoramic image in advance, and determines the pixel coordinates of the panoramic image directly according to the predetermined correspondence after acquiring the attitude information of the user to obtain the screenshot image.
Scheme 12. the video playing and photographing system according to scheme 8 or 9, wherein the frame sequence of the high resolution panoramic image is set to have M frame sequences, and each frame sequence has N images, so that M × N images are shared; when each frame image of the high-resolution panoramic video file is stored, the second server is suitable for fusing an nth frame image and a frames of images before and after the nth frame image, taking the fused image as a super-resolution enhanced image of the nth frame image, and storing M frames of super-resolution enhanced images corresponding to M frames of images, wherein N is 1,2, … and M is N; and the candidate image is a super-resolution enhanced image corresponding to the current frame of the on-demand panoramic video watched by the user in time.
acquiring time period information and attitude information carried in a data request instruction sent by a user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment;
selecting a part or all of frame panoramic images or super-resolution enhanced images corresponding to the time period from the stored high-resolution panoramic image frame sequence as candidate images according to the time period information;
capturing screenshots, the directions of which correspond to the posture information carried in the instruction, in each frame of candidate panoramic image aiming at the selected plurality of frames of candidate images;
and coding video files of all the intercepted screenshots according to a time sequence and storing the video files under an account corresponding to the user side for final preview and downloading of the user.
Scheme 14. the video playing and photographing system according to any of the schemes 1 to 13, wherein the second server is further configured to:
receiving a reservation request instruction sent by a user side, and feeding back reservation success information and reservation success time period information to the corresponding user side; sending appointment arrival time reminding information to a corresponding user side by the appointment starting time or the preset time in advance; and after acquiring the live broadcast starting information input by the user, forwarding the live broadcast video/image data output by the remote control equipment to the user side, wherein the live broadcast video data can be forwarded to the user side through the first server.
Scheme 15. the video playing and photographing system according to any of the schemes 1 to 14, wherein the second server is further configured to:
receiving an unmanned aerial vehicle control instruction from a user side, and judging the authority of the user side: if the user side has the authority, receiving the unmanned aerial vehicle control instruction to allow the user side to correspondingly control the unmanned aerial vehicle; and if the user has no authority, rejecting the unmanned aerial vehicle control instruction.
Scheme 16. the video playing and photographing system according to any one of schemes 1 to 15, wherein when receiving a video/image data request instruction, a live broadcast reservation request instruction, or an unmanned aerial vehicle control instruction from a user side, the second server first determines whether the instruction includes paid information, and establishes a data connection with the user side if the instruction includes paid information.
Scheme 17. the video playback and photographing system according to any of the schemes 1 to 16, wherein the plurality of different resolution panoramic video files corresponding to each of the plurality of high definition video sources include:
and generating N panoramic video files with different resolutions by performing secondary encoding on each high-definition video source in the plurality of high-definition video sources for N times, wherein N is an integer greater than 1.
Scheme 18. the video playing and photographing system according to any one of the schemes 1 to 17, wherein the second server is provided with a user management module, the user management module is configured to receive an identity authentication request from a user side, perform identity authentication on the corresponding user side based on the identity authentication request, and send authentication success information to the corresponding user side after the authentication is successful so as to establish data connection with the user side.
Scheme 19. the video playing and photographing system according to any of the schemes 1 to 18, further comprising one or more user terminals; each user side includes:
a first sending module, configured to send a live broadcast reservation request to the first server or the second server;
the second sending module is used for sending a request for acquiring live broadcast data to the first server or the second server;
a third sending module, configured to send a video-on-demand request to the second server;
the fourth sending module is used for sending a photographing request in the video-on-demand to the second server, wherein the photographing request comprises the posture information of the needed photo;
a fifth sending module, configured to send an unmanned aerial vehicle control instruction to the second server;
the first receiving module is used for receiving and displaying the information whether the server successfully reserves and the time slot information of successful reservation sent by the server after the first sending module sends the live broadcast reservation request information to the corresponding server;
the second receiving module is used for receiving and displaying the live video sent by the first server or the second server;
the third receiving module is used for receiving and displaying the video-on-demand sent by the second server;
the fourth receiving module is used for receiving and displaying the pictures sent by the second server; and
and a transmission module.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense, and the scope of the present invention is defined by the appended claims.
Claims (7)
1. The video playing and photographing system is characterized by comprising a live broadcasting end and a live broadcasting end;
the live broadcast end comprises an unmanned aerial vehicle, remote control equipment and a first server,
the unmanned aerial vehicle comprises an airborne control module, an airborne image transmission module, a holder and a camera mounted on the holder, and the unmanned aerial vehicle adjusts the shooting angle and the direction of the camera through the holder; the onboard image transmission module is used for sending video/image information shot by the camera in real time to the remote control equipment as live broadcast data;
the remote control equipment is provided with a ground image transmission module and is used for receiving live broadcast data from the airborne image transmission module, and the remote control equipment is used for processing the live broadcast data and sending the live broadcast data to the first server;
the first server comprises a streaming media server or a video encoder and is suitable for receiving live video data sent by the remote control equipment, recoding the live video data, directly establishing connection between a user who successfully reserves live broadcast and the remote control equipment, and pushing the live broadcast to a corresponding user side through a video transmission protocol; the on-demand terminal comprises a second server, on-demand data are stored in the second server in advance, and the on-demand data comprise a plurality of panoramic video files with different resolutions corresponding to each of a plurality of high-definition video sources and a high-resolution panoramic image frame sequence acquired from each high-definition video source and serve as candidate image sequences of the on-demand image data;
the second server is used for acquiring corresponding on-demand data according to the data type requested by the data request instruction when receiving at least one data request instruction from one or more user sides; when the requested data type is the on-demand image data, the second server acquires the corresponding photographed picture in the following way: acquiring time information and attitude information carried in a data request instruction sent by the user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment; selecting a frame of panoramic image from the stored high-resolution panoramic image frame sequence as a candidate image, wherein the frame of panoramic image is a frame of image corresponding to the current frame of the on-demand panoramic video watched by the user side in time; capturing a screenshot of which the direction corresponds to the posture information carried in the instruction in the selected candidate image; storing the screenshot as a photographed picture under an account corresponding to the user side for final preview and download of the user;
the second server prestores a preset corresponding relation between the attitude angle and the pixel point coordinates of the panoramic image, and directly determines the pixel point coordinates of the panoramic image according to the preset corresponding relation after acquiring the attitude information of the user so as to obtain a screenshot picture; the mapping relation in the screenshot process is stored in advance in the following mode: the user attitude angle change range is 360 degrees in the horizontal direction and 180 degrees in the vertical direction, a unit of 0.1 degree or less precision is taken as one unit of the attitude angle, the corresponding relation between the attitude angle and the panoramic spherical pixel point coordinate is established according to the preset size of the screenshot, then the corresponding relation between the spherical pixel point coordinate and the panoramic image (plane rectangular picture) pixel point coordinate is established according to the known projection relation, namely the corresponding relation between the attitude angle and the panoramic image pixel point coordinate is finally established;
the second server is further configured to: receiving a reservation request instruction sent by a user side, and feeding back reservation success information and reservation success time period information to the corresponding user side; sending appointment arrival time reminding information to a corresponding user side by the appointment starting time or the preset time in advance; and after acquiring the live broadcast starting information input by the user, forwarding the live broadcast video/image data output by the remote control equipment to the user side, wherein the live broadcast video data can be forwarded to the user side through the first server.
2. The video playing and photographing system of claim 1, wherein the second server is adapted to:
when at least one data request instruction from one or more user terminals is received, determining the type of data requested by the data request instruction for each data request instruction;
if the requested data type is the on-demand panoramic video data, sending the stored URL address of the panoramic video file matched with the resolution contained in the instruction to the user side;
if the requested data type is the on-demand image data, acquiring a corresponding photographed picture and sending the photographed picture to the user side;
and if the requested data type is the on-demand short video data, acquiring the corresponding short video and sending the short video to the user side.
3. The video playing and photographing system of claim 2, wherein when the requested data type is on-demand image data, the second server obtains the corresponding photographed picture by:
acquiring time information and attitude information carried in a data request instruction sent by the user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment;
selecting a frame corresponding to the current frame of the video in time and images of a plurality of frames before and after the frame from a stored high-resolution panoramic image frame sequence for fusion, and taking a fused enhanced image as a candidate image;
capturing a screenshot of which the direction corresponds to the posture information carried in the instruction in the selected candidate image;
and taking the screenshot as a photographed picture and storing the photographed picture under an account corresponding to the user side for final preview and downloading of the user.
4. The video playing and photographing system of claim 2, wherein when the requested data type is on-demand image data, the second server obtains the corresponding photographed picture by:
acquiring time information and attitude information carried in a data request instruction sent by the user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment;
selecting a frame corresponding to the current frame of the watched on-demand panoramic video in time and images of a plurality of frames before and after the frame from the stored high-resolution panoramic image frame sequence as candidate images;
capturing screenshots, the directions of which correspond to the posture information carried in the instruction, in each frame of candidate panoramic image aiming at the selected plurality of frames of candidate images;
and fusing the plurality of captured screenshots, and storing the fused enhanced image as a photographed image under an account corresponding to the user side for final preview and downloading of the user.
5. The video playing and photographing system of claim 3 or 4, wherein the high resolution panoramic image frame sequence has M frame sequences, and each frame sequence has N images, so that M x N images are total; when each frame image of the high-resolution panoramic video file is stored, the second server is suitable for fusing an nth frame image and a frames of images before and after the nth frame image, taking the fused image as a super-resolution enhanced image of the nth frame image, and storing M frames of super-resolution enhanced images corresponding to M frames of images, wherein N is 1,2, … and M is N; and the candidate image is a super-resolution enhanced image corresponding to the current frame of the on-demand panoramic video watched by the user in time.
6. The video playing and photographing system of claim 5, wherein when the requested data type is short video-on-demand data, the second server obtains the corresponding short video by:
acquiring time period information and attitude information carried in a data request instruction sent by a user side, wherein the attitude information comprises a horizontal angle and a pitch angle of corresponding user equipment;
selecting a part or all of frame panoramic images or super-resolution enhanced images corresponding to the time period from the stored high-resolution panoramic image frame sequence as candidate images according to the time period information;
capturing screenshots, the directions of which correspond to the posture information carried in the instruction, in each frame of candidate panoramic image aiming at the selected plurality of frames of candidate images;
and coding video files of all the intercepted screenshots according to a time sequence and storing the video files under an account corresponding to the user side for final preview and downloading of the user.
7. The video playing and photographing system of claim 1, wherein the second server is further configured to:
receiving an unmanned aerial vehicle control instruction from a user side, and judging the authority of the user side: if the user side has the authority, receiving the unmanned aerial vehicle control instruction to allow the user side to correspondingly control the unmanned aerial vehicle; and if the user has no authority, rejecting the unmanned aerial vehicle control instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810681020.8A CN108924590B (en) | 2018-06-27 | 2018-06-27 | Video playing and photographing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810681020.8A CN108924590B (en) | 2018-06-27 | 2018-06-27 | Video playing and photographing system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108924590A CN108924590A (en) | 2018-11-30 |
| CN108924590B true CN108924590B (en) | 2021-09-03 |
Family
ID=64422870
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810681020.8A Active CN108924590B (en) | 2018-06-27 | 2018-06-27 | Video playing and photographing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108924590B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112738010B (en) * | 2019-10-28 | 2023-08-22 | 阿里巴巴集团控股有限公司 | Data interaction method and system, interaction terminal and readable storage medium |
| CN112788374B (en) * | 2019-11-05 | 2023-02-28 | 腾讯科技（深圳）有限公司 | Information processing method, device, equipment and storage medium |
| CN113159201B (en) * | 2021-04-28 | 2023-04-25 | 上海德衡数据科技有限公司 | Cloud edge-based intelligent fusion information calculation method and device and cloud server |
| CN113473009B (en) * | 2021-06-29 | 2022-11-08 | 广州极飞科技股份有限公司 | Photographing method and device based on dual systems and camera equipment |
| CN117131225A (en) * | 2022-05-19 | 2023-11-28 | 影石创新科技股份有限公司 | Video processing method, device, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104038694A (en) * | 2014-05-27 | 2014-09-10 | 小米科技有限责任公司 | Method and device for displaying panoramic image |
| CN105744231A (en) * | 2016-03-18 | 2016-07-06 | 普宙飞行器科技（深圳）有限公司 | Unmanned ship mobile live telecasting method and unmanned ship mobile live telecasting system |
| CN107205122A (en) * | 2017-08-03 | 2017-09-26 | 哈尔滨市舍科技有限公司 | The live camera system of multiresolution panoramic video and method |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103438868B (en) * | 2012-01-09 | 2015-09-09 | 刘进 | Based on the object height measuring method of spherical panorama camera |
| US20180027265A1 (en) * | 2016-07-21 | 2018-01-25 | Drop In, Inc. | Methods and systems for live video broadcasting from a remote location based on an overlay of audio |
| CN106534087A (en) * | 2016-10-31 | 2017-03-22 | 易瓦特科技股份公司 | System and method for live broadcast, server and unmanned plane |
| CN106657792B (en) * | 2017-01-10 | 2020-02-18 | 哈尔滨市一舍科技有限公司 | Shared viewing device |
| CN107155065A (en) * | 2017-06-28 | 2017-09-12 | 哈尔滨市舍科技有限公司 | A kind of virtual photograph device and method |
-
2018
- 2018-06-27 CN CN201810681020.8A patent/CN108924590B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104038694A (en) * | 2014-05-27 | 2014-09-10 | 小米科技有限责任公司 | Method and device for displaying panoramic image |
| CN105744231A (en) * | 2016-03-18 | 2016-07-06 | 普宙飞行器科技（深圳）有限公司 | Unmanned ship mobile live telecasting method and unmanned ship mobile live telecasting system |
| CN107205122A (en) * | 2017-08-03 | 2017-09-26 | 哈尔滨市舍科技有限公司 | The live camera system of multiresolution panoramic video and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108924590A (en) | 2018-11-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108924590B (en) | Video playing and photographing system | |
| CN106550182B (en) | Shared unmanned aerial vehicle viewing system | |
| US10271082B2 (en) | Video distribution method, video reception method, server, terminal apparatus, and video distribution system | |
| CN109417624B (en) | Apparatus and method for providing and displaying content | |
| EP3238445B1 (en) | Interactive binocular video display | |
| JP6607433B2 (en) | Video distribution method and server | |
| CN106657923B (en) | Scene switching type shared viewing system based on position | |
| WO2018030206A1 (en) | Camerawork generating method and video processing device | |
| CN108616557B (en) | Panoramic video transmission method, device, terminal, server and system | |
| US20200329266A1 (en) | Information processing apparatus, method for processing information, and storage medium | |
| US20150124171A1 (en) | Multiple vantage point viewing platform and user interface | |
| CN108650494B (en) | Live broadcast system capable of instantly obtaining high-definition photos based on voice control | |
| US20140240500A1 (en) | System and method for adjusting an image for a vehicle mounted camera | |
| CN108495048B (en) | Double-camera image acquisition equipment based on holder control | |
| US11539983B2 (en) | Virtual reality video transmission method, client device and server | |
| KR102644833B1 (en) | Method, and system for compensating delay of virtural reality stream | |
| CN104012106A (en) | Aligning videos representing different viewpoints | |
| CN106657792B (en) | Shared viewing device | |
| US20180227501A1 (en) | Multiple vantage point viewing platform and user interface | |
| CN107592549B (en) | Panoramic video playing and photographing system based on two-way communication | |
| WO2015159487A1 (en) | Image delivery method, image reception method, server, terminal apparatus, and image delivery system | |
| CN115103166A (en) | Video processing method and terminal equipment | |
| US20200259880A1 (en) | Data processing method and apparatus | |
| CN106657922B (en) | Scene switching type shared image processing system based on position | |
| CN107835435B (en) | Event wide-view live broadcasting equipment and associated live broadcasting system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 266100 Block C 200-43, Chuangke Street, Qingdao, 306 Ningxia Road, Laoshan District, Qingdao City, Shandong Province Applicant after: QINGDAO YISPACE TECHNOLOGY Co.,Ltd. Address before: 150016 Heilongjiang Province, Harbin City Economic Development Zone haping Road District Dalian road and Xingkai road junction Applicant before: HARBIN YISHE TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |