CN114556958A

CN114556958A - Video transmission method and system, video processing method and device, playing terminal and movable platform

Info

Publication number: CN114556958A
Application number: CN202080071094.5A
Authority: CN
Inventors: 杨效; 曹子晟; 张超; 王新伟
Original assignee: SZ DJI Technology Co Ltd
Current assignee: SZ DJI Technology Co Ltd
Priority date: 2020-12-23
Filing date: 2020-12-23
Publication date: 2022-05-27
Also published as: WO2022133782A1

Abstract

A video transmission method and system, a video processing method and device, a playing terminal and a movable platform are provided. The video transmission method (200) is applied to a playing terminal, the playing terminal is in communication connection with a movable platform, the movable platform comprises a picture transmission device and a shooting device, the shooting device is used for shooting video data, the picture transmission device is used for acquiring the video data and sending the video data to the playing terminal, and the method comprises the following steps: acquiring image transmission setting information and video recording specification setting information (S201), wherein the video recording specification setting information comprises video recording resolution and video recording frame rate, when the image transmission setting information is in a first image transmission mode, the image transmission frame rate is a first frame rate, the video recording frame rate is greater than or equal to the first frame rate, when the image transmission setting information is in a second image transmission mode, the image transmission frame rate is a second frame rate, the video recording frame rate is less than or equal to the second frame rate, and the first frame rate is less than the second frame rate; based on the picture transmission setting information and the video recording specification setting information, a control signal is transmitted (S202).

Description

Video transmission method and system, video processing method and device, playing terminal and movable platform

Technical Field

The present invention generally relates to the field of video technologies, and in particular, to a video transmission method and system, a video processing method and device, a playing terminal, and a mobile platform.

Background

The pass-through machine with the glasses is tested, extremely image transmission experience (low time delay and high image quality) is pursued, high frame rate video recording is supported, the video recording format and the image transmission format of the current pass-through machine are bound one by one, the frame rates are required to be the same, and the selectivity of a user to the video recording format is limited. In addition, the glasses have playback requirements of inserting an SD (secure digital) card (the SD card has an airplane-side video memory), but the processing capability of the image transmission processing chip at the glasses end is limited, and sometimes, part of video files cannot be played back, which affects the user experience.

Therefore, in view of the above problems, a video transmission method and system, a video data processing method and device, a playing terminal, and a mobile platform are provided.

Disclosure of Invention

The present invention has been made to solve at least one of the above problems. Specifically, a first aspect of the present invention provides a video transmission method applied to a play terminal, where the play terminal is in communication connection with a movable platform, the movable platform includes a mapping device and a shooting device, the shooting device is used to shoot video data, the mapping device is used to obtain the video data and send the video data to the play terminal, and the method includes: acquiring image transmission setting information and video recording specification setting information, wherein the image transmission setting information comprises one mode setting information of a first image transmission mode and a second image transmission mode, the video recording specification setting information comprises a video recording resolution and a video recording frame rate, when the image transmission setting information is the first image transmission mode, the image transmission frame rate is a first frame rate, the video recording frame rate is greater than or equal to the first frame rate, when the image transmission setting information is the second image transmission mode, the image transmission frame rate is a second frame rate, the video recording frame rate is less than or equal to the second frame rate, and the first frame rate is less than the second frame rate; and sending a control signal based on the image transmission setting information and the video specification setting information, wherein the control signal is used for controlling the shooting device to shoot video data, controlling the image transmission device to send the video data to the playing terminal based on the image transmission setting information, and controlling the shooting device to record the video data based on the video setting information.

A second aspect of the present invention provides a video transmission method applied to a mobile platform, where a play terminal is in communication connection with the mobile platform, the mobile platform includes a picture-taking device and a shooting device, the shooting device is used to shoot video data, the play terminal is used to obtain and play the video data, the picture-taking device is used to obtain and send the video data to the play terminal, and the method includes: acquiring a control signal sent by the playing terminal, wherein the control signal is used for controlling the shooting device to shoot video data, controlling the image transmission device to transmit the video data to the play terminal based on image transmission setting information, and controlling the photographing device to record the video data based on video recording setting information, wherein the image transmission setting information includes one of a first image transmission mode and a second image transmission mode, the video recording specification setting information includes a video recording resolution and a video recording frame rate, when the image transmission setting information is the first image transmission mode, the image transmission frame rate is a first frame rate, the video recording frame rate is greater than or equal to the first frame rate, when the image transmission setting information is a second image transmission mode, the image transmission frame rate is a second frame rate, the video recording frame rate is less than or equal to the second frame rate, and the first frame rate is less than the second frame rate; and responding to the control signal, controlling the shooting device to shoot video data, controlling the image transmission device to send the video data to the playing terminal based on image transmission setting information, and controlling the shooting device to record the video data based on the video recording setting information.

A third aspect of the present application provides a broadcast terminal, including:

a memory for storing executable program instructions;

the mobile platform comprises an image transmission device and a shooting device, wherein the shooting device is used for shooting video data, and the image transmission device is used for acquiring the video data and sending the video data to the playing terminal;

one or more processors configured to execute the program instructions stored in the memory, causing the processors to perform the steps of: acquiring image transmission setting information and video recording specification setting information, wherein the image transmission setting information comprises one mode setting information of a first image transmission mode and a second image transmission mode, the video recording specification setting information comprises a video recording resolution and a video recording frame rate, when the image transmission setting information is the first image transmission mode, the image transmission frame rate is a first frame rate, the video recording frame rate is greater than or equal to the first frame rate, when the image transmission setting information is the second image transmission mode, the image transmission frame rate is a second frame rate, the video recording frame rate is less than or equal to the second frame rate, and the first frame rate is less than the second frame rate; and sending a control signal based on the image transmission setting information and the video specification setting information, wherein the control signal is used for controlling the shooting device to shoot video data, controlling the image transmission device to send the video data to the playing terminal based on the image transmission setting information, and controlling the shooting device to record the video data based on the video setting information.

A fourth aspect of the present application provides a movable platform comprising

A photographing device for photographing video data;

the image transmission device is used for acquiring the video data and sending the video data to the playing terminal,

a memory for storing executable program instructions;

one or more processors configured to execute the program instructions stored in the memory, causing the processors to perform the steps of: acquiring a control signal sent by the playing terminal, wherein the control signal is used for controlling the shooting device to shoot video data, controlling the image transmission device to transmit the video data to the play terminal based on image transmission setting information, and controlling the photographing device to record the video data based on video recording setting information, wherein the image transmission setting information includes one of a first image transmission mode and a second image transmission mode, the video recording specification setting information includes a video recording resolution and a video recording frame rate, when the image transmission setting information is the first image transmission mode, the image transmission frame rate is a first frame rate, the video recording frame rate is greater than or equal to the first frame rate, when the image transmission setting information is a second image transmission mode, the image transmission frame rate is a second frame rate, the video recording frame rate is less than or equal to the second frame rate, and the first frame rate is less than the second frame rate; and responding to the control signal, controlling the shooting device to shoot video data, controlling the image transmission device to send the video data to the playing terminal based on image transmission setting information, and controlling the shooting device to record the video data based on the video recording setting information.

A fifth aspect of the present application provides a video transmission system, comprising: the foregoing playback terminal; as well as the aforementioned movable platform.

A sixth aspect of the present application provides a video processing method, including: acquiring a first video code stream, a second video code stream and an audio code stream, wherein the first video code stream is used for playing by a first type of playing terminal, the coding format of the first video code stream corresponds to the coding format which can be played by the first type of playing terminal, the second video code stream is used for playing by a second type of playing terminal, the coding format of the second video code stream corresponds to the coding format which can be played by the second type of playing terminal, and the video specification of the second video code stream is smaller than or equal to the threshold specification; packaging the first video code stream, the second video code stream and the audio code stream into a video file with a preset file format; and storing the video file into a first memory so that the first type of playing terminal and/or the second type of playing terminal can play back the video file.

A seventh aspect of the present application provides a video processing apparatus, comprising: a memory for storing executable program instructions; one or more processors for executing the program instructions stored in the memory, causing the processors to perform the aforementioned video processing methods; the memory comprises a first memory, the first memory is used for storing the video file, and the memory is arranged in the video processing device in a pluggable mode.

An eighth aspect of the present application provides a movable platform, comprising: a photographing device for photographing video data; a memory for storing executable program instructions; one or more processors for executing the program instructions stored in the memory, causing the processors to perform the aforementioned video processing methods; the memory comprises a first memory, the first memory is used for storing the video file, and the first memory is arranged in the video processing device in a pluggable mode.

A ninth aspect of the present application provides a computer storage medium having stored thereon a computer program that, when executed by a processor, implements the aforementioned video transmission method or, alternatively, implements the aforementioned video processing method.

According to the video transmission method, the control device can transmit the video data to the playing terminal in one of the first image transmission mode and the second image transmission mode, so that a user can experience the image transmission experience with low delay or high image quality, in the video transmission method, the video recording frame rate can be equal to or lower than the first frame rate in the first image transmission mode, the requirement of the user on the video recording with the low frame rate can be met, the storage space occupied by the video data of the video recording can be saved, the video recording frame rate can be larger than or equal to the second frame rate in the second image transmission mode, the requirements of the user on various video recording frame rates can be met, more experiences and selections can be provided for the user, and the use experience of the user can be improved.

In addition, according to the video processing method, the first video code stream, the second video code stream and the audio code stream are packaged in one video file, so that the video file can be played at multiple types of playing terminals, the capacity limitation of a second type of playing terminal chip is overcome, the video playing effect of the first type of playing terminal is improved, and compared with a scheme that the first video code stream and the second video code stream are independently packaged, the video processing method reduces one path of audio code stream, reduces the processing load of a processor, reduces the total storage code rate and improves the user experience.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive labor.

FIG. 1 shows a schematic block diagram of a video transmission system in one embodiment of the present application;

FIG. 2 shows a schematic flow chart of a video transmission method in one embodiment of the present application;

FIG. 3 shows a schematic flow chart of a video transmission method in another embodiment of the present application;

FIG. 4 shows a schematic block diagram of a cast terminal in one embodiment of the present application;

FIG. 5 shows a schematic block diagram of a movable platform in one embodiment of the present application;

FIG. 6 shows a schematic flow chart of a video processing method in one embodiment of the present application;

FIG. 7 is a diagram illustrating a packaging structure of a video file in one embodiment of the present application;

fig. 8 shows a schematic block diagram of a video processing apparatus in an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, exemplary embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. It is to be understood that the described embodiments are merely a subset of embodiments of the invention and not all embodiments of the invention, with the understanding that the invention is not limited to the example embodiments described herein. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the invention described herein without inventive step, shall fall within the scope of protection of the invention.

In the following description, numerous specific details are set forth in order to provide a more thorough understanding of the present invention. It will be apparent, however, to one skilled in the art, that the present invention may be practiced without one or more of these specific details. In other instances, well-known features have not been described in order to avoid obscuring the invention.

It is to be understood that the present invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. As used herein, the term "and/or" includes any and all combinations of the associated listed items.

In order to provide a thorough understanding of the present invention, a detailed structure will be set forth in the following description in order to explain the present invention. Alternative embodiments of the invention are described in detail below, however, the invention may be practiced in other embodiments that depart from these specific details.

Some embodiments of the invention are described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.

First, the present application provides a video transmission system, which may include a movable platform, a play terminal, a control terminal, and the like, wherein the movable platform may include an airplane such as an unmanned aerial vehicle, a ship, a robot, and the like. The play terminal may include a terminal device for playing the map data, and the play terminal may be handheld or wearable, for example, the play terminal may include a smart phone, a tablet computer, a desktop computer, a computer, glasses, gloves, a helmet, a microphone, or any combination thereof. The control terminal may include, for example, a mobile phone, a remote controller, a tablet computer, a notebook computer, etc., and may also be a part or all of a control system of the movable platform, and may also be a part or all of a computer device that can implement the control method of the movable platform by software, hardware, or a combination of software and hardware.

The movable platform can comprise a shooting device and an image transmission device, wherein the shooting device is used for shooting video or image data; the image transmission device is used for acquiring the video data and sending the video data to the playing terminal. The camera device may be a device with an image sensor, such as a camera, a video camera, or also other devices. An image sensor (also referred to herein as a camera sensor) is a device for capturing image data, which may be, for example, a CMOS image sensor, a CCD image sensor, or the like. In one example, the camera may also be disposed on the body of a movable platform (e.g., an aircraft, a handheld tripod head) in the form of an embedded imaging system. Alternatively, the photographing device may be disposed on the body of the movable platform as a load, and the user may control the photographing device through the play terminal or the control terminal.

The broadcasting terminal and/or the control terminal may have an Application (APP) installed thereon, where the APP is configured to receive an operation instruction input by a user, the broadcasting terminal and/or the control terminal provides a control signal to one or more of the aircraft or the pan/tilt/zoom apparatus, the carrier, and the load according to the operation instruction input by the user, and the control signal of the terminal device may cause a load control, such as controlling an operation of a camera such as a camera or other shooting apparatus (capturing still or moving video or images, zooming, turning on or off, switching an imaging mode, changing a resolution of the video or images, changing a focal length, changing a depth of field, changing an exposure time, changing a viewing angle or a viewing field).

In one particular example, as shown in fig. 1, the video transmission system may include an aircraft 101, glasses 102, and a remote control device 103.

Aircraft 101 is for example unmanned aerial vehicle, and unmanned aerial vehicle can be rotor type unmanned aerial vehicle, for example four rotor unmanned aerial vehicle, six rotor unmanned aerial vehicle, eight rotor unmanned aerial vehicle, also can be fixed wing unmanned aerial vehicle. The aircraft 101 may include a power system, a pan and tilt head, a camera, a map-transfer device such as a digital map-transfer transceiver, a mobile device, and the like.

The power system is used for providing moving power for the airplane 101, and comprises one or more of a propeller, a motor and an electric speed regulator. The shooting device can be carried on the main body of the movable platform through the pan-tilt, is used for shooting images in the moving process of the movable platform and is also used for recording videos in the moving process of the movable platform. The photographing device includes, but is not limited to, a multispectral imager, a hyperspectral imager, a visible light camera, an infrared camera, and the like. The tripod head is a multi-shaft transmission and stability augmentation system, and a tripod head motor compensates the shooting angle of the image shooting device by adjusting the rotation angle of the rotation shaft, and prevents or reduces the shake of the imaging equipment by arranging a proper buffer mechanism. The digital image transceiver may refer to a device that transmits information (e.g., image data) in a digital communication link, i.e., the digital image transceiver may be used for the mobile platform to interact with other terminals, which may include one or more of a play terminal and a control terminal. For example, the digital image transceiver may be used to transmit a data packet including image data captured by a camera to a cast terminal. The moving device is used for controlling the movable platform to move, namely controlling the moving parameters of the movable platform, wherein the moving parameters comprise moving speed, moving attitude, moving direction, moving track and the like.

In this embodiment, the playing terminal may refer to a glasses device at the flyer end or other devices. The glasses device may refer to a glasses device that can play video, such as Virtual Reality (VR) or Augmented Reality (AR). In a cross-flight competition, the eyewear equipment at the flyer end may refer to eyewear equipment controlled by the flyer (i.e., the contestant). The broadcast terminal may include a mapping device, such as a digital mapping transceiver, a display, etc., which may be used for the broadcast terminal to interact with the movable platform. For example, the image transmission device of the playing terminal can be used for receiving a data packet sent by the movable platform through the image transmission device and playing according to the data packet so as to present a picture shot by the movable platform.

In the system shown in fig. 1, an airplane 101 carries an image pickup device such as a camera to record images and transmit real-time image data to ground-side glasses 102, a remote control device 103 is used to control the airplane 101 to fly, record images and the like, and the glasses 102 are used to receive and display image data such as images or videos, set formats, control airplane-side video and the like.

The pass-through machine with glasses pursues an extreme image transmission experience (such as low delay and high image quality) and supports high frame rate video recording. Here, (image-transfer) high image quality mode: since the channel widths of the sky end (e.g., the airplane end) and the ground end (e.g., the glasses end) are fixed (e.g., 40Mbps), the higher the frame rate of transmission is, the smaller the average bandwidth that can be allocated per frame is, and the poorer the image quality is. Therefore, the image-transfer low frame rate 60fps is better than the image-transfer high frame rate 120fps, so the image-transfer low frame rate 60fps can be called as the high image quality mode. (graph passing) low latency mode: since the higher the frame rate, the faster the screen refresh rate, and the smaller the delay that can be felt by human eyes, the image transmission high frame rate 120fps is called as a low delay mode.

In the conventional scheme at present, the following defects mainly exist:

1. the video format and the image format of a camera, for example, are bound one by one, and the frame rate must be the same, in such a way that the following determinations are made: a) graph-passing low latency mode: the camera settings can only select 1080P120 video, which is sometimes not desired by the user. For example, in order to save the storage space of the SD card, the user prefers to use 1080P60, but the user cannot select this mode unless switching to the high-quality mode; b) image-transfer high-quality mode: the camera setting can only select 4KP60 or 1080P60 for recording, and the 1080P120 (for example, 4 times of slow motion) slow motion recording mode cannot be selected, thereby limiting the exertion of the user.

2. When one of the camera video format and the image transmission format changes, the other changes, so that a user feels strange, and the user needs to learn and grope to understand the corresponding relation between the camera video format and the image transmission format;

3. the camera video format setting and the image transmission format setting are respectively placed under different menus, and a user sets image transmission high-quality image quality/low-delay time and cannot see the change of the corresponding camera video format; the user sets the camera recording format and cannot see the change of picture transmission high image quality/low time delay. Unless switching to another menu for viewing, the operation is too complicated.

Therefore, in view of the above problems, the present application provides a video transmission method applied to a play terminal, where the play terminal is in communication connection with a movable platform, the movable platform includes an image transmission device and a shooting device, the shooting device is used for shooting video data, the image transmission device is used for acquiring the video data and sending the video data to the play terminal, and the method includes: acquiring image transmission setting information and video recording specification setting information, wherein the image transmission setting information comprises one mode setting information of a first image transmission mode and a second image transmission mode, the video recording specification setting information comprises a video recording resolution and a video recording frame rate, when the image transmission setting information is the first image transmission mode, the image transmission frame rate is a first frame rate, the video recording frame rate is greater than or equal to the first frame rate, when the image transmission setting information is the second image transmission mode, the image transmission frame rate is a second frame rate, the video recording frame rate is less than or equal to the second frame rate, and the first frame rate is less than the second frame rate; and sending a control signal based on the image transmission setting information and the video specification setting information, wherein the control signal is used for controlling the shooting device to shoot video data, controlling the image transmission device to send the video data to the playing terminal based on the image transmission setting information, and controlling the shooting device to record the video data based on the video setting information.

Next, a video transmission method 200 of the present application is described based on the angle of the play terminal with reference to fig. 2. The mobile platform is applied to a playing terminal which is in communication connection with the mobile platform, the mobile platform comprises a picture transmission device and a shooting device, the shooting device is used for shooting video data, the picture transmission device is used for acquiring the video data and sending the video data to the playing terminal,

first, as shown in fig. 2, a video transmission method 200 of the present application includes: in step S201, obtaining image transmission setting information and video recording specification setting information, where the image transmission setting information includes one of a first image transmission mode and a second image transmission mode, the video recording specification setting information includes a video recording resolution and a video recording frame rate, when the image transmission setting information is the first image transmission mode, the image transmission frame rate is a first frame rate, the video recording frame rate is greater than or equal to the first frame rate, when the image transmission setting information is the second image transmission mode, the image transmission frame rate is a second frame rate, the video recording frame rate is less than or equal to the second frame rate, and the first frame rate is less than the second frame rate; in step S202, based on the image transmission setting information and the video recording specification setting information, a control signal is sent, where the control signal is used to control the shooting device to shoot video data, control the image transmission device to send the video data to the playing terminal based on the image transmission setting information, and control the shooting device to record video data based on the video recording setting information.

In one example, the first image transfer mode may be an image transfer high image quality mode, and when the image transfer setting information is the first image transfer mode, the image transfer frame rate is a first frame rate, optionally, the first frame rate is less than or equal to 60fps, for example, the first frame rate is equal to 60fps, as shown in table 1; illustratively, the second image transmission mode may be a low latency mode, and when the image transmission setting information is the second image transmission mode, the image transmission frame rate is a second frame rate, which is optionally greater than 60fps and less than or equal to 120fps, for example, the second frame rate may be equal to 120fps, as shown in table 1.

In one example, acquiring picture transmission setting information and video recording specification setting information of a photographing apparatus includes: firstly, responding to a first user instruction, controlling a display of the playing terminal to display a setting interface, wherein the setting interface is used for displaying: the option corresponding to the first image transmission mode and the option corresponding to the second image transmission mode; alternatively, the setting interface may also be configured to display setting information of other cameras, such as camera parameters, and the like, the playback terminal may be provided with a plurality of function keys, such as a physical key (e.g., a menu key, and the like) or a virtual function key, and the display of the playback terminal may be controlled to display the setting interface based on a first user instruction input by the user through the function keys. Then, in response to a mode selection instruction input by a user, determining one of the first image transmission mode and the second image transmission mode as the image transmission setting information, for example, acquiring a mode selection instruction input by the user through, for example, a function key, and in response to the mode selection instruction input by the user, determining one of the first image transmission mode and the second image transmission mode as the image transmission setting information; in another example, the setting interface may further display a plurality of options, such as an image transmission specification, a camera parameter, a video specification, and the like, and may select one of the plurality of options by obtaining an instruction input by a user through a function key, such as a direction key, a volume key, and the like, and further select a plurality of sub-options set under the option, such as a low latency mode, a high image quality mode, and the like under the image transmission specification option. And finally, determining the video specification setting information based on the determined picture transmission setting information. The setting linkage of the picture transmission setting information and the picture recording specification setting information is realized, the video recording and the picture transmission frame rate of the shooting device are set, the user can be ensured to obtain expected video effects such as low delay or high image quality, and the user can observe the picture meeting the subjective requirement at the playing terminal. In addition, the video format setting, the picture transmission high image quality and the low delay switching options of the camera are all arranged under the menu of the camera, so that a user can conveniently and quickly check the state change.

The playable terminal may automatically determine the video recording specification setting information based on the determined map transmission setting information, or may manually determine the video recording specification setting information based on a user instruction. In this application, the video specification setting information includes a video resolution and a video frame rate, that is, the video specification (also referred to as a video format herein) may include a video resolution and a video frame rate, as shown in table 1, a video format 4KP60 indicates that the video resolution is 4KP, and the video frame rate is 60fps, and for example, a video format 1080P60 indicates that the video resolution is 1080P, and the video frame rate is 60 fps; for example, the video format 1080P120 indicates a video resolution of 1080P and a video frame rate of 120 fps. Optionally, the recording resolution includes, but is not limited to, 4KP, 720P, or 1080P, or other resolutions.

In one example, determining the video recording specification setting information based on the determined map transmission setting information includes: when the image transmission setting information is in a first image transmission mode, responding to a video specification setting instruction input by a user, and controlling a display of the playing terminal to display a plurality of first type video specifications on the setting interface, wherein the video frame rate of the first type video specifications is greater than or equal to the first frame rate; in response to a user-entered specification selection instruction, one of the plurality of first-type video recording specifications is determined as the video recording specification setting information, for example, the first-type video recording specifications may include, but are not limited to, 4KP60, 1080P60, 1080P120, or other video recording specifications. For example, when the user determines that the video specification setting information is 1080P120, the photographing apparatus may be controlled to perform a slow motion video recording mode, for example, a quadruple slow motion, so that the user obtains more experience of video effects.

In the embodiment of the present application, the image-recording-frame rate is greater than or equal to the first frame rate when the image-recording setting information is in the first image-recording mode, for example, high-quality image, for example, as shown in table 1, for example, when the image-recording setting information is in the first image-recording mode, for example, high-quality image, the first frame rate may be 60fps, the image-recording frame rate is greater than or equal to the first frame rate, for example, the image-recording frame rate may be 60fps or 120fps, and therefore, in the high-quality image, the image-recording format may be selected from 4KP60, 1080P60 or 1080P120, and when the image-recording setting information has other frame rates and resolutions, the image-recording format may be more than 3 types listed in the table.

In another example, determining the video recording specification setting information based on the determined map transmission setting information includes: when the image transmission setting information is in a second image transmission mode, controlling a display of the playing terminal to display a plurality of second type video recording specifications on the setting interface based on a video recording specification setting instruction input by a user, wherein the video recording frame rate of the plurality of second type video recording specifications is less than or equal to the second frame rate; and determining one of the plurality of second-type video recording specifications as the video recording specification setting information based on a specification selection instruction input by a user. For example, the second type of video specification may include, but is not limited to, 1080P60, 1080P120, or other video specifications. For example, in the second image mode, when the user determines that the recording specification setting information is 1080P60, the storage space required for recording video, such as the storage space of the SD card, can be saved by lowering the recording frame rate on the premise of obtaining low latency.

In the embodiment of the present application, the image-transferring setting information and the video-recording specification setting information are linked, for example, when the image-transferring setting information is in the second image-transferring mode, for example, low latency, the video-recording frame rate is less than or equal to the second frame rate, for example, as shown in table 1, for example, when the image-transferring setting information is in the second image-transferring mode, for example, low latency, the second frame rate may be 120fps, the video-recording frame rate is less than or equal to the first frame rate, for example, the video-recording frame rate may be 60fps, 120fps, therefore, in the low latency mode, the video-recording format may be selected from 1080P60, 1080P120, and of course, in the case of other frame rates and resolutions, the video-recording format may be more than 2 listed in the table.

Both the video and the image transmission of the shooting device can actively drop frames, for example, the frame rate of image transmission is 120fps to 60fps, and for example, the frame rate of image transmission is 120fps, and the video of the shooting device is actively dropped to 60fps for video recording.

In the embodiment of the present application, the picture-taking setting is prioritized over the video-taking specification setting, for example, when the picture-taking preference (i.e., the picture-taking mode) is the high-quality mode, when the video-taking format is set, only the first type of video-taking specification, for example, 4KP60, 1080P60, 1080P120 shown in the first 3 rows of table 1, may be displayed, and when the picture-taking preference (i.e., the picture-taking mode) is the low-latency mode, when the video-taking format is set, only the second type of video-taking specification, for example, 1080P60, 1080P120 shown in the last two rows of table 1, may be displayed. Generally, the passive switching of the image transmission mode is not caused by the switching of the video recording specification of the shooting device.

Table 1:

in one example, the method of the present application further comprises: and determining an acquisition frame rate of an image sensor of the shooting device based on the image transmission setting information and the video specification setting information, wherein the acquisition frame rate is greater than or equal to the greater of the video frame rate and the image transmission frame rate. The acquisition frame rate refers to the number of image frames acquired by the image sensor per second.

The image sensor outputs a high frame rate, for example, a second frame rate, for example, 120fps, only when necessary, for example, when the image transmission setting information is the first image transmission mode and the video frame rate is equal to the second frame rate, the acquisition frame rate is equal to the second frame rate, for example, 120 fps; for another example, when the image transmission setting information is the second image transmission mode, and the capture frame rate is equal to the second frame rate, for example, 120fps, when other video recording specification settings and image transmission format settings of the first image mode, for example, the video recording frame rate and the image transmission frame rate, are both less than the second frame rate, for example, both the video recording frame rate and the image transmission frame rate are the first frame rate (for example, 60fps), the image sensor may not output the high frame rate, for example, 120fps, so as to reduce the load and power consumption of the system.

In one example, when the shooting device is in a video recording mode at a first resolution and a first video recording frame rate, the method further includes: acquiring a mode switching instruction input by a user, wherein the mode switching instruction is used for indicating that the first image transmission mode currently running is switched to a second image transmission mode or the second image transmission mode currently running is switched to the first image transmission mode; sending the mode switching instruction to the movable platform so as to switch the first image transmission mode currently operated into a second image transmission mode or switch the second image transmission mode currently operated into the first image transmission mode; according to the switched image transmission mode, updating the video specification setting information, and sending the updated video specification setting information to the movable platform so as to control the shooting device to record the video with the updated video specification setting information, wherein the updated video specification setting information includes a second resolution and the first video frame rate, and the second resolution is less than or equal to the first resolution.

When the image transmission mode is switched, the video resolution or the video frame rate of the shooting device is kept unchanged as much as possible, if the video resolution cannot be reduced, the updated video resolution is lower than or equal to the video resolution before updating, through the setting, the video specification of the shooting device can be kept unchanged as much as possible along with the image transmission mode, the corresponding relation between the video format and the image transmission format is avoided being learned and groped by a user due to the change, the user operation is simplified, the user time is saved, and the user experience is improved.

In one specific example, when switching from the low latency mode to the high quality mode in the video recording mode, the video recording format is kept unchanged as much as possible, for example, as shown in table 2.

Table 2:

before switching (Camera format)	After switching (Camera format)
		1080P60(120->60)	1080P60(60-60)
1080P120(120-120)	1080P120(120->60

1080P60(120- >60) refers to that the frame rate of acquisition is lost from 120fps to 60fps to obtain the video frame rate, in this embodiment, the specific frame loss processing mode may be an equal interval frame loss mode or an equal interval extraction mode, or an image fusion mode, and the like, which is not limited specifically herein.

In another specific example, in the video recording mode, when switching from the high quality mode to the low latency mode, the video recording format is kept unchanged as much as possible, for example, as shown in table 3.

Table 3:

before switching (Camera format)	After switching (Camera format)
		4KP60(120-60)	1080P60(120->60)
1080P60(60-60 or 120->60)	1080P60(120->60)

Further, when the image-capturing mode is switched (for example, switching between high-quality image and low-latency), the video recording specification of the image-capturing device may be passively switched, and no matter the video frame rate or the video resolution of the image-capturing device is changed, a prompt is provided interactively, for example: when the shooting device records at a first resolution and a first recording frame rate, the method further comprises: when the first image transmission mode is switched to a second image transmission mode, or when the second image transmission mode is switched to the first image transmission mode, sending updated video specification setting information to the movable platform so as to control the shooting device to record video according to the updated video specification setting information, wherein the updated video specification setting information comprises a second resolution and a second video frame rate; and when the second resolution is different from the first resolution and/or when the second video recording frame rate is different from the first video recording frame rate, outputting prompt information to prompt a user that the video recording specification is changed. The prompt message can be a text message or other types of prompt messages, the display of the playing terminal can display the prompt message in a differentiated manner in any suitable preset manner, and the differentiated display in the preset manner comprises at least one of the following display manners: highlighting, blinking, diacritic, distinctive shading or distinctive font color, for example, by displaying a reminder in the color of a red shading, or any other video recording specification that enables a user to quickly identify a change.

The video transmission method 300 of the present application is described below with reference to fig. 3 based on the angle of the movable platform. The video transmission method 300 is applied to a movable platform, the playing terminal is in communication connection with the movable platform, the movable platform comprises an image transmission device and a shooting device, the shooting device is used for shooting video data, the playing terminal is used for acquiring and playing the video data, and the image transmission device is used for acquiring the video data and sending the video data to the playing terminal.

Referring to fig. 3, a video transmission method 300 includes the steps of: in step S301, a control signal sent by the broadcast terminal is obtained, where the control signal is used to control the shooting device to shoot video data, controlling the image transmission device to transmit the video data to the play terminal based on image transmission setting information, and controlling the photographing device to record the video data based on video recording setting information, wherein the image transmission setting information includes one of a first image transmission mode and a second image transmission mode, the video recording specification setting information includes a video recording resolution and a video recording frame rate, when the image transmission setting information is the first image transmission mode, the image transmission frame rate is a first frame rate, the video recording frame rate is greater than or equal to the first frame rate, when the image transmission setting information is a second image transmission mode, the image transmission frame rate is a second frame rate, the video recording frame rate is less than or equal to the second frame rate, and the first frame rate is less than the second frame rate; in step S302, in response to the control signal, the shooting device is controlled to shoot video data, the image transmission device is controlled to send the video data to the playing terminal based on the image transmission setting information, and the shooting device is controlled to record the video data based on the video recording setting information.

Optionally, when the image-rendering setting information includes a first image-rendering mode, for example, a high-definition mode, the video recording specification setting information includes one of a plurality of first type video recording specifications, and the video recording frame rate of the plurality of first type video recording specification options is greater than or equal to the first frame rate. For example, the first type of video specification may include, but is not limited to, 4KP60, 1080P60, 1080P120, or other video specifications. For example, when the user determines that the video specification setting information is 1080P120, the photographing apparatus may be controlled to perform a slow motion video recording mode, for example, a quadruple slow motion, so that the user obtains more experience of video effects.

In one example, when the map transmission setting information is the second map transmission mode, the video recording specification setting information includes one of the second type video recording specifications, and the video recording frame rate of the second type video recording specifications is less than or equal to the second frame rate. For example, as shown in table 1, for example, when the mapping setting information is the second mapping mode, such as low latency, the second frame rate may be 120fps, and the video frame rate is less than or equal to the first frame rate, for example, the video frame rate may be 60fps, 120fps, so that in the low latency mode, the video format may be selected from 1080P60, 1080P120, and of course, in other frame rates and resolutions, the video format may be more than 2 listed in the table.

In one example, the video transmission method 300 further comprises: and determining an acquisition frame rate of an image sensor of the shooting device based on the image transmission setting information and the video specification setting information, wherein the acquisition frame rate is greater than or equal to the greater of the video frame rate and the image transmission frame rate. The mobile platform may automatically determine the frame rate of the image sensor of the shooting device after obtaining the image transmission setting information and the video specification setting information, or may determine the frame rate of the image sensor of the shooting device based on the image transmission setting information and the video specification setting information, and acquire the frame rate from the playing terminal and control the image sensor of the shooting device to acquire image data based on the frame rate.

The image sensor outputs a high frame rate, for example, a second frame rate, for example, 120fps, only when necessary, for example, when the image transmission setting information is the first image transmission mode and the video frame rate is equal to the second frame rate, the acquisition frame rate is equal to the second frame rate, for example, 120 fps; for another example, when the image-rendering setting information is the second image-rendering mode, and the capture frame rate is equal to the second frame rate, for example, 120fps, when other video-rendering specification settings and image-rendering format settings of the first image mode, for example, both the video-rendering frame rate and the image-rendering frame rate, are less than the second frame rate, for example, both the video-rendering frame rate and the image-rendering frame rate are the first frame rate (for example, 60fps), the image sensor may not output the high frame rate, for example, 120fps, so as to reduce the load and power consumption of the system.

In one example, when the camera is recording at a first resolution and a first recording frame rate, the video transmission method 300 further includes: acquiring a mode switching instruction sent by the playing terminal; responding to the mode switching instruction, and switching the first image transmission mode currently operated into a second image transmission mode or switching the second image transmission mode currently operated into the first image transmission mode; and acquiring updated video specification setting information, and controlling the shooting device to record the video according to the updated video specification setting information, wherein the updated video specification setting information comprises a second resolution and the first video frame rate, and the second resolution is less than or equal to the first resolution. The updated video specification setting information may be acquired from the playback terminal, or may be updated video specification setting information determined by the movable platform according to the switched image transmission mode.

When the image transmission mode is switched, the video resolution or the video frame rate of the shooting device is kept unchanged as much as possible, if the video resolution cannot be reduced, namely the updated video resolution is lower than or equal to the video resolution before updating, through the setting, the video specification of the shooting device can be kept unchanged as much as possible along with the image transmission mode, the situation that a user needs to learn and grope the corresponding relation between the video format and the image transmission format due to the change is avoided, the user operation is simplified, the user time is saved, the learning cost of the user is reduced, and the user experience is improved.

For some details regarding the relevant steps of the video transmission method 300, reference may also be made to the video transmission method 200 described above, which is not repeated herein.

Next, a cast terminal 400 of the present application, which can perform as the main body of the foregoing video transmission method 200, is described with reference to fig. 4.

In one example, as shown in fig. 4, the cast terminal 400 includes one or more processors 401, memory 402, communication interface 403, display 404, and the like. These components are interconnected by a bus system and/or other form of connection mechanism (not shown).

The memory 402 is used for storing executable instructions, such as for storing corresponding steps and program instructions for implementing the video transmission method 200 according to embodiments of the present application. The memory 402 may store an operating system (including programs for processing various basic system services and for performing hardware-related tasks), application programs required for at least one function (such as a control function of the photographing apparatus, a sound playing function, an image playing function, and the like), and the like. Some of these applications may be downloaded from an external server via wireless communication. Other applications may be installed in the memory 402 at the time of manufacture or factory, for example, for basic functions of the glasses-type player terminal 400 (e.g., receiving a phone call, making a phone call, receiving a message, transmitting a message, etc.). It is common that an application program is stored in the memory 402 and executed by the processor to perform the operation (or function) of the glasses-type player terminal 400. May include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, Random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, Read Only Memory (ROM), a hard disk, flash memory (e.g., SD card), and the like.

The communication interface 403 may be used for communication between the cast terminal 400 and a removable platform or other device, including wired or wireless communication. The communication interface 403 may be for accessing a wireless network based on a communication standard, such as WiFi (e.g., WiFi6), Software-defined radio (SDR), 2G, 3G, 4G, 5G, or a combination thereof. In an exemplary embodiment, the communication interface 403 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication interface 403 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

Optionally, the cast terminal 400 further includes a display 404, a means for displaying images or video generated by the processor assembly. The display may include, for example, a Liquid Crystal Display (LCD) device or an Organic Light Emitting Diode (OLED) device. Based on data obtained from the processor, the display may display various images, such as menus, selected operating parameters, a shooting mode selection interface, images captured by an image sensor, other information received with the processor, etc., and/or from a user interface of the device, etc.

Optionally, the cast terminal 400 also includes an input device (not shown) that may be a device used by the user to input various operations, such as may include one or more of function keys (such as, for example, touch keys, keys (e.g., volume control keys, switch keys, etc.), mechanical keys, soft keys, etc., a joystick, microphone, touch screen, etc., or other user input device for enabling the user to input information.

The cast terminal 400, for example, glasses, may further include a power supply unit (not shown) capable of being configured to receive external power or provide internal power in order to supply appropriate power required to operate elements and components included in the cast terminal 400. The power supply unit may include a battery, and the battery may be configured to be embedded in the terminal body or configured to be detachable from the terminal body. The cast terminal 400, for example, glasses, according to an embodiment of the present application may include an optical unit forming a virtual image of visual information, and may display virtual images having various sizes in various positions based on the optical unit.

The processor 401 may be a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in the camera to perform desired functions. The processor 401 is capable of executing the instructions stored in the memory 402 to perform the respective steps of the video transmission methods described herein. For example, the processor 401 can include one or more embedded processors, processor cores, microprocessors, logic circuits, hardware Finite State Machines (FSMs), Digital Signal Processors (DSPs), ISPs, encoders, or a combination thereof.

In one example, processor 401 is operative to execute program instructions stored in the memory to cause one or more processors to perform the steps of:

acquiring image transmission setting information and video recording specification setting information, wherein the image transmission setting information comprises one mode setting information of a first image transmission mode and a second image transmission mode, the video recording specification setting information comprises a video recording resolution and a video recording frame rate, when the image transmission setting information is the first image transmission mode, the image transmission frame rate is a first frame rate, the video recording frame rate is greater than or equal to the first frame rate, when the image transmission setting information is the second image transmission mode, the image transmission frame rate is a second frame rate, the video recording frame rate is less than or equal to the second frame rate, and the first frame rate is less than the second frame rate;

and sending a control signal based on the image transmission setting information and the video specification setting information, wherein the control signal is used for controlling the image transmission device to send the video data to the playing terminal based on the image transmission setting information when the shooting device shoots the video data, and controlling the shooting device to record the video data based on the video setting information.

Optionally, the first frame rate is less than or equal to 60fps, and the second frame rate is greater than 60fps and less than or equal to 120 fps.

Optionally, the video resolution includes 4KP, 720P, or 1080P or other suitable resolutions.

In one example, processor 401 is configured to execute program instructions stored in the memory to cause one or more processors to perform the steps of obtaining picture-taking settings information and video recording specification settings information for a camera, including: responding to a first user instruction, controlling a display of the playing terminal to display a setting interface, wherein the setting interface is used for displaying: the option corresponding to the first image transmission mode and the option corresponding to the second image transmission mode; determining one of the first image transmission mode and the second image transmission mode as the image transmission setting information in response to a mode selection instruction input by a user; and determining the video recording specification setting information based on the determined picture transmission setting information.

In one example, processor 401 is configured to execute program instructions stored in the memory to cause one or more processors to determine the video cassette recording specification setting information based on the determined map transmission setting information, including: when the image transmission setting information is in a first image transmission mode, responding to a video specification setting instruction input by a user, and controlling a display of the playing terminal to display a plurality of first type video specifications on the setting interface, wherein the video frame rate of the first type video specifications is greater than or equal to the first frame rate; in response to a specification selection instruction input by a user, determining one of the plurality of first-type video recording specifications as the video recording specification setting information.

In one example, processor 401 is configured to execute program instructions stored in the memory to cause one or more processors to determine the video cassette recording specification setting information based on the determined map transmission setting information, including: when the image transmission setting information is in a second image transmission mode, controlling a display of the playing terminal to display a plurality of second type video recording specifications on the setting interface based on a video recording specification setting instruction input by a user, wherein the video recording frame rate of the plurality of second type video recording specifications is less than or equal to the second frame rate; and determining one of the plurality of second-type video recording specifications as the video recording specification setting information based on a specification selection instruction input by a user.

In one example, processor 401 is operative to execute program instructions stored in the memory to cause one or more processors to perform: and determining an acquisition frame rate of an image sensor of the shooting device based on the image transmission setting information and the video specification setting information, wherein the acquisition frame rate is greater than or equal to the greater of the video frame rate and the image transmission frame rate. Optionally, when the image transmission setting information is the first image transmission mode and the video recording frame rate is equal to the second frame rate, the acquisition frame rate is equal to the second frame rate, or when the image transmission setting information is the second image transmission mode and the acquisition frame rate is equal to the second frame rate.

In one example, when the camera is recording at a first resolution and a first recording frame rate, processor 401 is configured to execute the program instructions stored in the memory such that the one or more processors execute the processor to further: acquiring a mode switching instruction input by a user, wherein the mode switching instruction is used for indicating that the first image transmission mode currently running is switched to a second image transmission mode or the second image transmission mode currently running is switched to the first image transmission mode; sending the mode switching instruction to the movable platform so as to switch the first image transmission mode currently operated into a second image transmission mode or switch the second image transmission mode currently operated into the first image transmission mode; and updating video specification setting information according to the switched image transmission mode, and sending the updated video specification setting information to the movable platform so as to control the shooting device to record the video according to the updated video specification setting information, wherein the updated video specification setting information comprises a second resolution and the first video frame rate, and the second resolution is less than or equal to the first resolution.

When the camera is recording at a first resolution and a first recording frame rate, in one example, processor 401 is configured to execute the program instructions stored in the memory to cause one or more processors to perform: when the first image transmission mode is switched to a second image transmission mode, or when the second image transmission mode is switched to the first image transmission mode, controlling the shooting device to record at a second resolution and a second video recording frame rate; when the second resolution is different from the first resolution and/or when the second video frame rate is different from the first video frame rate, outputting prompt information; the playing terminal further comprises a display, and the display is used for acquiring and displaying the prompt information, so that when the video format changes, a user can acquire the prompt information in time.

In the embodiment of the present application, the first frame rate is less than or equal to 60fps, for example, the first frame rate is equal to 60fps, the second frame rate is greater than 60fps and less than or equal to 120fps, for example, the second frame rate is equal to 120 fps. Optionally, the video resolution includes 4KP, 720P, or 1080P, or other suitable resolution.

The movable platform of the present application is described with reference to fig. 5, wherein the movable platform 500 can be used to perform the relevant steps of the video transmission method 300.

In one example, as shown in fig. 5, movable platform 500 includes one or more processors 501, cameras 505, memory 502, image transfer devices 503, cameras 504, communication interfaces (not shown), and the like. These components are interconnected by a bus system and/or other form of connection mechanism (not shown).

The memory 502 is used for storing executable instructions, such as for storing corresponding steps and program instructions for implementing the video transmission method 300 according to embodiments of the present application. The memory 502 may store an operating system (including programs for handling various basic system services and for performing hardware related tasks), application programs required for at least one function, and the like. May include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, Random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, Read Only Memory (ROM), a hard disk, flash memory (e.g., SD card), and the like.

A communication interface (not shown) may be used for communication between the movable platform 500 and a terminal device (e.g., a control terminal, a play terminal such as glasses) or other devices, including wired or wireless communication. The communication interface 1004 may be for accessing a wireless network based on a communication standard, such as WiFi (e.g., WiFi6), Software-defined radio (SDR), 2G, 3G, 4G, 5G, or a combination thereof. In an exemplary embodiment, the mobile platform 500 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, 1004 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

The processor 501 may be a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in the camera to perform desired functions. The processor 501 is capable of executing the instructions stored in the memory 502 to perform the respective steps of the video transmission method 300 described herein. For example, the processor 1001 can include one or more embedded processors, processor cores, microprocessors, logic circuits, hardware Finite State Machines (FSMs), Digital Signal Processors (DSPs), ISPs, encoders, or a combination thereof.

The shooting device 504 is configured to shoot video or image data, and the image transmission device 503 is configured to obtain the video data and send the video data to the play terminal. The camera 504 may be a device with an image sensor, such as a camera, video camera, or other device as well. An image sensor (also referred to herein as a camera sensor) is a device for capturing image data, which may be, for example, a CMOS image sensor, a CCD image sensor, or the like. In one example, the camera 504 may also be disposed on the body of a movable platform (e.g., an aircraft, a handheld tripod head) in the form of an embedded video system. Alternatively, the camera 504 may be disposed on the body of the movable platform as a load, and the user may control the camera through a play terminal or a control terminal. The image transmission device 503, such as a digital image transmission transceiver, may refer to a device that transmits information (such as image data) through a digital communication link, that is, the digital image transmission transceiver may be used for the mobile platform to interact with other terminals.

The camera 504 may be disposed on the movable platform body. In certain embodiments, the movable platform comprises an aircraft (e.g., an unmanned aerial vehicle), a robot, a vehicle, a pan-tilt head, or a boat. When the shooting device is applied to the unmanned aerial vehicle, the platform body is the fuselage of the unmanned aerial vehicle, wherein the shooting device can be arranged on the movable platform body in an embedded image system mode. When the photographing device is applied to a vehicle, the platform body is a body of the vehicle. The vehicle may be an autonomous vehicle or a semi-autonomous vehicle, without limitation. When the shooting device is applied to the robot, the platform body is the robot. When the shooting device is applied to the ship, the platform body is a ship body.

In one example, the processor 1001 is configured to execute the program instructions stored in the memory, so that the one or more processors execute the relevant steps of the video transmission method 300 described in the foregoing, and the description of the specific video transmission method 300 may refer to the foregoing, and will not be repeated here.

In addition, the present application also provides a video transmission system, which includes the foregoing playing terminal, movable platform, control terminal, etc. The details of the specific video transmission system can be found in the description of fig. 1, fig. 4 and fig. 5, and will not be repeated here.

In summary, according to the video transmission method, the playing terminal, the mobile platform and the video transmission system of the present application, the control apparatus may transmit the video data to the playing terminal in one of the first image transmission mode and the second image transmission mode, so that the user experiences the image transmission experience with low latency or high image quality, and in the video transmission method of the present application, the video frame rate may be equal to or lower than the first frame rate in the first image transmission mode, so as to meet the requirement of the user for the video with the low frame rate, and further save the storage space occupied by the video data of the video, and the video frame rate may be greater than or equal to the second frame rate in the second image transmission mode, so as to meet the requirement of the user with multiple frame rates, provide the user with more video experiences and selections, and improve the user experience.

A pass-through machine with glasses has a playback requirement for inserting an SD card (for example, an airplane-side video is stored in a card).

But because the processing capacity of the glasses end image transmission processing chip is limited: therefore, the method can only decode the H.264 coding format, cannot decode the H.265 coding format (for example, the video of the H.265 coding format recorded by the airplane end cannot be played, but the H.265 coding format has lower code rate and better image quality compared with the H.264 coding format), has insufficient processing capacity, and only has the processing capacity of 4Kp30, about 265420800pixel/s (for example, the video of 4Kp60, 4Kp50, 1080p240 and the like recorded by the airplane end cannot be played).

In order to solve the above problems, a general processing method is: 1. the video coding format and the video specification of the airplane end are not limited. Therefore, the receiving glasses end cannot play back part of the video file, and the experience is not good; 2. and (3) limiting the video coding format and the video specification of the airplane end, and only recording the video which can be played back by the glasses end. Therefore, the method for recording the video by the user is limited, the film production is influenced, and the experience is not good. 3. Simultaneously, two paths of recorded files are respectively placed in two video files, one file is used for playing a computer terminal and the like, and the other file is used for playing back a glasses plug-in card; and two video files are recorded simultaneously, the CPU load can rise, and the card writing speed can be influenced by writing in multiple paths of code streams simultaneously.

Therefore, in view of the above problems, the present application also provides a video processing method, including: acquiring a first video code stream, a second video code stream and an audio code stream, wherein the first video code stream is used for playing by a first type of playing terminal, the coding format of the first video code stream corresponds to the coding format which can be played by the first type of playing terminal, the second video code stream is used for playing by a second type of playing terminal, the coding format of the second video code stream corresponds to the coding format which can be played by the second type of playing terminal, and the video specification of the second video code stream is smaller than or equal to the threshold specification; packaging the first video code stream, the second video code stream and the audio code stream into a video file with a preset file format; and storing the video file into a first memory so that the first type of playing terminal or the second type of playing terminal can play back the video file. According to the video processing method, the first video code stream, the second video code stream and the audio code stream are packaged in one video file, so that the video file can be played at multiple types of playing terminals, the capacity limit of a second type of playing terminal chip is overcome, the video playing effect of the first type of playing terminal is improved, and compared with a scheme that the first video code stream and the second video code stream are independently packaged, the video processing method reduces the audio code stream all the way, reduces the processing load of a processor, reduces the total storage code rate, and improves the user experience.

The video processing method of the present application is described below with reference to fig. 6, where fig. 6-6 show a schematic flow chart of the video processing method in one embodiment of the present invention.

In one example, as shown in fig. 6, a video processing method 600 of the present application includes the steps of: in step S601, a first video code stream, a second video code stream, and an audio code stream are obtained, where the first video code stream is used for a first type of playing terminal to play, a coding format of the first video code stream corresponds to a coding format that can be played by the first type of playing terminal, the second video code stream is used for a second type of playing terminal to play, a coding format of the second video code stream corresponds to a coding format that can be played by the second type of playing terminal, and a video specification of the second video code stream is smaller than or equal to a threshold specification; in step S602, the first video stream, the second video stream, and the audio stream are packaged into a video file with a preset file format; in step S603, the video file is stored in a first memory, so that the first type of playback terminal and/or the second type of playback terminal can play back the video file.

The first video code stream may be referred to as a main video code stream, and for example, when the first type of playing terminal includes at least one of a computer terminal or a mobile terminal, an encoding format of the first video code stream is an h.264 encoding format or an h.265 encoding format, or another encoding format. The mobile terminal may include, but is not limited to, a cell phone, a tablet computer, and the like. The encoding format of the video code stream for the first type of playing terminal is not limited, so that the video code stream can have more selectivity, and when the h.265 encoding format is used, compared with the h.264 encoding format, the video code stream can have a lower code rate and better image quality.

In an example, the video specification of the first video code stream is greater than or equal to the threshold specification, the threshold specification may be reasonably set according to actual needs, and the threshold specification may be 4Kp30, and the video specification of the first video code stream may exceed 4Kp30, for example, 4Kp60, 4Kp50, 1080p60, 1080p120, 1080p240, or other video specifications, so as to obtain a better video playing effect and improve user experience.

In an example, the second video code stream may also be referred to as a secondary video code stream, and an encoding format of the second video code stream corresponds to an encoding format that can be played by the second type of playback terminal, for example, when the second type of playback terminal includes a glasses terminal, the encoding format of the second video code stream is an h.264 encoding format, and a video specification of the second video code stream is less than or equal to a threshold specification, for example, not more than 4Kp30, for example, 4Kp30, 1080P30, and the like.

And packaging the first video code stream, the second video code stream and the audio code stream into a video file with a preset file format, such as an MP4 or an MOV or other file formats. The packaging process may be any scheme known to those skilled in the art that can package the three in one video file, and in the packaging scheme of the video file as shown in fig. 7, the track (track) data in the video file may further include a thumbnail, a data header, a creation date, source data, stream data, and the like. According to the scheme of the application, the first video code stream and the second video code stream are packaged in one file, the same audio code stream can be used, the same thumbnail can be used, and the like, so that the track of the audio code stream and the track storage of the information such as the thumbnail are reduced, the CPU load in the video recording process is reduced, and the total code rate of card writing is stored.

In the embodiment of the application, the auxiliary path video code stream is manufactured and used for playing at the glasses end, so that the capacity limitation of the glasses chip is overcome, and the support of the main path code stream on H.265 coding and the specification of using more than 4Kp30 is reserved.

In an example, the track type corresponding to the second video code stream is a type that cannot be identified by the first type of playing terminal, for example, a non-standard private type, and the glasses end program can identify the second video code stream and can correctly play back the second video code stream, but the second video code stream can achieve the effect that cannot be identified by a computer (PC) terminal, a mobile phone end, video post-editing software, and the like, so that when an SD card is inserted into the computer (PC) terminal or the mobile phone end to play, a user cannot perceive the existence of the second video code stream, and user experience is optimized.

The embodiment of the present application further provides a video processing apparatus, which can be used as an execution main body of the foregoing video processing method.

In one example, as shown in fig. 8, a video processing apparatus 800 may include one or more processors 801, memory 802, a communication interface, and the like. These components are interconnected by a bus system and/or other form of connection mechanism (not shown).

The memory 802 is used for storing executable instructions, such as for storing corresponding steps and program instructions for implementing the video processing method 600 according to embodiments of the present application. May include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, Random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, Read Only Memory (ROM), a hard disk, flash memory (e.g., SD card), and the like. The memory 802 includes a first memory (e.g., an SD card) for storing the video file, and the first memory is provided in the video processing apparatus 800 in a pluggable manner, and when the video file needs to be played by another terminal device, the first memory can be taken out from the video processing apparatus and inserted into a playing terminal such as glasses for playing back the video.

The video processing apparatus 800 may have a communication interface for communication with or between other devices, including wired or wireless communication. And will not be described in detail herein.

The video processing apparatus 800 may be any apparatus having an image data processing function, such as an imaging apparatus, a movable platform on which the imaging apparatus is mounted, or the like, and is not particularly limited herein.

In addition, the present application also provides a movable platform, as shown in fig. 5, the movable platform 500 includes one or more processors 501, cameras 505, memories 502, image transmission devices 503, cameras 504, communication interfaces (not shown), and the like. These components are interconnected by a bus system and/or other form of connection mechanism (not shown).

The one or more processors 501 are configured to execute the program instructions stored in the memory 502, so that the processors execute the video processing method 600, and the details regarding the structure of the movable platform 500 and the steps related to the video processing method 600 can refer to the foregoing description, which is not repeated herein.

The memory 502 is used for storing executable instructions, such as for storing corresponding steps and program instructions for implementing the video processing method 600 according to embodiments of the present application. May include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, Random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, Read Only Memory (ROM), a hard disk, flash memory (e.g., SD card), and the like. The memory 502 includes a first memory (e.g., an SD card) for storing the video file, and the first memory is removably disposed in the removable platform 500, and when the video file needs to be played by another terminal device, the first memory can be taken out from the video processing apparatus and inserted into a playing terminal, such as glasses, for playing back the video.

In summary, according to the video processing method, the video processing device and the mobile platform, the first video code stream, the second video code stream and the audio code stream are encapsulated in one video file, so that the video file can be played at multiple types of playing terminals, the capability limitation of a second type of playing terminal chip is overcome, the video playing effect of the first type of playing terminal is improved, and compared with a scheme of independently encapsulating the first video code stream and the second video code stream, one path of audio code stream is reduced, the processing load of a processor is reduced, the total storage code rate is reduced, and the user experience is improved.

In addition, the embodiment of the invention also provides a computer storage medium, and the computer storage medium is stored with the computer program. One or more computer program instructions may be stored on the computer-readable storage medium, and a processor may execute the program instructions stored by the storage device to implement the functions (implemented by the processor) of the embodiments of the present invention described herein and/or other desired functions, for example, to execute the corresponding steps of the

video transmission methods

200, 300 according to the embodiments of the present application, or to execute the corresponding steps of the video processing method 600 according to the embodiments of the present application.

For example, the computer storage medium may include, for example, a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM), a portable compact disc read only memory (CD-ROM), a USB memory, or any combination of the above storage media. The computer-readable storage medium may be any combination of one or more computer-readable storage media.

Although the illustrative embodiments have been described herein with reference to the accompanying drawings, it is to be understood that the foregoing illustrative embodiments are merely exemplary and are not intended to limit the scope of the invention thereto. Various changes and modifications may be effected therein by one of ordinary skill in the pertinent art without departing from the scope or spirit of the present invention. All such changes and modifications are intended to be included within the scope of the present invention as set forth in the appended claims.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described device embodiments are merely illustrative, and for example, the division of the units is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another device, or some features may be omitted, or not executed.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the invention and aiding in the understanding of one or more of the various inventive aspects. However, the method of the present invention should not be construed to reflect the intent: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

It will be understood by those skilled in the art that all of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where such features are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.

The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functionality of some of the modules according to embodiments of the present invention. The present invention may also be embodied as apparatus programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

Claims

1. A video transmission method is applied to a playing terminal, the playing terminal is in communication connection with a movable platform, the movable platform comprises a picture transmission device and a shooting device, the shooting device is used for shooting video data, the picture transmission device is used for acquiring the video data and sending the video data to the playing terminal, and the method comprises the following steps:

and sending a control signal based on the image transmission setting information and the video specification setting information, wherein the control signal is used for controlling the shooting device to shoot video data, controlling the image transmission device to send the video data to the playing terminal based on the image transmission setting information, and controlling the shooting device to record the video data based on the video setting information.

2. The method of claim 1, wherein the obtaining picture transmission setting information and video recording specification setting information of the camera comprises:

responding to a first user instruction, controlling a display of the playing terminal to display a setting interface, wherein the setting interface is used for displaying: the option corresponding to the first image transmission mode and the option corresponding to the second image transmission mode;

determining one of the first image transmission mode and the second image transmission mode as the image transmission setting information in response to a mode selection instruction input by a user;

and determining the video recording specification setting information based on the determined picture transmission setting information.

3. The method of claim 2, wherein determining the video recording specification setting information based on the determined map pass setting information comprises:

when the image transmission setting information is in a first image transmission mode, responding to a video specification setting instruction input by a user, and controlling a display of the playing terminal to display a plurality of first type video specifications on the setting interface, wherein the video frame rate of the first type video specifications is greater than or equal to the first frame rate;

in response to a specification selection instruction input by a user, determining one of the plurality of first-type video recording specifications as the video recording specification setting information.

4. The method of claim 2, wherein determining the video recording specification setting information based on the determined map pass setting information comprises:

when the image transmission setting information is in a second image transmission mode, controlling a display of the playing terminal to display a plurality of second type video recording specifications on the setting interface based on a video recording specification setting instruction input by a user, wherein the video recording frame rate of the plurality of second type video recording specifications is less than or equal to the second frame rate;

and determining one of the plurality of second-type video recording specifications as the video recording specification setting information based on a specification selection instruction input by a user.

5. The method of claim 1, wherein the method further comprises: and determining an acquisition frame rate of an image sensor of the shooting device based on the image transmission setting information and the video specification setting information, wherein the acquisition frame rate is greater than or equal to the greater of the video frame rate and the image transmission frame rate.

6. The method of claim 5, wherein when the image transmission setting information is the first image transmission mode and the video frame rate is equal to the second frame rate, the acquisition frame rate is equal to the second frame rate, or

And when the image transmission setting information is in the second image transmission mode, the acquisition frame rate is equal to the second frame rate.

7. The method of claim 1, wherein when the camera is recording at a first resolution and a first video frame rate, the method further comprises:

acquiring a mode switching instruction input by a user, wherein the mode switching instruction is used for indicating that the first image transmission mode currently running is switched to a second image transmission mode or the second image transmission mode currently running is switched to the first image transmission mode;

sending the mode switching instruction to the movable platform so as to switch the first image transmission mode currently operated into a second image transmission mode or switch the second image transmission mode currently operated into the first image transmission mode;

and updating video specification setting information according to the switched image transmission mode, and sending the updated video specification setting information to the movable platform so as to control the shooting device to record the video according to the updated video specification setting information, wherein the updated video specification setting information comprises a second resolution and the first video frame rate, and the second resolution is less than or equal to the first resolution.

8. The method of claim 1, wherein when the camera is recording at a first resolution and a first video frame rate, the method further comprises:

when the first image transmission mode is switched to a second image transmission mode, or when the second image transmission mode is switched to the first image transmission mode, sending updated video specification setting information to the movable platform so as to control the shooting device to record video according to the updated video specification setting information, wherein the updated video specification setting information comprises a second resolution and a second video frame rate;

and when the second resolution is different from the first resolution and/or when the second video frame rate is different from the first video frame rate, outputting prompt information.

9. The method of any of claims 1 to 8, wherein the first frame rate is less than or equal to 60fps, and the second frame rate is greater than 60fps and less than or equal to 120 fps.

10. The method of any of claims 1 to 9, wherein the recording resolution comprises 4KP, 720P, or 1080P.

11. A video transmission method is applied to a movable platform, a playing terminal is in communication connection with the movable platform, the movable platform comprises a picture transmission device and a shooting device, the shooting device is used for shooting video data, the playing terminal is used for acquiring and playing the video data, the picture transmission device is used for acquiring the video data and sending the video data to the playing terminal, and the method comprises the following steps:

acquiring a control signal sent by the playing terminal, wherein the control signal is used for controlling the shooting device to shoot video data, controlling the image transmission device to transmit the video data to the play terminal based on image transmission setting information, and controlling the photographing device to record the video data based on video recording setting information, wherein the image transmission setting information includes one of a first image transmission mode and a second image transmission mode, the video recording specification setting information includes a video recording resolution and a video recording frame rate, when the image transmission setting information is the first image transmission mode, the image transmission frame rate is a first frame rate, the video recording frame rate is greater than or equal to the first frame rate, when the image transmission setting information is a second image transmission mode, the image transmission frame rate is a second frame rate, the video recording frame rate is less than or equal to the second frame rate, and the first frame rate is less than the second frame rate;

and responding to the control signal, controlling the shooting device to shoot video data, controlling the image transmission device to send the video data to the playing terminal based on image transmission setting information, and controlling the shooting device to record the video data based on the video recording setting information.

12. The method of claim 11, wherein when the map transmission setting information includes a first map transmission mode, the video recording specification setting information includes one of a plurality of first type video recording specifications, and a video recording frame rate of the plurality of first type video recording specification options is greater than or equal to the first frame rate.

13. The method of claim 11, wherein when the map transmission setting information is a second map transmission mode, the video recording specification setting information includes one of the second type video recording specifications, and a video recording frame rate of the second type video recording specifications is less than or equal to the second frame rate.

14. The method of claim 11, wherein the method further comprises: and determining the acquisition frame rate of an image sensor of the shooting device based on the image transmission setting information and the video specification setting information, wherein the acquisition frame rate is greater than or equal to the greater of the video frame rate and the image transmission frame rate.

15. The method of claim 14, wherein when the image transmission setting information is the first image transmission mode and the video frame rate is equal to the second frame rate, the acquisition frame rate is equal to the second frame rate, or

16. The method of claim 11, wherein when the camera is recording at a first resolution and a first video frame rate, the method further comprises:

acquiring a mode switching instruction sent by the playing terminal;

responding to the mode switching instruction, and switching the first image transmission mode currently operated into a second image transmission mode or switching the second image transmission mode currently operated into the first image transmission mode;

and acquiring updated video specification setting information, and controlling the shooting device to record the video according to the updated video specification setting information, wherein the updated video specification setting information comprises a second resolution and the first video frame rate, and the second resolution is less than or equal to the first resolution.

17. The method as claimed in any one of claims 11 to 16, wherein said first frame rate is less than or equal to 60fps and said second frame rate is greater than 60fps and less than or equal to 120 fps.

18. The method of any of claims 11 to 17, wherein the recording resolution comprises 4KP, 720P, or 1080P.

19. A cast terminal, characterized in that the cast terminal comprises:

a memory for storing executable program instructions;

the mobile platform comprises a picture transmission device and a shooting device, wherein the shooting device is used for shooting video data, and the picture transmission device is used for acquiring the video data and sending the video data to the playing terminal;

one or more processors configured to execute the program instructions stored in the memory, causing the processors to perform the steps of:

and sending a control signal based on the picture transmission setting information and the video specification setting information, wherein the control signal is used for controlling the shooting device to shoot video data, controlling the picture transmission device to send the video data to the playing terminal based on the picture transmission setting information, and controlling the shooting device to record the video data based on the video setting information.

20. The playback terminal of claim 19, wherein the playback terminal further comprises a display, and the acquiring the image transmission setting information and the video recording specification setting information of the camera comprises: responding to a first user instruction, controlling a display of the playing terminal to display a setting interface, wherein the setting interface is used for displaying: the option corresponding to the first image transmission mode and the option corresponding to the second image transmission mode;

21. The playback terminal of claim 20, wherein determining the video recording specification setting information based on the determined map transmission setting information includes:

22. The playback terminal of claim 20, wherein determining the video recording specification setting information based on the determined map transmission setting information includes:

23. The cast terminal of claim 19, wherein the processor is further configured to: and determining the acquisition frame rate of an image sensor of the shooting device based on the image transmission setting information and the video specification setting information, wherein the acquisition frame rate is greater than or equal to the greater of the video frame rate and the image transmission frame rate.

24. The playback terminal of claim 23, wherein when the image transmission setting information is the first image transmission mode and the video frame rate is equal to the second frame rate, the collection frame rate is equal to the second frame rate, or

25. The cast terminal of claim 19, wherein when the camera is recording at a first resolution and a first video frame rate, the processor is further configured to:

26. The cast terminal of claim 19, wherein when the camera is recording at a first resolution and a first video frame rate, the processor is further configured to:

when the first image transmission mode is switched to a second image transmission mode, or when the second image transmission mode is switched to the first image transmission mode, controlling the shooting device to record at a second resolution and a second video recording frame rate;

when the second resolution is different from the first resolution and/or when the second video frame rate is different from the first video frame rate, outputting prompt information;

the playing terminal further comprises a display, and the display is used for acquiring and displaying the prompt information.

27. The playback terminal of any of claims 19 to 26, wherein the first frame rate is less than or equal to 60fps, and the second frame rate is greater than 60fps and less than or equal to 120 fps.

28. The cast terminal according to any of claims 19 to 27, wherein the video resolution comprises 4KP, 720P or 1080P.

29. A movable platform, characterized in that the movable platform comprises

A photographing device for photographing video data;

a memory for storing executable program instructions;

30. The movable platform of claim 29, wherein when the mapping settings information includes a first mapping mode, the record specification settings information includes one of a plurality of first type record specifications, the plurality of first type record specification options having a record frame rate greater than or equal to the first frame rate.

31. The movable platform of claim 29, wherein the record specification setting information includes one of the second plurality of record specifications when the map transmission setting information is the second map transmission mode, the record frame rates of the second plurality of record specifications being less than or equal to the second frame rate.

32. The movable platform of claim 29, wherein the processor is further to: and determining an acquisition frame rate of an image sensor of the shooting device based on the image transmission setting information and the video specification setting information, wherein the acquisition frame rate is greater than or equal to the greater of the video frame rate and the image transmission frame rate.

33. The movable platform of claim 32, wherein when the mapping setting information is the first mapping mode and the video frame rate is equal to the second frame rate, the capture frame rate is equal to the second frame rate, or

34. The movable platform of claim 29, wherein when the camera is recording at a first resolution and a first video frame rate, the processor is further configured to:

acquiring a mode switching instruction sent by the playing terminal;

35. The movable platform of any one of claims 29-34, wherein the first frame rate is less than or equal to 60fps and the second frame rate is greater than 60fps and less than or equal to 120 fps.

36. The movable platform of any one of claims 29-35, wherein the video resolution comprises 4KP, 720P, or 1080P.

37. A video transmission system, characterized in that the video transmission system comprises:

the cast terminal according to any of claims 19 to 28; and

a movable platform as claimed in any one of claims 29 to 36.

38. A method of video processing, the method comprising:

acquiring a first video code stream, a second video code stream and an audio code stream, wherein the first video code stream is used for playing by a first type of playing terminal, the coding format of the first video code stream corresponds to the coding format which can be played by the first type of playing terminal, the second video code stream is used for playing by a second type of playing terminal, the coding format of the second video code stream corresponds to the coding format which can be played by the second type of playing terminal, and the video specification of the second video code stream is smaller than or equal to the threshold specification;

packaging the first video code stream, the second video code stream and the audio code stream into a video file with a preset file format;

and storing the video file into a first memory so that the first type of playing terminal and/or the second type of playing terminal can play back the video file.

39. The video processing method of claim 38, wherein when the first type of playback terminal comprises at least one of a computer terminal or a mobile terminal, the encoding format of the first video bitstream is an h.264 or h.265 encoding format.

40. The video processing method of claim 38, wherein a video specification of the first video bitstream is greater than or equal to the threshold specification.

41. The video processing method according to claim 38, wherein when the second type of playback terminal comprises an eyeglass terminal, the encoding format of the second video stream is an h.264 encoding format.

42. The video processing method of claim 38, wherein the threshold specification comprises 4Kp 30.

43. The video processing method of claim 38, wherein the track type corresponding to the second video stream is a type that cannot be identified by the first type of playing terminal.

44. The video processing method according to any of claims 38 to 43, wherein the preset file format comprises MP4 or MOV.

45. A video processing apparatus, characterized in that the apparatus comprises:

a memory for storing executable program instructions;

one or more processors configured to execute the program instructions stored in the memory to cause the processors to perform the video processing method of any of claims 38 to 44;

the memory comprises a first memory, the first memory is used for storing the video file, and the memory is arranged in the video processing device in a pluggable mode.

46. A movable platform, comprising:

a photographing device for photographing video data;

a memory for storing executable program instructions;

the memory comprises a first memory, the first memory is used for storing the video file, and the first memory is arranged in the video processing device in a pluggable mode.

47. The movable platform of claim 46, wherein the movable platform comprises an aircraft, a robot, a vehicle, a pan-tilt, or a boat.

48. A computer storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the video transmission method of any one of claims 1 to 28, or implements the video processing method of any one of claims 38 to 44.