WO2020150951A1 - 控制端的显示方法、设备及存储介质 - Google Patents
控制端的显示方法、设备及存储介质 Download PDFInfo
- Publication number
- WO2020150951A1 WO2020150951A1 PCT/CN2019/072922 CN2019072922W WO2020150951A1 WO 2020150951 A1 WO2020150951 A1 WO 2020150951A1 CN 2019072922 W CN2019072922 W CN 2019072922W WO 2020150951 A1 WO2020150951 A1 WO 2020150951A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- control terminal
- stream data
- code stream
- movable platform
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Program-control systems
- G05B19/02—Program-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
- H04N5/45—Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Definitions
- the embodiment of the present invention relates to the field of remote control, and in particular to a display method, device and storage medium of a control terminal.
- the movable platform is equipped with a remote control to remotely control the movable platform; the image acquisition equipment set on the movable platform, such as visible light camera, infrared camera, etc., can transmit real-time images collected by the remote control to the remote control. Real-time display on the remote control's display device.
- the embodiment of the present invention provides a display method, equipment and storage medium of the control terminal, so as to realize that multiple control terminals display the code stream data obtained by the image acquisition device of the movable platform, so as to improve the visual effect and the user experience.
- the first aspect of the embodiments of the present invention is to provide a display method of a control terminal, wherein the movable platform is configured with a plurality of control terminals, and the method includes:
- At least one of the plurality of control terminals obtains at least two code stream data, and the at least two code stream data are code stream data obtained by at least two image acquisition devices of the movable platform;
- the control terminal performs display processing according to the at least two code stream data.
- the second aspect of the embodiments of the present invention is to provide a control terminal, the movable platform is configured with multiple control terminals, the control terminal includes: a memory, a processor, a communication interface and a display device;
- the memory is used to store program code
- the processor calls the program code, and when the program code is executed, it is used to perform the following operations:
- the third aspect of the embodiments of the present invention is to provide a movable platform, including:
- the power system is installed on the fuselage to provide power
- At least two image acquisition devices for the acquired code stream data At least two image acquisition devices for the acquired code stream data
- the fourth aspect of the embodiments of the present invention is to provide a computer-readable storage medium having a computer program stored thereon, and the computer program is executed by a processor to implement the method described in the first aspect.
- the control terminal by configuring a plurality of control terminals on the mobile platform, the control terminal can obtain at least two code stream data, and the at least two code stream data are the movable The code stream data obtained by at least two image acquisition devices of the platform; and the control end can perform display processing according to the at least two code stream data, so that multiple control ends can display the code stream data obtained by the image acquisition device of the movable platform , In order to improve the visual effect and improve the user experience.
- FIG. 1 is a flowchart of a display method of a control terminal provided by an embodiment of the present invention
- FIG. 2 is a flowchart of a display method of a control terminal provided by another embodiment of the present invention.
- FIG. 3 is a flowchart of a display method of a control terminal according to another embodiment of the present invention.
- FIG. 4 is a schematic diagram of a communication system between a movable platform and a control terminal provided by an embodiment of the present invention
- FIG. 5 is a schematic diagram of a communication system between a movable platform and a control terminal according to another embodiment of the present invention.
- Figure 6 is a structural diagram of a control terminal provided by an embodiment of the present invention.
- Fig. 7 is a schematic diagram of a movable platform provided by an embodiment of the present invention.
- a component when referred to as being "fixed to” another component, it can be directly on the other component or a central component may also exist.
- a component When a component is considered to be “connected” to another component, it can be directly connected to another component or a centered component may exist at the same time.
- FIG. 1 is a flowchart of a display method of a control terminal provided by an embodiment of the present invention.
- the movable platform is configured with multiple control terminals. As shown in Fig. 1, the method in this embodiment may include:
- Step S101 At least one of the plurality of control terminals acquires at least two code stream data, where the at least two code stream data are code stream data acquired by at least two image acquisition devices of the movable platform.
- the execution subject of the method in this embodiment may be a control terminal, which may be any one of a plurality of control terminals of the movable platform, and the control terminal may be a control device that controls the movable platform, specifically, it may be Remote controls for mobile platforms such as unmanned aerial vehicles and remote control vehicles, or mobile phones and tablets with remote control functions.
- At least two image acquisition devices are provided on the movable platform in this embodiment, such as fixed focus visible light camera, zoom visible light, fixed focus far infrared camera, zoom far infrared camera, fixed focus near infrared camera, zoom near infrared camera, and As at least two of the image acquisition devices such as fixed cameras, which are first-person view (FPV for short) on the mobile platform, each image acquisition device acquires one bit stream data.
- fixed focus visible light camera zoom visible light
- fixed focus far infrared camera zoom far infrared camera
- zoom far infrared camera zoom far infrared camera
- fixed focus near infrared camera zoom near infrared camera
- each image acquisition device acquires one bit stream data.
- the data output by the image acquisition device can be stream data in raw, yuv, rgb and other formats, and then processed separately through the respective SOC (System on Chip) platforms connected to it, such as ISP (Image Signal Processing, image signal) Processing) or codec (Coder-DECoder codec), and then transmitted to the radio frequency module of the mobile platform to be directly sent to the control end or indirectly sent to the control end through other equipment.
- the control terminal obtains at least two code stream data. It is not limited to directly obtain the code stream data from the mobile platform.
- the master control terminal can directly obtain the code stream data from the movable platform, and the slave control terminal can obtain the code stream data from the master control terminal.
- Step S102 The control terminal performs display processing according to the at least two code stream data, wherein each of the multiple control terminals uses different code stream data for display.
- control terminal after the control terminal obtains at least two code stream data, it can display the data on the display device of the control terminal according to the at least two code stream data.
- the control terminal may only display one bit stream data, or select two or more bit stream data for screen fusion display, or select two or more bit stream data for screen superimposed display and so on.
- the code stream data displayed by each of the multiple control terminals of the movable platform is different, so that the user can watch multiple streams at the same time, for example, the fixed-focus wide-angle picture and the zoom picture are displayed simultaneously Especially for some outdoor inspection work, one worker is responsible for flight control by watching the wide-angle picture through one control terminal, and another worker is responsible for defect observation by watching the zoom picture through the other control terminal.
- the control terminal by configuring multiple control terminals on the movable platform, the control terminal can acquire at least two stream data, and the at least two stream data are at least two image collections of the movable platform The code stream data obtained by the device; and the control end can perform display processing according to the at least two code stream data, so that multiple control ends can display the code stream data obtained by the movable platform image acquisition device to improve the visual effect and user experience.
- control terminal in step S102 performs display processing according to the at least two code stream data, including:
- the control terminal selects one code stream data from the at least two code stream data, and displays it on the display device of the control terminal according to the code stream data.
- control terminal can display only one bit stream data on the display device, and can display the maximum value, so as to display the selected bit stream data more clearly and intuitively.
- control terminal in step S102 performs display processing according to the at least two code stream data, including:
- Step S201 The control terminal selects more than two code stream data from the at least two code stream data
- Step S202 The control terminal performs picture fusion, and displays the merged picture on the display device of the control terminal.
- control end can select more than two stream data for picture fusion, where picture fusion is to perform image processing on the stream data collected by multiple image acquisition devices of the movable platform on the same target, and extract each code to the maximum.
- the feature information in the stream data is finally integrated into a fusion picture.
- control terminal selecting two or more code stream data from the at least two code stream data to perform picture fusion includes:
- the control terminal selects two or more code stream data with different spectra from the at least two code stream data, and performs picture fusion on the two or more code stream data with different spectra.
- the visible light code stream data can be combined with the far-infrared light code stream data, that is, the control terminal can fuse the far-infrared image into the visible light image; for another example, the visible light code stream data can also be combined with the near Infrared light stream data is used for picture fusion, that is, the control terminal can fuse the near-infrared image into the visible light image.
- the picture fusion process can use any picture fusion method in the prior art.
- control terminal in step S102 performs display processing according to the at least two bitstream data, including:
- Step S301 The control terminal selects more than two code stream data from the at least two code stream data
- Step S302 The control terminal performs screen superimposition, and displays the superimposed screen on the display device of the control terminal.
- two or more stream data can be superimposed on the screen, thereby forming a picture-in-picture (Picture-in-Picture, referred to as PiP), that is, in a small area of the screen of one stream data
- PiP picture-in-picture
- the screen of another stream data is displayed on the screen at the same time.
- the screen overlay can also be displayed in parallel, for example, the display device is divided into different display areas to display different stream data respectively.
- the multiple control terminals of the movable platform 400 include a master control terminal 401 and a slave control terminal 402.
- each control terminal of the movable platform 400 may have a master-slave relationship, wherein the master control terminal 401 has a higher control authority than the slave control terminal 402. Furthermore, acquiring at least two code stream data by at least one of the plurality of control terminals in step S101 in the foregoing embodiment includes:
- control terminal is the master control terminal 401
- the control terminal receives at least two stream data sent by the movable platform 400, and sends all or part of the at least two stream data to the slave control terminal 402; or
- control terminal is the slave control terminal 402
- the control terminal receives at least two stream data sent by the master control terminal 401.
- the master control terminal 401 can directly receive at least two stream data sent by the mobile platform 400, and then send all or part of the received stream data to the slave control terminal 402 through the communication link, so that The slave control terminal 402 performs display processing according to the received code stream data.
- the communication link is not limited to WIFI, infrared communication, near field communication (NFC), etc.
- the method further includes:
- the control terminal sends a first display instruction to the slave control terminal 402, so that the slave control terminal 402 displays code stream data different from the master control terminal 401 according to the first display instruction.
- the master control terminal 401 can send a first display instruction to the slave control terminal 402 to inform the slave control terminal Which code stream data can be displayed by 402, so that the slave control terminal 402 can display code stream data different from the main control terminal 401 according to the first display instruction.
- the sending all or part of the at least two bitstream data to the slave control terminal 402 includes:
- the control terminal selects the code stream data different from that displayed by the master control terminal 401 and sends it to the slave control terminal 402.
- the main control terminal 401 may first select the code stream data that is different from that displayed by the main control terminal 401. Then it is sent to the slave control terminal 402, and the slave control terminal 402 can select any stream data to display from the received stream data, so as to realize the display of the stream data different from the master control terminal 401.
- the method further includes:
- the control terminal selects the code stream data to be played according to the user selection instruction, so that the code stream data displayed by the control terminal is different from other control terminals.
- the code stream data of the master control terminal 401 and the slave control terminal 402 can be selected according to the user selection instruction .
- the user specifies which stream data or stream data the main control terminal 401 displays, and which stream data to display from the control terminal 402, to ensure that the stream data displayed by each control terminal is different.
- the multiple control terminals of the movable platform 400 include multiple parallel control terminals 403, 404.
- control terminals of the movable platform 400 do not have a master-slave relationship, and the control terminals 403 and 404 are in a parallel relationship. Furthermore, acquiring at least two code stream data by at least one of the plurality of control terminals in step S101 in the foregoing embodiment includes:
- the control terminal receives at least two stream data sent by the movable platform.
- each of the control terminals 403 and 404 can receive at least two stream data sent by the movable platform 400.
- the code stream data received by each control terminal 403 and 404 may be the same or of course different.
- the method further includes:
- the control terminal receives a second display instruction sent by the movable platform, so that the control terminal displays code stream data different from other parallel control terminals according to the second display instruction.
- the mobile platform 400 can send a second display instruction to each control terminal 403, 404 to notify each control terminal 403, 404 According to the second display instruction, the code stream data different from other parallel control terminals is displayed.
- control terminal receiving at least two stream data sent by the movable platform includes:
- the control terminal receives code stream data that is different from other parallel control terminals sent by the movable platform.
- the mobile platform 400 in order to make the code stream data displayed by each control terminal of the multiple control terminals of the mobile platform different, can send different code stream data to different control terminals 403 and 404 respectively, so that the control The terminals 403 and 404 select any code stream data to display in the received code stream data, so as to realize the display of the code stream data different from other control terminals.
- the method further includes:
- the control terminal selects the code stream data to be played according to the user selection instruction, so that the code stream data displayed by the control terminal is different from other control terminals.
- the code stream data of each control terminal 403, 404 can be selected according to the user selection instruction, and the user specifies each Which code stream data is displayed on the control terminal to ensure that the code stream data displayed by each control terminal 403, 404 is different.
- At least one of the plurality of control terminals in step S101 obtains at least two bitstream data, including:
- the control terminal determines the limit number of code stream data it receives, and receives at least two code stream data sent by the movable platform according to the limit number.
- the control terminal can first determine the limit number of code stream data it can receive, and then receive the code stream data according to the limit number. For example, if the limit number is 3, you can receive less than 3 bit stream data.
- the receiving at least two stream data sent by the movable platform according to the limit number includes:
- control terminal selects the required target code stream data to receive;
- the control terminal receives all the stream data acquired by the image acquisition device of the movable platform or selects the desired target Stream data is received.
- the control end can select the required target code stream data to receive, and the required target The code stream data can include the code stream data specified by the user. If the control terminal has a master-slave relationship, the target code stream data required by the master control terminal can include the code stream data that the master control terminal needs to display and the code stream that the slave control terminal needs to display data. If the number of streams acquired by the image acquisition device of the mobile platform is less than or equal to the limit number of stream data received by the control end, the control end can receive all stream data of the mobile platform, and of course the desired target stream data can be selected To receive.
- FIG. 6 is a structural diagram of the control terminal provided by an embodiment of the present invention.
- the movable platform is configured with multiple control terminals.
- the control terminal 50 includes a memory 51, a processor 52, a communication interface 53 and a display device. 54.
- the memory 51 is used to store program codes
- the processor 52 calls the program code, and when the program code is executed, it is used to perform the following operations:
- the at least two code stream data are code stream data obtained by at least two image acquisition devices of the movable platform;
- the processor 52 when the processor 52 performs display processing according to the at least two bitstream data, the processor 52 is configured to:
- One code stream data is selected from the at least two code stream data, and displayed on the display device 54 of the control terminal according to the code stream data.
- the processor 52 when the processor 52 performs display processing according to the at least two bitstream data, the processor 52 is configured to:
- the processor 52 when the processor 52 selects two or more code stream data from the at least two code stream data to perform picture fusion, the processor 52 is configured to:
- the processor 52 when the processor 52 performs picture fusion on two or more stream data with different spectra, the processor 52 is configured to:
- the control terminal fuses the far-infrared image into the visible light image, or fuses the near-infrared image into the visible light image.
- the processor 52 when the processor 52 performs display processing according to the at least two bitstream data, the processor 52 is configured to:
- Select two or more code stream data from the at least two code stream data perform screen overlay, and display the overlay screen on the display device 54 of the control terminal.
- the multiple control terminals include a master control terminal and a slave control terminal;
- the processor 52 When the processor 52 obtains at least one bit stream data through the communication interface 53, the processor 52 is configured to:
- control terminal is the master control terminal, it receives at least two stream data sent by the mobile platform through the communication interface 53, and transmits all or all of the at least two stream data through the communication interface 53 Part of it is sent to the slave control end; or
- control terminal is a slave control terminal
- at least two stream data sent by the master control terminal are received through the communication interface 53.
- the processor 52 is further configured to:
- a first display instruction is sent to the slave control terminal through the communication interface 53, so that the slave control terminal displays code stream data different from the master control terminal according to the first display instruction.
- control terminal is the master control terminal
- processor 52 when the processor 52 sends all or part of the at least two stream data to the slave control terminal through the communication interface 53 ,
- the processor 52 is configured to:
- the selected code stream data other than the code stream data displayed by the master control terminal is sent to the slave control terminal through the communication interface 53.
- the processor 52 is further configured to:
- the code stream data to be played is selected according to the user selection instruction, so that the code stream data displayed by the control terminal is different from other control terminals.
- the multiple control terminals include multiple parallel control terminals
- the processor 52 is configured to:
- At least two stream data sent by the mobile platform are received through the communication interface 53.
- the processor 52 is further configured to:
- the second display instruction sent by the movable platform is received through the communication interface 53, so that the control terminal displays code stream data different from other parallel control terminals according to the second display instruction.
- the processor 52 when the processor 52 receives at least two stream data sent by the movable platform through the communication interface 53, the processor 52 is configured to:
- the code stream data that is different from other parallel control terminals sent by the movable platform is received through the communication interface 53.
- the processor 52 is further configured to:
- the code stream data to be played is selected according to the user selection instruction, so that the code stream data displayed by the control terminal is different from other control terminals.
- the processor 52 when the processor 52 obtains at least two bitstream data, the processor 52 is configured to:
- the processor 52 when the processor 52 receives at least two stream data sent by the movable platform according to the limit number, the processor 52 is configured to:
- the number of streams acquired by the image acquisition device of the movable platform is less than or equal to the limit number, then all the stream data acquired by the image acquisition device of the movable platform are received or the desired target stream data is selected for processing. receive.
- the movable platform includes at least one of the following:
- Remote control vehicles unmanned aerial vehicles.
- control terminal by configuring multiple control terminals on the movable platform, the control terminal can acquire at least two stream data, and the at least two stream data are at least two image collections of the movable platform The code stream data obtained by the device; and the control end can perform display processing according to the at least two code stream data, so that multiple control ends can display the code stream data obtained by the movable platform image acquisition device to improve the visual effect and user experience.
- FIG. 7 is a structural diagram of a movable platform provided by an embodiment of the present invention. As shown in FIG. 7, the movable platform 60 includes:
- the power system 62 is installed on the fuselage to provide power
- At least two image acquisition devices for the acquired code stream data At least two image acquisition devices for the acquired code stream data
- the control terminal can obtain at least two code stream data, and the at least two code stream data are code stream data obtained by at least two image acquisition devices of the movable platform; and the control terminal can obtain the code stream data according to the at least two The code stream data is displayed and processed, so that multiple control terminals can display the code stream data obtained by the image acquisition device of the movable platform to improve the visual effect and the user experience.
- multiple control terminals 50 may be in a master-slave relationship or a parallel relationship.
- the movable platform includes at least one of the following: a remote control vehicle and an unmanned aerial vehicle.
- this embodiment also provides a computer-readable storage medium on which a computer program is stored, and the computer program is executed by a processor to implement the display method of the control terminal described in the foregoing embodiment.
- the disclosed device and method may be implemented in other ways.
- the device embodiments described above are only illustrative.
- the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
- the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
- the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
- the functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
- the above-mentioned integrated unit can be realized in the form of hardware, or in the form of hardware plus software functional unit.
- the above-mentioned integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium.
- the above-mentioned software functional unit is stored in a storage medium and includes several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) execute the method described in the various embodiments of the present invention. Part of the steps.
- the aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code .
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- User Interface Of Digital Computer (AREA)
- Selective Calling Equipment (AREA)
Abstract
本发明实施例提供一种控制端的显示方法、设备及存储介质,通过对可移动平台配置多个控制端,控制端可获取至少二个码流数据,所述至少二个码流数据为所述可移动平台的至少二个图像采集装置获取的码流数据;进而控制端可根据所述至少二个码流数据进行显示处理,实现多个控制端对可移动平台图像采集装置获取的码流数据进行显示,以提高视觉效果,提高用户体验。
Description
本发明实施例涉及遥控领域,尤其涉及一种控制端的显示方法、设备及存储介质。
随着无线控制技术的发展,可移动平台例如无人机、遥控车等在生产领域和日常生活中都得到了广泛的应用。通常情况下,可移动平台配置有一个遥控器,以对可移动平台进行遥控;可移动平台上设置的图像采集设备,例如可见光相机、红外相机等采集的实时图像可传输给遥控器,以在遥控器的显示设备上实时显示。
随着无人机、遥控车等可移动平台功能的不断丰富,可移动平台上设置的图像采集设备越来越多,因此由可移动平台发送给遥控器的实时图像的码流数据的数量越来越多,不便于该遥控器对于码流数据的显示,视觉效果较差,用户体验较差。
发明内容
本发明实施例提供一种控制端的显示方法、设备及存储介质,以实现多个控制端对可移动平台图像采集装置获取的码流数据进行显示,以提高视觉效果,提高用户体验。
本发明实施例的第一方面是提供一种控制端的显示方法,其中可移动平台配置有多个控制端,所述方法包括:
所述多个控制端中的至少一个控制端获取至少二个码流数据,所述至少二个码流数据为所述可移动平台的至少二个图像采集装置获取的码流数据;
所述控制端根据所述至少二个码流数据进行显示处理。
本发明实施例的第二方面是提供一种控制端,可移动平台配置有多个控制端,所述控制端包括:存储器、处理器、通讯接口和显示设备;
所述存储器用于存储程序代码;
所述处理器调用所述程序代码,当程序代码被执行时,用于执行以下操作:
通过所述通讯接口获取至少二个码流数据,所述至少二个码流数据为所述可移动平台的至少二个图像采集装置获取的码流数据;
根据所述至少二个码流数据进行显示处理。
本发明实施例的第三方面是提供一种可移动平台,包括:
机身;
动力系统,安装在所述机身,用于提供动力;
至少二个图像采集装置,用于获取的码流数据;
以及多个如第二方面所述的控制端。
本发明实施例的第四方面是提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行以实现第一方面所述的方法。
本实施例提供的控制端的显示方法、设备及存储介质,通过对可移动平台配置多个控制端,控制端可获取至少二个码流数据,所述至少二个码流数据为所述可移动平台的至少二个图像采集装置获取的码流数据;进而控制端可根据所述至少二个码流数据进行显示处理,实现多个控制端对可移动平台图像采集装置获取的码流数据进行显示,以提高视觉效果,提高用户体验。
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1为本发明实施例提供的控制端的显示方法的流程图;
图2为本发明另一实施例提供的控制端的显示方法的流程图;
图3为本发明另一实施例提供的控制端的显示方法的流程图;
图4为本发明实施例提供的可移动平台与控制端在之间通信系统的示意图;
图5为本发明另一实施例提供的可移动平台与控制端在之间通信系统的示意图;
图6为本发明实施例提供的控制端的结构图;
图7为本发明实施例提供的可移动平台的示意图。
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
需要说明的是,当组件被称为“固定于”另一个组件,它可以直接在另一个组件上或者也可以存在居中的组件。当一个组件被认为是“连接”另一个组件,它可以是直接连接到另一个组件或者可能同时存在居中组件。
除非另有定义,本文所使用的所有的技术和科学术语与属于本发明的技术领域的技术人员通常理解的含义相同。本文中在本发明的说明书中所使用的术语只是为了描述具体的实施例的目的,不是旨在于限制本发明。本文所使用的术语“及/或”包括一个或多个相关的所列项目的任意的和所有的组合。
下面结合附图,对本发明的一些实施方式作详细说明。在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。
本发明实施例提供一种控制端的显示方法。图1为本发明实施例提供的控制端的显示方法的流程图。其中可移动平台配置有多个控制端,如图1所示,本实施例中的方法,可以包括:
步骤S101、所述多个控制端中的至少一个控制端获取至少二个码流数据,所述至少二个码流数据为所述可移动平台的至少二个图像采集装置获取的码流数据。
本实施例方法的执行主体可以是控制端,该控制端可以为可移动平台的多个控制端中的任意一个,该控制端可以是对可移动平台进行控制的控制设备,具体地,可以是无人飞行器、遥控车等可移动平台的遥控器或具有遥控功能的手机、平板电脑等设备。本实施例中的可移动平台上至少设 置有二个图像采集装置,例如定焦可见光相机、变焦可见光、定焦远红外相机、变焦远红外相机、定焦近红外相机、变焦近红外相机、以及作为可移动平台第一人称主视角(First Person View,简称FPV)的固定相机等图像采集装置中的至少两个,其中每一图像采集装置获取一个码流数据。其中图像采集装置输出的数据可以是raw、yuv、rgb等格式的码流数据,然后通过各自接入的SOC(System on Chip,系统级芯片)平台分别处理,如ISP(Image Signal Processing,图像信号处理)或codec(Coder-DECoder编译码器),然后传输给可移动平台的射频模块,以直接发送给控制端或通过其他设备间接发送给控制端。本实施例中控制端获取至少二个码流数据,不限于从可移动平台直接获取码流数据,也可通过其他途径获取可移动平台的码流数据,例如当可移动平台的多个控制端具有主从关系时,主控制端可直接从可移动平台获取码流数据,而从控制端可从主控制端获取码流数据。
步骤S102、所述控制端根据所述至少二个码流数据进行显示处理,其中所述多个控制端中各所述控制端用于显示的码流数据不同。
在本实施例中,控制端在获取至少二个码流数据后,可根据至少二个码流数据在控制端的显示设备上显示。具体的,控制端可以只显示一个码流数据,也可选择两个以上码流数据进行画面融合显示,也可选择两个以上码流数据进行画面叠加显示等等。
本实施例中优选的,可移动平台的多个控制端中各控制端显示的码流数据存在不同,从而使得用户可同时观看多路码流,例如定焦广角画面和变焦画面同时最大化显示,特别是一些户外的巡检工作,一个工人通过一个控制端观看广角画面负责飞行控制,另一个工人通过另一个控制端观看变焦画面负责缺陷观察。
本实施例控制端的显示方法,通过对可移动平台配置多个控制端,控制端可获取至少二个码流数据,所述至少二个码流数据为所述可移动平台的至少二个图像采集装置获取的码流数据;进而控制端可根据所述至少二个码流数据进行显示处理,实现多个控制端对可移动平台图像采集装置获取的码流数据进行显示,以提高视觉效果,提高用户体验。
在上述任一实施例的基础上,步骤S102所述控制端根据所述至少二个码流数据进行显示处理,包括:
所述控制端从所述至少二个码流数据选择一个码流数据,并根据所述码流数据在所述控制端的显示设备上显示。
在本实施例中,控制端可仅对一个码流数据在显示设备上进行显示,可以以最大化显示,以更清晰直观的对选择的码流数据进行显示。
在上述任一实施例的基础上,如图2所示,步骤S102所述控制端根据所述至少二个码流数据进行显示处理,包括:
步骤S201、所述控制端从所述至少二个码流数据中选择两个以上码流数据;
步骤S202、所述控制端进行画面融合,并在所述控制端的显示设备上显示融合画面。
在本实施例中,控制端可选择两个以上码流数据进行画面融合,其中画面融合为对可移动平台多个图像采集装置对同一目标采集的码流数据进行图像处理,最大限度提取各码流数据中的特征信息,最后综合成融合画面。
更具体的,所述控制端从所述至少二个码流数据中选择两个以上码流数据,进行画面融合,包括:
所述控制端从所述至少二个码流数据中选择光谱不同的两个以上码流数据,将所述光谱不同的两个以上码流数据进行画面融合。
例如,本实施例中可将可见光码流数据与远红外光码流数据进行画面融合,也即控制端可将远红外图像融合到可见光图像中;再如,可也将可见光码流数据与近红外光码流数据进行画面融合,也即控制端可将近红外图像融合到可见光图像中。其中画面融合过程可采用现有技术中的任意画面融合方法。
在上述任一实施例的基础上,如图3所示,步骤S102所述控制端根据所述至少二个码流数据进行显示处理,包括:
步骤S301、所述控制端从所述至少二个码流数据中选择两个以上码流数据;
步骤S302、所述控制端进行画面叠加,并在所述控制端的显示设备上 显示叠加画面。
在本实施例中,可将两个以上码流数据进行画面叠加,从而可形成画中画(Picture-in-Picture,简称PiP),也即在一个码流数据的画面的某一小面积区域上同时显示另一码流数据的画面,此外画面叠加也可以并列的显示方式,例如将显示设备分为不同的显示区域,分别显示不同的码流数据。
在上述任一实施例的基础上,如图4所示,可移动平台400的多个控制端包括主控制端401和从控制端402。
在本实施例中,可移动平台400的各控制端可具有主从关系,其中主控制端401较从控制端402具有更高的控制权限。进而上述实施例中的步骤S101所述多个控制端中的至少一个控制端获取至少二个码流数据,包括:
若所述控制端为主控制端401,则所述控制端接收所述可移动平台400发送的至少二个码流数据,并将所述至少二个码流数据全部或部分发送给从控制端402;或
若所述控制端为从控制端402,则所述控制端接收主控制端401发送的至少二个码流数据。
在本实施例中,主控制端401可直接接收可移动平台400发送的至少二个码流数据,然后将接收到的码流数据通过通信链路全部或部分发送给从控制端402,以使从控制端402根据接收到的码流数据进行显示处理。其中通信链路不限于WIFI、红外线通信、近场通信(NFC)等。
在上述任一实施例的基础上,可选的,若所述控制端为主控制端401,所述方法还包括:
所述控制端向从控制端402发送第一显示指令,以使所述从控制端402根据第一显示指令显示不同于主控制端401的码流数据。
在本实施例中,为了使可移动平台400的多个控制端中各控制端显示的码流数据存在不同,可由主控制端401向从控制端402发送第一显示指令,以告知从控制端402可显示哪些码流数据,从而使从控制端402根据第一显示指令显示不同于主控制端401的码流数据。
在上述任一实施例的基础上,可选的,若所述控制端为主控制端401,所述将所述至少二个码流数据全部或部分发送给从控制端402,包括:
所述控制端选择不同于主控制端401显示的码流数据发送给从控制端402。
在本实施例中,为了使可移动平台400的多个控制端中各控制端显示的码流数据存在不同,可以由主控制端401首先选择出不同于主控制端401显示的码流数据,再发送给从控制端402,从控制端402从接收到的码流数据中可以选择任一码流数据显示,从而实现显示不同于主控制端401的码流数据。
在上述实施例的基础上,可选的,所述方法还包括:
所述控制端根据用户选择指令选择播放的码流数据,以使所述控制端显示的码流数据不同于其他控制端。
在本实施例中,为了使可移动平台400的多个控制端中各控制端显示的码流数据存在不同,可根据用户选择指令进行主控制端401和从控制端402的码流数据的选择,由用户指定主控制端401显示哪个或哪些码流数据,从控制端402显示哪个或哪些码流数据,保证各控制端显示的码流数据存在不同。
在上述任一实施例的基础上,如图5所示,可移动平台400的多个控制端包括多个并列控制端403,404。
在本实施例中,可移动平台400的各控制端不具有主从关系,各控制端403,404之间为并列关系。进而上述实施例中的步骤S101所述多个控制端中的至少一个控制端获取至少二个码流数据,包括:
所述控制端接收所述可移动平台发送的至少二个码流数据。
在本实施例中,由于可移动平台的各控制端为并列关系,因此每一控制端403,404均可接收可移动平台400发送的至少二个码流数据。其中各控制端403,404接收到的码流数据可相同,当然也可不同。
在上述任一实施例的基础上,可选的,所述方法还包括:
所述控制端接收可移动平台发送的第二显示指令,以使所述控制端根据所述第二显示指令显示不同于其他并列控制端的码流数据。
在本实施例中,为了使可移动平台的多个控制端中各控制端显示的码流数据存在不同,可由可移动平台400向各控制端403,404发送第二显示指令,以通知各控制端403,404根据第二显示指令显示不同于其他并列控制端的码流数据。
在上述任一实施例的基础上,可选的,所述控制端接收所述可移动平台发送的至少二个码流数据,包括:
所述控制端接收所述可移动平台发送的不同于其他并列控制端的码流数据。
在本实施例中,为了使可移动平台的多个控制端中各控制端显示的码流数据存在不同,可由可移动平台400分别向不同的控制端403,404发送不同的码流数据,从而使控制端403,404在接收到的码流数据中选择任一码流数据显示,从而实现显示不同于其他控制端的码流数据。
在上述任一实施例的基础上,可选的,所述方法还包括:
所述控制端根据用户选择指令选择播放的码流数据,以使所述控制端显示的码流数据不同于其他控制端。
在本实施例中,为了使可移动平台的多个控制端中各控制端显示的码流数据存在不同,可根据用户选择指令进行各控制端403,404的码流数据的选择,由用户指定每一控制端显示哪个或哪些码流数据,保证各控制端403,404显示的码流数据存在不同。
在上述任一实施例的基础上,步骤S101所述多个控制端中的至少一个控制端获取至少二个码流数据,包括:
所述控制端确定其接收码流数据的极限数量,并根据所述极限数量接收所述可移动平台发送的至少二个码流数据。
在本实施例中,由于控制端接收码流数据的能力是一定的,因此控制端可首先确定其能接收码流数据的极限数量,然后根据极限数量接收码流数据,例如,若极限数量为3个,则可接收3个以下的码流数据。
更具体的,所述根据所述极限数量接收所述可移动平台发送的至少二个码流数据,包括:
若所述可移动平台的图像采集装置获取的码流数量大于所述极限数 量,则所述控制端选择所需的目标码流数据进行接收;或
若所述可移动平台的图像采集装置获取的码流数量小于或等于所述极限数量,则所述控制端接收所述可移动平台的图像采集装置获取的全部码流数据或选择所需的目标码流数据进行接收。
在本实施例中,若可移动平台的图像采集装置获取的码流数量大于控制端接收码流数据的极限数量,则控制端可选择所需的目标码流数据进行接收,其中所需的目标码流数据可以包括用户指定的码流数据,若控制端存在主从关系,主控制端所需的目标码流数据可包括主控制端需要显示的码流数据以及从控制端需要显示的码流数据。若可移动平台的图像采集装置获取的码流数量小于或等于控制端接收码流数据的极限数量,则控制端可接收可移动平台全部码流数据,当然也可选择所需的目标码流数据进行接收。
本发明实施例提供一种控制端。图6为本发明实施例提供的控制端的结构图,其中可移动平台配置有多个控制端,如图6所示,所述控制端50包括存储器51、处理器52、通讯接口53和显示设备54。
所述存储器51用于存储程序代码;
所述处理器52调用所述程序代码,当程序代码被执行时,用于执行以下操作:
通过所述通讯接口53获取至少二个码流数据,所述至少二个码流数据为所述可移动平台的至少二个图像采集装置获取的码流数据;
根据所述至少二个码流数据进行显示处理,其中所述多个控制端中各所述控制端用于显示的码流数据不同。
在上述任一实施例的基础上,在所述处理器52根据所述至少二个码流数据进行显示处理时,所述处理器52被配置为:
从所述至少二个码流数据选择一个码流数据,并根据所述码流数据在所述控制端的显示设备54上显示。
在上述任一实施例的基础上,在所述处理器52根据所述至少二个码流数据进行显示处理时,所述处理器52被配置为:
从所述至少二个码流数据中选择两个以上码流数据,进行画面融合, 并在所述控制端的显示设备54上显示融合画面。
在上述任一实施例的基础上,在所述处理器52从所述至少二个码流数据中选择两个以上码流数据,进行画面融合时,所述处理器52被配置为:
从所述至少二个码流数据中选择光谱不同的两个以上码流数据,将所述光谱不同的两个以上码流数据进行画面融合。
在上述任一实施例的基础上,在所述处理器52将所述光谱不同的两个以上码流数据进行画面融合时,所述处理器52被配置为:
所述控制端将远红外图像融合到可见光图像中、或将近红外图像融合到可见光图像中。
在上述任一实施例的基础上,在所述处理器52根据所述至少二个码流数据进行显示处理时,所述处理器52被配置为:
从所述至少二个码流数据中选择两个以上码流数据,进行画面叠加,并在所述控制端的显示设备54上显示叠加画面。
在上述任一实施例的基础上,所述多个控制端包括主控制端和从控制端;
在所述处理器52通过所述通讯接口53获取至少一个码流数据时,所述处理器52被配置为:
若所述控制端为主控制端,则通过所述通讯接口53接收所述可移动平台发送的至少二个码流数据,并通过所述通讯接口53将所述至少二个码流数据全部或部分发送给从控制端;或
若所述控制端为从控制端,则通过所述通讯接口53接收主控制端发送的至少二个码流数据。
在上述任一实施例的基础上,若所述控制端为主控制端,所述处理器52还被配置为:
通过所述通讯接口53向从控制端发送第一显示指令,以使所述从控制端根据第一显示指令显示不同于主控制端的码流数据。
在上述任一实施例的基础上,若所述控制端为主控制端,在所述处理器52通过所述通讯接口53将所述至少二个码流数据全部或部分发送给从控制端时,所述处理器52被配置为:
选择不同于主控制端显示的码流数据外的码流数据通过所述通讯接口53发送给从控制端。
在上述任一实施例的基础上,所述处理器52还被配置为:
根据用户选择指令选择播放的码流数据,以使所述控制端显示的码流数据不同于其他控制端。
在上述任一实施例的基础上,所述多个控制端包括多个并列控制端;
在所述处理通过所述通讯接口53获取至少二个码流数据时,所述处理器52被配置为:
通过所述通讯接口53接收所述可移动平台发送的至少二个码流数据。
在上述任一实施例的基础上,所述处理器52还被配置为:
通过所述通讯接口53接收可移动平台发送的第二显示指令,以使所述控制端根据所述第二显示指令显示不同于其他并列控制端的码流数据。
在上述任一实施例的基础上,在所述处理器52通过所述通讯接口53接收所述可移动平台发送的至少二个码流数据时,所述处理器52被配置为:
通过所述通讯接口53接收所述可移动平台发送的不同于其他并列控制端的码流数据。
在上述任一实施例的基础上,所述处理器52还被配置为:
根据用户选择指令选择播放的码流数据,以使所述控制端显示的码流数据不同于其他控制端。
在上述任一实施例的基础上,在所述处理器52获取至少二个码流数据时,所述处理器52被配置为:
确定其接收码流数据的极限数量,并根据所述极限数量接收所述可移动平台发送的至少二个码流数据。
在上述任一实施例的基础上,在所述处理器52根据所述极限数量接收所述可移动平台发送的至少二个码流数据时,所述处理器52被配置为:
若所述可移动平台的图像采集装置获取的码流数量大于所述极限数量,则选择所需的目标码流数据进行接收;或
若所述可移动平台的图像采集装置获取的码流数量小于或等于所述极限数量,则接收所述可移动平台的图像采集装置获取的全部码流数据或 选择所需的目标码流数据进行接收。
在上述任一实施例的基础上,所述可移动平台包括如下至少一种:
遥控车、无人飞行器。
本发明实施例提供的控制端的具体原理和实现方式可参见上述实施例,此处不再赘述。
本实施例提供的控制端,通过对可移动平台配置多个控制端,控制端可获取至少二个码流数据,所述至少二个码流数据为所述可移动平台的至少二个图像采集装置获取的码流数据;进而控制端可根据所述至少二个码流数据进行显示处理,实现多个控制端对可移动平台图像采集装置获取的码流数据进行显示,以提高视觉效果,提高用户体验。
本发明实施例提供一种可移动平台。图7为本发明实施例提供的可移动平台的结构图;如图7所示,所述可移动平台60包括:
机身61;
动力系统62,安装在所述机身,用于提供动力;
至少二个图像采集装置,用于获取的码流数据;
多个如上述实施例所述的控制端50。
其中控制端可实现获取至少二个码流数据,所述至少二个码流数据为所述可移动平台的至少二个图像采集装置获取的码流数据;进而控制端可根据所述至少二个码流数据进行显示处理,实现多个控制端对可移动平台图像采集装置获取的码流数据进行显示,以提高视觉效果,提高用户体验。
需要说明的是,多个所述的控制端50可以为主从关系,也可为并列关系
进一步的,所述可移动平台包括如下至少一种:遥控车、无人飞行器。
本发明实施例提供的可移动平台的具体原理和实现方式可参见上述实施例,此处不再赘述。
另外,本实施例还提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行以实现上述实施例所述的控制端的显示方法。
在本发明所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。
上述以软件功能单元的形式实现的集成的单元,可以存储在一个计算机可读取存储介质中。上述软件功能单元存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器(processor)执行本发明各个实施例所述方法的部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
本领域技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的装置的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
最后应说明的是:以上各实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述各实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进 行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。
Claims (37)
- 一种控制端的显示方法,其特征在于,可移动平台配置有多个控制端,所述方法包括:所述多个控制端中的至少一个控制端获取至少二个码流数据,所述至少二个码流数据为所述可移动平台的至少二个图像采集装置获取的码流数据;所述控制端根据所述至少二个码流数据进行显示处理,其中所述多个控制端中各所述控制端用于显示的码流数据不同。
- 根据权利要求1所述的方法,其特征在于,所述控制端根据所述至少二个码流数据进行显示处理,包括:所述控制端从所述至少二个码流数据选择一个码流数据,并根据所述码流数据在所述控制端的显示设备上显示。
- 根据权利要求1所述的方法,其特征在于,所述控制端根据所述至少二个码流数据进行显示处理,包括:所述控制端从所述至少二个码流数据中选择两个以上码流数据,进行画面融合,并在所述控制端的显示设备上显示融合画面。
- 根据权利要求3所述的方法,其特征在于,所述控制端从所述至少二个码流数据中选择两个以上码流数据,进行画面融合,包括:所述控制端从所述至少二个码流数据中选择光谱不同的两个以上码流数据,将所述光谱不同的两个以上码流数据进行画面融合。
- 根据权利要求4所述的方法,其特征在于,所述将所述光谱不同的两个以上码流数据进行画面融合,包括:所述控制端将远红外图像融合到可见光图像中、或将近红外图像融合到可见光图像中。
- 根据权利要求1所述的方法,其特征在于,所述控制端根据所述至少二个码流数据进行显示处理,包括:所述控制端从所述至少二个码流数据中选择两个以上码流数据,进行画面叠加,并在所述控制端的显示设备上显示叠加画面。
- 根据权利要求1-5任一项所述的方法,其特征在于,所述多个控制端包括主控制端和从控制端;所述多个控制端中的至少一个控制端获取至少二个码流数据,包括:若所述控制端为主控制端,则所述控制端接收所述可移动平台发送的至少二个码流数据,并将所述至少二个码流数据全部或部分发送给从控制端;或若所述控制端为从控制端,则所述控制端接收主控制端发送的至少二个码流数据。
- 根据权利要求7所述的方法,其特征在于,若所述控制端为主控制端,所述方法还包括:所述控制端向从控制端发送第一显示指令,以使所述从控制端根据第一显示指令显示不同于主控制端的码流数据。
- 根据权利要求7所述的方法,其特征在于,若所述控制端为主控制端,所述将所述至少二个码流数据全部或部分发送给从控制端,包括:所述控制端选择不同于主控制端显示的码流数据发送给从控制端。
- 根据权利要求7所述的方法,其特征在于,所述方法还包括:所述控制端根据用户选择指令选择播放的码流数据,以使所述控制端显示的码流数据不同于其他控制端。
- 根据权利要求1-5任一项所述的方法,其特征在于,所述多个控制端包括多个并列控制端;所述多个控制端中的至少一个控制端获取至少二个码流数据,包括:所述控制端接收所述可移动平台发送的至少二个码流数据。
- 根据权利要求11所述的方法,其特征在于,所述方法还包括:所述控制端接收可移动平台发送的第二显示指令,以使所述控制端根据所述第二显示指令显示不同于其他并列控制端的码流数据。
- 根据权利要求11所述的方法,其特征在于,所述控制端接收所述可移动平台发送的至少二个码流数据,包括:所述控制端接收所述可移动平台发送的不同于其他并列控制端的码流数据。
- 根据权利要求11所述的方法,其特征在于,所述方法还包括:所述控制端根据用户选择指令选择播放的码流数据,以使所述控制端显示的码流数据不同于其他控制端。
- 根据权利要求1-14任一项所述的方法,其特征在于,所述多个控制端中的至少一个控制端获取至少二个码流数据,包括:所述控制端确定其接收码流数据的极限数量,并根据所述极限数量接收所述可移动平台发送的至少二个码流数据。
- 根据权利要求15所述的方法,其特征在于,所述根据所述极限数量接收所述可移动平台发送的至少二个码流数据,包括:若所述可移动平台的图像采集装置获取的码流数量大于所述极限数量,则所述控制端选择所需的目标码流数据进行接收;或若所述可移动平台的图像采集装置获取的码流数量小于或等于所述极限数量,则所述控制端接收所述可移动平台的图像采集装置获取的全部码流数据或选择所需的目标码流数据进行接收。
- 根据权利要求1-16任一项所述的方法,其特征在于,所述可移动平台包括如下至少一种:遥控车、无人飞行器。
- 一种控制端,其特征在于,可移动平台配置有多个控制端,所述控制端包括:存储器、处理器、通讯接口和显示设备;所述存储器用于存储程序代码;所述处理器调用所述程序代码,当程序代码被执行时,用于执行以下操作:通过所述通讯接口获取至少二个码流数据,所述至少二个码流数据为所述可移动平台的至少二个图像采集装置获取的码流数据;根据所述至少二个码流数据进行显示处理,其中所述多个控制端中各所述控制端用于显示的码流数据不同。
- 根据权利要求18所述的控制端,其特征在于,在所述处理器根据所述至少二个码流数据进行显示处理时,所述处理器被配置为:从所述至少二个码流数据选择一个码流数据,并根据所述码流数据在所述控制端的显示设备上显示。
- 根据权利要求18所述的控制端,其特征在于,在所述处理器根据所述至少二个码流数据进行显示处理时,所述处理器被配置为:从所述至少二个码流数据中选择两个以上码流数据,进行画面融合, 并在所述控制端的显示设备上显示融合画面。
- 根据权利要求20所述的控制端,其特征在于,在所述处理器从所述至少二个码流数据中选择两个以上码流数据,进行画面融合时,所述处理器被配置为:从所述至少二个码流数据中选择光谱不同的两个以上码流数据,将所述光谱不同的两个以上码流数据进行画面融合。
- 根据权利要求21所述的控制端,其特征在于,在所述处理器将所述光谱不同的两个以上码流数据进行画面融合时,所述处理器被配置为:所述控制端将远红外图像融合到可见光图像中、或将近红外图像融合到可见光图像中。
- 根据权利要求18所述的控制端,其特征在于,在所述处理器根据所述至少二个码流数据进行显示处理时,所述处理器被配置为:从所述至少二个码流数据中选择两个以上码流数据,进行画面叠加,并在所述控制端的显示设备上显示叠加画面。
- 根据权利要求18-23任一项所述的控制端,其特征在于,所述多个控制端包括主控制端和从控制端;在所述处理器通过所述通讯接口获取至少一个码流数据时,所述处理器被配置为:若所述控制端为主控制端,则通过所述通讯接口接收所述可移动平台发送的至少二个码流数据,并通过所述通讯接口将所述至少二个码流数据全部或部分发送给从控制端;或若所述控制端为从控制端,则通过所述通讯接口接收主控制端发送的至少二个码流数据。
- 根据权利要求24所述的控制端,其特征在于,若所述控制端为主控制端,所述处理器还被配置为:通过所述通讯接口向从控制端发送第一显示指令,以使所述从控制端根据第一显示指令显示不同于主控制端的码流数据。
- 根据权利要求24所述的控制端,其特征在于,若所述控制端为主控制端,在所述处理器通过所述通讯接口将所述至少二个码流数据全部或部分发送给从控制端时,所述处理器被配置为:选择不同于主控制端显示的码流数据外的码流数据通过所述通讯接口发送给从控制端。
- 根据权利要求24所述的控制端,其特征在于,所述处理器还被配置为:根据用户选择指令选择播放的码流数据,以使所述控制端显示的码流数据不同于其他控制端。
- 根据权利要求18-23任一项所述的控制端,其特征在于,所述多个控制端包括多个并列控制端;在所述处理通过所述通讯接口获取至少二个码流数据时,所述处理器被配置为:通过所述通讯接口接收所述可移动平台发送的至少二个码流数据。
- 根据权利要求28所述的控制端,其特征在于,所述处理器还被配置为:通过所述通讯接口接收可移动平台发送的第二显示指令,以使所述控制端根据所述第二显示指令显示不同于其他并列控制端的码流数据。
- 根据权利要求28所述的控制端,其特征在于,在所述处理器通过所述通讯接口接收所述可移动平台发送的至少二个码流数据时,所述处理器被配置为:通过所述通讯接口接收所述可移动平台发送的不同于其他并列控制端的码流数据。
- 根据权利要求28所述的控制端,其特征在于,所述处理器还被配置为:根据用户选择指令选择播放的码流数据,以使所述控制端显示的码流数据不同于其他控制端。
- 根据权利要求18-31所述的控制端,其特征在于,在所述处理器获取至少二个码流数据时,所述处理器被配置为:确定其接收码流数据的极限数量,并根据所述极限数量接收所述可移动平台发送的至少二个码流数据。
- 根据权利要求32所述的控制端,其特征在于,在所述处理器根据所述极限数量接收所述可移动平台发送的至少二个码流数据时,所述处 理器被配置为:若所述可移动平台的图像采集装置获取的码流数量大于所述极限数量,则选择所需的目标码流数据进行接收;或若所述可移动平台的图像采集装置获取的码流数量小于或等于所述极限数量,则接收所述可移动平台的图像采集装置获取的全部码流数据或选择所需的目标码流数据进行接收。
- 根据权利要求19-33任一项所述的控制端,其特征在于,所述可移动平台包括如下至少一种:遥控车、无人飞行器。
- 一种可移动平台,其特征在于,包括:机身;动力系统,安装在所述机身,用于提供动力;至少二个图像采集装置,用于获取的码流数据;多个如权利要求18-34任一项所述的控制端。
- 根据权利要求35所述的可移动平台,其特征在于,所述可移动平台包括如下至少一种:遥控车、无人飞行器。
- 一种计算机可读存储介质,其特征在于,其上存储有计算机程序,所述计算机程序被处理器执行以实现如权利要求1-17一项所述的方法。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201980005651.0A CN111357274A (zh) | 2019-01-24 | 2019-01-24 | 控制端的显示方法、设备及存储介质 |
| PCT/CN2019/072922 WO2020150951A1 (zh) | 2019-01-24 | 2019-01-24 | 控制端的显示方法、设备及存储介质 |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2019/072922 WO2020150951A1 (zh) | 2019-01-24 | 2019-01-24 | 控制端的显示方法、设备及存储介质 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020150951A1 true WO2020150951A1 (zh) | 2020-07-30 |
Family
ID=71195196
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2019/072922 Ceased WO2020150951A1 (zh) | 2019-01-24 | 2019-01-24 | 控制端的显示方法、设备及存储介质 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111357274A (zh) |
| WO (1) | WO2020150951A1 (zh) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105391988A (zh) * | 2015-12-11 | 2016-03-09 | 谭圆圆 | 多视角的无人飞行器及其多视角显示方法 |
| CN107089319A (zh) * | 2017-04-20 | 2017-08-25 | 中化舟山危化品应急救援基地有限公司 | 储罐火灾侦检系统 |
| CN107438801A (zh) * | 2016-09-27 | 2017-12-05 | 深圳市大疆创新科技有限公司 | 一种飞行器控制方法、终端及飞行器 |
| US20170353731A1 (en) * | 2016-06-01 | 2017-12-07 | Jack Wade | System and method for parallel image processing and routing |
| CN107529033A (zh) * | 2016-06-22 | 2017-12-29 | 北京臻迪机器人有限公司 | 一种图传数传共链路的通信系统及方法 |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9769387B1 (en) * | 2013-11-05 | 2017-09-19 | Trace Live Network Inc. | Action camera system for unmanned aerial vehicle |
| US20170251169A1 (en) * | 2014-06-03 | 2017-08-31 | Gopro, Inc. | Apparatus and methods for context based video data compression |
| KR102364730B1 (ko) * | 2015-07-29 | 2022-02-18 | 엘지전자 주식회사 | 이동 단말기 및 이의 제어방법 |
| CN108292365A (zh) * | 2015-12-09 | 2018-07-17 | 深圳市大疆创新科技有限公司 | 用于无人载运工具的成像系统和方法 |
| KR102521040B1 (ko) * | 2016-05-10 | 2023-04-13 | 삼성전자주식회사 | 수평 자세 유지 장치 |
| CN107454131A (zh) * | 2017-03-28 | 2017-12-08 | 亿航智能设备(广州)有限公司 | 通过移动网络共享无人机控制权的装置及方法 |
| US10379545B2 (en) * | 2017-07-03 | 2019-08-13 | Skydio, Inc. | Detecting optical discrepancies in captured images |
| WO2019084791A1 (zh) * | 2017-10-31 | 2019-05-09 | 深圳市大疆创新科技有限公司 | 图像显示方法、控制方法及相关设备 |
| CN109076173A (zh) * | 2017-11-21 | 2018-12-21 | 深圳市大疆创新科技有限公司 | 输出影像生成方法、设备及无人机 |
| CN208270451U (zh) * | 2018-03-28 | 2018-12-21 | 南京天创电子技术有限公司 | 一种利用无人机搭载双摄像头的热斑检查装置 |
| CN109151402B (zh) * | 2018-10-26 | 2022-10-11 | 深圳市道通智能航空技术股份有限公司 | 航拍相机的图像处理方法、图像处理系统及无人机 |
-
2019
- 2019-01-24 WO PCT/CN2019/072922 patent/WO2020150951A1/zh not_active Ceased
- 2019-01-24 CN CN201980005651.0A patent/CN111357274A/zh active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105391988A (zh) * | 2015-12-11 | 2016-03-09 | 谭圆圆 | 多视角的无人飞行器及其多视角显示方法 |
| US20170353731A1 (en) * | 2016-06-01 | 2017-12-07 | Jack Wade | System and method for parallel image processing and routing |
| CN107529033A (zh) * | 2016-06-22 | 2017-12-29 | 北京臻迪机器人有限公司 | 一种图传数传共链路的通信系统及方法 |
| CN107438801A (zh) * | 2016-09-27 | 2017-12-05 | 深圳市大疆创新科技有限公司 | 一种飞行器控制方法、终端及飞行器 |
| CN107089319A (zh) * | 2017-04-20 | 2017-08-25 | 中化舟山危化品应急救援基地有限公司 | 储罐火灾侦检系统 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111357274A (zh) | 2020-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109151402B (zh) | 航拍相机的图像处理方法、图像处理系统及无人机 | |
| CN102761702B (zh) | 用于移动通信设备中的图像重叠的方法以及成像系统 | |
| US20190246104A1 (en) | Panoramic video processing method, device and system | |
| US20160180593A1 (en) | Wearable device-based augmented reality method and system | |
| CN105611170A (zh) | 一种无人机及其全景拼接方法、装置和系统 | |
| CN104796611A (zh) | 移动终端遥控无人机实现智能飞行拍摄的方法及系统 | |
| US11106421B2 (en) | Display method and system for wireless intelligent multi-screen display | |
| US11876951B1 (en) | Imaging system and method for unmanned vehicles | |
| CN106716244B (zh) | 摄影控制装置、摄影装置、摄影控制方法 | |
| CN114845078B (zh) | 通话方法及电子设备 | |
| US20150023649A1 (en) | Network connection configuration method for multimedia player and related computer system | |
| US20140198215A1 (en) | Multiple camera systems with user selectable field of view and methods for their operation | |
| WO2018107362A1 (zh) | 一种宽窄带通信设备及方法 | |
| WO2018058575A1 (zh) | 一种飞行图像数据的处理方法、系统及地面端设备 | |
| US20170318165A1 (en) | Communication device, communication system and communication method | |
| CN106598213A (zh) | 一种虚拟现实设备及其控制方法、系统 | |
| CN103841322A (zh) | 一种终端及协同拍照方法 | |
| US10026205B2 (en) | Method and apparatus for providing preview image | |
| CN210007799U (zh) | 图像处理系统及无人机 | |
| CN111357274A (zh) | 控制端的显示方法、设备及存储介质 | |
| CN110012205A (zh) | 一种低功耗视频成像方法、处理器及装置 | |
| KR20180078931A (ko) | 듀얼 카메라로부터의 영상스트리밍의 스위칭 전송 기능을 구비한 드론 및 드론시스템 | |
| US20170332053A1 (en) | Control method and information processing device | |
| CN109996004A (zh) | 一种低功耗图像成像方法、处理器及装置 | |
| US20170134651A1 (en) | Portable Device for Generating Wide Angle Images |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19911614 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 19911614 Country of ref document: EP Kind code of ref document: A1 |