WO2018040092A1 - Remote execution device, method, and system - Google Patents
Remote execution device, method, and system Download PDFInfo
- Publication number
- WO2018040092A1 WO2018040092A1 PCT/CN2016/098052 CN2016098052W WO2018040092A1 WO 2018040092 A1 WO2018040092 A1 WO 2018040092A1 CN 2016098052 W CN2016098052 W CN 2016098052W WO 2018040092 A1 WO2018040092 A1 WO 2018040092A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- remote control
- execution
- executing
- control
- specific action
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 230000009471 action Effects 0.000 claims abstract description 77
- 230000007246 mechanism Effects 0.000 claims abstract description 59
- 230000003213 activating effect Effects 0.000 claims 3
- 238000003384 imaging method Methods 0.000 description 24
- 230000001360 synchronised effect Effects 0.000 description 13
- 238000004891 communication Methods 0.000 description 10
- 238000003860 storage Methods 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000010365 information processing Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 238000001931 thermography Methods 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000011217 control strategy Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
- G01C11/02—Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C23/00—Non-electrical signal transmission systems, e.g. optical systems
- G08C23/04—Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
Definitions
- the invention belongs to the field of remote control technology, and particularly relates to a remote control executing device, method and system used in applications such as a drone or a driverless car.
- the same drone sometimes needs to carry two or more cameras.
- a visible light camera and an infrared camera are required to work together.
- the infrared camera and the visible light camera it is often necessary to simultaneously see the normal exposure picture and the infrared thermal imaging effect of the normal camera, so it is necessary to achieve simultaneous shooting, so as to ensure the consistency of the video and the photo.
- Fig. 1A shows the case where two cameras of the same command are simultaneously transmitted to the drone in the prior art.
- serious problems can arise if the existing single-camera drone control method is directly applied to a multi-camera drone. Because, if the same command is received by two cameras, two kinds of information feedback will be generated. As the sender's remote controller receives two feedback information at the same time, it will be disordered, that is, it cannot be determined which camera is fed back. Thus, if there is a case where data is lost, it cannot be determined which camera has failed to perform the action.
- FIG. 1B shows the prior art in which two cameras are simultaneously generated and sent to the two cameras of the drone.
- the user if the user operates, two commands are directly generated and sent to the two cameras, which increases the amount of data. And after the transmission fails, it needs to be resent. Because the link is long, the retransmission will increase the time difference and the shooting will be out of sync.
- the present invention provides a remote control executing device comprising a main control module and at least two executing mechanisms, the main control module for receiving a control command from outside the remote control executing device, wherein when the control command is used to indicate at least When the two actuators perform a specific action at the same time, the master module generates a separate control command for each of the at least two actuators to control the at least two actuators to simultaneously perform the specific action.
- the present invention also provides a remote control execution method, comprising: receiving a control command from the outside; and when the control command is used to instruct at least two actuators to simultaneously perform a specific action, for each of the at least two actuators Generating a sub-control command separately; sending the sub-control command to each executing mechanism separately, so that the at least two executing mechanisms simultaneously perform the specific action.
- the present invention also provides a remote control execution system including a remote control device and a remote control device capable of transmitting control commands for controlling at least two remote control actuators of the remote control execution device, wherein: the remote control execution device further includes a main control a control module, the main control module is configured to receive a control command from the remote control device; and when the control command is used to indicate that at least two actuators located in the remote control execution device simultaneously perform a specific action, the main control module A separate control command is generated for each of the at least two actuators to control the at least two actuators to simultaneously perform the specific action.
- the present invention also provides a remote control execution system including a remote control device and at least one remote control device capable of transmitting control commands for controlling the at least two remote control actuators, wherein: the remote control execution device includes a main control module And at least one actuator for receiving a control command from the remote control device; when the control command is used to indicate that at least two actuators located at the same remote control execution device or different remote control execution devices simultaneously perform a specific action At least one of the main control modules of the remote control device for the at least two Each of the executing agencies generates a separate control command to control the at least two executing mechanisms to simultaneously perform the specific actions.
- aspects of the invention may also include a non-transitory computer readable medium comprising program instructions for: receiving a control command; when the control command is for indicating that at least two actuators perform a particular action simultaneously And generating, by each of the at least two executing mechanisms, a sub-control command; respectively, sending the sub-control command to each of the executing mechanisms, so that the at least two executing mechanisms simultaneously perform the specific action.
- the device of the present invention and the method, system and computer readable medium are capable of avoiding the occurrence of out-of-sync and error when the user remotely operates different actuators, and can simplify the operation of the user.
- FIG. 1A shows a case where two cameras of the same command are simultaneously transmitted to a drone in the prior art
- FIG. 1B shows a case where two cameras are simultaneously generated and sent to the drones in the prior art
- FIG. 2 is a block diagram of a module of an embodiment of the present invention.
- FIG. 3 is a view showing an application scenario of a second embodiment of the present invention.
- Figure 4 is a flow chart showing the specific operation in the second embodiment of the present invention.
- Figure 5 is a diagram of an application scenario of a third implementation of the present invention.
- the present invention primarily contemplates the situation where the remote control actuator includes more than one actuator, such as two cameras.
- the two or more actuators need to cooperate with each other to perform a certain task, how to prevent errors caused by the transmission and feedback of the commands and the asynchronous problems generated during the execution.
- the system, the device and the method of the present invention are not limited to the field, and any of them are wired or not.
- the remote control of the line allows the invention to be utilized in a field where two or more different actuators are engaged in a coordinated action, for example, including various unmanned vehicles, and any person who does not need to be directly
- Various application devices and application scenarios on the device body such as robot technology, virtual reality technology, and the like.
- the "remote control” mentioned in the present invention can be extended to any system or device that performs remote control using the Internet, mobile communication, etc., and wireless control systems and devices implemented using infrared, Bluetooth, NFC near field communication, Zigbee, and the like.
- the "execution” mentioned in the present invention is not limited to a specific action of an image acquisition section such as a camera, but may be extended to any operation based on mechanical, electronic, or optical.
- a "module” as referred to in the present invention may be any hardware device or component of a device, such as a processor, or a logic module of software.
- the hardware device or components of the device may also execute the corresponding method in accordance with a computer program stored in a non-transitory computer readable medium stored in the memory.
- the "two or more actuators" proposed in the present invention are not limited to the same or the same type of actuator, but any arbitrary or different actuators as long as they can cooperate with each other in a specific scene. Complete a task.
- the "remote control device” of the present invention generally needs to be used with a specific “remote control device” such as a remote controller, it is not necessary for the “remote control device” and the entity “remote device” as long as “remote control is performed”
- the device can receive a signal from the outside, and the signal may not be sent by a specific certain/some physical device, for example, it may be a device that is not specifically specified in the communication network, or a device located in the "cloud”. Issued, and so on. Even when the "remote control device” of the present invention communicates with the “remote control device” of the entity, the number and type of the "remote control device” are not limited.
- the present invention proposes to set the main control module in the remote control execution device, that is, the remote control of the present invention.
- At least one master module and at least two actuators are provided in the execution device, the master module being configured to receive a control command from outside the remote control device.
- the received command may be issued by a particular materialized remote control device or by an unspecified, non-materialized system.
- the master module when the control command is used to indicate that at least two actuators perform a specific action at the same time, the master module generates a separate control command for each of the at least two actuators. In order to control the at least two actuators to perform the specific action simultaneously. That is to say, the present invention converts a control command into a control command for separately controlling different actuators, thereby avoiding sending a plurality of control commands to a plurality of actuators, resulting in a complicated link.
- the generated sub-control commands are transmitted to the at least two actuators by wire or wirelessly.
- the main control module and the executing mechanism are both disposed in the remote control executing device and directly connected in a wired manner, the sub-control command issued by the main control module can well realize the synchronization of sending and receiving, thereby enabling the execution of the executing mechanism. Achieve good synchronization. This also avoids the delay caused by the out of synchronization of the transmission and reception processes when multiple control commands are sent to multiple actuators.
- the main control module and the actuator send the sub-control command wirelessly, it can simplify the electrical structure of the remote control device, making the mechanical structure of the remote control device more flexible.
- Each actuator performs a specific action after receiving the sub-control command, such as turning on the camera, after which it can selectively feed back status information of the execution action to the main control module. Since the main control module generates the sub-control command for different actuators, the execution status information fed back to the main control module has the identity to the executing mechanism. The main control module can also selectively send the execution status information obtained by the main control module to the outside, or simply store the execution status information. Since the execution status information has an identifier for the execution mechanism, the situation in which the feedback information obtained when the control command is directly sent to the plurality of execution units in the prior art cannot be recognized and causes a problem occurs.
- the present invention can be automatically re-executed directly at the remote control execution device when the execution fails, so as to reduce the burden on the end of the control command. That is, when the execution state information fed back by at least one of the at least two execution mechanisms indicates that the execution mechanism fails to execute the specific action, the main control module separately generates points for each of the two or more execution mechanisms. Controlling commands to control the at least two actuators to perform the specific actions simultaneously. In order to avoid falling into the loop of execution failure, a predetermined value may be set. When the number of consecutive re-executions of each actuator reaches the predetermined value, the main control module stops generating the sub-control command and selectively executes the specific control. The message that the action failed is sent to the outside.
- the main control module of the present invention is not limited to a specific position provided in the remote control executing device, but generally a position where each actuator can communicate well should be provided.
- the main control module can be set inside the gimbal of the drone.
- the image acquisition device as an actuator is located on the gimbal.
- the two or more actuators of the present invention may be located in the same remote control device or in different remote control devices.
- the actuator in the present invention may be a different camera of the same drone or a camera on a different drone.
- This scenario is useful when multiple drones are tracking the same person, scene, or environment. That is to say, the present invention can issue a control command to a drone to simultaneously operate cameras located on different drones to achieve simultaneous shooting.
- the main control module of a drone is required as the main drone that receives the main control command, and the main drone can communicate well with the actuators (such as cameras) of other drones that cooperate with the operation. For example, Bluetooth communication within 200 meters.
- the master drone issues a minute control command to the camera on its own camera or other drone after receiving the master command, thereby Complete the simultaneous start, synchronized shooting and other actions.
- the remote control executing device 1 is a stand-alone device capable of receiving a control command from the outside. In this embodiment, it is capable of receiving control signals from a remote control device 2 having a particular entity.
- the number of remote control devices 2 is not limited, and may not be a specific physical device, for example, may be a device that is not specifically designated from a communication network, or an unspecified device located in the "cloud". Wait.
- the remote control actuator 1 includes a plurality of actuators 11, 12, 13. Although three actuators are shown in the figure, the invention can be used for two or more actuators Be applicable. These actuators can be the same type of actuator, for example two cameras for three-dimensional imaging, or different types of actuators, such as a combination of a visible light camera and an infrared camera, or even an actuator that cannot function. For example, a combination of a lighting device and a camera.
- the present invention adds a main control module 10 to the remote control executing device 1, and the main control module 10 can perform information communication with each of the actuators 11, 12, and 13.
- the main control module 10 is connected to each actuator by a solid line in the figure, this does not mean that the invention can only use a wired connection, and the main control module 10 can also adopt wireless methods such as infrared, Bluetooth, WiFi, Zigbee and the like. The agency conducts information communication.
- the main control module 10 By setting the main control module 10, the information interaction between the actuator 2 and the main control module 10 in the prior art can be replaced by the information interaction between the remote control device 2 and the main control module 10. At this time, the main control module 10 needs to use those.
- the control command for instructing the actuator to perform an action is forwarded to each of the actuators 11, 12, 13 by generating a minute control command.
- the manner in which the remote control device directly transmits the control command to the actuator is not excluded in the present invention. That is to say, for the remote control device 2, in different embodiments, it may send the control command only to the main control module 10, or may selectively send the control command to the main control module 10 or the actuators 11, 12 , 13 and so on.
- the advantages of the present invention are embodied in that when the control command is used to instruct at least two actuators 11, 12, 13 to simultaneously perform a specific action, the master module 10 can execute for two or more Each of the actuators in the organization generates a separate control command, which enables each actuator to perform specific actions simultaneously.
- the remote control device 2 it is necessary to send a synchronously executed control command to the main control module 10 without transmitting a plurality of control commands as in the prior art.
- different actuators 11, 12, and 13 obtain different sub-control commands from the main control module 10, which do not cause mutual interference of signals and cause errors in parsing commands, causing problems.
- the main control module 10 assumes the function of signal forwarding, it can also be designed to have certain information processing capability, so that after receiving the control command of the remote control device 2, the actuators can be more intelligently controlled. 11, 12, 13 action.
- the main control module 10 can be heavy when an execution mechanism fails. Newly start the simultaneous execution of each actuator.
- each execution mechanism 11, 12, 13 needs to feed back the execution status information of the execution action to the main control module 10.
- the main control module 10 can directly forward the same.
- the remote control device 2 can also be selectively attempted to restart the execution of the actions by the respective execution devices. When it selects the latter, the main control module 10 can re-send the component control command and send it to each executing mechanism, so that each executing mechanism resynchronizes the execution action.
- the main control module 10 is further capable of determining the number of times the connection resynchronization execution fails, and stops attempting to restart the synchronization execution when the number reaches the predetermined value, thereby avoiding a fatal problem that cannot be repaired due to the execution mechanism. It is caught in an infinite loop of restart.
- the main control module 10 transmits execution state information of the execution failure to the remote control device 2.
- the main control module 10 can intelligently control the execution of each execution mechanism in real time after receiving the synchronous execution command issued by the remote control device 2, instead of the specific synchronous execution control mode. That is to say, the main control module 10 of the present invention may also adopt other control strategies to enable each execution mechanism to perform synchronously, such as timing restart, or delayed restart, etc., which are all included in the scope of the present invention. .
- the main control module itself can have certain information processing energy, it can also have a certain information storage capability, and thus, it can store or process the execution state information of each execution mechanism and then send it to the remote control device 2.
- FIG. 3 is an application scenario diagram of another embodiment (second embodiment) of the present invention.
- This embodiment is one of the specific embodiments of the prior embodiment in the field of drones.
- the remote control device 3 is a drone, and the remote control device is correspondingly the remote controller 4 of the drone 3.
- the drone 3 has a pan/tilt 30 on which two cameras are mounted: a visible light camera 32 and an infrared camera 33.
- an imaging controller 31 having a function of transmitting and receiving information with the remote controller, and capable of transmitting an operation instruction to the visible light camera 32 and the infrared camera 33.
- the imaging controller 31 in this embodiment is the master mode.
- the specific embodiment of the block, while the visible light camera 32 and the infrared camera 32 are specific embodiments of the two actuators.
- the remote controller 4 sends a synchronous start visible light camera to the drone 3 with the same control command as the infrared, which control command is received and parsed by the imaging controller 31.
- the imaging controller parses the control command, it begins to control the visible light camera 32 and the infrared machine phase 32 to cause them to start synchronously.
- the imaging controller can also perform some necessary pre-operations to ensure the smooth execution of the synchronization, such as checking the state of each camera, stopping the currently performed action, and the like.
- the imaging controller 31 respectively generates a sub-control command that activates the visible light camera 32 and the infrared camera 33 and simultaneously transmits them to the two cameras so that the two cameras are simultaneously activated, and the photographing is simultaneously performed at a subsequent time.
- the Bluetooth controller is established between the imaging controller 31 and each of the cameras 32, 33 when the drone is activated.
- the present invention can also establish the connection by means of a wired connection or other wireless connection.
- FIG. 4 is a flow chart showing the specific operation in the above embodiment.
- the synchronously executed operation is initiated by the user operating the remote controller.
- the control command is received by the imaging controller located on the drone, and the imaging controller receives the control command. Analyze and obtain the content of the specific synchronous execution, including the execution organization, the action information of the execution, and the like.
- the control command includes information that causes the visible light to be the same as the infrared camera to perform the startup.
- the imaging controller generates two sub-control commands and transmits them to the two cameras, thereby controlling simultaneous activation of the visible light camera and the infrared camera.
- the visible light camera and the infrared camera feed back execution status information to the imaging controller after performing the startup action, and if both cameras are successfully executed, the imaging controller transmits successful execution status information to the remote controller.
- the imaging controller determines whether the number of times the synchronization execution action is restarted has reached a predetermined value, which is, for example, five. If the predetermined value is reached, the synchronous execution action is no longer attempted, and the execution status information of the failed execution is sent to the imaging controller, otherwise the attempt to restart the synchronization is continued.
- the execution state information is transmitted to the remote controller after the execution state information of the execution failure that is received by the imaging controller d. At this point, the operation flow ends.
- the synchronously executed action is the same as the synchronous start of the visible light camera and the infrared, but in other embodiments, it may also perform other actions synchronously, such as synchronous photographing, synchronization adjustment parameters, and the like.
- the imaging controller disposed in the pan/tilt is used as the main control module 10, but in other embodiments of the present invention, the main control may be implemented by other hardware or software having information processing capabilities.
- the module 10 is implemented, for example, by a control chip implemented by a CPU, a DSP, an FPGA, or the like, or a logic function module in a drone master program. Such variations are intended to be encompassed within the scope of the invention.
- the mechanical connection relationship between the camera and the imaging control module of the above embodiment on the drone is not specific, that is, it does not have to be mounted on the pan/tilt, which may be any mechanical assembly method conforming to the actual application scenario, as long as the camera is guaranteed.
- the imaging control module can exchange information by wire or wirelessly.
- Fig. 5 is a view showing an application scenario of the third embodiment. As shown in FIG. 5, the present invention is also applicable to scenes of a plurality of remote control executing devices based on the subject matter of the present invention.
- This third embodiment is still illustrated by the example of a drone, but the technical architecture embodied therein is still a general way.
- two drones are taken as an example.
- the requirements for synchronizing the cameras of multiple drones may be more prominent.
- the first drone 3 and the second drone 3' cooperate to perform shooting.
- one of the drones An imaging controller is provided on the 3rd.
- the first drone 3 can interact with the camera of the second drone in addition to information interaction with its own camera.
- a Bluetooth communication method of wireless communication within a range of 200 meters can be employed.
- the imaging controller is only provided on the first drone 3, but in other embodiments, the imaging controller may be provided on the other drones 3, or may be set on all the drones.
- An imaging controller, the remote controller 4 can selectively be turned into a drone Like the controller sends a control command that is executed synchronously.
- the present invention employs a command to cause at least two actuators to simultaneously perform the startup, photographing or recording of the phase in the example, which will save user interaction costs.
- the fewer the signals the better, of course, the better, only one execution button is needed at the interactive end, and the user can synchronize by one action. Take photos and videos.
- the above method and module according to various embodiments of the present invention may be implemented by executing a computer-containing software by a computing-capable electronic device.
- the system can include storage devices to implement the various storages described above.
- the computing capable electronic device can include a general purpose processor, a digital signal processor, a dedicated processor, a reconfigurable processor, etc., but is not limited thereto. Executing such instructions causes the electronic device to be configured to perform the operations described above in accordance with the present invention.
- the above methods and/or modules may be implemented in one electronic device or in different electronic devices.
- Embodiments of the invention use software, which may be stored in the form of volatile memory or non-volatile storage (such as a storage device such as a ROM), whether erasable or rewritable, or stored as
- the form of the memory eg, RAM, memory chip, device, or integrated circuit
- the storage device and the storage medium are embodiments of a machine-readable storage device adapted to store one or more programs, the program or programs comprising instructions that, when executed, implement the present invention An embodiment.
- these programs can be routed via any medium, such as a communication signal carried via a wired connection or a wireless connection, and various embodiments suitably include such programs.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Selective Calling Equipment (AREA)
- Studio Devices (AREA)
Abstract
Disclosed is a remote execution device (1) comprising a master control module (10) and at least two execution mechanisms (11, 12, and 13). The master control module (10) receives a control command from outside of the remote execution device (1), such as a remote control device (2). When the control command is used for instructing the at least two execution mechanisms (11, 12, and 13) to concurrently execute a specific action, the master control module (10) respectively generates one sub-control command for each execution mechanism (11, 12, and 13) of the at least two execution mechanisms (11, 12, and 13), thus controlling the at least two execution mechanisms (11, 12, and 13) to concurrently execute the specific action. The remote execution device (1) and the remote control device (2) constitute a remote execution system. The device and system prevent desynchronization and error from being produced when a user is remotely operating different execution mechanisms and simplify user operation. Also disclosed is a remote execution method.
Description
版权申明Copyright statement
本专利文件披露的内容包含受版权保护的材料。该版权为版权所有人所有。版权所有人不反对任何人复制专利与商标局的官方记录和档案中所存在的该专利文件或者专利披露。The disclosure of this patent document contains material that is subject to copyright protection. This copyright is the property of the copyright holder. The copyright owner has no objection to the reproduction of the patent document or patent disclosure contained in the official records and files of the Patent and Trademark Office.
本发明属于遥控技术领域,具体涉及无人机、无人驾驶汽车等应用中使用的遥控执行装置、方法和系统。The invention belongs to the field of remote control technology, and particularly relates to a remote control executing device, method and system used in applications such as a drone or a driverless car.
随着无人机行业应用的范围越来越广泛,在电力巡检、热成像搜索等领域,同一台无人机上有时候需要搭载两台或多台相机。例如在某些场景中,需要一台可见光相机和一台红外相机配合工作。在红外相机和可见光相机的配合的应用中,往往需要同时看见正常相机拍摄的正常曝光画面和红外热成像的效果,因此必须实现同步拍摄,这样才能够保证视频和照片的一致性。With the wide range of applications in the UAV industry, in the field of power inspection, thermal imaging search, etc., the same drone sometimes needs to carry two or more cameras. For example, in some scenarios, a visible light camera and an infrared camera are required to work together. In the application of the infrared camera and the visible light camera, it is often necessary to simultaneously see the normal exposure picture and the infrared thermal imaging effect of the normal camera, so it is necessary to achieve simultaneous shooting, so as to ensure the consistency of the video and the photo.
现有的单相机无人机的拍摄过程中,用户的拍摄动作产生的拍摄命令只有一个相机响应,进行拍照或者录像。如果需要实现多台相机同时启动,或者同时成像,这就需要用户执行两次或更多次的动作,但是,凡是执行两次以上的动作,在时间上就极大的可能会不同步,从而无法同步拍摄以致无法反映同一时刻同一视角。During the shooting of the existing single-camera drone, only one camera responds to the shooting command generated by the user's shooting action, taking a picture or recording. If multiple cameras need to be activated at the same time, or simultaneously, this requires the user to perform two or more actions. However, if more than two actions are performed, the time may be greatly out of sync. Cannot sync shots so that they cannot reflect the same view at the same time.
图1A所示为现有技术中将同一命令同时发送给无人机的两个相机的情况。如图1所示,如果将现有的单相机无人机的控制方式直接应用于多相机无人机中会出现严重的问题。因为,若同一条命令被两个相机接收到后就产生两条信息反馈,作为发送者的遥控器同时受到两条反馈信息就会出现紊乱,即无法判定是由哪个相机反馈的。这样,如果存在数据丢失的情况,则不能判定是哪个相机执行动作失败。
Fig. 1A shows the case where two cameras of the same command are simultaneously transmitted to the drone in the prior art. As shown in Figure 1, serious problems can arise if the existing single-camera drone control method is directly applied to a multi-camera drone. Because, if the same command is received by two cameras, two kinds of information feedback will be generated. As the sender's remote controller receives two feedback information at the same time, it will be disordered, that is, it cannot be determined which camera is fed back. Thus, if there is a case where data is lost, it cannot be determined which camera has failed to perform the action.
图1B所示为现有技术中同时生成两条命令并分别发送给无人机的两个相机的情况。如图1B所示,如果用户操作就直接生成两条命令发送给两个相机,这样就会徒增数据量。并且在发送失败后,需要重新发送,由于链路较长,重新发送就会出现时间差增大导致拍摄不同步。FIG. 1B shows the prior art in which two cameras are simultaneously generated and sent to the two cameras of the drone. As shown in FIG. 1B, if the user operates, two commands are directly generated and sent to the two cameras, which increases the amount of data. And after the transmission fails, it needs to be resent. Because the link is long, the retransmission will increase the time difference and the shooting will be out of sync.
发明内容Summary of the invention
本发明提出一种遥控执行装置,包括主控模块和至少两个执行机构,所述主控模块用于从所述遥控执行装置的外部接收控制命令,其中,当所述控制命令用于指示至少两个执行机构同时执行特定动作时,所述主控模块对于该至少两个执行机构中的每个执行机构分别生成一个分控命令,以便控制该至少两个执行机构同时执行所述特定动作。The present invention provides a remote control executing device comprising a main control module and at least two executing mechanisms, the main control module for receiving a control command from outside the remote control executing device, wherein when the control command is used to indicate at least When the two actuators perform a specific action at the same time, the master module generates a separate control command for each of the at least two actuators to control the at least two actuators to simultaneously perform the specific action.
本发明还提出一种遥控执行方法,包括:从外部接收控制命令;当所述控制命令用于指示至少两个执行机构同时执行特定动作时,对于该至少两个执行机构中的每个执行机构分别生成一个分控命令;将所述分控命令分别发送到各执行机构,以使得该至少两个执行机构同时执行所述特定动作。The present invention also provides a remote control execution method, comprising: receiving a control command from the outside; and when the control command is used to instruct at least two actuators to simultaneously perform a specific action, for each of the at least two actuators Generating a sub-control command separately; sending the sub-control command to each executing mechanism separately, so that the at least two executing mechanisms simultaneously perform the specific action.
本发明还提出一种遥控执行系统,包括遥控装置和遥控执行装置,该遥控装置能够发送控制所述遥控执行装置的至少两个遥控执行机构的控制命令,其中:所述遥控执行装置还包括主控模块,所述主控模块用于从所述遥控装置接收控制命令;当所述控制命令用于指示位于所述遥控执行装置的至少两个执行机构同时执行特定动作时,所述主控模块对于该至少两个执行机构中的每个执行机构分别生成一个分控命令,以便控制该至少两个执行机构同时执行所述特定动作。The present invention also provides a remote control execution system including a remote control device and a remote control device capable of transmitting control commands for controlling at least two remote control actuators of the remote control execution device, wherein: the remote control execution device further includes a main control a control module, the main control module is configured to receive a control command from the remote control device; and when the control command is used to indicate that at least two actuators located in the remote control execution device simultaneously perform a specific action, the main control module A separate control command is generated for each of the at least two actuators to control the at least two actuators to simultaneously perform the specific action.
本发明还提出一种遥控执行系统,包括一个遥控装置和至少一个遥控执行装置,该遥控装置能够发送控制所述至少两个遥控执行机构的控制命令,其中:所述遥控执行装置包括主控模块和至少一个执行机构,所述主控模块用于从所述遥控装置接收控制命令;当所述控制命令用于指示位于同一遥控执行装置或不同遥控执行装置的至少两个执行机构同时执行特定动作时,其中一个遥控执行装置的主控模块对于该至少两
个执行机构中的每个执行机构分别生成一个分控命令,以便控制该至少两个执行机构同时执行所述特定动作。The present invention also provides a remote control execution system including a remote control device and at least one remote control device capable of transmitting control commands for controlling the at least two remote control actuators, wherein: the remote control execution device includes a main control module And at least one actuator for receiving a control command from the remote control device; when the control command is used to indicate that at least two actuators located at the same remote control execution device or different remote control execution devices simultaneously perform a specific action At least one of the main control modules of the remote control device for the at least two
Each of the executing agencies generates a separate control command to control the at least two executing mechanisms to simultaneously perform the specific actions.
本发明的其它方面也可以包括非易失性计算机可读介质,其包括程序指令,所述程序指令用于:接收控制命令;当所述控制命令用于指示至少两个执行机构同时执行特定动作时,对于该至少两个执行机构中的每个执行机构分别生成一个分控命令;将所述分控命令分别发送到各执行机构,以使得该至少两个执行机构同时执行所述特定动作。Other aspects of the invention may also include a non-transitory computer readable medium comprising program instructions for: receiving a control command; when the control command is for indicating that at least two actuators perform a particular action simultaneously And generating, by each of the at least two executing mechanisms, a sub-control command; respectively, sending the sub-control command to each of the executing mechanisms, so that the at least two executing mechanisms simultaneously perform the specific action.
本发明装置及其方法、系统、计算机可读介质能够避免用户遥控操作不同执行机构时的不同步和错误的产生,并且能简化用户的操作。The device of the present invention and the method, system and computer readable medium are capable of avoiding the occurrence of out-of-sync and error when the user remotely operates different actuators, and can simplify the operation of the user.
图1A所示为现有技术中将同一命令同时发送给无人机的两个相机的情况;FIG. 1A shows a case where two cameras of the same command are simultaneously transmitted to a drone in the prior art;
图1B所示为现有技术中同时生成两条命令并分别发送给无人机的两个相机的情况;FIG. 1B shows a case where two cameras are simultaneously generated and sent to the drones in the prior art;
图2是本发明的一个实施例的模块架构图;2 is a block diagram of a module of an embodiment of the present invention;
图3是本发明的第二实施例的应用场景图;3 is a view showing an application scenario of a second embodiment of the present invention;
图4是本发明的第二实施例中具体操作的流程图;Figure 4 is a flow chart showing the specific operation in the second embodiment of the present invention;
图5是本发明的第三实施你的应用场景图。Figure 5 is a diagram of an application scenario of a third implementation of the present invention.
对于无人机、无人驾驶汽车等遥控执行装置,本发明主要考虑这样一种情形,即该遥控执行装置包括不止一个执行机构,例如两个相机。当该两个或多个执行机构需要相互配合动作来执行某一任务时,如何防止因命令的传送和反馈引起的错误以及执行过程中产生的不同步问题。For remotely operated devices such as drones, driverless cars, etc., the present invention primarily contemplates the situation where the remote control actuator includes more than one actuator, such as two cameras. When the two or more actuators need to cooperate with each other to perform a certain task, how to prevent errors caused by the transmission and feedback of the commands and the asynchronous problems generated during the execution.
下面在具体描述本发明的方案时,尽管是采用无人机为例来进行说明,但本发明的系统、装置和方法并不限于该领域,任何通过有线、无
线的远程控制的方式来使被控的两个或多个不同执行机构进行配合动作的领域都可合理地利用本发明,例如包括各种无人驾驶的交通工具,以及任何不需要人直接在设备本体上进行操作的各种应用设备和应用场景,例如机器人技术、虚拟现实技术等。In the following, when the solution of the present invention is specifically described, although the description is made by taking an unmanned aerial vehicle as an example, the system, the device and the method of the present invention are not limited to the field, and any of them are wired or not.
The remote control of the line allows the invention to be utilized in a field where two or more different actuators are engaged in a coordinated action, for example, including various unmanned vehicles, and any person who does not need to be directly Various application devices and application scenarios on the device body, such as robot technology, virtual reality technology, and the like.
本发明中提及的“遥控”可延及利用互联网、移动通信等进行远程控制的任何系统或设备,以及利用红外、蓝牙、NFC近场通信、Zigbee等实现的无线控制系统和装置等。本发明中提及的“执行”也并非限定于相机等图像获取部件的特定动作,而是可以延及基于机械、电子、光学的任何操作过程。The "remote control" mentioned in the present invention can be extended to any system or device that performs remote control using the Internet, mobile communication, etc., and wireless control systems and devices implemented using infrared, Bluetooth, NFC near field communication, Zigbee, and the like. The "execution" mentioned in the present invention is not limited to a specific action of an image acquisition section such as a camera, but may be extended to any operation based on mechanical, electronic, or optical.
本发明中提及的“模块”可以是任何硬件设备或设备的部件,例如处理器,也可以是软件的逻辑模块。所述硬件设备或设备的部件也可根据存储在存储器中的非易失性计算机可读介质中存储的计算机程序来执行相应的方法。A "module" as referred to in the present invention may be any hardware device or component of a device, such as a processor, or a logic module of software. The hardware device or components of the device may also execute the corresponding method in accordance with a computer program stored in a non-transitory computer readable medium stored in the memory.
本发明中提出的“两个或多个执行机构”并不限定其是同样的或同种的执行机构,而是指任意的相同或不同的执行机构,只要他们能够在特定场景中相互配合来完成某项任务即可。The "two or more actuators" proposed in the present invention are not limited to the same or the same type of actuator, but any arbitrary or different actuators as long as they can cooperate with each other in a specific scene. Complete a task.
此外,尽管本发明的“遥控执行装置”通常需要配合特定的“遥控装置”,例如遥控器来使用,但对于“遥控执行装置”、实体的“遥控装置”并非是必需的,只要“遥控执行装置”能从外部接收信号即可,该信号可以不是由特定的某个/某些实体装置发出,例如可以是从通信网络中的并非特别指定的设备,或者是位于“云端”的某个设备发出,等等。而即便当本发明的“遥控执行装置”与实体的“遥控装置”进行通信,“遥控装置”的数量、类型也不受限制。In addition, although the "remote control device" of the present invention generally needs to be used with a specific "remote control device" such as a remote controller, it is not necessary for the "remote control device" and the entity "remote device" as long as "remote control is performed" The device can receive a signal from the outside, and the signal may not be sent by a specific certain/some physical device, for example, it may be a device that is not specifically specified in the communication network, or a device located in the "cloud". Issued, and so on. Even when the "remote control device" of the present invention communicates with the "remote control device" of the entity, the number and type of the "remote control device" are not limited.
总的来说,为了避免因产生多个控制命令给多个执行机构而引起的命令发送、接收不同步的问题,本发明提出在遥控执行装置设置主控模块,也就是说,本发明的遥控执行装置中至少设置一个主控模块以及至少两个执行机构,所述主控模块用于从所述遥控执行装置的外部接收控制命令。如前所述,该接收的命令可以是特定的实体化的遥控装置发出,也可以是不特定的、非实体化的系统发出。
In general, in order to avoid the problem that the command transmission and reception are not synchronized due to the generation of multiple control commands to multiple actuators, the present invention proposes to set the main control module in the remote control execution device, that is, the remote control of the present invention. At least one master module and at least two actuators are provided in the execution device, the master module being configured to receive a control command from outside the remote control device. As previously mentioned, the received command may be issued by a particular materialized remote control device or by an unspecified, non-materialized system.
而对于本发明更重要的是,当所述控制命令用于指示至少两个执行机构同时执行特定动作时,主控模块对于该至少两个执行机构中的每个执行机构分别生成一个分控命令,以便控制该至少两个执行机构同时执行所述特定动作。也就是说,本发明将一个控制命令转化为分别控制不同执行机构的分控命令,从而避免了向多个执行机构发送多个控制命令,造成链路的复杂。More importantly for the present invention, when the control command is used to indicate that at least two actuators perform a specific action at the same time, the master module generates a separate control command for each of the at least two actuators. In order to control the at least two actuators to perform the specific action simultaneously. That is to say, the present invention converts a control command into a control command for separately controlling different actuators, thereby avoiding sending a plurality of control commands to a plurality of actuators, resulting in a complicated link.
所生成的各个分控命令通过有线或者无线的方式传输给该至少两个执行机构。当主控模块与执行机构均设置于该遥控执行装置中并且直接以有线方式电性连接时,主控模块发出的分控命令可以很好地实现发送与接收的同步,从而使得执行机构的执行实现良好的同步。这也避免了向多个执行机构发送多个控制命令时的发送与接收过程的不同步造成的时延。当主控模块和执行机构通过无线方式发送分控命令时,其可简化遥控执行装置的电气结构,使得遥控执行装置的机械架构更加灵活。The generated sub-control commands are transmitted to the at least two actuators by wire or wirelessly. When the main control module and the executing mechanism are both disposed in the remote control executing device and directly connected in a wired manner, the sub-control command issued by the main control module can well realize the synchronization of sending and receiving, thereby enabling the execution of the executing mechanism. Achieve good synchronization. This also avoids the delay caused by the out of synchronization of the transmission and reception processes when multiple control commands are sent to multiple actuators. When the main control module and the actuator send the sub-control command wirelessly, it can simplify the electrical structure of the remote control device, making the mechanical structure of the remote control device more flexible.
各执行机构在接收到分控命令之后执行特定的动作,例如开启相机,之后,其可以选择性地将执行动作的状态信息反馈给主控模块。由于主控模块产生的是分控命令是针对不同的执行机构的,因此,其反馈给主控模块的执行状态信息具有对执行机构的标识性。而主控模块也可选择性地即时或择机将其获得的执行状态信息发送给外部,或者仅仅是存储该执行状态信息。由于该执行状态信息具有对执行机构的标识性,从而避免了现有技术中直接向多个执行机构发送控制命令时得到的反馈信息无法辩识而引起问题的情况发生。Each actuator performs a specific action after receiving the sub-control command, such as turning on the camera, after which it can selectively feed back status information of the execution action to the main control module. Since the main control module generates the sub-control command for different actuators, the execution status information fed back to the main control module has the identity to the executing mechanism. The main control module can also selectively send the execution status information obtained by the main control module to the outside, or simply store the execution status information. Since the execution status information has an identifier for the execution mechanism, the situation in which the feedback information obtained when the control command is directly sent to the plurality of execution units in the prior art cannot be recognized and causes a problem occurs.
进一步来说,本发明在执行失败时,可以在遥控执行装置一端直接自动重新执行,以减小控制命令发出一端的负担。也就是说,当至少两个执行机构中的至少一个反馈的执行状态信息表示该执行机构执行所述特定动作失败时,主控模块对于两个或多个执行机构中每一个都重新分别生成分控命令,以便控制该至少两个执行机构重新同时执行所述特定动作。为了避免陷入执行失败的循环中,可以设定一个预定值,当各执行机构连续重新同时执行的次数达到这个预定值时,主控模块停止生成分控命令,并选择性地将执行所述特定动作失败的信息向外部发送。
Further, the present invention can be automatically re-executed directly at the remote control execution device when the execution fails, so as to reduce the burden on the end of the control command. That is, when the execution state information fed back by at least one of the at least two execution mechanisms indicates that the execution mechanism fails to execute the specific action, the main control module separately generates points for each of the two or more execution mechanisms. Controlling commands to control the at least two actuators to perform the specific actions simultaneously. In order to avoid falling into the loop of execution failure, a predetermined value may be set. When the number of consecutive re-executions of each actuator reaches the predetermined value, the main control module stops generating the sub-control command and selectively executes the specific control. The message that the action failed is sent to the outside.
本发明的主控模块不限于设置于遥控执行装置中的特定位置,但通常应设置各执行机构能够良好通信的位置。在无人机中,主控模块可设于无人机的云台内部。而作为执行机构的图像获取装置则设于云台上。The main control module of the present invention is not limited to a specific position provided in the remote control executing device, but generally a position where each actuator can communicate well should be provided. In the drone, the main control module can be set inside the gimbal of the drone. The image acquisition device as an actuator is located on the gimbal.
更进一步来说,本发明的两个或多个执行机构可以是位于同一遥控执行装置中,也可以是位于不同的遥控执行装置中。例如,当遥控执行装置是无人机时,本发明中的执行机构可以是同一台无人机的不同相机,也可以是不同无人机上的相机。这种场景在多台无人机跟踪拍摄同一人物、场面或环境时较为有用。也就是说,本发明可以向一台无人机发出控制命令来同时操作位于不同无人机上的相机来实现同步拍摄。此时,需要一台无人机的主控模块作为接收主控命令的主无人机,该主无人机能够与配合作业的其他无人机的执行机构(如相机)进行良好的通信,例如200米范围内的蓝牙通信。这样,当用户用遥控器向主无人机发出同步拍摄的主控命令时,该主无人机在接收主控命令之后向其自身的相机或其他无人机上的相机发出分控命令,从而完成同步启动、同步拍摄等动作。Furthermore, the two or more actuators of the present invention may be located in the same remote control device or in different remote control devices. For example, when the remote control executing device is a drone, the actuator in the present invention may be a different camera of the same drone or a camera on a different drone. This scenario is useful when multiple drones are tracking the same person, scene, or environment. That is to say, the present invention can issue a control command to a drone to simultaneously operate cameras located on different drones to achieve simultaneous shooting. At this time, the main control module of a drone is required as the main drone that receives the main control command, and the main drone can communicate well with the actuators (such as cameras) of other drones that cooperate with the operation. For example, Bluetooth communication within 200 meters. Thus, when the user issues a master command for synchronous shooting to the master drone with the remote controller, the master drone issues a minute control command to the camera on its own camera or other drone after receiving the master command, thereby Complete the simultaneous start, synchronized shooting and other actions.
为使本发明的目的、技术方案和优点更加清楚明白,以下结合具体实施例,并参照附图,对本发明作进一步的详细说明。应理解的是,以下的实施例是以无人机作为遥控执行装置的特例来进行说明的,但是这并不表示本发明不能应用于其他领域。正如前面所说,凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The present invention will be further described in detail below with reference to the specific embodiments of the invention, It should be understood that the following embodiments are described with the exception that the drone is used as a remote control executing device, but this does not mean that the present invention cannot be applied to other fields. It is to be understood that any modifications, equivalents, improvements, etc., made within the spirit and scope of the invention are intended to be included within the scope of the invention.
图2是本发明的一个实施例的模块架构图。如图所示,遥控执行装置1是一个能够从外部接收控制命令的独立装置。在该实施例中,其能够从一个具有特定实体的遥控装置2接收控制信号。在其他的实施例中,遥控装置2的数量不受限制,并且也可以不是特定的实体装置,例如可以是从通信网络中的并非特别指定的设备,或者是位于“云端”的不特定的设备等。2 is a block diagram of an embodiment of the present invention. As shown, the remote control executing device 1 is a stand-alone device capable of receiving a control command from the outside. In this embodiment, it is capable of receiving control signals from a remote control device 2 having a particular entity. In other embodiments, the number of remote control devices 2 is not limited, and may not be a specific physical device, for example, may be a device that is not specifically designated from a communication network, or an unspecified device located in the "cloud". Wait.
遥控执行装置1中包括有多个执行机构11、12、13。尽管在该图中显示了三个执行机构,但本发明对于两个及两个以上的执行机构均可以
适用。这些执行机构可以是同种执行机构,例如是两个用于三维成像的两个相机,也可以是不同类型的执行机构,例如可见光相机和红外相机的组合,甚至是具有不能功能的执行机构,例如照明设备与相机的组合等。The remote control actuator 1 includes a plurality of actuators 11, 12, 13. Although three actuators are shown in the figure, the invention can be used for two or more actuators
Be applicable. These actuators can be the same type of actuator, for example two cameras for three-dimensional imaging, or different types of actuators, such as a combination of a visible light camera and an infrared camera, or even an actuator that cannot function. For example, a combination of a lighting device and a camera.
如图2所示,本发明在遥控执行装置1中增设一个主控模块10,该主控模块10能够与各执行机构11、12、13进行信息通信。尽管图中是用实线将主控模块10与各执行机构连接,但这并不表示本发明只能采用有线连接,主控模块10也可以采用红外、蓝牙、WiFi、Zigbee等无线方式与各执行机构进行信息通信。As shown in FIG. 2, the present invention adds a main control module 10 to the remote control executing device 1, and the main control module 10 can perform information communication with each of the actuators 11, 12, and 13. Although the main control module 10 is connected to each actuator by a solid line in the figure, this does not mean that the invention can only use a wired connection, and the main control module 10 can also adopt wireless methods such as infrared, Bluetooth, WiFi, Zigbee and the like. The agency conducts information communication.
通过设置主控模块10,现有技术中执行机构2与主控模块10的信息交互可以由遥控装置2与主控模块10之间的信息交互代替,此时,主控模块10需要将那些用于指示执行机构进行动作的控制命令通过生成分控命令再转发给各执行机构11、12、13。但是,本发明中并不排除遥控装置直接发送控制命令给执行机构的方式。也就是说,对于遥控装置2来说,在不同实施例中,其可以将控制命令只发送给主控模块10,也可以选择性地将控制命令发送给主控模块10或执行机构11、12、13等。By setting the main control module 10, the information interaction between the actuator 2 and the main control module 10 in the prior art can be replaced by the information interaction between the remote control device 2 and the main control module 10. At this time, the main control module 10 needs to use those. The control command for instructing the actuator to perform an action is forwarded to each of the actuators 11, 12, 13 by generating a minute control command. However, the manner in which the remote control device directly transmits the control command to the actuator is not excluded in the present invention. That is to say, for the remote control device 2, in different embodiments, it may send the control command only to the main control module 10, or may selectively send the control command to the main control module 10 or the actuators 11, 12 , 13 and so on.
然而,正如前面所述,本发明的优势体现在:当控制命令用于指示至少两个执行机构11、12、13同时执行特定动作时,所述主控模块10可以对于两个或多个执行机构中的每个执行机构均分别生成一个分控命令,这样就能够控制各个执行机构同时执行特定动作。对于遥控装置2来说,其中需要发送一条同步执行的控制命令给主控模块10即可,而无需像现有技术那样发送多条控制命令。对于执行机构来说,不同的执行机构11、12、13从主控模块10获取的是不同的分控命令,不会造成信号的相互干扰而造成解析命令失误而引发问题。进一步的,由于主控模块10承担了信号转发的功能,其本身也可以设计成具有一定的信息处理能力,由此在接收遥控装置2的控制命令这后,可以更加智能地分控各执行机构11、12、13的动作。However, as described above, the advantages of the present invention are embodied in that when the control command is used to instruct at least two actuators 11, 12, 13 to simultaneously perform a specific action, the master module 10 can execute for two or more Each of the actuators in the organization generates a separate control command, which enables each actuator to perform specific actions simultaneously. For the remote control device 2, it is necessary to send a synchronously executed control command to the main control module 10 without transmitting a plurality of control commands as in the prior art. For the actuator, different actuators 11, 12, and 13 obtain different sub-control commands from the main control module 10, which do not cause mutual interference of signals and cause errors in parsing commands, causing problems. Further, since the main control module 10 assumes the function of signal forwarding, it can also be designed to have certain information processing capability, so that after receiving the control command of the remote control device 2, the actuators can be more intelligently controlled. 11, 12, 13 action.
作为一个实施例,主控模块10可以在某个执行机构执行失败时重
新启动各执行机构的同步执行。在该实施例中,各执行机构11、12、13需要将执行动作的执行状态信息反馈给主控模块10,主控模块10在接受到各执行机构的执行状态信息后,可以直接将其转发给遥控装置2,也可以选择性地先行尝试重新启动各执行装置对动作的执行。当其选择后者时,主控模块10可以重新重成分控命令后发送给各执行机构,使得各执行机构重新同步执行动作。这样的好处在于,一旦各执行机构中的至少一个出现了执行错误,主控模块10自动进行重新启动就很可能修复错误执行而重新恢复同步执行操作,有效地避免了在遥控装置端动执行错误的处理,使得用户的操作更加省心和便捷。As an embodiment, the main control module 10 can be heavy when an execution mechanism fails.
Newly start the simultaneous execution of each actuator. In this embodiment, each execution mechanism 11, 12, 13 needs to feed back the execution status information of the execution action to the main control module 10. After receiving the execution status information of each execution unit, the main control module 10 can directly forward the same. The remote control device 2 can also be selectively attempted to restart the execution of the actions by the respective execution devices. When it selects the latter, the main control module 10 can re-send the component control command and send it to each executing mechanism, so that each executing mechanism resynchronizes the execution action. This has the advantage that once at least one of the execution agencies has an execution error, the main control module 10 automatically restarts and is likely to repair the error execution and resume the synchronous execution operation, effectively avoiding the execution error at the remote control device. The processing makes the user's operation more worry-free and convenient.
作为更为优选的实施例,主控模块10还能够判断连接重新同步执行失败的次数,并在该次数达到预定值时停止尝试重新启动同步执行,从而避免因执行机构因发生无法修复的致命问题时陷入重新启动的死循环中。在重新尝试的次数达到该预定值时,主控模块10将执行失败的执行状态信息发送给遥控装置2。As a more preferred embodiment, the main control module 10 is further capable of determining the number of times the connection resynchronization execution fails, and stops attempting to restart the synchronization execution when the number reaches the predetermined value, thereby avoiding a fatal problem that cannot be repaired due to the execution mechanism. It is caught in an infinite loop of restart. When the number of retries reaches the predetermined value, the main control module 10 transmits execution state information of the execution failure to the remote control device 2.
应当理解,本发明的实质在于使主控模块10在接收遥控装置2发出的同步执行命令后,能够智能化地实时地控制各执行机构进行同步执行,而不在于具体的同步执行的控制方式。也就是说,本发明的主控模块10也可以采取其他的控制策略来使得各执行机构同步执行,例如定时重新启动,或者延时重新启动等等,其均应涵盖在本发明的范围之内。此外,由于主控模块本身可以具有一定的信息处理能量,也可以具有一定的信息存储能力,由此,其可以对各执行机构的执行状态信息进行存储或处理之后择机发送给遥控装置2。It should be understood that the essence of the present invention is that the main control module 10 can intelligently control the execution of each execution mechanism in real time after receiving the synchronous execution command issued by the remote control device 2, instead of the specific synchronous execution control mode. That is to say, the main control module 10 of the present invention may also adopt other control strategies to enable each execution mechanism to perform synchronously, such as timing restart, or delayed restart, etc., which are all included in the scope of the present invention. . In addition, since the main control module itself can have certain information processing energy, it can also have a certain information storage capability, and thus, it can store or process the execution state information of each execution mechanism and then send it to the remote control device 2.
图3是本发明的另一实施例(第二实施例)的应用场景图。该实施例是对前一实施例在无人机领域的具体实施方式之一。如图所示,该实施例中,遥控执行装置3是一台无人机,遥控装置相应地是无人机3的遥控器4。无人机3具有一个云台30,云台30上装配有两台相机:可见光相机32和红外相机33。在云台30内还设置有成像控制器31,其具有与遥控器之间的信息收发的功能,并能够向可见光相机32和红外相机33发送操作指令。可见,该实施例中的成像控制器31即是主控模
块的具体实施方式,而可见光相机32和红外相机32是两个执行机构的具体实施方式。FIG. 3 is an application scenario diagram of another embodiment (second embodiment) of the present invention. This embodiment is one of the specific embodiments of the prior embodiment in the field of drones. As shown in the figure, in this embodiment, the remote control device 3 is a drone, and the remote control device is correspondingly the remote controller 4 of the drone 3. The drone 3 has a pan/tilt 30 on which two cameras are mounted: a visible light camera 32 and an infrared camera 33. Also provided in the pan/tilt 30 is an imaging controller 31 having a function of transmitting and receiving information with the remote controller, and capable of transmitting an operation instruction to the visible light camera 32 and the infrared camera 33. It can be seen that the imaging controller 31 in this embodiment is the master mode.
The specific embodiment of the block, while the visible light camera 32 and the infrared camera 32 are specific embodiments of the two actuators.
在该实施例中,遥控器4向无人机3发送一个同步启动可见光相机与红外相同的控制命令,该控制命令由成像控制器31接收并解析。成像控制器解析控制命令后开始对可见光相机32和红外机相32进行控制以使其同步启动。当然,在同步启动两个相机之前,成像控制器也可以先进行一些必要的预操作以保证同步执行的顺利进行,例如检查各相机的态、停止当前执行的动作等。接着,成像控制器31分别生成启动可见光相机32与红外相机33的分控命令并同时发送给两个相机,使得两个相机同时启动,并在后续的时间同步进行拍摄。在该实施例中,在无人机启动时,成像控制器31与各相机32、33之间就建立了蓝牙连接。但本发明也可以采用有线连接的方式,或者其他无线连接方式建立该连接。In this embodiment, the remote controller 4 sends a synchronous start visible light camera to the drone 3 with the same control command as the infrared, which control command is received and parsed by the imaging controller 31. After the imaging controller parses the control command, it begins to control the visible light camera 32 and the infrared machine phase 32 to cause them to start synchronously. Of course, before the two cameras are started synchronously, the imaging controller can also perform some necessary pre-operations to ensure the smooth execution of the synchronization, such as checking the state of each camera, stopping the currently performed action, and the like. Next, the imaging controller 31 respectively generates a sub-control command that activates the visible light camera 32 and the infrared camera 33 and simultaneously transmits them to the two cameras so that the two cameras are simultaneously activated, and the photographing is simultaneously performed at a subsequent time. In this embodiment, the Bluetooth controller is established between the imaging controller 31 and each of the cameras 32, 33 when the drone is activated. However, the present invention can also establish the connection by means of a wired connection or other wireless connection.
图4是上述实施例中具体操作的流程图。如图4所示,同步执行的操作由用户操作遥控器发起,遥控器发送同步执行的控制命令之后,由位于无人机上的成像控制器来接收该控制命令,成像控制器接收该控制命令之后进行解析并获得具体同步执行的内容,包括执行机构、执行的动作信息等。在该实施例中,该控制命令中包含有使可见光相同与红外相机同步执行启动的信息。由此,成像控制器生成两个分控命令并分别发送给两个相机,由此来控制可见光相机和红外相机的同时启动。Figure 4 is a flow chart showing the specific operation in the above embodiment. As shown in FIG. 4, the synchronously executed operation is initiated by the user operating the remote controller. After the remote controller sends the synchronously executed control command, the control command is received by the imaging controller located on the drone, and the imaging controller receives the control command. Analyze and obtain the content of the specific synchronous execution, including the execution organization, the action information of the execution, and the like. In this embodiment, the control command includes information that causes the visible light to be the same as the infrared camera to perform the startup. Thus, the imaging controller generates two sub-control commands and transmits them to the two cameras, thereby controlling simultaneous activation of the visible light camera and the infrared camera.
可见光相机和红外相机在执行启动动作之后,向成像控制器反馈执行状态信息,如果两个相机均成功执行,则成像控制器将执行成功的执行状态信息发送给遥控器。The visible light camera and the infrared camera feed back execution status information to the imaging controller after performing the startup action, and if both cameras are successfully executed, the imaging controller transmits successful execution status information to the remote controller.
如果两个相机中至少一个未成功执行启动,则成像控制器接着判断是否重新启动同步执行动作的次数已达到预定值,该预定值例如是5。如果达到预定值,则不再尝试重新启动同步执行动作,将执行失败的执行状态信息发送给成像控制器,否则继续尝试重新启同步执行作。成像控制器d接收到的执行失败的执行状态信息之后将该执行状态信息发送给遥控器。至此,该操作流程结束。
If at least one of the two cameras does not successfully perform the startup, the imaging controller then determines whether the number of times the synchronization execution action is restarted has reached a predetermined value, which is, for example, five. If the predetermined value is reached, the synchronous execution action is no longer attempted, and the execution status information of the failed execution is sent to the imaging controller, otherwise the attempt to restart the synchronization is continued. The execution state information is transmitted to the remote controller after the execution state information of the execution failure that is received by the imaging controller d. At this point, the operation flow ends.
需要说明的是在上述实施例中,同步执行的动作为同步启动可见光相机和红外相同,但在其他实施例中,其也可以是同步执行其他动作,例如同步拍照,同步调节参数等。此外,上述实施例中是以设置于云台中的成像控制器来为主控模块10,但在本发明的其他实施方式中,可以由其他各具有信息处理能力的硬件或软件来实施该主控模块10,例如由CPU、DSP、FPGA等实现的控制芯片或无人机主控程序中的某个逻辑功能模块来实施。此种变化方式均应涵盖在本发明的范围之内。It should be noted that in the foregoing embodiment, the synchronously executed action is the same as the synchronous start of the visible light camera and the infrared, but in other embodiments, it may also perform other actions synchronously, such as synchronous photographing, synchronization adjustment parameters, and the like. In addition, in the above embodiment, the imaging controller disposed in the pan/tilt is used as the main control module 10, but in other embodiments of the present invention, the main control may be implemented by other hardware or software having information processing capabilities. The module 10 is implemented, for example, by a control chip implemented by a CPU, a DSP, an FPGA, or the like, or a logic function module in a drone master program. Such variations are intended to be encompassed within the scope of the invention.
此外,上述实施例的相机和成像控制模块在无人机上的机械连接关系并非是特定的,即其并非必需装配在云台上,其可以是符合实际应用场景的任何机械装配方式,只要保证相机和成像控制模块能够通过有线或无线方式进行信息交互即可。In addition, the mechanical connection relationship between the camera and the imaging control module of the above embodiment on the drone is not specific, that is, it does not have to be mounted on the pan/tilt, which may be any mechanical assembly method conforming to the actual application scenario, as long as the camera is guaranteed. And the imaging control module can exchange information by wire or wirelessly.
图5是第三实施例的应用场景图。如图5所示,基于本发明的主题,本发明还可适用于多个遥控执行装置的场景中。该第三实施例仍以无人机的例子进行说明,但其体现的技术架构仍是一种通用的方式。Fig. 5 is a view showing an application scenario of the third embodiment. As shown in FIG. 5, the present invention is also applicable to scenes of a plurality of remote control executing devices based on the subject matter of the present invention. This third embodiment is still illustrated by the example of a drone, but the technical architecture embodied therein is still a general way.
参照图5所示,以两台无人机为例。现实的场景中很有可能使用两台或多台无人机来多角度地拍摄同一场面、人物或环境。此时,对多台无人机的拍摄装置同步的要求可能更加突出。Referring to Figure 5, two drones are taken as an example. In a realistic scene, it is possible to use two or more drones to shoot the same scene, person or environment from multiple angles. At this time, the requirements for synchronizing the cameras of multiple drones may be more prominent.
在该实施例中,第一无人机3和第二无人机3’协同配合进行拍摄,为了使两台无人机的相机进行同步启动,该实施例中,在其中一台无人机3上设置有成像控制器。与前一实施例不同的是,第一无人机3除了能与其本身的相机进行信息交互之外,还能与第二无人机的相机进行交互。在该实施例中,可以采用200米范围内无线通信的蓝牙通信方式。由此,当遥控器4发出一个同步启动的控制命令时,第一无人机的成像控制器向位于第一无人机3和第二无人机3’的相机同时发送分控命令,以使得两台无人机上的相机同步启动进行拍摄。具体的操作过程与前一实施例相同,在此不再赘述。In this embodiment, the first drone 3 and the second drone 3' cooperate to perform shooting. In order to synchronize the cameras of the two drones, in this embodiment, one of the drones An imaging controller is provided on the 3rd. Different from the previous embodiment, the first drone 3 can interact with the camera of the second drone in addition to information interaction with its own camera. In this embodiment, a Bluetooth communication method of wireless communication within a range of 200 meters can be employed. Thus, when the remote controller 4 issues a synchronous start control command, the imaging controller of the first drone simultaneously sends a sub-control command to the cameras located in the first drone 3 and the second drone 3' to The cameras on the two drones are synchronized to start shooting. The specific operation process is the same as that of the previous embodiment, and details are not described herein again.
该第三实施例中,仅在第一无人机3上设置成像控制器,但在其他实施方式中,也可以在其他无人机3上设置该成像控制器,或者在全部无人机上设置成像控制器,遥控器4可以选择性地将向某台无人机的成
像控制器发送同步执行的控制命令。In the third embodiment, the imaging controller is only provided on the first drone 3, but in other embodiments, the imaging controller may be provided on the other drones 3, or may be set on all the drones. An imaging controller, the remote controller 4 can selectively be turned into a drone
Like the controller sends a control command that is executed synchronously.
综合上述,本发明采用一个命令使至少两个执行机构同步执行例中相术的启动、拍照或者录像,这将节约用户交互成本。特别是在无人机等设备中,受通信链路抗干扰性等各方面,信号越少越优当然更好,在交互端只需要有一个执行按钮即可,并且用户一次动作便可通过同步拍摄照片和视频。In summary, the present invention employs a command to cause at least two actuators to simultaneously perform the startup, photographing or recording of the phase in the example, which will save user interaction costs. Especially in equipment such as drones, due to the anti-interference of communication links, etc., the fewer the signals, the better, of course, the better, only one execution button is needed at the interactive end, and the user can synchronize by one action. Take photos and videos.
根据本发明各实施例的上述方法、模块可以通过有计算能力的电子设备执行包含计算机指令的软件来实现。该系统可以包括存储设备,以实现上文所描述的各种存储。所述有计算能力的电子设备可以包含通用处理器、数字信号处理器、专用处理器、可重新配置处理器等能够执行计算机指令的装置,但不限于此。执行这样的指令使得电子设备被配置为执行根据本发明的上述各项操作。上述各方法和/或模块可以在一个电子设备中实现,也可以在不同电子设备中实现。The above method and module according to various embodiments of the present invention may be implemented by executing a computer-containing software by a computing-capable electronic device. The system can include storage devices to implement the various storages described above. The computing capable electronic device can include a general purpose processor, a digital signal processor, a dedicated processor, a reconfigurable processor, etc., but is not limited thereto. Executing such instructions causes the electronic device to be configured to perform the operations described above in accordance with the present invention. The above methods and/or modules may be implemented in one electronic device or in different electronic devices.
本发明的实施例使用软件的,软件可以存储为易失性存储器或非易失性存储装置的形式(比如类似ROM等存储设备),不论是可擦除的还是可重写的,或者存储为存储器的形式(例如RAM、存储器芯片、设备或集成电路),或者被存储在光可读介质或磁可读介质上(比如,CD、DVD、磁盘或磁带等等)。应该意识到,存储设备和存储介质是适于存储一个或多个程序的机器可读存储装置的实施例,所述一个程序或多个程序包括指令,当所述指令被执行时,实现本发明的实施例。此外,可以经由任何介质(比如,经由有线连接或无线连接携带的通信信号)来电传递这些程序,多个实施例适当地包括这些程序。Embodiments of the invention use software, which may be stored in the form of volatile memory or non-volatile storage (such as a storage device such as a ROM), whether erasable or rewritable, or stored as The form of the memory (eg, RAM, memory chip, device, or integrated circuit) is either stored on an optically readable medium or a magnetically readable medium (eg, CD, DVD, magnetic or tape, etc.). It should be appreciated that the storage device and the storage medium are embodiments of a machine-readable storage device adapted to store one or more programs, the program or programs comprising instructions that, when executed, implement the present invention An embodiment. Moreover, these programs can be routed via any medium, such as a communication signal carried via a wired connection or a wireless connection, and various embodiments suitably include such programs.
以上所述的具体实施例,对本发明的目的、技术方案和有益效果进行了进一步详细说明,应理解的是,以上所述仅为本发明的具体实施例而已,并不用于限制本发明,凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。
The specific embodiments of the present invention have been described in detail in the foregoing detailed description of the embodiments of the present invention. All modifications, equivalents, improvements, etc., made within the spirit and scope of the invention are intended to be included within the scope of the invention.
Claims (38)
- 一种遥控执行装置,包括主控模块和至少两个执行机构,所述主控模块用于从所述遥控执行装置的外部接收控制命令,其中:A remote control executing device includes a main control module and at least two executing mechanisms, wherein the main control module is configured to receive a control command from outside the remote control executing device, wherein:当所述控制命令用于指示至少两个执行机构同时执行特定动作时,所述主控模块对于该至少两个执行机构中的每个执行机构分别生成一个分控命令,以便控制该至少两个执行机构同时执行所述特定动作。When the control command is used to indicate that at least two executing mechanisms perform a specific action at the same time, the master control module generates a separate control command for each of the at least two executing mechanisms to control the at least two The actuator performs the specific action at the same time.
- 如权利要求1所述的遥控执行装置,其中:该生成的各个分控命令通过有线或者无线的方式传输给该至少两个执行机构。The remote control executing apparatus according to claim 1, wherein the generated respective sub-control commands are transmitted to the at least two actuators by wire or wirelessly.
- 如权利要求1所述的遥控执行装置,其中:The remote control execution device of claim 1 wherein:所述至少两个执行机构还用于将执行所述特定动作的执行状态信息反馈给所述主控模块。The at least two executing mechanisms are further configured to feed back execution state information of the specific action to the main control module.
- 如权利要求3所述的遥控执行装置,其中:The remote control executing device according to claim 3, wherein:所述主控模块还用于将所述至少两个执行机构反馈的所述执行状态信息直接向外部发送。The main control module is further configured to send the execution status information fed back by the at least two actuators directly to the outside.
- 如权利要求3所述的遥控执行装置,其中:The remote control executing device according to claim 3, wherein:当所述至少两个执行机构中的至少一个反馈的执行状态信息表示该执行机构执行所述特定动作失败时,所述主控模块对于所述至少两个执行机构中每一个重新分别生成分控命令,以便控制该至少两个执行机构重新同时执行所述特定动作。When the execution state information fed back by at least one of the at least two executing mechanisms indicates that the executing mechanism fails to perform the specific action, the main control module separately generates a sub-control for each of the at least two executing mechanisms a command to control the at least two actuators to perform the specific action simultaneously.
- 如权利要求5所述的遥控执行装置,其中:The remote control executing device according to claim 5, wherein:当所述至少两个执行机构连续重新同时执行所述特定动作的次数达到一个预定值时,所述主控模块停止生成分控命令,并将执行所述特定动作失败的信息向外部发送。When the number of times the at least two executing mechanisms continuously re-execute the specific action simultaneously reaches a predetermined value, the main control module stops generating a sub-control command and transmits information for performing the specific action failure to the outside.
- 如权利要求1至6中任一项所述的遥控执行装置,其中:至少一个执行机构为图像获取装置。The remote control execution device according to any one of claims 1 to 6, wherein the at least one actuator is an image acquisition device.
- 如权利要求7所述的遥控执行装置,其中:所述特定动作为启动图像获取装置的动作。The remote control execution device according to claim 7, wherein said specific action is an action of activating an image acquisition device.
- 如权利要求7所述的遥控执行装置,其中:所述遥控执行装置 为无人机。The remote control executing device according to claim 7, wherein: said remote control executing device For drones.
- 如权利要求9所述的遥控执行装置,其特征在于:所述图像获取装置安装在无人机的云台上,所述主控模块位于无人机的云台内。The remote control execution device according to claim 9, wherein the image acquisition device is installed on a pan/tilt of the drone, and the main control module is located in a gimbal of the drone.
- 一种遥控执行方法,包括:A remote control execution method includes:从外部接收控制命令;Receiving control commands from the outside;当所述控制命令用于指示至少两个执行机构同时执行特定动作时,对于该至少两个执行机构中的每个执行机构分别生成一个分控命令;When the control command is used to indicate that at least two executing mechanisms perform a specific action at the same time, a separate control command is generated for each of the at least two executing mechanisms;将所述分控命令分别发送到各执行机构,以使得该至少两个执行机构同时执行所述特定动作。The sub-control commands are separately sent to the respective executing mechanisms such that the at least two executing mechanisms simultaneously perform the specific actions.
- 如权利要求11所述的遥控执行方法,其中,该生成的各个分控命令通过有线或者无线的方式传输给该至少两个执行机构。The remote control execution method according to claim 11, wherein the generated respective sub-control commands are transmitted to the at least two actuators by wire or wirelessly.
- 如权利要求11所述的遥控执行方法,还包括:The remote control execution method of claim 11, further comprising:所述至少两个执行机构将执行所述特定动作的执行状态信息反馈给一个主控模块。The at least two actuators feed back execution state information of the specific action to a master module.
- 如权利要求13所述的遥控执行方法,还包括:The remote control execution method of claim 13, further comprising:所述主控模块将所述至少两个执行机构反馈的所述执行状态信息直接向外部发送。The main control module directly transmits the execution status information fed back by the at least two actuators to the outside.
- 如权利要求13所述的遥控执行方法,其中:The remote control execution method according to claim 13, wherein:当所述至少两个执行机构中的至少一个反馈的执行状态信息表示该执行机构执行所述特定动作失败时,对于所述至少两个执行机构中每一个重新分别生成分控命令,以便控制该至少两个执行机构重新同时执行所述特定动作。When the execution state information fed back by at least one of the at least two execution mechanisms indicates that the execution mechanism fails to perform the specific action, a separate control command is separately generated for each of the at least two execution mechanisms to control the At least two actuators re-execute the specific action simultaneously.
- 如权利要求15所述的遥控执行方法,其中:The remote control execution method according to claim 15, wherein:当所述至少两个执行机构连续重新同时执行所述特定动作的次数达到一个预定值时,停止生成分控命令,并将执行所述特定动作失败的信息向外部发送。When the number of times the at least two executing mechanisms continuously re-execute the specific action simultaneously reaches a predetermined value, the generation of the minute control command is stopped, and the information for performing the specific action failure is transmitted to the outside.
- 如权利要求11至16中任一项所述的遥控执行方法,其中:至少一个执行机构为图像获取装置。The remote control execution method according to any one of claims 11 to 16, wherein the at least one actuator is an image acquisition device.
- 如权利要求17所述的遥控执行方法,其中:所述特定动作为 启动图像获取装置的动作。The remote control execution method according to claim 17, wherein: said specific action is The action of the image acquisition device is activated.
- 一种遥控执行系统,包括遥控装置和遥控执行装置,该遥控装置能够发送控制所述遥控执行装置的至少两个遥控执行机构的控制命令,其中:A remote control execution system includes a remote control device and a remote control device capable of transmitting control commands for controlling at least two remote control actuators of the remote control device, wherein:所述遥控执行装置还包括主控模块,所述主控模块用于从所述遥控装置接收控制命令;The remote control executing device further includes a main control module, and the main control module is configured to receive a control command from the remote control device;当所述控制命令用于指示位于所述遥控执行装置的至少两个执行机构同时执行特定动作时,所述主控模块对于该至少两个执行机构中的每个执行机构分别生成一个分控命令,以便控制该至少两个执行机构同时执行所述特定动作。When the control command is used to indicate that at least two executing mechanisms located at the remote control executing device simultaneously perform a specific action, the main control module generates a separate control command for each of the at least two executing mechanisms In order to control the at least two actuators to perform the specific action simultaneously.
- 如权利要求19所述的遥控执行系统,其中:该生成的各个分控命令通过有线或者无线的方式传输给该至少两个执行机构。The remote control execution system of claim 19, wherein the generated respective sub-control commands are transmitted to the at least two actuators by wire or wirelessly.
- 如权利要求19所述的遥控执行系统,其中:The remote control execution system of claim 19 wherein:所述至少两个执行机构还用于将执行所述特定动作的执行状态信息反馈给所述主控模块。The at least two executing mechanisms are further configured to feed back execution state information of the specific action to the main control module.
- 如权利要求21所述的遥控执行系统,其中:The remote control execution system of claim 21 wherein:所述主控模块还用于将所述至少两个执行机构反馈的所述执行状态信息直接向所述遥控装置发送。The main control module is further configured to send the execution status information fed back by the at least two actuators directly to the remote control device.
- 如权利要求21所述的遥控执行系统,其中:The remote control execution system of claim 21 wherein:当所述至少两个执行机构中的至少一个反馈的执行状态信息表示该执行机构执行所述特定动作失败时,所述主控模块对于所述至少两个执行机构中每一个重新分别生成分控命令,以便控制该至少两个执行机构重新同时执行所述特定动作。When the execution state information fed back by at least one of the at least two executing mechanisms indicates that the executing mechanism fails to perform the specific action, the main control module separately generates a sub-control for each of the at least two executing mechanisms a command to control the at least two actuators to perform the specific action simultaneously.
- 如权利要求23所述的遥控执行系统,其中:The remote control execution system of claim 23 wherein:当所述至少两个执行机构连续重新同时执行所述特定动作的次数达到一个预定值时,所述主控模块停止生成分控命令,并将执行所述特定动作失败的信息向所述遥控装置发送。When the number of times the at least two actuators continuously re-execute the specific action simultaneously reaches a predetermined value, the main control module stops generating a sub-control command, and sends information for performing the specific action failure to the remote control device. send.
- 如权利要求19至24中任一项所述的遥控执行系统,其中:所述至少两个执行机构均为图像获取装置。 A remote control execution system according to any one of claims 19 to 24, wherein said at least two actuators are image acquisition means.
- 如权利要求25所述的遥控执行系统,其中:所述特定动作为启动图像获取装置的动作。The remote control execution system according to claim 25, wherein said specific action is an action of activating an image acquisition device.
- 权利要求25所述的遥控执行系统,其中:所述遥控执行装置是无人机。The remote control execution system of claim 25 wherein: said remote control device is a drone.
- 如权利要求27所述的遥控执行系统,其中:所述图像获取装置安装在无人机的云台上,所述主控模块位于无人机的云台内。A remote control execution system according to claim 27, wherein said image acquisition means is mounted on a head of the drone, and said main control module is located in the head of the drone.
- 一种遥控执行系统,包括一个遥控装置和至少一个遥控执行装置,该遥控装置能够发送控制所述至少两个遥控执行机构的控制命令,其中:A remote control execution system includes a remote control device and at least one remote control device capable of transmitting control commands for controlling the at least two remote control actuators, wherein:所述遥控执行装置包括主控模块和至少一个执行机构,所述主控模块用于从所述遥控装置接收控制命令;The remote control executing device includes a main control module and at least one executing mechanism, and the main control module is configured to receive a control command from the remote control device;当所述控制命令用于指示位于同一遥控执行装置或不同遥控执行装置的至少两个执行机构同时执行特定动作时,其中一个遥控执行装置的主控模块对于该至少两个执行机构中的每个执行机构分别生成一个分控命令,以便控制该至少两个执行机构同时执行所述特定动作。When the control command is used to indicate that at least two actuators located at the same remote control executing device or different remote control executing devices simultaneously perform a specific action, the master control module of one of the remote control executing devices is for each of the at least two executing mechanisms The executing agency generates a separate control command to control the at least two executing mechanisms to simultaneously perform the specific action.
- 如权利要求29所述的遥控执行系统,其中:该生成的各个分控命令通过有线或者无线的方式传输给该至少两个执行机构。The remote control execution system of claim 29, wherein the generated respective sub-control commands are transmitted to the at least two actuators by wire or wirelessly.
- 如权利要求29所述的遥控执行系统,其中:The remote control execution system of claim 29 wherein:所述至少两个执行机构还用于将执行所述特定动作的执行状态信息反馈给所述生成分控命令的主控模块。The at least two executing mechanisms are further configured to feed back execution state information of performing the specific action to the main control module that generates the sub-control command.
- 如权利要求31所述的遥控执行系统,其中:A remote control execution system according to claim 31, wherein:所述生成分控命令的主控模块还用于将所述至少两个执行机构反馈的所述执行状态信息直接向所述遥控装置发送。The main control module for generating the sub-control command is further configured to send the execution status information fed back by the at least two executing mechanisms directly to the remote control device.
- 如权利要求31所述的遥控执行系统,其中:A remote control execution system according to claim 31, wherein:当所述至少两个执行机构中的至少一个反馈的执行状态信息表示该执行机构执行所述特定动作失败时,所述生成分控命令的主控模块对于所述至少两个执行机构中每一个重新分别生成分控命令,以便控制该至少两个执行机构重新同时执行所述特定动作。When the execution state information fed back by at least one of the at least two execution mechanisms indicates that the execution mechanism fails to execute the specific action, the master control module that generates the minute control command is for each of the at least two execution mechanisms The sub-control commands are separately generated to control the at least two actuators to perform the specific actions simultaneously.
- 如权利要求33所述的遥控执行系统,其中: A remote control execution system according to claim 33, wherein:当所述至少两个执行机构连续重新同时执行所述特定动作的次数达到一个预定值时,所述生成分控命令的主控模块停止生成分控命令,并将执行所述特定动作失败的信息向所述遥控装置发送。When the number of times the at least two executing mechanisms continuously re-execute the specific action simultaneously reaches a predetermined value, the main control module that generates the sub-control command stops generating the sub-control command, and performs information that the specific action fails. Sended to the remote control device.
- 如权利要求29至34中任一项所述的遥控执行系统,其中:所述至少两个执行机构均为图像获取装置。The remote control execution system according to any one of claims 29 to 34, wherein the at least two actuators are image acquisition devices.
- 如权利要求35所述的遥控执行系统,其中:所述特定动作为启动图像获取装置的动作。The remote control execution system according to claim 35, wherein said specific action is an action of activating an image acquisition device.
- 权利要求35所述的遥控执行系统,其中:所述遥控执行装置是无人机。A remote control execution system according to claim 35, wherein said remote control executing means is a drone.
- 如权利要求37所述的遥控执行系统,其中:所述图像获取装置安装在无人机的云台上,所述主控模块位于无人机的云台内。 A remote control execution system according to claim 37, wherein said image acquisition means is mounted on a head of the drone, and said main control module is located in the head of the drone.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201680002263.3A CN106797436B (en) | 2016-09-05 | 2016-09-05 | Remote control execution device, method and system |
PCT/CN2016/098052 WO2018040092A1 (en) | 2016-09-05 | 2016-09-05 | Remote execution device, method, and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2016/098052 WO2018040092A1 (en) | 2016-09-05 | 2016-09-05 | Remote execution device, method, and system |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018040092A1 true WO2018040092A1 (en) | 2018-03-08 |
Family
ID=58952975
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2016/098052 WO2018040092A1 (en) | 2016-09-05 | 2016-09-05 | Remote execution device, method, and system |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN106797436B (en) |
WO (1) | WO2018040092A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113873169A (en) * | 2019-01-30 | 2021-12-31 | 深圳市大疆创新科技有限公司 | Load control method and device |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN208580498U (en) * | 2018-05-31 | 2019-03-05 | 深圳市大疆创新科技有限公司 | Infrared emission angle adjustment structure, infrared transmission module and remote control device |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005265983A (en) * | 2004-03-16 | 2005-09-29 | Tac Project:Kk | Synchronous release and method for photographing picture |
CN201707777U (en) * | 2010-04-16 | 2011-01-12 | 陈伟坤 | Grouping remote control device |
CN103149788A (en) * | 2013-03-22 | 2013-06-12 | 天津曙光敬业科技有限公司 | Air 360-degree distant view photograph shooting device and method |
CN103453891A (en) * | 2013-09-06 | 2013-12-18 | 中测新图(北京)遥感技术有限责任公司 | Airborne multi-look three-dimensional aerial remote sensing device and system of light small-sized unmanned aerial vehicle |
CN205123880U (en) * | 2015-12-07 | 2016-03-30 | 北京即刻叁全视觉科技有限公司 | Shoot device in step based on wireless control |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105530433A (en) * | 2016-01-28 | 2016-04-27 | 北京金久瑞科技有限公司 | Image capturing synchronization control device of multi-camera system |
-
2016
- 2016-09-05 WO PCT/CN2016/098052 patent/WO2018040092A1/en active Application Filing
- 2016-09-05 CN CN201680002263.3A patent/CN106797436B/en not_active Expired - Fee Related
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005265983A (en) * | 2004-03-16 | 2005-09-29 | Tac Project:Kk | Synchronous release and method for photographing picture |
CN201707777U (en) * | 2010-04-16 | 2011-01-12 | 陈伟坤 | Grouping remote control device |
CN103149788A (en) * | 2013-03-22 | 2013-06-12 | 天津曙光敬业科技有限公司 | Air 360-degree distant view photograph shooting device and method |
CN103453891A (en) * | 2013-09-06 | 2013-12-18 | 中测新图(北京)遥感技术有限责任公司 | Airborne multi-look three-dimensional aerial remote sensing device and system of light small-sized unmanned aerial vehicle |
CN205123880U (en) * | 2015-12-07 | 2016-03-30 | 北京即刻叁全视觉科技有限公司 | Shoot device in step based on wireless control |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113873169A (en) * | 2019-01-30 | 2021-12-31 | 深圳市大疆创新科技有限公司 | Load control method and device |
Also Published As
Publication number | Publication date |
---|---|
CN106797436A (en) | 2017-05-31 |
CN106797436B (en) | 2019-12-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10582107B2 (en) | System and method for bullet-time photography | |
US11924538B2 (en) | Target tracking method and apparatus and unmanned aerial vehicle | |
WO2019127137A1 (en) | Method for switching operating mode of gimbal, and controller and image stability augmentation device | |
US9253389B2 (en) | Image pickup apparatus, image pickup system, image pickup method and computer readable recording medium implementing synchronization for image pickup operations | |
US20120307071A1 (en) | Monitoring camera system | |
JP2011054170A (en) | System and method for effectively utilizing recorder device | |
WO2019061159A1 (en) | Method and device for locating faulty photovoltaic panel, and unmanned aerial vehicle | |
JP2019087791A (en) | Information processing apparatus, information processing method, and program | |
WO2019061295A1 (en) | Video processing method and device, unmanned aerial vehicle and system | |
WO2018232688A1 (en) | Method for controlling photography device, photography device, and system | |
WO2019023846A1 (en) | Data conversion and capture control method, system, cradle head assembly, and unmanned aerial vehicle system | |
WO2018040092A1 (en) | Remote execution device, method, and system | |
US11575832B2 (en) | Imaging device, camera-mounted drone, mode control method, and program | |
WO2017206036A1 (en) | Movable apparatus and control method and device thereof, control terminal and photographing apparatus | |
WO2017181930A1 (en) | Method and device for displaying flight direction, and unmanned aerial vehicle | |
CN108989605A (en) | A kind of image capturing and transmitting system and method | |
TW201635250A (en) | Indoor monitoring system and method thereof | |
CN107872558B (en) | Intelligent electronic equipment, image processing unit, image acquisition device and image acquisition method | |
JP2012063575A (en) | Digital camera | |
JP5721485B2 (en) | Communication system and control method thereof | |
KR102308347B1 (en) | Synchronization device for camera and synchronization method for camera | |
JP2010258894A (en) | Video receiving apparatus, method of receiving video, and program | |
CN107079109B (en) | Camera shutter control method, apparatus and system | |
JP4270961B2 (en) | Digital camera | |
WO2021207943A1 (en) | Projection display method and system based on multiple photographic apparatuses, and terminal and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16914658 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16914658 Country of ref document: EP Kind code of ref document: A1 |