WO2020103680A1 - 一种数据通信方法及人机交互系统 - Google Patents
一种数据通信方法及人机交互系统Info
- Publication number
- WO2020103680A1 WO2020103680A1 PCT/CN2019/115261 CN2019115261W WO2020103680A1 WO 2020103680 A1 WO2020103680 A1 WO 2020103680A1 CN 2019115261 W CN2019115261 W CN 2019115261W WO 2020103680 A1 WO2020103680 A1 WO 2020103680A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- robot
- communication method
- terminal device
- intelligent terminal
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/06—Notations for structuring of protocol data, e.g. abstract syntax notation one [ASN.1]
Definitions
- the invention relates to the technical field of robot control, in particular to a data communication method and a human-computer interaction system.
- AGV Auto Guided Vehicle (Guided Vehicle)
- An excellent robot system can greatly improve work efficiency, which is of great significance and has received extensive attention.
- the human-computer interaction interface of the traditional robot uses a remote control handle or a control button, which is less intuitive for the user, is not easy to control and use, and has a poor operation control experience.
- the robot main control device and the intelligent terminal device do not support two-way data transmission, so that the user cannot control the robot through the more convenient intelligent terminal device.
- the object of the present invention is to provide a data communication method and a human-computer interaction system, aiming to solve the problems of inconvenient robot-computer interaction and insufficient intuitive control in the prior art.
- a human-computer interaction system wherein the system includes: an intelligent terminal device for interacting with a user; a robot main control device for controlling the operation of one or more robots, Connect with the smart terminal device via USB;
- AOA Agent Open Accessory
- the uplink data from the smart terminal device and the downlink data from the robot main control device are encapsulated in a preset protocol format and transmitted on the data transmission path
- a data communication method applied to the robot main control device includes: when establishing a USB connection with an intelligent terminal device, switching the USB state to the AOA mode; collecting the state information of the robot; encapsulating the state information in a preset protocol format to form corresponding upstream data; through AOA The data path sends the uplink data to the intelligent terminal device.
- the method further includes: receiving downlink data from the smart terminal device; parsing the downlink data according to the preset protocol format; and performing an operation corresponding to the analysis result of the downlink data.
- switching the USB state to the AOA mode includes: polling and refreshing the USB state after the robot main control device is started; determining whether the USB state is the AOA mode; if If not, switch to AOA mode.
- collecting the state information of the robot specifically includes: monitoring whether the running state of the robot has changed: if so, acquiring corresponding state information.
- a data communication method applied to intelligent terminal equipment includes: acquiring the operation information to be sent; encapsulating the operation information to be sent in a preset protocol format to form downlink data; and through the AOA data path to the robot connected to the smart terminal device via USB The main control device sends the downlink data.
- the method further includes: receiving uplink data from the robot main control device; parsing the uplink data according to the preset protocol format; and performing an action corresponding to the analysis result of the uplink data.
- the act corresponding to the analysis result of the uplink data specifically includes: updating a user interaction interface according to the analysis result of the uplink data.
- the obtaining operation information to be transmitted specifically includes: obtaining a task list through an external data collection device; the task list contains a number of operation information pointing to the robot.
- the preset protocol format defines that the data packet is composed of a data header and data content; the data header includes three fields of the current data packet type, length, and check code, and the data content is used to encapsulate the real Data information.
- the data communication method and human-computer interaction system establish a two-way data transmission path between an intelligent mobile terminal and a main control device by switching to the AOA mode, and encapsulate it in combination with a preset protocol format of upstream data and downstream data , So that users can easily use smart mobile terminals to interact with AGV, the control is intuitive and visible, easy to use, and has good application prospects.
- FIG. 1 is a schematic diagram of a human-computer interaction system provided by an embodiment of the present invention.
- Figure 2 is a schematic diagram of a protocol format provided by an embodiment of the present invention.
- FIG. 3 is a method flowchart of a data communication method provided by an embodiment of the present invention.
- FIG. 1 is a schematic diagram of a human-computer interaction system provided by an embodiment of the present invention.
- the human-computer interaction system can be applied in the interaction scene between the robot and the intelligent mobile terminal.
- the human-computer interaction system may include: an intelligent terminal device 10 and a robot main control device 20.
- the intelligent terminal device 10 and the robot main control device 20 are connected via USB.
- the smart terminal device 10 may be any type of smart portable device for interacting with a user, including but not limited to a smart phone, tablet computer, PDA, or laptop computer. These smart portable devices can run a corresponding operating system and have a very rich input / output device, such as a touch screen, etc., which can provide users with a very intuitive interactive interface and interaction mode, and the user interaction experience is better. Take the computer as an example.
- the robot master control device is the control core of the robot, and is responsible for performing logic operations and device control, and is used to control the operation of one or more automatic transportation devices.
- automated transportation equipment means an AGV or an automated equipment or robot that has similar functions as the AGV and is used to realize the transportation of goods.
- the robot can use any suitable walking mechanism, such as bionic feet or wheels, and can automatically transport the load to its destination.
- the smart terminal device uses the Android system as the main device side (that is, the Host side), and only has the OTG (On-The-Go) interface.
- the robot master control device is the slave device side (ie Device side).
- the existing USB protocol does not support the robot main control device to send data to the tablet computer, and the intelligent terminal device cannot recognize the robot main control device.
- the USB state of the robot main control device can be switched to the AOA mode through a drive module additionally provided in the robot main control device.
- the robot master control device is converted into the master device side, and the intelligent terminal device is converted into the slave device side, thereby realizing a bidirectional data transmission path.
- FIG. 2 is a schematic diagram of a protocol format provided by an embodiment of the present invention. As shown in FIG. 2, the preset protocol format definition data packet is composed of a data header 31 and data content 32.
- the length of the data header is constant, including three fields of the current data packet type, length and check code.
- the data content is used to encapsulate real data information and represents the real payload of the data packet. Its length will change accordingly according to the content of the data, such as transmitting a certain picture data or character string.
- the check code is used to check the accuracy of data packet transmission, which can improve the reliability of information transmission.
- the following verification method may be used to verify the data packet: first sum the values of all fields, and then use the low-order byte value as a verification code to be used at the receiving and sending ends of the data packet Check the data accuracy of the data packet.
- the robot control device when users need to interact with the robot, for example, when setting up a goods list, they can use a tablet or similar smart terminal device to operate on the interactive interface provided by the smart terminal device to list the goods to be picked After being encapsulated and packaged in a preset protocol format, the data is sent to the robot control device.
- the robot master control device After receiving the delivered data packet, the robot master control device uses the same protocol format for analysis, and then controls the robot or AGV to move to the corresponding container to complete the picking according to the analysis result.
- FIG. 3 is a data communication process of the human-computer interaction system shown in FIG. 1, which can be described at both ends of the robot main control device and the intelligent terminal, respectively.
- the data communication method may include the following steps:
- the step S20 may specifically include the following steps:
- step S203 Determine whether the USB state is the AOA mode. If not, step S42 is executed.
- AOA Android Open Accessory
- AOA is a protocol for USB communication between Android devices and peripheral devices. The agreement expands the functions of the USB interface of Android devices, and provides conditions for the application of smart devices based on Android systems in the field of data collection and device control.
- the state information refers to information related to the current movement state of the robot, such as different states such as starting movement, moving in progress, and reaching the destination.
- the robot main control device may keep monitoring the robot to determine whether a state change has occurred. And when the state changes, the corresponding state information is obtained.
- S22 Encapsulate the status information in a preset protocol format to form corresponding uplink data.
- the method further includes:
- the operation may be of any type, pointing to instructions for the robot to run, such as controlling robot movement or querying the robot's hardware status.
- the data communication method may include the following steps:
- the intelligent terminal device may specifically obtain a task list through an external data collection device.
- the task list contains a number of operation information pointing to the automatic transportation equipment, such as instructions for planning robot movements, order of picking, etc.
- the intelligent terminal device may run a corresponding APP client, and the operation information is encapsulated in a preset protocol format through the APP client.
- the method may further include processing the uplink data.
- the process includes:
- the corresponding behavior may be any type of user interaction behavior.
- it may be to update the user interaction interface of the APP client, or the feedback information of the robot or other user interaction behaviors.
- the data communication method and human-computer interaction system establish a two-way data transmission path between an intelligent mobile terminal and a main control device by switching to the AOA mode, and encapsulate it in combination with a preset protocol format of upstream data and downstream data , So that users can easily use intelligent mobile terminals to interact with the robot's main control device, the control is intuitive and visible, easy to use, and has good application prospects.
Abstract
Description
Claims (10)
- 一种人机交互系统,包括:智能终端设备,设置为与用户交互;机器人主控设备,设置为控制一个或者多个机器人的运行,与所述智能终端设备通过USB连接;在AOA模式下所述机器人主控设备转换为主设备端,所述智能终端设备转换为从设备端,形成双向的数据传输通路;来自所述智能终端设备的上行数据和来自所述机器人主控设备的下行数据以预设的协议格式封装并在所述数据传输通路上传输。
- 一种数据通信方法,应用于机器人主控设备,包括:在与智能终端设备建立USB连接时,将USB状态切换为AOA模式;采集机器人的状态信息;以预设的协议格式封装所述状态信息以形成对应的上行数据;通过AOA数据通路,发送所述上行数据至所述智能终端设备。
- 根据权利要求2所述的数据通信方法,其中,所述方法还包括:接收来自所述智能终端设备的下行数据;根据所述预设的协议格式,解析所述下行数据;执行与所述下行数据的解析结果对应的操作。
- 根据权利要求2所述的数据通信方法,其中,所述在与智能终端设备建立USB连接时,将USB状态切换为AOA模式,包括:在机器人主控设备启动后,轮询并刷新USB状态;判断所述USB状态是否为AOA模式;若否,则切换到AOA模式。
- 根据权利要求2所述的数据通信方法,其中,所述采集机器人的状态信息,具体包括:监听所述机器人是否发生运行状态变化:若是,获取对应的状态信息。
- 一种数据通信方法,应用于智能终端设备,其中,所述方法包括:获取待发送的操作信息;以预设的协议格式封装所述待发送的操作信息,形成下行数据;通过AOA数据通路,向与所述智能终端设备通过USB连接的机器人主控设备发送所述下行数据。
- 根据权利要求6所述的数据通信方法,其中,所述方法还包括:接收来自所述机器人主控设备的上行数据;根据所述预设的协议格式,解析所述上行数据;执行与所述上行数据的解析结果对应的行为。
- 根据权利要求6所述的数据通信方法,其中,所述执行与所述上行数据的解析结果对应的行为,具体包括:根据所述上行数据的解析结果更新用户交互界面。
- 根据权利要求5所述的数据通信方法,其中,所述获取待发送的操作信息,具体包括:通过外界数据采集装置,获取任务清单;所述任务清单包含若干指向所述机器人的操作信息。
- 根据权利要求2-9任一所述的数据通信方法,其中,所述预设的协议格式定义数据包由数据头部和数据内容组成;所述数据头包括当前数据包的类型、长度以及校验码三个字段,所述数据内容用于封装真实的数据信息。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2020526980A JP6932852B2 (ja) | 2018-11-19 | 2019-11-04 | データ通信方法及びヒューマンコンピュータインタラクションシステム |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811371590.3 | 2018-11-19 | ||
CN201811371590.3A CN109150926A (zh) | 2018-11-19 | 2018-11-19 | 一种数据通信方法及人机交互系统 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020103680A1 true WO2020103680A1 (zh) | 2020-05-28 |
Family
ID=64806133
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/115261 WO2020103680A1 (zh) | 2018-11-19 | 2019-11-04 | 一种数据通信方法及人机交互系统 |
Country Status (3)
Country | Link |
---|---|
JP (1) | JP6932852B2 (zh) |
CN (1) | CN109150926A (zh) |
WO (1) | WO2020103680A1 (zh) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109150926A (zh) * | 2018-11-19 | 2019-01-04 | 炬星科技(深圳)有限公司 | 一种数据通信方法及人机交互系统 |
CN115412613B (zh) * | 2021-05-26 | 2023-11-24 | 博泰车联网科技(上海)股份有限公司 | 管理交通工具的后装设备的方法、计算机存储介质 |
CN114244821B (zh) * | 2021-12-16 | 2023-03-14 | 北京百度网讯科技有限公司 | 数据处理方法、装置、设备、电子设备和存储介质 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106549840A (zh) * | 2016-12-09 | 2017-03-29 | 滕敏 | 数据交互系统、方法及装置 |
US20170255458A1 (en) * | 2016-03-07 | 2017-09-07 | Luxrobo | Module system, module based robot system, and update method for module system |
CN107803845A (zh) * | 2017-09-29 | 2018-03-16 | 纳博特南京科技有限公司 | 一种工业机器人的示教方法及系统 |
CN108491344A (zh) * | 2018-03-14 | 2018-09-04 | 广东美的制冷设备有限公司 | 机器人控制管理方法、系统、机器人和计算机存储介质 |
CN109150926A (zh) * | 2018-11-19 | 2019-01-04 | 炬星科技(深圳)有限公司 | 一种数据通信方法及人机交互系统 |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9518821B2 (en) * | 2012-08-02 | 2016-12-13 | Benjamin Malay | Vehicle control system |
JP6167490B2 (ja) * | 2012-09-04 | 2017-07-26 | 富士通株式会社 | 情報処理装置,端末装置,及び制御プログラム |
CN104572564B (zh) * | 2015-01-13 | 2018-04-20 | 上海动联信息技术股份有限公司 | 一种实现android移动设备与USB OTG主机通讯的方法 |
KR102239572B1 (ko) * | 2015-01-27 | 2021-04-13 | 삼성전자주식회사 | 전자 장치들 간 양방향 데이터 통신 방법 및 장치 |
CN107926075B (zh) * | 2015-08-14 | 2021-12-17 | 深圳市大疆创新科技有限公司 | 支持异构环境下的数据通信的系统和方法 |
KR101856930B1 (ko) * | 2016-08-29 | 2018-05-11 | 현대자동차주식회사 | 유에스비 액세서리의 유에스비 통신 제어 방법 |
CN106844275A (zh) * | 2016-12-30 | 2017-06-13 | 百度在线网络技术(北京)有限公司 | 数据传输方法及装置 |
CN107483696B (zh) * | 2017-07-12 | 2019-11-22 | 武汉卡比特信息有限公司 | 一种手机与计算机类设备的通信方法及系统 |
-
2018
- 2018-11-19 CN CN201811371590.3A patent/CN109150926A/zh active Pending
-
2019
- 2019-11-04 JP JP2020526980A patent/JP6932852B2/ja active Active
- 2019-11-04 WO PCT/CN2019/115261 patent/WO2020103680A1/zh active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170255458A1 (en) * | 2016-03-07 | 2017-09-07 | Luxrobo | Module system, module based robot system, and update method for module system |
CN106549840A (zh) * | 2016-12-09 | 2017-03-29 | 滕敏 | 数据交互系统、方法及装置 |
CN107803845A (zh) * | 2017-09-29 | 2018-03-16 | 纳博特南京科技有限公司 | 一种工业机器人的示教方法及系统 |
CN108491344A (zh) * | 2018-03-14 | 2018-09-04 | 广东美的制冷设备有限公司 | 机器人控制管理方法、系统、机器人和计算机存储介质 |
CN109150926A (zh) * | 2018-11-19 | 2019-01-04 | 炬星科技(深圳)有限公司 | 一种数据通信方法及人机交互系统 |
Also Published As
Publication number | Publication date |
---|---|
JP6932852B2 (ja) | 2021-09-08 |
CN109150926A (zh) | 2019-01-04 |
JP2021508190A (ja) | 2021-02-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020103680A1 (zh) | 一种数据通信方法及人机交互系统 | |
US20170193702A1 (en) | Head-mounted display device and method for interaction between head-mounted display device and intelligent terminal | |
CN103167338A (zh) | 一种基于移动终端的智能电视输入控制系统及方法 | |
CN104954476A (zh) | App平衡车控制装置及远程网络控制系统 | |
CN108924806A (zh) | 一种采用ble技术的家庭物联网数据通信方法及系统 | |
CN107071551A (zh) | 应用于智能电视系统中的多屏互动屏幕响应方法 | |
CN110784533A (zh) | 通信方法、通信装置、中转模块、控制终端及存储介质 | |
CN103607658A (zh) | 利用移动终端向智能电视应用软件输入字符的方法 | |
AU2015101900A4 (en) | System and method for embedded operating system achieving bluetooth slave device function | |
WO2015188529A1 (zh) | 一种嵌入式监控设备的管理方法及系统 | |
CN204819528U (zh) | 基于web的远程控制机器人 | |
CN104735510B (zh) | 一种机顶盒控制方法、装置及系统 | |
CN103376975A (zh) | 一种控制方法及装置、移动通信终端 | |
CN101834894A (zh) | 远程处理方法、装置及系统 | |
CN102710877A (zh) | 移动终端的外部控制方法、移动终端及系统 | |
CN102855112A (zh) | 用于屏幕控制的装置 | |
Ma et al. | Networked robot systems for indoor service enhanced via ROS middleware | |
TW201319821A (zh) | 應用於至少二部人機介面裝置主機之間之無線傳輸方法、系統及其無線傳輸轉換裝置 | |
US9146889B2 (en) | Method and device for sending and receiving data | |
CN109712380A (zh) | 寻找遥控设备的方法及装置、存储介质、终端设备、遥控设备 | |
CN102223610B (zh) | 在移动设备间进行数据交换的方法及移动设备 | |
WO2012055237A1 (zh) | 智能空调系统及智能空调控制方法 | |
CN112185096A (zh) | 语音遥控方法、装置、电子设备和存储介质 | |
CN104616480A (zh) | 基于nfc的红外遥控设置方法及系统 | |
CN104536672A (zh) | 一种智能终端多媒体辅助装置及其辅助输入输出的方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2020526980 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19886139 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19886139 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 29/09/2021) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19886139 Country of ref document: EP Kind code of ref document: A1 |