CN1233514C - Internet control system for remotely controlling robots to play chess - Google Patents

Internet control system for remotely controlling robots to play chess Download PDF

Info

Publication number
CN1233514C
CN1233514C CN 03119499 CN03119499A CN1233514C CN 1233514 C CN1233514 C CN 1233514C CN 03119499 CN03119499 CN 03119499 CN 03119499 A CN03119499 A CN 03119499A CN 1233514 C CN1233514 C CN 1233514C
Authority
CN
China
Prior art keywords
game
robot
client
server
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 03119499
Other languages
Chinese (zh)
Other versions
CN1440856A (en
Inventor
刘景泰
安刚
徐为民
赵新
张蕾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nankai University
Original Assignee
Nankai University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nankai University filed Critical Nankai University
Priority to CN 03119499 priority Critical patent/CN1233514C/en
Publication of CN1440856A publication Critical patent/CN1440856A/en
Application granted granted Critical
Publication of CN1233514C publication Critical patent/CN1233514C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Manipulator (AREA)

Abstract

本发明涉及遥操作机器人对弈的控制,尤其是基于国际互联网上的遥操作机器人对弈控制系统。通常采用的传输媒体主要有专线网络、局域网、无线网络和国际互联网等。由于网络传输具有时延性,会使机器人控制系统不稳定,为此,本发明提出如下技术方案:基于国际互联网,采用独特的系统构建方式(构建在通用工业总线上的分布式分级实时控制)和对弈机构,多主方式,并采用了非破坏性总线裁决机制,从客户端软件实现方式上包括两种对弈模式:网络通用界面和在本地进行。利用鼠标键盘和游戏操纵杆完成对弈操作。有益效果:将不同类型的机器人操作手进行组合和任务分配,系统运行状态可远程监控,控制方法和对弈策略可以实时变更,对弈结果可及时评估。

Figure 03119499

The invention relates to the control of remote-operated robot games, in particular to the remote-operated robot game control system based on the Internet. The commonly used transmission media mainly include dedicated line network, local area network, wireless network and Internet. Because the network transmission has time delay, it will make the robot control system unstable. For this reason, the present invention proposes the following technical solutions: based on the Internet, a unique system construction method (distributed hierarchical real-time control built on a general industrial bus) and The game organization adopts a multi-master mode, and adopts a non-destructive bus arbitration mechanism. From the client software implementation method, it includes two game modes: a general network interface and a local game. Use the mouse keyboard and game joystick to complete the game operation. Beneficial effects: different types of robot operators can be combined and assigned tasks, the operating status of the system can be monitored remotely, the control method and game strategy can be changed in real time, and the game results can be evaluated in time.

Figure 03119499

Description

国际互联网的网上遥操作机器人对弈的控制系统The Control System of Teleoperation Robot Game on Internet

技术领域technical field

本发明涉及遥操作机器人对弈的控制系统,尤其是一种基于国际互联网的网上遥操作机器人对弈的控制系统,属于机器人技术领域。The invention relates to a control system for remote-operated robot games, in particular to a control system for online remote-operated robot games based on the Internet, belonging to the technical field of robots.

背景技术Background technique

由于应用环境的复杂化和作业任务需求的推动,基于网络环境的遥操作机器人技术的发展和应用方兴未艾。一般地,机器人遥操作通常采用的传输媒体主要有专线网络、局域网、无线网络和国际互联网等。执行的主要作业任务包括主从操作、定位装配、双臂协调作业等,其应用领域主要包括远程装配、远程探险、远程医疗和远程服务等。由于网络传输具有时延性,这种时延是时变的,不可建模的,而且随着网络和通讯环境的不同而变化,特别严重的情况是基于国际互联网的机器人遥操作。网络的时延会使机器人控制系统不稳定,给机器人遥操作系统的实时控制带来困难。目前学术研究领域正在尝试使用各种控制方法和控制手段,解决基于国际互联网的遥操作机器人控制中的问题,并且开发出了各种不同的机器人实验装置和控制系统。主要包括如下几类:第一,基于传统控制方法和通讯手段改进的遥操作控制系统,主要解决遥操作系统中的时延、轨迹规划等问题等,如,滑模控制、阻抗控制方法以及基于“推”(PUSH)的通讯技术、基于CORBA的分布式结构等;另一类是基于任务的机器人遥操作控制系统,这类系统采用监督控制模式,将监督指令作为任务执行,避免了网络时延或网络通讯中断带来的系统不稳定,如基于Petri网的遥操作控制系统等;第三类是采用各种传感器和虚拟现实技术辅助控制,补偿网络时延带来的影响,完成各种遥操作任务,如基于视觉传感的遥操作系统等。此外,还有基于不同计算机通讯技术的遥操作控制系统,其出发点是补偿和降低网络延迟的影响。以上系统一般都采用各种改进的控制手段或方法,解决机器人遥操作的基本作业问题,如远程装配、双臂协调等。Due to the complexity of the application environment and the promotion of task requirements, the development and application of teleoperation robot technology based on the network environment is in the ascendant. In general, the transmission media commonly used in robot teleoperation mainly include dedicated line network, local area network, wireless network and Internet. The main tasks performed include master-slave operation, positioning assembly, double-arm coordination operation, etc. Its application fields mainly include remote assembly, remote exploration, telemedicine and remote service. Due to the delay in network transmission, this delay is time-varying and cannot be modeled, and it changes with different network and communication environments. The particularly serious situation is the remote operation of robots based on the Internet. The time delay of the network will make the robot control system unstable and bring difficulties to the real-time control of the robot teleoperation system. At present, the academic research field is trying to use various control methods and means to solve the problems in the Internet-based teleoperation robot control, and has developed various robot experimental devices and control systems. It mainly includes the following categories: First, the improved teleoperation control system based on traditional control methods and communication means mainly solves problems such as time delay and trajectory planning in the teleoperation system, such as sliding mode control, impedance control method and based on "PUSH" communication technology, CORBA-based distributed structure, etc.; the other type is task-based robot teleoperation control system, which adopts the supervisory control mode and executes supervisory instructions as tasks, avoiding System instability caused by delay or interruption of network communication, such as the remote operation control system based on Petri net; Teleoperation tasks, such as teleoperation systems based on vision sensing, etc. In addition, there are teleoperation control systems based on different computer communication technologies, whose starting point is to compensate and reduce the impact of network delay. The above systems generally use various improved control means or methods to solve the basic operation problems of robot teleoperation, such as remote assembly, dual-arm coordination, etc.

基于国际互联网的机器人遥操作系统存在着传输时延性,这种时延严重地影响着机器人实时控制系统的稳定性,甚至使控制失败,因此,目前大部分的遥操作机器人系统的主要工作是采用各种实时控制或补偿方法,解决这个问题并完成一些基于国际互联网的基本遥操作任务,如远程定位安装、远程焊接和双臂协调等作业。The robot teleoperation system based on the Internet has transmission delay, which seriously affects the stability of the real-time control system of the robot, and even makes the control fail. Therefore, the main work of most teleoperation robot systems at present is to use Various real-time control or compensation methods can solve this problem and complete some basic Internet-based teleoperation tasks, such as remote positioning installation, remote welding, and dual-arm coordination.

发明内容Contents of the invention

为了解决现有机器人遥操作系统存在着传输时延以及远程定位安装、远程焊接和双臂协调等作业等问题,本发明提出如下技术方案:我们所发明的基于国际互联网的网上对弈机器人系统,采用了独特的系统构建方式和对弈机构,机器人对弈控制系统是构建在通用工业总线上的分布式分级实时控制系统。这种总线可以采用控制器局域网(CAN)总线、外部设备互联总线(PCI)总线或过程现场总线(PROFIBUS-DP)等,由于它们具有较强的纠错能力,支持差分收发,因而适合高噪声环境,并具有较远的传输距离(直接通讯距离最远可达10km以上),可以实现多主方式工作,总线节点信息(节点数最多可达100个以上)可分成不同的优先级,并采用了非破坏性总线裁决机制,能够满足分布式分级机器人对弈系统的控制要求。遥操作对弈系统从客户端实现方式上包括两种对弈模式:一种是基于网络web通用界面的对弈方式(游览器/服务器B/S);另一种是通过专用的客户端在本地进行对弈客户/服务器(C/S)。并运用了先进的控制方法、辅助视觉传感技术和三维仿真技术,完成复杂的、带有竞争性和策略性的机器人操作手的远程实时对弈任务。三维图形仿真系统可以工作在两个模式之下:在线模式和离线模式。对弈者基于网络环境在客户机(10)(12)上,利用鼠标键盘和游戏操纵杆完成对弈操作,同时通过客户机上的实时仿真环境辅助进行对弈操作,并通过对弈现场电荷耦合器件(CCD)摄像机(5)传来的视频信息形象化地了解对弈结果。In order to solve the problems of transmission time delay, remote positioning and installation, remote welding and double-arm coordination in the existing robot teleoperation system, the present invention proposes the following technical solutions: the Internet-based online game robot system invented by us uses With a unique system construction method and game mechanism, the robot game control system is a distributed hierarchical real-time control system built on a general industrial bus. This kind of bus can adopt Controller Area Network (CAN) bus, Peripheral Device Interconnection Bus (PCI) bus or Process Field Bus (PROFIBUS-DP), etc., because they have strong error correction ability and support differential transmission and reception, they are suitable for high noise environment, and has a long transmission distance (the direct communication distance can reach more than 10km), and it can work in multi-master mode. The bus node information (the number of nodes can reach more than 100) can be divided into different priorities, and adopt A non-destructive bus arbitration mechanism is proposed, which can meet the control requirements of the distributed hierarchical robot game system. The remote operation game system includes two game modes from the client side: one is the game mode based on the general web interface (browser/server B/S); the other is to play games locally through a dedicated client Client/Server (C/S). And it uses advanced control methods, auxiliary visual sensing technology and three-dimensional simulation technology to complete complex, competitive and strategic remote real-time game tasks of robot operators. The 3D graphics simulation system can work in two modes: online mode and offline mode. Players use the mouse, keyboard and joystick to complete the game operation on the client computer (10) (12) based on the network environment. The video information sent by the camera (5) visualizes the game result.

本发明的有益效果:相较于现存的机器人遥操作系统,新技术的优越性及技术效果表现在:采用了一种新颖的机器手分布式分级控制方式,基于国际互联网,将不同类型的、六自由度工业机器人操作手进行组合和任务分配,同时,引入了一个可配置的对弈机构作为任务平台,使得整个机器人系统具有9+9+7+1个自由度;系统采用了先进的控制方法、辅助视觉传感技术和仿真技术;系统运行状态可远程监控,控制方法和对弈策略可以实时变更,对弈结果可以及时评估;该系统可以提供多种更加复杂的协调作业任务环境,用以研究或开发遥操作系统的控制应用。Beneficial effects of the present invention: Compared with the existing robot remote operating system, the superiority and technical effect of the new technology are manifested in: a novel distributed hierarchical control method for manipulators is adopted, and based on the Internet, different types, Six-degree-of-freedom industrial robot operators combine and assign tasks. At the same time, a configurable game mechanism is introduced as a task platform, so that the entire robot system has 9+9+7+1 degrees of freedom; the system adopts advanced control methods , Auxiliary visual sensing technology and simulation technology; the operating status of the system can be monitored remotely, the control method and game strategy can be changed in real time, and the game results can be evaluated in time; the system can provide a variety of more complex coordination task environments for research or Develop control applications for teleoperation systems.

附图说明Description of drawings

图1:网上对弈机器人系统体系结构示意图Figure 1: Schematic diagram of the online game robot system architecture

图2:控制系统控制流程图Figure 2: Control system control flow chart

图中in the picture

1.监督仲裁机器手  2.对弈机器手  3.工业总线  4.对弈环境  5.电荷耦合器件(CCD)摄像机(其中安装在“1”上的为主动电荷耦合器件)摄像机,另一个为全局电荷耦合器件摄像机)  6.机器人控制器  7.图像服务器  8.机器人服务器  9.网络WEB服务器  10.本地对弈客户机  11.国际互联网网  12.远程对弈客户机1. Supervision and arbitration robot 2. Game robot 3. Industrial bus 4. Game environment 5. Charge-coupled device (CCD) camera (the one installed on "1" is an active charge-coupled device) camera, and the other is a global charge Coupling device camera) 6. Robot controller 7. Image server 8. Robot server 9. Network WEB server 10. Local game client 11. Internet 12. Remote game client

具体实施方式Detailed ways

下面结合附图对本发明的体系结构、组成和控制系统及其工作过程说明如下:Below in conjunction with accompanying drawing, system structure, composition and control system and working process thereof of the present invention are described as follows:

遥操作对弈系统由12个部分组成:监督仲裁机器手1、对弈机器手2两个工业总线3、对弈环境4、电荷耦合器件摄像机5、机器人控制器6、图像服务器7、机器人服务器8、网络(WEB)服务器9、本地对弈客户机10、国际互联网网11提供远程对弈访问的网络、它与web服务器9和远程对弈客户机12连接。The remote operation game system consists of 12 parts: supervision and arbitration robot hand 1, game robot hand 2, two industrial buses 3, game environment 4, charge-coupled device camera 5, robot controller 6, image server 7, robot server 8, network (WEB) server 9, local game client 10, Internet 11 provide the network of remote game access, and it is connected with web server 9 and remote game client 12.

监督仲裁机器手1,安装有电荷耦合器件摄像头,它与机器人控制器6连接,是一种六自由度工业机器手,用于对对弈情况的变化主动进行监视;The supervision and arbitration robot hand 1 is equipped with a charge-coupled device camera, which is connected to the robot controller 6, and is a six-degree-of-freedom industrial robot hand, which is used to actively monitor changes in the game situation;

对弈机器手(2两个),它与机器人控制器6连接,是一种六自由度工业机器手,其末端装有柔性对弈器具,用于进行对弈操作,两个对弈机器手2根据对弈客户机10或12的指令,在对弈环境上完成对弈活动,并以各自最终得到的分值来决定输赢,在对弈过程中,两台对弈机器手2可以采用不同的避碰策略(相应的对弈规则也不相同),避碰策略和对弈规则在对弈系统初始化时进行选择;Playing chess robot hands (2 two), it is connected with robot controller 6, is a kind of industrial robot hand with six degrees of freedom, and its end is equipped with flexible playing chess utensil, is used for playing chess operation, two playing chess robot hands 2 according to playing chess client Instructions from machine 10 or 12, complete the game game in the game environment, and determine the winner or loser with their final scores. During the game game, the two game robot hands 2 can adopt different collision avoidance strategies (corresponding game rules are not the same), the collision avoidance strategy and game rules are selected when the game system is initialized;

工业总线3,是一种通用工业总线,它连接机器人服务器8、图像服务器7、web服务器、本地对弈客户机10,作为本地网络控制的环境,用于提供网络控制环境支持;对弈环境4,它与工业总线连接,是一种由步进电机驱动的带有圆盘的机械装置,用于提供对弈环境,包括一个划分了区域并带有标识的可旋转的圆盘,圆盘上可以覆盖标纸,由一个伺服电机驱动,通过调节速度可以改变难度和对弈等级,另外,通过变换圆盘上的标纸和对弈规则,可以改变对弈模式;Industrial bus 3, is a kind of general industrial bus, it connects robot server 8, image server 7, web server, local game client 10, as the environment of local network control, is used to provide network control environment support; Game environment 4, it Connected with the industrial bus, it is a mechanical device with a disc driven by a stepping motor, which is used to provide a game environment, including a rotatable disc that divides the area and has a logo, and the logo can be covered on the disc. The paper is driven by a servo motor, and the difficulty and game level can be changed by adjusting the speed. In addition, the game mode can be changed by changing the marked paper on the disc and the game rules;

CCD摄像机5,它与图像服务器7连接,是一种通用工业CCD摄像头,用于进行图像采集,由两台CCD摄像机组成对弈机器人系统的视觉监视系统,可以使对弈客户机10、12完成对对弈环境全景的视频监视,同时将CCD信息与仿真信息结合,给对弈客户机10、12提供三维实时仿真图形;CCD camera 5, it is connected with image server 7, is a kind of general industry CCD camera, is used for carrying out image collection, forms the visual monitoring system of playing chess robot system by two CCD cameras, can make playing chess client 10,12 finish playing chess The video monitoring of the environment panorama, at the same time, combines the CCD information with the simulation information to provide three-dimensional real-time simulation graphics for the game client 10, 12;

机器人控制器6,它与机器手和工业总线连接,是由机器手控制板卡组成的控制器,用来实现对六自由度对弈机器手的控制;Robot controller 6, which is connected with the robot hand and the industrial bus, is a controller composed of robot hand control boards, and is used to realize the control of the six-degree-of-freedom game robot hand;

图像服务器7,它与摄像头和工业总线连接,是由图像采集卡和计算机组成的服务器,对CCD摄像机采集的图像进行处理并根据用户的请求进行发送,在基于网络的机器人对弈遥操作中,用户10、或12通过网络接收机器人现场的传感器和图像等信息,发送控制命令,操纵机器人完成工作任务,客户端的三维图形仿真系统能生成机器人和对弈环境模型,根据接收的传感器数据,改变机器人关节的位置和姿态,渲染三维动画;遥操作用户可以利用鼠标、键盘或游戏杆等交互工具,向机器人发送操作命令,控制机器人运动;采用三维图形仿真,通过网络传送的少量传感器数据,实时仿真机器人对弈环境;Image server 7, which is connected with camera and industrial bus, is a server made up of image acquisition card and computer, processes the image collected by CCD camera and sends it according to user's request, in the remote operation of robot game based on network, user 10, or 12 Receive information such as sensors and images on the robot site through the network, send control commands, and manipulate the robot to complete work tasks. The 3D graphics simulation system on the client side can generate a model of the robot and the game environment, and change the joints of the robot according to the received sensor data. Position and posture, rendering 3D animation; remote operation users can use interactive tools such as mouse, keyboard or joystick to send operation commands to the robot to control the movement of the robot; use 3D graphics simulation, a small amount of sensor data transmitted through the network, real-time simulation robot game environment;

机器人服务器8,它与工业总线连接,是由计算机及相应的软件系统组成的服务器,用于提供机器手的对弈策略和指令,负责对弈机器人轨迹的生成和优化,它将对弈客户机10、12的策略指令变换为适当的机器人轨迹,并将经过优化后的轨迹传送到机器人控制器6,根据对弈情况的变化和图像服务器7传来的信息,通过机器人控制器6来调整监督仲裁机器手1的姿态和位置,控制对弈机器人2执行相应的动作出了使其末端安装的主动CCD摄像机能够得到最完整的对弈画面,负责监督和管理整个对弈过程。The robot server 8, which is connected with the industrial bus, is a server made up of computers and corresponding software systems, which is used to provide the game strategy and instructions of the robotic hand, and is responsible for the generation and optimization of the trajectory of the game robot. It will play the game client 10,12 Transform the strategy instructions into appropriate robot trajectories, and send the optimized trajectories to the robot controller 6. According to the changes in the game situation and the information from the image server 7, the robot controller 6 adjusts the supervision and arbitration robot hand 1 Control the game robot 2 to perform corresponding actions so that the active CCD camera installed at the end can obtain the most complete picture of the game, and is responsible for supervising and managing the entire game process.

WEB服务器9,它与工业总线和国际互联网网连接,用来提供远程客户的登录和访问管理;WEB server 9, which is connected with the industrial bus and the Internet, is used to provide remote client login and access management;

本地对弈客户机10,是进行本地对弈的客户端,它与工业总线连是带有对弈系统的客户机,用于本地对弈操作;The local game client 10 is a client for local games, and it is connected with the industrial bus to be a client with a game system for local game operations;

国际互联网网11,用于提供远程对弈访问,提供远程对弈访问的网络,它与web服务器9和远程对弈客户机12连接;The Internet 11 is used to provide remote game access, a network that provides remote game access, and it is connected with web server 9 and remote game client 12;

远程对弈客户机12带有浏览器的远程客户端,用于进行远程对弈操作,它与国际互联网连接。The remote game client machine 12 has a remote client with a browser, which is used to carry out remote game operations, and it is connected with the Internet.

从客户端软件实现方式上包括两种对弈模式:一种是基于web通用界面的对弈模式(浏览器/服务器);另一种是通过专用的客户端在本地进行对弈的模式(客户/服务器)。前者利用国际互联网浏览器工具,采用超文本传输协议(HTTP协议)等来访问WEB服务器。操作者登陆WEB站点,通过浏览器提供的界面来操纵机器人完成某种任务。后者主要基于传输控制协议(TCP)协议,实现自己的应用层协议功能。系统提供了两种对弈模式,对实时交互控制要求高或数据传输量较大的用户提供专用的客户端软件,采用客户/服务器(C/S)软件模式工作,这需要用户在第一次使用时安装客户端程序。对一般的用户提供开放的web站点,用户可以用浏览器(IE)或浏览器(Netscape)访问该站点,一旦用户顺利连接到WEB服务器,通过身份认证得到访问权限,就可以控制机器人完成遥操作对弈任务。There are two game modes in terms of client software implementation: one is the game mode based on the web general interface (browser/server); the other is the mode of playing games locally through a dedicated client (client/server) . The former utilizes the Internet browser tool to access the WEB server by using the hypertext transfer protocol (HTTP protocol). The operator logs on to the WEB site and manipulates the robot to complete certain tasks through the interface provided by the browser. The latter is mainly based on the Transmission Control Protocol (TCP) protocol to realize its own application layer protocol functions. The system provides two game modes, and provides dedicated client software for users with high requirements for real-time interactive control or large data transmission, and adopts the client/server (C/S) software mode to work, which requires users to use it for the first time. When installing the client program. Provide an open web site for general users. Users can access the site with a browser (IE) or a browser (Netscape). Once the user successfully connects to the WEB server and obtains access rights through identity authentication, the robot can be controlled to complete remote operations. Game task.

三维图形仿真系统可以工作在两个模式之下:在线模式和离线模式。The 3D graphics simulation system can work in two modes: online mode and offline mode.

在线模式下,通过网络获取机器人关节角度值和力传感器值并存储到数据文件中;利用得到关节值完成对下一帧画面中机器人和导轨的位置和姿态的设定,然后重新渲染三维图形;力传感器值送给游戏杆,利用DirectInput等方法模拟虚拟力。根据机器人现场的工作状况,灵活变换视角来观测仿真场景,同时可以发送控制命令。In online mode, obtain the robot joint angle value and force sensor value through the network and store them in the data file; use the obtained joint value to complete the setting of the position and attitude of the robot and guide rail in the next frame, and then re-render the 3D graphics; The force sensor value is sent to the joystick, and the virtual force is simulated by methods such as DirectInput. According to the working conditions of the robot on site, the viewing angle can be flexibly changed to observe the simulation scene, and control commands can be sent at the same time.

在离线模式下,可根据轨迹规划算法,计算生成机器人关节值序列,用各个关节值的变化量作参数绘制关节值曲线图,当确定变化量属于正常范围后,可以把关节序列作为输入,在系统中完成对机器人和导轨的三维图形仿真。In offline mode, the robot joint value sequence can be calculated and generated according to the trajectory planning algorithm, and the joint value curve can be drawn using the variation of each joint value as a parameter. When the variation is determined to be within the normal range, the joint sequence can be used as input. The system completes the three-dimensional graphics simulation of the robot and the guide rail.

在线模式主要用于在遥操作中现场机器人运动的图形仿真,离线模式主要用于检验机器人轨迹规划算法,进行数据的分析测试。对弈控制系统的控制,包括以下步骤:The online mode is mainly used for graphic simulation of the on-site robot movement in teleoperation, and the offline mode is mainly used for testing the robot trajectory planning algorithm and performing data analysis and testing. The control of the game control system includes the following steps:

(1)先运行服务器端程序,等待客户端的连接请求(1) Run the server-side program first, and wait for the connection request from the client

(2)客户端连接服务器端,请求对弈机器人的控制权(2) The client connects to the server and requests control of the playing robot

(3)机器人服务器根据当前情况,决定是否给予客户端控制权限(3) The robot server decides whether to give the client control authority according to the current situation

(4)两个客户端都取得机器人控制权限后,对弈开始(4) After both clients have obtained the robot control authority, the game starts

(5)各客户端根据服务器端所提供的机器人及周边环境信息进行判断,发出各种机器人对弈命令(5) Each client makes a judgment based on the robot and surrounding environment information provided by the server, and issues various robot game commands

(6)机器人服务器接收客户端命令,对机器人进行相应控制,并对对弈进展情况、对弈客户端得分等情况进行记录,而后,告知客户端。(6) The robot server receives the command from the client, controls the robot accordingly, records the progress of the game, the score of the client, etc., and then informs the client.

的记录、控制等工作也将结束。Recording, control and other work will also end.

实施例Example

本发明在南开大学机器人与信息自动化系统研究所智能机器人网点开放实验室得到了实施。该对弈系统由一台PUMA562六自由度工业机器手和两台RH6六自由度工业机器手为主体按三角形进行固定(见图),同时在两台RH6的中间安装了一个速度可调的旋转平台作为对弈平台,平台上划分了不同的区间,每个区间赋予不同的分值。其中PUMA562机器手末端安装一台CCD摄像机作为对弈环境的视觉监督反馈,在旋转对弈平台正上方安装另一台全局电荷耦合器件CCD摄像机作为机器手位置辅助反馈。该系统还包括一个可配置的集成控制平台[由一个控制服务器(PC机)和三个机器人控制器(模块化专用控制器)组成]和一个图像服务器(PC机)。通过集成控制平台,可以利用鼠标、键盘和操纵杆对机器手进行远程对弈操作,还可以对机器手控制系统设置控制方式、控制参数和对弈策略,进行在线控制。利用图像服务器可以对对弈操作的效果进行实时仿真研究,也可以辅助进行对弈操作。在两台RH6对弈机器手末端分别装有带被动柔性机构的不同颜色的笔,在对弈中,两个机器手分别在各自操作者的控制下,对对弈平台上的网格进行标点,实际操作的效果可以通过视频传输结果观察,并利用三维实时图形仿真系统校正对弈机器手的操作精度。最后,以双方在规定时间内所取得的分值作为评判胜负的依据。The invention has been implemented in the open laboratory of intelligent robot outlets of the Robot and Information Automation System Research Institute of Nankai University. The game system is composed of a PUMA562 six-degree-of-freedom industrial robot and two RH6 six-degree-of-freedom industrial robots, which are fixed in a triangle (see figure), and a speed-adjustable rotating platform is installed in the middle of the two RH6 As a game platform, the platform is divided into different intervals, and each interval is assigned a different score. Among them, a CCD camera is installed at the end of the PUMA562 robot hand as the visual supervision feedback of the game environment, and another global charge-coupled device CCD camera is installed directly above the rotating game platform as the auxiliary feedback of the robot hand position. The system also includes a configurable integrated control platform [composed of a control server (PC) and three robot controllers (modular dedicated controllers)] and an image server (PC). Through the integrated control platform, it is possible to use the mouse, keyboard and joystick to perform remote gaming operations on the robotic hand, and it is also possible to set the control mode, control parameters, and game strategy for the robotic hand control system for online control. The image server can be used to carry out real-time simulation research on the effect of the game operation, and can also assist in the game operation. Pens of different colors with passive flexible mechanisms are installed at the ends of the two RH6 game robot hands. During the game, the two robot hands punctuate the grid on the game platform under the control of their respective operators. The actual operation The effect of the game can be observed through the video transmission results, and the operation accuracy of the playing robot hand can be corrected by using the three-dimensional real-time graphics simulation system. Finally, the score obtained by the two sides within the specified time is used as the basis for judging the outcome.

Claims (6)

1、一种国际互联网的网上遥操作机器人对弈的控制系统,其特征在于:机器人对弈控制系统是构建在通用工业总线(3)上的分布式分级实时控制系统,可以实现多主方式工作,总线节点信息分成不同的优先级,并采用了非破坏性总线裁决机制,它包括:1. A control system for teleoperating robot games on the Internet, characterized in that: the robot game control system is a distributed hierarchical real-time control system built on a general industrial bus (3), which can realize multi-master mode work, and the bus Node information is divided into different priorities, and a non-destructive bus arbitration mechanism is adopted, which includes: 监督仲裁机器手(1)安装有电荷耦合器件摄像头,所述监督仲裁机器手(1)与机器人控制器(6)连接;The supervision and arbitration robot (1) is equipped with a charge-coupled device camera, and the supervision and arbitration robot (1) is connected to the robot controller (6); 对弈机器手(2)两个,它与机器人控制器(6)连接;There are two playing robot hands (2), which are connected with the robot controller (6); 工业总线(3)它连接机器人服务器(8)、图像服务器(7)、网络服务器、本地对弈客户机(10);Industrial bus (3) it connects robot server (8), image server (7), network server, local game client (10); 对弈环境(4)它与工业总线连接(3);Game environment (4) it is connected with industrial bus (3); 电荷耦合器件摄像机(5)它与图像服务器(7)连接;Charge-coupled device camera (5) it is connected with image server (7); 机器人控制器(6)它与机器手和工业总线连接;Robot controller (6) it is connected with manipulator and industrial bus; 图像服务器(7)它与摄像头和工业总线连接;Image server (7) it is connected with camera and industrial bus; 机器人服务器(8)它与工业总线连接;Robot server (8) it is connected with industrial bus; 网络服务器(9)它与工业总线和国际互联网连接;Network server (9) it is connected with industrial bus and Internet; 本地对弈客户机(10)是进行本地对弈的客户端,它与工业总线连接;Local game client (10) is the client that carries out local game, and it is connected with industrial bus; 国际互联网(11)提供远程对弈访问的网络,它与网络服务器(9)和远程对弈客户机(12)连接;The Internet (11) provides a network for remote game access, which is connected with the web server (9) and the remote game client (12); 远程对弈客户机(12)用于进行远程对弈的客户端,它与国际互联网连接。Remote game client (12) is used for the client of remote game, and it is connected with Internet. 2、根据权利要求1所述的基于国际互联网的网上遥操作机器人对弈的控制系统,其特征在于所述的:2. The Internet-based online teleoperation robot game control system according to claim 1, characterized in that: 监督仲裁机器手(1)是一种六自由度工业机器手,用于对对弈情况的变化主动进行监视;The supervision and arbitration robot (1) is a six-degree-of-freedom industrial robot, which is used to actively monitor changes in the game situation; 对弈机器手(2)是一种六自由度工业机器手,其末端装有柔性对弈器具,用于进行对弈操作,两个对弈机器手(2)根据本地客户机(10)或远程对弈客户机(12)的指令,在对弈环境上完成对弈活动,并以各自最终得到的分值来决定输赢;The playing robot hand (2) is a six-degree-of-freedom industrial robot hand, and its end is equipped with flexible playing equipment for playing chess. (12) to complete the game game in the game environment, and determine the winner or loser based on the final score obtained by each player; 工业总线(3)是一种通用工业总线,作为本地网络控制的环境,用于提供网络控制环境支持;The industrial bus (3) is a general industrial bus used as a local network control environment to provide network control environment support; 对弈环境(4)是一种由步进电机驱动的带有圆盘的机械装置,用于提供对弈环境,包括一个划分了区域并带有标识的可旋转的圆盘,圆盘上可以覆盖标纸,由一个伺服电机驱动,通过调节速度可以改变难度和对弈等级,另外,通过变换圆盘上的标纸和对弈规则,可以改变对弈模式;The playing environment (4) is a mechanical device with a disk driven by a stepping motor, which is used to provide a playing environment, including a rotatable disk that is divided into areas and has a logo, and the logo can be covered on the disk. The paper is driven by a servo motor, and the difficulty and game level can be changed by adjusting the speed. In addition, the game mode can be changed by changing the marked paper on the disc and the game rules; 电荷耦合器件摄像机(5)是一种通用工业电荷耦合器件摄像头,用于进行图像采集,由两台电荷耦合器件摄像机组成对弈机器人系统的视觉监视系统,可以使对弈客户机(10)(12)完成对对弈环境全景的视频监视,同时将电荷耦合器件摄像头采集的信息与仿真信息结合,给对弈客户机(10)(12)提供三维实时仿真图形;The charge-coupled device camera (5) is a general-purpose industrial charge-coupled device camera for image acquisition. The visual monitoring system of the game robot system is composed of two charge-coupled device cameras, which can make the game client (10) (12) Complete the video monitoring of the panoramic view of the playing environment, and combine the information collected by the charge-coupled device camera with the simulation information to provide three-dimensional real-time simulation graphics for the playing client (10) (12); 机器人控制器(6)是由机器手控制板卡组成的控制器,用来实现对六自由度对弈机器手的控制;The robot controller (6) is a controller composed of a robot hand control board, which is used to realize the control of the six-degree-of-freedom game robot hand; 图像服务器(7)是由图像采集卡和计算机组成的服务器,对电荷耦合器件摄像头采集的图像进行处理并根据用户的请求进行发送,在基于网络的机器人对弈遥操作中,用户(10)或(12)通过网络接收机器人现场的传感器和图像等信息,发送控制命令,操纵机器人完成工作任务,客户端的三维图形仿真系统能生成机器人和对弈环境模型,根据接收的传感器数据,改变机器人关节的位置和姿态,渲染三维动画;遥操作用户可以利用鼠标、键盘或游戏杆等交互工具,向机器人发送操作命令,控制机器人运动;采用三维图形仿真,通过网络传送的少量传感器数据,实时仿真机器人对弈环境;The image server (7) is a server composed of an image acquisition card and a computer, which processes the image collected by the charge-coupled device camera and sends it according to the user's request. In the remote operation of the robot game based on the network, the user (10) or ( 12) Receive information such as sensors and images on the robot site through the network, send control commands, and manipulate the robot to complete work tasks. The 3D graphics simulation system on the client side can generate a model of the robot and the game environment, and change the position and position of the robot's joints according to the received sensor data. Gesture, rendering 3D animation; remote operation users can use interactive tools such as mouse, keyboard or joystick to send operation commands to the robot to control the movement of the robot; use 3D graphics simulation, a small amount of sensor data transmitted through the network, real-time simulation robot game environment; 机器人服务器(8)是由计算机及相应的软件系统组成的服务器,用于提供机器手的对弈策略和指令,它将对弈客户机(10)、(12)的策略指令变换为适当的机器人轨迹,并将经过优化后的轨迹传送到机器人控制(6),来控制对弈机器人(2)执行相应的动作;Robot server (8) is the server that is made up of computer and corresponding software system, is used to provide the game strategy and instruction of robot hand, it changes the strategy instruction of game client (10), (12) into appropriate robot track, And transmit the optimized trajectory to the robot control (6) to control the playing robot (2) to perform corresponding actions; 网络服务器(9)用来提供远程客户的登录和访问管理;The web server (9) is used to provide remote client login and access management; 本地对弈客户机(10)是带有对弈系统的客户机,用于本地对弈操作;The local game client (10) is a client with a game system for local game operations; 国际互联网(11)用于提供远程对弈访问;The Internet (11) is used to provide remote game access; 远程对弈客户机(12)带有浏览器的远程客户端,用于进行远程对弈操作。The remote game client (12) is a remote client with a browser, which is used for remote game operations. 3、根据权利要求1所述的基于国际互联网的网上遥操作机器人对弈的控制系统,其特征在于:所述的工业总线(3)是采用控制器局域网总线、外部设备互联总线或过程现场总线。3. The Internet-based online teleoperation robot game control system according to claim 1, characterized in that: the industrial bus (3) is a controller local area network bus, an external device interconnection bus or a process field bus. 4、根据权利要求2所述的基于国际互联网的网上遥操作机器人对弈的控制系统,其特征在于:所述的三维图形仿真系统可以工作在两个模式之下,在线模式和离线模式。在线模式用于在遥操作中现场机器人运动的图形仿真,离线模式主要用于检验机器人轨迹规划算法,进行数据的分析测试。4. The Internet-based online teleoperation robot game control system according to claim 2, characterized in that: said three-dimensional graphic simulation system can work in two modes, online mode and offline mode. The online mode is used for the graphic simulation of the on-site robot movement in teleoperation, and the offline mode is mainly used for testing the robot trajectory planning algorithm and analyzing and testing the data. 5、一种基于国际互联网的网上遥操作机器人对弈的控制系统的控制方法,其特征在于:5. A control method for a control system of an Internet-based remote operation robot game, characterized in that: 机器人对弈控制系统是构建在通用工业总线(3)上的分布式分级实时控制系统,可以实现多主方式工作,总线节点信息分成不同的优先级,并采用了非破坏性总线裁决机制,它包括:The robot game control system is a distributed hierarchical real-time control system built on a general industrial bus (3). It can work in a multi-master mode. The bus node information is divided into different priorities, and a non-destructive bus arbitration mechanism is adopted. It includes : 监督仲裁机器手(1)安装有电荷耦合器件摄像头,所述监督仲裁机器手(1)与机器人控制器(6)连接;The supervision and arbitration robot (1) is equipped with a charge-coupled device camera, and the supervision and arbitration robot (1) is connected to the robot controller (6); 对弈机器手(2)两个,它与机器人控制器(6)连接;There are two playing robot hands (2), which are connected with the robot controller (6); 工业总线(3)它连接机器人服务器(8)、图像服务器(7)、网络服务器、本地对弈客户机(10);Industrial bus (3) it connects robot server (8), image server (7), network server, local game client (10); 对弈环境(4)它与工业总线连接(3);Game environment (4) it is connected with industrial bus (3); 电荷耦合器件摄像机(5)它与图像服务器(7)连接;Charge-coupled device camera (5) it is connected with image server (7); 机器人控制器(6)它与机器手和工业总线连接;Robot controller (6) it is connected with manipulator and industrial bus; 图像服务器(7)它与摄像头和工业总线连接;Image server (7) it is connected with camera and industrial bus; 机器人服务器(8)它与工业总线连接;Robot server (8) it is connected with industrial bus; 网络服务器(9)它与工业总线和国际互联网连接;Network server (9) it is connected with industrial bus and Internet; 本地对弈客户机(10)是进行本地对弈的客户端,它与工业总线连接;Local game client (10) is the client that carries out local game, and it is connected with industrial bus; 国际互联网(11)提供远程对弈访问的网络,它与网络服务器(9)和远程对弈客户机(12)连接;The Internet (11) provides a network for remote game access, which is connected with the web server (9) and the remote game client (12); 远程对弈客户机(12)用于进行远程对弈的客户端,它与国际互联网连接;Remote game client (12) is used to carry out the client of remote game, and it is connected with Internet; 对弈者基于网络环境在客户机(10)(12)上,利用鼠标键盘和游戏操纵杆完成对弈操作,同时通过客户机上的实时仿真环境辅助进行对弈操作,并通过对弈现场电荷耦合器件摄像机(5)传来的视频信息形象化地了解对弈结果,它包括以下控制步骤:Players based on the network environment on the client (10) (12), use the mouse keyboard and game joystick to complete the game operation, while assisting the game operation through the real-time simulation environment on the client computer, and through the live charge-coupled device camera (5 ) to understand the result of the game visually through the video information transmitted, and it includes the following control steps: (1)先运行服务器端程序,等待客户端的连接请求(1) Run the server-side program first, and wait for the connection request from the client (2)客户端连接服务器端,请求对弈机器人的控制权(2) The client connects to the server and requests control of the playing robot (3)机器人服务器根据当前情况,决定是否给予客户端控制权限(3) The robot server decides whether to give the client control authority according to the current situation (4)两个客户端都取得机器人控制权限后,对弈开始(4) After both clients have obtained the robot control authority, the game starts (5)各客户端根据服务器端所提供的机器人及周边环境信息进行判断,发出各种机器人对弈命令(5) Each client makes a judgment based on the robot and surrounding environment information provided by the server, and issues various robot game commands (6)机器人服务器接收客户端命令,对机器人进行相应控制,并对对弈进展情况、对弈客户端得分等情况进行记录,而后,告知客户端。(6) The robot server receives the command from the client, controls the robot accordingly, records the progress of the game, the score of the client, etc., and then informs the client. (7)对弈结束时,对弈客户端交还对机器人的控制权,此时,机器人服务器对该次对弈的记录、控制等工作也将结束。(7) At the end of the game, the game client returns the control right to the robot. At this time, the recording and control of the game by the robot server will also end. 6、根据权利要求1或3所述的基于INTERNET的网上遥操作机器人对弈的控制系统,其特征在于所述的两种对弈模式是:一种是基于网络通用界面的对弈方式;另一种是通过专用的客户端在本地进行对弈,前者利用国际互联网浏览器工具,采用超文本传输协议协议,来访问网络服务器;后者主要基于传输控制协议协议,实现自己的应用层协议功能。系统提供的两种对弈模式,分别采用客户/服务器软件模式工作,这需要用户在第一次使用时安装客户端软件,对一般的用户提供开放的网络站点,用户可以用网络浏览器访问该站点,一旦用户顺利连接到网络服务器,通过身份认证得到访问权限,就可以控制机器人完成遥操作对弈任务。6. The Internet-based remote operation robot game control system according to claim 1 or 3, characterized in that the two game modes are: one is a game mode based on a general network interface; the other is The game is played locally through a dedicated client. The former uses the Internet browser tool and the Hypertext Transfer Protocol protocol to access the network server; the latter is mainly based on the Transmission Control Protocol protocol to realize its own application layer protocol functions. The two game modes provided by the system work in the client/server software mode respectively, which requires the user to install the client software when using it for the first time, and provides an open network site for general users, and users can visit the site with a web browser , once the user successfully connects to the network server and obtains access rights through identity authentication, he can control the robot to complete the teleoperation game task.
CN 03119499 2003-03-14 2003-03-14 Internet control system for remotely controlling robots to play chess Expired - Fee Related CN1233514C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 03119499 CN1233514C (en) 2003-03-14 2003-03-14 Internet control system for remotely controlling robots to play chess

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 03119499 CN1233514C (en) 2003-03-14 2003-03-14 Internet control system for remotely controlling robots to play chess

Publications (2)

Publication Number Publication Date
CN1440856A CN1440856A (en) 2003-09-10
CN1233514C true CN1233514C (en) 2005-12-28

Family

ID=27770465

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 03119499 Expired - Fee Related CN1233514C (en) 2003-03-14 2003-03-14 Internet control system for remotely controlling robots to play chess

Country Status (1)

Country Link
CN (1) CN1233514C (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1835582B (en) * 2005-03-18 2010-04-21 北京富星创业科技发展有限公司 Inquiry commanding and special supervision management system and its working method
CN101436061B (en) * 2008-12-12 2010-08-25 南开大学 Competing type network robot chess-playing system
CN101794349B (en) * 2010-02-09 2012-08-29 北京邮电大学 Experimental system and method for augmented reality of teleoperation of robot
CN102957732A (en) * 2011-08-31 2013-03-06 德信互动科技(北京)有限公司 Man-machine interaction system and method
WO2013150596A1 (en) * 2012-04-02 2013-10-10 株式会社安川電機 Robot system and work facility
CN103389650B (en) * 2013-08-08 2016-01-06 西华大学 The bilateral unknown dead zone adaptive control system of four-way remote control system
CN105138754A (en) * 2015-05-13 2015-12-09 西北工业大学 Design method of variable-structure controller for double teleoperation with feature of time-varying delay
CN105965507B (en) * 2016-05-16 2018-04-03 西北工业大学 A kind of double shared tow-armed robot remote operating control system
CN106444638B (en) * 2016-07-26 2018-12-04 南京国际船舶设备配件有限公司 A kind of marine low-speed machine air valve welding robot workstation control system
CN106254632A (en) * 2016-07-26 2016-12-21 青岛欧开智能系统有限公司 Remote operation controller
CN106422295B (en) * 2016-09-27 2020-03-17 珠海格力智能装备有限公司 Method and device for processing difficulty level of playing chess and robot
CN106926260A (en) * 2017-03-10 2017-07-07 蒙柳 A kind of teleoperation robot interaction controller

Also Published As

Publication number Publication date
CN1440856A (en) 2003-09-10

Similar Documents

Publication Publication Date Title
Pérez et al. Industrial robot control and operator training using virtual reality interfaces
US10571896B2 (en) Natural machine interface system
CN1233514C (en) Internet control system for remotely controlling robots to play chess
US9387589B2 (en) Visual debugging of robotic tasks
Naceri et al. Towards a virtual reality interface for remote robotic teleoperation
CN108284436B (en) Remote robotic dual-arm system and method with imitation learning mechanism
CN206326605U (en) A kind of intelligent teaching system based on machine vision
Cai et al. Modeling Method of Autonomous Robot Manipulator Based on D‐H Algorithm
Lo et al. Cooperative teleoperation of a multirobot system with force reflection via internet
Yim et al. WFH-VR: Teleoperating a robot arm to set a dining table across the globe via virtual reality
CN112497208A (en) Mobile operation robot general control method based on full-state impedance controller
CN115122325A (en) Robust visual servo control method for anthropomorphic manipulator with view field constraint
CN110355750A (en) Interaction control method towards remote operating hand eye coordination
Meng et al. Virtual reality based robot teleoperation via human-scene interaction
CN116197899A (en) Active robot teleoperation system based on VR
Liang et al. Trajectory-based skill learning for overhead construction robots using generalized cylinders with orientation
CN101436061B (en) Competing type network robot chess-playing system
Duan et al. Morphology agnostic gesture mapping for intuitive teleoperation of construction robots
CN110434854A (en) A kind of redundancy mechanical arm Visual servoing control method and apparatus based on data-driven
Liu et al. Competitive multi-robot teleoperation
CN117086882A (en) A reinforcement learning method based on the degree of freedom of robot arm posture movement
Bentivegna et al. A framework for learning from observation using primitives
Bellamine et al. Remote machinery maintenance system with the use of virtual reality
Lo et al. Co-operative control of Internet based multi-robot systems with force reflection
JP3716134B2 (en) Oscillation device operation command data generation method and oscillation device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C19 Lapse of patent right due to non-payment of the annual fee
CF01 Termination of patent right due to non-payment of annual fee