CN105468432A - Realization method based on robot visual interactive simulation environment - Google Patents

Realization method based on robot visual interactive simulation environment Download PDF

Info

Publication number
CN105468432A
CN105468432A CN201510798285.2A CN201510798285A CN105468432A CN 105468432 A CN105468432 A CN 105468432A CN 201510798285 A CN201510798285 A CN 201510798285A CN 105468432 A CN105468432 A CN 105468432A
Authority
CN
China
Prior art keywords
robot
visualization model
received
controller
emulation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510798285.2A
Other languages
Chinese (zh)
Inventor
周继强
王丽峰
涂国栋
刘川
陈磊
杨宛璐
倪琳轩
张孝勇
朱洪昌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangxi Hongdu Aviation Industry Group Co Ltd
Original Assignee
Jiangxi Hongdu Aviation Industry Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangxi Hongdu Aviation Industry Group Co Ltd filed Critical Jiangxi Hongdu Aviation Industry Group Co Ltd
Priority to CN201510798285.2A priority Critical patent/CN105468432A/en
Publication of CN105468432A publication Critical patent/CN105468432A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45504Abstract machines for programme code execution, e.g. Java virtual machine [JVM], interpreters, emulators
    • G06F9/45508Runtime interpretation or emulation, e g. emulator loops, bytecode interpretation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45575Starting, stopping, suspending or resuming virtual machine instances

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Manipulator (AREA)

Abstract

The invention discloses a realization method based on a robot visual interactive simulation environment. According to the method, a mouse conveniently creates different house type images, barriers, start points, unavoidable points and terminal points on an interactive simulation interface, a virtual environment required by experiments can be created by use of an interactive display module, and it is checked that whether a program meets the demand when a simulation robot operates in a visual interactive simulation environment system, so that potential unnecessary loss caused by direct operation on a physical robot is prevented, and unnecessary loss brought about by direct physical experiments is lowered.

Description

A kind of implementation method based on robot Visual Interactive simulated environment
Technical field
The present invention relates to a kind of Visual Interactive simulated environment, particularly relate to a kind of implementation method based on robot Visual Interactive simulated environment.
Background technology
Existing Visualized Monitoring System, only play the effect of monitoring, there is no the virtual environment needed for testing, emulated robot cannot be checked to move whether satisfy the demand at visualization interactive simulation environmental system Program, robot operating system is all directly carry out Physical Experiment, causes much unnecessary loss.
Therefore, need to provide a kind of new technical scheme to solve the problems referred to above.
Summary of the invention
The technical issues that need to address of the present invention are to provide a kind of implementation method based on robot Visual Interactive simulated environment.By mouse set up on interactive simulation interface easily various different floor plan, barrier, starting point, must through the setting of point, terminating point, be true environment constructing virtual simulated environment by interactive display module, emulation, by just carrying out the operation under true environment, avoids unnecessary Physical Loss or Damage.
For solving technical matters of the present invention, the technical solution used in the present invention is:
Based on an implementation method for robot Visual Interactive simulated environment, it comprises block world construction step and visualization model operating procedure,
Block world construction step is as follows:
(1) emulation zone grid size is set;
(2) simulated environment size is set;
(3) choose figure, show by sample;
(4) whether pull figure and enter emulation zone, if so, then enter emulation zone; If not, then preserve and pull figure;
(5) pull after figure enters emulation zone, judge whether mobile or convergent-divergent figure, if so, then the figure chosen emulation zone moves or zoom operations; If not, then to the graphics saving that emulation zone is chosen, finally emulate end;
Visualization model operating procedure is as follows:
(1) visualization model opens a communication port, and is connected to the particular port of controller place main frame;
(2) judge whether controller receives, if do not received, then visualization model request controller distribution of machine people steering order, if received, then the data that receive of controller process send data to visualization model;
(3) judge whether visualization model receives, if do not received, then continue the data waiting for that controller sends, if received, visualization model realizes motion and the barrier avoiding function of robot according to the data mobile robot received, if do not terminated, then return visualization model request controller distribution of machine people steering order.
(4) step (2) (3) are repeated until terminate simulation process after reaching emulation object.
Beneficial effect of the present invention: interactive environment converts environmental model to unified figure module, can build environment information fast, is flexible, general, platform efficiently, supports the secondary development of user; Robot interactive formula simulated environment platform, can reduce unnecessary Physical Loss or Damage, reduces project spending simultaneously.
Accompanying drawing explanation
Fig. 1 is the software flow pattern that block world of the present invention builds.
Main flow figure when Fig. 2 is visualization model of the present invention operation.
Embodiment
Below in conjunction with the drawings and specific embodiments, the invention will be further described.Following examples, only for illustration of the present invention, are not used for limiting the scope of the invention.
Shown in Fig. 1 and 2, a kind of implementation method based on robot Visual Interactive simulated environment of the present invention, comprise block world construction step and visualization model operating procedure, block world construction step is as follows:
(1) emulation zone grid size is set;
(2) simulated environment size is set;
(3) choose figure, show by sample;
(4) whether pull figure and enter emulation zone, if so, then enter emulation zone; If not, then preserve and pull figure;
(5) pull after figure enters emulation zone, judge whether mobile or convergent-divergent figure, if so, then the figure chosen emulation zone moves or zoom operations; If not, then to the graphics saving that emulation zone is chosen, finally emulate end.
Visualization model operating procedure is as follows:
(1) visualization model opens a communication port, and is connected to the particular port of controller place main frame;
(2) judge whether controller receives, if do not received, then visualization model request controller distribution of machine people steering order, if received, then the data that receive of controller process send data to visualization model;
(3) judge whether visualization model receives, if do not received, then continue the data waiting for that controller sends, if received, visualization model realizes motion and the barrier avoiding function of robot according to the data mobile robot received, if do not terminated, then return visualization model request controller distribution of machine people steering order.
(4) step (2) (3) are repeated until terminate simulation process after reaching emulation object.
Robot develops under Windows operating system environment, develops based on VisualStudio2010/2012.Coupled together by point-to-point communication network between Controlling vertex and functional node.Development environment accessible site open source software resource.Such as, the driver, OpenCV, ROS open source software etc. of sensor manufacturer issue.
Robot Visual Interactive emulation platform comprises: block world, library management, building blocks storehouse, robot storehouse, preference pattern (remote control, path planning (A*), path planning (elastic webbing), script-editor).
1, block world: Figure 1 shows that building blocks composition process flow diagram.Pull building blocks into and carry out composition, be i.e. off-line composition.
2, library management: library management comprises the management to building blocks storehouse and robot storehouse, the task that library management mainly completes is function building blocks storehouse and robot storehouse being completed to interpolation, deletion, preservation.
3, building blocks storehouse: the just rectangular obstruction that building blocks storehouse of the present invention provides, in addition also has 8 kinds of barrier figures such as chair, bed, cupboard, desk, the kitchen range top, sofa, cabinet for TV, tea table.Can personal different demand manage building blocks storehouse, the functions such as increase, deletion, preservation, the increase function in building blocks storehouse is the * .3ds file formed by 3DSMAX modeling, and this file is imported to shape library, then is preserved by XML file.
4, robot imports: build block world, selects robot, edit script.
5, robot storehouse: robot storehouse is when the robot kind used in visualized operation process is many, conveniently to the storehouse that the concentrated of robot and administrative institute are built.What comprise in robot storehouse only has wheeled mobile robot, but can be expanded in robot storehouse as required.Preserving type is similar to building blocks storehouse above, the information of robot modeling can be kept in the middle of * .xml file.When needs amendment robot parameter, double-click robot, eject dialog box, in picture frame, is modified in the place of required amendment.Robot storehouse is by the collection of bots of various different modeling together and manage it.The management in robot storehouse with building blocks storehouse administrative class seemingly, also be divided into the operations such as importing, deletion, preservation, specific operation process is also similar with building blocks storehouse, increase operation select want load and the * .xml file of the robot of modeling, robot is loaded in the middle of storehouse.In simulation process afterwards, this robot can complete movement, turning, straight line people, selects " deletion " option to be deleted; For the robot storehouse of having modified, family also needs to carry out preserving to facilitate use next time.Right-click " robot storehouse " ejects shortcut menu, chooses " preservation " option, ejects dialog box (i.e. the path at place, robot storehouse), is saved in original robot storehouse.
6, robot imports: mainly comprise and import robot and pose setting.On the basis of existing block world, robot directly can be pulled into in block world.When robot is present in block world, can arrange the position money of robot.Select " pose setting " menu item in robot importing menu, the position of machine entered people, angle, click " setting " button, completes robot pose and arrange.
7, preference pattern: comprise remote control, path planning (A*), path planning (elastic webbing), the several function of script-editor.
Remote control mode: remote control comprises rocking bar remote control and control panel remote control, these two kinds of remote controls are not mutual exclusions, can use simultaneously, such as can click " stopping " the key controlled robot stop motion on control panel when distant bar is invalid suddenly.If pilot lamp is bright, then represent that rocking bar can normally use, what now show in " speed " and " angle " edit box is the speed of the robot that rocking bar sends and the angle of rotation; Otherwise represent that rocking bar can not normally use.When rocking bar can not normally use, control panel can be used to operate, operation first will input " speed " and " angle " value, clicks the button such as " advance ", " retrogressing ", " left-hand rotation ", " right-hand rotation " afterwards and carrys out control motion.
Path planning (A*, elastic webbing): select A* planning algorithm, can environmentally by clicking " impact point ", " must through point " button carrys out Offered target point, must through point, click " coordinates measurement " button, software can call PathPlanningAstar () or PathPlanningElastic () function, generation pass also shows in the environment, and path point is also shown in the middle of list, now clicks " beginning " button and just can manipulate robot path motion according to the rules.
Script-editor: script format has three kinds, is respectively " identifiable language+speed+distance; ", " identifiable language+angular velocity+angle " or " identifiable language " (as STOP; ).When form is " identifiable language+angular velocity+angle; " time, the unit of angular velocity is Radian per second (rad/s), the unit radian (rad) of angle.Such as, edit script manipulates robot with the speed advance 5m of 0.5m/s, then with the angular velocity left-hand rotation 1.57rad of 0.087rad/s." FRONT0.5005.000 can be written as in edit box; LEFT0.0871.570; ", click " transmission " button, trigger OnBnClickedVisualeditdialogSend () function, this function performance is sent by script information.Script can be sent to controller, manipulation robot motion.
Visualization interactive simulation environment of the present invention can build the virtual environment needed for experiment, whether the motion of inspection emulated robot satisfies the demand at visualization interactive simulation environmental system Program, avoid the unnecessary loss that direct control robot entity may cause, reduce direct physical and test the unnecessary loss brought.

Claims (1)

1. based on an implementation method for robot Visual Interactive simulated environment, it is characterized in that: it comprises block world construction step and visualization model operating procedure,
Block world construction step is as follows:
(1) emulation zone grid size is set;
(2) simulated environment size is set;
(3) choose figure, show by sample;
(4) whether pull figure and enter emulation zone, if so, then enter emulation zone; If not, then preserve and pull figure;
(5) pull after figure enters emulation zone, judge whether mobile or convergent-divergent figure, if so, then the figure chosen emulation zone moves or zoom operations; If not, then to the graphics saving that emulation zone is chosen, finally emulate end;
Visualization model operating procedure is as follows:
(1) visualization model opens a communication port, and is connected to the particular port of controller place main frame;
(2) judge whether controller receives, if do not received, then visualization model request controller distribution of machine people steering order, if received, then the data that receive of controller process send data to visualization model;
(3) judge whether visualization model receives, if do not received, then continue the data waiting for that controller sends, if received, visualization model realizes motion and the barrier avoiding function of robot according to the data mobile robot received, if do not terminated, then return visualization model request controller distribution of machine people steering order;
(4) step (2) (3) are repeated until terminate simulation process after reaching emulation object.
CN201510798285.2A 2015-11-19 2015-11-19 Realization method based on robot visual interactive simulation environment Pending CN105468432A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510798285.2A CN105468432A (en) 2015-11-19 2015-11-19 Realization method based on robot visual interactive simulation environment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510798285.2A CN105468432A (en) 2015-11-19 2015-11-19 Realization method based on robot visual interactive simulation environment

Publications (1)

Publication Number Publication Date
CN105468432A true CN105468432A (en) 2016-04-06

Family

ID=55606170

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510798285.2A Pending CN105468432A (en) 2015-11-19 2015-11-19 Realization method based on robot visual interactive simulation environment

Country Status (1)

Country Link
CN (1) CN105468432A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106326087A (en) * 2016-08-31 2017-01-11 北京光年无限科技有限公司 Webpage experiencing method based on robot operating system and system thereof
CN106408642A (en) * 2016-09-23 2017-02-15 江西洪都航空工业集团有限责任公司 Method for realizing three-dimensional simulation of service robot
CN110262505A (en) * 2019-07-03 2019-09-20 安徽工程大学 Robot moves method for visualizing by planning path in virtual reality
CN114147705A (en) * 2021-11-18 2022-03-08 珠海格力智能装备有限公司 Robot control method and device, computer equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103262080A (en) * 2010-07-22 2013-08-21 卡格梅森机器人有限公司 A non-programmer method for creating simulation-enabled 3d robotic models for immediate robotic simulation, without programming intervention
CN104460670A (en) * 2014-11-10 2015-03-25 华南理工大学 SCARA robot motion simulation and remote control system and method
CN104778872A (en) * 2015-04-03 2015-07-15 上海交通大学 Simulation testing and training platform for mechanical arm teleoperation human-computer interaction study
CN104914733A (en) * 2014-12-31 2015-09-16 中国航天科技集团公司第五研究院第五一三研究所 Space mechanical arm three-dimensional simulation system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103262080A (en) * 2010-07-22 2013-08-21 卡格梅森机器人有限公司 A non-programmer method for creating simulation-enabled 3d robotic models for immediate robotic simulation, without programming intervention
CN104460670A (en) * 2014-11-10 2015-03-25 华南理工大学 SCARA robot motion simulation and remote control system and method
CN104914733A (en) * 2014-12-31 2015-09-16 中国航天科技集团公司第五研究院第五一三研究所 Space mechanical arm three-dimensional simulation system
CN104778872A (en) * 2015-04-03 2015-07-15 上海交通大学 Simulation testing and training platform for mechanical arm teleoperation human-computer interaction study

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
渠瀛: ""机器人模块化可重用仿真平台的设计与研究"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *
翁妙凤 等: ""机器人装配作业规划的图形仿真"", 《华东船舶工业学院学报》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106326087A (en) * 2016-08-31 2017-01-11 北京光年无限科技有限公司 Webpage experiencing method based on robot operating system and system thereof
CN106326087B (en) * 2016-08-31 2019-04-19 北京光年无限科技有限公司 Web page experience method and system based on robot operating system
CN106408642A (en) * 2016-09-23 2017-02-15 江西洪都航空工业集团有限责任公司 Method for realizing three-dimensional simulation of service robot
CN110262505A (en) * 2019-07-03 2019-09-20 安徽工程大学 Robot moves method for visualizing by planning path in virtual reality
CN110262505B (en) * 2019-07-03 2022-03-11 安徽工程大学 Method for visualizing robot motion according to planned path in virtual reality
CN114147705A (en) * 2021-11-18 2022-03-08 珠海格力智能装备有限公司 Robot control method and device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
US11645817B2 (en) Information processing method and apparatus, terminal device, and computer readable storage medium on displaying decoupled virtual objects in a virtual scene
US11809685B2 (en) Information interaction method and apparatus, storage medium, and electronic apparatus
CA2985870C (en) Information processing method, terminal, and computer storage medium
Chi et al. Research trends and opportunities of augmented reality applications in architecture, engineering, and construction
WO2018192394A1 (en) Interaction method and apparatus for virtual reality scene, storage medium and electronic apparatus
CN105468432A (en) Realization method based on robot visual interactive simulation environment
CN106843124A (en) A kind of Automatic Warehouse three-dimensional real-time monitoring method and system
US20020199156A1 (en) Hardware-adaptable data visualization tool for use in complex data analysis and engineering design
US10921796B2 (en) Component information retrieval device, component information retrieval method, and program
CN104881518A (en) Three-dimensional vision simulation system for aerial vehicles
CN109701265A (en) Remote desktop cursor mode switching method, system, client and remote server
CN111047708A (en) Complex equipment high-risk project training system based on mixed reality
WO2019074807A1 (en) Dimensional content surface rendering
CN117541713A (en) Variable element universe scene building method and system based on illusion engine
CN101833421A (en) Electronic device and method for acquiring user operation
CN109710092A (en) A kind of nuclear power station virtual master control room man-machine interaction method, system and server
CN107624627A (en) A kind of agricultural irrigation systems based on virtual reality
CN110555222B (en) Three-dimensional visualization service platform-based method for rapidly constructing three-dimensional visualization application
Jia et al. Collision detection based on augmented reality for construction robot
CN115794979A (en) GIS digital twinning system based on Unity3D
CN104932467A (en) Method for controlling program-controlled equipment in centralized way
CN104777993A (en) Method and device for controlling multi-screen adapter by mobile terminal touch screen
CN103513787B (en) For operating air mouse achievement method and the system of multi-screen adapter
CN202771416U (en) Visual three-dimensional (3D) programming device
CN105467872A (en) Graphical configuration sequentialization control system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160406

RJ01 Rejection of invention patent application after publication