CN106953900A - A kind of industrial environment outdoor scene enhanced interactive terminal and system - Google Patents

A kind of industrial environment outdoor scene enhanced interactive terminal and system Download PDF

Info

Publication number
CN106953900A
CN106953900A CN201710138192.6A CN201710138192A CN106953900A CN 106953900 A CN106953900 A CN 106953900A CN 201710138192 A CN201710138192 A CN 201710138192A CN 106953900 A CN106953900 A CN 106953900A
Authority
CN
China
Prior art keywords
equipment
module
time data
outdoor scene
industrial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710138192.6A
Other languages
Chinese (zh)
Inventor
何积丰
毛侠
史建琦
黄滟鸿
李昂
方徽星
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Fenglei Information Technology Co Ltd
East China Normal University
Original Assignee
Shanghai Fenglei Information Technology Co Ltd
East China Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Fenglei Information Technology Co Ltd, East China Normal University filed Critical Shanghai Fenglei Information Technology Co Ltd
Priority to CN201710138192.6A priority Critical patent/CN106953900A/en
Publication of CN106953900A publication Critical patent/CN106953900A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/04Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/05Programmable logic controllers, e.g. simulating logic interconnections of signals according to ladder diagrams or function charts
    • G05B19/054Input/output
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/10Plc systems
    • G05B2219/15Plc structure of the system
    • G05B2219/15011Configuration of operating system
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/10Plc systems
    • G05B2219/15Plc structure of the system
    • G05B2219/15042Synoptic display of process, mimic diagram

Abstract

The invention discloses a kind of industrial environment outdoor scene enhanced interactive terminal and system, outdoor scene enhanced interactive terminal therein includes AR equipment, Intelligent positioning module, real-time data acquisition module and wireless communication module;AR equipment therein includes AR backstages configuration module and AR outdoor scenes from adaptation module, AR backstages configuration module is used for the parameters index and additional real time data for obtaining industrial equipment, it is used for the instruction for receiving and explaining AR equipment simultaneously, to realize the generation and/or renewal of configuration environment;AR outdoor scenes therein are used to catch the actual observation object in the AR equipment visual field from adaptation module, the position of appearing and mode of the real time data for the industrial equipment that adjust automatically is gathered, the observation operation interface of virtualization is shown, calls and interfaceization shows the configuration environment for being generated and/or being updated by AR backstages configuration module.The mode called, show and observed there is provided brand-new configuration.

Description

A kind of industrial environment outdoor scene enhanced interactive terminal and system
Technical field
The present invention relates to industrial control field, in particular it relates to industrial environment outdoor scene enhanced interactive system.This interaction System relate to AR (augmented reality) technology, PLC (programmable logic controller (PLC)) data monitorings acquisition technique, bluetooth wireless networking With short distance location technology and HMI (man-machine interface) configuration technology.
Background technology
Intelligence manufacture leading capacity alliance of the U.S. proposed the concept of intelligence manufacture in 2011.Germany is in 2013 in Chinese promise Industry 4.0 is proposed in the rich meeting of prestige work, and is included what is issued by German Government《German 2020 Hi-Tech Strategies》It is ten big In Future Project, it is desirable to capture first chance in the industrial revolution of a new round.China was taken the lead formulation in 2015 by national Ministry of Industry and Information 《Made in China 2025》Deng strategic level plan.As can be seen here, industrial control system is paid attention to by more and more national.
Industrial control system is the basis of power, greatly to nuclear power plant, Aero-Space, track traffic, small to arrive private production etc. Deng according to statistics, the field for being related to national economy more than 80% is required for industrial control system to realize automated job, its elder generation The property entered and up-to-dateness close relation the strategic of country.PLC has as new, the general controller of industry spot The remarkable advantages such as flexible, the safe, strong antijamming capability of assembling, major industry have been used in extensively and in large quantities Scene.The continuous upgrading and innovation of controller bring matter for all many-sides such as the productions, maintenance and management of Industry Control Break through, however, supporting auxiliary equipment is breakthrough and innovative not obvious enough.All there are following these and show in substantial amounts of industry spot As:Traditional is only used till today using the mechanical HMI modes of operation of physical button, and it is inflexible that control mode is fixed;Match somebody with somebody for equipment Independent physical display is put, with high costs, data isolate relatively;Industry spot uses full wired data transfer, and wiring is extremely Very complicated etc..How industrial 4.0 epoch improve traditional industry manufacturing mode and it is made the transition largely to intelligence manufacture It is upper to realize that technology is closely bound up with existing.
Although the species of the PLC brands in market is various, the controller manufacturer of main flow but cans be counted on one's fingers, and is made extensively With and influential industry spot communication protocol quantity and few, this to carry out agreement docking for market mainstream PLC It is possibly realized with device data acquisition.In addition, Internet of Things and wireless communication technology are developed rapidly as technical grade data transfer Mode brings new extension approach, and national 3G/4G transmission rates are substantially improved and coverage is increasingly perfect, and bluetooth is from 4.0+ Start that the superior new features such as low-power consumption, MANET and safety encryption, industrial application environment of more fitting have been done step-by-step.Remove Outside this, visually, high technological tide related AR is just impacting the static fixation display mode of conventional physical screen;Limbs On, the use of depth of field camera gradually opens the new markets of a personal-machine natural interaction.At the same time, the continuous hair of big data Exhibition and unprecedented attention of the people to security to use the technology of on-line expert diagnostic system to turn into popular in industrial environment, New technology involved by above-mentioned every bit may all bring the technological incorporation and innovation of initiative in industrial quarters.
The present invention is directed to the above mentioned problem of the current physical presence in traditional industry scene, and scope is fixed, quantity many It is many and can not be re-used, cost is higher, take larger space, configuration is called, shown and observed pattern underaction, man-machine friendship A kind of the problems such as mutual mode underaction, device diagnostic effect need further improve, it is proposed that industrial environment outdoor scene enhanced Interactive terminal and system.
The content of the invention
In order at least partly solve the above-mentioned technical problem of the current physical presence in traditional industry scene, the present invention proposes work Industry environment outdoor scene enhanced interactive terminal and system.
The present invention proposes a kind of industrial environment outdoor scene enhanced interactive terminal, including:AR equipment;Intelligent positioning module, For the positional information of real-time location tracking AR equipment, while providing the physical services scope of industrial equipment;Real-time data acquisition Module, for gathering the real time data of industrial equipment and the feedback of real time data being carried out to industrial equipment;And, radio communication mold Block, for AR equipment enter industrial equipment physical services in the range of when, the industry gathered to real-time data acquisition module The real time data of equipment, the interaction data progress transmitted in both directions produced with AR equipment, update to real-time continuous;AR equipment therein Including AR backstages configuration module and AR outdoor scenes from adaptation module, AR backstages configuration module is used for the parameters for obtaining industrial equipment Index and additional real time data, while the instruction for receiving and explaining AR equipment, to realize the generation and/or more of configuration environment Newly;AR outdoor scenes therein are used to catch the actual observation object in the AR equipment visual field from adaptation module, what adjust automatically was gathered The position of appearing and mode of the real time data of industrial equipment, show the observation operation interface of virtualization, call and interfaceization display The configuration environment for being generated and/or being updated by AR backstages configuration module.
According to the present invention this outdoor scene enhanced interactive terminal have been provided for a kind of brand-new configuration call, show and The mode of observation, by body-worn industrial environment outdoor scene enhanced interactive terminal (for example, it may be implemented as wireless access AR equipment form, can also be other transportable displays and interactive device) portable multiplexing, can be to a certain degree The upper quantity for reducing industrial environment conventional display apparatus, reduces purchase cost, more saving energy consumption and equipment occupation space.
Moreover, the people being combined according to this outdoor scene enhanced interactive terminal of the present invention as a result of physics with body-sensing Machine interactive mode, so control that can not only be with high-precision operation to use to physical equipment, is passed so as to ensure that it has Stability, safety and reliability in system industry;And gesture, voice can be used with low precision and suggestive operation Man-machine interaction is carried out Deng more natural mode, so that data interaction is more directly perceived, convenient, hommization.
According to the outdoor scene enhanced interactive terminal of the present invention, real-time data acquisition module therein includes:Data acquisition is filled Put, the real time data for gathering industrial equipment;And, data feedback device is real for being carried out to the industrial equipment gathered When data feedback.
According to the outdoor scene enhanced interactive terminal of the present invention, real-time data acquisition module therein uses Wired access mode Or wireless access way, and bind in network insertion the IP address of the industrial equipment.
According to the outdoor scene enhanced interactive terminal of the present invention, real-time data acquisition module therein is respectively adopted following wired At least one in access way or wireless access way:Serial ports, netting twine, WiFi, 2G/3G/4G.
According to the outdoor scene enhanced interactive terminal of the present invention, the network scheme of real-time data acquisition module therein is adopted With the clients of C/S frameworks or the data access mode of the web services of B/S frameworks.
According to the outdoor scene enhanced interactive terminal of the present invention, Intelligent positioning module therein is to use the nothing with networking Internet of Things The locating module of line location technology.
According to the outdoor scene enhanced interactive terminal of the present invention, Intelligent positioning module therein is used with lower band networking Internet of Things Wireless location technology:Bluetooth wireless location technology, the service range for providing industrial equipment;Bluetooth group technology, for many Equipment is interconnected and combined data is so as to provide the dummy node equipment of simulation industry spot.
According to the outdoor scene enhanced interactive terminal of the present invention, wireless communication module therein communicates based on using bluetooth Scheme, and at least one scheme expanded in 2G/3G/4G, WiFi and LoRa communication plan, for being set in the AR When in the service range of the standby control node equipment for entering Intelligent positioning module, the instruction of AR equipment is sent according to related protocol To control node equipment, so that the equipment controlled attribute of control node equipment is enabled, wherein the AR equipment uses bluetooth conduct Base communication scheme, or at least one scheme expanded in 2G/3G/4G, WiFi and LoRa communication plan.
According to the outdoor scene enhanced interactive terminal of the present invention, AR outdoor scenes are from adaptation module adjust automatically and select configuration interface Or the configuration of General Purpose Interface, the real time data for showing gathered industrial equipment in AR equipment.
According to the second aspect of the invention, it is proposed that a kind of industrial environment outdoor scene enhanced interactive system, it is including following Equipment:Need the industrial equipment for carrying out real-time data acquisition and being fed back to it;And, outdoor scene enhanced as described above Interactive terminal, industrial equipment therein can be by the way of wired connection and/or wireless connection adaptation come access real-time Acquisition module, moreover, real-time data acquisition module is not with industrial equipment (i.e. node device), serial ports is direct-connected, but passes through network side When formula is attached with it, real-time data acquisition module can be used as dummy node in itself.
As the skilled person will understand, can according to the outdoor scene enhanced interactive terminal of the present invention and system Obtain following beneficial effect:
The outdoor scene enhanced interactive terminal of the present invention and system provide what a kind of brand-new configuration was called, and showed and observed Mode, is multiplexed by the movable type of body-worn AR equipment, industrial environment conventional display apparatus can be reduced to a certain extent Quantity, reduces purchase cost, more saving energy consumption and equipment occupation space, while alleviating the complicated wiring problem in scene.
The man-machine interaction that the outdoor scene enhanced interactive terminal and system of the present invention is combined as a result of physics with body-sensing Mode, so control that can not only be with high-precision operation to use to physical equipment, so as to ensure that it has traditional industry In stability, safety and reliability;And gesture, voice etc. can be used with low precision and suggestive operation more Natural mode carries out man-machine interaction, so that data interaction is more directly perceived, convenient, hommization.
The outdoor scene enhanced interactive terminal of the present invention and system combination online diagnosing technique of support shaft, extension coordinate on-line expert diagnosis System, can not only provide the abundant assistant service such as parameter index early warning, also can reach reduction training cost, drop The purposes such as low operation error probability, the lifting means efficiency of management.
Brief description of the drawings
By reading the detailed description of following detailed description, various other advantages and benefit is common for this area Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of embodiment, and is not considered as to the present invention Limitation.And in the accompanying drawings, identical part is denoted by the same reference numerals.In the accompanying drawings:
Fig. 1 shows the overall signal of industrial environment outdoor scene enhanced interactive system according to the embodiment of the present invention Figure;
Fig. 2 shows the industrial environment in industrial environment outdoor scene enhanced interactive system according to the embodiment of the present invention The structured flowchart of outdoor scene enhanced interactive terminal;
Fig. 3 shows the real time data in industrial environment outdoor scene enhanced interactive terminal according to the embodiment of the present invention The exemplary structured flowchart of acquisition module;
Fig. 4 shows what is interacted with industrial environment outdoor scene enhanced interactive terminal according to the embodiment of the present invention The structured flowchart of exemplary industrial equipment;
Fig. 5 shows the method flow diagram that outdoor scene enhanced interactive system according to the embodiment of the present invention is realized;
Fig. 6 shows what outdoor scene enhanced interactive terminal according to the embodiment of the present invention was interacted with industrial equipment Method flow diagram;And
Fig. 7 shows the system framework of the industrial environment outdoor scene enhanced interactive system according to the specific embodiment of the invention Figure.
Embodiment
The illustrative embodiments of the present invention are more fully described below with reference to accompanying drawings.Although showing this hair in accompanying drawing Bright illustrative embodiments, it being understood, however, that the reality of the invention without that should be illustrated here can be realized in a variety of manners The mode of applying is limited.Conversely it is able to be best understood from the present invention there is provided these embodiments, and this can be sent out Bright scope completely convey to those skilled in the art.
Fig. 1 shows the overall signal of industrial environment outdoor scene enhanced interactive system according to the embodiment of the present invention Figure.As shown in figure 1, whole system schematically includes outdoor scene enhanced interactive terminal and industrial field device, the outdoor scene increases Strong formula interactive terminal includes real-time data acquisition module, Intelligent positioning module, wireless communication module, AR equipment.
Wherein, real-time data acquisition module is the basic module of the whole system, and it is by being adapted to market main flow PLC (such as Siemens, Mitsubishi, Omron), a variety of industrial field bus communications protocol of support (such as PROFINET, EtherCAT, Modbus etc.), the real time data for gathering industrial equipment (that is, industry spot node device), while needs pair Industrial field device carries out data feedback, and basic connected mode therebetween is wired connection mode (for example, showing in Fig. 1 Industrial netting twine and the serial mode using UART are gone out, but have been not limited in both).Real-time data acquisition module can be with Using Wired access mode or wireless access way, it can be respectively adopted in following Wired access mode or wireless access way It is at least one:Serial ports, netting twine, WiFi, 2G/3G/4G.Scheme of the real-time data acquisition module based on network collection can use C/ The client of S frameworks or the web services of B/S frameworks access data, and data monitoring and the API of management can be opened to the 3rd Fang Jinhang extends in many ways.
Wherein, wireless communication module is (for example, figure 1 illustrates the wireless communication module comprising bluetooth, WiFi, still It is not limited in both), for being communicated between AR equipment and industrial field device.Thus, wireless communication module can The communication plan based on using bluetooth, and at least one expanded in 2G/3G/4G, WiFi and LoRa communication plan The scheme of kind, the control for entering Intelligent positioning module in the AR equipment with the radio function realized by above-mentioned communication plan When in the service range of node device, the instruction of AR equipment is sent to control node equipment according to related protocol, so as to enable The equipment controlled attribute of control node equipment.Specifically, once the AR equipment enters in the range of the system service, channel radio The data that letter module obtains the real-time data acquisition module carry out double with the interaction data that the AR equipment of the system is produced To transmission, update to real-time continuous.
Wherein, Intelligent positioning module, using the wireless location technology and scheme of main flow (for example, bluetooth is positioned, LoRa is fixed Position, indoor-GPS etc.), the scope of the physical services of each node device in system is on the one hand provided, on the other hand inspection in real time Survey and follow the trail of the positional information that the user of the system enters after service range.Intelligent positioning module can use band networking The locating module of the wireless location technology of Internet of Things, can be used with the wireless location technology of lower band networking Internet of Things:Bluetooth is wirelessly fixed Position technology, the service range for providing industrial equipment;Can mutual group if the overlapping multiple devices of presence service range section Into network, many equipment interconnections are realized, the I/O back end of virtualization is simulated.
Wherein, AR equipment includes AR outdoor scenes from adaptation module and AR backstages configuration module.When the AR equipment of the system is obtained The data that the real-time data acquisition module for taking the wireless communication module to transmit is collected, AR outdoor scenes are from adaptation module and AR Backstage configuration module synthetic operation, actual sight of the AR outdoor scenes from adaptation module in the AR equipment visual field captured Survey object, adjust automatically data position of appearing and mode and show the observation behaviour of virtualization and make interface, i.e. can adjust automatically Whole and selection configuration interface or General Purpose Interface configuration, provides more suitable mode for received data and is shown in the system In AR equipment;AR backstages configuration module is by obtaining equipment parameters index, to be received and explanation AR equipment operations The real time datas such as instruction, complete the generation of configuration environment and more New function in time, and AR backstages configuration module is additionally may included in line Expert diagnostic system, for carrying out index extraction analysis, and for carrying out Comprehensive Evaluation to provide Optimal Decision-making prompting, for User makes a policy for kinds of schemes.
Such as Fig. 2, it shows industrial environment outdoor scene enhancing according to the embodiment of the present invention in the form of functional module The structured flowchart of industrial environment outdoor scene enhanced interactive terminal in formula interactive system, industrial environment outdoor scene enhanced interaction is eventually End includes real-time data acquisition module, Intelligent positioning module, wireless communication module, AR equipment, the function and Fig. 1 of above-mentioned each module The function of middle corresponding module is corresponding.
Wherein, Intelligent positioning module, for the positional information of real-time location tracking AR equipment, while providing industrial equipment Physical services scope;Real-time data acquisition module, for gathering the real time data of industrial equipment and being carried out to industrial equipment real-time The feedback of data;And, wireless communication module, for when AR equipment enters in the range of the physical services of industrial equipment, to reality When the real time data of industrial equipment that is gathered of data acquisition module and the instruction of AR equipment is forwarded, real-time continuous Ground updates;AR equipment therein includes AR backstages configuration module and AR outdoor scenes from adaptation module, and AR backstages configuration module is used to obtain The parameters index and additional real time data of industrial equipment are taken, while the instruction for receiving and explaining AR equipment, to realize The generation and/or renewal of configuration environment;AR outdoor scenes therein are used to catch the actual observation in the AR equipment visual field from adaptation module Object, the position of appearing and mode of the real time data for the industrial equipment that adjust automatically is gathered, the observation operation of display virtualization Interface, is called and interfaceization shows the configuration environment for being generated and/or being updated by AR backstages configuration module.
As shown in Fig. 2 between schematically show respectively modules with four-headed arrow and unidirectional arrow wherein Two-way and one way data communication relation.But those skilled in the art will be appreciated that each module shown in Fig. 2 it Between data communications context be only schematical, it can be envisaged that other data communications contexts between each module.
Understand as a person skilled in the art, first, according to the present invention outdoor scene enhanced interactive terminal and The terminal, there is provided the mode that a kind of brand-new configuration is called, shows and observed, is led to system that industrial field device is combined The portable multiplexing of body-worn AR equipment is crossed, the quantity of industrial environment conventional display apparatus can be reduced to a certain extent, is dropped Low purchase cost, more saving energy consumption and equipment occupation space.Secondly as employing the man-machine friendship that physics is combined with body-sensing Mutual mode, so control that can not only be with high-precision operation to use to physical equipment, so as to ensure that it has traditional work Stability, safety and reliability in industry;And gesture, voice etc. can be used with low precision and suggestive operation more Man-machine interaction is carried out for natural mode, so that data interaction is more directly perceived, convenient, hommization.Moreover, according to the present invention's This outdoor scene enhanced interactive terminal can alleviate live complicated wiring problem.
Again, this outdoor scene enhanced interactive terminal of online diagnosing technique of support shaft is combined, because extension has coordinated online special Family's diagnostic system, so can not only provide the abundant assistant service such as parameter index early warning, also can reach reduction The purposes such as training cost, reduction operation error probability, the lifting means efficiency of management.
Fig. 3 shows the real time data in industrial environment outdoor scene enhanced interactive terminal according to the embodiment of the present invention The exemplary structured flowchart of acquisition module.As shown in figure 3, real-time data acquisition module includes data acquisition facility and data are anti- Device is presented, data acquisition facility therein is used for the real time data for gathering industrial equipment;And data feedback device therein is to institute The industrial equipment of collection carries out the feedback of real time data.
Fig. 4 shows what is interacted with industrial environment outdoor scene enhanced interactive terminal according to the embodiment of the present invention The structured flowchart of industrial equipment.As shown in Figure 4, alternatively, industrial equipment passes through in serial ports, netting twine, WiFi, 2G/3G/4G One or more modes are connected adaptation with the real-time data acquisition module in outdoor scene enhanced interactive terminal, so as to realize that industry is set Standby real-time data acquisition and feedback function.
The block diagram for the step of Fig. 5 shows outdoor scene enhanced exchange method according to the embodiment of the present invention, wherein wrapping The manipulable basic step S501 to S505 in outdoor scene enhanced interactive terminal represented in the form of solid box is included.
In step S501, the positional information of AR equipment of the real-time location tracking of Intelligent positioning module with radio function, together When provide the physical services scope of industrial equipment.
In step S502, real-time data acquisition module gathers the real time data of industrial equipment.
In step S503, when AR equipment enters in the range of the physical services of industrial equipment, wireless communication module is to reality When the instruction that produces of the real time data of the industrial equipment that is gathered of data acquisition module, AR equipment carry out data interaction, connect in real time Update continuously.
In step S504, AR backstages configuration module obtains the parameters index and additional real time data of industrial equipment, The instruction of AR equipment is received and explains simultaneously, to realize the generation and/or renewal of configuration environment.
In step S505, AR outdoor scenes catch the actual observation object in the AR equipment visual field, adjust automatically from adaptation module The position of appearing and mode of the real time data of the industrial equipment gathered, show the observation operation interface of virtualization, call and boundary The configuration environment that faceization display is generated and/or updated by AR backstages configuration module.
According to step S504 and step S505 operation, and the AR outdoor scenes shown in Fig. 2 are from adaptation module and AR backstages Annexation between configuration module, it can be seen that AR outdoor scenes from adaptation module and AR backstages configuration module be synthetic operation, But those skilled in the art is it is also contemplated that realize other implementations of identical function.
Selectively, when the wireless communication module of the outdoor scene enhanced interactive terminal according to the present invention using bluetooth is used as base Plinth communication plan, and when expanding at least one scheme in 2G/3G/4G, WiFi and LoRa communication plan, outdoor scene increases Strong formula interactive terminal also performs step S506.In Figure 5 with the step S506 represented in the form of dotted line frame, with by upper State communication plan realization radio function AR equipment (correspondingly, AR equipment use bluetooth based on communication plan, Huo Zhekuo Open up at least one scheme in 2G/3G/4G, WiFi and LoRa communication plan) enter Intelligent positioning module control node When in the service range of equipment, the instruction of AR equipment is sent to control node equipment according to related protocol, so as to enable control The equipment controlled attribute of node device.
Selectively, step S507 is performed according to the outdoor scene enhanced interactive terminal of the present invention.In Figure 5 with dotted line frame In the step S507 that form is represented, AR outdoor scenes from adaptation module adjust automatically and selection configuration interface or General Purpose Interface configuration, Real time data for showing gathered industrial equipment in AR equipment.
Selectively, when AR backstages configuration module includes online expert diagnostic system, strengthened according to the outdoor scene of the present invention Formula interactive terminal performs step S508.In Figure 5 with the step S508 represented in the form of dotted line frame, on-line expert diagnostic system Index extraction analysis is carried out, and carries out Comprehensive Evaluation to provide Optimal Decision-making prompting, so that user does for kinds of schemes Go out decision-making.
Fig. 6 shows what outdoor scene enhanced interactive terminal according to the embodiment of the present invention was interacted with industrial equipment Method flow diagram.
As shown in fig. 6, which includes the manipulable basic step of the industrial equipment represented in the form of solid box S601.In step s 601, the real-time data acquisition module in outdoor scene enhanced interactive terminal is connected into industrial equipment by adaptation, The mode that the adaptation is connected into uses one or more modes in wired direct-connected (such as serial ports, netting twine) or WiFi, 2G/3G/4G.
Selectively, the industrial equipment execution step with being interacted according to the outdoor scene enhanced interactive terminal of the present invention S602.In figure 6 so that in the step S602 represented in the form of dotted line frame, the partly overlapping multiple industrial equipments of service range are constituted Network, realizes that equipment is interconnected, the I/O back end for simulating virtualization.
Selectively, when also including control node equipment using its outdoor scene enhanced interactive system, and according to this hair The industrial equipment that bright outdoor scene enhanced interactive terminal is interacted performs step S603.The table in the form of dotted line frame in figure 6 In the step S603 shown, the communication plan based on the wireless communication module of outdoor scene enhanced interactive terminal uses bluetooth, and And when expanding at least one scheme in 2G/3G/4G, WiFi and LoRa communication plan, and with passing through above-mentioned communication (correspondingly, AR equipment uses communication plan based on bluetooth to the AR equipment for the radio function that scheme is realized, or expands to At least one scheme in 2G/3G/4G, WiFi and LoRa communication plan) enter Intelligent positioning module control node equipment Service range in when, the instruction of AR equipment is sent to control node equipment according to related protocol, so as to enable control node The equipment controlled attribute of equipment.
Can be by outdoor scene enhanced interactive terminal and work although being shown respectively with the example sequence of diagram in Fig. 5, Fig. 6 The selectable exemplary step that industry equipment is performed.But, as will be appreciated by one skilled in the art, these steps It can in the other order perform, other steps being contemplated that can be included, and sub-step can be included.
Realized according to above-mentioned embodiment according to industrial environment outdoor scene enhanced interactive terminal of the invention, system And method.Only for illustration purposes only, the details that part listed here is realized, to help those skilled in the art to manage Solution.
As shown in fig. 7, AnyLinkTM products have been used according to the data acquisition module of an embodiment of the invention, AnyLinkTM boxes are integrated with a large amount of technical grade communications protocol (such as PROFINET, EtherCAT, Modbus) and are adapted to The main flow PLC (such as Siemens, Mitsubishi, Omron) of in the market, and there is provided task-driven, device drives and high in the clouds The API of exploitation, carries out secondary development convenient, fast on its basis;Intelligent positioning module therein selects bluetooth locating module, Bluetooth chip uses the TC35676 chips or TC35678 chips of Toshiba, and they support bluetooths 4.1, with low power consuming and oneself The brilliance feature such as networking, can provide the physical services scope of each industrial equipment, and if presence service range section is overlapping Many industrial equipments then can mutual network consisting, realize many equipment interconnections, simulate the I/O back end of virtualization;It is therein Wireless communication module uses above-mentioned Bluetooth chip, and in the operation system of embedded device plate (such as cortex-M3/M4 development boards) The transparent transmission and task scheduling of data are carried out in system, when AR equipment enters in the range of the control node device service of Intelligent positioning module When, by wireless communication module by the data forwarding of the industrial equipment gathered to outdoor scene enhanced interactive terminal;Outdoor scene strengthens Formula interactive terminal can use the Hololens products of Microsoft Corporation, and its average weight, time delay are low and with depth of field shooting Head, can provide hardware foundation, on this basis, AR outdoor scenes are from adaptation module according in the AR equipment visual field for the interaction of natural person's machine Object of observation adjust automatically data position of appearing and mode, and show the observation operation interface of virtualization, and AR backstages group Morphotype block then by the parameters index for obtaining industrial equipment, the to be received and real time data such as the instruction of AR equipment explained, The generation of configuration environment and more New function are completed in time.
As the skilled personnel can understand, interacted according to the outdoor scene enhanced of the above-mentioned embodiment of the present invention and be It is special that system at least includes identical with the outdoor scene enhanced interactive terminal of the above-mentioned embodiment according to the present invention or corresponding technology Levy, therefore also solve what the outdoor scene enhanced interactive terminal of the above-mentioned embodiment described above according to the present invention was solved Technical problem, and result in its beneficial effect obtained.
The above, is only the exemplary embodiment of the present invention, but protection scope of the present invention do not limit to In this, any one skilled in the art the invention discloses technical scope in, the change that can readily occur in or Replace, should all be included within the scope of the present invention.Therefore, protection scope of the present invention should be with the protection model of claim Enclose and be defined.

Claims (10)

1. a kind of industrial environment outdoor scene enhanced interactive terminal, it is characterised in that including:
AR equipment;
Intelligent positioning module, for the positional information of AR equipment described in real-time location tracking, while providing the physics of industrial equipment Service range;
Real-time data acquisition module, for gathering the real time data of the industrial equipment and being counted in real time to the industrial equipment According to feedback;And
Wireless communication module, for when the AR equipment enters in the range of the physical services of the industrial equipment, to the reality When the industrial equipment that is gathered of data acquisition module the real time data, carry out with the interaction data that the AR equipment is produced it is double To transmission, update to real-time continuous;
Wherein, the AR equipment includes AR backstages configuration module and AR outdoor scenes from adaptation module, and AR backstages configuration module is used In the parameters index and additional real time data that obtain the industrial equipment, while for receiving and explaining the AR equipment Instruction, to realize the generation and/or renewal of configuration environment;The AR outdoor scenes are used to catch the AR equipment visual field from adaptation module In actual observation object, the position of appearing and mode of the real time data for the industrial equipment that adjust automatically is gathered, display The observation operation interface of virtualization, is called and interfaceization shows the group for being generated and/or being updated by AR backstages configuration module State environment.
2. outdoor scene enhanced interactive terminal according to claim 1, it is characterised in that the real-time data acquisition module bag Include:
Data acquisition facility, the real time data for gathering the industrial equipment;And
Data feedback device, the feedback for carrying out real time data to the industrial equipment gathered.
3. outdoor scene enhanced interactive terminal according to claim 1 or 2, it is characterised in that the real-time data acquisition mould Block uses Wired access mode or wireless access way, and binds in network insertion the IP address of the industrial equipment.
4. outdoor scene enhanced interactive terminal according to claim 3, it is characterised in that the real-time data acquisition module point At least one that Cai Yong be in following Wired access mode or wireless access way:Serial ports, netting twine, WiFi, 2G/3G/4G.
5. outdoor scene enhanced interactive terminal according to claim 1 or 2, it is characterised in that the real-time data acquisition mould The network scheme of block uses the data access mode of the client of C/S frameworks or the web services of B/S frameworks.
6. outdoor scene enhanced interactive terminal according to claim 1 or 2, it is characterised in that the Intelligent positioning module is Using the locating module of the wireless location technology with networking Internet of Things.
7. outdoor scene enhanced interactive terminal according to claim 6, it is characterised in that the Intelligent positioning module use with The wireless location technology of lower band networking Internet of Things:Bluetooth wireless location technology, the service range for providing the industrial equipment;It is blue Tooth networking technology, is interconnected for many equipment and combined data is so as to provide the dummy node equipment of simulation industry spot.
8. outdoor scene enhanced interactive terminal according to claim 1 or 2, it is characterised in that the wireless communication module is adopted With communication plan based on bluetooth, and at least one side expanded in 2G/3G/4G, WiFi and LoRa communication plan Case, during in the service range for the control node equipment for entering the Intelligent positioning module in the AR equipment, by the AR The instruction of equipment is sent to the control node equipment according to related protocol, so as to enable the equipment control of the control node equipment Attribute processed, wherein the AR equipment use bluetooth based on communication plan, or expand to 2G/3G/4G, WiFi and At least one scheme in LoRa communication plans.
9. outdoor scene enhanced interactive terminal according to claim 1 or 2, it is characterised in that the AR outdoor scenes are adapted to mould certainly The configuration of block adjust automatically and selection configuration interface or General Purpose Interface, for showing the work gathered in the AR equipment The real time data of industry equipment.
10. a kind of industrial environment outdoor scene enhanced interactive system, it is characterised in that including following equipment:
Need the industrial equipment for carrying out real-time data acquisition and being fed back to it;And
Outdoor scene enhanced interactive terminal according to any one of claim 1-9 claim.
CN201710138192.6A 2017-03-09 2017-03-09 A kind of industrial environment outdoor scene enhanced interactive terminal and system Pending CN106953900A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710138192.6A CN106953900A (en) 2017-03-09 2017-03-09 A kind of industrial environment outdoor scene enhanced interactive terminal and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710138192.6A CN106953900A (en) 2017-03-09 2017-03-09 A kind of industrial environment outdoor scene enhanced interactive terminal and system

Publications (1)

Publication Number Publication Date
CN106953900A true CN106953900A (en) 2017-07-14

Family

ID=59466736

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710138192.6A Pending CN106953900A (en) 2017-03-09 2017-03-09 A kind of industrial environment outdoor scene enhanced interactive terminal and system

Country Status (1)

Country Link
CN (1) CN106953900A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107508737A (en) * 2017-08-10 2017-12-22 杰克缝纫机股份有限公司 Radio communication device and its communication means based on EtherCAT
CN107515674A (en) * 2017-08-08 2017-12-26 山东科技大学 It is a kind of that implementation method is interacted based on virtual reality more with the mining processes of augmented reality
CN108415386A (en) * 2018-03-12 2018-08-17 范业鹏 Augmented reality system and its working method for intelligent workshop
CN108809971A (en) * 2018-06-01 2018-11-13 广州亿图自动控制系统有限公司 A kind of opened industrial Internet of Things
CN109688450A (en) * 2017-10-19 2019-04-26 阿里巴巴集团控股有限公司 Multi-screen interaction method, device and electronic equipment
CN110347259A (en) * 2019-07-09 2019-10-18 北京猫眼视觉科技有限公司 A kind of method and system being presented IOT device data in AR application apparatus
CN113256836A (en) * 2021-04-27 2021-08-13 交通运输部天津水运工程科学研究所 Immersive intelligent inspection method for port facilities

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103823935A (en) * 2014-02-28 2014-05-28 武汉大学 Three-dimensional remote monitoring system for wind power plant
CN104486586A (en) * 2014-12-18 2015-04-01 深圳先进技术研究院 Disaster lifesaving simulated training method and system based on video map
CN104794583A (en) * 2015-04-30 2015-07-22 武汉光谷北斗控股集团有限公司 Perceptual mine internet-of-things model

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103823935A (en) * 2014-02-28 2014-05-28 武汉大学 Three-dimensional remote monitoring system for wind power plant
CN104486586A (en) * 2014-12-18 2015-04-01 深圳先进技术研究院 Disaster lifesaving simulated training method and system based on video map
CN104794583A (en) * 2015-04-30 2015-07-22 武汉光谷北斗控股集团有限公司 Perceptual mine internet-of-things model

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107515674A (en) * 2017-08-08 2017-12-26 山东科技大学 It is a kind of that implementation method is interacted based on virtual reality more with the mining processes of augmented reality
CN107508737A (en) * 2017-08-10 2017-12-22 杰克缝纫机股份有限公司 Radio communication device and its communication means based on EtherCAT
CN109688450A (en) * 2017-10-19 2019-04-26 阿里巴巴集团控股有限公司 Multi-screen interaction method, device and electronic equipment
CN108415386A (en) * 2018-03-12 2018-08-17 范业鹏 Augmented reality system and its working method for intelligent workshop
CN108809971A (en) * 2018-06-01 2018-11-13 广州亿图自动控制系统有限公司 A kind of opened industrial Internet of Things
CN110347259A (en) * 2019-07-09 2019-10-18 北京猫眼视觉科技有限公司 A kind of method and system being presented IOT device data in AR application apparatus
CN113256836A (en) * 2021-04-27 2021-08-13 交通运输部天津水运工程科学研究所 Immersive intelligent inspection method for port facilities

Similar Documents

Publication Publication Date Title
CN106953900A (en) A kind of industrial environment outdoor scene enhanced interactive terminal and system
CN105450654B (en) Smart home development platform and its business development method based on middleware Technology
CN110320873A (en) A kind of real-time three-dimensional presentation system based on distributed sensor
CN106595565A (en) BIM-based intelligent monitoring system
CN106301911A (en) Information Network based on SDN half centralized simulation platform in kind and its implementation
CN106776685A (en) A kind of information collecting method and system
CN103618382A (en) Transformer substation operation and maintenance integration field work data collection and field work instruction system
CN106899599A (en) A kind of industrial environment outdoor scene enhanced exchange method
CN109041012A (en) Base station selecting method and system based on integrated communication and computing capability
CN102427417A (en) System and method for remotely controlling Internet of things access equipment
CN102982209A (en) Space network visual simulation system and method based on HLA (high level architecture)
CN107248925A (en) A kind of collocation method of Radio Network System, configurating terminal and configuration system
CN107102833A (en) Line information interactive approach and electronic equipment
CN107948008A (en) A kind of modeling method for low-voltage network monitoring system
CN107770786A (en) A kind of method of testing of network performance, equipment and system
CN106953656A (en) A kind of intelligent terminal control intercom carries out the method and apparatus of information transfer
CN107818595A (en) Wearable Instant Interaction System
CN107483284A (en) The method of testing and device of the network equipment
CN104539722B (en) A kind of collection method of remote short-haul connections manipulation data
CN111710032A (en) Method, device, equipment and medium for constructing three-dimensional model of transformer substation
CN206894660U (en) A kind of system for being used to configure the wireless network of multiple equipment node
CN108908342A (en) Intelligent Mobile Robot and scheduling system business operations linkage system and method
CN109785199A (en) The service discovery method of Intelligent campus system and Intelligent campus based on scenario analysis
CN105357654B (en) A kind of emergency communication service system and its working method based on the Big Dipper
CN102647511A (en) Three-dimensional museum interaction system based on smartphone and interaction method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170714

RJ01 Rejection of invention patent application after publication