CN211236847U - Man-machine interaction system of electromechanical equipment on expressway based on AR technology - Google Patents
Man-machine interaction system of electromechanical equipment on expressway based on AR technology Download PDFInfo
- Publication number
- CN211236847U CN211236847U CN202020004649.1U CN202020004649U CN211236847U CN 211236847 U CN211236847 U CN 211236847U CN 202020004649 U CN202020004649 U CN 202020004649U CN 211236847 U CN211236847 U CN 211236847U
- Authority
- CN
- China
- Prior art keywords
- electromechanical device
- mobile terminal
- interaction system
- technology
- computer interaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
Abstract
The utility model provides a highway electromechanical device human-computer interaction system based on AR technique, the system includes mobile terminal and AR glasses, mobile terminal with electromechanical device communication connection is used for acquireing electromechanical device's operational data, AR glasses with mobile terminal connects, is used for with the data that mobile terminal acquireed show. The utility model adopts the AR technology, the mobile terminal is connected with the electromechanical device in a wireless mode, the data to be displayed is projected into the AR glasses, the display information is not limited by the size and the installation position of the electromechanical device, and the AR glasses have the advantages of large display information amount and convenient data reading; meanwhile, the maintainers can freely move within a certain range, hands of the maintainers are completely liberated, equipment is convenient to overhaul, and working efficiency is improved.
Description
Technical Field
The utility model relates to a highway equipment field, concretely relates to highway electromechanical device human-computer interaction system based on AR technique.
Background
The electromechanical equipment on the highway is various and huge in quantity. Because the highway electromechanical equipment is often installed in a centralized manner by a plurality of pieces of equipment when being installed, the size of the installation position of single equipment is small, so that most highway electromechanical equipment does not provide man-machine interaction equipment such as a display screen, a keyboard and the like, the running state of the equipment is displayed only by a state indicator lamp installed on the equipment, and the quantity of information which can be directly acquired by maintenance personnel according to the state indicator lamp is very small. If the maintenance personnel want to acquire more equipment operation data, the maintenance personnel need to be connected with a computer or other terminal display equipment through serial port lines, network cables or USB connecting lines and the like to realize human-computer interaction. When maintenance personnel need to overhaul or maintain the equipment, on one hand, the length of the connecting line is limited, and the movable range of a computer or other terminal display equipment is limited; on the other hand, when maintenance personnel need observe equipment running state data at any time, hand-held computers or other terminal display devices are needed, so that both hands of the maintenance personnel are bound, flexible operation of the maintenance personnel is not facilitated, and the working efficiency of the maintenance personnel is reduced.
The invention patent application with application number 201810514954.2 discloses a hybrid augmented reality human-computer interaction system, which is realized based on networked industrial equipment, wherein the industrial equipment is provided with an identification code and comprises an AR control device for controlling the industrial equipment and an interaction device for interaction between a user and the AR control device. The man-machine interaction system effectively improves the system reliability, stability, flexibility and high efficiency in the man-machine interaction operation link, improves the man-machine interaction operation efficiency between a user and the AR control device while realizing the man-machine interaction mode function of the augmented reality system for the industrial field environment, and is suitable for the man-machine interaction between any user and the AR control device. However, the display system of the above-mentioned human-computer interaction system adopts an AR billboard system (such as a display screen of a portable AR terminal, a monitor screen of a working condition site, etc.) or an AR remote monitoring system, and a user accesses the AR service network of the industrial site through the second input device of the AR billboard system or the AR remote monitoring system on site by means of an AR camera installed in the industrial site, and similarly, the user cannot observe the display device at any time without being affected by a moving range, and can liberate both hands, thereby improving the working efficiency.
SUMMERY OF THE UTILITY MODEL
The utility model discloses there is running state and the inconvenient human-computer interaction problem of data reading to highway electromechanical device, provide a highway electromechanical device human-computer interaction system based on AR technique to realize that maintainer can observe the concrete operating parameter of equipment at any time and do not receive the influence of migration range, and can not produce the constraint to both hands, improve maintainer work efficiency.
The man-machine interaction system for the electromechanical equipment on the highway based on the AR technology comprises a mobile terminal and AR glasses, wherein the mobile terminal is in communication connection with the electromechanical equipment and used for acquiring the operation data of the electromechanical equipment, and the AR glasses are connected with the mobile terminal and used for displaying the data acquired by the mobile terminal.
Preferably, the mobile terminal is provided with a first information acquisition module for acquiring the device identifier on the electromechanical device.
Preferably in any of the above schemes, the first information acquisition module includes at least one of a camera and a touch screen.
In any of the above schemes, preferably, the mobile terminal is further provided with a wireless communication module, configured to wirelessly communicate with the electromechanical device.
In any of the above schemes, preferably, the wireless communication module includes at least one of a bluetooth communication module, a WiFi communication module, and a Zigbee communication module.
In any of the above schemes, preferably, the mobile terminal and the AR glasses are both provided with a data interface for performing wired communication.
Preferably, in any of the above schemes, the data interface includes at least one of a Lighting interface, a Micro-USB data interface, a Mini-USB data interface, and a Type-C data interface.
Preferably in any of the above schemes, the AR glasses include a second information collecting module, configured to collect a device identifier on the electromechanical device.
In any of the above schemes, preferably, the second information acquisition module includes a camera.
Preferably, in any of the above schemes, the AR glasses further include a third information acquisition module for acquiring a voice control command.
In any of the above schemes, preferably, the third information collecting module includes a microphone.
Preferably, in any of the above schemes, the AR glasses further include a screen for displaying data acquired by the mobile terminal.
In any of the above schemes, preferably, the device identifier includes at least one of a two-dimensional code, a barcode, and an identification number.
Preferably, in any of the above schemes, the second information collecting module of the AR glasses collects an equipment identifier, and the mobile terminal obtains the equipment identifier.
Preferably, in any of the above schemes, the third information acquisition module of the AR glasses acquires the voice control command, and the mobile terminal acquires the voice control command.
Preferably, in any of the above solutions, the mobile terminal identifies the type of the electromechanical device according to the device identifier, and invokes a corresponding communication protocol according to the identified device type to receive and analyze the operation data of the electromechanical device.
Preferably, in any of the above schemes, the mobile terminal switches the display interface of the AR glasses according to the identified device type.
Preferably, in any of the above schemes, the mobile terminal performs corresponding control according to the voice control command, where the voice control command includes at least one of display menu switching, data input, parameter setting, and data storage.
Preferably, in any of the above schemes, the mobile terminal is further connected to a server, and is configured to send the received data to the server for storage.
The utility model discloses a highway electromechanical device man-machine interaction system based on AR technique adopts AR technique, and mobile terminal is connected with electromechanical device through wireless mode, projects the data that need show in the AR glasses, and the display information does not receive electromechanical device size and mounted position's restriction, has that the volume of display information is big, data reading is convenient advantage; meanwhile, the maintainers can freely move within a certain range, hands of the maintainers are completely liberated, equipment is convenient to overhaul, and working efficiency is improved.
Drawings
Fig. 1 is a schematic structural diagram of a preferred embodiment of a man-machine interaction system of an electromechanical device on a highway based on AR technology according to the present invention.
Fig. 2 is a schematic structural diagram of an AR glasses of the man-machine interaction system of the highway electromechanical device based on the AR technology according to the present invention.
Fig. 3A is a schematic front structural diagram of a mobile terminal of a man-machine interaction system of an electromechanical device on a highway based on AR technology according to the present invention.
Fig. 3B is a schematic side view of a mobile terminal of a man-machine interaction system of an electromechanical device on a highway based on AR technology according to the present invention.
Fig. 4 is a schematic structural diagram of another embodiment of the man-machine interaction system of the highway electromechanical device based on the AR technology according to the present invention.
Fig. 5 is a schematic workflow diagram of the man-machine interaction system of the highway electromechanical device based on the AR technology according to the embodiment of the present invention as shown in fig. 1.
Detailed Description
For a better understanding of the present invention, reference will now be made in detail to the present invention with reference to the following examples.
Example 1
As shown in fig. 1, the man-machine interaction system for the electromechanical device on the highway based on the AR technology includes a mobile terminal 11 and AR glasses 12, where the mobile terminal 11 is in communication connection with the electromechanical device 10 and is used to acquire operation data of the electromechanical device 10, and the AR glasses 12 are connected with the mobile terminal 11 and are used to display the data acquired by the mobile terminal 11.
The mobile terminal 11 is provided with a first information acquisition module, and is used for acquiring an equipment identifier on the electromechanical equipment 10. The mobile terminal 11 is further provided with a wireless communication module, and after the identification of the electromechanical device 10 is obtained, the mobile terminal 11 and the electromechanical device 10 are in communication pairing through the wireless communication module. The wireless communication module comprises at least one of a Bluetooth communication module, a WiFi communication module and a Zigbee communication module, namely a GSM communication module.
The mobile terminal 11 and the AR glasses 12 are both provided with data interfaces for performing wired communication.
The AR glasses 12 further include a second information acquisition module and a third information acquisition module, where the second information acquisition module is used to acquire an equipment identifier on the electromechanical device 10, and includes a camera; the third information acquisition module is used for acquiring voice control commands and comprises a microphone. The AR glasses 12 further include a screen for displaying data acquired by the mobile terminal 11.
The man-machine interaction system of the highway electromechanical equipment based on the AR technology further comprises a server 13, and the server 13 is connected with the mobile terminal 11.
As shown in fig. 2, a data interface 21 and a third information acquisition module 22 are disposed at a right side of the AR glasses, and the third information acquisition module 22 includes a microphone for acquiring a voice control command; the second information acquisition module 23 is arranged on a beam right in front of the electromechanical device, and the second information acquisition module 23 comprises a camera and is used for acquiring the device identifier on the electromechanical device 10; and a screen 24 is arranged on the left side of the mobile terminal and used for displaying the electromechanical device operation data acquired by the mobile terminal 11.
The AR glasses are only used as an information display window, a battery, a data storage component and a data processing component are not arranged in the AR glasses, and the functions of power supply, data storage, data processing and voice control command recognition are realized by the mobile terminal 11 connected with the AR glasses, so that the weight of the AR glasses can be reduced to the maximum extent, the heating value is reduced, and the wearing comfort level is improved.
As shown in fig. 3A and 3B, the mobile terminal 11 includes a first information collection module, the first information collection module includes a touch screen 35, an electromechanical device identification number can be input on the touch screen 35, the first information collection module further includes a camera, and a two-dimensional code or a barcode of the electromechanical device 10 can be collected by the camera to obtain an electromechanical device identification. The mobile terminal 11 is further provided with a permission verification key 31, a speaker hole 32, a first indicator light 33 and a second indicator light 34 around the touch screen 35. The permission verification key 31 collects fingerprints of a user and is used for verifying the identity of the user, the mobile terminal can be opened only by an authorized user, the loudspeaker 32 is used for voice reminding, the first indicator light 33 is used for displaying the communication state of the mobile terminal and the electromechanical device, and the second indicator light 34 is used for displaying the connection state of the mobile terminal and the AR glasses. The data interface is arranged at the bottom of the mobile terminal 11 and used for being connected with the AR glasses 12, the data interface comprises a Type-C data interface 36, and the Type-C data interface 36 can be replaced by other types of data interfaces, such as one or more of Lighting interface, Micro-USB data interface and Mini-USB data interface. The mobile terminal 11 is further provided with a printing paper outlet 38 and a printing paper replacing port 37, and after the user finishes using the mobile terminal, the user prints and attaches the use information to the electromechanical device, wherein the use information includes one or more of user identity information, use time, connected electromechanical device number, electromechanical device state and the like.
When the man-machine interaction system of the electromechanical device on the highway based on the AR technology is used, firstly, the two-dimensional code or the bar code of the electromechanical device is acquired through the camera of the first information acquisition unit on the mobile terminal 11, or the identification number of the electromechanical device is directly input into the touch screen 35, or the two-dimensional code or the bar code of the electromechanical device is acquired through the second information acquisition module 23 on the AR glasses, and the mobile terminal 11 can directly acquire the two-dimensional code or the bar code of the electromechanical device acquired by the second information acquisition module through the data interface. After acquiring the electromechanical device identification code, the mobile terminal 11 establishes communication pairing with the electromechanical device, identifies the type of the electromechanical device 10 according to the device identification, calls a corresponding communication protocol according to the identified device type to receive and analyze the operation data of the electromechanical device, switches the display interface of the AR glasses according to the identified device type, and finally controls the AR glasses to display the analyzed operation data of the device. In the using process, a user can send a voice control instruction, the third information acquisition module 22 acquires the voice control command, the mobile terminal 11 directly acquires the voice control command acquired by the third information acquisition module 22 through the data interface, the mobile terminal 11 performs corresponding control according to the voice control command, and the voice control command comprises at least one of display menu switching, data input, parameter setting and data storage.
The mobile terminal 11 also transmits the received data to a server for storage through wireless communication.
Example 2
The difference between the man-machine interaction system based on the AR technology and the man-machine interaction system of the highway electromechanical device in the embodiment 1 is that the mobile terminal 11 directly adopts a smart phone or a tablet computer, and the smart phone or the tablet computer is internally provided with an APP for executing corresponding functions.
Use during the highway electromechanical device man-machine interaction system based on AR technique, open APP, then gather through text input or the mode that the camera gathered two-dimensional code or bar code electromechanical device's equipment sign, mobile terminal 11 with electromechanical device establishes communication pairing, discerns electromechanical device type, invokes corresponding communication protocol analytic data, switches the display interface of AR glasses shows the data through the analysis.
Different from the embodiment 1, the mobile terminal directly adopts a smart phone or a tablet computer, and does not have a function of directly printing the use information, nor a function of displaying the communication or connection state. The authority verification function can be realized by inputting a user name and a password into the APP.
Example 3
As shown in fig. 5, the workflow of the man-machine interaction system of the highway electromechanical device based on the AR technology includes the steps of:
s1, the mobile terminal identifies the type of the electromechanical equipment according to the equipment identification of the electromechanical equipment;
s2, the mobile terminal calls a corresponding communication protocol according to the identified equipment type;
s3, switching the display interface of the AR glasses by the mobile terminal according to the identified equipment identifier;
and S4, the mobile terminal receives the operation data of the electromechanical equipment, analyzes the data according to the communication protocol and displays the data through the AR glasses.
The step S1 is preceded by the step S01: the first information acquisition module acquires the device identifier of the electromechanical device, or step S02: and the second information acquisition module acquires the equipment identifier of the electromechanical equipment, and the mobile terminal acquires the equipment identifier.
In step S1, the mobile terminal acquires the device identifier, establishes a communication pairing with the mechatronic device, and starts data communication.
The step S4 is followed by a step S5: and the mobile terminal sends the received data to a server for storage.
The working process of the man-machine interaction system of the electromechanical equipment on the highway based on the AR technology further comprises the following steps: and the third information acquisition module acquires a voice control command, the mobile terminal acquires the language control command, and the mobile terminal performs corresponding control according to the voice control command.
It should be noted that the technical solutions of the present application all relate to improvements in hardware, and do not relate to improvements in software; for each part without the indicated model, the part can be selected from common parts in the prior art and is not limited by the model; the components of the embodiments are indicated by the models, which are only used for describing the technical scheme of the application in detail, and it should be understood that the technical scheme to be protected by the invention is not limited by the models, and the prior art has many alternatives for replacing the components.
The above embodiments are only used for illustrating the technical solution of the present invention, and not for limiting the same; although the foregoing embodiments illustrate the present invention in detail, those skilled in the art will appreciate that: it is possible to modify the solutions described in the foregoing embodiments or to substitute some or all of the technical features thereof, without departing from the scope of the present invention.
Claims (13)
1. The utility model provides a highway electromechanical device man-machine interaction system based on AR technique, includes mobile terminal, its characterized in that: the mobile terminal is in communication connection with the electromechanical device and used for acquiring the operating data of the electromechanical device, and the AR glasses are connected with the mobile terminal and used for displaying the data acquired by the mobile terminal.
2. The AR technology-based highway electromechanical device human-computer interaction system of claim 1, wherein: the mobile terminal is provided with a first information acquisition module for acquiring the equipment identifier on the electromechanical equipment.
3. The AR technology-based highway electromechanical device human-computer interaction system of claim 2, wherein: the first information acquisition module comprises at least one of a camera and a touch screen.
4. The AR technology-based highway electromechanical device human-computer interaction system of claim 2, wherein: the mobile terminal is also provided with a wireless communication module for carrying out wireless communication with the electromechanical equipment.
5. The AR technology-based highway electromechanical device human-computer interaction system of claim 4, wherein: the wireless communication module comprises at least one of a Bluetooth communication module, a WiFi communication module and a Zigbee communication module.
6. The AR technology-based highway electromechanical device human-computer interaction system of claim 1, wherein: the mobile terminal and the AR glasses are provided with data interfaces for wired communication.
7. The AR technology-based highway electromechanical device human-computer interaction system of claim 6, wherein: the data interface comprises at least one of a Lighting interface, a Micro-USB data interface, a Mini-USB data interface and a Type-C data interface.
8. The AR technology-based highway electromechanical device human-computer interaction system of claim 6, wherein: the AR glasses comprise a second information acquisition module used for acquiring the equipment identification on the electromechanical equipment.
9. A highway electromechanical device human-computer interaction system based on AR technology as recited in claim 8, wherein: the second information acquisition module comprises a camera.
10. A highway electromechanical device human-computer interaction system based on AR technology as recited in claim 8, wherein: the AR glasses further comprise a third information acquisition module used for acquiring voice control commands.
11. A highway electromechanical device human-computer interaction system based on AR technology as recited in claim 10, wherein: the third information acquisition module comprises a microphone.
12. A highway electromechanical device human-computer interaction system based on AR technology as recited in claim 10, wherein: the AR glasses further comprise a screen used for displaying the data acquired by the mobile terminal.
13. A highway electromechanical device human-computer interaction system based on AR technology as recited in claim 2 or 8 wherein: the equipment identification comprises at least one of a two-dimensional code, a bar code and an identification number.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202020004649.1U CN211236847U (en) | 2020-01-02 | 2020-01-02 | Man-machine interaction system of electromechanical equipment on expressway based on AR technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202020004649.1U CN211236847U (en) | 2020-01-02 | 2020-01-02 | Man-machine interaction system of electromechanical equipment on expressway based on AR technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN211236847U true CN211236847U (en) | 2020-08-11 |
Family
ID=71941470
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202020004649.1U Active CN211236847U (en) | 2020-01-02 | 2020-01-02 | Man-machine interaction system of electromechanical equipment on expressway based on AR technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN211236847U (en) |
-
2020
- 2020-01-02 CN CN202020004649.1U patent/CN211236847U/en active Active
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101047899B1 (en) | User interface automatic generation and industrial facility controlling system using portable terminal | |
| CN102804211B (en) | Messaging device, information processing system, information processing method and message handling program | |
| CN112651126B (en) | BIM-based construction engineering construction optimization system, method, terminal and storage medium | |
| CN105719462A (en) | Industrial equipment control system based on multi-terminal personal hotspot control and industrial equipment control method | |
| CN101916507A (en) | Bridge health monitoring system | |
| CN102272724A (en) | System and method for remote monitoring and control of field device | |
| CN103248874B (en) | Job site wireless portable data acquiring and transmission system headend equipment | |
| CN104090549A (en) | Remote water supply control system | |
| CN109597475A (en) | A kind of server power supply information processing method, apparatus and system | |
| CN116112341B (en) | Network equipment detection method and device, electronic equipment and storage medium | |
| CN110515793A (en) | System performance monitoring method, device, equipment and storage medium | |
| JP2013218559A (en) | Air conditioner management device, air conditioner management program and air conditioner management system | |
| CN111240473A (en) | Man-machine interaction system and method for highway electromechanical equipment based on AR technology | |
| CN211236847U (en) | Man-machine interaction system of electromechanical equipment on expressway based on AR technology | |
| CN203882342U (en) | Back brake operation order safe execution system | |
| CN107797526B (en) | On-site equipment detecting and managing system | |
| CN101015212B (en) | Method and automation system for monitoring at least one facility component of a technical facility | |
| CN102608972A (en) | Remote monitoring method for wine cabinets | |
| CN112987597B (en) | FSU control method, device, equipment and computer readable storage medium | |
| CN209517518U (en) | Intelligent operation management case and intelligent operation management system | |
| CN205050186U (en) | Real -time automatic system of booking rooms | |
| CN104122849A (en) | Computer room wireless monitoring method and system, handheld device and computer room device | |
| CN114167820A (en) | Internet of things terminal rapid debugging and testing system and method | |
| CN103207582A (en) | Wireless paperless recording instrument based on 3G (third-generation telecommunication)/Beidou satellite communication technology | |
| CN203165187U (en) | Wireless data acquisition device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |