CN115827750A - Inspection robot remote control system and method based on natural semantic recognition - Google Patents
Inspection robot remote control system and method based on natural semantic recognition Download PDFInfo
- Publication number
- CN115827750A CN115827750A CN202211359834.2A CN202211359834A CN115827750A CN 115827750 A CN115827750 A CN 115827750A CN 202211359834 A CN202211359834 A CN 202211359834A CN 115827750 A CN115827750 A CN 115827750A
- Authority
- CN
- China
- Prior art keywords
- control system
- voice
- remote control
- robot
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Manipulator (AREA)
Abstract
The invention discloses an inspection robot remote control system based on natural semantic recognition, which comprises voice interaction equipment, an inspection robot, a remote control system and a database; the voice interaction device is used for sending the collected voice data to a natural semantic recognition module of the remote control system and playing the received voice data sent by a voice conversion module of the remote control system. The voice-based patrol robot behavior control system gives full play to the convenience of voice, realizes the behavior control of the patrol robot through voice, effectively avoids the problems of multiple operation steps, long flow, multiple control items and the like of manual driving, and greatly improves the working efficiency; the invention can realize the increase and maintenance of the control instruction without completely modifying programs such as a page, a background interface and the like of the remote control system, thereby greatly reducing the cost of system development and upgrading maintenance.
Description
Technical Field
The invention relates to the technical field of intelligent operation and maintenance of transformer substations, in particular to a patrol robot remote control system and method based on natural semantic recognition.
Background
Along with the continuous construction of novel electric power system, the daily fortune of electric power unit such as transformer substation, distribution substation is also gradually to digitization, intelligent development, and daily work of patrolling and examining is accomplished to the electric power unit such as more and more transformer substations, distribution substation adoption robot of patrolling and examining to this realizes reducing personnel's dependence and whole operation cost's effect. However, the remote control of the inspection robot usually adopts a gesture driving mode at present, thereby bringing the following problems:
1) Because the remote control robot has more operation steps, long flow and more control items, the remote control robot is undoubtedly low in efficiency and very inconvenient for operation and maintenance personnel who often need to adjust the motion mode, destination and behavior of the inspection robot;
2) As long as the remote control items of the robot are increased, modified and the like, programs such as pages, background interfaces and the like of the remote control system are comprehensively modified, not only needs various developers to coordinate and complete, but also increases the difficulty of upgrading and maintaining.
There is currently no effective solution to the above problems.
Disclosure of Invention
Aiming at the technical problems in the related art, the invention provides a system and a method for remotely controlling an inspection robot based on natural semantic recognition, which can overcome the defects in the prior art.
In order to achieve the technical purpose, the technical scheme of the invention is realized as follows:
a remote inspection robot control system based on natural semantic recognition comprises voice interaction equipment, an inspection robot, a remote control system and a database;
the voice interaction equipment is used for sending the collected voice data to a natural semantic recognition module of the remote control system and playing the received voice data sent by a voice conversion module of the remote control system;
the inspection robot comprises a robot control device, wherein the robot control device is used for receiving a control instruction and parameters sent by an instruction sending module of a remote control system, driving the robot to act according to the instruction and returning a result to the instruction sending module of the remote control system;
the remote control system comprises an instruction management module, a natural semantic recognition module, a voice conversion module, a parameter management module and an instruction sending module; the remote control system is used for carrying out natural semantic recognition on voice data acquired by the voice interaction equipment, generating semantic text information at the same time, converting the recognized key information into a robot control instruction and parameters, sending the robot control data to the inspection robot, receiving a control result sent back by the robot, storing the control result in a database, converting the control result into voice and playing the voice to operation and maintenance personnel through the voice interaction equipment;
the database is used for storing information such as voice, semantic text, robot control instructions and the like.
Further, the voice interaction device includes a microphone and a speaker.
A remote inspection robot control method based on natural semantic recognition comprises the following steps:
s1, maintenance personnel maintain voice instructions and parameters through an instruction management module of a remote control system and establish a mapping relation with control instructions and parameters of robot control equipment;
s2, the operation and maintenance personnel maintain the control result codes and the corresponding natural semantics through a parameter management module of the remote control system;
s3, the operation and maintenance personnel open the remote control system, submit operator information and successfully log in;
s4, the remote control system automatically sets the voice interaction equipment to be in an opening state;
s5, the operation and maintenance personnel send voice to the voice interaction equipment;
s6, the voice interaction equipment sends the voice data collected by the microphone to a remote control system;
s7, the remote control system receives the voice data, identifies the voice data through a natural semantic identification module, and converts the identified voice command and parameters into robot control commands and parameters;
s8, the remote control system sends a robot control instruction and parameters to the robot control equipment through the instruction sending module;
s9, the inspection robot receives a control instruction and parameters sent by the remote control system through the robot control equipment, drives the robot to act according to the instruction, and returns the result to the remote control system;
s10, the remote control system receives the control result and stores the control result in a database, and the control result is converted into natural semantic data according to a preset mapping relation;
s11, the remote control system converts the natural semantic data of the control result into voice data through a voice conversion module and sends the voice data to voice interaction equipment;
s12, the voice interaction equipment receives voice data sent by the remote control system and plays the voice data through a loudspeaker.
The invention has the beneficial effects that: the voice-based patrol robot behavior control system gives full play to the convenience of voice, realizes the behavior control of the patrol robot through voice, effectively avoids the problems of multiple operation steps, long flow, multiple control items and the like of manual driving, and greatly improves the working efficiency; the invention can realize the increase and maintenance of the control instruction without completely modifying programs such as a page, a background interface and the like of the remote control system, thereby greatly reducing the cost of system development and upgrading maintenance.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required in the embodiments will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a block diagram of a remote inspection robot control system based on natural semantic recognition according to an embodiment of the invention;
fig. 2 is a flow chart of a remote inspection robot control method based on natural semantic recognition according to an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present invention.
As shown in fig. 1, the inspection robot remote control system based on natural semantic recognition according to the embodiment of the present invention includes a voice interaction device, an inspection robot, a remote control system, and a database;
the voice interaction equipment is used for sending the collected voice data to a natural semantic recognition module of the remote control system and playing the received voice data sent by a voice conversion module of the remote control system;
the inspection robot comprises a robot control device, wherein the robot control device is used for receiving a control instruction and parameters sent by an instruction sending module of a remote control system, driving the robot to act according to the instruction and returning the result to the instruction sending module of the remote control system;
the remote control system comprises an instruction management module, a natural semantic recognition module, a voice conversion module, a parameter management module and an instruction sending module; the remote control system is used for carrying out natural semantic recognition on voice data acquired by the voice interaction equipment, generating semantic text information at the same time, converting the recognized key information into a robot control instruction and parameters, sending the robot control data to the inspection robot, receiving a control result sent back by the robot, storing the control result in a database, converting the control result into voice and playing the voice to operation and maintenance personnel through the voice interaction equipment;
the database is used for storing information such as voice, semantic text, robot control instructions and the like.
In an embodiment, the voice interaction device comprises a microphone and a speaker.
As shown in fig. 2, the inspection robot remote control method based on natural semantic recognition according to the embodiment of the present invention includes the following steps:
s1, maintenance personnel maintain voice instructions and parameters through an instruction management module of a remote control system and establish a mapping relation with control instructions and parameters of robot control equipment;
s2, the operation and maintenance personnel maintain the control result codes and the corresponding natural semantics through a parameter management module of the remote control system;
s3, the operation and maintenance personnel open the remote control system, submit operator information and successfully log in;
s4, the remote control system automatically sets the voice interaction equipment to be in an opening state;
s5, the operation and maintenance personnel send voice to the voice interaction equipment;
s6, the voice interaction equipment sends the voice data collected by the microphone to a remote control system;
s7, the remote control system receives the voice data, identifies the voice data through a natural semantic identification module, and converts the identified voice command and parameters into robot control commands and parameters;
s8, the remote control system sends a robot control instruction and parameters to the robot control equipment through the instruction sending module;
s9, the inspection robot receives a control instruction and parameters sent by the remote control system through the robot control equipment, drives the robot to act according to the instruction, and returns the result to the remote control system;
s10, the remote control system receives the control result and stores the control result in a database, and the control result is converted into natural semantic data according to a preset mapping relation;
s11, the remote control system converts the natural semantic data of the control result into voice data through a voice conversion module and sends the voice data to voice interaction equipment;
s12, the voice interaction equipment receives voice data sent by the remote control system and plays the voice data through a loudspeaker.
In order to facilitate understanding of the above-described technical aspects of the present invention, the above-described technical aspects of the present invention will be described in detail below in terms of specific usage.
When the inspection robot remote control system is used specifically, the inspection robot remote control system based on natural semantic recognition comprises the following components: 4 parts such as voice interaction equipment, robot control equipment, remote control system, database and the like, wherein fig. 1 is a structural relationship diagram of each component, and the specific function description is as follows:
1. the voice interaction equipment comprises a microphone and a loudspeaker, wherein the microphone collects the voice of the operation and maintenance personnel, and the loudspeaker plays the control result voice;
2. the robot control equipment is used for receiving a control instruction and parameters sent by the remote control system, driving the robot to act according to the instruction and returning the result to the remote control system;
3. the database is used for storing information such as voice, semantic text, robot control instructions and the like;
4. and the remote control system is used for carrying out natural semantic recognition on the operation and maintenance personnel voice collected by the voice interaction equipment, converting the recognized key information into a robot control instruction and parameters, sending the robot control data to the inspection robot, receiving a control result sent back by the robot, storing the control result into a database, converting the control result into voice and playing the voice to the operation and maintenance personnel through the voice interaction equipment.
A flow chart of a patrol robot remote control method based on natural semantic recognition is shown in fig. 2, and a specific control flow is described as follows:
1. the operation and maintenance personnel maintain the voice command and the parameters through a command management module of the remote control system and establish a mapping relation with the robot control command and the parameters;
2. the operation and maintenance personnel maintain the control result codes and the corresponding natural semantics through a parameter management module of the remote control system;
3. the operation and maintenance personnel open the remote control system, submit the operator information and successfully log in;
4. the remote control system automatically sets the voice interaction equipment to be in an opening state;
5. the operation and maintenance personnel send voice to the voice interaction equipment;
6. the voice interaction equipment is used for sending the voice data acquired by the microphone to the remote control system;
7. the remote control system receives the voice data, identifies the voice data through the natural semantic identification module, and converts the identified voice command and parameter into a robot control command and parameter;
8. the remote control system sends a robot control instruction and parameters to the robot control equipment through the instruction sending module;
9. the inspection robot receives the control instruction and the parameters sent by the remote control system through the robot control equipment, drives the robot to act according to the instruction and returns the result to the remote control system;
10. the remote control system receives the control result, stores the control result in the database and converts the control result into natural semantic data according to a preset mapping relation;
11. the remote control system converts the natural semantic data of the control result into voice data through the voice conversion module and sends the voice data to the voice interaction equipment;
12. and the voice interaction equipment receives the voice data sent by the remote control system and plays the voice data through a loudspeaker.
In conclusion, by means of the technical scheme, the voice convenience is fully exerted, the behavior control of the inspection robot is realized through voice, the problems of multiple operation steps, long flow, multiple control items and the like of manual driving are effectively solved, and the working efficiency is greatly improved; meanwhile, the increase and maintenance of control instructions can be realized under the condition that programs such as pages, background interfaces and the like of the remote control system are not comprehensively modified, and the system development and upgrading maintenance cost is greatly reduced.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (3)
1. A remote inspection robot control system based on natural semantic recognition is characterized by comprising voice interaction equipment, an inspection robot, a remote control system and a database;
the voice interaction equipment is used for sending the collected voice data to a natural semantic recognition module of the remote control system and playing the received voice data sent by a voice conversion module of the remote control system;
the inspection robot comprises a robot control device, wherein the robot control device is used for receiving a control instruction and parameters sent by an instruction sending module of a remote control system, driving the robot to act according to the instruction and returning the result to the instruction sending module of the remote control system;
the remote control system comprises an instruction management module, a natural semantic recognition module, a voice conversion module, a parameter management module and an instruction sending module; the remote control system is used for carrying out natural semantic recognition on voice data acquired by the voice interaction equipment, generating semantic text information at the same time, converting the recognized key information into a robot control instruction and parameters, sending the robot control data to the inspection robot, receiving a control result sent back by the robot, storing the control result in a database, converting the control result into voice and playing the voice to operation and maintenance personnel through the voice interaction equipment;
the database is used for storing voice, semantic text and robot control instruction information.
2. The inspection robot remote control system based on natural semantic recognition of claim 1, wherein the voice interaction device comprises a microphone and a speaker.
3. A remote inspection robot control method based on natural semantic recognition is characterized by comprising the following steps:
s1, maintenance personnel maintain voice instructions and parameters through an instruction management module of a remote control system and establish a mapping relation with control instructions and parameters of robot control equipment;
s2, the operation and maintenance personnel maintain the control result codes and the corresponding natural semantics through a parameter management module of the remote control system;
s3, the operation and maintenance personnel open the remote control system, submit the information of the operator and successfully log in;
s4, the remote control system automatically sets the voice interaction equipment to be in an opening state;
s5, the operation and maintenance personnel send voice to the voice interaction equipment;
s6, the voice interaction equipment sends the voice data collected by the microphone to a remote control system;
s7, the remote control system receives the voice data, identifies the voice data through a natural semantic identification module, and converts the identified voice command and parameters into robot control commands and parameters;
s8, the remote control system sends a robot control instruction and parameters to the robot control equipment through the instruction sending module;
s9, the inspection robot receives a control instruction and parameters sent by the remote control system through the robot control equipment, drives the robot to act according to the instruction, and returns the result to the remote control system;
s10, the remote control system receives the control result and stores the control result in a database, and the control result is converted into natural semantic data according to a preset mapping relation;
s11, the remote control system converts the natural semantic data of the control result into voice data through a voice conversion module and sends the voice data to voice interaction equipment;
s12, the voice interaction equipment receives voice data sent by the remote control system and plays the voice data through a loudspeaker.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211359834.2A CN115827750A (en) | 2022-11-02 | 2022-11-02 | Inspection robot remote control system and method based on natural semantic recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211359834.2A CN115827750A (en) | 2022-11-02 | 2022-11-02 | Inspection robot remote control system and method based on natural semantic recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115827750A true CN115827750A (en) | 2023-03-21 |
Family
ID=85526142
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211359834.2A Pending CN115827750A (en) | 2022-11-02 | 2022-11-02 | Inspection robot remote control system and method based on natural semantic recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115827750A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117975968A (en) * | 2024-04-02 | 2024-05-03 | 四川金信石信息技术有限公司 | Remote patrol system control method and system based on sound and language model |
-
2022
- 2022-11-02 CN CN202211359834.2A patent/CN115827750A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117975968A (en) * | 2024-04-02 | 2024-05-03 | 四川金信石信息技术有限公司 | Remote patrol system control method and system based on sound and language model |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN203038075U (en) | Android phone and computer based remote voice intelligent control system | |
| CN103985382A (en) | Power grid dispatching auxiliary interactive method based on speech recognition technology | |
| CN106371801A (en) | Voice mouse system based on voice recognition technology | |
| CN115827750A (en) | Inspection robot remote control system and method based on natural semantic recognition | |
| CN106847285A (en) | A kind of robot and its audio recognition method | |
| CN113314106A (en) | Electric power information query and regulation function calling method based on voice and intention recognition | |
| CN111429915A (en) | Scheduling system and scheduling method based on voice recognition | |
| CN111179928A (en) | Intelligent control method for power transformation and distribution station based on voice interaction | |
| CN113140219A (en) | Regulation and control instruction generation method and device, electronic equipment and storage medium | |
| CN109509468A (en) | A kind of equipment executes the method and device of voice broadcast task | |
| CN111384778B (en) | Intelligent operation and maintenance system for power distribution network equipment | |
| CN113990324A (en) | Voice intelligent home control system | |
| CN107635178A (en) | A kind of pull bar audio amplifier with identification phonetic function | |
| CN110728980A (en) | Intelligent service bus system based on voice and conversation robot | |
| CN111161727A (en) | Artificial intelligence barrier-free control system | |
| CN110232918A (en) | A kind of UAV ground control station's speech control system and control method | |
| CN213461246U (en) | Automatic intelligent robot on duty device of electric wire netting dispatch | |
| CN101753095B (en) | Talking frequency changer and frequency changer system | |
| CN210896535U (en) | Automatic guide and explanation device for museum | |
| CN2459694Y (en) | USB based multi-function remote controller | |
| CN218481867U (en) | Fire alarm controller interface circuit with voice recognition function | |
| CN206575440U (en) | The Voice command terminal used cooperatively with Intelligent wireless router | |
| CN110349576A (en) | Power system operation instruction executing method, apparatus and system based on speech recognition | |
| CN206833233U (en) | A kind of intelligent domestic system with phonetic order transimiison analysis function | |
| CN109961788A (en) | The speech-sound intelligent assistant devices and speech control system of wind-powered electricity generation central monitoring system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |