CN115019411A - Routing inspection system and method based on voice interaction - Google Patents
Routing inspection system and method based on voice interaction Download PDFInfo
- Publication number
- CN115019411A CN115019411A CN202210505027.0A CN202210505027A CN115019411A CN 115019411 A CN115019411 A CN 115019411A CN 202210505027 A CN202210505027 A CN 202210505027A CN 115019411 A CN115019411 A CN 115019411A
- Authority
- CN
- China
- Prior art keywords
- central server
- detection
- equipment
- information
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007689 inspection Methods 0.000 title claims abstract description 58
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000003993 interaction Effects 0.000 title claims abstract description 32
- 238000001514 detection method Methods 0.000 claims abstract description 121
- 238000012544 monitoring process Methods 0.000 claims description 36
- 238000004891 communication Methods 0.000 claims description 6
- 230000007613 environmental effect Effects 0.000 claims description 6
- 230000005236 sound signal Effects 0.000 claims description 6
- 238000011156 evaluation Methods 0.000 claims description 4
- 238000012360 testing method Methods 0.000 claims description 2
- 238000007726 management method Methods 0.000 description 21
- 238000010586 diagram Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 9
- 230000002159 abnormal effect Effects 0.000 description 6
- 238000009826 distribution Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 3
- 238000007405 data analysis Methods 0.000 description 3
- 238000003786 synthesis reaction Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000009776 industrial production Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 239000002737 fuel gas Substances 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 239000003208 petroleum Substances 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012954 risk control Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C1/00—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
- G07C1/20—Checking timed patrols, e.g. of watchman
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/08—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B3/00—Audible signalling systems; Audible personal calling systems
- G08B3/10—Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Electromagnetism (AREA)
- Testing And Monitoring For Control Systems (AREA)
Abstract
The application belongs to the technical field of inspection, and particularly relates to an inspection system and method based on voice interaction, wherein the system comprises: the management terminal is used for receiving a task allocation instruction sent by an administrator, generating task allocation information based on the task allocation instruction and sending the task allocation information to the central server; the central server is used for generating detection content information and risk early warning prompt information of the current equipment to be detected based on the task allocation information and the position information of the portable terminal acquired in real time; the portable terminal is used for generating a detection voice prompt signal based on the detection content information and the risk early warning prompt information; receiving an equipment detection result input by a detection person through voice, and sending the equipment detection result to a central server; and the central server is used for pushing the equipment detection result to the management terminal in real time and generating a routing inspection report based on the equipment detection result of each equipment. The system improves the inspection efficiency, timely carries out risk early warning and ensures the safe operation of equipment.
Description
Technical Field
The application belongs to the technical field of inspection, and particularly relates to an inspection system and method based on voice interaction.
Background
In modern production enterprises, production equipment is multiple, distribution is wide, and installation position environment is complicated, so that inspection work content is complicated, and work flows are multiple. Especially in high-risk industries such as electric power, petroleum and petrochemical industry, fuel gas and the like, production accidents can be caused by small improper operation in the using process of production equipment, and personal safety accidents can be caused in severe cases, so that great economic losses are caused.
Because of the limitation of computer hardware and software conditions, the existing factory detection is mainly carried out in a more traditional mode, namely, internal and external operators carry out work separately in an interphone mode. This mode of operation has significant drawbacks:
the efficiency is low, once an external operator encounters a problem in the detection process, the problem is solved through the communication with the internal operator to the telephone, the problem solving channel is single, and the accuracy and timeliness of problem solving are influenced by the influence of individual experience;
no data storage and analysis exists, and for factory detection, big data cannot be analyzed and predicted through daily detection data, and risk prediction and early warning are carried out;
and thirdly, the safety degree is low, an operator needs to contact a high-risk area or equipment in the factory detection process, the operator self-judgment or system detection notification is mainly used in the implementation process, and the risk control level is not high.
The above problems are technical problems to be solved urgently in the existing inspection system.
Disclosure of Invention
Technical problem to be solved
In view of the above disadvantages and shortcomings of the prior art, the present application provides a system and method for routing inspection based on voice interaction.
(II) technical scheme
In order to achieve the purpose, the following technical scheme is adopted in the application:
in a first aspect, an embodiment of the present application provides an inspection system based on voice interaction, where the inspection system includes: the system comprises a center server, a portable terminal and a management terminal, wherein the portable terminal and the management terminal are respectively in communication connection with the center server;
the management terminal is used for receiving a task allocation instruction sent by an administrator for the inspection task to be executed, generating task allocation information based on the task allocation instruction and sending the task allocation information to the central server;
the central server is used for generating detection content information and risk early warning prompt information of the equipment to be detected currently based on the task allocation information and the position information of the portable terminal acquired in real time, and sending the detection content information and the risk early warning prompt information to the portable terminal;
the portable terminal is used for generating a corresponding detection voice prompt signal based on the detection content information and the risk early warning prompt information; receiving an equipment detection result input by a detection person through voice, and sending the equipment detection result to the central server;
and the central server is used for pushing the equipment detection result to the management terminal in real time and generating an inspection report based on the equipment detection result of each equipment in the inspection task.
Optionally, the central server is connected to the distributed control system, and is configured to obtain control data of the relevant detection device in the distributed control system; the central server is also connected with the environment monitoring system and used for acquiring real-time environment monitoring data.
Optionally, the central server is configured to generate risk early warning prompt information based on the control data and/or the environmental monitoring data, and send the risk early warning prompt information to the management terminal and the portable terminal.
Optionally, the central server is configured to generate a plant operation evaluation report based on the historically collected device detection results, the environmental monitoring data, and the control data.
Optionally, the central server comprises an industrial monitoring intelligent database;
the portable terminal is used for receiving the field problems input by the detection personnel through voice and sending the field problems to the central server;
and the central server is used for retrieving a solution in the industrial monitoring intelligent database based on the field problem and sending the solution to the portable terminal.
Optionally, the portable terminal comprises a voice recognition module;
the voice recognition module is used for acquiring an audio signal to be recognized and inputting the audio signal to be recognized into a pre-established language recognition model to obtain a corresponding character sequence; the language recognition model carries out voice recognition based on a dialect voice library pre-built in an acoustic feature library and an industrial detection vocabulary library pre-built in a language model library.
In a second aspect, an embodiment of the present application provides a routing inspection method based on voice interaction, where the method includes:
the method comprises the steps that a management terminal receives a task distribution instruction sent by an administrator aiming at an inspection task to be executed, generates task distribution information based on the task distribution instruction and sends the task distribution information to a central server;
the central server generates detection content information and risk early warning prompt information of the equipment to be detected at present based on the task allocation information and the position information of the portable terminal acquired in real time, and sends the detection content information and the risk early warning prompt information to the portable terminal;
the portable terminal generates a corresponding detection voice prompt signal based on the detection content information and the risk early warning prompt information; receiving an equipment detection result input by a detection person through voice, and sending the equipment detection result to the central server;
and the central server pushes the equipment detection result to the management terminal in real time, and generates an inspection report based on the equipment detection result of each equipment in the inspection task.
Optionally, the method further comprises: the central server acquires control data of related detection equipment in the distributed control system and real-time environment monitoring data in the environment monitoring system, generates risk early warning prompt information based on the control data and/or the environment monitoring data, and sends the risk early warning prompt information to the management terminal and the portable terminal.
Optionally, the method further comprises:
the portable terminal receives the field problems input by the detection personnel through voice and sends the field problems to the central server;
and the central server searches an industrial monitoring intelligent database established in advance based on the field problem to obtain a solution, and sends the solution to the portable terminal.
(III) advantageous effects
The beneficial effect of this application is: the application provides a system and a method for patrolling based on voice interaction, wherein the system comprises: the management terminal is used for receiving a task allocation instruction sent by an administrator, generating task allocation information based on the task allocation instruction and sending the task allocation information to the central server; the central server is used for generating detection content information and risk early warning prompt information of the current equipment to be detected based on the task allocation information and the position information of the portable terminal acquired in real time; the portable terminal is used for generating a detection voice prompt signal based on the detection content information and the risk early warning prompt information; receiving an equipment detection result input by a detection person through voice, and sending the equipment detection result to a central server; and the central server is used for pushing the equipment detection result to the management terminal in real time and generating a routing inspection report based on the equipment detection result of each equipment. The system improves the inspection efficiency, can timely perform early warning on risks in system equipment, and ensures safe operation of the equipment.
Drawings
The application is described with the aid of the following figures:
fig. 1 is a schematic structural diagram of an inspection system based on voice interaction in an embodiment of the present application;
FIG. 2 is a schematic flow chart of a speech recognition module processing a speech signal according to another embodiment of the present application;
FIG. 3 is a schematic flow chart of a polling method based on voice interaction in another embodiment of the present application;
FIG. 4 is a schematic illustration of an internal operator workflow in accordance with yet another embodiment of the present application;
FIG. 5 is an exemplary illustration of an inter-operator task assignment interface in a further embodiment of the subject application;
FIG. 6 is an exemplary illustration of an operator monitoring data interface in accordance with yet another embodiment of the present application;
FIG. 7 is an exemplary illustration of an internal operation monitoring anomaly information alert interface in accordance with yet another embodiment of the subject application;
FIG. 8 is a schematic view of an exooperator workflow in yet another embodiment of the present application;
FIG. 9 is a diagram illustrating an example of an exooperator task assignment information receiving interface in yet another embodiment of the present application;
FIG. 10 is an exemplary diagram of an exception information alert interface for an outsider in accordance with yet another embodiment of the present application.
Detailed Description
For the purpose of better explaining the present invention and to facilitate understanding, the present invention will be described in detail by way of specific embodiments with reference to the accompanying drawings. It is to be understood that the following specific examples are illustrative of the invention only and are not to be construed as limiting the invention. In addition, it should be noted that, in the case of no conflict, the embodiments and features in the embodiments in the present application may be combined with each other; for convenience of description, only portions related to the invention are shown in the drawings.
Example one
Fig. 1 is a schematic structural diagram of an inspection system based on voice interaction in an embodiment of the present application, and as shown in fig. 1, the inspection system based on voice interaction in the embodiment includes: the system comprises a center server 01, a portable terminal 02 and a management terminal 03, wherein the portable terminal 02 and the management terminal 03 are respectively in communication connection with the center server 01;
the management terminal 03 is used for receiving a task allocation instruction sent by an administrator for the inspection task to be executed, generating task allocation information based on the task allocation instruction and sending the task allocation information to the central server 01;
the central server 01 is used for generating detection content information and risk early warning prompt information of the current equipment to be detected based on the task allocation information and the position information of the portable terminal 02 acquired in real time, and sending the detection content information and the risk early warning prompt information to the portable terminal 02;
the portable terminal 02 is used for generating a corresponding detection voice prompt signal based on the detection content information and the risk early warning prompt information; receiving an equipment detection result input by a detection person through voice, and sending the equipment detection result to the central server 01;
the central server 01 is configured to push the device detection result to the management terminal 03 in real time, and generate an inspection report based on the device detection result of each device in the inspection task.
The patrol inspection system based on voice interaction of the embodiment can effectively ensure that the patrol inspection personnel comprehensively solve the mechanical passive patrol inspection operation mode of the patrol inspection personnel while performing patrol inspection according to the regulations, comprehensively improve the efficiency of patrol inspection work, and can timely perform early warning on risks in system equipment, thereby ensuring the safe operation of the equipment.
For a better understanding of the present invention, the following description will be made of each apparatus in the present embodiment.
In this embodiment, the portable terminal may be a device that provides the detection result reporting, positioning, and data connectivity to the detection personnel, such as: a smart phone, a tablet computer, a computer with a wireless transceiving function, a wireless terminal in an industrial control (industrial control), etc., in some other embodiments, the smart phone may also be other electronic devices that can implement the same or similar functions, which is not limited in this embodiment.
In this embodiment, the management terminal may be any mobile terminal, computer terminal, or the like that can be connected to the center server 01.
In this embodiment, the central server may be an independent server, or may be a cloud server that provides basic cloud computing services such as cloud service, a cloud database, cloud computing, a cloud function, cloud storage, Network service, cloud communication, middleware service, domain name service, security service, Content Delivery Network (CDN), big data, and an artificial intelligence platform.
In this embodiment, the task allocation instruction is a polling task allocation instruction issued by an administrator according to a production job schedule, and the instruction includes information of an assigned detection person, device information of a device to be detected, and detection content. Therefore, the central server acquires the position information of the detection personnel in real time and generates the detection content information of the current equipment to be detected according to the position information.
In the embodiment, the central server is connected with the distributed control system to acquire control data of related detection equipment in the distributed control system; the central server is also connected with the environment monitoring system, so that the central server collects environment monitoring data through a field environment data collector of the environment monitoring system, makes a prediction curve according to relevant indexes through big data analysis, makes risk early warning according to upper and lower limit thresholds, and sends the risk early warning and task allocation information to the management terminal and the portable terminal of the assigned detection personnel.
The central server can perform data prediction on batch big data by quickly inputting and storing feedback data of the external operators and integrating and analyzing the big data.
In this embodiment, the method for acquiring the position information in real time may be any one of a Global Positioning System (GPS), a BeiDou Navigation Satellite System (BDS), a Global Satellite Navigation System (GLONASS), a Galileo Satellite Navigation System (Galileo Satellite Navigation System), and a WIFI Positioning System, which are built in the portable terminal.
Example two
The embodiment describes in detail a specific implementation process of the embodiment on the basis of the first embodiment.
The embodiment is applied to the field of industrial production, wherein an internal operator is used as an administrator, and an external operator is used as an inspector.
The portable terminal adopts a customized communication tool, such as a mobile detection device which is specially developed according to a specific scene, so as to collect a field detection result. The management terminal adopts a tablet computer (pad), and the mobile detection device and the tablet computer perform data intercommunication and interaction through data link and binding.
In this embodiment, the voice interaction adopts voice recognition software systems such as science news flight and Teng news, and according to the detection requirement, the training is performed on the basis of a common voice corpus by using factory detection rules, equipment operation specifications and historical operations, and a detection professional corpus is established to support accurate conversion of scheduling voice, working conversation and speaking information into characters and provide the characters for intelligent interaction and conversation between human and machines. The method has the advantages that accurate word segmentation is carried out in the analysis process by constructing a voice recognition model, information keywords and keywords, such as equipment parameter information, operation term information and working content information, are automatically recognized and are converted into structural information to be stored and inquired, and therefore data intercommunication, intelligent search and interconnection in the detection field are achieved through a voice technology.
In this embodiment, the central server generates a plant operation evaluation report based on the collected device detection result, the environmental monitoring data, and the control data. Specifically, the system collects the daily data, analyzes and integrates the data, displays the current data, judges the data trend, and the like (the implementation mode is a general software programming technology, and no further description is given). The partial data collection comprises comprehensive data such as personnel operation, environmental data, abnormal information and equipment information. And comprehensively analyzing and integrating the current plant operation capacity, the manpower distribution performance, the equipment performance and the like on the basis of integrating all data to generate an evaluation report, and optimizing various indexes under the plant scene on the basis.
In an embodiment, the central server comprises an industrial monitoring intelligent database; the intelligent database is used for establishing a customized problem and solving the database according to the daily routing inspection problem feedback of the detection personnel, so that the detection personnel can be assisted to quickly acquire an information analysis and answer strategy.
The portable terminal receives the field problem input by the detection personnel through voice and sends the field problem to the central server; and the central server searches the industrial monitoring intelligent database based on the field problem to obtain a solution, and sends the solution to the portable terminal.
When the system is used, the operator immediately transmits information to the background in a voice mode, and can quickly search problems in a dictation mode. The central server retrieves the solutions from the database according to the feedback problems of the operator.
In the present embodiment, the portable terminal includes a voice recognition module;
the voice recognition module is used for acquiring an audio signal to be recognized and inputting the audio signal to be recognized into a pre-established language recognition model to obtain a corresponding character sequence; the language recognition model carries out voice recognition based on a dialect voice library pre-built in an acoustic feature library and an industrial detection vocabulary library pre-built in a language model library.
The voice interaction mainly represents a speech output and system recognition and feedback mode of an operator on information, and comprises a voice recognition module and a voice synthesis module. Fig. 2 is a schematic flow chart of a speech recognition module processing a speech signal according to another embodiment of the present application, and as shown in fig. 2, speech recognition receives speech in a service manner, and outputs a text in a service manner through processes such as noise processing, feature extraction, speech decoding, and the like. Specifically, noise reduction preprocessing is performed after voice input, and feature extraction is performed on the preprocessed voice to obtain voice signal features. And then, carrying out similarity matching on the voice signal features based on an acoustic feature library, wherein a dialect voice library is constructed in the acoustic feature library. And then outputting a recognition result through a pre-established voice recognition model, wherein the voice recognition model is established by implementing a Viterbi decoding technology of WFST dynamic and static combination based on a Deep Neural Network (DNN) modeling method, and a professional vocabulary library corresponding to the industrial detection field is established. A dialect voice library is built in the acoustic feature library, an industrial detection vocabulary library is built in the language model, and the conversion accuracy of the corresponding terms and characters is improved.
The speech synthesis module may use existing speech synthesis techniques, which are not described herein in detail.
The system of patrolling and examining based on voice interaction of this embodiment can prevent the emergence of the incident that leads to because work maloperation nature, has guaranteed that the safety inspection personnel carry out correct effective and careful inspection of patrolling and examining to equipment and facilities in the regulation time at the during operation, in time discovers the potential safety hazard and reports, lets the potential safety hazard obtain timely control and handles.
EXAMPLE III
Fig. 3 is a schematic flow chart of a polling method based on voice interaction in another embodiment of the present application, and as shown in fig. 3, the polling method based on voice interaction of the present embodiment includes:
s10, the management terminal receives a task allocation instruction sent by an administrator aiming at the inspection task to be executed, generates task allocation information based on the task allocation instruction and sends the task allocation information to the central server;
s20, the central server generates detection content information and risk early warning prompt information of the current equipment to be detected based on task allocation information and the position information of the portable terminal acquired in real time, and sends the detection content information and the risk early warning prompt information to the portable terminal;
s30, the portable terminal generates a corresponding detection voice prompt signal based on the detection content information and the risk early warning prompt information; receiving an equipment detection result input by a detection person through voice, and sending the equipment detection result to a central server;
s40, the central server pushes the equipment detection result to the management terminal in real time, and generates an inspection report based on the equipment detection result of each equipment in the inspection task.
The inspection method of the embodiment applies the voice recognition technology to the current industrial detection field and introduces the voice recognition technology into inspection daily work, on one hand, mass information data and schemes are transmitted to users at the first time, and compared with the previous simple voice talkback, the inspection method has the advantages of lower cost and higher efficiency; on the other hand, voice interaction has an interface-free characteristic, so that the method is more advantageous than a GUI in terms of user input and system feedback speed, and for novices, the method can help the novices to be familiar with a flow quickly and work next according to directions.
In this embodiment, when the portable terminal generates a corresponding detection voice prompt signal based on the risk early warning prompt information, the portable terminal actively outputs a voice alarm guide in the detection voice prompt signal according to the on-site position of the user and the reported detection equipment, so as to prompt the operation key and the attention in real time. Risks can be effectively prevented and controlled through risk prompting.
In this embodiment, the method further includes: the central server acquires control data of related detection equipment in the distributed control system and real-time environment monitoring data in the environment monitoring system, generates risk early warning prompt information based on the control data and/or the environment monitoring data, and sends the risk early warning prompt information to the management terminal and the portable terminal.
In this embodiment, the method further includes:
the portable terminal receives the field problem input by the tester through voice and sends the field problem to the central server;
and the central server searches an industrial monitoring intelligent database established in advance based on the field problem to obtain a solution, and sends the solution to the portable terminal.
The method is described below with reference to a specific example. The example is applied to the field of industrial production. Here, the internal operator is an administrator, and the external operator is an inspector.
The administrator firstly carries out task allocation based on the pad end, at this time, the external operator receives a message for starting work, and after the external operator is opened, the external operator selects a voice mode or a manual mode according to task guidance. And if the voice mode is selected, the voice work navigation mode is started, the starting and the positioning (such as the positioning and the closing) are prompted, the external operator detects the detection equipment one by one according to the voice navigation and reports the detection equipment, the voice system identifies the detection equipment and then uploads the detection equipment to the background, and at the moment, the internal operator can observe data. Under the condition that the task is smoothly carried out, the external operator can break away from the hand-held action, and the whole process is completed through voice interaction. If the problem is met and needs to be solved, the whole detection is completed through system scheme retrieval or intercommunication with an internal operator, and a detection report is finally generated.
Fig. 4 is a schematic diagram of an internal operator workflow in another embodiment of the present application, and as shown in fig. 4, the internal operator workflow includes: task allocation, data acquisition and monitoring and report analysis. The management terminal is a pad, the system adopts an internal customization system, the system mainly realizes data interconnection with the mobile terminal, and the realization mode is a general software programming technology and is not described in detail.
In a task allocation stage, fig. 5 is an exemplary diagram of a task allocation interface of an internal operator in another embodiment of the present application, and as shown in fig. 5, the internal operator allocates a task to an external operator, and task information is pushed to an external operator moving end after the task is allocated.
In a data obtaining and monitoring stage, fig. 6 is an exemplary diagram of a data interface for monitoring an internal operator in another embodiment of the present application, and as shown in fig. 6, an external operator transmits received information to a background in real time, and the internal operator monitors and tracks the collected information.
And (5) alarming and processing abnormal information. Fig. 7 is an exemplary diagram of an internal operation monitoring abnormal information alarm interface in another embodiment of the present application, and as shown in fig. 7, abnormal information detected in an external operation scene may alarm in an internal operation system, at this time, an external operator may screen the information, and a database may also perform problem analysis and solution arrangement on the problem to assist the internal operator in performing the next processing. For example, the background system detects comprehensive analysis risk factors such as daily work infrared, air temperature and air pressure through the external environment data acquisition unit. On the basis of specific factors, a prediction curve can be made according to relevant indexes through big data analysis, early warning risks are made according to upper and lower limit thresholds, and the early warning risks are sent to a field operation mobile port. The external operator can receive the related risk prompt and further make the next operation prejudgment to select the change time or contact the internal operator for assistance and the like.
Fig. 8 is a flowchart illustrating an example of the workflow of the peripheral operator in another embodiment of the present application, and as shown in fig. 8, the mobile terminal process key nodes of the peripheral operator can be divided into two parts, namely, task information receiving and executing part and voice interaction part.
Fig. 9 is an exemplary diagram of an external operator task assignment information receiving interface in another embodiment of the present application, and as shown in fig. 9, a terminal of an external operator receives an internal operator assignment task, selects a voice mode, and after selection, the external operator arrives at each detection site respectively according to system voice to work, and for a problem described in a special area or an external operator, the system prompts risks and corresponding operation guidance in real time according to recorded data. For example, when entering a high-temperature and high-pressure area, the system can prompt the staff to pay attention to detecting real-time temperature and air pressure information and corresponding protection. This function can also cooperate corresponding camera equipment, infrared check out test set etc. to carry out data real-time update and in time indicate, promotes prevention and control risk ability.
Fig. 10 is an exemplary diagram of an abnormal information alarm interface for an external operator in another embodiment of the present application, as shown in fig. 10, when an abnormal indicator is detected, the system prompts an abnormality and gives a feedback to the interface by voice, the external operator may select whether to use a standby scheme or obtain a solution by searching according to the prompt, and may also select to directly contact the internal operator for consultation under the condition that the problem cannot be solved.
In this embodiment, through the sensor with core data, information and knowledge in the system in real time to more intelligent, more agile, more efficient mode transmits for the user, can exchange with more natural emotion simultaneously and promote user experience, not only standardizes the work flow, but also can prompt the risk fast under the special circumstances, promotes operating personnel security.
It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer.
Furthermore, it should be noted that in the description of the present specification, the description of the term "one embodiment", "some embodiments", "examples", "specific examples" or "some examples", etc., means that a specific feature, structure, material or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, the claims should be construed to include preferred embodiments and all changes and modifications that fall within the scope of the invention.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention should also include such modifications and variations.
Claims (9)
1. The utility model provides an inspection system based on voice interaction which characterized in that, this system includes: the system comprises a center server, a portable terminal and a management terminal, wherein the portable terminal and the management terminal are respectively in communication connection with the center server;
the management terminal is used for receiving a task allocation instruction sent by an administrator for the inspection task to be executed, generating task allocation information based on the task allocation instruction and sending the task allocation information to the central server;
the central server is used for generating detection content information and risk early warning prompt information of the equipment to be detected currently based on the task allocation information and the position information of the portable terminal acquired in real time, and sending the detection content information and the risk early warning prompt information to the portable terminal;
the portable terminal is used for generating a corresponding detection voice prompt signal based on the detection content information and the risk early warning prompt information; receiving an equipment detection result input by a detection person through voice, and sending the equipment detection result to the central server;
and the central server is used for pushing the equipment detection result to the management terminal in real time and generating an inspection report based on the equipment detection result of each equipment in the inspection task.
2. The inspection system based on voice interaction according to claim 1, wherein the central server is connected with the distributed control system and is used for acquiring control data of relevant detection devices in the distributed control system; the central server is also connected with the environment monitoring system and used for acquiring real-time environment monitoring data.
3. The inspection system based on voice interaction according to claim 2,
and the central server is used for generating risk early warning prompt information based on the control data and/or the environmental monitoring data and sending the risk early warning prompt information to the management terminal and the portable terminal.
4. The voice interaction-based inspection system according to claim 2, wherein the central server is configured to generate plant operation evaluation reports based on historically collected equipment testing results, environmental monitoring data, and control data.
5. The voice interaction-based inspection system according to claim 1, wherein the central server includes an industrial monitoring intelligent database;
the portable terminal is used for receiving the field problems input by the detection personnel through voice and sending the field problems to the central server;
and the central server is used for retrieving a solution in the industrial monitoring intelligent database based on the field problem and sending the solution to the portable terminal.
6. The inspection system based on voice interaction according to claim 1, wherein the portable terminal comprises a voice recognition module;
the voice recognition module is used for acquiring an audio signal to be recognized and inputting the audio signal to be recognized into a pre-established language recognition model to obtain a corresponding character sequence; the language recognition model carries out voice recognition based on a dialect voice library pre-built in an acoustic feature library and an industrial detection vocabulary library pre-built in a language model library.
7. A routing inspection method based on voice interaction is characterized by comprising the following steps:
the method comprises the steps that a management terminal receives a task allocation instruction sent by an administrator for an inspection task to be executed, generates task allocation information based on the task allocation instruction and sends the task allocation information to a central server;
the central server generates detection content information and risk early warning prompt information of the equipment to be detected at present based on the task allocation information and the position information of the portable terminal acquired in real time, and sends the detection content information and the risk early warning prompt information to the portable terminal;
the portable terminal generates a corresponding detection voice prompt signal based on the detection content information and the risk early warning prompt information; receiving an equipment detection result input by a detection person through voice, and sending the equipment detection result to the central server;
and the central server pushes the equipment detection result to the management terminal in real time, and generates an inspection report based on the equipment detection result of each equipment in the inspection task.
8. The inspection method based on voice interaction according to claim 7, characterized in that the method further comprises: the central server acquires control data of related detection equipment in the distributed control system and real-time environment monitoring data in the environment monitoring system, generates risk early warning prompt information based on the control data and/or the environment monitoring data, and sends the risk early warning prompt information to the management terminal and the portable terminal.
9. The inspection method based on voice interaction according to claim 7, characterized in that the method further comprises:
the portable terminal receives the field problems input by the detection personnel through voice and sends the field problems to the central server;
and the central server searches an industrial monitoring intelligent database established in advance based on the field problem to obtain a solution, and sends the solution to the portable terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210505027.0A CN115019411A (en) | 2022-05-10 | 2022-05-10 | Routing inspection system and method based on voice interaction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210505027.0A CN115019411A (en) | 2022-05-10 | 2022-05-10 | Routing inspection system and method based on voice interaction |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115019411A true CN115019411A (en) | 2022-09-06 |
Family
ID=83068236
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210505027.0A Pending CN115019411A (en) | 2022-05-10 | 2022-05-10 | Routing inspection system and method based on voice interaction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115019411A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116405801A (en) * | 2023-05-31 | 2023-07-07 | 中瑞科技术有限公司 | Interphone system capable of early warning and broadcasting |
| CN117274918A (en) * | 2023-11-23 | 2023-12-22 | 深圳市易图资讯股份有限公司 | Big data metering regional analysis system and method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010182287A (en) * | 2008-07-17 | 2010-08-19 | Steven C Kays | Intelligent adaptive design |
| CN109961531A (en) * | 2019-04-02 | 2019-07-02 | 深圳市慧友安电子技术有限公司 | A kind of intelligent wireless speech interactive cruising inspection system and its method for inspecting |
| CN111126751A (en) * | 2019-11-07 | 2020-05-08 | 天津大学 | Intelligent inspection and safety monitoring early warning system and method based on mobile interconnection |
| CN111613207A (en) * | 2020-05-11 | 2020-09-01 | 国网内蒙古东部电力有限公司呼伦贝尔供电公司 | Power transmission line inspection system |
| CN112802466A (en) * | 2020-12-01 | 2021-05-14 | 南京纳新信息科技有限公司 | Artificial intelligence voice interaction service system |
| CN113987455A (en) * | 2021-10-25 | 2022-01-28 | 浙江中控技术股份有限公司 | BS architecture-based industrial control system multi-factor authentication login method and system |
| CN114141179A (en) * | 2021-12-07 | 2022-03-04 | 贝塔智能科技(北京)有限公司 | Park guide and scenic spot introduction system based on intelligent voice interaction |
-
2022
- 2022-05-10 CN CN202210505027.0A patent/CN115019411A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010182287A (en) * | 2008-07-17 | 2010-08-19 | Steven C Kays | Intelligent adaptive design |
| CN109961531A (en) * | 2019-04-02 | 2019-07-02 | 深圳市慧友安电子技术有限公司 | A kind of intelligent wireless speech interactive cruising inspection system and its method for inspecting |
| CN111126751A (en) * | 2019-11-07 | 2020-05-08 | 天津大学 | Intelligent inspection and safety monitoring early warning system and method based on mobile interconnection |
| CN111613207A (en) * | 2020-05-11 | 2020-09-01 | 国网内蒙古东部电力有限公司呼伦贝尔供电公司 | Power transmission line inspection system |
| CN112802466A (en) * | 2020-12-01 | 2021-05-14 | 南京纳新信息科技有限公司 | Artificial intelligence voice interaction service system |
| CN113987455A (en) * | 2021-10-25 | 2022-01-28 | 浙江中控技术股份有限公司 | BS architecture-based industrial control system multi-factor authentication login method and system |
| CN114141179A (en) * | 2021-12-07 | 2022-03-04 | 贝塔智能科技(北京)有限公司 | Park guide and scenic spot introduction system based on intelligent voice interaction |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116405801A (en) * | 2023-05-31 | 2023-07-07 | 中瑞科技术有限公司 | Interphone system capable of early warning and broadcasting |
| CN116405801B (en) * | 2023-05-31 | 2023-09-08 | 中瑞科技术有限公司 | Interphone system capable of early warning and broadcasting |
| CN117274918A (en) * | 2023-11-23 | 2023-12-22 | 深圳市易图资讯股份有限公司 | Big data metering regional analysis system and method |
| CN117274918B (en) * | 2023-11-23 | 2024-03-22 | 深圳市易图资讯股份有限公司 | Big data metering regional analysis system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115019411A (en) | Routing inspection system and method based on voice interaction | |
| CN113689013A (en) | Intelligent monitoring and operation and maintenance system for transformer | |
| US10244111B1 (en) | System for providing data to an interactive response system | |
| CN111145510B (en) | Alarm receiving processing method, device and equipment | |
| CN105721660B (en) | Harassing call recognition methods and system | |
| CN109559737A (en) | Electric power system dispatching speech model method for building up | |
| KR102353545B1 (en) | Method and Apparatus for Recommending Disaster Response | |
| US10714079B2 (en) | Methods and system for analyzing conversational statements and providing feedback in real-time | |
| CN209374053U (en) | Dispatching intelligent monitor and check system | |
| CN103279830A (en) | Transformer substation or converter station accident handling cloud terminal remote support decision-making method and system | |
| CN112579789A (en) | Equipment fault diagnosis method and device and equipment | |
| CN111399464A (en) | Intelligent vehicle quality inspection method and system | |
| CN112418717A (en) | Engineering field personnel behavior early warning method and system based on artificial intelligence | |
| CN112990656A (en) | Health evaluation system and health evaluation method for IT equipment monitoring data | |
| CN108960547A (en) | Emergency preplan aided management system | |
| CN112053007B (en) | Distribution network fault first-aid repair prediction analysis system and method | |
| CN112116168B (en) | User behavior prediction method and device and electronic equipment | |
| CN103901878A (en) | Remote fault diagnosis system and method for concrete batching plants | |
| CN115511329A (en) | Electric power operation compliance monitoring system and method | |
| CN112860868A (en) | Customer service telephone analysis method, system, equipment and storage medium | |
| CN110019285A (en) | A kind of alert identification allocating method and electronic equipment | |
| CN116452154B (en) | Project management system suitable for communication operators | |
| CN108613820A (en) | A kind of online allophone monitoring algorithm for GIS bulk mechanicals defect diagonsis and positioning | |
| WO2013116461A1 (en) | Systems and methods for voice-guided operations | |
| CN116128546A (en) | AI public opinion monitoring system and method for external service window in power industry |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |