CN116489297A - Remote operation and maintenance guiding equipment oriented to overhaul scene - Google Patents
Remote operation and maintenance guiding equipment oriented to overhaul scene Download PDFInfo
- Publication number
- CN116489297A CN116489297A CN202211670268.7A CN202211670268A CN116489297A CN 116489297 A CN116489297 A CN 116489297A CN 202211670268 A CN202211670268 A CN 202211670268A CN 116489297 A CN116489297 A CN 116489297A
- Authority
- CN
- China
- Prior art keywords
- module
- system terminal
- maintenance
- fault
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012423 maintenance Methods 0.000 title claims abstract description 64
- 230000003993 interaction Effects 0.000 claims abstract description 46
- 238000007726 management method Methods 0.000 claims abstract description 29
- 238000013500 data storage Methods 0.000 claims abstract description 11
- 238000012795 verification Methods 0.000 claims description 50
- 238000000034 method Methods 0.000 claims description 20
- 230000001360 synchronised effect Effects 0.000 claims description 9
- 238000004891 communication Methods 0.000 claims description 8
- 238000002372 labelling Methods 0.000 claims 2
- 230000008569 process Effects 0.000 description 8
- 238000012545 processing Methods 0.000 description 5
- 238000013475 authorization Methods 0.000 description 4
- 238000013024 troubleshooting Methods 0.000 description 4
- 230000002618 waking effect Effects 0.000 description 4
- 230000002159 abnormal effect Effects 0.000 description 3
- 230000003213 activating effect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000009434 installation Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/01—Customer relationship services
- G06Q30/015—Providing customer assistance, e.g. assisting a customer within a business location or via helpdesk
- G06Q30/016—After-sales
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S10/00—Systems supporting electrical power generation, transmission or distribution
- Y04S10/50—Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Development Economics (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Computer Networks & Wireless Communication (AREA)
- Accounting & Taxation (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Economics (AREA)
- Finance (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention relates to the technical field of maintenance of operation vehicles, in particular to remote operation and maintenance guiding equipment for maintenance scenes. The remote operation and maintenance guiding device for the overhaul scene is provided, and the remote operation and maintenance guiding device for the overhaul scene provides online and offline redundant overhaul guiding, and comprises a system terminal and a server which are communicated through a network, wherein a hardware carrier of the system terminal is portable intelligent equipment with a camera; the system terminal comprises a video guiding module, a photographing recording module, a maintenance suggestion module, an offline voice recognition module and a file synchronization module; the server side comprises an information interaction module, an online voice recognition module, a data storage and fault file library module and a video guidance management module. The invention is effectively compatible with maintenance and operation guidance in off-line and on-line states.
Description
Technical Field
The invention relates to the technical field of maintenance of operation vehicles, in particular to remote operation and maintenance guiding equipment for maintenance scenes.
Background
Urban traffic jam is a problem of social normalization, and subways gradually become a preferred travel scheme for people by virtue of the advantages of large traffic, convenience and the like. With the continuous increase of operation vehicles, better requirements are also put on the safety and the high efficiency of operation work. The maintenance of vehicles is a serious problem in subway operation work, and the safety of the vehicles is related by the self-help of the vehicles. The manual overhaul under the traditional live working is greatly influenced by human objective factors, abnormal conditions such as missed detection and false detection are easy to occur, and a large amount of waiting time is needed when the abnormal conditions are encountered.
One of the prior art schemes is to carry out augmented reality prompt on the operation steps through intelligent wearable equipment, obtain corresponding process steps through image recognition and sign recognition on the grabbed objects, combine the steps with a real scene, and finally send the 3D model to be displayed and instruction explanation of the process steps to the intelligent wearable equipment.
The second existing technical scheme is that on-site operation personnel and guiding personnel carry out video communication through APP, operation contents are transmitted through functions of AR marking, voice information and the like, and the on-site operation personnel are guided to carry out equipment maintenance.
Disclosure of Invention
The invention aims to provide remote operation and maintenance guiding equipment which can perform timely response of difficult and complicated maintenance operation on line and maintenance guiding under off-line condition and record and maintain fault information, thereby providing novel remote operation and maintenance guiding equipment facing maintenance scenes and providing on-line and off-line redundant maintenance guiding.
The invention is realized by adopting the following technical scheme:
the remote operation and maintenance guiding device for the overhaul scene comprises a system terminal and a server which are communicated through a network, wherein a hardware carrier of the system terminal is portable intelligent equipment with a camera; the system terminal comprises a video guiding module, a photographing recording module, a maintenance suggestion module, an offline voice recognition module and a file synchronization module; the server comprises an information interaction module, an online voice recognition module, a data storage and fault file library module and a video guidance management module;
the video guiding module is used for guiding personnel to conduct video guiding on site operation personnel; the video guidance can transmit the on-site overhaul video back in real time, so that the on-site situation is clear at a glance, the treatment method is consulted, and the treatment progress is counted. Through the coordination of visualization and consultation of the simultaneous actions of all departments, scientific decision and efficient treatment are realized, the accident treatment time is greatly shortened, and the accident influence is reduced. Meanwhile, each treatment process in video guidance can be recorded in video, and the stored media data can be used for repeated deduction by design and maintenance personnel as input materials for subsequent working training.
The photographing recording module is used for collecting and recording pictures and fault description information of the overhaul site;
the maintenance suggestion module is internally provided with an offline fault file library and is used for inquiring a maintenance guidance method by field operators; the maintenance suggestion module can rapidly identify fault codes or fault reasons, fault actions, reset reasons, maintenance faults and other information corresponding to the fault names, and can independently conduct fault troubleshooting and preliminary fault diagnosis, so that fault judging and handling capacity of after-sales service personnel is enhanced, workload of technical expert technical support of companies is reduced, fault troubleshooting and diagnosing time is shortened, and customer satisfaction is improved.
The off-line voice recognition module is used for on-line voice recognition in an off-line state;
the file synchronization module is used for uploading fault field pictures and fault description information recorded in an offline state;
the information interaction module is used for information communication between the system terminal and the server;
the online voice recognition module is used for calculating the audio frequency transmitted into the information interaction module by the system terminal and obtaining a recognition result when the network is online;
the data storage module is used for storing information to be stored from the system terminal;
the fault file library module refers to a module of a fault file library which needs to be issued to the system terminal after receiving an offline fault file library updating request of the system terminal;
and the video guidance management module is used for carrying out user management of video guidance of the system terminal.
Further, the system terminal also comprises a login module, wherein the login module comprises two-dimension code login, user name and password login, and the system terminal can enter other modules after successful login. The login module is arranged, the confidentiality of equipment is protected, and a redundant login mode is adopted, so that the login of clients is facilitated.
The server side further comprises a user management module, a user name and a corresponding password are stored in the user management module, the user name and the password are logged in to be network verification login, information input by a user is required to be transmitted to the user management module through an information interaction module of the server side, verification is performed by the user management module, a verification result is output to the system terminal, and other modules of the system terminal can be accessed after verification is passed.
Further, the two-dimension code login is an offline specific rule verification login, an offline decoding module is built in the system, and when the decoded information meets specific system rules, verification is considered to be successful, other modules of the system terminal can be accessed without network verification. When the user is in an off-line state, the user logs in through the two-dimension code.
Further, the video guidance module supports a 1-to-1 conference or a multi-person conference, the person participating in the guidance can freeze the field image of the video and mark the image, all persons participating in the conference can see the mark of the expert in real time during image marking, voice communication can be carried out, and the final picture after marking is completed can be sent to all persons participating in the conference.
Further, the maintenance suggestion module comprises a fault vehicle type unit and a fault code unit, a user inputs a fault vehicle to be queried and a fault code, and offline maintenance guidance suggestions are obtained from an offline fault file library, so that the maintenance suggestion module is convenient to use for rapidly processing faults. The maintenance suggestion module is also provided with a synchronous fault library module for automatically updating the offline fault file library
Further, the system terminal comprises a software update module, the server side further comprises a software release module for releasing a software version and a software package to the system terminal, the system terminal obtains the latest version information of the software from the software release module of the server side through the information interaction module of the server side, and a user decides whether to download and install according to actual needs, so that the software is convenient to update.
Further, after the updated software installation package is downloaded, MD5 verification is required, and after the verification is completed, the latest version of software installation is executed.
Further, the portable intelligent device is a portable wearable device or a handheld portable device.
The beneficial effects of the invention are as follows: the remote operation and maintenance guiding equipment not only effectively solves the problems of unclear site conditions, incapability of mastering treatment progress, untimely information circulation and the like caused by invisible, inaudible and asymmetric information and the like on an operation and maintenance site, and is convenient for an operator to respond in time for difficult maintenance operation on line, but also can conduct maintenance guidance under an off-line condition and the problem of fault information recording and retaining, thereby effectively shortening the fault processing time, the fault recording time, improving the fault recording accuracy and the site operation accuracy; meanwhile, the method is also effectively compatible with maintenance and operation guidance in off-line and on-line states.
Drawings
FIG. 1 is a schematic diagram of the overall structure of the present invention;
FIG. 2 is a two-dimensional code login flow chart;
FIG. 3 is a user name and password login flow chart;
FIG. 4 is a diagram of a repair advice module interface;
FIG. 5 is a flowchart of an offline fault file library query;
FIG. 6 is a flowchart of a photo suggestion module;
FIG. 7 is a flow chart of a plurality of file synchronization modules;
FIG. 8 is a flow chart of a single file synchronization upload;
FIG. 9 is a software update flow chart;
FIG. 10 is a schematic diagram of a system redundancy login operation.
Detailed Description
As shown in fig. 1, a remote operation and maintenance guiding device for an overhaul scene comprises a system terminal and a service end which are communicated through a network, wherein a hardware carrier of the system terminal is a portable intelligent device with a camera (the portable intelligent device is a portable wearing device or a handheld portable device); the system terminal comprises a video guiding module, a photographing recording module, a maintenance suggestion module, an offline voice recognition module and a file synchronization module; the server comprises an information interaction module, an online voice recognition module, a data storage and fault file library module and a video guidance management module;
the video guide module is used for guiding personnel to conduct video guide on site operation personnel, namely point-to-point conversation can be conducted, and single-line guide of experts and the site operation personnel is conducted. Meanwhile, the system can communicate with staff in the address book, and can also join the guidance staff of a third party or multiple parties through the invitation code and the invitation link without interrupting the guidance process. When the multi-person instruction is needed, the invitation can be sent to a third party or other parties at any time in the form of network link or conference invitation code, the invited person can participate in the instruction by a browser through a network connection scheme, and the conference invitation code can also be used for participating in the instruction through an installation system terminal; the personnel participating in the guidance can share the data in the terminal equipment such as personal PC, mobile phone, tablet and the like for the field staff, the field staff obtains the guidance content through the portable wearable equipment, and meanwhile, the guidance staff can observe the dynamics of the field staff through the video moment transmitted back in real time, so that the operation execution is ensured to be in place. The whole video guiding process and materials such as chat text, AR mark, picture, file and the like are stored in the server, so that other hardware resources are not occupied;
the method specifically comprises the following functional characteristics:
a. the method has the advantages that video, voice and pictures are shared in real time through a wired, WIFI, 4G and 5G wireless communication network and a satellite network, site images and images are shared in a first visual angle mode, site abnormal conditions are transmitted back to a system server in real time, and meanwhile the system server can realize forwarding to an internal network and an external network, so that emergency commanders of enterprises can timely know site comprehensive information in the company and outside the company, and corresponding processing instructions are made;
b. the system supports to construct temporary groups to carry out online conferences, the Windows end displays all videos, the Android mobile phone end uses a paging display mode, and each page can be switched and displayed for 4 persons at most, and the system supports wired networks, WIFI wireless networks, 4G wireless networks and satellite networks;
c. video formats such as CIF, VGA, 720P, 1080P, 4K and the like and resolution are supported;
d. the master control expert can select a participant at any time to conduct remote guidance, and can give a plurality of persons as the expert;
e. the expert can freeze the field engineer image for image identification during instruction, and all participants can see the mark of the expert in real time during image identification, and can perform voice communication. After the identification is completed, the final picture is sent to all people in the conference to be used as an archive or to be checked later;
f. the currently displayed video is grabbed and marked, and the video can be selectively sent to all persons in the conference to be archived, and the participants can also call the pictures at any time to view;
g. the expert or the video owner can operate on the currently displayed video, and the operation instructions comprise:
an expert remotely controls a terminal camera of an amplifying/shrinking system to shoot pictures;
focusing by an expert remote control system terminal camera;
the expert remotely controls to turn on or off a system terminal flash lamp;
switching front and rear cameras;
h. in the process of remote guidance, an expert sometimes needs to switch and display own videos to explain, and in the process of remote guidance, an expert terminal switches and displays the videos of the expert or a field engineer through the function;
i. the expert obtains the geographic information of the opposite party and knows the position of the opposite party;
g. screen sharing, wherein an expert can open an operation manual, a flow chart or other documents on the current machine to share the current content to all participants;
k. sending the file or the flow chart to all participants, wherein the participants can open the file at any time to learn or explain;
i, sending text messages to all participants;
and m, recording video, recording a conference screen and conference sound (a local PC manually triggers a recording button).
The video guidance can transmit the on-site overhaul video back in real time, so that the on-site situation is clear at a glance, the treatment method is consulted, and the treatment progress is counted. Through the coordination of visualization and consultation of the simultaneous actions of all departments, scientific decision and efficient treatment are realized, the accident treatment time is greatly shortened, and the accident influence is reduced. Meanwhile, each treatment process in video guidance can be recorded in video, and the stored media data can be used for repeated deduction by design and maintenance personnel as input materials for subsequent working training.
The photographing recording module is used for collecting and recording pictures and fault description information of the overhaul site; as shown in fig. 6, the photographing recording module mainly includes three functional blocks of photographing, scanning and voice input, wherein the photographing is to take a picture of a product or a fault part by calling a camera of the system terminal, and store the picture in a storage position designated by the system terminal, and simultaneously display a preview effect on a photographing recording interface; scanning means that a camera of the system terminal is called to scan a two-dimensional code, a bar code and the like, and the two-dimensional code, the bar code and the like are sent to a background of the system terminal for software decoding, and the obtained content such as product information and the like is displayed in an information column under a scanning label; the voice input is that after the voice input is activated, the audio content dictated by the user is recorded and is sent to the information interaction module of the server together with the user ID and the equipment ID, the information interaction module sends the audio sample to the online voice recognition module for operation, after the operation is finished, the online voice recognition module outputs the operation result to the information interaction module, and then the information interaction module sends the operation result to the system terminal. And after receiving the output result, the system terminal presents the result in a prompt column under the voice input label. After the activation is completed, scanned information, text information recognized by voice input, photographed pictures, user information, time information and other contents are stored in a TXT format file and stored in a designated position of a system terminal. After the uploading is activated, scanned information, text information recognized by voice input, photographed pictures, user information, time information and other contents are transmitted to an information interaction module of a server through 4G/5G/WIFI and the like, and the information interaction module sends the information interaction module to a data storage module for storage. The flow of photographing recording is shown in fig. 6. The module is used for filling fault reasons and fault processing records through the offline voice recognition module and the online voice recognition module, temporarily storing the fault reasons and fault processing records in a system terminal when the network state is not good, and synchronously uploading TXT files containing fault pictures, scanned information, text information recognized by voice input, user information, time information and the like to a server for data storage when the network state is good, so that manual form filling or flat-panel electronic form filling is replaced. In order to keep the field record to the greatest extent, the system has two functions of completion and uploading in a photographing record module. When the network state is good, the uploading function can be directly awakened after the completion of awakening, the uploading of information and pictures is directly carried out, and the on-site fault information and the recorded information are sent to the server side in real time for synchronization; if the network state is bad, the user can wake up the completion to generate and store the file, and the file is stored in the appointed position of the system terminal. To ensure that information is not missed, the system logic is set to execute 'complete' first and then 'upload', otherwise, the 'upload' function cannot be executed.
The maintenance suggestion module is internally provided with an offline fault file library and comprises a fault vehicle type unit and a fault code unit, a user inputs a fault vehicle to be inquired and a fault code, as shown in fig. 4, offline maintenance guidance suggestions are obtained from the offline fault file library, and the offline maintenance suggestion module is used for field operators to inquire a maintenance guidance method; the maintenance suggestion module can rapidly identify fault codes or fault reasons, fault actions, reset reasons, maintenance faults and other information corresponding to the fault names, and can independently conduct fault troubleshooting and preliminary fault diagnosis, so that fault judging and handling capacity of after-sales service personnel is enhanced, workload of technical expert technical support of companies is reduced, fault troubleshooting and diagnosing time is shortened, and customer satisfaction is improved. When the method is used, a fault code or a fault name is input, a query is entered, a query instruction is sent to a corresponding offline database, the database performs data matching according to instruction information, and corresponding information is returned, the information is subjected to reverse-sequence decryption in the background, after the decryption is completed, a corresponding information prompt is displayed on a software interface after transfer, so that one query operation is completed, and an offline fault file library query flow chart is shown in fig. 5.
In order to ensure the uniformity, the correctness and the usability of the file, a synchronous fault library module is arranged in the module. After updating the fault library, service personnel issue the fault library file to the server, and a system terminal user can automatically update the fault library file by one key through synchronizing the function of the fault library, so that the reliability, availability and convenience of fault entries are improved. After the user wakes up the synchronous fault library, the system terminal sends a synchronous fault library request to the server in an online mode, the information interaction module of the server sends a file update request to the fault file library module after receiving the equipment ID, the user ID and the file update request, the module outputs a fault file to the information interaction module, the information interaction module sends the fault file to the system terminal for file downloading, the system terminal performs file verification after successful downloading, and the system terminal updates the local fault library file after the verification is completed. The local fault library file inquiry does not need a network, and the inquiry function can be completed in an offline state.
The off-line voice recognition module is used for on-line voice recognition under the condition of no network state or poor network state condition;
the file synchronization module is used for uploading the overhaul field pictures and the fault description information recorded in the offline state; detecting whether a file exists in a storage position of a system terminal, if the file exists, the system terminal sends the file to an information interaction module of a server side, the information interaction module sends the file to a data storage module for storage, the data storage module outputs file storage success information after finishing storage and outputs the file storage success information to the information interaction module, the information interaction module sends the information to the system terminal, the system terminal deletes the successfully uploaded file at the system terminal after receiving the information, and uploads the next file after uploading of one file is finished, and if uploading of the files at a designated position is finished, the system terminal prompts that the file uploading is finished at a page; otherwise, the "file not uploaded complete" is prompted, as shown in fig. 7 and 8.
The information interaction module is used for information communication between the system terminal and the server, namely, the information interaction module is used for receiving information from the system terminal and forwarding the information to other modules of the server, and meanwhile, the information interaction module is used for issuing information to the system terminal;
the online voice recognition module is used for calculating the audio frequency transmitted into the information interaction module by the system terminal and obtaining a recognition result; redundant online voice recognition module mode, when the network state is good, the audio sample carries out operation on the online voice recognition module transmitted to the server side, and outputs the result to the system terminal; when the network state is poor and the audio sample cannot be uploaded, the system terminal actively enables the built-in offline voice recognition module, sends the audio sample to the offline voice recognition module, and outputs a recognition result by the module.
The data storage module is used for storing information (such as text, pictures, audio and the like) which is required to be stored from the system terminal;
the fault file library module refers to a fault file library which needs to be issued to the system terminal after receiving an offline fault file library updating request of the system terminal;
and the video guidance management module is used for performing management services (including video guidance user management, video WEB service, video conference service, SIP service, proxy service, chat service, streaming media service, storage and the like) of video guidance of the system terminal.
In the specific implementation, the system terminal further comprises a login module, in order to meet the requirements that the system can be normally logged in offline and online, and the usability of the system is improved, the system adopts a redundant login mode, the login module comprises two-dimension code login, user name and password login, and other modules of the system terminal can be accessed after successful login. The login module is arranged, the confidentiality of equipment is protected, and a redundant login mode is adopted, so that the login of clients is facilitated.
When the method is implemented, the server side further comprises a user management module, a user name and a corresponding password are stored in the user management module, the user name and the password are logged in for network verification login, information input by a user is required to be transmitted to the user management module through an information interaction module of the server side, then the user management module performs user verification and outputs a verification result to the system terminal, and other modules of the system terminal can be accessed after verification is passed. After a user wakes up a user name and password login interface, the system terminal respectively inputs the user name and the password to input the password, activates a login instruction after the input is finished, encrypts the user name and the password input by the user, sends the encrypted information to a designated address of a server through HTTPS, receives the encrypted information through an information interaction module, transmits the encrypted information to a user management module to perform user verification, and if the user verification is passed, the user management module outputs a message of successful verification to the information interaction module, and transmits the message to the system terminal through the information interaction module, and the system terminal jumps to a system main interface after receiving the message; if the verification result of the user management module is not passed, the user management module outputs a message of verification failure to the information interaction module, and the message is issued to the system terminal by the information interaction module, and after the system terminal receives the message, the information prompt is carried out, and the system terminal interface stays at the user name and password login interface, as shown in fig. 3, which is a user name and password login flow chart.
In specific implementation, the two-dimension code login is an offline specific rule verification login, an offline decoding module is arranged in the system terminal, and when the decoded information meets specific system rules, the verification is considered to be successful, and other modules of the system terminal can be accessed，No network authentication is required. When the user is in an off-line state, the user logs in through the two-dimension code. After a user wakes up a two-dimension code login, a system terminal pops up a system authorization picture (photographing and video authorization and local storage access authorization), after the user agrees with the authorization, the system terminal enters a scanning interface, the user needs to place the system login two-dimension code in a visual field scanning frame, a background algorithm of the system terminal decodes and automatically performs specific rule verification, if the decoded information accords with the specific rule verification, the verification is considered to pass, the background of the system terminal outputs verification success information, and the system terminal interface automatically jumps to a system main interface. The operation does not need a network, and is an offline verification operation for the system terminal. The two-dimensional code login flow is shown in fig. 2.
In the implementation, the video guidance module supports a 1-to-1 conference or a multi-person conference, the person participating in the guidance can freeze the field image of the video and mark the image, all the persons participating in the conference can see the mark of the expert in real time during the image mark, and can carry out voice communication at the same time, and the final picture after the mark is completed can be sent to all the persons participating in the conference.
When the system terminal is implemented, the system terminal comprises a software updating module, the server side comprises a software release module for releasing a software version and a software package to the system terminal, when a business person releases a new version of software, only the version information and the software installation package are required to be released to the software release module of the server side, after the software updating module is activated, the system terminal backstage sends a software version information network request and equipment ID to an information interaction module of the server side, the server side information interaction module sends the request to the software release module, and the software release module outputs the latest version information to the information interaction module and sends the latest version information to the system terminal; after the system terminal receives the information prompt, the user selects whether to update the software or not, and after the user selects and determines, the software update is started to be executed. The system terminal sends the software update information to the information interaction module of the server, the server sends the request to the software release module, and the software release module outputs the software installation package to the information interaction module and sends the software installation package to the system terminal. And the system terminal starts to execute downloading and prompts the downloading progress to the interface. The software installation package will be stored in the designated location of the system terminal. After the downloading is completed, the system terminal performs MD5 algorithm verification on the downloaded installation package according to the information issued by the information interaction module, and after the verification is completed, the system terminal starts to execute software installation until the installation is completed, as shown in fig. 9.
When the system is used, as shown in fig. 10, a user needs to open a system terminal login interface, can enter the system through a login module, wake up a two-dimensional code login through a voice command, enter a scanning interface, wake up a function to start scanning, then authorize the system, place the system login two-dimensional code in a camera scanning frame after opening a camera preview interface, decode acquired two-dimensional code information by the system, perform regular verification, and enter a system terminal main interface if verification is successful; the logical relationship of the two-dimension code login user information verification is as follows: after the two-dimension code login from the login interface is selected, the system starts to scan the interface, the two-dimension code login is obtained through the camera scanning system, the system decodes the obtained information, verifies the information rule, checks whether the information accords with the agreed rule, and if so, the system is considered to be successful in verification and enters the system main interface; if not, the verification is considered to be failed, and the login interface is returned.
When the network state is good, the user can also enter the system through the user name and password login function. And waking up the user name and password login through a voice instruction on a system interface, and entering the user name and password login interface. The user name is awakened by voice, the user name input interface is entered, after an input mode is selected, voice selection input is carried out according to character prompts below numbers or letters, and after the input is completed, a voice instruction is received and used for determining input content which is displayed in a prompt column after command words. The user performs password input in the same manner. After the user name and the password are input, a voice command is used for logging in and verifying the user. After awakening login, after passing verification, entering a system main interface; otherwise, information prompt is performed. The logical relationship of user name and password login user information verification is as follows: after the user name and the password are selected to log in from the login interface, the system carries out the user name and the password login interface, the user logs in after finishing inputting the user name and the password, the user name and the password information are encrypted by the system and transmitted to the server through the HTTPS, the information interaction module of the server receives the user name and the password information, decrypts the user name and the password field of the information, inquires whether the user exists in the user management module, whether the system password is matched with the received password, if so, the user authentication success message is output to the information interaction module, and the information interaction module is issued to the system terminal to indicate that the user authentication is successful and jumps to the main interface; and if not, outputting a message of failure in user authentication to an information interaction module, and issuing the message to a system terminal by the information interaction module for indicating that the user authentication fails, and jumping to a user name and password login interface.
The user enters the video module by waking up the video guidance module, and after the video system is started, the user name and the password in the video guidance management module of the server are automatically acquired to log in the video system and enter the main interface of the video system. After the expert initiates a call to the system terminal through the PC, the system terminal displays a called interface and can be used for receiving the expert remote guidance through a voice command or hanging up the call for rejecting the expert remote guidance. After answering, the system terminal can control the flash lamp state of the system terminal by 'turning on/off the flash lamp' through a voice command; sending a voice message to the expert via "start dictation"; storing and sending the current picture of the system terminal through screenshot, and taking a high-definition photo through an expert; take a photograph and send the photograph to an expert. After the expert instructs, the system terminal user can hang up the conference through the voice instruction, end the call, and return to the system main interface through the jump instruction, at the same time, the expert can share the data on the PC to the system terminal through the video system at the PC end, and can make real-time annotation in the picture, and the annotation content will be projected on the system terminal synchronously.
The user wakes up the photographing record and enters the photographing record module. The photographing recording module comprises 5 functions of scanning identification codes, voice input, photographing, completion and uploading.
The scanning function is used for scanning identification codes such as two-dimensional codes and bar codes, and carrying out information prompt on code scanning information for manual inspection. After a user enters a photographing recording page, the user wakes up to scan, and then places the two-dimensional code or the bar code in a scanning frame, and the scanned information is directly displayed in a prompt bar below a scanning label.
The voice input is used for performing text description of fault information, fault handling, fault recording and the like. After the user wakes up the voice input interface, the user starts to dictate the information, the system sends the voice information dictated by the user to the server in an audio form, the voice information is simultaneously sent to the server and comprises the equipment ID, the service ID and the request ID, after the server receives the information, the audio is transmitted into the voice recognition module to operate according to the request ID, the recognition result and the response ID are generated after the recognition is completed, the server sends the recognition result and the response ID to the system terminal according to the equipment ID and the service ID, the system terminal displays the recognition result in a voice input column, and wakes up the system terminal to complete the voice input, wherein the recognition content is displayed in a prompt column below the tag in a text form. If the user needs to input again, the user wakes up the voice input interface to input again, the system re-records the audio spoken by the user and sends the audio spoken by the user to the voice recognition module at the server for recognition, and the process is the same as that of the voice recognition module at the server. If additional content is needed after the end of a piece of audio recognition, the system wakes up the "additional" in the voice input interface, and continues the voice recognition, and attaches the recognized result to the last result.
After the instruction of photographing is awakened, the system enters a photographing mode, photographing can be completed by the instruction of photographing, and the photographed pictures are stored at the appointed positions of the system and the host. In the camera interface, the zoom level X can be instructed to adjust the focal length, the shot picture can be enlarged and reduced, the exposure level X is instructed to adjust the wave light, and the brightness of the shot picture can be adjusted; if the light is darker at the position, the flash lamp can be controlled to be turned on by the command of turning on the flash lamp.
After the wake-up is completed, the recorded contents in the photographing recording module, including scanning contents, voice input contents, photographed pictures, user information, recording date and the like, are transcoded and stored as TXT format files and stored in the appointed storage position of the system terminal.
After awakening the upload, the recorded contents in the photographing recording module, including scanning contents, voice input contents, photographed pictures, user information, recording date and the like, are encrypted according to the stipulated rules and sent to the server through HTTPS for receiving and storing.
The user can update the fault library file stored in the appointed position of the system terminal by activating the 'maintenance proposal' to enter the maintenance proposal module and waking up the 'synchronous fault library'. After waking up the synchronous fault library, the system terminal sends the equipment ID, the user ID and the file updating request to the server, the server verifies the equipment ID and the user ID, after the verification is successful, the system terminal sends the updated file to the system terminal, and the system terminal downloads the file and deletes the original file. After the downloading is completed, the system terminal performs verification of the number of files, and after the verification is passed, the system terminal performs information prompt of 'the fault library is synchronized'; otherwise, failure information prompt is carried out, and the fault library is synchronized when the network condition is good in order to ensure normal use.
The user activates the fault code, selects through the popped input column and inputs the fault code by voice according to the prompt in the column. After the selection, dictating the acceptance, wherein the input fault code appears in a prompt column behind the fault code in the interface, the user activates the selection vehicle type, the interface pops up a vehicle type selection menu, the user performs voice selection, for example, the selection of the standard motor train with two hundred and fifty kilometers, the user directly dictates the standard motor train with two hundred and fifty kilometers, a 'check mark' appears in a box in front of a label, the sign indicates that the selection is carried out, and the selected label appears in the prompt column behind the selection vehicle type in the interface after the dictation of the determination.
After the fault codes and the selected vehicle types are operated, a user activates 'inquiry', and the system terminal traverses the local storage fault file library by taking the vehicle types as key values and matches corresponding fault files; traversing entries in the matched fault file by taking the fault code as a key value, and matching corresponding entries; if the fault file and the fault entry are successfully matched, displaying the related content of the fault entry on the page; otherwise, the matching is considered to be failed, interface information prompt is carried out, and the user ID, the equipment ID, the fault vehicle type and the fault code information are sent to other service platforms for information prompt.
The user starts to execute the file synchronization function by activating the 'file synchronization', namely, a recorded file and a device ID generated in a 'photographing record' module are transmitted to a server platform through HTTPS, file storage is carried out, after the transmission is completed, information is prompted that 'file uploading is successful', and the successfully uploaded file is deleted from the local storage of the system terminal; otherwise, information prompt 'the file is not uploaded successfully' is carried out.
The user enters the software update function by activating the "software update" module. After the user activates the update, the system terminal sends the equipment ID and the system software version acquisition request to the server, and after the server receives the request, the server sends version information to the system terminal, and the system terminal displays the received software version information. The user can choose whether to upgrade the system software according to the own needs. If 'determination' is selected, the device ID and the system software update request are sent to the server, after the server receives the request, the server sends a software update package to the system terminal, the system terminal monitors the downloading process, and the downloading progress is prompted on the downloading interface. After the software update package is downloaded, the software update package is stored in a designated storage position of a system terminal, the system terminal performs MD5 algorithm verification on the software update package, and after the verification is successful, a user can execute a software update step.
Claims (10)
1. The remote operation and maintenance guiding device for the overhaul scene is characterized by comprising a system terminal and a service end which are communicated through a network, wherein a hardware carrier of the system terminal is portable intelligent equipment with a camera; the system terminal comprises a video guiding module, a photographing recording module, a maintenance suggestion module, an offline voice recognition module and a file synchronization module; the server comprises an information interaction module, an online voice recognition module, a data storage and fault file library module and a video guidance management module;
the video guiding module is used for guiding personnel to conduct video guiding on site operation personnel;
the photographing recording module is used for collecting and recording pictures and fault description information of the overhaul site;
the maintenance suggestion module is internally provided with an offline fault file library and is used for inquiring a maintenance guidance method by field operators;
the off-line voice recognition module is used for on-line voice recognition in an off-line state;
the file synchronization module is used for uploading fault field pictures and fault description information recorded in an offline state;
the information interaction module is used for information communication between the system terminal and the server;
the online voice recognition module is used for calculating the audio frequency transmitted into the information interaction module by the system terminal and obtaining a recognition result when the network is online;
the data storage module is used for storing information to be stored from the system terminal;
the fault file library module refers to a fault file library which needs to be issued to the system terminal after receiving an offline fault file library updating request of the system terminal;
and the video guidance management module is used for performing management service of video guidance of the system terminal.
2. The remote operation and maintenance guiding device for the overhaul scene according to claim 1, wherein the system terminal further comprises a login module, wherein the login module comprises two-dimension code login, user name and password login, and the system terminal can enter other modules after the login is successful.
3. The remote operation and maintenance guiding device for maintenance scene according to claim 2, wherein the service end further comprises a user management module, the user management module stores a user name and a corresponding password, the user name and the password are registered for network verification, the information input by the user is required to be transmitted to the user management module through the information interaction module of the service end, and then the user management module performs verification and outputs a verification result to the system terminal, and the rest modules of the system terminal can be accessed after the verification is passed.
4. The remote operation and maintenance guiding device for the overhaul scene according to claim 3, wherein the two-dimensional code login is an offline specific rule verification login, an offline decoding module is arranged in the system, and when the decoded information meets a specific system rule, the verification is considered to be successful, the other modules of the system terminal can be accessed without network verification.
5. The remote operation and maintenance guiding device for the overhaul scene according to claim 1, 2, 3 or 4, wherein the overhaul suggestion module comprises a fault vehicle type unit and a fault code unit, the user inputs a fault vehicle to be inquired and a fault code, and the offline overhaul guiding suggestion is obtained from an offline fault file library.
6. The remote operation and maintenance guide device for the overhaul scene according to claim 5, wherein the maintenance suggestion module is provided with a synchronous fault library module for automatically updating an offline fault file library.
7. The remote operation and maintenance guiding device for the overhaul scene according to claim 6, wherein the video guiding module supports a 1-to-1 conference or a multi-person conference, and people participating in the guiding can make real-time labeling, data pushing and audio and video guiding on the overhaul scene, and labeling information is displayed on a screen of the system terminal in real time.
8. The remote operation and maintenance guiding device for maintenance according to claim 7, wherein the system terminal further comprises a software update module, and the server further comprises a software release module for releasing the software version and the software package to the system terminal.
9. The remote operation and maintenance guiding device for maintenance according to claim 8, wherein after the updated software installation package is downloaded, MD5 verification is required, and the latest version of software installation is executed after the verification is completed.
10. The remote operation and maintenance guidance device for an overhaul scenario of claim 9, wherein the portable intelligent device is a portable wearable device or a handheld portable device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211670268.7A CN116489297A (en) | 2022-12-26 | 2022-12-26 | Remote operation and maintenance guiding equipment oriented to overhaul scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211670268.7A CN116489297A (en) | 2022-12-26 | 2022-12-26 | Remote operation and maintenance guiding equipment oriented to overhaul scene |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116489297A true CN116489297A (en) | 2023-07-25 |
Family
ID=87210761
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211670268.7A Pending CN116489297A (en) | 2022-12-26 | 2022-12-26 | Remote operation and maintenance guiding equipment oriented to overhaul scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116489297A (en) |
-
2022
- 2022-12-26 CN CN202211670268.7A patent/CN116489297A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9094543B2 (en) | Real time transmission of photographic images from portable handheld devices | |
| US8417090B2 (en) | System and method for management of surveillance devices and surveillance footage | |
| JP4264955B2 (en) | Report creation system with authentication image | |
| CN107534704A (en) | Message processing device, information processing method and message handling program | |
| CN101681564A (en) | Content generation system, content generation device, and content generation program | |
| CN111107320A (en) | Interior decoration construction remote monitering system | |
| CN107045699A (en) | Online interaction auction system and system | |
| CN115604491A (en) | Live broadcast picture control method, device, equipment, medium and computer program product | |
| CN111554412B (en) | Large and small screen fusion type online video inquiry system and method | |
| CN111653343A (en) | Medical real-time image remote consultation system and method | |
| CN105761376A (en) | Medical self-service printing terminal and fault management method and system thereof | |
| CN116489297A (en) | Remote operation and maintenance guiding equipment oriented to overhaul scene | |
| CN111641790A (en) | Method, device and system for film and television production and distribution | |
| CN110557391B (en) | Multi-scene integration-oriented emergency mobile video interaction system | |
| US20220353563A1 (en) | Method and device for content recording and streaming | |
| CN115904296A (en) | Double-recording screen menu service system | |
| CN110855929B (en) | Tax coordination command system | |
| CN112601110B (en) | Method and apparatus for content recording and sharing | |
| CN210225603U (en) | Remote video guidance maintenance system | |
| US11838338B2 (en) | Method and device for conference control and conference participation, server, terminal, and storage medium | |
| CN115424156A (en) | Virtual video conference method and related device | |
| CN111405244A (en) | Online remote video wisdom community correction system | |
| EP4311241A1 (en) | Method and device for content recording and streaming | |
| CN115641217B (en) | System for be used for fast place of traffic accident to reimburse soon | |
| CN116366800B (en) | Online conference method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |