CN103971311A - Reasoning drill method and system based on man-machine coordination - Google Patents
Reasoning drill method and system based on man-machine coordination Download PDFInfo
- Publication number
- CN103971311A CN103971311A CN201410194355.9A CN201410194355A CN103971311A CN 103971311 A CN103971311 A CN 103971311A CN 201410194355 A CN201410194355 A CN 201410194355A CN 103971311 A CN103971311 A CN 103971311A
- Authority
- CN
- China
- Prior art keywords
- entity
- client
- script
- state
- rehearsal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Stored Programmes (AREA)
Abstract
The invention discloses a reasoning drill method and system based on man-machine coordination. According to the reasoning drill method and system based on man-machine coordination, a script interpretive execution technology, a pre-arranged plan reasoning visualization technology, a virtual reality technology and a network communication technology are combined; an independent architectural pattern is designed, wherein pre-arranged plan reasoning is driven by a kernel, data are managed by a server side, and the data are displayed by a client side; data are transmitted between all parts in the form of messages; the reasoning drill method and system can be applied to simulation training of emergency drill of various emergencies according to different pre-arranged plan scripts. The reasoning drill method and system based on man-machine coordination have the advantages that a drill scene is reproduced vividly, the drill cost is low, drill dangers and drill risks are small, and drill efficiency is high.
Description
Technical field
The present invention relates to a kind of reasoning drilling method and system based on man-machine coordination, belong to prediction scheme visualization technique and virtual reality technology field.The present invention relates generally to and converts word prediction scheme to 3D visual Simulation rehearsal process, specifically comprises model rendering and entity control technology, internet message transmission technology, script inference technology and the evaluation technology to true man.Method and system of the present invention can be for establishment and the amendment of the simulated maneuver of burst fire-disaster accident and emergency management and rescue prediction scheme.
Background technology
Safety in production is the eternal theme of enterprise, is related to the safety of national wealth and people's life, is related to the stable of society and develops in a healthy way, and safety does not just have benefit.All trades and professions are all attached great importance to trouble free service now, improve and can effectively reduce to the Ability of emergency management of burst accident injures and deaths and the loss that burst accident causes, and emergency management and rescue prediction scheme is widely recognized as the effective means that reply disaster occurs.
Manufacturing enterprise can carry out relevant emergency management and rescue combat exercise according to enterprise's characteristic, and conventional training modality is mainly to watch rehearsal training study course, in the middle of be aided with picture and text and sound and explain to strengthen emergency management and rescue consciousness and the attainment of enterprise staff.Moreover be to carry out combat exercise according to pre-buried disaster and the prediction scheme pre-establishing, thereby improve take part in a performance personnel's outstanding event handling ability and commanding officer's command ability and command art.
Traditional emergency management and rescue rehearsal training modality cannot meet the demand of modernization safety in production, due to the kind difference of disaster, different and the equipment of executor of reply, the restriction of the condition such as place and environment, relevant emergency preplan is learnt again to rehearsal from formulating to, expend a large amount of manpowers, material resources and financial resources, a huge burden and workload, it is few that actual rehearsal exists training opportunity, training effect is not obvious, training effect cannot reappear, training effect is evaluated untrue, can't drill whenever and wherever possible, even there is sequencing, formalization, rehearsal effect is unsatisfactory.
There is huge variation in the world today, the application that large-scale tactics of human sea has no longer adapted to industrial expansion, particularly virtual reality technology is being carried out a unprecedented revolution to industry.Virtual reality improves development efficiency to enterprise, and reinforcement data acquisition, analysis, processing power play an important role.Virtual reality is the comprehensive of multiple technologies, and it carries out visualized operation with mutual by man-machine interface to complex data.
Visualization technique, as explaining the most effective means of mass data, has developed into the research field of current hot topic.Visual data-switching is become to figure, make a lot of technical fields that basic change occur.The main process of scientific visualization is modeling and plays up, and modeling is the geometric graphic element that data-mapping is become to object, and playing up is that geometric graphic element is depicted as to figure and image.
The present invention proposes a kind of man-machine interaction method and system, the method and based on virtual reality technology and visualization technique, the method and system can be applied to the reasoning rehearsal of emergency management and rescue, utilize multimedia document and the tight enterprise's appraisal mechanism that both pictures and texts are excellent to come specification enterprise security manager, strengthening investigation of safety awareness of staff, angle is from actual combat set out, improve daily emergency drilling efficiency, degree of understanding and the practical operation technical ability of inspection emergency response personnel to emergency preplan, executive routine; Drill difficulty by adjustment simultaneously, further train and improve professional qualities and the ability of emergency response personnel, improve constantly emergent strick precaution level, avoid and reduce company and worker under accident conditions coming to harm, guarantee the stable operation of enterprise.
Summary of the invention
The invention provides a kind of reasoning drilling method based on man-machine coordination, the steps include:
1) initialization client scene state, sets up the communication connection with service end; Client comprises user interactive system and virtual scene drawing system; Service end comprises script inference system, cooperative control system and evaluation system;
2) it is synchronous that service end loading scripts prediction scheme the client to connection are carried out entity state;
3) client receives user's input by described user interactive system, and this input is resolved to the instruction message that cooperative control system or script inference system can be identified;
4) instruction message that client obtains parsing carries out data packing, and sends to service end;
5) service end receives and resolves the instruction message that client sends, and by cooperative control system, all entity state is carried out to consistency maintenance, and wherein said entity comprises true man's entity and machine entity;
6) script inference system, taking prediction scheme script as basis, carries out reasoning control according to described entity state to rehearsal flow process, and the result of reasoning control is encapsulated as to instruction message sends to client;
7) instruction message that client analysis service end sends, correspondingly upgrade rehearsal scene by virtual scene drawing system, and will in rehearsal flow process, need the content of feedback to present to user by user interactive system, user as true man's entity must feed back described content at the appointed time, otherwise machine entity replaces true man's entity to feed back, to ensure that drilling flow process continues;
8) service end receives the content feed that client packing sends, and by evaluation system, described content feed is passed judgment on, and evaluation result is preserved;
9) script inference system judges whether the script constitutional diagram of rehearsal flow process arrives final state, if arrived, finishes to drill flow process, otherwise execution step 3);
10) after rehearsal flow process finishes, client is obtained the evaluation result of evaluation system from service end, and carries out result demonstration by user interactive system.
Further, the process of described renewal rehearsal scene comprises: client reads scene configuration file, searches and load correlation model file under assigned catalogue, utilizes virtual reality three-dimensional rendering technology to show model of place state.
Further, the user interactive system of described client comprises: the functions such as scene walkthrough, version selection, flow process control and visual angle switching, and described virtual scene drawing system is for the real-time rendering of model of place;
Further, while building described script constitutional diagram, convert word prediction scheme to script prediction scheme, specifically comprise: first, the key message extracting in word prediction scheme builds state set; Then, in conjunction with network topological diagram and expansion finte-state machine thought, utilize node to represent status information, limit represents the migration information between state, builds the script constitutional diagram of complete rehearsal flow process; Finally, in conjunction with real logicality and the dependency number reduced state diagram of gaining knowledge; Wherein, the node of the script constitutional diagram of described rehearsal flow process and limit are all with the storage of XML document form, utilize the semi-automatic script state Core Generator of independent development to generate this configuration file, analyze the form of expression of the unit operation of word prediction scheme in virtual reality rehearsal, and the unit operation of being correlated with is packaged into script storehouse, utilize script storehouse to complete the final conversion of word prediction scheme to script prediction scheme.
Further, the instruction message form of communicating by letter between service end and client comprises message header and message body two parts, by the length information reading in message header, message flow is resolved to different message bodies.
Further, the entity state that cooperative control system relates to while carrying out consistency maintenance comprises the position of entity, towards, speed and action, also comprises speed, direction and the color of disaster particle; A part for described entity state is by the control of machine entity, and another part is by the control of true man's entity, and cooperative control system will ensure that these states have consistance eventually all clients.
Further, described XML file is state derivation configuration file, described script inference system builds by reading described XML file the described constitutional diagram that computing machine can be identified, carry out forward reasoning taking status information as node, support node state one to one, one-to-many and many-to-one resolvant, only have all former piece nodes of present node to be all labeled as final state, when the state of present node meets transition condition simultaneously, script inference system just allows present node to carry out state transition; Described XML file comprises entity information, status information, state transition information and expression formula information; In entity information and status information, comprise unique identification code, state transition information table understands the different resolvants between state, and expression formula information table understands the necessary satisfied condition of present node migration institute of carrying out.
Further, described script inference system is supported the in like manner pattern of mixing of true man's entity and machine entity; Script inference system is with critical event point division state, and each state comprises some unit's operations of not specifying true man's entity or machine entity; The designing requirement of described script inference system only judges whether state completes, and does not consider to be completed by true man's entity or machine entity, in the time that true man's entity rehearsal operation exceeds the stipulated time, is automatically replaced with machine entity, thereby ensures the correct execution of rehearsal flow process.
Further, the judge of described evaluation system comprises objective problem examination and subjective operation evaluation, the content of described judge is all kept in special database, and wherein objective problem comprises stem, item content and answer, and operation comprises content of operation, operating parameter and time qualified; The condition that script inference system is set according to described script prediction scheme sends answer or operation requirements to client; In the time that client requires to answer, the content of problem is shown in user interactive system, receive true man entity the result be sent to service end of answering; In the time that client arrives operation requirements, at the content of operation of time qualified interior reception true man entity, and content of operation is sent to service end; If true man's entity of client exceedes limiting time and fails complete operation, the machine entity in this client replaces true man's entity to complete follow-up rehearsal flow process.
Further, evaluation system is according to the corresponding judge content that reads from database, and answer result and content of operation that client is sent are passed judgment on, and will preserve corresponding evaluation result; After rehearsal process finishes, evaluation result is sent to client by evaluation system, and client shows at user interactive system after resolving.
The present invention also provides a kind of reasoning drilling system based on man-machine coordination, it is characterized in that comprising virtual reality rehearsal client and service end; Described virtual reality client is connected by communication network with service end; Described client comprises graphical interface of user, entity control module, particle FX Module, voice message and call module, visual angle administration module and message sink are resolved and sending module in real time; Service end comprises script reasoning module, Collaborative Control module, evaluation module and message sink parsing and sending module;
Described graphical interface of user, for receiving interactive operation request command;
Described entity control module, for the instruction message receiving from service end is converted to corresponding entity motion state, position and angle attribute that this module support is added personage, characters name and action is set, personage's translational speed and the anglec of rotation is set and personage's carrying object is set;
Described particle FX Module, thus show particle special efficacy for loading particle, support to control particle direction, speed and life cycle attribute;
Described voice message and the module of conversing in real time, its sound prompt function is for pointing out text to show with voice mode in rehearsal process, thus prompting user carries out key operation; Its real-time call function is in the time of the online rehearsal of many true man, carries out voice call chat for the true man user user that selects to take part in a performance arbitrarily in LAN (Local Area Network), supports one to one and one-to-many call mode;
Described visual angle administration module, for the visual angle of each entity of managing virtual space and scene, client utilizes this module to switch between above-mentioned each visual angle, shows space, corresponding visual angle;
The message sink of described client is resolved and sending module, for receiving the message bag that service end sends and it being resolved, mutual, the control parsing and maintenance command is sent to corresponding module processing; The Command encapsulate simultaneously other modules being generated is that message bag sends to described service end;
Described script reasoning module, for loading prediction scheme script, the rehearsal data that send according to client are carried out reasoning, and the reasoning results is returned to client message reception parsing and sending module with the form of order;
Described Collaborative Control module, for safeguarding the consistance of all clients entities states and particle state, wherein said entity comprises machine entity and true man's entity, and described entity state comprises position, towards, speed and action, and particle state comprises speed, direction and color;
Described evaluation module, passes judgment on and preserves corresponding evaluation result for answer result and content of operation that client is submitted to; Evaluation module receives that client checks after result request, and evaluation result is sent to this client;
The message sink of described service end is resolved and sending module, and for transmission, reception and the parsing work of message, this module is distributed to different messages according to type of message other each modules of service end.
Further, the described client method of operation can be divided into three kinds: demo mode, mode of learning and rehearsal pattern; Demo mode can not need true man's entity to participate in, and only has machine entity to advance rehearsal flow process according to script prediction scheme; Mode of learning belongs to unit networking pattern, and collaborative participation of single true man and machine entity drilled; Rehearsal pattern belongs to multimachine networking pattern, and several true man operators control many clients and are connected with service end, and collaborative participation of several true man and machine entity drilled; Meanwhile, under three kinds of patterns, all there is different types of emergency management and rescue script prediction scheme available.
The present invention explains that by script execution technique, prediction scheme reasoning visualization technique, virtual reality technology and the network communications technology combine, design a kind of independent architecture pattern taking " prediction scheme reasoning is as kernel-driven; service end management data; client shows data ", between each several part, carry out data transmission with form of message, can make the simulated training of the present invention for variety classes accident emergency drilling according to different prediction scheme scripts.The present invention not only supports that the automatic deduction of prediction scheme script is visual to realize prediction scheme, supports true man user to participate in emergency management and rescue rehearsal simultaneously, realizes rehearsing in coordination of true man and prediction scheme machine entity on the basis of man-machine interaction.The present invention has designed a kind of rehearsal procedural information Real-time Collection, and the method for after rehearsal, user's operation behavior being carried out evaluation can be carried out statistical study afterwards to rehearsal process effectively, finds out the irrationality of rehearsal flow process and the user's that takes part in a performance faulty operation.The present invention has that rehearsal scene reproduction true to nature, rehearsal cost are low, rehearsal danger and risk is little, rehearsal efficiency high, on the basis of, Evaluation visual in prediction scheme reasoning, the present invention is aided with screen text demonstration, briefing sound synthesizes and many true man real-time communication function, can complete efficiently the take part in a performance object of personnel training of emergency management and rescue, improve emergency personnel's the skill level to variety classes Rescue Plan and the Ability of emergency management to accident.
Brief description of the drawings
The process flow diagram of Fig. 1, a kind of emergency management and rescue reasoning drilling method based on man-machine coordination of the present invention;
The server side script reasoning process flow diagram of Fig. 2, a kind of emergency management and rescue reasoning rehearsal based on man-machine coordination of the present invention;
The system construction drawing of Fig. 3, a kind of emergency management and rescue reasoning rehearsal based on man-machine coordination of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the present invention is further elaborated:
The method of the emergency management and rescue reasoning rehearsal based on man-machine coordination of the present invention, as shown in Figure 1, overall procedure is as follows: the mutual client of virtual reality is connected with reasoning cooperation with service end, after the client of all participation rehearsals is all connected to service end, service end is assigned and is started to drill instruction, does not have the client of true man's entity control to be replaced by machine entity.During rehearsal, each client is carried out respectively task (comprise answer exercise question, complete rescue operation) separately according to prediction scheme content.Cooperative control system in service end is responsible for safeguarding the consistance of each client scene state, script inference system in service end is controlled in real time to rehearsal flow process, sent and received and resolve to the instruction of client transmission message by message, according to message, instruction completes scene and the renewal of rehearsal flow process to client.Script inference system judgement rehearsal flow process has arrived done state, sends rehearsal END instruction to client.The evaluation system acquisition rehearsal evaluation result of client service end, shows by user interactive system.
The mutual client of virtual reality is by the virtual rehearsal scene of virtual scene drawing system drawing three-dimensional, and accepts user and operate input and carry out alternately with virtual scene.
1) client loads local three-dimensional scenario resources and is presented in user interactive system, and user can pass through the various functions of the mutual clients of the whole virtual reality of interactive mode control such as mouse, keyboard.The interface of user interactive system can be divided into two parts: window main frame and three-dimensional vision window.Main window framework has comprised the controls such as menu, button, list, and the systemic functions such as system setting, demonstration are provided.Three-dimensional vision window shows three-dimensional virtual scene.User interactive system can also be controlled dummy scene roaming, can control rehearsal entity moves, turns to, complete rescue inter-related task action, the word that can drill flow process relevant information show and sound broadcasting etc. a series of to drill relevant function and operations.
2) user interactive input need to be converted to the instruction message that reasoning cooperation with service end can be identified.Different interaction contents is converted to different type of messages, and the form of every kind of type of message and parameter are not identical.Message sends transmission, reception and the parsing work of being responsible for message instruction with resolution system of receiving.Direct message transfer entity in network, message entity to be sent turned to byte stream by sequence and add some control bytes laggard enter Internet Transmission.The byte stream of receiving from network is all common binary digit, cannot directly read message command information, when message parse, to first binary digit be divided into some bytes corresponding to message entity, then these bytes be implemented to unserializing operation and just can obtain original message entity.Three-dimensional scenic drafting module is made corresponding renewal and is presented at graphic user interface rehearsal scene according to message content again.
The groundwork of reasoning cooperation with service end be to the virtual scene entity state in the client of all connections to carry out consistency maintenance identical with entity state to guarantee the scene of all clients.Service end according to prediction scheme content, rehearsal state is carried out to reasoning control and coordinate true man's entity and machine entity between state relation, and the rehearsal behavior to all true man's entities is carried out to evaluation.
1) workflow of script explanation and inference system as shown in Figure 2.First build entity state set, state transitions set and the set of expression formula branch according to script configuration file, build the required entity state of reasoning according to all aggregate information subsequently and shift tree; Script inference system receives that rehearsal starts just to start ergodic state tree from original state after message, the api interface that execution satisfies condition and provides without the state of former piece constraint-call service end system control system and evaluation system, by rear both complete concrete method and carry out; Simultaneously, when carrying out, method can send the instruction message that rehearsal is relevant to client, client is returned to execution result after resolving and carry out message, script inference system judges according to feedback result whether state is finished, can be for carrying out if state has been finished and has not remained script, just finish reasoning process, otherwise continue to carry out current not complete state or the next state of searching.
2) synchronous coordination that the other important process of service end has been all true man's entities and machine entity.On the one hand, virtual rehearsal scene has any state to change, and ensure that these change performance in all true man's entity clients consistent.Because true man's entity is shared same virtual scene, if there is no good synchronization mechanism, will cause the virtual scene of different clients inconsistent, just cannot cooperate the smoothly emergency management and rescue rehearsal of true man's entity.Client Real-Time Monitoring user input, if input causes current rehearsal scene to change, is encapsulated as message by change information and sends to the cooperative control system of service end.This system is to message parse, and amendment is for the internal data structure of scene maintenance, generating scene update instruction mails to all clients except changing source client subsequently, and client is upgraded virtual scene after receiving instruction immediately, consistent to ensure all client scenes.In the situation that network delay is less, whole synchronizing process is very fast, and it is synchronous that all clients enough realize moment.On the other hand, if some required client of virtual rehearsal does not have the control of true man's entity, just need to be replaced and be participated in rehearsal by machine entity, machine entity mutually cooperates and jointly completes emergency management and rescue task with true man's entity.Service end cooperation control system obtains after the state change information of each client transmission, after comprehensive, form the global state of whole rehearsal flow process, transfer to script inference system drill the deduction of state and return results, cooperative control system is unified to upgrade to the machine entity state of all clients according to result.
3) evaluation system is made an appraisal for user's answer and operation behavior, to reflect its grasp situation for rehearsal task.According to the predefined content of script, in script inference system reasoning process, call evaluation system interface, send answer or operational order to client, after user completes answer or operation, client can will be submitted result to automatically.Service end evaluation system is passed judgment on answer and operating result, exercise question Assessment is to submitting answer marking to according to model answer, operation evaluation mode is taking standard operation as foundation, user is operated to the index such as spent time, operating parameter and make comprehensive evaluation.
4) it is similar with resolution system that service end message sends reception and resolution system and client message transmission reception, be to be all responsible for transmission, reception and the parsing work of message, this system that different is in service end also needs, according to type of message, different messages is distributed to other subsystem of different service ends and goes processing.
Network is the carrier that connects the mutual client of virtual reality and reasoning cooperation with service end, and message communicatings all between client and service end are all undertaken by network.Network operation to bottom encapsulates, set up a perfect Network Communication Framework, no matter make is by wireless connections or wired connection, can ensure, meeting under the client terminal quantity of rehearsal requirement, between service end and client, can carry out fast and effeciently network service.
The present invention is based on man-machine coordination emergency management and rescue reasoning drilling system modular structure as shown in Figure 3.Whole system is made up of two parts, is respectively the mutual client of reasoning cooperation with service end and virtual reality.The mutual client of virtual reality comprises graphical interface of user, entity control module, particle FX Module, voice message and call module, visual angle administration module and message sink are resolved and sending module in real time, its function is to be responsible for receiving and carrying out user's operation, advances the required state completing thereby complete emergency drilling flow process.
1) graphical interface of user: the various interfaces of carrying out interactive operation in the mutual client of virtual reality are provided, user can be by menu bar to service end request demo mode, mode of learning or online rehearsal pattern, can control rehearsal flow process speed (as: accelerate, slow down, suspend), switch user perspective, check the current rehearsal time used by right hand column, can be by button the data to service end request Evaluation result, also can complete information interaction by clicking personage or the equipment that virtual reality play up in display interface.
2) entity control module: this module is for being converted to corresponding entity motion state by the instruction message receiving from service end, supports interpolation personage, characters name and action are set, personage's translational speed and the anglec of rotation are set, the attribute such as position and angle of personage's carrying object is set; Associative operation also can act on emergency management and rescue car and fire truck.
3) particle FX Module: this module, receiving after the particle load instructions that also analysis service end sends, can be searched the model matching with particle name and play up in resources bank.Particle effect is comprised attribute initialization by particle script, and the interface that also can provide by system after playing up is controlled the attributes such as particle emission direction, speed, life cycle.
4) voice message and the module of conversing in real time: sound prompt function is by the instruction of analysis service end message, calling system sound synthesis module will point out text to show with voice mode in message, thereby prompting user carries out key operation, this module not only supports multiple sound to mix broadcasting, also supports because of the far and near Doppler effect that produces alternative sounds size of distance; Call function, using the network address as user's unique identification code, sends to given client end by network by the speech data of this locality packing in real time, and client decompressed speech data are also called windows Basic API and carried out speech play.This module is when the online rehearsal of many true man, and the true man user user that can select to take part in a performance arbitrarily in LAN (Local Area Network) carries out voice call chat, supports one to one and one-to-many call mode.
5) visual angle administration module: be only equipped with a video camera in emergency management and rescue scene, mock inspection person carries out checking of different degrees of detail to the optional position in scene.This module supports the visual angle of fixed location to switch and follow the function at the real-time mobile visual angle of personnel of taking part in a performance arbitrarily, can be for the visual angle of each entity of managing virtual space and scene, and client utilizes this module to switch between above-mentioned visual angle, shows space, corresponding visual angle.
6) message sink is resolved and sending module: for receiving the message bag that service end sends and it being resolved, mutual, the control parsing and maintenance command are sent to corresponding module processing; The Command encapsulate simultaneously other modules being generated is that message bag sends to described service end.
Reasoning cooperation with service end comprises script reasoning module, Collaborative Control module, evaluation module and message sink parsing and sending module, and its function is to be responsible for the evaluation of the control of emergency drilling flow process, entity consistency maintenance and rehearsal flow process.
1) script reasoning module: this module is the combination of script system and inference system, script system has the execution of explanation function, can well script be converted to the instruction type that platform is identified.The emergency preplan entity state transfer relationship that first inference system generates according to configuration file, content of text in the corresponding script system of identification also sends rehearsal flow process steering order in order one by one to client, whether the rehearsal data that simultaneously receive client feedback judge whether current state is finished and follow-uply have state to carry out, and finally the reasoning results returned to order with the form of order and receive and resolve and sending module.
2) Collaborative Control module: the present invention takes service end-client framework, the form that service end sends message by network is safeguarded the consistance of all clients entities states and particle state, wherein entity comprises machine entity and true man's entity, described entity state comprises position, towards, speed and action, particle state comprises speed, direction, color;
3) evaluation module: service end receives exercise question answer data and the content of operation data that client true man submit in real time, rehearsal finishes give a mark evaluation result is preserved of the rear true man to submit operation.When receiving client, evaluation module checks that, after evaluation result request message, this module sends to this requesting client by network by evaluation result.
4) message sink is resolved and sending module, and for transmission, reception and the parsing work of message, this module is distributed to different messages according to type of message other each modules of service end.
Claims (10)
1. the reasoning drilling method based on man-machine coordination, the steps include:
1) initialization client scene state, sets up the communication connection with service end; Client comprises user interactive system and virtual scene drawing system; Service end comprises script inference system, cooperative control system and evaluation system;
2) it is synchronous that service end loading scripts prediction scheme the client to connection are carried out entity state;
3) client receives user's input by described user interactive system, and this input is resolved to the instruction message that cooperative control system or script inference system can be identified;
4) instruction message that client obtains parsing carries out data packing, and sends to service end;
5) service end receives and resolves the instruction message that client sends, and by cooperative control system, all entity state is carried out to consistency maintenance, and wherein said entity comprises true man's entity and machine entity;
6) script inference system, taking prediction scheme script as basis, carries out reasoning control according to described entity state to rehearsal flow process, and the result of reasoning control is encapsulated as to instruction message sends to client;
7) instruction message that client analysis service end sends, correspondingly upgrade rehearsal scene by virtual scene drawing system, and will in rehearsal flow process, need the content of feedback to present to user by user interactive system, user as true man's entity must feed back described content at the appointed time, otherwise machine entity replaces true man's entity to feed back, to ensure that drilling flow process continues;
8) service end receives the content feed that client packing sends, and by evaluation system, described content feed is passed judgment on, and evaluation result is preserved;
9) script inference system judges whether the script constitutional diagram of rehearsal flow process arrives final state, if arrived, finishes to drill flow process, otherwise execution step 3);
10) after rehearsal flow process finishes, client is obtained the evaluation result of evaluation system from service end, and carries out result demonstration by user interactive system.
2. the method for claim 1, is characterized in that the user interactive system of described client comprises: scene walkthrough, version selection, flow process control and visual angle handoff functionality; Described virtual scene drawing system is for the real-time rendering of model of place, the process of wherein said renewal rehearsal scene comprises: client reads scene configuration file, under assigned catalogue, search and load correlation model file, utilize virtual reality three-dimensional rendering technology to show model of place state.
3. the method for claim 1, while it is characterized in that building described script constitutional diagram, converts word prediction scheme to script prediction scheme, specifically comprises: first, the key message extracting in word prediction scheme builds state set; Then, in conjunction with network topological diagram and expansion finte-state machine thought, utilize node to represent status information, limit represents the migration information between state, builds the script constitutional diagram of complete rehearsal flow process; Finally, in conjunction with real logicality and the dependency number reduced state diagram of gaining knowledge; Wherein, the node of the script constitutional diagram of described rehearsal flow process and limit are all with the storage of XML document form, utilize the semi-automatic script state Core Generator of independent development to generate this configuration file, analyze the form of expression of the unit operation of word prediction scheme in virtual reality rehearsal, and the unit operation of being correlated with is packaged into script storehouse, utilize script storehouse to complete the final conversion of word prediction scheme to script prediction scheme.
4. method according to claim 1, is characterized in that: the instruction message form of communicating by letter between service end and client comprises message header and message body two parts, by the length information reading in message header, message flow is resolved to different message bodies.
5. method according to claim 1, is characterized in that: the entity state that cooperative control system relates to while carrying out consistency maintenance comprises the position of entity, towards, speed and action, also comprises speed, direction and the color of disaster particle; A part for described entity state is by the control of machine entity, and another part is by the control of true man's entity, and cooperative control system will ensure that these states have consistance eventually all clients.
6. method as claimed in claim 3, it is characterized in that, described XML file is state derivation configuration file, described script inference system builds by reading described XML file the described constitutional diagram that computing machine can be identified, carry out forward reasoning taking status information as node, support node state one to one, one-to-many and many-to-one resolvant, only have all former piece nodes of present node to be all labeled as final state, when the state of present node meets transition condition simultaneously, script inference system just allows present node to carry out state transition; Described XML file comprises entity information, status information, state transition information and expression formula information; In entity information and status information, comprise unique identification code, state transition information table understands the different resolvants between state, and expression formula information table understands the necessary satisfied condition of present node migration institute of carrying out.
7. the method for claim 1, is characterized in that the in like manner pattern of mixing of described script inference system support true man's entity and machine entity; Script inference system is with critical event point division state, and each state comprises some unit's operations of not specifying true man's entity or machine entity; The designing requirement of described script inference system only judges whether state completes, and does not consider to be completed by true man's entity or machine entity, in the time that true man's entity rehearsal operation exceeds the stipulated time, is automatically replaced with machine entity, thereby ensures the correct execution of rehearsal flow process.
8. method according to claim 3, it is characterized in that: the judge of described evaluation system comprises objective problem examination and subjective operation evaluation, the content of described judge is all kept in special database, wherein objective problem comprises stem, item content and answer, and operation comprises content of operation, operating parameter and time qualified; The condition that script inference system is set according to described script prediction scheme sends answer or operation requirements to client; In the time that client requires to answer, the content of problem is shown in user interactive system, receive true man entity the result be sent to service end of answering; In the time that client arrives operation requirements, at the content of operation of time qualified interior reception true man entity, and content of operation is sent to service end; If true man's entity of client exceedes limiting time and fails complete operation, the machine entity in this client replaces true man's entity to complete follow-up rehearsal flow process; Wherein, evaluation system is according to the corresponding judge content that reads from database, and answer result and content of operation that client is sent are passed judgment on, and will preserve corresponding evaluation result; And after rehearsal process finishes, evaluation result is sent to client by evaluation system, client shows at user interactive system after resolving.
9. the reasoning drilling system based on man-machine coordination, is characterized in that comprising virtual reality rehearsal client and service end; Described virtual reality client is connected by communication network with service end; Described client comprises graphical interface of user, entity control module, particle FX Module, voice message and call module, visual angle administration module and message sink are resolved and sending module in real time; Service end comprises script reasoning module, Collaborative Control module, evaluation module and message sink parsing and sending module;
Described graphical interface of user, for receiving interactive operation request command;
Described entity control module, for the instruction message receiving from service end is converted to corresponding entity motion state, position and angle attribute that this module support is added personage, characters name and action is set, personage's translational speed and the anglec of rotation is set and personage's carrying object is set;
Described particle FX Module, thus show particle special efficacy for loading particle, support to control particle direction, speed and life cycle attribute;
Described voice message and the module of conversing in real time, its sound prompt function is for pointing out text to show with voice mode in rehearsal process, thus prompting user carries out key operation; Its real-time call function is in the time of the online rehearsal of many true man, carries out voice call chat for the true man user user that selects to take part in a performance arbitrarily in LAN (Local Area Network), supports one to one and one-to-many call mode;
Described visual angle administration module, for the visual angle of each entity of managing virtual space and scene, client utilizes this module to switch between above-mentioned each visual angle, shows space, corresponding visual angle;
The message sink of described client is resolved and sending module, for receiving the message bag that service end sends and it being resolved, mutual, the control parsing and maintenance command is sent to corresponding module processing; The Command encapsulate simultaneously other modules being generated is that message bag sends to described service end;
Described script reasoning module, for loading prediction scheme script, the rehearsal data that send according to client are carried out reasoning, and the reasoning results is returned to client message reception parsing and sending module with the form of order;
Described Collaborative Control module, for safeguarding the consistance of all clients entities states and particle state, wherein said entity comprises machine entity and true man's entity, and described entity state comprises position, towards, speed and action, and particle state comprises speed, direction and color;
Described evaluation module, passes judgment on and preserves corresponding evaluation result for answer result and content of operation that client is submitted to; Evaluation module receives that client checks after result request, and evaluation result is sent to this client;
The message sink of described service end is resolved and sending module, and for transmission, reception and the parsing work of message, this module is distributed to different messages according to type of message other each modules of service end.
10. system as claimed in claim 9, is characterized in that the described client method of operation can be divided into three kinds: demo mode, mode of learning and rehearsal pattern; Demo mode can not need true man's entity to participate in, and only has machine entity to advance rehearsal flow process according to script prediction scheme; Mode of learning belongs to unit networking pattern, and collaborative participation of single true man and machine entity drilled; Rehearsal pattern belongs to multimachine networking pattern, and several true man operators control many clients and are connected with service end, and collaborative participation of several true man and machine entity drilled; Meanwhile, under three kinds of patterns, all there is different types of emergency management and rescue script prediction scheme available.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410194355.9A CN103971311A (en) | 2014-05-09 | 2014-05-09 | Reasoning drill method and system based on man-machine coordination |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410194355.9A CN103971311A (en) | 2014-05-09 | 2014-05-09 | Reasoning drill method and system based on man-machine coordination |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103971311A true CN103971311A (en) | 2014-08-06 |
Family
ID=51240764
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410194355.9A Pending CN103971311A (en) | 2014-05-09 | 2014-05-09 | Reasoning drill method and system based on man-machine coordination |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103971311A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107481574A (en) * | 2017-07-04 | 2017-12-15 | 河北信成发科技有限公司 | Railway shunting 3D simulation training appraisal systems |
| CN108847081A (en) * | 2018-07-09 | 2018-11-20 | 天维尔信息科技股份有限公司 | A kind of fire-fighting simulated training method based on virtual reality technology |
| CN109333532A (en) * | 2018-10-12 | 2019-02-15 | 南方电网科学研究院有限责任公司 | A kind of crusing robot control method based on man-machine coordination system |
| CN110879844A (en) * | 2019-10-25 | 2020-03-13 | 北京大学 | Cross-media reasoning method and system based on heterogeneous interactive learning |
| CN111125238A (en) * | 2019-12-25 | 2020-05-08 | 中国人民解放军63920部队 | Display data processing method and device |
| WO2024032728A1 (en) * | 2022-08-12 | 2024-02-15 | 北京津发科技股份有限公司 | Method and apparatus for evaluating intelligent human-computer coordination system, and storage medium |
| CN117764157A (en) * | 2023-12-19 | 2024-03-26 | 北京图安世纪科技股份有限公司 | Emergency desktop deduction system and method based on knowledge question and answer |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101075275A (en) * | 2007-06-28 | 2007-11-21 | 上海交通大学 | Multi-role distributed cooperating simulation drilling method |
| CN101777271A (en) * | 2009-01-13 | 2010-07-14 | 深圳市科皓信息技术有限公司 | Emergency training exercise method and system |
| CN101799999A (en) * | 2010-04-06 | 2010-08-11 | 中国石油化工股份有限公司 | Accident emergency drilling system and method |
| CN201886652U (en) * | 2010-09-26 | 2011-06-29 | 煤炭科学研究总院重庆研究院 | Analog simulation training and drilling system in mine |
| CN103093035A (en) * | 2012-12-30 | 2013-05-08 | 江苏远望神州软件有限公司 | Computer simulation system and simulation method used for urban crisis emergency decision-making drills |
-
2014
- 2014-05-09 CN CN201410194355.9A patent/CN103971311A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101075275A (en) * | 2007-06-28 | 2007-11-21 | 上海交通大学 | Multi-role distributed cooperating simulation drilling method |
| CN101777271A (en) * | 2009-01-13 | 2010-07-14 | 深圳市科皓信息技术有限公司 | Emergency training exercise method and system |
| CN101799999A (en) * | 2010-04-06 | 2010-08-11 | 中国石油化工股份有限公司 | Accident emergency drilling system and method |
| CN201886652U (en) * | 2010-09-26 | 2011-06-29 | 煤炭科学研究总院重庆研究院 | Analog simulation training and drilling system in mine |
| CN103093035A (en) * | 2012-12-30 | 2013-05-08 | 江苏远望神州软件有限公司 | Computer simulation system and simulation method used for urban crisis emergency decision-making drills |
Non-Patent Citations (1)
| Title |
|---|
| 张博伦，王宁，马慧敏: "有限状态机在模拟演练系统中的应用", 《计算机系统应用》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107481574A (en) * | 2017-07-04 | 2017-12-15 | 河北信成发科技有限公司 | Railway shunting 3D simulation training appraisal systems |
| CN108847081A (en) * | 2018-07-09 | 2018-11-20 | 天维尔信息科技股份有限公司 | A kind of fire-fighting simulated training method based on virtual reality technology |
| CN109333532A (en) * | 2018-10-12 | 2019-02-15 | 南方电网科学研究院有限责任公司 | A kind of crusing robot control method based on man-machine coordination system |
| CN110879844A (en) * | 2019-10-25 | 2020-03-13 | 北京大学 | Cross-media reasoning method and system based on heterogeneous interactive learning |
| CN110879844B (en) * | 2019-10-25 | 2022-10-14 | 北京大学 | Cross-media reasoning method and system based on heterogeneous interactive learning |
| CN111125238A (en) * | 2019-12-25 | 2020-05-08 | 中国人民解放军63920部队 | Display data processing method and device |
| CN111125238B (en) * | 2019-12-25 | 2023-09-01 | 中国人民解放军63920部队 | Display data processing method and device |
| WO2024032728A1 (en) * | 2022-08-12 | 2024-02-15 | 北京津发科技股份有限公司 | Method and apparatus for evaluating intelligent human-computer coordination system, and storage medium |
| CN117764157A (en) * | 2023-12-19 | 2024-03-26 | 北京图安世纪科技股份有限公司 | Emergency desktop deduction system and method based on knowledge question and answer |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103971311A (en) | Reasoning drill method and system based on man-machine coordination | |
| Prouzeau et al. | Corsican twin: Authoring in situ augmented reality visualisations in virtual reality | |
| CN106200983A (en) | A kind of combined with virtual reality and BIM realize the system of virtual reality scenario architectural design | |
| CN108268128A (en) | A kind of safety in production emergency preplan 3DVR virtual reality drilling systems | |
| CN104680320A (en) | BIM-based project management system and method | |
| Geng et al. | Digital Twin in smart manufacturing: remote control and virtual machining using VR and AR technologies | |
| Li et al. | A virtual reality platform for safety training in coal mines with AI and cloud computing | |
| CN104766155A (en) | Engineering project element management method and system based on BIM | |
| CN107888676A (en) | A kind of high in the clouds self-study environmental device based on micro services | |
| CN102982209A (en) | Space network visual simulation system and method based on HLA (high level architecture) | |
| CN103413041B (en) | A kind of collaborative perception system constituting method based on complex product development object | |
| Vidal-Balea et al. | A collaborative industrial augmented reality digital twin: Developing the future of shipyard 4.0 | |
| Yu et al. | A virtual reality simulation for coordination and interaction based on dynamics calculation | |
| CN103310668B (en) | Electric equipment maintenance multi-task multi-role collaborative interaction implementation method | |
| Chang et al. | Geo‐Social Model: A Conceptual Framework for Real‐time Geocollaboration | |
| Wittman | OneSAF as an in-stride mission command asset | |
| Yan et al. | Intergrating UAV development technology with augmented reality toward landscape tele-simulation | |
| Mapar et al. | The role of integrated modeling and simulation in disaster preparedness and emergency preparedness and response: the SUMMIT platform | |
| KR20200078816A (en) | Facility education and training system using virtual reality using the created 3d model | |
| CN113436320B (en) | 3D model generation system and method based on IFC model file | |
| KR20220167913A (en) | Manufacturing and using method of 3d education contents for military machine | |
| CN112541030A (en) | Intelligent patrol management tool based on mobile platform | |
| CN112598556A (en) | Virtual-real combined remote DDC experimental platform and application thereof | |
| CN104900103A (en) | Experiential 3D Internet-of-things teaching system | |
| Yong et al. | Design and Fabrication of Mobile Visual Emergency Command Hall Based on Virtual Reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20140806 |