KR101965732B1 - the method for controling motion platform using the authoring tool - Google Patents

Abstract

The present invention relates to a control method for a motion platform using a GUI authoring tool, which forms an editor including a simulation authoring tool which can easily develop simulation content and a motion control by providing a visual programming environment of what you see is what you get (WYSIWYG) method so that an unskilled person can easily use a motion control SDK and simulation based on an existing script. A motion control editor (103) comprises: an SDK node generating unit (1031) automatically changing the SDK provided by a motion simulator developer to a node used in the editor; a scrip change unit (1032) changing a completed node graph to the script enabling the interpretation of a game engine; a GUI processing unit (1033) processing the GUI and input of the editor user; and a node canvas management unit (1034) forming a graph by combining the node and managing the same. The control method for a motion platform can control a motion based on event data generated in content at the same time by improving an existing method in which a sense of difference is felt and the event data generated in the content cannot be used, as the motion simulator is controlled by the motion control method while watching an image made after the content and the image are firstly made.

Description

A method for controlling a motion platform using a GUI authoring tool,

The present invention relates to a method of controlling a motion platform using a GUI authoring tool, and more particularly, to a method and apparatus for controlling a motion platform using a graphical user interface, such as a wigwig (WYSIWYG) The present invention relates to a control method of a motion platform using a GUI authoring tool that implements a built-in editor of a simulation authoring tool capable of easily developing motion control and simulation contents by providing a visual programming environment of a GUI.

According to the publication No. 10-2014-0082266 (Mixed Reality Content Simulation System), "a mixed reality content simulation system includes at least one content demonstration real thing, which is disposed at a different position, Modal input / output device for collecting information about the actual content for the content demonstration, and a virtual content editing device for editing the virtual content according to a predefined scenario, receiving information about the content for the content demonstration collected by the multimodal input / output device And a content authoring device configured to edit the virtual content based on information about the actual content for the content demonstration and user feedback. "

According to the publication No. 10-2011-0065388 (Medical Training Simulation System and Method), "a simulation system includes a modeling unit for graphically modeling and haptic modeling a virtual object corresponding to an object included in image data acquired in a real environment, And a authoring unit for registering the virtual object in the image data and authoring the virtual object to reproduce the registered image data. Thus, based on the experience of the expert, the tactile characteristic is similar to the actual feeling, The tactile effect can be maximized when the object is touched. "

According to the publication No. 10-2016-0108017 (Virtual Tour Experience Apparatus and Method), the virtual tour experience apparatus includes a video output module for outputting an image of a virtual travel experience content, an operation recognition module for recognizing a user's body movement, A content driving module that controls the movement of a plurality of objects included in the video of the virtual travel experience contents according to the body movement recognized through the operation operation recognition module; And a user interface for providing feedback to the user about the change in motion of the object. "

Publication No. 10-2014-0082266 (Mixed Reality Content Simulation System) Publication No. 10-2011-0065388 (Medical Training Simulation System and Method) Open No. 10-2016-0108017 (Virtual Travel Experience Apparatus and Method)

However, the control of existing contents and motion platform was created by the programmer controlling contents of graphic artist and contents planner using contents authoring tool. Existing motion platform control technology controls the motion by watching programmed images or already created images through SDK.

However, if data flow between content and HMD (head mounted display) and motion platform are not properly synchronized, content users will experience visual impairment and vestibular The mental discomfort of the nausea due to discomfort and cognitive dissonance will suffer.

In the existing control case, separation of the work area and motion control and content control are not performed at the same time, thereby causing a cognitive dissonance to the user. Also, in order to control the realistic simulation, the intention of the planner and the artist should be accurately reflected, but there is a problem that it is difficult to accurately reflect the intention because the working areas are separated from each other.

Therefore, there is a desperate need for a GUI-based control system in which graphic artists and content planners easily control the motion of the motion and edit the contents.

The present invention provides a visual programming environment of WYSIWYG (WYSIWYG) to facilitate the use of existing script-based simulation and motion control SDKs by non-developers. And to provide a control method of a motion platform using a GUI authoring tool that implements a built-in editor of a simulation authoring tool capable of easily developing motion control and simulation contents.

In order to achieve the above object, the present invention is implemented as a method of controlling a motion platform using a GUI authoring tool, which includes a motion control editor 103 operating in the form of a plug-in of an editor of an existing game engine 102.

The motion control editor 103 includes an SDK node generator 1031 for automatically converting the SDK provided by the motion simulator developer into a node used in the editor, a script generator 1031 for converting the completed node graph into a script A GUI processing unit 1033 for processing an input of an editor user and a GUI, and a node canvas managing unit 1034 for creating and managing a single graph by combining nodes. The node canvas managing unit 1034 has the following features.

Since the motion simulator is controlled by the above motion control method, it is impossible to utilize the event data generated from the contents. In order to improve the existing method in which a sense of heterogeneity is felt, And the motion is controlled simultaneously based on the data.

In an embodiment, the node comprises an event node, a control node, a data node, and an operator node.

In the embodiment, the process of converting into the script includes 1) step S211 of the script conversion unit 1032 to initialize the resource; 2) step S212 of the SDK node creation unit 1031 creating an entry node source; 3) determining whether the script conversion unit 1032 determines whether the entry node is smaller than the number of the control nodes; 4) determining whether the script conversion unit 1032 determines whether the entry node is smaller than the input number of the control node; 5) step S215 in which the script conversion unit 1032 creates an input node source of the control node; 6) step S216 in which the script conversion unit 1032 creates a source of the control node.

If the number of control nodes is not smaller than the number of control nodes in the step S213, the loop ends. If the number of control nodes is less than the number of control nodes in the step S214, the flow branches to step S216.

In the embodiment, after performing the step S215, the flow branches to the step S214, and after the step S216, the flow branches to the step S213.

According to the advantageous effects of the present invention, the graphic artist and the content planner can easily control the simulation, and finally the GUI node graph is converted into the source code easy for the programmer to view, and further precise modification is possible. It is converted into a node of GUI editor and it is possible to collaborate closely.

1 is a block diagram showing a configuration for implementing a method of controlling a motion platform according to the present invention;
2 is a flowchart showing a script conversion process in a method of controlling a motion platform according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram showing a configuration for implementing a method of controlling a motion platform according to the present invention. The motion control editor 103, which is one of the core components of the present invention, ) In the form of a plug-in.

The game engine 102 may be a content executed in the hardware called the motion simulator 101. [

The motion control editor 103 includes an SDK node creation unit 1031 for automatically converting the SDK provided by the motion simulator developer to a node used in the editor, a conversion unit for converting the completed node graph into a script that can be interpreted by the game engine A GUI processing unit 1033 for processing an input of an editor user and a GUI, and a node canvas managing unit 1034 for creating and managing a single graph by combining nodes. In this case, the canvas is an area in which a node graph is arranged. This area can be stored and loaded according to a motion motion to be defined. In this canvas, many nodes are arranged to form a graph, You can create a dataset about which node is connected to which node and save it together so that the next time you load that canvas, you can recall the previous job.

In the present specification, 1) motion control is a method of 'controlling a motion simulator', which is a control method through a low-level SDK provided by a motion simulator manufacturer or a dedicated editor program, Is used mainly, and in this specification, 2) content control means 'to control internal events and situations occurring in content and game in a pure manner'.

Conventionally, the motion must be controlled simultaneously based on the event data generated from the content. In the conventional method, the content and image are preferentially made, and the created image is viewed. Since the motion simulator is controlled by the above motion control method, I could not use event data and I felt a sense of heterogeneity.

The motion control editor 103 is driven by reflecting a motion control game engine software development kit (SDK) 104 required for the game engine 102 and input data 105 inputted by the user .

Therefore, since the content being developed by the game engine and the script converted by the motion control editor interact with each other, they are simultaneously executed with development, so that there is an effect that the motion simulator can be interlocked immediately during content development.

In this motion control editor 103, the movement of the data, event-based motion motion platform is controlled through a node-based visual programming method which can be easily used by a content planner.

Therefore, a unit that performs a single function is used to effectively control the motion platform. The Editor Window for Editing Nodes is equipped with a script converter that initializes the basic GUI and converts the graphs from the GUI to source code, and generates and initializes these source codes.

Then, through the event loop of the editor, the processing related to the user input and the connection information of the generated node are passed to the script converter, and the source code is generated based on the received data.

A node represents an event node representing a starting point, a motion control included in the SDK, a control node representing a method of a simulation engine component and representing a substantial flow and operation, a data node representing data and variables Node), and a group of operation nodes (Calc Nodes) representing various operations, logical controls, and branches.

At the moment the Editor Window is launched, the node editor system dynamically loads an existing script-based Motion Control SDK built in an intermediate language, then dynamically loads the component class and method names, parameters , And analyze the return type.

A node has a flow pin indicating actual operation for connecting to each other and a pin for exchanging data according to the type of the node group and determines the type and shape of the node to be displayed on the GUI based on the analyzed information .

In addition, the node editor allows to generate a set of data such as the currently selected node, the hovered node, and the loading status of the canvas in order to manage the run time state. In this case, the hovered node is called "hovering" when the mouse is floating on a specific node in the canvas of the motion simulator control editor, and hovering check is required for controlling the event on various GUIs.

After the above initialization process is completed, the update process is performed to connect the drawing to the actual editor and the final script conversion.

The present invention provides specialized nodes for easy motion control and is used for data-based control and event-based control.

The node that is easy to control based on the data base includes a frame entry node, a data translation node, and a distance node, and a node that is easy to perform event-based control includes a Trigger Entry Node An Event Translation Node, a Delay Node, and a Distance Node.

A frame event node is an entry point of each frame of a content, and a data translation node controls an actuator based on data obtained from contents.

The Trigger Event Node is the entry point to enter when a specific event occurs, and the Event Transform Node controls the actuator to an arbitrary value.

The Delay Node provides a function to delay for a predetermined time and the Distance Node provides a function to return the distance between the player on the content and the specific virtual object.

After the node information connected to the editor is transferred to the script conversion unit, the script conversion unit recursively analyzes the connection and node information, and then the entry node is converted into the event method declaration of the script to be converted, .

The control node connected to the entry node converts the method included in the SDK to the calling syntax based on the received information.

Data nodes are converted into literal and local variables, and an operator node is converted into an operator and written.

For reference, the types of nodes are largely composed of event nodes, control nodes, data nodes, and operator nodes.

1) Event node: Game contents should be able to invoke the actuator control flow defined through the editor according to the situation, and design the event node to the node acting as such interface.

An event node is a node that is activated when a specific event occurs. This means the start point of a node graph predefined when a specific situation occurs in the corresponding content.

These types of event nodes include a Trigger Event Node that is called when a specific user defined situation occurs, a Frame Event Node that is called for each frame of each content, Collision Event Node which is called when the explosion occurred, and Explosion Event Node which is called when the explosion such as bomb occurs.

2) Control node: The control node is a key node representing the actual operation in the node graph. If the event node represents the point of view of the graph, the control node takes the flow and calculates the actual operation such as the control of the motion simulator and the distance Computation, and delay.

The control node includes a Transform Node for controlling the motion simulator, a Distance Node for calculating the distance between the collider and the vehicle in the content, a Delay Node for waiting for a predetermined time, We have designed a Data Transform Node for data driven type.

In addition, nodes generated from the motion control SDK and some of the nodes generated from the game engine SDK are also included in the control node group.

3) Data node: A data node is a node representing a pure data itself such as a pure variable, an operation value for controlling a motion simulator, and is connected to an input terminal of a control node and an operator node, It is designed for the role of transmitting information.

The data nodes include an operation value node designed for actuator control, a float node indicating a real number, a car state node indicating a state of a virtual vehicle on a game and contents, Designed. In addition, nodes generated from the motion control SDK and some of the nodes generated from the game engine SDK are also included in the control node group.

4) Operator node: In order to create more diverse data results, it is possible to consider a method of composing or calculating the data generated from the data node or the control node.

Operator nodes are used to process data generated by nodes and produce various results. We design a branching node that branches according to basic arithmetic operation and condition, and a repetition node that repeats a certain operation.

5) Configuration type of node

Each node has an input terminal on the left side and an output terminal on the right side. A node has a group according to a kind of a group of pins for exchanging data with a flow pin for connection with each other. The flow pin represents the flow between nodes and is indicated by a red button on the editor. The data pins to send data are indicated by black buttons, the flow lines connected to the flow pins are indicated in red, and the data lines connected to the data pins are indicated in blue.

The event node has no input node, and only the output flow and output data can be connected, so that it can be transferred to the next node. The control node has a plurality of input data terminals and one output terminal. The nodes automatically generated from the SDK are converted to the input data terminal based on the parameters of the function belonging to each SDK and converted to the output data terminal based on the return variable.

Since the data node is pure data, it has only one output terminal that has no input terminal and transmits data to the next node.

Since an operator node can not be executed independently and requires two data inputs, an operator node has two input nodes and one output data to be transferred to the next node as a result of the calculation.

The various nodes are the most basic unit to be connected to each other by a user's manipulation and made into a large graph, and the graph is a component belonging to the motion control editor, which is converted into a script for controlling the motion simulator and integrated with the game engine.

The script conversion unit 1031 generates and builds the finally completed source code to control the simulation and the motion platform.

2 is a flow chart showing a script conversion process in the control method of the motion platform according to the present invention. The script conversion unit 1032 initializes the resource in step S211 and the SDK node creation unit 1031 creates an entry node source And then proceeds to step S212.

Then, the script conversion unit 1032 determines whether or not the entry node is smaller than the number of control nodes, and the script conversion unit 1032 determines whether the entry node is smaller than the input number of the control node Step S214 is performed in order. If the number of control nodes is not smaller than the number of control nodes in step S213, the loop is terminated. If the number of control nodes is less than the number of control nodes in step S214, the flow branches to step S216.

The script conversion unit 1032 includes a step S215 for creating an input node source of the control node and a step S216 for the script conversion unit 1032 to create the source of the control node. At this time, after performing the step S215, the flow branches to the step S214, and after the step S216, the flow branches to the step S213.

101; A motion simulator 102; Game engine
103; A motion control editor 104; Motion Control Game Engine SDK
105; Input data 1031; SDK node creation unit
1032; A script conversion unit 1033; GUI processing section
1034; Node canvas management section

Claims (5)

A method of controlling a motion platform using a GUI authoring tool, the method comprising: a motion control editor (103) operating in the form of a plug-in of an editor of an existing game engine (102)
The motion control editor 103 includes an SDK node generator 1031 for automatically converting the SDK provided by the motion simulator developer into a node used in the editor, a script generator 1031 for converting the completed node graph into a script A GUI processing unit 1033 for processing an input of an editor user and a GUI, and a node canvas managing unit 1034 for creating and managing a single graph by combining nodes;
The process of converting into the script by the script conversion unit 1032,
1) step S211 in which the script conversion unit 1032 initializes a resource,
2) step S212 in which the SDK node creation unit 1031 creates an entry node source,
3) a step S213 in which the script conversion unit 1032 determines whether or not the entry node is smaller than the number of control nodes;
4) determining whether the script conversion unit 1032 determines whether the entry node is smaller than the input number of the control node,
5) step S215 in which the script conversion unit 1032 creates an input node source of the control node,
6) A method for controlling a motion platform using a GUI authoring tool including a step S216 in which the script converting unit 1032 creates a source of a control node. The method according to claim 1,
Wherein the node comprises an event node, a control node, a data node, and an operator node.
The method according to any one of claims 1 to 3,
If it is not smaller than the number of control nodes in the step S213, terminates the present loop, and if it is smaller than the input number of the control node in the step S214, the process branches to the step S216.
The method according to any one of claims 1 to 3,
Wherein the step S215 is followed by branching to the step S214, followed by the step S216, followed by branching to the step S213. delete

Images