KR20180031838A - Image Simulating System, Host Apparatus and Method for Providing Multi-perspective based Image - Google Patents

Abstract

The present invention relates to an image simulating system, a host apparatus, and a multi-visual point based image providing method. According to an embodiment of the present invention, the host apparatus for allowing a plurality of passengers on a multi-passenger motion platform to provide a multi-visual point based image capable of viewing different images comprises: a storage unit storing object information of a first object in a virtual space and a second object dependent on the first object, which are implemented in at least one image display apparatus; and a processor generating a first image and a second image reflecting an event based on the stored object information, and providing the first image and the second image to at least one image display apparatus when the event occurs in at least one of the first object and the second object.

Description

[0001] The present invention relates to an image simulating system, a host apparatus,

The present invention relates to a video simulating system, a host apparatus, and a method of providing a plurality of viewpoint-based images. More particularly, the present invention relates to a video simulating system, a host apparatus, A host apparatus, and a method for providing an image based on a plurality of viewpoints.

In general, a rider system used by a plurality of users provides various motions such as up / down / left / right / back / forth vibration, acceleration / deceleration, etc. to a user through a motion system included in a chair, On the other hand, the experience type 4D rider system provides various events such as wind, water, smell, bubble, and snow depending on the contents of the image. The rider system consists of an image display device such as a 3D projection screen and a speaker, a speaker, and an operating unit. The driving unit is composed of a one-passenger and multi-passenger chair and a motion system connected to the chair.

However, in the case of a conventional multi-passenger rider, the same contents are provided through a common video device, and this is not a problem when the same motion is effected on a common platform. However, There is a problem that the actual sensibility of the occupant is deteriorated when the directions are different.

Embodiments of the present disclosure provide a video simulating system, a host device, and a multi-viewpoint video game system in which a plurality of passengers on a multi-passenger motion platform, for example, can view images of different contents according to their own situations on a three- And a method of providing the image.

An image simulating system for providing a plurality of viewpoint-based images capable of viewing different images by a plurality of passengers on a multi-viewpoint motion platform according to an embodiment of the present disclosure includes at least one image display A first object in a virtual space implemented in the at least one image display device and a second object in a virtual space implemented in the at least one image display device and a second object dependent on the first object, And when the event occurs in at least one of the first object and the second object, generating a first image and a second image reflecting the event based on the stored object information, And a host device for providing at least one image display device.

In addition, a host apparatus that provides a plurality of view-based images, in which a plurality of passengers on a multi-passenger motion platform according to an embodiment of the present disclosure can view different images, A storage unit for storing object information of a first object and a second object that is dependent on the first object when the event occurs in at least one of the first object and the second object, And generating a first image and a second image reflecting the event and providing the generated first and second images to the at least one image display device.

The processor provides the first image to the first wearable image display device worn by the first occupant of the plurality of passengers and provides the second image to the second wearable image display device worn by the second occupant do.

The storage unit stores at least one of identification information for identifying the first object and the object, and motion information related to the position and direction of the first object and the second object as the object information.

The processor provides the first image and the second image based on the stored motion information matching the amount of change of the motion when the first object and the second object generate a motion as the event.

The multi-passenger motion platform includes a controller that the plurality of passengers operate to generate the motion, and the processor can determine the amount of change of the motion based on an operation signal provided from the controller.

The multi-passenger motion platform includes a first actuator for allowing the plurality of passengers to simultaneously sense movement of the first object and the second object, and a plurality of passengers for controlling movement of the first object and the second object And a second actuator for allowing the first actuator and the second actuator to be individually sensed, wherein the processor can control the first actuator and the second actuator based on the amount of change in the movement.

Meanwhile, the image providing method in which a plurality of users can view different images according to an embodiment of the present disclosure includes a first object in a virtual space implemented in at least one image display device and a second object in a virtual space When the event is generated in at least one of the first object and the second object, generating a first image and a second image reflecting the event based on the stored object information, To the at least one video display device.

Wherein the step of providing the at least one image display device includes providing the first image to a first wearable image display device worn by a first occupant of the plurality of occupants, And providing the second image to the image display device.

The storing step may store at least one of identification information for identifying the first object and the object and motion information related to the position and direction of the first object and the second object as the object information .

Wherein the step of providing the at least one image to the at least one image display device comprises the steps of: when a motion occurs in the first object and the second object as the event, And providing the second image.

The multi-passenger motion platform may further include a controller for the plurality of passengers to operate to generate the movement, and may further include a step of determining a change amount of the movement based on an operation signal provided from the controller.

The multi-passenger motion platform includes a first actuator for allowing the plurality of passengers to simultaneously sense movement of the first object and the second object, and a plurality of passengers for controlling movement of the first object and the second object The method may further include controlling the first actuator and the second actuator based on the amount of change in the movement.

1 is an illustration of an actual game simulator system according to an embodiment of the present disclosure,
2A is a block diagram illustrating a realistic game simulator system according to an embodiment of the present disclosure;
Figure 2b shows the drive mechanism of some of the components shown in Figure 2a,
3A is a diagram for explaining interlocking between a game content and a simulator,
FIG. 3B is a diagram for explaining transfer of in-game 3D motion information to a platform;
FIG. 4A is a diagram illustrating the structure of a simulator,
FIG. 4B is a diagram illustrating the structure of the motion platform of FIG. 4A,
5 is a diagram for explaining a coordinate system for a game simulator,
FIG. 6A is a block diagram illustrating a detailed structure of the platform control apparatus of FIG. 1,
FIG. 6B is a diagram illustrating a program included in the motion information processing unit of FIG. 6A,
7 is a diagram for explaining a process of processing three-dimensional motion information on a game,
FIG. 8 is a block diagram illustrating another detailed structure of the platform control apparatus of FIG. 1,
9 is a diagram showing a typical example of a torque control system loop,
10 is a flow chart illustrating a platform control method according to an embodiment of the present disclosure;
11 is a diagram illustrating a multi-pass game game simulation system according to an embodiment of the present disclosure;
Figure 12 again illustrates the multi-passenger motion platform of Figure 11,
13 is a block diagram illustrating the detailed structure of the host apparatus shown in FIG. 11,
FIG. 14 is a block diagram illustrating another detailed structure of the host apparatus shown in FIG. 11,
15 is a view for explaining a process of simulating a plurality of viewpoint based images according to the embodiment of the present disclosure, and
16 is a flowchart illustrating a method of providing a plurality of viewpoint-based images according to an embodiment of the present disclosure.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.

The multi-perspective based image used in the present specification means providing images of a plurality of viewpoints and is different from a multi-viewpoint based image used for generating a stereoscopic image. .

FIG. 2A is a block diagram showing an actual game simulator system according to an embodiment of the present disclosure, FIG. 2B is a block diagram showing a real game game simulator system according to an embodiment Fig. 4 is a view showing a driving mechanism of a component; Fig. FIG. 3A is a diagram for explaining interlocking between a game content and a simulator, and FIG. 3B is a diagram for explaining transfer of 3D motion information in a game to a platform. 4A is a diagram showing the structure of the simulator, FIG. 4B is a diagram showing the structure of the motion platform of FIG. 4A, and FIG. 5 is a diagram for explaining a coordinate system for the game simulator.

1 to 4B, a realistic game simulator system 90 according to an embodiment of the present disclosure includes a platform control device 100 and a simulator 110, and includes at least one of an image display device and an image display device .

First, a driving mechanism of a sensation game simulator system (or a video simulating system) 90 according to an embodiment of the present disclosure will be briefly described. First, for example, A 3D game can be operated through a content controller (e.g., controller, joystick) 110a mounted on a motion platform-based simulator 110 interlocked with 3D game contents.

For example, an operation such as movement and attack input by the user to the controller controls the virtual robot 100-3a existing on the 3D game as shown in FIGS. 3A and 3B, Or program) transmits the 3D motion data of the virtual robot 100-3a to the real-time game simulator controller, for example, the platform control device 100 such as the MLF module 100-2 in real time give.

The data received from the controller is converted into motion data to be transmitted to the passenger through the data analysis module, for example, and is expressed by the motion of the simulator 110.

As a result, in the embodiment of the present disclosure, the motion coordinates generated in the game are processed in real time by the controller such as the MLF module 100-2 as shown in FIGS. 2A and 2B, and the result is reflected in the motion platform in real time Structure. For this purpose, the controller provides three-dimensional coordinates (Px, Py, Pz) and rotation values (Ox, Oy, Oz)

More specifically, the platform control apparatus 100 includes an image processing unit 100-1 for processing game contents, an MLF module 100-2 for generating control information for motion control of the multi-axis motion platform 110b, A display unit 100-3 such as a screen or an image panel for displaying 3D game contents on a screen, and an acoustic output unit 100-4 for outputting sound. Here, the screen refers to a film that simply displays an image projected through an imager, such as a movie theater, and the image panel may refer to an LCD panel, an OLED panel, and a PDP panel applied to a computer monitor or a TV. Based on this point, the platform control apparatus 100 of FIG. 1 can be manufactured integrally with a video display device such as a monitor or a TV.

Accordingly, the platform control apparatus 100 of FIG. 1 displays a 3D game image (or content) on a screen in response to a user's request, and displays a specific object specified by the user in the displayed 3D game image, for example, The motion information for the virtual robot 100-3a can be generated in real time or the generated motion information can be extracted and provided to the multi-axis motion platform 110b constituting the simulator 110. [

In other words, the user can specify an object in order to enjoy the game image on the screen, which can be performed by the content controller 100a such as a controller or a joystick provided in the multi-axis motion platform 110b. Here, the content controller 100a may be a user interface device because a user interface is required. For example, when a battle robot game is executed, the user can designate and control a specific robot desired by him.

3B, when the object such as the virtual robot 100-3a moves according to the control of the user operating the controller, the platform control apparatus 100 displays coordinate information of the moving object, that is, X Axis axis, the Y-axis, and the Z-axis, and provides the generated coordinate values to the multi-axis motion platform 110b. In other words, the multi-axis motion platform 110b moves synchronously with the virtual robot 100-3a as shown in Fig. 3A.

Furthermore, if the virtual robot 100-3a is hit by an obstacle in the process of controlling the virtual robot 100-3a by an obstacle such as a stone or a wall during the game, If an impact event has occurred, the platform control apparatus 100 generates coordinate information of the virtual robot 100 - 3 a according to the amount of the impact and rotation information about the respective coordinate information or extracts the generated rotation information, To the platform 100b.

As will be described later, the platform control apparatus 100 may store a plurality of coordinate information corresponding to the controller adjustment amount of the user in the internal memory. For example, coordinate information of the X, Y, and Z axes may be different when the user manipulates the controller and the object, that is, the virtual robot 100-3a, slowly walks and walks or runs fast. Accordingly, the platform control apparatus 100 can store the coordinate amounts of the controller adjustment amounts, that is, the coordinate information of the virtual robot 100-3a when walking slowly, when walking quickly, and when skipping. And, based on this situation, the amount of rotation of each axis can vary even if the same impact occurs. In other words, even when the same impact is applied to the virtual robot 100-3a, the amount of rotation will increase when the robot is walking faster than when walking slowly, and when it is running faster than when walking. Accordingly, the platform control apparatus 100 can store different rotation information in accordance with each situation to coordinate information. When the impact event occurs, coordinate information and rotation information related to the event may be extracted and provided to the multi-axis motion platform 110b. For example, such information may be stored in the internal memory in an EMMT (Effect Motion Mapping Table) method and then extracted. Here, EMMT means that motion generated at a specific time is processed or stored beforehand in the production of contents.

Of course, according to the embodiment of the present disclosure, the platform control apparatus 100 may be able to calculate and provide real-time computation beyond simply extracting the previously stored information according to the occurrence of an event. For example, suppose that coordinate information and rotation information are set only for a situation when walking slowly. Then, it is possible to generate and provide the three-dimensional motion information suited to the situation by increasing the constant value in the coordinate information and the rotation information when walking fast and walking slowly when jumping. Here, the constant value may include a weighted value.

On the other hand, the generation of the coordinate information and the position information may vary depending on the user designation of the object, i.e., the type of the object. For example, if the size of the robot is large, the positional change may be less than that of the small robot with respect to the same impact amount. The generation of the three-dimensional motion information reflecting the information of the actual physical world can be calculated and provided using the physical engine in the game engine.

In addition, the above information may vary depending on which mode of operation the user has selected. For example, if the user does not want to experience precise motion at a professional level with respect to positional changes, the general user (motion) mode may be selected instead of the expert mode. Thus, the coordinate information and the rotation information may be variously changed according to a given situation. Therefore, the embodiment of the present disclosure is not particularly limited to the above.

The simulator 110 may include a content controller 110a, a multi-axis motion platform 110b, a boarding sheet 110c, and a footing 110d, as shown in Figs. 4a and 4b. Through this, the simulator 110 can board a user to enjoy the game. The multi-axis motion platform 110b uses only the coordinate information provided by the platform control device 100 or uses the coordinate information and the rotation information so that the user can feel the same motion as the virtual robot 100-3a Used together to control each axis of the platform. The structure of the simulator 110 according to the embodiment of the present disclosure provides convenience of content interworking. In other words, the platform specification is typically tailored to the purpose of the content. Therefore, in the embodiment of the present disclosure, the motion platform 110b is modularized into a motion part and an interface part in preparation for a change of contents, and is easy to change.

According to the embodiment of the present disclosure, the multi-axis motion platform 110b is preferably a platform capable of six-axis control as in Figs. 4B and 5. In other words, when there is no rotation information, the multi-axis motion platform 110b controls the corresponding axis using only the coordinate information about the X axis, the Y axis, and the Z axis. However, if the rotation information is provided together, the rotational axes of the X, Y, and Z axes are also used together to control the rotational axes. Table 1 shows the coordinate system for the realistic game simulator 110. Here, the axis may mean the actuators 420-1 to 420-6, and the actuators 420-1 to 420-6 can be linked to a motor (not shown) and a control unit (not shown). The multi-axis motion platform 110b includes a base plate 400 and a platform plate 410 for fixing the actuators 420-1 to 420-6.

A user aboard the boarding sheet 110c of the multi-axis motion platform 110b can control the content by controlling the content controller 110a, i.e., the controller, and enjoy the game. That is, the robot character is moved to change the surrounding background. Furthermore, if the multi-axis motion platform 110b is capable of rotating the object designated by the operation of the controller, the control information for the rotation will be provided to the motion control device 100. [ Accordingly, the platform control apparatus 100 generates or extracts rotation information using the control information for the rotation, and the multi-axis motion platform 110b may receive the corresponding value and control the rotation axis. Therefore, in the embodiment of the present disclosure, there is no particular limitation as to how the platform control apparatus 100 generates and provides motion information to the multi-axis motion platform 100b.

On the other hand, the multi-axis motion platform 100b according to the embodiment of the present disclosure can be designed as the sensation game simulator 110 by referring to the rated values on the data sheet shown in Table 2.

FIG. 6A is a block diagram illustrating a detailed structure of the platform control apparatus of FIG. 1, FIG. 6B is a diagram illustrating a program included in the motion information processing unit of FIG. 6A, Fig.

6A and 6B together with FIG. 1 for convenience of explanation, the platform control apparatus 100 of FIG. 1 may include a motion information processing unit 600 and a storage unit 610. FIG.

Here, the motion information processing unit 600 may be interlocked with a content controller 110a such as a controller, a joystick, etc., and an external video display device provided in the multi-axis motion platform 110b. For example, when receiving the game contents from the outside through the Internet or the like, the motion information processing unit 600 may temporarily store the game contents in the storage unit 610 and provide the same to an external video display device.

Then, a controller operation signal (or a joystick signal) for operating the motion of the virtual robot 100-3a shown in FIGS. 3A and 3B, that is, a content control signal, is received from the game content displayed on the screen of the video display device can do. The motion information processing unit 600 receives the controller operation signal in real time and reflects the controller operation signal to provide the game contents to the video display device.

In this process, the motion information processing unit 600 extracts (or calculates) the coordinate information of the object on the basis of the corresponding controller operation signal and provides it to the multi-axis motion platform 110b. Here, the extraction means that the coordinate information previously stored in the form of a table is called.

In addition, the motion information processing unit 600 may receive the controller operation signal in real time, and may reflect whether the event is generated in the object in the process of providing the game contents to the video display device. For example, it is possible to judge whether the virtual robot 100-3a is caught on the stone or hit the wall. The motion information processing unit 600 may extract the coordinate information and the rotation information of the virtual robot 100-3a and provide the same to the multi-axis motion platform 110b. Here, whether there is an impact is possible when the position of the obstacle is the same as the position of the virtual robot 100-3a. Other details have been fully explained above, so further explanation is omitted.

That is, the motion information, that is, the coordinate information and the rotation information, can be considered to be executed by the motion information generation program stored in the internal memory of the motion information processing unit 600. [ In other words, the motion information processing unit 600 may be configured in one software form, but may be configured in hardware form including a CPU and a memory. Of course, one piece of software is assumed to perform all the functions of the programs as shown in FIG. 6B stored in the memory and the functions of the CPU. These programs are stored in the storage unit 610 for a long period of time, and can be temporarily stored in the memory when a user requests, that is, when a game is about to proceed. The CPU executes the programs stored in the memory to perform the above operation.

For example, the motion information processing unit 610 can process data or information about game contents through the game engine 600-1 of FIG. 6A, that is, a game program. In other words, game contents stored in the storage unit 610 or the internal memory can be executed through the game engine. In addition, coordinate information on the motion of the moving object can be generated and output by the controller operation. The generated coordinate information can be provided to the motion information engine 600-2, that is, the motion information program.

The coordinate information (Px, Py, Pz) generated by reflecting the coordinate information provided by the game engine 600-1 and the impulse amount information generated by an event such as a stone impact through the motion information engine 600-2 The rotation information (Ox, Oy, Oz) can be generated and output. Actually, as described above, the motion information engine 600-2 can reflect impulse amount information due to a stone impact on information about the state of the robot, that is, whether it is walking fast or running. The motion information engine 600-2 may extract coordinate information and rotation information previously stored in the storage unit 610 and provide it. Or if it hits the wall, coordinate information and rotation information are extracted and provided according to the impact of the wall. At this time, the coordinate information and the rotation information provided vary depending on the size of the robot and the like, and the explanation has been omitted.

Referring to FIG. 7, a process of processing three-dimensional motion information on the game by the motion information processing unit 500 according to the embodiment of the present disclosure will be described below. Fig. 7 (a) shows an example of the movement amount in the world coordinate system, and Fig. 7 (b) shows an example of the movement amount in the local coordinate system.

Referring to FIG. 7, the position movement amount during game rendering can be expressed by Equation (1) below.

Here, i is a frame number before? T, and when the number of motion information on the world coordinate system collected during? T is n, k = i + n. P _i , P _{i + 1} , ... P _k represents the positional change between i and k frames, w represents the world coordinate system, and C _i and C _k are the object (robot in the game) coordinate system. The transformation from the world coordinate system to the object coordinate system is expressed as T _{w → c} .

In addition, the amount of movement of the position in the object coordinate system can be expressed as shown in Equation (2).

The movement amount in the three-dimensional space is converted into the movement amount in the character coordinate system based on the most recent object position local position C _k .

In this case, since it is necessary to adjust the size of the entire motion information in order to control the strength of the provided content, a scale factor s is defined.

By the same processing as described above, the final output information can have the same format as in Table 3. [

The storage unit 610 may include an EPROM or an EEPROM. In other words, it is preferable to be a nonvolatile memory. The storage unit 610 may permanently store the game contents and may store the game engine 600-1 and the motion information engine 600-2 as shown in FIG. 5B. If there is a request from the motion information processing unit 600, it may output at least one of the stored game contents, the game engine 600-1 and the motion information engine 600-2.

 The storage unit 610 stores coordinate information and rotation information as motion information, and the information can be stored by matching the state of the object or a specific event. For example, if the robot simply walks or runs, it extracts coordinate information and rotation information corresponding to the object situation. However, when a specific event occurs, coordinate information and rotation information corresponding to the event and object situation are extracted and provided. As described above, the storage unit 610 may store only representative coordinate information and rotation information according to a specific event. And further store information about the increment value or weight for a particular state of the object.

In this case, the motion information processing unit 600 may generate new coordinate information and rotation information by reflecting information on an increment value or a weight to representative coordinate information and rotation information according to a predetermined rule. As mentioned above, the coordinate information and the rotation information are stored based on the case where the robot is walking slowly. In case of walking or jumping fast, new information can be generated reflecting the stored increase value or weight.

Table 4 shows a table that defines the realism elements of the realistic game simulator. In other words, coordinate information and rotation information of the object can be changed according to various items shown in Table 4.

As shown in Table 4, the special motion generated in the special event No. 11 to 15 may have a limitation in realizing the physical phenomenon occurring in the virtual space on the platform in the same manner. Therefore, in the embodiment of the present disclosure, detailed definition (or design) of the MLF module 100-2 and the motion platform 110b shown in Figs. 2A and 2B may be needed to maximize the real sensibility of the special motion There will be.

For example, you can reproduce realistic motion by adding motion sensibility to special motions, such as free fall, acceleration-deceleration, and jumping.

In addition, it is possible to stabilize the system by referring to the data through the user immersion analysis. Accordingly, it is expected that the interest in use will be increased. Among them, the rider type system is a system in which the satisfaction of the platform is analyzed .

As described above, by implementing the game engine module (S / W) capable of interlocking with the robot type platform (H / W), a game platform capable of driving an arcade game based on the real robot platform can be realized. In addition, it develops a boarding robot platform that can reproduce similar mobility feedback through precise control of multi-axis (6DOF) mobility robot platform, and provides this virtual three-dimensional world with realistic service by interworking with arcade game You can do it.

Further, according to the embodiment of the present disclosure, 3D world autonomous navigation is enabled. In other words, it is possible to replace various simulation contents such as forklift, submarine and ship. Content images can be rendered in real time. In terms of motion synchronization, it is possible to transmit motion by inverse kinematic real-time analysis of game 3D information base.

Furthermore, 6 + 2 DoF may be possible in terms of motion reproducibility. The motorized platform configuration and the control technique according to the embodiments of the present disclosure enable instant replay of motion, such as rocking, tremor, recoil, and the like. Additional development of 2 DoFs can increase boarding sensibility. 1, but it will be possible to connect the same number of platforms to the network in the future. Furthermore, pre-work for game content replacement is minimized. In other words, since 3D motion data is used as it is, similar work will not be required.

8 is a block diagram illustrating another detailed structure of the platform control apparatus of FIG.

8, a platform control apparatus 100 'according to another embodiment of the present disclosure includes an interface unit 800, a control unit 810, a storage unit 820, Or may include some or all of the first portion 830.

Including some or all of them means that some components such as the storage unit 820 are omitted or some components such as the motion information generation unit 830 are integrated with other components such as the control unit 810 It is to be understood that the invention may be embodied in various forms, for example, as being capable of being constructed, and so on, to fully understand the invention.

The interface unit 800 includes a communication interface unit and a user interface unit. The communication interface may interface with a controller (e.g., a joystick) and a multi-axis motion platform 110b. In other words, the control unit 810 receives the controller operation signal from the controller and transfers the signal to the controller 810. And provides the three-dimensional motion information of the designated object moving based on the controller operation signal to the multi-axis motion platform 110b. Here, the three-dimensional motion information includes various information. Coordinate information on the motion of the robot in the X-axis, Y-axis, and Z-axis, rotation information for each axis, and impact amount information. The user interface unit may include a display unit, a button input unit, or a storage medium connection unit to which the storage medium can be connected. The display unit may display the game contents stored in the storage unit 820 or the storage medium on the screen according to a user's request. The button input unit may include an input button such as a power button or a volume button.

The control unit 810 controls overall operations of the interface unit 800, the storage unit 820, and the motion information generation unit 830 in the platform control apparatus 100 '. In other words, if there is a request from the user, the control unit 810 executes the game content stored in the storage unit 820 and displays the game content on the display unit. The program in the motion information generation unit 830 can be executed. Here, the program may be the motion information engine 600-2 of FIG. 6B. Further, the control unit 810 receives the controller operation signal for operating the game by viewing the game image displayed on the screen, and the controller 810 provides the image corresponding to the received controller operation signal to the display unit. Here, the image according to the controller operation signal may be a background image of the robot which is changed in accordance with the movement of an object such as a robot.

In addition, the user can walk or leap an object, such as a robot, according to the operation of the controller. The controller 810 generates motion information for generating or extracting three-dimensional motion information according to the state of the object, . The control unit 810 controls the generated information to be provided to the multi-axis motion platform 110b. Since the three-dimensional motion information at this time is related only to the motion of the robot, it can be coordinate information and rotation information about the X-axis, Y-axis, and Z-axis. In this process, when a specific event such as a stone impact occurs, the robot object may generate additional movement for each axis. Accordingly, the controller 810 may receive the coordinate information and the rotation information according to an event such as a rock impact and the situation of the object, and provide the coordinate information and the rotation information to the multi-axis motion platform 110b through the interface unit 800. [

On the other hand, the controller 810 may be configured in one software form, but may include a CPU and a memory in hardware. Here, one software software can be considered to perform operations on the CPU and programs in the memory. For example, when the user executes the game contents, the CPU stores the game contents stored in the storage unit 820, the game engine 600-1 and the motion information engine (FIG. 6B) stored in the motion information generation unit 830, 600-2) may be temporarily stored in the memory and executed. At this time, the memory may include volatile memory such as RAM.

The storage unit 820 may store game contents, three-dimensional motion information about an object such as a robot, and may further include the game engine 600-1 of FIG. 6B. The storage unit 820 is preferably a nonvolatile memory such as a ROM capable of storing information permanently. Other details are not so different from those of the storage unit 610 of FIG. 6A.

The motion information generation unit 830 may store a program such as the motion information engine 600-2 of FIG. 6B in the form of a mask ROM, EPROM, or EEPROM. According to the control of the control unit 810, the internal program can be executed and the result can be provided to the control unit 810. Alternatively, the program stored in the internal memory may be provided to the controller 810 in response to a request from the controller 810 when the game is executed. The motion information generation unit 830 executes the motion information engine 600-2 and outputs the motion information to the multi-axis motion platform 600-1 using various information about the coordinate information provided by the game engine 600-1, Lt; RTI ID = 0.0 > 110b. ≪ / RTI >

In other words, as described above, the storage unit 820 stores coordinate information when the robot object slowly walks. In addition, when walking slowly, when there is an impact event, if coordinate information and rotation information are changed to some extent, information on weight or an increase value is calculated to calculate coordinate information and rotation information. The coordinate information and the rotation information calculated by the above process are output.

Meanwhile, in order to improve game room sensibility based on the motion platform, the embodiment of the present disclosure can provide personal sensible sensibility. In other words, it is possible to vary the motion platform operating output adaptive to the occupant load. Particularly, if the existing platforms configure the system based on the position control, the platform according to the embodiment of the present disclosure is configured as a force control based system. That is, the force control based technique is applied. In order to use force control, the real-time nature of the system is important. Therefore, vibration and noise are important to prepare the specifications of the indoor / personal simulator, and they are related to the efficiency and stability of the mechanical part. This part may be considered in the future.

9 is a diagram showing a general example of a torque control system loop.

The existing platform mainly applied the control technique based on the position control, and implemented the movement of the platform by following the movement generated from the contents exactly. For this purpose, it is characterized by moving the fixed trajectory mechanically or by minimizing the error with respect to the movement itself, and generating a motion regardless of the response of the user who rides the vehicle. In this case, the feeling that the movement of the platform is hard is easily transmitted. To prevent this, the position-based control is performed. However, by performing the torque control for each motor as shown in FIG. 9, Should be designed to influence the movement of the platform.

In order to improve this, the platform control technology proposed in the embodiment of the present disclosure utilizes force control based control technology so that the movement of the robot can be corrected by the external environment in real time. Accordingly, the external force such as the load of a human being can be transmitted as it is to the robot and controlled by the dynamical analysis based current control method which controls the output of the robot. Through this, the flexibility of the robot according to the kind of the robot So that it is possible to adjust the degree of flexibility according to the tendency of the passenger.

Further, threshold correction techniques may be applied in embodiments of the present disclosure. In other words, if the motion of the game is reflected in the game platform as it is, there is a possibility that the occupant of the game platform may feel bored and tired, or a safety accident may occur. Therefore, as shown in FIGS. 2A and 2B, the MLF module 100-2 can maximize the real feeling and secure the comfort and stability of the passenger.

This threshold correction technique can be classified into a controllable threshold correction technique to be adjusted at the MLF module 100-2 and a mechanical threshold correction technique to control at the multi-axis motion platform 110b.

In the embodiment of this disclosure, interworking between robots and contents is important. However, the platform can be changed arbitrarily, and according to the specification, the content can be made to select the type of the platform. However, if values beyond the scope of the platform are generated, it will cause problems in the running of the platform, and knowing everything from contents to prior knowledge may take a considerable load.

Accordingly, in the content, only the movement, i.e., the movement and rotation information of the content robot to be applied, is generated, and the relationship can be interpreted mechanically in the robot platform. In this process, since the robot platform has a mechanical threshold value, it can perform a process of correcting the motion information so as to compensate it autonomously.

Through this, the platform can be driven to express motion within a range that can guarantee stable motion at all times.

In other words, when a threshold value is set for six axes, the multi-axis motion platform 110b can be considered to control the six axes so that the received coordinate information and the position information do not deviate from the threshold value.

On the other hand, all the motion information applied to the motion platform can be generated from the content. Therefore, the entire applied motion can be expressed as in Equation (3).

Here, m _i denotes motion generated by an individual motion and an event, and w _i denotes weight information for each motion. That is, it means that the motion applied according to the setting can be individually adjusted, thereby enabling various reactions to occur even if the same event occurs in the same environment. Even if the information of m is defined differently for the same event, it is possible to apply a personal reaction according to the user's selection.

The M _total generated by the combination of these can also be applied to the threshold by the user's choice.

Through this, the platform can be driven to express motion within a range that can guarantee stable motion at all times.

For example, the user can set the expert mode or the general user mode for setting before starting the game. Based on this, it can be seen that coordinate information and rotation information having specific values are provided to the multi-axis motion platform 110b.

10 is a flow chart illustrating a platform control method in accordance with an embodiment of the present disclosure.

1, the platform control apparatus 100 according to an embodiment of the present disclosure stores three-dimensional motion information related to an object of a three-dimensional image displayed on a screen of an image display apparatus S1000). Here, the three-dimensional motion information may be coordinate information and rotation information according to a specific situation as shown in Table 3, for example.

When an event occurs in the object, the platform control device 100 generates coordinate information and rotation information of the multi-axis motion platform 110b reflecting the event generated using the stored three-dimensional motion information as control information, (110b) (S1010). Since generation of such control information has been described in detail above, further explanation will be omitted.

The above-described motion generation, storage, provision, and reproduction processes are preferably performed in real time according to the embodiment of the present disclosure.

FIG. 11 is a diagram showing a multi-passenger realistic game simulator system according to another embodiment of the present disclosure, and FIG. 12 is a view again showing the multi-passenger motion platform of FIG.

11, the multi-passenger realistic game simulator system 1090 according to another embodiment of the present disclosure includes a multi-passenger motion platform 1100, a plurality of video display devices 1110-1 and 1110-2, Device 1120. The < / RTI >

Here, the multi-passenger motion platform 1100 includes a seat mounted on a platform, which includes a motion chair in which a separate motion (with movement of the platform) occurs. Accordingly, a plurality of users aboard the platform, that is, passengers, feel that they are similar to the actual environment in the virtual space (e.g., game image). For example, suppose that the multi-passenger motion platform 1100 is a platform such as a battle tank, the driver and the shooter ride on the same platform, but the shooter, Therefore, it is placed in a different direction from the driver. Therefore, assuming that the driver and shooter are looking at the right angle to each other and that impact is given at the front of the tank, the driver will be shocked in the forward direction, but the shooter will be impacted in the lateral direction. The multi-passenger motion platform 1100 is designed in consideration of this situation, so that the passengers can feel the motion in the game realistically and the feeling of immersion of the passengers in the game also increases.

More specifically, the multi-passenger motion platform 1100 includes a base plate 1200, a first actuator 1210, a platform plate 1220, a second actuator 1230, and a seat portion (not shown) 1240), and the like. The base plate 1200 and the platform plate 1220 correspond to the plates for fixing the first actuator 1210 on the upper side and the lower side and the second actuator 1230 is fixed on the upper side of the platform plate 1220, (1240). The seat portion 1240 fixed to the second actuator 1230 and the second actuator 1230 corresponds to a motion chair named in the present disclosure. In accordance with the above configuration, the multi-passenger motion platform 1100 can operate like a tank in a virtual space, so that a plurality of passengers aboard the platform 1100 simultaneously feel movement of the tank, Also, you can feel different movements depending on your position and direction in the tank. The platform 1100 can operate the first actuator 1210 and the second actuator 1230 can operate so that each occupant can feel different movements individually so as to feel the movement of the tank. Of course, these operations may be performed by control of a driving unit (e.g., the host device 1120 in FIG. 11) connected to the first and second actuators 1210 and 1230 and configured separately.

Of course, the multi-passenger motion platform 1100 according to the embodiments of the present disclosure can be variously modified. For example, initially all the occupants on the platform 1100 can automatically operate the platform 1100 to look in the same direction. When the user designates his / her role (ex. Driver, shooter, etc.) in an object (ex. Tank) after the user executes the game, the platform 1100 automatically advances or retreats the seat portion 1240 . Alternatively, the platform 1100 may perform the above operation by operating a controller such as a controller (e.g., a joystick) provided on the seat portion 1240 by a passenger on the platform 1100. [ In addition, if a rail is formed on the platform plate 1220, it may be possible to move it to its own position along the rail. Therefore, in the embodiment of the present disclosure, the above structure is not particularly limited.

The plurality of video display devices 1110-1 and 1110-2 include a wearable video display device. According to the embodiment of the present disclosure, the first image display device 1110-1 worn by the first occupant on the platform 1100 displays the first image in the direction in which the driver is driving in the virtual space, for example, , The second image display device 1110-2 can display a second image in the direction in which the shooter maneuvering the barrel is looking in the tank. That is, the plurality of image display devices 1110-1 and 1110-2 receive images of different contents to provide a plurality of viewpoint-based images to a plurality of occupants. The first image and the second image may be provided from the host apparatus 1120 linked to the image display apparatuses 1110-1 and 1110-2. At this time, the video display devices 1110-1 and 1110-2 can be connected to the host device 1120 by wire to receive the first video and the second video, respectively, but it is also possible to receive video data wirelessly , And is not particularly limited to a specific method.

The host device 1120 may include a computer, a cellular phone, a server, or the like. 11 shows that the multi-passenger motion platform 1100 is directly connected to a host device 1120 such as a neighboring computer. However, the multi-passenger motion platform 1100 is connected to the host device 1120 via a wireless communication network (e.g., an AP, a WCDMA network, etc.) It might be in the form of a server. The host apparatus 1120 is configured as one independent apparatus and includes a first operation for processing motion information (e.g., position and direction information) for controlling the multi-pass motion platform 1100, -2 < / RTI > in order to provide images of different contents. Of course, when the host device 1120 is interlocked with a separate device (e.g., the MLF device in FIG. 1A), only the second operation is performed, and only the image synchronized with the first operation is generated, -1, and 1110-2, respectively.

More specifically, the host device 1120 may store image information for various situations in a specific game or the like. In this context, "various situations" refers to situations in which the tank moves forward or backward, when the driver or shooter of the tank changes position and direction, an impact is caused by an obstacle such as a stone on the ground, And a state in which an impact occurs due to the impact. Typically, the image information can store image information according to the position and direction of the driver and shooter of the tank in the virtual space. More precisely, it may be image information matched with motion information indicating a position and a direction. When the passenger on the multi-passenger motion platform 1100 provides information on the amount of change, such as the controller operation signal, for the position and direction, etc., through the controller, joystick, etc., the host apparatus 1120 selects the image information, And can be provided to the display devices 1110-1 and 1110-2. Also, the host apparatus 1120 may store video information according to an external impact, for example, and if the event related thereto is input, the host apparatus 1120 may output image data corresponding to the situation. The simplest method related to the method of providing such image data is to store image information according to various variables (e.g., position, direction, impact, and the like), and to match the inputted variables with each other, for example, a lookup table Up table or image information of a specific area in one look-up table.

Other than that, the first operation and the like of the host apparatus 1120 have been described above in detail, and a further explanation will be omitted. Of course, while the host device 1120 of the present disclosure differs in that it performs operations to control the individual motions for each occupant on the multi-passenger motion platform 1100, as in FIG. 11, It is not so different from the control operation, so we want to replace it with its contents. 12, the second actuator 1230 is disposed between the platform plate 1220 and the seat portion 1240 to rotate motors that move or rotate the seat portion 1240 in the front-rear direction .

13 is a block diagram illustrating the detailed structure of the host apparatus shown in FIG.

13, a host apparatus 1120 according to another embodiment of the present disclosure may include a processor 1300 and a storage unit 1310. [

Here, the processor 1300 performs various operations in conjunction with the controller, the multi-view motion platform 1100, and the video display devices 1110-1 and 1110-2. The processor 1300 typically includes a multi- Performs a first operation for controlling the platform 1100 and a second operation for controlling the video display devices 1110-1 and 1110-2. Through the first operation, The processor 1300 may be able to sense the motion in synchronism with the object designated by the processor 1300 and allow the plurality of occupants on the platform to be conscious of the direction in which they are looking through the second action. A first image related to the front direction viewed by the driver is provided to the first image display device 1110-1 so as to be conscious of the direction in which the driver is driving, and the direction in which the catcher You can do it And provides the second image related to the front direction to the second image display device 1110-2.

In addition, the first and second operations relating to the processor 1300 have been described in sufficient detail in the foregoing, and further description will be omitted.

The storage unit 1310 may store image information for the various situations mentioned above. Such image information may be stored in the form of a look-up table. In addition, the storage unit 1310 may further store index information for each region of the lookup table or different lookup tables. Accordingly, the processor 1300 can check the index information of the storage unit 1310 and provide image information of a part corresponding to a variable (e.g., motion information) corresponding to various input situations. Of course, since the game may have various kinds of games, the storage unit 1310 may include identification information for recognizing a game or an object in the game.

If the storage unit 1310 stores only the image information having the reference index information, that is, the index information matching the variable corresponding to the inputted various situations is not confirmed, the most closely related It is possible to generate new image information corresponding to an input variable (e.g., a motion variation amount) using the image information of the reference index information, and to provide the new image information to the image display devices 1110-1 and 1100-2. But the present invention is not limited to the contents of FIG.

14 is a block diagram illustrating another detailed structure of the host apparatus shown in Fig.

14, the host apparatus 1120 'includes some or all of the interface unit 1400, the control unit 1410, the storage unit 1420, and the motion information processing unit 1430. [

Here, the remaining components 1300 'other than the storage unit 1420 can be seen as a modified example of the processor 1300 of FIG. 13, and the term "including some or all of them" Means that the host device 1120 'is configured by omitting the components or that some of the components such as the motion information processing unit 1430 can be configured to be integrated with other components such as the controller 1410, To fully understand the invention.

Compared with the host apparatus 1120 of FIG. 13, the host apparatus 1120 'of FIG. 14 further includes an interface unit 1400 such as a communication interface for performing communication and a user interface for performing an interface operation with a user There is a big difference in that the operations of the processor 1300 of FIG. 13 and the operations of generating the information are both made to be performed by different components.

Therefore, if the processor 1300 of FIG. 13 can perform various operations according to the embodiment of the present disclosure in the form of a one-chip, for example, only by executing software, the motion information processing unit 1430 of FIG. 1410). ≪ / RTI >

The motion information processing unit 1430 is not much different from the motion information processing unit 600 of FIG. 6A or the motion information generating unit 830 of FIG. However, there is a slight difference in that the motion information processing unit 1430 according to another embodiment of the present disclosure can further process the motion information for controlling the individual motion for the occupant on the platform.

The storage unit 1420 operates under the control of the controller 1410 and may output information requested by the controller 1410, for example, index information and / or image information. In this respect, since it is not so different from the storage unit 1310 of FIG. 13, it is replaced with its contents.

15 is a view for explaining a process of simulating a multi-viewpoint based image according to the embodiment of the present disclosure.

Referring to FIG. 15, the first passenger on the multi-passenger motion platform 1100 executes a 3D game image through an input device such as a controller to select a specific object (or a first object) in the virtual space. Further, when the first occupant designates the tank (or the body of the tank) as the first object, for example, it designates what role the tank occupy in the tank. In other words, if you designate the steering wheel (or driver) in the tank, you become the driver of the tank. Also, if you designate the gun (or catcher) of the tank, you become a shooter. Here, the steering wheel or barrel attached to the body of the tank and having a separate additional motion may be the second object.

When the game progresses, the first passenger of the image display apparatus 1 1110-1 changes the position of the tank (eg, forward and backward), the amount of change (eg, left and right) The host device 1120 generates a first image corresponding to the inputted controller operation signal and outputs the first image to the image display device 1110-1 .

At this time, if an event such as a collision with an obstacle occurs in the course of the tank, the host device 1120 may determine whether or not the event is occurred based on the stored motion information (e.g., coordinate and angle information of the axis) (1100). Whether or not such an event occurs is determined based on the position of the current tank and the position of the predetermined obstacle in the image based on the inputted controller operation signal from the image provided to the current image display apparatus 1 1110-1 by the host apparatus 1120 The host device 1120 can control the multi-passenger motion platform 1100 based on the extracted motion information by extracting motion information matching the predetermined amount of the impact and the impact amount with respect to the determined obstacle. Since the above description has been fully described above, further explanation is omitted.

Further, the second occupant who views the video display apparatus 2 (1110-2) can transmit the controller operation signal for the amount of angular change to the host apparatus 1120 by the operation of the input apparatus.

Accordingly, the host apparatus 1120 provides the second image to the image display apparatus 2 (1110-2) so as to be aware of the direction in which the co-ordinates in the virtual space, i.e., the catcher, .

In this process, the second occupant senses the same motion as the first occupant when an impact is generated in the tank, but also senses an individual motion different from the first occupant according to the position or the direction of the first occupant. For this purpose, the host device 1120 may use motion information for controlling the second actuator (see FIG. 12) of the multi-passenger motion platform 1100. In the case of such motion information for controlling the second actuator, the host device 1120 can use the motion information because the motion information for controlling the first actuator can be reflected and stored in the same manner as the motion information for controlling the first actuator.

16 is a flowchart illustrating a method of providing a plurality of viewpoint-based images according to an embodiment of the present disclosure.

16, the host apparatus 1120 according to the embodiment of the present disclosure includes a first object 1110-1 and a second object 1110-2 in a virtual space implemented in at least one of the video display devices 1110-1 and 1110-2, And object information of a second object dependent on the first object, respectively (S1600).

Here, if the first object is the body of the tank, the second object may be a steering wheel, barrel, or the like, which is attached to the tank and has a separate additional motion. Therefore, the object information can be motion information (e.g., coordinates, angle information) about the tank in the virtual space, and it is possible to obtain motion information of individual passengers ). That is, the motion information of the individual passengers may be information on the movement of the seat seated by the occupant.

In this state, when an event occurs in at least one of the first object and the second object, the host apparatus 1120 generates a first image and a second image reflecting the event based on the stored object information, To the video display devices 1110-1 and 1110-2 (S1610).

Here, an event occurring in the first object may be a movement of the tank on the ground, a collision by an obstacle on the ground, or an explosion by a shell from a relative tank. In addition, an event occurring in the second object may be a left-right rotation operation by manipulation of the steering wheel or manipulation of the barrel. The host device 1120 can determine various situations and provide images corresponding to each situation to at least one of the video display devices 1110-1 and 1110-2. And how to judge the situation, etc., the description will be omitted.

In addition, since the host device 1120 stores motion information for controlling the multi-pass motion platform 1100 in accordance with each situation, the host device 1120 can generate motion information based on the motion information stored when the image is output, So that the passengers can feel the motion in synchronization with the image.

As described above with reference to FIGS. 12 to 17, the method of providing a plurality of viewpoint-based images according to the embodiment of the present disclosure can be variously modified, and thus the present invention is not limited to any method in any way.

For example, the multi-viewpoint provision according to the embodiment of the present disclosure is not limited to two passengers, and it may be possible to extend to multi-passenger boarded vehicles such as two or more barrels mounted on the same base in addition to the tank will be.

In the meantime, the present disclosure is not necessarily limited to these embodiments, as all of the constituent elements constituting the embodiment of the present disclosure have been described as being combined or operated as a single unit. That is, within the scope of the present disclosure, all of the components may be selectively operable in combination with one or more. In addition, although all of the components may be implemented as one independent hardware, some or all of the components may be selectively combined to perform a part or all of the functions in one or a plurality of hardware. As shown in FIG. The codes and code segments that make up the computer program may be easily deduced by those skilled in the art. Such a computer program may be stored on a non-transitory computer readable medium readable by a computer and read and executed by a computer to implement embodiments of the present disclosure.

Here, the non-transitory readable recording medium is not a medium for storing data for a short time such as a register, a cache, a memory, etc., but means a medium that semi-permanently stores data and can be read by a device. Specifically, the above-described programs can be stored in non-volatile readable recording media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

While the present invention has been particularly shown and described with reference to preferred embodiments thereof, it is to be understood that the present invention is not limited to the specific embodiments thereof except as defined in the appended claims. It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present disclosure.

1100: Multi-passenger motion platform 1110-1, 1110-2: Image display device
1120: host device 1200: base plate
1210: first actuator 1220: platform plate
1230: second actuator 1240: seat portion
1300: Processor 1310, 1420:
1400: interface unit 1410:
1430: Motion information processor

Claims (13)

A host apparatus for providing a plurality of viewpoint-based images capable of viewing different images by a plurality of passengers on a multi-passenger motion platform,
A storage unit for storing object information of a first object in a virtual space implemented in at least one image display device and a second object dependent on the first object, respectively; And
When the event is generated in at least one of the first object and the second object, generates a first image and a second image reflecting the event on the basis of the stored object information, A processor
Host devices that contain. The method according to claim 1,
The processor provides the first image to the first wearable image display device worn by the first occupant of the plurality of passengers and provides the second image to the second wearable image display device worn by the second occupant Lt; / RTI > The method according to claim 1,
Wherein the storage unit stores at least one of identification information for identifying the first object and the object, and motion information related to the position and direction of the first object and the second object as the object information. The method of claim 3,
Wherein the processor is further configured to, when a motion occurs in the first object and the second object as the event, generate a first motion image and a second motion image based on the stored motion information, Device. 5. The method of claim 4,
The multi-passenger motion platform including a controller for the plurality of passengers to manipulate to generate the motion,
Wherein the processor determines a change amount of the motion based on an operation signal provided from the controller. 6. The method of claim 5,
The multi-
A first actuator for allowing the plurality of passengers to simultaneously detect movement of the first object and the second object; And
And a second actuator for allowing the plurality of passengers to individually detect movement of the first object and the second object,
And the processor controls to control the first actuator and the second actuator based on the amount of change in the motion. A method of providing a plurality of viewpoint-based images capable of viewing different images by a plurality of passengers on a multi-passenger motion platform,
Storing object information of a first object in a virtual space implemented in at least one image display device and a second object dependent on the first object, respectively; And
When the event is generated in at least one of the first object and the second object, generates a first image and a second image reflecting the event on the basis of the stored object information, Step
Based on the plurality of viewpoints. 8. The method of claim 7,
Wherein the step of providing the at least one image display device comprises:
Providing the first image to a first wearable image display device worn by a first occupant of the plurality of passengers and providing the second image to a second wearable image display device worn by a second occupant; Based on the plurality of viewpoints. 8. The method of claim 7,
Wherein the storing step comprises:
A plurality of viewpoint-based image providing methods for storing at least one piece of information among identification information for identifying the first object and the object, and motion information related to a position and a direction of the first object and the second object, . 10. The method of claim 9,
Wherein the step of providing the at least one image display device comprises:
And providing the first image and the second image based on the stored motion information matching the amount of change of the motion when the first object and the second object generate a motion as the event A method for providing a plurality of viewpoint based images. 11. The method of claim 10,
The multi-passenger motion platform including a controller for the plurality of passengers to manipulate to generate the motion,
And determining a change amount of the motion based on an operation signal provided from the controller. 12. The method of claim 11,
The multi-
A first actuator for allowing the plurality of passengers to simultaneously detect movement of the first object and the second object; And
And a second actuator for allowing the plurality of passengers to individually detect movement of the first object and the second object,
And controlling the first actuator and the second actuator based on the amount of change of the motion. 1. An image simulating system for providing a plurality of viewpoint-based images capable of allowing a plurality of users to view different images,
At least one image display device for implementing the plurality of viewpoint-based images;
A multi-view motion platform on which the plurality of users are boarded to view the multi-view-based image; And
Storing object information of a first object in a virtual space implemented in the at least one video display device and a second object dependent on the first object, Generates a first image and a second image reflecting the event on the basis of the stored object information and provides the first image and the second image to the at least one image display device
Including a video simulating system.

Images