KR20180112656A - Interactive trampoline play system and control method for the same - Google Patents

Abstract

The present invention provides image contents for a character corresponding to each player playing on a trampoline and detects motion of each player when one or more players make jumps or the like using the trampoline. And the present invention controls operation of the character corresponding to each player based on sensed information. Thus, interest in playing with the trampoline greatly improves through provision of interactive contents for motion of each player.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an interactive trampoline game system,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an interactive trampoline play system and a control method thereof, and more particularly, to an interactive trampoline play system and a control method thereof, To an interactive trampoline play system and a control method thereof.

In general, Trampoline is a play equipment that infants and children play mainly in play facilities and indoor playgrounds. It is a play equipment that players enjoy while jumping on a resilient mat.

Conventionally, there has been a problem that since the play in such a trampoline simply proceeds by repeating the jump, interest is easily lost.

By using the trampoline which can only perform the conventional simple repetition jump play, the simple repetitive jump is very interesting and interesting by providing the interactive contents together with the motion of the player jumping and playing in the trampoline There has been no development of a system that can be a breakthrough play, and there are few prior patents on it.

Prior art patents related to providing interactive contents in association with user operations in the past include Korean Patent No. 1745498, Japanese Patent Laid-Open No. 2001-216527, US Patent No. 9694277, Korean Patent No. 1711488 .

The present invention provides video content for a character corresponding to each player playing on the trampoline when one or more than one player uses a trampoline to play a jump or the like and detects the motion of each player And provides the image contents for controlling the operation of the character corresponding to each player based on the sensed information, thereby greatly enhancing the interest in the play using the trampoline by providing the interactive contents for the motion of each player The present invention provides an interactive trampoline play system and a control method thereof.

An interactive trampoline game system according to an embodiment of the present invention includes: a trampoline provided so that one or two or more players can play while jumping; An image output device for outputting predetermined image contents to at least one of the trampoline image and a screen provided around the trampoline image; A sensing device for acquiring sensing information for one or more players playing in the trampoline by acquiring and processing an image of the sensing area including the trampoline; And generating and processing image content for a character corresponding to each player as image content to be output through the video output device, recognizing motion of each player based on the sensing information, And a control device for controlling the operation of each of the characters so as to correspond to each other.

Preferably, the sensing device further includes: a camera that acquires an image of a sensing area including the trampoline; and an image acquiring unit that acquires an image acquired by the camera and analyzes an image of each frame, A sensing processing unit for extracting the one or two or more players from the image of the one or more players extracted by the sensing processing unit, and extracting and tracking feature points for recognizing the one or two or more players extracted by the sensing processing unit, And an information calculating unit for calculating the information.

Preferably, the control device further comprises: a data storage unit for storing data for generating the image contents; and a control unit for generating and storing image contents for characters corresponding to the respective players using the data stored in the data storage unit, An audio processing unit for providing a preset sound in the image content and a sound corresponding to a character corresponding to each player; and an audio processing unit for performing a motion of each player based on the sensing information of the sensing device And a control unit for controlling the image processing unit and the audio processing unit to generate and process image contents in which the characters operate according to the recognized motion.

Preferably, the sensing device further includes: a camera that acquires an image of a sensing area including the trampoline; and an image acquiring unit that acquires an image acquired by the camera and analyzes an image of each frame, Wherein the control device comprises: a data storage unit for storing data for generating the image content; and a data storage unit for storing the data stored in the data storage unit, An audio processing unit for providing a sound corresponding to a preset sound in the image content and a character corresponding to each player; The one or more players Extracts and tracks feature points for recognizing each of the players, calculates motion information of each recognized player, recognizes motion of each player based on the calculated information, and controls each of the characters And a control unit for controlling the image processing unit and the audio processing unit to generate and process the image contents.

Preferably, the control device sets in advance each of a plurality of characters to be provided as the image content, and when the player is detected by the sensing device, the detected player is informed of one of the plurality of preset characters So that each of the characters matched to each of the one or more players playing in the trampoline controls the matching of the player's character So that the interactive image contents between the player and the character are provided.

Preferably, the control device may set a scenario for each character for each of a plurality of characters to be provided in the video content in advance, and determine, for each of the character actions in the scenario, And the trigger condition for the specific character action in the scenario is satisfied in accordance with the sensing information of the sensing device for the motion of the player on the trampoline so that the character performs the character action So that the image contents can be provided.

Preferably, each time a new player is added to the trampoline on the trampoline, the control device matches another character that has not previously appeared on the image to a new player to be added according to a preset item for player-character matching Character-to-character interactive image content is provided by providing a predetermined action and a voice matched to each player corresponding to the motion of each of the players recognized based on the sensing information .

Preferably, the controller determines a position of each player on the trampoline in accordance with the sensing information, and determines a character matched to each player at a position on the screen corresponding to the determined position of the player, And the interactive image contents between the players and the characters located at positions corresponding to each other are provided.

According to another aspect of the present invention, there is provided an interactive trampoline game system comprising: a trampoline provided so that one or two or more players can play while jumping; An image output device for outputting predetermined image contents to at least one of the trampoline image and a screen provided around the trampoline image; A wearable device configured to transmit information for identifying each player worn on each of the plurality of players and configured to detect a motion of each player wearing the motion detection sensor; And generating and processing image content for a character corresponding to each player as image content to be output through the video output device, wherein, based on the motion detection information by the motion detection sensor of the wearable device, And a controller for recognizing the motion and controlling the operation of each of the characters to correspond to the recognized motion.

Preferably, the apparatus further includes a camera sensor for acquiring an image of the sensing area including the trampoline and subjecting the image to image processing, thereby collecting position information on each of the one or more players playing in the trampoline, and transmitting the collected position information to the controller And the controller is configured to recognize information on the position and operation of each player based on the sensing information of the motion sensor of the wearable device and the sensing information of the camera sensor.

Also, preferably, the wearable device is implemented with the motion detection sensor mounted on a protective helmet that can be used on the head of the player, or the motion detection sensor is mounted on a protector or a bracelet on the player's wrist The motion detection sensor may be provided on the clothing or the belt worn by the player or the motion detection sensor may be provided on the protector or the footrest on the player's ankle or the motion detection may be performed on the sock worn by the player, And a sensor is provided.

Meanwhile, a control method of an interactive trampoline game system according to an embodiment of the present invention includes a trampoline and a video output device for outputting a predetermined video content on a screen provided at a position viewable by a player playing in the trampoline A sensing device for collecting sensing information for each of one or more players playing in the trampoline; and a control device for controlling the image content based on the sensing information, Generating and processing image contents for a character corresponding to each player played on the trampoline by the control device and outputting the image content through the video output device; The sensing device acquiring an image of a sensing area including the trampoline and performing image processing to collect sensing information for each player playing the trampoline; And providing the interactive image content between the player and the character by controlling the operation of each character so that the controller recognizes the motion of each player based on the sensing information and corresponds to the recognized motion.

Preferably, the step of generating and processing the image content and outputting the image content through the video output device may include a step of detecting a new player by the sensing device, a step of selecting one of a plurality of characters The method of claim 1, wherein the step of providing the interactive image content between the player and the character comprises: sensing the player based on the sensed information of the player; Recognizing a motion of a player who has been recognized by the player and providing the image content including the specific motion in the predetermined scenario and the voice corresponding to the motion of the matched character corresponding to the motion of the recognized player .

Preferably, the providing of the interactive image content between the player and the character may include at least one of calculating the jump height of the player, calculating the number of jumps, and calculating the play time based on the sensing information about the player When the player judges that at least one of the calculated jump height, the number of jumps and the play time satisfies the trigger condition for the specific operation of the character on the image matched with the player, And providing the content for the voice or the voice for the voice or the voice, the operation for inducing the player to rest or the voice for the voice.

Preferably, the step of generating and processing the image content and outputting the image content through the video output device includes: matching one of a plurality of characters preset to each player; Comprising the steps of: determining the position of each player on the trampoline; and embodying an image such that characters matched to each player are located at positions on the image corresponding to the determined respective players' positions, The step of providing the interactive image content between the player and the character may include the step of providing the interactive image content between the player and the character at a position where the characters matched to each player and the characters matched with each other correspond to each other .

Preferably, the player-character area indicating the area on the trampoline corresponding to the player's position and the area corresponding to the position of the character matched to the player on the image is displayed separately from the other player-character area The method of claim 1, further comprising the step of:

The interactive trampoline play system and the control method thereof according to the present invention can be applied to an interactive trampoline play system and a control method thereof in which when one or two or more players jump by using a trampoline, Providing content, providing motion picture of each player, and controlling motion of a character corresponding to each player based on the sensed information, thereby providing an interactive content for each player's motion There is an effect of greatly improving the interest in play using the trampoline.

FIG. 1 is a diagram illustrating an interactive trampoline play system according to an exemplary embodiment of the present invention, which provides interactive image content between players and characters.
2 is a block diagram illustrating a configuration of an interactive trampoline play system according to an embodiment of the present invention.
3 is a flowchart illustrating a control method of an interactive trampoline play system according to an embodiment of the present invention.
FIG. 4 is a view for explaining scenarios set for each character and trigger conditions therefor in order to provide player-character interactive image contents shown in FIG.
5 (a) shows a case in which a specific character is matched to a player when one player appears in a trampoline in the interactive trampoline play system according to an embodiment of the present invention, and FIG. 5 (b) And different characters are matched for each of the players.
6 (a) and 6 (b) are diagrams showing an event occurring in an interactive trampoline play system according to an embodiment of the present invention, respectively.
FIG. 7 is a diagram for explaining player recognition, player-character matching, and the like in an interactive trampoline game system according to another embodiment of the present invention.

The details of the interactive trampoline play system and the control method thereof according to the present invention will be described in more detail with reference to the drawings.

The present invention basically relates to a play system for allowing a player who enjoys jumping while jumping on a trampoline to play more fun with image contents outputted on at least one of a trampoline image and a screen installed around the trampoline Motion detection, recognition of each player, etc., by using a sensing device of a camera sensing system for photographing and analyzing an image for this purpose, and the result is reflected on a trampoline or image content projected on a screen, And more particularly to an interactive trampoline play system that provides interactive content such as changes and various special effects.

In particular, according to the present invention, a character set in advance as a video content basically performs an operation such as jumping, and matches with a player playing on a trampoline, so that the matching character is predefined It is characterized by the fact that real player-character interactive contents can be realized by operating according to the scenario.

FIG. 1 illustrates a case where a sensing result using a sensing device by a stereo camera is implemented in connection with an interactive image content projected on a screen 102 as an interactive trampoline game system according to an embodiment of the present invention.

2 is a block diagram illustrating a configuration of an interactive trampoline game system according to an embodiment of the present invention.

The configuration of the interactive trampoline play system shown in FIG. 1 is basically the same as the configuration and control system of the block diagram shown in FIG. 2. In FIG. 1, the case of using a stereo camera system using two cameras 210 and 220 In FIG. 2, a depth camera or a TOF camera is used as one camera 230.

Whether the stereo camera method or the depth camera or the method using the TOF camera is to obtain position coordinate information on the three-dimensional space with respect to the player (s), for example, (When the camera takes a photograph with the angle of view looking down from top to bottom, a stereo camera or a depth camera senses the Z direction movement. When the camera photographs with the angle of view looking from the side, X Directional or Y-directional motion).

1 and 2, an interactive trampoline game system according to an embodiment of the present invention includes a trampoline 100 provided to enable one or two or more players P1 to P4 to play while jumping, An image output device 340 for outputting predetermined image contents 130 to at least one of the trampoline 100 and the screen 102 installed around the trampoline 100, A sensing device 200 for sensing the players P1 to P4, and a controller 200 for generating and processing image contents for the characters corresponding to the respective players, and based on the sensing information collected by the sensing device 200, And a controller 300 for recognizing motion and controlling the operation of each of the characters to correspond to the recognized motion.

Here, 'one or two or more players' means that a sensing device can sense a player's play, and also each player can be sensed even if two or more players play simultaneously , It means that the sensing result for each player can be reflected in the image content to provide interactive contents.

As shown in FIG. 2, the sensing device 200 may include a camera (two or more interlocking cameras 210 and 220 or a depth camera or a TOF camera 230 in a stereo system) And a single camera), a sensing processing unit 251, and an information calculating unit 252. [0156]

The camera 210, 220, or 230 is configured to acquire an image of a sensing area including the trampoline 100, and the sensing processing unit 251 collects the image acquired by the camera, And to extract one or more players playing in the trampoline 100 in the image of each frame.

The information calculating unit 252 is configured to extract and track feature points for recognizing each of the one or more players extracted by the sensing processing unit 251 and to calculate motion information of the recognized players.

2, the sensing device 200 may be configured to include the information calculating unit 252, and may include a camera 210 and 220 or 230, The controller 310 of the controller 300 may be configured to include the processor 251 and the information calculator 252 may be included in the controller 300 (Which may be configured to perform the functions of the second device 252 together).

When the sensing processing unit 251 collects the images acquired by the cameras 210 and 220 or 230 and analyzes the images of the collected frames and extracts the players P1 to P4 from the images, The information calculating unit 252 or the control unit 310 determines the position of the entire trampoline 100 (the trampoline 100 is fixed to each of the extracted players P1 to P4) The calculation of the positional information of each of the players P1 to P4 with respect to each of the players P1 to P4 and the calculation of the motion data of the players P1 to P4, It is possible to perform calculation of information capable of recognizing each player by finding and analyzing minutiae.

2, the control device 300 may include a control unit 310, a data storage unit 320, an image processing unit 330, an audio processing unit 360, and the like .

The data storage unit 320 is a unit for storing data for generating image contents to be output through the video output apparatus 340 and various data related to driving of the system, The control unit 310 generates image contents using the data stored in the storage unit 320 and generates interactive image contents by reflecting sensor sensing data according to the data operation and control of the control unit 310, The video content may be generated.

The audio processing unit 360 is a component for providing a preset sound in the image content and a sound corresponding to a character corresponding to each player.

The interactive trampoline play system according to the present invention is an interactive trampoline game system in which a player playing in a trampoline is provided with sensing information collected by a sensing device (that is, information for enabling each player to be identified through extraction of a feature point for each player, Motion detection information, and the like), and scenario information of a character operation set in advance for each of a plurality of characters to be provided as image contents, thereby providing interactive image contents between the player and the character.

Here, the interactive information content between the player and the character is provided by using the sensing information collected by the sensing device for the player playing in the trampoline, and the scenario information about the preset character action for each of the plurality of characters to be provided as the image content For example, not only when the character on the image corresponds to the action of the player but also when the character on the image requests, provokes, praises, cheers or rests something on the image depending on the action or state of the player Providing responsive or interactive content, such as providing an action and a voice, and then responding to it in response to a character on the image.

1, the interactive trampoline play system according to the present invention includes a camera 210 and a camera 220. The interactive trampoline play system includes a camera 210, (C1 to C4) corresponding to the respective players P1 to P4 are recognized as the image contents 130 by recognizing the players P1 to P4 of the players P1 to P4 sensed by the sensing devices, Each player is much more interesting and interesting to play than a simple jump by providing an interactive image that is based on player-character matching, by implementing an image in which motion is applied to each matched character (C1-C4) .

The sensing device can acquire three-dimensional coordinate information of xyz of each player P1 to P4 by using a stereo camera method or by using a depth camera or a TOF camera, C4), it is possible to provide a more interactive character image.

The sensing device can precisely detect the motion of each player P1 to P4. For example, if a player takes a quick-hitting gesture while jumping, the sensing device senses the motion and delivers the information to the control device, The device can implement an image so that the character on the image matched to the player can also perform an action of hurting it together.

As described above, it is also possible to connect the characters so as to correspond to each player, but it is also possible to provide contents so that a plurality of players can play a cooperative game, or to provide contents so that a plurality of players can compete with each other It is possible. That is, it is possible that all the players cooperate with each other to achieve one goal, or each player can compete with each other and provide contents to be achieved first for some purpose.

In this way, each player who plays in the trampoline can play very interesting and interesting game because each player can play while watching the character corresponding to his / her own character appearing in the image and moving in response to the motion of the player .

A more detailed description will be given later on characteristics of providing interactive image contents between the player and the character using the sensing information and the preset character action scenario information or the like.

3 and 4, an interactive trampoline play system according to another embodiment of the present invention will be described.

The interactive trampoline play system according to another embodiment of the present invention shown in Fig. 3 is a system in which an image output apparatus 340 projects an image onto a trampoline 100 played by players P1 to P4, To P4 are controlled by the sensing device 200 according to a result of sensing the operation of the trampoline 100.

That is, the interactive trampoline play system shown in FIG. 3 is a system for providing interactive contents based on player position information.

3, the sensing device 200 acquires an image photographed at an angle of view of the players P1 to P4 installed in the ceiling CL and plays the trampoline 100, and analyzes the images Lt; / RTI > The sensing device shown in FIG. 1 may be a single camera type, a depth camera, or a 3D camera.

An object corresponding to one or two or more players P1 to P4 may be detected in the trampoline 100 in the image photographed from the top by the sensing device 200 and the sensing processing unit 251 may perform predetermined image processing The information calculating unit 252 extracts each object from the image photographed through the trampoline 100, and the information calculating unit 252 knows coordinate information on the trampoline 100 in advance. Thus, the xy coordinate information on each object, i.e., the trampoline of each player, can be calculated.

The sensing device 200 can calculate the xy coordinate information on the trampoline 100 of each of the players P1 to P4 and transmits the xy coordinate information to the control device 300 so that the control device 300 determines the E1 position corresponding to the P1 player position The E2 position corresponding to the P2 player position, the E3 position corresponding to the P3 player position, and the E4 position corresponding to the P4 player position, respectively, on the image 120 projected on the trampoline 100, A predetermined effect preset at a position e1 to e4 corresponding to a position of the display unit may be generated or an image may be implemented such that the image changes according to preset items at e1 to e4.

That is, every time the players P1 to P4 jumps on the trampoline 100, the sensor 200 calculates the respective positions E1 to E4 and calculates the effect positions e1 to e4 on the image corresponding to the corresponding positions, e4 of the trampoline in association with the jump in the trampoline of the player so that a special effect can be generated at a position corresponding to the position of each player on the image 120 projected on the trampoline have.

At this time, in the effect positions (e1 to e4) in the state where the basic image 121 is projected on the trampoline 100, for example, the petals are scattered or the accumulated petals are digging at the respective effect positions e1 to e4 Each player can enjoy trampoline play while watching such interactive image contents.

Here, each of the players P1 to P4 may play away from each other, but they may jumping and jostling or dragging each other or holding hands together to play together. In this case, in the image captured by the camera sensor 200, May appear together.

In this case, the position of each object extracted from the image of the previous frame is examined to estimate the position of each object in the image of the current frame reasonably (the time between the frame and the frame is a very short time, It can not be separated much from the position in the previous frame. Therefore, even if two or more objects are attached to the current frame, it is possible to estimate the position of each object by reasonably estimating the previous frames.

As described above, the color of each player, the color of the hair, the height of each player, the size of each player through the silhouette image, the shape characteristic, the reflection of the light , Facial recognition, and the like are appropriately used to derive features that can discriminate each player using the images when the features are derived for each item through image analysis

4, an interactive trampoline play system according to another embodiment of the present invention will be described.

In the embodiment shown in FIG. 4, each player P1 to P4 wears a wearable device PS and plays without a sensing device.

Here, the wearable device PS is provided with a sensor (an inertial sensor for detecting a user's motion such as an acceleration sensor or a position sensor) to be worn on the body part of the player, and is provided with a protective helmet, A wearable device (PS) equipped with the above-described motion detection sensor, such as a garment or a belt for a vest, a protector or a bracelet for a player's wrist, a protector for a player's ankle, a sock worn by a player,

When each player P1 to P4 wears the wearable device PS, information unique to each wearable device itself is transmitted to the control device without having to recognize each player through image analysis using a separate sensing device It is possible to easily identify each player and a motion detection sensor mounted on the wearable device can sense jump and various operations of each player and reflect the detected result to the image contents or the like.

However, when providing interactive content using wearable devices, it may be somewhat difficult to determine the position of each player on the trampoline. In this case, as described above, the camera sensor is separately mounted, and the position information of each player is grasped through the camera sensor. When used together with the sensing data of the wearable device, it is possible to accurately identify the player, It is possible to more effectively provide the image contents reflecting this.

The wearable device PS worn by each player is equipped with a module for short range wireless communication such as Bluetooth and wirelessly communicates with the data communication unit 380 of the controller 300 to transmit motion detection data of each player through the data communication unit The control device 300 can continuously transmit the data to the control device, and the control device 300 can continuously process the data of the motion of each player and reflect the contents thereof effectively.

In the block diagram shown in FIG. 4, the information input unit 350 may be provided as required. For example, when the player selects a virtual character to be played together and sets it, the player can input predetermined information .

Before the player plays the trampoline, the character himself / herself is selected through the information input unit 350 so as to have a costume or equipment for the character, and the set character is connected to the player .

In other words, each player can select a character or the like desired by himself / herself before playing the trampoline, and enjoy the trampoline game more interesting and exciting by receiving image contents using his or her own selected character.

When the specific player selects and sets a specific character or an object, the control device 300 recognizes the player through the sensing device and recognizes the character set by the recognized player It is possible to realize an image such that the character interacts with the sensing data about the position, motion, etc. of the player by introducing the object on the image.

The data storage unit 320, the image processing unit 330, the audio processing unit 360, and the like, which are the remaining components of the control device 300, have already been described with reference to FIG.

A control method of an interactive trampoline play system according to an embodiment of the present invention will be described with reference to FIG.

FIG. 5 is a flowchart showing a control method of an interactive trampoline play system for providing interactive content between players and characters.

The provision of the interactive content between the player and the character through the interactive trampoline play system according to an embodiment of the present invention is basically based on the sensing information obtained by sensing the player (s) and the character Character-to-character interactive contents according to an embodiment of the present invention, as shown in FIG. 5, by using all of the setting information, in particular, the scenario information for the character- Is performed by a process in which the sensing device and the control device cooperate with each other.

For convenience of explanation, a state as shown in FIG. 7A, that is, a state in which the trampoline 100 and the screen 102 are installed and not shown in the drawings, the sensing device 200 (see FIG. 2) , See Fig. 2) are respectively provided.

Whether or not the player is on the trampoline, the sensing device works in conjunction with the operation of the system to continuously acquire the image for the field of view angle of view including the trampoline and analyze each image of the frames to be acquired, And whether or not a new player has been added in addition to the already-detected player (S100).

At the same time, the control device provides the image content while projecting the image generated by the image processing unit to the screen through the video output device. If the sensing device does not detect that the player is present on the trampoline, Thereby providing an image (S200).

For example, a character set as a basic character may appear on the image and perform a jump operation, so that the user can provide a voice such as "Friends come and play with me ".

If it is determined in step S100 that the sensing device is detecting a player and a new player has entered the trampoline on the trampoline (S110), the sensing device extracts a portion corresponding to the player from the acquired image, A characteristic portion for identifying the player is extracted (S120). Separately, the sensing device continuously detects whether a new player is entering the trampoline.

Regarding the extraction of the feature for identification of the player, the sensing device or the control device may use the object recognition process to recognize each player more accurately. To do this, rather than simply photographing the image on the head of the player, It is also possible to install a camera on the lateral side separately from the camera on the head and to analyze the characteristic points of each player in the image through the camera to recognize each player.

For example, the size of each player's skin color, head color, height of each player, size (geometric size or number of pixels, etc.) through each player's silhouette image, And the feature extracted from the silhouette image after the jump may be analyzed as a separate analysis item), the reflectance of the illumination, the facial recognition, and the like. If a feature is derived for each item, it is possible to extract a feature that can identify each player using the feature.

In order to recognize an effective player in the case of correctly recognizing each player by analyzing various items and recognizing each player using position information, a unique number is assigned to an object on an image corresponding to each player Etc. may be required.

For example, when the sensing device digitizes and stores the characteristics of each player, such as skin color, hair color, elongation, size, shape, etc. of each player through image analysis, the stored information is analyzed through feature analysis for each player So that each player can be identified.

As described above, when each player is identified and recognized by extracting a feature through image analysis for each player, each player is matched with a specific character, and the player-character is continuously detected through the motion detection information for each player The interactive contents can be implemented.

On the other hand, in the trampoline game system according to the present invention, since each player continuously jumps for a short time and data processing is performed during the short jump time, the game data must be reflected in the image contents, .

That is, there is no serious problem when the sensing data is processed for one player. However, when a plurality of players simultaneously play on the trampoline, it is preferable that the processing of the sensing data for a plurality of players is performed at the same time.

To this end, the sensing processing unit can use a multi-thread method for processing the sensing data of each player.

That is, a single thread is assigned to each player so that the processing of the sensing data (the calculation of the player's position, the recognition of the player, the tracking of the player, etc.) is performed simultaneously in the same number of threads as the number of players desirable.

Each of the players P1 to P4 may play away from each other, but they may jumping and jumping to each other or dragging each other or holding hands together to play together. In this case, in the image acquired by the sensing device 200, May appear together.

In this case, the position of each object extracted from the image of the previous frame is examined to estimate the position of each object in the image of the current frame reasonably (the time between the frame and the frame is a very short time, The position of each object can be reasonably estimated even if two or more objects are attached to the current frame by examining previous frames since the range of the current frame is very limited and can not be largely deviated from the position in the previous frame.

Returning to FIG. 5, if the sensing device extracts a feature for identifying a new player who has entered the trampoline and transmits the extracted feature to the controller, the controller can identify the player through the extracted feature (At this time, the index number can be recognized through the unique number using the indexing information), the controller matches the specific character to the corresponding player (S220).

For example, when the character appears in the image, a basic jump operation (corresponding to a case where the player starts to play in the trampoline), the control device implements the image in which the matched character appears on the image and performs an operation according to a scenario set in advance for the character. So that the character also performs a basic jump operation) (S230).

7A shows that a C1 character appears on the image 130 according to the step S220 as the player P1 enters the trampoline 100 and matches with the P1 player.

When the P2 player and the P3 player respectively enter the trampoline 100 in the state shown in FIG. 7A (when the sensing device detects this), as shown in FIG. 7B, The device matches the P2 character with the P3 player by appearing the C2 character on the image 130 by the step S220, matching the character with the P2 player, and matching the C3 character with the P3 player.

Each of the characters C1, C2, and C3 matched with each of the players P1, P2, and P3 provides a predetermined basic operation, for example, a jump operation, a light jump operation, .

5, the player-character matching is performed as described above, and each character matched to each player appears on the image, and each of the characters starts to perform a basic operation, After the player is identified, sensing information such as motion detection or motion tracking information about the player playing on the trampoline is collected and transmitted to the controller (S130).

The control device receives the sensing information such as the motion detection / tracking information for the player continuously from the sensing device, and provides the player with the image content according to the preset scenarios for the character matched to the player based on the sensing information. Interactive video contents between the characters are provided (S240).

In step S240, interactive image content between the player and the character is implemented in various forms, and an image of the operation of each character is implemented according to an operation scenario preset for each character.

In FIG. 6, an example of an operation scenario of the character and a trigger condition based on the motion of each player for each of the character actions in the scenario (such a trigger condition may be set in advance for each control item in the respective scenarios Is shown in FIG.

As shown in FIG. 6, the control device determines whether or not the character operation scenario is in a state in which the character operation scenario is selected (N10), the basic operation N20, provocation N30, cheering N40, N70), and the like.

Each of the action items occurs when a trigger condition that causes a character to perform an action on the item is satisfied, and the trigger condition may be preset based on sensing information for the player.

The above-mentioned appearance (N10) operation can be set so that the character appears on the image and in a different manner for each character, and it is detected as a trigger condition that the sensing device detects that a new player enters the trampoline (M10) Can be set in advance.

The basic operation N20 is set in advance by the sensing device as an operation that the character performs basically regardless of sensing information about the operation of the player. For example, the basic operation N20 may be a jump operation, a light jump operation, , And the like can be set variously for each character.

The provocation N30 can be set so that the character provokes the player to actively play the character, and the character can be set to provoke the character in different ways. For example, when the character sits down and performs the action, the character " And can be set to be mental.

For example, as shown in FIG. 4, when the player jump height is lower than a preset height or lower than the average jump height of the players through the sensing information for the player as the trigger condition M30 for the provocation, , Or when it is determined that the number of player jumps is less than a preset number of times or less than the average number of jump times of players, the character may be provided with image content for performing the operation for the provocation N30 .

The cheering N40 can be set to cheer each character in different ways as an action such as cheering, praising, or reacting to the player's play. For example, when the character jumps and sprays pollen and the like, "Wow ~! You can set it to be the best!

For example, as shown in FIG. 4, when the player jump height is higher than a predetermined height or higher than the average jump height of the players through the sensing information for the player as the trigger condition M40 for the cheering, , Or if it is determined that the highest jump height recording has been renewed, the image content in which the character performs the operation for the cheering N40 may be provided.

The event time N50 is an example of a case where the event time N50 is provided as an event image content as shown in steps S250 and S260 of FIG. 3. The event time N50 may be an event setting requirement (trigger condition M60 for event occurrence) The player can be provided as contents to be unfolded for celebration or the like specially prepared when the player is recording a maximum jump height or recording exceeding a predetermined number of times or when the total number of players is equal to or more than a preset number.

8A shows an example of an event image 132 to be unfolded when one or two or more players P1, P2, and P3 on the trampoline 100 have recorded the highest jump height, 8B shows an example of an event image 134 that is expanded when a predetermined number of players P1 to P5 are played on the trampoline 100. As shown in FIG.

When such an event time occurs, a camera device may be installed around the trampoline 100, and the camera device may photograph an image of the player's play state so that the camera device can provide the player with the image of the play state later.

Meanwhile, in order to prevent the excessive play time of the player, that is, to allow the child or the like to enjoy the trampoline play for a proper time, the play induction time N60 is set to be longer than the predetermined time The trigger condition M60 is set so that the character gives the player an action or voice to cause the player to rest.

For example, when the play time exceeds the time set as the trigger condition, the character stops the operation and sits down and can give the player a rest while giving a message such as "

The exit N70 occurs when the character leaves the image and the sensing device detects that the player is leaving the trampoline, as a trigger condition M70.

The above-described character operation scenario can be set differently for each of the C1 character, the C2 character and the C3 character shown in, for example, FIG. 5 (b).

For example, in the case of the C1 character, some of the above items N10 to N70 are excluded and set. In the case of the C2 character, all of the items N10 to N70 are set to be included. In the case of the C3 character, Some of the items of ~ N70 may be excluded and set to include other new items.

On the other hand, as described above, the sensing device collects information on various features such as the skin color, hair color, height, silhouette size and shape, facial recognition, and the like for identifying the player when the player senses it So that each player can be recognized.

However, since the players playing in the trampoline tend to have their own play spaces and tend to operate in the secured space, it is not possible to extract the feature portions for each player and recognize each player's trampoline By detecting a position of each player and dividing a predetermined area based on the position of each player, extracting a player on each area by examining a trampoline on each of the divided areas on an image acquired by the sensing device, It is also recognizable.

9, assuming that five players P1 to P5 on the trampoline 100 are playing at a predetermined distance apart from each other as shown in FIG. 9, P5 on the trampoline, and based on each position, a predetermined region, that is, an R1 region based on the position of the P1 player, an R2 region based on the position of the P2 player, and a position based on the position of the P3 player An area R4, an area R4 based on the position of the player P4, and an area R5 based on the position of the player P5, so that each player can be recognized by extracting players in the respective areas on the image.

For example, in the example shown in FIG. 9, a player can be extracted and recognized in each area in a manner of determining that the player is a P1 player when the player is extracted in the R1 area.

As shown in FIG. 9, the area can also be divided on the image 130 so as to correspond to the respective regions separated on the trampoline 100. FIG. That is, in the image 130, S1 region corresponding to R1 region, S2 region corresponding to R2 region, S3 region corresponding to R3 region, S4 region corresponding to R4 region, and S5 region corresponding to R5 region So that characters matched to the player on the trampoline can be positioned respectively.

9, a C1 character matched with the P1 player is placed in the S1 area corresponding to the R1 area, a C2 character matched with the P2 player is placed in the S2 area corresponding to the R2 area, The C4 character matched with the P3 player is placed in the S3 area corresponding to the R5 area, the C4 character matched with the P4 player is placed in the S4 area corresponding to the R4 area, It is possible to place the C5 character that has been moved.

Therefore, when the sensing device recognizes the player present in the area R1 as a P1 player and transmits the motion detection information of the player to the control device, the control device causes the C1 character, which is a character on the S1 area corresponding to the area R1, to operate And other characters can be configured to behave similarly.

Further, the image is displayed on the trampoline so that the regions on the respective trampolines and corresponding images, that is, the regions R1-S1, R2-S2, R3-S3, R4-S4, and R5- It is also possible to project, or provide illumination to make it look more like an image.

If each of the players P1 to P5 jumps and clashes with each other or draws with each other or grasps each other or grasps hands and plays together, it may be difficult to identify each player by dividing the regions R1 to R5 as described above have. This is because objects in the image acquired by the sensing device 200 may appear together with each other in this case.

In such a case, the position of each object extracted from the image of the previous frame may be examined, and the position of each object in the image of the current frame may be reasonably estimated.

INDUSTRIAL APPLICABILITY As described above, the interactive trampoline game system and its control method according to the present invention can be applied to each player playing on the trampoline when one or two or more players play a jump or the like by using a trampoline And provides image contents for the character of each player, detects the motion of each player, and controls the operation of the character corresponding to each player based on the sensed information, thereby providing an interactive The provision of one content can greatly enhance the interest in playing with the trampoline.

100: trampoline, 102: screen
200: sensing device, 251: sensing processing part
252: information calculating unit, 300: control unit
310: control unit, 320: data storage unit
330: image processing unit, 340: video output device

Claims (16)

A trampoline provided so that one or two or more players can play while jumping;
An image output device for outputting predetermined image contents to at least one of the trampoline image and a screen provided around the trampoline image;
A sensing device for acquiring sensing information for one or more players playing in the trampoline by acquiring and processing an image of the sensing area including the trampoline; And
And generating and processing image content for a character corresponding to each player as image content to be output through the video output device, recognizing motion of each player based on the sensing information, A control device for controlling the operation of each of the characters;
And an interactive trampoline play system. The apparatus according to claim 1,
A camera for acquiring an image of a detection area including the trampoline;
A sensing processor for collecting the images acquired by the camera and analyzing the images of the collected frames to extract the one or more players from the images of the respective frames;
And an information calculation unit for extracting and tracking feature points for recognizing each of the one or more players extracted by the sensing processing unit and calculating motion information of each of the recognized players. The control apparatus according to claim 1,
A data storage unit for storing data for generating the image contents;
An image processing unit for generating and processing image contents for a character corresponding to each player using data stored in the data storage unit;
An audio processor for providing a preset sound in the image content and a sound corresponding to a character corresponding to each player;
And a control unit for recognizing motion of each player based on the sensing information of the sensing device and controlling the image processing unit and the audio processing unit so that image contents in which the characters operate in correspondence with the recognized motion are generated and processed Wherein the interactive trampoline play system comprises: The method according to claim 1,
The sensing device includes:
A camera for acquiring an image of a sensing area including the trampoline; and an image acquiring unit for acquiring an image acquired by the camera and analyzing an image of each of the collected frames to acquire the one or more players And a sensing processing unit
The control device includes:
An image processing unit for generating and processing image contents for a character corresponding to each player using data stored in the data storage unit; An audio processing unit for providing a preset sound in the content and a sound corresponding to the character corresponding to each player, and a feature point extraction unit for extracting and tracking feature points for recognizing the one or two or more players extracted by the sensing processing unit, The motion information of each of the recognized players is calculated, the motion of each player is recognized based on the calculated information, and the image processing unit and the image processing unit are configured to generate and process the image contents, And a control unit for controlling the audio processing unit Trampoline, play interactive system wherein the. The control apparatus according to claim 1,
Wherein each of the plurality of characters to be provided as the image content is set in advance, and when the player senses the player by the sensing device, one of the plurality of preset characters is matched to the sensed player, By controlling the matching character to operate in accordance with the motion of the player, each of the characters matched to one or two players playing in the trampoline operates in accordance with the motion of the player, The interactive trampoline play system comprising: The control apparatus according to claim 1,
Setting scenarios for respective character behaviors for each of a plurality of characters to be provided as the image content in advance; setting trigger conditions based on the motions of the players for each of the character actions in the scenarios in advance; When the trigger condition for the specific character action in the scenario is satisfied according to the sensing information of the sensing device for the motion of the player on the trampoline, the image content is provided so that the character performs the character action. Interactive trampoline play system. The control apparatus according to claim 1,
Each time a new player is added to the trampoline, another character that has not appeared on the image is matched with a new player to be added according to a preset item for player-character matching, Characterized in that the character matched to each player corresponding to the motion of each player provides a preset motion and voice to provide interactive image content between the player and the character. The control apparatus according to claim 1,
Determines the position of each player on the trampoline in accordance with the sensing information, implements an image such that the character matched to each player is located at a position on the screen corresponding to the determined position of each player, And the interactive image contents between the player and the character positioned at the corresponding positions are provided in the interactive trampoline play system. A trampoline provided so that one or two or more players can play while jumping;
An image output device for outputting predetermined image contents to at least one of the trampoline image and a screen provided around the trampoline image;
A wearable device configured to transmit information for identifying each player worn on each of the plurality of players and configured to detect a motion of each player wearing the motion detection sensor; And
Wherein the control unit performs generation and processing of image content for a character corresponding to each player as image content to be output through the video output device, and generates motion information of each player based on motion detection information by the motion detection sensor of the wearable device And controls the operation of each of the characters to correspond to the recognized motion;
And an interactive trampoline play system. 10. The method of claim 9,
Further comprising a camera sensor for acquiring an image of a sensing area including the trampoline and performing image processing to collect position information on each of one or more players playing in the trampoline and transmitting the collected position information to the controller,
Wherein the control device is configured to recognize information on the position and operation of each player based on sensing information of the motion sensor of the wearable device and sensing information of the camera sensor. 10. The wearable device according to claim 9,
The motion detection sensor may be provided in a protective helmet that can be used on the player's head or the motion detection sensor may be provided on a protector or a bracelet that is placed on the wrist of the player, Wherein the motion detection sensor is provided or the motion sensing sensor is provided on a protector or a footrest on the player's ankle or the sock worn by the player is equipped with the motion sensing sensor Interactive trampoline play system. A trampoline, a video output device for outputting predetermined image contents on a screen provided at a position visible to a player playing in the trampoline, and a controller for collecting sensing information for one or more players playing in the trampoline And a control device for controlling the image content based on the sensing information, the control method comprising the steps of:
Generating and processing image contents for a character corresponding to each player played on the trampoline by the control device and outputting the image content through the video output device;
The sensing device acquiring an image of a sensing area including the trampoline and performing image processing to collect sensing information for each player playing the trampoline; And
Providing the interactive image content between the player and the character by controlling the operation of each character so that the controller recognizes the motion of each player based on the sensing information and corresponds to the recognized motion;
And a control unit for controlling the trampoline game system. 13. The method of claim 12,
Wherein the step of generating and processing the image content and outputting the image content through the image output apparatus comprises:
Detecting a new player by the sensing device; matching one of a plurality of characters preset to the detected player; and displaying the matching character on an image,
The step of providing the interactive image content between the player and the character comprises:
Recognizing a motion of the sensed player based on sensed information of the sensed player; recognizing a motion of the sensed player based on sensing information of the sensed player; And providing image content to the trampoline game system. 13. The method as claimed in claim 12, wherein the providing of interactive image content between the player and the character comprises:
Performing at least one of calculating a jump height of the player, calculating a jump count, and calculating a play time based on sensing information about the player;
And if it is determined that at least one of the calculated jump height, jump count, and play time satisfies a trigger condition for a specific operation of a character on an image matched to the player, the matched character provokes Comprising the steps of: providing content for operation and voice, or content for cheering and voice, or content for operation and voice to induce rest to said player. 13. The method of claim 12,
Wherein the step of generating and processing the image content and outputting the image content through the image output apparatus comprises:
The method comprising the steps of: matching one of a plurality of characters preset to each player; determining a position of each player on the trampoline in accordance with the sensing information; Wherein each of the plurality of players comprises a plurality of characters,
The step of providing the interactive image content between the player and the character comprises:
And providing interactive image content between the player and the character at a position where each player matches each character matched to each player. 16. The method of claim 15,
Characterized by further comprising the step of displaying a player-character area indicating an area on the trampoline corresponding to the position of the player and an area corresponding to a position on the image of the character matched to the player so as to be distinguished from the other player-character area Wherein the control unit controls the operation of the trampoline game system.

Images