KR101865579B1 - Apparatus for base-ball practice, sensing device and sensing method used to the same and control method for the same - Google Patents

Abstract

The present invention relates to an experience-type virtual baseball game apparatus that enables a user to experience a virtual team and a baseball game on the basis of a video image projected on a screen, It is possible to play a game in which a virtual team and a user playing a virtual baseball game are prevented from playing the main game of the virtual team and use a sensing device of the image sensing type for the play of the user, So that the user can fully enjoy the diversity and the reality of the baseball game, and a virtual baseball game control method using the virtual baseball game device.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an experience type virtual baseball game device and a virtual baseball game control method using the virtual baseball game device.

The present invention relates to a so-called screen baseball game in which a user paces a ball from a mound to a screen based on a virtual baseball image projected on a screen in a predetermined size indoor space, and a sensing device senses the ball and implements a simulation image according to the sensing result. System and a virtual baseball game control method using the virtual baseball game apparatus.

With the recent increase in baseball population, a so-called screen baseball system has emerged that overcomes the limitations of playing a real baseball game in a wide range of baseball stadiums and enables a virtual baseball game to be played in a small indoor space while feeling the sense of reality of the baseball game.

Typically, the screen baseball system is provided with a mound in which a user can hit a ball to be hit by a pitcher in a predetermined space in the room, or a mound where a user can pitch a ball as a pitcher, And the sensing device senses the movement of the hit ball or the pitching ball, so that the sensing device can sense the movement of the ball or the pitching ball, And based on the result, implements the image for the progress of the baseball game.

Korean Patent Application No. 10-2015-0041844, Korean Patent Application No. 10-2015-0041861, Korean Patent Application No. 10-2014-0054105, US Patent No. 5443260, Japanese Patent No. 4743763, etc., The contents of the screen baseball system as described above are disclosed in the technical literature.

However, in general, not only pitching and striking are performed in baseball games, but the portion of the main shaft occupies a considerable proportion, and even though baseball players consider the portion of the main shaft to be very important, Since only the user performs only the hitting of the ball or the user performs only the pitching of the ball and the portion related to the shaft is executed depending on AI (artificial intelligence of the game character) in the game, A user who only makes a pitch or strike easily loses his interest in a screen baseball game and can not fully enjoy the diversity of the baseball game.

The present invention relates to an experience-type virtual baseball game apparatus that enables a user to experience a virtual team and a baseball game on the basis of a video image projected on a screen, It is possible to play a game in which a virtual team and a user playing a virtual baseball game are prevented from playing the main game of the virtual team and use a sensing device of the image sensing type for the play of the user, So that the user can fully enjoy the diversity and the reality of the baseball game, and a virtual baseball game control method using the virtual baseball game device.

A method for controlling a virtual baseball game by an experiential virtual baseball game device according to an embodiment of the present invention is a method for controlling a virtual baseball game based on a virtual baseball image projected on a screen so that a user can play a baseball game or a baseball game with a virtual player Wherein a control device that implements the baseball practice or the image for the baseball game includes an image of a virtual team attacking the team defended by the user Implementing; The control device displays at least one dispatch area for guiding the ball throwing of the user on the image in accordance with the attack of the virtual team; The sensing device calculates motion information about a ball to be moved by the user as the user dispenses a ball, and calculates movement information of the ball using the motion information of the ball, Calculating a position and transmitting the calculated position to the control device; And a step in which the control device determines whether the screen arrival position is located within the shot area indicated on the image, and proceeds to baseball practice or baseball game according to the determination result.

Preferably, the step of displaying the at least one throwing area may include: a first throwing area for guiding the user to throw a first base in accordance with an attack situation of the virtual team; At least one of a second throwing area for guiding the third throw, a third throwing area for guiding throwing to the third throw, a home throwing area for guiding the throwing to the groove, and a picking area for guiding the pickling against the lead by the imaginary runner The method comprising the steps of:

Preferably, the step of implementing an image of attacking by the virtual team includes the step of implementing an image of a virtual batter preparing for batting at a batting in a situation where at least one virtual runner is on the way Wherein the step of displaying the at least one dispatch area comprises the step of displaying a custody area in which the user leads the custody of a virtual runner who has made the lead as the virtual runner makes a lead The baseball game or the baseball game according to the determination result may include a step of allowing a virtual ball with the virtual runner to be dispatched when the screen arrival position is determined to be located within the confrontation area, So that the baseball game or the baseball game is performed It characterized in that it comprises a system.

Preferably, the step of implementing the image of attacking by the virtual team includes the step of implementing an image of the virtual batter hitting the virtual ball on the image of the ball pitched by the user at the batter's seat Wherein the step of displaying the at least one throwing area includes the step of displaying an throwing area for guiding the throwing of the user to the hoop after the virtual batter hits after the hitting, The baseball game or the baseball game according to the present invention may be arranged such that when it is determined that the screen arrival position is located within the throwing area, The baseball game or the baseball game is implemented by implementing the image It shall be.

Preferably, the step of displaying the at least one throwing area may include: a first throwing area for guiding the user to throw a first base in accordance with an attack situation of the virtual team; Displaying a plurality of throwing areas of a second throwing area for guiding the third throw, a third throwing area for guiding throwing to the third throw, and a home throwing area for guiding throwing to the groove, Or playing a baseball game comprises the steps of: determining whether the screen arrival position is within one of the plurality of dispatch areas, and when the screen arrival position is located in any one dispatch area, The method comprising the steps of: providing an image to allow a virtual ball to be dispatched to a virtual player Value is characterized by including the step of implementing an image that does not contain in any of the plurality of throwing area, so that the view of the virtual throwing fault or the virtual player at that location so that the safe.

Preferably, the sensing device calculates the screen arrival time, which is the time at which the ball dispatched by the user reaches the screen, together with the screen arrival position, using motion information about the moving ball, And the baseball game or the baseball game according to the determination result includes a step of, when the screen arrival position is included in the specific throw-in area, when the control device reaches a base run by a virtual runner or a virtual batter And comparing the screen arrival time or the screen arrival time with the offset time to implement an image so that the virtual runner or virtual batter who flies is out or safed.

The step of displaying the at least one dispatch area may further include setting a time limit for the dispatch of the user to the dispatch area displayed on the image and displaying the progress of the time limit together And a step of playing baseball game or baseball game according to the result of the determination is performed when the ball dispatched by the user reaches the throw-in area after the time limit has elapsed, so that a virtual runner or a virtual batter is safely A virtual runner or a virtual batter is out-putted when the ball dispatched by the user to the throw-in area reaches the limit time, According to the result of the simulation according to the user's request, the virtual runner or the virtual batter Out, or an image to be safed.

Preferably, the step of displaying the at least one dispatch area may include a step of setting the display time of the dispatch area in advance by the control device, and when the condition is to display the dispatch area on the image, And the dispatch area is displayed and then extinguished during the display time.

Also, preferably, the step of displaying the at least one dispatch area may include the steps of: calculating a valid time at which the virtual runner or virtual batter can be out by throwing; And implementing an image so that the indicated dispatch area is illuminated during the calculated effective time or displaying the predetermined indication or the progress of the valid time for the calculated dispensed time in the dispensed area .

Preferably, the control device stores in advance the information about the main force of the virtual runner or the virtual batter, and the step of displaying the at least one throwaway area comprises: And determining and setting a time limit for the user's throw-in in the throw-in area displayed on the image based on the information about the main force of the batter, and performing the baseball practice or the baseball game according to the determination result The method comprising the steps of: imagining a virtual runner or a virtual batter to be safed when the ball dispatched by the user reaches the throw-in area after the time limit has elapsed; When the ball dispatched by the user arrives, the virtual runner or the virtual batter is out of the video image Or is in accordance with the result of simulation according to the base running and throwing of the user of the virtual leader, or virtual in the batter, it characterized in that it comprises the step of implementing the image so that the virtual runner or batter of the virtual out or safe.

Preferably, the control device stores in advance the information about the main force of the virtual runner or the virtual batter, and the control device controls the control device based on the information on the main force of the stored virtual runner or the virtual batter, The effective time can be determined according to the main information for each virtual player or virtual player by calculating the time.

Preferably, the step of calculating the screen arrival position and transferring the screen arrival position to the control device includes the steps of: photographing an image of a ball to be moved by the user; The method comprising the steps of: extracting a trigger area having a preset size at a set position; determining whether a ball is detected in the extracted trigger area; and, if a ball is detected in the trigger area, Generating a trigger for the ball pitching analysis when the ball traveling direction is toward the screen; and generating a trigger for the ball pitching analysis when the ball traveling direction is toward the screen, Calculating the ball motion information by the sensing device in accordance with the occurrence of the obstacle, For a characterized in that it comprises a step in which the process is taking place.

Preferably, the step of calculating the screen arrival position and transferring the screen arrival position to the control device includes the steps of: photographing an image of a ball being moved and dispatched by the user; Comprising the steps of: detecting coordinate data on a three-dimensional space on each image of the ball; determining a coordinate function of the detected ball on a predefined function for ball motion in a predefined coordinate axis direction on the three- Calculating a ball motion model for a ball that is pitched and moved by the user by applying coordinate data; and applying coordinate information of the screen to the calculated ball motion model so that the moving ball reaches the screen Calculating a time to reach a screen, which is a time, And calculating the screen arrival position.

Also, preferably, the hands-on virtual baseball game device is configured to be connected to the server by a network together with another experiential virtual baseball game device in which another user hits the ball fired from the ball pitching device, Wherein the step of implementing images for attacking by the virtual team comprises the steps of: sensing information about the operation or action of the other user in the other virtual baseball game device A virtual baseball game device in which the virtual baseball game device and the virtual baseball game device are connected to each other via a network; And implementing an image in which a play is performed.

Also, preferably, the hands-on virtual baseball game device is capable of performing wired / wireless communication with a terminal that allows another user to operate the virtual player's play when the user proceeds with baseball practice or baseball game with the virtual player Wherein the step of implementing an image of the virtual team attack includes the steps of controlling the virtual player of the virtual team or the virtual batter by manipulating the terminal by the other user And implementing an image in which a virtual runner of the virtual team or a virtual batter is played on the image in accordance with the operation of the terminal.

Meanwhile, the experiential virtual baseball game device according to an embodiment of the present invention includes a virtual baseball game in which a user can practice a baseball game or a baseball game with a virtual player on the basis of a virtual baseball image projected on a screen The game apparatus according to claim 1, further comprising: a movement information generating unit that generates motion information for the ball to be moved and dispensed by the user as the ball is dispatched, and generates a screen arrival position at which the ball reaches the screen Sensing device; And at least one throwing area for displaying an image of a virtual team attacking the team defended by the user and guiding the ball throwing of the user on the image in accordance with the attack of the virtual team, And a controller for determining whether the screen arrival position is located within the shot area indicated on the video and proceeding with baseball practice or baseball game according to the determination result.

Preferably, the control device further includes a control unit that controls the user to select one of the first throwing area for guiding the throw-in for the first throw, a second throwing area for guiding the throw-in for the second throw, A plurality of areas in accordance with an attack situation of the virtual team, the plurality of areas being set in advance for each of a plurality of areas The display unit displays at least one of the plurality of images on the image.

Also, preferably, the sensing device calculates the screen arrival time, which is the time at which the ball dispatched by the user reaches the screen, using the motion information on the moving ball together with the screen arrival position, When the screen arrival position is included in the specific dispatch area, the control device determines whether or not the time required for the control device to reach a virtual runner or a runner of the virtual batter, And a time when the screen arrival time is added to the offset time to implement an image so that the virtual runner or virtual batter who flies is out or safed.

The experiential virtual baseball game device and the virtual baseball game control method according to the present invention can be applied to a virtual baseball game device and a virtual baseball game control method that allow a user to experience a virtual team and a baseball game on the basis of a video, A virtual game system in which a player who plays a virtual baseball game with a player who plays virtual baseball game against a virtual team on a video is allowed to play the virtual game player's baseball game, It is possible to obtain a sensing accuracy and a sensing speed which are considerably high by using the sensing device of the image sensing method, so that the user can fully enjoy the diversity and reality of the baseball game.

FIG. 1 illustrates an example in which a virtual baseball simulation system, that is, a so-called screen baseball system, is implemented as a baseball training apparatus according to an embodiment of the present invention.
2 is a block diagram showing the configuration of the baseball training apparatus shown in Fig.
3 is a flowchart showing a sensing method of the sensing device and a control method by the control device in the baseball training device having the configuration shown in Fig.
FIG. 4 is a diagram illustrating an image taken by one camera of a camera unit of a sensing device according to an exemplary embodiment of the present invention, in which a sensing device displays a ball image appearing on an image of a plurality of frames at once, To describe the process of determining the ball motion model.
FIG. 5 is a diagram for explaining a determination of a ball motion model in consideration of a case where a sensing device according to an embodiment of the present invention collides with a pitch of a ball, a ceiling, or the like.
FIG. 6A is a view illustrating an example of an image of a virtual batter and a virtual catcher projected on a screen in a baseball training apparatus according to an embodiment of the present invention. Fig. 6 (b) is a view for explaining more easily the simulation of the ball as shown in Fig. 6 (a). Fig.
FIG. 7 is a diagram showing a case in which a user performs processing in a manner different from that shown in FIG. 6 (a) with respect to processing on an image of a ball pitched in a baseball training apparatus according to an embodiment of the present invention.

The experience virtual baseball game device and the virtual baseball game control method according to the present invention will be described in more detail with reference to the drawings.

First, a hands-on virtual baseball game device according to an embodiment of the present invention will be described with reference to FIGS. 1 and 2. FIG. FIG. 1 shows an example in which a so-called screen baseball system is implemented as an experiential virtual baseball game apparatus according to an embodiment of the present invention, and FIG. 2 shows an example of a virtual baseball game apparatus .

1, the experience type virtual baseball game device according to the embodiment of the present invention includes a mound 30 and a screen 20 in a space formed by the side wall 11 and the rear wall 12 , So that the user can pitch the ball (1) at the mound (30).

In the space SP between the screen 20 and the rear wall 12, a baseball field image to be projected on the screen 20, a video about an attack of a virtual team, and a simulation image for a ball (The image processed in the control device 300 is projected onto the screen 20 through the image output unit 420).

1 shows that a virtual batter VB on the image IM projected on the screen 20 prepares to strike a ball that the user P1 is pitching and a virtual runner VR plays a main- SD), and displays an oncoming area Rt for inducing the user to let out a virtual runner VR which is leading the user out on the image IM.

The baseball training apparatus according to the present invention may be configured not only to allow the user to practice baseball practice or baseball game of pitching the ball on the mound but also to allow the user to practice the baseball batting game or baseball game . At this time, when the user hits the ball, the mound 30 becomes an at-bat.

A ball pitching device (not shown) is provided behind the screen 20 and a pitching hole (not shown) is formed on the screen 20 in the case of a baseball practice or a baseball game in which a user hits the ball, And may be configured in such a way as to fire the ball from the pitching device to the batter. An example of this will be described later with reference to FIG.

1 and 2, a baseball training apparatus according to an embodiment of the present invention includes a control device 300 and a sensing device 200, As shown in FIG. A ball pitching device may also be included in the present invention if the system allows the user to perform ball pitching as well as ball pitching.

The sensing device 200 analyzes a photographed image and senses an object on the image. The sensing device 200 acquires and analyzes an image of a predetermined photographing range including the mound 30, Calculating ball motion information for a ball to be delivered to the throw-in region, and calculating information on the time at which the ball that the user has pitched or the ball that has been pitched by the user arrives at the screen and the screen arrival position using the calculated ball motion information do.

2, the sensing device 200 may include a camera unit 210 and a sensing processing unit 220. The camera unit 210 may include a mound 30, The sensing processing unit 220 receives an image from the camera unit 210 and performs image analysis according to preset items to perform baseball exercises using the baseball practice apparatus, And calculates information necessary for the baseball game.

The camera unit 210 of the sensing device 200 photographs the same photographing range at different positions and calculates the three-dimensional position information of the object on the photographed image by using the first camera 211 and the second camera 211 By including the camera 212 in a stereoscopic manner, the sensing processing unit 220 can obtain three-dimensional coordinate data of the ball by analyzing the image captured by the camera unit 210 .

The sensing processing unit 220 receives and collects images photographed by the first camera 211 and the second camera 212 of the camera unit 210 and analyzes each of the collected images, And extracts three-dimensional coordinate data for each ball, determines a motion model of the ball with respect to the ball that is pitching and moving or the ball that is moved by using the extracted three-dimensional coordinate data, and determines a motion model of the ball And calculates various kinds of information necessary for baseball practice or baseball game using the experiential virtual baseball game device according to the present invention.

Here, the motion model of the ball means that the ball is represented by an equation of motion concerning the trajectory in the three-dimensional space of the ball that is pitched or moved, and as shown in FIG. 1, the experiential virtual baseball game device Axis, a y-axis, and a z-axis with respect to a space in which the baseball game or baseball game is performed, and the motion model of the ball can be determined according to the defined coordinate system.

That is, the motion model of the ball can be defined as a motion equation in the x-axis direction, a motion equation in the y-axis direction, and a motion equation in the z-axis direction. A more detailed description will be given later.

Meanwhile, the sensing device 200 calculates the ball motion information and transmits the ball motion information to the control device 300. The control device 300 implements a simulation image of the ball motion based on the received ball motion information And can be projected onto the screen unit 20 through the image output unit 420.

2, the control device 300 may include a data storage unit 320, an image processing unit 330, and a control unit 310. In addition,

The data storage unit 320 stores data for processing of a baseball simulation image or the like, which is performed by the hands-on virtual baseball game apparatus. The data storage unit 320 may be configured to temporarily store data received from a server (not shown).

The image processing unit 330 may include a background image such as a video related to a virtual baseball field, a video image of a player, a referee, an audience, etc., a virtual catcher, a virtual batter, a virtual referee, In order to generate various baseball simulation related images such as a virtual runner's play image and a simulation image of the trajectory of a ball pitched by the user, processing is performed according to a preset program for the video data, Output unit 420 and the image output unit 420 projects the received image on the screen 20 so that the user can view the image.

The control unit 310 controls various components of the baseball training apparatus according to the present invention and performs various operations for realizing a baseball simulation image such as a simulation of a ball trajectory based on various information transmitted from the sensing apparatus 200 .

1, a baseball game apparatus according to the present invention is a baseball game apparatus in which when a throwing region Rt is displayed on an image during a baseball game proceeding, the user P1 moves the ball 1 to the throwing region Rt), a virtual ball implemented based on the sensing information sensed by the sensing device 200 (see FIG. 2) is transmitted to a virtual defender positioned in the corresponding ball.

At this time, the virtual runner VR on the image IM can be returned to the original position or run on the next run, and the controller can display an image of this content on an artificial intelligence (AI) preset for the virtual runner (VR) Artificial intelligence for the game character), or another user may operate the terminal to control the action for the virtual runner (VR).

FIG. 3 shows a case where a virtual runner performs a main play according to an operation of another user by operating a terminal by another user.

In FIG. 3, the parts related to the experiential virtual baseball game device are the same as those of the experiential virtual baseball game device shown in FIG. 1, and a detailed description thereof will be omitted.

3, in this embodiment, a user other than the user P1 who paces or sends a ball operates a terminal 400 provided for wired or wireless communication with the control device 300, VB) and to control the play of the virtual runner VR.

The terminal 400 includes a display unit 410 and an input unit 420. The display unit 410 is preferably configured to be operated by the operation of the input unit 420 or touch input.

The display unit 410 of the terminal 400 displays a screen for manipulating a virtual batter VB on the image IM projected on the screen 20 when the user paces the ball in the mound 30 , The other user controls the virtual batter VB to take an action such as batting, bad swing, and filtering. In a situation where a virtual runner (VR) is on the way as shown in FIG. 3, The display unit 410 provides a screen for operating the virtual runner VR so that the other user can control the runner play of the virtual runner VR.

3, when a hypothetical batter VB enters the batter in a situation where a virtual runner VR is running on the first base, the user P1 is placed in a virtual batter VB (VR) in the first row from the image IM on the screen 20 to the sub display SD while pitching the ball against the ball.

At this time, another user can manipulate the virtual runner (VR) to read from the screen provided by the display unit 410 of the terminal 400, The user P1 displays an unoccupied area Rt (that is, a soot area) for guiding the virtual runner VR to throw a check so that he can not steal, and when the user P1 is in the corresponding soot area Rt A virtual ball on the image IM can be sent to the first base so as to allow the virtual runner VR to be led out when the ball 1 is thrown and the dovetail is precisely delivered in the pick-off area Rt .

As the other user operates the main play (e.g., stolen) for the virtual runner or batter on the image through the terminal 400, the main play is progressed through the sub display (SD) It is also possible to display the above-mentioned throw-in area while realizing an image informing the user (user of the defensive team) in advance that the player can prepare for the main play.

The experiential virtual baseball game device according to the embodiment of the present invention can prevent the player from playing the main game of the virtual team which is the opponent who spreads the baseball game with the user in the same manner as the baseball game, And the like.

4, a virtual baseball game apparatus according to the present invention and other virtual baseball game apparatuses are connected to each other through a network via a network, (Hereinafter, referred to as "first user" for convenience), and another user (second user for convenience) in another virtual baseball game apparatus (referred to as 'second apparatus' for convenience) The user may be configured to attack and defend through different apparatuses in such a manner that both players are able to attack and defend against each other in such a manner that the ball is hit. In this case, in the second apparatus, And the second user hits the shot ball, a virtual batter VB on the image IM is hit by the virtual ball in the first device, To be a can to proceed.

In Figure 4, RM1 uses a first device to allow a first user (P1) to play a baseball game in a manner that pitches a ball (1) against a virtual batter (VB) on the IM RM2 refers to a play in which the second user P2 hits the ball la fired from the pitching device 100 at the batter seat 30a using the second device Space.

The first device of RM1 has the same configuration as that of the virtual baseball game device of the embodiment of the present invention shown in FIG. 1, and the second device of RM2 also connects the sensing device 200a and the control device 300a to the first device And the second device is provided with a ball pitching device 100 on the rear surface of the screen 20a so that the ball 1a can be fired from the ball pitching device 100 to the batter seat 30a A pitching hole 22a is formed.

The configuration of the ball pitching device and the pitching hole described above may not be clearly shown in the drawing, but the first device may be equally provided.

That is, the first device of RM1 and the second device of RM2 may be devices having the same configuration, and may be configured to allow both attack and defense in one device.

4, the control device 300 of the first device and the control device 300a of the second device are connected to the server S so that they can exchange data with each other through the server S, .

Therefore, when the first user P1 paces the ball 1 in the first device, the sensing device 200 senses the sensed information, calculates the sensing information, and transmits the sensed sensing information to the server S, Lt; / RTI >

The server S transmits the sensing information transmitted from the control device of the first device to the control device 300a of the second device and the control device 300a of the second device transmits the sensing information And the ball pitching apparatus 100 is controlled so as to fire the ball.

In the second device, when the ball pitching apparatus 100 fires the ball 1a in accordance with the ball pitching of the first user P1, the second user P2 can strike, swing or view the ball, The device 200a senses and transmits the generated sensing information to the control device 300a, and the control device 300a transmits the sensing information to the server S. [

The server S transmits the sensing information to the control device 300 of the first device and the control device 300 of the first device displays the image IM on the basis of the sensing information transmitted from the server S. [ (VB) on the virtual ball performs an action such as strike, bad swing, and filtering of the virtual ball.

In this way, the first user P1 playing on the RM 1 and the second user P2 playing on the RM 2 can enjoy the experience-based virtual baseball game in the same manner as playing the actual baseball game while attacking and defending against each other.

In the embodiment as shown in FIG. 4, when a virtual runner strikes or a virtual batter (VB) is struck in a situation where a virtual runner is on the way, a virtual runner moves to the next run, Can play a ball to the throwing area displayed on the screen 20 so as to block the main play by the user P2 playing on the RM2.

For example, by using a 3D camera such as a Depth Camera, the second device detects an operation or an action of the second user, transmits the detection information to the server, and the server transmits the information to the first device It is possible to perform the main-play on the image of the first device based on the received information.

The user P1 playing on RM1 can make a ball in the throw-in area displayed on the screen 20 to prevent the opponent team from playing the lap-top, as described with reference to Fig. 3, Therefore, the detailed explanation is omitted.

The difference between the embodiment shown in Fig. 3 and the embodiment shown in Fig. 4 in the main game is that in the embodiment shown in Fig. 3, the virtual player plays the main game by manipulating the terminal by the other user, In the embodiment shown in FIG. 4B, the virtual player plays the main game by playing another virtual baseball game device.

A baseball game control method of an experiential virtual baseball game device according to an embodiment of the present invention will be described with reference to a flowchart shown in FIG.

A virtual baseball game is started when a user is hit by a defensive team and a virtual team attacks against the defensive team, and an image related to the virtual team attacking a team defended by the user is implemented (S100).

For example, an image of a batter's catcher and a hypothetical batter of a virtual team entering the batter's seat and preparing for batting is implemented.

In response to the attack of the virtual team, at least one throwing area for guiding the ball throwing of the user on the image is displayed (S110).

The throwing area may include a first throwing area for guiding the throw-in for the first throw, a second throwing area for guiding throw-in for the second throw, a third throwing area for guiding throw-in for the third throw, A home throw-in area for guiding the throw-in against a lead by a virtual runner, and a pick-up area for guiding a pick-up for a lead by a virtual runner, either of which may be displayed according to an attack situation or a plurality of these may be displayed have.

For example, in the case where a virtual batter hits a ball on a video in a situation where there is no virtual runner (when the result of the batting is a ground ball), the virtual batter rushes to the base and an image is simultaneously The first throwing area is displayed on one side of the image so that the user can guide the ball to the first throwing position.

In a situation where a virtual runner is on the first base, when the virtual runner leads to the second base, a confrontation area may be displayed on one side of the video so that the user may be guided to throw the catch with one base.

As shown in FIG. 7, when the user P1 is in the process of ball pitching against a virtual batter VB on the image IM, A virtual runner (which is not shown on the drawing but can be separately indicated by the virtual runner through the sub display) is lead, and the checkout area Rtp is displayed on one side of the screen.

If the user P1 throws a ball into the picked-up area Rtp and the ball is hit in the picked-up area Rtp (and the throwing timing is also appropriate), the imaginary runner implements the out-of-picture image, Images that become safe can be implemented.

On the other hand, in another example, in a situation where a virtual runner stands on the first base, when a virtual batter hits the ball on the video, the virtual runner rushes to the second base and the virtual batter The first running ball and the second ball throwing area may be simultaneously displayed on the image so that the user can guide the ball to one of the first ball and the second ball.

A case in which the first sending area and the second sending area are displayed at the same time is shown in FIG. 8 as described above.

When a virtual batter hits a ball pitching by the user P1, the virtual runner in the first run rushes to the second run and the virtual batter rushes to the first run. At this time, as shown in FIG. 8, Rt1 and the second throwing region Rt2 are simultaneously displayed on the image IM and the user P1 places the ball at any one of the first throwing region Rt1 and the second throwing region Rt2 .

If a virtual runner is in the first and second ranks respectively, the first throwing area, the second throwing area and the third throwing area can be simultaneously displayed on the screen after the virtual batter hits, In the case where the runners are all in the first to third ranks, the first throwing area, the second throwing area, the third throwing area and the home throwing area may be simultaneously displayed on the screen after the virtual batter hits.

In the above-described dispatch area, when the control device sets the display time for the dispatch area in advance and the dispatch area is to be displayed on the image, the dispatch area is displayed for the predetermined display time, It can be made to disappear when the display time passes.

Therefore, when the throw-in area is displayed on the screen, the user must hit the throw-in while the throw-in area is displayed, and when the ball is hit in the throw-in area within the display time, the virtual batter or virtual runner is immediately processed out If a ball is hit in the throw-in area within the display time, a simulation image in which the ball is routed on the image is implemented and processed according to the result of the simulation image, or can be processed safely.

On the other hand, with respect to the above-described dispatch area, the control device may set the time limit for the dispatch of the user to the dispatch area displayed on the image, and display the progress of the time limit together.

For example, an image of an on-screen area may be displayed on the screen and a time limit may be separately displayed on the screen, or an image may be implemented such that the in-area is flickered for the time limit.

When the user hits the throw-in area in the throw-in area after the time limit has elapsed, the virtual runner or the virtual batter is safely handled. If the user hits the throw-in area in the throw- It is also possible to process the imaginary runner or the virtual batter to be out immediately or to process it as safe or out according to the result of the simulation image for the throw-in.

In addition, it is also possible to calculate, for the above-mentioned leave area, a valid time at which the control device can release the virtual runner or the virtual batter by throwing, and when the throwing area is lit for the calculated valid time or during the valid time It is also possible to display a predetermined display (e.g., display a band around the dispensing area with a color separated from the dispensing area, or the like), or display the progress of the validity time in numerals.

When a ball dispatched by the user in the calculated validity time is hit in the throw-in area, a virtual runner or a virtual batter can be processed out.

Further, the control device may store information on the main power (running ability) of a virtual runner or a virtual batter in advance in the data storage unit, and may store the limit time for the unoccupied area in the data storage unit, Or based on the main information of the virtual batter.

Of course, when calculating the validity time, the control device can also be based on the master information of the virtual runner or virtual batter stored in the data storage.

In other words, information about the main power is stored in each character corresponding to a virtual runner or a virtual batter. When displaying the above-described play area, the main information of a virtual runner or a virtual batter is extracted It is possible to calculate an effective time based on the main power information and to light up the dispatch area during the valid time, to display a predetermined display, or to display the progress of the valid time in numerical value.

The time for displaying the throw-in area is calculated on the basis of the master information of the virtual runner or the virtual batter, and only when the throw-in is successful, the virtual runner or batter can be out, It is also possible to display the area.

Referring again to FIG. 5, as described above, at least one dispensing area is displayed on the screen image, and then the user can throw the ball into a specific dispensing area. At this time, the sensing device calculates the ball exercise information (Screen reaching time) and a position at which the ball reaches the screen (screen reaching position), and transmits the sensing information to the control device, and the control device transmits the sensing information from the sensing device Sensing information such as ball motion information, screen arrival time, and screen arrival position (S120).

The control device implements an image in which a virtual ball is dispatched to a position corresponding to the dispatch area dispatched by the user based on the received sensing information (S130).

At this time, the control device determines whether the screen arrival position is within the indicated free area (S140).

If the screen arrival position is within the dispatch area indicated on the image, the virtual ball is dispatched correctly. However, if the screen arrival position is outside the dispatch area, an image for the dispatch error is implemented (S142).

For example, an image may be realized in which a virtual defender in the corresponding line becomes a mouthpiece and misses the throw-in.

Here, the calculation of the ball motion information on the ball dispatched by the user by the sensing device, the calculation of the screen arrival time and the screen arrival position will be described in more detail with reference to FIG. 6 and FIG.

FIG. 6 is a flowchart showing a process for calculating sensing information by a sensing device of a virtual baseball game device according to an embodiment of the present invention. FIG. (T1 to t11) appearing on an image of a plurality of frames at a time to describe a process of detecting a ball from an image and determining a ball motion model in a sensing apparatus according to an embodiment of the present invention will be.

As shown in FIG. 6, before the user releases the ball, the camera unit of the sensing device continuously acquires the image of the shooting range and stores it in the buffer (S10).

A sensing processing unit of the sensing device sets a trigger area on a photographed image in advance. An area of a predetermined size is set at a predetermined position on the image, and the trigger area is extracted for each image, (S12).

That is, it is checked which object, that is, the ball, is detected in the trigger area extracted from each image.

Referring to FIG. 9, a trigger area TR having a preset size at a predetermined position on the path that the user 10 makes to the ball can be set as shown in FIG.

When a ball is detected in the trigger area TR (S12), the sensing processing unit continuously examines the trigger area and detects the direction of the ball in which the detected ball advances (S13). The sensing processing unit may detect the ball traveling direction by irradiating the trigger area TR. When a ball is detected in the trigger area TR, a predetermined number of images after that point are inspected, It is also possible to detect the traveling direction.

Although the trigger area can be set anywhere from the ball pitching device to the batting position, it is also possible that the ball thrown by the user may fall on the floor before reaching the screen, for example, In such a case, if the trigger area is set near the mound, the ball may not be detected or detected correctly in the trigger area in the case of the bound ball.

Therefore, it is preferable that the trigger area is set at a position near the mound side in the image in advance.

If the ball traveling direction is the direction toward the screen as a result of detecting the ball traveling direction as described above (S14), the sensing processing unit generates a trigger (S15).

It is preferable that the generation of the trigger through the extraction and analysis of the trigger area proceeds in conjunction with the display of the dispatch area on the screen.

That is, before the dispatch area is displayed on the screen, the process of judging whether or not the trigger is generated through the extraction and analysis of the trigger area does not proceed, and from the moment the dispatch area is displayed on the screen, .

On the other hand, when the trigger occurs as described above, the sensing processing unit collects a predetermined number of images from the buffer before or after the trigger occurrence time, before and after the trigger occurrence time (S20).

When a preset number of images are collected, the sensing processing unit analyzes each of the collected images to detect a ball on each image (S21). The ball detected here may actually be a moving ball, but may be a ball placed on the floor of the play space or may contain other noise.

More precisely, what is detected in step S21 is a ball candidate.

The ball candidates on each of the images can be detected through several stages of ball detection process.

First, the sensing processing unit stores an image taken in advance by the camera unit before the ball moves, as a reference image.

If a difference image is obtained by image difference processing with respect to each of the images taken while the ball is being launched by the user, a moving object including a moving ball remains in the difference image do.

A threshold value of a pixel value (brightness value) for the pixels on the image is preset for the difference image, and the difference image is binarized on the basis of the predetermined threshold value (a pixel value exceeding the threshold value Pixels are represented by white, while the other pixels are represented by black, and binarized).

In the case of a real ball (baseball), since the pixel value (brightness value) on the image is large due to the influence of illumination, when the binarization is performed, the moving ball appears mostly white and the remaining portions appear black, Can be detected.

The sensing processing unit extracts a contour of a part appearing in white from the binarized image and extracts the extracted contour from a predetermined condition such as an aspect ratio, a size of the outline, (The range of the aspect ratio of the ball, the range of the size, the range of the internal brightness, and the like are preset in advance), for example, when the extracted outline is long and the aspect ratio is out of a preset range , And if the size of the extracted outline is out of the preset size range or is too small, the selected part is removed from the extracted outlines and selected as the ball candidate (even if the ball is selected as the ball candidate, Balls or other noise lying on the floor).

In the process of extracting a ball candidate on the image as described above, the sensing processing unit calculates the number of the frame when the ball candidate first appears on the image or the time stamp value at that time, As an initial time value (S22).

On the other hand, the sensing processing unit calculates the three-dimensional coordinates of each of the ball candidates detected on each image in the above-described manner (S23).

The calculation of the three-dimensional coordinates can be performed by using coordinate information obtained from each of the first camera acquired image and the second camera captured image for the same object. However, the three-dimensional coordinate acquisition of the object using the stereo camera system The description thereof will be omitted.

On the other hand, the sensing processing unit establishes an arbitrary ball motion model for arbitrary ball candidate coordinates using the three-dimensional coordinate data of the ball candidate calculated as described above (S24) (S25), the initial coordinate value of the ball is calculated by applying the time value to an arbitrary ball motion model, and the ball candidate included in the corresponding ball motion model when the initial coordinate value of the calculated ball exceeds the predetermined range is removed The coordinate data of the ball is detected by removing the non-ball candidates from the ball candidates (S26).

The sensing processing unit determines the ball motion model for the ball to be dispatched by the user using the detected ball coordinate data as described above (S27).

The above-described ball motion model can be determined by obtaining the equation of motion in each axial direction in the spatial coordinate system of the x-axis, the y-axis and the z-axis as illustrated in Fig. 1 using the three-dimensional coordinate data of the ball described above. A virtual baseball game apparatus according to an embodiment of the present invention is a game apparatus in which a ball pitched by a user in a limited space (for example, a space formed by side wall 11 and rear wall 12 as shown in Fig. 1) It is preferable to establish and determine the above-described ball motion model in consideration of the case of collision with a wall, a ceiling or the like.

As shown in Fig. 9, the image captured and collected by the camera unit of the sensing device includes a user 10 who paces or throws the ball in the mound 30, a ball t1- t11), as well as a portion (not shown) corresponding to a ball and other noise lying on the floor.

Here, the sensing processing unit of the sensing device sets the function of the x-axis direction, the function of the y-axis direction, and the function of the z-axis direction of the ball motion in advance in order to establish a motion model of the ball, By applying the three-dimensional coordinate data of the balls t1 to t11 to the above functions, it is possible to establish the ball motion model by determining the equations of motion in the respective axial directions with respect to the ball motion.

The function of each axial direction used in the formulation and determination of the motion model of the ball may be defined as follows, for example, with some assumptions.

<Function in the y-axis direction>

Since the motion in the y-axis with respect to the time of the moving ball can be assumed to be a constant-velocity motion, it can be expressed as a linear function for the following time.

y = a_y * t + b_y

Here, t denotes a time value, y denotes a y-direction coordinate value, a_y denotes an increase amount of the y-direction coordinate with respect to time (slope of the function), and b_y denotes a y-direction coordinate value (intercept) when t is zero.

<Function in the x-axis direction>

Since the motion in the x-axis with respect to the time of the moving ball can be assumed to be a constant-velocity motion, it can be expressed as a linear function with respect to the following time.

x = a_x * t + b_x

Here, t denotes a time value, x denotes an x-direction coordinate value, a_x denotes an increase amount of the x-direction coordinate with respect to time (slope of the function), and b_x denotes an x-direction coordinate value (intercept) when t is zero.

<Function in the z-axis direction>

Since the motion of the moving ball along the z axis can be assumed to be an equivalent velocity motion in which gravity always operates, it can be expressed as a quadratic function for the following time.

z = a_z * t + b_z - 0.5 * g * t ²

Where g is the gravitational acceleration, t is the time value, z is the coordinate in the z direction, a_z is the z direction velocity when t is 0, and b_z is the z coordinate value (intercept) when t is zero.

As shown in FIG. 9, it is assumed that not only the balls t1 to t11 but also noise may be included in the image to be analyzed, and that all of them are the ball candidates detected in step S21.

The time value can be known together with the three-dimensional coordinate data of each of the ball candidates (t1 to t11, etc.) (for example, when there is a ball candidate appearing in the image of the nth frame, the frame number of the ball candidate or the time stamp value Can be stored as the time value described above).

On the other hand, in order to detect valid ball coordinate data among the ball candidates, it is necessary to remove the coordinate data of the ball after the collision when the moving ball first collides with a wall or a ceiling, It is necessary to remove unnecessary noise such as a ball which has been laid out. It can be checked by checking whether the initial coordinate value exceeds a predetermined range by using the initial time value and the initial coordinate value as in step S26.

Here, the 'coordinate data included in the motion model' refers not only to a case where the coordinate value is present on the motion model in which the coordinate value is established, but also to a case where the coordinate value does not exist on the motion model, As shown in FIG. Here, 'close to a certain level' means that the error range is set in advance through a plurality of experiments and the data exists within the predetermined error range.

Hereinafter, the term 'coordinate data including a motion model' means coordinate data within a predetermined error range for the motion model as described above.

A method of eliminating all data included in a motion model in which the initial coordinate value exceeds a predetermined range by checking the initial coordinate value of the ball according to the initial time value of the established motion model by arbitrarily applying the coordinate data to each axial direction function, The effective ball coordinate data of the ball candidates can be obtained and the final ball motion model can be determined by applying the effective ball coordinate data to the above function.

As described above, when the ball motion model for the ball that is dispatched and moved by the user is finally determined, the sensing processing unit applies the coordinate information of the screen to the determined ball motion model to calculate the time at which the ball reaches the screen, The arrival time is calculated (S28).

Referring to Fig. 1, the y-axis direction coordinate of the screen is always a fixed value. Accordingly, it is possible to calculate the time at which the dispatched ball reaches the screen, that is, the screen arrival time, by applying the y-axis direction coordinate information of the screen to the determined ball motion model.

When the screen arrival time is calculated as described above, the calculated screen arrival time is again applied to the determined ball motion model to determine the remaining x-axis direction coordinate and z-axis direction coordinate (the y-axis direction coordinate is already fixed And the coordinate information in the x, y, and z-axis directions thus determined is coordinate information corresponding to the position at which the ball reaches the screen, that is, the screen arrival position (S28).

The sensing processing unit calculates the motion parameters of the ball (e.g., velocity, direction, height angle of the ball at the screen arrival position, etc.) according to the finally determined motion model of the ball, And &quot; sensing information &quot; together with the screen arrival position information to the control device.

Returning to FIG. 5, if the user sends a ball to the throw-in area, determines the ball movement model accordingly, calculates the screen arrival position and determines whether the position is within the displayed throw-in area. If the screen arrival position is within the throw-in area S140), the control device calculates the time Ta at which the virtual runner or the virtual batter reaches the runner (S150).

The controller then compares the time Tb obtained by adding the screen arrival time Tr or the offset time to the time Ta at which the imaginary runner or the virtual batter reaches the runner (S160) .

Here, the offset time is a time set in advance as a time taken for an action to tag a virtual runner from a moment when a virtual defender on a video receives a ball sent by a user in a virtual space.

In the case of comparing the screen arrival time Tr with the Ta time, it is possible to make out a virtual runner only by the hit of the throw-in without a tag. When the time Tb obtained by adding the offset time to the screen arrival time is compared with the Ta time Is a case where a virtual runner can be turned out only through a tag.

For example, if a virtual batter is hit in a situation where a virtual runner is at the first rank, a second throw zone is displayed. If the player's throw is hit by the second throw zone, And the time (Tb) obtained by adding the offset time to the time is compared with the Ta time.

If there is no virtual runner, if the virtual batter hits, the first throw zone is displayed. If the user's throw-in is hit by the first throw zone, the tag is not needed, Is compared with the Ta time.

If the time Tb obtained by adding the screen arrival time Tr or the offset time thereto is shorter than the time Ta at which the imaginary runner or the virtual batter reaches the runner S1, Or imitates a virtual typewriter out (S180).

That is, since the time taken for the throw-in (screen arrival time) or the time taken for reaching the tag after the throw-in (time added to the screen arrival time plus the offset time) is shorter than the time required for the virtual runner or the virtual batter to reach the runner, The runner or virtual batter is out.

If the time Tb obtained by adding the screen arrival time Tr or the offset time thereto is longer than the time Ta at which the imaginary runner or virtual batter reaches the runner S1, The imaginary batter implements the image to be safed (S190).

That is, since the time taken for the throw-in (screen arrival time) or the time taken for reaching the tag after the throw-in (time added to the screen arrival time plus the offset time) is longer than the time required for the virtual runner or the virtual batter to reach the base, The runner or fictitious batter is to be safeguarded.

On the other hand, if the screen arrival position is outside the dispatch area displayed on the screen, the controller implements an image for the case where the throw-in is wrong (S142). At this time, the defective dispenser is dispatched Sometimes they fall back without catching a virtual ball.

In this case, the hypothetical runner or virtual batter continues to run to the next lane. In such a case, the process of displaying the dispatch area is performed again from S110 (S144).

If the ball is not backed up in spite of a wrong throw, or if a backward ball is quickly caught by another virtual defender, the imaginary runner or fictitious batter may continue to flip and a safe image may be implemented (S190).

As described above, the experiential virtual baseball game apparatus according to the present invention and the virtual baseball game control method according to the present invention allow a user to experience a virtual team and a baseball game on the basis of a video projected on a screen And a virtual baseball game device in which a player who plays a virtual baseball game with the virtual team against a virtual baseball game is allowed to play the baseball game of the virtual team And it is preferable to use a sensing device of the image sensing type for the user's play so that a considerably high sensing accuracy and sensing speed can be obtained.

20: screen, 30: mound
200: sensing device, 210: camera unit
220: sensing processing unit, 300: control device
310: control unit, 320: data storage unit
330: image processing unit, 420: video output unit

Claims (18)

A virtual baseball game control method by an experiential virtual baseball game device in which a user can perform a baseball practice or a baseball game with a virtual player on an image based on a virtual baseball image projected on a screen,
The control device for implementing the image for the baseball practice or the baseball game includes a step of implementing an image of a virtual team attacking the team defended by the user;
The control device displays at least one dispatch area for guiding the ball throwing of the user on the image in accordance with the attack of the virtual team;
Capturing an image of a ball being driven by the user by the sensing device as the user dispenses the ball;
Analyzing the captured and collected image to detect coordinate data on a three-dimensional space on each image of the moving ball;
A ball motion model for a ball being dispatched and exercised by the user by applying coordinate data of the detected ball to a predefined function for ball motion in a predefined coordinate axis direction on the three- ;
Calculating a screen arrival position at which the ball reaches the screen using the calculated ball motion model, and transmitting the calculated position to the control device; And
Determining whether or not the screen arrival position is located in the shot area indicated on the image, and proceeding with baseball practice or baseball game according to the determination result;
Wherein the virtual baseball game device is a virtual baseball game device. 2. The method of claim 1, wherein displaying at least one dispatch area comprises:
And a third base for guiding the third base to the third base, a second base for guiding the second base to the second base, a second base for guiding the second base to the second base, A step of displaying at least one of a free throw area, a home throw-in area for guiding throw-in against the groove, and a pull-out area for guiding the pull-in against a lead by a virtual runner A method of controlling a virtual baseball game. The method according to claim 1,
Wherein the step of implementing an image of attack by the virtual team comprises:
Comprising the step of implementing an image of a virtual batter preparing to strike at bat at a time when at least one virtual runner has entered,
Wherein the displaying of the at least one dispatch area comprises:
And displaying the checkered area in which the user guides the catcher against the imaginary runner who made the lead as the virtual runner leads,
The baseball game or the baseball game according to the determination result may include:
The baseball game or baseball game is executed by implementing a video in which a hypothetical ball with the hypothetical runner is dispatched or the hypothetical runner is put out when the screen arrival position is judged to be located within the confrontation area Wherein the virtual baseball game device is a virtual baseball game device. The method according to claim 1,
Wherein the step of implementing an image of attack by the virtual team comprises:
Comprising the steps of: imagining an imaginary batter hitting a virtual ball on the image of the ball pitched by the user at a bat,
Wherein the displaying of the at least one dispatch area comprises:
And displaying a throw-in area for guiding the user to the throw-in after the virtual batter hits the throw-
The baseball game or the baseball game according to the determination result may include:
The baseball game or the baseball game is implemented by implementing a video in which a hypothetical ball is to be played by the virtual batter, or the virtual batter is played out when it is determined that the screen arrival position is located in the throwing area Wherein the virtual baseball game device is a virtual baseball game device. The method according to claim 1,
Wherein the displaying of the at least one dispatch area comprises:
And a third base for guiding the third base to the third base, a second base for guiding the second base to the second base, a second base for guiding the second base to the second base, And displaying a plurality of dispatch areas among a home dispatch area for guiding dispatch for the dispatch area and the groove,
The baseball game or the baseball game according to the determination result may include:
Determining whether the screen arrival position is within one of the plurality of dispatch areas,
Implementing an image for allowing a virtual ball to be dispatched to a corresponding position or a virtual player to be out at a corresponding position when the screen arrival position is located in any one dispatch area,
When the screen arrival position is not included in any one of the plurality of dispatch areas, realizing an image such that the virtual ball is misdirected or a virtual player becomes safe at the corresponding position A virtual baseball game control method using an experiential virtual baseball game device. 3. The method of claim 2,
The sensing device calculates a screen arrival time, which is a time at which the ball dispatched by the user reaches the screen, using the ball motion model for the moving ball together with the screen arrival position, and transmits the calculated screen arrival time to the control device,
The baseball game or the baseball game according to the determination result may include:
When the screen arrival position is included in the specific dispatch area, the control device calculates a time required for reaching a route where a virtual runner or a virtual batter laps and a time obtained by adding the offset time to the screen arrival time or the screen arrival time And implementing an image so that the virtual runner or the virtual batter who flies is out or safely compared with the virtual baseball game. A virtual baseball game control method by an experiential virtual baseball game device in which a user can perform a baseball practice or a baseball game with a virtual player on an image based on a virtual baseball image projected on a screen,
The control device for implementing the image for the baseball practice or the baseball game includes a step of implementing an image of a virtual team attacking the team defended by the user;
The control device displays at least one dispatch area for guiding the ball throwing of the user on the image in accordance with the attack of the virtual team;
The sensing device calculates motion information about a ball to be moved by the user as the user dispenses a ball, and calculates movement information of the ball using the motion information of the ball, Calculating a position and transmitting the calculated position to the control device; And
Determining whether or not the screen arrival position is located within the shot area indicated on the image, and proceeding with a baseball game or baseball game according to the determination result,
Wherein the displaying of the at least one dispatch area comprises:
Setting a time limit for the unauthorized use of the user in an unoccupied area displayed on the image and displaying progress of the time limit together,
The baseball game or the baseball game according to the determination result may include:
A step of implementing an image such that a virtual runner or a virtual batter is safed when the ball dispatched by the user reaches the throw-in area after the time limit has elapsed;
A virtual runner or a virtual batter is out of sight when the ball dispatched by the user to the throw-in area reaches the time limit before the time limit elapses; Wherein the virtual baseball game device comprises a virtual baseball game device for realizing an image such that the virtual runner or the virtual batter is out or safe according to a result of the simulation according to the simulation result. A virtual baseball game control method by an experiential virtual baseball game device in which a user can perform a baseball practice or a baseball game with a virtual player on an image based on a virtual baseball image projected on a screen,
The control device for implementing the image for the baseball practice or the baseball game includes a step of implementing an image of a virtual team attacking the team defended by the user;
The control device displays at least one dispatch area for guiding the ball throwing of the user on the image in accordance with the attack of the virtual team;
The sensing device calculates motion information about a ball to be moved by the user as the user dispenses a ball, and calculates movement information of the ball using the motion information of the ball, Calculating a position and transmitting the calculated position to the control device; And
Determining whether or not the screen arrival position is located within the shot area indicated on the image, and proceeding with a baseball game or baseball game according to the determination result,
Wherein the displaying of the at least one dispatch area comprises:
Wherein the controller sets the display time for the unoccupied area in advance and displays the unoccupied area for the preset display time if the unoccupied area is displayed on the image. A method of controlling a virtual baseball game by an experiential virtual baseball game device. A virtual baseball game control method by an experiential virtual baseball game device in which a user can perform a baseball practice or a baseball game with a virtual player on an image based on a virtual baseball image projected on a screen,
The control device for implementing the image for the baseball practice or the baseball game includes a step of implementing an image of a virtual team attacking the team defended by the user;
The control device displays at least one dispatch area for guiding the ball throwing of the user on the image in accordance with the attack of the virtual team;
The sensing device calculates motion information about a ball to be moved by the user as the user dispenses a ball, and calculates movement information of the ball using the motion information of the ball, Calculating a position and transmitting the calculated position to the control device; And
Determining whether or not the screen arrival position is located within the shot area indicated on the image, and proceeding with a baseball game or baseball game according to the determination result,
Wherein the displaying of the at least one dispatch area comprises:
Wherein the control device calculates a valid time at which the virtual runner or virtual batter can be out by throwing,
The control device includes a step of implementing an image so that the indicated dispatch area is lit up during the calculated valid time or implementing an image to display a predetermined display or a progress of the valid time during the calculated valid time in the displayed dispatch area Wherein the virtual baseball game device is a virtual baseball game device. A virtual baseball game control method by an experiential virtual baseball game device in which a user can perform a baseball practice or a baseball game with a virtual player on an image based on a virtual baseball image projected on a screen,
The control device for implementing the image for the baseball practice or the baseball game includes a step of implementing an image of a virtual team attacking the team defended by the user;
The control device displays at least one dispatch area for guiding the ball throwing of the user on the image in accordance with the attack of the virtual team;
The sensing device calculates motion information about a ball to be moved by the user as the user dispenses a ball, and calculates movement information of the ball using the motion information of the ball, Calculating a position and transmitting the calculated position to the control device; And
Determining whether or not the screen arrival position is located within the shot area indicated on the image, and proceeding with a baseball game or baseball game according to the determination result,
The control device stores in advance the information about the main power of the virtual runner or the virtual batter,
Wherein the displaying of the at least one dispatch area comprises:
And the control device determines and sets a time limit for the user's throw-in in the throw-in area displayed on the video based on the information about the main force of the virtual runner or the virtual batter,
The baseball game or the baseball game according to the determination result may include:
A step of implementing an image such that a virtual runner or a virtual batter is safed when the ball dispatched by the user reaches the throw-in area after the time limit has elapsed;
A virtual runner or a virtual batter is out of sight when the ball dispatched by the user to the throw-in area reaches the time limit before the time limit elapses; Wherein the virtual baseball game device comprises a virtual baseball game device for realizing an image such that the virtual runner or the virtual batter is out or safe according to a result of the simulation according to the simulation result. 10. The method of claim 9,
Wherein the control device previously stores information on the main force of the virtual runner or the virtual batter,
The control device calculates the effective time based on the information about the main power of the stored virtual runner or virtual batter so that the effective time can be determined according to the main power information for each virtual runner or virtual batter A virtual baseball game control method using an experiential virtual baseball game device. The method as claimed in claim 1, wherein the step of calculating and delivering the screen arrival position to the control device comprises:
Extracting a trigger area of a predetermined size at a predetermined position on the image for each of the images to be photographed;
Determining whether a ball is detected in the extracted trigger area,
Analyzing the image or the extracted trigger area to determine whether the ball progression direction is toward the screen when a ball is detected in the trigger area;
Generating a trigger for ball pitching analysis when the ball traveling direction is toward the screen;
And a step of calculating a ball motion model by the sensing device and a process of calculating the screen arrival position according to the occurrence of the trigger, . delete The method according to claim 1,
The experience virtual baseball game device is configured to be connected to a server via a network together with another experiential virtual baseball game device in which another user hits the ball fired from the ball pitching device, Data can be exchanged with each other,
Wherein the step of implementing an image of attack by the virtual team comprises:
A step in which sensing information on an operation or an action of the other user is transmitted from the other hands-on virtual baseball game device to the control device of the hands-based virtual baseball game device through the server;
And implementing the virtual play of the virtual team or the virtual batter based on the sensing information transmitted from the server by the control device A method of controlling a virtual baseball game. The method according to claim 1,
Wherein the hands-on virtual baseball game device is connected to a terminal that enables another user to operate the virtual player's game when the user is playing baseball practice or baseball game with the virtual player,
Wherein the step of implementing an image of attack by the virtual team comprises:
Controlling another player to manipulate the virtual player of the virtual team or the virtual batter by manipulating the terminal;
And a virtual baseball game control unit for implementing an imaginary baseball game apparatus in which a virtual runner of a virtual team or a virtual batter is played on the video in accordance with an operation of the terminal Way. An experiential virtual baseball game device that allows a user to baseball practice or baseball game with a virtual player on the basis of a virtual baseball image projected on a screen,
The method according to claim 1, further comprising: capturing an image of a ball being moved and dispatched by the user as the ball is dispatched; detecting coordinate data on a three-dimensional space on each image of the ball, A ball motion model for a ball being dispatched and exercised by the user by applying the detected ball coordinate data to a predefined function for ball motion in each of the predefined coordinate axes directions in a three- A sensing device for calculating a screen arrival position at which the ball reaches the screen using the calculated ball motion model; And
The game system according to any one of claims 1 to 3, further comprising: at least one dispatch area for implementing an image of a virtual team attacking a team defended by the user, A controller for determining whether or not a screen arrival position is located within the throwing area displayed on the video and proceeding with baseball practice or baseball game according to the determination result;
And a virtual baseball game device. 17. The control apparatus according to claim 16,
A second throwing area for guiding the throwing to the second throw, a third throwing area for guiding throwing to the third throw, a throwing action for guiding the throw to the hoop, And a control unit configured to set in advance each of a home area and a guard area guiding a guard against a lead by a virtual runner, wherein at least one of the plurality of areas is displayed on an image in accordance with an attack situation of the virtual team And the virtual baseball game device. 17. The method of claim 16,
The sensing device includes:
Calculates a screen arrival time, which is a time at which the ball dispatched by the user reaches the screen, using the ball motion model for the moving ball together with the screen arrival position, and transmits the calculated screen arrival time to the control device,
The control device includes:
Wherein when the screen arrival position is included in the specific dispatch area, the control device calculates a time at which the virtual player or the virtual batter reaches the lap routed by the virtual player and the offset time at the screen arrival time or the screen arrival time And the virtual virtual baseball game device is configured to implement an image so that the virtual virtual runner or the virtual batter is out or safe.

Images