JP2020014100A - Video system and video program - Google Patents

Abstract

To improve reality of a video displayed on a screen.SOLUTION: An imaging system 1 includes: forming means 40 for forming a screen by spraying a substance into a space; detecting means 42 for detecting positional information of a real object when the real object passes through the screen; generating means 66 for determining a position of a virtual object in a virtual space on the basis of the positional information detected by the detection means 42 to generate a video 14A including a virtual object arranged at the determined position; and control means 68 for controlling display of the video generated by the generation means 66 on the screen when the real object passes through the screen.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a video system and a video program.

  2. Description of the Related Art Conventionally, an image system that forms a screen with a substance such as a fluid and displays an image on the screen has been known (for example, see Patent Literature 1 and Patent Literature 2).

Japanese Patent Publication No. 7-60298 Japanese Utility Model Laid-Open No. 2-44731

  However, according to the techniques disclosed in Patent Documents 1 and 2, a viewer who views a video throws or moves a real object such as a ball toward a screen, and when the real object passes through the screen, the viewer is blocked by the screen. There is a problem in that it is difficult to visually recognize the real object, and the real object is not shown in the video, and the real object and the video have no continuity.

  The present invention has been made in view of such a problem, and an object of the present invention is to provide an image system that improves the reality of an image displayed on a screen.

  In order to solve the above-mentioned problems, an image system according to a first aspect of the present invention includes a forming unit that scatters a substance into a space to form a screen, and a position of the real object when the real object passes through the screen. Detecting means for detecting information; and generating a video that includes determining a position of the virtual object in a virtual space based on the position information detected by the detecting means, and generating an image including the virtual object disposed at the determined position. Means, and control means for controlling display of the image generated by the generation means on the screen when the real object passes through the screen.

  According to the first aspect, continuity can be provided between the position of the real object and the position of the virtual object. Therefore, according to the first aspect, the reality of the image displayed on the screen can be improved.

  ADVANTAGE OF THE INVENTION According to this invention, the reality of the image | video displayed on a screen can be improved.

It is a figure showing an example of the whole picture system composition concerning a first embodiment of the present invention. FIG. 2 is a diagram schematically illustrating an example of a hardware configuration of the terminal device illustrated in FIG. 1. It is a block diagram showing roughly an example of functional means of a picture system concerning a first embodiment of the present invention. It is a flow chart which shows a flow of processing of a picture system concerning a first embodiment of the present invention. (A) is a diagram showing a state of an image when a player hits a first real object (tennis ball) and the first real object is facing a screen. (B) is a diagram showing a state of a video or the like when the first real object passes through the screen, following (A). (C) is a diagram showing a state of a video and the like when the first real object is moving away from the screen, following from (B). (A) is a diagram showing, from (C), a state of an image or the like when the second real object ejected in response to the opponent character hitting the first virtual object is facing the screen. (B) is a diagram showing a state of a video and the like immediately before the second real object passes through the screen, following (A). (C) is a diagram showing a state of a video or the like when the second real object passes through the screen, following (B). FIG. 7 is a conceptual diagram showing a positional relationship between a battle character and a second virtual object in a virtual space and an actual ejection unit. It is a figure showing an example of the whole picture system composition concerning a second embodiment of the present invention. (A) is a diagram showing a state of a first virtual object when a player P swings down a katana as a first real object and a part of the katana passes through a screen. (B) is a diagram showing a state of the first virtual object when more than half of the first real object has passed through the screen, following FIG. (C) is a diagram showing a state where the artificial hand projects from the screen toward the player, following (B). (A) is a figure showing a picture situation when a player is playing a golf game. (B) is a figure showing a picture situation when a player is playing a baseball game. FIG. 14 is a diagram illustrating an example of an overall configuration of a video system according to a modification.

  Hereinafter, a plurality of embodiments of the present invention will be described with reference to the accompanying drawings. To facilitate understanding of the description, the same constituent elements and steps in each drawing are denoted by the same reference numerals as much as possible, and redundant description is omitted.

--- First embodiment ---
First, an image system according to the first embodiment of the present invention will be described. This image system relates to a system in which a substance is dispersed in space to form a screen and an image is displayed on the screen. The substance is not particularly limited as long as a real object can pass through the screen. Examples of the substance include fluids such as liquids and gases, paper chips, wood chips, powders such as sand, and light-emitting elements including LEDs and the like. Is mentioned. Also, the method of spraying is not particularly limited, but spraying by dropping or ejecting a substance, spraying by blowing on a substance, or spraying by applying external force such as magnetic force or static electricity to the substance. Is also good. Hereinafter, in the first embodiment, a case will be described in which the imaging system scatters by ejecting a fluid. Further, in the first embodiment, a case will be described in which the video displayed by the video system is a video related to a game, but may be another video, for example, a video related to a haunted house or an attraction.

<Overall configuration>
FIG. 1 is a diagram illustrating an example of an overall configuration of a video system 1 according to the first embodiment of the present invention.

  As shown in FIG. 1, the imaging system 1 according to the first embodiment includes a substance spraying device 10, a detection device 12, a projection device 14, an ejection device 16, a moving mechanism 18, a collection net 20, A hole 22, a resistance member 24, and a terminal device 30 are provided.

  The material spraying device 10 includes a nozzle, and sprays the material M (for example, a fluid such as water) supplied from a supply source (not shown) from the nozzle to a space below, thereby spraying the material M to the space and the screen 10A. Is an apparatus for forming

The detection device 12 is a device that detects position information and the like of the first real object O1. Examples of the detection device 12 include a position sensor and a camera. In the first embodiment, a case where the detection device 12 is a camera will be described. The first real object O1 is an object that is moved by the user of the video system 1 (the player P in the first embodiment). Examples of such a first real object O1 include a ball, a bullet, a sword, a staff, and the like. In the first embodiment, a case where the first real object O1 is a tennis ball that the player P moves (flies) by hitting with a racket will be described as an example.
The detection device 12 includes a first detection device 12A and a second detection device 12B. The first detection device 12A is a device that detects position information and the like of the first real object O1 when the first real object O1 passes through the screen 10A. The second detection device 12B detects position information and the like of the first real object O1 located in front of the screen 10A. Note that the “front side” means the player P side with respect to the screen 10A.
In addition, the detection device 12 detects, using the first detection device 12A and / or the second detection device 12B, direction information of the first real object O1 when passing through the screen 10A. Note that the terminal device 30 may detect the direction information of the first real object O1 based on the information detected from the detection device 12. Further, the detection device 12 may detect shape information and speed information of the first real object O1. The “direction information” includes not only the moving direction information of the first real object O1 but also the direction information of the first real object O1 in combination with the shape information of the first real object O1. You may go out.

  The projection device 14 is a device that projects an image 14A on a screen 10A configured by a projector or the like. The image 14A is an image obtained by projecting a virtual space in which the position of the player P is set as a viewpoint position as a two-dimensional image, and includes an opponent character C who is an opponent of the player P. The image 14A also includes a first virtual object O2 displayed after the first real object O1 has passed through the screen 10A. The first virtual object O2 may be related to the first real object O1 or may not be related to the first real object O1. However, from the viewpoint of maintaining continuity with the first real object O1, it is preferable that the first virtual object O2 imitates the first real object O1. Further, the first virtual object O2 may be of the same type as the first real object O1, or may be of a different type. When the type of the first virtual object O2 is different from the first real object O1, for example, the first real object O1 may be a tennis ball, and the first virtual object O2 may be a banana, a melon, a coconut, or the like. However, from the viewpoint of maintaining the continuity of the type with the first real object O1, the first virtual object O2 is preferably of the same type (ball in this case) as the first real object O1. Similarly, the first virtual object O2 may have the same shape as the first real object O1, or may have a different shape. However, from the viewpoint of maintaining the continuity of the shape with the first real object O1, the first virtual object O2 preferably has the same shape as the first real object O1. Further, the first virtual object O2 may be the same color as the first real object O1, or may be a different color. However, from the viewpoint of maintaining color continuity with the first real object O1, the first virtual object O2 is preferably of the same color as the first real object O1. Similarly, the first virtual object O2 may be related to the game provided to the player P, or may not be related to the game.

  The injection device 16 is a device that is provided in the depth direction of the screen 10A and emits a second real object that is the same as or different from the first real object O1 toward the front of the screen 10A. The second real object is, for example, a ball. In the first embodiment, the second real object is a tennis ball like the first real object O1. The depth direction is a side opposite to the player P with respect to the screen 10A, and means a destination of the first real object O1 moving from the player P toward the screen 10A. In other words, the depth direction means the side opposite to the side on which the video 14A is viewed.

  The moving mechanism 18 is a mechanism that moves the ejection device 16 to eject the second real object from an arbitrary position on the screen 10A. The moving mechanism 18 includes, for example, a rail and a driving unit. Further, not only the horizontal direction but also a vertical direction (not shown) may be used.

  The collection net 20 is a net that receives the first real object O1 flying in the depth direction of the screen 10A.

  The collection hole 22 is a hole for collecting the first real object O1 that has been received by the collection net 20 and has fallen. The collection hole 22 is connected to the moving mechanism 18 via a replenishing path (not shown), and the first real object O1 collected in the collection hole 22 is collected at one location through the moving mechanism 18 and injected there. The device 16 may be moved to replenish.

  The resistance member 24 is a member that protects the collection net 20 by resisting movement of the first real object O1 in the depth direction. Examples of the resistance member 24 include an elastic body such as rubber and a cushion, and a fiber.

  The terminal device 30 is connected to various devices such as the substance spraying device 10 described above, the detection device 12, the projection device 14, the injection device 16, and the moving mechanism 18, and performs control by giving information of various devices. It is an information processing device that acquires information from the device.

<Hardware configuration>
FIG. 2 is a diagram schematically showing an example of a hardware configuration of terminal device 30 shown in FIG.

  As shown in FIG. 2, the terminal device 30 includes a control device 32, a communication device 34, and a storage device 36. The control device 32 mainly includes a CPU (Central Processing Unit) 32A and a memory 32B.

  In the control device 32, the CPU 32A functions as various functional units by executing a predetermined program stored in the memory 32B or the storage device 36 or the like. Details of this functional means will be described later.

  The communication device 34 includes a communication interface for communicating with an external device. The communication device 34 is connected to various devices such as the substance dispersing device 10 described above, the detecting device 12, the projecting device 14, the ejecting device 16, and the moving mechanism 18, such as the detecting device 12, the ejecting device 16, and the moving mechanism. Various types of information are transmitted / received to / from the PC 18.

  The storage device 36 is configured by a hard disk or the like. The storage device 36 stores various programs and various types of information necessary for execution of processing in the control device 32, and information on processing results.

  The terminal device 30 can be realized by using an information processing device such as a dedicated or general-purpose server computer. Further, the terminal device 30 may be configured by a single information processing device or may be configured by a plurality of information processing devices distributed on a communication network. FIG. 2 shows only a part of the main hardware configuration of the terminal device 30. The terminal device 30 can have another configuration generally provided in a server. Also, the hardware configuration of the plurality of terminal devices 30 can have the same configuration as that of the terminal device 30 except that, for example, an operation device and a display device are provided.

<Functional means>
FIG. 3 is a block diagram schematically illustrating an example of functional units of the video system 1 according to the first embodiment.

  As shown in FIG. 3, the image system 1 includes a forming unit 40, a detecting unit 42, a projecting unit 44, an emitting unit 46, a moving unit 48, a resistance unit 50, and a collecting unit 40 outside the terminal device 30. It has functional means such as means 52. Further, the video system 1 includes functional units such as a storage unit 60, a game unit 62, a specifying unit 64, a generation unit 66, and a control unit 68 inside the terminal device 30. Note that a part of the detection unit 42 may be provided inside the terminal device 30.

  The forming means 40 is a functional means for forming one screen 10A by dispersing one kind of substance M in a space. Such a forming means 40 is realized by, for example, the above-described substance spraying device 10.

  The detecting means 42 is a functional means for detecting position information and direction information of the first real object O1 when the first real object O1 passes through the screen 10A. Further, the detecting unit 42 may detect at least one of the shape information, the speed information, the rotation speed information, and the rotation direction information of the first real object O1. Such detection means 42 is realized by, for example, the above-described detection device 12 or the detection device 12 and the CPU 32A.

  The projection unit 44 is a functional unit that projects the image 14A on the screen 10A. Such a projection unit 44 is realized by, for example, the projection device 14 described above.

  The ejection unit 46 is a functional unit that is provided in the depth direction of the screen 10A and that emits a second real object that is the same as or different from the first real object O1 toward the front of the screen 10A based on the progress of the game. For example, the ejection unit 46 ejects the second real object when the opponent character C has a serving right or when the opponent character C strikes back the first virtual object O2. Such an injection means 46 is realized by, for example, the injection device 16 described above.

  The moving unit 48 is a functional unit that moves the injection unit 46. In addition, the moving unit 48 may have a function of moving the injection unit 46 or may have a function of moving the resistance member 24 instead of moving the injection unit 46. Such moving means 48 is realized by, for example, the moving mechanism 18 described above.

  The resistance means 50 is a member that resists movement of the first real object O1 in the depth direction. Such a resistance means 50 is realized by the above-described resistance member 24. If the strength of the collection net 20 can be sufficiently secured, the resistance means 50 need not be provided.

  The collection unit 52 is a functional unit that collects the first real object O1 that has passed through the screen 10A. Such a collecting means 52 is realized by the collecting net 20, the collecting hole 22, and the like.

  The storage unit 60 is a functional unit that stores the video data 60A, the control parameters 60B, and the like. Such storage means 60 is realized by one or a plurality of storage devices 36. The video data 60A is video data for displaying the video 14A on the screen 10A. The control parameter 60B is a control parameter for controlling the forming unit 40, the detecting unit 42, the projecting unit 44, the emitting unit 46, the moving unit 48, and the like.

  The game unit 62 is a functional unit that progresses the game and provides it to the player P. In the first embodiment, the game means 62 proceeds with a tennis game. Such a game means 62 is realized by the control device 32 executing a program stored in the storage device 36 or the like, and mainly directly or indirectly detects the operation of the player P directly or indirectly. The game is advanced by operating the ejection means 46, the movement means 48, the projection means 44, and the like based on this.

  The specifying unit 64 is a functional unit that specifies the first real object O1 based on the shape information detected by the detecting unit 42. For example, the identification unit 64 compares the shape information detected by the detection unit 42 with shape data stored in advance in the storage unit 60 and associated with each of the plurality of pieces of identification information of the first real object. By acquiring the identification information corresponding to the shape data that matches the first real object O1, the first real object O1 is specified. Such a specifying unit 64 is realized by the control device 32 executing a program stored in the storage device 36 or the like. If the game provided by the game means 62 is limited to one game, such as a tennis game, the first real object O1 can be assumed to be a tennis ball, and the specifying means 64 can be largely omitted. is there.

The generation unit 66 determines the position of the first virtual object O2 in the virtual space based on the various information detected by the detection unit 42, and the first virtual object O2 and the opponent character C arranged at the determined position. This is a functional means for generating the video 14A including the image data and the like by appropriately using the video data 60A. Specifically, the generation unit 66 determines and determines a position substantially the same as the position indicated by the position information detected by the detection unit 42 as the position of the first virtual object O2 in the virtual space configuring the video 14A. An image 14A in a state where the first virtual object O2 is arranged at the position is generated.
Further, the generation unit 66 determines a moving direction of the first virtual object O2 in the virtual space based on the direction information detected by the detecting unit 42, and moves the first virtual object O2 along the determined moving direction. Let it. For example, the generation unit 66 determines the direction substantially the same as the direction indicated by the direction information detected by the detection unit 42 as the moving direction of the first virtual object O2, and moves the first virtual object O2 in the determined moving direction. Generate 14A.
Further, the generating unit 66 determines the moving speed of the first virtual object O2 based on the speed information detected by the detecting unit 42, and generates the image 14A that moves the first virtual object O2 in the virtual space at the determined moving speed. May be generated. For example, the generation unit 66 determines a speed substantially equal to the speed indicated by the speed information detected by the detection unit 42 as the speed of the first virtual object O2, and moves the first virtual object O2 in the virtual space at the determined speed. An image 14A to be generated may be generated. Further, the generation unit 66 may move the first virtual object O2 while decelerating over time.
In addition, the generation unit 66 determines the rotation speed or the rotation direction of the first virtual object O2 based on the rotation speed information or the rotation direction information of the first real object O1 detected by the detection unit 42, and determines the determined rotation speed or rotation. The image 14A including the first virtual object O2 rotating in the direction may be generated. For example, the generation unit 66 generates the image 14A including the first virtual object O2 that rotates in the virtual space at the rotation speed or the rotation direction substantially the same as the rotation speed or the rotation direction indicated by the rotation speed information or the rotation direction information. Is also good.
Further, the generation unit 66 may generate the image 14A of the first virtual object O2 related to the first real object O1 specified by the specification unit 64.

Further, the generation unit 66 determines the position of the second virtual object in the virtual space based on the control information (for example, the control parameter 60B) of the control unit 68 for the injection unit 46, and the second virtual object is located at the determined position. The control unit 68 controls the display of the image 14A including the second virtual object generated by the generation unit 66 on the screen 10A until the second real object passes through the screen 10A. .
Further, the generation unit 66 determines the direction and the speed of the second virtual object in the virtual space based on the control information (for example, the control parameter 60B) of the control unit 68 with respect to the injection unit 46, and determines the second direction and the speed in the determined direction and speed. The two virtual objects may be moved.
In addition, since the type of the second real object can be grasped in advance by the game provider, a second virtual object relating to the second real object is created in advance, and the generation unit 66 generates an image 14A including the second virtual object. May be generated.
Further, the generating means 66 generates the video 14A according to the progress of the game. For example, the generation unit 66 generates the video 14A that moves the opponent character C according to the progress of the game.
The generation unit 66 as described above is realized by the control device 32 executing a program stored in the storage device 36 or the like.

  The control unit 68 controls the forming unit 40, the detecting unit 42, the projecting unit 44, the emitting unit 46, the moving unit 48, and the like based on the control parameter 60B. For example, when the first real object O1 passes through the screen 10A, the control unit 68 controls the projection unit 44 at that timing, and displays the image 14A including the first virtual object O2 generated by the generation unit 66 on the screen 10A. Display (project). In other words, the control unit 68 controls the display of the image 14A including the first virtual object O2 generated by the generation unit 66 on the screen 10A. Such control means 68 is realized by the control device 32 executing a program stored in the storage device 36 or the like. Note that the control unit 68 continues to determine the position, direction, and speed of the first real object O1 in the virtual space even after the first real object O1 has passed through the screen 10A. Until moving away from the camera by more than a predetermined distance, the projection unit 44 may be controlled to display (project) the image 14A including the first virtual object O2 on the screen 10A.

Further, the control means 68 adjusts the control parameter 60B based on, for example, various information detected by the detection means 42, the ability of the opponent character C, the progress of the game, and the like, so that the ejection means 46 emits the second real object. Control the position, injection speed or injection direction. Further, the control means 68 may control the injection amount or the number of injections by adjusting the control parameter 60B.
Further, the control means 68 may control the amount of the substance M to be sprayed on the forming means 40 based on the position of the first real object O1. For example, in the tennis game, when the first real object O1 is located in front of the screen 10A in the tennis game, the control means 68 controls the amount of the substance M to be large so as to make the opponent character C visible, while controlling the first real object O1. When is located in the depth direction from the screen 10A, the amount of the substance M may be controlled to a small amount in order to make the first real object O1 visible. Conversely, when the first real object O1 is located in front of the screen 10A, the control means 68 controls the amount of the substance M to be small in order to concentrate the player P on the first real object O1, while controlling the first real object O1. When the body O1 is located in the depth direction from the screen 10A, the amount of the substance M may be controlled to be large in order to concentrate the player P on the image 14A.
Further, the control means 68 may control the amount of the substance M to be sprayed in the forming means 40 based on the progress of the game. For example, at the beginning of the game, the control means 68 controls the amount of the substance M to be small so as to give the player P a sense of entering the virtual world from the real world, and during the game, senses immersion in the virtual world. The amount of the substance M may be controlled to be large to give the player P, and the amount of the substance M may be controlled to be small at the end of the game so as to give the player P a feeling of returning from the virtual world to the real world.
The control means 68 as described above is realized by the control device 32 executing a program stored in the storage device 36 or the like. Note that, instead of controlling the amount of the substance M to be sprayed, the recovery net 20 is formed of a screen surface such as a cloth having a high strength, so that the substance M is sprayed in the game scene where the first real object O1 does not move. May be stopped, and the image 14A may be projected on the collection net 20 behind it. At this time, it is desirable that the resistance means 50 and the injection device 16 be moved out of the projection range of the image 14A.

<Process flow>
FIG. 4 is a flowchart illustrating a flow of processing of the video system 1 according to the first embodiment. In this process, the game means 62 starts the tennis game, the control means 68 controls the forming means 40 to spray the substance M into the space to form the screen 10A, and the control means 68 controls the projection means 44. The process is started by displaying the image 14A including the battle character C on the screen 10A.

  FIG. 5A is a diagram illustrating a state of the image 14A when the player P hits the first real object O1 (tennis ball) and the first real object O1 is flying toward the screen 10A. is there.

(Step SP10)
The game means 62 determines whether or not the detection means 42 has detected the first real object O1 (tennis ball) that has been hit by the player P in front of the screen 10A. When the determination is affirmative, the process proceeds to step SP12, and when the determination is negative, the process returns to step SP10.

(Step SP12)
The detecting means 42 detects the position information of the first real object O1 located in front of the screen 10A. Then, the process proceeds to the process of step SP14.

(Step SP14)
The game means 62 determines whether or not the detection means 42 has detected that the first real object O1 that has been skipped by the player P passes through the screen 10A. When the determination is affirmative, the process proceeds to step SP16, and when the determination is negative, the process returns to step SP14.

(Step SP16)
The detecting means 42 detects the position information of the first real object O1 when passing through the screen 10A. Then, the process proceeds to the process of step SP18.

(Step SP18)
The detecting means 42 detects direction information of the first real object O1 when passing through the screen 10A. In the first embodiment, the detecting means 42 detects at least two positions of the position information of the first real object O1 located in front of the screen 10A and the position information of the first real object O1 when passing through the screen 10A. Is acquired, and direction information is detected based on this. Then, the process proceeds to the process of step SP20.

(Step SP20)
The detecting means 42 detects speed information of the first real object O1 when passing through the screen 10A. In the first embodiment, the detection unit 42 acquires the position of the first real object O1 located in front of the screen 10A and the moving time to the position of the first real object O1 when passing through the screen 10A, Based on this, speed information is detected. Then, the process proceeds to the process of step SP22.

(Step SP22)
The generation unit 66 determines the position of the first virtual object O2 in the virtual space based on the position information detected by the detection unit 42, and generates the image 14A including the first virtual object O2 arranged at the determined position. Generate. Then, the control means 68 controls the display of the generated image 14A on the screen 10A when the first real object O1 passes through the screen 10A.

  FIG. 5B is a diagram showing a state of the image 14A and the like when the first real object O1 passes through the screen 10A, following FIG. 5A.

  As shown in FIG. 5B, the first real object O1 passes through the screen 10A and is blocked by the screen 10A and cannot be viewed from the player P. However, the first real object O1 is similar to the first real object O1. The virtual object O2 is displayed in the video 14A. Note that an effect 14B such as a flame or ice may be displayed around the first virtual object O2 according to the player P, specifically, according to the attribute and type of the player P. Further, the effect 14B may be displayed according to the moving direction and the moving speed.

  Returning to FIG. 4, the process proceeds to step SP24.

(Step SP24)
The generating unit 66 determines the speed and moving direction of the first virtual object O2 (tennis ball) based on the speed information and direction information of the first real object O1 detected by the detecting unit 42. Then, the process proceeds to the process of step SP26.

(Step SP26)
The generating unit 66 moves the first virtual object O2 in the video 14A along the determined speed and moving direction of the virtual object O. Accordingly, the first virtual object O2 displayed on the screen 10A moves.

  FIG. 5C is a diagram showing a state of the image 14A and the like when the first real object O1 is moving away from the screen 10A, following FIG. 5B.

  As shown in FIG. 5C, a state in which the first virtual object O2 is moving toward the opponent character C is displayed in the video 14A.

  Returning to FIG. 4, the process proceeds to step SP28.

(Step SP28)
The control means 68 controls the movement means 48 to move the resistance means 50 according to the progress of the game, the position of the first virtual object O2, the ability parameters of the character C, and the like. Here, in the tennis game, the resistance means 50 substitutes for a net, an obstacle, or the like. When the first real object O1 hits the resistance means 50, the resistance means 50 rebounds or falls down. If the size of the resistance means 50 is large (equivalent to the size of the screen 10A or the collection net 20), the resistance means 50 may not be moved. Then, the process proceeds to the process of step SP30.

(Step SP30)
The collecting means 52 collects the first real object O1 that has passed through the screen 10A. The game means 62 calculates the landing point of the first virtual object O2 based on the speed and the moving direction of the first virtual object O2 (tennis ball), the position of the resistance means 50, and the like. Then, the process proceeds to the process of step SP32.

(Step SP32)
The game means 62 determines whether or not one game out of one set has been determined based on the landing point of the first virtual object O2. When the determination is affirmative, the process proceeds to step SP34, and when the determination is negative, the process proceeds to step SP40.

(Step SP34)
The game means 62 adds the score of the player P or the score of the opponent character C according to the result of the win or loss. Then, the process proceeds to the process of step SP36.

(Step SP36)
The game means 62 determines whether or not the match (tennis game) has ended based on the score of the player P and the score of the opponent character C. Then, when the determination is affirmative, the series of processes illustrated in FIG. 4 ends, and when the determination is negative, the process proceeds to step SP38.

(Step SP38)
The game means 62 determines whether to change the serving right based on the score of the player P and the score of the opponent character C. When the determination is affirmative, the process proceeds to step SP40, and when the determination is negative, the process returns to step SP10.

(Step SP40)
In step SP32, when the opponent character C strikes back the first virtual object O2 (tennis ball) and the game is continued, the control means 68 controls the injection means 46 to direct the first character to the front of the screen 10A. A second real object similar to one real object O1 is emitted. Here, the control means 68 may control the injection position, the injection speed, or the injection direction of the second real object by the injection means 46 based on the position information, speed information, direction information, and the like detected by the detection means 42. . Further, the control unit 68 may control the position, speed or direction of the second real object by the injection unit 46 based on the ability of the battle character C.
Note that the calculated distance from the position at which the opponent character C hits back the first virtual object O2 in the virtual space to the screen surface in the viewpoint direction and the actual distance from the ejection means 46 located behind the screen 10A to the screen 10A. Distances are different. For this reason, as shown in FIG. 7, for example, the emission position and direction of the second real object O4 by the emission means 46 are different from those of the second virtual object O3 defined as the object in which the first virtual object O2 is hit back in the virtual space. A position on the calculated movement trajectory L where the actual distance position from the injection means 46 to the screen 10A is equal to the calculated distance between the second virtual object O2 and the screen surface in the virtual space. The control unit 68 controls the injection unit 46 so that the direction is the injection position and the injection direction. Further, the control means 68 controls the emission means 46 such that the timing when the second virtual object O2 reaches this position in the virtual space is the emission timing. Note that an effect 14C such as a star may be displayed around the second virtual object O3 according to the opponent character C, specifically, according to the attribute and type of the opponent character C. Then, the process proceeds to the process of step SP42.

(Step SP42)
The generating unit 66 generates an image 14A including the second virtual object O3 related to the second real object O4 emitted from the emitting unit 46. At this time, the generation unit 66 determines the position in the virtual space of the second virtual object O3 in the video 14A based on the emission position and the emission direction of the second real object O4 by the emission unit 46. Subsequently, the control unit 68 controls the display of the image 14A including the second virtual object O3 generated by the generation unit 66 on the screen 10A using the projection unit 44 until the second real object passes through the screen 10A. . Note that the second virtual object O3 may be the same as or different from the first virtual object O2. However, from the viewpoint of maintaining continuity, the second virtual object O3 is preferably the same as the first virtual object O2.

  FIG. 6A is a continuation of FIG. 5C, showing an image 14A when the second real object O4 ejected in response to the opponent character C hitting the first virtual object O2 faces the screen 10A. FIG.

  As shown in FIG. 6A, the second real object O4 is located in the depth direction with respect to the screen 10A, and therefore cannot be visually recognized by the player P. Instead, the second virtual object O4 is similar to the second real object O4. The object O3 is displayed in the video 14A.

  Returning to FIG. 4, the process proceeds to step SP44.

(Step SP44)
The generation unit 66 moves the second virtual object O3 in the video 14A toward the screen 10A based on the ejection speed and the like detected by the detection unit 42. Along with this, the second virtual object O3 displayed on the screen 10A moves.

  FIG. 6B is a diagram showing a state of the image 14A and the like immediately before the second real object O4 passes through the screen 10A, following FIG. 6A.

  As shown in FIG. 6B, a state in which the second virtual object O3 is moving toward the player P is displayed in the video 14A.

  Returning to FIG. 4, the process proceeds to step SP46.

(Step SP46)
The game means 62 determines whether or not the detection means 42 has detected that the second real object O4 passes through the screen 10A. When the determination is affirmative, the process proceeds to step SP48, and when the determination is negative, the process returns to step SP46.

(Step SP48)
The control means 68 deletes the display of the second virtual object O3 from the video 14A.

  FIG. 6C is a diagram showing a state of the image 14A and the like when the second real object O4 passes through the screen 10A, following FIG. 6B.

  As shown in FIG. 6C, when the second real object O4 passes through the screen 10A, the display of the second virtual object O3 disappears from the image 14A, and instead, the second real object O4 jumps out of the screen 10A. And can be visually recognized by the player P. At this time, the force from the second real object O4 may act to cause the substance M to scatter toward the front.

  Returning to FIG. 4, the process proceeds to step SP50.

(Step SP50)
The game means 62 determines whether or not the player P has hit back the second real object O4 based on the position information and the like of the second real object O4 detected by the detection means 42, thereby performing one game of one set. It is determined whether or not winning or losing is determined. Specifically, when the player P does not return the second real object O4, the game means 62 makes an affirmative determination that the winning or losing is determined, and when the player P returns the second real object O4, the winning or losing is determined. A negative determination is made that the determination has not been made. If the determination is affirmative, the process proceeds to step SP52, and if the determination is negative, the process returns to step SP10. When the second real object O4 is hit back, the second real object O4 is regarded as the first real object O1, and the processing after step SP10 is performed.

(Step SP52)
The game means 62 adds the score of the player P or the score of the opponent character C according to the result of the win or loss. Then, the process proceeds to step SP54.

(Step SP54)
The game means 62 determines whether or not the match (tennis game) has ended based on the score of the player P and the score of the opponent character C. Then, when the determination is affirmative, the series of processes illustrated in FIG. 4 ends, and when the determination is negative, the process proceeds to step SP56.

(Step SP56)
The game means 62 determines whether to change the serving right based on the score of the player P and the score of the opponent character C. When the determination is affirmative, the process returns to step SP40, and when the determination is negative, the process returns to step SP10. However, when the serving right has been changed in step SP38, the above determination is reversed. That is, in such a case, if the determination is affirmative, the process returns to step SP10, and if the determination is negative, the process returns to step SP40.

<Effect>
As described above, in the first embodiment, the imaging system 1 includes the forming unit 40 that scatters the substance M into the space to form the screen 10A, and the first real object O1 when the first real object O1 passes through the screen 10A. A position of the virtual object O2 in the virtual space is determined based on the position information detected by the detection unit 42, and an image including the virtual object O1 arranged at the determined position. A generating unit 66 for generating 14A and a control unit 68 for controlling the display of the image 14A generated by the generating unit 66 on the screen 10A when the first real object O1 passes through the screen 10A.

  According to this configuration, continuity can be provided between the position of the first real object O1 and the position of the first virtual object O2. Therefore, according to the first embodiment, the reality of the video 14A displayed on the screen 10A can be improved.

  Further, in the first embodiment, the detecting unit 42 further detects the first real object O1 and / or speed information when passing through the screen 10A, and the generating unit 66 further detects the information detected by the detecting unit 42. Based on this, the first virtual object O2 in the image 14A is moved.

  According to this configuration, continuity can be provided between the direction of the first real object O1 and the moving direction of the first virtual object O2. Therefore, according to the first embodiment, the reality of the image 14A displayed on the screen 10A can be further improved. According to this configuration, continuity can be provided between the speed of the first real object O1 and the speed of the first virtual object O2. Therefore, according to the first embodiment, the reality of the image 14A displayed on the screen 10A can be further improved.

  In the first embodiment, the detecting unit 42 further detects rotation speed information and / or rotation direction information of the first real object O1, and the generating unit 66 generates an image 14A based on the information detected by the detecting unit 42. Is rotated in the first virtual object O2.

  According to this configuration, continuity can be provided between the rotation speed and / or rotation direction of the first real object O1 and the rotation speed and / or rotation direction of the first virtual object O2. Therefore, according to the first embodiment, the reality of the image 14A displayed on the screen 10A can be further improved.

  In the first embodiment, the detecting unit 42 further detects the shape information of the first real object O1, and further includes the specifying unit 64 that specifies the first real object O1 based on the shape information detected by the detecting unit 42. The generating unit 66 generates, as the image 14A, an image of the virtual object O2 related to the first real object O1 specified by the specifying unit 64.

  According to this configuration, continuity can be provided between the type of the first real object O1 and the type of the first virtual object O2. Therefore, according to the first embodiment, the reality of the image 14A displayed on the screen 10A can be further improved.

  In the first embodiment, the apparatus further includes a collecting unit 52 that collects the first real object O1 that has passed through the screen 10A.

  According to this configuration, it is possible to save the trouble of collecting the first real object O1.

  Further, in the first embodiment, an emission unit 46 is provided in the depth direction of the screen 10A and emits the second real object O4 toward the front of the screen 10A.

  According to this configuration, since the second real object O4 protrudes from the screen 10A, the player P can be surprised and enjoyed. Further, according to this configuration, since the player P can hit back the second real object O4 that has jumped out, the tennis game can be continued.

  In the first embodiment, the control unit 68 controls at least one of the injection position, the injection speed, and the injection direction of the second real object O4 by the injection unit 46.

  According to this configuration, for example, according to the progress of the game, at least one of the ejection position, the ejection speed, and the ejection direction of the second real object O4 can be controlled.

  In the first embodiment, the control unit 68 controls at least one of the ejection position, the ejection speed, and the ejection direction of the second real object O4 based on at least the information detected by the detection unit 42.

  According to this configuration, continuity can be provided between the first real object O1 and the second real object O4. Therefore, according to the first embodiment, the reality of the game can be improved.

  In the first embodiment, the generation unit 66 determines the position of the second virtual object O3 in the virtual space based on the control information (control parameter 60B) of the control unit 68 for the injection unit 46, and determines the determined position. Generates a video 14A in a state where the second virtual object O3 is arranged, and the control means 68 controls the video including the second virtual object O3 generated by the generation means 66 until the second real object O4 passes through the screen 10A. 14A is displayed on the screen 10A.

  According to this configuration, continuity can be provided between the position of the second real object O4 and the position of the second virtual object O3. Therefore, according to the first embodiment, the reality of the image 14A displayed on the screen 10A can be further improved.

  In the first embodiment, the game device further includes a game unit 62 that progresses the game, and the generation unit 66 generates the video 14A according to the progress of the game.

  According to this configuration, since the video 14A corresponds to the progress of the game, the reality of the video 14A displayed on the screen 10A can be further improved.

  In the first embodiment, the control unit 68 controls the amount of the substance M to be sprayed on the forming unit 40 based on the progress of the game.

  According to this configuration, based on the progress of the game, the screen 10A and the image 14A of various atmospheres can be shown to the player P, and thus the interest of the game can be enhanced.

--- Second embodiment ---
Next, an image system according to a second embodiment of the present invention will be described. The second embodiment is different from the first embodiment in that the game is a fighting game and that the game device further includes a projecting unit. Other configurations of the video system according to the second embodiment are the same as the configurations of the video system 1 according to the first embodiment.

  FIG. 8 is a diagram illustrating an example of the overall configuration of a video system 1A according to the second embodiment of the present invention.

As shown in FIG. 8, the video system 1 </ b> A has a configuration similar to that of the first embodiment, and further includes a projecting unit 80. The projecting means 80 is provided in the depth direction of the screen 10A, and projects an object, for example, a game object relating to the game, from the screen 10A toward the near side based on the progress of the game. Examples of the game object include an artificial face, feet, and hands, as well as insects, water, blood, and the like. When the game object is assumed to be a fluid such as water or blood, the projecting means 80 may be a blower that blows the material M and projects the material M from the screen 10A instead of the game object. .
In the second embodiment, since the game is a fighting game, for example, the player P is holding a katana as the first real object O1. In addition, a samurai, a zombie, or the like is displayed on the video 14A as the battle character C. In this case, for example, the protruding means 80 protrudes the game object when the player P defeats the opponent character C, protrudes the game object when the player P stabs the opponent character C with katakana, Protruding game objects when clearing the game.

  FIG. 9A is a diagram illustrating a state of the first virtual object O2 when the player P swings down the katana as the first real object O1 and a part of the katana passes through the screen 10A.

  As shown in FIG. 9A, the rear end and the center of the first real object O1 can be visually recognized by the player P as it is, and the front end of the first real object O1 can be visually recognized by the player P as the first virtual object O2. It is. Therefore, continuity can be provided between the first real object O1 and the first virtual object O2. Therefore, according to the second embodiment, the reality of the image 14A displayed on the screen 10A can be further improved. Here, in the case where the opponent character C is cut or guarded by a sword, the control means 68 moves the resistance means 50 to the movement destination of the first real object O1 in order to feed back the sense to the sword. It may be controlled. In this case, the first real object O1 is resisted by the resistance means 50, and the player P can feel as if the opponent character C is actually guarding.

  FIG. 9B is a diagram showing a state of the first virtual object O2 when at least half of the first real object O1 passes through the screen 10A, following FIG. 9A.

  As shown in FIG. 9B, the rear end of the first real object O1 is directly visible to the player P, and the front end and the center of the first real object O1 are visually recognized to the player P as the first virtual object O2. It is possible. In the video 14A, the blood B spouted from the opponent character C is displayed after the tip of the first real object O1 pierces the opponent character C. The blood B may be expressed not only by an image but also by the projecting means 80 blowing the substance M to project the substance M from the screen 10A.

  FIG. 9C is a diagram illustrating a state where the artificial hand H projects from the screen 10A toward the player P, following FIG. 9B.

  As shown in FIG. 9C, when the opponent character C is defeated and the game proceeds, the projecting means 80 projects the game object H (artificial hand) from the screen 10A.

  As described above, in the second embodiment, the image system 1A includes the forming unit 40 that forms the screen 10A by dispersing the substance M in the space, the control unit 68 that controls the display of the image 14A on the screen, and views the image 14A. When the opposite side is defined as the depth direction, a projection means 80 is provided in the depth direction of the screen 10A and projects the game object H from the screen 10A in the front direction.

  According to this configuration, since the game object H projects from the screen 10A, the player P can be surprised and enjoyed. Further, it is possible to give the player P a powerful force that cannot be realized only by the image 14A.

−−− Modifications −−−
Note that the present invention is not limited to the above specific examples. That is, those in which a person skilled in the art appropriately changes the design to the above specific examples are also included in the scope of the present invention as long as they have the features of the present invention. In addition, each element included in the above-described embodiment and a modified example described later can be combined as far as technically possible, and a combination of these elements is included in the scope of the present invention as long as it includes the features of the present invention. .

  For example, in the first embodiment, the case where the forming unit 40 sprays one type of the substance M has been described, but a plurality of types of the substance M may be sprayed. Further, the control means 68 may change the type of the substance M to be sprayed by the forming means 40 according to the progress of the game. For example, the control means 68 changes the substance M to water when the game field is rainy, changes the substance M to paper when the game field is snowy, and changes the substance M to sand when the game field is sunny. May be. Further, the forming means 40 may spray the substance M of a plurality of colors. For example, the forming unit 40 may spray a red-colored fluid, a blue-colored fluid, or a green-colored fluid as the substance M according to the progress of the game.

  In the first embodiment, the case where the game is a tennis game is described, and in the second embodiment, the case where the game is a fighting game is described. However, the game is a golf game, a baseball game, an action game, a gun game, or the like. It may be shooting or the like.

  FIG. 10A is a diagram illustrating a state of the image 14A when the player P is playing the golf game. In this case, the first virtual object O2 is a golf ball. FIG. 10B is a diagram illustrating a state of the video 14A when the player P is playing the baseball game. In this case, the first virtual object O2 is a baseball. In the case of baseball, the opponent character C becomes a pitcher, the ball thrown by the pitcher becomes the second virtual object O2, and the second real object O4 jumps out from the screen 10A toward the player P. At this time, the position, timing, pitch, and the like of the pitcher throwing the ball are determined by the game program or the operation instruction of the opponent player. Therefore, the emission position and direction of the second real object by the emission unit 46 are on the calculated movement trajectory of the second virtual object O2, and are different from the actual distance position from the emission unit 46 to the screen 10A in the virtual space. The control means 68 controls the emission means 46 so that the position and direction at which the calculated distance between the second virtual object O2 and the screen surface coincides with the emission position and the emission direction. Further, the control means 68 controls the emission means 46 such that the timing when the second virtual object O2 reaches this position in the virtual space is the emission timing.

  Further, in the first embodiment, the case where the player P plays the game alone has been described. However, remote players may play the same game.

  FIG. 11 is a diagram illustrating an example of the overall configuration of a video system 1B according to a modification.

  As shown in FIG. 11, the video system 1B includes a plurality of video systems 1 and a server device 90. The plurality of video systems 1 include, for example, the video system 1 on the player P1 side and the video system 1 on the player P2 side. The control means 68 of the terminal device 30A of the one video system 1, the control means 68 of the terminal device 30B of the other video system 1, and the server device 90 communicate with each other via a communication network NT such as an intranet or the Internet. Connected as possible.

  The terminal device 30A and the terminal device 30B are located in locations remote from each other, and provide the same game. Then, the control unit 68 of the terminal device 30A transmits the information detected by the detection unit 42 to the terminal device 30B via the server device 30. Similarly, the control unit 68 of the terminal device 30B transmits the information detected by the detection unit 42 to the terminal device 30A via the server device 30. Thereby, for example, position information and speed information of the first real object O1 when the player P1 throws the first real object O1 (baseball ball) and passes through the screen 10A are transmitted from the terminal device 30A to the terminal device 30B. You. Then, the terminal device 30B controls the injection position, the injection speed, or the injection direction of the second real object O4 by the injection means 46 based on the received information. According to this configuration, for example, it is possible to play against the famous player P1 in a remote place in a form closer to reality.

  Also, the control unit 68 has described the case where the display of the image 14A is controlled when the first real object O1 passes through the screen 10A. However, when the first real object O1 passes through the screen 10A, the control unit 68 produces a sound effect. The output may be controlled. When the first real object O1 passes through the screen 10A, it may be difficult for the player P to hear the sound of the first real object O1. Therefore, the detecting means 42 further detects the sound of the first real object O1 when the first real object O1 passes through the screen 10A, and the generating means 66 generates a sound effect based on the detected sound, and performs control. The means 68 may control the output of the generated sound effect when the first real object O1 passes through the screen 10A.

  Further, the detecting means 42 may detect the head direction information of the player P, and the control means 68 may change the image 14A to be displayed and controlled according to the head direction information.

  Further, if the first real object O1 is held by hand, such as katana, a vibration member may be provided on the first real object O1. In this case, the control means 68 may control the vibration of the vibration member when the first real object O1 passes through the screen 10A, when the opponent character C is cut, or when the opponent character C is defeated.

  Further, a light emitting member may be provided on the first real object O1. In this case, the control means 68 may control the light emission of the light emitting member when the first real object O1 passes through the screen 10A, when the opponent character C is cut, or when the opponent character C is defeated.

  In addition, as the game progresses, a cooling member may be newly provided for injecting a cooling gas to the material M forming the screen 10A to freeze the material M. This makes it possible to give the player P an exhilaration when the opponent character C is cut.

  The forming unit 40 may form two or more screens 10A in the depth direction, and the control unit 68 may control the display of different images 14A on each screen 10A. In this case, the player P can enjoy various combinations of the images 14A of each screen 10A.

1, 1A, 1B ... video system 10A ... screen 40 ... forming means 42 ... detecting means 66 ... generating means 68 ... control means

Claims (12)

Forming means for spraying a substance into a space to form a screen;
Detection means for detecting position information of the real object when the real object passes through the screen,
Based on the position information detected by the detection means, determine the position of the virtual object in the virtual space, generating means for generating an image including the virtual object placed at the determined position,
When the real object passes through the screen, control means for controlling the display of the image generated by the generation means on the screen,
An image system comprising: The detecting means further detects direction information and / or speed information of the real object when passing through the screen,
The generating unit further moves the virtual object in the video based on the information detected by the detecting unit,
The video system according to claim 1. The detecting means further detects rotation speed information and / or rotation direction information of the real object,
The generating unit rotates the virtual object in the video based on the information detected by the detecting unit.
The video system according to claim 1. The detecting means further detects shape information of the real object,
The apparatus further includes a specifying unit that specifies the real object based on the shape information detected by the detection unit,
The generating means generates an image of the virtual object related to the specified real object as the image,
The video system according to claim 1. Collection means for collecting the real object that has passed through the screen,
The video system according to any one of claims 1 to 4, further comprising: When the real object is the first real object and the destination of the real object is the depth direction,
An emission unit that is provided in a depth direction of the screen and emits a second real object that is the same as or different from the first real object, toward the front of the screen.
The video system according to any one of claims 1 to 5, further comprising: The control means controls at least one of an injection position, an injection speed, and an injection direction of the second real object by the injection means,
The video system according to claim 6. The control unit controls at least one of an ejection position, an ejection speed, and an ejection direction of the second real object based on at least information detected by the detection unit.
The video system according to claim 7. When the virtual object is a first virtual object,
The generation unit determines a position of the second virtual object in the virtual space based on control information of the control unit with respect to the emission unit, and displays an image of a state where the second virtual object is arranged at the determined position. Generate
The control unit controls display of an image including the second virtual object generated by the generation unit on the screen until the second real object passes through the screen,
The video system according to claim 7. A terminal device located at a location remote from the location where the detection means is provided;
A server device capable of communicating with the control unit and the terminal device,
Further comprising
The control unit transmits information detected by the detection unit to the terminal device via the server device.
The video system according to claim 1. Forming means for spraying a substance into a space to form a screen;
Control means for controlling the display of an image on the screen,
Projection means provided in the depth direction of the screen and projecting an object from the screen in the front direction, when the opposite side to the side on which the image is viewed is defined as the depth direction,
An image system comprising: A computer connectable to detection means for detecting position information of the real object when the real object passes through a screen formed by scattering a substance in space,
Generating means for determining a position of the virtual object in the virtual space based on the position information detected by the detecting means, and generating an image including the virtual object arranged at the determined position;
Control means for controlling display of the image generated by the generation means on the screen when the real object passes through the screen;
Video program to function as.

Images