JP2022086371A - Projection control device and projection control method - Google Patents

Abstract

To improve the visibility of moving objects in watching competitions.SOLUTION: A projection control device includes: a video acquisition unit that acquires game video obtained by shooting the state of a game on the court from an imaging device; an object detection unit that detects an object from the game video; a position detection unit that detects a position of the object on the court based on the game video and the object; a speed calculation unit that calculates speed of the object based on the position of the object; an image generation unit that generates a projection image including a movement trajectory of the object based on the position of the object and the speed of the object; and a projection control unit that controls a projection device so as to project the projection image on the court.SELECTED DRAWING: Figure 3

Description

The present invention relates to a projection control device and a projection control method.

Conventionally, when watching a ball game such as badminton, a technique for not losing sight of the shuttle has been known. For example, Patent Document 1 discloses a technique for improving the visibility of a shuttle by causing the shuttle to emit light.

Japanese Unexamined Patent Publication No. 2001-87438

By the way, badminton is a popular sport and is also used as a professional sport. The professional badminton smash reaches 500 km / h, making it difficult for the audience to see with the naked eye. In order to enjoy watching badminton games by professional players, a technique for improving the visibility of the shuttle during the game is desired.

An object of the present invention is to provide a projection control device and a projection control method capable of improving the visibility of a moving object in watching a competition.

The projection control device according to the present invention includes a video acquisition unit that acquires a game image of a game on a court from an image pickup device, an object detection unit that detects an object from the game video, and the game video and the object. Based on, a position detection unit that detects the position of the object on the court, a speed calculation unit that calculates the speed of the object based on the position of the object, the position of the object, and the speed of the object. Based on this, it includes an image generation unit that generates a projection image including a movement locus of the object, and a projection control unit that controls a projection device so that the projection image is projected onto the coat.

The projection control method according to the present invention is based on a step of acquiring a game image of a game on a court from an image pickup device, a step of detecting an object from the game video, and the game video and the object. A step of detecting the position of the object on the court, a speed calculation unit for calculating the speed of the object based on the position of the object, the position of the object, and the speed of the object. It includes a step of generating a projection image including a movement locus, and a step of controlling a projection device to project the projection image onto the coat.

According to the present invention, it is possible to improve the visibility of a moving object when watching a competition.

FIG. 1 is a diagram for explaining a configuration example of a projection system according to the first embodiment. FIG. 2 is a diagram for explaining a configuration example of the projection system according to the first embodiment. FIG. 3 is a block diagram showing a configuration example of the control device according to the first embodiment. FIG. 4 is a flowchart showing an example of the processing flow of the control device according to the first embodiment. FIG. 5 is a diagram for explaining a method of generating a projected image showing the movement locus of the shuttle. FIG. 6 is a diagram for explaining a method of reflecting the height of the shuttle in the projected image. FIG. 7 is a diagram for explaining a method of projecting a projected image. FIG. 8 is a diagram for explaining a method of projecting a projected image. FIG. 9 is a diagram for explaining the processing of the projection system according to the second embodiment. FIG. 10 is a diagram for explaining a configuration example of the projection system according to the third embodiment. FIG. 11 is a block diagram showing a configuration example of the control device according to the third embodiment. FIG. 12 is a flowchart showing an example of the processing flow of the control device according to the third embodiment. FIG. 13 is a flowchart showing an example of the processing flow of the control device according to the modified example of the third embodiment. FIG. 14 is a flowchart showing an example of the processing flow of the control device according to the fourth embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The present invention is not limited to the embodiments described below.

[First Embodiment]
A configuration example of the projection system according to the first embodiment will be described with reference to FIGS. 1 and 2. 1 and 2 are diagrams for explaining a configuration example of the projection system according to the first embodiment.

As shown in FIGS. 1 and 2, the projection system 10 includes an image pickup device 12, a projection device 14, and a control device 16. In the present embodiment, the case where the projection system 10 improves the visibility of the shuttle S in watching a badminton game will be described as an example. In this case, the player P1, the player P2, and the shuttle S are included on the court C.

The game is not limited to badminton, and may be other ball games such as tennis, table tennis, volleyball, soccer, and baseball. Further, the game may be a sport played only outdoors such as golf.

The image pickup apparatus 12 takes an image of the entire coat C. The image pickup device 12 captures the state of the badminton game. The image pickup apparatus 12 has, for example, a zoom function, a pan function, and a tilt function. For example, one image pickup apparatus 12 is provided on the upper part of the coat C. A plurality of image pickup devices 12 may be provided.

The projection device 14 projects a projection image on the coat C. The projection device 14 projects a projection image regarding the trajectory of the shuttle S onto the coat C. For example, a plurality of projection devices 14 are provided around the coat C. In the example shown in FIG. 1, the number of projection devices 14 is "8", but this is not a limitation of the present invention. The number of projection devices 14 may be more or less than "8". The place where the projection device 14 shown in FIG. 1 is arranged is an example and does not limit the present invention. The projection device 14 may be arranged so that a projected image can be projected at each point on the court C.

The control device 16 controls the image pickup device 12 and the projection device 14. The control device 16 controls the image pickup device 12 to image a badminton game. The control device 16 acquires an image of a badminton game from the image pickup device 12. The control device 16 controls the projection device 14 to project the projected image onto the coat C. The control device 16 generates a projected image corresponding to the badminton game image acquired from the image pickup device 12, and projects the generated projected image onto the court C.

Specifically, as shown in FIG. 2, the control device 16 detects the shuttle S used in the badminton game from the image captured by the image pickup device 12. The control device 16 detects the position of the shuttle S, the moving speed, and the height. The control device 16 controls the projection device 14 to project the projected light L at the position where the shuttle S is detected, thereby drawing a projected image showing the movement trajectory of the shuttle S on the coat C.

[Control device configuration]
The configuration of the control device according to the first embodiment will be described with reference to FIG. FIG. 3 is a block diagram showing a configuration example of the control device according to the first embodiment.

As shown in FIG. 3, the control device 16 includes an input unit 20, a display unit 22, a storage unit 24, a communication unit 26, and a control unit (projection control device) 28.

The input unit 20 is an input device that receives various operations on the control device. The input unit 20 is realized by, for example, a button, a switch, a touch panel, or the like.

The display unit 22 displays various information. The display unit 22 is a display including, for example, a liquid crystal display (LCD) or an organic EL (Electro-Luminescence) display.

The storage unit 24 is a memory that stores various information such as calculation contents and programs of the control unit 28, and is, for example, a RAM (Random Access Memory), a main storage device such as a ROM (Read Only Memory), and an HDD (HDD). Includes at least one of external storage devices such as Hard Disk Drive).

The communication unit 26 communicates between the control device 16 and the external device. The communication unit 26 communicates between the control device 16 and the image pickup device 12, for example. The communication unit 26 communicates between the control device 16 and the projection device 14, for example.

The control unit 28 controls the operation of each unit of the projection system 10. The control unit 28 is realized by, for example, using a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like to execute a program stored in the storage unit 24 using a RAM or the like as a work area. The control unit 28 is a computer that operates the program according to the present invention. The control unit 28 may be realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 28 may be realized by a combination of hardware and software.

The control unit 28 includes a video acquisition unit 30, an object detection unit 32, a position detection unit 34, a speed detection unit 36, a height detection unit 38, an image generation unit 40, a projection control unit 42, and communication control. A unit 44 is provided.

The video acquisition unit 30 acquires video. The image acquisition unit 30 acquires, for example, the image captured by the image pickup device 12 via the communication unit 26. The image acquisition unit 30 acquires, for example, an image of a sports game captured by the image pickup device 12. The image acquisition unit 30 acquires, for example, an image of a badminton game from the image pickup device 12.

The object detection unit 32 detects an object from the image acquired by the image acquisition unit 30. The object detection unit 32 detects an object from the video acquired by the video acquisition unit 30, for example, using dictionary data (not shown) stored in the storage unit 24. In the present embodiment, the object detection unit 32 detects, for example, the shuttle S used in badminton as an object. The object detection unit 32 detects a player from, for example, an image of a badminton game.

The position detection unit 34 detects the position of the object included in the image acquired by the image acquisition unit 30. The position detection unit 34 detects the position of an object included in the image acquired by the image acquisition unit 30 based on the image acquired by the image acquisition unit 30.

The speed detection unit 36 detects the speed of an object included in the video acquired by the video acquisition unit 30. The speed detection unit 36 detects the speed of an object included in the video acquired by the video acquisition unit 30 based on the video acquired by the video acquisition unit 30.

The height detection unit 38 detects the height of the object included in the image acquired by the image acquisition unit 30 from the ground (floor surface). The height detection unit 38 detects the height of the object included in the image acquired by the image acquisition unit 30 from the ground based on the image acquired by the image acquisition unit 30.

The image generation unit 40 generates a projected image. The image generation unit 40 generates a projection image based on the calculation results of the position detection unit 34, the speed detection unit 36, and the height detection unit 38, for example.

The projection control unit 42 controls the projection device 14 to project a projected image. The projection control unit 42 controls the projection device 14 to project the projection image generated by the image generation unit 40.

The communication control unit 44 controls the communication unit 26 to control the communication between the control device 16 and the external device. The communication control unit 44 controls the communication unit 26 to control the communication between the control device 16 and the image pickup device 12. The communication control unit 44 controls the communication unit 26 to control the communication between the control device 16 and the projection device 14.

[Processing content]
A flow of processing of the control device according to the first embodiment will be described with reference to FIG. FIG. 4 is a flowchart showing an example of the processing flow of the control device according to the first embodiment.

First, the control unit 28 acquires an image (step S10). Specifically, the image acquisition unit 30 acquires, for example, an image of a badminton game as shown in FIG. 1 captured by the image pickup device 12 from the image pickup device 12. Then, the process proceeds to step S12.

The control unit 28 detects the shuttle S (step S12). Specifically, the object detection unit 32 performs object recognition processing on the video acquired by the video acquisition unit 30, using dictionary data (not shown) stored in the storage unit 24, and detects the shuttle S. Then, the process proceeds to step S14.

The control unit 28 detects the position of the shuttle S (step S14). Specifically, the position detection unit 34 detects the position of the shuttle S detected by the object detection unit 32 in the image of the coat C acquired by the image acquisition unit 30, for example. Then, the process proceeds to step S16.

The control unit 28 detects the speed of the shuttle S (step S16). Specifically, the speed detection unit 36 calculates, for example, the moving distance of the shuttle S based on the position of the shuttle S detected by the position detection unit 34 for each frame of the image acquired by the image acquisition unit 30. , Detects the speed of the shuttle S. Then, the process proceeds to step S18.

The control unit 28 detects the height of the shuttle S from the ground (step S18). Specifically, the height detection unit 38 detects the height of the shuttle S from the ground based on, for example, the height of the net N on the court C acquired by the image acquisition unit 30. More specifically, the height detection unit 38 compares, for example, the net N in which the height in the image acquired by the image acquisition unit 30 is constant with the size in the image of the shuttle S, so that the height detection unit 38 of the shuttle S can be used. Detect height. Then, the process proceeds to step S20.

The control unit 28 generates a projected image (step S20). Specifically, the image generation unit 40 generates a projection image showing the movement trajectory of the shuttle S, for example, based on the position detected by the position detection unit 34 and the speed of the shuttle S detected by the speed detection unit 36. do. For example, the image generation unit 40 may reflect the height of the shuttle S detected by the height detection unit 38 in the projected image showing the trajectory of the shuttle S.

A method of generating a projected image will be described with reference to FIGS. 5 and 6. FIG. 5 is a diagram for explaining a method of generating a projected image showing the movement locus of the shuttle S. FIG. 6 is a diagram for explaining a method of reflecting the height of the shuttle S in the projected image.

As shown in FIG. 5, it is assumed that the shuttle S located at the point 52 moves to the point 54 after t seconds. In this case, when the moving speed of the shuttle S from the point 52 to the point 54 is v [m / s], the moving locus tr1 is vt [m]. The image generation unit 40 generates a projection image showing the movement trajectory of the shuttle S at each point on the court C, so that, for example, the projection from the time when the player P1 hits the shuttle S back to the time when the player P2 reaches the court. Generate an image. The projection control unit 42 controls the projection device 14 to project the projection light L from the point 52 to the point 54, thereby drawing a projection image showing the movement locus tr1 on the coat C.

As shown in FIG. 6, in the present embodiment, the height of the shuttle S is based on the height of the net N, and has three areas of area AR1, area AR2, and area AR3 according to the height from the ground. It is divided into. The height of the net N is, for example, h = 1.55 [m].

Area AR1 is, for example, a range in which the height from the ground is 0 [m] or more and less than 0.725 [m]. That is, the area AR1 is in a range where the height from the ground is 0 [m] or more and less than half the height of the net N. Area AR2 is, for example, a range in which the height from the ground is 0.725 [m] or more and less than 2.275 [m]. That is, the area AR2 is in a range in which the height from the ground is at least half the height of the net N and less than 1.5 times the height of the net N. Area AR3 is, for example, in a range where the height from the ground is 2.275 [m] or more. That is, the area AR3 is in a range where the height from the ground is 1.5 times or more the height of the net N.

When the height of the shuttle S from the ground is within the range of the area AR1, the image generation unit 40 generates, for example, a red projected image. When the height of the shuttle S from the ground is within the range of the area AR2, the image generation unit 40 generates, for example, a green projected image. When the height of the shuttle S from the ground is within the range of the area AR3, the image generation unit 40 generates, for example, a blue projection image.

Return to FIG. After step S20, the control unit 28 projects a projected image (step S22). Specifically, the projection control unit 42 controls the projection device 14 to project the projection image generated in step S20 onto the coat C.

A method of projecting a projected image will be described with reference to FIGS. 7 and 8. 7 and 8 are diagrams for explaining a method of projecting a projected image.

FIG. 7 shows how player P1 and player P2 are playing a match on court C of badminton. For example, suppose player P1 hits Shuttle S back from point 56 to point 58. In this case, the image generation unit 40 generates a projection image IM1 for projecting from the point 56 to the range of the point 58. The image generation unit 40, for example, generates a projected image IM1 with the same color throughout. The projection control unit 42 controls the projection device 14 to project a projection image IM1 showing the movement locus of the shuttle S from the point 56 to the point 58 on the coat C. The projected image IM1 is, for example, an image that has a tail like a meteor. That is, the projected image IM1 is an image in which the width gradually increases from the position of the hitting point of the shuttle S toward the reaching point. The projected image IM1 is an image visible to the audience of the badminton game and the viewer watching the badminton game on television.

As shown in FIG. 8, the image generation unit 40 may generate a projected image IM1A whose color is changed according to the height of the shuttle S. The projected image IM1A has a region R1, a region R2, and a region R3. The height of the shuttle S from the ground is different in the area R1, the area R2, and the area R3. Therefore, the colors of the region R1, the region R2, and the region R3 are different from each other. For example, the region R1 is blue, the region R2 is green, and the region R3 is red. The projection control unit 42 controls the projection device 14 to project the projection image IM1A having different colors in the regions R1, the region R2, and the region R3 on the coat C.

Return to FIG. After step S22, the control unit 28 determines whether or not the match is continuing (step S24). For example, the object detection unit 32 determines that the match is continuing when the movement of the shuttle S is produced between the player P1 and the player P2. If it is determined that the match is continuing (step S24; Yes), the process proceeds to step S10. If it is not determined that the match is continuing (step S24; No), the process of FIG. 4 ends.

As described above, in the first embodiment, in the badminton game, a projected image showing the movement trajectory of the shuttle S is projected on the court C. In the first embodiment, a spectator watching a game at a badminton game venue and a viewer watching a game on a television or the like can grasp the position of the shuttle S and the trajectory of the shuttle S. In the first embodiment, the visibility of the badminton game can be improved, so that the user can enjoy watching the badminton game.

[Second Embodiment]
The processing of the projection system according to the second embodiment will be described with reference to FIG. 9. FIG. 9 is a diagram for explaining the processing of the projection system according to the second embodiment. Since the configuration of the projection system 10 according to the second embodiment is the same as the configuration of the projection system 10 shown in FIGS. 1 to 3, the description thereof will be omitted.

In the second embodiment, the control device 16 controls the projection device 14 to project two projection images, the current shot and the previous shot, onto the coat C.

As shown in FIG. 9, for example, it is assumed that the player P1 hits the shuttle S and the player P2 hits the shuttle S back. In this case, the image generation unit 40 generates the projected image IM1 based on the moving trajectory of the shuttle S struck by the player P1. The image generation unit 40 generates the projected image IM2 based on the moving trajectory of the shuttle S hit back by the player P2.

The projection control unit 42 controls the projection device 14 to project the projection image IM1 onto the coat C. The projection control unit 42 controls the projection device 14 in a state where the projection image IM1 is projected onto the coat C to project the projection image IM2 onto the coat C. That is, the projection control unit 42 projects two projection images, the projection image IM1 and the projection image IM2, on the coat C.

The projected image IM1 and the projected image IM2 are images that have a tail like a meteor, respectively. That is, the projected image IM1 and the projected image IM2 are images in which the width gradually increases from the position of the hitting point of the shuttle S toward the reaching point. As a result, since the projected image IM1 and the projected image IM2 are images showing the traveling direction of the shuttle S, an image showing the movement locus of the shuttle S struck by either the player P1 or the player P2. It is an image that can be grasped.

As described above, in the second embodiment, in a badminton game, two projection images, a projection image showing the movement locus of the shuttle S of the current shot and a projection image showing the movement locus of the shuttle S of the previous shot. Is projected onto the coat C. Thereby, in the second embodiment, since the projection image showing the state of the rally between the player P1 and the player P2 can be projected, the visibility of the badminton game can be further improved.

[Third Embodiment]
A configuration example of the projection system according to the third embodiment will be described with reference to FIG. 10. FIG. 10 is a diagram for explaining a configuration example of the projection system according to the third embodiment.

As shown in FIG. 10, the projection system 10A according to the third embodiment includes an image pickup device 12, a projection device 14, and a control device 16A.

In the third embodiment, the control device 16A determines the positional relationship between the athlete P1 or the athlete P2 and the shuttle S. When the control device 16A controls the projection device 14 to project the projection image onto the court C, the projection image is lacking because the projection light L is blocked by the athlete P1 and the athlete P2 among the plurality of projection devices 14. A projection device 14 capable of projecting a projection image is selected so as not to occur. That is, the control device 16A selects a projection device 14 capable of projecting a projection image so as not to interfere with the athlete P1 and the athlete P2. The control device 16A controls the selected projection device 14 to project a projection image on the coat C.

[Control device]
The configuration of the control device according to the third embodiment will be described with reference to FIG. FIG. 11 is a block diagram showing a configuration example of the control device according to the third embodiment.

As shown in FIG. 11, the control device 16A is different from the control device 16 shown in FIG. 3 in that the control unit 28A includes the projection device selection unit 46.

The object detection unit 32a detects the athlete P1, the athlete P2, and the shuttle S. The object detection unit 32a detects the player P1, the player P2, and the shuttle S by using, for example, the dictionary data stored in the storage unit 24. The object detection unit 32a determines the positional relationship between the detected athlete P1, the athlete P2, and the shuttle S. The object detection unit 32a determines the positional relationship between the detected athlete P1, the athlete P2, the shuttle S, and the projection device 14.

The projection device selection unit 46 selects the projection device 14 used for projecting the projected image from the plurality of projection devices 14. The projection device selection unit 46 is, for example, a projection device used to project a projection image based on the determination result of the positional relationship between the athlete P1, the athlete P2, the shuttle S, and the projection device 14 by the object detection unit 32a. Select 14.

[Processing content]
The processing content of the control device according to the third embodiment will be described with reference to FIG. FIG. 12 is a flowchart showing an example of the processing flow of the control device according to the third embodiment.

Since the processing from step S30 to step S40 is the same as the processing from step S10 to step S20, the description thereof will be omitted.

After step S40, the control unit 28A determines the positional relationship between the player P1, the player P2, and the shuttle S (step S42). Specifically, the object detection unit 32a performs object recognition processing on the image acquired by the image acquisition unit 30 using dictionary data (not shown) stored in the storage unit 24, whereby the player P1 and the player The positional relationship between P2 and the shuttle S is determined. Then, the process proceeds to step S44.

The control unit 28A selects the projection device 14 (step S44). Specifically, the projection device selection unit 46 has the player P1 and the player P2 based on the positional relationship between the player P1 determined by the object detection unit 32a, the player P2, and the shuttle S among the plurality of projection devices 14. Select a projection device 14 capable of projecting a projection image so as not to interfere with the above. Then, the process proceeds to step S46.

Since the processing of step S46 and step S48 is the same as the processing of step S22 and step S24 shown in FIG. 4, the description thereof will be omitted.

As described above, in the third embodiment, the projection device 14 is switched according to the positional relationship between the player P1, the player P2, and the shuttle S to project a projected image. Thereby, in the third embodiment, the projected image can be appropriately projected on the court so as not to interfere with the player P1 and the player P2.

[Modified example of the third embodiment]
Next, a modification of the third embodiment will be described.

In the modified example of the third embodiment, the timing of projecting the projected image is controlled so as not to interfere with the player P1 and the player P2 according to the positional relationship between the player P1 and the player P2 and the shuttle S. It differs from the third embodiment in that an image is projected. Since the configuration of the control device according to the modified example of the third embodiment is the same as the configuration of the control device 16A shown in FIG. 11, the description thereof will be omitted.

[Processing content]
With reference to FIG. 13, the processing content of the control device according to the modified example of the third embodiment will be described. FIG. 13 is a flowchart showing an example of the processing flow of the control device according to the modified example of the third embodiment.

Since the processing from step S50 to step S62 is the same as the processing from step S30 to step S42 shown in FIG. 12, the description thereof will be omitted.

After step S62, the timing of projecting the projected image is adjusted (step S64). Specifically, the projection control unit 42 displays a projection image so as not to interfere with the player P1 and the player P2 based on the positional relationship between the player P1 determined by the object detection unit 32a, the player P2, and the shuttle S. Adjust the projection timing. For example, the projection control unit 42 controls the projection device 14 so as to delay the timing and project the projection image when it is determined that the projection of the projection image interferes with the athlete P1 and the athlete P2. Then, the process proceeds to step S66.

Since the processing of step S66 and step S68 is the same as the processing of step S22 and step S24 shown in FIG. 4, the description thereof will be omitted.

As described above, in the modified example of the third embodiment, the timing of projecting the projected image is adjusted according to the positional relationship between the player P1, the player P2, and the shuttle S. Thereby, in the modified example of the third embodiment, the projected image can be appropriately projected on the court so as not to interfere with the player P1 and the player P2.

[Fourth Embodiment]
Next, the fourth embodiment will be described.

The fourth embodiment determines whether or not the player P1 or the player P2 has scored a point on the shot. In the fourth embodiment, when it is determined that the player P1 or the player P2 has scored a point, the projected image of the shot is emphasized and generated, and the projected image is projected on the court C. Since the configuration of the control device according to the fourth embodiment is the same as the configuration of the control device 16 shown in FIG. 3, the description thereof will be omitted.

[Processing content]
The processing content of the control device according to the fourth embodiment will be described with reference to FIG. FIG. 14 is a flowchart showing an example of the processing flow of the control device according to the fourth embodiment.

Since the processes of steps S70 to S78 are the same as the processes of steps S10 to S18 shown in FIG. 4, the description thereof will be omitted.

After step S78, the control unit 28 determines whether or not a point has been entered (step S80). For example, after the player P1 or the player P2 hits the shuttle S, when the height detection unit 38 determines that the height of the shuttle S is the same as the ground, it is determined that a point has been entered. Further, for example, when the object detection unit 32 detects that the shuttle S is caught in the net N, it determines that the point has been entered. If it is determined that no points have been entered (step S80; No), the process proceeds to step S82. If it is determined that a point has been entered (step S80; Yes), the process proceeds to step S86.

Since the processing of step S82 and step S84 is the same as the processing of step S22 and step S24 shown in FIG. 4, respectively, the description thereof will be omitted.

If it is determined to be Yes in step S80, the control unit 28 generates an emphasized projected image (step S86). Specifically, the image generation unit 40 generates a projection image that is emphasized more than the projection image when no point is included. The image generation unit 40 performs, for example, an effect process for applying an effect to a projected image. The image generation unit 40 performs effect processing, for example, to generate a projection image having a plurality of colors, to project a projection image whose color changes with the passage of time, or to generate a projection image that blinks. Or something. The image generation unit 40 may generate a projected image to which other effects are applied. Then, the process proceeds to step S88.

The control unit 28 projects the emphasized projection image (step S86). Specifically, the projection control unit 42 controls the projection device 14 to project the projection image to which the effect generated in step S86 is applied on the coat C. Then, the process proceeds to step S90.

Since the process of step S90 is the same as the process of step S24 shown in FIG. 4, the description thereof will be omitted.

As described above, in the fourth embodiment, when a point is entered in a badminton game, a projected image emphasizing the movement trajectory of the shuttle S of the shot in which the point is entered is projected.
As a result, in the fourth embodiment, the spectators watching the game at the badminton game venue and the viewers watching the game on TV or the like grasp that points have been scored by a fast shot such as a smash. be able to. As a result, the fourth embodiment can improve the visibility of the badminton game, so that the user can enjoy watching the badminton game more.

Although the embodiments of the present invention have been described above, the present invention is not limited to the contents of these embodiments. Further, the above-mentioned components include those that can be easily assumed by those skilled in the art, those that are substantially the same, that is, those in a so-called equal range. Further, the above-mentioned components can be combined as appropriate. Further, various omissions, replacements or changes of the components can be made without departing from the gist of the above-described embodiment.

10 Projection system 12 Imaging device 14 Projection device 16 Control device 20 Input unit 22 Display unit 24 Storage unit 26 Communication unit 28 Control unit 30 Image acquisition unit 32 Object detection unit 34 Position detection unit 36 Speed detection unit 38 Height detection unit 40 Image Generation unit 42 Projection control unit 44 Communication control unit 46 Projection device selection unit

Claims (5)

An image acquisition unit that acquires a match image of a match on the court from an image pickup device,
An object detection unit that detects an object from the game video,
A position detection unit that detects the position of the object on the court based on the game image and the object.
A speed calculation unit that calculates the speed of the object based on the position of the object,
An image generation unit that generates a projection image including a movement trajectory of the object based on the position of the object and the speed of the object.
A projection control unit that controls the projection device so that the projection image is projected onto the coat.
A projection control device. A height calculation unit for calculating the height of the object based on the game video is provided.
The image generation unit generates the projected image according to the height of the object.
The projection control device according to claim 1. The object detection unit detects the positional relationship between the object and the player on the court, and determines the positional relationship between the object and the player on the court.
The projection control unit can control a plurality of projection devices, and can project the projected image according to the positional relationship between the object and the player on the court so as not to chip the projected image. Select from the plurality of projection devices, control the selected projection device, and project the projection image onto the coat.
The projection control device according to claim 1 or 2. The game video is a badminton game video,
The object is a badminton shuttle,
The projection control device according to any one of claims 1 to 3. The step of acquiring the game image that captured the state of the game on the court from the image pickup device,
The step of detecting an object from the match video and
A step of detecting the position of the object on the court based on the game image and the object,
A speed calculation unit that calculates the speed of the object based on the position of the object,
A step of generating a projection image including a movement trajectory of the object based on the position of the object and the velocity of the object.
A step of controlling the projection device to project the projected image onto the coat,
Projection control methods, including.

Images