WO2018199115A1 - Production control device, direction system, and program - Google Patents

Abstract

In the present invention, an acquisition means acquires detection information which indicates a physical quantity detected by a detection device in a location related to an event. A determination means determines the production effect for content based on the detection information acquired by the acquisition means. A production control means controls a production device in accordance with the production effect determined by the determination means, and causes the production effect to be provided.

Description

Production control device, production system, and program

The present invention relates to a technique for producing an event.

The technology to improve the satisfaction of the event audience is known. For example, Patent Document 1 describes a technique in which a video stream obtained from a camera that captures a live sports event is transmitted to a portable electronic device of a spectator and displayed on the display.

Japan Special Table 2009-503922

However, with the technique described in Patent Document 1, it is only possible to see the situation of the player on the video, and lacks a sense of reality. On the other hand, in recent years, there is a case where an effect using a medium such as sound, light, and video is performed in order to excite the event. However, the conventional performance is performed regardless of the player's play and the audience's reaction performed at the event, and there is no contrivance for enhancing the sense of presence of the event.
An object of this invention is to provide the production effect which raises the realistic feeling of an event.

The present invention provides an acquisition unit that acquires detection information indicating a physical quantity detected by a detection device at a place related to an event, and a determination unit that determines an effect of content based on the detection information acquired by the acquisition unit. An effect control device is provided that includes an effect control means for controlling the effect device in accordance with the effect effect determined by the determining means and providing the effect effect.

The production control device further includes a specifying unit that specifies the status of the event based on the detection information acquired by the acquiring unit, and the determining unit is configured to add the event status specified by the specifying unit to the event status. A corresponding production effect may be determined.

The event situation may include a play performed by a player in the event.

The production control device further includes a generation unit that generates a sound signal based on the detection information when the production effect using sound is determined by the determination unit, and the production control unit is generated by the generation unit. The sound signal may be supplied to a speaker, and a sound corresponding to the sound signal may be output from the speaker.

The detection device includes a microphone that collects sound emitted in the event, the detection information includes a sound signal indicating the sound collected by the microphone, and the generation means is included in the detection information The sound signal may be subjected to sound processing, and the effect control means may supply the sound signal subjected to the sound processing to the speaker.

The detection device includes a motion detection device that detects a motion of a player of the event, the detection information indicates the motion detected by the motion detection device, and the generation means is indicated by the detection information. A sound signal corresponding to the movement may be generated.

The detection device includes a biological sensor that measures biological information of the player of the event, the detection information includes the biological information measured by the biological sensor, and the generation unit is included in the detection information A sound signal corresponding to the biological information may be generated.

The acquisition unit may further acquire progress information indicating the progress of the event, and the determination unit may determine the effect based on the detection information and the progress information acquired by the acquisition unit. Good.

The determining means determines a plurality of different presentation effects for a plurality of spectators or a plurality of spectator groups watching the event, and the presentation control means is a plurality corresponding to the plurality of spectators or the plurality of spectator groups. The effect device may be controlled to provide each of the plurality of effect devices with the effect determined for the audience or group of spectators to which the effect device corresponds among the plurality of effect effects.

The effect may be an effect using sound, light, vibration, or an image.

In addition, the present invention provides a detection device that detects a physical quantity at a place related to an event, an effect device that provides an effect of the event, and an acquisition unit that acquires detection information indicating the physical quantity detected by the detection device. Determining means for determining the effect of the content based on the detection information acquired by the acquisition means; and controlling the effect device according to the effect determined by the determining means to provide the effect There is provided an effect system including an effect control means.

Further, the present invention is a step of acquiring detection information indicating a physical quantity detected by a detection device at a location related to an event in a computer, and determining a presentation effect of contents based on the acquired detection information; A program for controlling an effect device according to the determined effect and executing the step of providing the effect is provided.

According to the present invention, it is possible to provide a production effect that enhances the presence of an event.

The figure which shows an example of a structure of the production system 1 which concerns on 1st Embodiment. The figure which shows an example of the audience seat 50. FIG. The figure which shows an example of the ball | bowl 60 used by the game of a basket, and the wearable terminal 70 with which a player wears. The figure which shows an example of the wearable terminal 80 with which a spectator wears. The figure which shows an example of the hardware constitutions of the server apparatus. The figure which shows an example of the function structure of the production system 1. FIG. The sequence chart which shows an example of operation | movement of the production system 1. The figure which shows an example of the production database 111. FIG. The figure which shows an example of the sound effect 120 corresponding to the motion of a shooter and the ball | bowl 60. FIG. The figure which shows an example of the display apparatus 28 which concerns on a modification.

First Embodiment Configuration FIG. 1 is a diagram illustrating an example of a configuration of an effect system 1 according to a first embodiment. The production system 1 produces an event. This event may be, for example, various sports matches, concerts, or plays. Here, it is assumed that the event is a basketball game.

The place where the event takes place is composed of the field 2 and the auditorium area 3. Field 2 includes a coat 4. On the court 4, a player plays a basketball game. A plurality of spectator seats 50 are provided in the spectator seat area 3. In the spectator seat area 3, the spectators watch the game.

In the place where the event is performed, a plurality of sound collecting devices 11, a plurality of vibration detecting devices 12, a plurality of photographing devices 13, a plurality of sound emitting devices 21, a plurality of light emitting devices 22, and a projection device 23 are provided. Is provided. In addition, the number and position of these apparatuses shown in FIG. 1 are illustrations, and the number and position of these apparatuses are not limited to the number illustrated in FIG.

The plurality of sound collecting devices 11 are provided at positions where the player's play sounds can be collected. For example, the plurality of sound collecting devices 11 may be provided around the coat 4 in the field 2. Alternatively, the plurality of sound collecting devices 11 may be embedded in the coat 4. Each sound collection device 11 collects sound at a predetermined time interval. Each sound collection device 11 has a microphone, for example.

The plurality of vibration detection devices 12 are provided at positions where vibrations generated by the player's play can be detected. For example, the plurality of vibration detection devices 12 may be embedded in the coat 4. Each vibration detection device 12 detects vibration at a predetermined interval. Each vibration detection device 12 includes, for example, a vibration sensor.

The plurality of photographing devices 13 are provided at positions where the player's play can be photographed. Each photographing device 13 photographs a video. Each photographing device 13 has a digital video camera, for example.

The plurality of sound emitting devices 21 are provided at positions where the sound output from these sound emitting devices 21 can be heard by the audience. For example, the plurality of sound emitting devices 21 may be provided between the passages in the auditorium area 3 or between the auditoriums 50. Each sound emitting device 21 outputs a sound corresponding to the sound signal. Each sound emitting device 21 has a speaker, for example. This speaker may be a directional speaker.

The plurality of light emitting devices 22 are provided at positions where light emitted from these light emitting devices 22 is visible to the player, the audience, or both the athlete and the audience. For example, the plurality of light emitting devices 22 may be provided between the passage in the spectator seat area 3 or between the spectator seats 50. Each light emitting device 22 emits light according to the light emission control signal. Each light emitting device 22 has, for example, an LED (Light Emitting Diode).

Projection device 23 is provided at a position where a video can be projected to a player, a spectator, or a position visible to both the player and the spectator. The projection device 23 projects an image corresponding to the image signal onto the projection surface. The projection device 23 includes, for example, a projector. This projection surface may be, for example, the field 2, the coat 4, or the ceiling.

FIG. 2 is a diagram illustrating an example of the spectator seat 50. The auditorium 50 is provided with a sound emitting device 24 similar to the sound emitting device 21 described above and a vibration device 25. Note that the spectator seat 50 may not necessarily be provided with all of these devices. For example, only one of the sound emitting device 24 and the vibration device 25 may be provided in the spectator seat 50. Further, these devices may not be provided in all the spectator seats 50. For example, these devices may be provided only in some spectator seats 50.

The vibration device 25 is provided at a position where vibration can be given to the audience. For example, the vibration device 25 is provided behind the seat surface of the spectator seat 50. The vibration device 25 vibrates according to the vibration control signal. The vibration device 25 has, for example, a vibration motor.

FIG. 3 is a diagram illustrating an example of a ball 60 used in a basket game and a wearable terminal 70 worn by a player. The ball 60 incorporates the motion detection device 14. The motion detection device 14 detects the motion of the ball 60. The motion detection device 14 includes, for example, an acceleration sensor.

The wearable terminal 70 is, for example, a wristwatch type terminal worn by a player. However, the wearable terminal 70 may have other shapes as long as the shape is wearable by the player. The wearable terminal 70 includes a sound collection device 15 similar to the sound collection device 11 described above, and a biological sensor 16. Note that the wearable terminal 70 is not necessarily provided with all of these devices. For example, only one of the sound collection device 15 and the biological sensor 16 may be provided in the wearable terminal 70.

The biosensor 16 measures the player's biometric information at predetermined time intervals. This biological information may be, for example, heart rate, pulse rate, body temperature, or blood pressure. For example, when the biological information is a heart rate, the biological sensor 16 includes a heart rate meter that measures the heart rate.

FIG. 4 is a diagram illustrating an example of a wearable terminal 80 worn by a spectator. The wearable terminal 80 is, for example, a wristwatch type terminal worn by a spectator. However, the wearable terminal 80 may have other shapes as long as it can be worn by the audience. The wearable terminal 80 includes a sound collecting device 17 similar to the sound collecting device 11 described above, a sound emitting device 26 similar to the sound emitting device 21 described above, and a light emitting device 27 similar to the light emitting device 22 described above. Note that the wearable terminal 80 is not necessarily provided with all of these devices. For example, only one or two of the sound collecting device 17, the sound emitting device 26, and the light emitting device 27 may be provided in the wearable terminal 80. Further, the wearable terminal 80 may be provided with a vibration device similar to the vibration device 25 described above.

In the following description, the above-described sound collection devices 11, 15, and 17, the vibration detection device 12, the imaging device 13, the motion detection device 14, and the biological sensor 16 are collectively referred to as “detection device 10”. To tell. In addition, the sound emitting devices 21, 24, and 26, the light emitting devices 22 and 27, the projection device 23, and the vibration device 25 are collectively referred to as the “production device 20”.

Each device included in the detection device 10 and the rendering device 20 has a communication interface, and is connected to the server device 30 via the communication line 40 as shown in FIG. Each communication interface performs data communication with the server device 30 via the communication line 40. Individual devices included in the detection device 10 and the rendering device 20 may be connected to the communication line 40 wirelessly or may be connected by wire. The communication line 40 transmits data between the individual devices included in the detection device 10 and the server device 30, and between the individual devices included in the rendering device 20 and the server device 30. The communication line 40 may be constituted by, for example, a wireless communication network and a private network such as a LAN (Local Area Network), and may further include the Internet.

FIG. 5 is a diagram illustrating an example of a hardware configuration of the server device 30. The server device 30 includes a processor 31, a memory 32, a communication interface 33, and a storage 34. These devices are connected via a bus 35 for transmitting data.

The processor 31 executes various processes by reading the program into the memory 32 and executing it. As the processor 31, for example, a CPU (Central Processing Unit) may be used. The memory 32 stores a program executed by the processor 31. As the memory 32, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), or a combination thereof may be used. The communication interface 33 performs data communication with individual devices included in the detection device 10 and the rendering device 20 via the communication line 40. The storage 34 stores various data and programs. As the storage 34, for example, a hard disk, a flash memory, or a combination thereof may be used.

FIG. 6 is a diagram illustrating an example of a functional configuration of the production system 1. The production system 1 functions as the acquisition unit 101, the identification unit 102, the determination unit 103, the generation unit 104, and the production control unit 105. In this example, all of these functions are implemented in the server device 30. Specifically, these functions are realized by the cooperation of a program stored in the memory 32 and a processor 31 that executes the program. In this case, the server device 30 functions as an effect control device.

The acquisition unit 101 acquires detection information indicating a physical quantity detected by the detection device 10 at a place where an event is performed. This physical quantity relates to at least one of sound, vibration, video, motion, and biological information. Note that the concept of the term “acquisition” includes reception.

The specifying unit 102 specifies the event status based on the detection information acquired by the acquiring unit 101. The status of this event includes play played by the players.

The determining unit 103 determines the effect of the content based on the detection information acquired by the acquiring unit 101. For example, the determining unit 103 determines the effect of the content based on the detection information related to the play specified by the specifying unit 102. This effect is an effect using at least one of sound, light, vibration, and video. That is, this effect may be an effect felt by at least one of auditory, visual, and tactile sensations.

The generating unit 104 generates a sound signal based on the detection information acquired by the acquiring unit 101 when the effect using the sound is determined by the determining unit 103. For example, the generation unit 104 may generate a sound signal by performing sound processing on the sound signal. This sound processing may be, for example, processing for processing a sound signal, or processing for synthesizing two or more sound signals. This processing includes amplification. The sound signal used for the sound processing may be included in the detection information, for example, or may be stored in the storage 34 in advance. As another example, the generation unit 104 may generate a sound signal using a sound source.

The production control unit 105 controls the production device 20 according to the production effect determined by the determination unit 103 and provides the production effect. The production device 20 provides an event production effect. This control is performed, for example, by transmitting control information for controlling the presentation effect. When the effect using sound is determined by the determining unit 103, the control information includes the sound signal generated by the generating unit 104.

Operation FIG. 7 is a sequence chart showing an example of the operation of the rendering system 1. This operation is started at a predetermined timing, such as at the start of an event.

In step S101, the detection apparatus 10 detects a physical quantity at a place where an event is performed. For example, the plurality of sound collection devices 11 collects player's play sounds. Each sound collecting device 15 collects sounds emitted from each player such as voices of each player and sounds of breathing. Each sound collecting device 17 collects sound emitted from each spectator, such as the sound of each spectator. These sounds are all sounds generated in the event. The plurality of vibration detection devices 12 detect vibrations generated by the player's play. The plurality of photographing devices 13 photograph a player's play. The motion detection device 14 detects the motion of the ball 60. Each biological sensor 16 measures biological information of each player. These devices detect these physical quantities at predetermined time intervals or continuously. However, the timing at which these devices detect physical quantities may be different.

In step S102, the detection device 10 transmits detection information indicating the physical quantity detected in step S101 to the server device 30. For example, the plurality of sound collection devices 11 transmit detection information including a sound signal indicating the collected sound and identification information for uniquely identifying each sound collection device 11. This identification information is used to identify each sound collection device 11. The same applies to the sound collecting devices 15 and 17. The plurality of vibration detection devices 12 transmit detection information including a vibration signal indicating the detected vibration and identification information for uniquely identifying each vibration detection device 12. This identification information is used to identify each vibration detection device 12. The plurality of photographing devices 13 transmit detection information including a video signal indicating the photographed video and identification information for uniquely identifying each photographing device 13. This identification information is used to identify each imaging device 13. The motion detection device 14 transmits detection information including a value indicating the detected motion. These devices may transmit detection information every time a physical quantity is detected, or may transmit detection information collectively at a predetermined timing.

The detection information transmitted from the detection device 10 is received by the acquisition unit 101 and stored in the storage 34. As a result, the detection information transmitted from the individual devices included in the detection device 10 is accumulated in the storage 34.

In step S103, the acquisition unit 101 acquires progress information indicating the progress of the game. For example, when the staff operating the game inputs progress information to a terminal device (not shown), the progress information is acquired from this terminal device. The progress of the game includes, for example, the elapsed time of the game, the score of the game, and the penalty imposed on the game. The acquisition of the progress information may be performed at a predetermined time interval or may be performed at a predetermined timing. The progress information acquired by the acquisition unit 101 is stored in the storage 34.

In step S104, the identification unit 102 identifies the play performed by the player by analyzing the detection information and the progress information stored in the storage 34. For example, the specifying unit 102 identifies the type of sound indicated by the sound signal by analyzing the sound signal included in the detection information received from each sound collecting device 11. Further, the specifying unit 102 identifies the type of vibration indicated by the vibration signal by analyzing the vibration signal included in the detection information received from each vibration detection device 12. Further, the specifying unit 102 detects the movement of the ball 60 and the movement of the player by performing an image recognition process on the video signal included in the detection information received from each imaging device 13. Further, the specifying unit 102 detects the movement of the ball 60 by analyzing the value included in the detection information received from the movement detecting device 14. Further, the specifying unit 102 recognizes the progress of the game indicated by the progress information. The identifying means 102 is based on the result obtained by such an analysis, that is, the type of sound, the type of vibration, the movement of the player, the movement of the ball 60, the course of the game, or a combination of at least two of these. Identify the play made by the player.

In step S105, a production effect corresponding to the play specified in step S104 is determined. The determination of the effect may be performed with reference to the effect database 111, for example. The effect database 111 may be generated in advance and stored in the storage 34, for example.

FIG. 8 is a diagram showing an example of the effect database 111. The effect database 111 stores a play type and an effect corresponding to the play type in association with each other. This effect has contents based on detection information related to the corresponding type of play. For example, when a certain play is specified in step S104, the effect stored in association with this play type is determined.

In step S106, when the production effect determined in step S105 includes a production effect using sound, the generation means 104 generates a sound signal indicating the sound used for the production effect. In addition, when the effect using sound is not included in the effect determined in step S105, the process of step S106 is not performed.

In step S107, the effect control means 105 transmits to the effect device 20 control information for controlling the effect device 20 in accordance with the effect determined in step S105. For example, when a production effect using sound is determined, control information including the sound signal generated in step S106 is transmitted to at least one of the sound emission devices 21, 24, and 26. When an effect using light is determined, control information including a light emission control signal corresponding to the effect is transmitted to at least one of the light emitting devices 22 and 27. When the effect using the vibration is determined, control information including a vibration signal indicating the vibration corresponding to the effect is transmitted to the vibration device 25. When the effect using the video is determined, control information including a video signal indicating the video corresponding to the effect is transmitted to the projection device 23.

In step S108, the rendering device 20 provides a rendering effect based on the control information received from the server device 30. For example, the sound emitting devices 21, 24, and 26 output a sound corresponding to a sound signal included in the control information. The light emitting devices 22 and 27 emit light according to a light emission control signal included in the control information. The vibration device 25 vibrates according to a vibration control signal included in the control information. The projection device 23 projects an image corresponding to the image signal included in the control information on the projection surface.

When a player dribbles When a player dribbles, dribbling is specified by analyzing detection information in step S104 mentioned above. For example, when a dribble sound is identified by analyzing a sound signal included in the detection information received from the sound collection device 11, the dribble may be specified. In addition, when the movement of the ball 60 indicating the dribble and the player is detected by performing image recognition processing on the video signal included in the detection information received from the imaging device 13, the dribble may be specified. Furthermore, dribble may be specified by adding at least one of these pieces of detection information to an analysis result of other detection information.

In step S105 described above, the effect “amplify and output dribble sound” stored in association with the play type “dribble” is determined in the effect database 111 shown in FIG. In step S106 described above, sound processing for amplifying a sound signal indicating a dribble sound is performed. As this sound signal, for example, a sound signal indicating a dribble sound included in the detection information received from the sound collection device 11 may be used. As another example, when a sound signal indicating a dribble sound is generated in advance and stored in the storage 34, this sound signal may be used. In step S107 described above, control information including the sound signal generated in step S106 is transmitted to the sound emitting devices 21, 24, and 26, for example. In this case, in step S108 described above, the sound output devices 21, 24, and 26 output sounds corresponding to the sound signals, that is, amplified dribble sounds. This dribbling sound is output in real time. That is, a dribble sound is output while the player is dribbling. However, the period during which the dribble sound is output and the period during which the dribble is performed may not be completely synchronized, and there may be a slight delay.

When a player shoots When a player shoots, a shot is identified by analyzing detection information in step S104 mentioned above. For example, when a motion of the ball 60 indicating a shot and a player is detected by performing image recognition processing on the video signal included in the detection information received from the imaging device 13, the shot may be specified. Furthermore, the shoot may be specified by adding the analysis result of other detection information to the analysis result of the detection information.

In step S105 described above, the production effect “output sound effect corresponding to movement of shooter and ball 60” stored in association with the play type “shoot” is determined in the production database 111 shown in FIG. In step S106 described above, processing for generating a sound signal indicating the sound effect 120 corresponding to the movement of the shooter and the ball 60 is performed.

FIG. 9 is a diagram illustrating an example of the sound effect 120 corresponding to the movement of the shooter and the ball 60. In this example, the player is ready to shoot with the ball 60 in the period T11. In a period T12, the player shoots and the ball 60 moves in the air. At time t13, the ball 60 reaches the goal or other place, and the shot ends. In this case, the sound effect 120 includes a sound 121 in the period T11, a sound 122 in the period T12, and a sound 123 at time t13 when the period T12 ends. The sound 121 may be, for example, a sound indicating that a shooting posture has been entered. The sound 122 may be, for example, the sound of the ball 60 thrown into the air “Hyu”. The sound 122 may have a length corresponding to the period T12, for example. The sound 123 may be, for example, a sound according to the shooting result. For example, when a shot is made, the sound 123 may be the sound of the ball 60 that has entered the goal of “bash”.

In step S107 described above, control information including the sound signal generated in step S106 is transmitted to, for example, sound emitting devices 21, 24, and 26. In this case, in step S108 described above, the sound effects 120 corresponding to the sound signal are output from the sound emitting devices 21, 24, and 26. The output of the sound effect 120 is performed in real time. That is, the sound effect 120 is output while the player is shooting. In the example shown in FIG. 9, a sound 121 is output in the period T11, a sound 122 is output in the period T12, and a sound 123 is output at the time t13 in accordance with the movement of the player who performs the shot. However, the output of the sound effect 120 may not be completely synchronized with the movement of the player, and there may be a slight delay.

When a player performs a free throw When a player performs a free throw, the free throw is identified by analyzing the detection information in step S104 described above. For example, when the progress information indicates that a free throw is performed, the free throw may be specified. Furthermore, the free throw may be specified in consideration of the analysis result of the detection information.

In step S105 described above, in the effect database 111 shown in FIG. 8, an effect “output a sound corresponding to the heart rate of the thrower” stored in association with the play type “free throw” is determined. In step S106 described above, a sound signal indicating a sound effect corresponding to the heart rate included in the detection information received from the wearable terminal 70 worn by the player who performs the free throw is generated. This sound effect may be, for example, a sound of “Dokudokudoku” having a rhythm corresponding to the heartbeat cycle. In this case, the sound effect changes in rhythm according to the heart rate. For example, the higher the heart rate, the faster the sound effect tempo may be.

In step S107 described above, control information including the sound signal generated in step S106 is transmitted to, for example, sound emitting devices 21, 24, and 26. In this case, in step S108 described above, the sound emitting devices 21, 24, and 26 output sound effects corresponding to the sound signals, that is, sound effects corresponding to the heart rate of the player performing the shot. This sound effect is output in real time. That is, this sound effect is output during the free throw. However, the period in which the sound effect is output and the period in which the free throw is performed may not be completely synchronized, and there may be a slight delay.

In the first embodiment described above, the contents are produced based on the detection information acquired from the detection device 10. Thereby, the realistic sensation of the event can be improved. In addition, this effect has contents corresponding to the player's situation such as the player's play and state, and can be felt with various senses such as hearing, tactile sensation, and vision. Thereby, since the audience can feel the situation of the player more strongly, the communication between the athlete and the audience is strengthened.

2nd Embodiment In 1st Embodiment mentioned above, the production | presentation corresponding to the condition of the player was performed. On the other hand, in the second embodiment, an effect corresponding to the situation of the audience is performed. The configuration of the rendering system 1 according to the second embodiment is the same as the configuration of the rendering system 1 according to the first embodiment described above. Hereinafter, descriptions of matters common to the first embodiment are omitted.

The determining unit 103 has contents based on the detection information acquired by the acquiring unit 101, and determines a production effect corresponding to the situation of the audience. For example, the determination unit 103 analyzes the sound signals included in the detection information received from the plurality of sound collection devices 17 and calculates the sum of the amount of sound of the audience indicated by these sound signals. The determining means 103 determines the effect of emitting light with a light emission amount corresponding to the sum of the calculated audio amounts. In this case, the amount of emitted light may increase as the sum of the amount of audio increases, for example.

The production control unit 105 controls the production device 20 according to the production effect determined by the determination unit 103 and provides the production effect. For example, the effect control unit 105 transmits control information including a light emission control signal indicating the light emission amount corresponding to the sum of the sound amounts to the light emitting devices 22 and 27. When receiving the control information, the light emitting devices 22 and 27 emit light according to the light emission control signal included in the control information. For example, the light emitting devices 22 and 27 emit light at the light emission amount indicated by the light emission control signal. In this case, the light emission amount of the light emitting devices 22 and 27 increases as the audio volume of the audience increases. Therefore, the player can feel the level of cheering by the audience based on the light emission amounts of the light emitting devices 22 and 27.

In the second embodiment described above, an effect corresponding to the situation of the audience of the event is performed. Thereby, since the player can feel the situation of the audience more strongly, the communication between the player and the audience is strengthened.

Third Embodiment In the first embodiment described above, an effect corresponding to the situation of the player is performed, and in the second embodiment described above, an effect corresponding to the situation of the audience is performed. In contrast, in the third embodiment, an effect corresponding to the situation of one spectator included in a plurality of spectators is performed for the other spectator. The configuration of the rendering system 1 according to the third embodiment is the same as the configuration of the rendering system 1 according to the first embodiment described above. Hereinafter, descriptions of matters common to the first embodiment are omitted.

In the third embodiment, a plurality of spectators are divided into a plurality of groups. For example, when a plurality of spectators include supporters and general customers other than the supporters, the plurality of spectators may be divided into supporters and general customers. As another example, the plurality of spectators may be divided depending on the location of the spectator seat area 3.

The deciding means 103 selects a reference group that is a base of the production effect and a target group that is a destination of the production effect from a plurality of groups. For example, the reference group may be a group to which a supporter belongs, and the target group may be a group to which a general customer belongs. As another example, the reference group and the target group may be selected based on the sum of the audio volume of the audience of each group. In this case, the determining unit 103 analyzes the sound signals included in the detection information received from the plurality of sound collecting devices 17 and calculates the sum of the sound volume of the audience of each group indicated by these sound signals. The determining unit 103 may select a group having the largest sum of the calculated sound amounts as a reference group, and may select a group having the smallest sum of the calculated sound amounts as a target group.

The determination unit 103 determines the effect of content based on the detection information acquired from the detection device 10 corresponding to the reference group among the detection information acquired by the acquisition unit 101. For example, this effect may be that the sound of the audience of the reference group is output to the audience of the target group.

The generation unit 104 generates a sound signal based on the detection information acquired from the detection device 10 corresponding to the reference group. As this sound signal, for example, a sound signal included in the detection information received from the sound collection device 17 corresponding to the reference group may be used as it is, or a sound signal subjected to sound processing may be used. Also good. The sound collection device 17 corresponding to the reference group is a sound collection device 17 that collects the sound of the audience of the reference group. Such a sound collection device 17 is identified by identification information included in the detection information.

The effect control means 105 selects the effect device 20 corresponding to the target group. For example, when outputting the sound of the reference group toward the target group, the sound emitting devices 21, 24, and 26 corresponding to the target group are selected from the plurality of sound emitting devices 21, 24, and 26. The sound emitting devices 21, 24, and 26 corresponding to the target group are the sound emitting devices 21, 24, and 26 that output sound toward the audience of the target group. For example, the sound emitting device 24 corresponding to the target group is the sound emitting device 24 provided in the spectator seat 50 where the audience of the target group sits. The sound emitting device 26 corresponding to the target group is the sound emitting device 26 of the wearable terminal 80 attached to the audience of the target group. Such sound emitting devices 21, 24, and 26 are identified by identification information included in the detection information.

The production control unit 105 controls the selected production device 20 according to the production effect determined by the determination unit 103 and provides the production effect. For example, the effect control unit 105 transmits control information including the sound signal generated by the generation unit 104 to the selected sound emitting devices 21, 24, and 26. Upon receiving this control information, these sound emitting devices 21, 24, and 26 output sound corresponding to the sound signal included in the control information. Thereby, the voice of the reference group audience is output to the audience of the target group.

In the third embodiment described above, an effect corresponding to the situation of one audience is performed for the other audience. Thereby, since the other audience can feel the situation of one audience, the sense of unity between these audiences is strengthened.

The present invention is not limited to the above-described embodiments. At least two of the first to third embodiments described above may be implemented in combination. Various modifications may be made to the above-described embodiments. In addition, at least two of the following modifications may be implemented in combination.

Modification 1
In each embodiment described above, the effect may be determined in consideration of the progress of the game. In this case, the determination unit 103 determines the effect based on the detection information and the progress information acquired by the acquisition unit 101. For example, the determining unit 103 may determine different effects depending on the progress of the game indicated by the progress information. For example, when the shoot is specified by the specifying unit 102, normally, as described in the first embodiment, the effect of “output sound effects corresponding to the movement of the shooter and the ball 60” is determined. . However, when the progress of the game indicated by the progress information is in a predetermined state, a special effect may be determined. This predetermined state may be, for example, a state where the game is exciting. For example, the predetermined state may be a reverse state. Alternatively, the predetermined state may be a state reversed within a predetermined time before the end of the game. In another example, a predetermined state may be defined for each team. This predetermined state may be determined based on, for example, a team hex.

The special performance effect is different from the normal performance effect. For example, the special effect may be a result of processing a normal effect, or may be a result of adding an effect using another medium to the normal effect. For example, when the normal production effect is a production effect using sound, the special production effect may be output by performing sound processing on the sound used for the normal production effect. In addition, in the special effect, in addition to the sound output performed in the normal effect, an effect using at least one of light, vibration, and video may be provided. According to this modified example, even when the same play is performed in the game, it is possible to provide different effects depending on the progress of the game.

Further, the progress of the game described above may be specified based on rule information indicating the rules of the game in addition to the progress information. This rule information may be stored, for example, in the production database 111, may be stored in the storage 34 of the server device 30, or may be stored in an external storage device. The progress of this game may be the remaining time of the game, for example. For example, when the elapsed time is included in the progress information and the game information is included in the rule information, the remaining time of the game is calculated by subtracting the elapsed time from the match time. This elapsed time may be, for example, a time measured by a game referee. In this case, for example, the staff operating the game may input the elapsed time measured by the referee to a terminal device (not shown), and the progress information including the elapsed time may be acquired from the terminal device. Furthermore, the effect of the content corresponding to the remaining time of the game may be provided. For example, when a production effect using sound is provided, the parameters of the audio processing applied to the sound signal may change according to the remaining time of the game. For example, when a sound signal is amplified by voice processing, the amplification degree may change according to the remaining time of the game. Thereby, the production according to the remaining time of the game can be performed.

Modification 2
In each embodiment mentioned above, a different production effect may be provided by an audience or an audience group. In this case, the determination unit 103 determines a plurality of different effects for each of a plurality of spectators or a plurality of spectator groups. The production control means 105 controls a plurality of production devices 20 corresponding to a plurality of spectators or a plurality of audience groups, and provides production effects corresponding to the production devices 20. The effect device 20 corresponding to the audience or the audience group is an effect device 20 that provides an effect to the audience or the audience group.

For example, different presentation effects may be provided by the audience supporting one team and the audience supporting the other team. For example, when a shot is made by a player of one team, the sound emitting devices 21, 24, and 26 corresponding to the first sound effects corresponding to the movement of the shooter and the ball 60 are provided to the audience supporting the one team. It may be output. The first sound effect may be a sound that excites the audience, for example. In addition, a second sound effect corresponding to the movement of the shooter and the ball 60 may be output from the corresponding sound emitting devices 21, 24, and 26 to the spectator who supports the other team. The second sound effect is different from the first sound effect, and may be a sound that keeps the audience cool, for example. According to this modification, it is possible to provide a presentation effect suitable for the team to be supported.

As another example, different effects may be provided depending on the location of the spectator seat area 3. Here, in the audience area 3, there is a passionate zone where there are spectators who cheer enthusiastically, an analysis zone where there is a spectator who likes to analyze the game, a beginner zone where there are spectators who watch the game for the first time, and player play A case is assumed in which a sensation zone in which there are spectators who want to experience more strongly is included. Note that these zones may be separated by the distance from the court 4 or the arrangement in the spectator seat area 3 (outfield seats, second floor seats, etc.). In this case, presentation effects corresponding to the attributes of the audience may be provided to the audience in each zone. For example, a gorgeous staging effect that excites cheering by the corresponding staging device 20 may be provided to the audience in the intense zone. In addition, the spectator in the sensation zone may be provided with an effect such that the corresponding effect device 20 can experience the player's play, for example, an effect using vibration. According to this modification, since a plurality of effects are provided in the spectator seat area 3, variations in how to enjoy watching events can be increased. Further, when the spectator seat area 3 is divided according to the spectator attributes, it is possible to provide a production effect according to the spectator attributes.

As another example, a specific audience may be provided with a plurality of performance effects different from those of other audiences. For example, when a shoot is performed by a player, an effect different from other spectators may be provided to a spectator who supports the player who has shot. In this case, the spectator registers in advance the players he supports. In the storage 34, registration information indicating the registration contents is stored in advance. Based on this registration information, the audience that supports the player who shot is identified. For example, a normal presentation effect may be provided to the audience other than the identified audience by the corresponding presentation device 20. On the other hand, a special effect may be provided to the specified audience by the corresponding effect device 20. The special production effect is a production effect different from the normal production effect, like the special production effect described above. According to this modification, it is possible to provide a presentation effect suitable for each audience.

As another example, the audience in a predetermined state may be provided with a plurality of performance effects different from those of other audiences. This predetermined state may be, for example, a state of standing up from the spectator seat 50. In this case, the seat 50 is provided with a seating sensor. The seating sensor detects the seating of the spectator on the spectator seat 50 and transmits detection information indicating the detection result to the server device 30. Based on this detection information, it is determined whether each spectator is sitting in the spectator seat 50. For example, a normal presentation effect may be provided to the audience sitting in the spectator seat 50 by the corresponding presentation device 20. On the other hand, since it is considered that the audience standing up from the spectator seat 50 is in an excited state, a special performance effect may be provided by the corresponding performance device 20. The special production effect is a production effect different from the normal production effect, like the special production effect described above. As another example, the audience standing up from the spectator seat 50 cannot be vibrated, and thus a presentation effect using a medium other than the vibration may be provided. According to this modification, it is possible to provide an effect that is suitable for the state of the audience.

Modification 3
In each of the above-described embodiments, different presentation effects may be provided depending on the player related to the event status specified by the specifying unit 102. For example, when a player change is performed in a game, a predetermined effect may be provided for a new player who has entered through the change. Further, different presentation effects may be provided depending on the popularity of the players related to the event status specified by the specifying means 102. For example, when an ace having a high degree of popularity participates in the middle of a match, a presentation effect different from that of other players may be provided. This effect may be, for example, the special effect described above.

Modification 4
In each embodiment mentioned above, a production effect is not limited to what used sound. For example, the effect may be one that uses at least one of sound, light, vibration, and an image. This image includes a still image and a moving image. For example, when dribbling is performed, the vibration device 25 may vibrate and the light emitting devices 22 and 27 may emit light according to the dribbling sound. This vibration and light emission may correspond to a dribble sound. In this case, a vibration control signal based on a sound signal indicating a dribble sound may be generated and provided to the vibration device 25. Similarly, a light emission control signal based on a sound signal indicating a dribble sound may be generated and provided to the light emitting devices 22 and 27.

Similarly, when a free throw is performed, the vibration device 25 may vibrate and the light emitting devices 22 and 27 may emit light according to the sound effect corresponding to the heart rate. This vibration and light emission may correspond to the heart rate. In this case, a vibration control signal based on the heart rate may be generated and provided to the vibration device 25. Similarly, a light emission control signal based on the heart rate may be generated and provided to the light emitting devices 22 and 27. Furthermore, the information of the player who performs free throw may be projected by the projection device 23. This player information may include, for example, the player's spine number and face image. Also, different color images may be projected depending on the state of the player indicated by the heart rate. For example, when the player is in an excited state, an image based on red may be projected. On the other hand, when the player is in a calm state, an image based on blue may be projected.

Modification 5
In each embodiment mentioned above, the image which shows the contents of the cheering of a spectator may be displayed. For example, this image may be displayed on equipment used in the game. This equipment may be a goal used in, for example, a basketball game. In this case, the rendering device 20 includes a display device 28.

FIG. 10 is a diagram showing an example of the display device 28 according to this modification. The display device 28 is provided integrally with the backboard of the basket goal. The display device 28 displays an image. The display device 28 may be, for example, a transparent organic EL (Electro-Luminescence) display. In this case, a sound recognition process is performed on the sound signals included in the detection information received from the plurality of sound collection devices 17, and an image signal indicating an image corresponding to the result of the sound recognition process is generated. For example, when the content of the sound of a certain audience specified by the speech recognition process is “shoot! Decide”, an image signal indicating an image including the content of the sound is generated. The effect control unit 105 transmits control information including the generated image signal to the display device 28. When receiving the control information, the display device 28 displays an image corresponding to the image signal included in the control information. Thereby, the player can visually recognize the cheering of the audience.

Modification 6
In each embodiment mentioned above, the audience does not necessarily need to be in the place where an event is performed. For example, a spectator may watch an event remotely. In this case, the audience is in a place different from the place where the event is held, such as a home or a live viewing venue. In this case, in addition to the place where the above-described event is performed, this other place is a place related to the event. Then, the video imaged by the imaging device 13 is distributed to another place via the communication line 40. In this case, the communication line 40 may be configured including the Internet, for example. The audience browses the distributed video using the terminal device. In addition, the spectator may wear the wearable terminal 80 in the same manner as the spectator at the place where the event is held.

Modification 7
In each embodiment described above, the movement of the player is detected using the video imaged by the imaging device 13, but the method of detecting the movement of the player is not limited to this. For example, the wearable terminal 70 may include a motion detection device that detects the motion of the player. This motion detection device may be, for example, at least one of an acceleration sensor, a gyro sensor, and a magnetic sensor. In another example, a player's movement may be detected using a non-contact type radar. As described above, the motion detection device that detects the motion of the player may be realized by the cooperation of the photographing device 13 and the specifying unit 102 described above, or realized by various sensors provided on the wearable terminal 70. Alternatively, it may be realized by a non-contact type radar.

Modification 8
In each embodiment described above, an effect of displaying a virtual object using AR (Augmented Reality) may be performed. In this case, for example, a display is provided on the wearable terminal 80. On this display, a virtual object corresponding to the event situation is displayed using AR. In this case, it is possible to enjoy an effect different from the real world by looking at the display.

Modification 9
In each embodiment described above, an example in which the event player is a player has been described, but the event player is not limited to a player. For example, when the event is an event other than a sport game, a person who performs some performance at the event is a player. When the event is an event other than a basketball game, an object other than the ball 60 may be used in the event. In this case, the motion detection device 14 described above may be provided for an object used in the event.

Modification 10
The object for implementing the function of the production system 1 is not limited to the examples described in the above embodiments. For example, some of the functions implemented by the server device 30 may be implemented by the detection device 10, the rendering device 20, or other devices. For example, the specifying unit 102 described above may be mounted on the detection apparatus 10. In this case, the above-described play specification is performed by the detection device 10.

Modification 11
The steps of processing performed in the production system 1 are not limited to the examples described in the above-described embodiment. The steps of this process may be interchanged as long as there is no contradiction. The present invention may be provided as an effect method including steps of processing performed in the effect system 1.

Modification 12
The present invention may be provided as a program executed in the detection device 10, the rendering device 20, or the server device 30. This program may be downloaded via a communication line such as the Internet. The program is provided in a state where it is recorded on a computer-readable recording medium such as a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disk, etc.), a magneto-optical recording medium, or a semiconductor memory. May be.

Modification 13
In the above-described embodiment, when a game replay is performed, an effect corresponding to the replay may be provided. For example, there is a case where a large screen is provided at a venue where a game is held, and a characteristic scene of the game is replayed on the screen. In this case, when a predetermined play such as a goal is performed in a game or a predetermined penalty such as a foul is imposed, the play or penalty scene may be replayed immediately after that. Specifically, the video imaged by the imaging device 13 is recorded, and the video image corresponding to the period of this scene is displayed on the screen. At this time, a presentation effect corresponding to the replay video is provided. Specifically, detection information indicating a physical quantity detected by the detection device 10 is stored. This detection information may be stored in the storage 34 of the server device 30, or may be stored in the detection device 10 or an external storage device. The determination unit 103 determines the effect of the content based on the detection information corresponding to the above-described scene period among the stored detection information. This effect is provided in accordance with the replay video. Thereby, powerful replay can be realized.

This application is based on Japanese Patent Application No. 2017-085454 filed on Apr. 24, 2017, the contents of which are incorporated herein by reference.

1: production system 10: detection device 11, 15, 17: sound collection device 13: imaging device 16: biometric sensor 20: production device 21, 24, 26: sound emission device 30: server device 101: acquisition unit 102: identification unit 103: Determination means 104: Generation means 105: Production control means

Claims (13)

1. An acquisition means for acquiring detection information indicating a physical quantity detected by the detection device at a location related to the event;
   Determining means for determining the effect of content based on the detection information acquired by the acquiring means;
   An effect control device comprising: an effect control means for controlling the effect device in accordance with the effect effect determined by the determining means and providing the effect effect.
2. Based on the detection information acquired by the acquisition means, further comprising a specifying means for specifying the status of the event,
   The effect control device according to claim 1, wherein the determining unit determines an effect that corresponds to the situation of the event specified by the specifying unit.
3. The effect control device according to claim 2, wherein the event state includes a play performed by a player in the event.
4. When the effect using the sound is determined by the determining means, further comprising a generating means for generating a sound signal based on the detection information,
   The effect control according to any one of claims 1 to 3, wherein the effect control means supplies the sound signal generated by the generating means to a speaker and outputs a sound corresponding to the sound signal from the speaker. apparatus.
5. The detection device includes a microphone that collects sound emitted in the event;
   The detection information includes a sound signal indicating the sound collected by the microphone,
   The generation means performs sound processing on the sound signal included in the detection information,
   The effect control device according to claim 4, wherein the effect control unit supplies the sound signal on which the sound processing has been performed to the speaker.
6. The detection device includes a motion detection device that detects a motion of a player of the event,
   The detection information indicates the motion detected by the motion detection device;
   The production control device according to claim 4, wherein the generation unit generates a sound signal corresponding to the movement indicated by the detection information.
7. The detection device includes a biological sensor that measures biological information of the player of the event,
   The detection information includes the biological information measured by the biological sensor,
   The production control device according to any one of claims 4 to 6, wherein the generation unit generates a sound signal corresponding to the biological information included in the detection information.
8. The acquisition means further acquires progress information indicating the progress of the event,
   The effect control device according to any one of claims 1 to 7, wherein the determining unit determines the effect based on the detection information and the progress information acquired by the acquiring unit.
9. The determining means determines a plurality of effects different from each other for a plurality of spectators or a plurality of spectator groups watching the event,
   The effect control means controls the plurality of effect devices corresponding to the plurality of audience members or the plurality of audience groups, and the effect device corresponds to each of the plurality of effect devices. The production control device according to claim 1, wherein the production effect determined for the audience group is provided.
10. The effect control device according to any one of claims 1 to 9, wherein the effect is an effect using sound, light, vibration, or an image.
11. A detection device for detecting a physical quantity at a location related to the event;
    An effect device that provides the effect of the event;
    Obtaining means for obtaining detection information indicating the physical quantity detected by the detection device;
    Determining means for determining the effect of content based on the detection information acquired by the acquiring means;
    An effect system comprising: an effect control means for controlling the effect device in accordance with the effect effect determined by the determining means and providing the effect effect.
12. Obtain detection information indicating the physical quantity detected by the detection device at the location related to the event,
    Determine the effect of the content based on the detection information acquired by the acquisition,
    Controlling the effect device according to the effect determined by the determination, and providing the effect.
    An effect control method executed by a computer system.
13. On the computer,
    Obtaining detection information indicating a physical quantity detected by the detection device at a location related to the event;
    Determining an effect of content based on the acquired detection information;
    A program for controlling a rendering device in accordance with the determined rendering effect and providing the rendering effect.

Images