JP2017151978A - Event rendition system, operation method and program therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an event rendition system for outputting a prescribed rendition effect to a video display device which is provided in an event site by users who collaborate or compete and who exist in or do not exist in the event site, by information terminal devices connected to a telecommunication network for evoking the event.SOLUTION: An event rendition system comprises: a rendition control sub system 1 for performing rendition control of an event site; a user terminal 2 which is an input terminal connected to the rendition control sub system 1 through a telecommunication network 6; and a video display device 3 for displaying a video for a rendition effect by the rendition control sub system 1 and being provided in the event site. The rendition control sub system 1 causes points generated by various works performed by users to function as common virtual currencies on the system, the points can be used for selecting each rendition effect and combining the point to video data.SELECTED DRAWING: Figure 1

Description

  The present invention controls users based on the points prepared by the users at the event venue or the users participating in the event via the communication network, so that the users cooperate or compete with each other. It is related to the technology that is going to excite the event while meeting.

  In the past, the atmosphere of the event venue was lively as the audiences who came to the event venue individually or all together cheered or shaken the lighting equipment to appreciate the performing arts such as singer concerts and theater performances. It was exciting.

  In recent years, as portable information terminal devices that can be easily carried like mobile phones, smartphones, tablets, etc. and are connected to communication networks such as the Internet and wireless telephone lines are widely used, these portable information terminal devices have been widely used. It is also possible to use the event venue to enhance the atmosphere.

  For example, in Patent Literature 1, a portable information terminal device that has an output device such as light emission, image output, and audio output and is connected to a communication network, and data that can be output by the portable information terminal device are stored in By using a server that transmits data, each user can communicate their intentions and feelings to enhance the sense of unity among the participants, including the performers. A system for playing is disclosed.

JP2013-50824A

  However, in the invention described in Patent Document 1 described above, even if the sense of unity of the participants such as the user of the portable information terminal device can be enhanced, it may be involved in the production on the device such as the stage at the event venue. It was not possible to share the production, and it was not exciting.

  In addition, in the invention described in Patent Document 1, users in the same event venue cooperate with each other, but users who are not in the event venue cannot even participate in the event in the first place.

  Therefore, in the present invention, even an event participant at an event venue or a viewer who is viewing an event at a remote place, the users cooperate with each other or compete with each other by the information terminal device connected to the communication network. It is an object of the present invention to provide an event production system that outputs a predetermined production effect to a video display device provided at an event venue and excites the event.

  Specifically, the present invention specifically provides an effect control subsystem for effect control of an event venue, a plurality of input terminals connected to the effect control subsystem via a communication network, and provided in the event venue. An event display system comprising: an image display device that displays a video of an effect produced by the effect control subsystem, wherein the effect control subsystem is configured to input a billing point based on the paid currency, and an input from the input terminal A point creation unit that calculates input points based on work, a charging point storage unit that stores charging points calculated by the point generation unit, and an input point storage unit that stores input points calculated by the point creation unit And the billing point stored in the billing point storage unit or the input point In the production effect selection unit that selects the production effect according to the input points stored in the existing unit, the video processing unit that performs processing based on the production effect selected by the production effect selection unit, and the video processing unit A video distribution unit that distributes the processed video to the video display device, and the input includes an input device for performing the input operation.

  And a sound collecting device that collects sound at an event venue as one of the effect control subsystem and the input terminal, and the point creation unit obtains a sound point based on the sound input from the sound collecting device. The voice point may be calculated and added to the input point and stored in the input point storage unit.

  And as an effect control subsystem and one of the input terminals, an image pickup device for picking up a spectator seat side in an event venue is provided, and the point creation unit calculates an image point based on an image input from the image pickup device The image point may be added to the input point and stored in the input point storage unit.

  And it can also comprise the direction device provided in the event hall, and the direction control subsystem may have a direction device control part which controls the direction device based on the effect.

  And the operation method of the above event production systems and the program are also provided.

  According to the present invention, even if an event participant is at an event venue or a viewer who is watching an event at a remote place, the users cooperate with each other or compete with each other by the information terminal device connected to the communication network. For example, a predetermined effect can be output to a video display device provided at the event venue, and the event can be excited.

  In addition, various behaviors that are difficult to be compared with each other by a user are centrally managed at a point that plays a role like a virtual currency on the system, and the point is associated with a production effect, so that the user can make money Regardless of whether you pay or not, you can share the effects and make the event more exciting.

It is the schematic which shows the various information communication apparatus etc. which were connected to the communication network in the event production system of this invention. It is a figure which shows an example of the functional block in the event presentation system of this invention. It is a figure which shows an example of the corresponding table of the production effect according to the point currently hold | maintained at the production control subsystem of this invention. It is a figure which shows an example of the image | video by which the production effect was processed into the live image | video displayed on the video display apparatus of this invention. It is a figure which shows an example of the hardware constitutions of the production control subsystem in the event production system of this invention. It is a figure which shows an example of the flow of the process in the event presentation system of this invention. It is a figure which shows another example of the flow of the process in the event presentation system of this invention.

  Hereinafter, embodiments relating to an event production system and the like according to the present invention will be described in detail. The embodiments described below are preferable specific examples for carrying out the present invention, and thus various technical limitations are made. However, the present invention is particularly limited in the following description. Unless otherwise specified, the present invention is not limited to these forms.

〔Overview〕
FIG. 1 is a conceptual diagram for explaining an embodiment of the event presentation system of the present invention. A video display device 3 for displaying videos of concerts of singers and characters for viewing by a plurality of spectators is installed at an event venue prepared indoors or outdoors, and also has a function as an input terminal. There are a plurality of spectators participating in the concert with the portable information terminal 2a which is the terminal 2. Also, the video of the concert displayed on the video display device 3 at a remote location physically separated from the event venue via the communication network 6 is transmitted to the portable information terminal 2a or the desktop personal computer 2b as the user terminal 2. Some viewers participate in the concert in the form of watching it on. Further, a server device S for storing the production control subsystem 1 that distributes the concert video to the video display device 3 and the user terminal via the wired or wireless communication network 6 is also installed in a place different from the event venue. . In FIG. 1, the server device S that stores the production control subsystem 1 is shown to be provided at a place different from the event venue, but may be installed at the event venue in other embodiments. Further, it may be composed of a plurality of devices according to functions, and all or some of them may be installed at the event venue.

  Then, at the event venue, a spectator (user of the portable information terminal 2a) who is viewing the concert of the singer displayed on the video display device 3 is built in by an action such as holding the portable information terminal 2a in his hand. The gyro sensor and the acceleration sensor that are used can detect the tilt and movement (input work of shaking the portable information terminal 2a), and the effect control subsystem 1 can acquire input points converted at a predetermined rate. Thereafter, using the acquired input points, various effects according to the predetermined input points are selected, and the various effects selected for the concert video displayed on the video display device 3 are processed. Is displayed. In addition, since the input points acquired by the individual users are combined and shared with a plurality of other users, for example, a plurality of users at the event venue cooperate to perform a predetermined time. When a predetermined input point is gathered, an effect corresponding to the input point is selected, whereby various effect effects selected for the concert video displayed on the video display device 3 can be processed and displayed. In this way, by actively raising the willingness to participate in the concert for the users in the event venue, it is possible to create a sense of unity among the participants and excitement.

  A user who views the video of the concert on the portable information terminal 2a or the desktop personal computer 2b that is physically remote from the event venue operates the portable information terminal 2a or the desktop personal computer 2b during the concert or Purchasing billing points by online payment in a given currency before the concert. Instead of purchasing billing points from the mobile information terminal 2a or the desktop personal computer 2b by using an online payment system such as a financial institution, a virtual currency such as various points distributed as a currency is used, Billing points can also be purchased by using a credit card or using other payment methods such as bank ATMs. By using some or all of the purchased charging points and selecting various effects according to the predetermined charging points, they are displayed on the portable information terminal 2a or the desktop personal computer 2b and further on the video display device 3. Various effect effects selected for the concert video are processed and displayed. In this way, it is possible to create a sense of unity among participants by actively raising their willingness to participate in concerts even for users who are physically remote from the event venue. it can. Furthermore, sales for the production effect can be expected by competing with the user in the event venue for the production effect against the user who is physically remote from the event venue. On the other hand, the user at the event venue can purchase the charging point by the above method, and each user at the event venue can select various effects according to the purchased charging point, thereby 2a, and further, it is possible to process and display various effects produced in the concert video displayed on the video display device 3.

  As described above, users who have acquired input points by a predetermined input operation such as shaking the portable information terminal 2a without using money, or users who have previously purchased billing points in a predetermined currency cooperate or compete with each other. This increases the willingness to participate in events such as concerts by singers and characters, and creates a sense of unity among those participants. Furthermore, as a result, the effect can be sold as a product.

  Further, in addition to the above contents, effect control is performed based on the sound volume input by the sound collection device 4 installed at the event venue as one of the input terminals or the portable information terminal 2a of the user at the event venue. It is also possible to calculate voice input points converted by the subsystem 1 at a predetermined ratio and add them to the input points.

  Further, in addition to the above contents, image points converted at a predetermined ratio by the effect control subsystem 1 are calculated based on the image input by the imaging device 5 installed at the event venue as one of the input terminals. You can also add the input points.

[Functional configuration]
FIG. 2 is a diagram showing an example of functional blocks in the event presentation system of the present invention. As shown in FIG. 2, the event presentation system of the present embodiment includes a user terminal 2 provided as one of input terminals, other input terminals T, an effect control subsystem 1, a video display device 3, and the like. ing.

  Note that the functional blocks in the event presentation system of the present invention described below can be realized by combining hardware and software. Specifically, if a computer is used, a CPU, a main memory, a bus, a secondary storage device such as a hard disk drive (HDD) or a solid state drive (SSD), and an input used for inputting information Examples include hardware such as devices, displays, and other external peripheral devices and their interfaces, communication interfaces that connect a plurality of hardware, application programs, and the like. Then, an instruction is input from an input device or the like by a CPU calculation process by a program stored in the main memory, and information is processed and stored while referring to data stored in the main memory or the secondary storage device. In addition, an instruction for controlling the hardware is generated.

  In addition, the present invention can be realized not only as a system but also as a method. A part of the invention can be configured as software. Further, a software product used for executing such software on hardware such as a computer and a recording medium such as a magnetic disk, an optical disk, and a flash memory storing the software product are also within the technical scope of the present invention. include.

(Input terminal)
The input terminal is for participants who are directly participating in the event venue, or participants who are not participating in the event venue but are indirectly participating in the event to try to express some kind of intention for the participating event. It is a physical device that is sometimes used or for detecting its intention. Examples of the input device include the user terminal 2 used by the participants and other input terminals T, and these can be used alone or in combination of two or more.

(User terminal)
As shown in FIG. 2, the user terminal 2 which is a kind of input terminal and other input terminals T are connected to the presentation control subsystem 1 via a communication network 6 by wire or wirelessly, and at least each of the input devices 201. The user terminal 2 may include a video acquisition unit 202 and a video display unit 203 as necessary. As the user terminal 2, a portable information terminal 2a generally called a smartphone or a tablet terminal, an information terminal that is difficult to carry as compared with the portable information terminal 2a, such as a desktop computer 2b or a notebook personal computer, are configured as information terminals. In addition, the user terminal 2 reads a one-dimensional or two-dimensional barcode installed in the event venue in a state where a specific application program is activated, and relates to user information stored in the presentation control subsystem 1. It can also function as a passport, for example, the participation procedure is performed against the data.

  The input device 201 has a function for a user to perform input work, and can input necessary information to the user terminal 2 by various means. Specifically, in the case of the portable information terminal 2a, a voice input work such as a capacitive touch panel, a resistive touch panel, etc. used for performing input work such as character input and selection with a finger, and cheering. Microphone used to perform, acceleration sensor used to perform motion input work such as shaking the mobile information terminal to the left and right, gyro sensor used to perform tilt input work such as tilting the mobile information terminal, event venue A temperature sensor used for performing hot air input work indicating the degree of swell in the camera, a camera used for performing image data input work such as user face information, and the like are preferable. Also, if it is an information terminal that is difficult to carry compared to the portable information terminal 2a, such as a desktop PC 2b or a notebook personal computer, a keyboard used to perform input operations such as character input, input operations such as character input and selection with a finger A mouse used for performing voice input, a microphone used for performing voice input work such as cheering, a camera used for performing image information input work such as user face information, and the like are preferable.

  For example, when a user at an event venue shakes a portable information terminal 2a such as a smartphone held in his hand up and down or left and right while a specific application program is activated, the motion is detected by an acceleration sensor. The effect control subsystem 1 can be notified of the motion shaken through the application program. In this way, necessary information can be input by the user's operation. In order to display a comment as a production effect, a user at the event venue or a user at a remote location physically away from the event venue inputs characters, symbols, etc. with the input device 201 such as a touch panel or a keyboard. You can also In addition, in a state where a user at the event venue or a user at a remote place physically away from the event venue activates a specific application program on the portable information terminal 2a such as a smartphone or the desktop personal computer 2b. In order to obtain a billing point, it is possible to indicate the intention using a touch panel, a keyboard, a mouse, or the like, and it is possible to confirm permission to use the billing point. When the user permits the use of the billing points, in a specific application program running on the user terminal 2, the covering of the displayed singer or ribbon that wraps the character is removed and the singer or character appears. Thus, it is possible to perform such effects as allowing the user to participate in the event.

The video acquisition unit 202 has a function of acquiring a processed video distributed from the video distribution unit 108 of the production control subsystem 1, and includes, for example, a CPU, a main memory, a communication circuit, a video processing circuit, a video reception program, and the like. The video data that is distributed sequentially is accumulated, and the encryption attached to the distributed video data is decrypted as necessary to prevent interception by a third party, It is possible to adjust the time lag so that the user does not feel uncomfortable or stress.

  The video display unit 203 has a function of displaying the video data sent from the video acquisition unit 202, and can be realized by, for example, a CPU, a main memory, a display, a speaker, a video display program, and the like. Specifically, a mobile information terminal 2a such as a smartphone or a desktop personal computer 2b that receives video data transmitted from the server device S (including all or part of the presentation control subsystem 1) via the communication network 6 Thus, the user can view the live video at the event site and the video with the effect produced. Even users who are physically remote from the event venue are more likely to participate because of the presence, and can feel a sense of unity with other users at the event venue.

(Other input terminals)
As an input terminal other than the user terminal 2 which is a kind of input terminal, as shown in FIG. 2, a sound collecting device 4 for collecting sound at the event venue, an imaging device 5 for imaging the audience seat side at the event venue, and an event One-dimensional or two-dimensional barcode reader that reads the barcodes owned by the event participants that are provided at the venue, a pedometer that is distributed to the event participants, a chair where the participants sit at the event venue or A pressure gauge disposed on the floor, a thermometer provided at the event venue for measuring the temperature in the venue, a hygrometer provided at the event venue for measuring the humidity in the venue are preferred.

  The input device T1, like the input device 201 in the user terminal, has a function of performing an input operation of a specific intention display in a participant who directly participates in an event held at the event venue. Necessary information can be input by various means. Specifically, if it is the sound collection device 4, it is a microphone used for performing voice input operations such as cheering, and if it is the imaging device 5, it is necessary to input image information such as face information of those participants. If it is a barcode reader, it is a light-receiving element that detects the light irradiated to the barcode. If it is a pressure gauge, it is a pressure sensor. If it is a thermometer, it is a temperature sensor. For example, a humidity sensor is preferable.

(Production control subsystem)
As shown in FIG. 2, the production control subsystem 1 has a function for creating, managing, and saving points such as billing points, input points, audio points, and image points, and a predetermined point from a correspondence table of production effects according to the points. A function for selecting a production effect for the video, a function for processing and distributing the video, and the like. As functions for creating, managing, and storing points, a point creation unit 101, a charging point storage unit 102, and an input point storage unit 103 are provided. And it has the production effect selection part 104 as a function which selects a production effect. As functions for processing and distributing video, a live video receiving unit 105, a video storage unit 106, a video processing unit 107, and a video distribution unit 108 are provided. The effect control subsystem 1 includes a server device S, a terminal device, or a series of devices that are a combination thereof. Note that the production control subsystem 1 in FIG. 2 is functionally shown as one block, and the hardware that realizes each function does not necessarily have to be physically integrated into one, It may be distributed in hardware.

  The point creation unit 101 is a function that calculates billing points based on the currency used by the user, or calculates input points based on input work from the user terminal 2, and contrasts with the user in general. It is possible to centrally manage various behavior modes that are difficult to perform at points that play a role like virtual currency on the system of the present invention. For example, it can be realized by a CPU, a main memory, a point creation program and the like.

  Specifically, when a user terminal 2 such as a mobile information terminal 2a such as a smartphone or a user terminal 2 such as a desktop personal computer 2b displays an intention to purchase a charging point, the hardware and software in the server device S constituting the effect control subsystem The software collaborates to check the payment information linked to the user's personal information using a payment system such as a financial institution, and uses the reference data such as a point conversion table to convert the currency used to a predetermined percentage ( For example, charge points are created by calculating charge points by converting 1,000 points for 1,000 yen. This is also the case where the user uses a virtual currency such as various points distributed as currency, uses a credit card, or deposits a predetermined amount by other payment methods such as bank ATMs. However, a billing point is created by calculating a billing point based on the amount and amount of money notified through the settlement organization or financial institution and the personal information of the user associated therewith.

  On the other hand, when the user at the event venue shakes the portable information terminal 2a such as a smartphone held in his hand up and down or left and right, the movement is detected by the acceleration sensor and the portable information terminal 2a is shaken. When notified to the point creation unit 101, input points are calculated by calculating the input points by converting the number of times at a predetermined ratio (for example, 10 points at 100 times) using reference data such as a point conversion table. Create In addition, when the production effect such as the rhythm effect stored in the production effect selection unit 104 of the production control subsystem 1 arrives at a predetermined location in the song, or is displayed on the video display device 3 at an arbitrary timing selected by the director. When this is done, the user or the like at the event venue shakes the portable information terminal 2a such as a smartphone held in hand according to the rhythm effect up and down or left and right, and the point creation unit 101 notified of the state is notified. You can also create input points according to the rhythm effect. At this time, the input points are managed for each user, and are managed so as to be added and shared among a plurality of users. In this way, sharing points between multiple users creates a sense of solidarity among users, and in order to reach a predetermined point, users collaborate with each other to increase input points, The billing points can be transferred to the input points and added. Then, by shaking the portable information terminal 2a such as a smartphone held in the hand up and down or left and right, an inclination is detected by the gyro sensor and an input point is created by calculating from the number of times the portable information terminal 2a is tilted. be able to. Furthermore, based on the character information and symbol information input from the user terminal 2, a font size and color, a specific keyword, An input point can be created by calculating from information such as a symbol. In addition, when an inappropriate character is input as the NG word, a predetermined point can be subtracted from the input point.

  In addition, based on the sound volume input from the sound collection device 4 such as a microphone provided at the event site or the user terminal 2, the volume of the sound is obtained using reference data such as a sound analysis program or a point conversion table. Is converted at a predetermined ratio (for example, 100 points at 100 dB, etc.) to generate a voice point, and then added to the input point.

  Also, color information on clothes, fan fans, banners, etc. taken by the imaging device 5 such as a video camera or a still camera provided at the event venue, and lighting fixtures such as chemical lights called Silium (registered trademark) Based on color information, color information emitted from the portable information terminal 2a, graphic information such as symbol marks of a target singer or character attached to clothes or hats worn by the user, etc. Using reference data such as an analysis program or a point conversion table, the color information and graphic information are specified in a predetermined ratio (for example, 30 points when a specific color in a specific image range occupies 50% or more, specific The image points are calculated by converting to 30 points if the number of specific figures occupies 50% or more of all the figures in the image Create an image point by and adds to the input point.

  It is also possible to design such that a predetermined point is added to the input point as a bonus by satisfying a predetermined condition based on personal information such as the user's sex, birthday, blood type, constellation, address, family structure.

  In this way, a user who thinks that money can be used and a user who does not want to use money participate together, sometimes aiming for a predetermined input point, and sometimes using money. Users who think that it is good can purchase a billing point in order to select an effect that they want to perform themselves, or each user can participate in an event as if it were a game.

  The charging point storage unit 102 has a function of storing the charging points created by the point creation unit 101, and is realized by, for example, a main memory or a secondary storage device. The charging point can be managed and stored for each individual user, and can be continuously stored even when a specific event ends, and can be used in other events.

  The input point storage unit 103 has a function of storing the input points created by the point creation unit 101, and is realized by, for example, a main memory or a secondary storage device. The input points for each individual user participating in a specific event and the total input points among multiple users participating in the specific event are managed and saved, and the specific event ends. Sometimes it can be designed to erase the input points to zero points.

  The production effect selection unit 104 has a function of selecting a production effect for a predetermined point from a production effect correspondence table corresponding to the number of points and the production effect based on each of the billing points and the input points, At any timing selected by the director or at any timing selected by the director, such as a rhythm effect, which is prepared in advance on the system side and has a function of selecting an arbitrary presentation effect that actively encourages participation by the user. , A main memory, a secondary storage device, a communication circuit, a presentation effect selection program, and the like.

  As shown in FIG. 3, the effect control subsystem 1 holds a table of effect effects corresponding to points, and the contents of effect effects on the video display device 3 and the effect device 7 according to predetermined points. Stored.

  For example, on the user terminal 2 of the user who intends to use a billing point, a table of effect effects corresponding to the point is displayed, and a predetermined effect can be selected within the range of the billing points owned. The charged points used are subtracted. Specifically, when 300 points are selected from the billing points and the effect of the cracker is selected, the movie that the cracker bursts in accordance with a predetermined display control rule is combined with the video as the background of the singer or character. Is done. Separately, for example, using 800 points, the effect of displaying the comment is selected, and the total of the charging points used by the user who participated in the event during the event is managed for each user. When ranked in descending order of the total and enters a predetermined ratio such as the top 10 to 40%, the character string of the comment that the user entered in the predetermined comment field on the predetermined application program before the start of the event is produced. As a background for a singer or character, it can be processed to be combined with the video. In addition, there may be an effect that singers and characters directly thank users who have entered such a high percentage from the stage. Moreover, the content of the production effect selected by the user is stored as a history in the user terminal 2 or the production control subsystem 1 and can be browsed by the user even after the event has ended. For example, it is possible to browse the user's own rankings, etc., which billing point is used to select which stage effect is selected during the event. Also, in the production control subsystem 1, depending on the total of the charging points used by the user during the event, different image files (songs) depending on the charging points used by the user in the form of a singer or character after the event ends. Or a message card can be transmitted as data to the user terminal 2 of the user. Furthermore, for users whose total of the billing points used by the user during the event falls within a predetermined percentage such as the top 5-10% of all users, the name of the user from the singer or character after the event ends An incoming message card, a voice message including a voice of a singer or character reading out the user's name can be transmitted as data to the user terminal 2 of the user. Thus, the motivation to participate in an event can be raised by giving a privilege to the user who participated in the event.

  In addition, a user who does not use money acquires input points according to the above-described contents, and uses the acquired input points to select various presentation effects according to predetermined input points and process them into an image. . Specifically, if 1000 input points can be acquired within a predetermined time, a mission that can process a video of 5 fireworks shots is given, and the input points of individual users are combined. If the input point that has been cleared can satisfy the condition, a moving image in which five fireworks fires is processed into a video as a production effect. In addition, if the input points obtained by adding up the input points of the individual users reach 5000 points within a predetermined time without previously presenting conditions to the user in the form of a mission in advance, the character's costume in the video will be changed to another Processing to be changed to costumes is made. The production effect corresponding to the input point can be set so that it can be randomly expressed depending on the type of concert, the video of the concert, the music piece in the concert, or can be set in advance according to the intention of the producer. In addition, there may be an effect that cannot be used depending on the type of video, and in this case, control is separately performed so as to apply a certain restriction. The content of the effect produced in response to the input point is also stored as a history in the user terminal 2 or the effect control subsystem 1 of the user, and can be browsed by the user even after the event ends. it can.

  Furthermore, the effect can be expressed not on the video display device 3 but on the effect device 7. For example, when the smoke generation device which is the production device 7 is provided at the event venue, 1600 points are used from the billing points, or the input points obtained by adding up the input points of individual users reach 1600 points. In some cases, smoke is selected as the production effect from the production effect selection unit 104, and a “smoke” can be generated by issuing a control command to the smoke generating device. In addition, when the lighting device that is the production device 7 is provided at the event venue, 2200 points are used from the charge points, or the input points obtained by adding the input points of individual users reach 2200 points. In some cases, it is possible to select “change lighting color arbitrarily” as the production effect from the production effect selection unit 104 and issue a control command to the illumination device to change the color of the illumination device by predetermined control.

  The live video receiving unit 105 has a function of receiving, as data, a video obtained by shooting a live singer on a stage provided at an event site with a video camera or the like, such as a CPU, a main memory, a communication circuit, and a decoder. Can be realized. This function is not used when a singer who is a living person does not participate.

  The video storage unit 106 has a function of storing a video of a character singing or dancing, and can be realized by a main memory, a secondary storage device, or the like, for example. In order to continuously distribute images randomly or in combination in a predetermined order, it is preferable that images are stored for each program. When there is a possibility that “change character costume” may be selected in the effect effect correspondence table according to the points in FIG. 3, the video of the character wearing a plurality of costumes is stored in the video storage unit 106 in advance. You can also save it.

  The video processing unit 107 has a function of processing by combining the production effect selected or selected by the production effect selection unit 104 based on the video stored in the video storage unit 106, for example, CPU, It can be realized by a main memory, a video processing program, or the like. Specifically, when “comment display” is selected in the effect effect correspondence table according to the point in FIG. 3, the image is stored in the video storage unit 106 in FIG. 4A as shown in FIG. For the video sung by the character located in the center, as a layer behind it in FIG. 4 (b), a series of video that disappears after displaying the input comment is added, and the character in FIG. 4 (c) Create a video, such as the comment displayed behind the singing video. 4 (b) and 4 (c) show a part of a process in which a plurality of comments are displayed and the comments are decomposed over time and disappear while being scattered in a radial pattern.

  When processing is performed by the video processing unit 107, when a specific effect is selected or selected in the effect effect correspondence table according to the point in FIG. 3, or when a rust portion of a song is reached The effect is processed according to the display control rules. This is because depending on the contents of the effect, the timing for adding the effect is important in order to increase the effect.

  Further, the image processing unit 107 can process other production methods. For example, the video processing unit 107 can perform processing to display in parallel the videos sung by two types of singers and characters stored in the video storage unit 106 in advance, and sequentially distribute them to the video distribution unit 108. In that case, for example, when the 0 point displayed at an arbitrary timing is selected or the 0 point is activated at an arbitrary timing as shown in FIG. Move to match battle mode. Then, when entering the battle mode, the point creation unit 101 manages the input points so as to correspond to the two types of singer and character, and the input points accumulated in each singer and character as necessary. The production control subsystem 1 can transmit to the video distribution unit 108 in real time as an image such as a gauge, a numerical value, or a graph and display it on the video display device 3. If the input point corresponding to one character exceeds the input point corresponding to the other character within a predetermined time, the result is transmitted to the video processing unit 107, and the video processing unit 107 displays the video sung by the other character. It is possible to perform the process of selecting and deleting only the video sung by one character and sequentially distributing it to the video distribution unit 108. For example, only one singer or character that has a large number of input points accumulated in the rust portion of the song is displayed on the video display device 3, and the other singer or character is accumulated in the next rust portion. If there are many, only the other singer or character can be displayed on the video display device 3. Also, in those choruses, the singing voice sung by the user together is collected by the sound collecting device 4, and the voice converted by the production control subsystem 1 at a predetermined ratio based on the volume of the inputted voice and the like It is also possible to calculate input points and add them together. Thus, it is possible to give a game characteristic that a winner is finally decided depending on which singer or character has more input points. In addition, the user can select a singer or character to be supported on a specific application program activated on the user terminal 2 during the battle mode, and the singer or character to be supported on the application program can be selected. It can also be displayed large in front. In addition, the user can also change the singer and character who are cheering in battle mode.

  The video distribution unit 108 has a function of distributing the video processed by the video processing unit 107 to the video display device 3 or the user terminal 2. For example, the CPU, main memory, communication circuit, video distribution program, encoder, etc. Can be realized. The video data to be distributed can be encoded as necessary, and can be prevented from being intercepted by a third party.

(Video display device)
The video display device 3 is installed at an event venue and has a function of displaying a video of a concert of a singer or a character for viewing by a plurality of spectators. For example, the video display device 3 is realized by a display or projector having various sizes. It is preferable.

  The video acquisition unit 301 has a function of acquiring the processed video distributed from the video distribution unit 108 of the production control subsystem 1, and includes, for example, a CPU, a main memory, a communication circuit, a video processing circuit, a video reception program, and the like. The video data that is distributed sequentially is accumulated, and the encryption attached to the distributed video data is decrypted as necessary to prevent interception by a third party, It is possible to adjust the time lag so that the user does not feel uncomfortable or stress.

  The video display unit 302 has a function of displaying the processed video acquired by the video acquisition unit 301. Specifically, when the video display device is a display, the display device itself is a liquid crystal screen or the like. When the video display device is a projector, the video display unit 302 is a projection member that projects onto a screen or the like.

(Director)
The stage device 7 has a function of exhibiting a predetermined stage effect installed at the event venue. For example, a smoke generating device that generates smoke, a lighting device that generates various colors, and an acoustic that generates various timbres and sound effects. It is preferably realized by an ignition device such as a device, a torch, or a discharge device that discharges confetti, paper tape, water, or the like.

[Hardware configuration]
FIG. 5 is a schematic diagram showing an example of a configuration when the functions in the effect control subsystem 1 are realized as hardware. The production control subsystem 1 includes a central processing unit (CPU) 11, a main memory 12, a hard disk drive (HDD) 13, a communication circuit 14, and an external interface 15, thereby creating and managing points and production. Various processes such as effect selection and image processing are performed.

  Various programs such as a point calculation program, a production effect selection program, and a video processing program are read into the main memory 12, and the CPU 11 refers to the read program and executes a calculation process according to the procedure indicated by the program. To do. A plurality of addresses are assigned to the main memory 12 and the HDD 13, respectively. In the arithmetic processing of the CPU 11, the arithmetic processing using the data is performed by specifying the address and accessing the stored data. It can be carried out.

  For example, when a user at the event venue shakes the portable information terminal 2 a on which a predetermined application program is executed by hand, the information is transmitted to the communication circuit 14 and the information is stored in the main memory 12. Then, the CPU 11 interprets the point creation program, refers to the point conversion table stored in the HDD 13 from the information, performs conversion into points, and stores it in user information including information on input points in the HDD 13. Process. In addition, when a user who is not at the event site operates the desktop personal computer 2b on which a predetermined application program is executed and performs a payment procedure, the information is transmitted to the communication circuit 14 through a payment system such as a financial institution, and the information is mainly used. Store in the memory 12. Then, the CPU 11 interprets the point creation program, refers to the point conversion table stored in the HDD 13 from the information, performs conversion processing to points, and stores it in user information including information related to the billing points in the HDD 13. Process.

  Then, points based on user requests and predetermined settings are stored in the main memory 12, the CPU 11 interprets the effect selection program, and an effect effect correspondence table corresponding to the points stored in the HDD 13 is created. Referring to FIG. 4, a calculation process for selecting a production effect from the points stored in the main memory 12 is performed.

  Then, the CPU 11 interprets the effect processing program, refers to the effect effect data stored in the HDD 13 corresponding to the selected effect, and further follows the display control rules for the video data stored in the HDD. Processing that combines the effect data is performed, and arithmetic processing for storing the processed video data in the main memory 12 is performed.

  Then, the CPU 11 interprets the video distribution program and performs arithmetic processing for distributing the processed video data stored in the main memory 12 to the user terminal 2 through the communication circuit 14. Note that the communication circuit 14 may be one that can use a wired communication means using a physical cable such as a coaxial cable, a twisted pair cable, or an optical fiber cable, or may be a Wi-Fi (registered trademark) or a Bluetooth (registered trademark). For example, a wireless communication standard that does not use a physical cable as a medium may be used.

  Further, through the external interface 15, the CPU 11 interprets the control command and performs arithmetic processing for performing various controls on the rendering device 7.

[Process flow]
6 and 7 are diagrams showing an example of the flow of processing in the event presentation system of the present invention. The steps shown below may be executed by each hardware configuration of the computer as described above, or may be processing steps that constitute a program for controlling the computer recorded on a medium. good.

  FIG. 6 shows the flow of processing when a user in the event venue participates in an attempt to obtain a presentation effect without displaying video on the user terminal 2 and without paying money. First, the production control subsystem 1 sequentially distributes video images of singers and characters singing and dancing to the video display device 3 (step S0201), and the video display device 3 sequentially receives the video data. (Step S0301), and the video is displayed (Step S0302). The user in the event venue is viewing the video displayed on the video display device 3 in this way.

  Then, at any timing, the user moves the mobile information terminal 2a such as a smartphone held by the user up and down or left and right with a specific application program activated, thereby moving the movement by the acceleration sensor. The movement is detected and the movement is input (step S0101).

  Then, in the production control subsystem 1, reference data such as a point conversion table is obtained from the state in which the mobile information terminal 2a is sent in parallel while continuously delivering the video data to the video display device 3. Is used to create an input point by calculating the input point (step S0202).

  Then, the effect control subsystem 1 stores the input points in the personal information of the user and also stores the input points combined with a plurality of users (step S0203).

  For example, if the input point obtained by adding up the input points of the individual users reaches the predetermined point within a predetermined time, the effect control subsystem 1 refers to the effect effect correspondence table corresponding to the point. Then, the effect according to the input point is selected (step S0204).

  Then, the production control subsystem 1 processes the video data distributed to the video display device 3 by synthesizing the selected production effect (step S0205).

  Then, the production control subsystem 1 sequentially distributes the video data processed by synthesizing the production effects to the video display device 3 (step S0206).

  Further, the video display device 3 receives the video data processed by synthesizing the effect distributed from the effect control subsystem 1 (step S0303).

  Then, in the video display device 3, the processed video data is displayed on a display or the like (step S0304).

  Then, in the production control subsystem 1, it is determined whether or not each piece of music or a series of performances connecting them is finished (step S0207). If not finished, the continuation of the video data is distributed, and if finished, End video data distribution.

  On the other hand, FIG. 7 shows processing when a user who is in the event venue or not in the event venue participates in displaying the video on the user terminal 2 and obtaining an effect even if paying money. The flow is shown. First, the production control subsystem 1 sequentially distributes video images of singers and characters singing and dancing to each user terminal 2 (step S1201), and each user terminal 2 sequentially receives the video data. (Step S1101), and the video is displayed (Step S1102). A user in the event hall and a user in the event hall thus watch the same video.

  Then, the user pays a predetermined amount and amount of virtual currency from the user terminal 2 in which a predetermined application program is activated at an arbitrary timing (step S1103).

  Then, the production control subsystem 1 uses a payment system such as a financial institution to check the payment information associated with the user's personal information and is paid using reference data such as a point conversion table. A billing point is created by calculating the billing point by converting the amount and amount of the virtual currency at a predetermined ratio (step S1202).

  Then, the effect control subsystem 1 stores the billing point in the user's personal information (step S1203).

  Then, for example, the user terminal 2 of the user who intends to use the billing point displays a table of effect effects corresponding to the point, and selects a predetermined effect within the range of the billing points owned. The desired effect is selected (step S1104).

  Then, in the effect control subsystem 1, the effect effect corresponding to the input point is selected with reference to the effect effect correspondence table corresponding to the point (step S1204).

  Then, the production control subsystem 1 processes the video data distributed to the user terminal 2 by synthesizing the selected production effect (step S1205).

  Then, the production control subsystem 1 sequentially distributes the video data processed by synthesizing the production effect to the user terminal 2 (step S1206).

  Further, the user terminal 2 receives the video data processed by synthesizing the effect produced by the effect control subsystem 1 (step S1105).

  Then, in the user terminal 2, the processed video data is displayed on a display or the like (step S1106).

  Then, in the production control subsystem 1, it is determined whether or not a series of performances for each piece of music or a combination of them is finished (step S1207). If not finished, the continuation of the video data is distributed, and if finished, End video data distribution.

  Although not described in FIG. 7, data related to the video distributed to the user terminal 2 is distributed not only to the user terminal 2 but also to the video display device 3, so that the user in the event venue and the event venue The user who is not paying the money is watching the same image regardless of whether the user is paying money or not. In addition, since the user at the event venue bothers to watch the video display device 3 installed at the event venue without watching the video of the mobile information terminal 2a which is the user terminal 2, the mobile information terminal 2a has the effect control subsystem 1 It is preferable that it is possible to select whether or not to receive data relating to video distributed from.

1 ... Production control subsystem 11 ... Central processing unit (CPU)
12 ... Main memory 13 ... Hard disk drive (HDD)
14 ... Communication circuit 15 ... External interface 2 ... User terminal (input terminal)
2a ... portable information terminal 2b ... desktop personal computer 3 ... video display device 4 ... sound collector (input terminal)
5 ... Imaging device (input terminal)
6 ... Communication network 7 ... Production device S ... Server device T ... Other input terminals (devices other than user terminals including sound collecting device and imaging device)

Claims (8)

An effect control subsystem for effect control of the event venue, a plurality of input terminals connected to the effect control subsystem via a communication network, and an effect effect image provided by the effect control subsystem provided in the event venue An event presentation system comprising: a video display device for displaying;
The production control subsystem is
A point creation unit that calculates an input point based on a charge point based on the paid currency and an input operation from the input terminal;
A charging point storage unit for storing the charging points calculated by the point creation unit;
An input point storage unit for storing the input points calculated by the point creation unit;
A production effect selection unit for selecting a production effect according to a charge point stored in the charge point storage unit or an input point stored in the input point storage unit;
A video processing unit that performs processing based on the production effect selected by the production effect selection unit;
A video distribution unit that distributes the video processed by the video processing unit to the video display device;
Have
The input terminal is
An event presentation system comprising an input device for performing the input work. A sound collection device for collecting sound at an event venue as one of the production control subsystem and the input terminal,
The point creation unit
Calculate voice points based on the voice input from the sound collector,
Adding the audio point to the input point and storing it in the input point storage unit;
The event production system according to claim 1, wherein: As an effect control subsystem and one of the input terminals, comprising an imaging device for imaging a spectator seat side in an event venue,
The point creation unit
Calculating an image point based on an image input from the imaging device;
Adding the image points to the input points and storing them in the input point storage unit;
The event presentation system according to claim 1 or 2, wherein It has a production device provided at the event venue,
The event presentation system according to any one of claims 1 to 3, wherein the presentation control subsystem includes a presentation device control unit that controls the presentation device based on the presentation effect. An operation method of an event presentation system, comprising: a video display device provided at an event venue for displaying a video of a selected presentation effect; and a plurality of input terminals connected to the video display device via a communication network. ,
A point creation step of calculating a charging point based on the paid currency and an input point based on an input operation from the input terminal;
An effect selection step for selecting an effect according to the billing point or the input point;
Video processing step for performing processing based on the production effect selected in the production effect selection step;
A video distribution step of distributing the video processed in the video processing step to the video display device;
A method for operating an event presentation system, characterized in that a computer is executed. An audio point creation step for calculating an audio point based on audio input from a sound collection device that collects audio at an event venue provided as one of the input terminals;
An adding step of adding the audio points to the input points;
6. The operation method of the event presentation system according to claim 5, wherein the computer is executed. A program for operating an event presentation system comprising: a video display device that displays a video of a production effect selected at an event venue; and an input terminal connected to the video display device via a communication network,
A point creation step of calculating a charging point based on the paid currency and an input point based on an input operation from the input terminal;
An effect selection step for selecting an effect according to the billing point or the input point;
Video processing step for performing processing based on the production effect selected in the production effect selection step;
A video distribution step of distributing the video processed in the video processing step to the video display device;
A program characterized by causing a computer to execute. An audio point creation step for calculating an audio point based on audio input from a sound collection device that collects audio at an event venue provided as one of the input terminals;
An adding step of adding the audio points to the input points;
8. The program according to claim 7, wherein the program is executed by a computer.

Images