JP2018094326A - Event control system, and event notification system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an event performance control system, its program, and the like capable of enhancing fun based on participation in an event, and at the same time permitting participation in the event continuously, and use of a process up to participation in the event as a target of interest.SOLUTION: A server device 10 executes special performance control processing for extracting a specific participant and providing a special performance toward an observation position on a virtual three-dimensional space of the extracted, specific participant by a performance character, such as an idle character and a robot character to be imaged after being disposed in the virtual three-dimensional space on the assumption that behavior history information of each participant, and an observation position in a virtual event executed in a virtual three-dimensional space are registered in association with each participant ID.SELECTED DRAWING: Figure 7

Description

  The present invention relates to an event presentation control system, an event notification system, a program, and the like used for an event.

  2. Description of the Related Art Conventionally, it is known to use a virtual reality world character such as an animation for an event in a real space by using VR technology or projecting it on a screen or the like. In particular, recently, in the event of the real space, not only the character performs a predetermined movement but also the movement of the character is controlled according to the voice and behavior of the participant (for example, Patent Document 1).

JP 2000-163178 A

  However, in such a conventional system including the device described in Patent Document 1, the character only reacts according to the behavior of the participant at the time of use such as an event, and the system is repeated. Participants' behavior other than that, such as the actual results used and the behavior of the participants until the system is used, are not considered.

  Therefore, in such a conventional system, the system is used continuously (participating in an event using the system) and the process until the system is used (the system is used). There is no motivation to use it as an object of interest in the process of participating in the event.

  The present invention has been made in order to solve the above-mentioned problems, and its purpose is to specify a specific participant based on behavior information, and a special effect such as a character for the specified participant. In addition to improving the interest based on participating in the event (using the system), it is possible to participate in the event continuously (using the system) and An object of the present invention is to provide an event production control system that can be used as an object of interest for a process up to participation (a process up to using the system), a program thereof, and the like.

(1) In order to solve the above problems, the present invention provides a computer,
Control means for controlling a production object or production device used for production of an event in which a plurality of participants participate,
First registration means for registering in the storage means behavior information indicating the behavior related to the event of the participant in association with the identification information of the participant;
Second registration means for registering viewing position information indicating the viewing position information of the event of the participant in association with the identification information of the participant in the storage means; and
An extraction means for extracting a specific participant as a specific participant from a plurality of participants based on the registered behavior information of each participant;
Function as
The control means is
Based on the extracted identification information of the specific participant, specifying the viewing position information of the specific participant,
It has a configuration for controlling execution of a special effect by the effect object or the effect device with respect to the viewing position indicated by the specified viewing position information.

  With this configuration, the present invention can perform a special performance for a specific individual by using a production object or a production device during an event in which a plurality of participants participate, and execute the special production. Participants who are eligible for the event, for example, participants who participated in the same or special event in the past, participants who purchased a specific product related to the event, or participants who performed a cumulative charge over a certain amount related to the event It can be extracted from the behavior information of each participant such as a person.

  Therefore, the present invention is special to, for example, participants who participate in many events, participants who have purchased a specific product, or participants who have been charged more than a certain amount. Since it can provide a production, each participant can maintain or improve the motivation to participate repeatedly in the event, and not only improve the interest based on participating in the event, Participation in an event continuously and the process until participation in the event can also be used as an object of interest.

  As a result, the present invention can improve the interest of the event with respect to the event, and thereby activate the event while attracting customers to the event.

  The “event” may be an event performed in the real space or an event performed in the virtual three-dimensional space. In particular, an event performed in a virtual three-dimensional space is an event in which each participant participates in a virtual three-dimensional space by wearing a device (specifically, a VR device) for experiencing the virtual three-dimensional space. It is. When the event is performed in the virtual three-dimensional space, the viewing position indicates a position set in the virtual three-dimensional space.

  In addition, in the case of real space, the “production object” includes, for example, a target that appears in an event such as a character or a robot that has an entity in the real space, and an image in which participants are displayed during the event. Includes a display object such as an imaged character or robot. In the case of a virtual three-dimensional space, the “effect object” includes, for example, an object arranged and imaged in a virtual three-dimensional space such as a character (idol character or robot character) watched by a participant. It is.

  Furthermore, examples of the “production device” include special effects devices such as bazooka-type and cannon-type crackers that fly decorations such as confetti and tape, lighting devices such as pin-spot-type lights and searchlights, and operational-type devices. Stage devices such as flower roads and seri, acoustic devices such as speakers, or flying devices in which effect objects fly over the audience seats are included.

In addition to the above, “event-related behavior”
[1] Participant's directing action for the directing object or the directing device during an event such as cheering or cheering for the directing object,
[2] Purchase of items (including appearance changes and makeup) to be equipped on the participant's avatar in the case of a virtual event, or a product related to an event such as a production object or event goods used for the production of the event Purchase,
[3] Executed in connection with an event such as charging by purchasing the above-mentioned product, charging by viewing position (that is, seat) or event participation, or charging by providing a twist (that is, a chip) to the production object Charged,
[4] Participation in a past event related to an event in which the same directing object participates, etc.
[5] Production response behavior in the event that has already participated (production response behavior shown in [2]),
[6] A mini game that occurs during an event (for example, a game that can be executed in a virtual three-dimensional space or a game that is linked to an event by a game terminal device in a real space), or a game terminal device before or after the event is held The execution of the game executed in conjunction with is included.

  The “special effect” is an action effect (such as a fan service when the effect object is a character that performs performance such as an idol) from an effect object such as a throwing kiss or message transmission to a specific participant. In addition to the above, there are effects provided by special effects such as an illumination effect in which a specific participant is irradiated with a pin spot or a searchlight by an illumination device, and an effect in which a decoration is blown toward the specific participant by a specific device. included.

(2) The present invention also provides:
The behavior information includes any of the information related to the behavior of the participant, the information related to the billing when the participant has been charged, or the past behavior of the participant or the information related to the billing. Have.

  With this configuration, the present invention, for example, by participating in a specific event in the past or many events, by supporting a production object during the event, by purchasing a specific product, a certain level or more Participants can be provided with special effects by performing billing or by executing a game related to the event.

  Therefore, the present invention can maintain or improve the motivation for each participant to participate repeatedly in the event, and not only provides interest by participating in the event, but also participates in the event. It can provide interest in the process up to.

  In addition, in the “information regarding behavior”, for example, the behavior corresponding to the production of the participant's production object or production device, the purchase of a product (including a virtual item) related to the production object or event, or the above event or related event In the above-described behavior such as participation in the event, the behavior type, the date and time when the behavior was executed, the type of the purchased product or event, or various information such as the number of purchases and the number of executed behaviors are included.

  In particular, a mini-game (for example, a game that can be executed in a virtual three-dimensional space or a game that is linked to an event by a game terminal device in a real space) in which “information on behavior” occurs during the event, or before or during the event In the case of information related to the execution of a game executed in conjunction with the game terminal device later, for example, the date and time (including the login date and time) of the game, the total of the game, the play time in a predetermined period, and the execution of the game Frequency (including login frequency), game level (including player level), items acquired in the game, winning information in gacha, and information based on relationships with friends registered in the game (for example, friends Game history information such as number and playing time with friends).

In addition, in the “information related to charging”, for example, in the charging when purchasing a product, the charging type, the date and time when the charging was performed, the type of the product purchased by charging, the number of purchases and the number of times of charging (frequency) Or various information, such as the information regarding the charge at the time of performing said game, is contained.

(3) The present invention also provides:
When the event is an event performed in a virtual three-dimensional space in which the viewing position of each participant is set,
For each participant, the viewing position of each participant in the virtual three-dimensional space is set as the position of the virtual camera corresponding to each participant, and the viewing direction of each participant is viewed from each virtual camera as a viewpoint. Further causing the computer to function as image generation means for generating visible images of a virtual three-dimensional space,
The control means is
Controlling execution of a special effect in the virtual three-dimensional space by the effect object or the effect device with respect to the viewing position of the specific participant set in the virtual three-dimensional space. .

  With this configuration, the present invention allows each participant to participate in an event in a virtual three-dimensional space, so that the event can be provided to many participants over time and space, and an idle character can be provided. It is possible to provide an event fused with an unreal world (for example, the world of animation) such as touching.

  The effect object includes, for example, a character that performs an action such as performance in a virtual three-dimensional space such as an idol, or a character that faces a participant according to a preset scenario (RPG or reasoning game) (dynamic As well as objects that are observed by participants and controlled by a computer (character objects).

(4) The present invention also provides:
In the storage means,
In association with each viewing position set in the virtual three-dimensional space, information indicating the participation position of the participant who participates in the event set in a given real space is stored as participation position information,
The control means is
It has the structure which controls execution of the special production | presentation by the said production | presentation object or the said production | presentation apparatus with respect to the viewing position in the virtual three-dimensional space of the said specific participant who exists in the said participation position.

  With this configuration, the present invention can participate in an event in the virtual three-dimensional space from the viewing position of the virtual three-dimensional space by allowing the participant to exist at the participation position in the real space. Even if it is an event, it is possible to provide the atmosphere and excitement as an event in real space.

(5) The present invention also provides:
The image generating means
In response to the participant's line-of-sight input received by the receiving means, the display means has a structure that covers the field of view of the participant and is configured by a wearable image display device that visually recognizes the image in the virtual three-dimensional space. The generated virtual three-dimensional space image is displayed.

With this configuration, the present invention can apply a virtual three-dimensional space that changes according to the position and posture of the participant's head to the virtual three-dimensional space. It can provide the feeling of experiencing an event.

  Therefore, the present invention can enhance the immersive feeling of the participants and improve the interest of participating in the event.

(6) The present invention also provides:
An accepting unit for executing processing for accepting at least an input of a gaze direction in the real space of the participant as a gaze input by the participant; and
Detecting means for detecting whether or not the input gaze of the specific participant is heading toward the effect object or the effect device;
Function the computer as
The control means is
When it is detected that the input line of sight of the specific participant is heading toward the effect object or the effect device, the effect is performed with respect to the viewing position indicated by the detected viewing position information of the specific participant. It has a configuration for controlling execution of a special effect by the object or the effect device.

  With this configuration, when the specific participant's line of sight is directed to the effect object or the effect device, the present invention performs a special effect by the effect object or the effect device on the specific participant (that is, activation). Therefore, it is possible to reliably provide the specific participant with a special performance.

  The event in this case need not be limited to the event in the virtual three-dimensional space. Even in the real space, the gaze direction is detected, and the position of the effect object or the effect device in the real space is detected. If possible, it will be feasible.

(7) The present invention also provides:
Causing the computer to function as determination means for determining whether or not each participant exists at the viewing position;
The control means is
When it is determined that the participant is present at the viewing position, control is performed to start the event.

  With this configuration, the present invention can automatically start an event when a participant is present at the viewing position, such as when the participant arrives at the viewing position, so that each participant can participate without depending on other participants. The event can be started at the timing of the person, and the participant can easily participate in the event without being caught by time.

  The event in this case need not be limited to the event in the virtual three-dimensional space, and can be applied to the real space or any event that does not cause a problem even if the event is started for each participant.

  Further, as the “determination means”, for example, the GPS attached to each participant, each human position provided in each participation position in the real space corresponding to each viewing position in the real space or the viewing position in the virtual three-dimensional space It is determined whether each participant exists at the viewing position according to a detection result of a sensor or a detection system capable of detecting an object in an event space (real space) that detects the position and depth of a light emitter. Anything that can be done.

(8) The present invention also provides:
Causing the computer to function as storage control means for storing an image of the event in the storage means during the event;
The storage control means is
When the image of the event is being stored and the effect object or the effect device is executing the special effect, the information indicating the viewing position to which the special effect is provided or the viewing position The information is stored in the storage unit in association with the stored image of the event.

  With this configuration, the present invention can provide a viewing position (for example, a viewing position indicating a column and a number of a seat or the like) that is a destination for providing the special effect in accordance with the execution timing of the special effect when the event image is reproduced. No.) and participant information (participant identification information, name or attribute, or nickname assigned to each participant in advance) associated with the viewing position information of the viewing position can be provided. , Can provide a different interest than the event.

  Therefore, according to the present invention, an event can be interesting from various angles, so that the attractiveness as content in such an event can be enhanced and the event itself can be activated.

  The viewing position and the participant information may be provided by a telop or a balloon superimposed on the image, or may be composed of the participant's face or a pre-registered image in addition to the character information. You may provide by image information, such as a thumbnail image.

  The “event image stored during the event” may be an image of each participant's virtual camera itself in the virtual three-dimensional space, or an image edited by switching a plurality of virtual cameras. In real space, it may be an image (including an image obtained by editing each of the plurality of captured images) captured by a single or a plurality of imaging cameras.

(9) In order to solve the above problems, the present invention provides:
First registration means for registering, in the storage means, behavior information indicating behavior related to the event of each participant in association with identification information of a plurality of participants participating in the event,
Second registration means for registering in the storage means viewing position information indicating the viewing position information of the event of the participant in association with the identification information of the participant;
Based on the registered behavior information of each participant, an extraction means for extracting a specific participant as a specific participant from a plurality of participants, and
Based on the extracted identification information of the specific participant and the stored viewing position information, the specific participant serving as a providing destination for providing a special effect by the effect object or effect device used for the event Notification control means for controlling the notification means for notifying the viewing position of
It has the structure which functions as.

  With this configuration, the present invention can cause a special effect for a specific individual to be implemented by a production object or a production device during an event in which a plurality of participants participate, and execute the special production. Participants who are eligible for the event, for example, participants who participated in the same or special event in the past, participants who purchased a specific product related to the event, or participants who performed a cumulative charge over a certain amount related to the event It can be extracted from the behavior information of each participant such as a person.

Therefore, the present invention is, for example, a specific participant among a plurality of participants who participate in many events, purchase a specific product, or execute charging more than a certain amount. As a special performance can be provided, the motivation to participate repeatedly in the event can be maintained or improved for each participant, and only the interest by participating in the event is provided. In addition, it can provide interest in the process up to participation in the event.

(10) Moreover, in order to solve the said subject, this invention is a control means which controls the production | presentation object used for production of the event in which a some participant participates, or a production apparatus,
First registration means for registering in the storage means behavior information indicating behavior related to the event of the participant in association with the identification information of the participant;
Second registration means for registering viewing position information indicating the viewing position information of the event of the participant in association with the identification information of the participant in the storage means;
An extracting means for extracting a specific participant as a specific participant from a plurality of participants based on the registered behavior information of each participant;
With
The control means is
Based on the extracted identification information of the specific participant, specifying the viewing position information of the specific participant,
It has a configuration for controlling execution of a special effect by the effect object or the effect device with respect to the viewing position indicated by the specified viewing position information.

  With this configuration, the present invention can cause a special effect for a specific individual to be implemented by a production object or a production device during an event in which a plurality of participants participate, and execute the special production. Participants who are eligible for the event, for example, participants who participated in the same or special event in the past, participants who purchased a specific product related to the event, or participants who performed a cumulative charge over a certain amount related to the event It can be extracted from the behavior information of each participant such as a person.

  Therefore, the present invention is, for example, a specific participant among a plurality of participants who participate in many events, purchase a specific product, or execute charging more than a certain amount. As a special performance can be provided, the motivation to participate repeatedly in the event can be maintained or improved for each participant, and only the interest by participating in the event is provided. In addition, it can provide interest in the process up to participation in the event.

(11) Moreover, in order to solve the said subject, this invention matches with each of the identification information of the some participant who participates in an event, and memorize | stores the behavior information which shows the action relevant to the said event of each participant First registration means for registering with
Second registration means for registering viewing position information indicating the viewing position information of the event of the participant in association with the identification information of the participant in the storage means;
An extracting means for extracting a specific participant as a specific participant from a plurality of participants based on the registered behavior information of each participant;
Based on the extracted identification information of the specific participant and the stored viewing position information, the specific participant serving as a providing destination for providing a special effect by the effect object or effect device used for the event A notification control means for controlling the notification means for notifying the viewing position.

With this configuration, the present invention can cause a special effect for a specific individual to be implemented by a production object or a production device during an event in which a plurality of participants participate, and execute the special production. Participants who are eligible for the event, for example, participants who participated in the same or special event in the past, participants who purchased a specific product related to the event, or participants who performed a cumulative charge over a certain amount related to the event It can be extracted from the behavior information of each participant such as a person.

  Therefore, the present invention is, for example, a specific participant among a plurality of participants who participate in many events, purchase a specific product, or execute charging more than a certain amount. As a special performance can be provided, the motivation to participate repeatedly in the event can be maintained or improved for each participant, and only the interest by participating in the event is provided. In addition, it can provide interest in the process up to participation in the event.

It is a block diagram which shows the schematic structure in 1st Embodiment of the event presentation control system which concerns on this invention. It is a figure for demonstrating the outline | summary of the event of 1st Embodiment. It is an example of the functional block diagram which shows the structure of the server apparatus in 1st Embodiment. It is an example of the functional block diagram which shows the structure of the terminal device in 1st Embodiment. It is an example of the figure which shows the external appearance structure of the terminal device in 1st Embodiment. It is a figure for demonstrating the relationship between the viewing position and the real space event holding place in the virtual event in 1st Embodiment. It is FIG. (1) for demonstrating the special effect control process in 1st Embodiment. It is FIG. (2) for demonstrating the special effect control process in 1st Embodiment. It is a flowchart which shows the operation | movement of the execution process in the virtual event including the special effect control process performed by the server apparatus of 1st Embodiment. It is a figure for demonstrating the structural example in 2nd Embodiment of the event presentation control system which concerns on this invention. It is a figure for demonstrating the modification of the event effect control system which concerns on this invention in 22nd Embodiment.

  Hereinafter, embodiments will be described. The embodiments described below do not unduly limit the contents of the present invention described in the claims. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

[A] First Embodiment First, a first embodiment of the event effect control system according to the present invention will be described. Note that this embodiment provides an event according to the present invention for a system in which an event is executed in a virtual three-dimensional space while wearing a HMD (head mounted display) as a wearable image display device for a plurality of participants. It is embodiment at the time of applying a production control system and a program.

[A1] Event production control system (virtual space)
[A1.1] Outline First, the outline and outline structure of the event effect control system 1 of the present embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an example of a system configuration showing the configuration of the event presentation control system 1 of the present embodiment.

The event presentation control system 1 of the present embodiment makes a participant character (hereinafter referred to as “avatar”) appear for each participant in the virtual space, and as if it exists around the participant. This is a system that provides a VR experience (virtual reality experience) to be recognized as an event (hereinafter referred to as “virtual event”).

  In particular, the event effect control system 1 of the present embodiment is a character (hereinafter referred to as a character object that is a virtual object in a virtual three-dimensional space where a participant is a virtual three-dimensional idol (a so-called character object watched by a participant). As a fan of "acting characters"))), the theme is to view a live stage (hereinafter also referred to as "stage") that performs virtual acting performance (specifically, singing live) It has a configuration that provides a simulation capable of three-dimensional stereoscopic viewing as a virtual event.

  In other words, the event effect control system 1 of the present embodiment has an action of sending a line of sight toward the participant in the virtual three-dimensional space (that is, toward the position of the virtual camera) or acting on the participant as the acting character. Acting characters that perform specially provided actions (acting fan services for participants when the acting characters and participants have a relationship between idols and fans, hereinafter referred to as “fan services”), etc. It has a configuration for providing an event including gaze.

In addition, the event production control system 1
(1) The generated virtual 3D space image is displayed in 3D on an HMD (wearable image display device) having a structure that covers the field of view of the participant and visually recognizing the virtual 3D space image,
(2) Control the virtual camera based on the attitude of the HMD,
(3) The event detected by the detecting means provided in the HMD, etc., accepts the participant's input including the visual line direction of the participant wearing the HMD and advances the event.

  Specifically, as shown in FIG. 1, the event presentation control system 1 includes a server device 10 that executes various processes for realizing a virtual event in a virtual three-dimensional space, and an HMD that is worn by a participant. And a terminal device 20 (for example, terminal devices 20A, 20B, and 20C) that allows a participant to experience an event in a virtual three-dimensional space using data transmitted from the server device 10 via a network. It can be connected to the network.

  The server device 10 is an information processing device that executes various processes for realizing a virtual event executed using, for example, an API (Application Programming Interface) or a predetermined platform.

  Further, the server device 10 may be configured by one (device, processor) or may be configured by a plurality (device, processor).

  A database (storage device in a broad sense) is connected to each information such as billing information and participant information stored in a storage area (storage unit 140 described later) of the server device 10 via a network (intranet or the Internet). Or information such as event information stored in the storage area may be stored in a database (storage device or memory in a broad sense) connected via a network (intranet or the Internet). You may make it do.

  In particular, the server device 10 receives input information based on an operation (participant input) of a user of the terminal device 20 (that is, a participant who participates in a virtual event), and in the virtual three-dimensional space based on the received input information. Processing for realizing a virtual event is performed.

  Then, the server device 10 receives the data (including data for displaying the image) in which the space (that is, the event space) to be executed by the event is converted into a three-dimensional image and each data related to the event execution process, from the terminal device 20. Send to.

  The terminal device 20 includes an HMD unit 200 and a terminal control unit 300. The terminal device 20 displays an image obtained by converting the event space into a virtual three-dimensional image, and provides performance performance and the like in the virtual three-dimensional space. It is a device for experiencing events.

  The terminal device 20 is configured by an information processing device such as an image generation device such as a smartphone, a mobile phone, a PHS, a computer, a game device, a PDA, or a portable game device, and a network such as the Internet (WAN) or a LAN. It is a device that can be connected to the server device 10 via the network. The communication line between the terminal device 20 and the server device 10 may be wired or wireless.

  In addition, the terminal device 20 performs display control using a communication control function for performing communication with the server device 10 and data received from the server device 10, and the operation information input by the participant is displayed on the server device. 10 and the like.

  And the terminal device 20 has a structure which provides a participant with a virtual event based on each information transmitted from the server apparatus 10. FIG.

[A1.2] Description of Virtual Event Next, an outline of a virtual event realized by the present embodiment as a VR experience will be described with reference to FIG. FIG. 2 is a diagram for explaining the outline of the virtual event of the present embodiment.

  For example, as shown in FIG. 2A, the virtual three-dimensional space 11 is constructed as a VR space (virtual three-dimensional space). The virtual three-dimensional space 11 includes a stage that is a live stage performance hall. 4 and a plurality of bleachers 6 on which avatars 5 as avatars are arranged.

  An idle character 8 (acting character), which is an NPC (non-avatar), acts on the stage, and the participant 2 can watch the performance of the idle character 8 via the avatar 5.

  The content of the live stage is a live performance such as song singing, musical instrument performance, dance, street performance, etc. For example, in this embodiment, a live performance is performed to sing a song with choreography. .

  The stage 4 can be set as appropriate, for example, an outdoor stage, a concert hall, or a live house. In addition, depending on the contents of the virtual event, it is possible to set situations such as a school gymnasium stage, classroom platform, truck bed, deck, etc.

  The viewing seat 6 is a viewing position for viewing the live stage, and a large number of people are prepared for each seat at one live stage venue. The arrangement layout of the auditorium 6 can be appropriately set according to the design of the stage 4. FIG. 2A shows an example in which the viewing seat 6 is set as a standing seat. However, it may be a seating type.

  The seats 6 are assigned to the participants for each virtual event, and each seat of the seats 6 is associated with the ID of the participant and stored as the seat information in the server device 10. In particular, in this embodiment, a participant visits a specific place (hereinafter referred to as “real space event holding place”) 7 such as a concert hall, a multipurpose hall, or a movie theater in a real space, and is in a virtual three-dimensional space. Therefore, each seat of the auditorium 6 is associated with each seat of the real space event holding place 7. However, in the virtual event, it may be possible to participate in any place as long as the terminal device 20 can be used without visiting a specific place in the real space.

  An avatar 5 having a role as an idol fan is arranged in the auditorium 6, and a participant is associated with at least one of the avatars 5 whose appearance, appearance, items, etc. are set in association with a virtual event. I will participate in.

  The composition of the sex, age, and number of the idle characters 8 performing the performance can be set as appropriate. In particular, in the present embodiment, as shown in FIG. 2A, the idle character 8 is composed of a pair of a first idle character (first acting character) 8A and a second idle character (second acting character) 8B. It is configured. However, it may be composed of one person or a group of three or more persons.

  For example, as shown in FIG. 2B, each avatar 5 is automatically controlled so as to be synchronized with and linked to the action of the participant detected by the HMD unit 200 attached to the participant 2.

  Specifically, the posture of the head of the avatar 5 is synchronized with the head posture of the participant 2 detected by the HMD unit 200, and the avatar 5 is based on the line-of-sight direction of the participant detected by the HMD unit 200. Are synchronized, and the avatar 5 in the virtual three-dimensional space 11 is automatically controlled based on these participant inputs.

  At the position of the avatar 5 in the virtual three-dimensional space 11, the virtual cameras for the right eye and the left eye, in which the shooting angle of view and the depth of field are set to be equivalent to the viewing angle of the person, face the front of the head. The images that have been set and photographed with these are displayed on the HMD unit 200 (specifically, a right-eye display panel 261 and a left-eye display panel 262 described later), respectively. Therefore, the participant 2 can visually recognize the image in the virtual three-dimensional space 11 as a three-dimensional image through the eyes of the avatar 5 by changing the head direction, posture, and line-of-sight direction. Yes.

  In addition, in the seating area 6, an avatar 5 associated with each participant is arranged in each seat. However, even in the bleacher seat 6 where the avatar 5 is not arranged, the NPC is automatically arranged and is automatically controlled by the computer so as to act as an idol fan.

  In the virtual event of this embodiment, the avatar 5 associated with each participant may or may not be displayed in the virtual three-dimensional image provided to each participant. Similarly, for the avatars 5 of other participants, the three-dimensional images provided to the participants may be displayed or may not be displayed.

[A2] Server Device First, the outline and configuration of the server device 10 of this embodiment will be described with reference to FIG. FIG. 3 is a diagram illustrating functional blocks of the server device 10 according to the present embodiment. Moreover, the server apparatus 10 of this embodiment is good also as a structure which abbreviate | omitted a part of component (each part) of FIG.

The server device 10 includes a server processing unit 100 that executes a process for providing a virtual event in a virtual three-dimensional space, an input unit 120 for use by an administrator and other inputs, a display unit 130 that performs a predetermined display, a virtual A storage unit 140 that stores events and data of each participant, an information storage medium 180 that stores predetermined information, and a communication unit 196 that communicates with the terminal device 20 and others are included.

  The input unit 120 is used by a system administrator or the like for settings related to virtual events, other necessary settings, and data input. For example, the input unit 120 of this embodiment is configured with a mouse, a keyboard, and the like.

  The display unit 130 displays an operation screen for the system administrator. For example, the display unit 130 of the present embodiment is configured by a liquid crystal display or the like.

  The information storage medium 180 (computer-readable medium) stores programs, data, and the like, and functions as an optical disk (CD, DVD), magneto-optical disk (MO), magnetic disk, hard disk, and magnetic tape. Or a memory (ROM) or the like.

  The communication unit 196 is a device that performs various controls for communicating with the outside (for example, a terminal, another server, or another network system), and functions as hardware such as various processors or a communication ASIC. Hardware and programs.

  The storage unit 140 serves as a work area for the server processing unit 100, the communication unit 196, and the like, and its function is configured by a RAM (VRAM) or the like. Note that information stored in the storage unit 140 may be managed in a database. For example, the storage unit 140 constitutes a storage unit of the present invention.

  Further, in the present embodiment, the storage unit 140 includes a main storage unit 1422 used as a work area, production information 144 related to effects in a virtual event to be provided, participant information 146 related to each participant, and information on the bleachers 6. And image (hereinafter referred to as “event image”) 149 relating to an event such as an image (hereinafter referred to as “virtual camera image”) from the viewpoint of each virtual camera in the virtual event. Is done. However, the storage unit 140 stores various types of information necessary for event calculation in addition to the above-described information.

  In particular, the participant information 146 includes participant identification information such as name information, age, sex, and account information for performing payment settlement, and avatar information in association with a participant ID for each participant. The avatar information includes basic shapes (basic shapes (including sizes) of people, animals, robots, etc.), appearances (including colors) of hairstyles and makeup, hairstyles), and items (costumes, Each piece of information for setting avatars such as ornaments and personal belongings (towels and psyllium) is included.

  In addition, the participant information 146 includes behavior history information in which behavior information indicating behavior of each participant related to the event, such as participation of a past virtual event or purchase of a product related to the virtual event, is listed, and each participant Includes billing history information in which billing information indicating the billing status at the time of billing in accordance with behavior is listed, and viewing position information indicating a viewing position of a real space event holding place when participating in a virtual event .

  The billing history information includes a billing date and time indicating the date and time when billing was performed, a type of billing element such as purchase of an item related to a virtual event or a twist used in a virtual event, a billing amount indicating a billed amount, etc. included.

  On the other hand, the seat information 148 includes table data in which each seat of the real space event holding place 7 and each seat of the virtual event viewing seat 6 are associated with each other.

  The server processing unit 100 performs various processes using the main storage unit 142 in the storage unit 140 as a work area. The functions of the server processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.), ASIC (gate array, etc.), and programs.

  The server processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, the information storage medium 180 stores a program for causing a computer to function as each unit of the present embodiment (a program for causing a computer to execute processing of each unit).

  For example, the server processing unit 100 (processor) controls the entire server device 10 based on a program stored in the information storage medium 180, and controls the execution of a virtual event, a special effect control process, an image Processing such as generation processing or sound generation processing is performed.

  Further, the server processing unit 100 controls the execution of a virtual event as a process for starting a virtual event when a virtual event start condition is satisfied, a process for advancing a virtual event, an object space such as a character or a map ( A process of arranging various objects in a (three-dimensional space), a process of displaying an object, a process of calculating a virtual event result, or a process of ending a virtual event when a virtual event end condition is satisfied is executed.

  Specifically, the server processing unit 100 according to the present embodiment includes a communication control unit 101, a user management unit 102, an information acquisition unit 104, a participant behavior management unit 105, an event control unit 110, a virtual camera control unit 106, and a sound. It has at least a generation unit 107, an image generation unit 108, an image editing / playback unit 109, and a timer unit 160.

  For example, the event control unit 110 of the present embodiment constitutes an extraction unit, a control unit, a determination unit, and a detection unit of the present invention, and the information acquisition unit 104 constitutes a reception unit of the present invention. Further, for example, the participant behavior management unit 105 of the present embodiment constitutes a first registration unit and a second registration unit of the present invention, and the image generation unit 108 constitutes an image generation unit of the present invention. Furthermore, for example, the image editing / playback unit 109 of this embodiment constitutes a storage control unit of the present invention.

  The communication control unit 101 performs processing for transmitting and receiving data to and from the terminal device 20 via the network. That is, the server device 10 performs various processes based on various information including the operation information of the participant received from the terminal device 20 or the like by the communication control unit 101.

  The user management unit 102 performs processing related to the user registration procedure and storage management of data associated with an account (participant ID).

  Specifically, the user management unit 102 controls account assignment, registration information management for registering and managing personal information related to users, and a virtual account that is used as a payment source for consideration associated with the execution of a billing element associated with an account. Setting and deposit / withdrawal control, registration of billing history related to billing elements by the user of the account, and event progress information related to virtual event progress status are stored and managed in association with the account.

  The information acquisition unit 104 acquires various information necessary for the processing of the server processing unit 100. That is, the receiving process of these information is performed. For example, the information acquisition unit 104 acquires participant operation information from each terminal device 20.

  Specifically, the information acquisition unit 104 is detected by the line-of-sight information of the participant based on the image information captured by the imaging unit 210 of the HMD unit 200 in the terminal device 20 during the virtual event, and detected by the motion sensor 220 of the HMD unit 200. Operation of a participant including information (hereinafter referred to as “motion detection information”) and switch input information (hereinafter referred to as “switch input information”) input in conjunction with the virtual event during execution of the virtual event. Get information.

  In particular, the information acquisition unit 104 acquires information about each of the three axes about the participant's head as motion detection information using the motion sensor 220, and determines the rotation angle around the three axes based on the acquired motion detection information. By obtaining the information on the direction in which the participant's head faces, the imaging information obtained by imaging the direction of the participant's eyeball may be acquired, and a predetermined value may be obtained with respect to the acquired imaging information. While performing image processing, line-of-sight information indicating the line-of-sight direction of the participant may be acquired using the direction of the participant's head calculated based on the motion detection information.

  Note that the information acquisition unit 104 may acquire line-of-sight information based on operation information from the input unit 260 (for example, a controller) of the terminal device 20. For example, the information acquisition unit 104 acquires (identifies) line-of-sight information based on operation information obtained by a participant operating a direction instruction key, an analog stick, an operation button, or the like provided in the input unit 260. May be.

  In addition to the motion detection information of the motion sensor 220, the line-of-sight information of the participant may be acquired using an image obtained by imaging a plurality of light emitting elements (LEDs) of a light emitting unit (not shown) by an imaging unit (not shown).

  Further, the line-of-sight information of the participant may be detected using information other than the motion detection information of the HMD unit 200. For example, an imaging unit (not shown) is provided with a depth sensor that can detect depth information (depth information) in a three-dimensional space, and the skeleton information of the participant is extracted using the color image from the color image sensor and the depth information from the depth sensor. Then, the line-of-sight information of the participant may be acquired using the extracted skeleton information.

  For each participant, the participant behavior management unit 105 performs an event-related behavior such as participation of a related event (such as participation of the same event in the past) or purchase of event goods of an event to participate based on an instruction from the participant. Information related to the event including the type and time of the action is associated with the participant ID and registered in the participant information 146 (action history information).

  In addition, the participant behavior management unit 105 registers billing information in the participant information 146 (billing history information) corresponding to the participant ID for behaviors that involve billing such as product purchases in the managed behavior.

  Then, the participant behavior management unit 105 executes a billing process in the billing element in the virtual event, and stores information related to billing (that is, billing information) in the participant behavior information 148 as a billing history (hereinafter referred to as “billing”). Process ").

  In particular, in the present embodiment, as a billing element, a billing amount charged to make a dressing degree such as the appearance of an avatar (for example, makeup, a costume or an item), a predetermined item (for example, a present or a twist) ) And a parameter corresponding to the amount charged for executing a virtual event such as continue or gacha.

Further, the participant behavior management unit 105 calculates a cumulative billing amount during the execution of the virtual event for each participant based on the billing history information in which the billing information is registered as a history.

  Note that the participant behavior management unit 105 requests charging by using virtual currency or points, or using a credit card or prepaid card, and executes each charging process based on instructions from the participant. To do.

  The event control unit 110 performs various processes related to virtual event execution management. The event control unit 110 according to the present embodiment performs control to provide data necessary for virtual event play while communicating with the terminal device 20.

  Specifically, the event control unit 110 includes an event management unit 111, a bleacher setting unit 112, an avatar setting unit 113, an object control unit 114, an avatar line-of-sight control unit 115, and a special control execution unit 117.

  For example, the special control execution unit 117 of the present embodiment constitutes the extraction unit, control unit, determination unit, and detection unit of the present invention in conjunction with the object control unit 114.

  The event management unit 111 executes various processes related to the execution of the virtual event including the performance start process and the end process including the performance of the performance character, and the process of executing each virtual event.

  In particular, the event management unit 111 sets and sets a live stage in a virtual three-dimensional space where the acting character performs, based on the operation input of the participant, when performing a virtual event including the acting of the acting character. Various controls such as reproduction and lighting of music during performance (that is, during performance) for the performance character to perform in the live stage are executed.

  The seat setting unit 112 sets the arrangement position of the avatar of the participant in the live stage set by the event management unit 111 based on the operation input of the participant, that is, the viewing position of the stage, and corresponds to the viewing position. A virtual camera (for the right eye and for the left eye) is set as the viewpoint of the participant to be played.

  The seat setting unit 112 of the present embodiment sets the viewing position by making a reservation designation as a seat before the live stage is held.

  The avatar setting unit 113 sets an avatar associated with the participant based on the operation input of the participant, and registers the set avatar in the participant information 146.

  Specifically, the avatar setting unit 113, based on the operation of the participant, the basic shape (basic modeling (including size) such as a person, animal or robot), and the appearance (including color) such as a hairstyle and makeup. , Hairstyle) and items (costumes, decorations, personal belongings (towels and psyllium)) that you own to make settings for dressing.

  Moreover, the avatar setting part 113 performs the setting for making an avatar be dressed by selecting a predetermined part etc. When an avatar is set by billing, the avatar setting unit 113 performs setting of the avatar in conjunction with the participant behavior management unit 105 for the portion for which billing has occurred.

In addition, the expiration date is set in the components and items of the appearance of the avatar, and the avatar setting unit 113 has the expiration date even if it is already owned by the participant. Even if a setting instruction of a participant is input, control is performed so that setting is impossible.

  On the other hand, the avatar setting unit 113 selects items associated with actual articles such as costumes and equipment (including presents and twists for acting characters) that exist in the real space based on the operations of the participants. It has the structure which can be set to.

  Specifically, for example, when the avatar setting unit 113 acquires identification information such as a product number assigned to an article transmitted from the terminal device 20 by a participant's operation or code information of a two-dimensional barcode, the identification is performed. An item that is associated with the information and that is digitized for the article can be set as the corresponding avatar.

  Note that items may be provided by a medium such as a virtual event card instead of an actual article, and conceptual items such as twists are similarly provided by a medium such as a virtual event card.

  In addition, when used during a virtual event such as a performance of an acting character such as twisting, the avatar setting unit 113 pre-registers the participant information 146 as an item before starting the virtual event based on the operation of the participant. Can be registered.

  The object control unit 114 performs setting processing of an object space (a virtual three-dimensional space that is a three-dimensional virtual space) in which a plurality of objects are arranged. For example, various objects representing display objects such as characters (people, animals, robots, etc.), maps (terrain), buildings, courses (roads), trees, walls, water surfaces (primitive surfaces such as polygons, free-form surfaces or subdivision surfaces) The object is arranged and set in the object space. In other words, the position and rotation angle of the object in the world coordinate system (synonymous with direction and direction) are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Arrange objects.

  Specifically, the storage unit 170 stores object data that is data such as the position, rotation angle, moving speed, and moving direction of an object (part object) in association with the object number. Further, the object control unit 114 performs a process of updating the object data for each frame, for example.

  The object control unit 114 also controls the movement of various objects including the acting character and the movement of the various objects such as the acting character and the avatar in the virtual three-dimensional space.

  In particular, the object control unit 114 performs, for each acting character, the movement of each part including choreography (face choreography, eye movement, line-of-sight direction, body direction, speech) on the stage during a virtual event including during performance performance. ) To control.

  Further, the object control unit 114 arranges each participant's participant character at a position in the virtual three-dimensional space of each participant, and based on a participant input including the visual line direction of each participant, or a virtual event The movement of the avatar which is each participant character is controlled according to the situation.

  The avatar line-of-sight control unit 115 controls the avatar's line of sight by controlling the posture of the virtual camera associated with the participant based on the line-of-sight input that is the operation input of the participant output from the terminal device 20.

  The special control execution unit 117 produces effects for specific participants (hereinafter referred to as “specific participants”) based on the registered participant information 146 (behavior history information and billing history information) of each participant. A control process (hereinafter referred to as “special effect control process”) for controlling a special effect (hereinafter referred to as “special effect”) in an effect device (lighting device or special effect device) used for a character or a virtual event is executed. To do.

  The virtual camera control unit 106 generates a virtual camera (viewpoint, reference virtual camera) for generating an image that can be seen from a given (arbitrary) viewpoint in the object space (position where the participant object is arranged in the present embodiment). The control process is performed.

  Specifically, processing for controlling the position (X, Y, Z) or rotation angle (rotation angle about the X, Y, Z axis) of the virtual camera (processing for controlling the viewpoint position, the line-of-sight direction or the angle of view) I do.

  The image generation unit 108 performs drawing processing based on the results of various processing (virtual event processing, simulation processing) performed by the server processing unit 100, thereby generating an image, and the generated image data is sent to the terminal device 20. Send.

  Specifically, the image generation unit 108 performs geometry processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, perspective transformation, or light source processing, and draws data ( The position coordinates, texture coordinates, color data, normal vector, α value, etc.) of the vertexes of the primitive surface are created. Based on the drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after the perspective transformation (after the geometry processing) is converted into image information in a pixel unit such as a drawing buffer (frame buffer, work buffer, etc.) not shown. Is drawn in a buffer that can store Thereby, an image that can be seen from the virtual camera (given viewpoint) in the object space is generated.

  Note that the drawing processing performed by the image generation unit 108 can be realized by vertex shader processing, pixel shader processing, or the like.

  Then, the image generation unit 108 visually recognizes an image in a virtual three-dimensional space having a predetermined amount of parallax with both eyes of the participant wearing the HMD unit 200 to realize stereoscopic viewing (right eye and left eye). For).

  The sound generation unit 107 performs sound processing based on the results of various processes performed by the server processing unit 100, generates virtual event sounds such as BGM, sound effects, or sounds, and the HMD unit via the communication unit 196. 200 (specifically, the sound output unit 240).

  The vibration generation unit 150 generates control data for controlling a pattern for vibrating the vibrating body 341 provided in the terminal device 20 based on the results of various processes performed by the server processing unit 100 and outputs the control data to the terminal device 20. To do.

  The image editing / playback unit 109 stores an image of each virtual camera as a virtual camera image as an event image 149 during a virtual event, and generates a virtual camera edited image using each virtual camera image as a material after the virtual event ends, The edited virtual camera edited image is stored as the event image 149.

  The timer unit 160 uses the system clock to measure time for executing processing for measuring timer values such as current date and time, time limit, time management for virtual event progress control, and the like.

[A3] Terminal Device Next, the terminal device 20 of the present embodiment will be described with reference to FIGS. 4 and 5. FIG. 4 is a diagram illustrating functional blocks of the terminal device 20 of the present embodiment, and FIG. 5 is an example of a diagram illustrating an external configuration of the terminal device 20 of the present embodiment. Moreover, the terminal device 20 of this embodiment is good also as a structure which abbreviate | omitted a part of component (each part) of FIG.

  The HMD unit 200 includes an imaging unit 210 that detects the line of sight of the participant who is attached, a motion sensor 220 that detects a posture including the head position and direction of the participant, an interface 230, a sound output unit 240, And a switch 250.

  The HMD unit 200 includes an imaging unit 210 that detects the line of sight of the participant who is attached, a motion sensor 220 that detects a posture including the head position and direction of the participant, an interface 230, a sound output unit 240, And a switch 250.

  Further, as shown in FIGS. 5A and 5B, the HMD unit 200 has a structure that holds the terminal control unit 300 and is worn by a participant.

  Then, the HMD unit 200 displays a virtual three-dimensional space image having a predetermined amount of parallax with both eyes of the participant wearing the terminal device 20 that is an HMD to realize a stereoscopic view (right eye). 261 and a display panel (for the left eye) 262, and has a structure for displaying the parallax image for the right eye and the parallax image for the left eye displayed on the terminal device 20.

  Note that a parallax image for realizing stereoscopic vision is the same as a conventional three-dimensional moving image, and thus detailed description thereof is omitted. FIG. 5B is a diagram in which the sound output unit 240 is omitted from the terminal device 20.

  The imaging unit 210 images the eyes (eye movements) of the participant wearing the HMD unit 200, detects the line-of-sight direction, and outputs a signal corresponding to the detection.

  In addition, the imaging unit 210 converts the imaging camera 211 having a predetermined imaging element such as a CCD and an optical system such as a lens, and an object captured based on the output of the imaging camera into the terminal control unit 300 as image data. And an image generation unit 212 to output.

  The motion sensor 220 is realized by, for example, an acceleration sensor or a gyro sensor. For example, the motion sensor 220 is a rotational movement of the participant's head (HMD) around the three axes of the X, Y, and Z axes, specifically, the X, Y, and Z axes by an acceleration sensor and a gyro sensor. Rotation angle and angular velocity around are detected.

  The interface 230 is, for example, a wired input / output interface such as HDMI (High-Definition Multimedia Interface / registered trademark), USB (Universal Serial Bus / registered trademark), Bluetooth (registered trademark), or IEEE 802.11a, g. , N, ac, and the like, and has a function for executing communication with the terminal control unit 300 (specifically, the communication unit 296) by wire or wirelessly.

  The interface 230 is configured by hardware such as a communication ASIC or a communication processor, or communication firmware.

  The sound output unit 240 outputs the sound generated by the server processing unit 100, and its function can be realized by hardware such as a speaker or headphones.

  The switch 250 is interlocked with the switch of the terminal control unit 300 and is used for performing a predetermined operation input while the HMD unit 200 is mounted.

  The terminal control unit 300 includes an input unit 260, a storage unit 270, an information storage medium 280, a display unit 290, a communication unit 296, a vibration unit 340, and a terminal processing unit.

  The input unit 260 is a device for inputting input information from the user, and outputs the user input information to the terminal processing unit 310. The input unit 260 of the present embodiment has a configuration for detecting user input information (input signal). For example, the input unit 260 includes a lever, a button, a steering, a microphone, a touch panel display, a keyboard, a mouse, and the like.

  Note that the input unit 260 of the present embodiment is formed by a touch panel formed on the display unit 290.

  On the other hand, the input unit 260 may include a microphone for collecting the voice of the participant in order to recognize the voice instruction of the participant, or may be configured by an imaging camera.

  In particular, when an imaging camera uses an item set for an avatar or an item used for a virtual event by digitizing an existing article, the imaging camera images the two-dimensional barcode as identification information for specifying the article. Is provided.

  In addition to the above, the input unit 260 may include an acceleration sensor, a line-of-sight detection sensor, and the like. Note that the acceleration sensor and the line-of-sight detection sensor may function instead of the imaging unit 210 and the motion sensor 220 provided in the HMD unit 200.

  The storage unit 270 serves as a work area for the terminal processing unit 310, the communication unit 296, and the like, and its function can be realized by a RAM (VRAM) or the like. The storage unit 270 of the present embodiment includes a main storage unit 271 used as a work area, and an image buffer 272 that stores a final display image and the like. Note that some of these may be omitted.

  The information storage medium 280 (computer-readable medium) stores programs, data, and the like, and functions as an optical disk (CD, DVD), magneto-optical disk (MO), magnetic disk, hard disk, and magnetic tape. Alternatively, it can be realized by a memory (ROM).

  The terminal processing unit 310 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 280. The information storage medium 280 can store a program for causing a computer to function as each unit of the present embodiment (a program for causing a computer to execute the processing of each unit).

  In the present embodiment, a program for causing a computer to function as each unit of the present embodiment stored in the information storage medium 180 or the storage unit 140 included in the server device 10 and data for realizing a virtual event are stored in a network. The received program and data are stored in the information storage medium 280. The program and data received from the server device 10 may be stored in the storage unit 270. The case where the network system is functioned by receiving programs and data as described above is also included in the scope of the present invention.

  The display unit 290 outputs an image generated according to the present embodiment, and its function can be realized by a CRT, LCD, touch panel display, HMD (head mounted display), or the like.

  For example, the display unit 290 displays the parallax image transmitted from the server device 10 at the position of the right-eye display panel 261 and the left-eye display panel 262 when the HMD unit 200 is attached. In the present embodiment, the display unit 290 is formed by a touch panel display.

  The communication unit 296 performs various controls for communicating with the outside such as the server apparatus 10, and the function can be realized by hardware such as various processors or communication ASICs, programs, and the like.

  The terminal processing unit 310 (processor) performs event control processing (including production control), image generation processing, or sound generation processing based on input information and programs output from the input unit 260 and the HMD unit 200. Process.

  Specifically, the terminal processing unit 310 performs various processes using the main storage unit 271 in the storage unit 270 as a work area. The functions of the terminal processing unit 310 can be realized by hardware such as various processors (CPU, DSP, etc.), ASIC (gate array, etc.), and programs.

  The terminal processing unit 310 includes a communication control unit 311, an event processing unit 312, a drawing unit 320, and a sound processing unit 330. Note that some of these may be omitted.

  The communication control unit 311 performs processing for transmitting / receiving data to / from the server device 10. In addition, the communication control unit 311 performs processing for storing data received from the server device 10 in the storage unit 270, processing for analyzing the received data, control processing for other data transmission / reception, and the like.

  Note that the communication control unit 311 may store the server destination information (IP address, port number) in the information storage medium 280 and perform a management process. Further, the communication control unit 311 may perform communication with the server device 10 when receiving input information for starting communication from the user.

  The event processing unit 312 performs various arithmetic processes for realizing various virtual events. For example, there are a process for starting a virtual event when a start condition for the virtual event is satisfied, a process for advancing the virtual event, a process for ending the virtual event when the end condition for the virtual event is satisfied, and the like.

  In addition, the event processing unit 312 may execute part of the virtual event processing in the server device 10 or may execute predetermined virtual event processing in conjunction with the server device 10.

  The drawing unit 320 performs drawing processing based on various types of processing (for example, various types of processing for realizing a virtual event) performed by the terminal processing unit 310, thereby generating an image and outputting the image to the display unit 290. . In particular, the drawing unit 320 generates a parallax image based on the image data transmitted from the server device 10, and displays the generated parallax image on the display unit 290.

  The sound processing unit 330 performs sound processing based on the sound data output from the server device 10 and the results of various processes performed by the terminal processing unit 310, and is used for virtual events such as BGM, sound effects, or sound. Sound is generated and output to the sound output unit 240.

  The vibration unit 340 includes a vibrating body 341, and based on vibration pattern data output from the server device 10 and vibration pattern data generated based on the results of various processes performed by the terminal processing unit 310, the vibration unit 340 The body 341 is configured to vibrate.

[A4] Method [A4.1] Overview of this Embodiment Next, the method (special effect control processing in a virtual event) of this embodiment will be described.

  The server device 10 of the present embodiment extracts specific participants on the assumption that the behavior history information of each participant and the viewing position in the virtual event are registered in association with each participant ID, and the extraction is performed. The special effect control process for providing a special effect on the acting character or the effect device is executed toward the viewing position on the virtual event of the specific participant who has performed.

  In particular, in the case of a virtual three-dimensional space as in the present embodiment, the server device 10 provides a special effect by acting characters such as idle characters and robot characters that are arranged and imaged in the virtual three-dimensional space. The special effect control process is executed.

Specifically, the server device 10
(1) In a virtual event in which a plurality of participants participate, an acting character or an effect device used to produce the virtual event is controlled,
(2) The behavior history information indicating the behavior related to the virtual event of the participant in association with the participant ID and the viewing position information of the virtual event of the participant are registered in the storage unit 140 as the participant information 146,
(3) Based on the registered action history information of each participant, a specific participant is extracted from a plurality of participants,
(4) Identifying the viewing position information of the specific participant based on the extracted participant ID of the specific participant,
(5) controlling the execution of a special performance by the performance technique character or the production device with respect to the viewing position in the virtual three-dimensional space indicated by the specified viewing position information;
It has a configuration.

  In this embodiment, by having such a configuration, for example, a participant who participates in many virtual events, a participant who purchased a specific product, or a certain amount of billing is executed. Since it is possible to provide a special performance to the participants who have been made, it is possible to maintain or improve the motivation for each participant to participate repeatedly in the virtual event and participate in the virtual event. In addition to improving the interest based on the above, it is possible to use the process of participating in a virtual event continuously and the process up to participation in the virtual event as an object of interest.

  Therefore, in this embodiment, while being able to improve the interest property with respect to a virtual event of a participant, the virtual event can be activated while aiming at attracting customers to the virtual event. It has become.

[A4.2] Action history information Next, action history information of the present embodiment will be described.
In this embodiment, the participant behavior management unit 105 stores, in the participant information 146, information indicating various behaviors related to a virtual event used for extracting a specific participant for each participant (that is, behavior information). ) Is registered, and action history information is generated and updated by listing the action information.

Specifically, the participant behavior management unit 105 includes, as behavior information,
(1) Directing action for participants' directing objects during events such as cheering and cheering for acting characters,
(2) Virtual purchases such as acting characters and virtual event goods (towels and stickers) used for the purchase of items for dressing such as the appearance of avatars (for example, makeup, costumes or items), or the production of virtual events Purchase of products related to the event (including virtual items),
(3) Charge by purchasing the above-mentioned product, purchase of the viewing position (that is, seat) or the real space event holding place in the virtual three-dimensional space of the virtual event, charging by participating in the virtual event, or acting character Billing performed in connection with an event, such as billing by providing a twist (ie, a chip),
(4) Participation in past events (including virtual events and real events implemented in real space) related to virtual events that are currently participating, such as events in which the same acting characters in the past participate.
(5) Production response behavior in the event (virtual event and real event) that has already participated (production response behavior shown in (2)),
(6) A mini-game that occurs during a virtual event or a real event (for example, a game that can be executed in a virtual three-dimensional space or a game that is linked to an event by a game terminal device in the real space), or before the virtual event is held or Various types of information such as action type, execution date and time, and charge amount (if there is charge information) of the game executed in conjunction with various game terminal devices (such as mobile phones and smartphones) as the action information Register in the participant information 146.

Specifically, the participant behavior management unit 105 works in conjunction with the terminal device 20 and other communication devices,
(1) Based on the participant ID input when logging in to a predetermined system or program in participation in a virtual event or game execution by the terminal device 20 or the like, or
(2) Based on the operation of participants and event managers using barcodes and electronic ticket ticket numbers given to admission tickets such as real events,
In addition to acquiring event IDs assigned in advance in virtual events and real events, related event IDs assigned for events related to the participating events, types of purchased items and products, charges, game results, and these actions The execution date and time is acquired and registered in the participant information 146.

In addition, the participant behavior management unit 105 associates the production response behavior with the event ID acquired as described above.
(A) Received a special performance, and
(B) Participant's voice, fingers, arms, head, line of sight, eyelids, or other input that is input or recognized according to the movement of the participant's body, detection of camera or other image detection, vibration detection (gyro), etc. Operation input detected by means,
Is changed to a predetermined parameter, and is registered in the participant information 146 for each participant (corresponding to the participant ID) as the strength in the action.

  In particular, the participant behavior management unit 105 operates in conjunction with the information acquisition unit 104 as an operation input, and is input to the HMD unit 200 of the terminal device 20 and a controller attached thereto, voice volume input, vibration input (by a shaking operation) The support parameter is changed based on an operation input such as input), switch input (for example, continuous hitting or combo input), and the support parameter is registered in the participant information 146.

  In addition, for example, the participant behavior management unit 105 executes the game, for example, the date and time of the game (including the login date and time), the total game, the play time in a predetermined period, and the game execution frequency (login frequency). ), Game level (including player level), items acquired in the game, winning information in gacha, information based on relationships with friends registered in the game (for example, executed with the number of friends and friends) Game history information such as the playing time) is registered in the participant information 146 for each participant (corresponding to the participant ID).

  Furthermore, the participant behavior management unit 105, for example, in the billing when purchasing a product, for example, the billing type, the date and time when the billing was performed, the type of the product purchased by billing, the number of purchases and the billing Information regarding the number of times (frequency) or billing when the above game is executed is registered in the participant information 146 for each participant (corresponding to the participant ID).

[A4.3] Relationship between Viewing Position and Real Space Event Holding Place in Virtual Event Next, the relationship between the viewing position and the real space event holding place in the virtual event in the present embodiment will be described with reference to FIG. FIG. 6 is a diagram for explaining the relationship between the viewing position and the real space event holding place in the virtual event in the present embodiment.

  In this embodiment, a plurality of real space event holding places (for example, Tokyo, Osaka, and Nagoya) 7 where participants attend are prepared, and each participant is assigned to one designated real space event holding place 7. Participate in virtual events by visiting.

  In particular, each real space holding place 7 is prepared with a plurality of participants' seats (including seats and standing seats) and areas, and each participant has designated the real space holding place 7 in advance by a purchase reservation or the like. Participate in virtual events at reserved seats and areas.

  Further, when each seat of each real space holding place 7 is reserved in advance by a participant, the seat is associated with the participant ID of the reserved participant and managed by the participant information 146. And each seat of each real space holding place 7 is managed corresponding to each seat of the spectator seat 6 in the virtual event by the spectator seat information 148.

  Therefore, when a participant participates in a virtual event using the terminal device 20 (a terminal device set in advance or a terminal device held by the participant, etc.) at each seat in each real space holding place 7 (that is, When the HMD unit 200 is attached and the user logs in to a virtual event game or event program), each participant attends a virtual event held in the virtual three-dimensional space, and a spectator seat 6 corresponding to the seat in each real space holding place 7. It is possible to participate virtually in the seat.

  In addition, each seat of each real space holding place 7 and each seat of the spectator seat 6 in the virtual event have a one-to-one correspondence, and the seats of the spectator seat 6 overlap to become the seat of the real space holding place 7. Not associated.

  For example, when a plurality of real space event holding places 7 where participants attend are Tokyo and Osaka, as shown in FIGS. 6 (A), (B) and (C), The left seat area toward the stage 4 of the audience seat 6 in the virtual event is associated with each seat of the real space event holding place 7A in Tokyo, and the right side toward the stage 4 of the audience seat 6 in the virtual event. The seat area is stored in association with each seat of the real space event holding place 7B in Osaka.

  In FIGS. 6A, 6B, and 6C, the seat A in the second row of the real space event holding place 7A in Tokyo becomes the seat A in the second row of the spectator seat 6 in the virtual event space. Correspondingly, it is shown that the seat No. 2 in row A of the real space event holding place 7B in Osaka corresponds to the seat No. 6 in row A of the audience seat 6 in the virtual event space.

  In addition, the event management unit 111 may include each participant who participates in the virtual event (may be all participants, all participants who participate in the same real space event holding place, or a plurality of registered friends) Each participant can participate in a virtual event, such as by controlling the start of a virtual event based on the fact that a predetermined time has been reached, or by attaching the HMD unit 200 so that the participant can entertain at the same time. The start of a virtual event may be automatically controlled individually at the time when participation is possible.

  In particular, when the event management unit 111 performs start control to automatically start a virtual event individually, each participant has a viewing position of the bleaching seat 6 (specifically, a seat at a real space event holding place). If the participant is determined to be present at the viewing position, control for starting the virtual event is executed.

  Specifically, the event management unit 111 works in conjunction with the information acquisition unit 104 to emit irradiation light emitted from a light emitter (not shown) formed in advance on the HMD unit 200, such as an imaging camera (not actually). Detected by a plurality of detection devices installed in a predetermined place in the real space event holding place, the position and height of the issuer (the height assumed when the participant wears the HMD unit 200) is predetermined. When the above condition is satisfied, it may be determined as a timing at which each participant can participate in the virtual event.

[A4.4] Special Effect Control Process Next, the special effect control process of this embodiment will be described with reference to FIGS. 7 and 8. 7 and 8 are diagrams for explaining the special effect control process of the present embodiment.

The special control execution unit 117 performs the special effect control process as follows:
(1) Based on the behavior information of each participant registered as the participant information 146, a specific participant is extracted from a plurality of participants participating in the virtual event,
(2) Referring to the participant information 146 of the extracted specific participant, the viewing position information of the specific participant is specified based on the participant ID of the specific participant,
(3) The execution of a special effect by the acting character or the effect device is controlled with respect to the viewing position in the virtual event indicated by the specified viewing position information.

  Specifically, the special control execution unit 117 refers to each participant information 146 (that is, the action history information registered as described above) of the participants participating in the virtual event. The top participant in the number of events, the number of purchased items, the total charge amount, the support parameters in the fixed period (within the last one week), or the score in the game in the game related to the event decide.

  Further, the special control execution unit 117 calculates a predetermined score (for example, a score obtained by changing and converting the value of each item into a predetermined point and summing up) by a combination of the two or more items, and the calculated score is the highest. Determine participants in the score.

  Then, the special control execution unit 117 extracts the highest-ranking participant determined in any of the plurality of items or the highest-scoring participant determined in the combination of two or more items as the specific participant.

  Note that the special control execution unit 117 determines the top participant as the specific participant in the predetermined one or more items. However, the special control execution unit 117 determines that the game related to the event has been won, Participants who have predetermined conditions, such as having a certain level, acquiring a predetermined item by a game, logging in at a predetermined frequency in the game, etc. Alternatively, one specific participant may be determined from among the participants determined in this manner by lottery or the highest score.

  Further, the special control execution unit 117 refers to the participant information 146 of the specific participant, specifies the viewing position on the auditorium 6 of the virtual event, and performs a special action by the acting character or the directing device toward the specified viewing position. Perform the production.

In particular, the special control execution unit 117 is a special production,
(1) For example, a fan service (i.e., action production) executed from a acting character to a specific participant such as a throwing kiss or message transmission,
(2) Illumination effect that irradiates a specific participant in a virtual event, that is, a pin spot or searchlight toward the avatar of the specific participant, and
(3) A special effect is produced for a specific participant by a special effect device such as a bazooka type or cannon type cracker that blows decorations such as confetti or tape.

  For example, when the specific participant is viewing in the virtual event at the viewing position of the 10th row of the seat 6, the special control execution unit 117 performs the acting character 8 as shown in FIG. In addition, the execution of a special effect that transmits a message “Mr. OO. Thank you always for your support!” To the viewing position of the second row of row B of the auditorium 6 at a predetermined timing is controlled.

  Further, in this case, the special control execution unit 117 applies the pin spot (direction device) 9 to the avatar arranged at the viewing position in the fifth row of the C seat 6 as shown in FIG. The execution of various effects.

  On the other hand, in the case of an effect other than executing a special effect (effect using a pin spot) directly at the viewing position of the auditorium 6 such as the stage 4 of the virtual event, the special control execution unit 117 The behavior of the acting character is controlled based on the information on the direction and the elevation angle determined in advance with respect to the specific viewing position of the specific participant defined in the information 148, and the execution of the special performance in the acting character is controlled. .

  For example, when the viewing position in the virtual event of the specific participant is on the right side (or left side) toward the stage 4, the special control execution unit 117 moves the acting character toward the left side (or right direction) toward the viewing seat 6. If the viewing position in the virtual event of the specific participant is on the side far from (or close to) the stage 4, the acting character faces the front of the viewing seat 6 (back side). And perform a special performance.

  The special control execution unit 117 controls the direction in which the special effect is provided (direction and elevation angle) according to the row or line of viewing positions in the virtual event.

On the other hand, the special control execution unit 117 is a case of a performance effect of a acting character or a special effect effect in a special effect device, for example, within a predetermined period during a virtual event such as an interlude performance of a singing performance in a performance character. In addition, when it is detected that the line of sight of the specific participant's avatar is directed to the acting character or the special effect device based on the line of sight input of the specific participant, the specific viewing position of the specific participant defined in the seat information 148 The execution of a special effect is controlled on the basis of information on the direction and the elevation angle determined in advance.

  That is, the special control execution unit 117 determines whether or not the line of sight of the specific participant is toward the acting character or the special effect device during the predetermined period (whether or not it is within the angle of view of the virtual camera). As shown in FIGS. 8A and 8B, the line of sight of the input specific participant is directed toward the acting character or special effect device (within the angle of view of the virtual camera). When it is detected, execution of a special performance by the acting character or special effect device is controlled with respect to the viewing position indicated by the detected viewing position information of the specific participant.

[A4.5] Event Image Next, an event image in the present embodiment will be described.

  During the execution of the virtual event, the image generation unit 108 stores an image from the viewpoint of each participant's virtual camera as the event image 149 in the storage unit 140.

  Then, when a special effect is executed during the execution of the virtual event, the image generation unit 108 relates to the viewing position information indicating the viewing position of the auditorium 6 serving as the destination of the special effect or the viewing position. Information is stored in the storage unit 140 in association with the event image.

  Note that the information related to the viewing position includes information on the participant corresponding to the avatar arranged at the viewing position, such as a participant ID, a nickname, and action history information, and a real space event holding place corresponding to the viewing position. .

  On the other hand, after the end of the virtual event, the image editing / playback unit 109 edits the stored image of each participant's virtual camera as a viewpoint to generate an event edit image, and registers it as an event image 149.

  When the image editing / playback unit 109 generates the event editing image, the image editing / playback unit 109 associates with the scene where the special effect is executed, and displays the viewing position information indicating the viewing position of the auditorium 6 that is the destination of the special effect. Alternatively, information regarding the viewing position is registered.

  On the other hand, when the image editing / playback unit 109 plays back an event-edited image or an image edited from the viewpoint of each participant's virtual camera stored after the end of the virtual event based on an instruction from the participant, The streaming data in a predetermined data format is provided so as to be viewable to the corresponding terminal device 20 or a communication terminal device (not shown).

  Then, when playing back the event image 149, the image editing / playback unit 109 converts the viewing position information or the information about the viewing position into text for the scene to which the viewing position information or the information about the viewing position is added. Then, a display process (OSD process) for displaying the image superimposed on the event image is executed.

  Note that the image editing / playback unit 109 has a predetermined data format in a data service (specifically, a server device that performs the data service) that distributes an image based on an instruction from the participant, It has a function of uploading an event edited image in which position information or the like is superimposed on the image, and the uploaded event edited image can be provided for reproduction by streaming distribution or downloading. Yes.

[A5] Operation in this Embodiment Next, the operation of the execution process in the virtual event including the special effect control process executed by the server device 10 of this embodiment will be described with reference to FIG. FIG. 9 is a flowchart showing the operation of the execution process in the virtual event including the special effect control process executed by the server device 10 of the present embodiment.

  In this operation, it is assumed that the behavior information, billing history information, and viewing position information of each participant is stored in the participant information 146, and the avatar for each participant is already placed at the viewing position in the virtual event. Shall.

  In this operation, during the performance of the acting character, the object control unit 114 arranges, moves, or moves each object including the acting character in the virtual three-dimensional space according to the program. It is assumed that the event management unit 111 is executing each effect in the virtual three-dimensional space.

  Further, the information acquisition unit 104 acquires the line-of-sight information output from each terminal device 20 at a predetermined timing (5 ms), and the avatar line-of-sight control unit 115 acquires the line-of-sight information for each participant. Each time it is acquired, the line-of-sight direction in the virtual three-dimensional space of each avatar is determined.

  Then, for each participant, the image generation unit 108 generates a virtual three-dimensional space image by imaging the virtual three-dimensional space viewed from each virtual camera placed in the auditorium based on the determined line-of-sight direction. Data of the generated virtual three-dimensional space image is output to the corresponding terminal device 20 as needed.

  On the other hand, each terminal device 20 generates an image (parallax image) for displaying an image in a virtual three-dimensional space based on the image data output from the image generation unit 108 and displays the image on the HMD unit 200. And

  First, when the event management unit 111 detects a start instruction of a virtual event such as detection of a predetermined timing or detection of completion of preparation of a participant by the HMD unit 200 (step S101), the special control execution 117 The specific participant is determined with reference to each participant information 146 of the participant participating in (Step S102).

  Next, the event management unit 111 starts a virtual event including the performance of the acting character and various effects (step S103). At this time, the image generation unit 108 starts storing an image with each virtual camera as a viewpoint in the storage unit 140 as an event image 149.

  Next, the special control execution 117 determines whether or not it is the execution timing of the special effect control process (step S104). At this time, if it is determined that the special control execution 117 is the execution timing of the special effect control process, the process proceeds to step S111. If it is determined that it is not the execution timing of the special effect control process, the event management unit 111 is performed. Determines whether the end of the virtual event has been detected (step S105).

  If the event management unit 111 determines that the end of the virtual event has been detected, the event management unit 111 executes end processing related to the end of the virtual event, such as displaying a demo image (step S106), and ends this operation. If it is determined that the end of the virtual event has not been detected, the process returns to step S104.

  On the other hand, if the special control execution 117 determines that it is the execution timing of the special effect control process, the special control execution 117 refers to the participant information 146 of the specific participant, and specifies the viewing position on the virtual event auditorium 6 ( Step S111).

Next, the special control execution 117 executes a special effect by the acting character or the effect device toward the specified viewing position (step S112), and returns to the process of step S104.

[B] Second Embodiment Next, a second embodiment of the event effect control system according to the present invention will be described. In the present embodiment, the event production control system and the program according to the present invention are applied to a system that controls various production devices used in the event in an event in which a plurality of participants are performed in a real space. Embodiment.

[B1] Overview of Event Effect Control System (Real Space) First, an overview of the event effect control system 1 of the present embodiment will be described. In addition, about the structure same as 1st Embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

  The present embodiment is characterized in that it controls the acting character in the real space instead of controlling the acting character in the virtual three-dimensional space in the first embodiment, and the other configuration is the first embodiment. It is the same as the form.

  In addition, although the event executed in the real space of the present embodiment is an event realized in the real space instead of the virtual three-dimensional space, the virtual event executed in the virtual three-dimensional space of the first embodiment is basically There is no difference in the content itself. However, real space events are different in that each event is actually performed using various devices.

  On the other hand, the event effect control system 1 of the present embodiment displays a character (hereinafter referred to as “acting character”) that performs a predetermined effect on a screen or a large display device in a real space, or a 3D hologram or the like. Various types of viewing for a live stage (hereinafter, also referred to as “stage”) for performing performance (specifically, singing live) performed by the performance character by displaying the performance character using the stereoscopic video technology of It is a system that controls.

  That is, the event production control system 1 of the present embodiment has, as the acting character, an action of sending a line of sight toward a participant who exists in the real space or an action (fan service) provided specifically to the participant. It has the structure which controls the event including gazing at the performance character which performs.

[B2] Details of Event Effect Control System (Real Space) Next, a schematic configuration of the event effect control system 1 of the present embodiment will be described with reference to FIG. In addition, FIG. 10 is a figure for demonstrating the structural example of the event presentation control system 1 of this embodiment.

  As shown in FIG. 10, the event presentation control system 1 of the present embodiment includes a server device 10 that executes various processes for realizing a virtual event in a virtual three-dimensional space, and a display device that displays an acting character 8. 11, a detection device 21 for detecting the line of sight of a participant provided with an imaging camera for detecting eyeball movement on the glasses, and a registration device 22 for registering a participant ID arranged at the viewing position of the participant And the input device 23 for detecting a participant's support action is comprised so that connection to networks, such as the internet, is possible.

  The display device 11 includes a large screen formed on the stage 4R and a projector that projects an image on the screen, and displays the image output from the server device 10.

The detection device 21 has the same function as the visual line direction detection function of the HMD unit 200 in the first embodiment, and is a glasses-type device worn by each participant. The detection device 21 has a function of transmitting the line-of-sight direction of each participant to the server device 10 by wireless communication together with the ID of each participant.

  The detection device 21 may include the motion sensor 220 provided in the HMD unit 200 of the first embodiment. In this case, the detected detection signal is transmitted to the server together with the ID of each participant by wireless communication. It has a function of transmitting to the device 10.

  Therefore, in the present embodiment, the gaze direction of each participant can be detected as in the first embodiment.

  The registration device 22 is provided at each viewing position of the viewing seat 6R, and has a configuration capable of touch input, key input, or bar code input. For example, the registration device 22 acquires the participant ID of each participant by reading a barcode formed on the ticket of each participant or by inputting the participant ID, and the acquired participant ID is It has a function of transmitting to the server device 10 by wireless communication or wired communication.

  Therefore, in the present embodiment, similarly to the first embodiment, the viewing position of each participant can be managed in association with the participant ID.

  The input device 23 may be configured by a portable information processing device such as a smartphone, a mobile phone, a PHS, a game device, a PDA, or a portable game device, or a device such as a psyllium that simply incorporates a motion sensor. It may be.

  Similarly to the detection device 21, the input device 23 has a function of transmitting the detected detection signal to the server device 10 by wireless communication together with the ID of each participant.

  Therefore, in the present embodiment, various operation inputs such as cheering of each participant can be detected as in the first embodiment.

  By having such a configuration, in the present embodiment, similarly to the first embodiment, in the server device 10, the behavior history information of each participant and viewing in an event in the real space are associated with each participant ID. Special effect control processing that extracts a specific participant on the assumption that the position is registered and provides a special effect in the acting character or the production device toward the viewing position on the event of the extracted specific participant Can be executed.

That is, the server device 10 of this embodiment is similar to the first embodiment,
(1) In an event in a real space where a plurality of participants participate, the acting character or the production device used for producing the event is controlled,
(2) The behavior history information indicating the behavior related to the event of the participant in association with the participant ID and the viewing position information of the event of the participant are registered in the storage unit 140 as the participant information 146, and (3) each Based on the registered action history information of participants, we extract specific participants from multiple participants,
(4) Identifying the viewing position information of the specific participant based on the extracted participant ID of the specific participant,
(5) Control the execution of a special performance by the performance character or the production device for the viewing position in the real space indicated by the identified viewing position information.
It has a configuration.

In this embodiment, by having such a configuration, for example, a participant who participates in many real space events, a participant who purchases a specific product, or a certain amount of charge or more Since it is possible to provide a special performance to the participants who have executed, it is possible to maintain or improve the motivation for each participant to participate repeatedly in the event and participate in the event. In addition to improving the interest based on the above, it is possible to use the process of participating in an event continuously and the process up to participation in the event as an object of interest.

  Therefore, in this embodiment, while being able to improve the interest property with respect to an event of a participant, the said event can be activated while aiming at the customer at the participant with respect to the said virtual event by it. Yes.

[B3] Modified Example of the Present Embodiment Next, a modified example of the present embodiment will be described with reference to FIG. In addition, FIG. 11 is a figure for demonstrating the modification of the event effect control system 1 of this embodiment.

(Modification 1)
In the present embodiment, the acting character is displayed on the display device 11 provided on the stage 4R. However, as shown in FIG. 11, an effect character constituted by the robot 8C is made to appear, and the server device is displayed. The effect character or effect device (illumination device or special effect device) may be controlled by 10 and a predetermined effect (including a special effect) may be executed by the effect character or effect device.

  In this modification, a special effect device such as a bazooka-type cracker device may be used instead of the robot.

(Modification 2)
In the present embodiment, the acting character or the production device is automatically controlled by the server device 10, but the specific participant is specified, the viewing position is notified to the administrator, and the specific participation is performed by the operation of the administrator. A special effect may be executed on the viewing position of the person.

Specifically, the server device 10
(1) In association with each participant ID of a plurality of participants participating in an event in the real space, the behavior information and viewing position information indicating the behavior related to the event of each participant are registered in the storage unit 140. ,
(2) Based on the registered behavior information of each participant, a specific participant is extracted as a specific participant from a plurality of participants,
(3) Based on the participant ID of the extracted specific participant and the stored viewing position information, the specific participant who is a providing destination that provides a special performance by the acting character or the production device used for the production of the event Notify viewing position,
You may have a structure.

[C] Others The present invention is not limited to that described in the above embodiment, and various modifications can be made. For example, terms cited as broad or synonymous terms in the description in the specification or drawings can be replaced with broad or synonymous terms in other descriptions in the specification or drawings.

  Although this embodiment has been described as a simulation event in which an acting character is watched, it can also be used in other simulation events such as love simulation, battle events, or other events such as RPG.

  In the present embodiment, each server device 10 may provide each event to the terminal device 20, or a plurality of server devices 10 may be linked to construct a server system and each event may be provided to the terminal device 20. May be.

  Furthermore, in the present embodiment, processing related to various events is executed by the server device 10, but the terminal control unit 300 of the terminal device 20 described above executes each function and event program of the server processing unit 100, The above event may be realized as a stand alone. Further, when an event is executed by a plurality of participants, one terminal device 20 may also function as the server.

  The present invention includes configurations that are substantially the same as the configurations described in the embodiments (for example, configurations that have the same functions, methods, and results, or configurations that have the same objects and effects). In addition, the invention includes a configuration in which a non-essential part of the configuration described in the embodiment is replaced. In addition, the present invention includes a configuration that exhibits the same operational effects as the configuration described in the embodiment or a configuration that can achieve the same object. In addition, the invention includes a configuration in which a known technique is added to the configuration described in the embodiment.

  As described above, the embodiments of the present invention have been described in detail. However, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. . Accordingly, all such modifications are intended to be included in the scope of the present invention.

1: Event production control system 2: Participant 4, 4R: Stage 5: Avatar 6, 6R: Standing seat 8: Acting character (idol character)
10: Server device 11: Display device 20: Terminal device 21: Detection device 22: Registration device 23: Input device 30: Display object 100: Server processing unit 101: Communication control unit 102: User management unit 104: Information acquisition unit 105 : Participant behavior management unit 106: Virtual camera control unit 107: Sound generation unit 108: Image generation unit 109: Image editing / playback unit 110: Event control unit 111: Event management unit 112: Spectator setting unit 113: Avatar setting unit 114 : Object control unit 115: Avatar line of sight control unit 117: Special control execution unit 120: Input unit 130: Display unit 140: Storage unit 142: Main storage unit 144: Event information 146: Participant information 149: Event image 150: Vibration generation Unit 160: Timer unit 180: Information storage medium 196: Communication unit 200 : HMD unit 210: Imaging unit 211: Imaging camera 212: Image generation unit 220: Motion sensor 230: Interface 240: Sound output unit 250: Switch 260: Input unit 261: Display panel for right eye 262: Display panel for left eye 270: Storage Unit 271: main storage unit 272: image buffer 280: information storage medium 290: display unit 296: communication unit 300: terminal control unit 310: terminal processing unit 311: communication control unit 312: event processing unit 320: drawing unit 330: sound Processing unit 340: Vibrating unit 341: Vibrating body

Claims (11)

Computer
Control means for controlling a production object or production device used for production of an event in which a plurality of participants participate,
First registration means for registering in the storage means behavior information indicating the behavior related to the event of the participant in association with the identification information of the participant;
Second registration means for registering viewing position information indicating the viewing position information of the event of the participant in association with the identification information of the participant in the storage means; and
An extraction means for extracting a specific participant as a specific participant from a plurality of participants based on the registered behavior information of each participant;
Function as
The control means is
Based on the extracted identification information of the specific participant, specifying the viewing position information of the specific participant,
A program for controlling execution of a special effect by the effect object or the effect device with respect to the viewing position indicated by the specified viewing position information. The program according to claim 1,
The behavior information includes any one of information related to the behavior of the participant, information related to charging when the participant is charged, or information related to the past behavior of the participant or information related to the charging. In the program according to claim 1 or 2,
When the event is an event performed in a virtual three-dimensional space in which the viewing position of each participant is set,
For each participant, the viewing position of each participant in the virtual three-dimensional space is set as the position of the virtual camera corresponding to each participant, and the viewing direction of each participant is viewed from each virtual camera as a viewpoint. Further causing the computer to function as image generation means for generating visible images of a virtual three-dimensional space,
The control means is
A program for controlling execution of a special effect in the virtual three-dimensional space by the effect object or the effect device with respect to the viewing position of the specific participant set in the virtual three-dimensional space. In the program according to claim 3,
In the storage means,
In association with each viewing position set in the virtual three-dimensional space, information indicating the participation position of the participant who participates in the event set in a given real space is stored as participation position information,
The control means is
A program for controlling execution of a special effect by the effect object or the effect device with respect to a viewing position in the virtual three-dimensional space of the specific participant existing at the participation position. The program according to claim 3 or 4,
The image generating means
In response to the participant's line-of-sight input received by the receiving means, the display means has a structure that covers the field of view of the participant and is configured by a wearable image display device that visually recognizes the image in the virtual three-dimensional space. And displaying the generated image of the virtual three-dimensional space. In the program according to any one of claims 1 to 5,
An accepting unit for executing processing for accepting at least an input of a gaze direction in the real space of the participant as a gaze input by the participant; and
Detecting means for detecting whether or not the input gaze of the specific participant is heading toward the effect object or the effect device;
Function the computer as
The control means is
When it is detected that the input line of sight of the specific participant is heading toward the effect object or the effect device, the effect is performed with respect to the viewing position indicated by the detected viewing position information of the specific participant. A program for controlling execution of a special effect by an object or the effect device. In the program according to any one of claims 1 to 6,
Causing the computer to function as determination means for determining whether or not each participant exists at the viewing position;
The control means is
A program that executes control to start the event when it is determined that the participant exists at the viewing position. In the program according to any one of claims 1 to 7,
Causing the computer to function as storage control means for storing an image of the event in the storage means during the event;
The storage control means is
When the image of the event is being stored and the effect object or the effect device is executing the special effect, the information indicating the viewing position to which the special effect is provided or the viewing position A program for storing information in the storage unit in association with the stored image of the event. Computer
First registration means for registering, in the storage means, behavior information indicating behavior related to the event of each participant in association with identification information of a plurality of participants participating in the event,
Second registration means for registering in the storage means viewing position information indicating the viewing position information of the event of the participant in association with the identification information of the participant;
Based on the registered behavior information of each participant, an extraction means for extracting a specific participant as a specific participant from a plurality of participants, and
Based on the extracted identification information of the specific participant and the stored viewing position information, the specific participant serving as a providing destination for providing a special effect by the effect object or effect device used for the event Notification control means for controlling the notification means for notifying the viewing position of
A program characterized by functioning as Control means for controlling a production object or production device used for production of an event in which a plurality of participants participate;
First registration means for registering in the storage means behavior information indicating behavior related to the event of the participant in association with the identification information of the participant;
Second registration means for registering viewing position information indicating the viewing position information of the event of the participant in association with the identification information of the participant in the storage means;
An extracting means for extracting a specific participant as a specific participant from a plurality of participants based on the registered behavior information of each participant;
With
The control means is
Based on the extracted identification information of the specific participant, specifying the viewing position information of the specific participant,
An event control system that controls execution of a special effect by the effect object or the effect device with respect to the viewing position indicated by the specified viewing position information. First registration means for registering in the storage means behavior information indicating the behavior related to the event of each participant in association with identification information of a plurality of participants participating in the event;
Second registration means for registering viewing position information indicating the viewing position information of the event of the participant in association with the identification information of the participant in the storage means;
An extracting means for extracting a specific participant as a specific participant from a plurality of participants based on the registered behavior information of each participant;
Based on the extracted identification information of the specific participant and the stored viewing position information, the specific participant serving as a providing destination for providing a special effect by the effect object or effect device used for the event An event notification system comprising: a notification control unit that controls a notification unit that notifies the viewing position of the event.

Images