JP4215256B2 - Communication system that conveys a sense of unity - Google Patents

Description

  The present invention senses, in real time, sense information such as biological information such as heart rate, heartbeat, and body temperature, and feeling of uplift, etc. of a performer in a venue where a performer and an audience exist such as a concert venue and a baseball field, and conveys it to the audience. This is a communication system that creates a sense of unity between the performers and the audience.

In addition, the present invention collects biometric information and sensibility information of audiences other than performers, configures the information as venue information, and distributes it to the performers and the audience, thereby sharing the atmosphere of the venue. The present invention relates to a communication system that creates a sense of unity.

  In order to create a sense of unity in concerts and the like, it is important for the audience to synchronize the state of the performers, such as a sense of tension and uplifting, as well as sharing video information and situation information on the spot.

  When conveying information about a venue such as a concert, traditionally, it conveys a sense of reality using video. In the conventional example that conveys a sense of reality, the surrounding information, including the performers, is acquired by the camera and reproduced using a high-definition output device, as if it were close to the performers. Presenting a sense of reality by directing

  As a technology that conveys a sense of realism using a method different from video input / output, the presence reproduction system and processing system convert the detection signals of sensors installed on objects that cannot be directly perceived by the five senses to a level that can be perceived by the five senses. By leaving it unattended, the realistic sensation is reproduced (for example, see Patent Document 1).

  On the other hand, as a technique for transmitting a sense of unity by a method different from a method for transmitting a sense of reality, there is a method for transmitting the status of a venue such as a concert venue. In order to convey the situation of the place, it is realized by image processing the video, judging the situation of the entire audience, determining the situation of the place, and reproducing the situation information. Also, by delivering and playing back content according to the situation, the sense of unity with the performers and the atmosphere of the place are reproduced.

As another method, there is a communication terminal that conveys a sense of connection by transmitting human presence information via a network (see, for example, Patent Document 2). This connection feeling communication terminal uses a sensor to automatically acquire the presence of others, transmit it in both directions, and present casually to foster a sense of connection among peers in remote locations. This is a targeted communication system. If this technique is used, human thoughts are not interrupted, and it is possible to share the partner's attitude and atmosphere.
Japanese Patent No. 373383 JP 2002-314707 A

  The technology that conveys the presence of the concert enhances the sense of reality by accurately transmitting the video, mainly to the performers, but it is not possible to convey the uplifting feeling or pulse of the performers through the video, so it is close to the performers. There is a problem that the atmosphere that the performers and the audience are united cannot be conveyed.

  In the above-described conventional realistic reproduction system and processing system, information that cannot be directly recognized by the five senses can be transmitted to the audience, but there is a problem that it is impossible to produce a sense of unity between the performers and the audience only by transmitting information.

  On the other hand, the method of communicating the situation of a venue such as a concert venue can grasp the situation of the audience and can distribute and play content according to the situation of the audience, but both create a sense of unity between the performers and the audience There is a problem that there is no directional mechanism.

  In addition, connection feeling communication can share the feelings and atmosphere of others without interrupting human thoughts, but in situations where there are performers and spectators in concerts, etc. Is necessary, and there is a problem that the production effect cannot be taken in.

  The above-mentioned conventional example can share the situation of the direct place of video and situation sharing, but the feeling of uplifting and pulse sharing of the performer like the concert venue, There is a problem that the effect of creating a sense of unity when transmitted and the effect of transmitting the sense of unity by feedback of the situation cannot be achieved.

The present invention can share the performer's psychological state and physical state with the audience, can enhance the sense of unity between the performer and the audience, and is collected from the audience and collected as venue information. It is an object of the present invention to provide a communication system that conveys a sense of unity that allows event information to be shared among spectators and also enhances the sense of unity between the spectators.

The present invention obtains environmental information such as temperature, humidity, illuminance, wind direction / volume, ambient sound, ambient video, smell, etc. by using a camera and a microphone to acquire video and audio and a plurality of sensors. Body information such as blood pressure, pulse rate, heart rate, electrocardiogram, myoelectricity, respiration rate, sweating, eye movement and limb movement using body temperature sensor, blood flow sensor, electroencephalograph and other biological sensors It is a state where people's biological information, sensibility information, and behavior information such as the amount of movement of the person are gathered together with information about the person and place, and people are gathered and are in an excited state or in a quiet state That is, there are information aggregating means configured as field information, scenario configuring means for configuring and storing these as time-series scenarios, and distribution control means for transmitting the above information as an atmosphere on the network.

According to the present invention, the psychological state and physical state of the performer can be shared with the audience, and there is an effect of enhancing the sense of unity between the performer and the audience. Since the event information is shared among the audience, it is possible to increase the sense of unity among the audience.

  The best mode for carrying out the invention is the following examples.

  FIG. 1 is a diagram illustrating a communication system CS1 that conveys a sense of unity according to the first embodiment of the present invention.

  The communication system CS1 that conveys a sense of unity includes a performer terminal T1 used by performers, audience terminals T11 to T13 used by the audience, and a management server SV1 that manages them.

  Although three audience terminals are shown in FIG. 1, two or more audience terminals may be provided.

  The network configuration may be any network that can use TCP / IP communication regardless of wired LAN or wireless LAN.

  In the communication system CS1, the management server SV1 centrally collects, manages and accumulates information collected from the performer terminal T1, and also changes the status of the performer P1 such as uplifting feeling, pulse, heart rate, and body temperature of the performer P1, Deliver to the audience terminals T11 to T13 in real time.

  The audience P11 to P13 can always reduce the psychological distance from the performer P1 by receiving the change of the performer P1 and foster a sense of unity between the performer P1 and the audience P11 to P13. . In addition, the management server SV1 collects and aggregates the reactions (reactions) of the audiences P11 to P13 that have received information from the performer P1, and distributes them to the performers P1 and the audiences P11 to P13. This system further enhances the sense of unity between the performer P1 and the audience P11 to P13.

  FIG. 2 is a diagram illustrating the communication system CS1 according to the first embodiment.

  The communication system CS1 includes a performer terminal T1, an audience terminal T11, and a management server SV1.

  The performer terminal T1 includes performer information acquisition means 10, performer peripheral information acquisition means 20, information presentation means 30, control means C1, and communication means CM1.

  The performer information acquisition means 10 automatically acquires human biological information such as heartbeat, pulse, electrocardiogram, myoelectricity, body temperature, and sweating amount, sensitivity information, body movement, and the like using a sensor.

  The performer's surrounding information acquisition means 20 automatically acquires surrounding environmental information such as temperature, humidity, illuminance, wind direction / volume, ambient sound, surrounding video, smell, etc. using a plurality of sensors.

  The information presenting means 30 uses the information on the place where the feature amount is extracted from the performer P1 transmitted from the management server SV1, the peripheral information of the performer P1, and the information collected from all the audience terminals. Alternatively, a change in information is presented to the terminal user by outputting a video or the like.

  The communication means CM1 exchanges communication data with the management server SV1.

  The audience terminal T11 includes audience information acquisition means 40, audience peripheral information acquisition means 50, information presentation means 60, control means C2, and communication means CM2.

  The audience information acquisition means 40 automatically acquires human biological information such as the heartbeat, pulse, electrocardiogram, myoelectricity, body temperature, sweating amount, etc. of the audience, sensitivity information, body movement, and the like using a sensor.

  The audience surrounding information acquisition means 50 automatically acquires environmental information around the audience, such as temperature, humidity, illuminance, wind direction / volume, ambient sound, surrounding video, smell, etc., using a plurality of sensors.

  The information presenting means 60 extracts information on the place where the feature amount is extracted from the performer P1 transmitted from the management server SV1, the peripheral information of the performer P1, and the information collected from all the audience terminals. Alternatively, a change in information is presented to the terminal user by outputting a video or the like.

  The communication means CM2 exchanges communication data with the management server SV1.

  The management server SV1 includes a communication unit CM3, a distribution control unit 71, an information storage unit 72, an information aggregation unit 73, and a scenario configuration unit 74.

  The communication means CM3 exchanges communication data with the performer terminal T1 and the audience terminal T11.

  The distribution control means 71 effectively distributes the communication data received from the performer terminal T1 and the audience terminal T11 to the performer terminal T1 and the audience terminal T11 according to a scenario registered in advance. The information storage means 72 stores user information and peripheral information collected from the performer terminal T1 and the audience terminal T11 in the storage device.

  The information aggregating means 73 aggregates the accumulated information and forms place information. The scenario constructing means 74 creates a scenario for organizing and reproducing the accumulated information in time series.

  The communication system CS1 centrally manages the information of the performer P1 collected from the performer terminal T1 by the management server SV1, distributes it to the audience, and performs the reaction of the audience through the management server SV1, the performer P1, the audience P11, P12, P13,... Is a system that conveys a sense of unity by feeding back.

  In FIG. 2, the audience terminal T11 is shown as a representative of a plurality of audience terminals, and there are as many audience terminals as there are audiences, but only one is shown here for the sake of simplicity. . That is, other audience terminals such as the audience terminals T12 and T13 may be connected. In this case, each configuration of the audience terminals T12, T13,... Is the same as that of the audience terminal T11.

  FIG. 3 is a block diagram illustrating a configuration example of the performer information acquisition unit 10.

  Performer information acquisition means 10 includes video input means 11, image processing means 12, biometric information input means 13, motion detection means 14, motion feature amount detection means 15, sensitivity information extraction means 16, and user information. It has a configuration means 17 and various setting means 18.

  The video input unit 11 acquires a moving image or a still image from an image acquisition device such as a camera. You may make it utilize the moving image and still image which were acquired with the image | video input means 11 as a moving image file and a still image file as it is.

  The image processing means 12 performs human motion detection and facial expression detection to extract human motion information.

  The biological information input means 13 acquires biological information such as blood pressure, pulse, heartbeat, and electrocardiogram from a temperature sensor, a blood flow sensor, or the like. The biometric information input means 13 is used as the user's biometric information, and is compared with the past history data accumulated by the sensibility information extraction means 16 to extract emotions, etc., and used as sensibility information.

  The motion detection means 14 acquires motion information such as human presence / absence information, up / down / left / right, and amount of movement by an infrared sensor, a pyroelectric sensor, or the like.

  The motion feature amount detection means 15 automatically detects a human motion by a pyroelectric sensor, an infrared sensor, a pressure sensor, or the like.

  The sensitivity information extracting means 16 extracts sensitivity information such as emotions from image processed information.

  The user information constituting unit 17 aggregates the information on the performers detected by the operation detecting unit 14 and constitutes a series of log data.

  The various setting means 18 are means for the performer to perform settings for transmitting the above information to the management server SV1 (address of the management server SV1, communication protocol, communication data format).

  The configuration of the audience information acquisition means 40 is a means for acquiring the information of the audience rather than obtaining the information of the performers. Except for this point, the configuration of the performer information acquisition means 10 is the same.

  FIG. 4 is a diagram illustrating a configuration example of the performer peripheral information acquisition unit 20 according to the first embodiment.

  The peripheral information is an image of the performer's surroundings, the movement of the person, environmental information such as temperature and humidity, and the like, and is acquired from the performer terminal T1 and the audience terminal T11.

  Performer's peripheral information acquisition means 20 includes video input means 21, environmental information input means 22, motion detection means 23, motion detection means 23, image processing means 24, motion feature amount detection means 25, peripheral And information composition means 26.

  The video input means 21 acquires a moving image and a still image of a place where the performer P1 and the audience exist from an image acquisition device installed at a fixed point such as a camera. You may make it utilize the moving image and still image which the video input means 21 acquired as a moving image file and a still image file as it is.

  The environmental information input means 22 acquires environmental information such as air temperature, humidity, illuminance, wind direction, and air volume using a temperature sensor, a humidity sensor, or the like.

  The image processing means 24 performs human motion detection and facial expression detection to extract human motion information.

  The motion detection means 23 acquires motion information such as human presence / absence information, up / down / left / right, and amount of movement, using an infrared sensor, a pyroelectric sensor, or the like.

  The motion feature amount detecting means 25 automatically detects human motion by a pyroelectric sensor, an infrared sensor, a pressure sensor, or the like installed at a fixed point.

  The peripheral information configuration unit 26 aggregates the information detected by the motion detection unit 25 and configures it as a series of event data of the peripheral information.

  The configuration of the audience surrounding information acquisition means 50 is a means for acquiring information around the audience rather than obtaining information around the performer. Except for this point, the surrounding information acquisition means 20 for the performer is provided. It is the same as that of the structure.

  FIG. 5 is a diagram illustrating a configuration example of the video input unit 11 according to the first embodiment.

  The video input unit 11 includes a plurality of video input devices 111 to 116 and a video aggregation unit 117.

  The video input devices 111 to 116 are connected to the video aggregation unit 117. The video aggregating means 117 has a wired or wireless, parallel, serial connection, USB connection, RS232C connection or LAN connection interface as a connection form, and can collect data from a plurality of video input devices in a unified manner.

  FIG. 6 is a diagram illustrating a configuration example of the information presentation unit 30 according to the first embodiment.

  The information presenting means 30 changes the light, sound, smell, vibration, and terminal temperature, and feels the state of the performer P1 and the atmosphere of the place. As the information presentation means 30, a pen type terminal 31, a pendant type terminal 32, and a card terminal 33 can be considered.

  The pen-type terminal 31 includes a device that emits light at the pen tip, a vibration generator provided on the pen shaft, and a heat generation unit. The pen-type terminal 31 includes a storage device and stores data transmitted from the management server SV1. be able to. Also, the pen-type terminal 31 receives data from the management server SV1, changes the biometric information of the performer P1, and changes the surrounding information of the place aggregated by the management server SV1, the light emitting part at the pen tip becomes seven colors. Shines on. In addition, when the sensitivity information such as uplifting feeling of the performer P1 changes and the sensitivity information of the audience gathered by the management server SV1 changes, the pen shaft vibrates, generates heat, raises the surface temperature of the pen terminal, Produce excitement.

  The pendant type terminal 32 includes a device that generates light in the pendant, a vibration generator, a heat generating unit, and a storage device. Data sent from the management server SV1 can be saved. The pendant type terminal 32 receives data from the management server SV1, and when the biometric information of the performer P1 changes and the surrounding information of the place aggregated by the management server SV1 changes, the light emitting part on the surface of the pendant shines in seven colors. . Also, if the sensibility information such as uplifting feeling of the performer P1 changes and the sensibility information of the audience aggregated by the management server SV1 changes, the pendant vibrates left and right and up and down, generates heat and raises the surface temperature of the pendant. , Produce the excitement of the place.

  The card-type terminal 33 includes video output means for presenting the video of the performer P1, a device that emits light, a vibration generator, and a storage device. Data sent from the management server SV1 can be saved and played back. When the card-type terminal 33 receives data from the management server SV1, the biometric information of the performer P1 changes, and the surrounding information of the place aggregated by the management server SV1 changes, the light emitting part on the surface shines in seven colors. Further, when the sensibility information such as the feeling of uplifting of the performer P1 is changed and the sensibility information of the audience aggregated by the management server SV1 is changed, the swaying information is slightly moved up and down and left and right.

  Next, operations for collecting and distributing user information and peripheral information in the above embodiment will be described.

  In the communication system CS1 that conveys a sense of unity, user information (performer information, spectator information) and peripheral information are acquired, and the data is collected by the management server SV1 and distributed to the spectator terminal T11.

  FIG. 7 is a flowchart illustrating an operation of collecting information on a venue in which information on the performer P1 such as a concert venue, a large number of spectators, and surrounding information about the spectators is collected in the first embodiment.

  The performer information acquisition means 10, the audience information acquisition means 40, the performer's peripheral information acquisition means 20, and the audience's peripheral information acquisition means 50 of the performer terminal T1, the audience terminal T11 are always sensed, and the performers A change in information, a change in audience information, a change in peripheral information of performers, and a change in peripheral information of the audience are monitored (S1).

  First, user information collection and acquisition means 10 of performer terminal T1 detects user information of performer P1. If there is no change in user information and surrounding information, sensing is repeated (S2). If there is a change, the performer terminal T1 or the audience terminal T11 that has detected the change constitutes event data and transmits it to the management server SV1 (S3). The management server SV1 receives event data from the performer terminal T1 and the audience terminal T11, and stores it in the storage medium using the information storage means 72 (S4).

  The management server SV1 stores all audience data stored using the information storage means 72 for a certain period of time (for example, 1 second, 10 seconds, 20 seconds, 30 seconds, 1 minute, 10 minutes, 20 minutes, 30 minutes, The information is extracted from the storage medium at intervals of 1 hour, and is collected by the information aggregating means 73 and configured as field information (S5). The management server SV1 configures a time-series scenario by combining the information on the performer P1 and the information on the place aggregated in step S5 by the combination of the time when the event occurred and the contents of the event, by the scenario forming unit 74 ( S6).

  Event data collected from the performer terminal T1 and the audience terminal T11 is centrally managed by the management server SV1, and is distributed to the audience terminal T11.

  Next, an operation for event distribution by the management server SV1 will be described.

  FIG. 8 is a flowchart showing the operation of the event distribution by the management server SV1.

  The management server SV1 always collects user information and peripheral information obtained by the performer terminal T1 and the audience terminal T11 in a unified manner (FIG. 5). Further, the management server SV1 always receives event data transmitted from the performer terminal T1 and the audience terminal T11, the information storage means 72 stores the event, and whether or not it is an event of the performer P1. It discriminate | determines (S11).

  When the information of the performer P1 changes, the event data of the performer P1 is extracted (S12), and the determination of the change of the place information is awaited (S13). If there is no change in the event of the performer P1, a change in information on the place is detected.

  If the place information changes, the amount of change in the place information is extracted, and if there is an information change of the performer P1, an event is formed by adding the event change of the place to the event information of the performer P1 (S14). If there is no change in the event of the performer P1, but the event of the venue information changes, a new event is formed (S16). If the event of the performer P1 does not change and the information on the place does not change, the event distribution flow ends.

  The management server SV1 distributes the event data configured in steps S14 and S16 to the performer terminal T1 and the audience terminal T11 participating in the concert using the communication means CM3 (S17).

  In the audience terminal T11, the communication means CM2 receives the event distributed from the management server SV1. In the audience terminal T11 that has received the event, the information presentation means 30 presents the event data by video output, vibration, light, etc. (S18), and the user information change (situation change) of the performer P1 and the information change of the place ( (Information that the audience is excited) is casually expressed.

  The audience terminal T11 detects the user information immediately after the information is presented to the user and the surrounding information, and acquires an event as reaction information that is a reaction at that time. The acquired reaction information is transmitted to the management server SV1 (S19). In the management server SV1, the information aggregating means 73 aggregates the reaction information and distributes it to the performer terminal T1 and the audience terminal T11 (S20).

  Next, the operation | movement which comprises the information of the place which the information aggregation means 73 of management server SV1 performs is demonstrated.

  FIG. 9 is a flowchart showing the operation of configuring the place information performed by the information aggregating unit 73 of the management server SV1.

  The audience information acquisition means 40 of the audience terminal T11 constantly acquires user information on the audience P11 such as pulse, heartbeat, electrocardiogram, body temperature, blood flow, myoelectricity, and electroencephalogram. If there is a change, the management server SV1 Send as event data. The management server SV1 always receives event data from the audience terminal T11, collects it centrally by the management server SV1, and stores it in a storage medium in time series using the information storage means 72.

  The management server SV1 stores time-series data stored in the information storage means 72 at regular time intervals (1 second, 10 seconds, 20 seconds, 30 seconds, 1 minute, 10 minutes, 20 minutes, 30 minutes, 1 hour). Then, it is extracted from the storage medium (S31). In the management server SV1, the information aggregating unit 73 calculates the minimum value, maximum value, average value, variance, and median value of the extracted data according to the type of information (biological information, environmental information, etc.) (S32). The management server SV1 holds the value previously calculated in step S32, compares the value with a preset threshold value, and adopts it as field information if the amount of change is large. The management server SV1 configures the venue information as event data (S33).

Performing the event delivery and reaction information delivery in real time all the time, performer P1's psychological state (tension, excitement, hot air, etc.), physical state, and psychological state and physical state of performer P1 and all audiences Share state and convey a sense of unity.

  FIG. 10 is a diagram illustrating a communication system CS2 that transmits a sense of unity that is Embodiment 2 of the present invention.

  The communication system CS2 is an embodiment in which the performer P2 performs when there are a plurality of places where the audience gathers. The communication system CS2 is an embodiment in which the performer P2 and a place where a plurality of spectators gather are connected via a management server SV2, and a sense of unity is transmitted between the performer P2 and the plurality of places.

  The communication system CS2 includes a performer terminal T2, a management server SV2, a first group G1, and a second group G2. The first group G1 is composed of audience terminals T21 to T23, and the second group is composed of audience terminals T24 to T26.

  Each of the audience terminals T21 to T26 has the same configuration as that of the audience terminal T11 and the operation thereof.

  The management server SV2 has the same configuration as the management server SV1, and executes the same operation.

  Although FIG. 8 shows two groups, three or more groups may be provided.

  Similarly to the communication system CS1, the communication system CS2 detects the user information (performer information, audience information) of the performer P2, the peripheral information of the performer, and the peripheral information of the audience, and all the audiences are detected. Deliver to the terminal and produce a sense of unity between the performer P2 and the audience.

  At the same time, each of the audience terminals T21 to T26 detects a change in the user information and the surrounding information, and if there is a change, transmits the event information to the management server SV2. In the management server SV2, the information storage unit 72 stores the received event data in a storage medium.

  In addition, the management server SV2 collects and accumulates information from all the audience terminals T21 to T26, extracts data for a certain period of time from the accumulated data, and the information aggregating means 73 is provided for the entire audience. Configure as information. The distribution control means 71 distributes information on the configured place to each of the audience terminals T21 to T26. Each audience terminal T21 to T26 receives data from the management server SV2, and uses the information presenting means 60 to generate light, sound, smell, vibration, and temperature change of the terminal, and to feel the atmosphere of the place. This has the effect of strengthening the sense of unity between groups in remote locations.

The management server SV2 exchanges user information and closeness information of the performer P2 (player) in real time between a friend who is actually watching a sport or the like and a friend who is watching a broadcast in a remote place. In addition to producing a sense of unity with performer P2, user information and peripheral information are collected and aggregated from all audiences, including those in remote locations, so that the sense of unity with remote friends Can be produced.

  FIG. 11 is a diagram illustrating a communication system CS3 that conveys a sense of unity that is Embodiment 3 of the present invention.

  In the communication system CS3, the scenario composition unit 74 reproduces the performer P3 (not shown) stored in the storage medium by the information storage unit 72 of the management server SV1 of the communication system CS1, and the on-site information. Although it is not time, it is an Example which produces a sense of unity with performer P3 and other spectators.

  The communication system CS3 includes a management server SV3 and an audience terminal T31 that reproduces a scenario. The management server SV3 reproduces the performer P3 and the venue information based on the request from the audience terminal T31.

  In the communication system CS3, when the audio / video is reproduced, the audio / video reproduction device 81 or the audience terminal T31 may perform it. When reproducing video and audio, if there is a change in the user information (performer information, audience information) of the performer P3 configured by the scenario constructing means 72, the peripheral information of the performer, and the peripheral information of the audience The management server SV3 distributes change information between the user information and the peripheral information to the audience terminal T31.

  In the audience terminal T31, the information presentation means 60 changes the light, sound, smell, vibration, temperature of the terminal, notifies the status change of the performer P3, and senses unity with the performer P3. Produce. In addition, even if there is a change in the field information in the scenario, the management server SV3 distributes the field information to the audience terminal T31 and changes the light, sound, smell, vibration, and terminal temperature in the same manner as described above. It is produced in real time so as to be in the same space as other audiences who are present at the same place as the performer P3 and have a sense of unity, and produce a sense of unity between the audiences over time.

  In the communication system CS3, when reproducing a scenario in which a video such as a movie, sound, etc. is reproduced, the user information and surrounding information of the performer P3 are felt, and a sense of unity with the performer P3 is produced, and the performer P3 By reproducing the event data that aggregates the information of the audience in the same space at the same time, it is possible to produce a sense of unity between the audiences over time.

Further, the communication system CS3 may be applied to the communication system CS2.

  FIG. 12 is a diagram showing a communication system CS4 that conveys a sense of unity that is Embodiment 4 of the present invention.

  In the communication system CS4, the management server SV3 is omitted from the communication system CS3, and the user information and the venue information of the performer P4 (not shown) are obtained from the audience in a concert, baseball game, soccer game, etc. that are experienced in real time. In this embodiment, the data is stored in the terminal T41 and then reproduced. As a result of the reproduction, it reproduces the sense of unity felt by the audience in concerts, watching baseball games, watching soccer games, and the like.

  The communication system CS4 is composed only of the audience terminal T41.

  The audience P41 reproduces the data stored in the storage device of the audience terminal T41, such as a concert, a baseball game, and a soccer game.

  When playing back video and audio, the video and audio playback device 82 may play back, or the audience terminal T41 may play back. When the video and audio are played, the audience P4 information and the venue information stored in the audience terminal T41 in the concert, baseball game, soccer game, etc. are matched with the video and audio playback. The information presentation means 30 of the terminal T41 reproduces the atmosphere of the place by shining, vibrating and generating heat.

In the communication system CS4, in addition to video and audio, by reproducing the information of the performer P4 and the venue, it is possible to recall a sense of unity in past events, not only to convey a sense of unity in real time, A deep sense of unity can be produced.

It is a figure which shows communication system CS1 which conveys a sense of unity which shows Example 1 of this invention. 1 is a diagram illustrating a communication system CS1 that is Embodiment 1. FIG. 3 is a block diagram illustrating a configuration example of performer information acquisition means 10. FIG. It is a figure which shows the structural example of the periphery information acquisition means 20 of the performer in Example 1. FIG. It is a figure which shows the structural example of the video input means 11 in Example 1. FIG. It is a figure which shows the structural example of the information presentation means 30 in Example 1. FIG. In Example 1, it is a flowchart which shows the operation | movement which collects the information of the place which aggregated the information of the performer P1, such as a concert hall, and many audiences and the peripheral information of those audiences. It is a flowchart which shows the operation | movement by which management server SV1 distributes an event. It is a flowchart which shows the operation | movement which comprises the information of the place which the information aggregation means 73 of management server SV1 performs. It is a figure which shows communication system CS2 which conveys a sense of unity which is Example 2 of this invention. It is a figure which shows communication system CS3 which conveys a sense of unity which is Example 3 of this invention. It is a figure which shows communication system CS4 which conveys a sense of unity which is Example 4 of this invention.

Explanation of symbols

SV1, SV2, SV3 ... management server,
T1, T2 ... Performer terminal,
T11-T13, T21-T26, T31, T41 ... audience terminal,
10 ... Performer information acquisition means,
11 ... Video input means,
12: Image processing means,
13 ... biometric information input means,
14 ... motion detection means,
15 ... Motion feature amount detection means,
16 ... Kansei information extraction means,
17: User information configuration means,
18 ... various setting means,
20 ... Performer information acquisition means,
21 ... Video input means,
22: Environmental information processing means,
23 ... motion detection means,
24. Image processing means,
25. Motion feature quantity detection means,
26. Peripheral information constituent means,
30, 60 ... information presentation means,
40. Audience information acquisition means,
50. Means for obtaining information around the audience,
C1, C2 ... control means,
CM1, CM2, CM3 ... communication means,
71 ... delivery control means,
72. Information storage means,
73. Information collecting means,
74: Scenario construction means.

Claims (6)

Performer information acquisition means for acquiring performer information including at least one of the performer's biometric information and sensitivity information, at least one of the environmental information around the performer, and the presence of a person other than the performer The presenter's information change is presented by changing at least one of the surrounding information acquisition means of the performer that acquires the surrounding information of the person including the light, light, sound, smell, vibration, and temperature of the terminal. A performer terminal comprising: an information presentation means for performing communication; a communication means for data communication with a predetermined management server; and a control means for controlling them;
Audience information acquisition means for acquiring audience information including at least one of the biological information and sensitivity information of the audience, environmental information around the audience, and information on the surroundings of the person including at least one person other than the audience The audience peripheral information acquisition means for acquiring the information, the information presentation means for presenting the information change of the audience by changing at least one of light, sound, smell, vibration, temperature of the terminal, and the management server A spectator terminal comprising communication means for data communication with and control means for controlling them;
Collecting data transmitted from the performer terminal or the audience terminal in a centralized manner, and distribution control means for transmitting data to the audience terminal according to a predetermined distribution rule, and storing the collected data in a storage medium A scenario in which information storage means, information aggregation means that configures the venue information based on the determined rules, and data collected from the performer terminal or the audience terminal are stored as a log and configured as a scenario in time series A management server comprising constituent means and communication means for data communication with the performer terminal or the audience terminal;
The video or audio of the performer is acquired using a camera or a microphone, distributed to the audience terminal, the visual information of the performer is presented to the audience, the performer information or the performer's Gathering the surrounding information and presenting it to the above audience, collecting and aggregating the audience information of the audience that constitutes the venue or the surrounding information of the audience, and configuring the group information in the venue as the venue information, A communication system that conveys a sense of unity, characterized by delivering information to performers and the audience and presenting information. In claim 1,
The performer information acquisition means is means having video input means, biological information input means, image processing means, motion detection means, motion feature amount detection means, and sensitivity information extraction means. Communication system that conveys a sense of unity. In claim 1,
The spectator information acquisition means includes a video input means, environmental information input means, motion detection means, image processing means, and motion feature amount detection means, and provides a sense of unity. In claim 1,
The audience information collected from the audience terminal and the surrounding information of the audience are accumulated, the accumulated data is extracted for a certain period of time, and the minimum value, maximum value, average value, variance, center are extracted according to the type of information. When the value is calculated and the amount of change is large compared to the previously calculated value, it is adopted as the venue information, the changed information is configured as the venue information, and distributed to the performers and the audience A communication system that conveys the characteristic sense of unity. In claim 1,
The audience information collected from the audience terminal and the surrounding information of the audience are accumulated in the management server in a unified manner, and the accumulated data is downloaded from the management server via the network, and video or audio of a concert or sport Is a communication system that conveys a sense of unity, characterized by reproducing. In claim 5,
When playing back saved video or audio for a concert or sporting event, reproduce the information of the performers or places saved on the above-mentioned audience terminal, and play the information on the place that aggregated the information of the audience who participated in the above-mentioned events A communication system that conveys a sense of unity.

Images