JP6824098B2 - Information information system, content distribution server, terminal and program - Google Patents

Description

The present invention relates to information information systems, content distribution servers, terminals and programs.

Conventionally, there is known a technique for providing computer graphics (CG, Computer Graphics) contents of handwriting to a deaf user or the like by using television broadcasting or the Internet (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2013-0873838

For example, consider providing a sign language CG video explaining the content of the program at the same time as the program by broadcasting or the like. In this case, in the prior art, when the program has relatively fast development content such as a broadcast of a sports competition, the content transmitted in the video of the program and the content transmitted in the video of sign language CG There is a problem that the current situation may be difficult for the user to understand due to the time difference.

Therefore, it is an object of the present invention to provide a technique capable of communicating the contents of a sports competition program in an easy-to-understand manner.

An information system that has a content generation server and a content distribution server.
The content generation server is distributed in real time from one or more metadata distribution servers, acquires at least metadata regarding the progress of sports competition, and based on the metadata acquired from the metadata distribution server, handwriting CG ( Computer Graphics) It has a content data generation unit that generates content data including moving images, and the content distribution server is real-time data indicating a real-time situation in the sports competition based on the metadata acquired by the content generation server. A real-time data generation unit that generates data, a storage unit that stores the content data generated by the content data generation unit, and data that reads the content data stored in the storage unit and includes identification information of the content data. It has a media data generation unit that generates certain media data, and a distribution unit that distributes the real-time data, the media data, and the content data to a terminal.

According to the disclosed technology, the content of the sports competition program can be conveyed in an easy-to-understand manner.

It is a figure which shows the structural example of the information processing system which concerns on embodiment. It is a functional block diagram which shows the functional structure of the information processing system which concerns on embodiment. It is a sequence diagram which shows an example of the processing of an information processing system. It is a flowchart which shows an example of the processing of a metadata distribution server. It is a figure which shows an example of the metadata which shows the progress of a sports competition. It is a flowchart which shows an example of the process of a content generation server. It is a flowchart which shows an example of the process of a content distribution server. It is a flowchart which shows an example of the processing of a terminal. It is a figure which shows an example of the game selection screen displayed on a terminal. It is a figure which shows an example of media XML. It is a figure which shows an example of real-time XML. It is a figure which shows an example of the main screen displayed on a terminal. It is a figure which shows an example of the rule explanation screen displayed on a terminal. It is a figure which shows an example of the player information screen displayed on a terminal. It is a figure which shows an example of the game progress screen displayed on a terminal. It is a flowchart which shows an example of the data update process of a terminal.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<System configuration>
FIG. 1 is a diagram showing a configuration example of the information processing system 1 according to the embodiment. In FIG. 1, the information processing system 1 includes a metadata distribution server 10, a content generation server 20, a content distribution server 30, and terminals 40-1, 40-2, ... (In the following, it is not necessary to distinguish between them. In the case, it is simply referred to as "terminal 40").

The content generation server 20 of the information processing system 1 acquires at least metadata regarding the progress of a sports competition, which is distributed in real time from one or more metadata distribution servers 10, and based on the metadata, the handwriting CG (Computer). Graphics) Generate content data including videos.

The content distribution server 30 generates real-time data indicating a real-time situation in a sports competition based on the metadata acquired by the content generation server 20. Further, the content distribution server 30 stores the content data generated by the content generation server 20 and generates media data which is data including identification information of the content data. Then, the content distribution server 30 distributes the real-time data, the media data, and the content data to the terminal.

The terminal 40 controls the vibration or display of the terminal based on the real-time data, acquires the content data based on the identification information included in the media data, and displays the acquired content data on the screen.

The metadata distribution server 10 and the content generation server 20 are connected so as to be able to communicate with each other via a network such as the Internet or a LAN (Local Area Network).

The content generation server 20 and the content distribution server 30 are connected so that they can communicate with each other via a network such as a LAN.

The content distribution server 30 and the terminal 40 are connected so as to be able to communicate with each other via, for example, the Internet or a mobile phone network such as LTE (Long Term Evolution).

The metadata distribution server 10 is an information processing device (computer) for a server, and generates and distributes metadata. Here, the metadata is, for example, data related to the contents of contents (television programs, etc.) broadcast by a television station. The metadata includes at least data on the progress of a sports competition, which is distributed in real time from one or more metadata distribution servers 10. Here, the broadcasting is not limited to broadcasting by radio waves, but also includes Internet broadcasting in which data of a television program is transmitted via a network.

The content generation server 20 is an information processing device for a server, and generates content data to be provided to the terminal 40 based on the metadata distributed from the metadata distribution server 10.

The content distribution server 30 is an information processing device for the server, and distributes content data generated by the content generation server 20 to the terminal 40.

The terminal 40 is, for example, an information processing device such as a tablet PC (Personal Computer), a smartphone, or a notebook PC. The terminal 40 provides the user with the content distributed from the content distribution server 30.

<Functional configuration>
Next, with reference to FIG. 2, the functional configuration of the information processing system 1 according to the embodiment will be described. FIG. 2 is a functional block diagram showing a functional configuration of the information processing system 1 according to the embodiment.

≪Metadata distribution server≫
The metadata distribution server 10 has an analysis unit 11, a metadata generation unit 12, and a communication unit 13.

The analysis unit 11 analyzes the video and audio of the broadcast program.

The metadata generation unit 12 generates metadata based on the result analyzed by the analysis unit 11.

The communication unit 13 transmits the metadata generated by the metadata generation unit 12 to the content generation server 20.

≪Content generation server≫
The content generation server 20 has a content data generation unit 21, a communication unit 22, and a control unit 23.

The content data generation unit 21 generates content data such as a handwriting CG video based on the metadata regarding the content of the broadcasted program received from the metadata distribution server 10.

The communication unit 22 receives the metadata from the metadata distribution server 10. In addition, the communication unit 22 transmits at least a part of the metadata and the content data generated by the content data generation unit 21 to the content distribution server 30.

The control unit 23 controls the content data generation unit 21, the communication unit 22, and the like based on the metadata received from the metadata distribution server 10.

≪Content distribution server≫
The content distribution server 30 includes a storage unit 31, a real-time data generation unit 32, a media data generation unit 33, a distribution unit 34, and a communication unit 35.

The storage unit 31 stores the media XML (Extensible Markup Language) 301 and the real-time XML 302. In addition, the storage unit 31 has a content data DB 311 that stores the content data generated by the content generation server 20.

The real-time data generation unit 32 generates a real-time XML 302 (an example of “real-time data”) indicating the situation in the program currently being broadcast based on the metadata received from the content generation server 20, and stores the generated real-time XML 302. It is stored in the part 31.

The media data generation unit 33 generates the media XML301 (an example of "media data") including the URL (Uniform Resource Locator, an example of "identification information") of the content data stored in the content data DB311, and generates the media XML301. Is stored in the storage unit 31.

The distribution unit 34 distributes the content data stored in the media XML301, the real-time XML302, and the content data DB311 to the terminal 40.

The communication unit 35 communicates with the content generation server 20 and the terminal 40.

≪Terminal≫
The terminal 40 has a control unit 41, an acquisition unit 42, a display control unit 43, and a communication unit 44.

The control unit 41 controls the vibration, display, and the like of the terminal 40 based on the real-time XML 302 distributed from the content distribution server 30.

The acquisition unit 42 acquires the content data of the URL by using the URL included in the media XML301 distributed from the content distribution server 30.

The display control unit 43 displays the content data acquired by the acquisition unit 42 on the screen.

The communication unit 44 communicates with the content distribution server 30.

<Processing>
Next, the processing of the information processing system 1 will be described with reference to FIG. FIG. 3 is a sequence diagram showing an example of processing of the information processing system 1.

In step S1, the communication unit 13 of the metadata distribution server 10 distributes the metadata to the content generation server 20.

Subsequently, in step S2, the content data generation unit 21 of the content generation server 20 generates predetermined content based on the received metadata. Here, the content generation server 20 generates each content such as a sign language CG video and character information.

Subsequently, in step S3, the communication unit 22 of the content generation server 20 transmits each generated content and at least a part of the received metadata to the content distribution server 30.

Subsequently, in step S4, the storage unit 31 of the content distribution server 30 stores each received content.

Subsequently, in step S5, the media data generation unit 33 of the content distribution server 30 generates media XML301, which is data indicating the URL of each stored content.

Subsequently, in step S6, the real-time data generation unit 32 of the content distribution server 30 generates a real-time XML 302 indicating a real-time event or situation in a match or the like based on the received metadata.

Subsequently, in step S7, the communication unit 44 of the terminal 40 accesses the content distribution server 30 in response to a user operation or the like.

Subsequently, in step S8, the communication unit 44 of the terminal 40 transmits the acquisition request of the media XML301 to the content distribution server 30.

Subsequently, in step S9, the distribution unit 34 of the content distribution server 30 distributes the media XML301 to the terminal 40.

Subsequently, in step S10, the communication unit 44 of the terminal 40 transmits an acquisition request to the URL specified by the media XML301.

Subsequently, in step S11, the distribution unit 34 of the content distribution server 30 distributes the content of the URL requested by the terminal 40 to the terminal 40.

Subsequently, in step S12, the display control unit 43 of the terminal 40 displays on the screen or the like based on the content acquired from the content distribution server 30.

Subsequently, in step S13, the communication unit 44 of the terminal 40 transmits the acquisition request of the real-time XML 302 to the content distribution server 30.

Subsequently, in step S14, the distribution unit 34 of the content distribution server 30 transmits the real-time XML 302 to the terminal 40.

Subsequently, in step S15, the control unit 41 of the terminal 40 performs vibration, display on the screen, or the like based on the real-time XML 302 acquired from the content distribution server 30.

The processing of steps S8 to S12 relating to the media XML301 and the processing of steps S13 to S15 relating to the real-time XML302 are performed asynchronously. For example, while steps S8 to S12 are performed once, the processes of steps S13 to S15 may be performed a plurality of times.

≪Metadata distribution server≫
Next, the processing of the metadata distribution server 10 will be described with reference to FIG. FIG. 4 is a flowchart showing an example of processing by the metadata distribution server 10. The process of FIG. 4 is repeatedly executed, for example, while a sports game is being played.

In step S101, the analysis unit 11 of the metadata distribution server 10 acquires video and audio. Here, the metadata distribution server 10 acquires, for example, the video and audio of a sports game distributed from a local TV station or the like. The video and audio of the sport match will be broadcast in the area after the audio of the announcer is included by the TV station or the like in the area where the terminal 40 is located.

Subsequently, in step S102, the analysis unit 11 of the metadata distribution server 10 analyzes at least one of the acquired video and audio, and detects the excitement level and a predetermined event.

Here, the excitement level is, for example, data indicating the degree of excitement of the spectators at the sports game venue. The excitement level may be determined by the level of volume such as cheers in the acquired voice or the value of loudness. Here, the loudness value may be determined by using, for example, an existing loudness measurement method (ITU-R Recommendation BS.1770-3) that supports up to 5.1ch surround. When the acquired voice contains almost no voice other than cheers, the volume level of the acquired voice may be determined. Further, when the acquired voice includes a voice other than the cheers, for example, a voice such as a live situation in the field, the cheers may be recognized as the voice and the volume level of the recognized cheers may be determined.

Further, the predetermined event may be, for example, an event in a sports game in which the situation of the game changes. For example, a foul (foul) is determined by the referee, a whistle is blown, a buzzer or the like is sounded to interrupt the game, or a player scores a goal may be detected as a predetermined event.

Subsequently, in step S103, the metadata generation unit 12 of the metadata distribution server 10 generates metadata indicating an event or the like detected by the analysis unit 11, and distributes the metadata to the content generation server 20 using the communication unit 13. ..

The metadata distribution server 10 may distribute metadata provided by an external business operator. In this case, for example, the metadata distribution server 10 is composed of a plurality of servers, and at least one of the plurality of servers provides a service for distributing the result and progress of a sports competition in real time, IOC (International). It may be an ODF (Olympic Data Feed) server of the Olympic Committee. The metadata distributed by the IOC is used to generate competition-related information and the like provided by television data broadcasting and the like.

FIG. 5 is a diagram showing an example of metadata showing the progress of a sports competition. In the example of FIG. 5, in XML format, statistical information such as a competition score and a serve decision rate, and data such as an event that occurred in the competition are included. Here, for example, a description such as "Result =" ACE "Value =" SRV "" indicates that a service ace has occurred. In the example of FIG. 5, it is shown that at 9 minutes and 21 seconds after the start of the game in the first set, the Japanese player with the third uniform number scored a service ace and the score was 11 to 11.

≪Content generation server≫
Next, the process of the content generation server 20 will be described with reference to FIG. FIG. 6 is a flowchart showing an example of processing by the content generation server 20. The process of FIG. 6 is executed, for example, when metadata is received from the metadata distribution server 10.

In step S201, the communication unit 22 of the content generation server 20 receives the metadata from the metadata distribution server 10.

Subsequently, in step S202, the control unit 23 of the content generation server 20 analyzes the received metadata.

Subsequently, in step S203, the control unit 23 of the content generation server 20 transmits the metadata indicating a real-time event or situation in a match or the like to the content distribution server 30 by the communication unit 22 among the received metadata. Here, the metadata transmitted to the content distribution server 30 includes data indicating an excitement level and a predetermined event.

Subsequently, in step S204, the content data generation unit 21 of the content generation server 20 generates content such as a sign language CG moving image and character information based on the received metadata. Here, for example, based on the metadata as shown in FIG. 5, a moving image of sign language CG showing the result and progress of the sports competition is generated. Sign language CG moving images are generated as data according to standards such as MPEG (Moving Picture Experts Group) -4.

Subsequently, in step S205, the content data generation unit 21 of the content generation server 20 transmits the generated content to the content distribution server 30 by the communication unit 22, and ends the process.

≪Content distribution server≫
Next, with reference to FIG. 7, the process of generating the media XML301 and the real-time XML302 by the content distribution server 30 will be described. FIG. 7 is a flowchart showing an example of media XML301 and real-time XML302 generation processing of the content distribution server 30. The process of FIG. 7 is executed, for example, when data is received from the content generation server 20.

In step S301, the communication unit 35 of the content distribution server 30 receives data from the content generation server 20.

Subsequently, in step S302, the communication unit 35 of the content distribution server 30 determines whether or not the received data is metadata.

When the received data is metadata (step S302: YES), the real-time data generation unit 32 of the content distribution server 30 generates real-time XML302 based on the received metadata in step S303, and ends the process. .. The generated real-time XML 302 is transmitted to the terminal 40, for example, in response to a HTTP (Hypertext Transfer Protocol) request from the terminal 40. Alternatively, when the real-time XML 302 is generated, it may be transmitted from the content distribution server 30 to the terminal 40 by push-type distribution.

When the received data is not metadata (step S302: NO), the storage unit 31 of the content distribution server 30 stores the received content data in the content data DB 311 in step S304.

Subsequently, in step S305, the media data generation unit 33 of the content distribution server 30 generates a URL corresponding to the stored content data.

Subsequently, in step S306, the media data generation unit 33 of the content distribution server 30 generates the media XML301 including the generated URL, and ends the process.

Further, the distribution unit 34 of the content distribution server 30 has, for example, the function of a Web server, and when the terminal 40 receives an HTTP request to a URL included in the media XML301, the content associated with the URL is received. Data is transmitted to the terminal 40.

≪Terminal≫
Next, the processing of the terminal 40 will be described with reference to FIGS. 8 to 11. FIG. 8 is a flowchart showing an example of processing of the terminal 40. FIG. 9 is a diagram showing an example of a game selection screen displayed on the terminal 40. FIG. 10 is a diagram showing an example of the media XML301. FIG. 11 is a diagram showing an example of the real-time XML 302.

In step S401, the control unit 41 of the terminal 40 accesses the content distribution server 30 in response to an operation from the user, for example, and displays a Web page of a list of each game currently being broadcast. Here, the terminal 40 accesses, for example, a predetermined URL and acquires the Web page of the content distribution server 30 by using HTTP.

Here, as shown in FIG. 9, a list 500 of various games is displayed on the game selection screen, and contents related to the selected game are displayed according to the selection operation of the buttons 501 to 503 from the user. become. The match displayed in the list 500 may be a match of each program currently being broadcast by various television stations.

Subsequently, in step S402, the control unit 41 of the terminal 40 receives an operation from the user to select a match for which the content is to be distributed.

Subsequently, in step S403, the acquisition unit 42 of the terminal 40 acquires the media XML301 indicating the URL of each content related to the game selected by the user from the content distribution server 30.

Here, in the media XML 301 shown in FIG. 10, data such as "MovieURL" 311, "RuleURL" 312, "PlayersURL" 313, "DigestURL" 314, and "StatsURL" 315 are described in XML format.

"Movie URL" 311 is a URL of a sign language CG video showing the actual condition of the game and the content of the commentary.

"RuleURL" 312 is a URL of a sign language CG video explaining the game rules determined to be a foul when the referee determines that the foul has occurred.

"Players URL" 313 is the URL of a site that provides information on each player participating in the game.

"DigestURL" 314 is a URL of a sign language CG video showing a digest of the game. Here, the digest may include, for example, a main scoring scene, an outline of the progress of the game, and the like.

"StatsURL" 315 is the URL of a site that provides statistical information about the game.

Subsequently, in step S404, the acquisition unit 42 of the terminal 40 acquires the real-time XML 302 indicating various events related to the game selected by the user from the content distribution server 30.

Here, in the real-time XML 302 shown in FIG. 11, data such as “Whistle” 321 and “Heat” 322 are described in XML format.

“Whistle” 321 is data indicating whether or not the referee has determined a foul, and if it is “1”, it indicates that a foul has been determined.

“Heat” 322 is a value indicating the excitement level. Here, the excitement level is a value of 10 levels from "1" to "10", and the level "10" may indicate that the venue is maximally excitement.

Subsequently, in step S405, the control unit 41 and the display control unit 43 of the terminal 40 notify the user of each content and real-time event related to the game selected by the user based on the media XML301 and the real-time XML302. ..

The acquisition unit 42 of the terminal 40 performs the process of acquiring the media XML301 in step S403 when the reproduction of the sign language CG video is completed (finished). When the sign language CG moving image is not played, it is performed at the first interval (for example, 10 second interval).

Further, the acquisition unit 42 of the terminal 40 executes the process of acquiring the real-time XML 302 in step S404 at a second interval (for example, 1 second interval) shorter than the first interval. Alternatively, when the real-time XML 302 is updated on the content distribution server 30, the content distribution server 30 may notify by push type.

Then, the acquisition unit 42 of the terminal 40 repeats the process of step S405 every time the media XML301 and the real-time XML302 are updated.

≪Terminal screen display example≫
Next, an example of a screen displayed on the terminal 40 will be described with reference to FIGS. 12 to 15. FIG. 12 is a diagram showing an example of a main screen displayed on the terminal 40. As shown in FIG. 12, on the main screen, the current display type 511A, the sign language CG512A of the actual situation and explanation of the game, the excitement level 513, the game outline 514, and the transition buttons 515A to 518A are displayed.

On the main screen, the current display type 511A is data indicating the content of the currently displayed content. In the example of FIG. 12, it is displayed as "real-time event". In the sign language CG512 of the game commentary and the game commentary, a video of the sign language CG showing the content of the game commentary and the game commentary acquired from "MovieURL" 311 is displayed. The excitement level 513 displays the excitement level distributed from the content distribution server 30 acquired from "Heat" 322. In the example of FIG. 12, the excitement level is “3”. In addition, the terminal 40 may notify the user by vibration instead of displaying the excitement level on the screen. In this case, the terminal 40 may vibrate the terminal 40, for example, with a magnitude of vibration corresponding to the value of the excitement level.

In the game outline 514, statistical information such as the opponent team, the score of each team, the elapsed time in the game, the scorer, the scoring time, and the batting average in baseball, which are obtained from "StatsURL" 315, are displayed.

The transition buttons 515A to 518A are buttons that display the selected screen in response to a selection operation from the user. When the transition button 515A is pressed on the main screen, the screen transitions to the match selection screen shown in FIG. When the transition button 516A is pressed, the screen transitions to the rule explanation screen shown in FIG. When the transition button 517A is pressed, the screen transitions to the player information screen shown in FIG. When the transition button 518A is pressed, the screen transitions to the game progress screen shown in FIG.

FIG. 13 is a diagram showing an example of a rule explanation screen displayed on the terminal 40. As shown in FIG. 13, the current display type 511B, the sign language CG512B for rule explanation, the game outline 514, and the transition buttons 515B to 518B are displayed on the rule explanation screen. On the rule explanation screen, "rule explanation" is displayed in the current display type 511B. In the sign language CG512B, a video of the sign language CG showing the actual condition of the game and the contents of the commentary acquired from "RuleURL" 312 is displayed. When the transition button 515B is pressed, the screen returns to the main screen. The transition buttons 516B to 518B are the same as the transition buttons 516A to 518A.

FIG. 14 is a diagram showing an example of a player information screen displayed on the terminal 40. As shown in FIG. 14, on the player information screen, the current display type 511C, player information 521, scroll bar 522, and transition button 515C are displayed. On the player information screen, the current display type 511C is displayed as "participating player". The player information 521 displays information on the players of each team in the match. The name of each player may be linked to content such as characters or videos showing detailed player information. When the transition button 515C is pressed, the screen returns to the main screen.

FIG. 15 is a diagram showing an example of a game progress screen displayed on the terminal 40. As shown in FIG. 15, the current display type 511D, the sign language CG512D of the game progress, the game outline 514, and the transition buttons 515D to 518D are displayed on the game progress screen. On the match progress screen, "match progress" is displayed in the current display type 511D. In the sign language CG512D, a video of the sign language CG showing the digest of the game acquired from "DigestURL" 314 is displayed. The transition buttons 515D to 518D are the same as the transition buttons 516B to 518B.

≪Data update processing on the terminal≫
Next, the data update process in the terminal 40 will be described with reference to FIG. FIG. 16 is a flowchart showing an example of data update processing of the terminal 40.

In step S501, the acquisition unit 42 of the terminal 40 acquires the updated real-time XML 302.

Subsequently, in step S502, the control unit 41 of the terminal 40 determines whether or not a predetermined event such as a foul has occurred. Here, the control unit 41 of the terminal 40 determines, for example, that a foul has occurred in the updated real-time XML 302 if the value of "Whistle" 321 is "1".

When a predetermined event has not occurred (step S502: NO), the control unit 41 of the terminal 40 updates the display of the excitement level and the like based on the updated real-time XML 302 in step S503, and ends the process. ..

When a predetermined event occurs (step S502: YES), the control unit 41 of the terminal 40 activates the vibration function of the terminal 40 and vibrates the terminal 40 in step S504, so that the predetermined event occurs. Notify the user of this. The control unit 41 of the terminal 40 may notify that a predetermined event has occurred by using at least one of vibration, banner, and dialog. Here, the banner and the dialog are functions provided by the OS (Operating System) of the tablet PC, and are functions for displaying a screen for notifying the user of an event. For example, in the banner function, a predetermined message may be displayed at the upper part of the screen, and the display may be automatically deleted. Further, in the dialog function, a predetermined message may be displayed in the center of the screen, and the display may disappear in response to a confirmation operation by the user.

Further, in step S504, the control unit 41 of the terminal 40 activates the vibration function of the terminal 40 to vibrate the terminal 40, and then uses a banner or a dialog to, for example, "a foul was taken by the referee. The content of a predetermined event may be displayed, such as ". Player A of team A violates the three-second rule."

Subsequently, in step S505, the control unit 41 of the terminal 40 determines whether or not the moving image of the sign language CG is being played.

When the sign language CG moving image is not being played back (step S505: NO), the control unit 41 of the terminal 40 proceeds to the process of step S507 described later.

When the sign language CG moving image is being played back (step S505: YES), the control unit 41 of the terminal 40 stops the display control unit 43 from playing the sign language CG moving image in step S506.

Subsequently, in step S507, the acquisition unit 42 of the terminal 40 communicates the acquisition request of the media XML301 at a third interval (for example, a 2-second interval) shorter than the first interval until the media XML301 is updated. It is transmitted to the metadata distribution server 10 by the unit 44.

Subsequently, in step S508, the display control unit 43 of the terminal 40 reproduces the moving image of the sign language CG based on the updated media XML301. As a result, for example, the terminal 40 vibrates due to the referee blowing a whistle, and when the user pays attention to the screen of the terminal 40, the video being played is stopped, and the user is concerned. You can wait until the video about the whistle starts playing.

<Summary>
For example, for big sporting events such as the Tokyo Olympics, there is a desire for hearing-impaired and able-bodied people to enjoy watching sports together.

Conventionally, in sports programs, it is difficult to understand all situations from images alone. For example, in a scene where a match is stopped due to a foul or the like, the content of the foul is often conveyed only by voice in a TV program, so a hearing-impaired person may not know what happened just by looking at the screen. ..

According to the above-described embodiment, real-time data indicating the situation in the program is generated based on the metadata about the content of the broadcast program, and the vibration or display of the terminal 40 is controlled based on the real-time data. Further, based on the metadata, content data including a sign language CG moving image is generated, and the content data is displayed on the screen of the terminal 40. As a result, the content of the program can be transmitted in an easy-to-understand manner.

Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments, and various modifications and variations are made within the scope of the gist of the present invention described in the claims. It can be changed. It is also possible to combine some or all of the above-mentioned examples.

For example, each functional unit of the metadata distribution server 10, the content generation server 20, the content distribution server 30, and the terminal 40 may be realized by, for example, cloud computing composed of a plurality of computers. Further, a plurality of servers among the metadata distribution server 10, the content generation server 20, and the content distribution server 30 may be realized by one information processing device. Further, any server may have each functional unit of the content generation server 20, the content distribution server 30, and the terminal 40. For example, the content generation server 20 or the like may have a real-time data generation unit 32, a media data generation unit 33, and the like. Further, the content distribution server 30 may have the control unit 41 and the like.

1 Information processing system 10 Metadata distribution server 11 Analysis unit 12 Metadata generation unit 13 Communication unit 20 Content generation server 21 Content data generation unit 22 Communication unit 23 Control unit 30 Content distribution server 31 Storage unit 301 Media XML
302 real-time XML
311 Content data DB
32 Real-time data generation unit 33 Media data generation unit 34 Distribution unit 35 Communication unit 40 Terminal 41 Control unit 42 Acquisition unit 43 Display control unit 44 Communication unit

Claims (8)

An information system that has a content generation server and a content distribution server.
The content generation server
It is distributed in real time from one or more metadata distribution servers, acquires at least metadata regarding the progress of sports competitions, and includes a handwriting CG (Computer Graphics) video based on the metadata acquired from the metadata distribution server. It has a content data generation unit that generates content data,
The content distribution server is
A real-time data generation unit that generates real-time data indicating a real-time situation in the sports competition based on the metadata acquired by the content generation server.
A storage unit that stores content data generated by the content data generation unit,
A media data generation unit that reads out the content data stored in the storage unit and generates media data that is data including identification information of the content data.
An information information system having the real-time data, the media data, and a distribution unit that distributes the content data to a terminal. In the information processing system according to claim 1,
The real-time data includes data on the loudness of cheers at the venue, which is a volume level or loudness value indicating the degree of excitement of the spectators in the sports competition.
Information processing system. In the information processing system according to claim 1 or 2.
The real-time data includes data on foul events in the sport competition.
Information processing system. A real-time data generation unit that is distributed in real time from one or more metadata distribution servers and generates real-time data indicating the real-time situation in the sports competition based on at least metadata about the progress of the sports competition.
A storage unit that stores content data generated based on the metadata,
A media data generation unit that reads out the content data stored in the storage unit and generates media data that is data including identification information of the content data.
A distribution unit that distributes the real-time data, the media data, and the content data to the terminal,
Content distribution server with. It ’s a terminal,
A control unit that controls the vibration or display of the terminal based on real-time data indicating the situation in the sports competition, which is generated based on at least the metadata regarding the progress of the sports competition.
An acquisition unit that acquires media data that includes identification information of content data generated based on the metadata, and acquires the content data based on the identification information included in the media data.
A display control unit that displays the content data acquired by the acquisition unit on the screen, and
Have,
The real-time data includes data on foul events in the sport competition.
The control unit notifies that the event has occurred by vibration of the terminal.
Terminal. The terminal according to claim 5.
When the reproduction of the sign language CG video included in the content data is completed, the acquisition unit acquires the media data again.
Terminal. The terminal according to claim 5 or 6.
When the control unit receives the real-time data, the display control unit stops the reproduction of the sign language CG moving image, and the acquisition unit acquires the media data again.
Terminal. A program for operating a computer as a terminal according to any one of claims 5 to 7.

Images