JP7154016B2 - Information provision system and information provision method - Google Patents

Description

Article 30, Paragraph 2 of the Patent Act applies Dates: November 7, 2017, November 13, 2017 Meeting name: COTOHA/AI Utilization Contest Venue: Tamachi, 3-4-1 Shibaura, Minato-ku, Tokyo Grand Park Plaza Building Tamachi Grand Park Conference 301 Large Conference Room

The present invention relates to technology for providing information about events that users are watching.

In recent years, various events that can be viewed have been provided to users. For example, spectator sports events and live music events are provided. Some of these events are offered locally, such as match venues and live venues, while others are available for viewing over networks. Also, a technology has been proposed that determines a program that the user is interested in and provides information about the determination result (see, for example, Patent Document 1).

One of the troubles and confusions for users watching these events is that they do not know the rules and information about the characters. For example, a user watching a rugby match at a venue may not be able to fully enjoy the match if he or she does not know enough about the rules of rugby and information about the players participating in the match. In such a case, there is a possibility that the user will be less likely to participate in the same type of event next time.

Japanese Patent No. 5666629

In general, commentary information such as live coverage is also provided for the event. However, there are cases in which novice users who do not know the rules and player information described above cannot understand the provided commentary information. On the other hand, if commentary information is provided in accordance with the level of understanding of such a beginner user, veteran users who regularly watch the same kind of event will be dissatisfied.
In view of the above circumstances, an object of the present invention is to provide a technology capable of providing more favorable information to a user who is watching an event.

One aspect of the present invention is an acquisition unit that acquires user attribute information regarding an event to be viewed, and an information provision unit that provides the user with information regarding the event according to the user's attribute information. and wherein the attribute information includes information indicating the user's degree of understanding of the event, and the information providing unit provides information about the event including a response sentence according to the user's degree of understanding. It is an information provision system.

One aspect of the present invention is the above information providing system, comprising: a learning unit that performs learning processing based on past information about the event; a learning result storage unit that stores learning results obtained by the learning unit; a determination unit that determines information indicating a future result of an event occurring in the event by using the learning result stored in the result storage unit, wherein the past information is 1 or 1 in the event supervised learning data in which semantic information indicating meaning in a plurality of scenes and result information as information indicating subsequent results in one or more scenes in the event are associated with each other; By performing a learning process using the supervised learning data, a learning result for estimating a subsequent result based on new semantic information is acquired, and the information providing unit determines the future determined by the determination unit. Provide information, including information about

According to one aspect of the present invention, an acquisition step in which a computer acquires user attribute information regarding an event to be viewed; wherein the attribute information includes information indicating the user's level of understanding of the event, and in the information providing step, the computer provides a response according to the user's level of understanding A method of providing information for providing information about the event including a sentence .

According to the present invention, it is possible to provide users viewing an event with more favorable information for the users.

1 is a schematic block diagram showing the system configuration of an information providing system 1 of the present invention; FIG. 2 is a schematic block diagram showing a specific example of the functional configuration of the terminal device 10; FIG. 3 is a schematic block diagram showing a specific example of the functional configuration of an analysis device 50; FIG. 3 is a schematic block diagram showing a specific example of the functional configuration of a corresponding control device 60; FIG. 3 is a schematic block diagram showing a specific example of the functional configuration of an information providing device 70; FIG. 6 is a diagram showing a specific example of a table stored in a scenario storage unit 73; FIG. 4 is a sequence chart showing a specific example of the flow of operations in the information providing system 1; 4 is a sequence chart showing a specific example of the flow of operations in the information providing system 1; 4 is a sequence chart showing a specific example of the flow of operations in the information providing system 1; 4 is a sequence chart showing a specific example of the flow of operations in the information providing system 1;

Hereinafter, specific configuration examples of the present invention will be described with reference to the drawings.
FIG. 1 is a schematic block diagram showing the system configuration of an information providing system 1 of the present invention. The information providing system 1 includes a terminal device 10 , an imaging device 20 , an operator terminal 30 , a data server 40 , an analysis device 50 , a corresponding control device 60 and an information providing device 70 . Each device is capable of data communication via network 80 . However, due to restrictions such as security, data communication may be disabled between some devices. The network 80 may be a network using wireless communication or a network using wired communication. Network 80 may be configured by combining a plurality of networks. Network 80 may be configured using the Internet, for example.

An outline of each device included in the information providing system 1 will be described. The terminal device 10 is an information processing device that moves with the user. The terminal device 10 is configured using an information device such as a smart phone, a tablet terminal, a portable personal computer (for example, a notebook computer), or a portable game device. The user inputs speech information about the event being viewed into the terminal device 10 . The utterance information is information expressed in spoken language, and is information that asks for a question or provides information regarding an event that the user is viewing. When response information corresponding to the utterance information is transmitted from the information providing device 70, the terminal device 10 receives and outputs the response information.

The imaging device 20 is a camera and a microphone that capture an event that the user wants to view. Events include, for example, sports games, Go and Shogi games, computer game games, live music and dance performances, magic and circus shows, and performing arts such as Kabuki and Noh. The imaging device 20 does not necessarily have to be one. The imaging device 20 transmits moving image data generated by imaging to other devices via the network 80 . The imaging device 20 transmits, for example, moving image data to the analysis device 50 and the information providing device 70 .

The operator terminal 30 is an information processing device operated by an operator regarding an event captured by the imaging device 20 . The operator terminal 30 is configured using an information device such as a smart phone, a tablet terminal, or a personal computer, for example. The operator conducts analysis on the event. The operator inputs information indicating his own analysis results (hereinafter referred to as “operator analysis information”) to the operator terminal 30 . The operator analytics information may be, for example, a sentence describing the current state of the event. For example, if the event is a sports game, the operator analysis information may be team stats or individual stats for the game. The operator terminal 30 transmits operator analysis information to the analysis device 50 and the information providing device 70 .

The data server 40 is an information processing device. The data server 40 is configured using an information processing device such as a personal computer or a server device, for example. The data server 40 stores data related to events captured by the imaging device 20 (hereinafter referred to as “related data”). The related data may be, for example, information about an event of the same type as the event that was held in the past. For example, if the event is a rugby match, information about the past performances and match results of both opposing teams may be stored as relevant information. For example, if the event is a live music performance, information related to past live performances of artists performing at the event may be stored as related information. Related data may be, for example, information about persons or characters appearing in an event. For example, if the event is a rugby match, information about the coaches and players of both competing teams, past team stats, and individual stats may be stored as related information. For example, if the event is a live music performance, information about artists performing at the live performance may be stored as related information. The data server 40 transmits related data to the analysis device 50 and the information providing device 70 .

The analysis device 50 is an information processing device. The analysis device 50 is configured using, for example, an information processing device such as a personal computer or a server device. The analyzer 50 has a learning function. The analysis device 50 performs learning processing based on one or more of moving image data transmitted from the imaging device 20, operator analysis information transmitted from the operator terminal 30, and related data transmitted from the data server 40. I do. The analysis device 50 analyzes the future event of the event based on the learning result and the information (moving image data or operator analysis information) indicating the current event situation. For example, when player A is about to take a corner kick in a soccer match, the analysis device 50 determines what the result of the corner kick will be based on past events or the like when player A kicked a corner kick. You can predict whether it will be The analysis device 50 transmits the analysis result to the corresponding control device 60 and the information providing device 70 .

The corresponding control device 60 is configured using, for example, an information processing device such as a personal computer or a server device. The corresponding control device 60 has learning results related to natural language analysis and interaction with the user. The corresponding control device 60 determines the content of the request by analyzing the utterance information transmitted from the user of the terminal device 10 based on the learning result. If the utterance information is a question, the response control device 60 determines the content of the question. The response control device 60 determines the content of the requested information when the utterance information is provision of information. The corresponding control device 60 selects the requested content from the information acquired from the imaging device 20, the operator terminal 30, the data server 40, or the analysis device 50 until then. The corresponding control device 60 generates a response sentence including the selected information for each different piece of attribute information. Attribute information is information indicating a user's attribute. The attribute information includes, for example, the user's degree of understanding of the event, the user's gender, the user's age (generation), the user's hometown, the user's hobbies, and the like. An example in which the comprehension level of an event is used as a specific example of attribute information will be described below. For example, a response sentence for users with low understanding of the event, a response sentence for users with moderate understanding of the event, and a response sentence for users with high understanding of the event are generated. The response control device 60 generates scenario information including such multiple response sentences and transmits the scenario information to the information providing device 70 .

The information providing device 70 is an information processing device. The information providing device 70 may be constructed as a web server, for example. The information providing device 70 transmits event-related information to the terminal device 10 using a predetermined protocol. For example, when receiving speech information from the terminal device 10, the information providing device 70 sends response information including a response sentence corresponding to the level of understanding (attribute information) of the user of the terminal device 10 out of the scenario information corresponding to the speech information to the terminal device. Send to 10. Through such an operation, the information providing device 70 provides information about the event that the user is viewing according to the user's degree of understanding (attribute information). Therefore, it is possible to provide the user watching the event with more preferable information for the user.

FIG. 2 is a schematic block diagram showing a specific example of the functional configuration of the terminal device 10. As shown in FIG. Details of the terminal device 10 will be described. The terminal device 10 includes a CPU (Central Processing Unit), a memory, an auxiliary storage device, and the like, which are connected via a bus. The terminal device 10 functions as a device including an input unit 11, an output unit 12, a communication unit 13, a position information acquisition unit 14, a user information storage unit 15, and a control unit 16 by executing a predetermined program. All or part of each function of the terminal device 10 may be implemented using hardware such as an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). A program executed by the terminal device 10 may be recorded on a computer-readable recording medium. Computer-readable recording media include portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, semiconductor storage devices (eg SSD: Solid State Drive), hard disks and semiconductor storage built into computer systems. It is a storage device such as a device. A program executed by the terminal device 10 may be transmitted via an electric communication line.

The input unit 11 is configured using existing input devices such as a keyboard, pointing device (mouse, tablet, etc.), buttons, touch panel, and the like. The input unit 11 is operated by a user when inputting a user's instruction to the terminal device 10 . The input unit 11 may be an interface for connecting an input device to the terminal device 10 . In this case, the input unit 11 inputs to the terminal device 10 an input signal generated according to the user's input in the input device. The input unit 11 may be configured using a microphone. In this case, the input unit 11 acquires the voice uttered by the user as a voice signal.

The output unit 12 is an image display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. The output unit 12 displays text data, still image data, and moving image data provided from the information providing device 70 . The output unit 12 may be an interface for connecting the image display device to the terminal device 10 . In this case, the output unit 12 generates a video signal for displaying text data and image data, and outputs the video signal to an image display device connected thereto. The output unit 12 may be configured as a speaker. In this case, the output unit 12 generates and outputs an audio signal representing the text data.

The communication unit 13 is configured using a network interface. The communication unit 13 communicates data with other devices via the network 80 .

The location information acquisition unit 14 acquires location information of the current location of the terminal device 10 . The position information acquisition unit 14 acquires position information of the current position, for example, by communication with a satellite positioning system or a base station of a mobile phone network. Specific examples of satellite positioning systems include GPS (Global Positioning System) and Galileo. The position information acquisition unit 14 outputs the acquired position information to the control unit 16 .

The user information storage unit 15 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The user information storage unit 15 stores information about the user of the terminal device 10 (hereinafter referred to as "user information"). The user information may be, for example, identification information given to the user in advance (hereinafter referred to as "user identification information"), or may be the user's name or nickname. For the user information, instead of information about the user himself/herself, information about the terminal device 10 to be operated by the user may be used. For example, the MAC address of the terminal device 10 or the identification information of the terminal device 10 may be used as the user information.

The control unit 16 controls each functional unit provided in the terminal device 10 . For example, when a user inputs an instruction by operating the input unit 11, the control unit 16 operates according to the input instruction. For example, when the user operates the input unit 11 to input information indicating the degree of understanding of the user about the event the user is watching, the control unit 16 outputs the input information to the information providing device. 70. At this time, the control unit 16 may further transmit the location information acquired by the location information acquiring unit 14 to the information providing device 70 .

For example, when display information including text data and image data is received from another device via the communication unit 13, the control unit 16 causes the output unit 12 to output video and audio corresponding to the display information.

FIG. 3 is a schematic block diagram showing a specific example of the functional configuration of the analysis device 50. As shown in FIG. Details of the analyzer 50 will be described. The analysis device 50 includes a CPU, a memory, an auxiliary storage device, and the like connected by a bus. The analysis device 50 functions as a device including a communication section 51, an event information storage section 52, a learning result information storage section 53, and a control section 54 by executing a predetermined program. All or part of each function of the analysis device 50 may be realized using hardware such as ASIC, PLD, FPGA, or the like. A program executed by the analysis device 50 may be recorded on a computer-readable recording medium. Computer-readable recording media include portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, semiconductor storage devices (such as SSD), and storage devices such as hard disks and semiconductor storage devices built into computer systems. It is a device. The program executed by analysis device 50 may be transmitted via an electrical communication line.

The communication unit 51 is configured using a network interface. Communication unit 51 performs data communication with other devices via network 80 .

The event information storage unit 52 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The event information storage unit 52 stores moving image data, operator analysis information, and related data received from the imaging device 20 , the operator terminal 30 and the data server 40 via the communication unit 51 . The event information storage unit 52 may store these data separately for each type of event.

The learning result information storage unit 53 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The learning result information storage unit 53 stores information (learning result information) indicating the result of the learning process.

The control unit 54 functions as an event information acquisition unit 541, a learning unit 542, and a determination unit 543 as a processor such as a CPU executes programs.

The event information acquisition unit 541 acquires various information about events as event information via the communication unit 51 . For example, the event information acquisition unit 541 acquires moving image data of an event captured by the imaging device 20 . For example, the event information acquisition unit 541 acquires operator analysis information generated by the operator terminal 30 . For example, the event information acquisition unit 541 acquires related data accumulated in the data server 40 . The event information acquisition unit 541 records each acquired information in the event information storage unit 52 in association with a classification identifier, which is an identifier corresponding to a predetermined classification. The predetermined classification may be, for example, the type of the event, the type of the organizer of the event, or the type of the person involved in the event (for example, a player in a game, a performer in a play, etc.). good too.

The event information acquisition unit 541 may acquire and record the semantic information of each piece of event information in association with the event information. Semantic information is information that indicates the meaning of one or more scenes in an event. For example, in a moving image of a soccer match, semantic information indicating a "corner kick" may be recorded in association with data in a time period in which a scene of a corner kick was captured. Furthermore, semantic information indicating information related to the scene may be associated. For example, for the data of the time period when the corner kick scene was filmed, the semantic information includes information indicating the name of the kicker player, the name of the opposing team, the time period of the game, and the position of the corner (right or left). may be associated as

The event information acquisition unit 541 may acquire and record the result information of each event information in association with the event information. Result information is information indicating subsequent results in one or more scenes in an event. For example, in a moving image of a soccer match, data for a time period in which a scene of a corner kick was shot can be used to determine whether the corner kick scored a goal, what kind of shot was taken, and who shot the shot. Information indicating whether the ball was hit or the like may be recorded as the result information.

The above-described semantic information and result information may be manually obtained as an analysis result and provided to the analysis device 50 . The semantic information and result information may be acquired as analysis results by a device that analyzes semantic information and result information from moving image data, and may be provided to the analysis device 50 .

The learning unit 542 performs machine learning processing using information stored in the event information storage unit 52 . Machine learning technology for generating or updating learning result data is applied to the learning unit 542, for example, by supervised learning. Specific examples of machine learning technology include SVM (Support Vector Machine) and DL (Deep Learning). The learning unit 542 may generate or update a discriminator as a learning result by performing machine learning processing based on, for example, a plurality of teacher data. The learning unit 542 may perform the learning process by using, for example, event information associated with semantic information and result information among the data stored in the event information storage unit 52 as supervised learning data. . The learning unit 542 records information (learning result information) indicating the learning result obtained by the learning process in the learning result information storage unit 53 .

By using the learning result information stored in the learning result information storage unit 53, the determination unit 543 determines, based on information (moving image data or operator analysis information) indicating the current event situation, after the situation Predict and judge events that will occur. For example, in a video image of a soccer match, the data for the time period during which a scene of a corner kick was shot can be used to determine whether the corner kick will result in a goal, what kind of shot will be taken, and who will shoot. The determination unit 543 may determine information indicating whether to hit . The determination unit 543 transmits the determination result to the corresponding control device 60 and the information providing device 70 .

FIG. 4 is a schematic block diagram showing a specific example of the functional configuration of the corresponding control device 60. As shown in FIG. Details of the corresponding control device 60 will be described. The corresponding control device 60 includes a CPU, a memory, an auxiliary storage device, etc., which are connected by a bus. The correspondence control device 60 functions as a device including a communication section 61, a determination result storage section 62, a learning result information storage section 63, and a control section 64 by executing a predetermined program. All or part of each function of the corresponding control device 60 may be realized using hardware such as ASIC, PLD, FPGA, or the like. A program executed by the corresponding control device 60 may be recorded on a computer-readable recording medium. Computer-readable recording media include portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, semiconductor storage devices (such as SSD), and storage devices such as hard disks and semiconductor storage devices built into computer systems. It is a device. Programs executed by the corresponding controller 60 may be transmitted via telecommunication lines.

The communication unit 61 is configured using a network interface. Communication unit 61 performs data communication with other devices via network 80 .

The determination result storage unit 62 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The determination result storage unit 62 stores data indicating determination results received from the analysis device 50 via the communication unit 61 . The determination result storage unit 62 may store the data indicating the determination result by classifying the event type.

The learning result information storage unit 63 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The learning result information storage unit 63 stores information (learning result information) indicating the result of the learning process. The learning result information stored in the learning result information storage unit 63 is information indicating the learning result obtained by the learning process executed in advance. The learning process executed in advance is performed using a learning technique such as SVM or DL, for example. The learning process uses, for example, learning data for performing natural language analysis, learning data relating to human interaction, and learning data relating to commentaries given by commentators for various types of events. By using the learning results stored in the learning result information storage unit 63, it is possible to contextually analyze the contents of user's utterances, generate natural answers to user's utterances, and analyze the current status of each type of event. It is possible to generate a natural commentary about future predictions and future predictions.

The control unit 64 functions as a determination result acquisition unit 641, a context information acquisition unit 642, and a scenario generation unit 643 by a processor such as a CPU executing programs.

The determination result acquisition unit 641 acquires data indicating determination results from the analysis device 50 via the communication unit 61 . The determination result acquisition unit 641 records the acquired determination result in the determination result storage unit 62 in association with a classification identifier that is an identifier corresponding to a predetermined classification. The predetermined classification may be, for example, the type of the event, the type of the organizer of the event, or the type of the person involved in the event (for example, a player in a game, a performer in a play, etc.). good too.

The context information acquisition unit 642 acquires context information for speech information transmitted from the terminal device 10 . The context information acquisition unit 642 may perform context analysis by using learning results stored in the learning result information storage unit 63, for example.

The scenario generation unit 643 generates scenario data regarding events. Scenario data is data provided to users and is information used to provide users with information about events. The scenario generation unit 643 generates scenario data including, for example, answer texts and explanatory texts indicating the determination results acquired by the determination result acquisition unit 641 based on the learning results stored in the learning result information storage unit 63. good too. The scenario generation unit 643 may generate scenario data including answer sentences and commentary sentences according to each of a plurality of predetermined levels of understanding. The scenario generation unit 643 transmits the generated scenario data to the information providing device 70 .

FIG. 5 is a schematic block diagram showing a specific example of the functional configuration of the information providing device 70. As shown in FIG. Details of the information providing device 70 will be described. The information providing device 70 includes a CPU, a memory, an auxiliary storage device, etc. connected by a bus. The information providing device 70 functions as a device including a communication section 71, a user information storage section 72, a scenario storage section 73 and a control section 74 by executing a predetermined program. All or part of each function of the information providing device 70 may be realized using hardware such as ASIC, PLD, FPGA, or the like. A program executed by the information providing device 70 may be recorded on a computer-readable recording medium. Computer-readable recording media include portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, semiconductor storage devices (such as SSD), and storage devices such as hard disks and semiconductor storage devices built into computer systems. It is a device. A program executed by the information providing device 70 may be transmitted via an electric communication line.

The communication unit 71 is configured using a network interface. Communication unit 71 performs data communication with other devices via network 80 .

The user information storage unit 72 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The user information storage unit 72 stores user information acquired from the terminal device 10 by the user information acquisition unit 741 via the communication unit 71 . The user information is information about the user who operates the terminal device 10 . The user information includes, for example, user identification information, information indicating the user's preferences regarding the event, and information indicating the user's degree of understanding regarding the event.

The scenario storage unit 73 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The scenario storage unit 73 stores scenario information transmitted from the corresponding control device 60 . When the scenario information is provided for each level of understanding, the scenario storage unit 73 stores the scenario information in association with the level of understanding. FIG. 6 is a diagram showing a specific example of a table stored in the scenario storage unit 73. As shown in FIG. For example, a plurality of scenarios regarding one event in the event are provided according to the level of understanding. In the example of FIG. 6, the scenario provided to users with a high level of understanding is "A", and the scenario provided to users with a medium level of understanding is "B", meaning that the level of understanding is low. The scenario offered to the user is "C". For example, the higher the degree of understanding, the more specialized wording may be used in the content of the scenario. For example, a plurality of stages may be provided according to the popularity of characters (players and performers), and only the names of characters in stages corresponding to the degree of understanding may be used in the scenario.

Returning to FIG. 5, the description continues. The control unit 74 functions as a user information acquisition unit 741, a scenario acquisition unit 742, and an information provision control unit 743 by a processor such as a CPU executing programs.

The user information acquisition unit 741 acquires user information by communicating with the terminal device 10 . For example, the user information acquisition unit 741 may generate a WEB screen having input fields for inputting values for each item of user information, and transmit the screen to the terminal device 10 . In this case, the user inputs values by operating the input unit 11 for each input column on the screen displayed on the output unit 12 of the terminal device 10 . User information including each input value may be transmitted from the terminal device 10 to the information providing device 70 in response to the user's operation of a predetermined button (for example, a send button). For example, the user information acquisition unit 741 generates a WEB screen having one or more question sentences for measuring the user's level of understanding and input fields for entering the answers, and transmits the screen to the terminal device 10. may In this case, the user operates the input unit 11 to input an answer to the question in each input field on the screen displayed on the output unit 12 of the terminal device 10 . Each input answer may be transmitted from the terminal device 10 to the information providing device 70 in response to the user's operation of a predetermined button (for example, a send button). In this case, the user information acquisition section 741 determines the degree of understanding of the user based on the acquired answer, and records the determination result in the user information storage section 72 as user information.

The scenario acquisition unit 742 acquires scenario information by communicating with the corresponding control device 60 . The scenario acquisition section 742 records the acquired scenario information in the scenario storage section 73 .

Upon receiving a request for information from the terminal device 10 , the information provision control section 743 reads from the scenario storage section 73 scenario information related to the requested information, which corresponds to the level of understanding of the requesting user. The information provision control unit 743 then transmits the read scenario information to the terminal device 10 . The information provision control unit 743 transmits the moving image data captured by the imaging device 20 to the terminal device 10 when the imaging data of the event is requested. The moving image data may be transmitted in a streaming format or in a download format. The information provision control unit 743 transmits the related data registered in the data server 40 to the terminal device 10 when the related data regarding the event is requested.

FIG. 7 is a sequence chart showing a specific example of the flow of operations in the information providing system 1. As shown in FIG. FIG. 7 shows a specific example of processing when the information providing device 70 acquires information indicating the degree of understanding in particular.

First, the terminal device 10 acquires the type of event for which the user intends to register the degree of understanding (step S101). For example, the terminal device 10 may acquire location information of its own device at that time, and acquire an event type according to the location information. Specifically, the event type may be acquired by inquiring of a specific server about an event held at a location indicated by the location information, or the terminal device 10 may store a table in which the location information and the event type are associated in advance. may be stored. The terminal device 10 may prompt the user to input the event type by displaying a screen for inputting the event type on the output unit 12 . The terminal device 10 may prompt the user to input the event type by outputting a voice asking the user about the event type from the output unit 12 .

After acquiring the event type, the terminal device 10 transmits information indicating the acquired event type to the information providing device 70 (step S102). At this time, the terminal device 10 may transmit the event type together with other user information (for example, user ID).

Upon receiving the event type, the information providing device 70 generates comprehension level request information corresponding to the received event type (step S103). The comprehension level request information is information indicating that the user's comprehension level is requested for the event indicated by the acquired event type. For example, the comprehension level request information may simply be data on a web screen having an input field for a value indicating the comprehension level, or input one or more question sentences and their answers to measure the user's comprehension level. WEB screen data having input fields for The information providing device 70 transmits the generated comprehension level request information to the terminal device 10 (step S104). When the terminal device 10 receives the comprehension level request information, the output unit 12 outputs a screen or sound corresponding to the received comprehension level request information.

The user inputs information about the degree of understanding by operating the input unit 11 of the terminal device 10 (step S105). Information about the degree of understanding may be the value itself indicating the degree of understanding, or may be an answer to a question for measuring the degree of understanding. The terminal device 10 transmits the information about the degree of understanding input by the user to the information providing device 70 as the degree of understanding response information (step S106). The information providing device 70 acquires the user's degree of understanding based on the information about the degree of understanding transmitted from the terminal device 10 . Then, the acquired comprehension level information is recorded in the user information storage unit 72 as user information of the terminal device 10 (step S107).

FIG. 8 is a sequence chart showing a specific example of the flow of operations in the information providing system 1. As shown in FIG. FIG. 8 shows a specific example of processing when analysis is performed by the analysis device 50 in particular.

The imaging device 20 generates moving image data by imaging the site of the event (step S201). The imaging device 20 transmits the moving image data to the analysis device 50 by using the provided transmission device (step S202). The operator terminal 30 acquires operator analysis information by being operated by the operator (step S203). The operator terminal 30 transmits the acquired operator analysis information to the analysis device 50 (step S204). The data server 40 reads related data relating to the event being processed (step S205). The data server 40 transmits the read related data to the analysis device 50 (step S206). The analysis device 50 stores the received moving image data, operator analysis information, and related data as event information (step S207). When a predetermined timing arrives, the analysis device 50 performs analysis processing using the learning result and event information (step S209). The predetermined timing may be, for example, a predetermined cycle, the timing when the administrator of the analyzer 50 issues an instruction to start the analysis process, or other timing. By performing an analysis process, analysis device 50 analyzes future occurrences of an event. The analysis device 50 transmits analysis information indicating the obtained analysis results to the corresponding control device 60 and the information providing device 70 (steps S210, S211).

FIG. 9 is a sequence chart showing a specific example of the flow of operations in the information providing system 1. As shown in FIG. FIG. 9 particularly shows a specific example of the first information providing process by the information providing device 70. FIG. First, when a predetermined timing arrives, the response control device 60 analyzes the context of the current state of the event (step S301). The predetermined timing may be, for example, a predetermined cycle, the timing when the manager of the corresponding control device 60 issues an instruction to start the analysis process, or other timing. . Based on the context analysis result, the corresponding control device 60 generates a scenario showing the current state and future of the event to the user (step S302). The corresponding control device 60 transmits the generated scenario information to the information providing device 70 (step S303).

When the user of the terminal device 10 desires information regarding an event that is currently being visited, the user performs an operation indicating a request for information. In response to such a user's operation, the terminal device 10 acquires an information request (step S304). Also, the terminal device 10 acquires the position information of the terminal device 10 at that time. The terminal device 10 transmits the acquired information indicating the information request and the location information to the information providing device 70 (step S305). The information request also includes a user ID indicating the user of the terminal device 10 .

Upon receiving the information request, the information providing device 70 generates provision information (step S306). Specifically, based on the location information included in the information request, the information providing device 70 acquires the event type of the event being held at that location on that date and time. The information providing device 70 acquires information indicating the degree of understanding of the acquired event type for the user indicated by the user ID. Then, the information providing device 70 generates provision information indicating event information corresponding to the level of understanding among the information regarding the event requested by the user. For example, the information providing device 70 generates provided information including scenario information according to the level of understanding. The information providing device 70 transmits the generated provided information to the terminal device 10 that requested the information (step S307). Upon receiving the provided information, the terminal device 10 outputs the received provided information on the screen or by voice (step S308).

In FIG. 9 , after receiving an information request from the terminal device 10 , the information providing device 70 may be configured to repeatedly generate provided information based on newer scenario information and transmit it to the terminal device 10 .

FIG. 10 is a sequence chart showing a specific example of the flow of operations in the information providing system 1. As shown in FIG. FIG. 10 particularly shows a specific example of the second information providing process by the information providing device 70. FIG. First, when the user of the terminal device 10 has a question regarding the event that is currently being visited, the user inputs speech information indicating the content of the question into the terminal device 10 . The input of speech information may be performed by voice input to the input unit 11 configured as a microphone, or may be performed by operating the input unit 11 configured as an operating device such as a touch panel. In response to such user input, the terminal device 10 acquires speech information (step S401). Also, the terminal device 10 acquires the position information of the terminal device 10 at that time. The terminal device 10 transmits the acquired speech information and position information to the information providing device 70 (step S402). The utterance information also includes a user ID indicating the user of the terminal device 10 .

Upon receiving the speech information and the location information, the information providing device 70 determines the event type according to the received location information. Then, the event type is added to the speech information, and the speech information is transmitted to the corresponding control device 60 (step S403). Upon receiving the speech information, the corresponding control device 60 performs context analysis on the speech information (step S404). Based on the context analysis result, the corresponding control device 60 generates a scenario showing the current state and future of the event to the user (step S405). The corresponding control device 60 transmits the generated scenario information to the information providing device 70 (step S406).

Upon receiving the scenario information, the information providing device 70 acquires information indicating the degree of understanding of the user according to the user ID and event type received together with the utterance information. The information providing device 70 generates response information including a scenario corresponding to the level of understanding of the user, among the scenario information received from the corresponding control device 60 (step S407). The information providing device 70 transmits the generated response information to the terminal device 10 that sent the question (step S408). Upon receiving the response information, the terminal device 10 outputs the received response information on the screen or by voice (step S409).

According to the information providing system 1 configured in this manner, it is possible to provide a user who desires information about an event with information in a form that corresponds to the user's degree of understanding of the event. Therefore, it is possible to provide a user who is watching the event with information more favorable to the user.

Further, when information is provided to the user, the information is provided based on the scenario generated by the corresponding control device 60 . The correspondence control device 60 uses learning data related to human interaction and learning data related to the commentary provided by the commentators of each type of event in the learning process performed in advance. Therefore, it is possible to provide users with information about events in a more natural style of writing.

The information provided to the user also includes the analysis result by the analysis device 50 . The analysis device 50 performs learning processing by using, for example, event information associated with semantic information and result information as supervised learning data. Analysis device 50 analyzes the future of events occurring in the event by using the learning result. In this way, since information about the future predicted using the learning result is provided, the user can be more interested in the event, and the information provided by the information providing device 70 can be given added value. becomes possible.

Also, the type of event that the user is viewing may be automatically determined based on the location information of the terminal device 10 . In this case, the user does not have to bother to input into the terminal device 10 the information specifying the type of the event that the user views.

(Modification)
The system configuration shown in FIGS. 1-4 is only one specific example. The functional unit provided in each device shown in FIG. 1 may be provided in another device different from the above embodiment. For example, the event information storage unit 52 may be provided not in the analysis device 50 but in a database server (not shown). For example, the context information acquisition unit 642 may be provided in the information providing device 70 or may be provided in the analysis device 50 instead of being provided in the corresponding control device 60 . For example, the analysis device 50 and the corresponding control device 60 may be configured as an integrated device.

In the sequence chart shown in FIG. 9 or FIG. 10 , the event type does not necessarily have to be specified based on the position information of the terminal device 10 . For example, the terminal device 10 may prompt the user to input the event type by displaying a screen for inputting the event type on the output unit 12 . The user may input the event type by operating the input unit 11 on such a screen. For example, the user may enter the event name in characters, or the user may select from a plurality of options presented on the screen. The terminal device 10 may prompt the user to input the event type by outputting a voice asking the user about the event type from the output unit 12 . The user may input the event type by vocalizing such voice. For example, the event name may be read aloud, or the event name selected by the user from a plurality of options presented by voice may be read aloud.

Viewing of the event by the user does not necessarily have to take place at the site where the event is being held. For example, viewing of an event may be performed by watching a live broadcast or a recorded broadcast of the situation of the event on a television receiver. Also, the user may view the content using a time shift function provided as a function of the television receiver or recording device. Users may view at public viewings, sports bars, or other venues.

Although the embodiment of the present invention has been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and design and the like are included within the scope of the gist of the present invention.

DESCRIPTION OF SYMBOLS 1... Information provision system 10... Terminal device 20... Imaging device 30... Operator terminal 40... Data server 50... Analysis apparatus 60... Corresponding control apparatus 70... Information provision apparatus 11... Input part 12 ... output unit 13... communication unit 14... position information acquisition unit 15... user information storage unit 16... control unit 51... communication unit 52... event information storage unit 53... learning result information storage unit 54... Control unit 541 Event information acquisition unit 542 Learning unit 543 Determination unit 61 Communication unit 62 Determination result storage unit 63 Learning result information storage unit 64 Control unit 641 Determination result acquisition Unit 642 Context information acquisition unit 643 Scenario generation unit 71 Communication unit 72 User information storage unit 73 Scenario storage unit 74 Control unit 741 User information acquisition unit 742 Scenario acquisition unit , 743 ... information provision control unit

Claims (2)

an acquisition unit that acquires user attribute information regarding an event to be viewed;
a learning unit that performs learning processing based on past information about the event;
a learning result storage unit that stores learning results obtained by the learning unit;
a determination unit that uses the learning result stored in the learning result storage unit to determine information indicating an event that will occur after the situation as a future result of the event occurring in the event;
an information providing unit that provides the user with information about the event according to the attribute information of the user;
with
The attribute information includes information indicating the user's degree of understanding of the event,
The information providing unit provides information about the event including a response sentence according to the user's level of understanding ,
The past information is a teacher in which semantic information indicating the meaning of one or more scenes in the event and result information that is information indicating subsequent results in one or more scenes of the event are associated with each other. is training data with
The learning unit acquires learning results for estimating subsequent results based on new semantic information by performing learning processing using the supervised learning data,
The information providing system , wherein the information providing unit provides information including information about the future determined by the determining unit . an acquisition step in which a computer acquires user attribute information about an event to be viewed;
A learning step in which a computer performs a learning process based on past information about the event;
A recording step in which the computer records the learning result in the learning step in a learning result storage unit;
a determination step in which the computer determines information indicating an event occurring after the situation as a future result of an event occurring in the event by using the learning result stored in the learning result storage unit;
an information providing step in which a computer provides information about the event to the user according to the attribute information of the user;
has
The attribute information includes information indicating the user's degree of understanding of the event,
In the information providing step, the computer provides information about the event including a response sentence according to the user's level of understanding ;
The past information is a teacher in which semantic information indicating the meaning of one or more scenes in the event and result information that is information indicating subsequent results in one or more scenes of the event are associated with each other. is training data with
In the learning step, the computer performs learning processing using the supervised learning data to acquire learning results for estimating subsequent results based on new semantic information,
The information providing method , wherein in the information providing step, the computer provides information including information about the future determined in the determining step .

Images