JP6543429B1 - Evaluation system, server device, terminal device, information processing method, and information processing program - Google Patents

Abstract

The purpose is to ensure the reliability of evaluation information for content. The terminal device detects video or sound output from an output device that outputs at least one of video and sound, which constitutes content. The terminal device transmits, to the server device, the evaluation information input by the user for the content and the detection information indicating the detected video or sound. The server apparatus acquires content information indicating video or sound, which constitutes content. The server device receives the evaluation information and the detection information from the terminal device. The server device compares the acquired content information with the received detection information. According to the comparison result, when there is a predetermined match between the content information and the detection information, the server device selects to use the received evaluation information for the evaluation of the content.

Description

  The present invention relates to the technical field of an evaluation system for a user to view content composed of video and / or sound and to input evaluation information for the content.

  2. Description of the Related Art Conventionally, there has been known a system for allowing viewers of content such as a television broadcast program to input evaluation information on the content and aggregating and analyzing evaluation information from each viewer. For example, when a predetermined button is pressed on the remote control of the television receiver while watching a program on the television receiver, options concerning the program are displayed on the screen of the television receiver. When one of the color buttons on the remote control is pressed, an option corresponding to the pressed button is selected, and the selection result is transmitted from the television receiver to the broadcast station side. Further, Patent Document 1 discloses a technique for grasping the preference of a television broadcast viewer. Specifically, the remote controller of the set top box is provided with a notification button for notifying the preference of the viewer for the person, thing, music, etc. on the air. When the notification button is pressed, the set top box stores a viewing log as a viewing event, and transmits the viewing log to the broadcast apparatus at predetermined time intervals. The broadcast device counts viewing events that meet the conditions set by the program creator or the like.

  In the above-described technology, a dedicated remote control is used for a television receiver or set top box or the like for receiving a television broadcast signal and displaying a video of a television program, and evaluation is performed via the television receiver or set top box or the like. Since the information is sent to the broadcaster or the program producer, it is ensured that the user has actually watched the program and has entered the rating information. Therefore, the reliability of the input evaluation information is secured.

  However, for example, a general-purpose terminal device such as a mobile phone and a tablet computer is used for inputting evaluation information by the user, and evaluation information of each user for contents in a highly versatile system which can be used for other applications. In the case of tallying, analyzing, etc., the issue is how to secure the reliability of the evaluation information. The reason is that when such a terminal device is used, the terminal device can not be dedicated for the evaluation input to the television receiver, so the user's act of inputting evaluation information is an actual program seen from the television receiver. It is easy to be done regardless of the viewing act of

  In Patent Document 2, the portable communication device acquires voice output from a speaker of a television receiver with a built-in microphone to store voice data, and broadcasts by using a tuner incorporated in the portable communication device. It is disclosed to store data indicating a viewing condition of a broadcast program based on acquiring program data, extracting audio data, and comparing audio data. However, although the technique disclosed in Patent Document 2 attempts to evaluate the viewing condition of the broadcast program by the viewer, it does not aim to evaluate the broadcast program itself.

JP 2000-333154 A Unexamined-Japanese-Patent No. 2017-060060

  The present invention has been made in view of the above points, and an evaluation system, a server device, and a terminal device capable of securing the reliability of evaluation information for content even when the content is evaluated using a general-purpose terminal device It is an object of the present invention to provide an information processing method and an information processing program.

In order to solve the above problems, one aspect of the present invention is an evaluation system including a terminal device and a server device connected to the terminal device via a network, wherein the terminal device is an image and a sound. A video or sound output by an input unit through which a user inputs evaluation information on content constituted by at least one, and an output device that outputs at least one of the video and the sound constituting the content. And detecting means for detecting the input information, and transmitting means for transmitting detection information indicating the detected video or sound to the server device, the server device including the content Acquiring means for acquiring content information indicating the video or the sound, and receiving the evaluation information and the detection information from the terminal device There is a predetermined match between the content information and the detection information according to the comparison result by the comparison means and the comparison means for comparing the received content information with the received detection information And selecting means for selecting the received evaluation information to be used for evaluation of the content , wherein the detecting means and the transmitting means repeatedly detect the video or the sound at predetermined time intervals. The detection information is transmitted, and the selection means is the time closest to the input time before or after the input time of the evaluation information among the detection information repeatedly received by the reception means with the predetermined time interval. It said terminal at least based on the comparison result between the detected information and the content information indicating the picture or sound is detected by, performing said selection And features.

According to the present invention, the content to be evaluated is actually evaluated based on the comparison between the detection information indicating the video or sound detected by the terminal device and the content information indicating the video or sound of the content acquired by the server device. It is possible to estimate whether the user is watching or not. Therefore, it is possible to preferentially use for evaluation of content, evaluation information estimated that the user is watching or listening to the content. Therefore, it is possible to secure the reliability of the evaluation information.
Further, according to the present invention, the server apparatus determines whether to use the evaluation information for the evaluation of the content using the detection information indicating the video or the sound detected at a time close to the time when the user inputs the evaluation information. judge. Therefore, even in a mode in which the terminal device periodically performs detection of video or sound and transmission of detection information, estimation accuracy of whether the user is watching the content or is listening at the time of inputting the evaluation information Can be enhanced.
In one embodiment of the present invention, the selection means is further detected at a time relatively close to an input time of the evaluation information among the detection information repeatedly received at predetermined time intervals by the reception means. The selection is performed based on a comparison result of two or more pieces of detection information respectively indicating video and sound and the content information.
According to the present invention, two or more pieces of detection information indicating video or sound detected at a time close to the time when the user inputs the evaluation information are used. Therefore, it is possible to further enhance the estimation accuracy as to whether the user is watching the content or is listening to the content when the evaluation information is input.
One embodiment of the present invention is an evaluation system including a terminal device and a server device connected to the terminal device via a network, wherein the terminal device is configured of at least one of video and sound. An input unit through which evaluation information on content is input by a user; a detection unit that detects an image or sound output from an output device that outputs at least one of the image and the sound that constitutes the content; And transmission means for transmitting input evaluation information and detection information indicating the detected video or sound to the server device, the server device constituting the content, the video or the sound , Acquisition means for acquiring content information indicating the information, reception means for receiving the evaluation information and the detection information from the terminal device, When the content information and the detection information have a predetermined match according to the comparison result comparing the content information and the received detection information, and the comparison result by the comparison unit, the received evaluation information Selection means for selecting to use for evaluation of the content, the detection means and the transmission means detect the image or the sound when the evaluation information is input, and simultaneously with the evaluation information And transmitting the detection information indicating the detected video or sound to the server device, and the selection unit simultaneously with the detection information when the content information includes a portion determined to match the detection information. The received evaluation information is selected to be used for the evaluation of the content.
According to the present invention, the content to be evaluated is actually evaluated based on the comparison between the detection information indicating the video or sound detected by the terminal device and the content information indicating the video or sound of the content acquired by the server device. It is possible to estimate whether the user is watching or not. Therefore, it is possible to preferentially use for evaluation of content, evaluation information estimated that the user is watching or listening to the content. Therefore, it is possible to secure the reliability of the evaluation information.
Further, according to the present invention, the server device determines whether or not to use the evaluation information for the evaluation of the content, using the detection information indicating the video or the sound detected when the user inputs the evaluation information. . Therefore, it is possible to enhance the estimation accuracy of whether the user is watching the content or is listening at the time when the evaluation information is input.
One embodiment of the present invention is an evaluation system including a terminal device and a server device connected to the terminal device via a network, wherein the terminal device is configured of at least one of video and sound. An input unit through which evaluation information on content is input by a user; a detection unit that detects an image or sound output from an output device that outputs at least one of the image and the sound that constitutes the content; And transmission means for transmitting input evaluation information and detection information indicating the detected video or sound to the server device, the server device constituting the content, the video or the sound , Acquisition means for acquiring content information indicating the information, reception means for receiving the evaluation information and the detection information from the terminal device, When the content information and the detection information have a predetermined match according to the comparison result comparing the content information and the received detection information, and the comparison result by the comparison unit, the received evaluation information Selecting means for selecting the evaluation of the content, and the detecting means and the transmitting means detect the image or the sound when the evaluation information is input, and When the detection information is transmitted to the server device, and the selection means has a portion where the content information is determined to match the detection information, the evaluation information received together with the detection information is used to evaluate the content. Of the image or sound indicated by the portion determined to match the detection information in the content information. The output time by serial output device, and identifies as an input time of the evaluation information received together with the detection information.
According to the present invention, the content to be evaluated is actually evaluated based on the comparison between the detection information indicating the video or sound detected by the terminal device and the content information indicating the video or sound of the content acquired by the server device. It is possible to estimate whether the user is watching or not. Therefore, it is possible to preferentially use for evaluation of content, evaluation information estimated that the user is watching or listening to the content. Therefore, it is possible to secure the reliability of the evaluation information.
Further, according to the present invention, the server device determines whether or not to use the evaluation information for the evaluation of the content, using the detection information indicating the video or the sound detected when the user inputs the evaluation information. . Therefore, it is possible to enhance the estimation accuracy of whether the user is watching the content or is listening at the time when the evaluation information is input.
Further, according to the present invention, the server device specifies, as the input time of the evaluation information, the output time of the video or the sound in the content that matches the video or the sound detected when the user inputs the evaluation information. Therefore, since it is possible to appropriately specify which scene of the content the evaluation information is input to, it is possible to perform an appropriate evaluation on the content.
In one embodiment of the present invention, the acquisition means further comprises: specific information converted from time-series data of feature information composed of time-series data of feature information indicating features of the video or the sound constituting the content. It is specific information time-series data configured in time series, the corresponding feature information can be specified based on each of the specific information, and the information amount of each of the specific information is information of the corresponding feature information Specific information time series data smaller than the amount is acquired as the content information, and the terminal device acquires characteristic information time series data acquiring means for acquiring the characteristic information time series data in advance, and the detected video or sound Of the feature information extracted from the feature information included in the acquired feature information time-series data, and the matching degree between the feature information and the extracted feature information is predetermined And generating means for generating specific information of an amount of information smaller than the amount of information of the characteristic information, and the transmission means further includes the generated specific information. Transmitting, as the detection information, the selection means, among the specific information included in the feature information time-series data, the output time corresponding to the specific information matching the specific information received as the detection information , As the input time.
According to the present invention, the terminal device compares the feature information time-series data of the content acquired before the output of the content with the feature information extracted from the detected video or sound. If there is feature information whose degree of coincidence with the extracted feature information exceeds a predetermined value in the feature information time-series data, the terminal device generates specific information with a smaller amount of information from the feature information. Then, this specific information is transmitted to the server as detection information. The server device compares the specific information time-series data converted from the feature information time-series data with the specific information received from the terminal device. The server device acquires, as the input time of the evaluation information, the output time of the video or sound output device corresponding to the specific information matching the received specific information among the specific information time-series data. Therefore, since the amount of information of detection information is reduced, the communication load of the terminal device and the server device can be reduced.
In one embodiment of the present invention, the specific information is a hash value of the feature information.

  In one embodiment of the present invention, the content is a content to be broadcast, and the evaluation information and the detection information are transmitted from the plurality of terminal devices as the terminal device to the server device while the content is being broadcast. The server apparatus transmits at least one of the evaluation information and the detection information by at least one of the plurality of terminals according to at least one of the plurality of terminals. As different from the transmission timing by the terminal device, timing determination means for determining the transmission timing for each of the plurality of terminal devices and timing information indicating the determined transmission timing are transmitted to each of the plurality of terminal devices Timing information transmitting means, and the terminal device comprises the server Further timing information receiving means for receiving a placed et the timing information provided, the transmission unit, in accordance with the received timing information, and transmits at least one of the evaluation information and the detection information.

  According to the present invention, even when evaluation information and detection information are transmitted from each of a plurality of terminal devices to the server device during broadcast of content, transmission timing of at least one of evaluation information and detection information is plural. Distributed to Therefore, the processing load of the server can be distributed in the time axis direction.

  In one embodiment of the present invention, the timing information transmission means further determines transmission timing by the at least one other terminal during an interval of transmission timing by the at least one terminal. Do.

  According to the present invention, since the transmission timing by at least one terminal device and the transmission timing by the other at least one terminal device are deviated, the number of information received by the server device per unit time is equalized. The processing load of the device can be further distributed.

According to one aspect of the present invention, there is provided an acquisition means for acquiring content information representing the video or the sound, which constitutes content composed of at least one of video and sound in a server apparatus, and evaluation information on the content The evaluation information and the detection information from a terminal device that detects a video or a sound output by an output device that outputs at least one of the video and the sound, which is input by a user and that configures the content The content information according to a comparison result by the comparison means, receiving means for receiving the detected video or sound, comparison means for comparing the acquired content information with the received detection information, and Use the received evaluation information for evaluation of the content if there is a predetermined match between the and the detection information. Comprising selecting means for selecting, wherein the terminal device detects the image or the sound repeatedly at predetermined time intervals and transmitting the detected information to the server apparatus, the selection means by the receiving means Detection information indicating video or sound detected by the terminal device at a time closest to the input time before or after the input time of the evaluation information among the detection information repeatedly received at predetermined time intervals; The selection is performed based at least on a comparison result with the content information .
According to one aspect of the present invention, there is provided an acquisition means for acquiring content information representing the video or the sound, which constitutes content composed of at least one of video and sound in a server apparatus, and evaluation information on the content The evaluation information and the detection information from a terminal device that detects a video or a sound output by an output device that outputs at least one of the video and the sound, which is input by a user and that configures the content The content information according to a comparison result by the comparison means, receiving means for receiving the detected video or sound, comparison means for comparing the acquired content information with the received detection information, and Use the received evaluation information for evaluation of the content if there is a predetermined match between the and the detection information. Selection means for selecting, wherein the terminal device detects the video or the sound when the evaluation information is input, and detects the video or the sound simultaneously with the evaluation information. When the information is transmitted to the server device, and the selection means has a portion where the content information is determined to match the detection information, the evaluation information received at the same time as the detection information is used to evaluate the content Selected for use in the
According to one aspect of the present invention, there is provided an acquisition means for acquiring content information representing the video or the sound, which constitutes content composed of at least one of video and sound in a server apparatus, and evaluation information on the content The evaluation information and the detection information from a terminal device that detects a video or a sound output by an output device that outputs at least one of the video and the sound, which is input by a user and that configures the content The content information according to a comparison result by the comparison means, receiving means for receiving the detected video or sound, comparison means for comparing the acquired content information with the received detection information, and Use the received evaluation information for evaluation of the content if there is a predetermined match between the and the detection information. The terminal device detects the video or the sound when the evaluation information is input, and transmits the detection information together with the evaluation information to the server device; The means selects the evaluation information received together with the detection information to be used for evaluation of the content, when the content information has a portion determined to match the detection information, and the content information is selected from among the content information. The output time by the output device of the video or sound indicated by the portion determined to match the detection information is specified as the input time of the evaluation information received together with the detection information.

According to one aspect of the present invention, in a terminal device, an input unit through which a user inputs evaluation information on content constituted by at least one of video and sound , and the video and the sound constituting the content. The content is configured as a detection unit that detects an image or sound output by an output device that outputs at least one, the input evaluation information, and detection information indicating the detected image or sound. When there is a predetermined match between the content information and the detection information according to the comparison result of the content information indicating at least one of the video and the sound and the detection information, the evaluation information is and transmitting means for transmitting to the server device selected to use in the evaluation of the content and the detecting means and the transmission means, the predetermined time period At intervals, the video or the sound is repeatedly detected to transmit the detection information, and the server apparatus transmits the evaluation information among the detection information repeatedly received from the terminal apparatus at the predetermined time interval. The selection is performed based on at least a comparison result of detection information indicating a video or a sound detected by the terminal device at a time closest to the input time before or after the input time of the content and the content information. Do.
According to one aspect of the present invention, in a terminal device, an input unit through which a user inputs evaluation information on content constituted by at least one of video and sound, and the video and the sound constituting the content. The content is configured as a detection unit that detects an image or sound output by an output device that outputs at least one, the input evaluation information, and detection information indicating the detected image or sound. When there is a predetermined match between the content information and the detection information according to the comparison result of the content information indicating at least one of the video and the sound and the detection information, the evaluation information is And transmission means for transmitting to the server apparatus which is selected to be used for evaluation of the content, wherein the detection means and the transmission means When the information is input, the video or the sound is detected, and simultaneously with the evaluation information, the detection information indicating the detected video or the sound is transmitted to the server device, and the server device is configured to When the information has a portion determined to be coincident with the detection information, the evaluation information received simultaneously with the detection information from the terminal device is selected to be used for the evaluation of the content.
According to one aspect of the present invention, in a terminal device, an input unit through which a user inputs evaluation information on content constituted by at least one of video and sound , and the video and the sound constituting the content. The content is configured as a detection unit that detects an image or sound output by an output device that outputs at least one, the input evaluation information, and detection information indicating the detected image or sound. When there is a predetermined match between the content information and the detection information according to the comparison result of the content information indicating at least one of the video and the sound and the detection information, the evaluation information is and transmitting means for transmitting to the server device selected to use in the evaluation of the content and the detecting means and the transmission means, the evaluation When the information is input, the video or the sound is detected, and the detection information is transmitted to the server device together with the evaluation information, and the server device is determined that the content information matches the detection information. If the evaluation information received from the terminal device together with the detection information is selected for use in the evaluation of the content, the portion of the content information determined to match the detection information The output time of the shown video or sound by the output device is specified as the input time of the evaluation information received together with the detection information .

One embodiment of the present invention is an information processing method in an evaluation system including a terminal device and a server device connected to the terminal device via a network, wherein the server device is at least one of video and sound. An acquisition step of acquiring content information indicating the video or the sound, the content constituting the content, and the evaluation information on the content input by the user to an input unit included in the terminal device, the terminal device including An evaluation information acquisition step for acquiring; a detection step for detecting an image or sound output from an output device for outputting at least one of the image and the sound, the terminal device constituting the content; and the terminal An apparatus includes the server, the acquired evaluation information, and detection information indicating the detected video or sound. A transmitting step of transmitting to the device, a receiving step of receiving the evaluation information and the detection information from the terminal device by the server device, the acquired content information and the received detection information by the server device When the server apparatus determines that there is a predetermined match between the content information and the detection information as a result of comparison by the comparison step, the received evaluation information is compared with the received evaluation information. seen including a selection step of selecting, as used in the evaluation of the content and the detection step and the transmission step detects the video or the sound repeatedly at predetermined time intervals to transmit the detection information, the selection In the step, in the detection information, the detection information repeatedly received at the predetermined time interval by the reception step is selected. At least based on the comparison result of the input time before or after the detection information indicating a video or sound is detected by the terminal device at the closest time to the input time and the content information of information, characterized in that the selection I assume.
One embodiment of the present invention is an information processing method in an evaluation system including a terminal device and a server device connected to the terminal device via a network, wherein the server device is at least one of video and sound. An acquisition step of acquiring content information indicating the video or the sound, the content constituting the content, and the evaluation information on the content input by the user to an input unit included in the terminal device, the terminal device including An evaluation information acquisition step for acquiring; a detection step for detecting an image or sound output from an output device for outputting at least one of the image and the sound, the terminal device constituting the content; and the terminal An apparatus includes the server, the acquired evaluation information, and detection information indicating the detected video or sound. A transmitting step of transmitting to the device, a receiving step of receiving the evaluation information and the detection information from the terminal device by the server device, the acquired content information and the received detection information by the server device When the server apparatus determines that there is a predetermined match between the content information and the detection information as a result of comparison by the comparison step, the received evaluation information is compared with the received evaluation information. And a selection step of selecting to use for evaluation of content, wherein the detection step and the transmission step detect the image or the sound when the evaluation information is input, and simultaneously with the evaluation information. The detection information indicating the detected video or sound is transmitted to the server device, and in the selection step, the content information is If having a portion that is determined to match the serial detection information, the evaluation information received at the same time as the detection information, and selects to use in evaluation of the content.
One embodiment of the present invention is an information processing method in an evaluation system including a terminal device and a server device connected to the terminal device via a network, wherein the server device is at least one of video and sound. An acquisition step of acquiring content information indicating the video or the sound, the content constituting the content, and the evaluation information on the content input by the user to an input unit included in the terminal device, the terminal device including An evaluation information acquisition step for acquiring; a detection step for detecting an image or sound output from an output device for outputting at least one of the image and the sound, the terminal device constituting the content; and the terminal An apparatus includes the server, the acquired evaluation information, and detection information indicating the detected video or sound. A transmitting step of transmitting to the device, a receiving step of receiving the evaluation information and the detection information from the terminal device by the server device, the acquired content information and the received detection information by the server device When the server apparatus determines that there is a predetermined match between the content information and the detection information as a result of comparison by the comparison step, the received evaluation information is compared with the received evaluation information. And a selection step of selecting to use for evaluation of content, wherein the detection step and the transmission step detect the video or the sound when the evaluation information is input, and the detection information together with the evaluation information. Is transmitted to the server apparatus, and the selection step determines that the content information matches the detection information. If the evaluation information received together with the detection information is selected to be used for the evaluation of the content, an image indicated by the portion determined to match the detection information in the content information or The output time of the sound by the output device is specified as the input time of the evaluation information received together with the detection information.

One embodiment of the present invention is an information processing method executed by a computer of a server device, which acquires content information indicating the video or the sound, which constitutes content composed of at least one of video and sound. A terminal device for detecting an image or sound output by an acquisition step, an evaluation device for inputting evaluation information of the content by a user, and configuring the content and outputting at least one of the image and the sound A receiving step of receiving the evaluation information and detection information indicating the detected video or sound, a comparison step of comparing the acquired content information with the received detection information, and the comparison step. If there is a predetermined match between the content information and the detection information according to the comparison result by the step A selection step of selecting to use the received evaluation information to the evaluation of the content, only including, the terminal device, the detection information by detecting the image or the sound repeatedly at a predetermined time interval The terminal apparatus transmits, and the selection step selects, in the detection information repeatedly received with the predetermined time interval in the reception step, the terminal device at a time closest to the input time before or after the input time of the evaluation information. The selection is performed based at least on the comparison result of the detection information indicating the video or the sound detected by the method and the content information .
One embodiment of the present invention is an information processing method executed by a computer of a server device, which acquires content information indicating the video or the sound, which constitutes content composed of at least one of video and sound. A terminal device for detecting an image or sound output by an acquisition step, an evaluation device for inputting evaluation information of the content by a user, and configuring the content and outputting at least one of the image and the sound A receiving step of receiving the evaluation information and detection information indicating the detected video or sound, a comparison step of comparing the acquired content information with the received detection information, and the comparison step. If there is a predetermined match between the content information and the detection information according to the comparison result by the step Selecting the received evaluation information to be used for evaluation of the content, and the terminal device detects the video or the sound when the evaluation information is input, and the evaluation is performed. At the same time as the information, the detection information indicating the detected video or sound is transmitted to the server device, and in the selection step, the detection is performed when the content information has a portion determined to match the detection information. The evaluation information received simultaneously with the information is selected to be used for the evaluation of the content.
One embodiment of the present invention is an information processing method executed by a computer of a server device, which acquires content information indicating the video or the sound, which constitutes content composed of at least one of video and sound. A terminal device for detecting an image or sound output by an acquisition step, an evaluation device for inputting evaluation information of the content by a user, and configuring the content and outputting at least one of the image and the sound A receiving step of receiving the evaluation information and detection information indicating the detected video or sound, a comparison step of comparing the acquired content information with the received detection information, and the comparison step. If there is a predetermined match between the content information and the detection information according to the comparison result by the step Selecting the received evaluation information to be used for evaluation of the content, and the terminal device detects the video or the sound when the evaluation information is input, and the evaluation is performed. When the detection information is transmitted to the server apparatus together with the information, and the selection step includes the portion where the content information is determined to match the detection information, the evaluation information received together with the detection information is It is selected to be used for evaluation of content, and the output time by the output device of the video or sound indicated by the portion determined to be coincident with the detection information among the content information is received together with the detection information. It is characterized in that it is specified as an input time of information.

One embodiment of the present invention is an information processing method executed by a computer of a terminal device, the evaluation of the content composed of at least one of video and sound input by a user to input means included in the terminal device. An evaluation information acquisition step of acquiring information; a detection step of detecting an image or a sound output by an output device which outputs the at least one of the image and the sound which constitutes the content; the acquired evaluation Information and detection information indicating the detected video or sound, the comparison result of content information indicating at least one of the video and the sound, which is included in the content, and the detection information; If it is indicated that there is a predetermined match between content information and the detection information, the evaluation information is A transmission step of transmitting to the server device selected to use in the evaluation of Ntsu, only containing the detection step and the transmitting step, the detection information by detecting the image or the sound repeatedly at a predetermined time interval The server apparatus transmits the terminal apparatus before or after the input time of the evaluation information among the detection information repeatedly received from the terminal apparatus at predetermined time intervals, before or after the input time of the evaluation information. The selection is performed based at least on the comparison result of the detection information indicating the video or the sound detected by the method and the content information .
One embodiment of the present invention is an information processing method executed by a computer of a terminal device, the evaluation of the content composed of at least one of video and sound input by a user to input means included in the terminal device. An evaluation information acquisition step of acquiring information; a detection step of detecting an image or a sound output by an output device which outputs the at least one of the image and the sound which constitutes the content; the acquired evaluation Information and detection information indicating the detected video or sound, the comparison result of content information indicating at least one of the video and the sound, which is included in the content, and the detection information; If it is indicated that there is a predetermined match between content information and the detection information, the evaluation information is Transmitting to a server device that is selected to be used for evaluation of the data, wherein the detecting and the transmitting detect the video or the sound when the evaluation information is input, and the evaluation is performed. When the detection information indicating the detected video or sound is transmitted to the server device simultaneously with the information, and the server device has a portion in which the content information is determined to match the detection information, the terminal The evaluation information received from the device simultaneously with the detection information is selected to be used for evaluation of the content.
One embodiment of the present invention is an information processing method executed by a computer of a terminal device, the evaluation of the content composed of at least one of video and sound input by a user to input means included in the terminal device. An evaluation information acquisition step of acquiring information; a detection step of detecting an image or a sound output by an output device which outputs the at least one of the image and the sound which constitutes the content; the acquired evaluation Information and detection information indicating the detected video or sound, the comparison result of content information indicating at least one of the video and the sound, which is included in the content, and the detection information; If it is indicated that there is a predetermined match between content information and the detection information, the evaluation information is Transmitting to the server apparatus selected to be used for evaluation of the data, and the detecting and the transmitting detect the video or the sound when the evaluation information is input, and the evaluation is performed. When the detection information is transmitted to the server device together with the information, and the server device has a portion where the content information is determined to match the detection information, the evaluation received from the terminal device together with the detection information Information is selected to be used for evaluation of the content, and the output time by the output device of the video or sound indicated by the portion determined to match the detection information among the content information is received together with the detection information It is characterized by specifying as input time of the said evaluation information.

One embodiment of the present invention is an information processing program executed by a computer of a server device , wherein the computer constitutes content constituted by at least one of video and sound, and the content indicating the video or the sound A video or a sound output from an acquisition unit for acquiring information, an output device for outputting at least one of the video and the sound, the evaluation information on the content being input by the user, and constituting the content Receiving means for receiving the evaluation information and detection information indicating the detected video or sound from a terminal device to be detected, and comparison means for comparing the acquired content information with the received detection information And the comparison result by the comparison means, the predetermined one between the content information and the detection information. If there is, a selecting means for selecting to use the received evaluation information to the evaluation of the content, to function as the terminal apparatus detects the image or the sound repeatedly at a predetermined time interval the The detection information is transmitted to the server device, and the selection means selects the detection time before or after the input time of the evaluation information among the detection information repeatedly received by the reception means with the predetermined time interval. The selection is performed based at least on a comparison result of detection information indicating video or sound detected by the terminal device at the closest time and the content information .
One embodiment of the present invention is an information processing program executed by a computer of a server device, wherein the computer constitutes content constituted by at least one of video and sound, and the content indicating the video or the sound A video or a sound output from an acquisition unit for acquiring information, an output device for outputting at least one of the video and the sound, the evaluation information on the content being input by the user, and constituting the content Receiving means for receiving the evaluation information and detection information indicating the detected video or sound from a terminal device to be detected, and comparison means for comparing the acquired content information with the received detection information And the comparison result by the comparison means, the predetermined one between the content information and the detection information. Function as selection means for selecting the received evaluation information to be used for evaluation of the content, and the terminal device detects the video or the sound when the evaluation information is input. Simultaneously with the evaluation information, the detection information indicating the detected video or sound is transmitted to the server device, and the selection unit has a portion where the content information is determined to match the detection information. In the case, the evaluation information received simultaneously with the detection information is selected to be used for the evaluation of the content.
One embodiment of the present invention is an information processing program executed by a computer of a server device, wherein the computer constitutes content constituted by at least one of video and sound, and the content indicating the video or the sound A video or a sound output from an acquisition unit for acquiring information, an output device for outputting at least one of the video and the sound, the evaluation information on the content being input by the user, and constituting the content Receiving means for receiving the evaluation information and detection information indicating the detected video or sound from a terminal device to be detected, and comparison means for comparing the acquired content information with the received detection information And the comparison result by the comparison means, the predetermined one between the content information and the detection information. Function as selection means for selecting the received evaluation information to be used for evaluation of the content, and the terminal device detects the video or the sound when the evaluation information is input. And the evaluation information is transmitted to the server apparatus, and the selection means has the portion where the content information is determined to match the detection information, the evaluation received with the detection information Information is selected to be used for evaluation of the content, and the output time by the output device of the video or sound indicated by the portion determined to match the detection information among the content information is received together with the detection information It is characterized by specifying as input time of the said evaluation information.

One embodiment of the present invention is an information processing program executed by a computer of a terminal device, the computer comprising at least one of video and sound input by a user to input means included in the terminal device. The evaluation information acquisition means for acquiring evaluation information for the content, and the detection means for detecting the image or sound outputted by the output device for outputting at least one of the image and the sound that constitutes the content; Detection information acquiring means for acquiring detection information indicating a detected video or sound, the acquired evaluation information, and the acquired detection information constitute at least one of the video and the sound. The content information and the inspection information are compared according to the comparison result between the content information indicating one of them and the detection information. If there is a predetermined match between the information transmitting means for transmitting the evaluation information to the server device selected to use in the evaluation of the content, to function as the detection means and the transmission means, the predetermined time interval And repeatedly detect the video or the sound to transmit the detection information, and the server device transmits the detection information among the detection information repeatedly received from the terminal device at the predetermined time intervals. The selection is performed based on at least a comparison result of detection information indicating video or sound detected by the terminal device at a time closest to the input time before or after the input time and the content information. .
One embodiment of the present invention is an information processing program executed by a computer of a terminal device, the computer comprising at least one of video and sound input by a user to input means included in the terminal device. The evaluation information acquisition means for acquiring evaluation information for the content, and the detection means for detecting the image or sound outputted by the output device for outputting at least one of the image and the sound that constitutes the content; Detection information acquiring means for acquiring detection information indicating a detected video or sound, the acquired evaluation information, and the acquired detection information constitute at least one of the video and the sound. The content information and the inspection information are compared according to the comparison result between the content information indicating one of them and the detection information. And a transmitting unit configured to transmit the evaluation information to the server apparatus to be used for evaluating the content when there is a predetermined match with the information, and the detecting unit and the transmitting unit are configured to transmit the evaluation information Detects the video or the sound when it is input, and simultaneously transmits the detection information indicating the detected video or sound to the server device, the server device simultaneously with the evaluation information If the evaluation information has a portion determined to match the detection information, the evaluation information received simultaneously with the detection information from the terminal device is selected to be used for the evaluation of the content.
One embodiment of the present invention is an information processing program executed by a computer of a terminal device, the computer comprising at least one of video and sound input by a user to input means included in the terminal device. The evaluation information acquisition means for acquiring evaluation information for the content, and the detection means for detecting the image or sound outputted by the output device for outputting at least one of the image and the sound that constitutes the content; Detection information acquiring means for acquiring detection information indicating a detected video or sound, the acquired evaluation information, and the acquired detection information constitute at least one of the video and the sound. The content information and the inspection information are compared according to the comparison result between the content information indicating one of them and the detection information. And a transmitting unit configured to transmit the evaluation information to the server apparatus to be used for evaluating the content when there is a predetermined match with the information, and the detecting unit and the transmitting unit are configured to transmit the evaluation information Detects the video or the sound when it is input, and transmits the detection information to the server device together with the evaluation information, and the server device determines that the content information matches the detection information If it has a part, the evaluation information received from the terminal device together with the detection information is selected for use in the evaluation of the content, and the content information is indicated by the part determined to match the detection information. The output time of the output device by the output device of the video or sound to be used is specified as the input time of the evaluation information received together with the detection information. Characterized in that it.

  According to the present invention, even in the case where content is evaluated using a general-purpose terminal device, it is possible to ensure the reliability of the evaluation information for the content.

It is a figure showing an example of the outline composition of program evaluation system S concerning one embodiment. It is a block diagram showing an example of outline composition of server 1 concerning one embodiment. It is a figure which shows an example of the functional block of the system control part 11 of the server 1 which concerns on one Embodiment. It is a block diagram showing an example of outline composition of user terminal 2 concerning one embodiment. It is a figure which shows an example of the functional block of the system control part 21 of the user terminal 2 which concerns on one Embodiment. It is a figure which shows an example of the processing outline in program evaluation system S. FIG. It is a figure which shows an example of the method of determining whether evaluation information is used for evaluation of a program. It is a figure which shows an example of the input screen for inputting the evaluation information with respect to a program. It is a figure which shows an example of the transmission timing of the information by several user terminals 2. FIG. It is a figure which shows an example of the produced | generated report. 5 is a flowchart showing an example of terminal processing executed by the system control unit 21 of the user terminal 2; 5 is a flowchart showing an example of server processing executed by the system control unit 11 of the server 1; It is a figure which shows an example of the processing outline in program evaluation system S. FIG. 5 is a flowchart showing an example of terminal processing executed by the system control unit 21 of the user terminal 2; 5 is a flowchart showing an example of server processing executed by the system control unit 11 of the server 1;

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The content that can be evaluated in the present invention is composed of at least one of video (especially moving image) and sound. Broadcast, on-demand delivery, etc. may be mentioned as an example of the delivery form of the content. Examples of the broadcast format include digital terrestrial television broadcasting, satellite broadcasting, cable television, radio broadcasting, Internet broadcasting, and the like. Satellite broadcasting, cable television, the Internet, etc. may be mentioned as examples of forms of on-demand delivery. The embodiments described below are embodiments in the case where the present invention is applied to a system for evaluating a program in digital terrestrial television broadcasting.

[1. First embodiment]

[1-1. Configuration of Program Evaluation System]

  First, the configuration of a program evaluation system S according to the present embodiment will be described using FIG. FIG. 1 is a diagram showing an example of a schematic configuration of a program evaluation system S according to the present embodiment.

  As shown in FIG. 1, the program evaluation system S is configured to include a server 1 and one or more user terminals 2. The server 1 and each user terminal 2 can mutually transmit and receive data via the network NW using, for example, TCP / IP as a communication protocol. The network NW is constructed by, for example, the Internet, a dedicated communication line (for example, a CATV (Community Antenna Television) line), a mobile communication network (including a base station and the like), a gateway, and the like.

  The server 1 is a server device for totaling or analyzing the user's evaluation of the television program broadcasted by the broadcasting station 3. In order to determine the reliability of the evaluation by each user, the server 1 acquires, as program sound information, information indicating the sound of the program to be evaluated during or before the broadcast of the program. During broadcasting of a program to be evaluated, the server 1 receives, from each user terminal 2, evaluation information indicating an evaluation by the user. In addition, the server 1 receives, from each user terminal 2, sound data indicating sound detected by the user terminal 2 and detected sound information. Then, based on the detected sound information, the server 1 determines whether to use the evaluation information from the user terminal 2 for the evaluation of the program.

  Each user terminal 2 is used by a user who is registered as a member in the program evaluation system S. When each user is viewing the evaluation target program on each television receiver 4, the user terminal 2 used by the user detects the sound output from the television receiver 4 and detects the detected sound information. Send to server 1 Further, each user terminal 2 transmits evaluation information indicating the input evaluation to the server 1 when an evaluation for a program is input by the user. There is no particular upper limit on the number of times that the user can input evaluation information per unit time while watching a program. For example, the user may input evaluation information at intervals of seconds or intervals of hundreds of milliseconds. The user terminal 2 is preferably a portable computer, but may be a stationary computer. Examples of the user terminal 2 include a smartphone, a portable information terminal such as a tablet computer, a mobile phone, a PDA (Personal Digital Assistant), a personal computer, and the like.

[1-2. Server configuration]

  Next, the configuration of the server 1 will be described using FIG. 2A. FIG. 2A is a block diagram showing an example of a schematic configuration of the server 1 according to the present embodiment. As shown in FIG. 2A, the server 1 includes a system control unit 11, a system bus 12, an input / output interface 13, a storage unit 14, and a communication unit 15. The system control unit 11 and the input / output interface 13 are connected via the system bus 12.

  The system control unit 11 includes a central processing unit (CPU) 11 a, a read only memory (ROM) 11 b, a random access memory (RAM) 11 c, and the like. The CPU 11a is an example of a processor. The present invention is also applicable to various processors different from the CPU. The storage unit 14, the ROM 11b, and the RAM 11c are each an example of a memory. The present invention is also applicable to various memories different from hard disks, ROMs and RAMs.

  The input / output interface 13 performs interface processing between the storage unit 14 and the communication unit 15 and the system control unit 11.

  The storage unit 14 is configured of, for example, a hard disk drive or the like. The storage unit 14 stores program sound information acquired from the broadcast station 3. The storage unit 14 also stores evaluation information received from each user terminal 2. Further, the storage unit 14 stores a user database. The user database stores information on users registered as members of the program evaluation system S. For example, in the user database, user attributes such as user ID, name, date of birth, gender, occupation, etc. are stored in association with each user. The user ID is information for identifying a user. Furthermore, the storage unit 14 stores various programs such as an operating system and a server program. The server program is a program for executing acquisition of program information, reception of evaluation information and detected sound information, determination of whether to use the evaluation information, and the like. The server program may be acquired from, for example, another server apparatus or the like via the network NW, or may be recorded on a recording medium such as a magnetic tape, an optical disc, or a memory card and read via the drive apparatus. You may

  The communication unit 15 connects to the network NW and controls the communication state with each user terminal 2.

[1-3. Configuration of user terminal]

  Next, the configuration of the user terminal 2 will be described using FIG. 3A. FIG. 3A is a block diagram showing an example of a schematic configuration of the user terminal 2 according to the present embodiment. As shown in FIG. 3A, the user terminal 2 includes a system control unit 21, a system bus 22, an input / output interface 23, a storage unit 24, a communication unit 25, an operation input unit 26, and a display unit 27. A microphone 28 and a camera 29 are provided. The system control unit 21 and the input / output interface 23 are connected via the system bus 22.

  The system control unit 21 includes a CPU 21a, a ROM 21b, a RAM 21c, and the like.

  The input / output interface 23 performs interface processing between the storage unit 24 to the camera 29 and the system control unit 21.

  The storage unit 24 is configured by, for example, a flash memory, a hard disk drive, or the like. The storage unit 24 stores various programs such as an operating system, a web browser, and a program evaluation application. The program evaluation application is a program for performing processing for using the program evaluation system S. The program evaluation application may be acquired from, for example, a server apparatus such as the server 1 via the network NW, or may be recorded on a recording medium such as an optical disc or a memory card and read via a drive apparatus. May be The program evaluation application may be a web application.

  The communication unit 25 connects to the network NW and controls the communication state with the server 1.

  The operation input unit 26 receives an operation by the user, and outputs a signal corresponding to the content of the operation to the system control unit 21. Examples of the operation input unit 26 include a touch panel, a button, a switch, a key, a keyboard, and a mouse. The operation input unit 26 functions as a means by which evaluation information on a broadcast program is input by the user.

  The display unit 27 displays information such as images and characters under the control of the system control unit 21. Examples of the display unit 27 include a liquid crystal display, an organic EL (Electro Luminescence) display, and the like.

  The microphone 28 is a device that converts a sound wave into an audio signal and outputs the audio signal to the system control unit 21. The microphone 28 functions as a means for detecting the sound of the broadcast program output from the television receiver 4.

  The camera 29 captures a still image or a moving image. The camera 29 is configured of, for example, a CCD (Colony Collapse Disorder) image sensor or the like.

[1-4. Functional overview]

  Next, functional outlines of the system control unit 11 of the server 1 and the system control unit 21 of the user terminal 2 will be described with reference to FIGS. 2B and 3B to 6.

  FIG. 3B is a diagram showing an example of functional blocks of the system control unit 21 of the user terminal 2 according to the present embodiment. As shown in FIG. 3B, the system control unit 21 causes the CPU 21a to read and execute various codes included in the program evaluation application, thereby obtaining an evaluation information acquisition unit 211, a detection information acquisition unit 212, and an evaluation information / detection information transmission unit. It functions as 213 grade.

  FIG. 4A is a diagram showing an example of an outline of processing in the program evaluation system S. The evaluation information acquisition unit 211 acquires, from the operation input unit 26, evaluation information input by the user for the broadcast program. As shown in FIG. 4A, the user inputs evaluation information to the user terminal 2 while viewing a broadcast program to be evaluated by the television receiver 4 under normal conditions.

  FIG. 5 is a diagram showing an example of an input screen for inputting evaluation information on a program. The evaluation information acquisition unit 211 causes the display unit 27 of the user terminal 2 to display the input screen illustrated in FIG. 5 when the program evaluation application is activated and the user performs a program survey start operation. For example, the evaluation information acquisition unit 211 may perform display control so that the input screen can be displayed only in the broadcast time zone of the program to be evaluated. The input screen may be configured by, for example, evaluation buttons 101 and 102, a comment input area 103, a comment transmission button 104, and the like. The evaluation button 101 is a button that is pressed when the user feels that the program is boring. When the evaluation button 101 is pressed, the evaluation information acquisition unit 211 acquires evaluation information that indicates “not boring”. The evaluation button 102 is a button that is pressed when the user feels that the program is interesting. When the evaluation button 102 is pressed, the evaluation information acquisition unit 211 acquires evaluation information indicating “interesting”. The comment input area 103 is a button for inputting a comment on a program. The comment transmission button 104 is a button for transmitting a comment input to the comment input area 103. When the comment transmission button 104 is pressed, the evaluation information acquisition unit 211 acquires evaluation information including the character string of the input comment. In addition, the evaluation for the program is not limited to "interesting", "poor" and comments. For example, it may be possible to input “interesting %%” by the touch operation of the indicator bar displayed on the screen. That is, it may be possible to visually input the degree and tendency of the evaluation. In that case, if the indicator bar is selected as near the center, it will be evaluated and input as "interesting 50%". Various other forms of evaluation can be input as evaluation information.

  The detection information acquisition unit 212 acquires detection sound information indicating the sound detected by the microphone 28. As shown in FIG. 4A, when the user inputs evaluation information while watching a broadcast program to be evaluated, the microphone 28 detects the sound of the program. The detection information acquisition unit 212 may generate detection sound information by converting an audio signal output from the microphone 28, for example. For example, the detection information acquisition unit 212 may extract waveform information indicating the feature of the sound waveform as the detection sound information from the sound signal by analyzing the sound signal. For example, the detection information acquisition unit 212 may define a plurality of amplitude bands and specify the amplitude band in which the waveform of the audio signal is sampled at each predetermined sampling interval. The detection information acquisition unit 212 may count the number of samples of the waveform for each amplitude band, and generate an array of the number of samples as waveform information. Alternatively, the detection information acquisition unit 212 may extract the feature amount of the detected sound from the audio signal by analyzing the audio signal. For example, feature quantities are extracted using discrete Fourier transform or the like. The detection information acquisition unit 212 acquires this feature amount as detection sound information. Alternatively, the audio signal may be converted into audio data in a format such as MP3 (MPEG-1 Audio Layer-3) and acquired as detected sound information.

  The detection information acquisition unit 212 controls on / off of sound detection by the microphone 28. For example, the detection information acquisition unit 212 may turn on the constant sound detection to acquire detection sound information during the broadcast of the program to be evaluated. However, in consideration of processing load, power consumption, network load and the like, it is desirable to perform detection only at a predetermined timing. For example, the detection information acquisition unit 212 may repeatedly make the microphone 28 detect a sound at predetermined time intervals. The sound detection interval may be, for example, 1 second, 5 seconds, 10 seconds, 30 seconds, 1 minute, or the like. As the sound detection interval is set shorter, the content evaluation described later can be performed timely according to the change of the content, and the feedback to the creation or editing of the content can be accurately performed. become. The detection information acquisition unit 212 continues the detection of the sound by the microphone 28 for a time shorter than the detection interval for each detection of the sound. Alternatively, the detection information acquisition unit 212 may cause the microphone 28 to detect sound at the timing when the user inputs the evaluation information.

  The evaluation information / detection information transmission unit 213 transmits the evaluation information acquired by the evaluation information acquisition unit 211 and the detection sound information acquired by the detection information acquisition unit 212 to the server 1. The evaluation information / detection information transmission unit 213 may collectively transmit at least one of the evaluation information and the detected sound information, for example, after the end of the broadcast of the program to be evaluated. On the other hand, the evaluation information / detection information transmission unit 213 may transmit the evaluation information and the detected sound information during the broadcast of the program to be evaluated. For example, the evaluation information / detection information transmission unit 213 may transmit the evaluation information at the timing when the evaluation information is input, while the detection sound information may be repeatedly transmitted at predetermined time intervals. For example, in the case where detection of sound is repeatedly performed with a predetermined time interval by the microphone 28, the evaluation information / detection information transmission unit 213 may transmit detection sound information each time detection is performed. The detection sound information is periodically transmitted to the server 1 so that the server 1 can constantly grasp the viewing situation of the program by the user during the broadcast of the program to be evaluated. When sound is detected by the microphone 28 at the timing when the evaluation information is input, the evaluation information / detection information transmission unit 213 may repeatedly transmit the evaluation information together with the detection sound information at predetermined time intervals. In this case, transmission of the evaluation information and the detected sound information is reserved until the periodic transmission timing comes after the evaluation information is input. Alternatively, the evaluation information / detection information transmission unit 213 may transmit the evaluation information together with the detection information at the timing when the evaluation information is input. Although details will be described later, the evaluation information / detection information transmission unit 213 may transmit detection sound information at timing according to the timing information transmitted from the server 1.

  FIG. 2B is a diagram showing an example of functional blocks of the system control unit 11 of the server 1 according to the present embodiment. As shown in FIG. 2B, the system control unit 11 causes the program information acquisition unit 111, the evaluation information / detection information reception unit 112, the comparison unit 113, and the evaluation, as the CPU 11a reads and executes various codes included in the server program. It functions as the information use determination unit 114, the evaluation unit 115, and the like.

  The program information acquisition unit 111 acquires content information indicating at least one of video and sound, which constitutes content of a broadcast program to be evaluated. In the present embodiment, the program information acquisition unit 111 acquires program sound information indicating the sound of a broadcast program as content information. For example, when a program to be evaluated is recorded in advance, the server 1 may receive audio data of a program from the broadcast station 3 via the network NW before the start of the broadcast of the program. Alternatively, audio data of a program may be recorded on a recording medium and loaded into the server 1 via a drive device. Alternatively, while the program is being broadcasted, a tuner (not shown) may receive a broadcast signal transmitted from the broadcast station 3 and the server 1 may acquire audio data extracted from the broadcast signal by the tuner in real time. The program information acquisition unit 111 may store voice data of a program in the storage unit 14 as program sound information. Alternatively, similar to the detection information acquisition unit 212 of the user terminal 2, the program information acquisition unit 111 may extract the waveform information or the feature amount of the sound of the program from the audio data at predetermined time intervals. And the program information acquisition part 111 may database the time-series data comprised by time series of waveform information or a feature-value as program sound information. In the program sound information, each waveform information or feature amount may be associated with a time when a sound corresponding to the waveform information or feature amount is broadcasted in a program to be evaluated. This broadcast time may be an absolute time or may be a relative time from the broadcast start time.

  The evaluation information / detection information receiving unit 112 receives evaluation information and detected sound information from each user terminal 2. As described above, the evaluation information and the detected sound information may be transmitted together or may be transmitted at different timings.

  Here, when the evaluation information and the detected sound information are simultaneously transmitted from the plurality of user terminals 2, there is a possibility that the processing load and communication load of the server 1, and further, the network load may increase. Therefore, the evaluation information / detection information receiving unit 112 is configured to transmit at least one of the evaluation information and the detected sound information by at least one of the plurality of user terminals 2 to another of the plurality of user terminals 2. The transmission timing of at least one of the evaluation information and the detected sound information is determined for each user terminal 2 so as to be different from the transmission timing of at least one of the evaluation information and the detected sound information by the at least one user terminal 2 of You may Then, the server 1 may transmit timing information indicating the determined timing to each of the plurality of user terminals 2. For example, the evaluation information / detection information receiving unit 112 may determine the transmission timing by the at least one other user terminal 2 during the transmission timing interval by the at least one user terminal 2 in the plurality of user terminals 2 . Thereby, the number of detection information received by the server device per unit time is equalized. In this case, the server 1 causes each user terminal 2 to periodically transmit detection sound information.

  For example, it is assumed that a transmission cycle of information (at least one of evaluation information and detected sound information) by each user terminal 2 is P seconds, and transmission timings of the information are distributed to N transmission timings. Also, let Ti be the start time of the ith transmission cycle from the start of the program broadcast. In this case, the transmission timing of the information in the i-th cycle is, for example, Ti + 0 seconds, Ti + 1 × P / N seconds, Ti + 2 × P / N seconds,... Ti + (N−1) × P / N seconds. 0, 1 × P / N, 2 × P / N,... (N−1) × P / N are offsets from the start time. Each user terminal 2 may, for example, notify the server 1 when an operation for starting the evaluation of a program is performed by the user. In response to the notification from the user terminal 2, the evaluation information / detection information receiving unit 112 may cyclically or randomly determine one transmission timing from among a plurality of transmission timings according to the order. Since transmission timings by a plurality of user terminals 2 may be dispersed as a whole, there is no problem that transmission timings overlap among some of the user terminals 2. The evaluation information / detection information receiving unit 112 transmits timing information indicating the determined transmission timing to the user terminal 2 that has transmitted the notification. The evaluation information / detection information transmission unit 213 of the user terminal 2 transmits information in accordance with the timing indicated by the timing information. The timing information may include, for example, the start time of the transmission cycle (e.g., 0 seconds per minute) and the offset (e.g., 0 seconds, 20 seconds, 40 seconds).

  FIG. 6 is a diagram illustrating an example of transmission timings of information by a plurality of user terminals 2. In this example, P is 60 seconds and N is 3. In FIG. 6, the user terminal 2-1 receives, from the server 1, timing information indicating “0 second every minute”. The user terminal 2-2 receives, from the server 1, timing information indicating "after 0 to 20 seconds per minute". The user terminal 2-3 receives, from the server 1, timing information indicating "every 40 seconds after the lapse of 40 seconds." It is assumed that a certain transmission cycle starts at time T. In this case, the user terminal 2-1 transmits information between time T and T + 20 seconds. The user terminal 2-2 transmits information during time T + 20 to T + 40 seconds. The user terminal 2-3 transmits information during time T + 40 to T + 60 seconds. Furthermore, the user terminal 2-1 transmits information during time T + 60 to T + 80 seconds. The user terminal 2-2 transmits information during time T + 80 to T + 100 seconds. The user terminal 2-3 transmits information during time T + 100 to T + 120 seconds.

  The comparison unit 113 compares the program sound information acquired by the program information acquisition unit 111 with the detected sound information received by the evaluation information / detection information reception unit 112. For example, when the program sound information and the detected sound information are waveform information, the comparison unit 113 indicates the waveform information or the feature amount of the sound detected by the user terminal 2 indicated in the detected sound information and the program indicated in the program sound information The degree of coincidence between the waveform information of the detected sound and the waveform information of the sound of the program may be calculated by comparing each of the waveform information of the time-series waveform information of the sound of. For example, the degree of coincidence may be calculated based on coincidence or non-coincidence of the number of samples for each amplitude band. Comparison section 113 compares only the waveform information broadcast within a predetermined time before and after the time when the sound is detected in user terminal 2 in the time series of the waveform information shown in the program sound information with the detected sound information. It is also good. The same applies to the case where program sound information and detected sound information are feature amounts. The matching degree in the case of the feature amount may be, for example, cosine similarity.

  There may be a plurality of programs to be evaluated, and the plurality of programs may be broadcast in the same time zone. In this case, the program evaluation application may be programmed so that, for example, the user terminal 2 can select a program to be evaluated by the user. Assuming that the user is viewing the selected program, the comparison unit 113 compares the program sound information of the selected program with the detected sound information. Alternatively, the comparison unit 113 may compare each of the program sound information of a plurality of programs with the detected sound information, and determine that the program having the highest matching degree is the program being viewed by the user.

  The evaluation information use determining unit 114 determines that the evaluation information received by the evaluation information / detection information receiving unit 112 is the result of the comparison when the program sound information and the detection sound information have a predetermined match according to the comparison result by the comparison unit 113. Choose to use for program evaluation. For example, when it is determined that the sound detected by the user terminal 2 matches the sound of a part of the program as shown in FIG. 4A, the evaluation information use determining unit 114 uses the evaluation information for evaluation. If determined and determined not to match, it may be determined not to use the evaluation information for evaluation. If the sound detected by the user terminal 2 matches the sound of part of the program, the user is likely to view the program to be evaluated and evaluate it, so the reliability of the evaluation information is high. On the other hand, if they do not match, it is unlikely that the user is watching the program to be evaluated, so the reliability of the evaluation information is low. Specifically, the evaluation information use determining unit 114 determines whether the program sound information has a portion determined to match the detected sound information. For example, when the program sound information and the detected sound information are waveform information, the evaluation information use determining unit 114 determines that the degree of coincidence with the waveform information of the sound detected by the user terminal 2 among the waveform information included in the program sound information. It is determined whether or not waveform information exceeding a predetermined threshold value is present. If such waveform information exists, the evaluation information use determining unit 114 may determine that the detected sound matches the sound of the program. In the present embodiment, accurate voice recognition is not necessary, and if it is possible to determine the coincidence of voice waveforms, it is possible to determine whether the user is actually watching a program. The processing of the evaluation information utilization determining unit 114 is basically the same as in the case where the program sound information and the detected sound information are feature amounts. The microphone 28 of the user terminal 2 may detect speech of a user or the like, environmental sound, etc., as well as the sound of the program. Therefore, the threshold may be set lower. Even in this case, it is possible to increase the accuracy of the match determination, for example, by considering the degree of coincidence between the sounds detected at predetermined timings or more and the sound of the program. For example, the evaluation information utilization determining unit 114 may determine that the detected sound matches the sound of the program when all the coincidences exceed the threshold, or the average value of the coincidences exceeds the threshold and If the standard deviation of the degree of coincidence is less than a predetermined value, it may be determined that the detected sound matches the sound of the program. In addition, in the condition where the user's etc.'s speaking voice, an environmental sound, etc. are detected by the microphone 28 of the user terminal 2, pre-processing may be performed and it may remove as noise. When the user terminal 2 repeatedly detects the sound by the microphone 28 at predetermined time intervals and transmits the detected sound information, the evaluation information utilization determining unit 114 determines whether the sound of the program and the detected sound are transmitted. Match determination can be performed at predetermined time intervals. By shortening the interval, it is possible to accurately determine in real time whether the user is watching a program when the user inputs evaluation information. The user's interest in the program may change in seconds as the program progresses, and if the program is not interesting, the user stops watching the program or watches another program even in the middle of the program. Therefore, evaluation information in seconds for a program is important. The reliability of the real-time evaluation information can be secured.

  The evaluation information use determining unit 114 evaluates the evaluation information of the program based on comparison of the sound detected by the microphone 28 at the same time as or near the time when the evaluation information is input by the user and the sound of the program. It may be determined whether to use it or not. While a program to be evaluated is being broadcast, it may change whether the user is watching the program. The evaluation information use determining unit 114 makes a determination according to the change in the viewing condition. FIG. 4B is a diagram illustrating an example of user behavior that may occur when a method for determining whether to use evaluation information for program evaluation is implemented. As shown in FIG. 4B, a certain user, for example, entered evaluation information five minutes after the start of broadcasting of a program. At this time, the sound detected by the microphone 28 matched the sound of the program. In this case, the evaluation information is used for evaluation. After that, the user left the room where the television receiver 4 is located, and entered the evaluation information 30 minutes after the broadcast of the program started. The sound detected at this time and the sound of the program did not match. In this case, the evaluation information is not used for the evaluation. After that, the user returned to the room and entered evaluation information 50 minutes after the start of the broadcast of the program. The sound detected at this time and the sound of the program coincided. In this case, the evaluation information is used for evaluation.

  When the user terminal 2 transmits the detected sound information to the server 1 together with the evaluation information, the evaluation information utilization determining unit 114 uses the evaluation information for the evaluation of the program based on the comparison between the detected sound information and the program sound information. It may be determined whether or not it is present. While the user terminal 2 repeatedly transmits detection sound information at predetermined time intervals, the evaluation information utilization determining unit 114 periodically receives the evaluation information when transmitting the evaluation information to the server 1 each time the evaluation information is input. Among the detected sound information to be detected, the comparison result between the detected sound information indicating the sound detected by the microphone 28 of the user terminal 2 before or after the input time of the evaluation information or the program sound information Based at least on the basis, it may be determined whether the evaluation information is to be used for evaluation of the program. That is, detection information on a time closest to the input time before or after the input time of the evaluation information is used at least in the determination of whether to use the evaluation information for evaluation. In addition, when the time width | variety with which evaluation information is input and the time width | variety with which detection sound information is detected overlap at least one part, you may determine whether the evaluation information is used for evaluation of a program.

  The user terminal 2 may transmit the input time of the evaluation information to the server 1 together with the evaluation information, or may transmit the time to transmit the evaluation information to the server 1 as the input time of the evaluation information. Alternatively, the time when the server 1 receives the evaluation information from the user terminal 2 may be used as the input time of the evaluation information. In addition, the user terminal 2 may transmit the time when the sound is detected by the microphone 28 to the server 1 together with the detection sound information, or the time for transmitting the detection sound information to the server 1 as the time when the sound is detected. It may be sent. Alternatively, the time when the server 1 receives the detected sound information from the user terminal 2 may be used as the time when the sound is detected.

  The evaluation information use determining unit 114 detects two or more of the detected sound information repeatedly received at predetermined time intervals, each indicating a sound detected by the microphone 28 at a time relatively close to the input time of the evaluation information. Whether to use the evaluation information for evaluation of the program may be determined based on the comparison result of the sound information detection sound information and the program sound information. That is, two or more pieces of detected sound information are used to determine whether to use evaluation information for evaluation. As a result, it is possible to improve the determination accuracy as to whether or not the user is watching a program to be evaluated. For example, the evaluation information utilization determining unit 114 may use a predetermined number of pieces of detection sound information in the order in which the detected times are closer to the input time before or after the input time of the evaluation information, or the detected times are input time Detection sound information within a predetermined time may be used. Alternatively, the evaluation information utilization determining unit 114 may use a predetermined number of pieces of detection sound information in the order in which the detected times are closer to the input time before and after the input time of the evaluation information, or the detected times are calculated from the input time Detection sound information that is within a predetermined time may be used. The evaluation information utilization determining unit 114 may determine to use the evaluation information for evaluation when, for example, the degree of coincidence for all two or more pieces of detected sound information exceeds a threshold, the average value of the degree of coincidence exceeds the threshold And when the standard deviation of the degree of coincidence is less than a predetermined value, it may be decided to use the evaluation information for evaluation.

  In the present embodiment, whether to use the evaluation information for the evaluation of the program is determined based only on the sound of the program, but the evaluation information utilization determining unit 114 determines the video based on only the video of the program or Whether to use the evaluation information for the evaluation of the program may be determined based on both the sound and the sound. When using an image, the user directs the lens of the camera 29 of the user terminal 2 to the television receiver 4. The detection information acquisition unit 212 of the user terminal 2 causes the camera 29 to detect an image, for example, periodically or when evaluation information is input. The detection information acquisition unit 212 may extract the feature amount of the video from the video data output from the camera 29, for example, and generate the detection video information. For example, features may be extracted using an algorithm such as Scale Invariant Feature Transform (SIFT) or Speeded Up Robust Features (SURF). The evaluation information / detection information transmission unit 213 transmits the detection video information to the server 1. The program information acquisition unit 111 of the server 1 causes a tuner to receive a broadcast signal from a broadcasting station or acquires video data via the network NW, extracts feature quantities of video of a program, and generates program video information You may The comparing unit 113 compares the program video information and the detected video information, and the evaluation information utilization determining unit 114 determines whether to use the evaluation information for the evaluation of the program based on the comparison. The details and modifications in the case of using an image may be similar to those in the case of using a sound. In the case of using both video and sound, the evaluation information utilization determining unit 114 may determine to use the evaluation information for evaluation of the program, for example, when it is determined that the video matches and the sound matches.

  The evaluation unit 115 executes a process of evaluating a program based on the evaluation information determined to be used by the evaluation information utilization determining unit 114 among the evaluation information received by the evaluation information / detection information receiving unit 112. For example, the evaluation information / detection information receiving unit 112 counts and analyzes the evaluation information. The evaluation unit 115 may calculate the total of the evaluations of the respective items, such as “Bad”, “interesting”, and the number of evaluations input at each time between the start and the end of the program broadcast. Further, the evaluation unit 115 may count the total of evaluations as a whole, and the number of evaluations input at each time. The evaluation unit 115 may generate information indicating the transition of the evaluation number, information indicating the ranking of the time when the evaluation number is large, and the like. In addition, the evaluation unit 115 determines the number of users who have participated in the evaluation of the program, or the number of users who are determined to be used for the evaluation of the program by the evaluation information utilization determining unit 114 with respect to at least one evaluation information. The number of users who have visited once may be counted. Further, the evaluation unit 115 may generate the distribution of the attributes of the user who has made the effective evaluation. Further, the evaluation unit 115 may generate a list of comments. The evaluation unit 115 may generate a report as the evaluation result of the program. FIG. 7 is a diagram showing an example of the generated report. The format of the report may be, for example, HTML (Hyper Text Markup Language), PDF (Portable Document Format), or the like. The server 1 transmits the generated report via the network NW, for example, in response to a request from a terminal device (not shown) in the broadcasting station 3. In addition, the terminal device etc. which the management of program evaluation system S utilizes may perform the process which evaluates a program, for example. Further, the evaluation unit 115 may give a benefit such as points to the ID of the user who has performed the evaluation. As a result, it is possible to collect a large amount of evaluation information using the user's motivation, and increase the population to improve the reliability of the evaluation result.

[1-5. Operation of program evaluation system]

  Next, the operation of the program evaluation system S will be described using FIGS. 8 and 9. In the operation example described below, it is assumed that the server 1 acquires program sound information in advance and stores the program sound information in the storage unit 14. The user terminal 2 periodically detects sound and transmits detected sound information to the server 1. The server 1 determines whether to use the evaluation information for the evaluation of the program, using the detected sound information received at the time closest to the reception time before the reception time of the evaluation information. It is assumed that waveform information is used as program sound information and detected sound information.

  FIG. 8 is a flowchart showing an example of the terminal process performed by the system control unit 21 of the user terminal 2. For example, the user activates a program evaluation application to perform a program survey start operation. In response to this, the system control unit 21 executes terminal processing in accordance with the program evaluation application.

  First, the evaluation information / detection information transmission unit 213 transmits a survey start notification to the server 1 together with the user ID of the user who uses the user terminal 2 (step S1). Next, the evaluation information / detection information transmission unit 213 receives timing information from the server 1 and stores the timing information in the RAM 21c (step S2).

  Next, the detection information acquisition unit 212 determines, based on the current time, whether or not a sound detection timing has arrived (step S3). For example, the detection information acquisition unit 212 determines the detection timing in time for transmission timing, based on the transmission timing of the detection sound information indicated by the timing information, the time for which the detection of the sound is continued, and the like. If the detection information acquisition unit 212 determines that the detection timing has come (step S2: YES), the process proceeds to step S4. In step S4, the detection information acquisition unit 212 causes the microphone 28 to detect a sound. Next, the detection information acquisition unit 212 extracts waveform information as detection sound information from the audio signal output from the microphone 28 (step S5).

  In step S3, when the detection information acquisition unit 212 determines that the detection timing has not arrived (step S2: NO), the process proceeds to step S6. In step S6, the evaluation information / detection information transmission unit 213 determines whether the transmission timing indicated by the timing information has arrived based on the current time. If the evaluation information / detection information transmission unit 213 determines that the transmission timing has come (step S6: YES), the process proceeds to step S7. In step S7, the evaluation information / detection information transmission unit 213 transmits the detection sound information stored in the RAM 21c to the server 1 together with the user ID.

  In step S6, when the evaluation information / detection information transmission unit 213 determines that the transmission timing has not arrived (step S6: YES), the process proceeds to step S8. In step S8, the evaluation information acquisition unit 211 determines, based on the signal from the operation input unit 26, whether the evaluation information has been input. If the evaluation information acquisition unit 211 determines that the evaluation information has been input (step S8: YES), the process proceeds to step S9. In step S9, the evaluation information acquisition unit 211 transmits the input evaluation information to the server 1 together with the user ID.

  When step S5, S7 or S9 is finished, or when it is determined that the evaluation information is not input in step S8 (step S8: NO), the system control unit 21 has reached the broadcast end time of the program to be evaluated. It is determined whether or not (step S10). If the system control unit 21 determines that the end time has not arrived (step S10: NO), the process proceeds to step S3. On the other hand, when the system control unit 21 determines that the end time has come (step S10: YES), the system control unit 21 ends the terminal processing.

  FIG. 9 is a flowchart showing an example of the server process executed by the system control unit 11 of the server 1. The system control unit 11 starts server processing, for example, a predetermined time before the start of the broadcast of the program to be evaluated, according to the server program.

  First, the evaluation information / detection information receiving unit 112 determines whether a survey start notification has been received from any of the user terminals 2 (step S21). If the evaluation information / detection information receiving unit 112 determines that the investigation start notification has been received (step S21: YES), the process proceeds to step S22. In step S22, the evaluation information / detection information receiving unit 112 stores the viewing flag set to FALSE in the RAM 11c in association with the user ID received together with the investigation start notification. The viewing flag is information indicating whether the user views a program to be evaluated. Next, the evaluation information / detection information receiving unit 112 randomly determines, for example, one of the plurality of transmission timings determined in advance (step S23). The evaluation information / detection information receiving unit 112 transmits timing information indicating the determined transmission timing to the user terminal 2 that has transmitted the investigation start notification (step S24).

  In step S21, when the evaluation information / detection information receiving unit 112 determines that the survey start notification has not been received (step S21: NO), the process proceeds to step S25. In step S25, the evaluation information / detection information receiving unit 112 determines whether or not detection sound information has been received from any of the user terminals 2. If the evaluation information / detection information receiving unit 112 determines that the detection sound information has been received (step S25: YES), the process proceeds to step S26. In step S26, the comparison unit 113 calculates the degree of coincidence between the waveform information indicated by the received detection sound information and each waveform information included in the program information. The comparison unit 113 determines whether or not the calculated degree of coincidence exceeds the threshold value among the waveform information included in the program information. If the comparing unit 113 determines that there is waveform information whose degree of coincidence exceeds the threshold (YES in step S26), the viewing flag associated with the user ID received together with the detected sound information is set to TRUE (see FIG. Step S27). On the other hand, when the comparing unit 113 determines that there is no waveform information whose degree of coincidence exceeds the threshold (step S26: NO), the viewing flag associated with the user ID received together with the detected sound information is set to FALSE. (Step S28).

  In step S25, when the evaluation information / detection information receiving unit 112 determines that the detection sound information has not been received (step S25: NO), the process proceeds to step S29. In step S29, the evaluation information / detection information receiving unit 112 determines whether evaluation information has been received from any of the user terminals 2. If the evaluation information / detection information receiving unit 112 determines that the evaluation information has been received (step S29: YES), the process proceeds to step S30. In step S30, the evaluation information use determining unit 114 determines whether the viewing flag associated with the user ID received together with the evaluation information is TRUE. If the evaluation information use determining unit 114 determines that the viewing flag is TRUE (step S30: YES), the process proceeds to step S31. In step S31, the evaluation information use determining unit 114 sets the input time of the received evaluation information as the reception time of the evaluation information. Next, the evaluation information use determining unit 114 associates the evaluation information, the input time, and the user ID, and stores them in the storage unit 14 (step S32). On the other hand, when it is determined that the viewing information flag is FALSE (step S30: NO), the evaluation information use determining unit 114 discards the received evaluation information (step S33).

  When step S24, S27, S28, S32 or S33 is completed, or when it is determined that the evaluation information is not received in step S29 (step S29: NO), the evaluation unit 115 determines that the broadcast end time of the program to be evaluated Is judged (step S34). If the evaluation unit 115 determines that the end time has not arrived (step S34: NO), the process proceeds to step S21. On the other hand, when the evaluation unit 115 determines that the end time has come (step S34: YES), the evaluation unit 115 executes program evaluation processing using the evaluation information (step S35). The evaluation unit 115 counts and analyzes the evaluation information stored in the storage unit 14. For example, the evaluation unit 115 may calculate, for example, the transition of the evaluation number for each evaluation item or determine the ranking of the time having a large number of evaluations using the input time. The evaluation unit 115 generates a report indicating the evaluation result and stores the report in the storage unit 14. When the evaluation process is finished, the evaluation unit 115 ends the server process.

  As described above, according to the present embodiment, the user terminal 2 detects the sound output from the television receiver 4 that outputs the video and the sound constituting the program. In addition, the user terminal 2 transmits, to the server 1, the evaluation information input by the user and the detected sound information indicating the detected sound. The server 1 acquires program sound information indicating sounds constituting a program. Further, the server 1 receives the evaluation information and the detected sound information from the user terminal 2. Further, the server 1 compares the acquired program sound information with the received detected sound information. Further, the server 1 selects to use the received evaluation information for the evaluation of the program when there is a predetermined match between the program sound information and the received detected sound information according to the comparison result. Therefore, it is possible to estimate whether the user is actually viewing the program to be evaluated. Therefore, only the evaluation information estimated that the user is watching the program can be used for the evaluation of the program. Therefore, it is possible to secure the reliability of the evaluation information.

  Also, the content may be content of a broadcast program. Further, at least one of the evaluation information and the detected sound information by the at least one user terminal 2 among the plurality of user terminals 2 during the broadcast of the program, the server 1 transmits the other timing among the plurality of user terminals 2. The transmission timing may be determined for each of the plurality of user terminals 2 so as to be different from the transmission timing by at least one user terminal 2. Further, the server 1 may transmit timing information indicating the determined transmission timing to each of the plurality of user terminals 2. Each user terminal 2 may receive timing information from the server 1. Also, each user terminal 2 may transmit at least one of the evaluation information and the detected sound information according to the transmission timing indicated by the received timing information. In this case, even if detection sound information is transmitted from each of the plurality of user terminals 2 to the server 1 during broadcast of a program, transmission timings of at least one of the evaluation information and the detection sound information are dispersed into a plurality. Ru. Therefore, it is possible to suppress the processing loads on the server 1 from being concentrated at the same time and to distribute the load.

  Also, the server 1 may determine the transmission timing by the at least one other user terminal 2 during the transmission timing interval by the at least one user terminal 2 in the plurality of user terminals 2. In this case, since the number of detection information received by the server 1 per unit time is equalized, the processing load of the server device can be further dispersed.

  Alternatively, the user terminal 2 may repeatedly detect a sound and transmit detection sound information at predetermined time intervals. Among the detection sound information repeatedly received at predetermined time intervals, the server 1 detects sound information indicating a sound detected by the user terminal 2 before or after the input time of the evaluation information. Whether to use the evaluation information for the evaluation of the program may be determined based at least on the comparison result with the program sound information. In this case, even in a mode in which the user terminal 2 periodically performs sound detection and detection sound information transmission, it is possible to improve the estimation accuracy as to whether the user is watching a program at the time of inputting the evaluation information. it can.

  Further, among the detected sound information periodically received by the server 1, comparison between two or more detected sound information and program sound information respectively indicating a sound detected at a time relatively close to the input time of the evaluation information Based on the result, it may be determined whether the evaluation information is to be used for the evaluation of the program. In this case, it is possible to further increase the estimation accuracy as to whether the user is watching a program at the time of inputting the evaluation information.

  Also, the user terminal 2 may detect a sound when the evaluation information is input. The server 1 may determine to use the evaluation information received together with the detected sound information for the evaluation of the program when the program sound information has a portion determined to match the detected sound information. In this case, it is possible to increase the estimation accuracy as to whether the user is watching a program at the time of inputting the evaluation information.

[2. Second embodiment]

[2-1. Functional overview]

  Next, functional outlines of the system control unit 11 of the server 1 and the system control unit 21 of the user terminal 2 in the second embodiment will be described using FIG. In the present embodiment, the user terminal 2 detects a sound at the timing when the evaluation information is input and acquires detection sound information. The transmission timing of the evaluation information and the detection sound information may be at the time when the detection sound information is detected or may be periodic.

  The server 1 specifies the time when the evaluation information is input to the user terminal 2 based on the detected sound information. When the program sound information has a portion determined to match the detected sound information, the evaluation information use determining unit 114 determines that the evaluation information received from the user terminal 2 together with the detected sound information is used for the evaluation of the program. . At this time, the evaluation information utilization determining unit 114 receives the output time (broadcast time) by the television receiver 4 of the sound indicated by the portion determined to match the detection information in the program to be evaluated together with the detection sound information. It may be specified as the input time of evaluation information. This time may be an absolute time or may be a relative time from the broadcast start time. Thereby, it is possible to evaluate a program using a highly accurate input time. This input time specifying method is also effective for on-demand distribution in which the distribution time zone is not predetermined.

  For example, a feature amount of sound may be used for the matching determination in the server 1, but feature amount specifying information capable of specifying the feature amount may be used. The feature amount specifying information is information having a smaller amount of information than the feature amount. The feature amount specifying information basically differs for each feature amount in at least one program. When there are a plurality of programs to be evaluated, it is preferable that the feature amount specifying information be different among the programs. The feature amount specifying information may be, for example, a hash value indicating a summary of the feature amount, or may be identification information provided to the feature amount based on a predetermined standard. Alternatively, the feature amount specifying information may include the broadcast time of the sound corresponding to the feature amount. Note that instead of the feature amount and the feature amount specifying information, waveform information and information that can specify the waveform information and that has a smaller amount of information than the waveform information may be used.

  In the following, the case where the hash value of the feature amount is used as the feature amount specifying information will be described. FIG. 10 is a diagram showing an example of an outline of processing in the program evaluation system S. The program information acquisition unit 111 is configured to use time series of feature amounts of program sound from voice data of a program acquired via the network NW before broadcasting of a program to be evaluated is started. Generate series data. In other words, audio data of a program is divided into a plurality of parts and arranged in time series, and stored in the storage unit 24 in a state of being converted into feature amounts. Also, the program information acquisition unit 111 converts the generated feature amount time-series data into specific information time-series data. For example, the program information acquisition unit 111 generates a hash value of each feature amount of the feature amount time-series data using a predetermined hash function. Then, the program information acquisition unit 111 generates, as program sound information, specific information time-series data composed of time series of hash values and causes the storage unit 14 to store the generated information. In the program sound information, each hash value may be associated with the time when the sound corresponding to the hash value is broadcasted in the program to be evaluated.

  The user terminal 2 acquires feature amount time-series data in advance as program sound feature amount information. For example, the user operates the user terminal 2 before the broadcast of the program to be evaluated is started, and enters the program survey in advance. When receiving the notification of the entry from the user terminal 2, the server 1 transmits the program sound feature amount information. The user terminal 2 stores program sound feature amount information in the storage unit 24.

  During the broadcast of a program to be evaluated, the user inputs evaluation information to the user terminal 2. At this time, the detection information acquisition unit 212 causes the microphone 28 to detect a sound and receives an audio signal from the microphone 28. The detection information acquisition unit 212 extracts the feature amount from the audio signal, compares the feature amount with each feature amount in the program sound feature amount information, and calculates the degree of coincidence. If there is a feature amount whose degree of coincidence exceeds a predetermined threshold value in the program sound feature amount information, the detection information acquisition unit 212 hashes the hash value of the feature amount the same as the hash function used by the server 1 It is generated by a function (for example, included in a program evaluation application). The detection information acquisition unit 212 acquires this hash value as detection sound information. The evaluation information / detection information transmission unit 213 transmits a hash value as detection sound information to the server 1 together with the evaluation information.

  The comparison unit 113 of the server 1 compares the detected sound information received from the user terminal 2 with each time-series hash value of the hash value as the program sound information. As a result of comparison, when there is a hash value that matches the detected sound information in the time series of hash values, the evaluation information / detection information transmission unit 213 determines that the evaluation information is to be used for evaluation of the program. The evaluation information / detection information transmission unit 213 specifies, as an input time of the evaluation information, a time at which a sound corresponding to the hash value matching the detection sound information is broadcast in the program to be evaluated. By using the feature amount specifying information such as the hash value, the accuracy of the input time used for the evaluation can be enhanced, and the communication amount between the server 1 and the user terminal 2 during the broadcast of the program can be reduced. The reduction of the communication amount is realized by reduction of the information amount of the detected sound information by replacing the detected sound information with the feature amount specifying information. In addition, when the sound detected by the microphone 28 and the sound of the program do not match, the user terminal 2 does not have to transmit either the detected sound information or the evaluation information to the server 1, so the number of times of communication is reduced. Ru.

  For example, in FIG. 10, the user terminal 2 determines that the feature amount 102 in the program sound feature amount information matches the detected sound information. Therefore, the user terminal 2 transmits the hash value of the feature amount 102 to the server 1. On the server 1 side, the hash value 102 originally generated from the feature amount 102 in the program sound information matches the hash value received from the user terminal 2. Therefore, time T102 associated with the hash value 102 is the input time of the evaluation information.

[2-2. Operation of program evaluation system]

  Next, the operation of the program evaluation system S will be described with reference to FIGS. In the operation example described below, the user terminal 2 transmits detection sound information to the server 1 together with the evaluation information at the timing when the evaluation information is input. Further, it is assumed that the user terminal 2 acquires program sound feature amount information in advance and stores the information in the storage unit 24.

  FIG. 11 is a flowchart showing an example of terminal processing performed by the system control unit 21 of the user terminal 2. In FIG. 11, the same processing as that of FIG. 8 is denoted by the same reference numeral.

  First, the evaluation information acquisition unit 211 determines whether evaluation information has been input (step S8). If the evaluation information acquisition unit 211 determines that the evaluation information has been input (step S8: YES), the process proceeds to step S4. In step S4, the detection information acquisition unit 212 causes the microphone 28 to detect a sound. Next, the detection information acquisition unit 212 extracts a feature amount from the audio signal output from the microphone 28 (step S41). Next, the detection information acquisition unit 212 compares the generated feature amount with each feature amount in the program sound feature amount information. The evaluation information acquisition unit 211 determines whether a feature amount whose degree of coincidence with the generated feature amount exceeds a threshold value exists in the program sound feature amount information (step S42). If the detection information acquisition unit 212 determines that there is a feature amount whose degree of coincidence exceeds the threshold (step S42: YES), the process proceeds to step S43. In step S43, the detection information acquisition unit 212 generates a hash value of the feature quantity whose match degree is the largest among the feature quantities whose match degree of the generated feature quantity exceeds the threshold in the program sound feature quantity information. . Next, the evaluation information / detection information transmission unit 213 transmits the evaluation information and the generated hash value to the server 1 together with the user ID (step S44).

  When step S44 is finished, when it is determined that the evaluation information is not input in step S8 (step S8: NO), or when it is determined that no feature amount whose degree of coincidence exceeds the threshold value exists in step S42 ( Step S42: NO) The system control unit 21 determines whether the broadcast end time of the program to be evaluated has arrived (Step S10). If the system control unit 21 determines that the end time has not arrived (step S10: NO), the process proceeds to step S8. On the other hand, when the system control unit 21 determines that the end time has come (step S10: YES), the system control unit 21 ends the terminal processing.

  FIG. 12 is a flowchart showing an example of the server process executed by the system control unit 11 of the server 1. In FIG. 12, the same processes as in FIG. 9 are denoted by the same reference numerals.

  First, the evaluation information / detection information receiving unit 112 determines whether evaluation information and a hash value have been received from any of the user terminals 2 (step S51). If the evaluation information / detection information receiving unit 112 determines that the evaluation information and the hash value have been received (step S51: YES), the process proceeds to step S52. In step S52, the comparison unit 52 determines whether there is a hash value matching the received hash value in the program sound information. If the evaluation information / detection information receiving unit 112 determines that there is a hash value that matches the received hash value (step S52: YES), the process proceeds to step S53. In step S53, the evaluation information use determining unit 114 sets the input time of the received evaluation information to the broadcast time associated with the hash value that matches the received hash value. Next, the evaluation information use determining unit 114 associates the evaluation information, the input time, and the user ID, and stores them in the storage unit 14 (step S32). On the other hand, when it is determined that there is no hash value that matches the received hash value (step S52: NO), the evaluation information use determining unit 114 discards the received evaluation information (step S33).

  When step S32 or S32 is finished, or when it is determined that the evaluation information and the hash value are not received in step S51 (step S51: NO), the evaluation unit 115 has reached the broadcast end time of the program to be evaluated. It is determined whether or not (step S34). If the evaluation unit 115 determines that the end time has not arrived (step S34: NO), the process proceeds to step S51. On the other hand, when the evaluation unit 115 determines that the end time has arrived (step S34: YES), the evaluation unit 115 executes program evaluation processing using the evaluation information (step S35), and ends the server processing.

  As described above, according to the present embodiment, the output time by the television receiver 4 of the sound indicated by the portion of the program sound information determined by the server 1 to match the detected sound information is detected sound information As the input time of the evaluation information received together with the Therefore, since it is possible to appropriately specify which scene of the program the evaluation information is input to, it is possible to perform an appropriate evaluation on the program.

  In addition, the server 1 may acquire, as program sound information, a time series of feature amount specifying information that specifies each of the feature amounts in the time series of the feature amounts of the sound constituting the content of the program. The user terminal 2 may obtain in advance program sound feature amount information indicating a time series of sound feature amounts. In addition, when there is a feature amount whose degree of coincidence with the detected feature amount of the sound exceeds the threshold value in the program sound feature amount information, the user terminal 2 specifies the feature amount specifying feature amount May be transmitted as detection sound information. The server 1 specifies, as the input time of the evaluation information, the output time by the television receiver 4 of the sound corresponding to the feature amount specifying information matching the feature amount specifying information received from the user terminal 2 among the program sound information. May be In this case, since the amount of detected sound information is reduced, the communication load on the user terminal 2 and the server 1 can be reduced.

1 server 2 user terminal 11 system control unit 12 system bus 13 input / output interface 14 storage unit 15 communication unit 111 program information acquisition unit 112 evaluation information / detection information reception unit 113 comparison unit 114 evaluation information use determination unit 115 evaluation unit 21 system control Unit 22 System bus 23 Input / output interface 24 Storage unit 25 Communication unit 26 Operation input unit 27 Display unit 28 Microphone 29 Camera 211 Evaluation information acquisition unit 212 Detection information acquisition unit 213 Information evaluation information / detection information transmission unit NW Network

Claims (29)

In an evaluation system including a terminal device and a server device connected to the terminal device via a network,
The terminal device is
An input unit through which a user inputs evaluation information on content composed of at least one of video and sound;
A detection unit that detects the video or sound output by an output device that outputs at least one of the video and the sound, which constitutes the content;
Transmission means for transmitting the input evaluation information and detection information indicating the detected video or sound to the server device;
Equipped with
The server device is
An acquisition unit configured to acquire content information indicating the video or the sound, which constitutes the content;
Receiving means for receiving the evaluation information and the detection information from the terminal device;
Comparing means for comparing the acquired content information with the received detection information;
Selecting means for selecting the received evaluation information to be used for evaluation of the content when there is a predetermined match between the content information and the detection information according to the comparison result by the comparison means;
Equipped with
The detection means and the transmission means repeatedly detect the image or the sound at predetermined time intervals, and transmit the detection information.
The selection means is detected by the terminal device at a time closest to the input time before or after the input time of the evaluation information among the detection information repeatedly received by the reception means at the predetermined time intervals. The evaluation system is characterized in that the selection is performed based at least on the comparison result of the detection information indicating the video or sound and the content information . The selection means is at least two of the detection information repeatedly received at predetermined time intervals by the reception means, each indicating video or sound detected at a time relatively close to the input time of the evaluation information. The evaluation system according to claim 1, wherein the selection is performed based on a comparison result of the detection information and the content information. In an evaluation system including a terminal device and a server device connected to the terminal device via a network,
The terminal device is
An input unit through which a user inputs evaluation information on content composed of at least one of video and sound;
A detection unit that detects the video or sound output by an output device that outputs at least one of the video and the sound, which constitutes the content;
Transmission means for transmitting the input evaluation information and detection information indicating the detected video or sound to the server device;
Equipped with
The server device is
An acquisition unit configured to acquire content information indicating the video or the sound, which constitutes the content;
Receiving means for receiving the evaluation information and the detection information from the terminal device;
Comparing means for comparing the acquired content information with the received detection information;
Selecting means for selecting the received evaluation information to be used for evaluation of the content when there is a predetermined match between the content information and the detection information according to the comparison result by the comparison means;
Equipped with
The detection unit and the transmission unit detect the video or the sound when the evaluation information is input, and simultaneously detect the detection information indicating the detected video or sound as the evaluation information. Send to
The selection means is characterized in that, when the content information has a portion determined to be coincident with the detection information, the selection means selects the evaluation information received simultaneously with the detection information to be used for evaluation of the content. Evaluation system. In an evaluation system including a terminal device and a server device connected to the terminal device via a network,
The terminal device is
An input unit through which a user inputs evaluation information on content composed of at least one of video and sound;
A detection unit that detects the video or sound output by an output device that outputs at least one of the video and the sound, which constitutes the content;
Transmission means for transmitting the input evaluation information and detection information indicating the detected video or sound to the server device;
Equipped with
The server device is
An acquisition unit configured to acquire content information indicating the video or the sound, which constitutes the content;
Receiving means for receiving the evaluation information and the detection information from the terminal device;
Comparing means for comparing the acquired content information with the received detection information;
Selecting means for selecting the received evaluation information to be used for evaluation of the content when there is a predetermined match between the content information and the detection information according to the comparison result by the comparison means;
Equipped with
The detection means and the transmission means detect the video or the sound when the evaluation information is input, and transmit the detection information together with the evaluation information to the server device.
When the content information has a portion determined to be coincident with the detection information, the selection means selects the evaluation information received together with the detection information to be used for evaluation of the content, and Among them, an output time by the output device of the video or sound indicated by the portion determined to match the detection information is specified as an input time of the evaluation information received together with the detection information. system. The acquisition means is a specific information time series constituted by a time series of specific information converted from feature information time series data constituted by a time series of the video constituting the content or the characteristic information indicating the characteristic of the sound It is data, The corresponding feature information can be specified based on each of the specific information, and the amount of information of each of the specific information is smaller than the amount of information of the corresponding feature information. , Acquired as the content information,
The terminal device is
Feature information time-series data acquisition means for acquiring the feature information time-series data in advance;
Extracting means for extracting feature information indicating features of the detected video or sound;
  Among the feature information included in the obtained feature information time-series data, it is specific information for identifying feature information whose degree of coincidence with the extracted feature information exceeds a predetermined value, Generation means for generating specific information of an amount of information smaller than the amount of information;
And further
The transmission means transmits the generated specific information as the detection information.
The selection means specifies, as the input time, the output time corresponding to specific information matching the specific information received as the detection information among the specific information included in the feature information time-series data. The evaluation system according to claim 4, characterized by The evaluation system according to claim 5, wherein the specific information is a hash value of the feature information. The content is content to be broadcast,
During broadcasting of the content, the evaluation information and the detection information are transmitted from the plurality of terminal devices as the terminal device to the server device,
The server device is
The transmission timing of at least one of the evaluation information and the detection information by at least one of the plurality of terminal devices is different from the transmission timing of at least one of the plurality of terminal devices. Thus, timing determination means for determining the transmission timing for each of the plurality of terminal devices;
Timing information transmitting means for transmitting timing information indicating the determined transmission timing to each of the plurality of terminal devices;
And further
The terminal device is
It further comprises timing information receiving means for receiving the timing information from the server device,
The evaluation system according to any one of claims 1 to 6, wherein the transmission means transmits at least one of the evaluation information and the detection information according to the received timing information. The evaluation system according to claim 7, wherein the timing information transmission means determines transmission timings by the at least one other terminal device during a transmission timing interval by the at least one terminal device. In the server device
An acquisition unit configured to acquire content information indicating the video or the sound, the content being configured by at least one of video and sound;
From the terminal device that receives evaluation information on the content and is configured by the user and detects an image or sound output from an output device that outputs at least one of the image and the sound, which constitutes the content, the evaluation Receiving means for receiving information and detection information indicative of the detected video or sound;
Comparing means for comparing the acquired content information with the received detection information;
Selecting means for selecting the received evaluation information to be used for evaluation of the content when there is a predetermined match between the content information and the detection information according to the comparison result by the comparison means;
Equipped with
The terminal device repeatedly detects the video or the sound at predetermined time intervals, and transmits the detection information to the server device.
The selection means is detected by the terminal device at a time closest to the input time before or after the input time of the evaluation information among the detection information repeatedly received by the reception means at the predetermined time intervals. The server apparatus characterized in that the selection is performed based on at least a comparison result of the detection information indicating the video or sound and the content information. In the server device
An acquisition unit configured to acquire content information indicating the video or the sound, the content being configured by at least one of video and sound;
From the terminal device that receives evaluation information on the content and is configured by the user and detects an image or sound output from an output device that outputs at least one of the image and the sound, which constitutes the content, the evaluation Receiving means for receiving information and detection information indicative of the detected video or sound;
Comparing means for comparing the acquired content information with the received detection information;
Selecting means for selecting the received evaluation information to be used for evaluation of the content when there is a predetermined match between the content information and the detection information according to the comparison result by the comparison means;
Equipped with
The terminal device detects the video or the sound when the evaluation information is input, and transmits the detection information indicating the detected video or sound to the server device simultaneously with the evaluation information.
The selection means is characterized in that, when the content information has a portion determined to be coincident with the detection information, the selection means selects the evaluation information received simultaneously with the detection information to be used for evaluation of the content. Server device. In the server device
An acquisition unit configured to acquire content information indicating the video or the sound, the content being configured by at least one of video and sound;
From the terminal device that receives evaluation information on the content and is configured by the user and detects an image or sound output from an output device that outputs at least one of the image and the sound, which constitutes the content, the evaluation Receiving means for receiving information and detection information indicative of the detected video or sound;
Comparing means for comparing the acquired content information with the received detection information;
  Selecting means for selecting the received evaluation information to be used for evaluation of the content when there is a predetermined match between the content information and the detection information according to the comparison result by the comparison means;
Equipped with
The terminal device detects the video or the sound when the evaluation information is input, and transmits the detection information to the server device together with the evaluation information.
When the content information has a portion determined to be coincident with the detection information, the selection means selects the evaluation information received together with the detection information to be used for evaluation of the content, and A server characterized by specifying, as the input time of the evaluation information received together with the detection information, an output time by the output device of the video or sound indicated by the portion determined to match the detection information. apparatus. In the terminal device
An input unit through which a user inputs evaluation information on content composed of at least one of video and sound;
A detection unit that detects the video or sound output by an output device that outputs at least one of the video and the sound, which constitutes the content;
The input evaluation information and detection information indicating the detected video or sound, the content information indicating at least one of the video and the sound, which constitutes the content, and the detection information A transmitting unit that transmits the evaluation information to a server apparatus that selects the evaluation information to be used for the evaluation of the content if there is a predetermined match between the content information and the detection information according to the comparison result;
Equipped with
The detection means and the transmission means repeatedly detect the image or the sound at predetermined time intervals, and transmit the detection information.
The server apparatus is detected by the terminal apparatus at a time closest to the input time before or after an input time of the evaluation information among the detection information repeatedly received from the terminal apparatus at predetermined time intervals. The terminal device is characterized in that the selection is performed based at least on the comparison result of the detection information indicating the video or sound and the content information. In the terminal device
An input unit through which a user inputs evaluation information on content composed of at least one of video and sound;
A detection unit that detects the video or sound output by an output device that outputs at least one of the video and the sound, which constitutes the content;
The input evaluation information and detection information indicating the detected video or sound, the content information indicating at least one of the video and the sound, which constitutes the content, and the detection information A transmitting unit that transmits the evaluation information to a server apparatus that selects the evaluation information to be used for the evaluation of the content if there is a predetermined match between the content information and the detection information according to the comparison result;
Equipped with
The detection unit and the transmission unit detect the video or the sound when the evaluation information is input, and simultaneously detect the detection information indicating the detected video or sound as the evaluation information. Send to
The server device selects the evaluation information received simultaneously with the detection information from the terminal device to be used for evaluation of the content when the content information has a portion determined to match the detection information. A terminal device characterized by In the terminal device
An input unit through which a user inputs evaluation information on content composed of at least one of video and sound;
A detection unit that detects the video or sound output by an output device that outputs at least one of the video and the sound, which constitutes the content;
The input evaluation information and detection information indicating the detected video or sound, the content information indicating at least one of the video and the sound, which constitutes the content, and the detection information A transmitting unit that transmits the evaluation information to a server apparatus that selects the evaluation information to be used for the evaluation of the content if there is a predetermined match between the content information and the detection information according to the comparison result;
Equipped with
The detection means and the transmission means detect the video or the sound when the evaluation information is input, and transmit the detection information together with the evaluation information to the server device.
When the content information has a portion determined to be coincident with the detection information, the server device selects the evaluation information received from the terminal device together with the detection information to be used for evaluation of the content. In the content information, the output time of the video or sound indicated by the portion determined to match the detection information by the output device is specified as the input time of the evaluation information received together with the detection information. Terminal device to be characterized. In an information processing method in an evaluation system including a terminal device and a server device connected to the terminal device via a network,
An acquisition step of acquiring content information indicating the video or the sound, the server device configuring the content including at least one of video and sound;
An evaluation information acquisition step in which the terminal device acquires evaluation information on the content input by a user to input means provided in the terminal device;
A detection step of detecting the video or the sound output by the output device which outputs the at least one of the video and the sound, the terminal device constituting the content;
A transmitting step in which the terminal device transmits the acquired evaluation information and detection information indicating the detected video or sound to the server device;
A receiving step in which the server device receives the evaluation information and the detection information from the terminal device;
A comparison step in which the server device compares the acquired content information with the received detection information;
The server apparatus is selected to use the received evaluation information for evaluation of the content when the comparison result in the comparison step indicates that there is a predetermined match between the content information and the detection information. Selection step to
Including
The detecting step and the transmitting step repeatedly detect the video or the sound at predetermined time intervals and transmit the detection information.
The selection step is detected by the terminal device at a time closest to the input time before or after the input time of the evaluation information among the detection information repeatedly received with the predetermined time interval by the reception step. An information processing method characterized in that the selection is performed based on at least a comparison result of the detection information indicating the video or sound and the content information; In an information processing method in an evaluation system including a terminal device and a server device connected to the terminal device via a network,
An acquisition step of acquiring content information indicating the video or the sound, the server device configuring the content including at least one of video and sound;
An evaluation information acquisition step in which the terminal device acquires evaluation information on the content input by a user to input means provided in the terminal device;
A detection step of detecting the video or the sound output by the output device which outputs the at least one of the video and the sound, the terminal device constituting the content;
A transmitting step in which the terminal device transmits the acquired evaluation information and detection information indicating the detected video or sound to the server device;
A receiving step in which the server device receives the evaluation information and the detection information from the terminal device;
A comparison step in which the server device compares the acquired content information with the received detection information;
The server apparatus is selected to use the received evaluation information for evaluation of the content when the comparison result in the comparison step indicates that there is a predetermined match between the content information and the detection information. Selection step to
Including
The detection step and the transmission step detect the video or the sound when the evaluation information is input, and the server apparatus detects the detection information indicating the detected video or sound at the same time as the evaluation information. Send to
The selection step is characterized in that, when the content information has a portion determined to be coincident with the detection information, the evaluation information received simultaneously with the detection information is selected to be used for evaluation of the content. Information processing method. In an information processing method in an evaluation system including a terminal device and a server device connected to the terminal device via a network,
An acquisition step of acquiring content information indicating the video or the sound, the server device configuring the content including at least one of video and sound;
An evaluation information acquisition step in which the terminal device acquires evaluation information on the content input by a user to input means provided in the terminal device;
A detection step of detecting the video or the sound output by the output device which outputs the at least one of the video and the sound, the terminal device constituting the content;
A transmitting step in which the terminal device transmits the acquired evaluation information and detection information indicating the detected video or sound to the server device;
A receiving step in which the server device receives the evaluation information and the detection information from the terminal device;
A comparison step in which the server device compares the acquired content information with the received detection information;
The server apparatus is selected to use the received evaluation information for evaluation of the content when the comparison result in the comparison step indicates that there is a predetermined match between the content information and the detection information. Selection step to
Including
The detection step and the transmission step detect the video or the sound when the evaluation information is input, and transmit the detection information together with the evaluation information to the server device.
In the selection step, when the content information includes a portion determined to match the detection information, the evaluation information received together with the detection information is selected to be used for the evaluation of the content, and Information characterized by specifying, as the input time of the evaluation information received together with the detection information, the output time of the video or sound indicated by the portion determined to match the detection information, among the information or the sound Processing method. In an information processing method executed by a computer of a server device,
An acquisition step of acquiring content information indicating the video or the sound, which constitutes content configured of at least one of video and sound;
From the terminal device that receives evaluation information on the content and is configured by the user and detects an image or sound output from an output device that outputs at least one of the image and the sound, which constitutes the content, the evaluation Receiving information and detection information indicative of the detected video or sound;
Comparing the acquired content information with the received detection information;
A selection step of selecting the received evaluation information to be used for evaluation of the content when there is a predetermined match between the content information and the detection information according to the comparison result in the comparison step;
Including
The terminal device repeatedly detects the video or the sound at predetermined time intervals and transmits the detection information.
The selection step is detected by the terminal device at a time closest to the input time before or after the input time of the evaluation information among the detection information repeatedly received with the predetermined time interval by the reception step. An information processing method characterized in that the selection is performed based on at least a comparison result of the detection information indicating the video or sound and the content information; In an information processing method executed by a computer of a server device,
An acquisition step of acquiring content information indicating the video or the sound, which constitutes content configured of at least one of video and sound;
From the terminal device that receives evaluation information on the content and is configured by the user and detects an image or sound output from an output device that outputs at least one of the image and the sound, which constitutes the content, the evaluation Receiving information and detection information indicative of the detected video or sound;
Comparing the acquired content information with the received detection information;
A selection step of selecting the received evaluation information to be used for evaluation of the content when there is a predetermined match between the content information and the detection information according to the comparison result in the comparison step;
Including
The terminal device detects the video or the sound when the evaluation information is input, and transmits the detection information indicating the detected video or sound to the server device simultaneously with the evaluation information.
The selection step is characterized in that, when the content information has a portion determined to be coincident with the detection information, the evaluation information received simultaneously with the detection information is selected to be used for evaluation of the content. Information processing method. In an information processing method executed by a computer of a server device,
An acquisition step of acquiring content information indicating the video or the sound, which constitutes content configured of at least one of video and sound;
From the terminal device that receives evaluation information on the content and is configured by the user and detects an image or sound output from an output device that outputs at least one of the image and the sound, which constitutes the content, the evaluation Receiving information and detection information indicative of the detected video or sound;
Comparing the acquired content information with the received detection information;
A selection step of selecting the received evaluation information to be used for evaluation of the content when there is a predetermined match between the content information and the detection information according to the comparison result in the comparison step;
Including
The terminal device detects the video or the sound when the evaluation information is input, and transmits the detection information to the server device together with the evaluation information.
In the selection step, when the content information includes a portion determined to match the detection information, the evaluation information received together with the detection information is selected to be used for the evaluation of the content, and Information characterized by specifying, as the input time of the evaluation information received together with the detection information, the output time of the video or sound indicated by the portion determined to match the detection information, among the information or the sound Processing method. In the information processing method executed by the computer of the terminal device,
An evaluation information acquisition step of acquiring evaluation information on content composed of at least one of video and sound input by a user to input means included in the terminal device;
A detection step of detecting video or sound output by an output device that outputs at least one of the video and the sound, which constitutes the content;
The acquired evaluation information and detection information indicating the detected video or sound, the content information indicating at least one of the video and the sound, which constitutes the content, and the detection information A transmitting step of transmitting the evaluation information to the server apparatus which selects to use the evaluation of the content if the comparison result indicates that a predetermined match exists between the content information and the detection information;
Including
The detecting step and the transmitting step repeatedly detect the video or the sound at predetermined time intervals and transmit the detection information.
The server apparatus is detected by the terminal apparatus at a time closest to the input time before or after an input time of the evaluation information among the detection information repeatedly received from the terminal apparatus at predetermined time intervals. An information processing method characterized in that the selection is performed based on at least a comparison result of the detection information indicating the video or sound and the content information; In the information processing method executed by the computer of the terminal device,
An evaluation information acquisition step of acquiring evaluation information on content composed of at least one of video and sound input by a user to input means included in the terminal device;
A detection step of detecting video or sound output by an output device that outputs at least one of the video and the sound, which constitutes the content;
The acquired evaluation information and detection information indicating the detected video or sound, the content information indicating at least one of the video and the sound, which constitutes the content, and the detection information A transmitting step of transmitting the evaluation information to the server apparatus which selects to use the evaluation of the content if the comparison result indicates that a predetermined match exists between the content information and the detection information;
Including
The detection step and the transmission step detect the video or the sound when the evaluation information is input, and the server apparatus detects the detection information indicating the detected video or sound at the same time as the evaluation information. Send to
The server device selects the evaluation information received simultaneously with the detection information from the terminal device to be used for evaluation of the content when the content information has a portion determined to match the detection information. An information processing method characterized by In the information processing method executed by the computer of the terminal device,
An evaluation information acquisition step of acquiring evaluation information on content composed of at least one of video and sound input by a user to input means included in the terminal device;
A detection step of detecting video or sound output by an output device that outputs at least one of the video and the sound, which constitutes the content;
The acquired evaluation information and detection information indicating the detected video or sound, the content information indicating at least one of the video and the sound, which constitutes the content, and the detection information A transmitting step of transmitting the evaluation information to the server apparatus which selects to use the evaluation of the content if the comparison result indicates that a predetermined match exists between the content information and the detection information;
Including
The detection step and the transmission step detect the video or the sound when the evaluation information is input, and transmit the detection information together with the evaluation information to the server device.
When the content information has a portion determined to be coincident with the detection information, the server device selects the evaluation information received from the terminal device together with the detection information to be used for evaluation of the content. In the content information, the output time of the video or sound indicated by the portion determined to match the detection information by the output device is specified as the input time of the evaluation information received together with the detection information. Characteristic information processing method. In the information processing program executed by the computer of the server device,
The computer,
An acquisition unit configured to acquire content information indicating the video or the sound, the content being configured by at least one of video and sound;
From the terminal device that receives evaluation information on the content and is configured by the user and detects an image or sound output from an output device that outputs at least one of the image and the sound, which constitutes the content, the evaluation Receiving means for receiving information and detection information indicative of the detected video or sound;
Comparing means for comparing the acquired content information with the received detection information;
Selecting means for selecting the received evaluation information to be used for evaluation of the content when there is a predetermined match between the content information and the detection information according to the comparison result by the comparison means;
To act as
The terminal device repeatedly detects the video or the sound at predetermined time intervals, and transmits the detection information to the server device.
The selection means is detected by the terminal device at a time closest to the input time before or after the input time of the evaluation information among the detection information repeatedly received by the reception means at the predetermined time intervals. An information processing program characterized in that the selection is performed based on at least a comparison result of the detection information indicating the video or sound and the content information. In the information processing program executed by the computer of the server device,
The computer,
An acquisition unit configured to acquire content information indicating the video or the sound, the content being configured by at least one of video and sound;
From the terminal device that receives evaluation information on the content and is configured by the user and detects an image or sound output from an output device that outputs at least one of the image and the sound, which constitutes the content, the evaluation Receiving means for receiving information and detection information indicative of the detected video or sound;
Comparing means for comparing the acquired content information with the received detection information;
Selecting means for selecting the received evaluation information to be used for evaluation of the content when there is a predetermined match between the content information and the detection information according to the comparison result by the comparison means;
To act as
The terminal device detects the video or the sound when the evaluation information is input, and transmits the detection information indicating the detected video or sound to the server device simultaneously with the evaluation information.
The selection means is characterized in that, when the content information has a portion determined to be coincident with the detection information, the selection means selects the evaluation information received simultaneously with the detection information to be used for evaluation of the content. Information processing program. In the information processing program executed by the computer of the server device,
The computer,
An acquisition unit configured to acquire content information indicating the video or the sound, the content being configured by at least one of video and sound;
From the terminal device that receives evaluation information on the content and is configured by the user and detects an image or sound output from an output device that outputs at least one of the image and the sound, which constitutes the content, the evaluation Receiving means for receiving information and detection information indicative of the detected video or sound;
Comparing means for comparing the acquired content information with the received detection information;
Selecting means for selecting the received evaluation information to be used for evaluation of the content when there is a predetermined match between the content information and the detection information according to the comparison result by the comparison means;
To act as
The terminal device detects the video or the sound when the evaluation information is input, and transmits the detection information to the server device together with the evaluation information.
When the content information has a portion determined to be coincident with the detection information, the selection means selects the evaluation information received together with the detection information to be used for evaluation of the content, and Information characterized by specifying, as the input time of the evaluation information received together with the detection information, the output time of the video or sound indicated by the portion determined to match the detection information, among the information or the sound Processing program. In the information processing program executed by the computer of the terminal device,
The computer,
Evaluation information acquisition means for acquiring evaluation information on content composed of at least one of video and sound input by a user to input means included in the terminal device;
Detection for acquiring detection information indicating the detected video or sound from detection means for detecting video or sound output by an output device that outputs at least one of the video and the sound that constitutes the content Information acquisition means,
The comparison between the acquired evaluation information and the acquired detection information is the comparison result of the detection information and content information indicating at least one of the video and the sound, which constitute the content. A transmitting unit that transmits the evaluation information to a server apparatus that selects to use the evaluation of the content when there is a predetermined match between the content information and the detection information;
To act as
The detection means and the transmission means repeatedly detect the image or the sound at predetermined time intervals, and transmit the detection information.
The server apparatus is detected by the terminal apparatus at a time closest to the input time before or after an input time of the evaluation information among the detection information repeatedly received from the terminal apparatus at predetermined time intervals. An information processing program characterized in that the selection is performed based on at least a comparison result of the detection information indicating the video or sound and the content information. In the information processing program executed by the computer of the terminal device,
The computer,
Evaluation information acquisition means for acquiring evaluation information on content composed of at least one of video and sound input by a user to input means included in the terminal device;
Detection for acquiring detection information indicating the detected video or sound from detection means for detecting video or sound output by an output device that outputs at least one of the video and the sound that constitutes the content Information acquisition means,
The comparison between the acquired evaluation information and the acquired detection information is the comparison result of the detection information and content information indicating at least one of the video and the sound, which constitute the content. A transmitting unit that transmits the evaluation information to a server apparatus that selects to use the evaluation of the content when there is a predetermined match between the content information and the detection information;
To act as
The detection unit and the transmission unit detect the video or the sound when the evaluation information is input, and simultaneously detect the detection information indicating the detected video or sound as the evaluation information. Send to
The server device selects the evaluation information received simultaneously with the detection information from the terminal device to be used for evaluation of the content when the content information has a portion determined to match the detection information. An information processing program characterized by In the information processing program executed by the computer of the terminal device,
The computer,
Evaluation information acquisition means for acquiring evaluation information on content composed of at least one of video and sound input by a user to input means included in the terminal device;
Detection for acquiring detection information indicating the detected video or sound from detection means for detecting video or sound output by an output device that outputs at least one of the video and the sound that constitutes the content Information acquisition means,
The comparison between the acquired evaluation information and the acquired detection information is the comparison result of the detection information and content information indicating at least one of the video and the sound, which constitute the content. A transmitting unit that transmits the evaluation information to a server apparatus that selects to use the evaluation of the content when there is a predetermined match between the content information and the detection information;
To act as
The detection means and the transmission means detect the video or the sound when the evaluation information is input, and transmit the detection information together with the evaluation information to the server device.
When the content information has a portion determined to be coincident with the detection information, the server device selects the evaluation information received from the terminal device together with the detection information to be used for evaluation of the content. In the content information, the output time of the video or sound indicated by the portion determined to match the detection information by the output device is specified as the input time of the evaluation information received together with the detection information. Information processing program that features.

Images