JP2002247612A - System for analyzing reaction from moving image information - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system for analyzing reaction from moving image information that can easily collect and analyze reaction data by many clients who receive the moving image information of one and same moving image file, without the need for strict control. SOLUTION: The client 10 uses a moving image decoder 12 to decode and reproduce the moving image information of the moving picture file distributed from a server 20 via the Internet 30 and returns reaction data associated with the time base at the reproduction, together with the identification information of the distributed moving image file to the server 20 via the Internet 30. The server 20 distributes the moving image information to many of the clients 10 via the Internet 30. The server 20 integrates the reaction data and the identification information of the moving image files that are replied via the Internet 30 from the clients 10, by using an analyzer 25 to relate them with the time base, with respect to the moving image file and analyzes and evaluates a collective reaction on the moving image file.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system for analyzing reaction of moving picture information, and more particularly to a server for collecting reaction information of viewers at each terminal of moving picture information of moving picture content distributed from a server to a plurality of terminals. The present invention relates to a reaction analysis system for moving image information to be analyzed.

[0002]

2. Description of the Related Art Conventionally, a method of using the Internet to collect reader / viewer responses to certain contents is well known. This is to collect responses to questions in accordance with the set identification information. But,
Heretofore, there has been no known method of collecting a reaction by associating this with a time axis for a target having a time axis such as a moving image.

[0003] In the case of a moving image, the reaction to the entire content may be identified at the stage when the projection is completed, but it does not correspond to the time axis during the operation of the moving image. In addition, it is possible to relate the relative time on the moving image by moving the clock separately during projection of the moving image and measuring the absolute time at which the reaction has occurred. For example, in current television broadcasting, viewing information is collected from television viewers who have watched moving images such as broadcasted programs and commercials, and the audience rating is calculated.

[0004]

However, a method of associating a relative time on a moving image by measuring the absolute time at which a reaction has occurred by separately moving a clock during the projection of a moving image has a variety of devices. Requires strict control,
It was expensive.

A conventional method of analyzing a viewer's reaction by measuring the audience rating of a moving image such as a program or a commercial broadcasted on a television is based on the viewing information of the moving image at an absolute time. Because the analysis is performed by the user, the freedom of the viewing time zone is restricted, and since the viewing information is collected through the telephone line and during the viewing time, if the number of viewers is too large, the same telephone Incoming calls are concentrated on the number, the possibility of congestion on the telephone line increases, and it is difficult to collect viewing information from a large number of viewers of about thousands or more, and the number of samples is limited.

Further, conventionally, MPEG (Moving Pictu)
In a moving image compression coding standard such as a Re Experts Group, a computer-supported group that uses a computer to write the same content from a plurality of terminals is a CSCW (Computer Supported Cooperative Work).
However, it does not mention a method of integrating information collected by distributing and distributing the same content.

[0007] The present invention has been made in view of the above points,
It is an object of the present invention to provide a reaction analysis system of moving image information that can easily collect and analyze reaction data of a plurality of clients of moving image information of the same moving image file without strict control.

[0008]

SUMMARY OF THE INVENTION In order to achieve the above object, the present invention provides a system in which one server is connected to a plurality of clients via a network. A distribution means for distributing via a network to, and a plurality of clients transmitted via a network,
An integrating means for receiving the identification information of the distributed moving image file and the reaction data associated with the time axis, and integrating the reaction data by associating the reaction data with the time axis for each moving image file; Analyzing means for analyzing the response data from the client, wherein each of the plurality of clients receives the content data of the moving image file from the server via the network, and reproduces the content data of the received moving image file. Meanwhile, input means for inputting reaction data in relation to the playback time axis, and reaction data input in the input means and associated with the time axis at the time of playback of the moving image file,
And transmitting means for transmitting to the server via the network together with the identification information of the distributed moving image file.

According to the present invention, the server collects the response data to the content data of the moving image file distributed to the plurality of clients from the respective clients, and integrates the response data in relation to the time axis during the reproduction of the content data. Then, since the integrated reaction data group is analyzed, each client can reproduce the content data at an arbitrary time unique to each client and collect the input reaction data.

[0010] In order to achieve the above object, the present invention provides a method for transmitting only reaction data and identification information of a moving image file to a server by separating the transmitting means of the client from the content data of the received moving image file. Features. In the present invention, the client sends the server
Although the distributed content data can be integrated with the reaction data and the identification information, only the reaction data and the identification information are transmitted, and the content data is not transmitted. Here, the above-mentioned reaction data may be an arbitrary or set keyword or key operation information indicating a previously set reaction pattern.

[0011]

Next, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 shows a system configuration diagram of an embodiment of a reaction analysis system for moving image information according to the present invention. The reaction analysis system according to the present embodiment includes a client 10 that transmits reaction data of moving image information, a server 20 that distributes moving image information, and analyzes and displays reaction data.
It is roughly composed of the client 10 and the Internet 30 linking the server 20. Client 1
Although there are many 0's, FIG. 1 shows only one as a representative for convenience of illustration.

The client 10 is connected to the Internet 30
This is a terminal that downloads moving image information (also referred to as moving image content data) of a moving image file distributed from the server 20 via the download wizard 11 and decodes and reproduces the moving image information by the moving image decoder 12. Further, the client 10 reproduces the decoded moving image signal by using the moving image and the object reproduction function 13 of the plug-in AEG (Active Echo Gathering), and also outputs the reaction data associated with the time axis at the time of reproducing the distributed moving image file. And the server 20 via the Internet 30 by the upload wizard 14 together with the identification information of the distributed moving image file.
Reestablish Note that AEG refers to the system according to the present invention.

The server 20 converts the moving image information of the original content by the moving image encoder 21 into, for example, MPEG4
Generates encoded data according to the standard. Further, the server 20 has an AEG setting wizard 22 and distributes the encoded moving image information to a large number of clients 10 via the Internet 30 by the object distribution function 23 of the moving image and the plug-in AEG.

The AEG setting wizard 22 defines attributes such as an image file to be investigated and a storage location of reaction data, and defines an investigation method. In other words, the “reaction pattern definition” and “measurement rule setting” are determined by the server-side operator selecting from a type or formula prepared in advance or uniquely defining it. AEG setting wizard 2
2 selects and determines the layout of the screen displayed on the client of the surveyee, determines other necessary survey conditions, sets various parameters of the execution program based on these selections, Prepare to be able to distribute.

The server 20 converts a large number of reaction data and identification information of a moving image file received from a large number of clients 10 via the Internet 30 by a data converter 24, and converts the converted data by an analyzer 25 into time for the moving image file. Merge by linking by axis, analyze collective responses to video files,
evaluate.

Next, the operation of the client 10 will be described in more detail with reference to FIG. The client 10 extracts a moving image signal (data of moving image content data) of a moving image file distributed from the server 20 via the Internet 30 by using the moving image decoder 12 to decode and reproduce the moving image information. It is displayed on the directory display screen for selection (step 41).

When the viewer selects an arbitrary target file from the target file selection directory display screen, the screen of the client 10 includes a definition of a reaction pattern of the target file, measurement rules, a feedback method, and the like. The screen is switched to an operation explanation screen (step 42). The feedback method is to notify the viewer of the measured result as information or to display an explanatory note on giving thanks for the cooperation (for example, giving a telephone card).

Further, when the viewer approves the contents of the display of the operation explanation screen and presses the OK button, the server 20 starts the media player and the AEG.
The viewer is started and the target file is downloaded.
The object playback function 13 of the moving image and the plug-in AEG is activated by X (step 43).

Thus, the screen 44 of the client 10
, A moving image display 44a of the target file selected from the moving image files distributed from the server 20, a reaction input status display 44b, and a display 44c of a measurement rule and the like are displayed. Based on this screen 44, the viewer can display the moving image 44a.
The keyboard buffer is monitored to see if a key input has been made in a scene showing interest of the user (steps 45 and 46).
The elapsed time value from the first display time of the moving image and the input flag are stored or written (step 47).

Subsequently, when the storage or writing of the time value and the input flag are all completed, the state of the key input is confirmed by the viewer (step 48). If the key input based on the screen 44 is redone and the state of the key input is OK,
Using the upload wizard 14, the response data including the stored or written time value and the input flag is transmitted to the Internet 30 together with the identification information of the moving image file.
Is uploaded to the server 20 via the
9).

Here, the uploading is performed only with the reaction data and the identification information of the moving image file. This will be described with reference to FIGS. The moving image information of the moving image file to be distributed is compression-coded according to the MPEG4 standard. As shown in FIG. 3, the moving image information is a moving image element data group related to a common time axis together with background video, audio information, data, and the like.
The data is compressed and encoded according to PEG4, distributed to the client 10, and decoded and reproduced by the client 10.

As described in step 45 of FIG. 2, the viewer of the client 10 inputs a reaction value at the moment of an interesting scene display among the displayed scenes as shown in FIG. I do. This response data is generally entered as a proportional or qualitative measure corresponding to a time axis and having a dimension perpendicular to the time value. In MPEG4, the reaction data added to the first distributed moving image data group is the response data shown in FIG.
As shown in (1), they are associated with the time axis in a consistent manner, and can be integrated as an integrated content. However, the encoder is expensive, and it is inefficient to encode and communicate the entire image data.

Therefore, in the present embodiment, as shown in FIG. 6, the reaction data 50 and the identification information of the moving image file are separated from the first distributed moving image data group, transmitted to the server 20, and counted. Enables communication with a small load. The reaction data 50 includes a relative time and a reaction value 52, and is uploaded to the server together with a file ID and file attribute 51, which are identification information of the moving image file. The relative time is the time from the first display time of the file when the client (viewer) inputs a reaction value at the moment of displaying a scene of interest.

As described above, the client 10 reproduces the received moving image content data (the first group of distributed moving image data) such as commercials, movies, and program information at a desired time and inputs reaction data. . After the playback of the video content data, the reaction data is separated from the video content data (the first video data group distributed),
It is transmitted to the server 20 via the Internet 30 together with the moving image file identification information.

Since the reaction data is a reaction input at a relative time from the reproduction start time of the moving image content, it is not necessary for all the clients to reproduce at the same time at the same time.
Playback can be performed at any time for each client.
For this reason, there is no line congestion at the time of uploading the response data of a large number of clients, and the response data can be easily collected from a large number of clients as compared with the related art.
In addition, since response data is transmitted and content data is not transmitted, communication with a small load is possible.

The server 20 analyzes the reaction data collected from the many clients 10 via the Internet 30 by the analyzer 25, and displays the analysis result. Next, the processing of the analyzer 25 will be described in more detail with reference to FIG. When a moving image file is displayed on the target file selection directory display screen of the server 20 (step 61), and an arbitrary target file is selected from the target file selection directory display screen,
The screen of the server 20 is switched to an operation explanation screen including the definition of the reaction pattern of the target file, the rules of measurement, the method of feedback, and the like (step 6).
2).

When the server approves the contents of the display and presses the OK button, the screen is switched to an analysis setting screen for allowing the user to specify the editing of the totalization unit and select the analysis (display) type for the data type (step 63). ), When those designations and selections are made, the screen is switched to the analysis and reproduction screen (step 64). The analysis and reproduction screen includes a moving image display area 64a, a real-time indicator area 64b, an analysis graph display area 64c, a play button 64d, a fast forward button 64e, and a rewind button 6 of the selected target file.
4f, a stop button 64g, a print button 64h, an entire area display button 64i, and a rear display button 64j. The analysis graph 64c shows a graph of the analysis result. The moving image itself as the content is displayed in the moving image display area 64a.

The whole area display button 64i and the rear display button 64j are connected to the analysis graph display area 64c at the bottom of the screen.
In the case of the full-area display button 64i, the whole area of the content, ie, 10
In the case of a minute video, the reaction value is displayed on a scale from 0 minutes 0 seconds to 10 minutes 0 seconds. The current relative time is displayed by changing the color or moving the indicator. By the way, all the graphs shown in each display example described later are expressed by this full area display.

On the other hand, the display by the rear display button 64j displays only the transition of the reaction data up to the current relative time. Speaking of each display example to be described later, "current time ▼"
Is not displayed on the right side (that is, the future side) of the location indicated by. Such a display format is selected in consideration of displaying the data on the future side to prevent the analyst from foreseeing the reaction to the content.

Next, it is determined whether or not the analysis of the target file has been completed (step 65). If the analysis has not been completed, the screen switches to the analysis setting screen again (step 63).
If the processing has been completed, the processing ends. In this embodiment, the server 20 distributes original moving image content data to a large number of clients 10, and inputs the data as independent contents from the client (viewer) 10 on the basis of a time axis that maintains the same.・ Collect, combine, integrate and analyze only the integrated difference data (reaction data).

Next, the analysis method and each example of the display will be described in more detail. The first analysis method is a method in which, for each set period (for example, one minute), the number of reactions occurring during that period is totaled and displayed for each period. In this first analysis method, when each client (viewer) 10 is set as a subject, the reaction pattern of the client (viewer) 10 is schematically shown at 71a in FIG. Is shown. The subject's reaction operation is limited to one operation within the same set period.

As shown by 72a in FIG. 8, the real-time indicator 64b of FIG. 7 displays, for each set period, the total number of reactions during that period in the form of a bar graph. Further, the analysis graph 64c of FIG.
As shown by, a bar graph of the total number of reactions for each set period from the past to the present is displayed. The first analysis method is a simple analysis method that is most intuitive and easy to understand when the number of clients is large. This is an effective analysis method in the case of performing actual measurement after several viewings, such as measurement by the public, selection of a popular scene by voting once, and the like.

In the second analysis method, the number of reactions in a set period (for example, one minute) preceding from the current time is counted,
This is a method of displaying the current coordinates. According to the second analysis method, a client (viewer) is added to 71b in FIG.
As schematically showing the reaction patterns of 10, when each client (viewer) 10 is set as a subject, a reaction operation on the moving image time axis of the subject is shown. The subject's reaction operation is limited to one operation within the same set period.

The real-time indicator 64b in FIG. 7 displays the total number of reactions in the set period preceding the current time, as indicated by 72b in FIG. This display collects and collects all the reaction data from all of the clients 10 in advance. Even if the set time is one minute, for example, the display is continuously performed every second for example from the current time. The total number of reactions in the period is displayed. For example, the number of reactions for one minute in a set period from 10: 10: 00: 00 to 10: 11: 00: 0 is displayed at 10: 10: 00: 00, and from 10: 10: 1 to 10: 11: 1. The number of reactions for one minute for the set period is displayed at 10:10:01.

Further, the analysis graph 64c of FIG.
As shown by 73b, a rough graph of the total number of reactions in the set period preceding from the current time from the past to the present is displayed. In the second analysis method, when it is assumed that the reaction operation is performed with a delay with respect to the moving image of the actual screen,
This has the effect of correcting the delay. In terms of expression, there is a feature that continuous measurement values can be obtained. This second analysis method is a preferable method for analyzing an object to be measured immediately in one viewing.

The third analysis method is a method of analyzing and displaying the total value of the number of reactions up to the present time. In the third analysis method, the client (viewer) is set at 71c in FIG.
As schematically showing the reaction patterns of 10, when each client (viewer) 10 is set as a subject, a reaction operation on the moving image time axis of the subject is shown. The subject's reaction operation is limited to one operation within the same set period.

Further, in the real-time indicator 64b of FIG. 7, as shown by 72c in FIG. 10, the number of reaction cases at the current time point is displayed in a bar graph. Further, FIG.
In the analysis graph 64c, as shown by 73c in FIG. 10, the cumulative value of the total number of reactions up to the present time is graphically displayed. This third analysis method is suitable for grasping the degree of receptive attitude such as a commercial film as the required time or the speed of attitude formation, and measures the degree of speed of public measurement and attitude determination for an object ( This is an effective analytical method when measuring approval, approval, consent, etc.).

The fourth analysis method is a method in which a set reaction is repeated indefinitely without restricting the reaction operation, and this frequency is measured and displayed within a set period. According to the fourth analysis method, a client (viewer) 1 is added to 71d in FIG.
As schematically showing a response pattern of 0, when each client (viewer) is set as a subject, a reaction operation on the moving image time axis of the subject is shown. Note that the fourth analysis method is similar to the first analysis method in that the number of reactions at each set time is displayed, but the reaction operation of the subject is one in the same set period in the first analysis method. Unlike the fourth analysis method, the fourth analysis method is different in that the number of reactions in a set time is unlimited.

Further, as shown by 72d in FIG. 11, the real-time indicator 64b of FIG. 7 displays, for each set period, the total number of reactions during that period in the form of a bar graph. Further, the analysis graph 64c of FIG.
As shown by d, a bar graph of the total number of reactions for each set period from the past to the present is displayed.

In the fourth analysis method, since there is no constraint on the number of times of the reaction operation, the subject can participate without being nervous, the reaction at the time of the excitement appears strongly, and the reaction tends to vary. There is a feature. In addition, the fourth analysis method has a problem that the response frequency is not strict (the response of the same person may be counted as a double), but the response is expanded and selected by selecting a popular scene or the like. This is an effective analysis method when you want to.

The fifth analysis method is a method of analyzing and displaying the total value of the number of reactions up to the present time. According to the fifth analysis method, a client (viewer) is placed at 71e in FIG.
When each client 10 is set as a subject, a reaction operation on the moving image time axis of the subject is shown as schematically showing the ten reaction patterns. Note that this fifth analysis method is an analysis method in which the third analysis method is repeated a plurality of times.

In the fifth analysis method, as shown by 72e in FIG. 12, the real-time indicator 64b of FIG. 7 displays the cumulative value of the number of reactions up to the present time for each set period (for example, 1 minute) in a bar graph. It is displayed in the shape. Furthermore,
In the analysis graph 64c of FIG. 7, as indicated by 73e in FIG. 12, the cumulative value of the total number of reactions up to the present time is displayed in a graph for each set period.

This fifth analysis method is suitable for grasping the degree of receptive attitude such as a commercial film as the required time and the speed of attitude formation, similar to the third analysis method. This is an effective analytical method for measuring the degree of speed in determining the attitude toward a subject (approval, approval, satisfaction, etc.).

As other tallying / analyzing methods,
The client enters any or configured keywords for the relative time value, the server merges the keywords from all clients for the relative time,
With the relative time value as the starting point, a direct display method that displays all of those keywords for a preset time, or the client inputs a numeric key (which is a proportional scale) indicating the degree of response, and the server There is a method of summing up the values of the degree of response for each client by section estimation (extrapolation method, interpolation method) with respect to the relative time axis for all clients, and displaying the absolute value or ratio.

[0045]

Next, embodiments of the present invention will be described.
The first embodiment of the present invention is a video information reaction analysis system for evaluating a video training program. In the first embodiment, the server records the lecture scene of the lecturer as a moving image, and stores the information of the moving image (including the sound) in MPEG4 format.
After compressing and encoding the data, it is distributed to the client who is the student on the Internet, and the degree to which the student has shown interest in the lecture content and the degree to which he / she has understood (not able to understand) the lecture data as response data from the client to the server via the Internet Receives and collects and displays the reaction data linked to the video scene of the lecture scene. In this embodiment, the degree of understanding of the student is quantitatively displayed along the time axis of the content of the lecture, and thus is a material for improving and improving the content of the lecture.

Next, a second embodiment of the present invention will be described. A second embodiment of the present invention is a reaction analysis system of moving image information for evaluating a viewer for a video work. In the second embodiment, a server distributes a video work to a viewer who is a client via the Internet, and the viewer indicates a degree of excitement and a favorable impression for each scene of the distributed video work. This is an example of returning response data to a server via the Internet. In this embodiment, the server can quantitatively grasp the degree of excitement and the liking of each scene of the video work based on the reaction data in association with the scene.

Next, a third embodiment of the present invention will be described. This third embodiment is a reaction analysis system of moving image information for evaluating a viewer for a commercial (CM) film. In the third embodiment, the server distributes the moving image information (including audio) of the CM to the viewer who is the client via the Internet, and the viewer receives the distributed CM.
This is an example in which response data indicating the degree of excitement and favorable impression is returned to a server via the Internet for each scene of a moving image.

In this embodiment, the server can systematically collect and analyze reaction information in which the viewer specifically expresses the viewer's liking to the CM and the reaction when the product appears, and the like.

As another embodiment, there is an example in which the reaction of the public to a specific image is compiled. In this embodiment, the server can collect comments from the client on a specific screen and display them efficiently.

Note that the present invention is not limited to the above-described embodiments and examples. For example, distribution may be performed via an intranet, and distribution and collection using a mobile phone such as i-mode may be performed. . Further, as the reaction data, sentences such as arbitrary short sentences and comments can be used in place of the arbitrary or set keywords. Furthermore, the compression encoding of moving images is not limited to MPEG4.

[0051]

As described above, according to the present invention,
The server integrates the reaction data from multiple clients by associating them with the time axis during the playback of the content data, and analyzes the integrated reaction data group, so that each client plays the content data at its own arbitrary time The server can collect the reaction data entered by the user, so that the reaction data input work of each client can be performed at each client's desired time, and simultaneously using the conventional telephone line. Compared to the method of collecting and analyzing reaction data, line congestion does not occur, so that reaction data can be collected from a much larger number of clients than in the past, and the reaction, recognition, and evaluation of moving images Can be obtained more accurately and easily.

Further, according to the present invention, since a plurality of clients separate client data from the server and transmit only reaction data and identification information to the server, communication with a small load can be performed.

[Brief description of the drawings]

FIG. 1 is a system configuration diagram according to an embodiment of the present invention.

FIG. 2 is an explanatory diagram of a process of a client in FIG. 1;

FIG. 3 is an explanatory diagram of an example of moving image information to be distributed.

FIG. 4 is a diagram illustrating input of viewer reaction data to distributed moving image information.

FIG. 5 is a diagram illustrating that reaction data and distributed moving image information can be integrated as an integrated content.

FIG. 6 is a diagram illustrating that a client transmits only reaction data and identification information to a server in the present invention.

FIG. 7 is an explanatory diagram of an example of an analyzer process of a client according to the present invention.

FIG. 8 is a diagram showing a first example of a display of a measurement pattern, a real-time indicator, and an analysis graph according to the present invention.

FIG. 9 is a diagram showing a second example of the display of the measurement pattern, the real-time indicator, and the analysis graph according to the present invention.

FIG. 10 is a diagram showing a third example of a display of a measurement pattern, a real-time indicator, and an analysis graph according to the present invention.

FIG. 11 is a diagram showing a fourth example of a display of a measurement pattern, a real-time indicator, and an analysis graph according to the present invention.

FIG. 12 is a diagram showing a fifth example of a display of a measurement pattern, a real-time indicator, and an analysis graph according to the present invention.

[Explanation of symbols]

10 Client 11 Download Wizard 12 Video Decoder 13 Video and Plug-in AEG Object Playback 14 Upload Wizard 20 Server 21 Video Encoder 22 AEG Setting Wizard 23 Video and Plug-in AEG Object Delivery Function 24 Data Converter 25 Analyzer 30 Internet

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5C061 BB20 5C064 BA07 BB10 BC18 BC23 BD01 BD02 BD08 BD09

Claims (3)

[Claims] 1. A system in which one server is connected to a plurality of clients via a network, wherein the server distributes content data of a moving image file to the plurality of clients via the network; Receiving, from a plurality of clients, identification information of the distributed moving image file and reaction data associated with a time axis, and relating the reaction data to each moving image file on a time axis; And an analyzing means for analyzing the reaction data from the plurality of clients integrated by the integrating means, wherein each of the plurality of clients comprises the moving image from the server via the network. Receiving means for receiving the content data of the file; An input unit for inputting the reaction data in relation to the reproduction time axis while reproducing the content data of the video file; and A transmission means for transmitting the reaction data to the server via the network together with the identification information of the distributed moving image file. 2. The server according to claim 1, wherein the transmitting unit of the client transmits only the reaction data and identification information of the moving image file to the server, separately from the received content data of the moving image file. A reaction analysis system for the described video information. 3. The reaction of the moving image information according to claim 1, wherein the reaction data is an arbitrary or set keyword or sentence or key operation information indicating a predetermined reaction pattern. Analysis system.