JP2021087034A - Information processing device, information processing method, and program - Google Patents

Abstract

To allow the transition of a response of a user who views a moving image to be simply verified.SOLUTION: An information processing device 10 includes: a moving image acquisition unit 130 that acquires moving image data; a giving unit 120 that gives a moving image an image to acquire a response of a user who views a moving image based on the moving image data; a reproduction unit 130 that causes a communication terminal 30 of the user to reproduce the moving image together with the image; an information acquisition unit 140 that acquires information on operation and a reproduction time of the moving image based on operation of the user for the image while the moving image is being reproduced; and a generation unit 150 that generates display data for displaying the information on the operation in association with the reproduction time of the moving image.SELECTED DRAWING: Figure 2

Description

The present invention relates to an information processing device, an information processing method and a program.

In recent years, users can watch various moving images by using a portable communication terminal or the like. When the user is watching a video, the user may have emotions or make rational judgments about the video being watched. As a technique for estimating a person's emotion, for example, in Patent Document 1, when the user performs an action reflecting the emotion, the user's hand is based on the contact data regarding the contact state of the contact member with which the user's hand comes into contact. Techniques for estimating emotions are described.

Japanese Unexamined Patent Publication No. 2009-26125

It is considered necessary to know how such a reaction of a user who watches a video is changing in order to evaluate the video. However, in the technique described in Patent Document 1, in order to estimate the emotion of the user, there is a burden of preparing a contact member provided with a vibration motor, a light source, or the like. When verifying the reaction of the user who watches the moving image, it is desirable that such a burden does not occur.

Therefore, an object of the present invention is to provide an information processing device, an information processing method, and a program that can easily verify the transition of the reaction of a user who watches a moving image.

The information processing device according to one aspect of the present invention includes a moving image acquisition unit that acquires moving image data, and an giving unit that assigns an image for acquiring a reaction of a user who views a moving image based on the moving image data to the moving image. , A playback unit that causes the user's communication terminal to play the video together with the image, and an information acquisition unit that acquires information on the operation and the playback time of the video based on the user's operation on the image while the video is being played. It includes a generation unit that generates display data for displaying information related to the operation in association with the playback time of the moving image.

According to this aspect, it is possible to display the transition of the user's reaction while the moving image is being played on the display device. By viewing the display, it is possible to easily verify the transition of the user's reaction while the moving image is being played.

In the above aspect, a calculation unit for calculating a statistical value of an index related to a reaction based on information on an operation may be further provided.

According to this aspect, a numerical value representing the characteristics of the user's reaction is calculated. By using this numerical value, it becomes possible to more accurately verify the user's reaction to the moving image.

In the above aspect, the statistical value may be the difference between the maximum value and the average value of the exponent that functions on the reaction per unit time.

According to this aspect, by using the difference between the maximum value and the average value, it is possible to estimate the magnitude of the undulations of the user's reaction while the moving image is being played. Therefore, it is possible to more accurately verify the reaction of the user who watches the moving image.

In the above embodiment, the statistical value may be the average value of the index for the reaction per unit time.

According to this aspect, by using the average value of the index regarding the reaction per unit time, it is possible to estimate the average magnitude of the user's reaction while the moving image is being played. Therefore, it is possible to verify the reaction of the user who watches the moving image in more detail.

In the above aspect, the information acquisition unit may acquire an index related to the reaction associated with the information that can identify the user.

According to this aspect, it is possible to associate the index related to the reaction with a specific user. This makes it possible to verify in more detail the transition of the reaction of the user who watches the moving image.

The information processing method according to another aspect of the present invention includes acquiring moving image data and adding an image for acquiring a reaction of a user who watches a moving image based on the moving image data to the moving image. , Information on the operation and information on the playback time of the moving image based on the user's operation on the image while the moving image is being played, and playing the moving image together with the image on the user's communication terminal. And to generate display data for displaying the information related to the operation in association with the playback time of the moving image.

According to this aspect, it is possible to display the transition of the user's reaction while the moving image is being played on the display device. By viewing the display, it is possible to easily verify the transition of the user's reaction while the moving image is being played.

In the program according to another aspect of the present invention, the computer is provided with an image for acquiring moving image data and an image for acquiring a reaction of a user who watches a moving image based on the moving image data. And, based on the user's operation of playing the moving image together with the image on the user's communication terminal and the user's operation on the image when the moving image is being played, information on the operation and information on the playback time of the moving image. And to generate display data for displaying the information related to the operation in association with the playback time of the moving image.

According to this aspect, it is possible to display the transition of the user's reaction while the moving image is being played on the display device. By viewing the display, it is possible to easily verify the transition of the user's reaction while the moving image is being played.

According to the present invention, it is possible to provide an information processing device, an information processing method, and a program that can easily verify the transition of the reaction of a user who watches a moving image.

It is a figure which shows the structural example of the information processing system which concerns on one Embodiment of this invention. It is a figure which shows the configuration example of the server which concerns on the same embodiment. It is a figure which shows an example of the display screen which displayed the reaction image together with the moving image. It is a figure which showed the reaction index with respect to the moving image play time. It is a figure which shows the structural example of the management terminal which concerns on one Embodiment of this invention. It is a figure which shows the hardware configuration example of the server, the management terminal and the user terminal which concerns on this embodiment. It is a flowchart which shows the process of the information processing system which concerns on the embodiment from the time when a management terminal accesses a server to the time when a server transmits moving image data to a user terminal. It is a flowchart which shows the process of the information processing system which concerns on the embodiment from the time when the moving image is reproduced on the user terminal to the time when the verification result is displayed on the management terminal. It is a figure which shows an example of the display screen which enables selection of the segment of the survey subject. It is a figure which arranged some images in the moving image to be evaluated in chronological order. It is a figure which shows the transition of the audience rating and the reaction index of a moving image. It is a figure which arranged some images in a newly created moving image in chronological order by exchanging a part of scenes in the moving image to be evaluated. It is a figure which shows the transition of the audience rating in the original video, and the transition of the audience rating expected in the newly created video.

Preferred embodiments of the present invention will be described with reference to the accompanying drawings. In each figure, those having the same reference numerals have the same or similar configurations.

As shown in FIG. 1, the information processing system 1 according to the embodiment of the present invention includes a server 10 (information processing device), a management terminal 20, a user terminal 30, and a network 35. The server 10, the management terminal 20, and the user terminal 30 are connected to each other via the network 35 so that information can be transmitted and received as needed. Although FIG. 1 shows one server 10, one management terminal 20, and one user terminal 30, the information processing system 1 includes a plurality of servers 10, a management terminal 20, or a user terminal 30. May be good.

The server 10 acquires video data from the management terminal 20, attaches a predetermined image to the video data, and then transmits the video data to the user terminal 30. Further, the server 10 acquires information on the operation by the user who views the moving image (hereinafter, also referred to as "operation information") and information on the playback time of the moving image based on the predetermined operation by the user of the user terminal 30. Further, the server 10 outputs display data for displaying the operation information in association with the playback time of the moving image to the management terminal 20.

The management terminal 20 is a communication terminal managed by an administrator. In the present embodiment, it is assumed that the administrator creates a moving image for advertisement and investigates the reaction of the user who watches the created moving image. The administrator uses the management terminal 20 to transmit video data to be evaluated to the server 10, acquire display data indicating information on the reaction of the user who watches the video from the server 10, and obtain an image based on the display data. Can be viewed. This allows the administrator to know the user's reaction to the video.

The user terminal 30 is a communication terminal used by the user. In the present embodiment, the user can use the user terminal 30 to watch a moving image based on the moving image data transmitted from the server 10 to the user terminal 30. Further, the user can transmit information about the operation to the server 10 by performing a predetermined operation while the moving image is being played. In the present embodiment, it is assumed that a plurality of users and user terminals 30 exist, and various information related to the plurality of users is registered in the server 10 in advance.

The configuration of the server 10 according to the present embodiment will be described with reference to FIG. As shown in FIG. 2, the server 10 according to the present embodiment includes a moving image DB 110, a granting unit 120, a communication unit 130, an index acquisition unit 140, a generation unit 150, and a calculation unit 160.

The moving image DB 110 stores various types of moving image data. The moving image data may be data for displaying only an image, or may be data for outputting sound together with an image. Further, the moving image data may be data for displaying a continuously changing image, or may be data for displaying a discontinuously changing image such as a picture-story show. The moving image DB 110 may receive the moving image data from the communication unit 130 and store the moving image data. The moving image data stored in the moving image DB 110 is referred to by the giving unit 120 as necessary.

The giving unit 120 has a function of giving an image (hereinafter, referred to as “reaction image”) for acquiring a reaction of a user who views a moving image based on the moving image data to the moving image data. In the present specification, the reaction of the user is a state occurring inside the user, and may be, for example, an emotional reaction or a rational reaction. Emotional reactions are, for example, the occurrence of various emotions such as like, disgust, conviction, sadness, anger, peace of mind, gratitude, startle, calm, happiness, tension, respect, satisfaction, shame, and jealousy. You can. In addition, the rational reaction may be to make a judgment on the content of the moving image, for example, convincing or correctness. The method of imparting the reaction image by the imparting unit 120 is not particularly limited, and for example, a method using various known programming languages such as Javascript (registered trademark) may be used.

The reaction image is displayed together with the moving image when the moving image is played back. FIG. 3 is a diagram showing an example of a display screen 400 in which a reaction image is displayed together with a moving image. FIG. 3 shows a display screen 400 that displays two reaction images displayed together with the moving image 402. The display screen 400 shown in FIG. 3 may be displayed on the user terminal 30, for example.

In FIG. 3, two reaction images (first reaction image 404 and second reaction image 406) are shown below the moving image 402. In the first reaction image 404 and the second reaction image 406, characters indicating the feelings of "convinced" or "like" are displayed in the rectangular figure. The user can perform a predetermined operation on these reaction images while the moving image 402 is being played. The predetermined operation may be, for example, an operation of clicking the reaction image. When the user terminal 30 has a touch panel and a moving image and a reaction image are displayed on the touch panel, the predetermined operation may be an operation of touching the reaction image. Although two reaction images are shown in FIG. 3, the number of reaction images displayed may be one or three or more. Further, in FIG. 3, the reaction image is shown on the lower side of the moving image, but the position where the reaction image is displayed may be the left side, the right side, or the upper side of the moving image 402, and the reaction image is shown on the moving image 402. It may be displayed in an overlapping manner.

Returning to FIG. 2, the configuration of the server 10 will be described. The communication unit 130 has a function of transmitting and receiving various types of information. The communication unit 130 can acquire the moving image data by receiving the moving image data from the management terminal 20, for example. As described above, in the present embodiment, the communication unit 130 has a function as a moving image acquisition unit. The communication unit 130 transmits the acquired display data to the moving image DB 110.

Further, the communication unit 130 can acquire the moving image data to which the reaction image is added from the addition unit 120 and transmit it to, for example, the user terminal 30. As a result, the moving image is reproduced on the user terminal 30 together with the reaction image. As described above, the communication unit 130 also has a function as a reproduction unit capable of causing the user terminal 30 to reproduce the moving image together with the reaction image.

Further, in the present embodiment, when the moving image is being reproduced together with the reaction image on the user terminal 30, a predetermined operation is performed by the user. The communication unit 130 can receive information on the predetermined operation and information on the reproduction time of the moving image from the user terminal 30. The communication unit 130 transmits the received operation information and information on the playback time of the moving image to the index acquisition unit 140. The information regarding the playback time of the moving image may be, for example, the playing time of the moving image being viewed by the user at the timing when a predetermined operation is performed by the user.

The index acquisition unit 140 can acquire operation information and information regarding the playback time of the moving image (hereinafter, also referred to as “time information”). As described above, in the present embodiment, the index acquisition unit 140 also has a function as an information acquisition unit. The operation information may be information indicating the number of times a predetermined operation is performed by the user in a predetermined unit time while the moving image is being played. Further, the time information may be, for example, information representing a specific period in the playback time of the moving image played on the user terminal 30. Therefore, the index acquisition unit 140 can acquire information indicating how many times a predetermined operation has been performed per a predetermined unit time in a specific period of the reproduced moving image. The index acquisition unit 140 can acquire the number of times a predetermined operation is performed as an index related to the user's reaction (hereinafter, also referred to as "reaction index"). For example, the index acquisition unit 140 may acquire a reaction index according to the number of times a predetermined operation based on an emotional reaction is performed as an emotional index, or a predetermined operation based on a rational reaction is performed. The reaction index according to the number of times may be acquired as the reason index. In addition, the index acquisition unit 140 can also acquire an emotion index or a reason index for each predetermined time.

The reaction index acquired by the index acquisition unit 140 may be associated with information that can identify the user (hereinafter, also simply referred to as “identification information”). It is assumed that the index acquisition unit 140 holds the segment information of the user registered in advance. The user segment information may be, for example, information indicating the user's gender, age, residential area, marital status, presence / absence of children, annual household income, occupation, and the like. The user's segment information and identification information are associated with each other, and the index acquisition unit 140 can associate the acquired reaction index with the segment information by comparing the registered segment information with the identification information. .. The index acquisition unit 140 transmits the acquired reaction index to the generation unit 150 or the calculation unit 160.

The generation unit 150 has a function of generating display data for displaying the operation information in association with the playback time information of the moving image. An example of an image displayed based on the display data will be described with reference to FIG. FIG. 4 is an example of an image showing the transition of the reaction index in chronological order. Such an image may be displayed on the display screen of the management terminal 20, for example. The horizontal axis represents the time elapsed since the start of playback of the moving image (video playing time), and the vertical axis represents the reaction index.

In FIG. 4, the transition of the emotion index and the reason index is shown as a bar graph. Specifically, in the 23-second moving image, the transition of the emotion index and the reason index per second per unit time is shown. The shaded area indicates the rational index, and the unshaded area indicates the emotional index. By referring to such a graph, the administrator can verify the transition of the user's reaction at the time of playing the moving image. In the example shown in FIG. 4, a graph showing each type of emotion index and reason index is shown, but the graph may show only the emotion index or only the reason index. May be good. Further, the graph may show only one kind of emotional index or rational index, or may show three or more kinds of emotional index or rational index. Further, the displayed reaction index may be a reaction index generated by adding up the reaction indexes by a plurality of users, or may be a reaction index by one user. The unit time for totaling the reaction index may be a time other than 1 second.

Returning to FIG. 2, the configuration of the server 10 will be described. The calculation unit 160 has a function of calculating statistical numerical values of a plurality of acquired reaction indexes. The numerical value enables the administrator to verify the video more accurately.

The statistical value may be, for example, the difference between the maximum value of the plurality of reaction indexes and the average value of the reaction indexes. The difference between the maximum value and the average value of the reaction index will be described with reference to FIG. 4 described above. In the example shown in FIG. 4, among the reaction indexes in the moving image reproduction time from 1 second to 23 seconds, the reaction index in the moving image reproduction time of 19 seconds is 37, which is the maximum value. The average value of the reaction index in the moving image reproduction time of 1 second to 23 seconds is 15. Therefore, the calculation unit 160 can calculate 22 as the difference, which is obtained by subtracting the average value of 15 from the maximum value of 37. It can be estimated that the larger the difference, the greater the undulations of the reaction of the user who watches the moving image.

In addition, the statistical value may be a reaction index per unit time. More specifically, the statistical value may be the average value of the reaction index per unit time in a predetermined moving image reproduction period. In the example shown in FIG. 4, for example, the statistical value may be the average value of the reaction index per second in the moving image reproduction period of 23 seconds. It can be estimated that the larger the reaction index per unit time, the greater the excitement of the user's emotions toward the moving image. In this way, by using the reaction index per unit time, it becomes possible to evaluate the moving image more appropriately.

The calculation unit 160 transmits the calculation result to the generation unit 150. As a result, the generation unit 150 can generate display data including the calculation result.

The configuration of the management terminal 20 will be described with reference to FIG. As shown in FIG. 5, the management terminal 20 includes an input unit 210, a communication unit 220, and a display unit 230.

The input unit 210 has a function of accepting a user's operation and generating input information according to the operation. The input unit 210 may be a mouse, a keyboard, a touch panel, or the like. The generated input information is transmitted to the communication unit 220.

The communication unit 220 has a function of transmitting and receiving various types of information. The communication unit 220 can transmit, for example, the moving image data of the management terminal 20 or the input information generated by the input unit 210 to the server 10. Further, the communication unit 220 may receive the display data or the like transmitted by the server 10 and transmit it to the display unit 230.

The display unit 230 has a function of displaying various types of information. The display unit 230 may be, for example, a liquid crystal display or the like. The display unit 230 can display various information such as a reaction index or a calculation result based on the display data transmitted from the server 10.

Next, the configuration of the user terminal 30 will be described. Since the configuration of the user terminal 30 is substantially the same as the configuration of the management terminal 20, the illustration of the user terminal 30 is omitted. Here, the difference between the operation in the user terminal 30 and the operation in the management terminal 20 will be described.

The communication unit of the user terminal 30 can receive the moving image data for reproducing the moving image together with the display of the reaction image from the server 10 and transmit the moving image data to the display unit. The display unit can display the reaction image and play the moving image based on the moving image data.

The input unit of the user terminal 30 may accept a predetermined operation such as clicking or touching a reaction image when the moving image is being played, generate input information corresponding to the operation, and transmit the input information to the communication unit 220. it can. Further, the communication unit of the user terminal 30 can transmit the input information to the server 10. The input information is used for generating a reaction index and the like.

An example of the hardware configuration of the server 10, the management terminal 20, and the user terminal 30 described above will be described with reference to FIG. The server 10, the management terminal 20, and the user terminal 30 are a CPU, a processor 11 such as a GPU (Graphical Processing Unit), a memory, a storage device 12 such as an HDD (Hard Disk Drive) and / or an SSD (Solid State Drive), wired or It has a communication IF (Interface) 13 that performs wireless communication, an input device 14 that accepts input operations, and an output device 15 that outputs information. The input device 14 is, for example, a keyboard, a touch panel, a mouse and / or a microphone. The output device 15 is, for example, a display and / or a speaker.

The processor 11 is a control unit that controls execution of a program stored in the storage device 12, calculates data, and processes data. In the server 10, the processor 11 executes the program to realize various operations described with reference to FIG.

An example of processing by the server 10, the management terminal 20, and the user terminal 30 according to the present embodiment will be described with reference to FIGS. 7 and 8. FIG. 7 is a flowchart showing a process from the time when the management terminal 20 accesses the server 10 until the server 10 transmits the moving image data to be evaluated to the user terminal 30. Further, FIG. 8 is a flowchart showing a process from the start of playback of the moving image by the user terminal 30 to the display of the verification result by the management terminal 20. Hereinafter, processing by the server 10, the management terminal 20, and the user terminal 30 will be described with reference to FIGS. 7 and 8.

First, the communication unit 220 of the management terminal 20 requests the server 10 to access the management site, for example, in response to an operation on the input unit 210 by the administrator (step S101). Next, the communication unit 130 of the server 10 transmits the management screen data in response to the request from the management terminal 20 (step S103). In response to this, the communication unit 220 of the management terminal 20 receives the management screen data and transmits it to the display unit 230. Then, the management screen is displayed on the display unit 230 (step S105). Various images such as images for accepting uploads of video data are displayed on the management screen.

Next, the management terminal 20 transmits the moving image data to the server 10 (step S107). For example, the management terminal 20 may transmit the stored moving image data to the management terminal 20 by the communication unit 220 based on the operation of the administrator. Next, the server 10 transmits the input screen data for acquiring the segment information to the management terminal 20 (step S109). The segment input screen is displayed on the display unit 230 of the management terminal 20 in response to the transmission of the input screen data (step S111).

FIG. 9 is a diagram showing an example of the display screen 410 on which the segment input screen is displayed. On the display screen 410 shown in FIG. 9, a moving image 412 and an image for inputting segment information are displayed. In FIG. 9, texts for selecting gender (male, female) and age (under 20 years old, 20s, 30s) are displayed. The administrator can select the segment of the surveyed person by clicking the check box 414 displayed on the left side of each text. Information other than the segment shown in FIG. 9 may be displayed on the segment input screen.

When the segment of the user to be verified is selected based on the operation of the administrator, the management terminal 20 transmits the segment information to the server 10 (step S113). When the communication unit 130 of the server 10 receives the segment information, the adding unit 120 adds a reaction image to the moving image data transmitted in step S107 (step S115). The moving image data to which the reaction image is added is transmitted by the communication unit 130 to the user terminal 30 of the user matching the selected segment (step S117). When the segment of male and 20's is selected, the server 10 transmits the moving image data to the user terminal 30 in response to the access from the user registered as the male in his 20's. As a result, the user of the user terminal 30 to which the moving image data is transmitted can watch the moving image based on the moving image data.

Next, with reference to FIG. 8, the processing of the information processing system 1 after the moving image data is transmitted by the user terminal 30 will be described. The user terminal 30 accepts input by the user while playing a moving image based on the moving image data (step S201). At this time, the reaction image is displayed on the display unit of the user terminal 30 while the moving image is being played back. While the moving image is being played, the user can input by performing a predetermined operation such as clicking the reaction image. When, for example, a reaction image representing "convinced" is clicked on the user terminal 30, operation information based on the click of the reaction image is generated as input information. At this time, information related to the playback time of the moving image is also generated as input information. These input information are generated each time a predetermined operation is performed.

Next, the user terminal 30 transmits the input information to the server 10 (step S203). The user terminal 30 may transmit the input information to the server 10 each time a predetermined operation is performed. For example, when the playback of the moving image is finished, the input generated from the playback of the moving image to the end is completed. The information may be collectively transmitted to the server 10. When the input information is transmitted to the server 10 each time a predetermined operation is performed, the information related to the playback time of the moving image may be generated on the server 10 side. Further, the user terminal 30 may transmit the input information to the server 10 together with the information that can identify the user. When the input information is transmitted to the server 10, the communication unit 130 of the server 10 receives the input information and transmits it to the index acquisition unit 140.

Next, the index acquisition unit 140 acquires the reaction index (step S205). Specifically, the index acquisition unit 140 generates a reaction index based on the operation information included in the input information. For example, the index acquisition unit 140 counts the number of times the reaction image is clicked per unit time for a predetermined period of the moving image reproduction time in the moving image data to be verified. In this way, the index acquisition unit 140 can acquire the reaction index per unit time in the period. In addition, the index acquisition unit 140 may aggregate the reaction indexes of one or a plurality of survey subjects and use the aggregated results.

At this time, the index acquisition unit 140 can acquire the reaction index based on the input information associated with the information that can identify the user. As a result, the index acquisition unit 140 can recognize what kind of user's reaction index is. In the present embodiment, the index acquisition unit 140 can associate the reaction index with the segment information. Therefore, it is possible to associate a user in a specific segment with a reaction that the user shows to a moving image.

Next, the management terminal 20 requests the server 10 for the aggregation result of the reaction index in response to the input by the administrator (step S207). The generation unit 150 of the server 10 generates display data for displaying information based on the reaction index in response to a request from the management terminal 20 (step S209). Specifically, the generation unit 150 generates display data for displaying the time information and the reaction index in association with each other. The generation unit 150 may generate display data for displaying an image as described with reference to FIG. 4, for example. The generated display data is transmitted to the communication unit 130.

The communication unit 130 of the server 10 transmits the display data to the management terminal 20 (step S211). When the communication unit 220 of the management terminal 20 receives the display data, the display unit 230 displays the aggregation result based on the display data (step S213). As a result, the administrator can verify the transition of the reaction that occurs in the inspection target person while the moving image is being played with respect to the moving image data to be evaluated.

Here, it is assumed that after the processing in step S213 is performed, the aggregation of the reaction index for the moving image data to be evaluated is completed. The management terminal 20 requests the verification result from the server 10 (step S215). Then, the communication unit 130 of the server 10 receives the information representing the request and transmits the information to the calculation unit 160.

Then, the calculation unit 160 calculates the statistical value of the reaction index acquired by the index acquisition unit 140 (step S217). Here, the calculation unit 160 calculates a statistical numerical value based on a plurality of reaction indexes acquired for the moving image to be evaluated. For example, the calculation unit 160 calculates a statistical value such as the difference between the maximum value and the average value of the reaction index per unit time or the average value of the reaction index per unit time. The calculation unit 160 transmits the calculation result to the generation unit 150.

Next, the generation unit 150 generates display data including the calculation result (step S219). Specifically, the generation unit 150 generates display data for displaying the calculation result of the calculation unit 160 in addition to the graph showing the reaction index with respect to the playback time of the moving image as shown in FIG. .. In addition, when a plurality of moving image data are evaluated, the generation unit 150 may generate display data showing graphs and calculation results of each of the plurality of moving image data. The generation unit 150 transmits the generated display data to the communication unit 130.

The communication unit 130 of the server 10 transmits the display data generated in step S219 to the management terminal 20 (step S221). When the communication unit 220 of the management terminal 20 receives the display data, the communication unit 220 transmits the display data to the display unit 230. Then, the display unit 230 displays a display screen showing the survey result based on the display data (step S223). On the display screen, for example, a graph and a calculation result of each of the two moving images to be evaluated are displayed. This allows the administrator to compare the emotional transitions that occur in the surveyed person for the two videos. The display data includes graphs and calculation results relating to three or more moving images to be evaluated, and these graphs and calculation results may be displayed on the display unit 230.

The processing by the information processing system 1 according to the present embodiment has been described above. According to the information processing system 1 according to the present embodiment, the manager can recognize the relationship between the reaction index and the time information. Therefore, the administrator can easily verify how the reaction changes when the viewer is watching the moving image.

As a conventional method of investigating the reaction of viewers to videos, there is a method of taking a questionnaire about the impressions of the videos to the viewers who watched the videos. However, since such a survey is conducted after watching the video, it is difficult to know what kind of emotion occurred at what time in the video. According to the information processing system 1 according to the present embodiment, it is possible to know what kind of reaction was given to the viewer at what timing when the moving image is being played back.

In the following, the uses of the survey results obtained as described above will be described. Specifically, a method of using the survey results for editing a moving image will be described.

Here, it is assumed that a moving image used as an advertisement (hereinafter, also simply referred to as “advertising moving image”) is created. First, before the advertisement video is created, it is assumed that a video of a storyboard showing the outline of the advertisement video to be created is created. The storyboard video includes a plurality of images and sounds obtained by cutting out some scenes in the created advertisement video. When the moving image of the storyboard is played back, the displayed image is switched at predetermined time (for example, several seconds), and the sound is output.

The creator of the advertising video creates the advertising video based on the viewer's reaction to the played storyboard video. Specifically, the moving image creator can evaluate a plurality of moving images by using the information processing system 1 described above. Here, it is assumed that the moving image creator evaluates three moving images (first to third moving images). For example, these three videos are assumed to be videos related to a press conference. In these videos, it is assumed that there is a difference, for example, that the person holding the press conference is crying or not crying.

Here, each of the three moving images is viewed by a predetermined number of users using the information processing system 1, and the calculation unit 160 of the server 10 determines the average value of the reaction index per unit time (hereinafter, "average reaction"). (Also referred to as "index") is calculated, and it is assumed that the average reaction index of the first moving image is 15.4, the average reaction index of the second moving image is 13.9, and the average reaction index of the third moving image is 16.7. .. Based on these average reaction indexes, the video creator can infer that the third video has the greatest influence on the viewer's emotions among these three videos. For example, if the third video is a video showing a person holding a press conference crying, the viewer is crying when the person is crying than when the person is not crying. It can be inferred that it is possible to appeal to the emotions of the person and to be convinced. Based on such a guess, the moving image creator can create an advertising moving image that can obtain a more viewer reaction by using the third moving image.

Generally, it costs a lot to create one advertising video. For this reason, it is required to create an advertising video that is commensurate with the cost. By using the information processing system 1 according to the present embodiment, it is possible to evaluate the moving image of the storyboard before creating the advertising moving image and create the advertising moving image according to the evaluation result. Therefore, by using the information processing system 1 according to the present embodiment, it is possible to create a high-quality advertising video that is commensurate with the high cost.

Further, conventionally, when evaluating a moving image of three storyboards as described above, a specific person often watches the moving image and an advertising moving image is created based on the subjectivity of the specific person. According to the information processing system 1 according to the present embodiment, it is possible to evaluate the moving image of the storyboard based on the transition of the reactions of a large number of survey subjects, so that it is possible to create a more appropriate moving image.

In addition, the cost of evaluating a storyboard video as described here is much lower than the cost required to create an advertising video, and can be, for example, about 1% of the cost of creating an advertising video. Therefore, the quality of the moving image can be improved at a low cost, and the cost effectiveness of the moving image creation can be improved.

As described above, the method of evaluating the moving image of the storyboard and creating the moving image has been described using the information processing system 1 according to the present embodiment before creating the advertising moving image. Next, a method of evaluating the already created advertising video using the information processing system 1 according to the present embodiment will be described.

FIG. 10 shows a part of the image used in the already created advertising video. In the example shown in FIG. 10, the first image 500, the second image 502, the third image 504, and the fourth image 506 are shown in order from the image displayed first. Here, it is assumed that the created advertising video includes four scenes, and the four images shown in FIG. 10 are images representing these four scenes. Here, the video creator enables the user to view the created advertising video by accessing a predetermined site, and investigates the audience rating of the video. Further, the moving image creator evaluates the created advertising moving image by using the information processing system 1 described above.

FIG. 11 is a diagram showing changes in the audience rating and reaction index of the advertising video created by the video creator with respect to the video playback time. Here, the audience rating is a numerical value indicating the percentage of viewers who have played the moving image without leaving until that time. As shown in FIG. 11, the audience rating of the created advertising video rapidly decreases as the video playback time elapses. That is, it can be said that the reproduced advertising video has been stopped in the middle by many viewers.

FIG. 11 also shows the transition of the emotion index of the created advertising video along with the audience rating. Here, a reason index 510 indicated by the shape of a light bulb and an emotion index 512 indicated by a heart symbol are shown. Here, the reason index 510 is a reason index related to the rational judgment of "convinced", and the emotion index 512 is an emotion index related to the feeling of "like". It is assumed that these reaction indexes correspond to the above-mentioned four timings of the moving image reproduction time. As shown in FIG. 11, the reaction index at the second timing after the start of playback of the moving image is 7, which is the sum of the rational index 510 and the emotion index 512, which is higher than the reaction indexes at other timings. That is, it can be said that the viewer's emotions are greatly shaken in the scene corresponding to the second image 502 shown in FIG. On the other hand, the reaction index of the scene corresponding to the first image 500 is lower than the reaction index of the other scenes. Therefore, the moving image creator can presume that the audience rating drops rapidly when the scene of the first image 500 is displayed first.

Therefore, the moving image creator can create a new moving image as shown in FIG. 12 by exchanging the scene corresponding to the first image 500 and the scene corresponding to the second image 502. As a result, it is possible to display a scene that can shake the viewer's emotions at the beginning of the moving image, and it is considered that a decrease in the audience rating can be suppressed.

FIG. 13 is a diagram showing a transition of the audience rating of the originally created advertising video and a transition of the audience rating expected in the newly created advertising video. In FIG. 13, the audience rating of the originally created advertising video is shown by a broken line, and the audience rating expected of the newly created advertising video is shown by a solid line. As shown in FIG. 13, in the newly created advertising video, the scene that shakes the viewer's emotions is displayed first, so that the audience rating is less likely to decrease and the probability that the advertising video is viewed to the end increases. Can be expected.

In general, an advertising video on the Web is not always viewed to the end even if it is played once. For example, a 30-second advertising video is often viewed for only about 15 seconds. Therefore, it is considered that a greater effect can be exhibited by applying the information processing system 1 of the present embodiment to the creation of an advertisement moving image on the Web.

Further, according to the information processing system 1 according to the present embodiment, it is possible to evaluate an already created moving image and create a new moving image based on the moving image. Therefore, it is possible to create a video with a high audience rating using an existing video without creating a new video from scratch.

In addition, the viewer of the advertising video is stimulated by watching the advertising video and takes actions such as purchasing the product of the advertisement. At this time, when the viewer receives a stimulus, the viewer takes the above-mentioned action according to the reaction (emotion generated in the advertising video, etc.) based on the stimulus. With the conventional technology, it has been possible to investigate the viewer's stimulus based on the audience rating, the viewer's behavior based on the number of visits to the site related to the advertising video, and the like. There is a viewer's reaction to the advertising video between the viewer's stimulus and the viewer's behavior. Conventionally, as a method of investigating the reaction, there has been a brand lift survey that investigates the feelings toward the brand between those who have touched the advertisement of a specific brand and those who have not. According to the information processing system 1 according to the present invention, it becomes possible to verify the transition of the reaction of the viewer based on the stimulus by viewing the advertisement moving image. Further, by modifying the advertisement video as described above based on the reaction of the viewer, the audience rating of the advertisement video can be further improved, and the effect of the advertisement video can be enhanced.

The embodiments described above are for facilitating the understanding of the present invention, and are not for limiting and interpreting the present invention. Each element included in the embodiment and its arrangement, material, condition, shape, size, etc. are not limited to those exemplified, and can be changed as appropriate. In addition, the configurations shown in different embodiments can be partially replaced or combined.

The processes in the flowcharts shown in FIGS. 7 and 8 may not be performed in the order shown in these flowcharts. Each process may be carried out in an order in which they are appropriately replaced within a consistent range, or may be carried out in parallel. For example, in the process shown in FIG. 7, in the process of adding the reaction image to the moving image data in step S115, after the process of transmitting the moving image data to the server 10 (that is, the process in step S107) is performed, the moving image data is generated. It may be executed at any timing until the process transmitted to the user terminal 30 (that is, the process in step S117) is performed. For example, the process of adding the reaction image to the moving image data may be performed on the server 10 immediately after the process of step S107 is performed.

1 ... Information processing system, 10 ... Server, 11 ... Processor, 12 ... Storage device, 14 ... Input device, 15 ... Output device, 20 ... Management terminal, 30 ... User terminal, 35 ... Network, 120 ... Grant unit, 130 ... Communication unit, 140 ... Index acquisition unit, 150 ... Generation unit, 160 ... Calculation unit, 210 ... Input unit, 220 ... Communication unit, 230 ... Display unit, 400 ... Display screen, 402 ... Movie, 404 ... First reaction image, 406 ... 2nd reaction image, 410 ... Display screen, 412 ... Movie, 500 ... 1st image, 502 ... 2nd image, 504 ... 3rd image, 506 ... 4th image, 510 ... Reason index, 512 ... Emotion index

Claims (7)

The video acquisition department that acquires video data and
An giving unit that gives an image for acquiring the reaction of a user who watches a moving image based on the moving image data to the moving image, and
A playback unit that causes the user's communication terminal to play the moving image together with the image,
An information acquisition unit that acquires information on the operation and information on the playback time of the moving image based on the user's operation on the image when the moving image is being played.
A generation unit that generates display data for displaying information related to the operation in association with the playback time of the moving image.
Information processing device. A calculation unit for calculating a statistical value of an index related to the reaction based on the information related to the operation is further provided.
The information processing device according to claim 1. The statistical value is the difference between the maximum value and the average value of the index related to the reaction per unit time.
The information processing device according to claim 2. The statistical value is the average value of the index for the reaction per unit time.
The information processing device according to claim 2. The information acquisition unit acquires information on the reaction associated with information that can identify the user.
The information processing device according to any one of claims 1 to 4. Acquiring video data and
An image for acquiring the reaction of a user who watches a video based on the video data is added to the video, and
Playing the moving image together with the image on the communication terminal of the user,
Acquiring information on the operation and information on the playback time of the moving image based on the user's operation on the image while the moving image is being played.
To generate display data for displaying information related to the operation in association with the playback time of the moving image.
Information processing methods, including. On the computer
Acquiring video data and
An image for acquiring the reaction of a user who watches a video based on the video data is added to the video, and
Playing the moving image together with the image on the communication terminal of the user,
Acquiring information on the operation and information on the playback time of the moving image based on the user's operation on the image while the moving image is being played.
To generate display data for displaying information related to the operation in association with the playback time of the moving image.
A program to execute.

Images