JP4069392B2 - Content reproduction apparatus and content presentation control method - Google Patents

Description

This invention relates to an apparatus for reproducing contents from a recording medium such as DVD (Digital Versatile Disc), and relates to the content presentation control method when reproducing content in the content reproduction apparatus.

  In the present invention, at least one of video information and audio information is defined as content. In addition, video information includes all information visually recognizable by humans, such as moving images, still images, graphics, etc., and acoustic information includes all information that can be recognized by humans, such as music, speech, and natural sounds. Information.

  Determining the story development of a content by an instruction or operation of a viewer (user) is performed by a DVD system, a video game system, or the like.

  In the DVD system, the parental lock function that can remove violent scenes from the presented content according to the level value set in advance by the viewer, and images of concerts and sports, etc. There is a multi-angle function that allows you to select and view videos.

  Specifically, the parental lock function is to play back the scenes and shot connections prepared for each viewer level as content according to the viewer level set in the playback device, The multi-angle function is a function that allows a viewer to appropriately switch and view videos recorded at a plurality of camera angles.

  In the video game system, story development is determined according to the player's operation, and the game proceeds.

  In addition, as a method for observing or investigating the reaction and evaluation of viewers (audiences) with respect to contents recorded on a recording medium such as a movie, a TV (television) program, or a DVD, a preview has been conventionally used for movies. Going to the audience and observing facial expressions and actions such as laughter and surprises, or using questionnaires to listen to the audience's impressions and opinions. For TV programs, etc. The audience rate (reception occupancy rate) of each product is investigated, and the viewer's preferences are analyzed. The content recorded on the recording medium is examined for sales by date and sales area, A method of counting is taken.

  However, in the conventional content presentation control method described above, the impression and evaluation intended by the content provider (creator) can be viewed only by selecting the video and changing the story development of the content in accordance with the viewer's instructions and operations. Cannot be given to a person. For example, if the viewer does not show the interest or interest as expected by the content provider with respect to the presented content, the presentation of the content is controlled so as to make the viewer more interested or interested It is not possible.

SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to enable an apparatus for reproducing content to give a viewer an impression and evaluation intended by the content provider.

  In addition, in the first method for movies and the like, which is the above-described conventional method for collecting, analyzing, and collecting and managing the reaction and evaluation of viewers (audience) with respect to content, an internal reaction that is difficult to appear in the expressions and actions of the audience Oversight and cannot measure physiological responses, so it is not possible to know in detail and specifically how the viewer felt about the content, and what the impressions were, and in particular, many audiences Cannot be obtained and analyzed frequently and continuously.

  In addition, in the second method for TV programs and the like, it is possible to know only the audience rating for each time zone, and it is impossible to know what impression the viewer has viewed the program. For this reason, it is impossible to accurately grasp the popularity of the program and obtain an index for continuously revising the program and an index for the subsequent program production. The same applies to the third method for the content recorded on the recording medium.

Therefore, in [Best Mode for Carrying Out the Invention], which will be described later, contents including internal and physiological reactions that are difficult to appear in the viewer's facial expressions and actions, and for each presentation time zone of the content, In addition to knowing viewer ratings in detail and accuracy, it is possible to obtain and analyze the ratings of many viewers frequently and continuously. An apparatus and method that can reliably obtain an index for content production are also disclosed .

The content playback apparatus of the present invention
Reproduction means for reproducing the content and the assumed evaluation value from a recording medium in which the content that is at least one of video information and audio information and the evaluation value assumed for the content are recorded;
A reaction value input means for inputting the reaction of the viewer to the reproduced content as a reaction value;
A recognition evaluation value calculating means for calculating a viewer's evaluation of the content reproduced by the reproducing means as a recognition evaluation value from the input reaction value;
In order to change the recognition evaluation value so that the difference between the estimated evaluation value and the recognition evaluation value is within an allowable range by comparing the calculated recognition evaluation value and the assumed evaluation value reproduced by the reproducing unit. Control evaluation value calculating means for calculating the control evaluation value of
Control means for controlling the reproduction of the content from the recording medium by the reproduction means so that the difference between the assumed evaluation value and the recognition evaluation value is within an allowable range according to the calculated control evaluation value;
It is characterized by providing.

  In the above content reproduction apparatus, instead of the reaction value input means and the recognition evaluation value calculation means, a recognition evaluation value input means for inputting the viewer's evaluation of the content reproduced by the reproduction means as a recognition evaluation value is provided, and the control is performed. The evaluation value calculation means compares the input recognition evaluation value with the assumed evaluation value reproduced by the reproduction means, and recognizes and evaluates so that the difference between the assumed evaluation value and the recognition evaluation value is within an allowable range. It is good also as a structure which calculates the control evaluation value for changing a value.

  In the content reproduction apparatus having the above-described configuration, the viewer can be given the impression and evaluation intended by the content provider.

As described above, according to the present invention , an impression and evaluation intended by a content provider can be given to the viewer, and the content reproduction characteristics and stories can be estimated by estimating matters that the viewer is interested in. The development can also be changed in a direction in which the viewer shows interest.

[Embodiment of Content Presentation Control: FIGS. 1 to 9]
As a first embodiment, a case where the presentation of content is controlled according to the viewer's evaluation of the reproduced or received content will be described below.

(Example of content playback apparatus: FIG. 1)
FIG. 1 shows an example of an optical disc playback apparatus as a content playback apparatus according to the first embodiment.

  In this example, content and assumed evaluation values are recorded on the optical disc 1. The content in this case is video information and audio information such as a movie. Specifically, video data and audio data are compressed and encoded by the moving picture experts group (MPEG) method, multiplexed, and recorded on the optical disc 1. It is recorded.

  As will be described later, the assumed evaluation value is a content provider (producer) assuming an impression or evaluation of the content when the viewer views the content, and the assumed evaluation value data is encoded. In this example, the video data and the audio data are multiplexed and recorded on the optical disc 1.

  Specifically, the assumed evaluation value data is multiplexed for each GOP (Group Of Picture) of the MPEG stream or for each picture of the MPEG stream. In any case, for example, the time axis of the assumed evaluation value multiplexed can be managed by referring to the reproduction time management information of the GOP or the picture.

  As another example of managing the time axis of the assumed evaluation value, data describing the assumed evaluation value and time information such as the start time and end time, or the start time and duration, as in this example The video data and the audio data can be multiplexed and transmitted, or the video data and the audio data can be transmitted separately as described later.

  As an example, description data of a scene “flower” having a three-dimensional assumed evaluation value (attention level 50, beauty 40, stimulation level 5) expressed by a start time (1 minute 25 seconds) and a duration time (13 seconds) The description data as shown in FIG. 9 can be used, and this description data is multiplexed with video data and audio data and transmitted, or transmitted separately from the video data and audio data via a wired line or a wireless line. .

  Furthermore, the optical disc 1 stores decoding time information such as a decoding time stamp and content presentation time information (reproduction time information) such as a presentation time stamp.

<Outline of playback device>
The optical disk 1 is driven by a disk motor 3. The optical head (pickup) 4 is driven by a drive unit 5 including a feed motor and tracking and focusing actuators.

  The system controller 7 instructs the drive unit 5 to play the optical disc 1 by the playback operation of the viewer using the operation unit 6, and the optical head 4 reads a signal from the optical disc 1. The read signal is demodulated by the demodulation / error correction unit 11, corrected for error, written to the buffer 12, and read from the buffer 12.

  The signal read from the buffer 12 is supplied to the demultiplexer 13, and the encoded video data, audio data, caption data, and assumed evaluation value data are obtained separately from the demultiplexer 13.

  The video data, audio data, caption data, and assumed evaluation value data are written in the video code buffer 21, the audio code buffer 31, the caption code buffer 41, and the assumed evaluation value code buffer 51, respectively. After being read from the buffer 31, the caption code buffer 41, and the assumed evaluation value code buffer 51, they are decoded by the video decoder 22, the audio decoder 32, the caption decoder 42, and the assumed evaluation value decoder 52, respectively.

  The system controller 7 controls the decoding timing in each of the decoders 22, 32, 42, 52 based on the timing information such as the above decoding time stamp, and based on the timing information such as the above presentation time stamp. The output timing in each decoder 22, 32, 42, 52 is controlled so that the time series of the data from each decoder 22, 32, 42, 52 is matched.

  The video data from the video decoder 22 and the caption data from the caption decoder 42 are supplied to the video processing unit 23, and the video characteristics are controlled by the video processing unit 23 by a characteristic control signal from the system controller 7 as will be described later. In addition, the caption signal is superimposed on the video signal.

  The video signal output from the video processing unit 23 is led to the video output terminal 24, and is transmitted from the video output terminal 24 to a video display device such as a CRT display or a liquid crystal video projector.

  The video signal is sent to a video display device having a D / A (Digital to Analog) conversion unit as it is without being converted into an analog video signal by the video processing unit 23, or analog by the video processing unit 23. It is converted into a video signal and sent to a video display device.

  The acoustic data from the audio decoder 32 is supplied to the audio processing unit 33, and the acoustic characteristics are controlled by the audio processing unit 33 by a characteristic control signal from the system controller 7 as will be described later.

  The acoustic signal output from the audio processing unit 33 is derived to the audio output terminal 34 and is transmitted from the audio output terminal 34 to an acoustic output device such as a speaker or headphones.

  The audio signal is also sent to an audio output device including a D / A converter without being converted into an analog audio signal by the audio processor 33, or converted into an analog audio signal by the audio processor 33. And sent to the sound output device.

  When content is reproduced from the optical disc 1, the reaction of the viewer who has watched the video displayed on the video display device and the sound output from the audio output device is input from the reaction value input unit 61 as a reaction value. The system controller 7 measures the viewer's reaction by the reaction value input unit 61 simultaneously with the reproduction of the content from the optical disc 1.

  The reaction value input from the reaction value input unit 61 is analyzed by the reaction value analysis unit 62, and another reaction value is calculated by the reaction value analysis unit 62. Further, the recognition evaluation value calculation unit 63 uses the reaction value input from the reaction value input unit 61 and the reaction value calculated by the reaction value analysis unit 62, and the viewer's impression and evaluation on the content reproduced from the optical disc 1. A recognition evaluation value indicating is calculated.

  Further, the control evaluation value calculation unit 53 compares the assumed evaluation value obtained from the optical disc 1 and decoded by the assumed evaluation value decoder 52 with the recognition evaluation value calculated by the recognition evaluation value calculation unit 63. Is evaluated, and a control evaluation value is calculated.

  The system controller 7 generates a control signal for controlling the reproduction characteristics of the content and a control signal for changing the story development of the content from the control evaluation value calculated by the control evaluation value calculation unit 53, and uses the former control signal. It is sent to the video processing unit 23 and the audio processing unit 33 to control the reproduction characteristics of video and sound, and the latter control signal is sent to the drive unit 5 to change the reproduction place and reproduction order of the optical disc 1.

  In FIG. 1, the reaction value input unit 61, the reaction value analysis unit 62, the recognition evaluation value calculation unit 63, the control evaluation value calculation unit 53, and the system controller 7 are shown functionally separated. The signal processing of the input unit 61 and the functions of the reaction value analysis unit 62, the recognition evaluation value calculation unit 63, and the control evaluation value calculation unit 53 can be configured as a part of the function of the system controller 7.

<Assumed evaluation value>
The assumed evaluation value recorded on the optical disc 1 assumes the impression and evaluation of the content when the viewer views the content, and the type and brightness of the video to be presented, the type and level of the sound to be presented ( This is set by the content provider (creator) in consideration of the volume of the sound) and the story development of the content to be presented.

  In many cases, the presented content is narrative, and the psychological state of the presented viewer usually changes depending on the story development. Therefore, even for the same video and sound, it is expected that impressions and evaluations such as how to feel and interpret it differ depending on the scene. Therefore, the assumed evaluation value is based on content such as scenes and shots of content, taking into account the video and audio characteristics (physical properties such as video brightness and sound level) as well as the narrative nature of the presented content. Set for each break. Naturally, scenes and shots that the viewer wants to pay attention to are audibly devised so that the recognition evaluation value indicating the degree of interest and the degree of interest is high, so the estimated evaluation value of the scene or shot is also high. Will be set.

  The assumed evaluation value can also be expressed as multidimensional data. In that case, an identifier indicating the meaning of the dimension is added before the assumed evaluation value data of each dimension.

<Measurement of reaction value and calculation of recognition evaluation value>
The reaction value input unit 61 includes various sensors and a signal processing unit, and the signal processing unit obtains a reaction value by performing arithmetic processing such as differentiation, integration, and correlation calculation on the sensor output measurement data. It is done.

  However, the reaction value input unit 61 may include only a sensor portion and an interface portion, and the reaction value may be calculated by processing the sensor output by the system controller 7.

  Sensors that measure the viewer's reaction are attached to the seating surface, backrest, armrest, etc. of the seat where the viewer sits, the earpads and headbands of the headset worn by the viewer, and the remote commander operated by the viewer .

  The reaction value includes data itself measured as a viewer's reaction and data obtained by analyzing the measurement data from the reaction value input unit 61 by the reaction value analysis unit 62.

  Specifically, the items to be measured as the viewer's response are electrocardiogram, respiratory rate, respiratory cycle, electromyogram, cerebral blood flow, brain wave, sweating, skin temperature, pupil diameter, eye openness, blink, facial expression, limbs These include blood flow, earlobe blood flow, and limb temperature.

  In addition, in a movie, a game, a viewer-participating drama in the case of a broadcast receiving apparatus to be described later, as a reaction value, a value obtained by observing the viewer's active behavior, for example, the pitch of the sound generated by the viewer The frequency and the variation thereof, the loudness and variation of the voice, the smoothness of the movement when moving the operation lever, the magnitude of the force, and the like can be used.

  The data obtained by analyzing these measurement data in the reaction value analysis unit 62 is, for example, data indicating a time interval without blinking calculated from data indicating the blinking time point, and the degree of eye opening and blinking. This is data indicating a laughing interval calculated from a change in time, a facial expression of the mouth, and the like.

  Furthermore, the reaction value analysis unit 62 can calculate data indicating a surprising interval from the degree of eye opening, changes in pupil diameter, and electromyogram (muscle tension of limbs), and the amount of sweat, heart rate, and Data indicating a tension section can be calculated from the degree of increase, change in pupil diameter, change in blood flow in the limbs, change in temperature in the limbs, and the like.

  As a method for calculating a new response value from a plurality of measurement data, a method of linearly combining the measurement data can be used.

  The recognition evaluation value calculation unit 63 calculates the viewer's impression and evaluation of the content as the recognition evaluation value from the reaction value input from the reaction value input unit 61 and the reaction value calculated by the reaction value analysis unit 62. .

  As specific recognition evaluation values, an evaluation value indicating interest or degree of interest, an evaluation value indicating impression strength, an evaluation value indicating the degree of preference, an evaluation value indicating the degree of fear, and the like are calculated. .

  The recognition evaluation value indicating the degree of interest and the degree of interest is calculated as a function of the degree of eye opening, the degree of blinking, the heart rate, and the like. The recognition evaluation value indicating the strength of the impression is calculated as a function of the degree of eye opening, heart rate, sweating, and the like. The recognition evaluation value indicating the degree of preference is calculated from the stability of the heart rate, the stability of the sweat rate, the temperature of the limbs, the blood flow volume of the limbs, and the like. The recognition evaluation value indicating the degree of fear is calculated from the degree of surprise and the degree of tension.

  The recognition evaluation values here are defined and calculated in consideration of the meaning of recognition, and are not necessarily independent of each other.

  Similar to the assumed evaluation value, the recognition evaluation value can also be expressed as multidimensional data. In that case, an identifier indicating the meaning of each dimension is added to obtain recognition evaluation value data. In this case, the comparison between the estimated evaluation value expressed as multidimensional data and the recognition evaluation value expressed as multidimensional data in the control evaluation value calculation unit 53 is, for example, the direction and the size of the multidimensional vector. By comparing.

  The reaction value and the recognition evaluation value can be measured or calculated from moment to moment, but may be measured or calculated for each segment of content such as a scene or shot of the presented content. In this case, the information indicating the section such as a scene or shot may be recorded on the optical disc 1 together with the content. However, the system controller 7 detects the section such as the scene and shot from the reproduced video and audio characteristics. It can also be set as the structure to do.

<Calculation of control evaluation value and content presentation control>
The viewer's psychological state with respect to the presented content can be understood by looking at various reaction values or recognition evaluation values calculated therefrom. In addition, by comparing the assumed evaluation value set in advance by the content provider with the recognition evaluation value calculated from various reaction values, whether the viewer is in a psychological state as expected by the content provider. I understand.

  In the first embodiment, the comparison result between the assumed evaluation value and the recognition evaluation value is also actively used for content presentation control.

  Specifically, as a result of comparing the estimated evaluation value and the recognition evaluation value, for example, when it is determined that the viewer is not scared more than expected, the brightness of the video in the subsequent scenes and shots, the sound level, etc. Change the audiovisual characteristics, or change the story development later.

  Further, for example, when it is determined that the viewer is not enjoying more than expected, less interested than expected, or less concentrated on the scene than expected, the subsequent story development is changed.

  One way to change the story development is to insert a scene that implies a later development or a scene that can be predicted from a previous scene so that the story development can be predicted. As a result, the viewer's attention to the story can be increased. Or, conversely, by changing or deleting the scene contents that suggest the story development, the story development cannot be easily predicted, and the story development is not bored.

  When changing a story, a scene, or a shot, it is possible to refer to the history of past reaction values or recognition evaluation values indicated by the viewer. The history stores the response value or recognition evaluation value for another content that the viewer has viewed in the past, even if the response value or recognition evaluation value for the content presented at that time has been stored. You may have used it.

  Specifically, in the example of FIG. 1, content is read from the optical disc 1 and decoded so that it can be output to a video display device and an audio output device, and at the same time, an assumed evaluation value for each scene or shot is read from the optical disc 1. It is.

  The assumed evaluation value read from the optical disc 1 is associated with the content presentation time information. Therefore, for example, the system controller 7 determines that the estimated evaluation value is 40 in the meaning indicated by the identifier from the presentation time 01:25:30 to the presentation time 01:26:20. An assumed evaluation value can be recognized.

  On the other hand, at the same time that the content is decoded and played back, the viewer's reaction is measured as a reaction value, and a recognition evaluation value indicating the viewer's impression and evaluation on the played content is calculated. Then, it is compared with the assumed evaluation value read from the optical disc 1.

  Then, the system controller 7 determines whether the difference between the assumed evaluation value and the recognized evaluation value in the scene or shot to be evaluated is within a preset allowable range based on the comparison result between the assumed evaluation value and the recognized evaluation value. And the difference between the estimated evaluation value and the recognition evaluation value in the past scene or shot is widening or shrinking, or the recognition evaluation value is increasing The tendency of the difference between the assumed evaluation value and the recognition evaluation value and the change of the recognition evaluation value, such as whether it is preferable or not, whether it is preferable to decrease or whether it is preferable to take the local maximum or minimum as the recognition evaluation value Judging.

  For example, even if the difference between the assumed evaluation value and the recognized evaluation value is within the allowable range, if it is large, it is determined that the viewer's reaction (evaluation) is in a direction different from the expected direction.

  Based on such a determination result, the system controller 7 controls the reproduction characteristics of the content and changes the story development of the content.

  The reproduction characteristics of content are brightness, contrast, saturation, hue (hue), etc. for video, and frequency characteristics, levels, etc. for sound.

  The story development is changed by, for example, a method of presenting a scene by selecting one from a plurality of scenes or by exchanging some shots constituting the scene. .

  In order to change the story development, the scene or shot can be replaced at any time, but the scene or shot can be replaced only in a predetermined scene.

  In order to control the flow of how the viewer feels about the content, an index relating to the meaning and direction of recognition evaluation, such as “consecutive rollover”, is attached in advance to the plurality of selectable scenes, and the system controller 7 The optical disc reproducing apparatus is configured to select a scene to be presented from the index and the comparison result between the assumed evaluation value and the recognition evaluation value.

  Similarly, for shot replacement, an optical disc reproducing apparatus is provided so that a shot index is attached and a shot constituting the scene is selected from the index and a comparison result between the assumed evaluation value and the recognition evaluation value. Configure.

<Effect>
According to the above example, it is possible to give the viewer the impression and evaluation expected by the content provider, such as wanting the viewer to feel or want to be interested. In addition, based on the difference between the assumed evaluation value and the recognition evaluation value and the tendency of the recognition evaluation value to change, the viewer can infer the interests and interests, and the content reproduction characteristics and story development. It is also possible to change the direction to indicate.

(Other examples of content playback apparatus: FIGS. 2 to 4)
The example of FIG. 1 is a case where the recognition evaluation value calculation unit 63 calculates the recognition evaluation value from the reaction value from the reaction value input unit 61. The viewer directly inputs the recognition evaluation value for each item. You can also

  FIG. 2 shows an example of this case, and a recognition evaluation value input unit 64 is provided instead of the reaction value input unit 61, the reaction value analysis unit 62, and the recognition evaluation value calculation unit 63 in the example of FIG.

  The recognition evaluation value input unit 64 is configured such that, for example, the viewer inputs the recognition evaluation value for each item numerically such that the degree of interest is “−2” and the degree of preference is “+3”. Alternatively, a lever is provided for each item of the recognition evaluation value, and the viewer slides each lever in the plus direction or the minus direction.

  Alternatively, the recognition evaluation value input unit 64 is composed of a microphone and a signal processing unit having a voice recognition function, so that the viewer can recognize each item such as “not interested at all” or “very preferable”. The evaluation value can also be input by voice.

  This example can also give viewers the impressions and evaluations intended by the content provider, as well as inferring the viewer's interests and interests, and the viewer can determine the playback characteristics and story development of the content. It can also be changed in the direction of interest.

  The example of FIGS. 1 and 2 is a case where content and an assumed evaluation value are recorded on the optical disc 1, but the assumed evaluation value may be received from a transmission source separately from the content.

  FIG. 3 shows an example of this case. The optical disc 1 is the same as the example of FIGS. 1 and 2 except that the assumed evaluation value is not recorded.

  However, in order to verify whether or not the assumed evaluation value received from the transmission source is a pair with the content recorded on the optical disc 1, content identification information is recorded on the optical disc 1, and content reproduction is performed. At the start time, the content identification information is read from the optical disc 1 and taken into the system controller 7.

  The optical disk reproducing device is provided with a communication device unit 54 connected to a communication network 9 such as the Internet, and the system controller 7 that has received the content identification information corresponds to the content identification information to the communication device unit 54. An instruction to send a signal requesting assumed evaluation value data to the transmission source is given.

  In response to this instruction, the communication device unit 54 secures a communication line with the transmission source and requests the assumed evaluation value data corresponding to the content identification information from the transmission source. If the communication line cannot be secured, the communication device unit 54 notifies the system controller 7 of an error. Even when it is found as a result of communication with the transmission source that the assumed evaluation value data for which the transmission source is designated cannot be transmitted, the communication device unit 54 notifies the system controller 7 of an error.

  The assumed evaluation value data transmitted from the transmission source and received by the communication device unit 54 is written in the assumed evaluation value code buffer 51, read from the assumed evaluation value code buffer 51, and then decoded by the assumed evaluation value decoder 52. Is done.

  Reaction value measurement by reaction value input unit 61, calculation of reaction value by reaction value analysis unit 62, calculation of recognition evaluation value by recognition evaluation value calculation unit 63, calculation of control evaluation value by control evaluation value calculation unit 53 The content presentation control based on the control evaluation value (control of content reproduction characteristics and change of story development) is the same as the example of FIG.

  If the assumed evaluation value data received once is stored, the next time the same content is reproduced, it is not necessary to receive the assumed evaluation value data again. Therefore, the system controller 7 receives the necessary evaluation value data as necessary. The playback device may be configured to store the estimated evaluation value data in association with the content identification information in a storage device unit in the playback device or an external storage device attached to or connected to the playback device.

  In this example as well, the viewer can directly input the recognition evaluation value for each item.

  FIG. 4 shows an example of this case, and a recognition evaluation value input unit 64 is provided instead of the reaction value input unit 61, the reaction value analysis unit 62, and the recognition evaluation value calculation unit 63 in the example of FIG. The specific configuration of the recognition evaluation value input unit 64 is the same as the example of FIG.

(Example of content receiving device (broadcast receiving device): FIGS. 5 and 6)
As an example, the content receiving apparatus according to the first embodiment can be configured as an apparatus that receives a digital TV broadcast such as a BS digital broadcast.

  In digital TV broadcasting, a program ID (identifier), a program name, and the like are broadcast as content identification information, and information inserted into a program, scene, or shot to describe its video characteristics, acoustic characteristics, etc., so-called metadata Can be broadcast.

  FIG. 5 shows an example of a broadcast receiving apparatus. In this example, as a digital TV broadcast, the broadcast is performed so that the assumed evaluation value data is broadcast by being multiplexed with the content (program video data and audio data) and the story development of the content can be changed by the broadcast receiving device. It is assumed that a plurality of scenes or shots that can be selected by the receiving device are broadcast.

  In the reception channel selection unit 71, a broadcast signal including assumed evaluation value data is received and selected by channel selection control of the system controller 7 based on the channel selection operation in the operation unit 6. The received and tuned signal is demodulated and demodulated by the demodulation / error correction unit 72, written to the storage device unit 73, and read from the storage device unit 73. The storage device 73 functions as a buffer, but is for selecting a scene or a shot for changing the story development of the content.

  The signal read from the storage device unit 73 is supplied to the demultiplexer 13, and the encoded video data, audio data, caption data, and assumed evaluation value data are separately obtained from the demultiplexer 13. Others are the same as those of the optical disk reproducing apparatus in the example of FIG.

  In this broadcast receiving apparatus, the story development of the content is changed by selecting a scene or shot read from the storage device unit 73 under the control of the system controller 7 based on the control evaluation value.

  When measuring or calculating the reaction value or the recognition evaluation value for each scene or shot of the content (program), the information indicating the section of the scene or shot may be broadcast together with the content, but the reproduced video In addition, the system controller 7 may be configured to detect a scene or a shot section from the characteristics of sound and sound.

  The broadcast receiving apparatus can also be configured such that the viewer directly inputs the recognition evaluation value for each item.

  FIG. 6 shows an example of this case, and a recognition evaluation value input unit 64 is provided instead of the reaction value input unit 61, the reaction value analysis unit 62, and the recognition evaluation value calculation unit 63 in the example of FIG. The specific configuration of the recognition evaluation value input unit 64 is the same as that of the optical disc playback apparatus in the example of FIG.

(Other examples of content receiving apparatus: FIGS. 7 and 8)
As another example, the content receiving apparatus according to the first embodiment may be configured as an apparatus that receives content and an assumed evaluation value transmitted from a transmission source in response to a content transmission request.

  FIG. 7 shows an example of the content receiving apparatus in this case. In this content reception device, the transmission device unit 85 requests transmission of content and assumed evaluation value data from the transmission source via the communication network 9 such as the Internet, and the reception device unit 81 transmits the communication via the communication network 9. The contents and assumed evaluation value data are received from the source.

  Based on the operation at the operation unit 6, the system controller 7 sends content identification information to the transmission device unit 85, and sends a signal requesting the corresponding content and assumed evaluation value data to the transmission source. Instruct.

  Upon receiving this instruction, the transmission device unit 85 secures a communication line with the transmission source, and requests the content corresponding to the content identification information and assumed evaluation value data from the transmission source. When the communication line cannot be secured, the transmission device unit 85 notifies the system controller 7 of an error. Even when it is found as a result of communication with the transmission source that the content designated by the transmission source and the assumed evaluation value data cannot be transmitted, the transmission device unit 85 notifies the system controller 7 of an error.

  The content and the assumed evaluation value data transmitted from the transmission source and received by the reception device unit 81 are demodulated by the demodulation / error correction unit 82, corrected for error, written to the storage device unit 83, and stored in the storage device unit 83. Read from.

  It is assumed that the transmission source transmits a plurality of scenes or shots that can be selected by the content receiving device so that the content story development can be changed by the content receiving device. The storage unit 83 functions as a buffer, but is for selecting a scene or a shot for changing the story development of the content.

  The signal read from the storage device unit 83 is supplied to the demultiplexer 13, and the encoded video data, audio data, caption data, and assumed evaluation value data are separately obtained from the demultiplexer 13. Others are the same as the broadcast receiving apparatus of the example of FIG.

  In this content receiving device, the story development of the content is changed by selecting a scene or shot read from the storage device unit 83 under the control of the system controller 7 based on the control evaluation value.

  When the amount of information of content and assumed evaluation value is large, the system can be configured so that the content and assumed evaluation value are transmitted from the transmission source as viewing progresses. The system is configured such that interruption and resumption of transmission of contents and assumed evaluation values are controlled by a time stamp indicating progress and address information.

  Note that once the received content and assumed evaluation value data are stored, it is not necessary to receive the same content and assumed evaluation value data again. Therefore, the system controller 7 may receive the received content and assumed evaluation as necessary. The receiving device may be configured to store the value data in association with the content identification information in a storage device unit in the receiving device or an external storage device attached to or connected to the receiving device.

  The content receiving apparatus in this case can also be configured such that the viewer directly inputs the recognition evaluation value for each item.

  FIG. 8 shows an example of this case, and a recognition evaluation value input unit 64 is provided instead of the reaction value input unit 61, the reaction value analysis unit 62, and the recognition evaluation value calculation unit 63 in the example of FIG. The specific configuration of the recognition evaluation value input unit 64 is the same as that of the optical disc playback apparatus in the example of FIG.

(Other examples of content presentation control)
The above-described invention related to content presentation control can also be applied to a device that reproduces content from a recording medium other than an optical disc, or when the content consists only of video information or only audio information.

[Embodiments of Content Evaluation Collection Analysis: FIGS. 10 to 19]
As a second embodiment, a case where viewer evaluations of content reproduced or received are collected and analyzed will be described below.

(Example of content playback apparatus: FIGS. 10 and 11)
FIG. 10 shows an example of an optical disc playback apparatus as a content playback apparatus according to the second embodiment.

  Content is recorded on the optical disc 1. The content in this case is video information and audio information such as a movie. Specifically, video data and audio data are compressed and encoded by the MPEG method, multiplexed, and recorded on the optical disc 1.

  Furthermore, the optical disc 1 stores decoding time information such as a decoding time stamp and content presentation time information (reproduction time information) such as a presentation time stamp.

<Outline of playback device>
The optical disk 1 is driven by a disk motor 3. The optical head (pickup) 4 is driven by a drive unit 5 including a feed motor and tracking and focusing actuators.

  The system controller 7 instructs the drive unit 5 to play the optical disc 1 by the playback operation of the viewer using the operation unit 6, and the optical head 4 reads a signal from the optical disc 1. The read signal is demodulated by the demodulation / error correction unit 11, corrected for error, written to the buffer 12, and read from the buffer 12.

  The signal read from the buffer 12 is supplied to the demultiplexer 13, and the encoded video data, audio data, and caption data are respectively obtained from the demultiplexer 13 by being separated.

  The video data, audio data, and subtitle data are written to the video code buffer 21, the audio code buffer 31, and the subtitle code buffer 41, respectively, and read from the video code buffer 21, the audio code buffer 31, and the subtitle code buffer 41, respectively. Thereafter, the video decoder 22, the audio decoder 32, and the caption decoder 42 respectively decode the decoded data.

  The system controller 7 controls the decoding timing in each of the decoders 22, 32, and 42 based on the timing information such as the above-mentioned decoding time stamp, and based on the timing information such as the above-mentioned presentation time stamp, The output timing in each decoder 22, 32, 42 is controlled so that the time series of the data from the decoders 22, 32, 42 is matched.

  The video data from the video decoder 22 and the subtitle data from the subtitle decoder 42 are supplied to the video processing unit 23, and the video processing unit 23 superimposes the subtitle signal in the video signal.

  The video signal output from the video processing unit 23 is led to the video output terminal 24, and is transmitted from the video output terminal 24 to a video display device such as a CRT display or a liquid crystal video projector.

  The video signal is sent to a video display device having a D / A converter as it is without being converted into an analog video signal by the video processor 23, or converted into an analog video signal by the video processor 23. And sent to the video display device.

  The acoustic data from the audio decoder 32 is processed by the audio processing unit 33, and the acoustic signal output from the audio processing unit 33 is led to the audio output terminal 34, and from the audio output terminal 34, an acoustic output device such as a speaker or headphones Is sent out.

  The audio signal is also sent to an audio output device including a D / A converter without being converted into an analog audio signal by the audio processor 33, or converted into an analog audio signal by the audio processor 33. And sent to the sound output device.

  When content is reproduced from the optical disc 1, the reaction of the viewer who has watched the video displayed on the video display device and the sound output from the audio output device is input from the reaction value input unit 61 as a reaction value. The system controller 7 measures the viewer's reaction by the reaction value input unit 61 simultaneously with the reproduction of the content from the optical disc 1.

  The reaction value input from the reaction value input unit 61 is analyzed by the reaction value analysis unit 62, and another reaction value is calculated by the reaction value analysis unit 62. Further, the recognition evaluation value calculation unit 63 uses the reaction value input from the reaction value input unit 61 and the reaction value calculated by the reaction value analysis unit 62, and the viewer's impression and evaluation on the content reproduced from the optical disc 1. A recognition evaluation value indicating is calculated.

  The information of the calculated recognition evaluation value is associated with the content presentation time information, and is multiplexed with content identification information, transmission source identification information, and viewer information described later from the system controller 7 in the multiplexing unit 65. Then, the multiplexed data is written into the buffer 66, read out from the buffer 66, and then transmitted to the aggregation center by the communication device unit 67 via the communication network 9 such as the Internet.

  In FIG. 10, the reaction value input unit 61, the reaction value analysis unit 62, the recognition evaluation value calculation unit 63, the multiplexing unit 65, and the system controller 7 are shown functionally separated. The signal processing 61 and the functions of the reaction value analysis unit 62, the recognition evaluation value calculation unit 63, and the multiplexing unit 65 may be configured as a part of the function of the system controller 7.

<Measurement of reaction value and calculation of recognition evaluation value>
The reaction value input unit 61 includes various sensors and a signal processing unit, and the signal processing unit obtains a reaction value by performing arithmetic processing such as differentiation, integration, and correlation calculation on the sensor output measurement data. It is done.

  However, the reaction value input unit 61 may include only a sensor portion and an interface portion, and the reaction value may be calculated by processing the sensor output by the system controller 7.

  Sensors that measure the viewer's reaction are attached to the seating surface, backrest, armrest, etc. of the seat where the viewer sits, the earpads and headbands of the headset worn by the viewer, and the remote commander operated by the viewer .

  The reaction value includes data itself measured as a viewer's reaction and data obtained by analyzing the measurement data from the reaction value input unit 61 by the reaction value analysis unit 62.

  Specifically, the items to be measured as the viewer's response are electrocardiogram, respiratory rate, respiratory cycle, electromyogram, cerebral blood flow, brain wave, sweating, skin temperature, pupil diameter, eye openness, blink, facial expression, limbs These include blood flow, earlobe blood flow, and limb temperature.

  In addition, in a movie, a game, a viewer-participating drama in the case of a broadcast receiving apparatus to be described later, as a reaction value, a value obtained by observing the viewer's active behavior, for example, the pitch of the sound generated by the viewer The frequency and the variation thereof, the loudness and variation of the voice, the smoothness of the movement when moving the operation lever, the magnitude of the force, and the like can be used.

  The data obtained by analyzing these measurement data in the reaction value analysis unit 62 is, for example, data indicating a time interval without blinking calculated from data indicating the blinking time point, and the degree of eye opening and blinking. This is data indicating a laughing interval calculated from a change in time, a facial expression of the mouth, and the like.

  Furthermore, the reaction value analysis unit 62 can calculate data indicating a surprising interval from the degree of eye opening, changes in pupil diameter, and electromyogram (muscle tension of limbs), and the amount of sweat, heart rate, and Data indicating a tension section can be calculated from the degree of increase, change in pupil diameter, change in blood flow in the limbs, change in temperature in the limbs, and the like.

  As a method for calculating a new response value from a plurality of measurement data, a method of linearly combining the measurement data can be used.

  The recognition evaluation value calculation unit 63 calculates the viewer's impression and evaluation of the content as the recognition evaluation value from the reaction value input from the reaction value input unit 61 and the reaction value calculated by the reaction value analysis unit 62. .

  As specific recognition evaluation values, an evaluation value indicating interest or degree of interest, an evaluation value indicating impression strength, an evaluation value indicating the degree of preference, an evaluation value indicating the degree of fear, and the like are calculated. .

  The recognition evaluation value indicating the degree of interest and the degree of interest is calculated as a function of the degree of eye opening, the degree of blinking, the heart rate, and the like. The recognition evaluation value indicating the strength of the impression is calculated as a function of the degree of eye opening, heart rate, sweating, and the like. The recognition evaluation value indicating the degree of preference is calculated from the stability of the heart rate, the stability of the sweat rate, the temperature of the limbs, the blood flow volume of the limbs, and the like. The recognition evaluation value indicating the degree of fear is calculated from the degree of surprise and the degree of tension.

  The recognition evaluation values here are defined and calculated in consideration of the meaning of recognition, and are not necessarily independent of each other.

  The recognition evaluation value can also be expressed as multidimensional data. In that case, an identifier indicating the meaning of each dimension is added to obtain recognition evaluation value data.

  The reaction value and the recognition evaluation value can be measured or calculated from moment to moment, but may be measured or calculated for each segment of content such as a scene or shot of the reproduced content. In this case, the information indicating the section such as a scene or shot may be recorded on the optical disc 1 together with the content. However, the system controller 7 detects the section such as the scene and shot from the reproduced video and audio characteristics. It can also be set as the structure to do.

<Data transmission>
The recognition evaluation value calculated by the recognition evaluation value calculation unit 63 is associated with the content presentation time information, and when it is received at the aggregation center as will be described later, it can be understood which part of the content it is. Is.

  The content identification information is information for specifying content, and is not limited to information added to the content itself. For example, only one content is recorded on the optical disc 1, and disc identification information (information for specifying a disc) is included. When recorded, the disc identification information can be used as content identification information. Further, when only one content is recorded on the optical disc 1 and disc identification information is not recorded, the header information of the disc is determined according to a predetermined rule such as combining the number of chapters contained in the disc and the performance time. The disc identification information can be combined with the content identification information.

  The transmission source identification information is information for specifying a terminal device, in this example, an optical disc playback device as a content playback device, or information for specifying a viewer.

  Information for identifying the terminal device is set in advance in the system controller 7 by the manufacturer of the terminal device. Information for specifying the viewer is set in advance in the system controller 7 by an input operation in the operation unit 6, or the system controller 7 is installed by attaching an external storage medium such as a memory card in which the viewer is written to the terminal device. Set to

  Specifically, the viewer information includes information indicating the attributes of the viewer such as the viewer's age, gender, residential area, and hobbies, and information indicating the history of content viewed by the viewer in the past. The viewer information is set in the system controller 7 in advance by an input operation on the operation unit 6, or is set in the system controller 7 by mounting an external storage medium such as a memory card in which the viewer information is written in the terminal device. The

  The viewer information does not necessarily have to be transmitted. However, when this is transmitted, as described later, how the viewer's evaluation for the same content is evaluated for each viewer attribute as described below. It is possible to perform analysis in consideration of the attributes of viewers, such as whether they are different.

  The recognition evaluation value information, content identification information, transmission source identification information, and viewer information to which the content presentation time information is added have the recognition evaluation value information to which the content presentation time information is added as the data portion, and the transmission source identification information, the viewing information The user information and the content identification information are multiplexed by the multiplexing unit 65 using the header information and the content identification information, and transmitted to the aggregation center by the communication device unit 67.

  The recognition evaluation value information is transmitted every time at predetermined time intervals such as 5 seconds, 30 seconds, etc., or is transmitted together when all the content reproduction is completed. In any case, each of the above information is temporarily stored in the buffer 66 and then transmitted to the aggregation center by the communication device unit 67.

  It can be considered that a long time content such as a movie is viewed by a viewer divided into several times. When the playback is paused in the middle of the content in this way, the system controller 7 holds the information for specifying the stopped location, the recognition evaluation value and the content presentation time information at the location, and the same content. The optical disc playback apparatus is configured to be used for the next content playback and data transmission.

<When the recognition evaluation value is directly input: FIG. 11>
The example of FIG. 10 is a case where the recognition evaluation value calculation unit 63 calculates the recognition evaluation value from the reaction value from the reaction value input unit 61, and the viewer directly inputs the recognition evaluation value for each item. You can also

  FIG. 11 shows an example of this case, and a recognition evaluation value input unit 64 is provided instead of the reaction value input unit 61, the reaction value analysis unit 62, and the recognition evaluation value calculation unit 63 in the example of FIG.

  The recognition evaluation value input unit 64 is configured such that, for example, the viewer inputs the recognition evaluation value for each item numerically such that the degree of interest is “−2” and the degree of preference is “+3”. Alternatively, a lever is provided for each item of the recognition evaluation value, and the viewer slides each lever in the plus direction or the minus direction.

  Alternatively, the recognition evaluation value input unit 64 is composed of a microphone and a signal processing unit having a voice recognition function, so that the viewer can recognize each item such as “not interested at all” or “very preferable”. The evaluation value can also be input by voice.

(Another example of content reproduction apparatus: FIG. 12)
FIG. 12 shows another example of an optical disc playback apparatus as a content playback apparatus according to the second embodiment.

  In this example, an assumed evaluation value for this is recorded on the optical disc 1 along with the content. The assumed evaluation value assumes the impression and evaluation of the content when the viewer views the content. The type and brightness of the video to be presented, the type and level of sound to be presented (sound volume), the presentation This is set by the content provider (creator) in consideration of the story development of the content to be performed.

  In many cases, the presented content is narrative, and the psychological state of the presented viewer usually changes depending on the story development. Therefore, even for the same video and sound, it is expected that impressions and evaluations such as how to feel and interpret it differ depending on the scene. Therefore, the assumed evaluation value is based on content such as scenes and shots of content, taking into account the video and audio characteristics (physical properties such as video brightness and sound level) as well as the narrative nature of the presented content. Set for each break. Naturally, scenes and shots that the viewer wants to pay attention to are audibly devised so that the recognition evaluation value indicating the degree of interest and the degree of interest is high, so the estimated evaluation value of the scene or shot is also high. Will be set.

  The viewer's psychological state with respect to the presented content can be understood by looking at the recognition evaluation value calculated from the various reaction values described above and the time passage thereof. In addition, by comparing the assumed evaluation value set in advance by the content provider as described above with the recognition evaluation value calculated from various reaction values, the viewer's psychological state as expected by the content provider You can see if there is. Furthermore, the comparison result between the assumed evaluation value and the recognition evaluation value can be actively used for content presentation control.

  FIG. 12 shows an example in that case. The assumed evaluation value data is encoded. In this example, the assumed evaluation value data is multiplexed with video data and audio data and recorded on the optical disc 1. The specific method of time axis management and multiplexing of the assumed evaluation value is the same as in the first embodiment related to content presentation control.

<Outline of playback device>
At the same time as the content is reproduced from the optical disc 1, the assumed evaluation value data is read from the optical disc 1. The read estimated evaluation value data is separated by the demultiplexer 13, written to the assumed evaluation value code buffer 51, read from the assumed evaluation value code buffer 51, and then decoded by the assumed evaluation value decoder 52. .

  On the other hand, at the same time as the content is reproduced, the reaction value input unit 61 measures the reaction of the viewer as the reaction value, and the recognition evaluation value calculation unit 63 views the reproduced content, as in the example of FIG. A recognition evaluation value indicating the impression and evaluation of the person is calculated.

  Further, in this example, the system controller 7 compares the assumed evaluation value decoded by the assumed evaluation value decoder 52 with the recognition evaluation value calculated by the recognition evaluation value calculation unit 63, and evaluates the result.

  Similar to the recognition evaluation value, the assumed evaluation value can also be expressed as multidimensional data. In that case, an identifier indicating the meaning of the dimension is added before the assumed evaluation value data of each dimension. When the assumed evaluation value and the recognition evaluation value are expressed as multidimensional data in this way, the comparison between the assumed evaluation value and the recognition evaluation value in the system controller 7 is performed by, for example, comparing the direction and size of the multidimensional vector. By doing.

  The assumed evaluation value read from the optical disc 1 is also associated with the content presentation time information. Therefore, for example, the system controller 7 determines that the estimated evaluation value is 40 in the meaning indicated by the identifier from the presentation time 01:25:30 to the presentation time 01:26:20. An assumed evaluation value can be recognized.

<Content presentation control>
The system controller 7 generates a control signal for controlling the reproduction characteristics of the content and a control signal for changing the story development of the content from the comparison result between the assumed evaluation value and the recognition evaluation value, and the video control unit 23 uses the former control signal. Then, it is sent to the audio processing unit 33 to control the reproduction characteristics of video and sound, and the latter control signal is sent to the drive unit 5 to change the reproduction place and reproduction order of the optical disc 1.

  Specifically, the system controller 7 determines whether or not the difference between the assumed evaluation value and the recognition evaluation value in the scene or shot to be evaluated is within a preset allowable range, and the past scene or shot. Whether the difference between the assumed evaluation value and the recognition evaluation value is widening or shrinking, whether the recognition evaluation value is preferably increasing or decreasing. The difference between the assumed evaluation value and the recognition evaluation value and the tendency of the change in the recognition evaluation value, such as whether it is preferable or whether it is preferable to take the maximum value or the minimum value as the recognition evaluation value, are determined.

  For example, even if the difference between the assumed evaluation value and the recognized evaluation value is within the allowable range, if it is large, it is determined that the viewer's reaction (evaluation) is in a direction different from the expected direction.

  Based on such a determination result, the system controller 7 controls the reproduction characteristics of the content and changes the story development of the content.

  Specifically, from the comparison result of the assumed evaluation value and the recognition evaluation value, for example, when it is determined that the viewer is not scared more than expected, the brightness of the video in the subsequent scene or shot, the sound level, etc. Change the audiovisual characteristics, or change the story development later.

  Further, for example, when it is determined that the viewer is not enjoying more than expected, less interested than expected, or less concentrated on the scene than expected, the subsequent story development is changed.

  One way to change the story development is to insert a scene that implies a later development or a scene that can be predicted from a previous scene so that the story development can be predicted. As a result, the viewer's attention to the story can be increased. Or, conversely, by changing or deleting the scene contents that suggest the story development, the story development cannot be easily predicted, and the story development is not bored.

  When changing a story, a scene, or a shot, it is possible to refer to the history of past reaction values or recognition evaluation values indicated by the viewer. The history stores the response value or recognition evaluation value for another content that the viewer has viewed in the past, even if the response value or recognition evaluation value for the content presented at that time has been stored. You may have used it.

  The reproduction characteristics of content are brightness, contrast, saturation, hue (hue), etc. for video, and frequency characteristics, levels, etc. for sound.

  The story development is changed by, for example, a method of presenting a scene by selecting one from a plurality of scenes or by exchanging some shots constituting the scene. .

  In order to change the story development, the scene or shot can be replaced at any time, but the scene or shot can be replaced only in a predetermined scene.

  In order to control the flow of how the viewer feels about the content, an index relating to the meaning and direction of recognition evaluation, such as “consecutive rollover”, is attached in advance to the plurality of selectable scenes, and the system controller 7 The optical disc reproducing apparatus is configured to select a scene to be presented from the index and the comparison result between the assumed evaluation value and the recognition evaluation value.

  Similarly, for shot replacement, an optical disc reproducing apparatus is provided so that a shot index is attached and a shot constituting the scene is selected from the index and a comparison result between the assumed evaluation value and the recognition evaluation value. Configure.

<When directly entering recognition evaluation values>
Also in this example, a recognition evaluation value input unit is provided instead of the reaction value input unit 61, the reaction value analysis unit 62, and the recognition evaluation value calculation unit 63, and the viewer directly inputs the recognition evaluation value for each item. It can be configured.

(Example of content receiving apparatus (broadcast receiving apparatus): FIGS. 13 and 14)
As an example, the content receiving apparatus of the second embodiment can be configured as an apparatus that receives a digital TV broadcast such as a BS digital broadcast.

  In digital TV broadcasting, a program ID (identifier), a program name, and the like are broadcast as content identification information, and information inserted into a program, scene, or shot to describe its video characteristics, acoustic characteristics, etc., so-called metadata Can be broadcast.

  FIG. 13 shows an example of a broadcast receiving apparatus. In the reception channel selection unit 71, the broadcast signal is received and selected by the channel selection control of the system controller 7 based on the channel selection operation in the operation unit 6. The received and tuned signal is demodulated and demodulated by the demodulation / error correction unit 72, written to the storage device unit 73 that functions as a buffer, and read from the storage device unit 73.

  The signal read from the storage device unit 73 is supplied to the demultiplexer 13, and the encoded video data, audio data, and caption data are separated from the demultiplexer 13 and obtained. Others are the same as those of the optical disc reproducing apparatus in the example of FIG.

  When measuring or calculating the reaction value or the recognition evaluation value for each scene or shot of the content (program), the information indicating the section of the scene or shot may be broadcast together with the content, but the reproduced video In addition, the system controller 7 may be configured to detect a scene or a shot section from the characteristics of sound and sound.

  FIG. 14 shows another example of the broadcast receiving apparatus. In this example, as the digital TV broadcast, it is multiplexed with the content (video data and audio data of the program) and the above-described assumed evaluation value data is broadcast, and the story development of the content can be changed by the broadcast receiving device. Assume that a plurality of scenes or shots that can be selected by the broadcast receiving apparatus are broadcast.

  The reception channel selection unit 71 receives and tunes the broadcast signal including the estimated evaluation value data, and the received channel selection signal is demodulated and demodulated by the demodulation / error correction unit 72 and then stored in the storage unit 73. It is written and read from the storage device unit 73. The storage device 73 functions as a buffer, but is for selecting a scene or a shot for changing the story development of the content.

  The signal read from the storage device unit 73 is supplied to the demultiplexer 13, and the encoded video data, audio data, caption data, and assumed evaluation value data are separately obtained from the demultiplexer 13. Others are the same as those of the optical disc reproducing apparatus in the example of FIG.

  In this broadcast receiving device, the story development of the content is changed by selecting a scene or shot read from the storage device unit 73 under the control of the system controller 7 based on the comparison result between the assumed evaluation value and the recognition evaluation value. It is done.

  Also in the broadcast receiving apparatus of the example of FIG. 13 or FIG. 14, a recognition evaluation value input unit is provided instead of the reaction value input unit 61, the reaction value analysis unit 62, and the recognition evaluation value calculation unit 63 so that the viewer can check each item. The recognition evaluation value can be directly input.

(Other examples of content receiving apparatus: FIGS. 15 and 16)
As another example, the content receiving apparatus according to the second embodiment may be configured as an apparatus that receives content transmitted from a transmission source in response to a content transmission request.

  FIG. 15 shows an example of the content receiving apparatus in this case. In this content receiving device, the communication device unit 89 having a transmission function and a reception function requests the transmission source of the content via the communication network 9 such as the Internet, and the content is transmitted from the transmission source via the communication network 9 to the content. Receive.

  Based on the operation at the operation unit 6, the system controller 7 sends the content identification information to the communication device unit 89 and instructs the transmission source to send a signal requesting the corresponding content.

  Upon receiving this instruction, the communication device unit 89 secures a communication line with the transmission source and requests the content corresponding to the content identification information from the transmission source. If the communication line cannot be secured, the communication device unit 89 notifies the system controller 7 of an error. Even when it is found as a result of communication with the transmission source that the content designated by the transmission source cannot be transmitted, the communication device unit 89 notifies the system controller 7 of an error.

  The content transmitted from the transmission source and received by the communication device unit 89 is demodulated and demodulated by the demodulation / error correction unit 82 and then written to the storage device unit 83 that functions as a buffer. Read out.

  Others are the same as the broadcast receiving apparatus of the example of FIG. However, in the example of FIG. 15, the communication device unit 89 is simultaneously provided with the data transmission function of the communication device unit 67 of the examples of FIGS.

  If the amount of content information is large, the system can also be configured so that the content is transmitted from the transmission source as the viewing progresses. In this case, a time stamp or address information indicating the progress of the content The system is configured such that the interruption and resumption of content transmission are controlled by

  When measuring or calculating a reaction value or a recognition evaluation value for each scene or shot of content, the information indicating the scene or shot section may be transmitted from the transmission source together with the content, The system controller 7 may be configured to detect a scene or a shot section from the acoustic characteristics.

  FIG. 16 shows another example of the content receiving apparatus in this case. In this example, the assumed evaluation value data described above is transmitted from the transmission source together with the content, and a plurality of scenes or shots that can be selected by the content reception device are transmitted so that the story development of the content can be changed by the content reception device. Is done.

  The content and the assumed evaluation value data transmitted from the transmission source and received by the communication device unit 89 are demodulated by the demodulation / error correction unit 82, corrected for error, written to the storage device unit 83, and stored in the storage device unit 83. Read from. The storage unit 83 functions as a buffer, but is for selecting a scene or a shot for changing the story development of the content.

  Others are the same as the broadcast receiving apparatus of the example of FIG. However, in the example of FIG. 16, the communication device unit 89 is simultaneously provided with the data transmission function of the communication device unit 67 of the examples of FIGS.

  Also in the content receiving device in the example of FIG. 15 or FIG. 16, a recognition evaluation value input unit is provided instead of the reaction value input unit 61, the reaction value analysis unit 62, and the recognition evaluation value calculation unit 63 so that the viewer can check each item. The recognition evaluation value can be directly input.

(Examples of collection analysis apparatus and collection analysis method: FIGS. 17 to 19)
In the content evaluation collection / analysis method according to the second embodiment, the aggregation center receives data transmitted from a terminal device (content reproduction device or content reception device) as in the examples of FIGS. And analyze the viewer's evaluation of the content.

  FIG. 17 shows an example of a collection analysis apparatus provided in the aggregation center. In this collection and analysis apparatus 100, the communication apparatus unit 101 recognizes and evaluates the data transmitted from the terminal apparatus as in the examples of FIGS. 10 to 16 via the communication network 9, that is, the content presentation time information. Data in which value information, transmission source identification information, content identification information, and viewer information are multiplexed is received.

  The received data is demodulated and demodulated by the demodulation / error correction unit 102, written to the buffer 103, read from the buffer 103, and taken into the system controller 104.

  The system controller 104 identifies the transmission source by the transmission source identification information, identifies the content to be evaluated by the content identification information, identifies the viewer attribute by the viewer information, and sets the received recognition evaluation value for each content. Are sorted according to the attributes of the viewer and written into the storage device unit 105.

  Further, the system controller 104 reads out the recognition evaluation values from the storage device unit 105 in accordance with an instruction from the operation unit 106, adds up the recognition evaluation values for each presentation time series, and analyzes the viewer's evaluation on the content. The aggregation is performed based on the degree of approximation of the time series change pattern of the recognition evaluation value.

  In the storage device unit 105, the above-described assumed evaluation value set by the content provider (producer) in advance can be written for each content, and the assumed evaluation value for the content to be evaluated is stored in the storage device unit 105. Is written, the system controller 104 analyzes the viewer's evaluation of the content by comparing the assumed evaluation value with the recognition evaluation value.

  The analysis result in the system controller 104 is recorded in the storage device unit 105 and displayed on the display 108 by the display control unit 107.

  FIG. 18 shows an example of a collection processing routine in the collection analysis apparatus 100. In this collection processing routine 110, first, in step 111, data is received, then in step 112, data is demodulated and error correction is performed, and then in step 113, transmission source identification information and content identification information are determined, Next, in step 114, the recognition evaluation value to which the content presentation time information is added is detected and written together with the transmission source identification information and the content identification information in the storage device unit 105. Next, in step 115, whether the data collection is stopped. When the data collection is continued, the process returns to step 111 to repeat the processes after step 111, and when the data collection is stopped, the collection process is terminated.

  FIG. 19 shows an example of an analysis processing routine in the collection analysis apparatus 100. In this analysis processing routine 120, first, in step 121, the recognition evaluation value is read from the storage unit 105, and then in step 122, it is determined whether or not the assumed evaluation value is read. Then, after reading the assumed evaluation value from the storage device unit 105, the process proceeds to step 124. When the assumed evaluation value for the content to be evaluated is not written in the storage device unit 105, the process proceeds directly from step 122 to step 124.

  In step 124, the evaluation of the viewer for the content is analyzed from the estimated evaluation value and the recognition evaluation value with or without the comparison, and then the process proceeds to step 125, and the analysis result is stored. The information is recorded in the device unit 105 and displayed on the display 108.

  In step 124, the system controller 104 specifically performs the following analysis.

  When comparing the assumed evaluation value and the recognition evaluation value, the assumed evaluation value and the recognition evaluation value in the scene or shot to be evaluated are the same as described above for the terminal devices in the examples of FIGS. The difference between the estimated evaluation value and the recognition evaluation value is determined based on the relationship between the estimated evaluation value in the past scene or shot and the recognition evaluation value. Assuming whether the difference is widening or shrinking, whether the recognition evaluation value is preferably increasing or decreasing, and whether the recognition evaluation value is preferably a local maximum or minimum The difference between the evaluation value and the recognition evaluation value and the tendency of change of the recognition evaluation value are determined.

  For example, even if the difference between the assumed evaluation value and the recognized evaluation value is within the allowable range, if it is large, it is determined that the viewer's reaction (evaluation) is in a direction different from the expected direction.

  Even when analyzing the viewer's evaluation of the content from the recognition evaluation value alone without comparing the assumed evaluation value and the recognition evaluation value, the viewing of the presented content is similarly determined from the magnitude of the recognition evaluation value and the tendency of change. The psychological state of the viewer is determined, and it is determined whether or not the viewer is in the psychological state as expected by the content provider.

  For example, when it is found from the analysis result of the system controller 104 displayed on the display 108 that the content provider is not more scared than expected, the content provider edits the content again and displays the video of the content. You can change the development of the story by changing the video and audio characteristics such as the brightness and sound level.

  Further, for example, when it is found that the viewer is not enjoying more than expected, not showing interest more than expected, or not concentrating on the scene more than expected, the story development of the content can be changed.

  When changing a story, a scene, or a shot, the history of past recognition evaluation values indicated by the viewer can be referred to. The history may be the one that stores the recognition evaluation value so far for the content presented at that time, or the one that stores the recognition evaluation value for another content that the viewer has viewed in the past. .

  If the content to be evaluated is a program or commercial that has been broadcast or distributed, the content provider will indicate the level of interest, interest, impression, or degree of preference of the viewer about the program or commercial. , You can know for each presentation time.

  If the received data includes viewer information, the content provider will show the viewer's interest and preference trends for each age group, gender, residential area, past content viewing history, etc. It is possible to analyze for each presentation time.

  If the content is something like a travel journal, the content provider can know the viewer's favorite travel destinations, events and accommodations they were interested in, etc. Survey results that directly reflect the preferences and interests of the person.

(Other examples of content evaluation collection analysis)
The above-described invention related to content evaluation collection analysis can be applied to a device that reproduces content from a recording medium other than an optical disc, or when the content is composed only of video information or only acoustic information.

[Embodiment of Content Evaluation Aggregation Management: FIGS. 20 to 30]
As a third embodiment, a case in which viewer evaluations of content that has been played back or received is tabulated and managed will be described below.

(Example of content reproduction apparatus: FIGS. 20 and 21)
FIG. 20 shows an example of an optical disk playback device as a content playback device of the third embodiment.

  Content is recorded on the optical disc 1. The content in this case is video information and audio information such as a movie. Specifically, video data and audio data are compressed and encoded by the MPEG method, multiplexed, and recorded on the optical disc 1.

  Furthermore, the optical disc 1 stores decoding time information such as a decoding time stamp and content presentation time information (reproduction time information) such as a presentation time stamp.

<Outline of playback device>
The optical disk 1 is driven by a disk motor 3. The optical head (pickup) 4 is driven by a drive unit 5 including a feed motor and tracking and focusing actuators.

  The system controller 7 instructs the drive unit 5 to play the optical disc 1 by the playback operation of the viewer using the operation unit 6, and the optical head 4 reads a signal from the optical disc 1. The read signal is demodulated by the demodulation / error correction unit 11, corrected for error, written to the buffer 12, and read from the buffer 12.

  The signal read from the buffer 12 is supplied to the demultiplexer 13, and the encoded video data, audio data, and caption data are respectively obtained from the demultiplexer 13 by being separated.

  The video data, audio data, and subtitle data are written to the video code buffer 21, the audio code buffer 31, and the subtitle code buffer 41, respectively, and read from the video code buffer 21, the audio code buffer 31, and the subtitle code buffer 41, respectively. Thereafter, the video decoder 22, the audio decoder 32, and the caption decoder 42 respectively decode the decoded data.

  The system controller 7 controls the decoding timing in each of the decoders 22, 32, and 42 based on the timing information such as the above-mentioned decoding time stamp, and based on the timing information such as the above-mentioned presentation time stamp, The output timing in each decoder 22, 32, 42 is controlled so that the time series of the data from the decoders 22, 32, 42 is matched.

  The video data from the video decoder 22 and the subtitle data from the subtitle decoder 42 are supplied to the video processing unit 23, and the video processing unit 23 superimposes the subtitle signal in the video signal.

  The video signal output from the video processing unit 23 is led to the video output terminal 24 and is sent from the video output terminal 24 to a video display device 25 such as a CRT display or a liquid crystal video projector.

  The video signal is sent to a video display device 25 having a D / A converter as it is without being converted into an analog video signal by the video processor 23, or converted into an analog video signal by the video processor 23. Then, it is sent to the video display device 25.

  The acoustic data from the audio decoder 32 is processed by the audio processing unit 33, and the acoustic signal output from the audio processing unit 33 is led to the audio output terminal 34, and from the audio output terminal 34, an acoustic output device such as a speaker or headphones 35.

  The audio signal is also sent to the audio output device 35 having the D / A converter without being converted into an analog audio signal by the audio processor 33 or converted into an analog audio signal by the audio processor 33. And sent to the sound output device 35.

  When content is reproduced from the optical disc 1, the reaction of the viewer who has watched the video displayed on the video display device 25 and the sound output from the sound output device 35 is input from the reaction value input unit 61 as a reaction value. . The system controller 7 measures the viewer's reaction by the reaction value input unit 61 simultaneously with the reproduction of the content from the optical disc 1.

  The reaction value input from the reaction value input unit 61 is analyzed by the reaction value analysis unit 62, and another reaction value is calculated by the reaction value analysis unit 62. Further, the recognition evaluation value calculation unit 63 uses the reaction value input from the reaction value input unit 61 and the reaction value calculated by the reaction value analysis unit 62, and the viewer's impression and evaluation on the content reproduced from the optical disc 1. A recognition evaluation value indicating is calculated.

  The information of the calculated recognition evaluation value is associated with the content presentation time information, and in the multiplexing unit 65, the viewer code (code for specifying the viewer) and the content identification code (code for specifying the content) And multiplexed. As will be described later, the viewer code is assigned by the tabulation management center at the time of initial setting prior to content reproduction.

  The multiplexed data is written into the buffer 66, read out from the buffer 66, and then transmitted to the aggregation management center by the communication device unit 67 via the communication network 9 such as the Internet.

  A terminal code (a code for identifying a terminal device) is set in advance by an apparatus manufacturer or the like for an optical disk reproducing device as a terminal device. As will be described later, this terminal code is transmitted from the terminal device (optical disk playback device) to the aggregation management center at the time of initial setting prior to content playback.

  A viewer identification information input unit 91, a viewer profile input unit 92, and a storage device unit 93 are connected to the system controller 7.

  The viewer identification information input unit 91 is input with viewer identification information (information for identifying the viewer) by the viewer at the time of initial setting and at the start of content reproduction. Specifically, the viewer identification information input unit 91 reads the viewer's fingerprint as the viewer identification information, for example, by pressing the finger on the predetermined surface of the viewer, or the viewer faces the microphone. By speaking, the voice features such as the voice pitch frequency and voiceprint of the viewer are read as viewer identification information, or when the viewer enters his or her common name or nickname in alphabetical characters, the common name or nickname And the like are detected as viewer identification information.

  The viewer profile input unit 92 is for inputting a viewer profile by the viewer at the time of initial setting. Specifically, the viewer profile includes information indicating the attributes of the viewer, such as the viewer's age, gender, residential area, and hobbies, and information indicating the history of content viewed by the viewer in the past.

  At the time of initial setting, the viewer identification information input by the viewer identification information input unit 91 and the viewer profile input by the viewer profile input unit 92 are registered in the storage device unit 93. The viewer code assigned by the tabulation management center is also registered in the storage device unit 93.

  In FIG. 20, the reaction value input unit 61, the reaction value analysis unit 62, the recognition evaluation value calculation unit 63, the multiplexing unit 65, and the system controller 7 are functionally separated. The signal processing 61 and the functions of the reaction value analysis unit 62, the recognition evaluation value calculation unit 63, and the multiplexing unit 65 may be configured as a part of the function of the system controller 7.

<Measurement of reaction value and calculation of recognition evaluation value>
The reaction value input unit 61 includes various sensors and a signal processing unit. In the signal processing unit, the reaction value is obtained by performing arithmetic processing such as differentiation, integration, and correlation calculation on the measurement data of the sensor output. can get.

  However, the reaction value input unit 61 may include only a sensor portion and an interface portion, and the reaction value may be calculated by processing the sensor output by the system controller 7.

  Sensors that measure the viewer's reaction are attached to the seating surface, backrest, armrest, etc. of the seat where the viewer sits, the earpads and headbands of the headset worn by the viewer, and the remote commander operated by the viewer .

  The reaction value includes data itself measured as a viewer's reaction and data obtained by analyzing the measurement data from the reaction value input unit 61 by the reaction value analysis unit 62.

  Specifically, the items to be measured as the viewer's response are electrocardiogram, respiratory rate, respiratory cycle, electromyogram, cerebral blood flow, brain wave, sweating, skin temperature, pupil diameter, eye openness, blink, facial expression, limbs These include blood flow, earlobe blood flow, and limb temperature.

  In addition, in a movie, a game, a viewer-participating drama in the case of a broadcast receiving apparatus to be described later, as a reaction value, a value obtained by observing the viewer's active behavior, for example, the pitch of the sound generated by the viewer The frequency and the variation thereof, the loudness and variation of the voice, the smoothness of the movement when moving the operation lever, the magnitude of the force, and the like can be used.

  The data obtained by analyzing these measurement data in the reaction value analysis unit 62 is, for example, data indicating a time interval without blinking calculated from data indicating the blinking time point, and the degree of eye opening and blinking. This is data indicating a laughing interval calculated from a change in time, a facial expression of the mouth, and the like.

  Further, the reaction value analysis unit 62 can calculate data indicating a surprising interval from changes in the degree of eye opening / pupil diameter and electromyogram (muscle tension of limbs), and the amount of sweat, heart rate, and Data indicating a tension section can be calculated from the degree of increase, change in pupil diameter, change in blood flow in the limbs, change in temperature in the limbs, and the like.

  As a method for calculating a new response value from a plurality of measurement data, a method of linearly combining the measurement data can be used.

  The recognition evaluation value calculation unit 63 calculates the viewer's impression and evaluation of the content as the recognition evaluation value from the reaction value input from the reaction value input unit 61 and the reaction value calculated by the reaction value analysis unit 62. .

  As specific recognition evaluation values, an evaluation value indicating interest or degree of interest, an evaluation value indicating impression strength, an evaluation value indicating the degree of preference, an evaluation value indicating the degree of fear, and the like are calculated. .

  The recognition evaluation value indicating the degree of interest and the degree of interest is calculated as a function of the degree of eye opening, the degree of blinking, the heart rate, and the like. The recognition evaluation value indicating the strength of the impression is calculated as a function of the degree of eye opening, heart rate, sweating, and the like. The recognition evaluation value indicating the degree of preference is calculated from the stability of the heart rate, the stability of the sweat rate, the temperature of the limbs, the blood flow volume of the limbs, and the like. The recognition evaluation value indicating the degree of fear is calculated from the degree of surprise and the degree of tension.

  The recognition evaluation values here are defined and calculated in consideration of the meaning of recognition, and are not necessarily independent of each other.

  The recognition evaluation value can also be expressed as multidimensional data. In that case, an identifier indicating the meaning of each dimension is added to obtain recognition evaluation value data.

  The reaction value and the recognition evaluation value can be measured or calculated from moment to moment, but may be measured or calculated for each segment of content such as a scene or shot of the reproduced content. In this case, the information indicating the section such as a scene or shot may be recorded on the optical disc 1 together with the content. However, the system controller 7 detects the section such as the scene and shot from the reproduced video and audio characteristics. It can also be set as the structure to do.

<Data transmission during content playback>
The content identification code multiplexed with the recognition evaluation value and the viewer code and transmitted to the aggregation management center is not limited to the content itself added to the content itself. For example, only one content is recorded on the optical disc 1, When a disc identification code (a code for specifying a disc) is recorded, the disc identification code can be used as a content identification code. Further, when only one content is recorded on the optical disc 1 and no disc identification code is recorded, the header information of the disc is determined according to a predetermined rule, such as combining the number of chapters contained in the disc and the performance time. The disc identification code and the content identification code can be combined.

  The recognition evaluation value information, the viewer code, and the content identification code are multiplexed by the multiplexing unit 65 using the recognition evaluation value information as a data portion and the viewer code and the content identification code as a header portion. Sent to the summary management center.

  The recognition evaluation value information is transmitted every time at predetermined time intervals such as 5 seconds, 30 seconds, etc., or is transmitted together when all the content reproduction is completed. In any case, each piece of information described above is temporarily stored in the buffer 66 and then transmitted to the total management center by the communication device unit 67.

  It can be considered that a long time content such as a movie is viewed by a viewer divided into several times. When the playback is paused in the middle of the content in this way, the system controller 7 holds the information for specifying the stopped location, the recognition evaluation value and the content presentation time information at the location, and the same content. The optical disc playback apparatus is configured to be used for the next content playback and data transmission.

<Remote controller using memory card: Fig. 25>
The reaction value input unit 61, the viewer identification information input unit 91, the viewer profile input unit 92, the storage device unit 93, and the like are preferably provided in a remote controller of the terminal device.

  FIG. 25 shows an example of this case. The operation unit 6, the reaction value input unit 61, the viewer identification information input unit 91, the viewer profile input unit 92, the controller 97, and the wireless transmission / reception unit 98 are provided in the remote controller 10b. In addition, a memory card 94 as a storage device unit is detachably attached to the remote controller 10b. The terminal device body 10 a is provided with a wireless transmission / reception unit 8 connected to the system controller 7.

  In this example, at the time of initial setting, the viewer identification information input by the viewer identification information input unit 91, the viewer profile input by the viewer profile input unit 92, and the viewer code assigned by the total management center are as follows. Registered in the memory card 94. After the registration, the viewer can view the content even at a travel destination other than home by carrying the memory card 94 to the travel destination and attaching it to the remote controller 10b of the terminal device at the travel destination. The recognition evaluation value can be transmitted to the total management center.

<When the recognition evaluation value is directly input: FIG. 21>
The example of FIG. 20 is a case where the recognition evaluation value calculation unit 63 calculates the recognition evaluation value from the reaction value from the reaction value input unit 61. The viewer directly inputs the recognition evaluation value for each item. You can also

  FIG. 21 shows an example of this case, and a recognition evaluation value input unit 64 is provided instead of the reaction value input unit 61, the reaction value analysis unit 62, and the recognition evaluation value calculation unit 63 in the example of FIG.

  The recognition evaluation value input unit 64 is configured such that, for example, the viewer inputs the recognition evaluation value for each item numerically such that the degree of interest is “−2” and the degree of preference is “+3”. Alternatively, a lever is provided for each item of the recognition evaluation value, and the viewer slides each lever in the plus direction or the minus direction.

  Alternatively, the recognition evaluation value input unit 64 is composed of a microphone and a signal processing unit having a voice recognition function, so that the viewer can recognize each item such as “not interested at all” or “very preferable”. The evaluation value can also be input by voice.

(Another example of content reproduction apparatus: FIG. 22)
FIG. 22 shows another example of an optical disc playback apparatus as a content playback apparatus of the third embodiment.

  In this example, an assumed evaluation value for this is recorded on the optical disc 1 along with the content. The assumed evaluation value assumes the impression and evaluation of the content when the viewer views the content. The type and brightness of the video to be presented, the type and level of sound to be presented (sound volume), the presentation This is set by the content provider (creator) in consideration of the story development of the content to be performed.

  In many cases, the presented content is narrative, and the psychological state of the presented viewer usually changes depending on the story development. Therefore, even for the same video and sound, it is expected that impressions and evaluations such as how to feel and interpret it differ depending on the scene. Therefore, the assumed evaluation value is based on content such as scenes and shots of content, taking into account the video and audio characteristics (physical properties such as video brightness and sound level) as well as the narrative nature of the presented content. Set for each break. Naturally, scenes and shots that the viewer wants to pay attention to are audibly devised so that the recognition evaluation value indicating the degree of interest and the degree of interest is high, so the estimated evaluation value of the scene or shot is also high. Will be set.

  The viewer's psychological state with respect to the presented content can be understood by looking at the recognition evaluation value calculated from the various reaction values described above and the time passage thereof. In addition, by comparing the assumed evaluation value set in advance by the content provider as described above with the recognition evaluation value calculated from various reaction values, the viewer's psychological state as expected by the content provider You can see if there is.

  The example of FIG. 22 is a case where a comparative evaluation value of a comparison result between the assumed evaluation value and the recognition evaluation value is transmitted to the total management center instead of the recognition evaluation value. The assumed evaluation value data is encoded. In this example, the assumed evaluation value data is multiplexed with video data and audio data and recorded on the optical disc 1. The specific method of time axis management and multiplexing of the assumed evaluation value is the same as in the first embodiment related to content presentation control.

  At the same time as the content is reproduced from the optical disc 1, the assumed evaluation value data is read from the optical disc 1. The read estimated evaluation value data is separated by the demultiplexer 13, written to the assumed evaluation value code buffer 51, read from the assumed evaluation value code buffer 51, and then decoded by the assumed evaluation value decoder 52. . The estimated estimated value decoded is also associated with the content presentation time information.

  On the other hand, at the same time as the content is played back, the reaction value input unit 61 measures the viewer's reaction as the reaction value, and the recognition evaluation value calculation unit 63 views the played content with respect to the content, as in the example of FIG. A recognition evaluation value indicating the impression and evaluation of the person is calculated.

  Further, in this example, the comparison evaluation value calculation unit 54 compares the assumed evaluation value decoded by the assumed evaluation value decoder 52 with the recognition evaluation value calculated by the recognition evaluation value calculation unit 63.

  Similar to the recognition evaluation value, the assumed evaluation value can also be expressed as multidimensional data. In that case, an identifier indicating the meaning of the dimension is added before the assumed evaluation value data of each dimension. When the assumed evaluation value and the recognition evaluation value are expressed as multidimensional data as described above, the comparison between the assumed evaluation value and the recognition evaluation value in the comparative evaluation value calculation unit 54 is, for example, the direction and magnitude of the multidimensional vector. This is done by comparing

  In this example, the comparison evaluation value obtained as a comparison result between the assumed evaluation value and the recognition evaluation value obtained from the comparison evaluation value calculation unit 54 at the time of content reproduction is converted into a viewer code and a content identification code in the multiplexing unit 65. The multiplexed data is written into the buffer 66, read out from the buffer 66, and transmitted to the aggregation management center via the communication network 9 by the communication device unit 67.

  Also in this example, a recognition evaluation value input unit is provided instead of the reaction value input unit 61, the reaction value analysis unit 62, and the recognition evaluation value calculation unit 63, and the viewer directly inputs the recognition evaluation value for each item. It can be configured.

  Further, as in the example of FIG. 25, the memory card 94 may be detachably provided to the remote controller 10b.

(Example of content receiving device (broadcast receiving device): FIGS. 23 and 24)
As an example, the content receiving apparatus of the third embodiment can be configured as an apparatus that receives a digital TV broadcast such as a BS digital broadcast.

  The content in this case is video information and audio information of the program, and a program code or the like is used as the content identification code.

  FIG. 23 shows an example of a broadcast receiving apparatus. In the reception channel selection unit 71, the broadcast signal is received and selected by the channel selection control of the system controller 7 based on the channel selection operation in the operation unit 6. The received and selected signal is demodulated and demodulated by the demodulation / error correction unit 72, written to the buffer 73, and read from the buffer 73.

  The signal read from the buffer 73 is supplied to the demultiplexer 13, and the encoded video data, audio data, and caption data are respectively obtained from the demultiplexer 13 by being separated. Others are the same as those of the optical disk reproducing apparatus in the example of FIG.

  When measuring or calculating the reaction value or the recognition evaluation value for each scene or shot of the content (program), the information indicating the section of the scene or shot may be broadcast together with the content, but the reproduced video In addition, the system controller 7 may be configured to detect a scene or a shot section from the characteristics of sound and sound.

  FIG. 24 shows another example of the broadcast receiving apparatus. In this example, as the digital TV broadcast, the assumed evaluation value data described above is broadcast by being multiplexed with the content (video data and audio data of the program), and the assumed evaluation value is the same as in the optical disc playback apparatus in the example of FIG. The comparison evaluation value of the comparison result of the recognition evaluation value is transmitted to the total management center.

  The reception channel selection unit 71 receives and tunes a broadcast signal including assumed evaluation value data, and the received channel selection signal is demodulated and demodulated by the demodulation / error correction unit 72 and then written to the buffer 73. , Read from the buffer 73.

  The signal read from the buffer 73 is supplied to the demultiplexer 13, and the encoded video data, audio data, caption data, and assumed evaluation value data are separately obtained from the demultiplexer 13. Others are the same as those of the optical disc reproducing apparatus in the example of FIG.

  Also in the broadcast receiving apparatus in the example of FIG. 23 or FIG. 24, a recognition evaluation value input unit is provided instead of the reaction value input unit 61, the reaction value analysis unit 62, and the recognition evaluation value calculation unit 63 so that the viewer can check each item. The recognition evaluation value can be directly input.

  Further, as in the example of FIG. 25, the memory card 94 may be detachably provided to the remote controller 10b.

(Example of total management device and total management method: FIGS. 26 to 30)
In the content evaluation aggregation management method according to the third embodiment, in an aggregation management center (hereinafter abbreviated as “center”), from a terminal device (content reproduction device or content reception device) as in the example of FIGS. The transmitted data is received, each piece of information is detected, the viewer's evaluation of the content is analyzed, the evaluation history is updated, and the viewer management data is updated.

  FIG. 26 shows an example of an aggregation management device provided in the center. The total management device 130 includes a communication device unit 131, a demodulation / error correction unit 132, a buffer 133, a system controller 134, an evaluation database 135, a viewer management database 136, an operation unit 137, a display control unit 138, and a display 139. The

  Data transmitted from the terminal device 10 via the communication network 9 is received by the communication device unit 131, demodulated by the demodulation / error correction unit 132, error-corrected, written to the buffer 133, and read from the buffer 133. And is taken into the system controller 134.

  As will be described later, the system controller 134 performs a registration process associated with an initial setting process in the terminal device 10 and a data reception process and an evaluation analysis process associated with a content reproduction process in the terminal apparatus 10, as well as the aggregation management apparatus 130. Control each part.

  The evaluation database 135 records the viewer's evaluation history with respect to the content and records the analysis results of the evaluation. The viewer management database 136 stores the individual viewers identified by the viewer code. Management data such as points (scores) is recorded.

  In the system described above, content is played back by the terminal device 10 (hereinafter, “reception” in the case of a broadcast receiving device is also included in “playback”), and before the data including the recognition evaluation value or the comparative evaluation value is transmitted to the center. In addition, the terminal device 10 executes an initial setting processing routine as shown on the left side of FIG. 27, and the center total management device 130 executes a registration processing routine as shown on the right side of FIG.

  That is, in the initial setting processing routine 140 on the terminal side, first, in step 141, the system controller 7 stores the viewer in the storage device section 93 (or memory card 94) by the viewer's input operation in the viewer profile input section 92. In step 142, communication with the center is started. Next, in step 143, a terminal code is transmitted to the center, and in step 144, a viewer code is requested from the center.

  In the registration process routine 150 on the center side, the system controller 134 first receives the terminal code transmitted from the terminal device 10 in step 143 by the communication device 131 in step 153, and then in step 154 and in step 144. In response to a request from the terminal device 10, a viewer code is newly or additionally assigned to the terminal code received in step 153, and is transmitted to the terminal device 10 by the communication device unit 131.

  The viewer code is newly assigned to a certain terminal code when the first viewer who wants to view the content by the terminal device requests the viewer code, and the viewer code is additionally assigned. The allocation is performed when the second, third,... Viewers who want to view the content by the same terminal device request the viewer code. In either case, the viewer enters his / her viewer profile and requests his / her viewer code from the center.

  In the initial setting processing routine 140 on the terminal side, in step 145, the viewer code transmitted from the center in step 154 is received and registered in the storage device 93 (or memory card 94), and the viewer is also received. The code and the viewer profile registered in step 141 are transmitted to the center.

  In the registration process routine 150 on the center side, next, in step 155, the viewer code and the viewer profile transmitted from the terminal device 10 are received, and the viewer management data in the viewer management database 136 is updated. Specifically, management data for a viewer who has been assigned a viewer code is newly provided, and an initial score is assigned thereto. The initial score can be arbitrarily determined.

  In the initial setting processing routine 140 on the terminal side, in step 146, the viewer identification information is registered in the storage device unit 93 (or the memory card 94) by the viewer input operation in the viewer identification information input unit 91. In step 147, the communication with the center is terminated.

  By the initial setting processing routine 140 and the registration processing routine 150 described above, the viewer code, the viewer profile, and the viewer identification information are registered in the storage device section 93 (or the memory card 94) of the terminal device 10, and the center The viewer management database 136 is set with viewer management data for each assigned viewer code.

  After the initial setting as described above, the content is reproduced by the terminal device 10 and data including the recognition evaluation value or the comparison evaluation value is transmitted to the center. FIG. 28 shows an example of a content reproduction processing routine performed by the system controller 7 of the terminal device 10 in this case.

  In the content reproduction processing routine 160, the system controller 7 first receives the viewer identification information from the viewer identification information input unit 91 in step 161 when viewing the content, or as shown in FIG. By attaching the memory card 94 in which the viewer identification information is registered to the remote controller 10b, it is confirmed that the viewer who wants to view the content is the registered viewer, and then proceeds to step 162. Then select the content and play it.

  Next, in step 163, the viewer code, content identification code, and recognition evaluation value or comparison evaluation value are multiplexed by the multiplexing unit 65 and temporarily stored in the buffer 66. The recognition evaluation value or the comparative evaluation value is associated with the content presentation time information.

  Next, in step 164, the viewer code, content identification code, and recognition evaluation value or comparison evaluation value stored in the buffer 66 are transmitted to the center by the communication device unit 67.

  The center total management device 130 receives the data transmitted from the terminal device 10, detects each piece of information, updates the viewer's evaluation history for the content, and updates the viewer management data. FIG. 29 shows an example of a data reception processing routine performed by the system controller 134 of the aggregation management device 130 in this case.

  In this data reception processing routine 170, the system controller 134 first receives data by the communication device unit 131 in step 171, and then performs demodulation and error correction of data by the demodulation / error correction unit 132 in step 172. Next, in step 173, the viewer code and the content identification code are discriminated. In step 174, the recognition evaluation value or the comparative evaluation value to which the content presentation time information is added is evaluated together with the viewer code and the content identification code. Write to database 135.

  In step 175, the evaluation history in the evaluation database 135 is updated. The evaluation history in this case describes the content viewed and the evaluation value (recognition evaluation value or comparative evaluation value) for each viewer.

  Next, in step 176, the viewer management data in the viewer management database 136 is updated. Next, in step 177, it is determined whether or not to stop the data reception. Returning to step 171, the processing from step 171 is repeated, and when the reception of data is stopped, the data receiving process is terminated.

  As the update of the viewer management data in step 176, specifically, the score is added to the management data of the viewer who has transmitted the recognition evaluation value or the comparative evaluation value. This score can be used for payment of paid content viewing fee, shopping fee, etc., and when it is applied, the viewer management data is updated by subtracting the corresponding score.

  Further, the system controller 134 of the tabulation management device 130 reads the recognition evaluation value or the comparative evaluation value from the evaluation database 135 together with the viewer code and the content identification code in accordance with an instruction from the operation unit 137, and tabulates each presentation time series. Then, the viewer's evaluation of the content is analyzed. Aggregation is performed by correlation and dispersion of time series change patterns of recognition evaluation values or comparative evaluation values.

  As a specific method of evaluation analysis, for example, when evaluating a recognition evaluation value, first, a local peak value such as a local maximum value is calculated for each evaluation value of each viewer, and correspondence with content presentation time Is detected.

  Next, the local peak value of each viewer is accumulated for each event section in the content prepared by the content provider (creator). At this time, the positive value and the negative value are separately accumulated. In other words, separate positive and negative ratings among viewers by accumulating negative values such as “Not interested” and “Boring” separately from positive values such as “I am interested” and “Preferred”. Even in the case of a negative, it is possible to perform aggregations that reflect market evaluations without positive and negative becoming zero.

  Further, as in the above-described example, when the viewer profile is received from the terminal device 10 and recorded in the viewer management database 136 at the initial setting, the viewer's age group, gender, residential area, past The viewers are classified based on the content viewing history and the recognition evaluation values are totaled.

  When categorizing viewers by content viewing history, the content viewing history can be managed by the content identification code added to each content, but the content is roughly classified and the content viewing history is managed for each category. You can also As content classification, in addition to general classification such as “sport”, “document”, “comedy”, “love story”, and “adventure”, classification based on a narrative evaluation pattern such as a semantic score can be considered. The semantic score is described in detail in Takahashi et al., “Structural Expression of Movies Using Semantic Score Method” (Japan Society for the Science of Design, Vol. 47, No. 6, 57-66, 2000).

  When the evaluation value transmitted from the terminal device 10 and written in the evaluation database 135 is not a comparison evaluation value of a comparison result between the assumed evaluation value and the recognition evaluation value but a recognition evaluation value, the evaluation database 135 stores in advance An assumed evaluation value set by the content provider can be written for each content.

  When the assumed evaluation value for the content to be evaluated is written in the evaluation database 135 as described above, the system controller 134 receives the assumed evaluation value and the communication device unit 131 and writes it in the evaluation database 135. The viewer's evaluation of the content is analyzed by comparing the recognition evaluation value.

  The analysis result in the system controller 134 is recorded in the evaluation database 135 and displayed on the display 139 by the display control unit 138.

  FIG. 30 shows an example of the above-described evaluation analysis processing routine. In this evaluation analysis processing routine 180, first, in step 181, the recognition evaluation value or the comparative evaluation value is read from the evaluation database 135. Next, in step 182, it is determined whether or not the assumed evaluation value is read. Then, the process proceeds to step 183, reads the assumed evaluation value from the evaluation database 135, and then proceeds to step 184.

  When the comparative evaluation value is read from the evaluation database 135 or when the assumed evaluation value for the content to be evaluated is not written in the evaluation database 135, the process proceeds directly from step 182 to step 184.

  In step 184, the content is viewed by comparing the recognition evaluation value read from the evaluation database 135 with the assumed evaluation value, from only the recognition evaluation value read from the evaluation database 135, or from the comparison evaluation value read from the evaluation database 135. The user's evaluation is analyzed, and then the process proceeds to step 185, where the analysis result is recorded in the evaluation database 135 and displayed on the display 139.

  In step 184, the system controller 134 specifically performs the following analysis.

  When the recognition evaluation value read from the evaluation database 135 is compared with the assumed evaluation value, or when the viewer's evaluation for the content is analyzed from the comparison evaluation value read from the evaluation database 135, the scene or shot to be evaluated is used. It is judged whether the difference between the recognition evaluation value and the assumed evaluation value (comparison evaluation value) is within the preset allowable range, and the relationship with the difference in the past scene or shot (comparison evaluation value) Whether the difference (comparison evaluation value) is large or small, whether the recognition evaluation value is preferably increasing or is preferably decreasing, and the recognition evaluation value is a local maximum or minimum. A difference between the recognition evaluation value and the assumed evaluation value (comparison evaluation value) and a tendency of a change in the recognition evaluation value, such as whether it is preferable to take a value, are determined.

  For example, even if the difference between the recognition evaluation value and the assumed evaluation value is within the allowable range, if it is large, it is determined that the viewer's reaction (evaluation) is in a direction different from the expected direction.

  Similarly, when analyzing the viewer's evaluation of the content from the recognition evaluation value alone, the viewer's psychological state of the presented content is similarly judged from the magnitude of the recognition evaluation value or the tendency of change, and the viewer can Determine whether the provider is in the psychological state as expected.

  For example, when it is found from the analysis result of the system controller 134 displayed on the display 139 that the content provider is not afraid of the viewer than expected, the content provider edits the content again and displays the video of the content. You can change the development of the story by changing the video and audio characteristics such as the brightness and sound level.

  Further, for example, when it is found that the viewer is not enjoying more than expected, not showing interest more than expected, or not concentrating on the scene more than expected, the story development of the content can be changed.

  When changing a story, a scene, or a shot, the history of past recognition evaluation values or comparative evaluation values indicated by the viewer can be referred to. Even if the history stores the recognition evaluation value or comparison evaluation value so far for the content presented at that time, the recognition evaluation value or comparison evaluation value for another content that the viewer has viewed in the past is used. You may remember it.

  When the content to be evaluated is a broadcast program or commercial, the content provider presents the audience's interest, interest level, impression strength, or degree of preference for the program or commercial. You can know every time.

  In addition, the content provider can analyze the viewer's interests and preferences for each presentation time for each age group, sex, residential area, past content viewing history, and the like.

  If the content is something like a travel journal, the content provider can know the viewer's favorite travel destinations, events and accommodations they were interested in, etc. Survey results that directly reflect the preferences and interests of the person.

(Other examples of content evaluation summary management)
The invention related to content evaluation aggregation management described above is an apparatus that reproduces content from a recording medium other than an optical disc, an apparatus that receives content distributed from a distribution source via a communication network such as the Internet, or the content is video information. The present invention can also be applied to a case where only audio information is included, or a case where only audio information is included.

It is a figure which shows an example of the content reproduction apparatus of this invention. It is a figure which shows an example of the content reproduction apparatus of this invention. It is a figure which shows an example of the content reproduction apparatus of this invention. It is a figure which shows an example of the content reproduction apparatus of this invention. It is a figure which shows an example of the content receiver of this invention. It is a figure which shows an example of the content receiver of this invention. It is a figure which shows an example of the content receiver of this invention. It is a figure which shows an example of the content receiver of this invention. It is a figure which shows an example of the data which described assumption evaluation value. It is a figure which shows an example of the content reproduction apparatus of this invention. It is a figure which shows an example of the content reproduction apparatus of this invention. It is a figure which shows an example of the content reproduction apparatus of this invention. It is a figure which shows an example of the content receiver of this invention. It is a figure which shows an example of the content receiver of this invention. It is a figure which shows an example of the content receiver of this invention. It is a figure which shows an example of the content receiver of this invention. It is a figure which shows an example of the content evaluation collection analysis apparatus of this invention. It is a figure which shows an example of a content evaluation collection process routine. It is a figure which shows an example of a content evaluation analysis process routine. It is a figure which shows an example of the content reproduction apparatus of this invention. It is a figure which shows an example of the content reproduction apparatus of this invention. It is a figure which shows an example of the content reproduction apparatus of this invention. It is a figure which shows an example of the content receiver of this invention. It is a figure which shows an example of the content receiver of this invention. It is a figure which shows an example in the case of comprising the operation input part of a terminal device as a remote controller. It is a figure which shows an example of the content evaluation totalization management apparatus of this invention. It is a figure which shows an example of the initialization process routine in a terminal device, and the registration process routine in a content evaluation totalization management apparatus. It is a figure which shows an example of the content reproduction process routine with a terminal device. It is a figure which shows an example of the data reception process routine in a content evaluation total management apparatus. It is a figure which shows an example of the content evaluation analysis processing routine in a content evaluation totaling management apparatus.

Explanation of symbols

  Since all the main parts are described in the figure, they are omitted here.

Claims (8)

Reproduction means for reproducing the content and the assumed evaluation value from a recording medium in which the content that is at least one of video information and audio information and the evaluation value assumed for the content are recorded;
A reaction value input means for inputting the reaction of the viewer to the reproduced content as a reaction value;
A recognition evaluation value calculating means for calculating a viewer's evaluation of the content reproduced by the reproducing means as a recognition evaluation value from the input reaction value;
In order to change the recognition evaluation value so that the difference between the estimated evaluation value and the recognition evaluation value is within an allowable range by comparing the calculated recognition evaluation value and the assumed evaluation value reproduced by the reproducing unit. Control evaluation value calculating means for calculating the control evaluation value of
Control means for controlling the reproduction of the content from the recording medium by the reproduction means so that the difference between the assumed evaluation value and the recognition evaluation value is within an allowable range according to the calculated control evaluation value;
A content playback apparatus comprising: Reproduction means for reproducing the content and the assumed evaluation value from a recording medium in which the content that is at least one of video information and audio information and the evaluation value assumed for the content are recorded;
A recognition evaluation value input means for inputting a viewer evaluation of the reproduced content as a recognition evaluation value;
In order to change the recognition evaluation value so that the difference between the estimated evaluation value and the recognition evaluation value is within an allowable range by comparing the input recognition evaluation value with the assumed evaluation value reproduced by the reproducing means. Control evaluation value calculating means for calculating the control evaluation value of
Control means for controlling the reproduction of the content from the recording medium by the reproduction means so that the difference between the assumed evaluation value and the recognition evaluation value is within an allowable range according to the calculated control evaluation value;
A content playback apparatus comprising: Reproduction means for reproducing the content from a recording medium in which the content that is at least one of video information and audio information is recorded;
Receiving means for receiving an estimated value assumed for the content;
Reaction value input means for inputting the reaction of the viewer to the content reproduced by the reproduction means as a reaction value;
A recognition evaluation value calculating means for calculating a viewer's evaluation of the content reproduced by the reproducing means as a recognition evaluation value from the input reaction value;
To compare the calculated recognition evaluation value with the assumed evaluation value received by the receiving means and change the recognition evaluation value so that the difference between the assumed evaluation value and the recognition evaluation value is within an allowable range. Control evaluation value calculating means for calculating the control evaluation value of
Control means for controlling the reproduction of the content from the recording medium by the reproduction means so that the difference between the assumed evaluation value and the recognition evaluation value is within an allowable range according to the calculated control evaluation value;
A content playback apparatus comprising: Reproduction means for reproducing the content from a recording medium in which the content that is at least one of video information and audio information is recorded;
Receiving means for receiving an estimated value assumed for the content;
A recognition evaluation value input means for inputting a viewer evaluation of the content reproduced by the reproduction means as a recognition evaluation value;
To compare the input recognition evaluation value with the assumed evaluation value received by the receiving means and change the recognition evaluation value so that the difference between the assumed evaluation value and the recognition evaluation value is within an allowable range. Control evaluation value calculating means for calculating the control evaluation value of
Control means for controlling the reproduction of the content from the recording medium by the reproduction means so that the difference between the assumed evaluation value and the recognition evaluation value is within an allowable range according to the calculated control evaluation value;
A content playback apparatus comprising: Playing back the content and the assumed evaluation value from a content that is at least one of video information and audio information, and a recording medium on which an estimated value assumed for the content is recorded,
The viewer's response to the reproduced content is captured as a response value, and the viewer's evaluation of the reproduced content is calculated as a recognition evaluation value from the captured response value, and the calculated recognition evaluation value, Content presentation for controlling reproduction of content from the recording medium so that a difference between the assumed evaluation value and the recognition evaluation value is within an allowable range based on a comparison result with the reproduced assumed evaluation value. Control method. Playing back the content and the assumed evaluation value from a content that is at least one of video information and audio information, and a recording medium on which an estimated value assumed for the content is recorded,
The viewer's evaluation of the reproduced content is captured as a recognition evaluation value, the captured recognition evaluation value is compared with the reproduced assumed evaluation value, and the assumed evaluation value and the recognition evaluation are compared based on the comparison result. A content presentation control method for controlling reproduction of content from the recording medium so that a difference from a value falls within an allowable range. Reproducing the content from a recording medium on which content that is at least one of video information and audio information is recorded, and receiving an evaluation value assumed for the content from a transmission source,
The viewer's response to the reproduced content is captured as a reaction value, and the viewer's evaluation of the reproduced content is calculated as a recognition evaluation value from the captured response value, and the calculated recognition evaluation value; Content presentation that controls the reproduction of content from the recording medium so that the difference between the assumed evaluation value and the recognition evaluation value is within an allowable range by comparing the received estimated evaluation value with the comparison result Control method. Reproducing the content from a recording medium on which content that is at least one of video information and audio information is recorded, and receiving an evaluation value assumed for the content from a transmission source,
The viewer's evaluation of the reproduced content is captured as a recognition evaluation value, the captured recognition evaluation value is compared with the received assumed evaluation value, and the assumed evaluation value and the recognition evaluation are compared based on the comparison result. A content presentation control method for controlling reproduction of content from the recording medium so that a difference from a value falls within an allowable range.

Images