JP4580345B2 - Content transmission device and content output device - Google Patents

Description

  The present invention relates to a content transmitting apparatus that transmits the content that is output on the receiving side reflecting the intention of the creator who created the content, and a content output apparatus that outputs the content.

  2. Description of the Related Art Conventionally, there has been a presentation content selection method in which received content is presented to a viewer in a viewable state with reference to a user profile that is personal information of the viewer. For example, if the viewer is a hearing-impaired person, this audio will be presented as a visible subtitle instead of the content sound, or if the viewer is a visually impaired person, the commentary sound explaining the content video Is output.

  Or, even if the viewer is a healthy person, depending on the situation, it is assumed that the audio of the content cannot be output, the audio of the content cannot be heard, or the video of the content cannot be seen. It is necessary to change the presentation of content, such as a commentary or commentary voice. In other words, when the content viewer cannot fully understand the intention of the content creator due to various disabilities (human disabilities, environmental disabilities), etc. And commentary audio (for example, see Patent Document 1).

The transmission method disclosed in Patent Document 1 multiplexes subtitles for various viewers into content and enables display according to the viewer's preference (situation). The subtitles are not displayed according to the viewer profile which is personal information of the viewer, and the viewer has to select.
Japanese Patent Laid-Open No. 10-208446

  However, in the conventional presentation content selection method, the condition derived from the user profile, the content presentation method and the presentation content are handled in a fixed one-to-one manner, so that the content intended by the content creator is sufficient. In spite of the situation transmitted to the user, there is a problem that an extra alternative is presented, or conversely, the alternative presentation is not performed despite the situation where the content is not transmitted. In addition, there is a problem that the presentation method desired by the transmission side that transmits the content and the presentation method desired by the reception side that receives the content may not be engaged. Further, the conventional presentation content selection method has a problem that it is impossible to select various presentation methods of content corresponding to the physical ability of the individual viewer and the situation.

  In addition, on the transmitting side that transmits the content, it corresponds to each viewer on the basis of the metadata of the content that is uniformly described and the user profile that is uniformly described on the receiving side that receives the content. A general mechanism for providing alternative presentations was desired. In other words, although the user profile components and the content metadata expression method are expected to show new things in the future, the conventional presentation content selection method and the existing alternative presentation method are used. This is because the system for this cannot cope.

  Specifically, in the presentation content selection method and the existing alternative presentation system, subtitles are presented as an alternative presentation of the audio of the content. Semantic description such as “subtitles are an alternative means for presenting audio” is not included. Similarly, the content metadata does not include a semantic description such as “explanatory audio is an alternative presentation means for video”.

  For this reason, in some cases, a “semantic description”, that is, the intention of the producer who created the content may not be reflected on the receiving side. Currently, the alternative presentation means in the presentation content selection method and the existing alternative presentation system are only implicitly shared between the content transmission side and the content reception side, It is not derived on the presentation side (reception side) after reflecting the intention of the producer side (transmission side).

  As a result, when trying to realize a new service for content transmission, for example, an expanded presentation service that makes characters on the display screen larger than usual for low vision viewers, the existing system for alternative presentation Even if a description such as “when a small character that cannot be identified by a low-sighted person (viewer) is displayed on the display screen on the transmission side, the small character is enlarged (replaced by an enlarged character)” is described. The content receiving side cannot be derived.

  In other words, the content receiving side cannot interpret it as a “semantic description” “if the subtitle text is too small to be read, it will be made larger”. In this way, when trying to realize a new service, a new system (in this case, an updated interpretation method) on both the producer side (sender side) who created the content and the presenter side (receiver side) ) Must be introduced.

  Therefore, in the present invention, a content transmission apparatus and a content output apparatus that can solve the above-described problems and can select and perform various presentation methods of contents corresponding to physical abilities of individual viewers and situations. The purpose is to provide.

  In order to solve the above-mentioned problem, the content output device according to claim 1, according to the content, the alternative presentation content to be presented instead of the content, the divided metadata indicating the divided portion of the content, and the divided metadata Necessary list meta which defines each of the divided parts of the content and the alternative presentation content and a presentation device required on the reception side for the alternative presentation content, a function of the device, and a viewing ability required for the viewer on the reception side Data, grouping metadata for grouping the component parts of the content and the alternative presentation content, and each of the component parts and the alternative presentation content assigned according to a preset criterion. Correlation metadata and the course of the content A content output device that receives time information of the alternative presentation content attached in correspondence with the content information and outputs the content or the alternative presentation content to the presentation device, and includes a profile storage unit, a determination unit, The derivation unit, the reconstruction unit, and the output unit are provided.

  According to such a configuration, the content output device receives the content, the alternative presentation content, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information by the receiving unit. The content output device also has a viewer profile that defines the viewing ability of the viewer who views the content or alternative presentation content in the profile storage means, a presentation device that can present the content or alternative presentation content, and the function of the device The viewing environment profile described is stored. The viewing ability of viewers means physical ability such as visual hearing, knowledge of general education and trivia, comprehension ability to understand words other than Japanese, and content such as laughter and crying. It includes sensitivity.

  Then, the content output device compares the necessary list metadata with the viewer profile and the viewing environment profile stored in the profile storage unit by the determination unit, and each component part in which the content is divided according to the divided metadata. Then, it is determined whether or not the viewer profile and the viewing environment profile satisfy the conditions described in the necessary list metadata. Furthermore, the content output apparatus determines that the necessary list metadata that has not been satisfied when the viewer profile and the viewing environment profile do not satisfy the conditions described in the necessary list metadata as a result of the determination by the determination unit by the derivation unit. Regarding the added components, the viewing ability is satisfied and the same grouping metadata is added or predetermined based on the viewer profile, viewing environment profile, grouping metadata, correlation metadata and time information. The alternative presentation content to which the correlation metadata within the range is added is derived.

  The content output device reconstructs the alternative presentation content derived by the deriving unit and the component part of the content by the reconstructing unit, and presents the reconstructed content reconstructed by the reconstructing unit by the output unit. Output to.

  The content output device according to claim 2, wherein the content, the alternative presentation content to be presented instead of the content, the divided metadata indicating the divided part of the content, and the component obtained by dividing the content according to the divided metadata And necessary list metadata defining the presentation device required on the receiving side and the function of the device and the viewing capability required for the viewer on the receiving side, and the constituent parts of the content and the alternative The grouping metadata for grouping the presented content, the correlation metadata of the component parts and the alternative presented content, which are assigned according to a preset criterion, and the elapsed time of the content Time information of the alternative presentation content attached correspondingly And outputting the content or the alternative presentation content to the presentation device, the reception means, the profile storage means, the determination means, the derivation means, the conversion means, and the reconfiguration Means and output means.

  According to such a configuration, the content output device receives the content, the alternative presentation content, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information by the receiving unit. In addition, the content output device includes a viewer profile that defines the viewing ability of a viewer who views the content or alternative presentation content in the profile storage means, a presentation device that can present the content or alternative presentation content, the function of the device, A viewing environment profile describing a convertible conversion device is stored.

  Then, the content output device compares the necessary list metadata with the viewer profile and the viewing environment profile stored in the profile storage unit by the determination unit, and each component part in which the content is divided according to the divided metadata. In addition, it is determined whether or not the viewer profile and the viewing environment profile satisfy the conditions described in the required list metadata. As a result of the determination by the determination unit by the deriving unit, the viewer profile and the viewing environment profile are determined as necessary list metadata. Based on the viewer profile, viewing environment profile, grouping metadata, correlation metadata, and time information for the component with the required list metadata that was not met if the conditions described in the data were not met Satisfying the viewing ability Together, to derive the alternative presentation content correlated metadata is added or within a predetermined range the same grouping metadata is added.

  Then, as a result of the determination by the determining means by the converting means, the content output apparatus, when the viewing environment profile does not satisfy the required list metadata, for the component portion to which the required list metadata that is not satisfied is added. Alternative presentation content to which the same grouping metadata is added or correlation metadata within a predetermined range can be output by the conversion device based on the user profile and the viewing environment profile, and the viewing capability is satisfied To convert it into a conversion part that can be transmitted to the viewer. The conversion means may be used when the alternative presentation content cannot be derived by the derivation means, or may be used immediately depending on the result determined by the determination means even when the alternative presentation content can be derived. . And if the alternative presentation content derived by the derivation means is described as being necessary to be converted by the conversion means in the added required list metadata, the conversion means converts the constituent parts of the content, Convert to a conversion part that can be transmitted to the viewer. Then, the content output device reconstructs the alternative presentation content derived by the deriving unit, the converted part converted by the converting unit, and the component part of the content by the reconstructing unit, and the reconstructing unit by the output unit The reconstructed reconstructed content is output to the presentation device.

  The content transmission device according to claim 3 is a content output device according to claim 1 or 2, wherein the content, the alternative presentation content to be presented instead of the content, and the divided metadata indicating the divided portion of the content, The required list that defines the presentation device required on the reception side for each component part obtained by dividing the content according to the division metadata and the substitute presentation content, the function of the device, and the viewing ability required for the viewer on the reception side Meta data, grouping metadata for grouping the component parts of the content and the alternative presentation content, and each of the component parts and the alternative presentations assigned with a correlation of the grouped metadata according to a preset criterion The correlation metadata of the content and the elapsed time of the content And configured to include a transmitting means for transmitting a response is not subjected time information.

  According to such a configuration, the content transmission device transmits the content, the alternative presentation content, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information by the transmission unit. In addition, when transmitting here, you may multiplex these and may transmit separately in the state which can identify a correspondence on the receiving side.

  According to the first aspect of the present invention, the content transmitted from the transmission side, the alternative presentation content, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information are stored. Referring to the viewer profile and the viewing environment profile, derive the presentation method to convey the physical ability of the individual viewer and the content creator's intention as much as possible without compromising the situation. Thus, the content can be presented.

  According to the second aspect of the present invention, the content transmitted from the transmission side, the alternative presentation content, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information are stored. Referring to the viewer profile and the viewing environment profile, derive the presentation method to convey the physical ability of the individual viewer and the content creator's intention as much as possible without compromising the situation. Thus, the content can be presented, and in some cases, a converted part obtained by converting the constituent part of the content so as to be transmitted can be added to the content.

  According to the third aspect of the present invention, each component of content is divided according to the divided metadata, and the presentation device required for the divided component and the alternative presentation content on the receiving side, the function of the device, and the receiving side Necessary list metadata that defines the viewing ability required for viewers, grouping metadata for grouping content components and alternative presentation content, and criteria that set the correlation between the grouping metadata in advance By transmitting the component parts attached in accordance with the above and the correlation metadata of the alternative presentation content, the receiving side refers to the stored viewer profile and viewing environment profile, and the physical body of the individual viewer A presentation to convey the ability and context of the content creator as much as possible Derive the way, it is possible to present the content.

Next, embodiments of the present invention will be described in detail with reference to the drawings as appropriate.
FIG. 1 is a block diagram of a content transmission output system. As shown in FIG. 1, the content transmission output system S transmits content, alternative presentation content to be presented instead of this content, and various metadata on the transmission side, so that the content can be transmitted on the reception side. In addition to reflecting the intention of the creator who created the alternative presentation content, it is possible to realize various presentation forms of the content according to the viewer on the receiving side. 3 is provided. The content output device 3 is connected to a presentation device 2 that outputs (presents) video and audio of the content.

<Configuration of content transmission device>
The content transmission device 1 transmits content (original content), alternative presentation content, and various metadata, and includes an input unit 5 and a transmission unit 7.
The input means 5 inputs content, alternative presentation content, divided metadata, necessary list metadata, grouping metadata, correlation metadata, and time information.

  The content is so-called multimedia content, and is composed of various data such as text, still images, sound effects, and semantic information in addition to video (moving image) and audio. Further, this content is composed of a plurality of components divided by the divided metadata.

  The alternative presentation content is content that is presented in place of the content when the presentation form on the receiving side that is originally assumed by the creator who created the content (original content) cannot be realized. In other words, the content is such that the intention of the producer can be transmitted even if the content is not originally presented as it is on the receiving side.

  For example, if the original content is a normal news program consisting of video, audio, and subtitles, and the viewer on the receiving side is a hearing impaired person, the alternative presentation content is a substitute for audio, In order to realize the purpose of “to convey the detailed contents of each news”, the text-to-speech is replaced with text data displayed near the announcer who is reading the voice. Here, the position where the text data is displayed is “near the announcer”, which means that the position is easier for the viewer to see, unlike the subtitle of the original content. Furthermore, it is preferable that the alternative presentation content displayed as text data be displayed in characters larger than the characters displayed in subtitles from the viewpoints of ease of viewing and readability.

  The division metadata is metadata indicating a division part when the content is divided into constituent parts. Specifically, the divided metadata indicates a portion to be divided according to the content contents by a temporal range, that is, a coordinate on the screen of the video content or a frequency band of the audio content.

  For example, when the content is a baseball broadcast program, the divided metadata indicates the time at which each scene is separated, such as a scene pitched by a pitcher, a scene hit by a batter, or a scene run by a runner who has come out. It will be a thing.

  Necessary list metadata enumerates presentation devices and functions of the presentation device that are necessary on the receiving side so that the original content is displayed on the receiving side according to the intention of the creator who created the content (original content). Furthermore, the metadata defines viewing ability required for the viewer on the receiving side.

  For example, the required list metadata is “video display, visual” if the presentation of the content appeals to the viewer's visual perception, and “speaker, auditory” if the content presentation appeals to the hearing. It will be up.

  Viewing ability refers to the viewer's physical ability, knowledge (knowledge amount), cognitive ability, comprehension ability, sensitivity, etc., which are converted to text data or digitized so that they can be processed by the receiving device. It is.

For example, if text data related to physical ability called “sight” is listed in the required list metadata, the condition derived from this is “only the person with vision has the intention of the creator included in this component. I understand. "
In addition, if the required list metadata lists text data related to comprehension, “Japanese listening ability”, the condition derived from this is “Only those who have Japanese listening ability can include this component. I understand the intentions of the creators included. "

In addition, if the required list metadata lists text data related to the knowledge "XX Prime Minister", the condition derived from this is that only those who know the XX Prime Minister are included in this component. Understand the intentions of the creators. "
Furthermore, as an example of the quantified data, when text data and quantified data related to physical ability “visual acuity 0.5 or more” are listed in the necessary list metadata, the condition derived from this is “ Only people with a visual acuity of 0.5 or more can understand the intentions of the producers included in this component. "

  The grouping metadata is attached when classifying the constituent parts into which the content is divided. That is, the same grouping metadata is attached to the components belonging to the same group, and different grouping metadata is assigned to the components belonging to different groups. In this embodiment, the constituent parts of the content and the alternative presentation content are classified based on the “creator's intention” that produced the content and the alternative presentation content, and grouping metadata corresponding to the classification is provided. It is attached.

  For example, if the content is a baseball broadcast program and the grouping metadata is a scene pitched by the pitcher, it corresponds to the creator ’s intention of #A (“Let the viewer understand that the ball was thrown”) If the scene was hit by the batter, it would be #B (a symbol attached in response to the creator ’s intention to “make the viewer understand that the ball was hit”). .

  The correlation metadata is obtained by converting the correlation of grouped metadata for each component into a numerical value or an ID according to a preset criterion. For example, if the grouping metadata of the constituent part 001 and the constituent part 002 is #A (a symbol given in correspondence with the creator's intention to “make the viewer understand that the ball has been thrown”). Since the correlation metadata between the component part 001 and the component part 002 has the same grouping metadata, the correlation metadata of the component part 003 takes a high value, for example, 100 (correlation degree 100%), and the grouping metadata of the component part 003 is #B. ("A symbol attached in correspondence with the creator's intention to make the viewer understand that the player has hit the ball"), the correlation metadata between the component part 001 and the component part 003 is the grouping metadata. Since the data is different, a low value, for example, 10 (correlation degree 10%) is taken.

  The case where the grouped metadata has a correlation will be described. For example, the content is a baseball broadcast program, the content component 00A is live audio, and the grouped metadata is #C (" The content component part 00B is a subtitle supermarket of SBO indicating the outcount, the number of strikes and the number of balls, and the grouping metadata is In #D (a symbol given in correspondence with the producer's intention to “make viewers understand the progress of the game”), the correlation metadata of the correlation between these grouped metadata #C and #D is correlated. (ID: #C, ID: #D, 80), the grouping metadata #C and #D have a high correlation (phase) Degree 80, in similar relationship) become. When this correlation is high, the priority order selected as the alternative presentation content is high when the receiving side cannot display the corresponding component part of the content.

  The time information is information related to the time attached to the alternative presentation content in correspondence with the elapsed time of the content, and indicates a relative time with respect to the actual time (real time). In other words, the information regarding the time of the content is uniquely determined by the transmission time, that is, the time code, while the time information of the alternative presented content is reproduced when viewing the content (after being accumulated, When the head of the content is started to be viewed (reproduced), it is attached so as to correspond to the time elapsed.

  The transmission means 7 sends the content input to the input means 5, the alternative presentation content, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information to the content output device. 3 is transmitted.

  According to the content transmitting apparatus 1, the divided metadata is used to divide each component of the content, and the necessary list metadata is used to provide the presentation device required on the reception side, the function of the presentation device, and the viewer on the reception side. By defining the required viewing ability, grouping the component parts and alternative presentation content by grouping metadata, and quantifying the correlation of these groups by correlation metadata, it is accumulated on the receiving side. The viewer's individual profile and viewing environment profile can be referred to, and a variety of presentation methods can be selected according to the physical abilities of the individual viewer and the content corresponding to the situation.

<Configuration of content output device>
The content output device 3 receives the content transmitted from the content transmitting device 1, the alternative presentation content, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information. In response to the input viewer profile, the information is output to the connected presentation device 2. The receiving means 9, the content / metadata storage means 11, the profile holding means 13, the determination means 15, and the derivation Means 17, conversion means 19, reconstruction means 21, and output means 23 are provided.

  The receiving means 9 receives the content, the alternative presentation content, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information, and these are received as the determination means 15 and the content This is output to the metadata storage means 11. In the content output device 3, the content received by the receiving means 9, the alternative presentation content, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information are determined. 15, the content / metadata storage unit 11 outputs the content or the alternative presentation content in real time when the reconfiguration unit 21 regenerates the content or the alternative presentation content. This is to prepare for the case where it is necessary to configure.

  The content / metadata storage unit 11 receives the content received by the reception unit 9, the alternative presentation content, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information. It accumulates and is constituted by a general recording medium. The content stored in the content / metadata storage means 11, the alternative presentation content, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information are necessary. In response, the data is read from the reconstruction means 21.

The profile holding means 13 holds (accumulates) the viewer profile and the viewing environment profile input by the user (viewer) who uses the content output device 3, and is configured by a general recording medium.
The viewer profile includes the viewer's personal information (gender, age, occupation, hobbies / preferences, etc.), lifestyle (weekday and holiday viewing hours, concentration / situation, etc.), and viewing ability (physical ability, Knowledge (knowledge amount), cognitive ability, understanding ability, sensitivity, etc.). In this viewer profile, the personal information, lifestyle and viewing ability are converted into text data or digitized so that the apparatus 3 can process them.

The gender, age, and occupation in the personal information are the gender, age, and occupation of each individual viewer who constitutes the family when the viewer who uses the device 3 is a family unit.
Hobbies and preferences in personal information include movies, music appreciation, reading, sports, cooking, shogi shogi, gardening, photography, language learning, history learning, and liquor, tea, coffee, tobacco and other preferences ) And information.

  The viewing time zone in the lifestyle is information on the main time zone in which the viewer views the content. For example, if the viewer is a student or a worker, on weekdays, from wake-up time to school (commuting time), and in the time zone from return time to bedtime, on holidays, from wake-up time to bedtime In this time zone, it is information relating to the time zone for viewing content for each day of the week. In addition, if the viewer is a full-time housewife, the information is related to a time period during which content for each day of the week is viewed in the time period from wake-up time to bedtime.

  The degree of concentration / situation in the lifestyle is information indicating the degree of concentration of the viewer when viewing the content and the surrounding situation when viewing (presenting) the content. For example, “concentrated viewing (normal viewing)” where the viewer concentrates on viewing the content, “view while viewing” where the viewer views the content while doing something else, and the viewer can view the content video "No video viewing" when there is no video, "No audio viewing" when the viewer is unable to hear the audio of the content, "Alternative" when the viewer is unable to receive an alternative presentation other than video or audio It is something like “impossible viewing”.

Physical ability (perceptual ability) in viewing ability is information indicating that normal viewing of content is difficult when the viewer has visual impairment or hearing impairment, except when the viewer is healthy. It is.
Knowledge (knowledge amount) in viewing ability indicates background knowledge related to the general level of education and content of the viewer. For example, a class specified by a kanji test is assumed for a Japanese vocabulary to indicate a general level of education.

  The recognition ability in viewing ability is information indicating whether or not the viewer can understand a language other than Japanese, for example, English or German, when the viewer is a healthy person. Language and English) and language reading ability (Japanese, English, etc.).

  The comprehension in viewing ability is information indicating how much the viewer can understand the language (Japanese, English, etc.) and scene of the content when the viewer is a healthy person. Further, it is information regarding whether or not Braille can be understood when the viewer is visually impaired, and whether or not sign language can be understood when the viewer is hearing impaired.

  Sensitivity in viewing ability indicates a viewer's sensibility, and is a numerical value of being easily moved, tearful, easily frustrated, and the like. This numerical value is determined based on the result of the viewer answering a prepared questionnaire-type input sheet displayed on a display device (not shown). For example, it can be obtained by self-assessment in five stages (numerical values of 1 to 5) in response to questions such as “Can you be impressed by a love drama?”, “Can you sympathize with a tragedy”, or “Can you withstand long explanations?” . Further, it is assumed that this numerical value is obtained by referring to the viewing history of the content viewed by the viewer and estimating from the selection tendency of the content included in the viewing history.

That is, these sensibilities indicate a viewer's psychological tendency in viewing the content, and the constituent parts of the content can be replaced with alternative presented content by the sensitivity defined here. For example, in the case of a viewer who has a sensitivity that cannot be touched by a love drama (the numerical value answered in response to the question “Can you touch the love drama?” Is low) For this reason, the alternative presentation content with a more excessive presentation is prepared, and the constituent part of the corresponding content is changed to the alternative presentation content. In addition, in the case of a viewer who has the sensitivity that the tragedy cannot be sympathized (the numerical value answered in response to the question “Can you sympathize with tragedy?”), In order to sympathize with the viewer In order to have a sad feeling), an alternative presentation content with a more excessive presentation is prepared, and the constituent part of the corresponding content is changed to the alternative presentation content. In addition, for viewers who have a sense of being unable to withstand long explanations (the number of respondents who answered “Can you withstand long explanations?” Is low) An alternative presentation content with a simple explanation is prepared, and the constituent part of the corresponding content is changed to the alternative presentation content.
Note that the sensibility in the viewing ability is processed by the control means (not shown) of the apparatus 3 and is held in advance in the profile holding means 13.

The viewing environment profile describes a presentation device capable of presenting content or alternative presentation content and a conversion device capable of conversion.
The description of the presentation device that can present content or alternative presentation content is related to the presentation device 2 connected to the device 3, and is information about the name, function, and specification of the presentation device 2. The description of the conversion device that can convert the content or the alternative presentation content is information regarding the function of the conversion means 19 described later.

  The judging unit 15 compares the necessary list metadata received by the receiving unit 9 with the viewer profile and the viewing environment profile held in the profile holding unit 13, and the viewer profile and the viewing environment profile are necessary lists. It is determined whether or not the conditions described in the metadata are satisfied. When the determination unit 15 determines that the viewing environment profile satisfies the condition described in the necessary list metadata, the content input to the determination unit 15 is output to the output unit 23 as it is.

  In addition, when the determination unit 15 does not determine that the viewer profile and the viewing environment profile satisfy the conditions described in the necessary list metadata, the content, alternative presentation content, grouping metadata, and correlation metadata are derived. The content, the alternative presentation content, the viewer profile, and the viewing environment profile are output to the conversion unit 19.

  The deriving unit 17, when it is determined that the viewer profile and the viewing environment profile satisfy the necessary list metadata, substitutes the alternative presentation content for the grouping metadata, the correlation metadata, and the time information instead of the constituent parts of the content. Is derived on the basis of The details of the derivation method (derivation method) for deriving the alternative presentation content by the derivation means 17 will be described later.

When the content conversion apparatus that converts the alternative presentation content is listed in the necessary list metadata of the alternative presentation content derived by the derivation unit 17, the conversion unit 19 transmits the alternative presentation content to the viewer. It converts to a possible conversion part. Note that details of the conversion method (conversion method) for converting the alternative presentation content into a converted part by the conversion means 19 will be described later.
Here, the derivation means 17 and the conversion means 19 are used together, but at least the derivation means 17 may be provided.

  The reconstructing means 21 reconstructs the alternative presentation content derived by the derivation means 17 or the converted portion obtained by converting the alternative presentation content by the conversion means 19 and the content accumulated by the content / metadata accumulation means 11. It constitutes.

  The output unit 23 outputs the reconstructed content reconfigured by the reconfiguration unit 21 to the presentation device 2.

  According to the content output device 3, the reception means 9 receives the content, alternative presentation content, divided metadata, necessary list metadata, grouping metadata, correlation metadata, and time information transmitted from the transmission side, and determines By referring to the viewer profile and the viewing environment profile held (accumulated) by the profile holding unit 13 by the means 15 and the derivation unit 17, the physical ability of the individual viewer and the content corresponding to the situation A variety of presentation methods can be selected and performed. Further, in some cases, the conversion unit 19 can add a converted portion converted from the alternative presentation content to the content.

<Operation of content transmission device>
Next, the operation of the content transmission device 1 will be described.
The content transmitting apparatus 1 inputs content (original content), divided metadata, necessary list metadata, grouping metadata, and correlation metadata by the input unit 5. Then, the content transmission device 1 transmits the content (original content) input by the transmission means 7, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information. .

<Operation of content output device>
Next, the operation of the content output apparatus 3 will be described with reference to the flowcharts shown in FIGS. 2 and 3 (see FIG. 1 as appropriate).
First, the content output device 3 receives the content, the alternative presentation content, the divided metadata, the necessary list metadata, the grouping metadata, the correlation metadata, and the time information by the receiving unit 9 (step S1).

  Subsequently, the content output device 3 uses the determination unit 15 to determine the conditions described in the content required list metadata for each part (component) divided by the divided metadata, based on the conditions in the viewer profile and the viewing environment profile. It is determined whether or not the condition is satisfied (step S2). When the content output device 3 determines that the viewer list and the viewing environment profile satisfy the necessary list metadata (Yes in step S2), the content output device 3 outputs the content as it is, as it is not necessary to present the alternative list. To be presented on the presentation device 2 (step S3).

  In addition, when the content output device 3 does not determine that the required list metadata is satisfied by the viewer profile and the viewing environment profile (step S2, No), the content output device 3 It is determined whether there is a content component having the same grouping metadata as the grouping metadata of the content component (step S4).

  If the content output device 3 determines that there is a content component having the same grouping metadata as the grouping metadata of the content component (step S4, Yes), there is no need to present an alternative. Then, the content is output as it is to the output means 23 and is presented on the presentation device 2 (step S3). If the content output device 3 does not determine that there is a content component having the same grouping metadata as the grouping metadata of the content component (step S4, No), the content output device 3 It is determined whether or not there is a content component having a correlation based on the correlation metadata of the component (step S5).

  If the content output device 3 determines that there is a content component having a correlation based on the correlation metadata of the content component (step S5, Yes), the content output device 3 outputs the content as it is, as it is not necessary to present an alternative. It outputs to 23 and makes the presentation apparatus 2 present (step S3). If the content output device 3 does not determine that there is a content component having a correlation based on the correlation metadata of the content component (step S5, No), the group of alternative presentation content for the unsatisfied part It is determined whether or not there is alternative presentation content having the same group metadata as the generalized metadata (step S6).

  When the content output device 3 determines that there is alternative presentation content having the same group metadata as the grouping metadata of the constituent parts of the content (step S6, Yes), the determination unit 16 performs the replacement. It is determined whether the viewer list and the viewing environment profile satisfy the required list metadata of the presented content (step S7). When the content output device 3 determines that the viewer list and the viewing environment profile satisfy the required list metadata of the alternative presentation content (Yes in step S7), the content output device 3 executes the alternative presentation by the derivation unit 17. (Step S8).

  In addition, the content output apparatus 3 does not determine that there is alternative presentation content having the grouping metadata of the content component and the same group metadata (No in step S6) and the necessary list of alternative presentation content If it is not determined that the viewer profile and the viewing environment profile satisfy the metadata (step S7, No), whether or not there is alternative presentation content having a “included” correlation for the unsatisfied portion Is determined (step S9).

In addition, when it is not determined that there is alternative presentation content having “included” correlation (No in step S9), the content output device 3 provides alternative presentation having “similarity” correlation for unsatisfied parts. It is determined whether there is content (step S10).
If the content output device 3 determines in step S9 that there is alternative presentation content having “included” correlation (Yes in step S9), the determination unit 15 needs the alternative presentation content. It is determined whether or not the list metadata satisfies the viewer profile and the viewing environment profile (step S11), and if satisfied (step S11, Yes), the process proceeds to step S8, and if not satisfied (step S11, No) ), Go to step S10.

  If the content output device 3 determines in step 10 that there is an alternative presentation content having a correlation of “similarity” (step S10, Yes), the determination unit 15 needs the alternative presentation content. It is determined whether or not the list metadata satisfies the viewer profile and the viewing environment profile (step S12), and if satisfied (step S12, Yes), the process proceeds to step S8, and if not satisfied (step S12, No) ), The process returns to step S10.

  Then, if it is not determined that there is alternative presentation content having a correlation of “similarity” (No in step S10), the content output device 3 outputs the content as it is to the output unit 23 as alternative presentation is impossible. Then, it is presented to the presentation device 2 (step S13).

<Specific examples of viewer profile and viewing environment profile>
Next, specific examples of information (items) included in the viewer profile and the viewing environment profile will be described with reference to FIG.
As shown in FIG. 4, the viewer profile defines perceptual power, cognitive power, and comprehension power. Visual, auditory, and tactile sensations are defined as the perceptual power. (Japanese) and language reading (Japanese, English) are defined, and as comprehension, language understanding (Japanese, English) and scene understanding (recalling a specific situation when a certain video or voice is received) For example, an ability to recall “summer in the country” when a scene composed of “wind chimes video” and “semi cry” is defined.

  The viewing environment profile describes the names of the conversion generation device (conversion means 19) and the presentation device (presentation device 2 connected to the content output device 3). A device, a caption super device, and a text sentence Braille device are included, and a video display, a speaker, a Braille display, and a tactile pin display are included as presentation devices.

  By holding the viewer profile and the viewing environment profile including such information in the profile holding unit 13, the content output device 3 realizes the presentation of content corresponding to the viewer's viewing ability and viewing environment. can do.

<Specific examples of alternative presentation by deriving means and converting means>
Next, specific examples of alternative presentation in the content output apparatus 3 will be described with reference to FIGS. 5 to 8 (specific example 1: news program) and FIGS. 9 to 13 (specific example 2: baseball broadcast program).
FIG. 5 shows a scene in which a caster is reading a manuscript in one scene of a news program displayed on the video display. FIG. 6 shows the result of the alternative presentation (the result of adding the alternative presentation content) to the scene shown in FIG. FIG. 7 explains the constituent parts of the content corresponding to the scene shown in FIG. 5 and alternative presentation content, and added metadata (including non-multiplexed metadata). FIG. 8 shows an example of divided metadata that defines the constituent parts of the content to which the metadata shown in FIG. 7 is added.

  As shown in FIG. 5 and FIG. 6, in the news program, the voice read by the caster “I understand that yesterday's ...” (see FIG. 5). If the viewer cannot understand (the viewer is hearing-impaired and hearing of the viewing ability of the viewer profile is NG), or the voice presentation is difficult (sound presentation is NG) In addition, the voice is displayed as text data near a caster on the screen of the video display (see FIG. 6).

  In order to perform such alternative presentation, the content components shown in FIG. 7 and the alternative presentation content and metadata are defined. In FIG. 7, “names of content components and alternative presentation content” are defined. When the creator groups the “original or alternative” indicating whether it is a content component or alternative presentation content and the content component or alternative presentation content at the time of production (not multiplexed as metadata) The relationship between “the intention of this component”, “grouping metadata”, and “necessary list metadata” is defined.

  In FIG. 7, the “name of the content component and alternative presentation content” “ana voice” indicates the content (original content) component, and the “intention of this component” of the content component. "Is to understand the details of a certain news", "#A" is defined as "grouping metadata", and "required list metadata" (which means is used to convey) " "Speaker" is defined.

  In FIG. 7, for example, “original text data (alternative time-series text)” of “content component part and alternative presentation content name” indicates the alternative presentation content. “Intention of this component” is “Let me understand the detailed contents about a certain news”, “#A” is defined as “Grouping metadata”, and “Necessary list metadata” is “ “Time-series text presentation device”, “Japanese-English translation device”, “speech synthesizer”, and “speaker” are defined. The “time-series text presentation device” described in the first row of the “necessary list metadata” indicates the presentation device, and the “Japanese-English translation device” described in the second and third rows. "Speech synthesizer" indicates a conversion device.

  That is, in the “original text data (substitution time-series text)” of the alternative presentation content, three presentation methods (presentation methods) are defined in the required list metadata, and the viewer profile and the viewing environment are defined. As a result of referring to the profile, when “time series text presentation device” is selected in the required list metadata, the alternative presentation content is derived by the deriving means 17 instead of the component part of the content, and further converted. It is presented after being converted by a Japanese-English translation device or a speech synthesizer corresponding to the means 19.

  FIG. 8 is a definition of divided metadata that divides content into constituent parts. For example, the constituent part of “ana voice” shown in FIG. 7 is a time position between a start time X and an end time Y. As a spatial position, it is added to the area of audio chA and frequency bands BB to CC. Further, for example, the component part of “item super” is added as a time position between the start time X and the end time Y as a spatial position in the coordinate range DD to EE of the video (on the video). .

Next, specific examples of alternative presentation in the content output device 3 will be described with reference to FIGS. 9 to 13 (specific example 2: baseball broadcast program).
FIG. 9 shows a case where a normal presentation is performed in a baseball broadcast program, a case where presentation is made for a person who cannot hear or hear a sound, and a case where presentation is made for a person watching on a caption display. FIG. 4 is a diagram showing a relationship between a producer's intention with time and video, audio, and subtitles. FIG. 10 is a diagram showing an example in which the way of presentation is changed according to the viewer (here, viewer A and viewer B) when displaying the baseball broadcast program. FIG. 11 shows a list of metadata added to a scene with a baseball broadcast program. FIG. 12 is a diagram showing an example in which an alternative presentation of a baseball broadcast program (only a voice is displayed when a display screen is not seen) is performed according to the metadata shown in FIG. FIG. 13 shows an example in which an alternative presentation of a baseball broadcast program (only the voice is displayed when the display screen is small enough to prevent the ball from being discriminated) according to the metadata shown in FIG. It is a figure.

  As shown in FIG. 9, in the case of normal presentation in a baseball broadcast program, the intention of the producer is conveyed by the presentation of video and audio, and the subtitles in which the audio content is transcribed are not presented. In addition, the intention (creator's intention) expressed in the video (relay video) is “tell the game content”, and among the intentions expressed by the voice, the actual part is “tell the game content” As for the commentary part, it is “to convey commentary about the game”.

  In addition, in a baseball broadcast program, when a presentation is made for a person who cannot hear sound or for a person who has not heard, a video and a voice are presented, and the intention of the producer is conveyed for the video, but the voice is not recognized. In addition, the subtitles with the audio content converted into text are not presented in the live part, but are presented in the commentary part to convey the intention of the producer.

  Furthermore, in the baseball broadcast program, when the presentation for the person watching on the caption display is performed, neither video nor audio is presented. In addition, all subtitles in which the audio content is converted to text are presented and the intention of the producer is conveyed.

  Here, when the alternative presentation in the content output device 3 is compared with the conventional presentation method, the conventional presentation method can be understood by looking at the display screen, for example, subtitles in which the audio content is also transcribed in the live part of the audio If you send only the commentary part of the audio to be displayed in subtitles, the content of the game will not be transmitted to those who are watching only the subtitles. It was happening. Therefore, in the alternative presentation in the content output device 3, the content transmitting device 1 attaches grouping metadata and necessary list metadata to each constituent part and has the same intention as the constituent part composed of video ( In other words, the device 3 determines not to make a substitute presentation even if it is not recognized with respect to a constituent part composed of audio (having the same grouping metadata), so that it can respond to the viewer in various viewing situations. You can make a presentation.

  As shown in FIG. 10, in a baseball broadcast program, when the intention of the producer is “tell SBO status” in a part of the video of the scene where the pitcher throws the ball (the area is designated by coordinates) In addition, alternative presentation contents having the same intention (expandable data indicating the SBO status) are prepared. Here, the area is a coordinate surrounding the area where the SBO is displayed. In the alternative presentation in the content output device 3, the viewer A does not present alternative text data because the SBO originally included in the content is always displayed, and the viewer B substitutes when necessary. Text data is presented.

  That is, as a result of enlarging the original video in the original video (original content), the “informed SBO status” part intended by the producer is not displayed on the display screen, so the alternative text data is superposed. In addition, if the portion of the original video (original content) that is originally intended to expand the video and the “speaking SBO status” that is the intention of the producer is within the display screen, the alternative text data is not superposed. .

Also, as shown in FIG. 11, the constituent parts of content corresponding to a scene and alternative presentation content, and added metadata (including non-multiplexed metadata) are defined, so that FIG. Further, the alternative presentation shown in FIG. 13 is possible.
That is, FIG. 12 shows a case where an alternative presentation is realized when the viewer cannot see the display screen in the baseball relay program, and FIG. 13 shows that the viewer is in the batter state or the ball in the baseball relay program. This shows a case where an alternative presentation is realized when the display screen is so small that the count cannot be determined.

  More specifically, in FIG. 11, “relay video” (grouped metadata #A) and “relay video pitching” (grouped metadata), which are constituent parts (sources to be added) originally related to presentation of content on the video display. #B), “relay video hitting” (grouped metadata #C, #D), “to relay video runner 1” (grouped metadata #E), “SBO super” (grouped metadata #F) ) Requires a video display as the presentation device 2 and is displayed on the display screen, and cannot be presented.

  Then, “ball field SE” (grouped metadata #A, #C), which is a component having the same correlation metadata as these components, “live voice“ Now count is two-three ”” (grouped metadata #G ), “Live audio“ I threw ”” (Grouped metadata #B), “Live audio“ I hit it! ”(Grouped metadata #C),“ Live audio “Hit before left” ”(Grouped) Metadata #D and #E) require a speaker as the presentation device 2 and are output as audio. Among these, since “ballpark SE” (grouped metadata #A, #C) is originally content, the components that require alternative presentation are “relay video pitching” (grouped metadata #B), “Relay video hitting” (grouped metadata #D), “To relay video runner 1 塁” (grouped metadata #E).

  Among the components that require alternative presentation, those with grouping metadata of #B, #D, and #E are the actual presentation voices “throwed”, “hit”, “left” which are alternative presentation contents There is a “pre-hit”, and each grouping metadata “makes you understand that you threw” (#B), “makes you understand the direction of the hit ball” (#D), “makes you understand that it is a single hit” ( #E), an alternative presentation can be made.

  That is, the original content component “relay video pitching” (grouped metadata #B) is replaced with the alternative presentation content component “live speech“ threw ”(grouped metadata #B). The part “relay video hitting” (grouped metadata #D) is included in the constituent part “relay video” of the original content in the constituent part “actual voice“ hit before left ”” (grouped metadata #D) of the alternative presentation content. “To Runner 1」 ”(grouped metadata #E) will be presented in place of the constituent part“ actual voice “hit before left” ”(grouped metadata #E) of the alternative presentation content.

  Further, among the components that need to be replaced, the component “SBO Super” (grouped metadata #F) of the original content can be replaced as shown in FIG. As shown in FIG. 12, since the viewer cannot see the display screen, the “present condition voice”, which is an alternative presentation content of the grouping metadata #G correlated with the grouping metadata #F, An alternative presentation by “two three” ”will be performed.

  Further, in the alternative presentation when the display screen is so small that the viewer cannot determine the batter state and the ball count in the baseball broadcast program shown in FIG. “Relay video hitting” (grouped metadata #C, #D), “To relay video runner 1” (grouped metadata #E), “SBO super” (grouped) Since the metadata #F) requires a video display as the presentation device 2 and is displayed on the display screen, it cannot be presented.

  Then, “ball field SE” (grouped metadata #A, #C), which is a component having the same correlation metadata as these components, “live voice“ Now count is two-three ”” (grouped metadata #G ), “Live audio“ I threw ”” (Grouped metadata #B), “Live audio“ I hit it! ”(Grouped metadata #C),“ Live audio “Hit before left” ”(Grouped) Metadata #D and #E) require a speaker as the presentation device 2 and are output as audio. Among them, “baseball field SE” (grouped metadata #A, #C) is inherently content, so the component that needs to be replaced is “relay video hitting” (grouped metadata #D). “To relay video runner 1” (grouped metadata #E) and “SBO super” (grouped metadata #F).

  Therefore, the original content component “relay video hitting” (grouped metadata #D) is replaced with the original content “replacement voice“ pre-left hit ”” (grouped metadata #D). The component part “To the relay video runner 1” (grouped metadata #E) is to be presented in place of the component part “actual voice“ hit before left ”” (grouped metadata #E) of the alternative presentation content It becomes.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to the said embodiment. For example, in the present embodiment, the content transmission device 1 and the content output device 3 are configured. However, the content transmission program and the content reception program described in a general-purpose or special computer language can be realized so that the processing of these configurations can be realized. It is also possible to do. In these cases, the same effects as those of the content transmission device 1 and the content output device 3 can be obtained.

It is a block diagram of the content transmission output system which concerns on embodiment of this invention. 3 is a flowchart for explaining the operation of the content output apparatus shown in FIG. 1 (first half). 3 is a flowchart for explaining the operation of the content output apparatus shown in FIG. 1 (second half). It is the figure which showed the specific example of the viewer profile and the viewing environment profile. It is a figure for demonstrating the specific example (specific example 1: news program) of alternative presentation. It is a figure for demonstrating the specific example (specific example 1: news program) of alternative presentation. It is a figure for demonstrating the specific example (specific example 1: news program) of alternative presentation. It is a figure for demonstrating the specific example (specific example 1: news program) of alternative presentation. It is a figure for demonstrating the specific example (specific example 2: baseball broadcast program) of alternative presentation. It is a figure for demonstrating the specific example (specific example 2: baseball broadcast program) of alternative presentation. It is a figure for demonstrating the specific example (specific example 2: baseball broadcast program) of alternative presentation. It is a figure for demonstrating the specific example (specific example 2: baseball broadcast program) of alternative presentation. It is a figure for demonstrating the specific example (specific example 2: baseball broadcast program) of alternative presentation.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Content transmission apparatus 2 Presentation apparatus 3 Content output apparatus 5 Input means 7 Transmission means 9 Receiving means 11 Content metadata storage means 13 Profile holding means 15 Determination means 17 Derivation means 19 Conversion means 21 Reconfiguration means 23 Output means

Claims (3)

Necessary on the receiving side for content, alternative presentation content to be presented in place of this content, division metadata indicating the division part of the content, and for each constituent part obtained by dividing the content according to the division metadata and for the alternative presentation content Required list metadata that defines the presentation device to be used, the function of the device, and the viewing ability required for the viewer on the receiving side, and grouping meta data for grouping the constituent parts of the content and the alternative presentation content Correlation metadata of each component part and the alternative presentation content provided with the correlation of the data and the grouped metadata in accordance with a preset criterion, and the time of the alternative presentation content attached corresponding to the elapsed time of the content Information and receiving the information on the presentation device. Ntsu or said a content output apparatus that outputs the alternate presentation content,
Receiving means for receiving the content, the alternative presentation content, the split metadata, the required list metadata, the grouping metadata, the correlation metadata, and the time information;
A viewer profile that defines the viewing ability of a viewer who views the content or the alternative presentation content, a presentation device that can present the content or the alternative presentation content, and a viewing environment profile that describes the function of the device are stored. Profile storage means to
The necessary list metadata is compared with the viewer profile and viewing environment profile stored in the profile storage means, and the viewer profile and Determining means for determining whether or not the viewing environment profile satisfies a condition described in the necessary list metadata;
As a result of the determination by the determination means, when the viewer profile and the viewing environment profile do not satisfy the conditions described in the necessary list metadata, the component to which the necessary list metadata that is not satisfied is added Based on the viewer profile, the grouping metadata, the correlation metadata and the time information, the viewing ability is satisfied, and the same grouping metadata is added or correlation metadata within a predetermined range Deriving means for deriving the alternative presentation content to which is added,
Reconstructing means for reconstructing the alternative presentation content derived by the deriving means and the constituent parts of the content;
Output means for outputting the reconstructed content reconstructed by the reconstructing means to the presentation device;
A content output apparatus comprising: Necessary on the receiving side for content, alternative presentation content to be presented in place of this content, division metadata indicating the division part of the content, and for each constituent part obtained by dividing the content according to the division metadata and for the alternative presentation content Required list metadata that defines the presentation device to be used, the function of the device, and the viewing ability required for the viewer on the receiving side, and grouping meta data for grouping the constituent parts of the content and the alternative presentation content Data, correlation metadata of each of the component parts and the alternative presentation content provided according to a preset criterion for correlation of the grouped metadata, and time information attached corresponding to the elapsed time of the content. The content or the alternative presentation on the presentation device A content output apparatus for outputting content,
Receiving means for receiving the content, the alternative presentation content, the split metadata, the required list metadata, the grouping metadata, the correlation metadata, and the time information;
A viewer profile that defines a viewing ability of a viewer who views the content or the alternative presentation content, a presentation device that can present the content or the alternative presentation content, a function of the device, and a conversion device that can be converted are described. Profile storage means for storing a viewing environment profile;
The necessary list metadata is compared with the viewer profile and viewing environment profile stored in the profile storage means, and the viewer profile and Determining means for determining whether or not the viewing environment profile satisfies a condition described in the necessary list metadata;
As a result of the determination by the determination means, when the viewer profile and the viewing environment profile do not satisfy the conditions described in the necessary list metadata, the component to which the necessary list metadata that is not satisfied is added Based on the viewer profile, the grouping metadata, the correlation metadata and the time information, the viewing ability is satisfied, and the same grouping metadata is added or correlation metadata within a predetermined range Deriving means for deriving the alternative presentation content to which is added,
As a result of the determination by the determination means, when the viewing environment profile does not satisfy the necessary list metadata, the viewer profile and the viewing environment profile for the component to which the necessary list metadata that did not satisfy is added. The alternative presentation content to which the same grouping metadata is added or to which correlation metadata within a predetermined range is added can be output by the conversion device and the viewing capability is satisfied and the viewing is performed. Conversion means for converting into a conversion part that can be transmitted to a person,
Reconstructing means for reconstructing the converted part converted by the converting means, the alternative presentation content derived by the deriving means, and the constituent parts of the content;
Output means for outputting the reconstructed content reconstructed by the reconstructing means to the presentation device;
A content output apparatus comprising:   The content output apparatus according to claim 1 or 2, wherein the content, alternative presentation content to be presented instead of the content, division metadata indicating a division part of the content, and the content and the substitution according to the division metadata The required list metadata that defines the presentation device required on the receiving side for the constituent parts into which the presentation content is divided and the substitute presentation content, the function of the device, and the viewing ability required for the viewer on the receiving side, and the content Grouping metadata for grouping the component parts and the alternative presentation content, and the correlation metadata of the component parts and the alternative presentation content with the correlation of the grouping metadata attached according to a preset criterion , Corresponding to the elapsed time of the content Content transmitting apparatus comprising: a transmitting means for transmitting the the time information.

Images