JP2009253825A - Electronic device, and scene enhancement method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic device and a scene enhancement method for enhancing a particular scene to a user in replay of a plurality of audio-visual content data. <P>SOLUTION: In the electronic device which can replay the audio-visual content data including moving image data and audio data and also can display the plurality of replayed moving image data in each of split windows, the particular scene is identified from the moving image data based on a given criteria, and the audio data to be associated with the particular scene identified is identified. In addition, when highlighting the identified particular scene in the display, the audio data associated with the particular scene is released as a sound from a speaker. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an electronic apparatus and a scene enhancement method for emphasizing a specific scene when reproducing audiovisual content data.

  2. Description of the Related Art In recent years, techniques for displaying moving image data in a plurality of reproduced audiovisual content data on a single monitor have been developed along with improvement in processor processing capacity and increase in monitor size.

In Patent Document 1, a plurality of contents are displayed on a monitor, and the screen configuration of a multi-screen is changed according to the state of excitement or popularity of each content. For example, audio is displayed on the left side of the monitor. A technique is disclosed in which if the audio of a program being selected is output from the speaker, only the audio of the program displayed on the left side is output from the speaker and the audio of the right program is not output.
Japanese Patent Application Laid-Open No. 2007-31942 (Pages 5, 7 and 4)

  However, when a plurality of moving image data is displayed on one monitor, there is a need for the user to concentrate on only a specific scene in the reproduced moving image data and view it.

  SUMMARY An advantage of some aspects of the invention is that it provides an electronic device and a scene enhancement method for emphasizing a specific scene to a user by reproducing a plurality of audiovisual content data.

  In order to achieve the above object, an electronic device according to claim 1 is an electronic device capable of reproducing audiovisual content data including moving image data and audio data, and a moving image included in a plurality of reproduced audiovisual content data. A specific scene is detected from image data based on a predetermined condition, and audio data associated with the detected specific scene is selected from audio data included in the reproduced plurality of audiovisual content data. A detection unit for detecting, a display unit for highlighting the specific scene detected by the detection unit when displaying a plurality of reproduced moving image data, and a case of highlighting the specific scene on the display unit Audio data detected by the detection means. Characterized by comprising a speaker that emits a sound.

  The scene enhancement method according to claim 13 is a scene enhancement method in an electronic device capable of reproducing audiovisual content data including moving image data and audio data, and the moving image included in a plurality of reproduced audiovisual content data. In a state where a specific scene is detected from data based on a predetermined condition, audio data associated with the detected specific scene is detected, and a plurality of reproduced moving image data is displayed. The detected specific scene is highlighted on a display unit, and the detected audio data is emitted as a sound from a speaker at the timing of highlighting the specific scene on the display unit.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to provide the electronic device and scene enhancement method which emphasize a specific scene to a user by reproduction | regeneration of several audio visual content data.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  First, the configuration of an electronic apparatus according to an embodiment of the present invention will be described with reference to FIGS. The electronic device of the present embodiment is realized as, for example, the digital television 1.

  FIG. 1 is a diagram illustrating an example of a digital television.

  The digital television 1 includes a main body 20 and a stand 21 that supports the main body 20.

  An LCD 13 is incorporated in the front surface of the main body 20. The LCD 13 displays moving image data included in the audiovisual content data.

  Further, the main body 20 has a built-in speaker 17. The speaker 17 is provided so as to be positioned at the lower part of the front surface of the digital television 1. The speaker 17 emits audio data included in the audiovisual content data as sound. Next, the hardware configuration of the digital television 1 will be described.

  FIG. 2 is a diagram illustrating an example of the hardware configuration of the digital television 1.

  The tuner 12 receives digital broadcast program data that is stream data via an antenna 12 a connected to the tuner 12. For example, stream data encoded in MPEG format such as MPEG2 (Moving Picture Experts Group 2) is received.

  The video / audio processing unit 11 processes the digital broadcast program data input via the tuner 12. The video / audio processing unit 11 separates the digital broadcast program data, which is audiovisual content data including moving image data and audio data, into moving image data and audio data, and each is generated by performing the separation processing. The decoding process is performed on the data, and the rendering process is performed on the data generated by the decoding process.

  The video / audio processing unit 11 outputs the moving image data after the rendering process to the LCD 13, while outputting the audio data after the rendering process to the speaker 15.

  The HDD 14 stores digital broadcast program data received by the tuner 12.

  The controller 10 decodes the command transmitted from the remote controller 2 and executes each control according to the content of the command.

  The controller 10 activates a multi-display application, which will be described in detail later. The activated multi-display application uses the video / audio processing unit 11 to process moving image data and audio data. Processing performed by the multi-display application will be described in detail later. Next, a state in which a multi-display application is executed to display a plurality of moving image data on the LCD 13 will be described.

  FIG. 3 is a diagram for explaining a state in which a multi-display application is executed to display a plurality of moving image data on the LCD 13.

  The multi-display application has a function of reproducing a plurality of moving image data and displaying the reproduced plurality of moving image data on the LCD 13.

  As shown in FIG. 3, the multi-display application divides the screen area of the LCD 13 into, for example, eight parts, and displays the reproduced moving image data mp1 to mp8 in each of the screen areas.

  As shown in FIG. 3, in a state in which the multi-display application is executed and the reproduced moving image data mp1 to mp8 are displayed in the respective screen areas, they are associated with each of the plurality of moving image data. When a plurality of audio data is reproduced, a plurality of sounds are simultaneously emitted from the speaker 17.

  Therefore, when the multi-display application displays the reproduced moving image data mp1 to mp8 in the respective screen areas, usually, a plurality of sounds associated with each of the plurality of moving image data are simultaneously displayed on the speaker 17. Does not release from.

  Next, among the functions of the multi-display application, a function for appealing a specific scene to the user when reproducing and displaying a plurality of moving image data will be described.

  FIG. 4A is a flowchart for explaining setting for highlighting a specific scene, which is one of the methods for appealing the specific scene to the user. FIG. 4B is a diagram illustrating an example of a setting window displayed on the LCD 13 for the user to select a highlighting method.

  When the user wants to highlight a specific scene, the user activates the setting function of the multi-display application to display the setting window shown in FIG. 4B on the LCD 13, and the user is shown in this window. One highlighting method is selected from a plurality of highlighting methods.

  When the multi-display application recognizes that the user has designated “enlarged display of specific scene” via the setting window shown in FIG. 4B (step S100 Yes), the multi-display application displays the specific scene. It sets so that it may enlarge and display (step S101).

  If the multi-display application does not recognize that “enlarged display of a specific scene” has been designated (No in step S100), the multi-display application can be read by the user via the setting window shown in FIG. It is determined whether or not it is recognized that “blink display of specific scene” is designated, and when it is determined that “blink display of specific scene” is designated (Yes in step S102), the multi-display application blinks the specific scene. It sets so that it may display (step S104).

  If the multi-display application does not recognize that “blink display of specific scene” has been designated (No in step S102), the multi-display application sets not to highlight the specific scene (step S104).

  Next, a description will be given of a first example of setting examples for specifying a scene to be highlighted when reproducing a plurality of moving image data.

  FIG. 5A is a flowchart illustrating a setting for specifying a scene based on a face image, which is one of setting examples for specifying a highlighted scene. FIG. 5B is a diagram illustrating an example of a setting window displayed on the LCD 13 in order for the user to select whether or not to specify a scene based on a face image. FIG. 5C is a diagram showing an example of a setting window displayed on the LCD 13 in order for the user to specify a face image used for specifying a highlighted scene.

  When it is desired to specify a scene including the face image designated by the user, the user activates the setting function of the multi-display application to display the setting window shown in FIG. It is selected whether or not the scene including the designated face image is specified.

  When the multi-display application recognizes that “specifying a scene including the designated face image” is designated by the user via the setting window shown in FIG. 5B (Yes in step S200), The multi-display application is set to specify a scene including the designated face image (step S201).

  When the multi-display application is set to specify a scene including the designated face image, the multi-display application displays a setting window shown in FIG. 5C on the LCD 13 (step S202).

  The multi-display application analyzes the face image designated by the user via the setting window shown in FIG. 5C displayed on the LCD 13 in step S202 (step S203). As an example of analysis of a face image, for example, facial features such as “eyes”, “nose”, and “mouth” are extracted. The multi-display application specifies a scene including the face image using the result analyzed in step S203.

  Next, the multi-display application in a state where the setting for selecting the highlighting method for the specific scene described with reference to FIG. 4 and the setting for specifying the scene based on the face image described with reference to FIG. An example of a reproduction process of a plurality of audiovisual content data performed by will be described. Here, a case where enlarged display is selected in the selection setting of the highlighting method for the specific scene described with reference to FIG. 4 will be described.

  FIG. 6 is a flowchart illustrating an example of a reproduction process of a plurality of audiovisual content data performed by the multi-display application in a state where the setting described with reference to FIGS. 4 and 5 is completed.

  In the following description, audio display content data such as digital broadcast program data stored in advance in the HDD 14 is divided into a plurality of multi-display applications, thereby generating a plurality of audiovisual content data. A case where each of the visual content data is reproduced will be described.

  The multi-display application reproduces each data of the plurality of audiovisual content data using the video / audio processing unit 11 (step S300).

  The multi-display application determines whether or not the face image specified by the user is included in the moving image data in the reproduced plurality of audiovisual content data (step S301).

  When the multi-display application determines that the reproduced moving image data includes the face image designated by the user (Yes in step S301), the reproduced moving image data includes the face image. A scene is specified (step S302).

  The multi-display application enlarges and displays the scene specified in step S302 on the LCD 13 (step S303).

  In step S303, when the specified scene is enlarged and displayed on the LCD 13, the multi-display application detects reproduced audio data associated with the specified scene, and uses the detected audio data as sound from the speaker 15. Release (step S304).

  FIG. 7 shows an enlarged display of a specific scene and a state in which a sound associated with the specific scene is emitted, which is executed by the multi-display application in steps S303 and S304.

  As described above, the multi-display application enlarges and displays the specific scene including the face image designated by the user on the LCD 13 and releases the audio data associated with the specific scene from the speaker 15 as a sound. The user can easily view the scene including the face image designated by the user among the plurality of moving image data displayed on the LCD 13 and the sound associated with the scene. Can be heard.

  Next, a second embodiment of setting examples for specifying a scene to be highlighted when reproducing a plurality of moving image data will be described.

  FIG. 8A is a flowchart for explaining setting for specifying a scene based on sound volume, which is one of setting examples for specifying a highlighted scene. FIG. 8B is a diagram showing an example of a setting window displayed on the LCD 13 for the user to select whether or not to specify a scene based on the volume of sound.

  When the user wants to specify a scene based on the volume of sound, the user activates the setting function of the multi-display application to display the setting window shown in FIG. Based on this, it is selected whether or not to specify a scene.

  When the multi-display application recognizes that “specify the scene based on the volume of sound” is designated by the user via the setting window shown in FIG. 8B (Yes in step S400), The display application is set to specify the scene based on the volume of the sound (step S401).

  Next, in the state where the setting for selecting the highlighting method for the specific scene described with reference to FIG. 4 and the setting for specifying the scene based on the sound volume described with reference to FIG. An example of reproduction processing of a plurality of audiovisual content data performed by the multi-display application will be described. Here, a case will be described in which enlarged display is selected and set in the selection setting of the highlighting method for the specific scene described with reference to FIG.

  FIG. 9 is a flowchart illustrating an example of a reproduction process of a plurality of audiovisual content data performed by the multi-display application in a state where the setting described with reference to FIGS. 4 and 8 is completed.

  In the following description, a plurality of audiovisual content data is generated by a multi-display application dividing audiovisual content data such as digital broadcast program data stored in advance in the HDD 14 into a plurality of pieces, and the plurality of generated audiovisual contents data is generated. A case where each of the visual content data is reproduced will be described.

  The multi-display application reproduces each of the plurality of audiovisual content data using the video / audio processing unit 11 (step S500).

  The multi-display application determines whether or not the audio data in the reproduced plurality of audiovisual content data is larger than a predetermined threshold value (step S501).

  When the multi-display application determines that the reproduced audio data is larger than the predetermined threshold (Yes in step S501), the multi-display application is associated with the audio data determined to be larger than the predetermined threshold from the moving image data. A scene is identified (step S502).

  The multi-display application enlarges and displays the scene specified in step S502 on the LCD 13 (step S503).

  In step S503, when the specified scene is enlarged and displayed on the LCD 13, the multi-display application determines that the audio data associated with the specified scene, that is, audio data determined as data having a value larger than a predetermined threshold value. Is emitted as a sound from the speaker 15 (step S504).

  The enlarged display of the specific scene and the sound emission state associated with the specific scene executed by the multi-display application in steps S503 and S504 are shown in FIG.

  In this way, the multi-display application enlarges and displays the specified scene on the LCD 13 and releases the audio data associated with the specific scene as a sound from the speaker 15, so that the user is displayed on the LCD 13. Among a plurality of moving image data, it is possible to easily see a scene having a loudness value larger than a predetermined threshold value, for example, a scene with a loud cheering level, and to associate with the scene. It is possible to listen to the sound being played.

  Next, a description will be given of a third embodiment of setting examples for specifying a scene to be highlighted in a state where a plurality of moving image data is being reproduced.

  FIG. 11A is a flowchart for explaining setting for specifying a scene based on a word, which is one of methods for specifying a highlighted scene. FIG. 11B is a diagram showing an example of a setting window displayed on the LCD 13 for the user to select whether or not to specify a scene based on a word. FIG. 11C is a diagram showing an example of a setting window displayed on the LCD 13 for the user to specify a word used for specifying a highlighted scene.

  When the user wants to specify a scene based on a word, the user activates the setting function of the multi-display application to display the setting window shown in FIG. 11B on the LCD 13 and based on the word specified by the user. Select whether or not to specify the scene.

  When the multi-display application recognizes that “specify the scene based on the word” is designated by the user via the setting window shown in FIG. 11B (Yes in step S600), the multi-display application The scene is set to be specified based on the word designated by the user (step S601).

  When the multi-display application is set to specify a scene based on a word designated by the user, the multi-display application displays a setting window shown in FIG. 11C on the LCD 13 (step S602).

  When the multi-display application recognizes that a word has been designated by the user via the setting window shown in FIG. 11C, the multi-display application sets a word used for specifying a scene (step S603). ).

  Next, in the state where the setting for selecting the highlighting method for the specific scene described with reference to FIG. 4 and the setting for specifying the scene based on the word specified by the user described with reference to FIG. 11 are completed. An example of a reproduction process of a plurality of audiovisual content data performed by the multi-display application will be described. Here, a case will be described in which enlarged display is selected and set in the selection setting of the highlighting method for the specific scene described with reference to FIG.

  FIG. 12 is a flowchart illustrating an example of a reproduction process of a plurality of audiovisual content data performed by the multi-display application in a state where the setting described with reference to FIGS. 4 and 11 is completed.

  In the following description, a plurality of audiovisual content data is generated by a multi-display application dividing audiovisual content data such as digital broadcast program data stored in advance in the HDD 14 into a plurality of pieces, and the plurality of generated audiovisual contents data is generated. A case where each of the visual content data is reproduced will be described.

  The multi-display application reproduces each of the plurality of audiovisual content data using the video / audio processing unit 11 (step S700).

  The multi-display application determines whether or not the word specified by the user is included in the audio data in the reproduced plurality of audiovisual content data (step S701).

  If the multi-display application determines that the reproduced audio data includes the word specified by the user (Yes in step S701), the moving image associated with the audio data including the specified word A scene in the data is specified (step S702).

  The multi-display application enlarges and displays the scene specified in step S702 on the LCD 13 (step S703).

  In step S703, when the specified scene is enlarged and displayed on the LCD 13, the multi-display application displays the audio data associated with the specified scene, that is, the audio data including the word specified by the user. Is emitted as sound (step S704).

  The enlarged display of the specific scene and the release of the sound associated with the specific scene executed by the multi-display application in steps S703 and S704 are shown in FIG.

  In this way, the multi-display application enlarges and displays the specified scene on the LCD 13 and releases the audio data associated with the specific scene as a sound from the speaker 15, so that the user is displayed on the LCD 13. Among a plurality of moving image data, a scene associated with audio data including a word specified by the user can be easily viewed, and further, a sound associated with the scene can be heard. .

  In the above-described embodiment, an example in which a specific scene is highlighted is described. However, the present invention is not limited to this. The specific scene may be highlighted using a display method such as a display that reduces the brightness of the screen portion of the LCD 13 on which moving image data other than the specific scene is displayed.

  Further, in the above-described embodiment, the configuration has been described in which the audiovisual content data stored in the HDD 14 is divided into a plurality of data and the reproduced plurality of data is displayed on the divided LCD 13 screen. This configuration has an advantage that the browsing time of the audiovisual content data can be reduced. However, the present invention is not limited to this configuration. For example, a configuration in which a plurality of tuners are mounted on the digital television 1, and audio visual content data received by the plurality of tuners is reproduced and displayed on the screen of the divided LCD 13 is displayed. It may be.

  In the above-described embodiment, the configuration for performing the setting for specifying the scene highlighted by the user has been described. However, the configuration is not limited to this configuration. For example, the type of audiovisual content data selected by the user, Depending on the contents and the like, the configuration may be such that the setting for specifying the scene in which the multi-display application is highlighted is automatically performed.

  Further, the configuration for highlighting a specific scene has been described in the above-described embodiment. However, when the scene to be highlighted is to be displayed on the entire screen of the LCD 13, the user highlights the digital television 1 using the remote controller 2. A configuration may be used in which a command for displaying the displayed scene on the full screen is transmitted, and the scene on which the multi-display application is highlighted based on the command is displayed on the LCD 13 on the full screen.

  Furthermore, a plurality of tuners are mounted on the digital television 1, audio visual content data received by the plurality of tuners is reproduced and displayed on the divided LCD 13 screen, and the highlighted scene is displayed on the entire LCD 13 screen. When displaying, the audio visual content data received by the tuner other than the highlighted scene may be automatically stored in the HDD 14.

  In the above-described embodiment, the configuration for highlighting a specific scene has been described with respect to a configuration such as designation of a face image by a user and designation of a word. Configuration in which these user designation operations are performed using the remote controller 2 It may be.

  In the above-described embodiment, an example of extracting a word from audio data has been described. However, the present invention is not limited to this configuration. For example, a configuration in which a word is extracted from telop data included in audiovisual content data is also possible. Good.

  In addition, when watching a highlighted video such as enlarged display or blinking display, a video that is not the target of viewing may be configured to avoid overlooking by using a function such as time-shift recording. Good.

  The present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

The perspective view which shows the example of the external appearance of the electronic device which concerns on one Embodiment of this invention. 2 is an exemplary block diagram showing an example of the system configuration of the electronic apparatus of the embodiment. FIG. The figure explaining the state which performs a multi-display application and displays several moving image data on LCD13. FIG. 4A is a flowchart for explaining setting for highlighting a specific scene, which is one of the methods for appealing the specific scene to the user. FIG. 4B is a diagram showing an example of a setting window displayed on the LCD 13 for the user to select a highlighting method. FIG. 5A is a flowchart illustrating a setting for specifying a scene based on a face image, which is one of setting examples for specifying a highlighted scene. FIG. 5B is a diagram showing an example of a setting window displayed on the LCD 13 in order to select whether or not the user specifies a scene based on a face image. FIG. 5C is a diagram showing an example of a setting window displayed on the LCD 13 for the user to specify a face image used for specifying a highlighted scene. 6 is a flowchart for explaining an example of a reproduction process of a plurality of audiovisual content data performed by the multi-display application in a state where the setting described with reference to FIGS. 4 and 5 is completed. The figure which shows the state which expands and displays the enlarged display of a specific scene, and the sound linked | related with a specific scene. FIG. 8A is a flowchart for explaining setting for specifying a scene based on sound volume, which is one of setting examples for specifying a highlighted scene. FIG. 8B shows an example of a setting window displayed on the LCD 13 for the user to select whether or not to specify a scene based on the volume of sound. FIG. 9 is a flowchart for explaining an example of a reproduction process of a plurality of audiovisual content data performed by the multi-display application in a state where the setting described with reference to FIGS. 4 and 8 is completed. The figure which shows the state which expands and displays the enlarged display of a specific scene, and the sound linked | related with a specific scene. FIG. 11A is a flowchart for explaining setting for specifying a scene based on a word, which is one of methods for specifying a highlighted scene. FIG. 11B is a diagram showing an example of a setting window displayed on the LCD 13 for the user to select whether or not to specify a scene based on a word. FIG. 11C is a diagram showing an example of a setting window displayed on the LCD 13 for the user to specify a word used for specifying a highlighted scene. 12 is a flowchart for explaining an example of a reproduction process of a plurality of audiovisual content data performed by the multi-display application in a state where the setting described with reference to FIGS. 4 and 11 is completed. The figure which shows the state which expands and displays the enlarged display of a specific scene, and the sound linked | related with a specific scene.

Explanation of symbols

1 ... digital television, 11 ... video / audio processor, 12 ... tuner,
13 ... LCD, 14 ... HDD, 17 ... speaker, 20 ... main body,
21 ... Stand part

Claims (18)

In an electronic device capable of reproducing audiovisual content data including moving image data and audio data,
A specific scene is detected based on a predetermined condition from moving image data included in a plurality of reproduced audiovisual content data, and the audio data included in the reproduced plurality of audiovisual content data Detecting means for detecting audio data associated with the detected specific scene;
A display unit for highlighting the specific scene detected by the detection unit when displaying a plurality of reproduced moving image data;
A speaker that emits audio data detected by the detection means as sound when highlighting the specific scene on the display unit;
An electronic device comprising: The electronic device according to claim 1, wherein the predetermined condition is a face image designated by a user. The electronic device according to claim 1, wherein the predetermined condition is a loudness. The electronic device according to claim 1, wherein the predetermined condition is a word designated by a user. The electronic device according to claim 1, wherein the highlighted display is an enlarged display. The electronic device according to claim 1, wherein the highlighted display is a blinking display. In an electronic device capable of reproducing audiovisual content data including moving image data and audio data,
Detecting means for detecting a specific scene based on a predetermined condition from moving image data included in the reproduced audiovisual content data;
Second detection means for detecting audio data associated with the specific scene detected by the detection means;
Highlighting means for highlighting the specific scene detected by the detecting means in a state where a plurality of moving image data reproduced on each screen is displayed on a screen divided into a plurality of screens,
A speaker that emits audio data detected by the second detection means as sound at the timing of highlighting the specific scene on the display;
An electronic device comprising: The electronic apparatus according to claim 7, wherein the predetermined condition is a face image designated by a user. The electronic apparatus according to claim 7, wherein the predetermined condition is a loudness. The electronic device according to claim 7, wherein the predetermined condition is a word designated by a user. The electronic device according to claim 7, wherein the highlighted display is an enlarged display. The electronic device according to claim 7, wherein the highlighted display is a blinking display. In a scene enhancement method in an electronic device capable of reproducing audiovisual content data including moving image data and audio data,
Detecting a specific scene based on a predetermined condition from moving image data included in a plurality of reproduced audiovisual content data, and detecting audio data associated with the detected specific scene;
In a state of displaying a plurality of reproduced moving image data, the detected specific scene is highlighted on a display unit,
A scene enhancement method for emitting the detected audio data as a sound from a speaker at a timing for highlighting the specific scene on the display unit. The scene enhancement method according to claim 13, wherein the predetermined condition is a face image designated by a user. The scene enhancement method according to claim 13, wherein the predetermined condition is a loudness. 14. The scene enhancement method according to claim 13, wherein the predetermined condition is a word designated by a user. 14. The scene emphasizing method according to claim 13, wherein the emphasis display is an enlarged display. 14. The scene emphasizing method according to claim 13, wherein the emphasis display is a blinking display.

Images