JP2012010189A - Voice control device and voice control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a voice control device which adaptively controls voice output corresponding to a screen display.SOLUTION: The voice control device of this embodiment is equipped with first acquisition means, determination means, output means, and control means. The first acquisition means acquires an application to be displayed on a screen. The determination means determines a display area of the application. The output means outputs the application so as to display thereof superimposed on a video. When a predetermined ratio or more of the display area of the video corresponding to the size of the screen is covered with the display area of the application, the control means controls the volume of the voice corresponding to the video to be adjusted.

Description

Embodiments described herein relate generally to a sound control apparatus and a sound control method for controlling the volume of sound output.

  In recent years, television broadcast receivers have various functions as performance increases. The television broadcast receiving apparatus includes, for example, interfaces of various standards and can be connected to various apparatuses. The television broadcast receiver has a function of connecting to the Internet. Therefore, the television broadcast receiving apparatus can display not only the video based on the broadcast signal received by the tuner but also information acquired from the Internet on the monitor.

  The television broadcast receiving apparatus can display an application called a widget on the screen by network connection. When the widget is activated, new information based on the content is displayed on the monitor every moment without the viewer being aware of it.

  Even when the video based on the broadcast signal is displayed on the monitor, the widget superimposes the video on the video and displays the content on the monitor. Therefore, two different pieces of information may be displayed on the monitor at the same time. The display area (display size, display position) of the widget on the monitor varies depending on the content of the widget.

JP 2009-55541 A

  However, when the video based on the broadcast signal is displayed on the monitor, the widget may cover almost the entire display screen. In this case, the television broadcast receiving apparatus is in a state of displaying a widget that covers almost the entire image on the monitor while outputting sound based on the broadcast signal. Therefore, the display on the monitor and the output sound do not match. For broadcasters, such a situation is undesirable in terms of services to viewers. Even for the viewer, it is uncomfortable that such a situation occurs even if it is instantaneous.

  On the other hand, two-screen display or PinP (Picture in Picture) display is also an example in which different information is simultaneously displayed on the monitor. However, these screen displays are based on input by the viewer's intention. In addition, some of the images on the screen display are consistent with the output audio. Therefore, these screen displays are not disadvantageous for broadcasters and viewers.

  Therefore, an object of the present invention is to provide a voice control device and a voice control method that adaptively control voice output in accordance with screen display.

  The voice control device according to the embodiment includes a first acquisition unit, a determination unit, an output unit, and a control unit. The first acquisition unit acquires an application to be displayed on the screen. The determination unit determines a display area of the application. The output means outputs the application so that the application is superimposed on the video. The control means controls to adjust the sound volume corresponding to the video when the display area of the application covers a predetermined ratio or more of the video display area corresponding to the size of the screen.

The block diagram which shows schematic structure of the television broadcast receiver which concerns on embodiment. The figure which shows the example of a synthesis | combination of the graphics of the subtitle based on embodiment, TV image | video, and a widget. The screen figure which shows the display format of the widget which concerns on embodiment. The figure which shows calculation of the area | region where the graphics of the widget which concern on embodiment are drawn. The figure which shows calculation of the area | region where the graphics of the widget which concerns on embodiment which are based on embodiment are drawn. The flowchart which shows control of the sound volume which concerns on embodiment.

  Hereinafter, embodiments will be described with reference to the drawings. FIG. 1 is a block diagram showing a schematic configuration of a television broadcast receiver 10 (hereinafter referred to as broadcast receiver 10) according to the embodiment. A broadcast signal received by an antenna for receiving terrestrial digital broadcasting is supplied to the tuner 102 via the input terminal 101. The tuner 102 selects a channel by switching a broadcast signal of a channel desired by the user. The broadcast signal selected by the tuner 102 is supplied to the subtitle decoder 103, the video decoder 104, and the audio decoder 105. Note that the subtitle decoder 103, the video decoder 104, and the audio decoder 105 may be configured integrally.

  The subtitle decoder 103 decodes the broadcast signal into a teletext signal including a subtitle (caption). Further, the subtitle decoder 103 draws the subtitle on the surface A based on the teletext signal. The surface A is a surface composed of pixels corresponding to the screen of the monitor 115 that displays an image. The subtitle decoder 103 draws the subtitle on the surface A so that the position is the same as the display position of the subtitle on the screen of the monitor 115. Thereafter, the subtitle drawn on the surface A is supplied to the synthesis module 106. The video decoder 104 decodes the broadcast signal into a video signal. Further, the video decoder 104 draws a TV video on the plane A based on the video signal. The video decoder 104 draws the TV video on the surface A so as to be the same position as the TV video display position on the screen of the monitor 115. Thereafter, the TV image drawn on the surface A is output to the synthesis module 106. The video decoder 104 functions as an acquisition unit that acquires a video signal from a broadcast signal.

  The audio decoder 105 decodes the broadcast signal into an audio signal. The audio signal is supplied to the audio output control module 107. The audio output control module 107 converts a digital audio signal into an analog audio signal in a format that can be reproduced by the speaker 108. The audio decoder 105 functions as an acquisition unit that acquires an audio signal from a broadcast signal. The audio output control module 107 supplies an analog audio signal to the speaker 108 to output audio. The audio output control module 107 can be led out to an external device via the output terminal 109. The audio output control module 107 adjusts the volume of the audio output from the speaker 109 based on information transmitted from the drawing area determination module 114, as will be described later.

  In the broadcast receiving apparatus 10 according to the embodiment, the communication I / F 110 is connected to a LAN (local area network) terminal 111. Therefore, the communication I / F 110 is connected to the Internet via the LAN terminal 111. The communication I / F 110 shows an example of connection to the Internet via the LAN terminal 111, but may be wireless connection. The communication I / F 110 acquires content of a widget (application) from the Internet. The communication I / F 110 functions as an application acquisition unit. The widget is supplied to the widget engine 112. The widget engine 112 functions to display the widget selected by the user. The widget engine 112 controls access to the Internet for periodically acquiring widgets via the communication I / F 110.

  The widget renderer 113 draws the widget graphics acquired by the widget engine 112 on the surface A. The widget renderer 113 draws the widget graphics on the surface A so as to be in the same position as the display position of the widget graphics on the screen of the monitor 115. The widget graphics are supplied to the drawing area determination module 114. The drawing area determination module 114 determines in which part of the surface A the widget graphics are drawn. That is, the drawing area determination module 114 functions as a determination unit for an area where the graphics of the widget on the surface A are drawn. The drawing area determination module 114 calculates an area area of the surface A in which the graphics of the widget are drawn (hereinafter referred to as a graphics area area).

  The drawing area determination module 114 calculates a ratio of the widget graphics being drawn on the surface A (hereinafter referred to as a graphics ratio) based on the area area of the graphics. Thereafter, the drawing area determination module 114 transmits a signal for adjusting the volume of the audio output from the speaker 108 (hereinafter referred to as a volume adjustment signal) to the audio output control module 107 based on the graphics ratio. The drawing area determination module 114 sends a sound volume adjustment signal to the audio output control module 107 so as to mute the output from the speaker 108 if the area of the graphics area is drawn on the surface A more than a threshold (for example, 80%). Send.

  The drawing area determination module 114 supplies the graphics of the widget drawn on the surface A to the synthesis module 106. The composition module 106 synthesizes the widget graphics, subtitles, and TV images individually drawn on the surface A to generate a composite image. The composition module 106 supplies the composite video to the monitor 115 to display the composite video. The composition module 106 functions as an output unit that outputs the widget graphics, the subtitle, and the TV video so as to be superimposed and displayed on the monitor 115. The synthesis module 106 can be led to an external device via the output terminal 116.

  In the broadcast receiving apparatus 10, all the above-described operations are comprehensively controlled by the control module. This control module 118 incorporates a CPU (central processing unit) and the like, receives operation information sent from the remote controller 20 and received via the light receiving module 119, and reflects the operation contents. To control each. The user can select a desired widget to be displayed on the monitor 115 using the remote controller 20.

  The control module 118 mainly includes a read only memory (ROM) 120 that stores a control program executed by the CPU, a random access memory (RAM) 121 that provides a work area for the CPU, and various setting information and control information. And the like.

  FIG. 2 is a diagram illustrating an example of synthesis of widget graphics, subtitles, and TV video according to the embodiment. The mixing module 106 is supplied with graphics of the widget drawn on the surface A, a subtitle, and a TV image. The widget graphics are drawn in a shaded area of the surface A. In the TV image, a landscape is drawn on the entire surface A. In the mixed video, the widget graphics are superimposed on the subtitle, TV video. Therefore, in the mixed video, the graphics of the widget are superimposed on the area shown by shading on the TV video. In other words, in the mixed video displayed on the monitor 115, the viewer cannot see the TV video in the area overlapping with the shaded area.

  FIG. 3 is a screen diagram illustrating an example of the display format of the widget in the mixed video displayed on the monitor 115. FIG. 3A is a screen view of a mixed video displaying a widget in the sidebar mode. The sidebar mode is a mode for displaying a widget on one end side of the screen. In the case of the sidebar mode, the area of the graphics overlapping with the TV video is smaller than the area of the TV video. In the sidebar mode, for example, icons for activating a plurality of widgets are displayed vertically. The sidebar mode may display information on one end of the screen based on activation of one widget.

  FIG. 3B is a screen view of a mixed video displaying a widget in the dock mode. The dock mode is a mode for displaying a widget on the lower side of the screen. In the case of the dock mode, the area area of the graphics overlapping with the TV image is smaller than the area area of the TV image. In the sidebar mode, for example, icons for starting a plurality of widgets are displayed side by side. The dock mode may display information on the lower side of the screen based on activation of one widget.

  FIG. 3C is a screen view of a mixed video displaying a widget in the information / alert mode. The information / alert mode is a mode in which a widget is displayed on the upper end side of the screen. In the case of the information / alert mode, the area of the graphics overlapping with the TV video is smaller than the area of the TV video. In the information / alert mode, for example, simple information or a warning is displayed based on activation of one widget.

  FIG. 3D is a screen view of a mixed video displaying a widget in the full mode mode. Full mode is a mode in which widgets are displayed on almost the entire screen. In the case of the full mode, the area area of the graphics overlapping with the TV image is almost the same as the area area of the TV image. In the full mode, for example, information such as news is displayed on almost the entire screen based on activation of one widget. Note that the display format of the widget shown in FIG. 3 is an example, and is not limited to this.

  FIG. 4 is a diagram illustrating an example of calculation of the graphics area by the drawing area determination module 114 according to the embodiment. FIG. 4 shows the graphics of the widget drawn on the surface A and an arbitrary area on the surface A in an enlarged manner. The widget graphics are drawn on the surface A in the sidebar mode, as shown in FIG. The drawing area determination module 114 acquires alpha value information representing transparency in addition to R (red), G (green), and B (blue) information from an arbitrary pixel. The alpha value indicates the transparency of an arbitrary pixel from 0 (completely transparent) to 255 (completely opaque) independently of the color expressed in RGB.

  As shown in FIG. 4, any one pixel on the surface A on which the widget graphic is not drawn is (alpha value, R, G, B) = (0, 0, 0, 0), and is completely colorless. It is a transparent pixel. On the other hand, an arbitrary pixel in the surface A on which the graphics of the widget are drawn is, for example, (alpha value, R, G, B) = (255, 0, 0, 255), and a colored, completely opaque pixel It is. The drawing area determination module 114 searches for transparency (transparency) for all pixels on the surface A. As a result, the drawing area determination module 114 can calculate a graphics area (display area). Note that the drawing area determination module 114 may determine that an arbitrary pixel is transparent even if the alpha value is not 0 but is equal to or less than a predetermined threshold. The viewer can arbitrarily change the threshold value of the alpha value. This is because the determination of whether or not the TV image displayed on the back of the widget graphics can be viewed (determination of the transparency level of the graphics) differs depending on the viewer's sense.

  FIG. 5 is a diagram illustrating another example of the calculation of the graphics area by the drawing area determination module 114 according to the embodiment. The graphics of the widget displayed on one screen is configured by combining a plurality of pieces of information (hereinafter referred to as rectangular information) having a display area for displaying the graphics portion of the widget.

  (A) of FIG. 5 is a figure which shows the example in which the graphics of the widget displayed on 1 screen are comprised by the five rectangular information 1-5. Here, the drawing area determination module 114 includes a back buffer. The back buffer holds rectangular information sequentially transferred from the widget renderer 113. The drawing area determination module 114 combines the display areas of the rectangular information 1 to 5 transferred from the widget renderer 113 to create a widget graphic. FIG. 5B is a diagram illustrating an example of the graphics of a widget displayed on one screen obtained by combining five pieces of rectangular information. The drawing area determination module 114 can calculate the final graphics area (display area) by combining the areas of the rectangular information 1 to 5 under the or condition.

  FIG. 6 is a flowchart showing volume control by the audio output control module 107 according to the embodiment. First, the drawing area determination module 114 calculates and acquires the area area of the graphics (Block 101). The drawing area determination module 114 determines whether or not the area of the graphics area is drawn on the surface A above the threshold (Block 102). The drawing area determination module 114 searches for the ratio of graphics when the user selects a widget to be displayed on the monitor 115 or at an arbitrary timing such as a predetermined time interval.

  When the area of the graphics area is drawn on the surface A above the threshold (for example, in the case of the full mode of FIG. 3D) (Block102, Yes), the drawing area determination module 114 mutes the sound from the speaker 108. The volume adjustment signal to be transmitted is transmitted to the audio output control module 107. Thereafter, the audio output control module 107 controls to mute the audio from the speaker 108 (Block 103). The audio output control module 107 functions as a control unit that adjusts the volume of audio from the speaker 108.

  When the graphics area is not drawn on the surface A above the threshold (for example, in the case of the sidebar mode in FIG. 3A) (Block102, No), the drawing area determination module 114 receives the sound from the speaker 108. Is transmitted to the audio output control module 107 as usual (the volume set by the user). Thereafter, the audio output control module 107 performs control so that the audio from the speaker 108 is output as usual (if mute is released, mute is released) (Block 103). Note that the drawing area determination module 114 and the audio output control module 107 may be configured as a single unit, or some or all of the operations described above may be substituted.

  Note that the drawing area determination module 114 may transmit a volume adjustment signal that specifies the volume of the sound from the speaker 108 to the sound output control module 107 in accordance with the ratio of graphics. For example, if the graphics ratio is less than 20%, the drawing area determination module 114 may transmit a volume adjustment signal for outputting sound from the speaker 108 as usual to the sound output control module 107. Furthermore, as the graphics ratio increases to 40% and 60%, the drawing area determination module 114 outputs a volume adjustment signal to be output from the speaker 108 at a volume that is gradually reduced from the normal output. May be sent to. Further, the drawing area determination module 114 may transmit a volume adjustment signal for muting the sound from the speaker 108 to the sound output control module 107 when the graphics ratio is 80% or more.

  In addition, when the widget includes an instruction to mute the sound, the drawing area determination module 114 transmits a volume adjustment signal for muting the sound from the speaker 108 to the sound output control module 107 regardless of the ratio of graphics. May be. In the embodiment, the application superimposed on the TV video is described as a widget. However, the same applies to other applications having other similar functions.

  According to the present embodiment, by determining the status of an application that operates on the screen, the broadcast receiving apparatus 10 can appropriately control sound based on a broadcast signal even if the application side does not have a sound control function. Therefore, even when the application is mainly displayed on the screen (in other words, while almost no TV image is displayed), the display content of the monitor and the audio content to be output should not be inconsistent. It is done.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  DESCRIPTION OF SYMBOLS 10 ... Broadcast receiver, 102 ... Tuner, 103 ... Sub turtle decoder, 104 ... Video decoder, 105 ... Audio decoder, 106 ... Synthesis module, 107 ... Audio output control module, 108 ... Speaker, 110 ... Communication I / F, 112 Widget engine 113 Widget renderer 114 Drawing area determination module 115 Monitor

Claims (8)

First acquisition means for acquiring an application to be displayed on the screen;
Determining means for determining a display area of the application;
Output means for outputting the application so as to be superimposed on the video;
Control means for controlling to adjust the volume of audio corresponding to the video when the display area of the application covers a predetermined ratio or more of the display area of the video corresponding to the size of the screen;
A voice control device comprising:   The audio control apparatus according to claim 1, further comprising second acquisition means for acquiring the video information and the audio information from a broadcast wave.   The voice control device according to claim 1, wherein the application is a widget.   The audio control apparatus according to claim 1, wherein the control unit controls the sound volume to be muted when the application display area covers the predetermined ratio or more of the video display area.   The audio control apparatus according to claim 1, wherein the control unit performs control so as to adjust the volume in a stepwise manner in accordance with a ratio of the display area of the application covered by the display area of the video.   The sound control apparatus according to claim 1, wherein the determination unit calculates a display area of the application by searching for transparency of all pixels on the screen.   The voice control device according to claim 1, wherein the determination unit calculates a display area of the application by combining display areas of one or more pieces of information constituting the application. Get the application to display on the screen,
Determine the display area of the application,
Output the application to be displayed superimposed on the video,
If the display area of the application covers a predetermined ratio or more of the display area of the video corresponding to the size of the screen, adjust the volume of the audio corresponding to the video;
Voice control method.

Images