JP2005333524A - Support equipment and support program for program selection - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent the lowering of the efficiency of program selection by displaying a designated child screen out of a multi-screen by a size corresponding to a time interval during which it has been designated. <P>SOLUTION: This equipment is equipped with a designated child screen specifying portion 11 for specifying a child screen specified by a viewer out of a multi-screen, a timer 12 which counts a designation time interval and outputs designation time data every designated time interval, a child screen size storage 14 for storing the ratio of the size of each child screen, a child screen size determination portion 13 for determining the ratio of the size of each child screen on the basis of the designation time interval counted by the timer 12 and the ratio of the size of each child screen stored in the storage 14, and a multi-screen forming portion 16 for forming a multi-screen on the basis of the ratio of the size of each child screen determined by the determination portion 13. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a program selection support apparatus and a program selection support program for supporting selection of a program when a viewer views the program.

In general, there is a technique in which a plurality of programs are received on a single display by using a plurality of tuners to receive a plurality of programs (for example, Patent Document 1). In this technique, there are a method in which the entire surface of the display is divided equally to project each program, and a method in which the program designated by the viewer is projected on the display and the other programs are projected in a smaller size.
With this technology, the viewer can view a plurality of programs on one display without changing the programs.
JP 2002-135679 A (paragraph 0002)

However, the viewer has a desire to display the specific program on the display so that the specific program is watched longer. Also, when changing the program that the viewer is watching, there is a tendency that the program that has been viewed for a longer time has a higher probability of being selected. Therefore, when changing the program that the viewer is watching, it is better for the viewer to display each program on the display at the rate of display of each program according to the viewing time of each program that the viewer was watching. This is convenient when changing programs. Further, the method of projecting each program by equally dividing the entire display screen has a problem in that the viewer's attention is hindered by a program that is not viewed, and the efficiency of program selection is reduced.
However, in the above technique, the display ratio of the program displayed on the multi-screen cannot be changed according to the time the viewer is watching.

  Therefore, the present invention has been made in view of the above problems, and a program selection support apparatus capable of changing the display ratio of each program displayed on the display according to the viewing time of the multi-screen and the like, and An object is to provide a program selection support program.

  The invention according to claim 1 is characterized in that the sub-screen includes a time during which a viewer is gazing at a sub-screen which is one of the multi-screens displayed on the screen display means, and a pointer displayed on the screen display means. Is a program selection support device that supports the viewer's program selection based on gaze / designation time that is at least one of the designated time and the designated child screen specifying means, and the child screen size storage Means, time measuring means, child screen size determining means, and multi-screen creating means.

  According to this configuration, the program selection support device uses the specifier screen specifying unit to display the subscreen on which the viewer is watching (the line of sight is directed) among the subscreens displayed on the multi-screen, or the pointer. Specify the sub-screen specified by (cursor etc.). In addition, the program selection support device counts the gaze / designation time of the sub-screen specified by the specifier screen specification unit, for example, 1 second, 3 seconds, 5 seconds, and 10 seconds, by the time measuring unit. Further, the program selection support device reads the display ratio of the sub-screen stored in the sub-screen size storage means by the sub-screen size determination means, and measures the read sub-screen display ratio and the timing means. The display ratio of the small screen is determined based on the gaze / designated time. For example, the program selection support device adds the gaze / designated time measured by the time measuring means to the predetermined value for the sub screen identified by the designator screen identifying means by the sub screen size determining means, and specifies the specifier screen. For sub-screens not specified by the means, a comparison value is obtained by subtracting the gaze / designated time measured by the time-measurement means from the predetermined value, and the comparison value for each sub-screen is compared. Based on this, the ratio of the size of each sub-screen is determined. Then, the program selection support device creates a multi-screen by the multi-screen creating unit based on the display ratio of the sub-screen determined by the sub-screen size determining unit.

  Here, the sub-screen refers to a screen generated by dividing one screen displayed on the entire display surface, for example, each screen divided into four when one screen is divided into four. Therefore, when one screen is divided into four, one screen is divided into four child screens, and four child screens are displayed on one display.

  The invention according to claim 2 is the program selection support device according to claim 1, and includes a volume ratio storage unit, a volume ratio determination unit, and a volume determination unit.

  According to such a configuration, the program selection support apparatus reads the volume ratio of the sound of each program stored in the volume ratio storage means by the volume ratio determination means, and the ratio of the volume of the sound of each read program. And the audio volume ratio of each program based on the gaze / designated time measured by the time measuring means. For example, the program selection support device uses the volume ratio determination means to monitor the sound volume of the program shown on the sub-screen specified by the specifier screen specification means, and to watch and specify the sound volume measured by the time-measurement means to a predetermined value. Add time to find the comparison value. Further, the program selection support device uses the volume ratio determination unit to determine the volume of the sound of the program displayed on the child screen that is not specified by the designator screen specifying unit. Subtract the gaze / designated time measured by the timekeeping means within the range of the volume of the sound volume that does not hinder the viewing of the sound of the program being projected on the screen and that can trigger the program selection. The comparison value is obtained by Then, the program selection support apparatus determines the volume ratio of the sound of the program displayed on each sub-screen by comparing these comparison values by the volume ratio determining means. Then, the program selection support apparatus determines the sound volume of each program based on the sound volume ratio of each program determined by the sound volume determination means.

The invention according to claim 3 is the program selection support apparatus according to claim 1, wherein the apparatus includes a sound determination unit that outputs only the sound of the program related to the child screen specified by the specifier screen specifying unit. .
According to such a configuration, only the audio of the program related to the sub-screen specified by the specifier sub-screen specifying means is output, and the audio of the program related to other sub-screens is not output.

The invention according to claim 4 is the program selection support apparatus according to claim 1, wherein the volume of the audio of the program related to the child screen specified by the specifier screen specifying means and the program related to the other child screens The sound determining means for outputting the sound volume of the sound based on a predetermined ratio is provided.
According to such a configuration, for example, the audio of the program related to the sub-screen specified by the specifier sub-screen specifying unit is set to the volume selected by the viewer, and the audio specified for the other sub-screen is specified by the viewer. The sound is output as a volume that does not hinder viewing of the program related to the sub-screen and is a trigger for selecting a program.

  The invention according to claim 5 is the program selection support apparatus according to any one of claims 1 to 4, wherein a time during which the child screen is specified by the specifier screen specifying means is predetermined. Program information acquisition and output means for acquiring program information corresponding to the program displayed on the sub-screen specified by the specifier screen specifying means from the electronic program guide and outputting the program information to the screen display means when the threshold is exceeded It was set as the structure provided.

  According to such a configuration, the program selection support device relates to the child screen designated by the viewer when the time for which the viewer designates the child screen exceeds a predetermined threshold by the program information acquisition / output unit. The program information of the program is displayed on the sub-screen specified by the viewer.

  Here, the electronic program guide includes at least a program name (title), a performer name, a program start time, a program end time, and detailed program information (a synopsis, a program overview such as an era background). It is also possible to set a plurality of threshold values and increase the program information to be output stepwise. For example, if the time for specifying the child screen exceeds the first threshold, the program name is output, and if the time for specifying the child screen exceeds the second threshold, the program name The program start time and the program end time are output, and when the time when the sub-screen is specified exceeds the third threshold value, the program name, the program start time, the program end time, and the detailed program information are output.

  The invention according to claim 5 is a program selection support program, in which a viewer is gazing at a child screen that is one of the multi-screens displayed on the screen display means, and the screen display means A program selection support device that supports the viewer's program selection based on a gaze / designation time that is at least one of the time when the child screen is designated by the displayed pointer. , Time counting means, sub-screen size determining means, and multi-screen creating means.

  According to such a configuration, the program selection support program causes the program selection support device to specify the child screen designated by the pointer displayed on the screen display means by the viewer among the multi-screens by the designated child screen specifying means. Make it specific. Further, the program selection support program causes the program selection support device to time the gaze / designated time of the sub-screen specified by the specifier screen specifying means by the time measuring means. Further, the program selection support program causes the program selection support device to read out the display ratio of the sub-screen stored in the sub-screen size storage unit by the sub-screen size determination unit, and read the sub-screen The display ratio of the sub-screen is determined based on the display ratio and the gaze / designated time measured by the timing means. Then, the program selection support program causes the program selection support device to create a multi-screen based on the display ratio of the sub-screen determined by the sub-screen size determination unit by the multi-screen creation unit.

According to the invention according to claim 1 or claim 5, the child screen designated among the multi-screens can be displayed in a size corresponding to the time for which the child screen is designated. It is possible to prevent the viewer's attention from being hindered by the sub-screen and to reduce the efficiency of program selection.
According to the invention of claim 2 or claim 4, the audio of the program related to the unspecified sub-screen does not hinder the viewing of the program related to the specified sub-screen, and triggers the program selection It can be.

According to the invention of claim 3, since only the audio of the program related to the designated sub-screen is output, the viewing of the program related to the sub-screen designated by the audio related to the non-designated sub-screen is hindered. Can be prevented.
According to the fifth aspect of the present invention, it is possible to eliminate the need for the viewer to bother to refer to the TV column or TV information magazine of the newspaper while watching the program.

[First Embodiment]
Next, the first embodiment will be described with reference to the drawings as appropriate.
FIG. 1 referred to here is a block diagram showing the configuration of the program selection support apparatus. As shown in FIG. 1, the program selection support apparatus 1 includes a specifier screen specifying unit 11, a timer unit 12, a subscreen size determining unit 13, a subscreen size storage unit 14, a tuner unit 15, a multiscreen creation unit 16, A screen storage unit 17 is provided.

  The line-of-sight detection device 2 detects the viewer's position and the viewer's line of sight by photographing the viewer's position and the viewer's face by an imaging unit (not shown). Here, the viewer's line of sight is obtained by calculating a line-of-sight vector connecting the center of the eyeball and the center of the pupil. The line-of-sight detection device 2 outputs position data indicating the position of the viewer and line-of-sight vector data indicating the line-of-sight vector to the specifier screen specifying unit 11.

The specifier screen specifying unit (designator screen specifying means) 11 is a multi-screen showing the multi-screen read from the multi-screen storage unit 17 to be described later, the line-of-sight vector data and viewer position data output from the line-of-sight detection device 2. This is to identify which sub-screen the viewer is watching from the data. Specifically, assuming that the viewer's position is A (x _A , y _A , z _A ) coordinates and the line-of-sight vector is B (x _B , y _B , z _B ), viewing is performed on the display surface of the screen display device 4. There is a position C (x _A + cx _B , y _A + cy _B , z _A + cz _B ) where the B vector starting from the position A of the person intersects (c is a constant). This position C is the position of the display surface of the screen display device 4 viewed by the viewer. Further, among the multi-screen sub-screens stored in the multi-screen storage unit 17, the sub-screen displayed at the position C is the sub-screen that the viewer is viewing. In addition, the specifier screen specifying unit 11 outputs to the sub screen size determining unit 13 sub screen specifying data indicating which sub screen the viewer is viewing.

  The timer unit (timer means) 12 measures a predetermined time (gaze / designated time) and outputs predetermined time data indicating the predetermined time to the child screen size determination unit 13 every predetermined time. The predetermined time is, for example, 1 second, 3 seconds, 5 seconds, or 10 seconds.

A sub-screen size determination unit (sub-screen size determination unit) 13 is configured to determine the size (display) of each sub-screen stored in the sub-screen size storage unit 14 based on predetermined time data output from the timer unit 12. The update child screen size ratio data indicating the ratio is read, and the ratio of the size of each child screen is updated (changed) from the predetermined time counted by the timer unit 12 and the child screen specifying data.
Specifically, the child screen size determination unit 13 has a large proportion of the size of the child screen that the viewer is viewing based on the predetermined time counted by the timer unit 12, and the child that the viewer has not viewed. Reduce the proportion of screen size.
In addition, the sub-screen size determination unit 13 outputs updated sub-screen size ratio data indicating the size ratio of each updated sub-screen to the sub-screen size storage unit 14 and the multi-screen creation unit 16.

  The sub-screen size storage unit (sub-screen size storage unit) 14 stores the updated sub-screen size ratio data output from the sub-screen size determination unit 13 and stores the updated sub-screen size ratio data in the sub-screen size determination unit 13. Is to be read. Here, the updated child screen size ratio data also includes data indicating the ratio of the size of each initial child screen, that is, the ratio of the size of each child screen before the first predetermined time data is output. included. In addition, the child screen size storage unit 14 stores points of each child screen used for determining the proportion of the size of each child screen. That is, points on each sub-screen before the first predetermined time data is output, points added according to the predetermined time for the sub-screen that the viewer is viewing in the specifier screen specifying unit 11, specifier screen specifying means 11 The points that are deducted according to a predetermined time for the sub-screen that the viewer does not see and the points of each sub-screen when the ratio of the size of each sub-screen is updated are stored. For example, 50 points for each sub-screen before the first predetermined time data is output, 1 second for a predetermined time, and 1 point for a predetermined time.

  The tuner unit 15... Is a multi-screen creation unit that generates video data indicating video by detecting and amplifying the broadcast wave received by the antenna based on the selected program data indicating the selected program output from the selected program input device 3. 16 is output.

The multi-screen creation unit (multi-screen creation means) 16 creates a multi-screen based on the sub-screen size data of each sub-screen output from the sub-screen size determination unit 13 and the video data output from the tuner unit 15. To do. That is, according to the size of each child screen determined by the child screen size determination unit 13 (ratio of the sizes of each child screen), the video of each program indicated by each video data is reduced to create a multi-screen. The multi-screen creating unit 16 enlarges / reduces each child screen without moving the center of the child screen, and displays a part of the child screen when the enlarged child screen is displayed on the display surface of the screen display device 4. When the message appears, the display position of the sub-screen is moved so that the enlarged sub-screen fits within the display surface. Further, when the child screens overlap each other due to enlargement / reduction of the child screens, the multi-screen creation unit 16 moves the display position of each child screen so that the child screens do not overlap each other.
Here, the arrangement of the multi-screen will be described with reference to FIG. 2A to be referred to is an image diagram showing a child screen obtained by dividing the screen displayed on the display surface of the screen display device into four equal parts, and FIG. 2B is an enlarged view of the A screen, the B screen, and the C screen. FIG. 2C is an image diagram showing a case where the display position of the A screen is moved, and FIG. 2D is a display position of the B screen, the C screen and the D screen. It is an image figure which shows the case where is moved.
As shown in FIG. 2A, the multi-screen creation unit 16 equally divides the screen displayed on the display surface into an A screen, a B screen, a C screen, and a D screen. Further, as shown in FIG. 2B, the multi-screen creation unit 16 enlarges the A screen according to the points of each sub-screen around the center of each sub-screen, and displays the B screen, the C screen, and the D screen. to shrink. Also, as shown in FIG. 2 (b), a part of the A screen comes out of the display surface, so as shown in FIG. 2 (c), the multi-screen creation unit 16 displays the A screen within the display surface. The display position of the A screen is moved so as to be within the range. As shown in FIG. 2C, the A screen, the B screen, the C screen, and the D screen overlap each other. Therefore, as shown in FIG. 2D, the multi-screen creation unit 16 performs the B screen, the C screen, and the D screen. The display position of the screen is moved so that the A screen, the B screen, the C screen, and the D screen do not overlap.
Returning to FIG. 1, the description will be continued. The multi-screen creation unit 16 outputs multi-screen data indicating the created multi-screen to the screen display device 4 and the multi-screen storage unit 17.
The multi-screen storage unit 17 stores data indicating a multi-screen output from the multi-screen creation unit 16 and reads multi-screen data stored in the specifier screen specifying unit 11.

The selected program input device 3 is for inputting selected program data for specifying a program selected by the viewer. For example, when the screen displayed on the entire display surface of the screen display device 4 is divided into four (when there are four sub-screens), four programs are specified in the screen display device 4 by the selected program data. Input. The selected program input device 3 outputs the input selected program data to the tuner units 15.
The screen display device (screen display means) 4 displays a multi-screen on the display surface based on the multi-screen data output from the multi-screen creation unit 16. For example, a liquid crystal display or a plasma display.

Next, a method for identifying the line of sight of the viewer in the line-of-sight detection device 2 will be described with reference to FIGS. FIG. 3 referred to here is a flowchart showing a method of specifying the viewer's line of sight. FIG. 4 is a schematic view of an eyeball.
First, as shown in FIG. 3, a photographing unit (not shown) of the line-of-sight detection device 2 photographs the viewer's face (step S11).
Next, the line-of-sight detection device 2 detects the contours of the viewer's eyes based on the color information (skin color, white of white eyes, black of black eyes, etc.) of the captured image of the viewer's face (step S12). .

Further, the line-of-sight detection device 2 detects the positions of both ends of the viewer's eyes based on the color information (skin color, white of white, black of black, etc.) of the image showing the face of the viewer taken (step S13). ).
Next, the line-of-sight detection device 2 detects the position of the pupil based on the luminance information of the captured image of the viewer's face with reference to the positions of both ends of the viewer's eyes (step S14).

Next, the line-of-sight detection device 2 estimates the position of the center 101 of the eyeball and the radius of the eyeball as shown in FIG. 4 based on the geometrical positional relationship between both ends of the eye and the position of the pupil (step S15). ).
Further, the position of the center 103 of the pupil is detected based on the luminance information in the eye outline (step S16).

Then, a vector connecting the center 101 of the eyeball and the center 103 of the pupil is calculated (step S17). By viewing this vector as the direction of the line of sight, the viewer's line of sight is detected.
In addition, as another method for detecting the line of sight, there is a method of irradiating the viewer's face with infrared rays and using the reflected infrared rays.

Next, the operation of the program selection support apparatus 1 will be described with reference to FIG. 5 (refer to FIG. 1 as appropriate). FIG. 5 referred to here is a flowchart showing the operation of the program selection support apparatus.
First, the line-of-sight detection apparatus 2 obtains a line-of-sight vector by photographing the viewer's face and detecting the viewer's line of sight and the position of the viewer using a photographing unit (not shown). Further, the line-of-sight detection device 2 outputs the line-of-sight vector data and the position data to the specifier screen specifying unit 11.
Next, the specifier screen specifying unit 11 determines which child screen the viewer views based on the line-of-sight vector data and position data output from the line-of-sight detection device 2 and the multi-screen data read from the multi-screen storage unit 17. Is identified (step S21).
Further, the specifier sub-screen specifying unit 11 outputs the sub-screen specifying data to the sub-screen size determining unit 13.
The timer unit 12 measures a predetermined time (step S22). Then, the predetermined time data is output to the small-screen size determination unit 13 every predetermined time.
Next, the sub-screen size determination unit 13 outputs the updated sub-screen size ratio data read from the sub-screen size storage unit 14 based on the predetermined time data output from the timer unit 12 and the designator screen specifying unit 11. The ratio of the size of each sub-screen is determined based on the sub-screen specifying data and the predetermined time counted by the timer unit 12 (step S23).

  Here, a method of determining the size of each child screen in the child screen size determination unit 13 will be described with reference to the drawings. FIG. 6A to be referred to is an image diagram showing a sub-screen divided into four equal parts displayed on the display surface of the screen display device, and FIG. 6B is a diagram showing each case where the viewer continues to watch the A screen for 10 seconds. An image diagram showing a child screen, (c) is an image diagram showing each child screen when the viewer views the B screen for 5 seconds after viewing the A screen for 10 seconds, and (d) is a viewer showing the A screen. It is an image figure of each sub-screen at the time of seeing B screen for 23 seconds after seeing 10 seconds.

  As shown in FIGS. 6A to 6D, when the viewer starts watching the screen displayed on the display surface of the screen display device 4, the screen displayed on the display surface of the screen display device 4 is divided into four equal parts. When a child screen is created by dividing the image into two, the following rules are to be followed. First, each sub-screen has 50 points. For the sub-screen that the viewer is watching, 1 point is added every second, and for the sub-screen that the viewer is not watching, the time that the viewer is not watching (the time of watching other sub-screens) every second One point is deducted. Then, the ratio of the calculated points of each sub-screen becomes the ratio of the size of each sub-screen (length and width of each sub-screen).

As shown in FIG. 6A, when the viewer starts to look at the display surface of the screen display device 4, the A screen, the B screen, the C screen, and the D screen are displayed on the display surface of the screen display device 4. The screen is divided into four equal parts.
As shown in FIG. 6B, when the viewer continues to watch the A screen for 10 seconds, the points on the A screen are 50 + 10 = 60 points. On the other hand, the points of the B screen, C screen, and D screen are 50-10 = 40 points. The ratio of the points on the A screen and the points on the B screen, the C screen, and the D screen is the ratio of the sizes of the A screen, the B screen, the C screen, and the D screen, and the A screen, the B screen, the C screen, and the D screen. The ratio of the sizes is 60: 40: 40: 40 = 3: 2: 2: 2. Further, since the A screen comes out of the screen displayed on the display surface of the screen display device 4 by enlarging the screen, the display position of the A screen is moved so as to be within the display surface. In addition, since the A screen, the B screen, the C screen, and the D screen overlap, the display positions of the B screen, the C screen, and the D screen are moved so that the B screen, the C screen, the D screen, and the A screen do not overlap. To do.

  As shown in FIG. 6C, when the viewer continues to watch the A screen for 10 seconds and then continues to watch the B screen for 5 seconds, the point on the A screen is 60-5 = 55 points, and the point on the B screen is 40 + 5 = 45 points, the points of the C screen and the D screen are 40-5 = 35 points, and the ratio of the sizes of the A screen, the B screen, the C screen, and the D screen is 55: 45: 35: 35 = 11 : 9: 7: 7. Further, since the B screen is moved out of the display surface of the screen display device 4 by enlarging the B screen, the display position of the B screen is moved so as to be within the display surface. Further, since the A screen and the B screen overlap, the display position of the A screen is moved so that the A screen and the B screen do not overlap.

As shown in FIG. 6 (d), if the B screen is continuously viewed for 18 seconds, the point of the A screen is 55-18 = 37 points, the point of the B screen is 45 + 18 = 63, and the points of the C screen and the D screen. Is 35-18 = 17 points, and the ratio of the sizes of the A screen, B screen, C screen, and D screen is 37: 63: 17: 17. In addition, since the B screen is moved out of the screen displayed on the display surface of the screen display device 4 by enlarging the B screen, the display position of the B screen is moved so as to be within the display surface. To do. In addition, since the A screen and the B screen overlap, the display position of the A screen is moved so that the A screen and the B screen do not overlap.
Returning to FIG. The sub-screen size determination unit 13 outputs the determined sub-screen size data of each sub-screen to the multi-screen creation unit 16.

The multi-screen creating unit 16 creates a multi-screen based on the determined sub-screen size data of each sub-screen output from the sub-screen size determining unit 13 and the video data output from the tuner unit 15 (step). S24).
Further, the multi-screen creating unit 16 outputs the multi-screen data to the screen display device 4 and the multi-screen storage unit 17.
Then, the screen display device 4 displays a multi-screen based on the multi-screen data output from the multi-screen creation unit 16.

  According to the program selection support apparatus 1 according to the first embodiment, since the size of the child screen is determined based on the time during which the viewer is watching the child screen, the attention of the viewer due to the child screen not being viewed. It is possible to prevent the efficiency of program selection from being reduced.

[Second Embodiment]
Next, a second embodiment will be described with reference to the drawings as appropriate. In addition, about the structure similar to 1st Embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted. FIG. 7 referred to here is a block diagram showing the configuration of the program selection support apparatus. As shown in FIG. 7, the program selection support apparatus 1A includes a specifier screen specifying unit 11A, a timer unit 12A, a sub screen size determining unit 13, a sub screen size storage unit 14, a tuner unit 15A, a multi screen creating unit 16, A screen storage unit 17, a volume ratio determination unit 18, a volume adjustment unit 19, and a volume ratio storage unit 22 are provided.

  Here, the program selection support apparatus 1 according to the first embodiment includes a specifier screen specifying unit 11A, a timer unit 12A, a tuner unit 15A, a volume ratio determination unit 18, a volume adjustment unit 19, and a volume ratio storage unit 22. Provided that the specifier screen specifying unit 11, the timer unit 12, and the tuner unit 15 are not provided.

The specifier screen specifying unit (designator screen specifying means) 11A is a multi-screen read out from the multi-screen storage unit 17, the line-of-sight vector data indicating the viewer's line-of-sight output from the line-of-sight detecting device 2, and the position data of the viewer. This is to identify which sub-screen the viewer is watching from the data.
Further, the specifier sub-screen specifying unit 11A outputs the sub-screen specifying data to the sub-screen size determining unit 13 and the volume ratio determining unit 18.
The timer unit (time measuring means) 12A measures a predetermined time and outputs predetermined time data to the child screen size determination unit 13 and the volume ratio determination unit 18 every predetermined time.

The tuner unit 15A ... detects and amplifies the broadcast wave received by the antenna based on the selected program data output from the selected program input device 3, outputs the video data to the multi-screen creating unit 16, and displays the audio indicating the audio. The data is output to the volume adjustment unit 19.
The volume ratio determination unit (volume ratio determination means) 18 is a ratio of the volume of the sound of the program displayed on each sub-screen stored in the volume ratio storage unit 22 based on the predetermined time data output from the timer unit 12A. Is updated (changed) from the predetermined time counted by the timer unit 12A and the ratio of the volume of the sound of the program displayed on each sub-screen from the sub-screen specifying data.

Specifically, the volume ratio determination unit 18 is based on the predetermined time counted by the timer unit 12A, and the volume ratio of the sound of the program displayed on the sub-screen that the viewer is watching is large. Decrease the volume ratio of the sound of the program shown on the sub-screen that is not viewed.
Then, the volume ratio determination unit 18 outputs updated sound volume ratio data indicating the volume ratio of the sound of the program displayed on each updated sub-screen to the volume ratio storage unit 22 and the volume adjustment unit 19.

  The volume ratio storage unit (volume ratio storage means) 22 stores the updated voice volume ratio data output from the volume ratio determination unit 18 and reads the updated voice volume ratio data to the volume ratio determination unit 18. Here, in the updated audio volume ratio data, the ratio of the volume level of the sound of the program displayed on each initial sub-screen, that is, each sub-screen before the first predetermined time data is output. Also included is data indicating the volume ratio of the sound volume of the program being displayed on the screen. In addition, the volume ratio storage unit 22 is a program (hereinafter referred to as “program” as appropriate) displayed on each sub-screen used to determine the volume ratio of the sound volume of the program displayed on each sub-screen. I remember the points.) In other words, the volume ratio storage unit 22 stores points for each program before the first predetermined time data is output, points added according to the predetermined time for the program viewed by the viewer in the specifier screen specifying unit 11, Points when points are deducted according to a predetermined time for programs that are not viewed by the viewer on the sub-screen specifying means 11, and each program when the volume ratio of the sound volume of the program displayed on each sub-screen is updated I remember the points. In addition, the volume ratio storage unit 22 stores points that are subtracted from the points of the program that have been viewed up to that point and points that are added to the points of the program that have begun to be viewed at that time when the sub-screen that the viewer is viewing is changed. I remember it. For example, as the points of each program before the first predetermined time data is output, the point of the program that the viewer is watching is 70 points, the point of the program that the viewer is not watching is 10 points, and the predetermined time is 1 Seconds, and a point for each predetermined time is 1 point. Further, when the sub-screen that the viewer is watching is changed, 60 points are added to the points that are drawn from the point of the program that has been viewed up to that point and the points that are added to the program that has started to be viewed from that point.

The volume adjustment unit (volume determination means) 19 is the updated volume ratio data output from the volume ratio determination unit 18, the volume of the selected audio output from the selected volume input device 6, for example, the program displayed on the screen The sound volume of each program is determined based on the data indicating the total sound volume of the programs.
The volume adjusting unit 19 outputs the audio data output from the tuner units 15A... And the volume data indicating the audio volume of each determined program to the audio providing apparatus 5.

  The selected volume input device 6 inputs selected volume data indicating the volume selected by the viewer. The selected volume input device 6 outputs the selected volume data to the volume adjustment unit 19.

Next, the operation of the program selection support apparatus 1A will be described with reference to FIG. 8 (refer to FIG. 7 as appropriate). FIG. 8 referred to here is a flowchart showing the operation of the program selection support apparatus.
As illustrated in FIG. 8, first, the line-of-sight detection apparatus 2 obtains a line-of-sight vector by photographing the viewer's face and detecting the viewer's line of sight and the position of the viewer using a photographing unit (not shown). Further, the line-of-sight detection device 2 outputs the line-of-sight vector data and the position data to the specifier screen specifying unit 11.
Next, the specifier screen specifying unit 11A determines which child screen the viewer views based on the line-of-sight vector data and position data output from the line-of-sight detection device 2 and the multi-screen data read from the multi-screen storage unit 17. Is identified (step S31).
In addition, the specifier sub-screen specifying unit 11A outputs the sub-screen specifying data to the sub-screen size determining unit 13 and the volume ratio determining unit 18.

In addition, the timer unit 12A measures a predetermined time (step S32). Then, the predetermined time data is output to the small-screen size determining unit 13 and the volume ratio determining unit 18 every predetermined time.
Next, the sub-screen size determining unit 13 outputs the updated sub-screen size ratio data read from the sub-screen size storage unit 14 and the specifier screen specifying unit 11A based on the predetermined time data output from the timer unit 12A. The ratio of the size of each child screen is determined based on the incoming child screen specifying data and the predetermined time counted by the timer unit 12A (step S33).
Further, the child screen size data of each child screen determined by the child screen size determining unit 13 is output to the multi-screen creating unit 16.

  Next, the volume ratio determination unit 18 updates the updated volume ratio data read from the volume ratio storage unit 22 according to the predetermined time data output from the timer unit 12A, and the child screen specification data output from the designator screen specification unit 11A. Based on the predetermined time counted by the timer unit 12A, the ratio of the volume of the sound of the program displayed on each sub-screen is determined (step S34).

  Here, with reference to the drawings, a method of determining the volume ratio of the audio of the program in the volume ratio determining unit 18 will be described. FIG. 9A referred to here is a diagram showing an example of the time when the child screen is viewed and the points of each program when viewing the A program, and FIG. It is the figure which showed one example of time and the point of each program which are looking at the subscreen at the time of changing the program currently seen in B program.

  In the case where four sub-screens are projected on the display surface of the screen display device 4, the program first projected on the sub-screen viewed by the viewer has 70 points. It is assumed that a program shown on a non-child screen has 10 points. For the sub-screen that the viewer is watching, 1 point is added every second, and for the sub-screen that the viewer is not watching, the time that the viewer is not watching (the time of watching other sub-screens) every second One point is deducted. In addition, when the sub-screen that the viewer is watching is changed, 60 points are deducted from the point of the program displayed on the sub-screen that has been viewed so far, and the program displayed on the sub-screen that has started to be viewed is displayed. Add 60 points to the point. Then, the ratio of the calculated points of each sub-screen becomes the ratio of the volume of the sound of the program displayed on each sub-screen.

  As shown in FIG. 9A, when the viewer continues to watch the A program for 3 seconds, the points of the A program are 70 + 3 = 73 points, and the points of the B program, the C program, and the D program are 10-3. = 7 points, and the volume ratio of the audio of the A program, the B program, the C program, and the D program is 73: 7: 7: 7.

  If the viewer continues to watch the A program for 2 seconds, the audio volume ratio of the A program is 73 + 2 = 75 points, and the B program, C program, and D program points are 7-2 = 5 points, The volume ratio of the audio of the A program, the B program, the C program, and the D program is 75: 5: 5: 5 = 15: 1: 1: 1.

  On the other hand, as shown in FIG. 9B, after the viewer watches the A program for 3 seconds, the program the viewer is watching is changed from the A program to the B program, and the B program is watched for 2 seconds. Then, when the program viewed by the viewer is changed from the A program to the B program, the point of the A program is changed from 73 points to 13 points (subtracting 60 points from the points of the previous A program). The point of the program is changed from 7 points to 67 points (60 points are added to 7 points which are the points of the previous B program). When the viewer views the B program for 2 seconds, the point of the A program is 13-2 = 11 points, the point of the B program is 67 + 2 = 69 points, and the points of the C program and the D program are 7− 2 = 5 points, and the volume ratio of the audio of the A program, the B program, the C program, and the D program is 11: 69: 5: 5.

  Returning to FIG. The multi-screen creating unit 16 creates a multi-screen based on the sub-screen size data output from the sub-screen size determining unit 13 and the video data output from the tuner unit 15A (step S35).

Further, the multi-screen creating unit 16 outputs the multi-screen data to the multi-screen storage unit 17 and the screen display device 4.
The volume adjustment unit 19 determines the volume of the sound of each program based on the volume ratio data output from the volume ratio determination unit 18 and the volume data output from the selected volume input device 6 (step S36).

The volume adjusting unit 19 outputs the audio data of each program and the volume data of each program to the audio providing device 5.
Then, the screen display device 4 displays a multi-screen on the display surface based on the multi-screen data output from the multi-screen creation unit 16.
Also, the audio providing device 5 provides audio based on the audio data of each program output from the volume adjusting unit 19 and the volume data of each program.

According to the program selection support device 1A according to the second embodiment, the size of the child screen is determined based on the time when the viewer is watching the child screen, and the program is selected based on the time when the child screen is viewed. The volume of the sound volume is determined.
In addition, the volume of the audio of the program that the viewer is watching is changed within a range that is just right for viewing the program, and the volume of the audio of the program that the viewer does not see is triggered by the viewer. If the volume is changed within the range of the volume of audio that can be heard, the audio of the program that the viewer is watching will be just loud enough for the viewer to watch the program, and the audio of the other program is being watched by the viewer It does not hinder listening to the audio of the program and can be a trigger for the viewer to select a program.

[Third Embodiment]
Next, a third embodiment will be described with reference to the drawings as appropriate. In addition, about the structure similar to 1st Embodiment or 2nd Embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted. FIG. 10 referred to here is a block diagram showing the configuration of the program selection support apparatus. As shown in FIG. 10, the program selection support apparatus 1B includes a specifier screen specifying unit 11B, a timer unit 12, a sub screen size determining unit 13, a sub screen size storage unit 14, a tuner unit 15A, a multi screen creating unit 16, a multi screen A screen storage unit 17 and a volume control unit 19B are provided.

  Here, the program selection support apparatus 1 according to the first embodiment includes the specifier screen specifying unit 11B, the tuner unit 15A, and the volume adjusting unit 19B, but does not include the specifier screen specifying unit 11 and the tuner unit 15. The program selection support apparatus 1A according to the second embodiment is different from the above in that a specifier screen specifying unit 11B and a volume adjusting unit 19B are provided, and a specifier screen specifying unit 11A, a volume ratio determining unit 18, and a volume adjusting unit 19 are provided. And the volume ratio storage unit 22 is not provided.

  The specifier screen specifying unit (designator screen specifying means) 11B is a multi-screen read out from the multi-screen storage unit 17 and the line-of-sight vector data indicating the viewer's line-of-sight output from the line-of-sight detection device 2 and the position data of the viewer. This is to identify which sub-screen the viewer is watching from the data. In addition, the specifier screen specifying unit 11B outputs the sub screen specifying data to the sub screen size determining unit 13 and the sound volume adjusting unit 19B.

  The volume adjusting unit (speech determining means) 19B converts the child screen specifying data output from the specifier screen specifying unit 11B, the sound data output from the tuner unit 15A, and the selected volume data output from the selected volume input device 6. Based on this, the sound volume of the program being displayed on the sub-screen is determined.

  For example, only the sound of the program being viewed by the viewer can be output at the sound volume selected by the selected sound volume input device 6 in the sound providing device 5, and the sound volume of the program being viewed by the viewer can be selected. As the volume selected by the volume input device 6, the volume of the sound that the viewer is not watching the volume of the sound of the program that the viewer is not viewing does not interfere with the program that the viewer is watching, and the volume of the sound that can be the trigger for the viewer to select the program It can also be.

According to the program selection support device 1B according to the third embodiment, the size of the child screen is determined based on the time during which the viewer is watching the child screen, and the audio of the program is determined based on the child screen being viewed. The volume is determined.
Further, if only the sound of the program that the viewer is watching is output by the sound providing device 5, the sound of the program that the viewer is watching is not hindered by the sound of the program that the viewer is not watching. On the other hand, the volume of the sound of the program viewed by the viewer is set as the volume input by the selected volume input device 6, and the volume of the sound of the program that is not viewed by the viewer is set as the volume of the sound that can trigger the viewer to select the program. If this is set to, the audio of the program that the viewer is watching will be just loud enough for the viewer to view the program, and the audio of the other programs will interfere with listening to the audio of the program that the viewer is watching. It can be a trigger for viewers to select a program.

[Fourth Embodiment]
Next, a fourth embodiment will be described with reference to the drawings as appropriate. In addition, about the structure similar to 1st Embodiment, the same code | symbol is attached | subjected and the description is abbreviate | omitted. FIG. 11 referred to here is a block diagram showing the configuration of the program selection support apparatus. As shown in FIG. 11, the program selection support device 1C includes a specifier screen specifying unit 11C, a timer unit 12, a timer unit 12C, a sub-screen size determining unit 13, a sub-screen size storage unit 14, a tuner unit 15C, and a multi-screen creation. 16C, multi-screen storage unit 17, support information generation unit 20, and superposition unit 21.
Here, the program selection support apparatus 1 according to the first embodiment includes a specifier screen specifying unit 11C, a timer unit 12C, a tuner unit 15C, a multi-screen creation unit 16C, a support information generation unit 20, and a superposition unit 21. The designator screen specifying unit 11 and the tuner unit 15 are not provided.

  The specifier screen specifying unit (designator screen specifying means) 11C is a multi-screen read out from the multi-screen storage unit 17, the line-of-sight vector data indicating the viewer's line-of-sight output from the line-of-sight detection device 2, and the viewer's position data. This is to identify which sub-screen the viewer is watching from the data. Further, the specifier screen specifying unit 11C outputs the sub screen specifying data indicating which sub screen the viewer is viewing to the timer unit 12C and the sub screen size determining unit 13.

The timer unit (timer) 12C measures the time during which the viewer is watching the child screen based on the child screen specifying data output from the specifier screen specifying unit 11C. When the screen viewing time exceeds a predetermined threshold, threshold elapsed data indicating that the threshold has been exceeded is output.
Specifically, the timer unit 12C outputs the first threshold elapsed data when the time when the viewer is watching the specific child screen exceeds the first threshold, and the viewer displays the specific child screen. When the viewing time exceeds the second threshold, the second threshold elapsed data is output, and when the viewer watches the specific child screen exceeds the third threshold, the third threshold is output. Output threshold elapsed data.

  The tuner unit 15C ... detects and amplifies the broadcast wave received by the antenna based on the selected program data output from the selected program input device 3, outputs the video data to the multi-screen creating unit 16C, and displays program information (electronic Program information data indicating a program guide) is output to the support information generating unit 20.

The multi-screen creation unit (multi-screen creation unit) 16C creates a multi-screen based on the sub-screen size data output from the sub-screen size determination unit 13 and the video data output from the tuner unit 15C. . The multi-screen creation unit 16C outputs multi-screen data to the multi-screen storage unit 17 and the superimposition unit 21.
The support information generating unit 20 supports the child screen specified by the designator screen specifying unit 11C from the program information data output from the tuner unit 15C based on the threshold elapsed data output from the timer unit 12C. Is generated.

  Next, a method for generating support information in the support information generation unit 20 will be described with reference to the drawings. FIG. 12A referred to here is an image diagram showing a telop displayed on the A screen when the viewer views the A screen for 10 seconds, and FIG. 12B shows the telop displayed on the A screen for 20 seconds. It is an image figure which shows the telop displayed on A screen when it was watching, (c) is an image figure which shows the telop displayed on A screen when a viewer is watching A screen for 30 seconds.

  For example, as shown in FIG. 12A, when the first threshold is 10 seconds, the time measured by the timer unit 12C (the time during which the viewer is watching the A screen) is 10 seconds. When the first threshold value elapsed data is output from the timer unit 12C, the support information generation unit 20 extracts only the program name (title name) from the program information of the program related to the child screen that the viewer is viewing, The program name (title name) is displayed as a telop for 5 seconds on the sub-screen that the viewer is watching.

  Further, for example, as shown in FIG. 12B, when the second threshold is 20 seconds, the time measured by the timer unit 12C (the time during which the viewer is watching the A screen) is 20 seconds. The second threshold elapsed data is output from the timer unit 12C, and the support information generation unit 20 determines the program name (title name) and performer name from the program information of the program related to the sub-screen that the viewer is viewing. The program start / end time (program start time and program end time) is extracted, and the program name (title name), performer name, and program start / end time are displayed as a telop on the sub-screen that the viewer is watching for 5 seconds. To do.

  Furthermore, for example, as shown in FIG. 12C, when the third threshold is 30 seconds, the time measured by the timer unit 12C (the time during which the viewer is watching the A screen) is 30 seconds. The third threshold elapsed data is output from the timer unit 12C, and the support information generation unit 20 determines the program name (title name) and performer name from the program information of the program related to the sub-screen that the viewer is viewing. The program details information related to the program start / end time and the program overview is extracted, and the viewer is viewing the program detail information related to the program name (title name), performer name, program start / end time and program overview. Displayed as a telop on the screen for 10 seconds.

Returning to FIG. 11, the description will be continued. The support information generation unit 20 outputs support information data indicating support information to the superposition unit 21. The superimposing unit 21 superimposes the support information on the multi-screen based on the multi-screen data output from the multi-screen creating unit 16C and the support information data output from the support information generating unit 20. In addition, the superimposing unit 21 outputs data indicating the multi-screen on which the support information is superimposed to the screen display device 4.
Here, the support information generating unit 20 and the superimposing unit 21 correspond to the program information acquisition / output means described in the claims.

  With respect to a program that the viewer of the program selection support apparatus 1C according to the fourth embodiment is viewing, support information is displayed on the display surface of the screen display device 4 when the time that the viewer is viewing is a predesignated time. Since it is displayed, it is possible to eliminate the need for the viewer to bother to refer to the TV column or TV information magazine of the newspaper while watching the program.

The present invention is not limited to the present embodiment, and various modifications are possible as long as the technical idea is the same.
For example, the program selection support device 1B and the program selection support device 1C may include the support information generation unit 20 and the superposition unit 21.
Further, instead of the line-of-sight detection device 2, a child screen may be specified by operating a mouse, a remote controller, or the like (for example, a child screen is specified by indicating a cursor on the child screen specified by operating the mouse) To do.)
It is also possible to change the size of the child screen with the specified time, increase or decrease the luminance of the child screen, or make the child screen transparent.

The screen displayed on the display surface of the screen display device 4 is divided into four sub-screens, but the number of sub-screens is not limited to four. For example, the sub-screen is divided into two sub-screens, Three child screens may be divided into three, five child screens may be divided into five, six child screens may be divided into six, and the like.
In addition, when the viewer starts to view the child screen, the screen displayed on the display surface of the screen display device 4 is divided into four equal parts, and the child screen is displayed. The screen displayed on the display surface of the screen display device 4 is not limited to the case where the child screen is displayed by equally dividing the screen. The display of the screen display device 4 is displayed when the viewer starts watching the child screen. As for the screen displayed on the screen, the screen that the viewer is viewing may be enlarged and the other screens may be displayed small.

Further, the functions of the components in the program selection support device 1, the program selection support device 1A, the program selection support device 1B, and the program selection support device 1C are stored in a program (program selection support program) stored in a storage unit (not shown). Based on this, the CPU (not shown) performs arithmetic processing.
In addition, each component in the program selection support device 1, the program selection support device 1A, the program selection support device 1B, and the program selection support device 1C may be realized by a separate computer, or by a single computer. It may be realized.

It is a block diagram which shows the structure of the program selection assistance apparatus which concerns on embodiment. (A) is an image diagram showing a child screen obtained by dividing the screen displayed on the display surface of the screen display device into four equal parts, and (b) is an enlargement of the A screen and a reduction of the B screen, the C screen, and the D screen. (C) is an image diagram showing a case where the display position of the A screen is moved, and (d) is an image diagram showing a case where the display positions of the B screen, the C screen and the D screen are moved. . It is a flowchart which shows the identification method of a viewer's eyes | visual_axis. It is the schematic of an eyeball. It is a flowchart which shows operation | movement of the program selection assistance apparatus which concerns on embodiment. (A) is an image figure which shows the subscreen which divided | segmented the screen displayed on the display surface of a screen display apparatus into 4 equal parts, (b) is each subscreen when a viewer keeps watching A screen for 10 second (C) is an image diagram showing each child screen when the viewer views the A screen for 10 seconds and then the B screen for 5 seconds. (D) is an image diagram showing the 10 screens. It is an image figure of each child screen at the time of seeing B screen for 23 seconds after seeing for 2 seconds. It is a block diagram which shows the structure of the program selection assistance apparatus which concerns on embodiment. It is a flowchart which shows operation | movement of the program selection assistance apparatus which concerns on embodiment. (A) is the figure which showed one example of the time and the point of each program which are looking at the subscreen at the time of continuing to watch A program, (b) is seen from A program to B program on the way It is the figure which showed one example of the time which is looking at the subscreen at the time of changing a certain program, and the point of each program. It is a block diagram which shows the structure of the program selection assistance apparatus which concerns on embodiment. It is a block diagram which shows the structure of the program selection assistance apparatus which concerns on embodiment. (a) is an image diagram showing a telop displayed on the A screen when the viewer views the A screen for 10 seconds, and (b) is an A screen when the viewer watches the A screen for 20 seconds. (C) is an image diagram showing the telop displayed on the A screen when the viewer watches the A screen for 30 seconds.

Explanation of symbols

1, 1A, 1B, 1C Program selection support device 11, 11A Designator screen specifying unit (designator screen specifying means)
12, 12A, 12C Timer part (time measuring means)
13 Sub-screen size determining unit (Sub-screen size determining means)
14 Sub-screen size storage unit (Sub-screen size storage means)
16, 16C Multi-screen creation unit (multi-screen creation means)
18 Volume ratio determination unit (volume determination means)
19, 19B Volume adjustment unit (volume determination means, sound determination means)
20 Support information generation part (program information acquisition output means)
21 Superimposition unit (program information acquisition output means)
22 Volume ratio storage unit (volume ratio storage means)

Claims (6)

The time when the viewer is gazing at the child screen which is one of the multi-screens displayed on the screen display means and the time when the child screen is designated by the pointer displayed on the screen display means A program selection support device that supports program selection of the viewer based on gaze / designation time that is at least one time,
A designator screen specifying means for specifying a subscreen specified by a pointer displayed on the screen display means or a subscreen being watched by the viewer among the multi-screen;
Sub-screen size storage means for storing the display ratio of the sub-screen;
A time measuring means for measuring the gaze / designated time of the child screen identified by the designator screen identifying means;
The sub screen display ratio is determined based on the gaze / designated time counted by the time measuring means and the sub screen display ratio stored in the sub screen size storage means, and the sub screen size storage A sub-screen size determining means for updating the display ratio of the sub-screen stored in the means;
Multi-screen creating means for creating the multi-screen based on the display ratio of the sub-screen determined by the sub-screen size determining means;
A program selection support apparatus comprising: A volume ratio storage means for storing a volume ratio of the sound of each program displayed on each sub-screen;
The sound volume ratio of each program is determined based on the gaze / designated time measured by the time measuring means and the sound volume ratio of each program stored in the volume ratio storage means, and the volume Volume ratio determining means for updating the volume ratio of the sound of each program stored in the ratio storage means;
Volume determining means for determining the sound volume of each program displayed on the multi-screen based on the sound volume ratio of each program determined by the volume ratio determining means;
The program selection support apparatus according to claim 1, further comprising:   2. The program selection support apparatus according to claim 1, further comprising an audio determination unit that outputs only audio of a program related to the sub-screen specified by the specifier screen specifying unit.   Audio determination means for outputting the sound volume of the program related to the child screen specified by the designator screen specifying means and the sound volume of the program related to the other child screen based on a predetermined ratio; The program selection support apparatus according to claim 1, wherein:   Program information corresponding to the program displayed on the child screen specified by the specifier screen specifying means when the time when the child screen is specified by the specifier screen specifying means exceeds a predetermined threshold value 5. The program selection support apparatus according to claim 1, further comprising: a program information acquisition / output unit that acquires the program information from an electronic program guide and outputs the program information to the screen display unit. It is at least one of the time when the viewer is gazing at the multi-screen sub-screen displayed on the screen display means and the time when the sub-screen is specified by the pointer displayed on the screen display means A program selection support device that supports the viewer's program selection based on the gaze / designated time,
A designator screen specifying means for specifying a subscreen that is being watched by the viewer among the multi-screens or a subscreen that is specified by a pointer displayed on the screen display means;
A clocking means for timing a gaze / designated time of the child screen identified by the designator screen identifying means;
The display ratio of the child screen based on the gaze / designated time measured by the timer means and the display ratio of the child screen stored in the child screen size storage means for storing the display ratio of the child screen Sub-screen size determining means for updating the display ratio of the sub-screen stored in the sub-screen size storage means,
Multi-screen creating means for creating the multi-screen based on the display ratio of the small screen determined by the small-screen size determining means;
A program selection support program characterized by functioning as a program.

Images