JP2011055382A - Display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display device capable of displaying one or more screens on a display in which the screens can be displayed constantly in an easily viewable manner by a plurality of viewers. <P>SOLUTION: The display device includes: a camera input part having a camera to input an image of the camera; a remote control signal receiver operated by remote control from the viewer; a viewer number detector for detecting the number of the viewers from the image displayed on the camera; a visual line detector for detecting visual lines of the viewers from the image displayed on the camera; a viewer position detector for detecting positions of the viewers from the image displayed on the camera; a display controller for controlling sizes or display positions of one or more screens; and a display for displaying one or more screens. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a display device in the case where a plurality of viewers view a plurality of screens displayed on one display, and more particularly to a display device that changes the screen display according to the viewer's line of sight.

  In recent years, with an increase in display size and definition, televisions that display multiple screens such as two-screen display or PinP in one display have appeared. However, it cannot be said that it is compatible with a plurality of viewers. For example, when three viewers want to display different screens, the screen is divided into three or three window screens are displayed on the display. However, there is no distinction in shape and size between the screen that you are watching and the screen that others are watching, so once you take your eyes off the display, It becomes difficult to identify whether the user was watching the screen.

  In addition, various television operations during television viewing may be switched on the full screen, and such operations hinder viewing by multiple people. For example, an electronic program guide is displayed to make a recording reservation, but the electronic program guide is often displayed on the full screen. If the electronic program guide is displayed on the full screen, other programs can be viewed. It will interfere with the viewing of those who are.

  As a method considering such a problem, there is a method disclosed in Patent Document 1. Patent Document 1 detects a viewing position of a viewer on one or more screens displayed on a display, and determines a display position on the display of the one or more screens based on the detected viewing position. Is.

JP 2001-94900 A

  However, in the above prior art documents, a plurality of remote controllers are required. Further, even if the display position of a plurality of screens is changed based on the viewer's position information, the display position may not necessarily be in line with the line of sight.

  The present invention has been made to solve the above-described problems, and in a display device that displays a plurality of screens on a display, the screen is always easier to view in consideration of the lines of sight of a plurality of viewers. It is an object to provide a display device that can perform display.

In order to solve the above problems, the present invention relates to a display device for viewing by a first viewer who performs a remote control operation and a second viewer who does not perform a remote control operation. A camera input unit that inputs a captured camera image; a line-of-sight detection unit that detects the line of sight of the first viewer from the camera image input by the camera input unit;
A first display screen instructed by a remote control operation by the first viewer, a display unit displaying a second display screen viewed by the second viewer, and a line of sight detected by the line-of-sight detection unit A display control unit for controlling the display unit to display the first display screen in the direction of

  In another aspect of the present invention, in a display device for viewing by a plurality of viewers, a camera input unit that inputs a camera image captured by the plurality of viewers, and a camera image input by the camera input unit A viewer number detecting unit for detecting the number of viewers from the camera, a line of sight detecting unit for detecting the line of sight of a plurality of viewers from the camera video input by the camera input unit, and a display unit for displaying at least two display screens When the number of viewers detected by the viewer number detection unit becomes 1, the display screen on which the viewer's line of sight of 1 detected by the line of sight detection unit is sent is displayed on the full screen. Thus, a display control unit for controlling the display unit is provided.

  According to another aspect of the present invention, in a display device for a first viewer and a second viewer to view, a camera input unit that inputs a camera image obtained by photographing the first and second viewers; , A line-of-sight detection unit that detects the line of sight of the first and second viewers from the camera video input by the camera input unit, a first display screen that the first viewer views, and the second A display unit that displays a second display screen to be viewed by a viewer, and when the line-of-sight detection unit detects only the line of sight of the first viewer, the first display screen is displayed in full screen. Thus, a display control unit for controlling the display unit is provided.

  In another aspect of the present invention, in a display device for viewing by a plurality of viewers, a camera input unit that inputs a camera image captured by the plurality of viewers, and a camera image input by the camera input unit A line-of-sight detection unit that detects the line of sight of the plurality of viewers, a display unit that displays two display screens, and a display having a larger number of lines of sight detected by the line-of-sight detection unit among the two display screens A display control unit that controls the display unit to display the screen in full screen is provided.

  According to the present invention, in a display device that displays two or more screens on a display, it is possible to display a screen so that it is always easier to view in consideration of the line of sight.

1 is a block diagram of a screen display device according to Embodiment 1. FIG. It is a flowchart which shows the process sequence of the screen display method which concerns on Example 1. FIG. FIG. 10 is a flowchart illustrating a processing procedure of a screen display method according to the second embodiment. FIG. 10 is a flowchart illustrating a processing procedure of a screen display method according to a third embodiment. FIG. 10 is a flowchart illustrating a processing procedure of a screen display method according to a fourth embodiment. FIG. 10 is a flowchart illustrating a processing procedure of a screen display method according to a fifth embodiment. It is a flowchart which shows the process sequence of the screen display method which concerns on Example 6. FIG. FIG. 10 is a flowchart illustrating a processing procedure of a screen display method according to a seventh embodiment. It is a flowchart which shows the process sequence of the screen display method which concerns on Example 8. FIG. It is a flowchart which shows the process sequence of the screen display method which concerns on Example 9. 6 is a screen display example according to a processing procedure of a screen display method according to the first embodiment. 10 is a screen display example according to a processing procedure of a screen display method according to the second embodiment. 10 is a screen display example according to a processing procedure of a screen display method according to a fourth embodiment. 18 is a screen display example according to the processing procedure of the screen display method according to the seventh embodiment. 10 is a screen display example according to a processing procedure of a screen display method according to an eighth embodiment.

  This embodiment is an embodiment of the screen display method of the present invention. Hereinafter, the present embodiment will be described with reference to FIGS.

  FIG. 1 is a block diagram of a screen display apparatus for realizing a screen display method according to the present invention, FIG. 2 is a flowchart showing a processing procedure of the screen display method according to the present embodiment, and FIG. 11 is a screen table according to the present embodiment. It is an example.

  FIG. 1 is a block diagram of a screen display apparatus for realizing a screen display method according to the present invention, 101 is a camera input unit for inputting camera video, and 102 is a remote control for receiving a remote control signal by a remote control operation from a viewer. Reference numeral 103 denotes a signal receiving unit, 103 denotes a viewer number detecting unit that detects the number of viewers from video captured by the camera, and 104 denotes a line-of-sight detecting unit that detects the viewer's line of sight from video displayed on the camera. Is a viewer position detection unit that detects the position of the viewer from the video imaged on the camera, 106 is a display control unit that controls the size and display position of one or more screens, and 107 is one or more screens. It is a display to display. Although not shown, the screen display device for realizing the screen display method in the present embodiment is provided with a camera, can receive broadcast waves, or has a communication function with the Internet, and has a program. And information accompanying the program, such as a program guide, can be displayed.

  Hereinafter, the processing procedure of the screen display method in the present embodiment will be described with reference to the flowchart of FIG.

  FIG. 2 shows the number of viewers detected by the viewer number detection unit 103 based on the camera video input by the camera input unit 101 and the gaze detection unit 104 based on the camera video input by the camera input unit 101. From the detected viewer's line of sight and the position of the remote control operator detected by the viewer position detection unit 105 based on the camera image input by the camera input unit 101, the display control unit 106 determines the number of screens, the screen size, It is a flowchart which shows a series of processes which determine a screen position and display one or more screens on the said display. First, an operation key is transmitted by a viewer's remote control operation, and key input is performed on the operation key received by the remote control reception unit 102 (step S201). When the input key content is a request for full screen display such as electronic program guide display, the number of viewers is detected by the viewer number detection unit 103 based on the camera video input by the camera input unit 101. Is detected (step S202). It is determined whether or not the number of viewers detected by the viewer number detection unit 103 is two or more (step S203). If the number of viewers is two or more, the camera video input by the camera input unit 101 is used as a basis. The gaze detection unit 104 detects gazes of a plurality of viewers (step S204). If the number of viewers detected in step S203 is less than two, that is, if only one is detected, a screen corresponding to the key input input in step S201 is displayed in full screen (step S205). Terminate the process. After detecting the line of sight of a plurality of viewers in step S204, the position of the remote control operator is detected by the viewer position detecting unit 105 based on the camera video input by the camera input unit 101 (step S206). The display control unit 106 determines the display position of the screen corresponding to the key input input in step S201 from the line of sight of the plurality of viewers detected in step S204 and the position of the remote control operator detected in step S206, and the display A screen is displayed on the screen 107 (step S207), and a series of processing ends. The screen position is determined in step S207 by, for example, shifting the center position of the program that is currently being viewed, changing the aspect ratio to 4: 3, cutting both ends, and displaying the program screen on the side far from the position of the remote control operator. Is displayed, and a screen corresponding to key input is displayed on the side closer to the position of the remote control operator. When the line of sight of the remote control operator is on the side far from the position of the remote control operator, a screen corresponding to key input is displayed on that side.

  FIG. 11 shows a screen display example displayed by the screen display method according to the present invention. 1111 is a remote control operator and 1112 is another viewer. 1101 is a screen for the remote controller operator, and 1102 is a screen for the viewer 1112. FIG. 11A shows a screen display example in the case where the number of viewers is one in step S203, and is a case where the remote controller operator presses the program guide display key. In this case, the program guide screen corresponding to the remote control key is displayed in full screen. FIG. 11B shows an example of a screen display when the number of viewers is two in step S203, where the remote control operator has pressed the program guide display key. In this case, the currently viewed program is shifted in the center position, the aspect ratio is changed to 4: 3, both ends are cut, and the program guide screen corresponding to the remote control key is displayed on the side close to the remote control operator. FIG. 11C shows an example of a screen display when the number of viewers is two in step S203, where the remote control operator presses the program guide display key. In this case, the currently viewed program is shifted in the center position, the aspect ratio is changed to 4: 3, both ends are cut, and the program guide screen corresponding to the remote control key is displayed on the line of sight of the remote control operator.

  By the above processing, it is possible to provide a screen display method that can perform screen display so that it is always easier to view without disturbing the viewing of other viewers.

  The present embodiment is a screen display method in consideration of the number of lines of sight with respect to the first embodiment. The block diagram of the screen display device for realizing the screen display method in the present embodiment is the same as FIG. 1 shown in the first embodiment. Hereinafter, the processing procedure of the screen display method in the present embodiment will be described with reference to FIGS.

  FIG. 3 is a flowchart showing the processing procedure of the screen display method in this embodiment. The number of viewers detected by the viewer number detection unit 103 based on the camera video input by the camera input unit 101, and the camera Detected by the viewer position detection unit 105 based on the number of viewers' gazes detected by the gaze detection unit 104 based on the camera video input by the input unit 101 and the camera video input by the camera input unit 101. FIG. 10 is a flowchart showing a series of processes for determining the number of screens, the screen size, and the screen position by the display control unit 106 from the position of a remote control operator and displaying one or more screens on the display 107. First, the operation key is transmitted by the remote control operation of the viewer, and the key input is performed on the operation key received by the remote control receiving unit 102 (step S301). When the input key content is a request for full screen display such as electronic program guide display, the number of viewers is detected by the viewer number detection unit 103 based on the camera video input by the camera input unit 101. Is detected (step S302). It is determined whether or not the number of viewers detected by the viewer number detection unit 103 is two or more (step S303). If the number of viewers is two or more, the camera video input by the camera input unit 101 is used as a basis. The gaze detection unit 104 detects gazes of a plurality of viewers (step S304). It is determined whether or not the number of lines of sight of the plurality of viewers is 2 or more (step S305). If the number of lines of sight is 2 or more, the viewer position detection unit 105 is based on the camera video input by the camera input unit 101. Then, the position of the remote control operator is detected (step S306). If the number of viewers detected in step S303 is less than 2, that is, only one is detected, and if the number of eyes detected in step S305 is less than 2, that is, only one eye is detected. If not, in this case, even if multiple viewers are detected, it can be determined that only one person is looking at the display, so the screen corresponding to the key input entered in step S301 is displayed in full screen (step S307), a series of processing ends. The display control unit 106 determines the display position of the screen corresponding to the key input input in step S301 from the line of sight of the multiple viewers detected in step S304 and the position of the remote control operator detected in step S306, and the display controller 106 determines the display position. A screen is displayed on the screen 107 (step S308), and a series of processing ends. The method for determining the screen position in step S308 is, for example, that the program currently being viewed is shifted in the center position, the aspect ratio is changed to 4: 3, both ends are cut, and the program screen is displayed on the side far from the position of the remote control operator. Is displayed, and a screen corresponding to key input is displayed on the side closer to the position of the remote control operator. When the line of sight of the remote control operator is on the side far from the position of the remote control operator, a screen corresponding to key input is displayed on that side.

  FIG. 12 is a screen display example displayed by the screen display method according to the present invention, where 1211 is a remote control operator and 1212 is another viewer. Reference numeral 1201 denotes a screen for the remote control operator. In FIG. 12, the number of viewers is two in step S303, but the line of sight of other viewers 1212 other than the remote control operator is not facing the display, and the number of lines of sight is one in step S305. In this example, the remote controller operator presses the program guide display key. In this case, the program guide screen corresponding to the remote control key is displayed in full screen.

  By the above processing, it is possible to provide a screen display method that can perform screen display so that it is always easier to view without disturbing the viewing of other viewers. Also, by determining the number of lines of sight, even when multiple viewers are detected, if only one line of sight is detected, that is, only one person is looking at the display and other persons are looking at the display. If not, it is possible to provide a screen display method that allows a screen table to be viewed more easily by displaying the entire screen.

  This embodiment is a screen display method in the case where processing is omitted by detecting the number of viewers' lines of sight instead of detecting the number of viewers compared to the first embodiment. The block diagram of the screen display device for realizing the screen display method in the present embodiment is almost the same as that in FIG. 1 shown in the first embodiment, but the viewer number detection unit 103 is not necessary. Hereinafter, the processing procedure of the screen display method in the present embodiment will be described with reference to FIG.

  FIG. 4 is a flowchart showing the processing procedure of the screen display method in the present embodiment, and the number of viewers' eyes detected by the eyes detector 104 based on the camera video input by the camera input unit 101, and From the position of the remote control operator detected by the viewer position detection unit 105 based on the camera video input by the camera input unit 101, the display control unit 106 determines the number of screens, the screen size, and the screen position, and the display 107 It is a flowchart which shows a series of processes which display one or more screens. First, the operation key is transmitted by the remote control operation of the viewer, and the key input is performed on the operation key received by the remote control receiving unit 102 (step S401). When the input key content is a request for full screen display such as an electronic program guide display, for example, the line of sight detection unit 104 determines the line of sight of multiple viewers based on the camera video input by the camera input unit 101. It detects (step S402). It is determined whether or not the number of viewers' line of sight is 2 or more (step S403). If the number of lines of sight is 2 or more, the viewer position detecting unit 105 uses the camera image input by the camera input unit 101 to determine the number of viewers. The position of the remote control operator is detected (step S404). When the number of lines of sight detected in step S403 is less than 2, that is, when only one line of sight is detected, a screen corresponding to the key input input in step S401 is displayed in full screen (step S405). A series of processing ends. Based on the viewer's line of sight detected in step S402 and the position of the remote control operator detected in step S404, the display control unit 106 determines the display position of the screen corresponding to the key input input in step S401, and the display 107 Is displayed on the screen (step S406), and the series of processing ends. The screen position is determined in step S406 by, for example, shifting the center position of the program currently being viewed, changing the aspect ratio to 4: 3, cutting both ends, and displaying the program screen on the side far from the position of the remote control operator. Is displayed, and a screen corresponding to key input is displayed on the side closer to the position of the remote control operator. When the line of sight of the remote control operator is on the side far from the position of the remote control operator, a screen corresponding to key input is displayed on that side.

  By the above processing, it is possible to provide a screen display method that can perform screen display so that it is always easier to view without disturbing the viewing of other viewers. Further, by determining the number of viewers based on the number of lines of sight, it is possible to omit the viewer number detection unit 103 and the processing procedure related thereto.

  The present embodiment is a screen display method that allows the viewer to customize the screen display method by providing a screen display mode with respect to the first embodiment. The block diagram of the screen display device for realizing the screen display method is the same as that of FIG. 1 shown in the first embodiment. Hereinafter, the processing procedure of the screen display method in the present embodiment will be described with reference to FIGS. 5 and 13.

  FIG. 5 is a flowchart showing the processing procedure of the screen display method in the present embodiment. The number of viewers detected by the viewer number detection unit 103 based on the camera video input by the camera input unit 101, and the camera Remote control operation detected by the viewer position detection unit 105 based on the viewer's line of sight detected by the visual line detection unit 104 based on the camera video input by the input unit 101 and the camera video input by the camera input unit 101 FIG. 10 is a flowchart showing a series of processes for determining the number of screens, the screen size, and the screen position by the display control unit 106 from the position of the person and displaying one or more screens on the display 107. First, the operation key is transmitted by the remote control operation of the viewer, and the key input is performed on the operation key received by the remote control receiving unit 102 (step S501). When the input key content is a request for full screen display such as electronic program guide display, the number of viewers is detected by the viewer number detection unit 103 based on the camera video input by the camera input unit 101. Is detected (step S502). It is determined whether or not the number of viewers detected by the viewer number detection unit 103 is two or more (step S503), and if the number of viewers is two or more, whether the pre-registered mode is the operator priority mode or not Is determined (step S504). Here, the modes in the present embodiment include an operator priority mode in which a screen is displayed closer to the operator and a viewer priority mode in which a screen is displayed with fewer lines of sight. If the pre-registered mode is not the operator priority mode, that is, the viewer priority mode, the gaze detection unit 104 detects the gazes of a plurality of viewers based on the camera video input by the camera input unit 101 (step) S506). Based on the detected line of sight of multiple viewers, the display control unit 106 determines the screen display position so that the display position of the screen corresponding to the key input input in step S501 is displayed on the side with the smaller line of sight, and the display 107 Is displayed on the screen (step S508), and a series of processing ends. If the mode registered in advance in step S504 is the operator priority mode, the viewer position detection unit 105 detects the position of the remote control operator based on the camera image input by the camera input unit 101 (step S507). Based on the detected position of the remote control operator, the display control unit 106 determines the screen display position so that the display position of the screen corresponding to the key input input in step S501 is displayed closer to the remote control operator. A screen is displayed on the display 107 (step S508), and a series of processing ends. If the number of viewers detected in step S503 is less than two, that is, if only one is detected, a screen corresponding to the key input input in step S501 is displayed in full screen (step S505). Then, a series of processing is completed.

  FIG. 13 shows a screen display example displayed by the screen display method according to the present invention, in which 1311 is a remote control operator, and 1312 and 1313 are other viewers. Reference numeral 1301 denotes a screen for the remote controller operator, and reference numeral 1302 denotes a screen for the viewers 1312 and 1313. FIG. 13 shows an example of the screen display when the number of viewers is three in step S503, and the remote controller operator presses the program guide display key. FIG. 13A shows an example of the screen when the mode is the operator priority mode in step S504. In this case, the program currently being viewed is shifted in the center position and the aspect ratio is changed to 4: 3. And a program guide screen corresponding to key input is displayed on the side closer to the position of the remote control operator. FIG. 13B is an example of a screen when the mode is the viewer priority mode in step S504, and the line of sight of the other viewers 1312 and 1313 is looking to the left from the center of the display. The program guide screen is displayed on the right side from the center of the display.

  With the above processing, it is possible to provide a screen display method capable of displaying a screen so that it is always easier to view without disturbing the viewing of other viewers, and providing a screen display mode allows viewing. The user can customize the display method of the screen, and it is possible to provide a screen display method that can perform screen display so that the viewer can easily view the screen.

  This embodiment is a screen display method in the case of performing personal identification of a remote control operator as compared to the first embodiment.

  The block diagram of the screen display device for realizing the screen display method in this embodiment is almost the same as that in FIG. 1 shown in the first embodiment, but the line-of-sight detection unit 104 is unnecessary, and a remote controller is used instead. A personal identification unit for personal identification of the operator is provided. Hereinafter, the processing procedure of the screen display method in the present embodiment will be described with reference to FIG.

  FIG. 6 is a flowchart showing the processing procedure of the screen display method in the present embodiment. The number of viewers detected by the viewer number detection unit 103 based on the camera video input by the camera input unit 101, and the camera Detected by the viewer position detection unit 105 based on the personal identification information of the remote control operator detected by the personal identification unit based on the camera video input by the input unit 101 and the camera video input by the camera input unit 101 FIG. 10 is a flowchart showing a series of processes for determining the number of screens, the screen size, and the screen position by the display control unit 106 from the position of a remote control operator and displaying one or more screens on the display 107. First, an operation key is transmitted by a viewer's remote control operation, and key input is performed on the operation key received by the remote control reception unit 102 (step S601). When the input key content is a request for full screen display such as electronic program guide display, the number of viewers is detected by the viewer number detection unit 103 based on the camera video input by the camera input unit 101. Is detected (step S602). It is determined whether or not the number of viewers detected by the viewer number detection unit 103 is two or more (step S603). If the number of viewers is two or more, the camera video input by the camera input unit 101 is used as a basis. Then, the viewer position detecting unit 105 detects the position of the remote control operator (step S604). Thereafter, the personal identification information of the remote control operator is detected by the personal identification unit based on the camera video input by the camera input unit 101 (step S606). It is determined whether or not the remote control operator identified in step S606 is a person registered in advance (step S607), and if it is a registered person, the screen size is determined according to screen display information such as a screen size registered in advance for each individual. (Step S608). After determining the screen size in step S608 or if the remote control operator is not a pre-registered person in step S607, the key input input in step S601 is changed from the position of the remote control operator detected in step S604. The display position of the corresponding screen is determined by the display control unit 106, displayed on the display 107 (step S609), and a series of processing ends.

  By the above processing, it is possible to provide a screen display method that can perform screen display so that it is always easier to view without disturbing the viewing of other viewers. In addition, a screen display method is provided that enables the viewer to view the screen more easily by identifying the remote control operator and displaying the screen according to screen display information such as a pre-registered screen size. can do.

  The present embodiment is a screen display method for controlling the screen display from the number of viewers and the line of sight during the multi-screen display as compared to the first embodiment. The block diagram of the screen display device for realizing the screen display method in the present embodiment is almost the same as FIG. 1 shown in the first embodiment, but the viewer position detecting unit 104 is not necessary. Hereinafter, the processing procedure of the screen display method in the present embodiment will be described with reference to FIG.

  FIG. 7 is a flowchart showing the processing procedure of the screen display method in the present embodiment. The number of viewers detected by the viewer number detection unit 103 based on the camera video input by the camera input unit 101, and the camera Based on the viewer's line of sight detected by the line-of-sight detection unit 104 based on the camera image input by the input unit 101, a series of processing for determining full screen display by the display control unit 106 and displaying the full screen on the display 107 is performed. FIG. While a plurality of screens are displayed, the number of viewers is detected by the viewer number detection unit 103 based on the camera video input by the camera input unit 101 (step S701). It is determined whether or not the number of viewers detected by the viewer number detection unit 103 is one (step S702). If the number of viewers is one, the camera image input by the camera input unit 101 is used to determine the number of viewers. The visual line detection unit 104 detects the visual line of the viewer (step S703). Of the plurality of screens displayed on the display 107, the display control unit 106 determines that the screen having the line of sight detected in step S703 is displayed on the full screen, and displays the full screen on the display 107 (step S704). Then, a series of processing is completed. If the detected number of viewers is not one in step S702, the process returns to step S701 and the process is repeated. Note that this process may sleep for a few seconds to lower the detection frequency.

  When the number of viewers becomes one by the above processing, the multi-screen display is canceled and the screen on the viewing side is displayed in full screen, so that the screen can be displayed so that it is always easier to view A display method can be provided.

  The present embodiment is a screen display method for controlling the screen display from the number of viewers' lines of sight during multi-screen display as compared to the first embodiment. The block diagram of the screen display device for realizing the screen display method in the present embodiment is almost the same as that in FIG. 1 shown in the first embodiment, but the viewer number detection unit 103 and the viewer position detection unit. 104 is unnecessary. Hereinafter, the processing procedure of the screen display method in the present embodiment will be described with reference to FIGS.

  FIG. 8 is a flowchart showing the processing procedure of the screen display method in the present embodiment. From the number of viewer gazes detected by the gaze detection unit 104 based on the camera video input by the camera input unit 101, FIG. 11 is a flowchart showing a series of processes for determining full screen display by the display control unit 106 and displaying the full screen on the display 107. While a plurality of screens are displayed, the line of sight of the viewer is detected by the line of sight detection unit 104 based on the camera video input by the camera input unit 101 (step S801). It is determined whether or not the number of viewers' eyes detected by the eye-gaze detection unit 104 is one (step S802). If the number of eyes is one, among the plurality of screens displayed on the display 107, step The display control unit 106 determines that the screen with the line of sight detected in S801 is displayed on the entire screen, displays the entire screen on the display 107 (step S803), and ends the series of processes. If it is determined in step S802 that the number of detected line of sight of the viewer is not one, the process returns to step S801 and the process is repeated. Note that this process may sleep for a few seconds to lower the detection frequency.

  FIG. 14 shows a screen display example displayed by the screen display method according to the present invention. Reference numerals 1411 and 1412 denote viewers. Reference numerals 1401 and 1402 denote screens. In FIG. 14A, there are two viewers, but since the viewer 1412's line of sight is not facing the display, the line-of-sight destination screen becomes 1 in step S802, and the line of sight of the viewer 1411 in step S803. The previous screen S1401 is displayed on the full screen. FIG. 14B shows a screen display when the entire screen is displayed by this processing.

  When the number of viewers' line of sight becomes one by the above process, that is, when the number of viewers is one, the multi-screen display is canceled, and the screen on the viewing side is displayed in full screen. It is possible to provide a screen display method capable of displaying a screen so that it is always easier to view. Compared to the sixth embodiment, the number of viewers and related processing are not necessary, and the cost is reduced.

  This embodiment is a screen display method for controlling screen display from CM detection and line of sight during multi-screen display as compared to the first embodiment. The block diagram of the screen display device for realizing the screen display method in the present embodiment is almost the same as that in FIG. 1 shown in the first embodiment, but the viewer number detection unit 103 and the viewer position detection unit. 104 is unnecessary, and a CM detection unit for detecting CM is provided instead. Hereinafter, the processing procedure of the screen display method in the present embodiment will be described with reference to FIGS.

  FIG. 9 is a flowchart showing the processing procedure of the screen display method in this embodiment. The number of viewer gazes detected by the gaze detection unit 104 based on the camera video input by the camera input unit 101 and broadcast It is a flowchart which shows a series of processes which screen-control by the said display control part 106 from the CM detection information detected by CM detection part which detects CM from the program image in the inside, and display on the said display 107. FIG. When a plurality of screens are displayed and a broadcast is displayed on the main screen side, CM detection is performed by the CM detection unit (step S901). When the CM is detected, the line of sight of the viewer is detected by the line of sight detection unit 104 based on the camera video input by the camera input unit 101 (step S902). Of the plurality of screens displayed on the display 107, it is determined whether or not the number of lines of sight to the child screen is larger than the number of lines of sight to the main screen (step S903), and the number of lines of sight to the child screen is larger. In this case, screen display information such as the current screen size and screen position is stored in the display control unit 106 (step S904), and the display control unit 106 determines to enlarge the sub-screen on the line-of-sight side, and the display A screen is displayed on 107 (step S905). Thereafter, the CM detection unit determines whether the CM on the main screen side has ended (step S906). If the CM on the main screen side ends, the display control unit returns to the screen state stored in step S904. In step S907, the series of processes is terminated. If the CM on the main screen side has not ended in step S906, the process returns to step S902 and the process is repeated. If the number of lines of sight to the main screen is greater than the number of lines of sight to the child screen in step S903, the process returns to step S901 and the process is repeated.

  FIG. 15 is a screen display example displayed by the screen display method according to the present invention, and reference numerals 1511, 1512, and 1513 denote viewers. Reference numeral 1501 denotes a main screen on which sound is output, and reference numeral 1502 denotes a child screen. In FIG. 15A, there are three viewers. Each viewer 1511 views the main screen 1501 and each of the viewers 1512 and 1513 views the sub-screen 1502. When the main screen 1501 becomes a CM, CM is detected in step S901, and in step S903, the number of lines of sight to the sub-screen becomes larger than the number of lines of sight to the main screen. Is displayed on the full screen (FIG. 15B). Thereafter, when it is detected in step S906 that the main screen CM has been completed, the screen returns to the original screen state (FIG. 15C).

  By the above processing, when CM is detected on the main screen side and the line of sight is concentrated on the sub screen side, the screen can be displayed so that it is always easier to view by enlarging the sub screen side A display method can be provided.

  This embodiment is a screen display method for controlling audio output from the line of sight of a plurality of viewers during the display of a plurality of screens as compared to the first embodiment. The block diagram of the screen display device for realizing the screen display method in the present embodiment is almost the same as that in FIG. 1 shown in the first embodiment, but the viewer number detection unit 103 and the viewer position detection unit. 104 is unnecessary, and the display control unit also controls audio. A speaker for outputting sound is also provided. Hereinafter, the processing procedure of the screen display method in the present embodiment will be described with reference to FIG.

  FIG. 10 is a flowchart showing the processing procedure of the screen display method in the present embodiment. From the number of viewer gazes detected by the gaze detection unit 104 based on the camera video input by the camera input unit 101, It is a flowchart which shows a series of processes which perform audio | voice output control by the display control part 106, and output an audio | voice from the said speaker. While a plurality of screens are displayed, the line of sight of the viewer is detected by the line of sight detection unit 104 based on the camera video input by the camera input unit 101 (step S1001). Of the plurality of screens displayed on the display 107, it is determined whether the number of lines of sight to the child screen is larger than the number of lines of sight to the main screen (step S1002), and the number of lines of sight to the child screen is larger. In this case, the display control unit 106 determines to output the audio of the sub screen on the line of sight, outputs the audio of the sub screen to the speaker (step S1003), and ends the series of processes. If the number of lines of sight to the main screen is greater than the number of lines of sight to the child screen in step S1002, the process returns to step S1001 and the process is repeated.

  By the above processing, when the line of sight is concentrated on the child screen side, it is possible to provide a screen display method that can display the screen so that it is always easier to view by outputting the sound on the child screen side. .

DESCRIPTION OF SYMBOLS 101 ... Camera input part 102 ... Remote control receiver 103 ... Viewer number detection part 104 ... Gaze detection part 105 ... Viewer position detection part 106 ... Display control part 107 ... Display

Claims (7)

A display device for viewing by a first viewer who performs a remote control operation and a second viewer who does not perform a remote control operation,
A camera input unit for inputting a camera image of the first viewer;
A line-of-sight detection unit that detects the line of sight of the first viewer from the camera video input by the camera input unit;
A first display screen instructed by a remote control operation by the first viewer, and a display unit for displaying a second display screen viewed by the second viewer;
A display device comprising: a display control unit configured to control the display unit so that the first display screen is displayed in a direction of a line of sight detected by the line-of-sight detection unit. A viewer number detecting unit for detecting the number of viewers from the camera video input by the input unit;
The display control unit controls the display unit to display the first display screen in full screen when the number of viewers detected by the viewer number detection unit is 1. The display device according to claim 1. The line-of-sight detection unit also detects the line of sight of the second viewer, and can detect the number of lines of sight,
The pre-display controller controls the display unit to display the first display screen in full screen when the number of lines of sight detected by the line of sight detection unit is 1. The display device according to claim 1. The line-of-sight detection unit can also detect the line of sight of the second viewer,
When it is possible to set priority for the second viewer's line of sight by the remote control operation, and the display control unit is set to prioritize the second viewer's line of sight, The display device according to claim 1, wherein the display unit is controlled to display the display screen in a direction in which the second viewer does not have a line of sight. A display device for viewing by a plurality of viewers,
A camera input unit for inputting camera images of the plurality of viewers;
A viewer number detection unit for detecting the number of viewers from the camera video input by the camera input unit;
A line-of-sight detection unit that detects the lines of sight of a plurality of viewers from the camera video input by the camera input unit;
A display for displaying at least two display screens;
When the number of viewers detected by the viewer number detection unit becomes 1, the display screen on which the viewer's line of sight of 1 detected by the line of sight detection unit is sent is displayed on the full screen. A display device comprising a display control unit for controlling the display unit. A display device for viewing by a first viewer and a second viewer,
A camera input unit for inputting camera images of the first and second viewers;
A line-of-sight detection unit that detects the line of sight of the first and second viewers from the camera video input by the camera input unit;
A first display screen viewed by the first viewer, and a display unit for displaying a second display screen viewed by the second viewer;
A display control unit is provided for controlling the display unit so that the first display screen is displayed in full screen when only the first viewer's line of sight is detected by the line-of-sight detection unit. Display device. A display device for viewing by a plurality of viewers,
A camera input unit for inputting camera images of the plurality of viewers;
A line-of-sight detection unit that detects the lines of sight of the plurality of viewers from the camera video input by the camera input unit;
A display unit for displaying two display screens;
A display apparatus comprising: a display control unit that controls the display unit so that the display screen having the larger number of lines of sight detected by the line-of-sight detection unit of the two display screens is displayed on a full screen.

Images