JP2013125191A - Video display device, video display method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce reception interference by displaying graphics irrelevant to data format of video data.SOLUTION: When generating graphics for being superimposedly displayed on a video relating to iput video data, the video display device detects a region of interest of a viewer such as a face of a person from the video data and accumulates the information. If the region of interest detected along with a time is superimposed on or approaches to a position where the graphics is displayed when displaying the graphics by a command from a user, the video display device determines a display position of the graphics at a position located in a peripheral area of the display screen and at least at a predetermined distance apart from the region of interest.

Description

  The present invention relates to a video display device, a video display method, and a program, and more particularly, to a technique suitable for use in displaying graphics when displaying a video.

  In a video display device such as a TV, a PC monitor, or a projector, information generated inside the video display device may be displayed according to a viewer's instruction or the like regardless of the video to be viewed. For example, a setting screen of a display device such as an OSD, status information, or graphics such as a timer for presentation may be displayed. In this case, these pieces of information are generally displayed in the peripheral part of the display screen so as not to hinder the viewing of the video, but when the viewer's attention area is in the peripheral part, it overlaps with the video. , It will be in a state of obstructing viewing.

  On the other hand, information to be watched by the viewer may be included in a part of the displayed video. For example, it is a case where sub-pictures such as telops encoded as part of video content and sub-information such as closed captions are included. This also applies to newly defined elements of interest on the video.

  For such information to be noticed by the viewer, sub-information is analyzed before displaying the video, and the presence / absence of the notice information and the display position are specified. For example, Patent Document 1 defines a display prohibition area in video data, acquires a method for avoiding the overlap display prohibition area and the caption display area, and corrects the caption display area according to the avoidance method. A technique for displaying is displayed. Further, there has been proposed a technique in which the position of a sub-picture of the DVD video standard is analyzed in advance, the OSD display position is controlled so as not to overlap, and the on-screen is displayed at a position not overlapping with the sub-picture (for example, a patent) Reference 2).

JP 2008-39841 A Japanese Patent No. 3714542 JP 2004-133737 A Japanese Patent No. 4453979 Japanese Patent Laid-Open No. 10-91325

  As described above, when generating graphics data of the clock or internal information inside the video display device and displaying the graphics superimposed on the video display, the graphics are generally displayed on the periphery of the screen and viewed. It is preferable not to interfere. In view of this, a technique has been proposed in which sub-information encoded in input video data is analyzed from a format, and the display position thereof is controlled to be different from the display position of graphics such as device internal information.

  However, when the input video data has a data structure such as raster data that does not include sub-information as a format, the display position of graphics cannot be controlled, and viewing disturbance cannot be reduced.

  In view of the above-described problems, an object of the present invention is to reduce viewing disturbance caused by displaying graphics regardless of the data format of video data.

  An image display apparatus according to the present invention includes an input unit that inputs image data, a generation unit that generates graphics for displaying the image related to the image data, and a viewer's attention area from the image data. A detecting unit; a determining unit that determines a display position of the graphics generated by the generating unit; and a video that is related to the video data is displayed on a display device so that the graphics overlaps the display position determined by the determining unit. Display control means for determining the display position of the graphics so as to provide at least a predetermined distance from the attention area detected by the detection means.

  According to the present invention, regardless of the data format of video data, viewing disturbance due to graphics display can be reduced no matter where the video's attention area is located on the display screen.

It is a block diagram which shows the function structural example of the video display apparatus which concerns on 1st Embodiment. It is a figure explaining the method to change the position of the graphics in 1st Embodiment. FIG. 6 is a diagram illustrating a method for calculating the position of graphics to be changed in the first embodiment. It is a block diagram which shows the function structural example of the video display apparatus which concerns on 2nd Embodiment. FIG. 10 is a diagram illustrating a method for calculating the position of graphics to be changed in the second embodiment. It is a block diagram which shows the function structural example of the video display apparatus which concerns on 3rd Embodiment. FIG. 10 is a diagram for describing a display form of graphics to be changed in the third embodiment. It is a block diagram which shows the function structural example of the video display apparatus which concerns on 4th Embodiment. It is a block diagram which shows the detailed structural example of the attention area detection part in 4th Embodiment. It is a figure which shows the imaging | photography condition by an imaging part in 4th Embodiment. It is a block diagram which shows the other detailed structural example of the attention area detection part in 4th Embodiment. In 4th Embodiment, it is a figure which shows the other imaging | photography condition by an imaging part.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(First embodiment)
FIG. 1 is a block diagram illustrating a functional configuration example of the video display device 100 according to the present embodiment.
In FIG. 1, a video input unit 101 inputs video data generated by an external video source generation device (not shown). The video processing unit 102 performs processing necessary for displaying video related to video data. The graphics drawing synthesis unit 103 draws graphics data and superimposes it on the video data to form video data for display. The display output unit 104 outputs video data to the display device 110.

  The user instruction input unit 105 is an operation unit for receiving an instruction from a user. The graphics generation unit 106 is for generating graphics. The attention area detection unit 107 detects the attention area of the video data. The attention area holding unit 108 holds information on the attention area in the past predetermined time. Further, the graphics position determination unit 109 determines the display position of the graphics generated by the graphics generation unit 106.

  The video input unit 101 receives video data from a video source generation device (not shown) or the like, and the video processing unit 102 performs predetermined image processing on the video data input from the video input unit 101. This processing includes, for example, conversion processing to display resolution, and the video processing unit 102 outputs video data in a display resolution raster data format or a compression format thereof.

  On the other hand, the user instruction input unit 105 detects the operation of the remote controller or the like by the user and transmits the operation information to the graphics generation unit 106. The graphics generation unit 106 generates graphics corresponding to the operation information, the internal state of the video display device 100, and the setting state information, and outputs the graphics data and the position information to the graphics drawing synthesis unit 103.

  The graphics drawing / synthesizing unit 103 draws graphics data to form a bitmap, and superimposes it on the video data processed by the video processing unit 102 according to the transmitted position information to form a display video. At this time, if video data is output from the video processing unit 102 in a compressed format, decompression processing is performed. The display output unit 104 performs display control by outputting the display video data on which the graphics are superimposed by the graphics drawing synthesis unit 103 to the display device 110 at the display timing (frame synchronization).

  On the other hand, the attention area detection unit 107 analyzes the video data on which the image processing is performed by the video processing unit 102, and detects the attention area (position on the displayed image). In this embodiment, a region of interest is detected by detecting the position of a person's face. As an example of detecting a person's face by analyzing video data, for example, a face is detected by various known techniques as described in Patent Document 3. Then, the attention area information is stored in the attention area holding unit 108. The graphics position determination unit 109 calculates the distance between the past attention area and the graphics, and determines the graphics display position using the area excluding the past attention area from the entire screen as a candidate for a position to be displayed. Then, the position information is output to the graphics generation unit 106.

  Next, an example of the operation according to the present embodiment will be described with reference to FIG. In the vicinity of the center of the display screen 201 shown in FIG. 2A, human faces 202 and 203 are shown, and an area where the human faces 202 and 203 are concentrated is an attention area 204. In the lower left area of the display screen 201, graphics 205 are displayed. Note that the attention area detection unit 107 detects human faces 202 and 203, and detects a face area in the vicinity of the circumscribed area as the attention area 204. Further, when the user instructs the graphics 205 to be displayed, the graphics position determination unit 109 determines the display position of the graphics 205 that is the default display position.

  Thereafter, as time passes, it is assumed that the positions of the human faces 202 and 203 have moved to the lower left of the screen as in the display screen 211 shown in FIG. Accordingly, the attention area 214 is detected at a different position by the attention area detection unit 107, and the position of the attention area 214 approaches the position of the graphics 205 displayed on the display screen 201 of FIG. Therefore, the graphics position determination unit 109 calculates the distance between the graphics display position and the attention area. As a result, if it is determined that they are close or overlapped, the graphics display position is redetermined in the upward direction, which is a position away from the attention area and that has not become the attention area within the past predetermined time. And transmitted to the graphics generation unit 106. The graphics generation unit 106 generates graphics data so as to display the graphics 215 at the redetermined position.

  Next, an example of graphics movement will be described in more detail with reference to FIG. In FIG. 3, it is assumed that the entire display screen 301 is divided into 6 × 4 areas. The attention area 302 follows the trajectory 303 in a predetermined time from the past and moves within the display screen 301. When the attention area 302 reaches the vicinity of the position where the graphics 304 is displayed, viewing disturbance occurs.

  The attention area holding unit 108 holds information on the attention area that has passed the trajectory 303, and based on this information, the graphics position determination unit 109 determines the thick line area 305 on the display screen 301 as a non-attention area. , A graphics destination candidate. Since it is preferable to display the graphics so as not to disturb viewing, the graphics position determination unit 109 determines the position as far as possible from the attention area along the outer periphery of the display screen 301 among the movement destination candidates. . In accordance with this determination, the graphics generation unit 106 generates graphic data so as to display the graphics 307 moved in the direction of the arrow 306.

  In the present embodiment, the example in which the attention area is detected by paying attention to the face of the person as the area estimated as the attention area has been described. On the other hand, in addition to the human face, the attention area may be detected by paying attention to the character area, icon, or cursor on the PC display. For example, a technique described in Patent Document 4 is used as a technique for detecting the character area by analyzing the video data. In the case of an icon or a cursor, the detection target is relatively fixed, and can be detected by pattern matching or the like. In addition, when detecting other specific objects, they may be registered in advance by a viewer and detected by pattern matching based on the registered information.

  As described above, according to the present embodiment, control is performed such that the position of the attention area is detected from the face of a person and the graphics is displayed at a position away from the position of the attention area. As a result, it is possible to reduce viewing disturbance caused by displaying graphics regardless of the data format of the video data.

(Second Embodiment)
FIG. 4 is a block diagram illustrating a functional configuration example of the video display apparatus 400 according to the present embodiment. Functions equivalent to those in FIG. 1 are denoted by the same reference numerals, and descriptions of functions and operations equivalent to those in the first embodiment are omitted.

  The video display device 400 according to the present embodiment further includes a flat portion detection unit 401. The graphics position determination unit 109 further uses the detection result by the flat part detection unit 401 when determining the destination of the graphics when the attention area and the graphics overlap or approach each other.

  The flat portion detection unit 401 analyzes the video data output from the video processing unit 102 and detects a flat portion of a video in which changes in luminance and saturation are equal to or less than predetermined values. For example, as shown in FIG. 5A, the flat part detection unit 401 divides the peripheral area of the display screen 501 into 16 small areas 502a to 502p, and detects a flat part for each small area. .

  FIG. 6B is a diagram for explaining an operation example when the attention area and the graphics overlap. When the attention area 503 moves according to a change in time and overlaps the graphics 504, the graphics 504 is displayed in the peripheral portion of the display screen 501, and therefore, the graphics can be moved in the directions of two arrows 506 and 507. Conceivable. When the change in luminance and saturation is equal to or less than the predetermined value and the flattest area is detected as the area 508 including the small areas 502g to i, the flat part detecting unit 401 uses the area 508 as a movement destination candidate and the graphics position determining unit. 109. The graphics position determination unit 109 determines that the closest small area 502g is the movement destination because the flat portion has a low degree of attention, and instructs the graphics generation unit 106 to generate graphic data in which the position of the graphics is moved.

  As described above, according to the present embodiment, since the flat portion of the video is directly detected, it is possible to more reliably reduce viewing disturbance.

(Third embodiment)
FIG. 6 is a block diagram illustrating a functional configuration example of the video display apparatus 600 according to the present embodiment. Functions equivalent to those in FIG. 1 are denoted by the same reference numerals, and descriptions of functions and operations equivalent to those in the first embodiment are omitted.

  The video display apparatus 600 according to the present embodiment includes a graphics display correction unit 601 instead of the graphics position determination unit 109, and changes the graphics display form when the attention area and the graphics overlap or are close to each other. , Reduce viewing disturbance. For example, as shown in FIG. 7A, when the attention area 703 moves on the display screen 701 and overlaps the graphics 702, the graphics display correction unit 601 instructs the graphics generation unit 106 to change the display form. .

  As a display form, for example, as shown in FIG. 7B, the graphics generation unit 106 is instructed to generate graphics 704 with a reduced size. Alternatively, as illustrated in FIG. 7C, the graphics generation unit 106 is instructed to generate graphics 705 in which the transparency value is changed by increasing the value α.

  As described above, according to the present embodiment, viewing disturbance can be reduced by changing the graphics display form. Further, in the present embodiment, since the display form is changed instead of moving the graphics, it is possible to reduce unnecessary influence on viewing accompanying the movement of the graphics.

(Fourth embodiment)
FIG. 8 is a block diagram illustrating a functional configuration example of the video display apparatus 800 according to the present embodiment. Functions equivalent to those in FIG. 1 are denoted by the same reference numerals, and descriptions of functions and operations equivalent to those in the first embodiment are omitted. The attention area detection unit 801 in this embodiment does not analyze the video data, but shoots the viewer to determine the attention area.

  FIG. 9 is a block diagram illustrating a detailed configuration example of the attention area detection unit 801 in the present embodiment. The line-of-sight detection unit 902 images the viewer from the imaging unit 901 and detects the viewer's line of sight. Then, the attention point detection unit 903 determines an attention point on the display screen from the detection result of the line of sight.

  For example, as shown in FIG. 10, an imaging unit 901 is installed on the upper part of the display screen 1001, and a viewer 1002 facing the display screen is photographed. Then, the line-of-sight detection unit 902 analyzes the imaging data of the imaging unit 901, and performs face detection and line-of-sight detection of the viewer 1002. As a method for detecting the face and the line of sight, for example, the technique described in Patent Document 3 or 5 is used.

  The point-of-interest detection unit 903 calculates an intersection between the line of sight and the video display screen as a point of interest from the line-of-sight detection result of the viewer 1002, and stores the information in the region-of-interest holding unit 108 as a region of interest. Since the line of sight is directed in the direction while the graphics are displayed, the point of interest is detected during a period in which the graphics are not displayed.

  Further, instead of detecting the viewer's line of sight, the point position indicated by the pointer operated by the viewer may be detected. In this case, the attention area detection unit 801 may be configured with an imaging unit 1101 and a point position detection unit 1102 that detects the viewer's point position, for example, as shown in FIG.

  As illustrated in FIG. 12, the imaging unit 1101 is installed at a position away from the display device and captures the display screen 1001. The viewer 1002 operates a pointing device 1201 such as a laser pointer to point on the display screen. In such a situation, it can be estimated that the vicinity of the point position 1202 is the viewer's attention point. The point position detection unit 1102 detects the point position 1202 on the video display screen from the imaging data of the display screen captured by the imaging unit 1101, and calculates the position. The calculation result is used as an attention area, and the information is stored in the attention area holding unit 108.

  As described above, according to the present embodiment, the viewer's line of sight or action is detected regardless of the video content, and the attention area is determined, so that it is possible to more reliably reduce viewing disturbance due to graphics display. It becomes.

(Other embodiments)
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

DESCRIPTION OF SYMBOLS 101 Image | video input part 104 Display output part 106 Graphic production | generation part 107 Attention area detection part 109 Graphics position determination part

Claims (14)

Input means for inputting video data;
Generating means for generating graphics for displaying superimposed on the video related to the video data;
Detecting means for detecting a viewer's attention area from the video data;
Determining means for determining a display position of graphics generated by the generating means;
Display control means for displaying a video related to the video data on a display device so that the graphics overlaps the display position determined by the determination means;
The video display apparatus, wherein the determination unit determines a display position of the graphics so as to provide at least a predetermined distance from a region of interest detected by the detection unit. Further comprising holding means for holding information of past attention areas detected by the detecting means;
The video display apparatus according to claim 1, wherein the determining unit determines a display position of the graphics in an area that does not include a past attention area based on information held in the holding unit. A flat portion detecting means for detecting a flat portion of luminance and saturation of the video data;
3. The video display according to claim 1, wherein the determining unit determines a display position of the graphics on a flat portion which is a peripheral portion of a display screen and detected by the flat portion detecting unit. apparatus.   The video display device according to claim 1, wherein the detection unit detects a character area in a video related to the video data as a target area.   The video display apparatus according to claim 1, wherein the detection unit detects a region including a face in a video related to the video data as a region of interest.   The video display device according to claim 1, wherein the detection unit detects a region including an icon in a video related to the video data as a region of interest.   The video display apparatus according to claim 1, wherein the detection unit detects a region including a cursor in a video related to the video data as a region of interest. It further has an imaging means for imaging the display screen of the display device and generating imaging data,
The detection unit detects a point position by a laser pointer on the display screen of the display device from the imaging data generated by the imaging unit, and detects a region including the point position as a region of interest. The video display device according to claim 1. An image capturing unit that captures an image viewer of the video displayed on the display device;
The detection means detects a point of interest on a display screen of the display device from a viewer's line of sight captured by the imaging means, and detects a region including the point of interest as a region of interest. 3. The video display device according to 1 or 2. Input means for inputting video data;
Generating means for generating graphics for displaying superimposed on the video related to the video data;
Detecting means for detecting a viewer's attention area from the video data;
Display control means for displaying a video related to the video data on a display device so that the graphics generated by the generation means overlap,
The video display device, wherein the generation unit changes the size or α value of the graphics in accordance with the position of the attention area detected by the detection unit. A generation step of generating graphics for displaying superimposed on the video related to the input video data;
A detection step of detecting a viewer's attention area from the video data;
A determination step of determining a display position of graphics generated in the generation step;
A display control step of displaying a video related to the video data on a display device so that the graphics overlaps the display position determined in the determination step,
In the determining step, the display position of the graphics is determined so as to provide at least a predetermined distance from the attention area detected in the detecting step. A generation step of generating graphics for displaying superimposed on the video related to the input video data;
A detection step of detecting a viewer's attention area from the video data;
A display control step of displaying a video related to the video data on a display device so that the graphics generated in the generation step overlap,
In the generating step, the graphics size or the α value is changed in accordance with the position of the attention area detected in the detecting step. A generation step of generating graphics for displaying superimposed on the video related to the input video data;
A detection step of detecting a viewer's attention area from the video data;
A determination step of determining a display position of graphics generated in the generation step;
Causing a computer to execute a display control step of displaying a video related to the video data on a display device so that the graphics overlaps the display position determined in the determination step;
In the determining step, the display position of the graphics is determined so as to provide at least a predetermined distance from the attention area detected in the detecting step. A generation step of generating graphics for displaying superimposed on the video related to the input video data;
A detection step of detecting a viewer's attention area from the video data;
Causing the computer to execute a display control step of displaying a video related to the video data on a display device so that the graphics generated in the generation step overlap.
In the generation step, the graphics size or α value is changed in accordance with the position of the attention area detected in the detection step.

Images