JP2013061988A - Display control device, display control method and display control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To alleviate an operator's load and intuitively execute a variety of operations.SOLUTION: A video imaging camera 10 detects a facial area from an imaged screen on the basis of a video of an imaged viewer and extracts feature points of the imaged person from a part of the facial area to determine which imaged person is the main viewer out of a plurality of the imaged persons on the basis of the feature points and face recognition data. The video imaging camera 10 detects the positions of the eyes of the main viewer and controls the image of an object displayed on a screen depending on a change in positions of the face or eyes.

Description

The present invention relates to an image control apparatus, an image control program, and an image control method for controlling an image of an object displayed on a screen in accordance with a change in the position of a viewer's face or eyes.

Conventionally, a mouse or a keyboard is generally used when performing an input operation of a computer. On the other hand, in recent years, the development of a technology that detects information related to the operation of the operator as a computer input operation without using a mouse or keyboard and controls the video display screen according to the intuitive movement of the operator. Has been done.

For example, as a technique for controlling such a video display screen, a technique for controlling the video display screen according to a change in the position of the line of sight of the operator is known. Specifically, a process of scrolling the screen is performed when the line-of-sight position of the operator is detected and the movement speed of the line-of-sight position exceeds a predetermined speed (see Patent Document 1).

JP-A-8-22385

By the way, in the technique for controlling the video display screen corresponding to the line of sight of the operator described above, the screen is scrolled based on the movement direction of the line of sight, so only a planar operation can be performed.
A three-dimensional operation that rotates the image of the object displayed on the screen is not possible. As a result, there is a problem that various operations cannot be performed.

Further, in the technology for controlling the video display screen corresponding to the line of sight of the operator described above, since the operator moves the line by adjusting the speed and direction of the line of sight, the burden on the eye is large and the burden on the operator is large. There was also a problem of being big.

Therefore, the present invention has been made to solve the above-described problems of the prior art,
The object is to realize various operations intuitively while reducing the burden on the operator.

In order to solve the above-described problems and achieve the object, this apparatus detects the position of the viewer's face or eyes, and displays the image of the object displayed on the screen according to the change in the position of the face or eyes. Control.

The disclosed apparatus has an effect that various operations can be intuitively performed while reducing the burden on the operator.

1 is a block diagram illustrating a configuration of a screen control apparatus according to a first embodiment. It is a figure for demonstrating a viewer's face recognition process. It is a block diagram for demonstrating the process which recognizes a main viewer. It is a figure for demonstrating TV screen control processing. It is a figure which shows the example of a change of TV screen. It is a figure which shows the example of a change of TV screen. It is a figure which shows the example of a change of TV screen. It is a figure which shows the example of a change of TV screen. It is a figure which shows the example of a change of TV screen. It is a figure which shows the example of a change of TV screen. 6 is a flowchart for explaining an overall processing procedure of the screen control apparatus according to the first embodiment. 7 is a flowchart for explaining a procedure of main viewer detection processing of the screen control apparatus according to the first embodiment. 6 is a flowchart for explaining a procedure of TV screen control processing of the screen control apparatus according to the first embodiment. It is a figure which shows the computer which performs a screen control program.

Exemplary embodiments of an image control apparatus, an image control program, and an image control method according to the present invention will be described below in detail with reference to the accompanying drawings.

In the following embodiments, the configuration and processing flow of the screen control apparatus according to the first embodiment will be described in order, and finally the effects of the first embodiment will be described. In the following, a case will be described in which the scrolling of the screen and the rotation of the object are controlled based on the position of the user's eyes and the positional relationship between both eyes.

[Configuration of screen controller]
First, the configuration of the screen control device 1 will be described with reference to FIG. FIG. 1 is a block diagram illustrating the configuration of the image control apparatus 1 according to the first embodiment. As shown in the figure, the image control apparatus 1 includes a video camera 10, an information processing unit 20, and a video display unit 30, and each unit is connected via a bus or the like.

In the screen control device 1, the video camera 10 having the egg-shaped EGG lens 11 is used to shoot, and the captured video is processed by the information processing unit 20 to create an all-around panoramic video. Display on the display. The processing of each of these units will be described below.

The video camera 10 captures the viewer's video and the video viewed by the viewer on the video display device 3 and transmits the captured video data to the information processing unit 20.
It has a CCD 12, an analog signal processing unit 13, an A / D conversion unit 14, a built-in memory 15, an AF control unit 16, and a camera driving unit 17.

The EGG lens 11 is an egg-shaped lens for photographing the entire collection in a donut shape. The image sensor 12 photoelectrically converts a subject image obtained by the photographing optical system to generate an image signal, and outputs the image signal to the analog signal processing unit 13. Here, the coordinates of the image signal will be described. Coordinates (0, 0, 0)
Indicates that the coordinates are on the upper left edge of the screen, and coordinates (x, y, 0) indicate that the coordinates are on the lower right edge of the screen.

The analog signal processing unit 13 performs various processes including sensitivity correction and white balance on the image signal output from the image sensor 12 and inputs the processed signal to the A / D conversion unit 14. A / D converter 1
4 digitally converts the image signal output from the analog signal processing unit 13 into a digital signal, and inputs the digital signal to the built-in memory 15 as a panoramic video image.

The built-in memory 15 stores the video shooting all-around panoramic video output from the analog signal processing unit 13. The AF control unit 16 controls processing and operation of each unit related to focus adjustment.
The camera driving unit 17 drives the EGG lens 11 and controls it so that the entire collection can be taken.

The information processing unit 20 stores the video captured by the video camera 10 and controls the screen displayed on the video display device 30 by detecting the viewer's face and eyes. Part 22.

The storage unit 22 stores data and programs necessary for various processes performed by the control unit 21, and particularly includes a face registration memory 22a and a TV screen memory 22b.

The face registration memory 22a includes face recognition data generated based on the feature points of a person's face,
The index image data for indicating the registered person corresponding to the face recognition data is recorded in association with each other. Specifically, the face registration memory 22a is a unique face (set of eigenvectors A) that is viewer face recognition data necessary for calculation of a face feature vector (expansion coefficient Ω) of an unknown input image,
The average face (average value vector x) and a set of face feature vectors {Ω _k } necessary for calculating the Euclidean distance are stored.

Here, eigenfaces (set of eigenvectors A), average faces (stored in the face registration memory 22a)
Mean value vector x) and a set of face feature vectors {Ω for calculating the Euclidean distance
_k } will be described. First, viewer face recognition data (from the video camera 10)
Viewer n ₁ Review k th viewer's face recognition data, the following concentration values referred to as "face recognition data") is expressed by dimensional array f (i, j), a material obtained by one-dimensional this and x _1. When the size of the face recognition data is m ₁ × m ₁ pixel, the following equation (1) is obtained.

Then, n ₁ face recognition data (its density value vector) is represented by x _k as shown in the following equation (2). “M ₁ = m ₁ × m ₁ ” indicates the total number of pixels, “K” indicates the index image data of the face recognition data, and “l” indicates that the images of the dimension array are arranged in one column from the upper left. Indicates the pixel number.

A matrix X of the entire _xk as shown in (3) below is called a face density value matrix. Further, a variance covariance matrix S is obtained from the face density value matrix X, and an eigenvalue λi, an eigenvector a _i (i = 1, 2,.
.., L) is calculated. The matrix A composed of eigenvectors is an orthonormal basis transformation matrix as shown in the following equation (4).

The eigenvector for the face image is particularly called an eigenface. Each face recognition data x _k and unique face a _i
As shown in the following equation (5), the expansion coefficient is obtained from the inner product of. The average value vector x is called an average face. Since each face recognition data can be restored by using the expansion coefficient and the unique face, the expansion coefficient vector Ω _k as shown in the following equation (6) is called a face feature vector.

Returning to the description of FIG. 1, the TV screen memory 22 b stores video panoramic video shot by the video camera 10. Specifically, the TV screen memory 22b has T
Eigen TV screen (eigen vector set B), which is the awareness TV screen data necessary for calculating the V screen feature vector (expansion coefficient Ω _k ), the average TV screen (average vector y), and the TV required for calculating the Euclidean distance A set of screen feature vectors {Ω _k } is stored.

Here, regarding the eigen TV screen (eigen vector set B), the average TV screen (average value vector y), and the TV screen feature vector set {Ω _k } necessary for calculating the Euclidean distance stored in the face registration memory 22a. explain.

First, awareness TV screen data (hereinafter referred to as “TV”) previously captured from the video camera 1.
Screen Data "and referred) density value is expressed with dimensional array g (i, j), a material obtained by one-dimensional so that the y _l. Assuming that the size of the TV screen data is m ₂ × m ₂ pixels,
It becomes the same as the formula (1).

n When the _two TV screen data (density value vectors thereof) are represented by y _k , the following equation (7) is obtained. However, M ₂ = m ₂ × m ₂ is the total number of pixels. K indicates the index image data of the TV screen data, and l indicates the pixel number when the images of the dimension array are arranged in one column from the upper left.

Further, the matrix Y of the entire y _k as shown in the following equation (8) is called a TV screen density value matrix. TV
A variance-covariance matrix s is obtained from the screen density value matrix Y, and an eigenvalue λi, an eigenvector b _i (i = 1).
, 2, ..., L). The matrix B composed of eigenvectors is given by (9)
The transformation matrix is an orthonormal basis as shown in the equation.

Further, the eigenvector for the TV screen image is particularly called an eigenTV screen. The expansion coefficient is obtained from the inner product of each TV screen recognition data y _k and the specific TV screen b _i as shown in the following equation (10).

The average value vector y is called an average TV screen. This T and the specific TV screen
Since the V screen recognition data can be restored, the expansion coefficient vector Ω as shown in the following equation (11)
_k is referred to as a TV screen feature vector.

Also, to create using the following (12) the TV screen feature vector Ω from the inner product of the specific TV screen and the b _i so can be restored seek one-dimensional density value vector y also against unknown input image. However, from the following equation (13), this average value vector y is an average TV screen obtained from TV screen face recognition data.

Returning to the description of FIG. 1, the control unit 21 has a program defining various processing procedures and an internal memory for storing necessary data, and executes various processes using these programs. Unit 21a, face recognition unit 21b, eye position detection unit 21c, TV image control unit 21d
Have

The face detection unit 21a is based on the viewer's video shot by the video camera 10.
A face area of the shooting screen is detected, a feature point of the face of the photographed person is extracted from the face area portion, and notified to the face recognition unit 21b.

The face recognition unit 21b determines which of the plurality of photographers is the main viewer based on the feature points and face recognition data extracted by the face detection unit. Here, as shown in FIG. 2, the main viewer is a person who is closest to the video display unit 30, and is a face or its face area that can be recognized as having the most overlapping body as viewed from the video display device 30. The viewer with the largest portion is recognized as the main viewer. Then, the face recognition unit 21b notifies the recognized main viewer to the eye position detection unit 21c.

Here, the face recognition processing will be specifically described with reference to FIG. As shown in the figure, the face recognition unit 21b performs a one-dimensional density for a viewer image (an unknown input image in FIG. 3) captured by the video camera 10 as a face recognition process. Compute the value vector x,
A face feature vector “Ω” is created from the inner product of the eigenface and a _i as shown in the following equation (14). However, from the following equation (15), this average value vector x is an average face obtained from each face recognition data.

Face recognition unit 21b, as an evaluation formula of the face matching, using the Euclidean distance, using the following equation (16), the distance d _e is the index of the-face feature vectors Omega _k (face recognizing data when the smallest Image data k) is identified and recognized as the main viewer.

The eye position detection unit 21c detects the position of the viewer's face or eyes. Specifically, the eye position detection unit 23 detects the position of the main viewer's eyes and also detects the presence or absence of the main viewer's gaze eye contact. That is, it is confirmed whether or not the main viewer is staring at the video image display screen.

As a result, when it is determined that there is a gaze eye contact of the main viewer, the eye position detection unit 21c detects the position of the main viewer's eyes at each set detection interval, and the position of the main viewer's eyes It is determined whether or not has moved. If it is not necessary to strictly check whether or not the main viewer is looking at the video image display screen, it is not necessary to determine whether or not there is a gaze eye contact.

As a result, the eye position detection unit 21c, when the position of the face or eyes of the main viewer moves,
The movement difference is notified to the TV image control unit 21d. Note that the movement of the face or eye position in this case refers to the movement of the face or eye position in the video data captured by the video camera 10, unlike the movement of the line-of-sight position as in Patent Document 1. . For example, in the case where the position of the face or eyes in the image is represented by coordinates, it means the change of the coordinates for each of the set detection intervals.

The TV image control unit 21d controls the image of the object displayed on the screen according to a change in the position of the face or eyes. Specifically, when the TV image control unit 21d receives the movement difference from the eye position detection unit 21c, the TV image control unit 21d controls the image of the object displayed on the screen according to the received movement difference.

Here, the TV screen control process will be specifically described with reference to the example of FIG. As shown in the figure, when the main viewer at the position (1) approaches the position (2) to look closely at the upper left part (3) of the video display screen 31, as shown in FIG. Control is performed so that the part that the user wants to see closely to the upper right part (4) of the video display screen 31 approaches and enlarges.

In addition, the TV image control unit 21d determines the position of the main viewer's eyes (1) from the position (1) of the eyes of the main viewer.
The movement differential to 2) when the Euclidean distance d _e, the movement difference from the video display screen 31 to the video display screen 31 is a Cd e _(constant C times the Euclidean distance d _e). In addition,
The constant C is determined by the size (number of inches) of the TV screen.

That is, the TV image control unit 21d, the movement of the TV screen constant C of the Euclidean distance d _e to reflect the moving difference eye of the viewer is used. The constant C is set by the user at the initial setting of the video display unit 30 according to the screen size of the video display screen 31 of the video display unit 30. Accordingly, the movement of the TV screen can be determined using the following (17).

Here, an example will be described in which the image of the object displayed on the screen changes in accordance with the change in the position of the viewer's eyes. As illustrated in FIG. 5, when the viewer rotates his / her face sideways, the image of the target object (a car in the example of FIG. 5) is rotated in the horizontal direction.

In addition, as illustrated in FIG. 6, when the viewer moves the face horizontally, the image control apparatus 10 detects the position of the viewer's eyes, and the image of the target object displayed on the screen is scrolled horizontally. To do. Also, as illustrated in FIG. 7, when the viewer brings his face close to the screen, the image of the object displayed on the screen is increased.

Further, as illustrated in FIG. 8, when the viewer moves his / her face up, the viewer rotates so that the image on the upper part of the object displayed on the screen can be seen. Further, as illustrated in FIG. 9, when the viewer moves his face down, the viewer rotates so that an image below the object displayed on the screen can be seen.

Further, as illustrated in FIG. 10, when the viewer tilts his / her face, the viewer rotates so that the image on the back side of the object displayed on the screen can be seen. In other words, the object on the screen is manipulated in three dimensions by controlling the image of the object displayed on the screen to move or rotate in conjunction with the movement of the viewer's face and eye position. it can.

The video display unit 30 displays the video stored in the TV screen memory 22 b of the information processing unit 20, and in particular has a video display screen 31 and an awareness TV stand 32. The video display screen 31 is controlled by the TV screen control unit 21d described above, and the TV screen memory 2 of the information processing unit 20 is controlled.
A part of the captured image of the panoramic image of the entire video recording stored in 2b is displayed.

The input / output I / F 40 is an input / output interface for inputting / outputting data.
It is an interface that accepts a wearness TV function detection instruction, which is an instruction to start screen control processing, and a detection interval setting for detecting the eye position from the viewer. Input / output I / F40
According to the detection interval set by (for example, 1 second), the eye position detection unit 21c described above detects the position of the eyes of the main viewer.

[Processing by image control processing]
Next, processing performed by the image control apparatus 10 according to the first embodiment will be described with reference to FIGS. FIG. 11 is a flowchart for explaining the entire processing procedure of the screen control apparatus according to the first embodiment. FIG. 12 is a flowchart for explaining the procedure of the main viewer detection process of the screen control apparatus according to the first embodiment. FIG. 13 is a flowchart for explaining the procedure of the TV screen control process of the screen control apparatus according to the first embodiment.

As shown in the figure, when the power is input (Yes at Step S101), the image control apparatus 10 displays the captured image stored in the TV screen memory 22b on the video display screen 31 (Step S102). When the image control apparatus 10 receives an instruction to detect the awareness TV function (Yes in step S103), the main viewer detection process for detecting the main viewer from a plurality of viewers (detailed later using FIG. 12). Is performed (step S104).

Then, the image control apparatus 10 detects the position of the main viewer's eyes (step S105), and determines whether or not the position of the main viewer's eyes has moved (step S106). As a result, when the position of the eyes of the main viewer moves (Yes at Step S106), the image control apparatus 10
If there is an instruction to change the screen, a screen control process (described later in detail with reference to FIG. 13) is performed, and the TV is
Processing for changing the screen is performed (step S107).

Next, the main viewer detection process of the image control apparatus 10 will be described with reference to FIG. As shown in the figure, the image control apparatus 10 detects the front face of the video camera 10 (step S).
201), it is determined whether or not a face is detected (step S202).

As a result, when detecting a face (Yes at Step S202), the image control apparatus 10 detects the person closest to the video display unit 30 as the main viewer, detects the position of the main viewing eye, and performs gaze eye contact. The presence or absence of (gaze eye contact) is detected (step S2
03) The presence / absence of the gaze eye contact of the main viewer is determined (step S204). That is, it is confirmed whether or not the main viewer is staring at the video image display screen.

As a result, if the image control apparatus 10 determines that there is a gaze eye contact of the main viewer (Yes in step S204), the image control apparatus 10 controls the image of the target portion displayed on the screen according to the change in the eye position. Is started (step S205).

Next, TV screen control processing of the image control apparatus 10 will be described with reference to FIG. As shown in the figure, the image control device 10 detects the movement difference of the eyes of the main viewer (step S30).
1) If there is a movement difference (Yes at Step S302), a process for calculating a TV screen movement difference is performed (Step S303), and it is determined whether the calculated TV screen movement difference is 0 or more (Step S304). .

When the TV screen movement difference is 0 or more, the image control apparatus 10 (step S
304 affirmation), the image of the target object displayed on the screen is controlled according to the TV screen movement difference (
Step S305).

[Effect of Example 1]
As described above, the image control apparatus 10 determines the position of the viewer's face or eyes, and controls the image of the object displayed on the screen in accordance with the change in the position of the face or eyes. For this reason, the object on the screen is three-dimensionally controlled by moving or rotating the image of the object displayed on the screen in conjunction with the movement of the position of the viewer's face and eyes. As a result of the operation, various operations can be performed intuitively while reducing the burden on the operator.

Further, according to the first embodiment, the setting of the detection interval for detecting the position of the face or eyes is accepted, and the position of the viewer's face or eyes is detected at the set detection interval. It is possible to adjust.

Although the embodiments of the present invention have been described so far, the present invention may be implemented in various different forms other than the embodiments described above. Therefore, another embodiment included in the present invention will be described below as a second embodiment.

(1) Image Control In this embodiment, image control may be performed using the position of the viewer's line of sight. Specifically, the image control apparatus detects the position of the viewer's line of sight and determines whether the detected line of sight is within the screen. As a result, when the position of the detected line of sight is within the screen, the image control apparatus controls the image according to a change in the position of the face or eyes.

On the other hand, when the position of the detected line of sight is not within the screen, the image control apparatus stops the image control according to the change in the position of the face or eyes. That is, when the line of sight is not in the screen, the image control device assumes that the viewer has moved the face and eyes without intending to operate the screen.
Does not control the image.

In this way, the position of the viewer's line of sight is detected, and if the detected line of sight is within the screen, the image is controlled according to the detected change in the face or eye position, and When the detected line-of-sight position is not in the screen, the control of the image is stopped, so that malfunction can be prevented.

(2) System Configuration The components of the illustrated devices are functionally conceptual and need not be physically configured as illustrated. In other words, the specific form of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. For example, the face detection unit 21a and the face recognition unit 21b may be integrated. Further, all or any part of each processing function performed in each device may be realized by a CPU and a program analyzed and executed by the CPU, or may be realized as hardware by wired logic.

In addition, among the processes described in this embodiment, all or part of the processes described as being performed automatically can be performed manually, or the processes described as being performed manually can be performed. All or a part can be automatically performed by a known method. In addition, the processing procedure, control procedure, specific name, and information including various data and parameters shown in the above-described document and drawings can be arbitrarily changed unless otherwise specified.

(3) Program By the way, the various processes described in the above embodiments can be realized by executing a screen control program prepared in advance by a computer. In the following, an example of a computer that executes a program having the same function as that of the above-described embodiment will be described with reference to FIG. FIG. 14 is a diagram illustrating a computer that executes a screen control program.

As shown in the figure, a computer 600 as a screen control device includes an HDD 610, an RA
M620, ROM630, and CPU640 are connected via a bus 650, respectively.

The ROM 630 stores a screen control program that exhibits the same function as that of the above-described embodiment, that is, as shown in FIG. 14, a face detection program 631, a face recognition program 632, an eye position detection program 633, and a TV screen control program. 634 is stored in advance. Note that the programs 631 to 634 may be appropriately integrated or distributed in the same manner as each component of the screen control apparatus shown in FIG.

Then, the CPU 640 reads out these programs 631 to 634 from the ROM 630 and executes them, so that each program 631 to 634 has a face detection process 641, a face recognition process 642, and an eye position detection process 643 as shown in FIG. Then, it functions as the TV screen control process 644. Each process 641 to 644 corresponds to the face detection unit 21a, the face recognition unit 21b, the eye position detection unit 21c, and the TV image control unit 21d shown in FIG.

Further, as shown in FIG. 14, the HDD 610 is provided with a face registration table 611 and a TV screen table 612. The face registration table 611 and the TV screen table 612 correspond to the face registration memory 22a and the TV screen memory 22b shown in FIG. And CPU
640 registers data in the face registration table 611 and the TV screen table 612, as well as the face registration data 621 and TV from the face registration table 611 and the TV screen table 612.
The screen data 622 is read out and stored in the RAM 620, and processing is executed based on the face registration data 621 and the TV screen data 622 stored in the RAM 620.

  Regarding the embodiment including the above-described Examples 1 and 2, the following additional notes are further disclosed.

(Supplementary note 1) a position detection unit for detecting the position of the viewer's face or eyes;
An image control unit that controls an image of an object displayed on a screen in accordance with a change in the position of the face or eye detected by the position detection unit;
An image control apparatus comprising:

(Additional remark 2) It further has a detection interval setting reception part which receives the setting of the detection interval which detects the position of the face or eyes by the position detection part,
The image control apparatus according to appendix 1, wherein the position detection unit detects the position of the viewer's face or eye at the detection interval set by the detection interval setting reception unit.

(Additional remark 3) It further has a gaze detection part which detects a position of a gaze of the viewer,
When the position of the line of sight detected by the line-of-sight detection unit is within the screen, the image control unit is configured to change the image according to a change in the position of the face or eye detected by the position detection unit. And the control of the image is stopped when the position of the line of sight detected by the line-of-sight detection unit is not in the screen. .

(Appendix 4) A position detection procedure for detecting the position of the face or eye of the viewer;
An image control procedure for controlling an image of an object displayed on a screen in accordance with a change in the position of the face or eye detected by the position detection procedure;
An image control program for causing a computer to execute.

(Additional remark 5) Let a computer further perform the detection interval setting reception procedure which receives the setting of the detection interval which detects the position of the face or eyes by the position detection procedure,
The position detection procedure is the detection interval set by the detection interval setting reception procedure,
The image control program according to appendix 4, wherein the position of the viewer's face or eyes is detected.

(Supplementary Note 6) The computer further executes a gaze detection procedure for detecting the position of the gaze of the viewer,
In the case where the position of the line of sight detected by the line-of-sight detection procedure is within the screen, the image control procedure is configured to change the image according to a change in the position of the face or eye detected by the position detection procedure. And the control of the image is stopped when the position of the line of sight detected by the line-of-sight detection procedure is not in the screen. .

(Appendix 7) A position detection step for detecting the position of the face or eye of the viewer;
An image control step for controlling an image of an object displayed on a screen in accordance with a change in the position of the face or eye detected by the position detection step;
An image control method comprising:

(Additional remark 8) It further includes a detection interval setting reception step for receiving a setting of a detection interval for detecting the position of the face or eye by the position detection step,
The image control method according to appendix 7, wherein the position detecting step detects the position of the viewer's face or eyes at the detection interval set by the detection interval setting receiving step.

(Additional remark 9) Let a computer further perform the gaze detection step of detecting the position of the gaze of the viewer,
In the image control step, when the position of the line of sight detected by the line of sight detection step is within the screen, the image is controlled according to a change in the position of the face or eye detected by the position detection step. And the control of the image is stopped when the position of the line of sight detected by the line-of-sight detection step is not within the screen. .

DESCRIPTION OF SYMBOLS 1 Image control apparatus 10 Video camera 20 Information processing apparatus 21 Processing part 21a Face detection part 21b Face recognition part 21c Eye position detection part 21d TV screen control part 22 Storage part 22a Face registration memory 22b TV screen memory 30 Video display part 40 On Output I / F

Exemplary embodiments of a display control device, a display control method, and a display control program according to the present invention will be explained below in detail with reference to the accompanying drawings.

(Additional remark 9) Let a computer further perform the gaze detection step of detecting the position of the gaze of the viewer,
In the image control step, when the position of the line of sight detected by the line of sight detection step is within the screen, the image is controlled according to a change in the position of the face or eye detected by the position detection step. controls, also when the position of the gaze detected by the gaze detecting step is not in the screen, the image control method according to note 7 or 8, characterized in that stops the control of the image .

Claims (5)

A position detection unit that detects the position of the viewer's face or eyes and detects any change in rotation, translation, or tilt of the detected position;
An image controller that changes the rotation, translation, or tilt of the image of the object displayed on the screen in accordance with the change in the position of the face or eye detected by the position detector;
An image control apparatus comprising: A detection interval setting receiving unit that receives a setting of a detection interval for detecting the position of the face or eye by the position detection unit;
The image control apparatus according to claim 1, wherein the position detection unit detects the position of the viewer's face or eye at the detection interval set by the detection interval setting reception unit. A line-of-sight detection unit that detects a position of the line of sight of the viewer;
When the line-of-sight position detected by the line-of-sight detection unit is within the screen, the image control unit rotates the image according to a change in the position of the face or eye detected by the position detection unit. The change of the image is stopped when the position of the line of sight detected by the line-of-sight detection unit is not within the screen. The image control apparatus according to 2. A position detection procedure for detecting the position of the viewer's face or eyes and detecting any change in rotation, translation, or tilt of the detected position;
An image control procedure for changing the rotation, translation, or tilt of the image of the object displayed on the screen in accordance with the change in the position of the face or eye detected by the position detection procedure;
An image control program for causing a computer to execute. A position detection step for detecting the position of the viewer's face or eyes and detecting any change in rotation, translation, or tilt of the detected position;
An image control step for changing the rotation, translation, or tilt of the image of the object displayed on the screen in accordance with the change in the position of the face or eye detected by the position detection step;
An image control method comprising:

Images