KR20130035862A - Calibration method and video display apparatus - Google Patents

Abstract

PURPOSE: A calibration method and an image displaying device are provided to easily implement the calibration of a camera fixed to a television device by calculating a first relative position between the camera and a first display. CONSTITUTION: A first display(3) and a second display(5) are arranged to face each other. A predetermined first display image is indicated on the first display. The first display image is reflected by the surface of the second display. A camera(4) photographs the first display image reflected by the second display for obtaining a first camera image. The first relative position relation between the camera and the first display is calculated. The first camera image is corrected based on the first relative position relation. [Reference numerals] (AA) Display; (BB) Display image on a second display; (CC) Display image on a first display; (DD) Camera image;

Description

Calibration method and video display device {CALIBRATION METHOD AND VIDEO DISPLAY APPARATUS}

Embodiments of the present invention generally relate to a calibration method and a video display device.

This application claims the benefit of priority based on Japanese Patent Application No. 2011-217601 for which it applied on September 30, 2011, and the whole content of Japanese Patent Application No. 2011-217601 is incorporated in this specification as a reference.

Recently, in a digital television apparatus, a type of digital television apparatus is known in which a camera is embedded to photograph a viewer with a built-in camera, and the photographed image is displayed on the display of the apparatus. In the television device, since the camera is fixed, unlike the external camera, the position, optical axis, etc. of the built-in camera cannot be finely adjusted.

In order to display a camera image photographed with a camera on a display, a technique of conventionally correcting a display position, a rotation angle, and other image distortion of a camera image by image processing, and displaying the corrected image on a display Known.

However, in the related art, a calibration method for correcting a camera image captured by a camera fixedly provided to a television device is still under development. There is a need for a calibration method that can be easily performed.

The problem to be solved by the present invention is to provide a calibration method and an image display device which can easily perform calibration of a camera fixed to a television device.

In general, according to one embodiment, a calibration method for calibrating a first camera image obtained by the camera of an image display device including a camera and a first display, wherein the calibration method comprises the first display and the second display. Arranging oppositely; A first display step of displaying a first predetermined display image on the first display; Reflecting the predetermined first display image on the first display by the surface of the second display; Imaging with the camera the first predetermined display image reflected by the second display to obtain the first camera image; Calculating a first relative positional relationship between the camera and the first display from a first positional shift of the first display image in the first camera image; Correcting the first camera image based on the first relative positional relationship.

A general architecture for implementing the various features of the invention will be described with reference to the drawings. The drawings and the associated description illustrate embodiments of the invention but do not limit the scope thereof.
1 is an exemplary diagram for schematically illustrating a calibration method according to an embodiment.
FIG. 2 is a diagram showing an appearance from an exemplary viewpoint showing an example of a television apparatus in the present embodiment.
3 is an exemplary block diagram showing a signal processing system of a television device in this embodiment.
4 is an exemplary diagram for explaining an example of positional shift between a camera image photographed with a camera and a display image displayed on a display in this embodiment.
5 is an exemplary block diagram showing a software configuration that a television device has in this embodiment.
6 is an exemplary flowchart showing a procedure of a correction value calculation process performed by the television apparatus in this embodiment.
FIG. 7 is an exemplary operation explanatory diagram in the case where the display image on the first display is photographed by the camera by reflecting the display image on the first display by the surface of the second display in this embodiment.
8 is an exemplary operation explanatory diagram when the display image on the second display is picked up by the camera in this embodiment.
9 is an exemplary diagram for explaining a coordinate system in the present embodiment.
FIG. 10 is an exemplary plan view for schematically illustrating the positional relationship between the display image on the first display, the virtual image of the display image, the display image on the second display, and the camera in this embodiment.
11 is an exemplary flowchart showing a procedure of a correction process of a camera image performed by the television apparatus in this embodiment.

1 is an exemplary diagram for schematically explaining a calibration method according to the present embodiment. The calibration method according to the present embodiment is a method of correcting a camera image captured by the camera 4 in a video display device (television device 1) including a camera 4 and a first display 3. In general, the calibration method is a method of arranging the first display 3 and the second display 5 to face each other, and performing calibration using the second display 5. Next, the configuration of the television device 1 as the video display device according to the present embodiment will be described.

FIG. 2 is a diagram showing an appearance from an exemplary perspective showing an example of the television apparatus 1. As shown in FIG. 2, the television device 1 shows the external appearance of a rectangular shape in the front view (top view of the front surface) seen from the front. The television device 1 includes a housing 2 and a first display 3. The first display 3 is formed of, for example, an LCD (Liquid Crystal Display). The first display 3 receives a video signal from a video processor 17 (see FIG. 3), which will be described later, and displays a video such as a still picture and a moving picture. In addition, the camera 4 is installed in the housing 2. The camera 4 can be used, for example, to photograph the viewer of the television device 1. The housing 2 is supported by the support 6.

3 is an exemplary block diagram showing a signal processing system of the television device 1. As shown in FIG. 3, the television apparatus 1 supplies the digital television broadcast signal received by the antenna 12 to the tuner module 14 through the input terminal 13, thereby providing a broadcast signal of a desired channel. You can tune in. Tuner A 141 and tuner B 142 are tuners for receiving terrestrial digital broadcasting, and tuner C 143 is a tuner for receiving BS / CS digital broadcasting. Note that although the television device 1 has three tuners in Fig. 3, the number of tuners is not limited to three.

The tuner module 14 outputs the received broadcast signal to the demodulator / decoder 15. The demodulator / decoder 15 decodes the input broadcast signal into a digital video signal, a digital audio signal, or the like, and outputs the decoded broadcast signal to the input signal processor 16.

The input terminal 21 for directly inputting a digital video signal or a digital audio signal from the outside of the television device 1 is provided in the television device 1. The digital video signal and the digital audio signal input through the input terminal 21 are input to the recording / playback processor 29.

The operation module 24 is installed in the housing 2 and includes a switch for turning on / off a power supply, a switch for switching channels, and the like. The receiver 26 receives a signal from the remote control 25 and outputs the received signal to the controller 40. The controller 40 receives instructions such as reproduction, channel switching, reservation recording, and the like based on the operation by the user in the operation module 24 or the remote control 25.

The disk drive module 27 records and reproduces digital data on an optical disk 28 such as a digital versatile disk (DVD). The disk drive module 27 reads out the digital video signal and the digital audio signal from the optical disk 28 based on the instructions from the controller 40, and outputs them to the recording / playback processor 29. The disk drive module 27 also records the digital video signal and the digital audio signal input from the recording / playback processor 29 on the optical disk 28.

The HDD (Hard Disk Drive) 20 records and plays back a hard disk provided therein. The HDD 20 reads out the digital video signal and the digital audio signal from the hard disk based on the instructions from the controller 40 and outputs them to the recording / playback processor 29. The HDD 20 also records digital video signals and digital audio signals input from the recording / playback processor 29 to the hard disk.

The recording / playback processor 29 is a digital video signal and digital audio input from a demodulator / decoder 15, an input terminal 21, a disk drive module 27, an HDD 20, or a network interface (not shown). The signal is encrypted and converted into a predetermined recording format. Then, the recording / playback processor 29 outputs the converted signal to the disk drive module 27 or the HDD 20. In addition, the recording / reproducing processor 29 restores the digital video signal and the digital audio signal read out from the disk drive module 27 or the HDD 20 and outputs them to the input signal processor 16.

The input signal processor 16 performs predetermined digital signal processing on the digital video signal and the digital audio signal input from the demodulator / decoder 15 or the recording / reproducing processor 29. The input signal processor 16 outputs a digital video signal to the video processor 17, and outputs a digital audio signal to the audio processor 18.

The image processor 17 converts the digital image signal input from the input signal processor 16 or the controller 40 into an analog image signal in a format that can be displayed on the first display 3, and thus, the first display. Enter in (3). The first display 3 displays a viewing screen of the program, other video, and the like in accordance with the analog video signal output from the video processor 17. In addition, an output terminal 171 is provided in the television apparatus 1. The second display 5 may be connected to the output terminal 171. The image processor 17 inputs an analog video signal to the second display 5 connected via the output terminal 171, and the second display 5 displays an image according to the input analog video signal.

The voice processor 18 converts the digital voice signal input from the input signal processor 16 into an analog voice signal in a format that can be reproduced by the speaker 19 at a subsequent stage, and converts the digital voice signal into the speaker 19. Enter it. The speaker 19 reproduces sound based on the analog sound signal input from the sound processor 18.

The controller 40 is a tuner module 14, a recording / reproducing processor 29, an input signal processor 16, an operation module 24, a receiver 26, and a disk drive module 27 by a bus or an interface. And HDD 20, a network interface (not shown), and the like, to control the operation of each unit. Moreover, the controller 40 is based on the operation by the user in the operation module 24 or the remote control 25, Each unit connected to the controller 40 is controlled to perform processing of program viewing, channel switching, scheduled recording of a program, video content, and the like.

In addition, as shown in FIG. 3, the controller 40 includes a central processing unit (CPU) 40a, a read only memory (ROM) 40b for storing a control program executed by the CPU 40a; And a random access memory (RAM) 40c for providing a work area to the CPU 40a.

Here, the position shift between the camera image photographed by the camera 4 and the display image displayed on the first display 3 will be described. 4 is an exemplary diagram for explaining an example of positional shift between a camera image photographed with the camera 4 and a display image displayed on the first display 3. First, the center position of the camera image captured by the camera 4 corresponds to the center position of the lens of the camera 4. The center position of the display image displayed on the first display 3 corresponds to the center position of the first display 3. Therefore, their center positions are spaced apart from each other along the width of the first display 3. In addition, as shown in FIG. 4, the optical axis of the camera 4 is inclined so as to be close to the center position of the first display 3, so that the camera 4 is a viewer in front of the first display 3. You can shoot. Therefore, the normal vector 51 of the lens surface of the camera 4 faces a direction different from the normal vector 52 of the display surface. Therefore, when the camera image is displayed on the first display 3, the deviation of the position and the direction needs to be corrected according to the relative positional relationship between the camera image and the display image on the first display 3. In addition, when the camera 4 is installed in the television apparatus 1, an individual difference arises regarding the position of the camera 4 depending on a case. Therefore, in such a case, the installation position or installation direction of the camera 4 needs to be corrected for each television device 1.

5 is an exemplary block diagram showing a software configuration of the television device 1. The controller 40 (refer to FIG. 3), when the CPU 40a included in the controller 40 loads and executes a program stored in the ROM 40b into the RAM 40c, is shown in FIG. 5. The functions as the first display module 41, the second display module 42, the image taking module 43, the calculator 44, and the corrector 45 are realized. The correction value storage module 46 is also provided in the nonvolatile storage area of the controller 40. Next, the function of each unit will be described schematically.

The first display module 41 controls the first display 3 via the image processor 17 to display a calibration image on the first display 3. In addition, the first display module 41 controls the brightness of the first display 3. The second display module 42 controls the second display 5 via the image processor 17 to display a calibration image on the second display 5. In addition, the second display module 42 controls the brightness of the second display 5.

As a calibration image to be displayed by the first display module 41 or the second display module 42, a pattern image such as a checker board can be used. However, the kind, color, and size of the image are not particularly limited.

The image taking module 43 (imaging module) picks up a display image on the first display 3 reflected by the surface of the second display 5 with a camera 4, and stores the camera image in a memory such as RAM. Brings up. In addition, the image taking module 43 (second imaging module) picks up the display image displayed on the second display 5 with the camera 4, and loads the camera image into a memory such as a RAM.

The calculator 44 calculates the relative positional relationship between the camera 4 and the first display 3 based on the deviation of the position of the display image on the first display 3 in the camera image. In addition, the calculator 44 (second calculator) calculates the relative between the camera 4 and the second display 5 based on the shift of the position of the display image of the second display 5 in the camera image. Calculate the positional relationship. In addition, the calculator 44 is based on the relative positional relationship between the camera 4 and the first display 3 and the relative positional relationship between the camera 4 and the second display 5. ) And the relative positional relationship between the first display 3 and then store it in the correction value storage module 46 as a correction value. However, the relative positional relationship indicates relative shifts, shifts in relative directions, and the like.

The corrector 45 corrects the camera image with the correction values stored in the correction value storage module 46. The more detailed function of each part is mentioned later.

Next, the process of the calibration process of the camera image performed by the television apparatus 1 is demonstrated with reference to FIG. 5 and FIG. FIG. 6 is an exemplary flowchart showing a procedure of the correction value calculation process performed by the television device 1.

First, the first display 3 and the second display 5 are disposed to face each other (S1). However, the relative positional relationship between the first display 3 and the second display 5 is measured at S6-S8. Therefore, the first display 3 and the second display 5 may not be completely opposed at S1. That is, the relative positional relationship between the first display 3 and the second display 5 is that the first display, when the image image on the first display 3 is reflected by the surface of the second display 5. A mirror image of the image image on (3) can be picked up by the camera 4, and the display image on the second display 5 can be set to be picked up by the camera 4. However, when the first display 3 and the second display 5 are parallel to each other, or when the relative directions of the first display 3 and the second display 5 are already known, the order of S6 to S8 is omitted. can do.

Next, the first display module 41 displays the calibration pattern image (hereinafter, simply referred to as "correction pattern") on the first display 3 (S2).

FIG. 7 illustrates an exemplary operation when photographing a display image on the first display 3 with the camera 4 by reflecting the display image on the first display 3 by the surface of the second display 5. It is also. The second display module 42 reduces the brightness of the second display 5 so that the correction pattern displayed on the first display 3 is easily reflected by the second display 5 (S3).

In order to make the image reflected by the second display 5 more clear, the surface of the second display 5 is preferably formed of a member having high reflectance. As a suitable embodiment, the second display 5 preferably has a glare panel on its surface. In addition, as another suitable embodiment, the second display 5 in which the half mirror is provided on the surface may be used.

Next, the image taking module 43 captures the image (virtual image) of the correction pattern reflected by the surface of the second display 5 with the camera 4, and loads the camera image into the memory (S4). .

The calculator 44 then positions the relative position between the camera 4 and the first display 3 based on the positional shift of the correction pattern with respect to a predetermined position in the camera image (for example, the center position of the camera image). The relationship is calculated (S5).

Next, the second display module 42 displays the correction pattern on the second display 5 (S6).

8 is an exemplary operation explanatory diagram in the case where the display image on the second display 5 is captured by the camera 4. The first display module 41 reduces the brightness of the first display 3. Thus, the display image on the first display 3 is prevented from being reflected on the second display 5. Therefore, image analysis of the correction pattern displayed on the second display 5 can be facilitated.

Then, the image acquisition module 43 picks up the correction pattern displayed on the second display 5 with the camera 4, and loads the camera image onto the memory (S7).

The calculator 44 calculates a relative positional relationship between the camera 4 and the second display 5 based on the positional shift of the correction pattern with respect to the predetermined position in the camera image (S8).

And the calculator 44 calculates the relative positional relationship between the camera 4 and the 1st display 3 based on the relative positional relationship computed by S5 and S8 (S9). An example of the calculation process performed at S5, S8, and S9 will be described in more detail with reference to FIGS. 9 and 10.

First, the coordinate system will be described with reference to FIG. 9. 9 is an exemplary diagram for explaining a coordinate system. As shown in FIG. 9, the axis passing through the center C of the first display 3 and extending in the width direction of the first display 3 is the X axis, and is in the height direction of the first display 3. The extending axis is the Y axis, and the axis extending in the depth direction and perpendicular to the surface of the first display 3 is the Z axis. In addition, the rotation angles with respect to the X, Y, and Z axes are θx, θy, and θz, respectively.

Next, with reference to FIG. 10, the shift | offset | difference of an X-axis direction is demonstrated, for example. 10 shows a display image 301 on the first display 3, a virtual image 302 of the display image 301, a display image 501 (correction pattern) on the second display 5, and a camera 4. It is an exemplary top view for demonstrating schematically the positional relationship between them. In S4, the image taking module 43 picks up the virtual image 302 of the display image 301 projected onto the surface of the second display 5 with the camera 4.

In S5, the calculator 44 detects a misalignment between the center point 302c of the virtual image 302 and the center point of the camera image, whereby the X axis between the center point 302c and the lens center position of the camera 4 is detected. The deviation dx1 of the direction is calculated. Similarly, the calculator 44 calculates shifts dy1 and dz1 in the Y-axis direction and the Z-axis direction between the center point 302c and the lens center position of the camera 4, respectively. The calculator 44 also calculates rotation angles (twisted angles) between the virtual image 302 and the optical axis of the camera 4, and calculates rotation angles θx1, θy1, and θz1 with respect to each axis.

In addition, in S7, the image taking module 43 picks up the display image 501 displayed on the second display 5 with the camera 4. In S8, the calculator 44 detects a deviation between the center point 501c of the display image 501 and the center point of the camera image, thereby providing an X-axis direction between the center point 501c and the lens center position of the camera 4. The deviation dx2 of is calculated. Similarly, the calculator 44 calculates shifts dy2 and dz2 in the Y-axis direction and the Z-axis direction, respectively, between the center point 501c and the lens center position of the camera 4. The calculator 44 also calculates rotation angles (twisted angles) between the display image 501 and the optical axis of the camera 4, and calculates rotation angles θx2, θy2, and θZ2 for each axis.

Then, the calculator 44 calculates the relative positional relationships dx1, dy1, dz1, θx1, θy1, and θz1 calculated at S5, and the relative positional relationships dx2, dy2, dz2, θx2, θy2, and θz2 calculated at S8. Based on this, the relative positional relationship between the camera 4 and the first display 3 is calculated (S9).

Here, the translation amounts in the X, Y, and Z-axis directions between the lens center position of the camera 4 and the center position of the first display 3 are Δdx, Δdy, and Δdz, respectively. And the rotation angle with respect to the Z axis are Δθx, Δθy, and Δθz, respectively. Based on the relationship between the incident angle and the reflection angle of the mirror, the relative positional relationship is expressed by the following equation. However, since Δdz cannot be calculated, it is assumed to be zero.

(1)

(One)

(2)

(2)

(3)

(3)

(4)

(4)

(5)

(5)

(6)

(6)

The calculator 44 corrects the relative positional relationship between the camera 4 and the first display 3 represented by the above formulas (1) to (6) as a correction value used for calibration of the camera image. It is stored in the storage module 46 (S10).

In the example described above with reference to FIGS. 9 and 10, the deviation between the center point (center point 302c, center point 501c) of the correction pattern and the camera image is detected. However, the present embodiment is not limited to this, and the deviation of other points on the correction pattern can also be detected. Alternatively, the amount of deviation may be calculated by detecting the positional shift between the correction pattern and the camera image with respect to the plurality of points.

Next, the procedure of the correction process of the camera image performed by the television apparatus 1 is demonstrated. 11 is an exemplary flowchart showing a procedure of a correction process of a camera image performed by the television device 1. As illustrated in FIG. 11, the corrector 45 performs calibration on a camera image captured by the camera 4 by using the correction value stored in the correction value storage module 46 (S11).

As described above, according to the present embodiment, the display image on the first display 3 reflected by the second display 5 is picked up by the camera 4 and based on the positional shift of the display image in the camera image. The relative positional relationship between the camera 4 and the first display 3 is calculated. Then, the camera image is corrected based on the relative positional relationship. Thus, the calibration of the camera 4 can be performed only if the device itself and the second display 5 are present. Therefore, an image display apparatus, an image display method, and a program which make it possible to easily perform the calibration of the camera 4 fixed to the television apparatus 1 can be provided.

Further, according to this embodiment, the display image displayed on the second display 5 is photographed by the camera 4, and the relative positional relationship between the camera 4 and the second display 5 is relative to the camera position. It calculates based on the position shift of a display image. The correction value is then calculated further using the relative positional relationship. Thus, it is not necessary to arrange the first display 3 and the second display 5 strictly parallel to each other. In addition, it is not necessary to know the relative positional relationship (relative arrangement, relative direction) between the first display 3 and the second display 5. Thereby, the calibration of the camera 4 can be performed more simply.

The size of the calibration image displayed on the first display 3 and the size of the calibration image displayed on the second display 5 may be the same or different. In addition, in the above description, the pattern of the checker board (checkered pattern) was used as the image for calibration. However, the image for calibration is not limited to this, and other images may be used. The calibration image displayed on the second display 5 may or may not be mirror-reversing the calibration image displayed on the first display 3. It is sufficient to calculate each relative positional relationship between the predetermined position in the image and the camera 4.

In the above description, it is assumed that the television device 1 includes the second display module 42. However, the present invention is not limited to this. Another video display device that controls the second display 5 may include a second display module 42, and a configuration in which the television device 1 and the other video display device are connected to each other to perform calibration may be applied.

The method of reducing the brightness | luminance of the 1st display 3 and the 2nd display 5 is not specifically limited. For example, by displaying a black image, a deep-colored image, or the like on each display, or by turning off the image output of each display, the brightness of each display can be reduced.

The program executed by the television device 1 according to the present embodiment is recorded in advance in a ROM or the like and provided. The program executed by the television apparatus 1 according to the present embodiment is in an installable or executable format, and is a computer such as a CD-ROM, a flexible disk (FD), a CD-R, or a digital versatile disk (DVD). It may be configured to be recorded and provided on a recording medium that can be read.

In addition, the program executed by the television device 1 according to the present embodiment may be configured to be stored in a computer connected to a network such as the Internet or provided by being downloaded through a network. Alternatively, the program executed by the television device 1 according to the present embodiment may be configured to be provided or distributed through a network such as the Internet.

In addition, this embodiment can be applied to the case where a camera is further provided to the television apparatus 1 which is not equipped with a camera later. That is, in the case where the camera is additionally installed, calibration of the camera image may be performed by performing the above-described correction value calculation process and using the calculated correction value.

In addition, the case where the camera 4 is fixed to the 1st display 3 was demonstrated. However, the location where the camera 4 is attached is not limited to this. The camera 4 may be attached to other points, such as the support part 6 of the television device 1, etc. As shown in FIG.

In addition, in the above description, the first display 3 and the second display 5 may be disposed to face each other, and a correction value calculation process may be performed. However, the arrangement relationship between the first display 3 and the second display 5 is not limited to this. As another example, an optical system such as a mirror is newly disposed between the first display 3 and the second display 5, and after the pattern image is diffracted by this optical system, the camera 4 photographs and calculates a correction value. The structure used for a process may be employ | adopted.

The case where the video display device according to the present embodiment is applied to the television device 1 has been described above. However, the present embodiment is not limited to this, but may be applied to information processing apparatuses such as PCs and various display apparatuses. In addition, the case where the television device 1 is a flat display type has been described above. However, the present embodiment may be applied to a television apparatus of a stereoscopic display type.

In addition, as an application example of the present embodiment, the position of the person or the position of the face detected in the camera image may be corrected using the correction value of the present embodiment.

In addition, an image display device including one camera 4 has been described as an example. However, the number of cameras is not limited to one. The video display device may include two cameras, such as a stereo camera, or may include the plurality of cameras and perform the above-described calibration for each camera.

In addition, various modules of the systems described herein may be implemented as one or more computer-based components, such as software applications, hardware and / or software modules, or servers. Although various modules have been described separately, they may share some or all of the same basic logic or code.

While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. The novel embodiments described herein may be embodied in various other forms, and various omissions, substitutions, and changes may be made without departing from the spirit of the inventions. The equivalents of the claims and claims are intended to cover these embodiments and modifications falling within the scope and spirit of the invention.

Claims (8)

A calibration method for correcting a first camera image obtained by the camera of an image display device including a camera and a first display,
Arranging the first display and the second display to face each other;
A first display step of displaying a first predetermined display image on the first display;
Reflecting the predetermined first display image on the first display by the surface of the second display;
Imaging with the camera the first predetermined display image reflected by the second display to obtain the first camera image;
Calculating a first relative positional relationship between the camera and the first display from a first positional shift of the first display image in the first camera image;
Correcting the first camera image based on the first relative positional relationship
Calibration method comprising a. The method of claim 1,
A second display step of displaying a second predetermined display image on the second display;
A second imaging step of capturing the predetermined second display image displayed on the second display with the camera to obtain a second camera image;
Calculating a second relative positional relationship between the camera and the second display from the second positional shift of the second display image in the second camera image
Further comprising:
The correcting may include correcting the first camera image based on the first relative positional relationship between the camera and the first display and the second relative positional relationship between the camera and the second display. And a calibration method. The method according to claim 1 or 2,
And the reflecting step includes reducing the brightness of the second display and then reflecting the predetermined first display image on the first display by the surface of the second display. The method according to claim 1 or 2,
And the surface of the second display comprises a glare panel. The method according to claim 1 or 2,
And the surface of the second display comprises a half mirror. As a video display device,
A camera configured to capture an image;
A first display configured to display an image;
A first display controller configured to control the first display to display a first predetermined display image;
A first imaging module configured to control the camera to capture the first predetermined display image reflected by a surface of a second display arranged opposite the first display to obtain a first camera image;
A calculator configured to calculate a first relative positional relationship between the camera and the first display from a first positional shift of the predetermined first display image in the first camera image;
A corrector configured to correct the first camera image based on the first relative positional relationship
Image display device comprising a. The method according to claim 6,
A second display controller configured to control the second display to display a second predetermined display image;
A second imaging module configured to control the camera to capture the second predetermined display image to obtain a second camera image;
A second calculator configured to calculate a second relative positional relationship between the camera and the second display from the second positional shift of the predetermined second display image in the second camera image
Further comprising:
And the corrector corrects the first camera image based on the first relative positional relationship between the camera and the first display and the second relative positional relationship between the camera and the second display. Video display device. As a video display device,
A camera configured to capture an image;
A first display configured to display an image;
A storage module configured to store a first relative positional relationship between the camera and the first display calculated from a first positional shift of the first predetermined display image in a first camera image, wherein the predetermined first display image is A storage module displayed on the first display, wherein the first camera image is obtained by imaging the predetermined first display image reflected by a surface of a second display arranged opposite to the first display; ;
A corrector configured to correct the first camera image based on the first relative positional relationship
Image display device comprising a.

Images