WO2012131851A1

WO2012131851A1 - Image display device, image transmission device, image display system, image transmission method, and program

Info

Publication number: WO2012131851A1
Application number: PCT/JP2011/057430
Authority: WO
Inventors: 田中　達也; 知也児玉; 古藤　晋一郎; 央小暮; 浅野　渉
Original assignee: 株式会社東芝
Priority date: 2011-03-25
Filing date: 2011-03-25
Publication date: 2012-10-04

Abstract

This image display device is provided with a transmission unit which transmits to an image transmission device the number of viewpoints necessary to display a stereoscopic image which can be viewed stereoscopically from multiple viewpoints, a receiving unit which receives from the image transmission device a stereoscopic image extracted on the basis of the aforementioned number of viewpoints, and a display unit which displays the received stereoscopic image.

Description

Image display device, image transmission device, image display system, image transmission method and program

Embodiments described herein relate generally to an image display device, an image transmission device, an image display system, an image transmission method, and a program.

There are various methods for displaying a stereoscopic image, such as a method that uses viewpoints for two left and right eyes, and a naked eye method that requires more viewpoint images than two eyes. As a general-purpose stereoscopic image, it is desired to prepare a multi-viewpoint image having more viewpoints in advance.

However, when image data having a large number of viewpoints is stored in advance on the image transmission apparatus side and transmitted to the image display apparatus, a multi-viewpoint from a viewpoint that does not require a desired reproduction method on the image display apparatus side. The image is also transmitted, the transmission efficiency of the image data is poor, and the storage capacity on the image display device side increases.

JP 2008-289064 A Japanese Patent No. 4346548

The problem to be solved by the present invention is an image display device, an image transmission device, an image display system, and an image transmission capable of suppressing an increase in storage capacity on the image display device side while improving the transmission efficiency of image data. It is to provide a method and program.

The image display device according to the embodiment is an image display device connected to the image transmission device, and includes a transmission unit, a reception unit, and a display unit.

The transmission unit transmits the number of viewpoints necessary for displaying a stereoscopic image that can be stereoscopically viewed from a plurality of viewpoints to the image transmission apparatus. The reception unit receives the stereoscopic image extracted based on the number of viewpoints from the image transmission device. The display unit displays the received stereoscopic image.

1 is a diagram of an image display system according to a first embodiment. FIG. 3 is a diagram illustrating a connection example between the image display device and the image transmission device according to the first embodiment. FIG. 3 is a diagram illustrating an example of viewpoint information according to the first embodiment. FIG. 4 shows an example of a transmission format in the first embodiment. FIG. 4 is a diagram illustrating an example of a viewpoint position according to the first embodiment. FIG. 4 is a diagram illustrating an example of parallax correction according to the first embodiment. 5 is a flowchart of image display processing according to the first embodiment. 5 is a flowchart of interrupt processing according to the first embodiment. 3 is a flowchart of a stereoscopic image extraction / transmission process according to the first embodiment. The figure of the image display system of Embodiment 2. FIG. FIG. 6 is a diagram illustrating an example of the number of viewpoints and viewpoint positions according to the second embodiment. 10 is a flowchart of image display processing according to the second embodiment. 10 is a flowchart of interrupt processing according to the second embodiment. FIG. 4 is a diagram of an image display system according to a third embodiment. FIG. 10 is a diagram illustrating a connection example between the image display device and the image transmission device according to the third embodiment. FIG. 10 is a diagram illustrating an example of viewpoint information according to the third embodiment. 10 is a flowchart of stereoscopic image extraction / transmission processing according to the third embodiment.

Hereinafter, an image display device, an image transmission device, an image display system, an image transmission method, and a program according to an embodiment will be described.

(Embodiment 1)
FIG. 1 is a block diagram illustrating a configuration of an image display system according to Embodiment 1, and a functional configuration of an image display device and an image transmission device. As shown in FIG. 1, in the image display system according to the present embodiment, an image display device 100 that displays a stereoscopic image that is a multi-viewpoint image and an image transmission device 200 that transmits the stereoscopic image to the image display device 100 are connected. It has been configured.

FIG. 2 is a schematic diagram illustrating an example of connection between the image display device 100 and the image transmission device 200. In the present embodiment, as shown in FIG. 2, the image display device 100 and the image transmission device 200 are connected by an HDMI (High-Definition Multimedia Interface) cable. Here, the image transmission apparatus 200 corresponds to, for example, a DVD player, a hard disk player, a tuner, a set top box, and the like, and the image display apparatus 100 corresponds to a display apparatus, a television apparatus, or the like, but is not limited thereto. It is not a thing.

Further, the image display apparatus 100 and the image transmission apparatus 200 are connected by an HDMI cable, a connection by other wires such as a DVI (Digital Visual Interface) cable, or a wireless communication method such as Wireless HD (High Definition). You may comprise.

Further, as in the second embodiment to be described later, it may be configured to be connected via a network such as the Internet or a wireless LAN. In this case, the image transmission device 200 corresponds to an image distribution server, and the image display device 100 corresponds to a PC (Personal Computer), a television device, or the like, but is not limited thereto.

The image display apparatus 100 transmits the viewpoint information regarding the viewpoints necessary for displaying the multi-viewpoint image, that is, the stereoscopic image in the self-image display apparatus 100, to the image transmission apparatus 200, and the stereoscopic image extracted by the image transmission apparatus 200 is transmitted. , Received from the image transmitting apparatus 200 and displayed.

The image transmission device 200 receives viewpoint information from the image display device 100, extracts a stereoscopic image of the viewpoint set by the received viewpoint information, and transmits the extracted stereoscopic image of the viewpoint to the image display device 100. It is.

Regarding the relationship between the image display device 100 and the image transmission device 200, as in a server / client system, the image display device 100 transmits a request for multi-viewpoint image transmission together with viewpoint information to the image transmission device 200, and the image transmission. A configuration in which the device 200 responds to the request may be employed. Further, the recording medium in which the multi-viewpoint image is stored is used as the image transmission apparatus 200, and the image display apparatus 100 accesses the recording medium and acquires the multi-viewpoint image based on the viewpoint information from the recording medium. May be.

Referring back to FIG. 1, details of the image display device 100 will be described. As shown in FIG. 1, the image display apparatus 100 mainly includes an information transmission unit 101, an extraction result reception unit 105, a parallax correction unit 106, a viewpoint / parallax correction amount switching unit 103, and an image display unit 102. I have. Note that when the parallax correction is performed on the image transmission device 200 side, the image display device 100 may not include the parallax correction unit 106.

The image display unit 102 corresponds to a display device such as a display for displaying a multi-viewpoint image, that is, a stereoscopic image, and a device driver thereof.

The information transmission unit 101 acquires each parameter included in the viewpoint information from setting information that is set in advance in a storage unit (not shown) such as a memory or that is stored in the storage unit by an input from the user, Generate viewpoint information. Then, the information transmission unit 101 transmits the generated viewpoint information to the image transmission apparatus 200 via a DDC (Display Data Channel) channel or a CEC (Consumer Electronics Control) channel via an HDMI cable.

Here, the viewpoint information is information relating to viewpoints necessary for displaying a stereoscopic image on the image display apparatus 100, and includes the number of viewpoints necessary for displaying the stereoscopic image. FIG. 3 is an explanatory diagram illustrating an example of viewpoint information. As shown in FIG. 3, the viewpoint information includes the transmission format, the number of viewpoints, the viewpoint position, the display width, the display height, the screen width, the screen height, the viewing distance, the jump distance, and the real space. The depth size is set.

Note that the setting items and format of the viewpoint information shown in FIG. 3 are examples, and the present invention is not limited to this. For example, other parameters such as a frame rate may be added to the viewpoint information, or they may be set in other expression formats. Further, when the image transmission apparatus 200 and the image display apparatus 100 are connected by a network such as the Internet, information regarding a transmission band, information regarding a bit rate of an image to be transmitted, and the like are set as viewpoint information, and image transmission is performed. It can also be configured to transmit to the device 200.

Of the viewpoint information, the transmission format (3D Format) is a format that can be received by the image display apparatus 100. Examples of the transmission format include a multicast method, a side-by-side method, a top-and-bottom method, a 2D + depth method, and a tile format method. Etc. can be set. FIG. 4 is a diagram schematically showing a display form of each method that can be designated as a transmission format.

Returning to FIG. 3, the number of viewpoints (NumViewPoint) in the viewpoint information is the number of viewpoints necessary for displaying a stereoscopic image in the image display apparatus 100. As the number of viewpoints, a desired number of viewpoints is set by an instruction from the user. The number of viewpoints can be set as 1 or 2 or more.

In the display width (DisplayWidth), the horizontal screen size of the image display unit 102 is set. Further, the vertical screen size of the image display unit 102 is set as the display height (DisplayHeight).

The screen width (ImageWidth) is the horizontal resolution of the stereoscopic image, and the screen height (ImageHeight) is the vertical resolution of the stereoscopic image. For each of the screen width and the screen height, a desired screen resolution is set by the viewing environment or the user.

The viewing distance (Viewing Distance), the pop-up distance (3D Position), and the depth size (Real Depth) in the real space are parallax correction information for parallax correction for enabling effective stereoscopic viewing on the image display device 100. is there. As the viewing distance, a distance from the user to the image display unit 102 is set by an instruction from the user. As the pop-out distance, a desired pop-out distance of the stereoscopic image is set. As the depth size in the real space, a desired depth size for adjusting the depth is set.

When these pieces of parallax correction information are set in the viewpoint information, parallax correction is performed on the stereoscopic image extracted based on the viewpoint information on the image transmission device 200 side.

On the other hand, when the parallax correction unit 106 is provided on the image display device 100 side and the user instructs the parallax correction to be performed on the image display device 100 side, the information transmission unit 101 displays the parallax correction information in the viewpoint information. Instead of this, it is set that the parallax correction is performed on the image display apparatus 100 side. In this case, parallax correction is not performed on the image transmission device 200 side, and parallax correction is performed on the stereoscopic image received from the image transmission device 200 by the parallax correction unit 106 of the image display device 100.

In addition, when having a parallax correction function such as the parallax correction unit 106, the information transmission unit 101 is configured to set the parallax correction to be executed on the image display device 100 side in the viewpoint information regardless of a user instruction. May be.

The viewpoint position (PosViewPoint) is the position of the viewpoint of the stereoscopic image displayed on the image display apparatus 100 among the multiple viewpoints of the stereoscopic image, and is information necessary for determining the viewpoint in the image transmission apparatus 200. The viewpoint position is composed of one or a plurality of parameters. The viewpoint position is set in the viewpoint information by the same number as the number set in the viewpoint number.

The viewpoint number is set in the viewpoint position. However, it is not limited to the viewpoint number, and can be set as the viewpoint position as long as the viewpoint can be determined. Examples of such viewpoint positions include the following.

FIG. 5A and FIG. 5B are diagrams for explaining examples of viewpoint positions. In the example of FIG. 5A, when the camera arrangement in the multi-viewpoint image (stereoscopic image) is known on the image display apparatus 100 side, an index indicating a desired viewpoint is set as the viewpoint position in the viewpoint information. The viewpoint position is designated by transmitting to the image transmitting apparatus 200. In the example of FIG. 5A, an example in the case of extracting a stereoscopic image from the viewpoint of the camera 2 is shown. In this case, the viewpoint position of camera ID = 2 is set as the viewpoint information, and the image transmission apparatus 200. Send to.

In FIG. 5A, the number of viewpoints = 1 is described as an example. However, when the number of viewpoints is two or more, camera IDs corresponding to the number of viewpoints are set as viewpoint information in the viewpoint information. (See FIGS. 11A and 11B described later).

In the example of FIG. 5B, for example, a viewpoint that is set in advance by a rotation angle and a translation distance in each of the horizontal, vertical, and depth directions from a reference viewpoint, which is set in advance by a content creator, an application, or the like. It is specified in the information. Thereby, it can be specified from which viewpoint from which angle the viewpoint is viewed.

In FIG. 5B, the number of viewpoints = 1 is described as an example. However, when the number of viewpoints is two or more, the parameter group of viewpoint positions shown in FIG. Is set to the viewpoint information.

The viewpoint information as described above is transmitted to the image transmission apparatus 200, and a stereoscopic image such as the viewpoint position and the number of viewpoints specified by the viewpoint information on the image transmission apparatus 200 side is extracted and transmitted to the image display apparatus 100. It will be.

Returning to FIG. 1, the extraction result receiving unit 105 receives an extraction result including a stereoscopic image extracted based on the viewpoint information from the image transmission device 200.

The parallax correction unit 106 does not set the parallax correction information in the viewpoint information, sets that the parallax correction is performed on the image display apparatus 100 side, transmits the parallax correction information to the image transmission apparatus 200, and extracts the extraction result from the image transmission apparatus 200. When received, parallax correction is performed. In this case, the parallax correction unit 106, for the stereoscopic image included in the extraction result, the viewing distance specified by the user, the pop-up distance, the depth size in the real space, and the parallax correction parameter (described later) included in the extraction result. Based on the above, parallax correction is performed.

The content of the parallax correction processing in the parallax correction unit 106 is the same as the parallax correction processing by the parallax correction unit 205 of the image transmission device 200, and details of the parallax correction processing by the parallax correction unit 205 of the image transmission device 200 will be described later. To do.

The viewpoint / parallax correction amount switching unit 103 is operated by a user operation unit (not shown) such as a remote controller or the like, and a parallax correction amount such as a viewpoint and a parallax correction amount (viewing distance, pop-out distance, depth size in real space, etc.) Accept the change command of the screen size, screen resolution, etc.) and change the number of viewpoints, viewpoint position, parallax correction information, screen size (screen width, screen height), screen resolution (display width, display height), etc. change. The changed viewpoint information is transmitted again to the image transmission apparatus 200 by the information transmission unit 101.

Next, details of the image transmission apparatus 200 will be described. As shown in FIG. 1, the image transmission apparatus 200 includes an information reception unit 202, a viewpoint determination unit 201, a stereoscopic image recording unit 203, a viewpoint extraction unit 204, a format conversion unit 206, and an extraction result transmission unit 207. It is mainly equipped with.

The stereoscopic image recording unit 203 is, for example, a storage medium such as a hard disk drive (HDD), and records stereoscopic image data compressed by MVC (Multi-view Video Coding) or the like.

The information receiving unit 202 receives the viewpoint information transmitted from the image display device 100. The viewpoint determination unit 201 determines viewpoints to be extracted based on the number of viewpoints, viewpoint positions, and the like included in the received viewpoint information. When the number of viewpoints is set in the viewpoint information, the viewpoint positions for the number of viewpoints are set, so the viewpoint determination unit 201 specifies and specifies viewpoints from the viewpoint positions for the set number of viewpoints. The viewpoints are extracted as many viewpoints as the number of viewpoints. For example, when the viewpoint number is set at the viewpoint position of the viewpoint information, the viewpoint determination unit 201 determines the viewpoint with the set number as a viewpoint to be extracted.

In addition, when the viewpoint position is set in the viewpoint information by the camera ID illustrated in the example of FIG. 5A, the viewpoint determination unit 201 specifies the viewpoint corresponding to the camera ID specified by the viewpoint position. Then, the identified viewpoint is determined as a viewpoint to be extracted. Further, the viewpoint determination unit 201 designates the rotation angle and the translation distance in the horizontal, vertical, and depth directions from the reference viewpoint shown in the example of FIG. 5B in the viewpoint information. First, the viewpoint is specified from the rotation angle and the translation distance from the reference viewpoint, and the identified viewpoint is determined as a viewpoint to be extracted.

The viewpoint extraction unit 204 decrypts the encrypted image data recorded in the stereoscopic image recording unit 203. Note that when the stereoscopic image data is recorded in the stereoscopic image recording unit 203 without being compressed, the decoding process is not necessary.

Then, the viewpoint extraction unit 204 extracts a stereoscopic image of the viewpoint specified by the number of viewpoints, the viewpoint position, etc. set in the viewpoint information and determined by the viewpoint determination unit 201. For example, when the viewpoint position is set in the viewpoint information in the example of FIG. 5A, the viewpoint from the viewpoint of the camera 2 is selected from the recorded multi-viewpoint images recorded in the stereoscopic image recording unit 203. A stereoscopic image is extracted. If the viewpoint position is set in the viewpoint information in the example of FIG. 5B, a stereoscopic image of the viewpoint captured from the specified position and angle is extracted.

If a stereoscopic image from the specified viewpoint position does not exist in the stereoscopic image recording unit 203, a stereoscopic image from the specified viewpoint position may be generated by image processing using a technique such as 3D Warping. Good. Here, as a technique such as 3D Warping, the technical literature “Yuji Mori, et.al .: View Generation with 3D Warping Usage Depth Information for FTV, Signal Processing: Image Communication, 24. 65-72, 2009. ”may be used.

The parallax correction unit 205, when the parallax correction information is set in the viewpoint information received from the image display device 100, that is, when it is not set in the viewpoint information that the parallax correction is performed on the image display device side. Based on the parallax correction information set in the viewpoint information and the parallax correction parameters held by the image transmission apparatus 200, parallax correction is performed on the stereoscopic image of the viewpoint extracted by the viewpoint extraction unit 204. That is, the conditions such as the viewing distance are different between when viewing the real object and when viewing the stereoscopic image on the image display unit 102 of the image display apparatus 100, and therefore, parallax correction is performed according to the image display apparatus 100.

FIG. 6 is an explanatory diagram showing an example of parallax correction. For example, when depth information (depth) Z can be acquired by a sensor such as a range finder or a method of performing matching between images taken by a multi-viewpoint camera, as shown in FIG. The disparity vector d is obtained by using two similarities of the left eye / object triangle and the right viewpoint / left viewpoint / object triangle on the screen.

Here, from the viewpoint information received from the image display device 100, as the parallax correction information, the viewing distance Z _S [cm] from the user's viewing position to the screen, the pop-out distance Z ₀ [cm] for adjusting the pop-out amount, real space The depth size L _{Z above} is obtained. Further, the screen size (cm) is obtained from the screen width and the screen height designated by the viewpoint information, and the screen resolution (pixel) is obtained from the display width and the display height designated by the viewpoint information.

On the other hand, as parallax correction parameters held by the image transmission apparatus 200, depth information (depth) Z and Z _max which are known values acquired by a sensor or the like, and an average distance between the right eye and the left eye. There is an interocular distance b.

In FIG. 6, the parallax correction unit 205 first calculates Z ′ from the screen to the target object using Equation (1).

Here, the coefficient γ is a parameter for converting the depth information Z normalized by a certain range to the depth size L _z in the real space, which is expressed by the equation (2). For example, when the depth information Z is expressed as 8-bit data, the depth distance is expressed by a value normalized to a range of [0, 255]. In order to convert this into a depth size in real space, A coefficient γ is used. When Z is 8 bits, Z _max = 255.

Equation (3) is established from two similarities of the right eye / left eye / object triangle shown in FIG. 6 and the right viewpoint / left viewpoint / object triangle on the screen. The equation for calculating the parallax vector d is expressed by equation (4). For this reason, the parallax correction unit 205 calculates the parallax vector d using equation (4).

Then, the parallax correction unit 205 performs parallax correction by shifting the pixels of the right-eye image and the left-eye image according to the calculated parallax vector d according to equation (5).

Returning to FIG. 1, the format conversion unit 206 of the image transmission apparatus 200 converts the extracted viewpoint stereoscopic image or the stereoscopic image subjected to further parallax correction into the format of the transmission format specified by the viewpoint information (that is, The image display apparatus 100 can receive).

For example, when a stereoscopic image is extracted based on viewpoint information in which the number of viewpoints = 2 and the transmission format = side-by-side method is set, for example, a multicast format obtained by decoding stereoscopic image data compressed by MVC A stereo image for two viewpoints is extracted from the multi-view image (stereo image), and then the format conversion unit 206 converts the extracted stereo image into a side-by-side format shown in FIG.

Note that, as long as the stereoscopic image to be transmitted is composed of an image composed of at least one or more viewpoints, the format is not particularly limited, and is converted into a format suitable for the desired image display apparatus 100. do it.

The extraction result transmission unit 207 outputs a stereoscopic image after the format conversion of the extracted viewpoint (a stereoscopic image after the parallax correction is performed when the parallax correction is performed), and various parameters (three-dimensional images (three-dimensional image after the format conversion)) ( The transmission format, the image size, the frame rate, and the like) are transmitted to the image display apparatus 100 as an extraction result via a HDMI DC (Transition Minimized Differential Signaling) channel or the like.

In addition, when the parallax correction is not performed, that is, when the viewpoint information indicates that the parallax correction is performed on the image display apparatus 100 side, the extraction result transmission unit 207 further adds the above-described extraction result to the above-described extraction result. Including the parallax correction parameters (depth information Z, Z _max , interocular distance b) are transmitted to the image display apparatus 100. Thereby, on the image display device 100 side, the parallax correction parameters included in the extraction result, the viewing distance Z _S , the pop-out distance Z ₀ , and the depth size L _Z in real space set on the image display device 100 side. From the screen size (cm) and the screen resolution, the same parallax correction process as the above-described parallax correction process performed on the image transmission apparatus 200 side is performed on the stereoscopic image received from the image transmission apparatus 200.

In the present embodiment, the extraction result transmission unit 207 includes the extracted viewpoint stereoscopic image and various parameters in the same extraction result, and transmits them to the image display device 100. However, the present invention is not limited to this. It is not something. For example, the extraction result transmission unit 207 can be configured to transmit various parameters to the image display apparatus 100 via a DDC channel or a CEC channel prior to transmission of a stereoscopic image.

In addition, uncompressed data can be transmitted by connection using an HDMI cable as in the present embodiment. However, the image display apparatus 100 and the image transmission apparatus 200 can be connected to a network such as the Internet, or connected by wireless communication. In the case of realization, a method of transmitting compressed stereoscopic image data can be adopted. Regarding the data compression method of the stereoscopic image to be transmitted, considering that an image is supplied to an arbitrary image display device 100, the H.264 format is H.264. A standardized method such as H.264 is preferable, but compression may be performed by a nonstandard method as long as the image display apparatus 100 is assumed to be compatible. In this case, a compression method that can be handled on the image display apparatus 100 side may be set in the viewpoint information and transmitted to the image transmission apparatus 200.

Next, image display processing by the image display apparatus 100 of the present embodiment configured as described above will be described. FIG. 7 is a flowchart illustrating a procedure of image display processing according to the first embodiment.

First, the information transmitting unit 101 acquires each parameter included in the viewpoint information from the setting information such as a memory, and generates viewpoint information based on the acquired parameters (step S11). And it is judged from the setting information memorize | stored in memory etc. whether the instruction | indication to perform parallax correction by the image display apparatus 100 side is given from the user (step S12).

When it is instructed to execute the parallax correction on the image display apparatus 100 side (step S12: Yes), the information transmission unit 101 determines that the parallax correction is performed on the image display apparatus 100 side. (Step S20). On the other hand, when it is not instructed to execute the parallax correction on the image display device 100 side (step S12: No), the information transmission unit 101 specifies the parallax correction information (from the setting information such as the memory) specified by the user ( (Viewing distance, pop-out distance, depth size in real space) is acquired, and this parallax correction information is set as viewpoint information (step S13).

Then, the information transmission unit 101 transmits the viewpoint information to the image transmission device 200 (step S14). Thereafter, the image display device 100 waits to receive an extraction result from the image transmission device 200 (steps S15 and S15: No).

When the extraction result reception unit 105 receives the extraction result from the image transmission device 200 (step S15: Yes), the extraction result indicates whether or not the extraction result includes a notification indicating that the extraction of the stereoscopic image at the specified viewpoint is not included. Judgment is made (step S16). If the notification is included in the extraction result (step S16: Yes), the process returns to step S11 to acquire the viewpoint information parameters. Note that if the extraction failure notification is included in the extraction result, a message indicating the extraction failure may be displayed on the image display unit 102 and the process may be terminated.

When an extraction failure notification is not included in the extraction result (step S16: No), the extraction result includes a stereoscopic image composed of parallax images for the number of viewpoints set in the viewpoint information. Whether the stereoscopic image is subjected to the parallax correction by the image transmission device 200 by determining whether or not the extraction result includes the parallax correction parameters (depth information Z, Z _max , interocular distance b). Is determined (step S17).

When the parallax correction parameter is included in the extraction result (step S17: Yes), the parallax correction unit 106 sets the parallax correction parameter and the parallax correction parameter on the image display device 100 side for the stereoscopic image included in the extraction result. The parallax correction is performed using the information such as the viewing distance, the pop-out distance, the depth size in real space, the screen size, and the screen resolution (step S18). Then, the image display unit 102 displays the stereoscopic image that has been subjected to parallax correction (step S19).

On the other hand, when the parallax correction parameter is not included in the extraction result in step S17 (step S17: No), since the parallax correction has already been performed on the image transmitting apparatus 200 side, the parallax correction is not performed and the image display is performed. The unit 102 displays a stereoscopic image (step S19).

It should be noted that, instead of the determination in step S17, whether or not the stereoscopic image is subjected to the parallax correction in the image transmission device 200 based on the parameter determined in step S12 whether or not the parallax correction is performed on the image display device 100 side. It may be configured to determine. Also, whether the stereoscopic image is subjected to the parallax correction in the image transmission apparatus 200 by the notification on the image display apparatus 100 side, including a notification indicating whether or not the parallax correction has been performed on the extraction result on the image transmission apparatus 200 side. It may be configured to determine whether or not.

Further, when the image display apparatus 100 has a parallax correction function, the parallax correction information is not included in the viewpoint information and is not performed on the image transmission apparatus 200 side. Thus, the image transmission device 200 may be configured to determine whether or not the stereoscopic image has been subjected to parallax correction.

In the image display apparatus 100, the user operates the operation unit (not shown) or the like, the parallax correction amount such as the viewpoint, the parallax correction amount, the viewing distance, the pop-out distance, the depth size in the real space, the screen size, the screen resolution, and the like. ) Change instructions. When the user gives an instruction to change the viewpoint or parallax correction amount, an interrupt process by the viewpoint / parallax correction amount switching unit 103 is executed. FIG. 8 is a flowchart showing the procedure of interrupt processing.

The viewpoint / parallax correction amount switching unit 103 receives an instruction to change the viewpoint and the parallax correction amount from the user (step S31). Then, the viewpoint / parallax correction amount switching unit 103 determines whether or not the change instruction is a viewpoint change instruction based on an input event or the like (step S32). If the change instruction is a viewpoint change (step S32: Yes), the viewpoint / parallax correction amount switching unit 103 changes parameters such as the viewpoint position and the number of viewpoints of the viewpoint information according to the change instruction (step S33). .

On the other hand, if the change instruction is not a viewpoint change in step S32 (step S32: No), parameters such as the viewpoint position and the number of viewpoints of the viewpoint information are not changed.

Next, the viewpoint / parallax correction amount switching unit 103 determines whether or not the change instruction is a parallax correction amount change instruction from an input event or the like (step S34). If the change instruction is not a parallax correction amount change instruction (step S34: No), the viewpoint / parallax correction amount switching unit 103 ends the interrupt process.

On the other hand, when the change instruction is an instruction to change the parallax correction amount (step S34: Yes), the viewpoint / parallax correction amount switching unit 103 executes the parallax correction from the setting information such as the memory on the image display apparatus side. It is determined whether or not (step S35).

When the parallax correction is executed on the image display device side (step S35: Yes), the process proceeds to step S18 in FIG. 7, and the parallax correction is performed with the parallax correction amount after the change instruction. On the other hand, when the parallax correction is not executed on the image display device side in step S35 (step S35: No), the viewpoint / parallax correction amount switching unit 103 changes the parallax correction information of the viewpoint information according to the change instruction (step S35). S36). Then, the process proceeds to step S <b> 14 in FIG. 7, and the information transmission unit 101 transmits the changed viewpoint information to the image transmission apparatus 200. As a result, the image transmission device 200 extracts the stereoscopic image of the changed viewpoint, performs the parallax correction with the changed parallax correction amount, and transmits the extraction result to the image display device 100.

Next, the stereoscopic image extraction and transmission process executed by the image transmission apparatus 200 will be described. FIG. 9 is a flowchart illustrating a procedure of the processing for extracting and transmitting a stereoscopic image according to the first embodiment.

The image transmitting apparatus 200 is in a state of waiting for receiving viewpoint information from the image display apparatus 100 (steps S51 and S51: No). When the information receiving unit 202 receives the viewpoint information from the image display device 100 (step S51: Yes), the viewpoint determining unit 201 determines the viewpoint according to the setting content of the viewpoint information (step S52). That is, the viewpoint determination unit 201 determines viewpoints from viewpoint positions corresponding to the number of viewpoints set in the viewpoint information.

Then, the viewpoint extraction unit 204 extracts a stereoscopic image of the viewpoint determined by the viewpoint determination unit 201, that is, a stereoscopic image that is a parallax image at each viewpoint position for the number of viewpoints from the stereoscopic image recording unit 203 (step S53). . The viewpoint extraction unit 204 determines whether or not the stereoscopic image of the determined viewpoint has been successfully extracted (step S54). If the extraction has failed (step S54: No), the extraction result transmission unit 207 is designated. A notification of failure to extract the stereoscopic image of the selected viewpoint is included in the extraction result (step S55), and the extraction result is transmitted to the image display device 100 (step S62).

On the other hand, when the stereo image of the determined viewpoint is successfully extracted in step S54 (step S54: Yes), the parallax correction unit 205 performs parallax correction on the viewpoint information on the image display device 100 side. Is determined (step S57). If it is set in the viewpoint information that parallax correction is to be performed on the image display apparatus 100 side (step S57: Yes), the parallax correction unit 205 holds the parallax correction parameter held on the image transmission apparatus 200 side. (Depth information Z, Z _max , interocular distance b) is included in the extraction result (step S58).

On the other hand, when it is not set in step S57 that the parallax correction is performed on the image display device 100 side in the viewpoint information, that is, when the parallax correction information is set (No in step S57), the parallax is set. The correction unit 205 includes the parallax correction information, the screen size (screen width, screen height) and screen resolution (display width, display height) set in the viewpoint information, and the parallax correction parameters held by the image transmission device 200. From the above, the above-described parallax correction is performed on the extracted stereoscopic image of the viewpoint (step S59).

Next, the format conversion unit 206 converts the extracted stereoscopic image of the viewpoint into a transmission format set by the viewpoint information (step S60).

Then, the extraction result transmission unit 207 includes the stereoscopic image and various parameters in the extraction result (step S61), and transmits the extraction result to the image display device 100 (step S62). As a result, the stereoscopic image of the viewpoint designated on the image display apparatus 100 side is transmitted to the image display apparatus 100 from among the stereoscopic images of the multiple viewpoints.

Thus, in the present embodiment, the image display apparatus 100 transmits viewpoint information including the number of viewpoints necessary for display to the image transmission apparatus 200, and the image transmission apparatus 200 has a stereoscopic image with the number of viewpoints specified by the viewpoint information. Are extracted from a large number of viewpoint stereoscopic images and transmitted to the image display apparatus 100. Therefore, unnecessary viewpoint stereoscopic image data is not transmitted by the reproduction method or the like on the image display apparatus 100 side. Therefore, according to the present embodiment, it is possible to improve the transmission efficiency of stereoscopic image data and to prevent an increase in storage capacity on the image display device 100 side.

(Embodiment 2)
In the first embodiment, in the image display apparatus 100, the viewpoint position set in the viewpoint information is determined by the change instruction by the operation of the user's remote controller or the like as the viewer, but in the second embodiment, the viewer The viewing position with respect to the image display apparatus is detected, and the viewpoint position of the number of viewpoints is determined based on the detected viewing position and set in the viewpoint information.

FIG. 10 is a block diagram illustrating the configuration of the image display system, the functional configuration of the image display device, and the image transmission device according to the second embodiment. As shown in FIG. 10, in the image display system according to the present embodiment, an image display apparatus 1000 that displays a stereoscopic image that is a multi-viewpoint image and an image transmission apparatus 200 that transmits the stereoscopic image to the image display apparatus 1000 are connected. It has been configured. Here, the configuration and functions of the image transmission apparatus of the present embodiment are the same as those of the first embodiment.

As shown in FIG. 10, the image display apparatus 1000 according to the present embodiment includes an information transmission unit 1001, an extraction result reception unit 105, a parallax correction unit 106, a viewpoint / parallax correction amount switching unit 1003, and a viewing position detection. It mainly includes a unit 1007 and an image display unit 102. Here, the functions of the extraction result reception unit 105, the parallax correction unit 106, and the image display unit 102 are the same as those of the image display device 100 of the first embodiment.

The viewing position detection unit 1007 detects the viewing position of the viewer who is the user with respect to the image display device 1000, and outputs information on the detected viewing position to the information transmission unit 1001 and the viewpoint / parallax correction amount switching unit 1003.

Specifically, the viewing position detection unit 1007 uses a head tracking or a sensor using a video camera, obtains the current position and direction of the viewer from the image captured by the video camera or the detection signal from the sensor, and this current From the position and direction, the viewer's viewpoint position with respect to the display surface of the image display unit 102 is detected as the viewing position.

It should be noted that as long as the viewer's viewing position can be detected, the present invention is not limited to head tracking or a sensor using a video camera.

The information transmission unit 1001 according to the present embodiment determines the number of viewpoints and the viewpoint position based on the viewing position detected by the viewing position detection unit 1007, and transmits the viewpoint information including the determined number of viewpoints and the viewpoint position to the image transmission apparatus. 200. As with the first embodiment, the viewpoint information other than the number of viewpoints and the viewpoint position is set in advance in each storage unit (not shown) such as a memory, or from the setting information stored in the storage unit by input from the user. To generate viewpoint information.

The viewpoint / parallax correction amount switching unit 1003 according to the present embodiment determines the number of viewpoints and the viewpoint position based on the viewing position detected by the viewing position detection unit 1007, and the viewpoint information is determined based on the determined number of viewpoints and the viewpoint position. change. Note that the viewpoint / parallax correction amount switching unit 1003 changes the viewpoint information with the parallax correction amount input by the user, as in the first embodiment.

As in the first embodiment, the viewpoint / parallax correction amount switching unit 1003 is configured to change the viewpoint information according to the input number of viewpoints and viewpoint positions even when the number of viewpoints and viewpoint positions are input by the user. May be.

Next, details of detection of the viewing position by the viewing position detection unit 1007 and determination of the number of viewpoints and the viewpoint position by the information transmission unit 1001 and the viewpoint / parallax correction amount switching unit 1003 will be described. FIG. 11A and FIG. 11B are explanatory diagrams for the detection of the viewer's viewing position and the determination of the number of viewpoints and the viewpoint position.

As shown in FIG. 11A, when there is only one viewer, the information transmission unit 1001 and the viewpoint / parallax correction amount switching unit 1003 calculate the number of viewpoints from the viewing position output from the viewing position detection unit 107. 2 is determined.

Also, the information transmission unit 1001 and the viewpoint / parallax correction amount switching unit 1003 have the camera 2 corresponding to the viewer's left eye viewpoint and the camera 3 corresponding to the viewer's right eye viewpoint as the viewpoint position, the number of viewpoints = 2, and the camera ID. = {2, 3} is set as the viewpoint information.

As shown in FIG. 11B, when there are a plurality of viewers, the information transmission unit 1001 and the viewpoint / parallax correction amount switching unit 1003 detect the viewing position as in the case where there is only one viewer. The number of viewpoints and the viewpoint position are determined from the viewing position output from the unit 1007. In the example of FIG. 11B, the information transmission unit 1001 and the viewpoint / parallax correction amount switching unit 1003 select the cameras 2 to 4 and use the viewpoint number = 3 and the camera ID = {2, 3, 4} as the viewpoint information. Set.

Here, the number of viewpoints and the viewpoint position are determined by the information transmission unit 1001 when the image display apparatus 1000 is activated or when a viewer starts viewing a stereoscopic image. On the other hand, the number of viewpoints and the viewpoint position are determined by the viewpoint / parallax correction amount switching unit 1003 when the viewer is viewing a stereoscopic image on the image display apparatus 1000, and the viewer moves and the necessary number of viewpoints and viewpoint positions change. The information transmission unit 1001 transmits the changed viewpoint information to the image transmission device 200 again.

Next, image display processing by the image display apparatus 100 of the present embodiment configured as described above will be described. FIG. 12 is a flowchart illustrating a procedure of image display processing according to the second embodiment.

First, the viewing position detection unit 1007 detects the viewing position of the viewer by the above-described method (step S1201). Next, the information transmitting unit 1001 determines the number of viewpoints and the viewpoint position from the viewing position by the above-described method (step 1202). Then, the information transmission unit 1001 acquires parameters other than the number of viewpoints and the viewpoint position in the same manner as in the first embodiment, and generates viewpoint information including the number of viewpoints, the viewpoint position, and the like (step S11). The subsequent processing (steps S12 to S19) is performed in the same manner as in the first embodiment. Thereby, the number of viewpoints corresponding to the viewing position of the viewer and the stereoscopic image at the viewpoint position can be transmitted from the image transmission apparatus 200 and displayed.

In the image display apparatus 1000, when the viewer moves and the viewing position is changed, the viewing position detection unit 1007 detects the movement, and interrupt processing is executed. FIG. 13 is a flowchart illustrating a procedure of interrupt processing according to the second embodiment.

When the viewing position detection unit 1007 detects that the viewer has moved, the viewing position of the viewer after the movement is detected by the above-described method (step S1301). Next, the viewpoint / parallax correction amount switching unit 1003 determines whether or not the viewing position after movement is changed from the viewing position before movement stored in the memory or the like based on the coordinate value or the like (step S1302). ). If the viewing position has not been changed (step S1302: No), the interrupt process is terminated.

On the other hand, when the viewing position has been changed (step S1302: Yes), the viewpoint / parallax correction amount switching unit 1003 determines the number of viewpoints and the viewpoint position from the viewing position by the above-described method (step 1303).

Then, the viewpoint / parallax correction amount switching unit 1003 changes the number of viewpoints and the viewpoint position of the viewpoint information with the number of viewpoints and the viewpoint position determined in step S1303 (step S1304). Then, the process proceeds to step S <b> 14 in FIG. 12, and the information transmission unit 1001 transmits the changed viewpoint information to the image transmission apparatus 200. As a result, the image transmission device 200 extracts a stereoscopic image of the changed number of viewpoints and viewpoint positions, and the extraction result is transmitted to the image display device 1000.

As described above, in the present embodiment, the viewer's viewing position is detected, the number of viewpoints and the viewpoint position are determined, and are included in the viewpoint information and transmitted to the image transmitting apparatus 200. 3D image suitable for the image can be displayed.

Further, in the present embodiment, even when the viewer moves while viewing the stereoscopic image, the viewing position of the viewer after the movement is detected, the number of viewpoints and the viewpoint position are determined, and included in the viewpoint information again. Since the image is transmitted to the image transmission apparatus 200, the received stereoscopic image can be dynamically changed, and a stereoscopic image more suitable for the viewer's actual viewpoint position can be displayed.

(Embodiment 3)
In the third embodiment, the viewpoint priority is set as viewpoint information on the image display apparatus side and transmitted to the image transmission apparatus, and the specified viewpoint is set according to the priority set in the viewpoint information on the image transmission apparatus side. A stereoscopic image is extracted and transmitted to the image display device.

FIG. 14 is a block diagram illustrating the configuration of the image display system, the functional configuration of the image display device, and the image transmission device according to the third embodiment. As shown in FIG. 14, in the image display system according to the present embodiment, an image display device 1100 that displays a stereoscopic image that is a multi-viewpoint image and an image transmission device 1200 that transmits a stereoscopic image to the image display device 1100 are connected. It has been configured.

FIG. 15 is a schematic diagram showing an example of connection between the image display device 1100 and the image transmission device 1200. In the present embodiment, as shown in FIG. 15, the image display device 1100 and the image transmission device 1200 are connected via a network such as the Internet. Here, the image transmission device 1200 corresponds to, for example, an image distribution server, and the image display device 1100 corresponds to a PC, a television device, a display device, or the like, but is not limited thereto.

In addition to connecting the image display device 1100 and the image transmission device 1200 via the Internet or the like, as in the first embodiment, they are connected by an HDMI cable, connected by another wire such as a DVI cable, or wireless HD, etc. You may comprise so that it may connect by the system by wireless communication.

The image display apparatus 1100 transmits to the image transmission apparatus 1200 viewpoint information including a multi-viewpoint image in its own image display apparatus 1100, that is, viewpoints necessary for displaying a stereoscopic image and priority of viewpoints. The extracted stereoscopic image is received from the image transmission device 1200 and displayed.

The image transmission device 1200 receives the viewpoint information from the image display device 1100, determines the viewpoint according to the priority in the received viewpoint information, extracts a stereoscopic image of the determined viewpoint, and displays the extracted stereoscopic image as an image display To the device 1100.

Referring back to FIG. 14, the details of the image display device 1100 will be described. As shown in FIG. 14, the image display apparatus 1100 mainly includes an information transmission unit 1101, an extraction result reception unit 105, a parallax correction unit 106, a viewpoint / parallax correction amount switching unit 103, and an image display unit 102. I have. Here, the functions of the extraction result receiving unit 105, the parallax correction unit 106, the viewpoint / parallax correction amount switching unit 103, and the image display unit 102 are the same as those of the image display device 100 of the first embodiment.

The information transmission unit 1101 according to the present embodiment sets viewpoint priority in the viewpoint information, and transmits this viewpoint information to the image transmission apparatus 1200.

FIG. 16 is an explanatory diagram illustrating an example of viewpoint information according to the third embodiment. In the viewpoint information of the present embodiment, the priorities of viewpoints 0 to 4 are set as shown in FIG. The priority in the viewpoint information indicates that the smaller the value set for the priority is, the higher the priority is, and transmission is performed with priority.

Here, the method of assigning priority by the information transmission unit 1101 of the image display device 1100 can be determined by the method described in Japanese Patent Laid-Open No. 2009-238117, for example. In this method, the priority is determined based on the viewpoint position of the user measured using a video camera or the like and viewing area priority information that defines an area where the user wants to observe an image with high resolution. For example, a viewpoint position of the user with respect to the display surface of the image display unit 102 is acquired by a video camera, a head tracking sensor, or the like, the viewpoint at the position is set to the highest priority (minimum value), and the viewpoint is the current viewpoint of the user. The viewpoint priority can be set so that the priority is higher (larger value) as the position is farther from the position.

When the image display apparatus 1100 and the image transmission apparatus 1200 are connected via the Internet as in the present embodiment, or when connected by wireless communication, fluctuations in transmission load or transmission errors in the network or the like It is preferable to realize image transmission that is robust to the image. For this reason, in the present embodiment, the viewpoint information with priority given to the viewpoint to be transmitted is transmitted to the image transmission apparatus 1200, so that the image transmission apparatus 1200 side extracts a stereoscopic image with a high priority viewpoint. To the image display apparatus 1100. As a result, it is possible to realize image transmission that is resistant to fluctuations in transmission load and transmission errors in a network or the like.

Next, details of the image transmission device 1200 will be described. Returning to FIG. 14, the image transmission device 1200 includes an information reception unit 202, a viewpoint determination unit 1201, a stereoscopic image recording unit 203, a viewpoint extraction unit 204, a parallax correction unit 205, a format conversion unit 206, and an extraction result. A transmission unit 207 is mainly provided. Here, the functions of the information reception unit 202, the stereoscopic image recording unit 203, the viewpoint extraction unit 204, the parallax correction unit 205, the format conversion unit 206, and the extraction result transmission unit 207 are the same as those of the image transmission apparatus 200 of the first embodiment. is there.

The viewpoint determination unit 1201 according to the present embodiment preferentially determines a viewpoint with a low priority, that is, a stereoscopic image with a high priority, based on the number of viewpoints and viewpoint positions included in the received viewpoint information. To do.

FIG. 17 is a flowchart showing the procedure of the extraction and transmission processing of the stereoscopic image of the third embodiment. In the three-dimensional image extraction and transmission process according to the present embodiment, in step S82, the viewpoint determination unit 1201 determines viewpoints to be extracted in order of priorities set in the viewpoint information (in order of decreasing priority values). However, unlike the stereoscopic image extraction and transmission process of the first embodiment, the other steps are the same as those of the first embodiment.

For example, the viewpoint determination unit 1201 detects the transmission state of the network and the like, and when the network is congested or there is a bandwidth limitation, the priority is a value below a certain value, that is, the priority is higher than a certain value. The viewpoint extraction unit 204 determines that the viewpoint is to be extracted, and the viewpoint extraction unit 204 extracts a stereoscopic image of the determined viewpoint with a high priority from the stereoscopic image recording unit 203, and the extraction result transmission unit 207 transmits it to the image display device 1100. .

As described above, according to the present embodiment, the image transmission apparatus 1200 encodes an image from a viewpoint with a high priority in the image display apparatus 1100 by encoding the viewpoint according to a compression method that is scalable to the viewpoint according to the priority of the viewpoint information. For an image from a viewpoint that is preferentially received and cannot be received due to band limitation or the like, it is possible to perform processing such as interpolation by a technique such as image synthesis. As a result, in this embodiment, in addition to the effects of the first embodiment, it is possible to improve resistance to transmission load fluctuations and transmission errors.

In this embodiment, the viewpoint priority is set in the viewpoint information. However, instead of the viewpoint, for example, a priority such as a frame rate or a resolution is set and scalability is provided in the time direction or the spatial direction. It is also possible to adopt a configuration for transmitting a stereoscopic image.

Also, in the image display apparatus 1100 of the present embodiment, a viewing position detection unit 1007 is provided as in the first embodiment, and the number of viewpoints and the viewpoint position are determined based on the viewing positions detected by the viewing position detection unit 1007. The viewpoint information may be set.

The image display program executed by the image display apparatuses 100 and 1100 according to the first and second embodiments and the image transmission program executed by the

image transmission apparatuses

200 and 1200 according to the first and second embodiments are incorporated in advance in a ROM or the like. Provided.

image transmission apparatuses

200 and 1200 according to the first and second embodiments are installable or executable. Various types of files may be recorded and provided on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk), or the like.

Further, the image display program executed by the image display apparatuses 100 and 1100 according to the first and second embodiments and the image transmission program executed by the

image transmission apparatuses

200 and 1200 according to the first and second embodiments are transferred to a network such as the Internet. It may be configured to be provided by being stored on a connected computer and downloaded via a network. The image display program executed by the image display apparatuses 100 and 1100 according to the first and second embodiments and the image transmission program executed by the

image transmission apparatuses

200 and 1200 according to the first and second embodiments are transmitted via a network such as the Internet. It may be configured to be provided or distributed.

The image display program executed by the image display apparatuses 100 and 1100 according to the first and second embodiments includes the above-described units (the information transmission units 101 and 1101, the extraction result reception unit 105, the parallax correction unit 106, the viewpoint and parallax. The module configuration includes a correction amount switching unit 103 and an image display unit 102). As actual hardware, the CPU (processor) reads out and executes an image display program from the ROM, and each unit stores the main memory. The information transmitting units 101 and 1101, the extraction result receiving unit 105, the parallax correction unit 106, the viewpoint / parallax correction amount switching unit 103, and the image display unit 102 are generated on the main storage device. It is like that.

In addition, the

image transmission apparatuses

200 and 1200 according to the first and second embodiments include the above-described units (the information reception unit 202, the viewpoint determination units 201 and 1201, the stereoscopic image recording unit 203, the viewpoint extraction unit 204, and the parallax correction. Unit 205, format conversion unit 206, and extraction result transmission unit 207). As actual hardware, the CPU (processor) reads out and executes the image transmission program from the ROM. Each unit is loaded on the main storage device, and the information receiving unit 202, the viewpoint determining units 201 and 1201, the stereoscopic image recording unit 203, the viewpoint extracting unit 204, the parallax correcting unit 205, the format converting unit 206, and the extraction The result transmission unit 207 is generated on the main storage device.

Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

100, 1000, 1100

Image display device

101, 1001, 1101 Information transmission unit 102

Image display unit

103, 1003 Viewpoint / parallax correction amount switching unit 105 Extraction result reception unit 106

Parallax correction unit

200, 1200 Image transmission device 201 Viewpoint determination unit 202 Information receiving unit 203 Stereoscopic image recording unit 204 View point extracting unit 205 Parallax correcting unit 206 Format converting unit 207 Extraction result transmitting unit 1007 Viewing position detecting unit

Claims

An image display device connected to the image transmission device,
A transmission unit that transmits the number of viewpoints necessary for displaying a stereoscopic image stereoscopically viewable from a plurality of viewpoints to the image transmission device;
A reception unit that receives the stereoscopic image extracted based on the number of viewpoints from the image transmission device;
A display unit for displaying the received stereoscopic image;
An image display device comprising:
The transmitter further transmits a viewpoint position of the required viewpoint;
The receiving unit receives the stereoscopic image extracted based on the number of viewpoints and the viewpoint position;
The image display device according to claim 1.
The transmission unit further transmits parallax correction information for correcting parallax of the stereoscopic image;
The receiving unit further receives the stereoscopic image that has been subjected to parallax correction based on the parallax correction information.
The image display device according to claim 2.
A parallax correction unit that performs parallax correction on the stereoscopic image;
The transmission unit further transmits execution information indicating that the parallax correction is performed on the image display device side,
The receiving unit receives the stereoscopic image that has not been subjected to parallax correction and the parallax parameters necessary for parallax correction from the image transmission device,
The parallax correction unit performs parallax correction on the received stereoscopic image based on parallax correction information on the parallax correction and the parallax parameter,
The display unit displays a stereoscopic image subjected to parallax correction;
The image display device according to claim 2.
A viewing position detector for detecting the position of the viewer;
A changing unit that changes the viewpoint position based on the position of the viewer;
The image display device according to claim 2.
An image transmission device connected to an image display device,
A receiving unit that receives the number of viewpoints necessary for displaying a stereoscopic image that can be stereoscopically viewed from a plurality of viewpoints from the image display device;
An extraction unit for extracting the stereoscopic image of the number of viewpoints;
A transmission unit that transmits the extracted three-dimensional image of the number of viewpoints to the image display device;
An image transmission device comprising:
The receiving unit further receives a viewpoint position necessary for displaying the stereoscopic image;
The extraction unit extracts the viewpoint based on the number of viewpoints and the viewpoint position;
The image transmission device according to claim 6.
A parallax correction unit that performs parallax correction on the stereoscopic image;
The receiver further receives correction information related to parallax correction,
The parallax correction unit performs parallax correction on the extracted stereoscopic image of the viewpoint based on parallax correction parameters necessary for parallax correction and the correction information,
The transmission unit transmits a stereoscopic image subjected to parallax correction;
The image transmission device according to claim 7.
An image display system including an image transmission device and an image display device,
The image display device includes:
A first transmission unit that transmits the number of viewpoints necessary for displaying a stereoscopic image stereoscopically viewable from a plurality of viewpoints to the image transmission device;
A first receiving unit that receives the stereoscopic image extracted based on the number of viewpoints from the image transmitting device;
A display unit for displaying the received stereoscopic image,
The image transmission device includes:
A second receiver for receiving the number of viewpoints from the image display device;
An extraction unit for extracting the stereoscopic image of the number of viewpoints;
A second transmission unit that transmits the extracted three-dimensional images of the number of viewpoints to the image display device;
An image display system comprising:
The number of viewpoints necessary for displaying a stereoscopic image that can be stereoscopically viewed from a plurality of viewpoints is received from the image display device,
Extracting the stereoscopic image of the number of viewpoints;
Transmitting the extracted stereoscopic image of the number of viewpoints to the image display device;
Image transmission method.
Computer
Means for receiving from the image display device the number of viewpoints necessary for displaying a stereoscopic image that can be stereoscopically viewed from a plurality of viewpoints;
Means for extracting the stereoscopic image of the number of viewpoints;
The program for functioning as a means to transmit the extracted three-dimensional image of the number of viewpoints to the image display device.