JP2010091764A - Image display device, method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display a virtual desktop screen, which is continuous in a horizontal direction from a main display, on a sub-display by arranging the sub-display at an angle on the side of the main display. <P>SOLUTION: The image display device includes: a display device 1 for displaying a first screen; a display device 2 for displaying a second screen adjacent to the first screen; an angle detector 51 for detecting arrangement angles of the display device 1 and the display device 2; a position detector for detecting the position of an observer; and an image generating part for generating the second screen by modifying the screen adjacent in a parallel direction of the first screen based on the arrangement angles detected by the angle detector 51 and the position detected by the position detector 52. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a technique for displaying an image on a plurality of displays.

  A personal computer (hereinafter referred to as a PC) is composed of a main body including a main computing device such as a main CPU and a display unit for displaying electronic information. There is a type of PC in which the main body and the display are separated, and a type of PC in which the main body and the display are integrated. Notebook PCs are widely used as integrated PCs.

  The display unit incorporates an LCD (Liquid Crystal Display) that constitutes a display panel, and the LCD is generally located at substantially the center of the display unit. Electronic information generated by the main body of the PC can be displayed on a display portion such as an LCD. In the case of a PC, the entire screen displayed on the display portion is called a “desktop screen”, and this desktop screen becomes a work space on the PC. Here, the work space displays “windows” related to the software activated on the main body. For example, the user of the PC uses a window for creating a document, a window for viewing images, etc. I do.

  The size of the “desktop screen” is limited to the physical size of the display unit. Therefore, in order to expand the work space, a method of expanding the desktop screen is taken. For example, there is a method in which N × M desktop screens are prepared in the PC main body, and one of them is actually displayed on the display unit to work. However, in order to make a plurality of desktops visible at the same time, it is common to prepare a second display (display device) as an external device and display the second desktop screen there. is there.

  On the other hand, when displaying the display object on the display, various effects can be obtained by displaying the display object after being deformed. For example, as a technique for displaying an image on a limited display portion, a method called “reduction” is used. If the second display is prepared as described above, usually only the second desktop screen can be displayed, but the second desktop screen with the area reduced to 1/4, the third desktop screen, the fourth screen If the desktop screen is prepared, the display portion of the second display can be divided into four and these three desktop screens can be displayed.

Further, “correction” is known as a technique for deformation other than reduction. For example, “keystone correction” is used as a technique for removing distortion that occurs when an image is displayed on a screen by a projector. As a technology applying this “trapezoidal correction”, the position of the observer who sees the display is detected, the distortion to the display object that occurs when the display is viewed from a position other than the front is corrected, and the display is viewed from the front. There is also known a method for providing a display without distortion as in the case of viewing from the viewpoint (Patent Documents 1 and 2).
JP 2005-92363 A JP 2007-65541 A

  The size of the desktop is usually limited to the size of the display screen, and a plurality of displays (display devices) are required to display a very horizontally long image that spans a plurality of desktops. On the other hand, if a plurality of desktops are simply reduced and arranged on the second display, continuity with respect to what is displayed is lost.

  Also in the case of keystone correction, it is easy to see the display on the display from the position other than the front by using the techniques disclosed in Patent Documents 1 and 2, but it is not a continuous display method but a continuous one. Not suitable for display.

  In order to solve the above problems, an image display device according to the present invention includes a first display unit that displays a first screen and a second display unit that displays a second screen adjacent to the first screen. An angle detection unit that detects an arrangement angle between the first display unit and the second display unit, a position detection unit that detects the position of an observer, and an arrangement angle detected by the angle detection unit An image generation unit configured to generate a second screen by deforming a screen adjacent to the first screen in a parallel direction from the position detected by the position detection unit.

  A first display unit that displays the first screen; a second display unit that displays a second screen adjacent to the first screen; the first display unit; and the second display. An angle detection unit that detects an arrangement angle with the unit, a position setting unit that sets the position of the observer, the arrangement angle detected by the angle detection unit, and the position set by the position setting unit. And an image generation unit that generates a second screen by deforming a screen adjacent to the screen in the parallel direction.

Place a second display at an angle rather than side-by-side on the main display, and if you look into the second display, there will be a continuous virtual desktop screen running horizontally from the main display. To be displayed.

In the limited area of the second display, it is possible to display a horizontally continuous thing that continues from the main display, and the user can recognize that it is continuous.

Hereinafter, embodiments will be described with reference to the drawings.
(First embodiment)
First, the display of the first display device (main display) will be described with reference to FIG. FIG. 1 shows a case where the user uses one display device 1. A desktop screen 11 is displayed on the display device 1, and an observer 3 as a user is viewing the desktop screen 11 from the front of the display device 1. A case where the user uses two display devices, the first display device and the second display device (sub display), will be described with reference to FIG. The desktop screen 21 is displayed on the display device 2 newly added as compared with FIG. 1, and the observer 3 is viewing the display device 1 and the display device 2 arranged side by side from the front. That is, as shown in FIG. 3, the number of display devices is increased to increase the displayed desktop screen. For example, if the display device 1 and the display device 2 are the same size, the area of the desktop screen that can be displayed is doubled by using two display devices.

  Here, FIG. 4 is a layout view when the display device 1 and the display device 2 are viewed from above. As shown in FIG. 4, the display device 1 and the display device 2 are arranged so that the angle between the display devices 1 and 2 is an angle θ. It is assumed that θ is in a range from 90 degrees to 180 degrees, and the desktop screen 21 that is adjacent in the horizontal direction from the desktop screen 11 displayed on the display device 1 is displayed on the display device 2. A desktop screen 11 and a screen that is adjacent to the desktop screen 11 and continues in the horizontal direction will be described with reference to FIGS.

  5 and 6 show that the position of the observer 3 who observes the display device 2 is different. Here, the observer 3 is usually three-dimensional and cannot be represented by one point. However, one point of the representative observation position 31 is set as position information representing the observer 3. An example of the representative observation position 31 may be one point between both eyes as shown in FIG.

  As shown in FIG. 5 and FIG. 6, if there are two virtual desktop screens (virtual desktop screen 12 and virtual desktop screen 13) in a side-by-side position adjacent to the desktop screen 11 of the display device 1. When the virtual desktop screens 12 and 13 are observed from the observation position 31-1 or 31-2, a screen that is a mapping of the virtual desktop screens 12 and 13 is displayed at the position of the display device 2. 5 and 6, a screen corresponding to the virtual desktop screen 12 is expressed as a virtual desktop mapping screen 41, and a screen corresponding to the virtual desktop screen 13 is expressed as a virtual desktop mapping screen 42.

  A method for detecting the angle θ between the display device 1 and the display device 2 will be described with reference to FIG. In FIG. 8, an angle detection device 51 is provided between the display device 1 and the display device 2. The display device 1 and the display device 2 are connected to the computing device 6 (main body in the PC) with a cable for transmitting and receiving display images. The angle information detected by the angle detection device 51 is transmitted to the calculation device 6 via a cable connected to the calculation device 6. FIG. 9 is a view of the display device 1, the display device 2, and the angle detection device 51 as viewed from above, and shows how the arrangement of the display device 1 and the display device 2 is changed. FIG. 9A shows an arrangement when the angle information detected by the angle detection device 51 is 180 degrees, and FIG. 9B shows an arrangement when the angle information is between 90 degrees and 180 degrees. 9 (c) shows the arrangement when the angle information is 90 degrees. The angle detection device 51 incorporates, for example, a variable resistor called a volume or a potentiometer as a sensor for detecting an angle. If a B-type volume in which the rotation angle and the resistance value are proportional is used as the volume, the rotation angle can be detected as the resistance value. Furthermore, this resistance value is detected as a voltage and used as angle information by A / D conversion. A rotary switch may be used as a sensor for detecting the angle.

  A method for detecting the representative observation position 31 representing the position of the observer will be described with reference to FIGS. First, FIG. 10 shows coordinate axes for expressing the position of the representative observation position 31. Three axes are represented by an X axis, a Y axis, and a Z axis, and the desktop screen 11 of the display device 1 is arranged on a plane where Z = 0. The desktop screen 11 is arranged in the region of X <0 and the virtual desktop screen 12 is arranged in the region of X> 0. Although not shown in FIG. 10, the desktop screen of the display device 2 is arranged in an area where Y> 0 in this case. Y = 0 is a position that matches the bottom of the desktop screen 11, and X = 0 is a point where the display device 1 and the display device 2 intersect. In the case of FIGS. The center point is X = 0. In this XYZ coordinate, the representative observation position 31 is expressed as (x1, y1, z1).

  As a method for obtaining (x1, y1, z1) of the representative observation position 31, the position detection device 52 is arranged on the display device 1 as shown in FIG. 11, and the detection result of the position detection device 52 is calculated by the calculation device 6. To obtain the representative observation position. For example, a camera device is used as the position detection device 52, and the face of the observer 3 is detected from the captured image by a known face detection technique on the calculation device 6 side, and the position of the representative observation position 31 is estimated therefrom. By doing so, the values of x1, y1, and z1 can be calculated. The number of position detection devices 52 is not limited to one, and a plurality of position detection devices 52 may be arranged to calculate the position of the representative observation position 31 by trigonometry.

  For example, as shown in FIG. 12, x1 is the central value on the X axis of the desktop screen 11 and y1 is the desktop without detecting all the information regarding x1, y1, and z1 by the position detection device 52. The central value on the Y-axis of the screen 11 may be used, and the representative observation position 31 may be detected only in the Z-axis direction. Furthermore, if only in the Z-axis direction, a mechanism is used for determination based on binary values of a short distance and a long distance. For example, z1 = 40 (cm) is determined for a short distance, and z1 = 80 ( You may set using the preset value of cm). When the determination is made based on the binary value of the short distance and the long distance, when the user is operating a keyboard (not shown) connected to the computing device 6 or an input signal from the keyboard is detected. After a certain period of time (for example, 3 minutes), it may be determined that the user is in the short distance state, and otherwise it may be determined that the user is in the long distance state.

  A method for generating a virtual desktop mapping screen will be described. An example of a desktop screen displayed on the display device 1 and the display device 2 will be described with reference to FIG. In the present embodiment, description will be made assuming that the display portion 1 and the display device 2 have the same length in the vertical direction and the same number of pixels. FIG. 13A shows a state where the desktop screen 11 is displayed. FIG. 13B shows a state in which the virtual desktop mapping screen 41 and the virtual desktop mapping screen 42 are displayed on the display device 2. The virtual desktop mapping screens 41 and 42 are trapezoidal. A method for obtaining the trapezoidal size will be described with reference to FIG. As shown in FIG. 14, the side 12 — a that is one side of the virtual desktop 12 corresponds to the side 41 — a of the virtual desktop mapping screen 41 in the display portion of the display device 2 when viewed from the representative observation position 31. Parameters necessary for calculating the side 41_a are the above-described angle θ between the display device 1 and the display device 2, and the position information of the representative observation position 31 that describes the position of the observer. On the other hand, for the side 41_b facing the side 41_a of the virtual desktop mapping screen 41, the size of the side 11_a of the desktop screen 11 that is continuous with the side 12_b of the virtual desktop screen 12 is used as it is, as shown in FIG. If side 41_a and side 41_b are determined for virtual desktop mapping screen 41 as shown in FIG. 16A, side 41_c and side 41_d are also automatically determined as shown in FIG. 16B, and the size of the trapezoid is determined. . The size of the virtual desktop mapping screen 42 is determined by the same method. The side 42_a of the virtual desktop mapping screen 42 corresponding to the side 13_a that is one side of the virtual desktop screen 13 is similarly the angle θ between the display device 1 and the display device 2 and the position of the representative observation position 31 that describes the position of the observer. Information can be obtained as a parameter. On the other hand, for the side 42_b opposite to the side 42_a of the virtual desktop mapping screen 42, the side 41_a of the virtual desktop mapping screen 41 already calculated is used. Also for the virtual desktop mapping screen 42, when the sides 42_a and 42_b are determined as shown in FIG. 17A, the sides 42_c and 42_d are also automatically determined as shown in FIG. To do.

  A configuration for generating a virtual desktop mapping screen in the computing device 6 will be described with reference to FIG. The calculation device 6 includes a frame buffer unit 71-1, 71-2, 71-n), a buffer data acquisition unit (72-1, 72-2, 72-n), and an image generation unit (image transformation unit 4-1, 74-2, 74- (n-1), composition processing unit 75), angle detection unit 77-1, representative observation position detection unit 77-2, and virtual desktop arrangement setting unit 76. Images generated as desktop screens 1 to N are held in the frame buffer units 1 to N (71-1, 71-2, 71-n), and buffer data acquisition units 1 to N (72-1, 72-2, 72-n) acquire the data of the respective desktop screens 1 to N. In the present embodiment, the image on the desktop screen 1 is displayed on the display device 1 as the desktop screen 11. On the other hand, the data of the desktop screens 2 to N is transformed into a trapezoid by the image transformation units 1 to N-1 (74-1, 74-2, 74- (n-1)). In the present embodiment, the case where N = 3 has been described so far. The desktop screen 2 corresponds to the virtual desktop screen 12 and the desktop screen 3 corresponds to the virtual desktop screen 13. A virtual desktop mapping screen 41 is generated from the deformation unit 1 (74-1), and a virtual desktop mapping screen 42 is generated from the image deformation unit 2 (74-2). The parameters for obtaining the size of the trapezoid are the angle θ between the display device 1 and the display device 2 and the position information of the representative observation position 31 indicating the position of the observer, and their detection units (angle θ detection unit) 77-1 and a representative observation position detection unit 77-2), yet another parameter is the position of the virtual desktop screen. 19 and 20 show a state in which the virtual desktop screen 13 is arranged so as to be perpendicular to the virtual desktop screen 12. If the arrangement of the virtual desktop screen can be changed by setting, the angle θ detection unit 77-1 is included in the image transformation units 1 to N-1 (74-1, 74-2, 74- (n-1)). The detected angle information, the position information detected by the representative observation position detection unit 77-2, and the arrangement information set by the virtual desktop arrangement setting unit 76 are input as parameters for obtaining the trapezoid size. In the synthesis processing unit 75 of the present embodiment, when output images from the image transformation units 1 to N-1 (74-1, 74-2, 74- (n-1)) are input, they are continuous. To be arranged. The synthesized image synthesized by the synthesis processing unit 75 is displayed on the display device 2. Here, the configuration using the layout information set by the virtual desktop layout setting unit 76 has been described, but the present invention can also be applied to a configuration that does not include the virtual desktop layout setting unit 76 as described above.

  In the display device 2, an area other than the virtual desktop mapping screen is defined as a virtual room area. FIG. 21 shows the relationship among the virtual desktop mapping screen 41, the virtual desktop mapping screen 42, and the virtual room area 43. In the case of the present embodiment, the desktop screen 4 may be prepared as a virtual desktop 33 (not shown) and used for the virtual room area 43. In the image transformation unit 3 (74-3), the desktop screen 4 is the size of the display part of the display device 2, and in the composition processing unit 75, the virtual room area 43 is the backmost screen as the background of another virtual desktop mapping screen. The composition process is performed so that the position is obtained.

  Images of the desktop screen 5 and the desktop screen 6 may be displayed like virtual windows 44 and 45 as shown in FIG. In this case, unlike the virtual room area 43, the image transformation units 4 and 5 (74-4 and 74-5) generate virtual windows 44 and 45 that are smaller than the size of the display portion of the display device 2, The composition processing unit 75 may perform the composition processing so that the virtual windows 44 and 45 are arranged in front of another virtual desktop mapping screen.

  A method for calculating the side 41_a of the virtual desktop mapping screen 41 in the display portion of the display device 2 from the side 12_a which is one side of the virtual desktop screen 12 will be described. As shown in FIG. 23, the position of the side 12_a on the X axis is L1, and the coordinates of the representative observation position 31 are (x1, y1, z1). It is assumed that the display portion of the display device 2 has an angle of θ as shown in FIG. Here, on the plane where Y = 0, the intersection of the straight line connecting the side 12_a ((L1,0,0)) and the representative observation position 31 ((x1,0, z1)) and the display part of the display device 2 is s0. Further, on the plane where Y = 0, the linear distance from the side 12_a ((L1,0,0)) to s0 is the distance from S1, s0 to the representative observation position 31 ((x1,0, z1)) is S2. And S1 and S2 can be calculated from L1, x1, z1, and θ. For example, S1 is as follows.

S1 = h / | z1 | × ((| x1 | + | L1 |) ² + (| z1 |) ² ) ^1/2
h = | L1 | / (1 / tanφ-1 / tanθ)
tanφ = | z1 | / (| L1 | + | x1 |)
As shown in FIG. 24A, on the plane of Y = 0, a straight line connecting the side 12_a ((L1,0,0)) and the representative observation position 31 ((x1,0, z1)) is defined as the S axis. Define and replace the Y-axis direction as the T-axis. The position of s0 at Y = 0 in the XYZ axis coordinates is set as a reference point (0, 0) on the ST coordinate axis. FIG. 24B shows the positions of the side 12_a and the representative observation position 31 on the ST coordinate axis. In FIG. 24, the length of the side 12_a is L2. That is, the position of the representative observation position 31 is (−S2, y1), and the side 12_a can be represented by two points (S1,0) and (S1, L2). It is possible to calculate (0, t1) and (0, t2) that are mappings on the T-axis of (S1,0) and (S1, L2). 25 and 26 show an example of the positional relationship between the side 12_a and the representative observation position 31, and how the trapezoidal size is obtained from the side 41_a and the side 41_b. FIG. 26C shows a state where an area that is not displayed on the display device 2 after the keystone deformation is deleted. In the case of FIG. 26C, the trapezoidal deformation unit 1 (74-1) obtains an undisplayable area after the trapezoidal deformation process is executed, and generates an image from which the undisplayable area is deleted.

  Hereinafter, a method for generating a virtual desktop mapping screen on the display screen 2 will be described with reference to FIGS. 27 to 30 show a processing procedure for generating a virtual desktop mapping screen. The parameters for generating the virtual desktop mapping screen are the angle θ between the display device 1 and the display device 2 and the representative observation position 31 describing the position of the observer.

  FIG. 27 shows a case where changes in the angle θ and the representative observation position 31 are always detected and used as parameters for generating a virtual desktop mapping screen. In this case, the angle between the display device 1 and the display device 2 is detected by the angle detection device 51 (S27-1), and the representative observation position of the observer 31 is detected by the position detection device 52 (S27-2). A virtual desktop mapping screen to be displayed on the display device 2 is generated by the image generation unit from the detected angle and the representative observation position (S27-3). This virtual desktop mapping screen is displayed on the display device 2.

  In FIG. 28, the angle θ is a value detected in the initial state as a parameter, but a change in the representative observation position 31 is always detected and the detected value is used as a parameter. The step of detecting the representative observation position of the observer 31 by the position detection device 52 using the value detected from the angle with the display device 2 (S28-1) (S28-2), the detected angle and the representative observation position Then, the step (S28-3) of generating a virtual desktop mapping screen to be displayed on the display device 2 by the image generation unit is repeatedly performed, and the virtual desktop mapping screen is displayed on the display device 2.

  In FIG. 29, the representative observation position 31 uses the value detected in the initial state as a parameter. However, the change in the angle θ is always detected, and the detected value is used as a parameter. Using the value obtained by detecting the representative observation position (S29-1), the angle detection device 51 detects the angle between the display device 1 and the display device 2 (S29-2), and the detected angle and the representative observation position. The step (S29-3) of generating a virtual desktop mapping screen to be displayed on the display device 2 by the image generation unit is repeatedly performed, and this virtual desktop mapping screen is displayed on the display device 2.

  FIG. 30 shows a case where the values detected in the initial state are used as parameters for both the angle θ and the representative observation position 31, and the angle between the display device 1 and the display device 2 is detected by the angle detection device 51 (S29). -1) and the value obtained by detecting the representative observation position of the observer 31 by the position detection device 52 (S29-1), the image generation unit displays the detected angle and the representative observation position on the display device 2. A virtual desktop mapping screen is generated (S29-3), and this virtual desktop mapping screen is displayed on the display device 2.

  The computing device 6 can be realized by causing a general computer to execute a program and operating with an arithmetic device or a storage device in the computer. This program (image display program) can be distributed through a communication line, or can be recorded and distributed on a recording medium such as a CD-ROM.

  In this way, when the second display is arranged at an angle rather than side-by-side on the main display, a continuous virtual desktop screen extending in the horizontal direction from the main display is displayed on the second display. Will come to be. In the limited area of the second display, it is possible to virtually display two or more desktop screens, to display a horizontally continuous one that continues from the main display, The user can recognize that it is continuous.

(Second Embodiment)
The second embodiment will be described below with reference to the drawings.
In the first embodiment, the display device 2 and the computing device 6 (main body in the PC) are connected by a dedicated cable for transmitting and receiving display images. In the second embodiment, the display device 2 ′ is connected. A case where the computer 6 and the computer 6 are connected via a network such as Ethernet (registered trademark) or wireless LAN will be described. The network is not limited to this, and for example, a short-range wireless communication method such as Bluetooth may be used. In the first embodiment, the vertical length and the number of pixels of the display portions of the display device 1 and the display device 2 are the same. However, in the second embodiment, the display device 2 ′ and the display device 1 are the same. A configuration in which the vertical length and the number of pixels are different from each other will be described. However, in this embodiment, in order to simplify the description, it is assumed that the vertical and horizontal aspect ratios in the number of pixels of the display device 1 and the display device 2 ′ are the same.

  Here, the configuration as described above will be described, but the display device 2 ′ and the calculation device 6 are connected by a cable, and the display device 2 ′ and the display device 1 have different lengths in the vertical direction and the number of pixels. Alternatively, the display device 2 ′ and the computing device 6 are connected via a network such as Ethernet (registered trademark) or a wireless LAN, and the vertical lengths of display portions of the display device 1 and the display device 2 and the number of pixels are the same. The same applies to.

  FIG. 31 shows a configuration example of the second embodiment. It is assumed that the display device 2 ′ is not connected to the computing device 6 by a dedicated cable, but is connected to a network (not shown). FIG. 31A shows a state where the display device 2 ′ is arranged separately, and FIG. 31B shows a state where the display device 2 ′ is connected to the angle detection device 51. Various methods are conceivable for connecting the display device 2 ′ to the angle detection device 51. For example, a groove may be provided in the angle detection device 51, and the display device 2 ′ may be inserted therein (see FIG. Not shown). In the present embodiment, description will be made assuming that the display device 1 and the display device 2 ′ are connected so that the positions of the bottoms of the display portions coincide with each other.

  A configuration for generating a virtual desktop mapping screen in the computing device 6 will be described with reference to FIG. In this embodiment, the amount of information for transmitting the image synthesized by the synthesis processing unit 75 as a video to the network is compressed by the video compression unit 78-1. As a specific example, the video is compressed and encoded into MPEG4 or motion JPEG format. The video data compressed by the video compression unit 78-1 is transmitted to the network 9 as packet data to which the network address of the display device 2 'is added according to a communication protocol such as UDP by the network transmission / reception unit 78-2.

  A configuration for displaying video data received from the calculation device 6 in the display device 2 'will be described with reference to FIG. The network transmission / reception unit 78-2 'receives packet data addressed to the display device 2' in accordance with a communication protocol such as UDP, and the video decompression unit 78-3 performs decompression processing on the received data. For example, if the received data is video data compressed to MPEG4, it is decompressed and decoded into uncompressed video data. The video reproduction unit 73-2 reproduces the uncompressed video data, and the display device 2 'displays the video data.

  A case where the display portion 1 and the display device 2 'are different in the length in the vertical direction and the number of pixels will be described with reference to FIG. In FIG. 34A, since the display device 1 and the display device 2 'have the same size, the display on the desktop screen 11 of the display device 1 and the virtual desktop mapping screen 41 of the display device 2' are continuous. On the other hand, FIG. 34 (b) shows a case where the size of the display device 2 ′ is larger than the display device 1, and FIG. 34 (c) shows a case where the size of the display device 2 ′ is smaller than the display device 1. In the configuration of the first embodiment, the display of the desktop screen 11 of the display device 1 and the virtual desktop mapping screen 41 of the display device 2 ′ are discontinuous as they are.

  Therefore, in the present embodiment, as shown in FIG. 33, a configuration information generation unit 79-2 is provided in the display device 2 ′, and the configuration information generation unit 79-2 is arranged in the vertical direction of the display portion of the display device 2 ′. Information regarding the length and the number of pixels is transmitted as configuration information to the computing device 6 using the network transceiver 78-2 ′. On the other hand, on the computing device 6 side, as shown in FIG. 32, a configuration information analysis unit 79-1 is provided. When the network transmission / reception unit 78-2 receives configuration information from the display device 2 ′ via the network 9, The configuration information analyzing unit 79-1 analyzes the received configuration information. Assume that the received configuration information includes information that the vertical length of the display portion of the display device 2 ′ is H 2 and the number of vertical pixels is P 2. On the other hand, it is assumed that the configuration information analysis unit 79-1 is preset with information that the vertical length of the display portion of the display device 1 is H1 and the number of pixels in the vertical direction is P1.

When H2 = H1 and P1 = P2, it is as shown in the first embodiment.
When H2 = H1 and P1 ≠ P2, the composition processing unit 75 performs pixel complementation or thinning to convert the pixels into continuously displayable pixels on the display device 2 ′.

  When H2 ≠ H1 and P1 = P2, the configuration information analysis unit 79-1 performs the following process. In the case of H2> H1, in the display device 2 ', only the pixel of P1 × H1 / H2 is used in the vertical direction with reference to the bottom of the display portion. Therefore, when information (H 1 / H 2 times) in length ratio is input to the image deformation unit (for example, image deformation unit 1 (74-1)) (via the virtual desktop arrangement setting unit 76 in FIG. 32), the image The deforming unit (for example, the image deforming unit 1 (74-1)) generates a virtual desktop mapping screen having a length ratio of H1 / H2 times and an area ratio of (H1 / H2) × (H1 / H2) times. A virtual desktop mapping screen having an area ratio of (H1 / H2) × (H1 / H2) times is synthesized by the synthesis processing unit 75, and then processed by the video compression unit 78-1 and the network processing unit 78-2. Thereafter, it is sent to the display device 2 ′ via the network 9. For example, when the information of H1 / H2 times is not used, if the virtual desktop mapping screen 41 as shown in FIG. 34B is displayed on the display device 2 ′, the processing of this embodiment is performed, A virtual desktop mapping screen 41 as shown in FIG. 35B is displayed on the display device 2 ′, and the screens of the display device 1 and the display device 2 are displayed continuously. On the other hand, in the case of H2 <H1, if the continuity of the desktop screen 11 of the display device 1 and the virtual desktop mapping screen 41 of the display device 2 ′ is to be given, the display device 2 ′ is shown in FIG. A virtual desktop mapping screen 41 as shown may be displayed. In this case, a virtual desktop mapping having a length ratio of H1 / H2 times and an area ratio of (H1 / H2) × (H1 / H2) times in the image deformation unit (for example, image deformation unit 1 (74-1)). When the screen is generated, processing is performed so that a portion that cannot be actually displayed is cut. In the present embodiment, since the virtual desktop mapping screen 41 shown in FIG. 35B or FIG. 35B appears to be continuous with the desktop screen 11 of the display device 1, the composition processing unit 75. In this case, the lower left of the display part of the display device 2 ′ is used as a reference point, and the synthesis process is performed so that the virtual desktop mapping screen 41 is arranged there. However, when the height positions of the bottoms of the display portions of the display device 1 and the display device 2 ′ do not match, the information about the reference point is taken as one piece of configuration information, and the display device 2 ′ and the display device 1 are displayed. You may communicate with

  Thus, according to the second embodiment, when the display device 2 ′ and the calculation device 6 are connected via a network such as Ethernet (registered trademark) or wireless LAN, or the display device 2 ′ and the display device 1 Even when the length in the vertical direction and the number of pixels are different, a continuous virtual desktop screen that continues in the horizontal direction from the main display is displayed on the second display. The second display can display a horizontally continuous one that continues from the main display, and the user can recognize that it is continuous.

  Hereinafter, the setting interface of the embodiment will be described with reference to FIG. In the first embodiment, the mechanism for determining the representative observation position 31 based on the binary values of the short distance and the long distance only in the Z-axis direction has been described. However, the distance is long when a specific instruction is received from the observer 3. Otherwise, it may be determined as a short distance (for example, z1 = 40 (cm)). FIG. 36 shows an example of a method for setting a long distance. FIG. 36 shows an interface screen for the user (observer 3) to make settings. In this embodiment, parameters can be input to the virtual desktop arrangement setting unit 76 from this interface screen (setting screen 8). For example, a radio button 81_1 for instructing “viewpoint: long distance” is prepared on the setting screen 8. When the user turns on the radio button 81_1, the virtual desktop layout setting unit 76 detects that a long distance has been set, and can be used as an estimated value (for example, z1 = 80 (cm)) of the representative observation position 31. .

  In the first embodiment, FIG. 19 and FIG. 20 are used to show a state in which the virtual desktop screen 13 is arranged so as to be perpendicular to the virtual desktop screen 12. As an example of a method of changing the arrangement of the virtual desktop screen, the user may be able to change the arrangement of the virtual desktop by “Desktop arrangement setting” on the setting screen 8 shown in FIG. In FIG. 36, two radio buttons (radio buttons 82_1 and 82_2) are prepared and selected by the user. However, the present invention is not limited to this, and the present invention is not deviated from the gist of the embodiment. Is applicable. Various inventions may be formed by appropriately combining a plurality of constituent elements disclosed in the above-described embodiments, for example, a configuration in which some constituent elements are excluded from all the constituent elements shown in the embodiments. The constituent elements over different embodiments may be appropriately combined.

The figure which shows a mode that a user uses one display apparatus The figure which shows a mode that a user uses two display apparatuses. Diagram explaining the number of display devices and the number of desktop screens that can be displayed The figure which shows arrangement | positioning of the display apparatus 1 and the display apparatus 2 which concern on the 1st Embodiment of this invention. 1st figure explaining the screen displayed on the display apparatus 2 which concerns on the 1st Embodiment of this invention. 2nd figure explaining the screen displayed on the display apparatus 2 which concerns on the 1st Embodiment of this invention. The figure explaining having made the position of the observer 3 which concerns on the 1st Embodiment of this invention into one point. The figure which shows an example of the system configuration | structure which consists of the display apparatus 1 and the display apparatus 2 which concern on 1st Embodiment of this invention. The figure which shows a mode that the arrangement | positioning angle of the display apparatus 1 and the display apparatus 2 which concerns on 1st Embodiment of this invention is changed. 1st figure for demonstrating a position using the coordinate axis which concerns on 1st Embodiment of this invention. The figure which shows another example of the system configuration | structure which consists of the display apparatus 1 and the display apparatus 2 which concern on 1st Embodiment of this invention. 2nd figure for demonstrating a position using the coordinate axis which concerns on 1st Embodiment of this invention. The figure which shows an example of the screen displayed on the display apparatus 1 and the display apparatus 2 which concern on 1st Embodiment of this invention. 3rd figure for demonstrating a position using the coordinate axis which concerns on 1st Embodiment of this invention. 4th figure for demonstrating a position using the coordinate axis which concerns on 1st Embodiment of this invention. 1st figure which shows the method of calculating | requiring the size of the trapezoid based on 1st Embodiment of this invention. 2nd figure which shows the method of calculating | requiring the size of the trapezoid based on 1st Embodiment of this invention. The figure which shows the internal structure of the calculation apparatus 6 which concerns on 1st Embodiment of this invention. 3rd figure explaining the screen displayed on the display apparatus 2 which concerns on 1st Embodiment of this invention. 4th figure explaining the screen displayed on the display apparatus 2 which concerns on 1st Embodiment of this invention. 5th figure explaining the screen displayed on the display apparatus 2 which concerns on 1st Embodiment of this invention. 6th figure explaining the screen displayed on the display apparatus 2 which concerns on 1st Embodiment of this invention. 5th figure for demonstrating a position using the coordinate axis which concerns on 1st Embodiment of this invention. 6th figure for demonstrating a position using the coordinate axis which concerns on 1st Embodiment of this invention. 1st figure which shows the method of calculating | requiring the size of the trapezoid displayed on the display apparatus 2 which concerns on 1st Embodiment of this invention. The 2nd figure which shows the method of calculating | requiring the size of the trapezoid displayed on the display apparatus 2 which concerns on 1st Embodiment of this invention. The figure which shows the 1st process sequence which produces | generates the screen on the display screen 2 which concerns on the 1st Embodiment of this invention. The figure which shows the 2nd process sequence which produces | generates the screen on the display screen 2 which concerns on the 1st Embodiment of this invention. The figure which shows the 3rd process sequence which produces | generates the screen on the display screen 2 which concerns on 1st Embodiment of this invention. The figure which shows the 4th process sequence which produces | generates the screen on the display screen 2 which concerns on 1st Embodiment of this invention. The figure which shows an example of the system configuration | structure which consists of the display apparatus 1 and display apparatus 2 'which concern on 2nd Embodiment of this invention. The figure which shows the internal structure of the calculation apparatus 6 which concerns on 2nd Embodiment of this invention. The figure which shows the internal structure of the display apparatus 2 'which concerns on 2nd Embodiment of this invention. The figure explaining an example of the screen displayed on the display apparatus 1 and the display apparatus 2 ' The figure which shows an example of the screen displayed on the display apparatus 1 and display apparatus 2 'which concern on 2nd Embodiment of this invention. The figure which shows an example of the setting interface screen which concerns on embodiment

Explanation of symbols

1, 2, 2 '... display devices 11, 21 ... desktop screens 12, 13 ... virtual desktop 41, 42 ... virtual desktop mapping screen 3 ... observer 31 ... representative observation position 51 ... angle detection device 52 ... Position detection device 6 ... Calculation devices 71-1, 71-2, 71-n ... Frame buffer units 72-1, 72-2, 72-n ... Buffer data acquisition unit 73-1 ... Display Processing unit 73-2 Video playback units 74-1, 74-2, 74- (n-1) Image transformation unit 75 Composition processing unit 76 Virtual desktop layout setting unit 77-1 Angle Detection unit 77-2 ... Representative observation position detection unit 78 ... Video transmission processing unit 78-1 ... Video compression units 78-2 and 78-2 '... Network transmission / reception unit 78-3 ... Video expansion unit 79- 1 ... Confy Configuration information analyzing unit 79-2 ‥‥ configuration information generation unit 8 ‥‥ setting screen 81_1,82_1,82_2 ‥‥ radio buttons 9 ‥‥ network

Claims (9)

A first display for displaying a first screen;
A second display for displaying a second screen adjacent to the first screen;
An angle detection unit for detecting an arrangement angle between the first display unit and the second display unit;
A position detector for detecting the position of the observer;
An image generation unit that generates a second screen by deforming a screen adjacent to the first screen in a parallel direction from the arrangement angle detected by the angle detection unit and the position detected by the position detection unit. An image display device comprising: A first display for displaying a first screen;
A second display for displaying a second screen adjacent to the first screen;
An angle detection unit for detecting an arrangement angle between the first display unit and the second display unit;
A position setting unit for setting the position of the observer;
An image generation unit configured to generate a second screen by deforming a screen adjacent to the first screen in a parallel direction using the arrangement angle detected by the angle detection unit and the position set by the position setting unit as parameters; An image display device comprising: Furthermore, an arrangement position setting unit for setting an arrangement position of a screen adjacent in the parallel direction of the first screen is provided,
The image generation unit generates a second screen by deforming a screen adjacent in the parallel direction of the first screen from the arrangement angle, the position, and the arrangement position set by the arrangement position setting. The image display device according to claim 1, wherein the image display device is a display device.   The image generation unit trapezoidally deforms the screens adjacent to each other in the parallel direction of the first screen so that the length of the portion where the first screen and the second screen contact is the same as viewed from the observer. The image display device according to claim 1, wherein the second screen is generated.   5. The image generating unit enlarges or reduces the second screen according to a ratio of display screen sizes of the first display unit and the second display unit. The image display device described. Detecting an arrangement angle between the first display unit and the second display unit by an angle detection unit;
Detecting the position of the observer with a position detector;
Based on the arrangement angle detected by the angle detection unit and the position detected by the position detection unit, a screen adjacent to the parallel direction of the screen displayed on the first display unit is deformed, and the second display unit Generating a second screen to be displayed by the image generation unit. Detecting an arrangement angle between the first display unit and the second display unit by an angle detection unit;
Setting the position of the observer in the position setting unit;
From the arrangement angle detected by the angle detection unit and the position set by the position setting unit, a screen adjacent to the parallel direction of the screen displayed on the first display unit is deformed, and the second display unit Generating a second screen to be displayed by the image generation unit. A program for generating a screen to be displayed on the second display unit in an image display system comprising a first display unit and a second display unit,
Detecting an arrangement angle between the first display unit and the second display unit by an angle detection unit;
Setting the position of the observer in the position setting unit;
From the arrangement angle detected by the angle detection unit and the position set by the position setting unit, a screen adjacent to the parallel direction of the screen displayed on the first display unit is deformed, and the second display unit An image display program for causing a computer to execute a step of generating a second screen to be displayed on the image generation unit. A program for generating a screen to be displayed on the second display unit in an image display system comprising a first display unit and a second display unit,
Detecting an arrangement angle between the first display unit and the second display unit by an angle detection unit;
Setting the position of the observer in the position setting unit;
From the arrangement angle detected by the angle detection unit and the position set by the position setting unit, a screen adjacent to the parallel direction of the screen displayed on the first display unit is deformed, and the second display unit An image display program for causing a computer to execute a step of generating a second screen to be displayed on the image generation unit.