JP2005149175A - Display controller and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To adjust the display magnification of image data so that the image data are apparently the same size when the image data of the same size are displayed in parallel on a plurality of display screens of different resolution, even if the display screens are arranged in different positions or if the distance between each display screen and the visual line position of the user varies. <P>SOLUTION: In cases where image data of the same size are displayed in parallel on a plurality of displays 6 of different resolution, when the distance between each display 6 and the visual line position of the user is measured by a distance measuring device 7, a CPU 1 varies the display magnification of the image data according to the distance measured for each display 6 and the resolution of each display, so that the image data are of the same apparent size for each display. At the magnification varied, the image data are redisplayed on the corresponding display 6. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a display control device and a program for displaying image data on a display screen.

Conventionally, as an image display device that displays image data on a plurality of display screens, for example, a multi-display device is known in which image interruption at a boundary portion of each display unit is prevented by controlling an optical system ( Patent Document 1). In addition, there is a display screen that displays a pre-stored body part of a human body as a three-dimensional image and a display screen that displays a head face image photographed as a real image in two dimensions. An image display method in which a screen of a three-dimensional image is synthesized is known (see Patent Document 2).
JP-A-10-289252 JP 2001-166663 A

 However, in each of the above-described techniques of Patent Documents 1 and 2, it is assumed that image data is displayed on a plurality of screens. However, Patent Document 1 prevents image interruption at a boundary portion. In addition, Patent Document 2 is a technique for completing a whole body image of a human body by synthesizing a two-dimensional image screen with a three-dimensional image screen.

By the way, when displaying image data on a plurality of screens, for example, each image data such as a front view, a right side view, and a left side view of an object is displayed in parallel on a plurality of display screens (displays) Thus, when displaying landscape images according to the field of view viewed from the front, right, left, etc. in parallel on multiple displays, if the distance between the user and the display is greatly different for each display, it is essentially the same Image data, which should be the size, can be seen in different sizes for each display.
In addition, when a transparent screen is provided on the windshield of an automobile and an object representing a traffic sign or the like is displayed on the scenery in the field of view seen through the transparent screen, the distance between the driver's line-of-sight position and the transparent screen Each time the line-of-sight position (eye position) fluctuates, the apparent size and display position of the object change greatly, and there is a risk of misidentifying the sign.

The subject of the first invention is that when image data of the same size is displayed in parallel on a plurality of display screens having different resolutions, the arrangement positions of the display screens are shifted from each other, or each display screen and the line-of-sight position of the user The display magnification of each image data can be adjusted so that each image data has the same size even if the distance between the image data and the image data fluctuates.
According to a second aspect of the present invention, in a state where an object is displayed on the display screen based on the currently set display magnification and display position, the viewpoint distance from the user's line-of-sight position to the display screen varies. Even if the line-of-sight position fluctuates, it is possible to adjust the display magnification and the display position that are currently set so that the object appears to have the same size and the same position.

The invention according to claim 1 (first invention) is a display control device for displaying image data of the same size in parallel on a plurality of display screens having different resolutions, between each display screen and a user's line-of-sight position. The measurement means for measuring and monitoring the distance of each screen, and the apparent size of each image data is the same for each display screen based on the distance for each display screen measured by this measurement means and the resolution of each display screen A change means for changing the display magnification of the image data and a display control means for redisplaying the image data on the corresponding display screen at the change magnification obtained for each display screen by the change means are provided.
Furthermore, a program for realizing the main functions shown in the above-described invention according to claim 1 is provided to the computer (the invention according to claim 4).

The invention described in claim 1 may be as follows.
The changing means calculates a distance ratio based on the measured distance for each display screen, calculates a resolution ratio based on the resolution of each display screen, and determines each display screen based on the distance ratio and the resolution ratio. The display magnification of the image data is changed to (Invention of Claim 2).

  Image data of the same size displayed in parallel on multiple display screens with different resolutions is image data for each direction when the object is viewed from multiple directions, or the direction when the surroundings are viewed in multiple directions by changing the line of sight The image data for different directions is displayed in parallel on a display screen arranged in association with the direction (invention of claim 3).

The invention according to claim 5 (second invention) is a display control apparatus for displaying an object as image data on a display screen based on a display magnification and a display position which are currently set. It is currently set when the viewpoint distance from the position to the display screen is measured, and the variation of the viewpoint distance is detected based on the measurement means that measures the line-of-sight position and the measurement result obtained by this measurement means. Display magnification changing means for changing the display magnification in accordance with the amount of change, and when a change in line-of-sight position is detected based on the measurement result obtained by the measurement means, the currently set display position is changed. A display position changing means that changes according to the amount, and an object on the display screen based on the change magnification and the change position changed by the display magnification changing means and the display position changing means. Characterized by comprising a display control means for re-displaying the door.
Furthermore, a program for realizing the main functions shown in the invention described in claim 5 is provided to the computer (the invention described in claim 8).

The invention described in claim 5 may be as follows.
Having first and second display screens that display mutually related contents, and arbitrarily specifying each corresponding position on the second display screen corresponding to a plurality of object positions on the first display screen The display currently set for the object on the first display screen so that each object position on the first display screen and each corresponding position on the second display screen are relatively matched by The magnification and the display position are adjusted (the invention according to claim 6).

 The display screen that displays the object is a transparent screen provided on the windshield of the vehicle. In the field of view that can be seen through this transparent screen, the existing signs are simulated and the route is changed. The virtual object for instructing is displayed in a superimposed manner (the invention according to claim 7).

  According to the first aspect of the present invention, when image data of the same size is displayed in parallel on a plurality of display screens having different resolutions, when the distance between each display screen and the user's line-of-sight position is measured, Based on the measurement distance for each display screen and the resolution of each display screen, the display magnification of the image data is changed so that the apparent size of each image data is the same, and the image data is restored to the corresponding display screen at this changed magnification. Since the display positions are shifted from each other or the distance from the user's line-of-sight position fluctuates, each image data is apparently the same size. The display magnification of the image data can be adjusted, and the apparent size can always be kept constant without being influenced by the arrangement state of each display screen and the position variation of the user.

According to the invention described in claim 2, in addition to having the same effect as the invention described in claim 1,
The distance ratio is calculated based on the measured distance for each display screen, the resolution ratio is calculated based on the resolution of each display screen, and the display magnification of the image data is displayed for each display screen based on the distance ratio and the resolution ratio. Therefore, it is possible to more reliably perform parallel display of the same size.

According to the invention described in claim 3, in addition to having the same effect as that of the invention described in claim 1, the image data or the line of sight for each direction when the object is viewed from a plurality of directions is changed to a plurality of directions. Since the image data for each direction when viewing the surroundings is displayed in parallel on the display screen arranged in association with the direction, each image such as a front view, a right side view, and a left side view of the object is displayed. As with data or flight simulator games, you can display landscape images for different fields of view, such as forward, right, and left, in a realistic manner while synchronizing the display magnification to the corresponding screen. Is possible.
When arranging the display screens by direction, the screen arranged in the center, the screen arranged on the right side thereof, and the screen arranged on the left side may be arranged in a straight line. If the direction corresponds to the data, the arrangement method is arbitrary.

  According to the fifth aspect of the present invention, in the state where the object as the image data is displayed on the display screen based on the currently set display magnification and display position, from the user's line-of-sight position to the display screen. When a change in the viewpoint distance is detected, the currently set display magnification is changed according to the amount of the change, and when a change in the user's gaze position is detected, the currently set display position Is changed according to the amount of change, and the object is redisplayed on the display screen based on the change magnification and change position, so that the viewpoint distance from the user's line-of-sight position to the display screen changes, Even if the line-of-sight position fluctuates, the display magnification and the display position that are currently set are adjusted so that the object appears to be the same size and the same position. It is possible.

  According to the sixth aspect of the present invention, the first display has the first and second display screens which display the contents related to each other, in addition to the same effects as the above-described fifth aspect of the present invention. By arbitrarily designating each corresponding position on the second display screen corresponding to a plurality of object positions on the screen, each object position on the first display screen and each corresponding position on the second display screen Since the display magnification and the display position that are currently set for the object on the first display screen are adjusted so that the two match relatively, the relative to the first and second display screens The display magnification and the display position of the object can be changed while maintaining this relationship.

  According to the seventh aspect of the invention, in addition to the same effects as the fifth aspect of the invention described above, the transparent screen provided on the windshield of the vehicle is used as a display screen for displaying objects, and the transparent screen is transparent. Since the virtual object for guiding the direction change etc. is superimposed on the scenery in the field of view that is seen, and the virtual object for instructing to change the course is displayed, it is displayed from the driver's line of sight to the transparent screen. Even if the viewpoint distance changes or the line-of-sight position changes, the object can be apparently adjusted to have the same size and the same position, and an effective guidance display for safe driving becomes possible.

(Example 1)
A first embodiment of the present invention will be described below with reference to FIGS.
FIG. 1 is a block diagram showing basic components of the image control apparatus in this embodiment.
This image control device controls a plurality of display devices having different resolutions. When image data of the same size is displayed in parallel on each display device, the arrangement positions of the display devices are shifted from each other, Even if the distance between the apparatus and the user's line-of-sight position fluctuates, the display magnification of each image data is adjusted so that each image data is apparently the same size.
Before detailed description of the features of this embodiment, the hardware configuration of this embodiment will be described below.

  The CPU 1 is a central processing unit that controls the overall operation of the image control apparatus in accordance with the operating system and various application software in the storage unit 2. The storage unit 2 has a program storage area and a data storage area and has a drive system in addition to a magnetic / optical memory and a semiconductor memory. The program storage area in the storage unit 2 stores an application program for realizing the present embodiment in accordance with an operation procedure shown in FIGS. 6 to 8 described later, and the data storage area in the storage unit 2 stores the application program. The data (display information table, image data information table, display state information table) shown in FIGS. 3 to 5 described later are stored. The storage unit 2 may be a detachable storage medium such as a CD-ROM or DVD, in addition to a fixed memory such as a hard disk. Programs and data in the storage unit 2 are loaded into a RAM (for example, static RAM) 3 as necessary, or data in the RAM 3 is saved in the storage unit 2. The RAM 3 has a program execution area and a work area.

Further, the CPU 1 can directly access a program / data on the other electronic device side via the communication device 4 or can download and receive the program / data via the communication device 4. On the other hand, the communication device 4, the input device 5, the plurality of display devices 6, and the distance measuring device 7, which are input / output peripheral devices, are connected to the CPU 1 through a bus line. It controls the operation of these input / output devices. The input device 5 is an operation unit that constitutes a pointing device such as a keyboard, a touch panel, a mouse, or a touch input pen, and inputs character string data and various commands.
The plurality of display devices (displays) 6 are, for example, a liquid crystal display device (LCD) that performs full-color display, a CRT display device, a plasma display device, and the like, each having a different resolution (dot size / dot pitch of the entire screen). . The plurality of displays 6 and the CPU 1 are connected via a wired transmission path such as a cable or a wireless transmission path such as radio waves and infrared rays.

  The distance measuring device 7 measures the distance from the user's line-of-sight position (eye position) to each display 6 to each display 6, and in this embodiment, the reflection when an ultrasonic pulse is generated. An ultrasonic measuring device that measures distance based on waves is used. In this case, the distance measuring device 7 calculates the distance from the line-of-sight position to each display 6 by analyzing the surrounding echo state with the user at the center, and gives the measurement distance for each display to the CPU 1. However, the analysis of the echo state and the calculation of the measurement distance may be performed on the CPU 1 side. The distance measuring device 7 is not limited to the ultrasonic measuring device but may be an infrared measuring device provided for each display 6.

FIG. 2 is a diagram showing the disposition state of each display 6 and the distance relationship between each display 6 and the user's line-of-sight position.
In the illustrated example, a landscape image according to visual field such as a forward direction, a right direction, and a left direction is displayed in parallel on the display 6 arranged in association with the direction as in a flight simulator game. That is, the three displays 6 are arranged in the forward direction, the right direction, and the left direction with respect to the user who sees the screen, and the right direction and left direction displays 6 are obliquely oriented with respect to the front display 6. Is arranged. Then, assuming that the distance from the user to the front display 6 is “A”, the distance to the right display 6 is “B”, and the distance to the left display 6 is “C”, In the example, the relationship is A>B> C.

 In this case, the CPU 1 acquires the measurement distance measured by the distance measurement device 7 so that the apparent size of each image data is the same for each display based on the measurement distance for each display and the resolution of each display 6. The display magnification of the image data is changed, and the changed image data enlarged / reduced by the change magnification for each display is displayed again on the corresponding display 6. That is, the distance ratio is calculated based on the measurement distance for each display, the resolution ratio is calculated based on the resolution of each display 6, and the display magnification of the image data is changed for each display based on the distance ratio and the resolution ratio. By doing so, the display magnification is adjusted so that the apparent size of each image data becomes the same.

FIG. 3 is a diagram showing the contents of the display information table 11.
The display information table 11 stores and manages the resolution corresponding to a plurality of displays 6. For each display, “display device name”, “resolution (number of display dots on the entire screen)”, “resolution ( Dot pitch) ”. In the example shown in the drawing, “display 1024 × vertical 768 dots” is set as “resolution (number of display dots on the entire screen)” and “display device name” is “CRT1”. “Resolution (dot pitch)” is set to “0.24”, and “LCD2” display is set to “resolution (number of display dots on the entire screen)” “horizontal 640 × vertical 400 dots” In addition, “0.36” is set as “resolution (dot pitch)”.

FIG. 4 is a diagram showing the contents of the image data information table 12.
This image data information table 12 manages various image data as display objects, and stores “image data name”, “total number of dots”, and “bitmap image data” for each image data. It has become. “Number of whole image dots” indicates the vertical and horizontal dot sizes of the entire image data. “Bitmap image data” is an actual data pattern, and indicates a frame image when the image data is a moving image. It should be noted that the same “image data name” is set in the landscape image for each field of view such as forward direction, right direction, and left direction in the flight simulator game.

FIG. 5 is a diagram showing the contents of the display state information table 13.
The display state information table 13 manages the current state of the image data displayed on each display 6. For each display 6, “display device name”, “display image data name”, “enlargement / reduction”. It is configured to store “magnification” and “display offset position”. “Display device name” indicates a display on which image data is displayed. “Enlargement / reduction magnification” indicates the current display magnification, and its default value is “1”. “Display offset position” indicates a reference position on a video memory (not shown).

  Next, the operation concept of the display control apparatus in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. In addition, the operation according to the above-described program code transmitted via the transmission medium can be sequentially executed. In other words, in addition to the recording medium, the program / data supplied externally via the transmission medium can be used to execute the operation specific to this embodiment.

FIG. 6 is a flowchart showing display magnification synchronization processing for the plurality of displays 6.
Now, assume that the image data information table 12 stores and manages landscape-specific landscape images such as forward direction, right direction, and left direction in the flight simulator game. Each image data is image data having the same “total number of dots”, and the same “image data” as the “display image data name” in the display state information table 13 corresponding to each image data. It is assumed that “1” is set and the default value “1” is set as “enlargement / reduction ratio”.
In this state, the CPU 1 displays each image data having “display image data name” “image data 1” on the corresponding display 6, according to the resolution (dot pitch) of each display 6. A process for calculating the enlargement / reduction ratio is performed every time (step A1).

FIG. 7 is a flowchart showing a process for calculating the enlargement / reduction ratio for each display 6.
First, the CPU 1 designates the display 6 where the mouse cursor is currently located or the display 6 stored at the head in the display information table 11 as the main display, and the “enlargement / reduction magnification” corresponding to this designated display. : B1 "is read from the display state information table 13 (step B1), and one display other than the main display is selected as a sub display (step B2). Then, the “resolution (dot pitch)” of the main display and the sub display is read from the display information table 11, and the process of calculating the “enlargement / reduction ratio: B2” of the sub display with respect to the main display is performed (step B3).

 In this case, if the dot pitch of the main display is “A1” and the dot pitch of the slave display is “A2”, the “enlargement / reduction ratio” of the slave display is calculated by the formula B2 = B1 * A1 / A2. Desired. Initially, since “1” is set as the default value for “enlargement / reduction ratio: B1” corresponding to the main display, the “enlargement / reduction ratio” of the slave display is a value corresponding to the difference in resolution. . Then, it is checked whether or not there is another unselected slave display (step B4). If there is a slave display, the process returns to step B2 to repeat the above operation.

 Thus, when the process of calculating the enlargement / reduction ratio for each display 6 is completed, the CPU 1 activates the distance measuring device 7 to start measurement of the distance from the user's line-of-sight position to each display 6 (FIG. 6 step A2). Thus, when the distance from the line-of-sight position is measured for each display 6, the distance L1 between the main display 6 and the line-of-sight position is acquired from the distance (step A3), and after selecting one sub-display (step A3) A4) A distance L2 between the slave display and the line-of-sight position is acquired (step A5). Then, a distance ratio between the measurement distance L1 of the main display and the measurement distance L2 of the slave display is calculated (step A6). Thereafter, it is checked whether there is another unselected slave display (step A7). If there is a slave display, the process returns to step A4 and the above-described operation is repeated.

 When the process of calculating the distance ratio of each slave display to the master display is completed in this way, the process of correcting the enlargement / reduction ratio calculated in step A1 based on the distance ratio is executed for each slave display. (Step A8). In this case, the enlargement / reduction ratio is corrected so that the apparent sizes of the image data are the same, but at this time, correction is performed in consideration of “distance ratio * coefficient”. Then, a process of updating each “enlargement / reduction magnification” in the display state information table 13 to the correction value is executed for each slave display (step A9). As a result, each “enlargement / reduction magnification” in the display state information table 13 is updated to a value corresponding to the resolution ratio and the distance ratio. Next, the process proceeds to the image data enlargement / reduction display process (step A12) shown in FIG. 8. At this time, any display 6 is designated (step A10), and all the displays 6 have been designated. (Step A11), and the image data enlargement / reduction display process (step A12) is repeated until all the displays 6 have been designated.

FIG. 8 is a flowchart detailing the enlargement / reduction display processing of image data.
First, the CPU 1 designates one of the displays 6 and acquires image data to be displayed on the designated display. In this case, the “display image data name” associated with the “display device name” of the designated display. Is read from the display state information table 13 and the corresponding “bitmap image data” is read by accessing the image data information table 12 based on this “display image data name” (step C1). Then, “enlargement / reduction magnification” corresponding to the designated display is read from the display state information table 13 (step C2), and processing for enlarging / reducing the dot size of the entire image is performed according to this “enlargement / reduction magnification” ( Step C3) In this case, the image size is changed by a normal method of complementing / decimating the color data of the intermediate dot position so that the total number of dots of the image data becomes the updated “enlargement / reduction magnification”. .

 Next, after the “display offset position” corresponding to the designated display is read from the display state information table 13 (step C4), the designated display is displayed in order to display the enlarged / reduced image data based on the “display offset position”. The corresponding video memory is accessed, and the enlarged / reduced image data is expanded in the video memory with reference to the “display offset position” on the video memory (step C5). As a result, image data having a size indicated by “enlargement / reduction magnification” is displayed at the “display offset position” on the designated display. When the enlargement / reduction display processing of image data is completed for each display 6 in this way, the process returns to step A12 in FIG. 6 to start distance measurement again, and the above-described operation is repeated thereafter.

  As described above, in the first embodiment, when the CPU 1 displays image data of the same size on a plurality of displays 6 having different resolutions in parallel, the distance between each display 6 and the user's line-of-sight position is a distance. When measured by the measuring device 7, the display magnification of the image data is changed so that the apparent size of each image data is the same for each display based on the measurement distance measured for each display and the resolution of each display. Since the image data is re-displayed on the corresponding display at the change magnification, even if the position of each display is shifted from each other or the distance between each display and the user's line of sight varies, The display magnification of each image data can be adjusted so that the image data looks the same size. Not being affected by the positional variations of and users, always, it is possible to keep the size of the apparent constant.

  In this case, the distance ratio is calculated based on the distance measured for each display, the resolution ratio is calculated based on the resolution of each display screen, and the image data of each display screen is calculated based on the distance ratio and the resolution ratio. Since the display magnification has been changed, parallel display of the same size can be performed more reliably, and landscape images for different fields of view, such as forward, right, and left, are supported as in a flight simulator game. The display magnification can be synchronized with the display magnification, and the display can be realized in reality, and a stereoscopic or realistic display can be achieved.

  As image data to be displayed in parallel, for example, image data such as a front view, a side view, and a rear view of an object may be displayed on a plurality of displays 6, and the same image data may be displayed on a plurality of displays. 6 may be displayed in parallel. Furthermore, the image data displayed in parallel on the plurality of displays 6 is arbitrary.

When the display 6 is arranged in each direction, the screen arranged in the center, the screen arranged on the right side thereof, and the screen arranged on the left side may be arranged in a substantially straight line. As long as the direction corresponds to the image data, the arrangement method is arbitrary.
In addition, the display control device is a distributed system in which each component is physically separated into two or more cases, and data is transmitted and received via a wired transmission path such as a cable or a wireless transmission path such as radio waves and infrared rays. It may be.

On the other hand, a recording medium (for example, a CD-ROM, a flexible disk, a RAM card, etc.) on which program codes for executing the above-described units are recorded may be provided to the computer. That is, a recording medium having a computer-readable program code, a function for measuring and monitoring the distance between a plurality of display screens having different resolutions and the user's line-of-sight position for each screen, and the measured display screen A function that changes the display magnification of image data so that the apparent size of each image data is the same for each display screen based on the distance for each display and the resolution of each display screen, and an image with the change magnification obtained for each display screen You may make it provide the computer-readable recording medium which recorded the program for implement | achieving the function to re-display data on the corresponding display screen.
(Example 2)

A second embodiment of the present invention will be described below with reference to FIGS.
The image control apparatus in the second embodiment performs display control of a screen (terminal display) of an in-vehicle terminal mounted on an automobile and a transparent screen attached to a windshield. The route guidance map corresponding to the current position is displayed in real time, and the transparent screen is used to simulate the existing signs and guide the route change etc. Virtual objects are displayed in a superimposed manner. In this case, when the virtual object is displayed on the transparent screen based on the currently set display magnification and display position, the viewpoint distance from the driver's line-of-sight position to the transparent screen varies, or the line-of-sight position varies. Even so, the currently set display magnification and display position are adjusted so that the virtual object is apparently the same size and the same position.

FIG. 9 is a block diagram showing basic components of the image control apparatus in the second embodiment.
This image control device has a CPU 21 that controls the overall operation of the image control device, a storage unit 22 that stores an operating system, various application software, route guidance map information, and the like, and a RAM 23 that has a program execution area and a work area. In addition, an input device 24, a terminal display 25, a transparent screen 26, a position measuring device 27, and a line-of-sight monitoring device 28, which are input / output peripheral devices, are connected to the CPU 21 via a bus line. Accordingly, the CPU 21 controls the operation of these input / output devices.

  The terminal display 25 displays a route guidance map corresponding to the current position and the traveling direction measured by the position measuring device 27, and roads and buildings on the road existing within a certain distance from the current position to the traveling direction. Displays various objects that represent. Note that a touch panel is stacked on the terminal display 25 to enable a touch operation on the terminal display 25. The route guidance map stores the position and shape of roads, buildings on the road, virtual signs (virtual objects), etc. as three-dimensional data, and the CPU 21 extracts various objects extracted from the three-dimensional data. Is converted into two-dimensional image data and displayed on the terminal display 25. The transparent screen 26 uses a sheet-like display with high transparency so as not to obstruct the scenery in front. The transparent object 26 is a semi-transparent virtual object for simulating a sign or instructing a course change. The color is displayed.

  The line-of-sight monitoring device 28 measures the viewpoint distance (interval) from the line-of-sight position (eye position) of the user (driver) to the transparent screen 26 and measures the line-of-sight position. In this embodiment, An ultrasonic measuring device is used to measure the viewpoint distance and the line-of-sight position based on the reflected wave when the ultrasonic pulse is generated. The line-of-sight monitoring device 28 is attached to a predetermined position such as a windshield of an automobile. In this case, the horizontal position and the vertical position are measured as the line-of-sight position (eye position). Accordingly, the line-of-sight monitoring device 28 measures the position of the driver in three dimensions, where the viewpoint distance (interval) is the Z direction, the horizontal position of the line of sight is the X direction, and the vertical position of the line of sight is the Y direction. ing.

FIG. 10 is a diagram showing the positional relationship between the driver and the transparent screen 26 and the positional relationship of the virtual object on the transparent screen 26.
In the figure, “AL” indicates a physical viewpoint distance from the driver's line-of-sight position to the virtual object on the transparent screen 26, and “BL” indicates the transparent screen 26 from the driver's line-of-sight position. It shows the apparent distance to the virtual object that can be seen. In this case, the virtual object on the transparent screen 26 maintains a relationship with the forward scenery seen through the transparent screen 26, that is, maintains a distance relationship or a positional relationship with an actual sign or a course change point. The display magnification and display position of the virtual object are set by default so as to be displayed in the state.

  In FIG. 11C, each virtual object (see FIG. 11B) on the transparent screen 26 is displayed superimposed on the scenery in the field of view seen through the transparent screen 26 (see FIG. 11A). It is the figure which showed the state made. In this case, in the illustrated example, a “right turn instruction” is displayed as a “one-way” sign object as a simulated object that simulates an existing sign and a guidance object that instructs a course change. . Here, every time the physical viewpoint distance AL to the transparent screen 26 changes or the line-of-sight position changes, the CPU 21 displays the display magnification and display currently set for the virtual object on the transparent screen 26. By changing the position, the display magnification and the display position of the virtual objects are adjusted so that the virtual objects are apparently the same size and the same position.

FIG. 12 is a flowchart showing the entire display process in the second embodiment.
First, the CPU 21 acquires the current position and the traveling direction from the position measuring device 27 (step D1), searches the route guidance map data based on the current position and the traveling direction, and is a fixed distance from the current position to the traveling direction. After extracting three-dimensional objects such as roads, buildings on the road, virtual signs, etc. (step D2), the extracted objects are developed as image data on a two-dimensional plane (step D3). In this case, when a three-dimensional object is converted into a two-dimensional object, the same method as usual is used. At this time, after setting the current position and the traveling direction as the line-of-sight position and the line-of-sight direction, 3 What is necessary is just to convert a dimensional object into a two-dimensional object. Of the objects developed as two-dimensional image data in this way, a road or a building on the road is displayed on the terminal display 25 based on a display magnification arbitrarily designated by the user in advance (step D4).

Next, among each object developed as two-dimensional image data as described above, a virtual object for representing a sign or giving guidance for changing a course is displayed. Based on the position, it is displayed on the transparent screen 26 (step D5). In this case, the default values of the currently set display magnification and display position are values determined in consideration of the line-of-sight position of the standard driver (average driver) and the viewpoint distance to the transparent screen 26.
When adjusting the default values of the display magnification and the display position to values suitable for the driver, the driver gives an instruction for the display adjustment. Then, the CPU 21 detects this in step D6, proceeds to step D7, and executes display adjustment (calibration) processing.

FIG. 13 is a flowchart detailing display adjustment (calibration) processing.
First, the CPU 21 automatically selects two objects for display adjustment from the virtual objects displayed on the transparent screen 26, and identifies and displays these objects on the transparent screen 26 by blinking or the like (step E1). ). In this case, when each position corresponding to the display position of the two virtual objects identified and displayed on the transparent screen 26 is touch-designated on the terminal display 25, the CPU 21 displays each touch position on the terminal display 25. Information is acquired (step E2).

 The touch position on the terminal display 25 and the display position of each virtual object that is identified and displayed on the transparent screen 26 are set for the object on the transparent screen 26 so that they are relatively matched. The displayed display magnification and display position are corrected (step E3). In this case, the display magnification and the display position are corrected while referring to the resolution (total dot size / dot pitch) of the terminal display 25 and the transparent screen 26. At the time of this correction, the CPU 21 acquires the measurement result of the viewpoint distance (interval) from the driver's line-of-sight position to the transparent screen 26 and the line-of-sight position from the line-of-sight monitoring device 28, and displays the viewpoint distance and line-of-sight position after correction. It is stored and held in association with the magnification and the display position (step E4).

 Next, the process proceeds to step D8 in FIG. 12, where the current driver's gaze distance (interval) and gaze position measured by the gaze monitoring device 28 are acquired, and the stored viewpoint distance and gaze position, and the current viewpoint. By comparing the distance and the line-of-sight position, whether or not the viewpoint distance and the line-of-sight position are changed is checked (step D9). If the viewpoint distance and the line-of-sight position have not changed, the process returns to the first step D1, but if the viewpoint distance and the line-of-sight position have changed, the process of correcting the display position and display magnification of the virtual object accordingly. Move (steps D10 and D11).

  That is, when there is a change in the line-of-sight position, the current display position of the virtual object is determined based on the movement distance (variation amount) obtained by comparing the line-of-sight position stored and the current line-of-sight position. Correction is performed (step D10). In this case, the display position of the virtual object is corrected in accordance with the movement distance in the horizontal direction and the movement distance in the vertical direction of the line-of-sight position. If there is a change in the viewpoint distance, the current display magnification of the virtual object is corrected based on the distance ratio obtained by comparing the stored viewpoint distance with the current viewpoint distance (step D11). ). The line-of-sight position and viewpoint distance measured this time are stored and held in association with the corrected display magnification and display position (step D12), and then the process returns to the first step D1 and the above-described operations are repeated.

  As described above, in the second embodiment, the CPU 21 starts from the visual line position of the driver with the transparent screen 26 in a state where the virtual object is displayed on the transparent screen 26 based on the currently set display magnification and display position. When the change in the viewpoint distance is detected, the currently set display magnification is changed according to the amount of change, and when the change in the driver's gaze position is detected, the currently set display is displayed. Since the position is changed according to the amount of change, and the virtual object is redisplayed on the transparent screen 26 based on the change magnification and the change position, even if the driver's viewpoint distance and line-of-sight position change, The display magnification currently set so that the virtual object appears to be the same size and the same position. Can adjust the fine display position, it is possible to safe driving on effective guidance display.

  In this case, when the driver touches each corresponding position on the terminal display 25 corresponding to the position of the plurality of virtual objects displayed on the transparent screen 26 between the terminal display 25 and the transparent screen 26, Since the display magnification and the display position currently set for the object on the transparent screen 26 are adjusted so that each object position and each corresponding position on the terminal display 25 are relatively matched, the terminal display The display magnification and display position of the virtual object can be changed while maintaining the relative relationship between the transparent screen 26 and the transparent screen 26.

 In addition, although the case where it applied to the transparent screen 26 for motor vehicles was illustrated in 2nd Example mentioned above, for example, sticking a transparent screen to the front surface of the tank of an aquarium and performing various guidance etc. It can also be applied to a transparent screen. In addition, it is needless to say that the present invention can be similarly applied to a normal display screen other than the transparent screen.

  On the other hand, you may make it provide the recording medium which each recorded the program code for making a computer perform each means mentioned above. That is, a recording medium having a computer-readable program code, a function for displaying an object as image data on a display screen based on a currently set display magnification and display position, and a user's line-of-sight position A function to change the currently set display magnification according to the amount of change when a change in the viewpoint distance is detected based on the measurement result of the viewpoint distance from the screen to the display screen, and the user's gaze position A function to change the currently set display position according to the amount of change when a change in the line-of-sight position is detected based on the measurement result, and a display based on the changed change magnification and change position. To provide a computer-readable recording medium on which a program for realizing a function for redisplaying an object on a screen is recorded It may be.

The block diagram which showed the basic component of the image control apparatus. The figure which showed the distance relationship between the arrangement | positioning state of each display 6, and each display 6 and a user's eyes | visual_axis position. The figure which showed the content of the display information table 11. FIG. The figure which showed the content of the image data information table 12. FIG. The figure which showed the content of the display status information table. 6 is a flowchart showing display magnification synchronization processing for a plurality of displays. 7 is a flowchart detailing a process of calculating an enlargement / reduction ratio for each display 6 shown in FIG. 7 is a flowchart detailing the image data enlargement / reduction display process shown in FIG. 6. The block diagram which showed the basic component of the image control apparatus in 2nd Example. The figure which showed the positional relationship of a driver and the transparent screen 26, and also the positional relationship of the virtual object on the transparent screen 26. FIG. 11 is a diagram showing a state in which virtual objects on the transparent screen 26 are superimposed and displayed on the scenery in the field of view seen through the transparent screen 26. The flowchart which showed the whole display process in 2nd Example. 13 is a flowchart detailing display adjustment (calibration) processing shown in FIG. 12.

Explanation of symbols

1,21 CPU
2, 22 Storage unit 5, 24 Input device 6 Display device (display)
7 Distance measuring device 11 Display information table 12 Image data information table 13 Display state information table 25 Terminal display 25
26 Transparent screen 26
27 Position measuring device 27
28 Gaze monitoring device

Claims (8)

A display control device for displaying image data of the same size in parallel on a plurality of display screens having different resolutions,
Measuring means for measuring the distance between each display screen and the user's line-of-sight position for each screen;
Changing means for changing the display magnification of the image data so that the apparent size of each image data is the same for each display screen based on the distance for each display screen measured by the measuring means and the resolution of each display screen;
Display control means for redisplaying the image data on the corresponding display screen at a change magnification obtained for each display screen by the changing means;
A display control apparatus comprising: The changing means calculates a distance ratio based on the measured distance for each display screen, calculates a resolution ratio based on the resolution of each display screen, and determines each display screen based on the distance ratio and the resolution ratio. Change the image data display magnification to
The display control apparatus according to claim 1, wherein the display control apparatus is configured as described above. Image data of the same size displayed in parallel on multiple display screens with different resolutions is image data for each direction when the object is viewed from multiple directions, or the direction when the surroundings are viewed in multiple directions by changing the line of sight Another image data,
The image data for each direction is displayed in parallel on a display screen arranged in association with the direction.
The display control apparatus according to claim 1, wherein the display control apparatus is configured as described above. Against the computer,
A function for measuring and monitoring the distance between a plurality of display screens with different resolutions and the user's line-of-sight position for each screen;
A function of changing the display magnification of the image data so that the apparent size of each image data is the same for each display screen based on the measured distance for each display screen and the resolution of each display screen;
A function for redisplaying the image data on the corresponding display screen at the change magnification obtained for each display screen;
A program to realize A display control device that displays an object as image data on a display screen based on a currently set display magnification and display position,
A measuring means for measuring the viewpoint distance from the user's line-of-sight position to the display screen, and measuring the line-of-sight position;
Display magnification changing means for changing the currently set display magnification in accordance with the amount of fluctuation when a change in viewpoint distance is detected based on the measurement result obtained by the measurement means;
Display position changing means for changing the currently set display position in accordance with the amount of change when a change in line-of-sight position is detected based on the measurement result obtained by the measuring means;
Display control means for redisplaying the object on the display screen based on the change magnification and the change position changed by the display magnification change means and the display position change means;
A display control apparatus comprising: Having first and second display screens that display mutually related contents, and arbitrarily specifying each corresponding position on the second display screen corresponding to a plurality of object positions on the first display screen The display currently set for the object on the first display screen so that each object position on the first display screen and each corresponding position on the second display screen are relatively matched by Adjust magnification and display position,
The display control apparatus according to claim 5, wherein the display control apparatus is configured as described above. The display screen that displays the object is a transparent screen provided on the windshield of the vehicle. In the field of view that can be seen through this transparent screen, the existing signs are simulated and the route is changed. Display a virtual object to superimpose,
The display control apparatus according to claim 4, wherein the display control apparatus is configured as described above. Against the computer,
A function for displaying an object as image data on the display screen based on the currently set display magnification and display position;
A function that changes the currently set display magnification according to the amount of change when a change in the viewpoint distance is detected based on the measurement result of the viewpoint distance from the user's line-of-sight position to the display screen;
A function for changing the currently set display position according to the amount of change when a change in the line-of-sight position is detected based on the measurement result obtained by measuring the user's line-of-sight position;
A function to re-display the object on the display screen based on the changed change magnification and the changed position;
A program to realize

Images