JP2000099237A - Display and input device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display and input device which makes it possible to easily recognize the position of an operation button and can decrease the amount of image data needed to display operation buttons. SOLUTION: This display and input device has a console panel 4 whose indication device 3 is arranged over a display device 2. The display device 2 displays the operation buttons as 3D images and also displays the shadows of the operation buttons. When an operation button is depressed, the operation button is displayed in a depressed state and its displayed shadow is short. The shadow of the operation button is vibrated at a predetermined vibration frequency to improve the visibility.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display / input device which displays various operation buttons and accepts various instruction inputs by depressing portions of the operation buttons.

[0002]

2. Description of the Related Art Conventionally, as a display / input device for displaying operation buttons and receiving various instruction inputs by pressing the operation buttons, an automatic teller machine (ATM) installed at a financial institution or a railway station 2. Description of the Related Art A touch panel-type operation panel mounted on a ticket vending machine installed in, for example, is known.

[0003] This type of operation panel is generally constructed by laminating an input section in which transparent electrodes are arranged in a matrix on a display section such as an LCD (liquid crystal display) for displaying operation buttons and the like. Various instructions are input by depressing a part of the input unit on the operation button displayed via the finger with a finger.

The image displayed on the display unit is obtained by reading out background image data and operation button image data previously stored as digital image data in an image storage device into an image memory and synthesizing the D / A. The image is converted into analog image data by the converter and output.

The image data of the operation button to be synthesized with the background image data includes image data indicating a standby state before the operation button is pressed, and image data indicating an input state after the operation button is pressed. , Are provided. These image data are prepared in advance in the image storage device as different colors and shapes of the operation buttons for each operation button. Then, a plurality of image data in which the colors and shapes of the operation buttons are different are selected in accordance with an instruction input in the input unit, and the selected image data is combined with the background image data, and output through the display unit. It is to be drawn.

That is, in the input standby state, a screen is displayed in which the image data of the operation button indicating the standby state is combined with the background image data, and a portion on the operation button is pressed via the input unit. On the condition that another image data indicating an input state in which the color or shape of the operation button is changed is combined with the background image data, another screen is switched and displayed.

[0007]

However, since the image of the operation button displayed through the above-mentioned conventional operation panel cannot be switched until the operation button part is pressed, the operation button before the input is input. There is a problem that it is difficult to determine the position. In other words, it was difficult to tell where the operation buttons were on the screen.

In addition, the above-mentioned conventional operation buttons merely change the color or shape and display the presence or absence of an input.
There is a problem that it is difficult for the operator to recognize whether or not the operation button is pressed.

Further, in the above-described conventional switching display method, in addition to the background image data, image data of an operation button indicating an input standby state and image data of an operation button indicating an input state are prepared in an image storage device in advance. However, there is a problem that the amount of image data to be stored is large and the storage capacity of the image storage device must be increased.

The present invention has been made in view of the above points, and its object is to easily recognize the position of an operation button.
An object of the present invention is to provide a display / input device capable of reducing the amount of image data required for displaying operation buttons.

[0011]

According to a first aspect of the present invention, there is provided a display / input device, comprising:
A display unit for displaying various operation buttons; an input unit for inputting an instruction via the operation buttons displayed via the display unit; a stereoscopic image generating means for generating a stereoscopic image of each of the operation buttons; A shadow creating unit for creating a shadow of the stereoscopic image generated by the image generating unit; and a display unit configured to combine the stereoscopic image generated by the stereoscopic image generating unit and the shadow created by the shadow generating unit. Composing / displaying means for displaying the image through a shadow, wherein the shadow creating means creates at least two types of shadows obtained by moving an imaginary light source for creating the shadow, and the combining / displaying means comprises: The at least two types of shadows are switched and displayed at predetermined time intervals, and the shadows are vibrated.

According to another aspect of the present invention, there is provided a display / input device for displaying various operation buttons, and an input unit for inputting an instruction via the operation buttons displayed via the display unit. A three-dimensional image generating means for generating a three-dimensional image of each of the operation buttons, a shadow generating means for generating a shadow of the three-dimensional image generated by the three-dimensional image generating means, and a three-dimensional image generated by the three-dimensional image generating means. Synthesizing and displaying means for synthesizing a stereoscopic image and a shadow created by the shadow creating means and displaying the combined image on the display unit, wherein the shadow creating means is an imaginary light source for creating the shadow. At least two types of shadows in which the amount of light is changed, the combining / displaying means switches and displays the at least two types of shadows at predetermined time intervals, and vibrates the shading of the shadows. .

According to a third aspect of the present invention, there is provided a display / input device for displaying various operation buttons, and an input unit for inputting an instruction via the operation buttons displayed via the display unit. Storage means for storing data for generating a stereoscopic image of each of the operation buttons and data relating to the position of an imaginary light source for shading each of the stereoscopic images; and a stereoscopic image stored in the storage means. A three-dimensional image generation unit that generates a three-dimensional image of each of the operation buttons based on data related to the three-dimensional image and data on a position of a light source stored in the storage unit. Creating means for creating a shadow of a three-dimensional image generated by the method, a three-dimensional image generated by the three-dimensional image generating means, and a shadow created by the shadow generating means. Synthesized and has and a synthetic-display means for displaying via the display unit.

According to a fourth aspect of the present invention, the storage means stores, as the data relating to the position of the imaginary light source, data relating to at least two positions where the light source has been moved. The shadow creating means creates at least two types of shadows based on the data on the at least two positions stored in the storage means, and the combining / displaying means determines the at least two types of shadows in a predetermined manner. The display is switched every time and the shadow is vibrated.

According to a fifth aspect of the present invention, in the display / input device according to the fifth aspect, the storage means stores, as the data for generating the three-dimensional image, a depth indicating an instruction input standby state of each operation button. The first data and the second data relating to the depth indicating the state in which each of the operation buttons is pressed are stored, and the three-dimensional image generation unit and the shadow creation unit are in a state of waiting for an instruction input of each of the operation buttons. The stereoscopic image and the shadow are created with reference to the first data, and the second data relating to the operation button is referred to on the condition that an instruction input by the operation button is performed through the input unit. To create a stereoscopic image and a shadow of the operation button.

According to a sixth aspect of the present invention, in the display / input device according to the sixth aspect, the storage means stores, as the data for each of the operation buttons, data on a reaction speed of the operation button and timing of switching of the operation button. The data, the data on the color of the operation button, and the data on the frequency and amplitude of the shadow of the operation button are rewritably stored, and the three-dimensional image generation unit and the shadow creation unit are stored in the storage unit. A three-dimensional image and a shadow of each operation button are created based on each data of each operation button.

A display / input device according to a seventh aspect of the present invention is a display unit for displaying various operation buttons, and an input unit for inputting an instruction via the operation buttons displayed via the display unit. Storage means for storing data for generating a stereoscopic image of each of the operation buttons and data relating to the position of an imaginary light source for shading each of the stereoscopic images; and a stereoscopic image stored in the storage means. A three-dimensional image generating means for generating a three-dimensional image of each of the operation buttons based on data relating to the three-dimensional image data stored in the storage means, and data relating to the position of the imaginary light source. Shadow creating means for creating a shadow of the three-dimensional image generated by the image generating means,
Combining / displaying means for combining the three-dimensional image generated by the three-dimensional image generating means and the shadow created by the shadow creating means and displaying it via the display unit, and detecting an operator approaching the display unit Detecting means for detecting, when the detecting means detects that the operator is approaching the display unit, the shadow creating means removes a portion that becomes a shadow on the display unit by the operator. It is characterized by measuring and changing the shadow of the operation button included in the shadow portion.

According to the display / input device of the present invention, the detection means further detects an operator's arm or finger held over the screen of the display unit, and the shadow creation means. Changing the shadow of the operation button to which the detected operator's arm or finger approaches when the detecting means detects the operator's arm or finger held over the screen of the display unit. It is characterized by.

Further, the display / input device according to the ninth aspect of the present invention is a display unit for displaying various operation buttons, and an input unit for inputting an instruction through the operation buttons displayed via the display unit. Storage means for storing data for generating a stereoscopic image of each of the operation buttons and data relating to the position of an imaginary light source for shading each of the stereoscopic images; and a stereoscopic image stored in the storage means. Image data generating means for generating a three-dimensional image of each of the operation buttons based on data relating to the three-dimensional image data stored in the storage means, data relating to the position of the imaginary light source, and detection by the detection means. Shadow creating means for creating a shadow of the three-dimensional image generated by the three-dimensional image generating means, based on the data on the direction and light amount of the light,
Combining / display means for combining the three-dimensional image generated by the three-dimensional image generating means and the shadow created by the shadow creating means for display via the display unit, and the amount of light illuminating the display unit Detecting means for detecting the luminance of the display screen based on the amount of light detected by the detecting means.

[0020]

Embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a display / input device 1 according to a first embodiment of the present invention. FIG. 2 shows an example of an image displayed via the display / input device 1.

The display / input device 1 includes a display device 2 such as an LCD for displaying various operation buttons and the like, and an operation panel 4 (FIG. 2) having a pointing device 3 stacked on the screen of the display device 2. Reference). Pointing device 3
Is composed of a touch panel in which a plurality of transparent electrodes are arranged in a matrix, and is switched by pressing a part of the panel on the operation buttons 1 to 5 displayed on the screen of the display device 2. An instruction input based on coordinates is received. At this time, the image of the operation button on the display device 2 at the site where the instruction input has been made is switched as described later. Note that instead of inputting an instruction via the instruction device 3, an instruction input may be received by clicking an operation button displayed on the screen of the display device 2 using a mouse or the like.

The display / input device 1 has an image storage device 5 in which data to be displayed via the display device 2 is stored in advance as digital image data. The image storage device 5 stores image data (background image data) relating to a portion that does not change, such as a background displayed on the screen of the display device 2, and its color and shape according to the situation such as operation buttons. Image data (component image data) relating to a portion where is changed is prepared in advance. Note that the part image data is stored in the image storage device 5 as object data (described later) shown in FIG.

Further, the display / input device 1 includes an image memory 6 for reading and developing background image data and component image data stored in the image storage device 5, and the image memory 6
3D of the part as shown in FIG. 2 from the part image data developed in
3D that generates an image and creates a shadow of the part
The image generation / shadow creation unit 7 combines the 3D image of the part generated and created by the 3D image creation / shadow creation unit 7 and the data related to the shadow of the part with the background image data, and converts the synthesized image data into analog data It has an image synthesizing and D / A converter 8 for converting and outputting to the display device 2.

The component image data shown in the table of FIG. 3 is prepared in the image storage device 5 as a plurality of types of object data according to the type of component such as operation buttons to be displayed and the display form. In other words, the shape of the operation button displayed as a 3D image includes a columnar shape such as a circular column or an elliptical column in addition to the rectangular parallelepiped shown in FIG. 2. There are various types and the like, and object data corresponding to each shape and display form are prepared.

For example, part of the object data relating to the operation button having a rectangular parallelepiped shape as shown in FIG. 2 is shown in the table of FIG. 3 as object 1 data, and coordinate data (X, Y) relating to the position to be displayed, Data related to the width of the operation button (W), data related to the height (H),
And data relating to depth (D1, D2) along the pressing direction of the operation button, etc., and a 3D image of the operation button is generated based on these various object data. In this case, two data (D1, D2) relating to the depth of the operation button are prepared. However, D1 is prepared as data relating to the depth of the operation button in the standby state before the instruction is input, and D2 is depressed by the instruction input. The data is prepared as data relating to the depth of the operation button in a state where the operation button is pressed in the screen direction.

The object 2 data relating to the columnar operation button includes coordinate data (X, Y) relating to the position to be displayed, data (R) relating to the radius of the operation button,
And data on the depth (D1, D2), and the object 3 data on the elliptical operation button is
Coordinate data (X, Y) relating to the position to be displayed, data relating to the short radius and long radius of the operation button (RS, RL)
), And data relating to depth (D1, D2).

Further, each of the above-described object data includes, as data relating to the shadow of the operation button generated as a 3D image as described above, the position of an imaginary light source (here, a point light source) for creating a shadow, That is, the direction of the light emitted from the light source, the light amount of the light emitted from the light source, the frequency and amplitude related to the movement of the light source for vibrating the shadow, and the frequency and amplitude related to the change in the light amount for vibrating the shading of the shadow. And other data. In addition, each object data includes, as data relating to the operation button, a color before the operation button is pressed, a color after the operation button is pressed, a switching timing of the operation button (when the button is pressed and when the button is released). ), Operation button response speed,
And the like.

The object data of the operation buttons described above can be set arbitrarily for each operation button. Next, a process of generating a 3D image of a rectangular parallelepiped operation button to create a shadow, combining the 3D image with a background image, and outputting an image will be described in detail with reference to FIGS. In FIG.
FIG. 5 conceptually illustrates a state in which a 3D image of an operation button is combined with a background image, and FIG. 5 conceptually illustrates a state in which a shadow of the operation button is created.

First, background image data and component image data stored in the image storage device 5 are read out and expanded in the image memory 6. The component image data read out at this time is object 1 data relating to a rectangular parallelepiped operation button shown in FIG. 3, and based on these data,
The 3D image generation and shadow generation unit 7 generates and generates a 3D image and a shadow of the operation button.

The 3D image of the operation button is the object 1
Among the data, data relating to the button width (W), data relating to the height (H), and data relating to the depth (D1)
) And color data.
At this time, since the depth of the operation button is displayed as a standby state before the button is pressed, the data (D1) is referred to. Further, the shadow of the operation button is created based on the data relating to the 3D image and the data relating to the position and light amount of the light source prepared in advance in the object 1 data. In this case, the shadows created are a shadow 1 that moves to the background, a shadow 2 that is formed on one side of the operation button, and a shadow 3 that is formed on the other side of the operation button. .

The 3D image data and the shadow image data of the operation buttons created in this manner are combined with the background image data developed in the image memory 6 by the image combining / D / A conversion unit 8 to form analog data. After that, the image is output as an image as shown in FIG.

As described above, by displaying the operation buttons as a 3D image and displaying the shadow of the buttons,
The position of the operation button on the screen can be easily confirmed. In addition, since the 3D image of the operation button is created based on the previously facilitated object data, the image of the operation button does not need to be easily prepared in advance, and the amount of image data stored in advance in the image storage device 5 can be reduced. The storage capacity of the image storage device 5 can be reduced.

Next, a method of changing (vibrating) the shadow of the operation button to make it easier to recognize the position of the operation button on the screen will be described with reference to the flowchart of FIG. 9 together with FIGS. .

First, as described above, the background image data and the component image data are read out to generate a 3D image and a shadow of the operation button, and are combined with the background image as shown in FIG. (Step 1). In this state, the shadows 1 to 3 are provided with shading corresponding to the light amount of the light source.

Then, based on the data on the position of the light source prepared in advance as the object data, that is, the frequency and the amplitude, the position of the imaginary light source is moved at predetermined time intervals in the direction indicated by the arrow a or b in FIG. Moved
A new shadow corresponding to the moved light source is created (step 2). In this case, for example, the light source is moved in the direction indicated by the arrow a in FIG. 6, and the shadow displayed as shown in FIG. 7 is moved and displayed as shown in FIG. 8 by the movement of the light source (step 3). ). In addition, with the movement of the shadow, shadow 1 to shadow 3
The size and the density of each are also changed.

After the position of the light source has been moved in step 2,
It is determined whether or not the operation button has been pressed within a predetermined time (step 4). If the button has not been pressed (step 4; NO), that is, after the predetermined time has elapsed, the position of the light source is changed to the original position before the movement. It is moved to the position (step 2) and the original image is displayed (step 3).

As described above, the operations in steps 2 to 4 are as follows.
The shadow of the operation button is vibrated at a predetermined frequency and amplitude until the operation button is pressed, that is, throughout the standby state of the instruction input. At this time, the frequency and amplitude of the vibrating shadow are prepared in advance for each object data and can be arbitrarily changed.

On the other hand, if it is determined in step 4 that the operation button has been pressed (step 4; YES), the next image data for expressing that the button has been pressed (described later)
Is read out to generate a new 3D image, and this 3D image is combined with the background image to display a new image (step 5).

As described above, by displaying the shadow of the operation button by vibrating at the predetermined frequency and amplitude, the position of the operation button can be easily recognized in the instruction input standby state before the operation button is pressed. be able to. Note that instead of moving the position of the light source to vibrate the shadow of the operation button as described above, the light amount of the light source may be vibrated to vibrate the shading of the shadow. Can be recognized.

Next, a method for displaying a state in which the operation button is pressed down so as to be easily recognized will be described with reference to a flowchart of FIG. 11 together with an operation explanatory diagram of FIG.
First, the background image data and the component image data are read, a 3D image and a shadow of the operation button are generated, combined with the background image, and displayed via the display device 2. At this time, D1 indicating the instruction input waiting state before the button is pressed is extracted from the object data as data relating to the depth of the operation button (step 1).

In this state, it is determined whether or not the operation button is pressed (step 2). When the operation button is pressed (step 2; YES), data D2 relating to the depth of the operation button is read from the object data. Data D1 on the depth before being issued and the button is pressed
Is generated, a new 3D image of the operation button having the data D2 is generated and synthesized with the background image, and FIG.
As shown in the figure, a new 3 indicating the pressed state of the button
The D image is displayed. At this time, as the depth of the operation button decreases from D1 to D2, the shadow 1 of the operation button is shortened and displayed as shown by the arrow in FIG. 10 (step 3).

As described above, when the operation button is pressed, the depth of the button is displayed as if the button was actually pressed, and the shadow of the button is displayed with the shadow shortened. It is easy to recognize that the operation button has been pressed, and it is possible to reliably recognize that the button has been pressed.

Next, a display / input device 11 according to a second embodiment of the present invention will be described with reference to the drawings. The display / input device 11 according to the present embodiment includes the ITV camera 9 connected to the 3D image generation / shadow creation unit 7, and the other components are the same as those of the display / input according to the first embodiment described above. This is substantially the same as the device 1. Therefore, the same components as those of the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted.

As shown in FIG. 12, the display / input device 11
Is an industrial television camera 9 (hereinafter simply referred to as an ITV camera 9) for photographing an area including the operation panel 4 as a detection means for detecting the direction and the amount of light illuminating the operation panel
). This ITV camera 9 is shown in FIG.
As shown in FIG. 3, it is arranged at a position where an area including the operation panel 4 can be photographed from above the apparatus main body 10, that is, from above the operator's head.

The ITV camera 9 thus installed is
In addition to detecting the direction and the amount of light applied to the periphery of the operation panel 4, an operator approaching the apparatus main body 10 is detected.
By detecting the light direction, the light amount, and the position of the operator in this manner, a change in light around the operation panel 4 can be captured by the 3D image generation and shadow creation unit 7, and the operation panel 4 has a three-dimensional image. It is possible to display a shadow as if a real operation button exists.

Here, the operation of detecting the position of the operator using the ITV camera 9 and changing the shadow of the operation button displayed through the operation panel 4 will be described with reference to the flowcharts of FIGS. 14 to 17 and 18. This will be described with reference to FIG.

First, as described above, the component image data and the background image data relating to the operation buttons are read out, and a 3D image and a shadow of the operation button are created.
The image data relating to the image and the shadow are combined with the background image data and displayed as an operation screen via the operation panel 4 (step 1).

Next, as shown in FIG. 14, an image including the operation panel 4 is photographed by the ITV camera 9 and an operator approaching the operation panel 4 is detected. Is compared with the image (FIG. 15), the difference between the two images is binarized, and the distance from the apparatus main body 10 to the operator (FIG. 14) is measured (step 2).

Then, according to the measured distance between the apparatus main body 10 and the operator, a shadowed portion on the operation panel 4 (FIG. 16; a portion where light does not come) is measured.
The shadow of the operation button corresponding to the shadow displayed via is changed (step 3). That is, when the distance from the apparatus main body 10 to the operator is measured as in step 2, the shadowed portion on the operation panel 4 is measured according to the distance, and the operation buttons included in the shadowed portion are measured. Is darkened and emphasized as shown in FIG. More specifically, as shown in FIG. 16, when the operator approaches the apparatus main body 10, a part of the front side of the operation panel 4 becomes a shadow as shown in FIG. 17, and the operation button 2 included in this shadow is The shadow is darkened as well as the actual shadow.

In this state, it is determined whether or not an instruction has been input through the operation button (step 4). If the instruction has been input (step 4; YES), it is displayed that the operation button has been pressed. The data on the next image to be read is read out and displayed via the operation panel 4 (step 5).

As described above, by photographing the vicinity of the operation panel 4 using the ITV camera 9 and monitoring the position of the operator in addition to monitoring the direction and the amount of light illuminating the operation panel 4,
The state in which the operator is approaching the apparatus main body 10 can be detected. Then, the shadow of the operation button displayed via the operation panel 4 can be changed according to the position of the operator, and the shadow can be changed similarly to the actual three-dimensional operation button.
While the operator is approaching the apparatus main body 10, the position of the operation button can be more easily recognized.

Further, as shown in FIG.
It is also possible to photograph the state in which the arm or finger is held over by the ITV camera 9 and change the shadow of the operation button according to the proximity of the arm or finger.

In this case, an image obtained by photographing the arm or finger held over the operation panel 4 is compared with an image having nothing on the operation panel 4 prepared in advance as shown in FIG. Are binarized, and the positions of the arms and fingers are detected. Then, the change in the light emitted on the operation panel 4 according to the position of the arm or finger is captured, and the shadow of the operation button to which the arm or finger approaches is darkened and emphasized.

As described above, by photographing the operator's arm or finger using the ITV camera 9, the shadow of the operation button can be changed with higher accuracy, and the position of the operation button can be more easily recognized. Become.

Further, the brightness of the operation panel 4 can be changed by detecting the amount of light emitted to the operation panel 4 using the ITV camera 9. That is, when the outside light around the operation panel 4 detected through the ITV camera 9 is bright, the brightness of the operation panel 4 is reduced as shown in FIG. When the outside light is dark, the brightness of the operation panel 4 is increased as shown in FIG. Thereby, the operation panel 4 can be more easily seen.

The present invention is not limited to the above-described embodiment, but can be variously modified within the scope of the present invention. That is, the display mode of each operation button displayed via the operation panel 4 can be individually set based on object data prepared in advance for each operation button.
Therefore, for example, the frequency of the shadow of the operation button that is relatively frequently used is set to about 4 Hz, and the frequency of the shadow of the operation button such as the stop button that is relatively infrequently used is set to about 2 Hz. it can. In addition, the reaction speed and switching timing of each operation button can be set separately.

[0057]

As described above, according to the present invention,
Since the input device has the above configuration and operation, the position of the operation button can be easily recognized, and the amount of image data required for displaying the operation button can be reduced.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a display / input device according to a first embodiment of the present invention.

FIG. 2 is a view showing an operation panel incorporated in the display / input device of FIG. 1;

FIG. 3 is a table showing object data relating to operation buttons displayed via the operation panel of FIG. 2;

FIG. 4 is a diagram conceptually showing how a 3D image of an operation button generated based on the object data of FIG. 3 is combined with a background image.

FIG. 5 is a diagram conceptually showing a state in which the 3D image and the shadow of FIG. 4 are combined with a background image.

FIG. 6 is an operation explanatory diagram for explaining an operation of vibrating a shadow of an operation button.

FIG. 7 is a diagram showing one state in which the shadow of the operation button is vibrated.

FIG. 8 is a diagram showing another state in which the shadow of the operation button is vibrated.

FIG. 9 is a flowchart for explaining a method of vibrating an operation button together with FIGS. 6 to 8;

FIG. 10 is an operation explanatory diagram for explaining a state of change when an operation button is pressed.

FIG. 11 is a flowchart for explaining a state when an operation button is pressed together with FIG. 10;

FIG. 12 is a block diagram showing a configuration of a display / input device according to a second embodiment of the present invention.

FIG. 13 is a view for explaining an arrangement place of the ITV camera in FIG. 12;

FIG. 14 is a view showing an image including an operator photographed through the ITV camera shown in FIGS. 13 and 14;

FIG. 15 is a view showing an image without an operator photographed through the ITV camera shown in FIGS. 13 and 14;

FIG. 16 is a view for explaining a portion that becomes a shadow on the operation panel when the operator approaches.

FIG. 17 is a diagram illustrating a change in the shadow of the operation button included in the shadow portion on the operation panel.

FIG. 18 is a flowchart for explaining a method of monitoring a position of an operator and changing a shadow of an operation button, with reference to FIGS. 14 to 17;

FIG. 19 is a diagram showing an image by the ITV camera when an operator's arm or finger approaches the operation panel.

FIG. 20 is a diagram showing an image when there is nothing on the operation panel.

FIG. 21 is a diagram illustrating a state in which the luminance of the operation panel is reduced.

FIG. 22 is a diagram illustrating a state in which the luminance of the operation panel is increased.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Display / input device, 2 ... Display device, 3 ... Instruction device, 4 ... Operation panel, 5 ... Image storage device, 6 ... Image memory, 7 ... 3D image generation, shadow creation part, 8 ... Image synthesis, D / A converter, 9 ITV camera, 10 device body.

Claims (9)

[Claims] A display unit for displaying various operation buttons; an input unit for inputting an instruction via the operation buttons displayed via the display unit; and a stereoscopic image generation for generating a stereoscopic image of each of the operation buttons. Means, a shadow creating means for creating a shadow of the three-dimensional image generated by the three-dimensional image generating means, and a three-dimensional image generated by the three-dimensional image generating means and a shadow created by the shadow generating means are combined. Synthesizing and displaying means for displaying through the display unit, wherein the shadow creating means creates at least two types of shadows obtained by moving an imaginary light source for creating the shadow, A display / input device, wherein the display means switches and displays the at least two types of shadows at predetermined time intervals and vibrates the shadows. 2. A display unit for displaying various operation buttons, an input unit for inputting an instruction via the operation buttons displayed on the display unit, and a stereoscopic image generation for generating a stereoscopic image of each of the operation buttons. Means, a shadow creating means for creating a shadow of the three-dimensional image generated by the three-dimensional image generating means, and a three-dimensional image generated by the three-dimensional image generating means and a shadow created by the shadow generating means are combined. Combining and displaying means for displaying through the display unit, the shadow creating means creates at least two types of shadows in which the amount of light of an imaginary light source for creating the shadow is changed, The display / input device, wherein the synthesizing / displaying means switches and displays the at least two types of shadows at predetermined time intervals, and vibrates the shading of the shadows. 3. A display unit for displaying various operation buttons, an input unit for inputting an instruction via the operation buttons displayed via the display unit, and data for generating a stereoscopic image of each of the operation buttons And storage means for storing data relating to the position of an imaginary light source for casting a shadow on each of the three-dimensional images, and generating a three-dimensional image of each of the operation buttons based on the three-dimensional image data stored in the storage means. A three-dimensional image generating unit that performs shadowing of a three-dimensional image generated by the three-dimensional image generating unit based on the three-dimensional image data and the light source position data stored in the storage unit. Synthesizing and displaying the stereoscopic image generated by the stereoscopic image generating means and the shadow generated by the shadow generating means and displaying the synthesized image via the display unit Display and input device characterized in that it comprises a stage, a. 4. The storage means stores, as data relating to the position of the imaginary light source, data relating to at least two positions at which the light source has been moved, and wherein the shadow creating means is stored in the storage means. At least two based on the data relating to said at least two positions
4. The display / input device according to claim 3, wherein the type / shadow is created, and the combining / display unit switches and displays the at least two types of shadows at predetermined time intervals, and vibrates the shadow. 5. The storage means includes, as data for generating the stereoscopic image, first data relating to depth indicating a standby state for inputting an instruction of each operation button, and a state where each operation button is pressed. The stereoscopic image generating means and the shadow creating means are configured to create the stereoscopic image and the shadow by referring to the first data in an instruction input standby state of each of the operation buttons. And providing a three-dimensional image and a shadow of the operation button with reference to the second data related to the operation button, on condition that an instruction is input by the operation button via the input unit. The display / input device according to claim 3, wherein 6. The storage means includes, as data for each of the operation buttons, data on a reaction speed of the operation button;
The data relating to the switching timing of the operation button, the data relating to the color of the operation button, and the data relating to the vibration frequency and amplitude of the shadow of the operation button are rewritably stored. 4. The display / input device according to claim 3, wherein a stereoscopic image and a shadow of each of the operation buttons are created based on each data of each of the operation buttons stored in the means. 7. A display unit for displaying various operation buttons, an input unit for inputting an instruction via the operation buttons displayed via the display unit, and data for generating a stereoscopic image of each operation button And storage means for storing data relating to the position of an imaginary light source for casting a shadow on each of the three-dimensional images, and generating a three-dimensional image of each of the operation buttons based on the three-dimensional image data stored in the storage means. A shadow of the stereoscopic image generated by the stereoscopic image generating means based on the stereoscopic image generating means, the data relating to the stereoscopic image stored in the storage means, and the data relating to the position of the imaginary light source. Shadow creating means for combining the three-dimensional image generated by the three-dimensional image generating means and the shadow created by the shadow creating means, and displaying the synthesized image via the display unit; Combining / displaying means, and detecting means for detecting an operator approaching the display unit, wherein the shadow creating means is configured to detect when the detecting means detects that the operator is approaching the display unit. A display / input device which measures a shadow portion on the display section by the operator and changes a shadow of an operation button included in the shadow portion. 8. The detection means further detects an operator's arm or finger held over the screen of the display unit, and the shadow creation means is held over the screen of the display unit by the detection means. 8. The display / input device according to claim 7, wherein when an arm or a finger of the operator is detected, the shadow of the operation button to which the detected arm or the finger of the operator approaches is changed. 9. A display unit for displaying various operation buttons, an input unit for inputting an instruction via the operation buttons displayed via the display unit, and data for generating a stereoscopic image of each of the operation buttons And storage means for storing data relating to the position of an imaginary light source for casting a shadow on each of the three-dimensional images, and generating a three-dimensional image of each of the operation buttons based on the three-dimensional image data stored in the storage means. Three-dimensional image generation means for performing the three-dimensional image generation based on data on the three-dimensional image stored in the storage means, data on the position of the imaginary light source, and data on the direction and amount of light detected by the detection means. A shadow creating unit for creating a shadow of the stereoscopic image generated by the image generating unit; and a stereoscopic image and the shadow creating unit generated by the stereoscopic image generating unit. And combining and displaying means for displaying via the display unit synthesizes the shadow created, and detecting means for detecting the amount of light illuminating the display portion,
A display / input device, comprising: changing the luminance of a display screen based on the amount of light detected by the detection unit.