JP2009211447A - Input system and display system using it - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an input system that prevents people other than a user from recognizing what operation is performed, while allowing the user to visually recognize ambient situations even when performing operations. <P>SOLUTION: The input system includes an eyeglass-type display device for displaying information, and an input device for making input based on the information displayed in the display device. The input device has a relative position identification means for discriminating a positional relationship with the display device. The display device includes a relative position recognition device for recognizing information for discriminating at least one positional relationship that is either the relative distance to the relative position identification means, inclination, or direction, and a transmissive display unit for displaying information based on relative position information recognized by the relative position recognition device and pattern information for a position for which the positional relationship between the input device and the display device serves as a reference. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an input system for an IT device and a display system using the same, and in particular, it is impossible to determine what operation is being performed by a person other than the user, and the surrounding scene even while the user is performing the operation. And an input system using the same.

For example, in a system that uses a bank ATM (Automated Teller Machine) to enter a password and perform personal authentication, a keyboard or touch panel with numbers, letters, symbols, etc. permanently displayed on the key top is used as the input device. ing.

However, when a keyboard or the like with characters or the like permanently displayed on the key top is used, it is easy for a non-user to enter a password and there is a risk that the password will be leaked. In order to prevent such password leakage, an input system in which it is impossible to determine what operation is performed by a person other than the user has been studied. For example, it is introduced in the following prior art documents.

Japanese Patent Application Laid-Open No. 08-5594

Hereinafter, a conventional input system will be described with reference to FIG. The keyboard 1 is an input device. The glasses-type display unit 2 displays information input from the processing unit 3 to be described later, and photographs the keyboard 1 and the user's hand with a photographing device (not shown) attached to the lower part. The glasses-type display unit 2 is made of an impermeable article, and the surrounding scene cannot be seen with the glasses-type display unit 2 attached.

The processing unit 3 is also provided with a storage device (not shown), and a keyboard pattern image is stored in the storage device. Then, the processing unit 3 outputs a video signal to be displayed on the glasses-type display unit 2 based on the pattern image of the keyboard of the storage device and the video imaged by the imaging device.

That is, in the input system of FIG. 7, the keyboard 1 and the user's hand are imaged by an imaging device (not shown) attached to the lower part of the glasses-type display unit 2, and the keyboard 1 is stored in the information stored in advance by the image processing device. Replacement, and the output (characters and images) from the processing unit 3 and the image of the keyboard 1 are displayed on the glasses-type display device 2 so that it is impossible to determine what operation is being performed by a person other than the user. It is.

Thus, since the conventional input system uses the glasses-type display unit 2, it is impossible to determine what operation is being performed by a person other than the user.

Next, a conventional display system will be described. For example, when a Western movie produced for Japan is screened, Japanese subtitles are displayed on the screen, but some people who watch the movie do not need subtitles and feel distracted. Japanese Patent Laid-Open No. 9-101749 is a prior art document for solving such a problem.

FIG. 8 is a configuration diagram of the invention disclosed in this document. The display device 4 displays two different images A and B alternately on the single display device in a time-division manner by the control device 5. Is a display system that separately displays the image using glasses 6 and 7 with a liquid crystal shutter. In this way, the person wearing the glasses 6 can see the image A, and the person wearing the glasses 7 can see the image B individually.

Thus, in the conventional display system, only the necessary information can be displayed by combining the display device 4 and the glasses 6 and 7 with the shutter.

However, in the input system shown in FIG. 7, since the display is performed using the non-transparent glasses-type display unit 2, the user cannot see the surrounding scene while wearing it. Therefore, in order to grasp the positional relationship between the keyboard 1 and the user's own hand, it is necessary to visually recognize where the user's own hand is. There was a problem that it could not be seen without it and it was difficult to handle.

On the other hand, the display device of FIG. 8 has a limitation in the number of images to be displayed in a time-division manner. For example, in the case of captions, there is a problem that captions in many languages cannot be displayed.

The present invention has been made in view of these problems, and it is impossible to determine what operation is being performed by a person other than the user, and the surrounding scene can be visually recognized even while the user is performing the operation. An object is to provide an input system and a display system using the same.

In order to achieve such a problem, the invention described in claim 1
In an input system including an eyeglass-type display device that displays information and an input device that performs input based on information displayed on the eyeglass-type display device,
The input device includes a relative position identifying means for grasping a relative positional relationship with the glasses-type display device,
The glasses-type display device includes:
A relative position recognition device for recognizing information for grasping a relative positional relationship of at least one of a relative distance, inclination, and direction between the relative position identification means;
A transmissive display unit that displays information based on relative position information recognized by the relative position recognition device, and pattern information in the case where the positional relationship between the input device and the glasses-type display device is a reference; and Is provided.

The invention according to claim 2
In a display system comprising a plurality of eyeglass-type display devices that display different information, and a screen that displays information common to these eyeglass-type display devices,
The screen includes a relative position identification unit for grasping a relative positional relationship between the plurality of glasses-type display devices,
The glasses-type display device includes:
A relative position recognition device for recognizing information for grasping a relative positional relationship of at least one of a relative distance, inclination, and direction between the relative position identification means;
Information is displayed based on relative position information recognized by the relative position recognition device, reference position image information that is a set of image information for each screen, and user information that is information of a user who uses the screen. A transmissive display unit.

The present invention has the following effects. When wearing a glasses-type display device and looking at the keyboard, characters and symbols displayed on the transmissive display section appear to overlap the corresponding keys on the keyboard, making it easy to identify the input information corresponding to each key Can be performed. Therefore, as in the conventional case, there is an effect that it is not possible to judge what kind of input each key on the keyboard corresponds to other than the user, and in addition to this, a transparent display unit is used. The surrounding scene can also be recognized.

Hereinafter, an input system according to the present invention will be described with reference to FIGS. The keyboard 10 is provided with a relative position identifying means 101 in addition to a plurality of keys. The plurality of keys are operated by moving up and down mechanically.

The relative position identifying unit 101 is identified by a relative position recognizing device 20 to be described later. As the identification method, for example, wireless, ultrasonic, infrared, visible light, or a combination thereof is output from the relative position recognition device 201, and the position, inclination, etc. are specified from the ultrasonic wave reflected by the relative position identification means 101.

Note that the relative position identifying means is not limited to one. For example, two relative position identifying means may be provided and the position may be grasped using triangulation. In addition, the relative position identification unit 101 may output ultrasonic waves or the like, and the relative position recognition device 201 may receive the radio waves to grasp the position.

The display device 20 includes a relative position recognition device 201 and a transmissive display unit 202. The relative position recognition device 201 detects a relative position (distance, inclination, direction, etc.) with respect to the relative position identification unit 101, and outputs it as relative position information to the control unit 30 described later. In addition, although the method of detecting distance, inclination, etc. uses infrared rays, a radio wave, etc., as long as the positional relationship of both can be grasped | ascertained, other methods may be used.

The transmissive display unit 202 can be realized in two ways. As a first method, the transmissive display unit 202 is formed of glass, transparent plastic, or the like, and image processing information input from the image processing apparatus 301 is displayed via a projector (not shown). In this case, when there is no image processing information, the transmissive display unit 202 can visually recognize the surrounding scene like simple glasses or goggles.

The second method is a method using a liquid crystal display. This method usually applies a voltage to the liquid crystal element in response to a command from the image processing device 301 so that the opposite side of the liquid crystal can be seen, that is, the surrounding scene can be visually recognized, and specific characters are displayed. When it is desired, characters and the like are made to appear without applying voltage only to the liquid crystal element in that portion.

The control device 30 is provided with an image processing device 301 and a pattern information holding device 302. The pattern information holding device 302 holds pattern information when the relative positional relationship between the keyboard 10 and the display device 20 is a reference position.

The image processing device 301 edits the pattern information held in the pattern information holding device 302 according to the relative position information output from the relative position recognition device 201, and outputs image information to be shown to the user on the transmissive display unit 202. To do. As described above, when the transmissive display unit 202 is formed of simple glass or transparent plastic, the image information is output by a projector (not shown).

Next, FIG. 2 will be described. FIG. 2 is an explanatory diagram of the usage state of the present invention. The user wears the display device 20 like glasses and visually recognizes the keyboard 10 through the transmissive display unit 202. Next, FIG. 3 will be described. 3A and 3B are diagrams for explaining the relationship between the keyboard 10 and the transmissive display unit 202. FIG. 3A is an overview of the keyboard, and FIG. 3B is a diagram for explaining patterns displayed on the transmissive display unit 202. FIG. (C) is a drawing when the keyboard 10 is viewed through the transmissive display unit 202.

The invention of FIG. 1 has the following effects by providing such a configuration. First, when the user wears the display device 20 as shown in FIG. 2 and looks at the keyboard 10, the characters and symbols displayed on the transmissive display unit 202 are displayed on the keyboard 10 as shown in FIG. Since it appears to overlap with the corresponding key, the input information corresponding to each key can be easily identified.

That is, the display of the key top is switched by visually recognizing through the transmissive display unit 202, and it is impossible for a person other than the user to determine what input each key on the keyboard corresponds to.

Further, by changing the distance between the display device 20 and the keyboard, it is possible to display a pattern corresponding to a part of the keyboard 10 or to display a pattern corresponding to the entire keyboard 10. There is no limit.

Furthermore, if the pattern information held in the pattern information holding device 302 can be changed by an external control signal (not shown), an optimal key top display can be obtained according to the type of the key input system. In addition, the key top display can be appropriately changed according to the application or mode to be used, and the input information by each key can be easily identified.

If the keyboard 10 in FIG. 1 is changed to an input system that detects an input according to a position touched by a user, such as a touch panel or a touch pad, the size and shape of the key can be changed.

In addition, the relative position identification means is attached to the user's finger or the like, and the position of the pattern displayed on the transmissive display unit 202 overlaps with the position of the relative position identification means which is visible to the user by image processing or the like. If a click is detected based on the distance from the device 20, the staying time, or an external device, the input can be detected by clicking on a part of the pattern where the finger is overlapped over the display device 20. Is no longer needed.

Further, if a plurality of users wearing the display device 20 and the control device 30 can simultaneously operate one operation unit (keyboard, touch panel, etc.), they can operate each while viewing the same screen. As a result, for example, the instructor can teach the student how to operate the keyboard.

Furthermore, if the relative position identification means has a unique authentication key and the pattern displayed on the display unit is changed for each recognizer, the head is moved in the same manner as when using a plurality of displays. It becomes possible to switch the screen only.

Further, if the display device 20 itself has a unique authentication key that allows the display device 20 to be individually identified, and the pattern displayed on the transmissive display unit 202 is changed for each display device 20, the same advertisement can be obtained. Even if the user sees, different images are displayed for adults and children, and different messages can be displayed for each message board.

For example, if a device that can recognize the movement of the pen by the user is attached to each page of the university notebook and the pattern entered with a pen-type input device such as a stylus is stored, it will be displayed only on the user's display device. And you can create notes without the dangers seen by others.

Also, if there are multiple users looking at the same screen, the guidance will be displayed by controlling the display on the display device so that some people will see a simple operation screen and others will see the operation guidance. A person can perform appropriate training for a person who cannot see the guidance while watching the guidance.

  Next, the display device of the present invention will be described. FIG. 4 shows an example of the configuration of the display device of the present invention. The same components as those in FIG. The screen 11 is provided with relative position identification means 101. The display device 20 is the same as the display device 20 of FIG. The control unit 30 includes an image processing device 301 and a pattern information generation device 303.

  The pattern information generation device 303 is held in reference position image information (a set of individual image information for each user (that is, the screen 11 used by the user)) input from an external device (not shown) and a user information holding device 401 described later. Pattern information (pattern information when the relative position between the screen 11 and the display device 20 is a reference position) is generated based on the user information.

The image processing apparatus 301 generates and outputs image information based on the pattern information output from the pattern information generation apparatus 303 and the relative position information output from the relative position recognition apparatus 201. The user information holding device 401 holds information about a user who uses the display device 20.

FIG. 5 will be described. FIG. 5 is an explanatory diagram of the usage state of the present invention. The user wears the display device 20 like glasses and visually recognizes the keyboard 10 through the transmissive display unit 202.

  The effect of the invention of FIG. 4 will be described with reference to FIG. Here, a case where the screen 11 is a movie screen will be described as an example. By displaying a common image (other than subtitles) on the screen 11 (screen) and displaying subtitles corresponding to the user information (the language used by the viewer) on the transparent display unit 202 of the screen used by the viewer, It is possible to recognize individual subtitles for each user while viewing one screen 11.

Here, Japanese users, the Chinese user, and on the screen of Korean users, subtitle means "hello" in their native languages will be displayed.

Next, the case where the screen 11 is a touch panel will be described as an example. When the user wears the display device 20 and looks at the touch panel through the transmissive display unit 202, different characters and symbols displayed on the transmissive display unit 202 appear to overlap with images on the touch panel. It is possible to acquire necessary information for each user according to the image displayed on the screen. This theory is the same as that already described with reference to FIG. 3 and therefore will not be described. However, the keyboard in FIG. 3A is assumed to be replaced with a touch panel.

If the screen 11 itself can be identified by a recognizer or the like, a plurality of screens 11 can be used simultaneously. Further, if the relative position identifying means 101 and a medium for storing a block of reference position image information are attached to a static medium such as a poster, the overall size of the display device 20 of the present invention can be reduced.

Further, when the instructor teaches the student how to operate the input system such as a touch panel (or keyboard), the display device 20 is visible so that the student can recognize the operation guidance together with the operation screen. If the display is controlled, the instructor can perform appropriate instruction to the student while viewing the guidance.

As described above, in the input system according to the present invention, when the glasses-type display device 20 is attached and the keyboard is viewed, characters, symbols, and the like displayed on the transmissive display unit 202 appear to overlap with corresponding keys on the keyboard. Therefore, it becomes possible to easily identify the input information corresponding to each key.

Therefore, there is an effect that it is not possible to determine what kind of input each key on the keyboard corresponds to other than the user as in the past, and in addition to this, the transmissive display unit 202 is used. The surrounding scene can also be recognized.

In the display system according to the present invention, the glasses-type display device 20 used in the above-described input system is used, and different information for each glasses-type display device and images common to all the glasses-type display devices are seen. You can watch movies on the same screen, even if the possible languages are different.

It is a block diagram of the input system of this invention. It is explanatory drawing of the utilization state of the input system of this invention. It is drawing explaining the relationship between the keyboard 1 and the transmissive display part 202, (A) is an outline figure of a keyboard, (B) is a pattern displayed on the transmissive display part 202, (C) is a transmissive display. 6 is a drawing when the keyboard 1 is viewed through the section 202. FIG. It is a block diagram of the display apparatus of this invention. It is explanatory drawing of the utilization condition of the display apparatus of this invention. It is explanatory drawing in case the screen 11 is a screen of a movie. It is a block diagram of the conventional input system. It is a block diagram of the conventional display apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Keyboard 11 Screen 20 Display apparatus 30 Control apparatus 101 Relative position identification means 201 Relative position recognition apparatus 202 Transmission type display part 301 Image processing apparatus 302 Pattern information holding apparatus 303 Pattern information generation apparatus 401 User information holding apparatus

Claims (2)

In an input system including an eyeglass-type display device that displays information and an input device that performs input based on information displayed on the eyeglass-type display device,
The input device includes a relative position identifying means for grasping a relative positional relationship with the glasses-type display device,
The glasses-type display device includes:
A relative position recognition device for recognizing information for grasping a relative positional relationship of at least one of a relative distance, inclination, and direction between the relative position identification means;
A transmissive display unit that displays information based on relative position information recognized by the relative position recognition device, and pattern information in the case where the positional relationship between the input device and the glasses-type display device is a reference; and An input system comprising: In a display system comprising a plurality of eyeglass-type display devices that display different information, and a screen that displays information common to these eyeglass-type display devices,
The screen includes a relative position identification unit for grasping a relative positional relationship between the plurality of glasses-type display devices,
The glasses-type display device includes:
A relative position recognition device for recognizing information for grasping a relative positional relationship of at least one of a relative distance, inclination, and direction between the relative position identification means;
Information is displayed based on relative position information recognized by the relative position recognition device, reference position image information that is a set of image information for each screen, and user information that is information of a user who uses the screen. A display system comprising: a transmissive display unit.

Images