WO2011136211A1

WO2011136211A1 - Operation device

Info

Publication number: WO2011136211A1
Application number: PCT/JP2011/060147
Authority: WO
Inventors: 優介鈴木; 省吾福島; 伸裕見市; 眞人鈴木; 武之酒井; 健一郎野坂
Original assignee: パナソニック電工株式会社
Priority date: 2010-04-27
Filing date: 2011-04-26
Publication date: 2011-11-03
Also published as: TW201205354A; JP2013148936A

Abstract

The disclosed operation device presents information that is used to operate designated equipment (9) to a user (P) and also receives operating input from the user (P). The operation device is equipped with a concave mirror (2), a detection unit (4) and a determination unit (5). The concave mirror (2) is provided in such a manner that the optical distance between the concave mirror (2) and an operating screen (information display medium) (A), which has information that can be viewed from the outside, is greater than the focal distance of the concave mirror (2). The concave mirror (2) is formed so that a real image (B) of the operating screen (real image of the information display medium) floats in space. The detection unit (4) detects operating input from the user (P) to the real image (B) of the operating screen. The determination unit (5) determines the operating content for the equipment (9), according to the operation input detected by the detection unit (4). Thus, the information used to operate the designated equipment (9) is presented to the user (P) at a position closer to the user than the installation site.

Description

Operating device

The present invention relates to an operation device that presents information used for operating a predetermined device to a user and receives an operation input from the user.

2. Description of the Related Art Conventionally, as an operation device used for a user to operate a device, for example, a device having an operation unit on the surface of the device main body such as a button type or a touch panel type for operation input by the user is known. (See Japanese Patent Application Publication No. 2009-260828). The conventional operating device determines the operation content with respect to an apparatus, when a user directly inputs and operates an operation part.

However, since the user needs to touch the operation unit in the conventional operation device, for example, the user is separated from the operation device, or the operation unit is provided between the user and the operation device. When there was no suitable place, there was a problem that the user was not easy to use. That is, in the conventional operating device, the installation location of the operating device is limited.

The present invention has been made in view of the above points, and an object of the present invention is to provide an operation device capable of presenting information used for operating a predetermined device to a user at a position closer to the user than the installation location. Is to provide.

The operating device of the present invention is an operating device that presents information used for operating a predetermined device to a user and receives an operation input from the user, and makes the information visible from the outside. A display unit having a concave mirror provided so that an optical distance to the display medium is longer than a focal length, and using the concave mirror to form a real image of the information display medium in a space; and the user A detection unit that detects an operation input to the real image, and a determination unit that determines an operation content for the device in accordance with the operation input detected by the detection unit.

In this operation device, it is preferable that the operation apparatus further includes a distance adjusting unit that changes the optical distance between the information display medium and the concave mirror within a range longer than the focal length of the concave mirror.

The operating device includes an instruction unit that gives an instruction to change the position of the real image, and the distance adjustment unit sets the optical distance between the information display medium and the concave mirror in accordance with an instruction from the instruction unit. It is preferable to change.

The operation device includes a visual function measuring unit that measures a visual function state of the user, and the distance adjusting unit is configured to perform the information display medium and the concave mirror according to the visual function state measured by the visual function measuring unit. It is preferable to change the optical distance between them.

In this operating device, it is preferable to provide a translucent member provided at a position where the real image is formed.

In this operation device, the display unit includes a beam splitter that is provided obliquely to the optical axis of the concave mirror and includes a split surface that divides the light into reflected light and transmitted light, and the beam splitter converts the reflected light into the reflected light. It is preferable that a real image of the information display medium is formed and presented to the user by reflecting the light to the concave mirror side and transmitting the light reflected by the concave mirror.

The operation device includes a monitor having a display surface on which the information display medium is displayed and projecting the information display medium displayed on the display surface, and the beam splitter is emitted from the monitor on the split surface. The reflected light is divided into the reflected light and the transmitted light, and the reflected light projected onto the center point of the mirror surface of the concave mirror is inclined toward the monitor side with respect to the normal line at the center point. Preferably, a beam splitter and the concave mirror are arranged, and the display surface of the monitor is formed in a non-planar shape.

In this operation device, it is preferable that the display surface of the monitor is formed to be convex toward the side opposite to the beam splitter.

The operation device includes a monitor having a display surface on which the information display medium is displayed and projecting the information display medium displayed on the display surface, and the beam splitter is emitted from the monitor on the split surface. The reflected light is divided into the reflected light and the transmitted light, and the reflected light projected onto the center point of the mirror surface of the concave mirror is inclined toward the monitor side with respect to the normal line at the center point. It is preferable that a beam splitter and the concave mirror are disposed, and the splitting surface of the beam splitter is formed to be non-planar.

In this operation device, it is preferable that the split surface of the beam splitter is formed to be convex toward the side opposite to the concave mirror.

In this operating device, it is preferable that the mirror surface of the concave mirror is formed as an aspherical surface.

In this operating device, the beam splitter is preferably a half mirror.

According to the present invention, since the real image of the information display medium can be formed so as to float in the space between the installation location of the operating device and the user, the information used for operating a predetermined device can be It can be presented to the user at a position closer to the user than the place. Thereby, in this invention, a user can perform operation input near.

1 is a configuration diagram of an operating device according to Embodiment 1. FIG. It is a figure which shows the operation screen of the operating device which concerns on the same as the above. It is the schematic explaining the 1st usage example of the operating device which concerns on the same as the above. It is the schematic explaining the 2nd usage example of the operating device which concerns on the same as the above. It is the schematic explaining the 3rd usage example of the operating device which concerns on the same as the above. FIG. 6 is a configuration diagram of an operating device according to a second embodiment. It is a block diagram of the operating device which concerns on Embodiment 3. FIG. FIG. 6 is a schematic diagram of an operating device according to a fourth embodiment. It is a figure explaining the design parameter of the operating device which concerns on the same as the above. In the operating device according to the above, (a) shows a real image distortion grid when the viewing distance is 400 mm, and (b) shows a real image distortion grid when the viewing distance is 410 mm. FIG. 10 is a schematic diagram of an operating device according to a fifth embodiment. It is a figure explaining the design parameter of the operating device which concerns on the same as the above. In the operating device according to the above, (a) shows a real image distortion grid when the viewing distance is 400 mm, and (b) shows a real image distortion grid when the viewing distance is 410 mm. It is the schematic explaining the principle of a concave mirror. It is a figure which shows the positional relationship of the operation screen at the time of using a concave mirror and a real image. It is the schematic of the operating device of a comparative example. In the operation device of the comparative example, (a) is a diagram showing a real image distortion grid when the viewing distance is 400 mm, and (b) is a diagram showing a real image distortion grid when the viewing distance is 410 mm.

(Embodiment 1)
The operating device according to the first embodiment presents information used for operating a predetermined device to the user and accepts an operation input from the user. As shown in FIG. 1, the operating device of the present embodiment includes a monitor 1, a concave mirror 2, a half mirror 3, a detection unit 4, a determination unit 5, and a distance adjustment unit 6, and a predetermined device 9. It is connected to the.

The monitor 1 is configured to display an operation screen A as shown in FIG. The monitor 1 is small, and a small flat panel display such as a liquid crystal display or an organic electro-luminescence display is used so that display contents can be easily controlled. Control for displaying the operation screen A is performed on the monitor 1 by, for example, a computer (not shown). Note that the monitor 1 displays an operation screen according to the optical distance a (see FIG. 14) between the operation screen A and the concave mirror 2 in order to present a later-described real image B to the user P with a certain brightness. It is possible to change the brightness of A. The monitor 1 can also change the brightness of the operation screen A according to the preference of the user P.

The operation screen A is a screen used for the user P to operate the device 9. On the operation screen A, a plurality of buttons Bt1 to Bt3 for receiving an operation input from the user P to the device 9 (hereinafter referred to as “device operation input”) are displayed. On the operation screen A, buttons Bt4 and Bt5 for receiving an operation input for changing the position of a real image B (to be described later) from the user P (hereinafter referred to as “position change operation input”) are displayed. That is, the operation screen A has information necessary for the user P to operate the device 9 so as to be visible from the outside. The operation screen A corresponds to an information display medium.

The concave mirror 2 shown in FIG. 1 is provided so that the optical distance a (see FIG. 14) between the operation screen A and the concave mirror 2 is longer than the focal length f (see FIG. 14) of the concave mirror 2. The user P is located in front of the concave mirror 2 on the optical axis Lx. The concave mirror 2 forms the real image B of the operation screen so as to float in the space between the concave mirror 2 and the user P, and presents the real image B of the operation screen to the user P. The concave mirror 2 corresponds to a display unit, and the real image B of the operation screen corresponds to a real image of the information display medium.

The principle of real image display when the concave mirror 2 is used will be described with reference to FIGS. F in FIG. 14 is the focal position of the concave mirror 2. When the operation screen A is on the side opposite to the concave mirror 2 (right side in FIG. 14) from the focal position F, a real image (inverted real image) B of the operation screen is formed in front of the concave mirror 2. The optical distance b between the real image B of the operation screen and the concave mirror 2 is obtained by using the optical distance a between the operation screen A and the concave mirror 2 and the focal length f of the concave mirror 2.
b = a × f / (af) (1)
It is expressed as The size B ₁ B ₂ of the real image B operation screen A is the size of the operation screen A When A ₁ A _2,
B ₁ B ₂ = A ₁ A ₂ × | f | / | af | (2)
It becomes.

FIG. 15 shows a value (b / f) in which the optical distance b is normalized by the focal length f with respect to a value (a / f) in which the optical distance a is normalized by the focal length f. From FIG. 15, when the value (a / f) changes in the range of 1 ≦ (a / f) ≦ 2, the value (b / f) changes in the range of (b / f) ≧ 2. For example, when the radius of curvature R of the concave mirror 2 is 300 mm, the focal length f (= R / 2) is 150 mm. Therefore, when the optical distance a can be changed in the range of 150 mm ≦ a ≦ 300 mm, the optical distance b can be changed in the range of b ≧ 300 mm.

The half mirror 3 shown in FIG. 1 is provided obliquely to the optical axis Lx of the concave mirror 2 at an angle of 45 degrees. The half mirror 3 reflects the light emitted from the operation screen A of the monitor 1 on the concave mirror 2 side in the direction of the optical axis Lx of the concave mirror 2, and transmits the light reflected by the concave mirror 2, thereby allowing the real image B of the operation screen to be transmitted. Is presented to the user P. Thus, unlike the structure in which the monitor 1 is provided between the user P and the concave mirror 2, the monitor 1 presents the real image B of the operation screen to the user P without blocking the user's line of sight. Can do. The half mirror 3 corresponds to the display unit together with the concave mirror 2.

As described above, in the operating device of the present embodiment, the half mirror 3 operates on the space in front of the concave mirror 2 by reflecting the light from the operation screen A toward the concave mirror 2 and transmitting the light reflected by the concave mirror 2. The light of the screen A can be imaged to form a real image B of the operation screen. Since the real image B of the operation screen is highly directional and the viewing angle at which the real image B of the operation screen can be viewed is narrow, the user P can only view the real image B of the operation screen from a narrow range near the optical axis Lx of the concave mirror 2. It can be visually recognized.

The detection unit 4 includes an imaging unit 41 and a processing unit 42. The detection unit 4 corresponds to a detection unit and an instruction unit.

The imaging unit 41 is, for example, a CCD (Charge Coupled Device) camera or the like, and captures a space between the operation device and the user P where the real image B of the operation screen is formed at predetermined time intervals. Accordingly, when the user P performs an operation input while viewing the real image B on the operation screen, the imaging unit 41 can capture an operation related to the operation input of the user P.

The processing unit 42 includes, for example, a computer microprocessor (MPU: Micro Processing Unit) as a main component, and detects within a range corresponding to each button Bt1 to Bt5 (see FIG. 2) on the captured image obtained by the imaging unit 41. It has a function to set an area. In other words, the range of the buttons Bt1 to Bt5 is presented to the user P by a graphic on the real image B of the operation screen, and the range corresponding to the graphic of the buttons Bt1 to Bt5 on the captured image obtained by capturing the real image B of the operation screen. The detection area is set to. The detection area includes an area corresponding to device operation input and an area corresponding to position change operation input.

The processing unit 42 acquires a captured image obtained by the imaging unit 41 every predetermined time. The processing unit 42 calculates a pixel value difference for each pixel in the detection region between the acquired captured image and the captured image in the initial state (the state where there is no operation input), and the difference value of each pixel in the detection region. Find the sum of The processing unit 42 compares the sum of difference values with a threshold value. When the sum of the difference values is larger than the threshold value, the processing unit 42 determines that there is an operation input corresponding to the detection area. When the sum of the difference values is equal to or smaller than the threshold value, the processing unit 42 determines that there is no operation input corresponding to the detection area. The processing unit 42 performs such determination for each detection region.

From the above, for each detection area, the processing unit 42 detects a device operation input when it is determined that there is a device operation input, and detects a position change operation input when it is determined that there is a position change operation input. Will do.

Information on the device operation input detected by the processing unit 42 is output from the processing unit 42 to the determination unit 5. Information on the position change operation input detected by the processing unit 42 is output from the processing unit 42 to the distance adjustment unit 6.

The determination unit 5 includes a storage unit 51, a processing unit 52, and an output unit 53. The storage unit 51 stores in advance a correspondence relationship between the device operation input of the user P and the operation content on the device 9.

The processing unit 52 uses, for example, a microprocessor of a computer as a main component, and acquires and determines the operation content corresponding to the device operation input detected by the detection unit 4 from the storage unit 51. The processing unit 52 controls the output unit 53 to output information on the determined operation content to the device 9.

The distance adjusting unit 6 includes a holding plate 61, a linear guide 62, a feed screw 63, a pulley 64, a pulley belt 65, a motor 66, a control unit 67, and a storage unit 68, and moves the monitor 1. It is the drive device comprised so that it might make.

The monitor 1 is held on the holding plate 61. The linear guide 62 supports the holding plate 61. The motor 66 is an electronic motor serving as a drive source for the distance adjusting unit 6. The pulley 64 and the pulley belt 65 transmit the rotational driving force of the motor 66 to the feed screw 63. The control unit 67 uses, for example, a computer microprocessor as a main component, and controls the motor 66 in accordance with information input from the detection unit 4. As described above, the distance adjusting unit 6 realizes the movement of the monitor 1 in the vertical direction (the arrow direction in FIG. 1) by converting the rotational driving force generated by the motor 66 into a linear motion by the feed screw 63. Note that the computer used for the control unit 67 may be a general-purpose computer such as a personal computer or a dedicated computer.

As described above, when the position change operation input information is input from the detection unit 4, the distance adjustment unit 6 can move the monitor 1 up and down according to the position change operation input information. When the monitor 1 moves up and down, the optical distance a (see FIG. 14) between the operation screen A on the monitor 1 and the concave mirror 2 changes, and the optical distance b between the real image B of the operation screen and the concave mirror 2 ( Changes). However, the moving range of the monitor 1 is limited to a range in which the optical distance a between the operation screen A and the concave mirror 2 is longer than the focal length f of the concave mirror 2.

Specifically, in the case of a position change operation input for bringing the real image B of the operation screen closer to the user P side, the distance adjustment unit 6 moves the monitor 1 below the current state so that the operation screen A and the concave mirror 2 Is shortened. As a result, the optical distance b between the real image B on the operation screen and the concave mirror 2 becomes longer, and the real image B on the operation screen is presented closer to the user P side than before. On the other hand, in the case of a position change operation input for moving the real image B of the operation screen away from the user P, the distance adjustment unit 6 moves the monitor 1 above the current state to increase the optical distance a. Thereby, the optical distance b becomes shorter, and the real image B of the operation screen is presented farther from the user P than before.

Next, the operation of the operating device according to this embodiment will be described. First, when the monitor 1 displays the operation screen A, the concave mirror 2 forms a real image B of the operation screen so as to float in the space and presents it to the user P. Thereafter, the user P sees the real image B on the operation screen and inputs an operation in the manner of touching the touch panel. In the detection unit 4, the processing unit 42 detects a device operation input of the user P from the captured image of the imaging unit 41. In the determination unit 5, the processing unit 52 acquires the operation content corresponding to the device operation input detected by the detection unit 4 from the storage unit 51 and determines it. Information on the determined operation content is output from the output unit 53 to the device 9.

In addition, when the processing unit 42 of the detection unit 4 detects a position change operation input from the captured image of the imaging unit 41, the processing unit 42 outputs information on the position change operation input to the distance adjustment unit 6. The control unit 67 of the distance adjustment unit 6 moves the monitor 1 according to the information of the position change operation input from the detection unit 4. Thereby, the user P can adjust the position of the real image B on the operation screen to a position suitable for his / her visual function state.

Next, a usage example of the operation device according to the present embodiment will be described. First, as a first usage example, a case where the operation device of the present embodiment is used in a bathroom or a shower room will be described with reference to FIG. That is, as a first usage example, a bathroom operation device such as a hot water operation device for a shower will be described. The operating device is installed embedded in a wall W of a bathroom (shower room). According to the first use example, even if the operation device is not installed near the user P when water from the shower S passes through the user P, the operation is performed closer to the installation location of the operation device. A real image B of the screen can be formed. Thereby, the user P can understand the information on the operation screen A by seeing the real image B of the operation screen even when the visibility is low by removing the glasses or contact lenses.

Subsequently, as a second usage example, a case where the operation device of the present embodiment is used in a kitchen will be described with reference to FIG. That is, a kitchen operating device will be described as a second usage example. In the kitchen, a work space and a high temperature part are required near the cook (user P). Also, it is not hygienic for the cook to touch the operating device directly during cooking. However, according to the operation device of the present embodiment, the cook can input an operation without directly touching the operation device. The operation information is, for example, the temperature of the stove. A cooking recipe may be displayed on the real image B of the operation screen.

Subsequently, as a third usage example, a case where the operation device of the present embodiment is used for, for example, a bank ATM or an automatic lock door authentication device will be described with reference to FIG. The operation device displays highly confidential information, and an operation input such as a password input is performed. According to the third usage example, the user P can operate near the installation position of the operating device, and the directivity of the real image B of the operation screen is high. It is possible to prevent the input content from being easily viewed.

As described above, according to the operation device of the present embodiment, the real image B of the operation screen can be formed so as to float in the space between the installation location of the operation device and the user P, so that the predetermined device 9 is operated. Therefore, information used for the purpose can be displayed at a position closer to the user P than the installation location. Thereby, in the operating device of this embodiment, the user P can input operation nearby.

According to the operation device of the present embodiment, the directivity of the real image B on the operation screen can be increased, so that the viewing angle at which the real image B on the operation screen can be viewed can be limited. The information it has can be presented only to the user P.

Further, according to the operation device of the present embodiment, the distance adjustment unit 6 changes the optical distance a between the operation screen A and the concave mirror 2 within a range longer than the focal length f of the concave mirror 2, thereby Since the real image B can be easily moved, the position of the real image B on the operation screen can be changed for each user P.

Furthermore, according to the operation device of the present embodiment, the distance adjustment unit 6 changes the optical distance a between the operation screen A and the concave mirror 2 in accordance with the position change operation input detected by the detection unit 4, whereby the operation screen The position of the real image B can be changed according to the preference of the user P.

Further, according to the operation device of the present embodiment, when the half mirror 3 obliquely crosses the optical axis Lx of the concave mirror 2, the operation screen A itself is obstructive when the user P visually recognizes the real image B of the operation screen. Can be prevented.

Furthermore, since the operation device of this embodiment can input operation without the user P touching the operation screen A directly, it is difficult for the user P to touch the operation screen A directly, or unsanitary. Even if it is, it is possible to input an operation without touching the operation screen A.

As a modification of the present embodiment, the operating device does not necessarily have a function of changing the optical distance a according to the position change operation input of the user P. That is, the position of the real image B on the operation screen may be fixed. Similarly to the operation device of the present embodiment, the operation device of the present modification can also be formed so that the real image B of the operation screen floats in the space between the installation location of the operation device and the user P. The information used for operating the device 9 can be displayed at a position closer to the user P than the installation location, and as a result, the user P can perform operation input nearby. In addition, since the directivity of the real image B on the operation screen can be increased, the viewing angle at which the real image B on the operation screen can be viewed can be limited, and the information that the operation screen A has can be used only by the user P. Can be presented. The same applies to the following second and third embodiments.

As a modification of the present embodiment, the operating device may use a flat object such as paper instead of the operation screen A as an information display medium used for operating the device 9, or a three-dimensional object. May be used. The planar object and the three-dimensional object can be moved by being directly or indirectly attached to the holding plate 61 of the distance adjusting unit 6. Even when a planar object or a three-dimensional object is used as the information display medium, the operation device transfers the real image of the information display medium (planar object, three-dimensional object) to the space between the installation position of the operation device and the user P. Since it can be formed so as to float, the information used for operating the predetermined device 9 can be presented to the user P at a position closer to the user P than the installation location, and as a result, the user P can be operated and input nearby. In addition, since the directivity of the real image of the information display medium can be increased, the viewing angle at which the real image of the information display medium can be viewed can be limited, and the information that the information display medium has can be limited to the user P only. Can be presented. The same applies to the following second and third embodiments.

Furthermore, in order to change the optical distance a between the operation screen A and the concave mirror 2, a method of moving only the monitor 1 (operation screen A), a method of moving only the concave mirror 2, and both the monitor 1 and the concave mirror 2 are used. There are three methods of moving. The operation device according to the present embodiment employs a method in which only the monitor 1 is moved using the distance adjustment unit 6. However, as a modification of the present embodiment, the operating device includes a concave mirror driving unit that moves the concave mirror 2 in the direction of the optical axis Lx of the concave mirror 2 instead of the distance adjusting unit 6 or together with the distance adjusting unit 6. Also good. The operating device of this modification can move the real image B of the operating screen by moving the concave mirror 2. However, in order for the user P to correctly observe the real image B, the position of the eye of the user P with respect to the concave mirror 2 is limited to a certain range. For this reason, when the concave mirror 2 is moved, the position of the eye of the user P also needs to be moved. Accordingly, among the above three methods, the method of moving only the monitor 1 is the best and practical. That is, the distance adjusting unit 6 of this embodiment is superior to the concave mirror driving unit in that it is not necessary to move the position of the eye of the user P, and is realistic. The same applies to the following second and third embodiments.

As a modification of the present embodiment, the monitor 1 may be provided separately from the operating device. According to the operation device of this modification, the same effect can be obtained by performing the same operation as the operation device of the present embodiment using the commercially available monitor 1. The same applies to the following second and third embodiments.

(Embodiment 2)
The operation device according to the second embodiment has a function of changing the optical distance a between the operation screen A and the concave mirror 2 according to the visual function state of the user P. (See FIG. 1). Hereinafter, the operating device of the present embodiment will be described with reference to FIG. In addition, about the component similar to the operating device of Embodiment 1, the same code | symbol is attached | subjected and description is abbreviate | omitted.

The operating device of this embodiment includes a visual function measuring unit 7 as shown in FIG. The visual function measuring unit 7 is an infrared optometer (autorefractometer), for example, and measures the visual function state of the user P. Visual functions include a focus adjustment function (visual acuity), pupil response, and convergence. The focus adjustment function refers to a function that always forms an image on the retina by changing the refractive power of the lens according to the distance between the lens and the target. Pupil reaction refers to adjusting the pupil in response to a stimulus such as a change in the amount of light. Convergence means that when looking at a nearby visual target, the eye muscles are placed on the inner side (nose side) so that the nearby line of sight is in focus. Information on the visual function state measured by the visual function measuring unit 7 is output to the distance adjusting unit 6.

The storage unit 68 of the distance adjusting unit 6 of the present embodiment stores in advance the correspondence between the optical distance a between the operation screen A and the concave mirror 2 and the visual function state of the user P.

When the information on the visual function state is input from the visual function measuring unit 7, the control unit 67 of the present embodiment acquires the value of the optical distance a corresponding to the information from the storage unit 68. Thereafter, the control unit 67 moves the monitor 1 so that the actual optical distance a becomes a value acquired from the storage unit 68. As a result, the optical distance a between the operation screen A and the concave mirror 2 changes according to the visual function state measured by the visual function measuring unit 7.

Next, the operation of the operating device according to this embodiment will be described. First, when the operation screen A is displayed on the monitor 1, the concave mirror 2 forms a real image B of the operation screen so as to float in the space and presents it to the user P. Thereafter, the visual function measuring unit 7 measures the visual function state of the user P. Information on the visual function state measured by the visual function measuring unit 7 is output from the visual function measuring unit 7 to the distance adjusting unit 6. The control unit 67 of the distance adjustment unit 6 acquires the value of the optical distance a corresponding to the information input from the visual function measurement unit 7 from the storage unit 68. Thereafter, the control unit 67 moves the monitor 1 so that the actual optical distance a becomes a value acquired from the storage unit 68.

After that, the user P performs operation input while viewing the real image B on the operation screen. In the detection unit 4, the processing unit 42 detects a device operation input of the user P from the captured image of the imaging unit 41. Thereafter, the processing unit 52 of the determination unit 5 acquires the operation content corresponding to the device operation input detected by the detection unit 4 from the storage unit 51 and determines it. Information on the determined operation content is output from the output unit 53 to the device 9.

The usage example of the operation device of the present embodiment is the same as the first to third usage examples of the first embodiment. The operation device is used in a bathroom or kitchen, or used in a bank ATM or a building auto-lock door. be able to.

As described above, according to the operating device of the present embodiment, the distance adjusting unit 6 changes the optical distance a between the operation screen A and the concave mirror 2 according to the visual function state measured by the visual function measuring unit 7. The real image B of the operation screen can be moved to a position suitable for the visual function state of the person P.

As a modification of the present embodiment, the operating device does not necessarily have a function of changing the optical distance a according to the position change operation input. That is, the operating device of this modification changes the optical distance a between the operation screen A and the concave mirror 2 only in accordance with the visual function state measured by the visual function measuring unit 7. Even in the operation device according to this modification, the distance adjustment unit 6 changes the optical distance a between the operation screen A and the concave mirror 2 according to the visual function state measured by the visual function measurement unit 7. The position of the real image B on the operation screen can be moved to a position suitable for the visual function state of P.

(Embodiment 3)
The operating device according to the third embodiment is different from the operating device according to the second embodiment (see FIG. 6) in that the operating device according to the third embodiment includes a translucent member 8 provided at a position where the real image B of the operation screen is formed. . Hereinafter, the operating device of this embodiment will be described with reference to FIG. In addition, about the component similar to the operating device of Embodiment 2, the same code | symbol is attached | subjected and description is abbreviate | omitted.

The translucent member 8 is a member in which, for example, transparent plastic or glass is formed in a plate shape, and the normal direction is set along the optical axis Lx of the concave mirror 2. That is, the translucent member 8 is installed so that the operation screen A overlaps the plane of the translucent member 8. The translucent member 8 moves to the moved position when the position of the real image B on the operation screen changes.

The usage example of the operating device of the present embodiment is the same as that of the second embodiment, and the operating device can be used for a bathroom or kitchen, a bank ATM, a building auto-lock door, or the like.

As described above, according to the operation device of the present embodiment, the translucent member 8 is provided at a position where the real image B of the operation screen is formed, so that the real image B of the operation screen is formed to float in the space. Since the user P can easily recognize the position of the real image B on the operation screen, the operability of the user P can be improved.

(Embodiment 4)
The operating device according to the fourth embodiment is different from the operating device according to the first embodiment (broken line in FIG. 8) in that the half mirror 3a is raised as shown in FIG. In addition, about the component similar to the operating device of Embodiment 1, the same code | symbol is attached | subjected and description is abbreviate | omitted.

In the monitor 1a of the present embodiment, the display surface 11 for displaying the operation screen A is not so as to reduce distortion of the real image B of the operation screen imaged by the concave mirror 2a as compared with the case where the display surface is a flat surface. It is formed in a plane (curved surface). Specifically, the display surface 11 of the monitor 1a is formed in a spherical surface that is convex toward the side opposite to the half mirror 3a. The display surface 11 may be a non-planar surface other than the spherical surface as described above as long as the distortion of the real image B on the operation screen can be reduced.

The concave mirror 2a and the half mirror 3a of this embodiment are arranged as shown in FIG. That is, the concave mirror 2a and the half mirror 3a so that the reflected light 33 projected onto the center point 22 of the mirror surface 21 of the concave mirror 2a is inclined to the monitor 1a side (upper side in FIG. 8) with respect to the normal line 23 at the center point 22. Is arranged. In other words, the reflected light 33 is inclined counterclockwise with respect to the normal 23 around the Y axis in FIG. The split surface 31 of the half mirror 3a rises in a direction (left side in FIG. 8) facing the mirror surface 21 of the concave mirror 2a as compared to the half mirror 3.

The half mirror 3a is arranged as described above with respect to the concave mirror 2a, and the angle θ1 formed by the split surface 31 and the optical axis of the monitor 1a at the point 32 of the split surface 31 is 45 ° with respect to the monitor 1a. It is arranged to be less than. A point 32 on the dividing surface 31 is a point at which the reflected light 33 projected onto the center point 22 of the mirror surface 21 of the concave mirror 2a is generated. Instead of the half mirror 3a, another beam splitter having a plane dividing surface may be used.

The mirror surface 21 of the concave mirror 2a of this embodiment is formed in an elliptical surface (aspherical surface) so as to reduce distortion of the real image B on the operation screen from the spherical surface. That is, the concave mirror 2a of the present embodiment is an elliptical mirror (aspherical mirror) shaped so as to reduce the distortion of the real image B on the operation screen as compared with a spherical mirror. The mirror surface 21 of the concave mirror 2a is not necessarily an elliptical surface as described above, but may be an aspherical surface that reduces distortion of the real image B on the operation screen rather than a spherical surface.

In the operating device of the present embodiment, as shown in FIG. 9, the monitor 1a is arranged so that the height L1 from the lowest position of the concave mirror 2a is movable between 182 mm and 185 mm, and the length of the concave mirror 2a in the Y-axis direction is set. The length L2 is 160 mm, and the length L3 in the Z-axis direction is 120 mm. In the X-axis direction, the distance L4 between the concave mirror 2a (center point 22) and the half mirror 3a (point 32) is 50 mm, and the distance L5 between the concave mirror 2a (center point 22) and the observation point 8 is 800 mm. It is. In addition, said height L1, length L2, L3, and distance L4, L5 are examples, and are not limited to said value, It sets suitably according to a use.

As shown in FIG. 10, the real image (solid line in FIG. 10) in the operating device of the present embodiment is compared with the case where the display surface 911 of the monitor 91 is a flat surface as shown in FIG. 16 (see the solid line in FIG. 17). , Distortion is reduced. The half mirror 93 shown in FIG. 16 rises in a direction (left side in FIG. 16) facing the mirror surface 921 (21) of the concave mirror 92 (2a) as compared to the half mirror 3. The half mirror 93 divides the light emitted from the monitor 91 into reflected light and transmitted light by a flat dividing surface 931. As an example of this embodiment, FIG. 10 shows that the radius of curvature of the display surface 11 of the monitor 1a is 50 mm and the conic constant k is −5.0, the radius of curvature of the mirror surface 21 of the concave mirror 2a is 250 mm, and the conic constant k. The distortion grating of the real image in the case where is −0.3 is shown. FIG. 10A shows a case where the viewing distance L6 is 400 mm, and FIG. 10B shows a case where the viewing distance L6 is 410 mm. The curvature radii and the conic constant k of the monitor 1a and the concave mirror 2a are not limited to the above values, and are appropriately set according to the application. The broken lines in FIGS. 10 and 17 indicate the distortion grid displayed on the display surface 11.

From the above, when the half mirror 3a is arranged so that the reflected light 33 projected onto the center point 22 of the mirror surface 21 of the concave mirror 2a is inclined to the monitor 1a side with respect to the normal line 23, the display surface 11 of the monitor 1a. By making the surface non-planar (spherical), the distortion of the real image B on the operation screen can be reduced compared to the case of the monitor 91 having a flat display surface 911.

From the above description, in the operating device of the present embodiment, the concave mirror 2a and the half mirror 3a are such that the reflected light 33 projected onto the center point 22 of the mirror surface 21 of the concave mirror 2a is inclined to the monitor 1a side with respect to the normal 23. And the display surface 11 of the monitor 1a is formed in a non-planar shape. Thereby, in the operating device of this embodiment, the width W1 of the device can be reduced without increasing the distortion of the real image B on the operating screen. That is, the operating device according to the first embodiment presents the real image B closer to the operation screen A as a visual target without causing the user P to worry about distortion of the visual target. The width W1 of the device can be made thinner than the width W2 of the broken line in FIG.

Particularly, in the operating device of the present embodiment, the display surface 11 of the monitor 1a is formed in a convex shape on the side opposite to the half mirror 3a, so that distortion of the visual target can be reduced more easily.

Furthermore, in the operating device of the present embodiment, the distortion of the target can be more easily reduced because the mirror surface 21 of the concave mirror 2a is aspherical.

In this embodiment as well, the optical distance between the display surface 11 and the concave mirror 2a can be changed by the distance adjusting unit 6 within a range longer than the focal length of the concave mirror 2a.

(Embodiment 5)
The operating device according to the fifth embodiment is different from the operating device according to the first embodiment (broken line in FIG. 11) in that the half mirror 3b is raised as shown in FIG. In addition, about the component similar to the operating device of Embodiment 1, the same code | symbol is attached | subjected and description is abbreviate | omitted.

The split surface 31 of the half mirror 3b according to the present embodiment is formed to be non-planar (curved surface) so as to reduce distortion of the real image B of the operation screen imaged by the concave mirror 2b as compared with the case where the split surface is a flat surface. Has been. Specifically, the split surface 31 of the half mirror 3b is formed in a spherical surface that is convex to the opposite side to the concave mirror 2b. The dividing surface 31 may be a non-planar surface other than the spherical surface as described above as long as the distortion of the real image B on the operation screen can be reduced.

The concave mirror 2b and the half mirror 3b of this embodiment are arranged as shown in FIG. That is, the concave mirror 2b and the half mirror 3b so that the reflected light 23 projected onto the center point 22 of the mirror surface 21 of the concave mirror 2b is inclined to the monitor 1 side (upper side in FIG. 11) with respect to the normal line 23 at the center point 22. Is arranged. In other words, the reflected light 33 is inclined counterclockwise with respect to the normal line 23 around the Y axis in FIG. The split surface 31 of the half mirror 3b rises in a direction (left side in FIG. 11) facing the mirror surface 21 of the concave mirror 2b as compared to the half mirror 3.

The half mirror 3b is arranged as described above with respect to the concave mirror 2b, and the angle θ2 formed by the tangent 34 of the dividing surface 31 and the optical axis of the monitor 1 at the point 32 of the dividing surface 31 with respect to the monitor 1. Is arranged to be less than 45 °. A point 32 on the dividing surface 31 is a point at which the reflected light 33 projected onto the center point 22 of the mirror surface 21 of the concave mirror 2b is generated. Instead of the half mirror 3b, another beam splitter having a split surface having the above shape may be used.

The mirror surface 21 of the concave mirror 2b of this embodiment is formed in an elliptical surface (aspherical surface) so as to reduce distortion of the real image B on the operation screen from the spherical surface. That is, the concave mirror 2b of the present embodiment is an elliptical mirror (aspherical mirror) shaped so as to reduce distortion of the real image B on the operation screen as compared with the case of a spherical mirror. The mirror surface 21 of the concave mirror 2b does not necessarily have to be an elliptical surface as described above, and may be an aspherical surface that reduces distortion of the real image B on the operation screen rather than a spherical surface.

In the operating device of the present embodiment, as shown in FIG. 12, the monitor 1 is arranged so that the height L1 of the concave mirror 2b from the lowest position is movable between 182 mm and 185 mm, and the length of the concave mirror 2b in the Y-axis direction is set. The length L2 is 160 mm, and the length L3 in the Z-axis direction is 120 mm. In the X-axis direction, the distance L4 between the concave mirror 2b (center point 22) and the half mirror 3b (point 22) is 50 mm, and the distance L5 between the concave mirror 2b (center point 22) and the observation point 8 is 800 mm. It is. In addition, said height L1, length L2, L3, and distance L4, L5 are examples, and are not limited to said value, It sets suitably according to a use.

As shown in FIG. 13, the real image (solid line in FIG. 13) in the operating device of the present embodiment is compared with the case where the dividing surface 931 of the half mirror 93 as shown in FIG. 16 is a plane (see the solid line in FIG. 17). This reduces distortion. FIG. 12 shows, as an example of this embodiment, the radius of curvature of the split surface 31 of the half mirror 3b is 5000 mm, the conic constant k is −50.0, the radius of curvature of the mirror surface 21 of the concave mirror 2b is 250 mm, and the conic constant. The distortion grating of the real image when k is −0.78 is shown. FIG. 13A shows a case where the viewing distance L6 is 400 mm, and FIG. 13B shows a case where the viewing distance L6 is 410 mm. The curvature radii and the conic constant k of the monitor 1 and the concave mirror 2b are not limited to the above values, and are appropriately set according to the application. The broken lines in FIGS. 13 and 17 indicate the distortion grid displayed on the display surface 11.

From the above, when the half mirror 3b is arranged so that the reflected light 33 projected onto the center point 22 of the mirror surface 21 of the concave mirror 2b is inclined to the monitor 1 side with respect to the normal line 23, the split surface of the half mirror 3b By making 31 a non-planar surface (spherical surface), the distortion of the real image B on the operation screen can be reduced as compared with the case of the half mirror 93 in which the dividing surface 931 is a flat surface.

From the above description, in the operating device of the present embodiment, the concave mirror 2b and the half mirror 3b are arranged such that the reflected light 33 projected onto the center point 22 of the mirror surface 21 of the concave mirror 2b is inclined to the monitor 1 side with respect to the normal 23. Are arranged, and the dividing surface 31 of the half mirror 3b is formed to be non-planar. Thereby, in the operating device of this embodiment, the width W1 of the device can be reduced without increasing the distortion of the real image B on the operating screen. That is, the operating device according to the first embodiment presents the real image B closer to the operation screen A as a visual target without causing the user P to worry about distortion of the visual target. Compared with the width W2 of the broken line in FIG. 11, the width W1 of the device can be reduced.

In particular, in the operating device of the present embodiment, the division surface 31 of the half mirror 3b is formed in a convex shape on the opposite side to the concave mirror 2b, so that distortion of the visual target can be reduced more easily.

Furthermore, in the operating device according to the present embodiment, since the mirror surface 21 of the concave mirror 2b is aspherical, the distortion of the target can be reduced more easily.

In this embodiment as well, the distance adjusting unit 6 can change the optical distance between the image formed by the half mirror 3b and the concave mirror 2b within a range longer than the focal length of the concave mirror 2b.

The detection unit 4 of each embodiment may detect three-dimensional coordinates in the real space of the operation position by the user P's finger using outputs of two position detection sensors (not shown). For example, when a camera is used as the position detection sensor, the detection unit 4 recognizes the fingertip portion of the user P in the image for each of two images captured by each camera, and obtains the coordinates of the fingertip portion in the image. . The detecting unit 4 that has obtained the coordinates in the image obtains a coordinate range in the real space corresponding to the obtained coordinates in accordance with the camera arrangement and lens characteristics, and the overlapping position of the coordinate ranges in the real space obtained for the two images. Is a three-dimensional coordinate in the real space of the operation position by the finger of the user P.

Claims

An operation device that presents information used for operating a predetermined device to a user and receives an operation input from the user,
A concave mirror provided so that an optical distance to the information display medium that enables the information to be visually recognized from outside is longer than a focal length, and a real image of the information display medium is floated in space using the concave mirror A display part to be formed on,
A detection unit for detecting an operation input from the user to the real image;
An operating device, comprising: a determining unit that determines an operation content for the device according to the operation input detected by the detecting unit.
The operation device according to claim 1, further comprising a distance adjusting unit that changes the optical distance between the information display medium and the concave mirror within a range longer than the focal length of the concave mirror.
An instruction unit for giving an instruction to change the position of the real image;
The operating device according to claim 2, wherein the distance adjustment unit changes the optical distance between the information display medium and the concave mirror in accordance with an instruction from the instruction unit.
A visual function measuring unit for measuring the visual function state of the user;
The operating device according to claim 2, wherein the distance adjustment unit changes the optical distance between the information display medium and the concave mirror according to the visual function state measured by the visual function measurement unit. .
The operating device according to claim 1, further comprising a translucent member provided at a position where the real image is formed.
The display unit includes a beam splitter that is provided obliquely with respect to the optical axis of the concave mirror and includes a split surface that divides the light into reflected light and transmitted light, and the beam splitter reflects the reflected light toward the concave mirror. The operating device according to claim 1, wherein a real image of the information display medium is formed and presented to the user by transmitting the light reflected by the concave mirror.
A monitor having a display surface on which the information display medium is displayed and projecting the information display medium displayed on the display surface;
The beam splitter divides the light emitted from the monitor into the reflected light and the transmitted light on the dividing plane,
The beam splitter and the concave mirror are arranged so that the reflected light projected onto the central point of the mirror surface of the concave mirror is inclined toward the monitor with respect to the normal line at the central point,
The operation device according to claim 6, wherein the display surface of the monitor is non-planar.
The operation device according to claim 7, wherein the display surface of the monitor is formed to be convex toward the opposite side of the beam splitter.
A monitor having a display surface on which the information display medium is displayed and projecting the information display medium displayed on the display surface;
The beam splitter divides the light emitted from the monitor into the reflected light and the transmitted light on the dividing plane,
The beam splitter and the concave mirror are arranged so that the reflected light projected onto the central point of the mirror surface of the concave mirror is inclined toward the monitor with respect to the normal line at the central point,
The operating device according to claim 6, wherein the split surface of the beam splitter is formed in a non-planar surface.
10. The operating device according to claim 9, wherein the split surface of the beam splitter is formed to be convex toward the opposite side of the concave mirror.
The operating device according to any one of claims 7 to 10, wherein the mirror surface of the concave mirror is formed as an aspherical surface.
The operating device according to claim 6, wherein the beam splitter is a half mirror.