JP2006146700A - Information presenting device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To automatically switch a user interface according to the operating condition of an information presenting device. <P>SOLUTION: This information presenting device 10 for presenting the image of an object and information related with the object to an operator is provided with an operating part 13 to be operated by the operator, a user interface part 14 including a display part (information display part 12 and a transparent reflector 11) for presenting information to the operator and a user interface control part 21 for detecting or estimating the posture of the operating part or the display part, and for switching the operation or function of the user interface part based on the detected or estimated posture. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information presenting apparatus that presents information related to an object together with an image of the object to an operator.

  As a portable information presentation device, for example, an optical see-through information presentation device as disclosed in Patent Literature 1 and Patent Literature 2 is known. This is because the information presentation device is held on the operator's temporal head so that a half mirror or the like is placed on the operator's line of sight, and the information is displayed on the real image of the observation target observed through the half mirror. Information is presented by superimposing and displaying a predetermined image on the display unit.

Japanese Patent Application Laid-Open No. 2004-133620 discloses a technique for appropriately converting and displaying the display direction of the display unit in accordance with the opening / closing posture in a foldable portable information terminal having a display unit and an operation unit. .
JP-A-5-323229 Japanese Patent Laid-Open No. 5-303054 JP 2003-174495 A

  In a portable information presentation device as disclosed in Patent Literature 1 and Patent Literature 2 described above, an eye (right eye or left eye) used to view the information presentation device depending on the operator and the situation in which it is used. And the hand (right hand or left hand) holding the device is different. Therefore, it is necessary to switch the user interface, that is, the orientation of the image to be displayed and the role of the button of the operation unit, depending on the usage state of the information presenting apparatus. However, conventionally, the switching is performed by a changeover switch operated by an operator, which is complicated.

  Here, regarding the switching of the display direction, there is a technique as disclosed in the above-mentioned Patent Document 3, but this technique is irrelevant to the eye used for viewing the display, and the technique is described above. It cannot be applied as it is to a simple information presentation apparatus.

  The present invention has been made in view of the above points, and an object of the present invention is to provide an information presenting apparatus capable of automatically switching a user interface according to a use situation.

One aspect of the information presenting apparatus of the present invention is an information presenting apparatus that presents information related to an object together with an image of the object to an operator,
A user interface unit including an operation unit operated by the operator or a display unit for presenting information to the operator;
A user interface switching unit that detects or estimates the posture of the operation unit or the display unit, and switches the operation or function of the user interface unit based on the detected or estimated posture;
It is characterized by comprising.

  ADVANTAGE OF THE INVENTION According to this invention, the information presentation apparatus which can switch a user interface automatically according to a use condition can be provided.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

[First Embodiment]
FIG. 1A is a perspective view showing an appearance of the information presentation apparatus 10 according to the first embodiment of the present invention, and FIG. 1B is a block configuration diagram of the information presentation apparatus 10.

  The information presenting apparatus 10 has a display unit that displays a predetermined image (information composed of characters, symbols, images, or the like) representing predetermined information on a screen at a predetermined position in front of the operator. The display unit includes a transparent reflection plate 11 that is a half mirror and an information display unit 12 such as a liquid crystal display. Since the transparent reflector 11 has a transmission function, as shown in FIG. 2A, the operator 100 holds the information presentation device 10 with his / her right hand 101 and presents the information on the operator's head 102. When the device 10 is applied and the user looks through the right eye 103, the real image of the observation object can be observed through the transparent reflector 11. Further, the reflection function of the transparent reflector 11 reflects the projected image of the predetermined image displayed on the information display unit 12 toward the right eyeball 103A on the reflection surface, as shown in FIG. 2B. The predetermined image can also be superposed on the real image of the observation target and observed by the operator 100. That is, the transparent reflector 11 can be used as a display screen.

  Moreover, the information presentation apparatus 10 includes an operation unit 13 including a plurality of operation buttons that are operated by the operator 100. As shown in FIG. 3A, the operation unit 13 includes a plurality of operations arranged on the side surface of the information presentation apparatus 10 that is on the upper side in a holding or wearing form in which the operator 100 observes with the right eye 103. Buttons (for example, the A button 13A and the B button 13B) and the side surface of the information presentation apparatus 10 that is on the upper side in the holding or wearing form in which the operator 100 observes with the left eye 104 as shown in FIG. And a plurality of operation buttons (for example, a C button 13C and a D button 13D). In this way, by arranging the operation buttons on both sides of the information presentation device 10, it is possible to increase the degree of freedom of the usage pattern by the dominant eye and dominant arm of the operator 100.

  The information display unit 12 (and the transparent reflector 11) and the operation unit 13 constitute a user interface unit 14.

  In addition, the information presenting apparatus 10 displays the image on the information display unit 12 and the image input unit 15 that is a camera for capturing an image including the observation target that the operator 100 observes through the transparent reflector 11. And a display information search unit 16 that searches information or an image to be superimposed on the real image to be observed based on the image input from the image input unit 15. That is, the image input unit 15 and the display information search unit 16 constitute an image generation unit 17 that generates information or an image related to the input image as a predetermined image displayed on the display unit.

  Note that, as a form of holding or wearing the information presenting apparatus 10, even if the substantial relative positional relationship between the display unit and the operation unit 13 is the same, the operator 100 changes the information presenting apparatus 10 to As shown in FIG. 3A, information is presented when held or worn so as to be observed with the right eye 103 and when held or worn so as to be observed with the left eye 104 as shown in FIG. Since the vertical relationship of the device 10 is reversed, it is necessary to change the orientation of the image displayed on the information display unit 12. Further, for example, when an icon representing the scrolling of the image to the left and right is displayed for the operator 100 and the operator 100 scrolls the image accordingly, the operator as shown in FIG. When the information presentation device 10 is held on the right side of the head 102, in order to hold the information presentation device 10 with the right hand, the right finger is instructed to scroll right from the first finger (thumb) to the fifth finger (little finger). It is easier to handle with the third finger (middle finger) than the fourth finger (ringing finger), and the right finger fourth finger ( It is natural to operate with the ring finger). Therefore, it is desirable to assign the A button 13A as the button of the operation unit 13 instructing such a right scroll and the B button 13B as the button of the operation unit 13 instructing the left scroll. On the other hand, when the information presentation device 10 is held on the left side of the operator's head 102 as shown in FIG. 3 (B), the information presentation device 10 is held with the left hand, so the first finger (thumb) from the left hand Of the fingers (small fingers), as a button for instructing the right scroll, it is easier to handle with the fourth finger (ringing finger) than with the third finger (middle finger), and similarly the left scroll As a button for instructing, it is natural to operate with the third finger (middle finger) of the left hand. Therefore, it is desirable to assign the C button 13C as the button of the operation unit 13 instructing such right scroll and the D button 13D as the button of the operation unit 13 instructing left scroll. That is, it is necessary to change the button assignment of the operation unit 13 in accordance with the manner in which the information presentation device 10 is held or worn.

  Therefore, in order to change the display direction and the operation button assignment according to the holding or wearing form of the information presenting apparatus 10, in this embodiment, the information presenting apparatus 10 has the posture of the user interface unit 14. That is, the posture estimation / detection unit 18 that estimates or detects the relative upward or downward direction of the user interface unit 14, and the operation unit 13 is allocated based on the estimation or detection result of the posture estimation / detection unit 18. A user interface comprising: an operation instruction determination unit 19 that switches the functions performed; and a display conversion unit 20 that converts an image to be displayed on the information display unit 12 based on the estimation or detection result of the posture estimation / detection unit 18. A control unit 21 is provided.

  The operation of the user interface control unit 21 will be described with reference to the flowchart of FIG. First, on the information display unit 12, for example, “Please operate the upper operation unit” is displayed on the information display unit 12 for prompting the operation of the upper or lower operation unit 13 (see FIG. Step S1). This is displayed either upward or downward so that the operator 100 can understand whether the information presentation device 10 is in the holding or wearing form of FIGS. 3 (A) and 3 (B). Then, the posture estimation / detection unit 18 detects the operation of the operator 100 according to the display that prompts the operation of the operation unit 13 (step S2), and the posture of the user interface unit 14 based on the detection result (step S2). (Vertical direction) is estimated (step S3). That is, when the A button 13A or the B button 13B is operated, the operation unit 13 is in the holding or wearing form shown in FIG. 3A, and the side where the A button 13A and the B button 13B are arranged is upward. It is estimated that. When the C button 13C or the D button 13D is operated, the operation unit 13 is in the holding or wearing form shown in FIG. 3B, and the side on which the C button 13C and the D button 13D are arranged is upward. It is estimated that.

  Then, according to this estimation, the operation instruction determination unit 19 changes the function assignment of the operation unit 13, and the display conversion unit 20 changes the display direction of the information display unit 12 (step S4). In the present embodiment, the information presentation apparatus 10 defaults to the holding or wearing form shown in FIG. Therefore, in practice, the operation of step S4 is not performed when it is estimated that the side where the A button 13A and the B button 13B are arranged is upward as shown in FIG. . That is, as shown in FIG. 3B, the operation of step S4 is performed only when it is estimated that the side on which the C button 13C and the D button 13D are arranged is upward. In this case, for example, the operation instruction determination unit 19 assigns a function for instructing the right scroll of the display image to the C button 13C and a function for instructing the left scroll to the D button 13D, and the A buttons 13A and B Another function is assigned to the button 13B. When any button of the operation unit 13 is operated, the operation instruction content according to the assigned function is given to the display information search unit 16 of the image generation unit 17 to perform a new search or the like. Generate an image. Further, the display conversion unit 20 changes the orientation of the image generated by the display information search unit 16 and causes the information display unit 12 to display the image.

  Note that the image generation unit 17 does not generate information or an image related to the input image to be superimposed and displayed on the real image to be observed until the user interface control unit 21 can make the up / down determination. After the above vertical determination is made, the information generated by the image generation unit 17 or the vertical orientation of the image is converted by the display conversion unit 20 and displayed on the information display unit 12.

  Further, in actual use of the information presenting apparatus 10, not only the switching of the user interface unit 14 by the above-described up / down determination but also a detailed description is omitted, but before starting observation of the actual observation target, a predetermined calibration is performed. It is necessary to observe the target image and execute the line-of-sight calibration operation and processing so that the information or image generated by the image generation unit 17 is superimposed and displayed at a predetermined position on the real image. Needless to say.

  As described above, according to the first embodiment of the present invention, based on the operation of the operator 100 after the display that prompts the operation of the relatively upper or lower operation unit 13 is displayed on the information display unit 12. By estimating the posture of the user interface unit 14, it is possible to provide the information presenting apparatus 10 that can automatically switch the user interface unit 14 according to the use situation.

[Second Embodiment]
FIG. 4 is a block configuration diagram of the information presentation apparatus 10 according to the second embodiment of the present invention.

  In the first embodiment, the posture estimation / detection unit 18 is based on the operation of the operator 100 after the display for prompting the operation of the relatively upper or lower operation unit 13 is displayed on the information display unit 12. The posture of the interface unit 14 is estimated.

  On the other hand, in the second embodiment, the posture estimation / detection unit 18 is configured to include a gravity sensor that detects the direction of gravity. Therefore, the posture of the user interface unit 14 can be estimated only by the posture estimation / detection unit 18 without waiting for the operation of the operator 100 as in the first embodiment.

  As described above, according to the second embodiment of the present invention, the posture of the user interface unit 14 can be easily estimated by using the gravity sensor, and the user interface unit 14 can be automatically switched according to the use situation. A possible information presentation device 10 can be provided.

[Third Embodiment]
FIG. 5 is a block configuration diagram of the information presentation apparatus 10 according to the third embodiment of the present invention. The image generation unit 17 includes a posture estimation / detection unit 18 in addition to the image input unit 15 and the display information search unit 16. including. The user interface control unit 21 includes an image input unit 15 in addition to the posture estimation / detection unit 18, the operation instruction determination unit 19, and the display conversion unit 20. That is, the image input unit 15 and the posture estimation / detection unit 18 are used as part of the image generation unit 17 and also as part of the user interface control unit 21. In this embodiment, the posture estimation / detection unit 18 is configured to include a position / posture determination unit.

  That is, in this embodiment, as shown in FIG. 6, a reference plane determination marker 202 is arranged on a reference plane such as a desk surface 200 in addition to the object 201, and the position / orientation determination unit The vertical direction of the user interface unit 14 is determined based on how the determination marker 202 is seen. That is, the position and orientation determination unit uses an image obtained by photographing the reference plane determination marker 202 having a known position and orientation and optical characteristics in an absolute coordinate system in the real world with the image input unit (camera) 15. The posture of the image input unit (camera) 15 when the reference plane determination marker 202 is photographed is estimated. The estimation is, for example, “Precise real-time estimation of rectangular marker position and orientation with a single eye for VR interface” (3D Image Conference '96 Proceedings pp.167-172 Takahashi Akira, Ishii Ikuo, Makino Hideo, Nakashizuka This can be easily realized by using the method for obtaining the position and orientation of the image input means from the reference mark position disclosed in Shin 1996), and thus detailed description thereof will be omitted.

  Further, the display information search unit 16 of the image generation unit 17 searches for display information using the output of the posture estimation / detection unit. That is, related information or an image for the reference plane determination marker 202 photographed as described above is searched.

  Further, in this embodiment, the display conversion unit 20 of the user interface control unit 21 not only converts the vertical direction as in the first and second embodiments, but also includes the position / posture determination unit. / Based on the position and orientation of the user interface unit 14 estimated by the detection unit 18, the related information retrieved by the display information retrieval unit or the position and orientation of the image are changed and displayed on the information display unit 12. It is possible to make the operator 100 observe the related information or the image at a position and orientation corresponding to the position and orientation of the object 201. Note that a technique for superimposing and displaying related information about the photographed reference plane determination marker 202 displays related information according to the viewpoint of the image input means disclosed in, for example, Japanese Patent Application Laid-Open No. 2001-126051. This method can be easily realized by using the technique, and therefore detailed description thereof is omitted.

  In addition, it cannot be overemphasized that information is not superimposed and presented as a sequence in use of the information presentation apparatus 10 according to the present embodiment until the reference plane determination marker 202 is recognized.

  As described above, according to the third embodiment, the information presentation apparatus 10 that can easily estimate the attitude of the user interface unit 14 and can automatically switch the user interface unit 14 according to the use state is provided. can do. Furthermore, it is possible to present an image to be superimposed and displayed not only in the vertical direction but also in a position and posture corresponding to the position and posture of the user interface unit 14.

  Although the present invention has been described above based on the embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention.

  For example, the information presentation device 10 has been described as being held with one hand, but it is not a hand, but is held or worn on the operator's head 102 with some kind of holding tool, and only the operation unit 13 is operated by hand. It does not matter. If the relative position and orientation of the display unit and the operation unit 13 do not change substantially, a part including the operation unit 13 is separated from the display unit, for example, the display unit is held or attached to the operator's head 102. The part including the operation unit 13 may be configured to be attached to the side of the waist of the operator 100, a belt, or the like.

(Appendix)
The invention having the following configuration can be extracted from the specific embodiment.

(1) An information presentation device for presenting information related to an object together with an image of the object to an operator,
A user interface unit including an operation unit operated by the operator or a display unit for presenting information to the operator;
A user interface switching unit that detects or estimates the posture of the operation unit or the display unit, and switches the operation or function of the user interface unit based on the detected or estimated posture;
An information presentation apparatus comprising:

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment related to the information presentation apparatus described in (1).

(Function and effect)
The information presentation device according to (1) switches the operation of the user interface unit based on the detected or estimated vertical direction.

  Therefore, according to the information presenting apparatus described in (1), it is possible to automatically switch the user interface unit according to the use situation.

  (2) The information display device according to (1), wherein the display unit superimposes a real image of the object and a predetermined image representing predetermined information and displays the image on the operator.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment related to the information presentation apparatus described in (2).

(Function and effect)
In the information presentation device described in (2), the display unit superimposes the real image of the target object and the generated image and presents it to the operator.

  Therefore, according to the information presentation apparatus described in (2), the operator can observe the real image and the image of the observation target.

  (3) The information presentation device according to (2), further comprising an image information generation unit that generates information related to the input image or an image as the predetermined image.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment related to the information presentation device described in (3).

(Function and effect)
The information presentation apparatus according to (3) further includes an image information generation unit that generates information related to an input image or an image.

  Therefore, according to the information presentation apparatus described in (3), information or an image related to the input image can be presented together.

  (4) The information presenting device according to (1), wherein the information presenting device has a plurality of forms (how to be worn or held) worn or held by the operator.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment related to the information presentation apparatus described in (4).

(Function and effect)
The information presentation device described in (4) has a plurality of mounting or holding forms (how to hold or mount).

  Therefore, according to the information presentation apparatus described in (4), a plurality of holding or mounting methods are possible.

  (5) In the plurality of embodiments, the substantial relative positional relationship between the display unit and the operation unit is the same.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment related to the information presentation device described in (5).

(Function and effect)
In the information presentation device described in (5), the “relative position and orientation” of the display unit and the operation unit are the same in a plurality of mounted or held forms.

  Therefore, according to the information presentation apparatus described in (5), the operator does not hesitate to hold or wear the apparatus, and the processing of the device itself needs to be largely changed according to the holding or wearing form. Disappear.

  (6) The information presenting device according to (4), wherein in the plurality of forms, directions of images displayed on the display unit are different.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment related to the information presentation device described in (6).

(Function and effect)
In the information presentation device according to (6), the orientation of the image displayed on the display unit is different in a plurality of “forms”.

  Therefore, according to the information presentation apparatus described in (6), an image can always be presented to the operator in the correct orientation regardless of a plurality of wearing or holding forms.

  (7) In the plurality of embodiments, the display unit is mounted or held on a side of the operator. The information presentation device according to (4),

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment related to the information presentation device described in (7).

(Function and effect)
In the information presentation device according to (7), the operation unit is mounted or held on the side of the operator.

  Therefore, according to the information presenting device described in (7), since the part including the operation unit can be separated, the usage forms are varied.

(8) The user interface control unit
A posture estimation / detection unit that estimates or detects the posture of the user interface unit;
An operation instruction determination unit that switches a function assigned to the operation unit based on an estimation or detection result of the posture estimation / detection unit;
A display conversion unit that converts an image to be displayed on the display unit based on the estimation or detection result of the posture estimation / detection unit;
(1) The information presentation device according to (1).

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment related to the information presentation device described in (8).

(Function and effect)
The information presentation device according to (8) estimates or detects the attitude of the user interface unit, switches the function assigned to the operation unit based on the result, and converts the image to be displayed on the display unit. To do.

  Therefore, according to the information presentation apparatus described in (8), it is possible to automatically switch the operation unit or the display unit according to the attitude of the user interface unit.

  (9) The information presentation device according to (8), wherein the posture estimation / detection unit detects a relative upward or downward direction of the user interface unit.

(Corresponding embodiment)
The first and second embodiments correspond to the embodiment related to the information presentation device described in (9).

(Function and effect)
The information presentation apparatus according to (9) detects the relative upward or downward direction of the user interface unit.

  Therefore, according to the information presentation device described in (9), it is possible to automatically switch the operation unit or the display unit according to the relative upward or downward direction of the user interface unit.

  (10) The information presentation device according to (8), wherein the posture estimation / detection unit includes a gravity sensor that detects a direction of gravity.

(Corresponding embodiment)
The second embodiment corresponds to the embodiment related to the information presentation device described in (10).

(Function and effect)
The information presentation apparatus according to (10) estimates or detects the posture of the user interface unit by detecting the direction of gravity with a gravity sensor.

  Therefore, according to the information presentation device described in (10), the posture of the user interface unit can be easily estimated or detected without bothering the operator.

  (11) The posture estimation / detection unit is configured to display the user interface unit based on the operation of the operator after the display for prompting the operation of the operation unit relatively above or below is displayed on the display unit. The information presentation device according to (8), wherein the posture is estimated.

(Corresponding embodiment)
The embodiment relating to the information presentation device according to (11) corresponds to the first embodiment.

(Function and effect)
The information presentation device according to (11) estimates or detects the posture of the user interface unit based on the operation after the display requesting the operation of the upper or lower operation unit is displayed.

  Therefore, according to the information presentation apparatus described in (11), the posture of the user interface unit can be estimated or detected without providing a special detection mechanism.

  (12) The posture estimation / detection unit uses an image obtained by photographing a marker having a known position and posture and optical characteristics in an absolute coordinate system in the real world with the camera, The information presentation device according to (8), further including a position / posture determination unit that estimates a posture.

(Corresponding embodiment)
The third embodiment corresponds to the embodiment of the information presentation device described in (12).

(Function and effect)
The information presentation device according to (12) can estimate or detect the attitude of the user interface unit based on the marker image.

  Therefore, according to the information presentation device described in (12), not only the vertical direction of the simple user interface unit but also the position and posture including the inclination and direction can be estimated or detected.

  (13) The information presentation device according to (12), wherein the output of the position / orientation determination unit is used when generating an image to be displayed on the display unit.

(Corresponding embodiment)
The third embodiment corresponds to the embodiment of the information presentation device described in (13).

(Function and effect)
The information presentation device according to (13) can generate an image to be displayed using the estimated or detected position and orientation.

  Therefore, according to the information presentation device described in (13), it is possible to present an image with a position and posture according to the estimated or detected position and posture.

  (14) The information display device according to (8), wherein the display conversion unit switches the operation of the display unit based on the output of the posture estimation / detection unit.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment related to the information presentation device described in (14).

(Function and effect)
In the information presentation device according to (14), the display conversion unit switches the operation of the display unit based on the output of the posture estimation / detection.

  Therefore, according to the information presentation device described in (14), the operation of the display unit can be switched according to the estimated or detected position and orientation.

  (15) The information presentation device according to (14), wherein the operation of the display unit switched by the display conversion unit is an orientation of an image displayed on the report display unit.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment related to the information presentation device described in (15).

(Function and effect)
The information presentation device according to (15) switches the orientation of the image displayed on the display unit according to the estimated or detected position and orientation.

  Therefore, according to the information presentation apparatus described in (15), an image is presented in the correct direction on the display unit regardless of the orientation of the display unit.

  (16) The information presentation device according to (8), wherein the operation instruction determination unit switches a function assigned to the operation unit based on an output of the posture estimation / detection unit.

(Corresponding embodiment)
The first to third embodiments correspond to the embodiment related to the information presentation device described in (16).

(Function and effect)
The information presentation apparatus according to (16) switches the function assigned to the operation unit according to the estimated or detected position and orientation.

  Therefore, according to the information presentation apparatus described in (16), it is possible to provide an operation unit that is easy to operate regardless of the attitude of the operation unit.

FIG. 1A is a perspective view showing the appearance of the information presentation apparatus according to the first embodiment of the present invention, and FIG. 1B is a block diagram of the information presentation apparatus. FIG. 2A is a perspective view showing a usage state of the information presenting apparatus, and FIG. 2B is a schematic diagram for explaining a configuration of a display unit. 3A is a diagram for explaining the right hand holding state of the information presenting device, FIG. 3B is a diagram for explaining the display information left hand holding state of the information presenting device, and FIG. It is a figure which shows the operation | movement flowchart of a user interface control part. FIG. 4 is a block configuration diagram of an information presentation apparatus according to the second embodiment of the present invention. FIG. 5 is a block diagram of an information presentation apparatus according to the third embodiment of the present invention. FIG. 6 is a perspective view showing a usage state of the information presentation apparatus according to the third embodiment.

Explanation of symbols

    DESCRIPTION OF SYMBOLS 10 ... Information presentation apparatus, 11 ... Transparent reflector, 12 ... Information display part, 13 ... Operation part, 13A ... A button, 13B ... B button, 13C ... C button, 13D ... D button, 14 ... User interface part, 15 DESCRIPTION OF SYMBOLS ... Image input part, 16 ... Display information search part, 17 ... Image generation part, 18 ... Attitude estimation / detection part, 19 ... Operation instruction determination part, 20 ... Display conversion part, 21 ... User interface control part, 100 ... Operator 101 ... Right hand, 102 ... Operator's head, 103 ... Right eye, 103A ... Right eyeball, 104 ... Left eye, 200 ... Desk surface, 201 ... Object, 202 ... Marker for reference plane determination.

Claims (16)

An information presentation device for presenting information related to an object together with an image of the object to an operator,
A user interface unit including an operation unit operated by the operator or a display unit for presenting information to the operator;
A user interface switching unit that detects or estimates the posture of the operation unit or the display unit, and switches the operation or function of the user interface unit based on the detected or estimated posture;
An information presentation apparatus comprising:   The information display device according to claim 1, wherein the display unit superimposes a real image of the object and a predetermined image representing predetermined information and displays the superimposed image on the operator.   The information presentation apparatus according to claim 2, further comprising an image information generation unit configured to generate information related to an input image or an image as the predetermined image.   The information presenting apparatus according to claim 1, wherein the information presenting apparatus has a plurality of forms attached or held by the operator.   The information presentation apparatus according to claim 4, wherein in the plurality of forms, a substantial relative positional relationship between the display unit and the operation unit is the same.   The information presentation apparatus according to claim 4, wherein in the plurality of forms, directions of images displayed on the display unit are different.   5. The information presenting apparatus according to claim 4, wherein in the plurality of forms, the display unit is mounted or held on a side of the operator. The user interface control unit
A posture estimation / detection unit that estimates or detects the posture of the user interface unit;
An operation instruction determination unit that switches a function assigned to the operation unit based on an estimation or detection result of the posture estimation / detection unit;
A display conversion unit that converts an image to be displayed on the display unit based on the estimation or detection result of the posture estimation / detection unit;
The information presentation apparatus according to claim 1, wherein   The information presentation apparatus according to claim 8, wherein the posture estimation / detection unit detects a relative upward or downward direction of the user interface unit.   The information presentation apparatus according to claim 8, wherein the posture estimation / detection unit includes a gravity sensor that detects a direction of gravity.   The posture estimation / detection unit estimates the posture of the user interface unit based on the operation of the operator after the display that prompts the operation of the operation unit relatively above or below is displayed on the display unit. The information presentation apparatus according to claim 8, wherein   The posture estimation / detection unit estimates the posture of the camera at the time of photographing the marker using an image obtained by photographing the marker having a known position and posture and optical characteristics in the absolute coordinate system in the real world. The information presentation apparatus according to claim 8, further comprising a position / orientation determination unit.   13. The information presentation apparatus according to claim 12, wherein the output of the position / orientation determination unit is used when generating an image to be displayed on the display unit.   The information display device according to claim 8, wherein the display conversion unit switches the operation of the display unit based on the output of the posture estimation / detection unit.   15. The information presentation apparatus according to claim 14, wherein the operation of the display unit switched by the display conversion unit is an orientation of an image displayed on the report display unit.   9. The information presentation device according to claim 8, wherein the operation instruction determination unit switches a function assigned to the operation unit based on an output of the posture estimation / detection unit.

Images