KR20080102942A - Information presentation device - Google Patents

Abstract

An information presentation device(10), which presents an object image and information associated with the object to an operator, is comprised of a user interface unit (14) including an operation unit (13) which the operator operates or a display unit (an information display unit (12) and a transparent reflective plate) for presenting information to the operator, and a user interface control unit (21) for detecting or estimating a posture of the operation unit or the display unit and for switching operations or functions of the user interface unit based on the detected or estimated posture.

Description

Information on time device {INFORMATION PRESENTATION DEVICE}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information presenting apparatus for presenting to an operator information associated with an object along with an image of the object.

As a portable information presenting apparatus, for example, an optical see-through type information presenting apparatus disclosed in Japanese Patent Laid-Open No. 5-323229 or Japanese Patent Laid-Open No. 5-303054 is known. This is done by holding the information display device on the head of the operator so that a half mirror or the like is placed on the operator's line of sight, and superimposing and displaying a predetermined image on the actual image of the observation target observed through the half mirror. It is to present information.

In addition, US 2003/0064758 A1 discloses a technique in which a folded portable information terminal having a display unit and an operation unit appropriately converts a display direction of a display unit according to its open / close posture and displays it.

In the portable information presenting device as disclosed in Japanese Patent Laid-Open No. 5-323229 or Japanese Patent Laid-Open No. 5-303054, it is used to view the information presenting device depending on the operator or the situation of use thereof. The eye (right or left eye) and the hand (right or left hand) holding the device are different. Therefore, it is necessary to switch the role of the user interface, ie, the direction of the image to be displayed and the button of the operation part, according to the use situation of the information presenting apparatus. However, in the past, the switching was complicated by a switching switch operated by an operator.

Here, regarding the switching of the display direction, there is a technique as disclosed in the above US 2003/0064758 A1, but the technique is independent of the eye used to view the display, and the technique is described above. It cannot be applied to the device on time.

<Start of invention>

This invention is made | formed in view of the said point, and an object of this invention is to provide the information timing apparatus which can switch a user interface automatically according to a use situation.

One aspect of the information presenting apparatus of the present invention is an information presenting apparatus for presenting an information related to an object with an image of an object to an operator.

A user interface unit including an operation unit for performing the operation by the operator or a display unit for specifying information on the operator;

A user interface control unit for detecting or estimating a posture of the operation unit or the display unit and switching the operation or function of the user interface unit based on the detected or estimated posture.

Characterized in having a.

1 is a perspective view showing an appearance of an information presenting apparatus according to a first embodiment of the present invention.

2 is a block diagram of an information presenting apparatus according to a first embodiment of the present invention;

3 is a perspective view showing a state of use of the information presenting apparatus;

4 is a schematic diagram for explaining the configuration of a display unit;

Fig. 5 is a diagram for explaining the right hand holding state of the information timing apparatus.

Fig. 6 is a diagram for explaining a left hand holding state of the information presenting apparatus.

7 is a flowchart illustrating an operation flowchart of a user interface control unit.

8 is a block diagram of an information presenting apparatus according to a second embodiment of the present invention;

9 is a block diagram of an information presenting apparatus according to a third embodiment of the present invention;

10 is a perspective view showing a state of use of the information presenting apparatus according to the third embodiment.

<Best Mode for Carrying Out the Invention>

EMBODIMENT OF THE INVENTION Hereinafter, the best form for implementing this invention is demonstrated with reference to drawings.

[First Embodiment]

As shown in Figs. 1 and 2, the information display apparatus 10 according to the first embodiment of the present invention is a predetermined image (character, symbol) representing predetermined information on a screen at a predetermined position in front of the operator. Or information composed of an image or the like). This display part includes the transparent reflecting plate 11 which is a half mirror, and the information display part 12, such as a liquid crystal display. The transparent reflecting plate 11 has a transmission function. Thus, as shown in FIG. 3, the operator 100 holds the information presenting device 10 with his right hand 101, and places the information presenting device 10 on the operator head 102 with the right eye 103. ), The actual image of the object to be observed can be observed through the transparent reflecting plate 11. In addition, due to the reflection function of the transparent reflecting plate 11, as shown in FIG. 4, the projection image of the predetermined image displayed on the information display unit 12 is directed toward the right eye 103A from the reflecting surface. Reflected. Therefore, the said predetermined image can also be superimposed on the real object of the said observation object, and can be observed by the operator 100. FIG. That is, the transparent reflecting plate 11 can be used as a display screen.

The information presenting apparatus 10 also has an operation unit 13 including a plurality of operation buttons for which the operator 100 performs an operation. As shown in FIG. 5, the operation unit 13 includes a plurality of operation units disposed on the side of the information display device 10 that is positioned upward in the form of holding or mounting in which the operator 100 observes the right eye 103. Operation buttons (e.g., A button 13A and B button 13B). Moreover, as shown in FIG. 6, the operation part 13 has a some arrange | positioned at the side of the information display device 10 which becomes the upper side in the form of the holding | maintenance or attachment which the operator 100 observes with the left eye 104. As shown in FIG. Operation buttons (e.g., C button 13C and D button 13D). In this way, by arranging the operation buttons on both sides of the information display device 10, the operator 100 can increase the degree of freedom of the use form by the eyes of the user who writes well and the arms of the user who writes well.

The information display unit 12 (and the transparent reflecting plate 11) and the operation unit 13 constitute a user interface unit 14.

In addition, the information presenting apparatus 10 includes an image input unit 15 and a display information search unit 16. The image input unit 15 includes a camera for photographing an image including an observation target that the operator 100 is observing through the transparent reflecting plate 11. The display information retrieval unit 16 searches the information display unit 12 for information or an image to be superimposed and displayed on the actual object to be observed based on the image input from the image input unit 15. That is, these image input unit 15 and the display information retrieval unit 16 constitute an image generation unit 17 that generates information or an image related to the input image as a predetermined image to be displayed on the display unit.

Moreover, as a form of holding or mounting of the information presenting apparatus 10, even if the actual relative positional relationship between the display unit and the operation unit 13 is the same, the operator 100 shows the information presenting apparatus 10 in FIG. 5. As shown in FIG. 6, when the device is held or mounted to observe the right eye 103 and when the holder is held or mounted to observe the left eye 104 as shown in FIG. The up-down relationship is reversed. Therefore, it is necessary to change the direction of the image displayed on the information display part 12 according to the holding or attaching state.

In addition, for example, the operator 100 displays icons representing the scrolling of the image to the left and the right, respectively, and the operator 100 may operate the image scrolling accordingly. As shown in FIG. 5, when holding the information display device 10 on the right side of the operator's head 102, the operator 100 holds the information display device 10 with his right hand. In this case, as a button for instructing the right scroll among the first to fifth fingers of the right hand, the one to operate with the third finger (stop) operates with the fourth finger (finger finger). It is easier to handle more intuitively. Similarly, the button for instructing the left scroll is more naturally operated by the fourth finger of the right hand (the ring finger). Therefore, it is preferable that the button A of 13A is assigned as a button of the operation unit 13 which instructs such a right scroll, and the button B 13B which is assigned as a button of the operation unit 13 instructing a left scroll. On the other hand, when the operator 100 holds the information display device 10 on the left side of the operator head 102 as shown in Fig. 6, the information display device 10 is held by the left hand. Therefore, as a button for instructing the right scroll among the first finger (thumb) of the left hand and the fifth finger (holding), the one operating with the fourth finger (finger finger) operates with the third finger (stop). It is easier to handle more intuitively. Similarly, the button for instructing the left scroll is naturally operated by the third finger (stop) of the left hand. Therefore, it is preferable to assign the C button 13C as the button of the operation unit 13 for instructing such right scroll and the D button 13D as the button of the operation unit 13 for instructing the left scroll.

In this way, it is necessary to change the assignment of the buttons of the operation unit 13 in accordance with the form of the holding or mounting of the information presenting apparatus 10.

Therefore, in order to change the direction of display and the operation button assignment according to the type of holding or mounting such information presenting device 10, in this embodiment, the information presenting device 10 is a posture estimating / detecting unit. 18, the operation instruction determination unit 19, and the display conversion unit 20 are provided. The attitude estimation / detector 18 estimates or detects the attitude of the user interface 14, that is, the relative up or down direction of the user interface 14. The operation instruction determination unit 19 switches the function assigned to the operation unit 13 based on the estimation or detection result of the attitude estimation / detection unit 18. The display conversion unit 20 converts an image displayed on the information display unit 12 based on the estimation or detection result of the attitude estimation / detection unit 18. These attitude estimation / detecting units 18, the operation instruction determining unit 19, and the display converting unit 20 constitute a user interface control unit 21.

The operation of the user interface control unit 21 will be described with reference to the flowchart of FIG. 7. First, the information display part 12 displays the display which prompts operation | movement of the said operation part 13 of the upper side or the lower side relatively, for example, "please operate the upper operation part" (step S1). This is displayed upward or downward, so that the operator 100 can understand the information or display device 10 in either the holding or the mounting form of Figs. 5 and 6. And the attitude | position estimation / detection part 18 detects the operation of the said operator 100 according to the display which prompts the operation of the said operation part 13 (step S2), and, based on the detection result, the said user interface part The attitude (up and down direction) of (14) is estimated (step S3). That is, when the said A button 13A or B button 13B of the operation part 13 was operated, it is the holding | maintenance or mounting form shown in FIG. 5, and those A button 13A and B button 13B are arrange | positioned. It is assumed that the side is upward. In addition, when the said C button 13C or the D button 13D of the operation part 13 was operated, it is the holding | maintenance or mounting form shown in FIG. 6, and those C buttons 13C and D button 13D are It is assumed that the arranged side is upward.

And according to this estimation, the operation instruction determination part 19 changes the function assignment of the operation part 13, and the display conversion part 20 changes the direction of the display of the information display part 12 (step S4). ). In addition, in the present Example, the information display apparatus 10 defaults to the holding | maintenance or mounting form shown in FIG. Therefore, in practice, the operation of step S4 does nothing when it is estimated that the side on which the A button 13A and the B button 13B are arranged is upward as shown in FIG. 5. That is, as shown in Fig. 6, the operation of step S4 is performed only when the side on which the C button 13C and the D button 13D are disposed is estimated to be upward. In this case, the operation instruction determining unit 19 assigns, for example, a function of instructing the right scroll of the display image to the C button 13C, and a function of instructing the left scroll to the D button 13D. The A button 13A and the B button 13B are assigned different functions. Then, when any button of the operation unit 13 is operated, the operation instruction content corresponding to the assigned function is supplied to the display information retrieval unit 16 of the image generation unit 17 so as to perform a new search. Create an image. In addition, the display conversion unit 20 changes the direction of the image generated by the display information retrieval unit 16, and causes the information display unit 12 to display the image.

In addition, the image generation unit 17 does not generate information or images related to the input image to be superimposed on the actual object to be observed until the user interface control unit 21 can determine the up and down. After the upper and lower determinations are made, the display converting unit 20 converts the information generated by the image generating unit 17 or the upper and lower directions of the image to be displayed on the information display unit 12.

In addition, at the time of actual use of the information display apparatus 10, not only the switching of the user interface part 14 by the said up-and-down judgment, but a detailed description are abbreviate | omitted, but before starting an observation of an actual observation target, it is a gaze calibration. Of course it is necessary to perform the operation and processing of. This is an operation and processing for observing an image of a predetermined calibration target and causing the information or image generated by the image generating unit 17 to be superimposed and displayed at a predetermined position with respect to the actual image.

As described above, according to the first embodiment of the present invention, the user interface is based on the operation of the operator 100 after the display for prompting the operation of the upper or lower operation unit 13 is made on the information display unit 12. The posture of the unit 14 is estimated. Thereby, the information timing apparatus 10 which can switch the user interface part 14 automatically according to a use situation can be provided.

Second Embodiment

In the first embodiment, the attitude estimation / detection unit 18 is based on the operation of the operator 100 after the display for prompting the operation of the upper or lower operation unit 13 is made on the information display unit 12. The posture of the user interface 14 was estimated.

In contrast, in the information presenting device 10 according to the second embodiment of the present invention, as shown in FIG. 8, the attitude estimating / detecting unit 18 is configured as including a gravity sensor for detecting the direction of gravity. have. Therefore, the attitude of the user interface unit 14 can be estimated only by the attitude estimation / detection unit 18 without waiting for the operation of the operator 100 as in the first embodiment.

As described above, according to the second embodiment of the present invention, the attitude of the user interface unit 14 can be easily estimated by using the gravity sensor. Therefore, the information timing apparatus 10 which can switch the user interface part 14 automatically according to a use situation can be provided.

Third Embodiment

In the information presenting apparatus 10 according to the third embodiment of the present invention, as shown in FIG. 9, the image generating unit 17 is in addition to the image input unit 15 and the display information retrieval unit 16 in posture estimation / The detection unit 18 is included. In addition, the user interface control unit 21 includes an image input unit 15 in addition to the attitude estimation / detection unit 18, the operation instruction determination unit 19, and the display conversion unit 20. That is, the image input unit 15 and the attitude estimation / detection unit 18 are used as part of the image generation unit 17 and also as part of the user interface control unit 21. In addition, the attitude | position estimation / detection part 18 is comprised in this embodiment as including a position and a attitude | position determination part.

That is, in this embodiment, as shown in FIG. 10, the reference plane determination marker 202 is disposed on the reference plane such as the desk surface 200 in addition to the object 201. And the position and attitude determination part of the attitude | position estimation / detection part 18 determines the up-down direction of the user interface part 14 by the method which this reference surface determination marker 202 sees. That is, this position and attitude determination part uses the image which image | photographed the reference plane determination marker 202 whose position and attitude | position and optical characteristic in a real world coordinate system are known by the image input part (camera) 15, and the reference plane The attitude | position of the image input part (camera) 15 at the time of imaging of the determination marker 202 is estimated. The estimation is, for example, "a high-precision real-time estimation method of the rectangular marker position and posture by monocular for the VR interface" (3D Image Conference '96 予 稿 集 pp.167-172, 高井 章, 石井郁 夫, 牧野 秀 夫, 中 靜) This can be easily realized by using a method of obtaining the position and attitude of the image input means from the reference mark position disclosed in reference (1996). Therefore, detailed description thereof is omitted.

In addition, the display information retrieval unit 16 of the image generation unit 17 retrieves the display information using the output of the attitude estimation / detection unit 18. That is, the relevant information about the photographed reference plane determination marker 202 as described above or an image is searched.

In addition, in this embodiment, the display conversion unit 20 of the user interface control unit 21 not only converts the up and down directions as in the first and second embodiments, but also includes the position and attitude determination unit. Based on the position and attitude of the user interface unit 14 estimated by the / detector 18, the position and attitude of the related information or image retrieved from the display information retrieval unit are changed and displayed on the information display unit 12. By doing in this way, the operator 100 can observe those related information or an image in the position and attitude | position corresponding to the position and attitude | position of the object 201. In addition, the method of superimposing the related information about the photographed reference plane determination marker 202 by using the method of displaying the related information according to the viewpoint of the image input means disclosed in USP6,577,249, for example is shown. It can be easily realized. Therefore, detailed description thereof is omitted.

In addition, it is a matter of course that the information is not superimposed and indicated until the reference plane determination marker 202 is recognized as a sequence of use of the information presenting apparatus 10 according to the present embodiment.

As described above, according to the third embodiment, the posture of the user interface unit 14 can be easily estimated, and the information presentation device 10 capable of automatically switching the user interface unit 14 in accordance with the use situation. ) Can be provided. In addition, the image to be superimposed also can be determined not only in the vertical direction but also in the position and posture according to the position and posture of the user interface unit 14.

Although the present invention has been described based on the above embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications can be made within the scope of the gist of the present invention.

For example, the information presentation device 10 has been described as being held by one hand, but is held or mounted on the operator's head 102 by some holding tool, not by hand, and performed by hand only by the operation of the operation unit 13. It may be. In addition, if the relative position and attitude | position of the display part and the operation part 13 do not change substantially, the site | part containing the operation part 13 will be separate from a display part, for example, a display part will be hold | maintained or mounted in the operator head 102, The portion including the operation portion 13 may be adopted to be attached to the side of the waist portion of the operator 100, the belt, or the like.

Bookkeeping

From the specific examples described above, the invention having the following structure can be extracted.

(1) As an information presenting device for presenting an image of an object with information related to the object to an operator,

A user interface unit including an operation unit for performing the operation by the operator or a display unit for specifying information on the operator;

A user interface control unit for detecting or estimating a posture of the operation unit or the display unit and switching the operation or function of the user interface unit based on the detected or estimated posture.

An information presenting apparatus comprising: a.

Corresponding Example

The first to third embodiments correspond to the embodiment of the information presenting apparatus according to this (1).

<Action effect>

The information presenting apparatus according to this (1) switches the operation of the user interface unit based on the detected or estimated vertical direction.

Therefore, according to the information timing apparatus described in this (1), it becomes possible to automatically switch a user interface part according to a use situation.

(2) The information presenting apparatus according to (1), wherein the display unit displays the actual image of the object and a predetermined image representing predetermined information and displays the same to the operator.

Corresponding Example

As for the embodiment relating to the information presenting apparatus according to this (2), the first to third embodiments correspond.

<Action effect>

In the information presenting apparatus according to this (2), the display unit superimposes the actual image of the object and the generated image on the operator.

Therefore, according to the information display apparatus described in this (2), the operator can observe the real image and the image of an observation object.

(3) The information presenting apparatus according to (2), further comprising an image information generation unit that generates information or an image related to the input image as the predetermined image.

Corresponding Example

As for the embodiment relating to the information presenting apparatus according to this (3), the first to third embodiments correspond.

<Action effect>

The information presenting apparatus according to this (3) further includes an image information generating unit that generates information or an image related to the input image.

Therefore, according to the information presenting apparatus described in this (3), the information or the image related to the input image can also be displayed simultaneously.

(4) The information presenting apparatus according to (1), having a plurality of forms (mounting or holding methods) to be mounted or held by the operator.

Corresponding Example

The first to third embodiments correspond to the embodiment of the information presenting apparatus according to this (4).

<Action effect>

The information presenting apparatus according to this (4) has a form (holding or mounting method) which is attached or held in multiple numbers.

Therefore, according to the information presentation apparatus described in this (4), several holding | maintenance or mounting method becomes possible.

(5) The information presenting apparatus according to (4), wherein in the plurality of aspects, substantial relative positional relationship between the display unit and the operation unit is the same.

Corresponding Example

The first to third embodiments correspond to the embodiment of the information presenting apparatus according to this (5).

<Action effect>

In the information display apparatus described in this (5), the "relative position and attitude" of a display part and an operation part are the same in the form of several mounting or holding | maintenance.

Therefore, according to the information display apparatus described in this (5), an operator does not have to wander about the form of the holding | maintenance or attachment, and also the process of the apparatus itself does not need to change greatly according to the form of the holding | maintenance or attachment.

(6) The information presenting apparatus according to (4), wherein the directions of the images displayed on the display unit are different in the plurality of forms.

Corresponding Example

The first to third embodiments correspond to the embodiment of the information presenting apparatus according to this (6).

<Action effect>

In the information presentation device of this (6), the direction of the image displayed on a display part differs in several "forms."

Therefore, according to the information display apparatus described in this (6), an image can always be displayed to an operator in a correct direction regardless of the form of mounting or holding in multiple numbers.

(7) The information presenting apparatus according to (4), wherein in the plurality of aspects, the display unit is mounted or held on the side of the operator.

Corresponding Example

The first to third embodiments correspond to the embodiment of the information presenting apparatus according to this (7).

<Action effect>

In the information presenting apparatus according to this (7), the operation portion is mounted or held on the side of the operator.

Therefore, according to the information presentation apparatus described in this (7), since the site | part containing an operation part can be set separately, the use form becomes versatile.

(8) The user interface control unit,

A posture estimation / detection unit for estimating or detecting a posture of the user interface unit;

An operation instruction determination unit for switching a function assigned to the operation unit based on an estimation or detection result of the attitude estimation / detection unit;

A display conversion unit for converting an image displayed on the display unit based on an estimation or detection result of the attitude estimation / detection unit

The information presentation device of (1) characterized by having a.

Corresponding Example

As for the embodiment relating to the information presenting apparatus according to this (8), the first to third embodiments correspond.

<Action effect>

The information presenting apparatus described in this (8) estimates or detects the attitude | position of a user interface part, and switches the function displayed on the said display part while switching the function assigned to the said operation part based on the result.

Therefore, according to the information presentation apparatus described in this (8), it becomes possible to automatically switch an operation part or a display part according to the attitude | position of a user interface part.

(9) The information presenting apparatus according to (8), wherein the attitude estimation / detecting unit detects a relative up or down direction of the user interface unit.

Corresponding Example

The first and second embodiments correspond to the embodiment of the information presenting apparatus described in this (9).

<Action effect>

The information presenting apparatus described in this (9) detects the relative up or down direction of a user interface part.

Therefore, according to the information presentation apparatus described in this (9), it becomes possible to automatically switch an operation part or a display part according to the relative up or down direction of a user interface part.

(10) The information presenting apparatus according to (8), wherein the attitude estimation / detection unit includes a gravity sensor that detects a gravity direction.

Corresponding Example

The second embodiment corresponds to the embodiment of the information presenting apparatus described in this (10).

<Action effect>

The information timing apparatus described in this (10) estimates or detects the attitude | position of a user interface part by detecting a gravity direction with a gravity sensor.

Therefore, according to the information display apparatus described in this (10), the attitude | position of a user interface part can be estimated or detected easily, without bothering an operator's hand.

(11) The attitude estimation / detecting unit estimates the attitude of the user interface unit based on the operation of the operator after the display prompting the operation of the operation unit on the upper or lower side is made to the display unit. The information timing device described in (8).

Corresponding Example

The first embodiment corresponds to the embodiment of the information presenting apparatus described in this (11).

<Action effect>

The information presentation apparatus described in this (11) estimates or detects the attitude | position of a user interface part based on operation after the display which requested operation of the operation part of an up-down direction is displayed.

Therefore, according to the information presentation apparatus described in this (11), the attitude | position of a user interface part can be estimated or detected, without providing a special detection mechanism.

(12) The posture estimating / detecting unit estimates the posture of the camera at the time of capturing the marker, using an image of the camera having photographed a marker whose position and posture in an absolute coordinate system in the real world and the optical characteristic are known An information presenting apparatus according to (8), comprising a position and attitude determining unit.

Corresponding Example

The third embodiment corresponds to the embodiment of the information presenting apparatus described in this (12).

<Action effect>

The information presenting apparatus according to this (12) can estimate or detect the posture of the user interface unit based on the marker image.

Therefore, according to the information presenting apparatus described in this (12), it is possible to estimate or detect not only the up-down direction of a simple user interface part but also the position and attitude which included the inclination, the direction, etc.

(13) The information presenting apparatus according to (12), wherein the output of the position and attitude determining unit is used when generating an image to be displayed on the display unit.

Corresponding Example

The third embodiment corresponds to the embodiment of the information presenting apparatus described in this (13).

<Action effect>

The information presenting apparatus described in this (13) can generate an image to display using the estimated or detected position and attitude.

Therefore, according to the information display apparatus described in this (13), it becomes possible to display an image by the position and attitude | position according to the position and attitude which were estimated or detected.

(14) The information presentation device according to (8), wherein the display conversion unit switches the operation of the display unit based on an output of the attitude estimation / detection unit.

Corresponding Example

The first to third embodiments correspond to the embodiment of the information presenting apparatus described in this (14).

<Action effect>

In the information presenting apparatus described in this (14), the display conversion unit switches the operation of the display unit based on the output of the attitude estimation / detection.

Therefore, according to the information presenting apparatus described in this (14), the operation of the display unit can be switched in accordance with the estimated or detected position and attitude.

(15) The information presenting apparatus according to (14), wherein the operation of the display unit switched by the display conversion unit is the direction of the image displayed on the display unit.

Corresponding Example

As for the embodiment of the information presenting apparatus described in this (15), the first to third embodiments correspond.

<Action effect>

The information presenting apparatus described in this (15) switches the direction of the image displayed on a display part according to the position and attitude which were estimated or detected.

Therefore, according to the information presenting apparatus described in this (15), an image is shown in a correct direction to a display part irrespective of the attitude | position of a display part.

(16) The information presenting apparatus according to (8), wherein the operation instruction determining unit switches a function assigned to the operation unit based on an output of the attitude estimation / detection unit.

Corresponding Example

As for the embodiment relating to the information presenting apparatus described in this (16), the first to third embodiments correspond.

<Action effect>

The information timing apparatus described in this (16) switches the function assigned to the operation part according to the position and attitude which were estimated or detected.

Therefore, according to the information presenting apparatus described in this (16), the operation part which is easy to operate can be provided irrespective of the attitude | position of the operation part.

Claims (16)

As an information presenting device 10 for presenting an image of an object and information related to the object to an operator, A user interface unit 14 including an operation unit 13 on which the operator performs an operation, or a display unit for indicating information to the operator; A user interface control unit 21 for detecting or estimating the attitude of the operation unit 13 or the display unit and switching the operation or function of the user interface unit 14 based on the detected or estimated attitude. An information presenting apparatus comprising: a. The method of claim 1, And the display unit displays the actual image of the object and a predetermined image representing predetermined information and displays the same to the operator. The method of claim 2, And an image information generating unit (17) for generating information related to the input image or an image as said predetermined image. The method of claim 1, An information presenting apparatus comprising a plurality of forms mounted or held by the operator. The method of claim 4, wherein In the plurality of forms, the information presenting apparatus characterized in that the substantial relative positional relationship between the display unit and the operation unit (13) is the same. The method of claim 4, wherein In the plural forms, the information presenting apparatus characterized by different directions of images displayed on the display unit. The method of claim 4, wherein In the plural forms, the information display device is mounted or held on the side of the operator. The method of claim 1, The user interface control unit 21, A posture estimator / detector 18 for estimating or detecting a posture of the user interface 14; An operation instruction determination unit 19 for switching a function assigned to the operation unit 13 based on the estimation or detection result of the attitude estimation / detection unit 18; The display conversion part 20 which converts the image displayed on the said display part based on the estimation or detection result of the said attitude | position estimation / detection part 18. Information presentation device having a. The method of claim 8, The attitude estimation / detection unit (18) detects the relative up or down direction of the user interface (14). The method of claim 8, And the attitude estimating / detecting section (18) includes a gravity sensor for detecting the direction of gravity. The method of claim 8, The posture estimating / detecting section 18 is a posture of the user interface section 14 based on an operation of the operator after a display for prompting an operation of the upper or lower side of the manipulation section 13 is made on the display section. Information timing apparatus, characterized in that for estimating. The method of claim 8, The posture estimation / detector 18 uses the image of the marker 202 whose position and posture in the real world coordinate system and the optical characteristic are known by the camera 15 to capture the marker. And a position determining position (18) for estimating the pose of the camera. The method of claim 12, The output of the position and attitude determining unit (18) is used when generating an image to be displayed on the display unit. The method of claim 8, And the display conversion unit (20) switches the operation of the display unit on the basis of the output of the attitude estimation / detection unit (18). The method of claim 14, The operation of the display unit switched by the display conversion unit (20) is the direction of the image displayed on the display unit. The method of claim 8, The operation instruction determining unit (19) switches the function assigned to the operation unit (13) based on the output of the attitude estimation / detection unit (18).

Images