JP2006163383A - Information processing apparatus and information processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology for controlling information to be supplied to an observer depending on whether the observer is receiving the information. <P>SOLUTION: A head-mounted display device 108 is powered ON/OFF under control based upon the position and/or posture of the a head-mounted display device 108. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a control process for an apparatus that provides information to an observer.

  In recent years, in a virtual space or mixed reality space (hereinafter, both spaces are collectively referred to as “virtual space”), a head-mounted display (hereinafter abbreviated as HMD: Head Mounted Display / HHD: Hand Held Display) A three-dimensional image is reproduced by mounting liquid crystal monitors on the left and right sides of the liquid crystal monitor (see Patent Document 1).

By applying this technology, it is now possible to display data in the prototype stage as if it existed on the spot and verify the design.
JP-A-11-088913

  However, the HMD / HHD usually has a structure in which a liquid crystal display is worn like glasses in front of both eyes of the user. For this reason, the user sees only the image displayed on the HMD / HHD. Also, even if a wide variety of GUIs are prepared and displayed on the HMD / HHD, the resolution is not sufficient, so that it is not possible to operate while confirming a fine GUI or the like through the HMD / HHD. Therefore, various operations when the HMD / HHD is mounted cannot be easily performed, and there is a problem that the time required for the work becomes long.

  Further, when the system for providing the virtual space to the observer is activated, the HMD / HHD always displays an image, so the observer can see the virtual space by observing the image. However, if the observer leaves the site once and leaves the HMD / HHD on a desk or the like, no one can see the image displayed on the HMD / HHD, so this display is useless. It will be something.

  In addition, such a system may provide not only images but also sound, but even in such a system, such a problem may occur. The problem as described above is that the power source for driving the system for providing information to the observer is useless. Therefore, when an observer does not receive information provided by the system, it is necessary to control the provision of information according to the situation.

  The present invention has been made in view of the above problems, and provides a technique for controlling the provision of information according to whether or not the observer is receiving information to be provided to the observer. With the goal.

  In order to achieve the object of the present invention, for example, an information processing apparatus of the present invention comprises the following arrangement.

That is, an input means for inputting the position and orientation of a display device for displaying an image in front of the observer's eyes;
Control means for controlling the power supply of the display device based on the position and / or orientation input by the input means.

  In order to achieve the object of the present invention, for example, an information processing apparatus of the present invention comprises the following arrangement.

That is, a detection unit that is attached to a display device for displaying an image in front of the observer's eyes and detects the presence or absence of a line of sight when the observer sees the display screen of the display device;
Control means for controlling the power supply of the display device based on whether or not the line of sight is detected by the detection means.

  In order to achieve the object of the present invention, for example, an information processing apparatus of the present invention comprises the following arrangement.

That is, an input means for inputting the position and orientation of the first display device for displaying an image in front of the observer's eyes;
Control means for controlling the size of a GUI displayed on a second display device different from the first display device based on the position and / or orientation input by the input means.

  In order to achieve the object of the present invention, for example, an information processing apparatus of the present invention comprises the following arrangement.

That is, the detecting means is attached to a first display device for displaying an image in front of the observer's eyes, and detects the presence or absence of a line of sight when the observer views the display screen of the first display device. When,
Control means for controlling the size of a GUI displayed on a second display device different from the first display device based on whether or not the line of sight is detected by the detection means.

  In order to achieve the object of the present invention, for example, an information processing apparatus of the present invention comprises the following arrangement.

That is, a position and orientation input means for inputting the position and orientation of a display device for displaying an image in front of the eyes of the observer;
Voice input means for inputting a voice indicating a desired instruction;
And control means for controlling the power supply of the voice input means based on the position and / or attitude input by the position and orientation input means.

  In order to achieve the object of the present invention, for example, an information processing apparatus of the present invention comprises the following arrangement.

That is, a detection unit that is attached to a display device for displaying an image in front of the observer's eyes and detects the presence or absence of a line of sight when the observer sees the display screen of the display device;
Voice input means for inputting a voice indicating a desired instruction;
Control means for controlling the power supply of the voice input means based on whether or not the line of sight is detected by the detection means.

  In order to achieve the object of the present invention, for example, an information processing apparatus of the present invention comprises the following arrangement.

That is, a position and orientation input means for inputting the position and orientation of a display device for displaying an image in front of the eyes of the observer;
An input means for inputting various instructions;
Control means for controlling whether or not an instruction can be accepted from the input means based on the position and / or orientation input by the position and orientation input means.

  In order to achieve the object of the present invention, for example, an information processing apparatus of the present invention comprises the following arrangement.

That is, a detection unit that is attached to a display device for displaying an image in front of the observer's eyes and detects the presence or absence of a line of sight when the observer sees the display screen of the display device;
An input means for inputting various instructions;
Control means for controlling whether or not to accept an instruction from the input means based on whether or not the line of sight is detected by the detection means.

  In order to achieve the object of the present invention, for example, an information processing method of the present invention comprises the following arrangement.

That is, an input step for inputting the position and orientation of the display device for displaying an image in front of the eyes of the observer;
And a control step of controlling the power supply of the display device based on the position and / or orientation input in the input step.

  In order to achieve the object of the present invention, for example, an information processing method of the present invention comprises the following arrangement.

That is, an information processing apparatus that is attached to a display device for displaying an image in front of an observer's eyes and that has detection means for detecting the presence or absence of a line of sight when the observer views the display screen of the display device. An information processing method to be performed,
The power source of the display device is controlled based on whether or not the line of sight is detected by the detection means.

  In order to achieve the object of the present invention, for example, an information processing method of the present invention comprises the following arrangement.

That is, an input step for inputting the position and orientation of the first display device for displaying an image in front of the observer's eyes;
And a control step of controlling the size of a GUI displayed on a second display device different from the first display device based on the position and / or orientation input in the input step.

  In order to achieve the object of the present invention, for example, an information processing method of the present invention comprises the following arrangement.

That is, the detecting means is attached to a first display device for displaying an image in front of the observer's eyes, and detects the presence or absence of a line of sight when the observer views the display screen of the first display device. An information processing method performed by an information processing apparatus having
The size of the GUI displayed on a second display device different from the first display device is controlled based on whether or not the line of sight is detected by the detection means.

  In order to achieve the object of the present invention, for example, an information processing method of the present invention comprises the following arrangement.

That is, an information processing method performed by an information processing apparatus having voice input means for inputting a voice indicating a desired instruction,
A position and orientation input step of inputting the position and orientation of the display device for displaying an image in front of the observer's eyes;
And a control step of controlling the power supply of the voice input means based on the position and / or posture input in the position and orientation input step.

  In order to achieve the object of the present invention, for example, an information processing method of the present invention comprises the following arrangement.

That is, a detection unit that is attached to a display device for displaying an image in front of the observer's eyes and detects the presence or absence of a line of sight when the observer sees the display screen of the display device;
An information processing method performed by an information processing apparatus having voice input means for inputting voice indicating a desired instruction,
The power source of the voice input unit is controlled based on whether or not the line of sight is detected by the detection unit.

  In order to achieve the object of the present invention, for example, an information processing method of the present invention comprises the following arrangement.

That is, an information processing method performed by an information processing apparatus having an input unit for inputting various instructions,
A position and orientation input step of inputting the position and orientation of the display device for displaying an image in front of the observer's eyes;
And a control step of controlling whether or not an instruction can be accepted from the input means based on the position and / or posture input in the position and orientation input step.

  In order to achieve the object of the present invention, for example, an information processing method of the present invention comprises the following arrangement.

That is, a detection unit that is attached to a display device for displaying an image in front of the observer's eyes and detects the presence or absence of a line of sight when the observer sees the display screen of the display device;
An information processing method performed by an information processing apparatus having an input unit for inputting various instructions,
Whether to accept an instruction from the input unit is controlled based on whether the line of sight is detected by the detection unit.

  In order to achieve the object of the present invention, for example, an information processing method of the present invention comprises the following arrangement.

That is, with a sensor attached to a display device for displaying an image in front of the observer's eyes, a step of detecting the presence or absence of a line of sight when the observer views the display screen of the display device;
Detecting the observer's pupil position;
Determining whether or not the observer is wearing correctly from the pupil position;
And a step of controlling voice notification to the observer according to the result of the determination.

  In order to achieve the object of the present invention, for example, an information processing method of the present invention comprises the following arrangement.

That is, with a sensor attached to a display device for displaying an image in front of the observer's eyes, a step of detecting the presence or absence of a line of sight when the observer views the display screen of the display device;
And a step of performing display control of an image to be notified to the observer according to a time during which it is continuously detected that the line of sight exists.

  In order to achieve the object of the present invention, for example, an information processing method of the present invention comprises the following arrangement.

That is, the step of inputting the biological information of the observer who views the display device for displaying an image in front of the observer's eyes,
Authenticating the observer based on the biological information;
A step of performing display control of an image according to the observer when the authentication is successful.

  In order to achieve the object of the present invention, for example, an information processing method of the present invention comprises the following arrangement.

That is, with a sensor attached to a display device for displaying an image in front of the observer's eyes, a step of detecting the presence or absence of a line of sight when the observer views the display screen of the display device;
Detecting the observer's pupil position;
Determining whether or not the observer is wearing correctly from the pupil position;
And a step of notifying that when it is determined that the observer is wearing correctly.

  In order to achieve the object of the present invention, for example, an information processing apparatus of the present invention comprises the following arrangement.

That is, a unit that is attached to a display device for displaying an image in front of the observer's eyes, and that detects the presence or absence of a line of sight when the observer views the display screen of the display device;
Means for detecting an observer's pupil position;
Means for determining whether or not the observer is wearing correctly from the pupil position;
And a means for notifying that when the observer determines that the user is wearing it correctly.

  According to the configuration of the present invention, it is possible to control the provision of information according to whether or not the information provided to the observer is received by the observer.

  Hereinafter, the present invention will be described in detail according to preferred embodiments with reference to the accompanying drawings.

[First Embodiment]
In the system according to the present embodiment, an observer who observes a virtual space using HMD / HHD (hereinafter, simply referred to as “display device” including this device) looks at the display screen of the display device. It is determined whether or not. If the result of the determination is that the display device is not viewed, it is determined that the image display by the display device is useless, and the display device is turned off. Then, the display device is turned on. Hereinafter, such a system will be described.

  FIG. 1 is a block diagram showing a functional configuration of a system according to the present embodiment.

  In the figure, reference numeral 101 denotes a video camera, which is installed on a head mounted display (hereinafter referred to as HMD) 108 that is mounted on the observer's head, and is adapted to its own position and orientation. The real space that can be seen is continuously imaged. The captured image signal of each frame is output to the image input unit 102. Since the video camera 101 is used as an observer's viewpoint, when the observer wears the head-mounted display device 108 on his / her head, the position is as close as possible to the position of the observer's viewpoint (eyes). To be provided.

  In addition, the following description is the same even if it uses the display device (Hand Held Display; hereinafter, referred to as HHD) of the type held by the hands of the experience person instead of the head-mounted display device 108.

  An image input unit 102 sends an image signal received from the video camera 101 to the subsequent image composition unit 103 as digital image data.

  Reference numeral 104 denotes a position / orientation sensor, which is attached to the head-mounted display device 108, detects a change in the magnetic field generated by a transmitter (not shown), and outputs a detection result signal to the position / orientation measurement unit 105. . The detected signal is a position / orientation sensor in a coordinate system (hereinafter referred to as a sensor coordinate system) in which the position of the transmitter is the origin and the three axes orthogonal to each other at the position of the origin are the x, y, and z axes. 104 is a signal indicating a change in magnetic field detected according to the position and orientation of 104. The position / orientation measurement unit 105 obtains the position / orientation of the position / orientation sensor 104 in the sensor coordinate system based on this signal. Data indicating the position and orientation of the position and orientation sensor 104 in the sensor coordinate system obtained by the position and orientation measurement unit 105 is sent to the subsequent image generation unit 107.

  The image generation unit 107 adds the “position / orientation relationship between the position / orientation sensor 104 and the video camera 101” measured in advance to the “position / orientation of the position / orientation sensor 104 in the sensor coordinate system” indicated by the data, The position and orientation of the video camera 101 in the coordinate system is obtained. It is assumed that data indicating the “position / orientation relationship between the position and orientation sensor 104 and the video camera 101” measured in advance is stored in advance in a virtual space database 106 described later.

  A virtual space database 106 is a database in which data relating to one or more virtual objects constituting the virtual space is registered. Here, for example, when the virtual object is composed of polygons, the data related to the virtual object is an image of the virtual object such as vertex data of each polygon, polygon normal data, texture data, and initial position data of the virtual object. This data is necessary for drawing. Further, as described above, the virtual space database 106 also stores data indicating “position / orientation relationship between the position / orientation sensor 104 and the video camera 101” measured in advance.

  Therefore, the image generation unit 107 arranges the virtual object in the virtual space using the data related to the virtual object stored in the virtual space database 106. Then, an image of the virtual space that can be seen from the viewpoint (video camera 101) of the position and orientation determined by the position and orientation measurement unit 105 is generated, and the generated image data is sent to the image composition unit 103.

  The image composition unit 103 superimposes the image of the virtual space received from the image generation unit 107 on the image of the real space received from the image input unit 102 and transmits the superimposed image to the head-mounted display device 108. As is well known, the head-mounted display device 108 is provided with a display unit. This display unit is mounted on the head-mounted display device 108 so as to be positioned in front of the eye when the observer mounts the head-mounted display device 108 on the head, and is transmitted from the image composition unit 103. An image based on the generated image signal is displayed. Accordingly, an image generated by the image composition unit 103 (an image obtained by superimposing a virtual space image on a real space image) is provided in front of the observer's eyes.

  Reference numeral 110 denotes a wearing state detection unit that determines whether or not the observer is viewing an image displayed on the head-mounted display device 108.

  Reference numeral 109 denotes a power control unit that performs power on / off control of the head-mounted display device 108 based on a determination result by the mounting state detection unit 110. That is, when the power supply control unit 109 receives a notification from the wearing state detection unit 110 that “the observer is viewing an image displayed on the head-mounted display device 108”, the head-mounted display The apparatus 108 is turned on. However, when the notification that the observer is not viewing the image displayed on the head-mounted display device 108 is received from the wearing state detection unit 110, the power of the head-mounted display device 108 is turned off. Process to make.

  FIG. 2 is a diagram showing a state in which an observer 201 wearing the head-mounted display device 108 on his / her head 202 is observing a pot as a virtual object placed on a desk as a real object. It is. In the figure, 204 is the desk and 205 is the pot. Reference numeral 201 denotes the observer, and the head-mounted display device 108 is attached to the head 202. The head-mounted display device 108 is equipped with a position / orientation sensor 104 and a video camera 101 as shown in FIG. Therefore, the video camera 101 captures an image of the real space that can be seen according to the position and orientation of the head 202 of the observer 201. Further, since the position / orientation sensor 104 changes the position / orientation according to the position / orientation of the head 202 of the observer 201, the position / orientation sensor 104 measures the changed position / orientation.

  Reference numeral 203 denotes a table on which the removed head-mounted display device 108 is placed when the observer 201 removes the head-mounted display device 108 from his / her head. The table 203 is also a table on which the head-mounted display device 108 is first placed.

  FIG. 16 is a block diagram showing a basic configuration of a system according to the present embodiment. As shown in the figure, the system includes a computer 1600, a head-mounted display device 108, and a position / orientation measurement device 1660.

  First, the computer 1600 will be described. Reference numeral 1601 denotes a CPU that controls the entire computer 1600 using programs and data stored in the RAM 1602 and the ROM 1603, and executes each process described below performed by the computer 1600. Note that the image generation unit 107, the image synthesis unit 103, and the wearing state detection unit 110 illustrated in FIG. 1 operate as part of the functions of the CPU 1601.

  Reference numeral 1602 denotes a RAM, an area for temporarily storing programs and data loaded from the external storage device 1607, and an area for temporarily storing data received via each of the subsequent I / Fs 1608 and 1609. Is provided. Furthermore, a work area used when the CPU 1601 performs various processes is provided.

  A ROM 1603 stores setting data, a boot program, and the like of the computer 1600.

  1604 and 1605 are a keyboard and a mouse, respectively, and can input various instructions to the CPU 1601.

  Reference numeral 1606 denotes a display device, which includes a CRT, a liquid crystal screen, and the like, and can display a processing result by the CPU 1601 using an image, text, or the like.

  Reference numeral 1607 denotes an external storage device, which is composed of a large-capacity information storage device such as a hard disk drive device. The OS (Operating System) and programs and data for causing the CPU 1601 to execute each process described below performed by the computer 1600 are provided here. Is saved. Some or all of these are loaded into the RAM 1602 according to the control of the CPU 1601, and the CPU 1601 uses this, so that the computer 1600 executes each process described below (performed by the computer 1600). Note that the virtual space database 106 shown in FIG. 1 operates as part of the functions of the external storage device 1607.

  Reference numeral 1608 denotes an I / F for connecting the head-mounted display device 108 to the computer 1600, and the computer 1600 performs data communication with the head-mounted display device 108 via the I / F 1608. It will be. Note that the image input unit 102 shown in FIG. 1 operates as part of the function of the I / F 1608.

  Reference numeral 1609 denotes an I / F for connecting the position / orientation measurement apparatus 1660 to the computer 1600, and the computer 1600 can receive data from the position / orientation measurement apparatus 1660 via the I / F 1609.

  Reference numeral 1610 denotes a bus connecting the above-described units.

  Instead of the computer 1600, dedicated hardware for performing the same processing may be used, or a workstation or the like may be used.

  Next, the head-mounted display device 108 will be described. The head-mounted display device 108 includes the video camera 101 and the position / orientation sensor 104 as described above, and also includes the power control device 1650. The power control device 1650 turns on / off the power of the head-mounted display device 108 in accordance with an instruction from the computer 1600. The power supply control unit 109 shown in FIG. 1 corresponds to the power supply control device 1650.

  Next, the position / orientation measurement apparatus 1660 will be described. The position / orientation measurement apparatus 1660 corresponds to the position / orientation measurement unit 105, and sends a signal received from the position / orientation sensor 104 to the I / F 1609 as digital data.

  In the following, various forms of the check process for checking whether or not the observer is looking at the image displayed on the head-mounted display device 108 will be described.

<Check process 1>
The head-mounted display device 108 is placed on the table 203 when not in use. Hereinafter, the position placed on the table 203 may be referred to as an initial position. When the observer is viewing an image displayed on the head-mounted display device 108, the head-mounted display device 108 is naturally not on the cradle 203 but on the viewer's head. It is installed. That is, whether or not the observer is viewing the image displayed on the head-mounted display device 108 is checked by checking whether or not the head-mounted display device 108 is on the table 203. It is done.

  Therefore, the position of the video camera 101 is used to check whether or not the head-mounted display device 108 is on the table 203. First, the head-mounted display device 108 is placed on the cradle 203, the position in the sensor coordinate system at that time (a predetermined position on the cradle 203) is measured as an initial position, and the data is stored in the virtual space database 106 as data. Register.

  Therefore, if the observer does nothing, the position of the video camera 101 is substantially the same as this initial position. That is, the distance between the video camera 101 and the initial position is substantially zero. However, when the observer tries to wear the head-mounted display device 108 on his / her head, this distance is not zero. Therefore, the wearing state detection unit 110 always obtains this distance, and if this distance is equal to or greater than the predetermined distance, it is determined that the observer is about to wear the head-mounted display device 108 on his / her head. This is notified to the power supply control unit 109. Thereby, the power control unit 109 turns on the power of the head-mounted display device 108. On the other hand, if the distance is smaller than the predetermined distance, it is determined that the observer is not trying to wear the head-mounted display device 108 on his / her head, and the power control unit 109 is notified accordingly. Thereby, the power control unit 109 turns off the power of the head-mounted display device 108.

  Thus, the power on / off control process of the head-mounted display device 108 is performed according to the distance from the initial position. The “predetermined distance” may be determined as appropriate according to the construction of the system.

  In addition to this, for example, when the posture of the video camera 101 obtained by the position / orientation measurement unit 105 is approximately 90 degrees vertically upward, the power on / off control processing is performed. Turn on. That is, it is determined that the observer is trying to put the head-mounted display device 108 placed on the table 203 on his / her head with the hand, and the head-mounted display device 108 is turned on. To do.

  In addition, if the initial position and orientation on the table 203 of the head-mounted display device 108 are obtained in advance, and the current position and orientation of the video camera 101 differ from the initial position and orientation by a predetermined amount or more, the head-mounted orientation is determined. The type display device 108 is turned on. That is, it is determined that the observer is trying to put the head-mounted display device 108 placed on the table 203 on his / her head with the hand, and the head-mounted display device 108 is turned on. You may do it. As described above, the position component and posture of the video camera 101 for determining whether or not the observer is about to wear the head-mounted display device 108 placed on the table 203 on his / her head. The method for using the components is not particularly limited.

  FIG. 3 is a flowchart of power control processing of the head-mounted display device 108 by <check processing 1> performed by the computer 1600. Note that programs and data for causing the CPU 1600 to execute processing according to the flowchart of FIG. This is loaded into the RAM 1602 under the control of the CPU 1600, and the CPU 1600 performs processing using this, whereby the computer 1600 performs each processing described later. Note that the processing according to the flowchart of FIG. 3 is being performed, for example, when the system provides information to the observer (in this embodiment, an image in which a virtual space image is superimposed on a real space image). Is always called as a subroutine.

  First, before the following processing is performed, the initial position (position in the sensor coordinate system) of the head-mounted display device 108 on the table 203 is measured and registered in the external storage device 1607 as data. (Step S0).

  And this system is started (step S1). Then, a signal indicating “the position and orientation of the position and orientation sensor 104 in the sensor coordinate system” is input from the position and orientation sensor 104 provided in the head-mounted display device 108 to the position and orientation measurement apparatus 1660. The position / orientation measurement apparatus 1660 sends this as data to the RAM 1602 via the I / F 1609. The CPU 1600 adds “position / orientation relationship between the position / orientation sensor 104 and the video camera 101” measured in advance to “position / orientation of the position / orientation sensor 104 in the sensor coordinate system” indicated by this data, “Position and orientation of the video camera 101” is obtained (step S2).

  Then, the distance between the initial position registered in advance in step S0 in the external storage device 1607 and the position obtained in step S2 is obtained (step S3), and it is determined whether this distance is equal to or greater than a predetermined distance (step S3). S4). In other words, the process in step S4 is a process of determining whether or not the observer is about to wear the head-mounted display device 108 on his / her head.

  If the distance obtained in step S3 is equal to or greater than the predetermined distance (when the observer is about to wear the head-mounted display device 108 on his / her head), the process proceeds to step S5. Since the CPU 1600 sends an instruction to turn on the power to the power control device 1650 provided in the head-mounted display device 108 (step S5), the power control device 1650 turns on the power of the head-mounted display device 108. To.

  On the other hand, when the distance obtained in step S3 is smaller than the predetermined distance (when the observer is not trying to wear the head-mounted display device 108 on his / her head), the process proceeds to step S6. Since the CPU 1600 sends an instruction to turn off the power to the power control device 1650 provided in the head-mounted display device 108 (step S6), the power control device 1650 turns off the power of the head-mounted display device 108. To.

  Then, when an instruction to end the above processing is input by, for example, the keyboard 1604 or the mouse 1605 provided in the computer 1600 and the CPU 1600 detects this, this processing ends (Yes in step S7). If not detected, the process returns to step S2 (No in step S7), and the subsequent processes are repeated.

<Check process 2>
In the check process 2, a line-of-sight detection device is used as the power supply control device 1650. In other words, in order to perform the check process 2, a position near the display unit of the head-mounted display device 108 and an observer who has mounted the head-mounted display device 108 on the head see this display unit. The gaze detection device is mounted at a position where the gaze can be detected. When such a line of sight is detected by the line-of-sight detection device, the computer 1600 is notified of this. Upon receiving this notification, the CPU 1600 determines that the observer is viewing an image displayed on the head-mounted display device 108, and turns on the power supply of the head-mounted display device 108 to the power control device 1650. Instruct you to. Therefore, the power supply control device 1650 turns on the power supply of the head-mounted display device 108.

  On the other hand, when the line-of-sight detection device does not detect the line of sight, it notifies the computer 1600 of that fact. Upon receiving this notification, the CPU 1600 determines that the observer is not looking at the image displayed on the head-mounted display device 108, and causes the power control device 1650 to turn off the power of the head-mounted display device 108. I will tell you. Therefore, the power supply control device 1650 turns off the power supply of the head-mounted display device 108.

  FIG. 4 is a flowchart of power control processing of the head-mounted display device 108 by <check processing 2> performed by the computer 1600. Note that programs and data for causing the CPU 1600 to execute processing according to the flowchart of FIG. This is loaded into the RAM 1602 under the control of the CPU 1600, and the CPU 1600 performs processing using this, whereby the computer 1600 performs each processing described later. Note that the processing according to the flowchart of FIG. 4 is, for example, during processing for the system to provide information to the observer (in this embodiment, an image in which a virtual space image is superimposed on a real space image). Is always called as a subroutine. Further, in each step shown in FIG. 4, the same processing steps as those in FIG. 3 are given the same step numbers, and the description thereof is omitted.

  In step S42, the observer's line-of-sight detection processing is performed by the line-of-sight detection device, and the detection result is received. Since the line-of-sight detection process is a well-known technique, a description thereof is omitted here. The CPU 1600 refers to this detection result, and if a line of sight is detected, the process proceeds to step S5 via step S43. The process in step S5 is as described above.

  On the other hand, if the line of sight cannot be detected, the process proceeds to step S6 via step S43. The process in step S6 is as described above.

<Check processing 3>
In the check process 3, a switch is provided on the head-mounted display device 108, and the observer presses this switch when he / she wants to view an image with the head-mounted display device 108. If the switch is pressed, the power supply control device 1650 notifies the computer 1600 that the switch is pressed. Upon receiving this notification, the computer 1600 interprets that the head-mounted display device 108 is being used, and notifies the power supply control device 1650 of an instruction to turn on the power of the head-mounted display device 108. Based on this notification, the power control device 1650 turns on the power of the head-mounted display device 108.

  FIG. 5 is a flowchart of power control processing of the head-mounted display device 108 by <check processing 3> performed by the computer 1600. Note that programs and data for causing the CPU 1600 to execute processing according to the flowchart of FIG. This is loaded into the RAM 1602 under the control of the CPU 1600, and the CPU 1600 performs processing using this, whereby the computer 1600 performs each processing described later. Note that the processing according to the flowchart of FIG. 5 is being performed, for example, when the system provides information to the observer (in this embodiment, an image obtained by superimposing a virtual space image on a real space image). Is always called as a subroutine. Further, in each step shown in FIG. 5, the same processing steps as those in FIG. 3 are given the same step numbers, and the description thereof is omitted.

  In step S52, the pressed state of the switch provided in power supply control device 1650 is detected by power supply control device 1650, and this detection result is received. The CPU 1600 refers to this detection result, and if the switch is pressed, advances the process to step S5 via step S53. The process in step S5 is as described above.

  On the other hand, if the switch is not pressed, the process proceeds to step S6 via step S53. The process in step S6 is as described above.

  As described above, according to the present embodiment, it is possible to perform on / off control of the power of the head-mounted display device 108 according to whether or not the viewer is viewing an image to be provided to the viewer. System power can be saved.

  In addition, although the sensor which concerns on this embodiment uses the magnetic sensor, it is not limited to this, For example, an optical sensor, an ultrasonic sensor, a mechanical sensor, etc. are properly used according to a use. You may do it.

  In the present embodiment, the power on / off control of the head-mounted display device 108 in the system for providing the observer with an image obtained by combining the real space and the virtual space has been described. However, the above-mentioned “turning on / off the head-mounted display device 108” also applies to a system that simply provides the observer with only the virtual space (displays only the image of the virtual space on the head-mounted display device 108). "Off control" can be applied. Furthermore, the system to be applied is not limited to the above system.

[Second Embodiment]
The system according to the present embodiment enables voice input in addition to the process of superimposing the virtual space image on the real space image and outputting it to the head-mounted display device 108. The voice input is performed by inputting a desired instruction by voice. The voice input can be performed when the observer is looking at the image displayed on the head-mounted display device 108, but the voice input cannot be performed when the viewer is not viewing the image. In the following, such a system will be described.

  FIG. 6 is a block diagram showing a functional configuration according to this embodiment. In the figure, the same parts as those shown in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted.

  Reference numeral 701 denotes a voice input unit for inputting a voice emitted from an observer. A voice information conversion unit 702 performs processing for converting the voice input from the voice input unit 701 into a command interpretable by the system. The converted command is sent to the image generation unit 107, where an image corresponding to the command is generated.

  Reference numeral 710 denotes a power control unit, which performs power on / off control processing in response to a notification from the mounting state detection unit 110, as in the first embodiment. However, the difference from the first embodiment is that the target of the power on / off control process is not the head-mounted display device 108 but the voice input unit 701 and the voice information conversion unit 702.

  FIG. 17 is a block diagram showing a basic configuration of a system according to the present embodiment. The system according to the present embodiment includes a voice input device 1701 and an I / F 1611 for the voice input device in addition to the system according to the first embodiment, and the head-mounted display device 108 has a power control device. This is different from the first embodiment in that it is not provided.

  The voice input device 1701 includes the voice input unit 701 and the power supply control unit 710 shown in FIG.

  FIG. 7 is a flowchart of power control processing of the voice input device 1701 performed by the computer 1600. Note that programs and data for causing the CPU 1600 to execute processing according to the flowchart of FIG. This is loaded into the RAM 1602 under the control of the CPU 1600, and the CPU 1600 performs processing using this, whereby the computer 1600 performs each processing described later. Note that the processing according to the flowchart of FIG. 7 is, for example, during processing for the system to provide information to the observer (in this embodiment, an image in which a virtual space image is superimposed on a real space image). Is always called as a subroutine. Further, in each step shown in FIG. 7, the same processing steps as those in FIG. 3 are given the same step numbers, and the description thereof is omitted.

  If it is determined in step S4 that the distance between the initial position registered in advance in step S0 in the external storage device 1607 and the position obtained in step S2 is greater than or equal to a predetermined distance, the process proceeds to step S75. The CPU 1600 sends an instruction to turn on the voice input unit 701 provided in the voice input device 1701 to the voice input device 1701 (step S75). At the same time, an instruction to turn on the voice information conversion unit 702 included in the voice input device 1701 is sent to the voice input device 1701 (step S76). Therefore, the voice input device 1701 includes the voice input unit 701, the voice information conversion unit. The power supply 702 is turned on.

  As a result, voice can be input to the voice input device 1701, and the input voice can be converted into a command that can be interpreted by the system.

  On the other hand, if the distance obtained in step S3 is smaller than the predetermined distance, the process proceeds to step S77, and the CPU 1600 sends an instruction to turn off the voice input unit 701 provided in the voice input device 1701 to the voice input device 1701. (Step S77). At the same time, an instruction to turn off the voice information conversion unit 702 included in the voice input device 1701 is sent to the voice input device 1701 (step S78). Therefore, the voice input device 1701 includes the voice input unit 701, the voice information conversion unit. The power source of 702 is turned off.

  With the above processing, the power input / output control processing of the voice input device 1701 can be performed depending on whether or not the observer is viewing an image displayed on the head-mounted display device 108.

  In addition, as described in the first embodiment, the determination process as to whether or not the observer is looking at the image displayed on the head-mounted display device 108 can be considered. For example, the determination may be made by visual line detection using the visual line detection device. In this case, when the line of sight is detected, the power of the voice input device 1701 is turned on.

  Further, the determination may be made by pressing the switch provided on the head-mounted display device 108. In this case, the power of the voice input device 1701 is turned on if the switch is pressed, and is turned off if the switch is not pressed.

  As described above, various processes for determining whether or not the observer is looking at the image displayed on the head-mounted display device 108 can be considered.

[Third Embodiment]
The system according to the present embodiment includes a head-mounted display device 108 and a liquid crystal display device. If an observer views an image displayed on the head-mounted display device 108, the head-mounted display device is displayed. The power of the device 108 is turned on and the power of the liquid crystal display device is turned off. On the other hand, if the observer does not see the image displayed on the head-mounted display device 108, the head-mounted display device 108 is turned off and the liquid crystal display device is turned on. Hereinafter, such a system will be described.

  FIG. 8 is a block diagram showing a functional configuration of the system according to the present embodiment. In the figure, the same parts as those in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted.

  Reference numeral 801 denotes a display destination switching unit that performs processing for turning on / off the power of the liquid crystal display device 802 and the head-mounted display device 108 based on the determination result by the mounting state detection unit 110. The processing performed by the wearing state detection unit 110 is the same as that in the first embodiment. That is, also in the present embodiment, the wearing state detection unit 110 performs a determination process as to whether or not the observer is viewing an image displayed on the head-mounted display device 108. The display destination switching unit 801 performs processing of turning on one of the liquid crystal display device 802 and the head-mounted display device 108 and turning off the other in accordance with the determination processing result.

  FIG. 18 is a block diagram illustrating a basic configuration of a system according to the present embodiment. The system according to the present embodiment has a configuration in which a liquid crystal display device 802 and an I / F 1612 for a liquid crystal display device are added to the system according to the first embodiment. The liquid crystal display device 802 includes a power control device 1802 similar to the power control device 1650 included in the head-mounted display device 108, and performs power on / off control processing of the liquid crystal display device 802 according to instructions from the computer 1600. .

  FIG. 9 is a diagram showing a state in which an observer wearing the head-mounted display device 108 on his / her head 202 is observing a pot as a virtual object placed on a desk as a real object. is there. In this figure, the same parts as those in FIG. In FIG. 9, the liquid crystal display device 802 is arranged on the desk 204, and the observer 201 displays both the image displayed on the head-mounted display device 108 and the image displayed on the liquid crystal display device 802. Can see. Therefore, as described above, an image is displayed on one of the display devices depending on whether or not the observer is viewing the image displayed on the head-mounted display device 108. The person 201 can see the image displayed on either of them.

  FIG. 10 is a flowchart of power control processing of the liquid crystal display device 802 and the head-mounted display device 108 performed by the computer 1600. Note that programs and data for causing the CPU 1600 to execute processing according to the flowchart of FIG. This is loaded into the RAM 1602 under the control of the CPU 1600, and the CPU 1600 performs processing using this, whereby the computer 1600 performs each processing described later. Note that the processing according to the flowchart of FIG. 10 is being performed, for example, when the system provides information to the observer (in this embodiment, an image obtained by superimposing a virtual space image on a real space image). Is always called as a subroutine. Further, in each step shown in FIG. 10, the same processing steps as those in FIG. 3 are given the same step numbers, and the description thereof is omitted.

  If it is determined in step S4 that the distance between the initial position registered in advance in step S0 in the external storage device 1607 and the position obtained in step S2 is greater than or equal to a predetermined distance, the process proceeds to step S105. First, the CPU 1600 sends an instruction to turn on the power to the power control device 1650, and outputs a composite image of the real space and the virtual space to the head-mounted display device 108 (step S105). At this time, an instruction to turn off the power is sent to the power supply control device 1802 of the liquid crystal display device 802. At this time, the power supply of the liquid crystal display device 802 is turned off.

  On the other hand, if the distance obtained in step S3 is smaller than the predetermined distance, the process proceeds to step S106. First, the CPU 1600 sends an instruction to turn off the power to the power supply control device 1650, and sends an instruction to turn on the power to the power supply control device 1802 of the liquid crystal display device 802 to display a composite image of the real space and the virtual space. It outputs to the liquid crystal display device 802 (step S106).

  As a result, an image can be displayed on the display device that the observer will be viewing.

  In addition, as described in the first embodiment, the determination process as to whether or not the observer is looking at the image displayed on the head-mounted display device 108 can be considered. For example, the determination may be made by visual line detection using the visual line detection device. In this case, the head-mounted display device 108 is turned on when the line of sight is detected, and is turned off when it is not detected.

  Further, the determination may be made by pressing the switch provided on the head-mounted display device 108. In this case, the power of the head-mounted display device 108 is turned on if the switch is pressed, and is turned off if the switch is not pressed.

  As described above, various processes for determining whether or not the observer is looking at the image displayed on the head-mounted display device 108 can be considered.

  In the above-described processing, the power of the display device that the observer will not see is turned off, but it is not necessary to turn it off.

  In this embodiment, the power on / off control processing of the liquid crystal display device 802 and the head-mounted display device 108 is performed. However, both the power supplies may be turned on, and the output destination of the image to be displayed may be switched to either the liquid crystal display device 802 or the head-mounted display device 108. In that case, in the above description, “turn on power” should be read as “image output destination”, and “turn off power” should be read as “not output image”. .

[Fourth Embodiment]
In the present embodiment, the display size of the graphical user interface (GUI) displayed on the liquid crystal display device 802 is changed according to whether or not the user is viewing an image displayed on the head-mounted display device 108. In this embodiment, an image is output to both the head-mounted display device 108 and the liquid crystal display device 802. However, if the display resolution of the display unit of the head-mounted display device 108 is low, the observer views the display screen of the liquid crystal display device 802 via this display unit, no matter how high the resolution of the liquid crystal display device 802 is. So small letters are difficult to see.

  Therefore, when displaying the GUI on the liquid crystal display device 802, if the observer does not see the image displayed on the head-mounted display device 108, the normal size GUI is displayed on the liquid crystal screen. On the other hand, if the observer is viewing an image displayed on the head-mounted display device 108, the display size of the GUI displayed on the liquid crystal display device 802 is increased. Accordingly, even if the display resolution of the display unit of the head-mounted display device 108 is low, characters on the GUI can be seen.

  FIG. 11 is a diagram showing a change in the display size of the GUI in the liquid crystal display device 802. When the observer does not see the image displayed on the head-mounted display device 108, the GUI is displayed in the normal size as shown in FIG. When viewing the image displayed on the display device 108, as shown in FIG. 1002, the GUI is displayed with a size larger than the normal size.

  FIG. 12 is a diagram illustrating a functional configuration of the system according to the present embodiment. In this figure, the same parts as those in FIG. 8 are denoted by the same reference numerals, and the description thereof is omitted. In the figure, reference numeral 1201 denotes a resolution switching unit that changes the size of the GUI displayed on the liquid crystal display device 802 based on the determination result by the mounting state detection unit 110. The processing performed by the wearing state detection unit 110 is the same as that in the first embodiment. That is, also in the present embodiment, the wearing state detection unit 110 performs a determination process as to whether or not the observer is viewing an image displayed on the head-mounted display device 108. Then, the resolution switching unit 1201 performs processing for changing the size of the GUI displayed on the liquid crystal display device 802 according to the determination processing result.

  The basic configuration of the system according to this embodiment is basically the same as that of the third embodiment.

  FIG. 13 is a flowchart of processing for changing the size of a GUI displayed on the liquid crystal display device 802 performed by the computer 1600. Note that programs and data for causing the CPU 1600 to execute processing according to the flowchart of FIG. This is loaded into the RAM 1602 under the control of the CPU 1600, and the CPU 1600 performs processing using this, whereby the computer 1600 performs each processing described later. Note that the processing according to the flowchart of FIG. 13 is, for example, during processing for the system to provide information to the observer (in this embodiment, an image in which a virtual space image is superimposed on a real space image). Is always called as a subroutine. Further, in each step shown in FIG. 13, the same processing steps as those in FIG. 3 are given the same step numbers, and the description thereof is omitted.

  If it is determined in step S4 that the distance between the initial position registered in advance in step S0 in the external storage device 1607 and the position obtained in step S2 is equal to or greater than a predetermined distance, the process proceeds to step S1305. The CPU 1600 increases the size of the GUI to be displayed on the liquid crystal display device 802 and outputs it to the liquid crystal display device 802 (step S1305).

  On the other hand, if the distance obtained in step S3 is smaller than the predetermined distance, the process proceeds to step S1306. The CPU 1600 outputs the GUI to be displayed on the liquid crystal display device 802 to the liquid crystal display device 802 with a normal size (a size smaller than the size of the GUI displayed in step S1305) (step S1306).

  In addition, as described in the first embodiment, the determination process as to whether or not the observer is looking at the image displayed on the head-mounted display device 108 can be considered. For example, the determination may be made by visual line detection using the visual line detection device. In this case, when the line of sight is detected, the size of the GUI displayed on the liquid crystal display device 802 is increased, and when the line of sight is not detected, the size of the GUI displayed on the liquid crystal display device 802 is set to a normal size.

  Further, the determination may be made by pressing the switch provided on the head-mounted display device 108. In this case, if the switch is pressed, the size of the GUI displayed on the liquid crystal display device 802 is increased. If the switch is not pressed, the size of the GUI displayed on the liquid crystal display device 802 is set to a normal size.

  As described above, various processes for determining whether or not the observer is looking at the image displayed on the head-mounted display device 108 can be considered.

[Fifth Embodiment]
The system according to this embodiment is as follows. That is, various instruction inputs from the input device such as the keyboard 1604 and the mouse 1605 can be performed when the observer is looking at the image displayed on the head-mounted display device 108, but not when the image is being viewed. It is not possible to input instructions. In the following, such a system will be described.

  FIG. 14 is a block diagram illustrating a functional configuration according to the present embodiment. In the figure, the same parts as those shown in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted.

  Reference numeral 1401 denotes an input device control unit that determines whether or not to allow instruction input from the input unit 1402 in accordance with a notification from the mounting state detection unit 110. The input unit 1401 corresponds to an input device such as a keyboard 1604 and a mouse 1605.

  Note that the basic configuration of the system according to the present embodiment is the same as that of the first embodiment.

  FIG. 15 is a flowchart of input control processing of instruction input from an input device such as a keyboard 1604 and a mouse 1605 performed by the computer 1600. Note that programs and data for causing the CPU 1600 to execute processing according to the flowchart of FIG. This is loaded into the RAM 1602 under the control of the CPU 1600, and the CPU 1600 performs processing using this, whereby the computer 1600 performs each processing described later. Note that the processing according to the flowchart of FIG. 15 is, for example, during processing for the system to provide information to the observer (in this embodiment, an image obtained by superimposing a virtual space image on a real space image). Is always called as a subroutine. Further, in each step shown in FIG. 15, the same processing steps as those in FIG. 3 are given the same step numbers, and the description thereof is omitted.

  If it is determined in step S4 that the distance between the initial position registered in advance in step S0 in the external storage device 1607 and the position obtained in step S2 is greater than or equal to a predetermined distance, the process proceeds to step S1505. The CPU 1600 receives an input instruction from an input device such as the keyboard 1604 and the mouse 1605 (step S1505).

  On the other hand, if the distance obtained in step S3 is smaller than the predetermined distance, the process proceeds to step S1506. The CPU 1600 does not accept input instructions from input devices such as the keyboard 1604 and the mouse 1605 (step S1506).

  In addition, as described in the first embodiment, the determination process as to whether or not the observer is looking at the image displayed on the head-mounted display device 108 can be considered. For example, the determination may be made by visual line detection using the visual line detection device. In this case, when a line of sight is detected, an instruction input from an input device such as the keyboard 1604 or the mouse 1605 is accepted.

  Further, the determination may be made by pressing the switch provided on the head-mounted display device 108. In this case, if the switch is pressed, an instruction input from an input device such as the keyboard 1604 or the mouse 1605 is accepted.

  As described above, various processes for determining whether or not the observer is looking at the image displayed on the head-mounted display device 108 can be considered.

[Sixth Embodiment]
In each of the above-described embodiments, the configuration has been described in which various information (image, sound) providing methods are switched depending on whether or not the observer is viewing an image displayed on the HMD 108. However, since the basic processing is the same even if the provided information is different, the above embodiments and the following embodiments can be used in appropriate combination. Further, the information to be provided can be considered other than this, and is not limited to only images and sounds.

[Seventh Embodiment]
In each of the above-described embodiments, the configuration has been described in which various information (image, sound) providing methods are switched depending on whether or not the observer is viewing an image displayed on the HMD 108. However, it is conceivable that, based on the same principle, the viewer is encouraged to properly wear the HMD 108 depending on whether or not the HMD 108 is properly worn.

  For example, first, the observer's line of sight is detected by the line-of-sight detection device attached to the display unit of the HMD 108. Further, this sensor detects the pupil position of the observer. As a result, when the observer's pupil position is not a predetermined position (for example, when two pupils are not positioned in front of the display unit), the observer has not properly worn the HMD 108 on the head. Judgment can be made. Note that the configuration for determining whether or not the observer appropriately wears the HMD 108 on the head is not limited to this.

  When the observer does not properly wear the HMD 108 on the head, a notification is made to prompt the user to wear the HMD 108 properly. As a notification form, for example, it may be performed by voice, or may be performed by display using the various display devices described above.

  On the other hand, when the pupil position of the observer is a predetermined position (for example, when two pupils are located in front of the display unit), the observer determines that the HMD 108 is appropriately worn on the head. In this case, the same processing as in the above embodiment is performed.

  In this way, the computer 1600 performs a series of processing performed in accordance with the determination result based on the pupil position as to whether or not the observer is appropriately wearing the HMD 108 on the head.

[Eighth Embodiment]
In the present embodiment, the computer 1600 measures the time during which it is continuously detected that there is a line of sight by the line-of-sight detection device. If the measured time is equal to or longer than a predetermined time, the observer is notified that the HMD 108 is removed from the head and rested in consideration of eye fatigue caused by continuously observing images. Against. In addition, as a form of notification, for example, it may be performed by voice or may be displayed on the display unit of the HMD 108.

  On the other hand, the computer 1600 also measures the time during which the gaze detection device detects that there is no gaze. Then, when the HMD 108 is worn on the head (that is, when the line-of-sight detection device detects the line of sight) when the time during which the line-of-sight is not detected does not reach the predetermined time continuously, Notify you that you have a little more break due to the short time. This notification form is not particularly limited, and for example, it is performed by voice or display as described above.

[Ninth Embodiment]
In this embodiment, in addition to the above-described embodiment, biometric information unique to individuals (human iris, fingerprint, vein, etc.) is used, and content is displayed only to an observer with appropriate authority. For use of such biometric information, for example, a sensor for detecting such biometric information is attached to the computer 1600, and the biometric information is read by this sensor and sent to the computer 1600 before using this system. Then, the authentication process may be performed on the computer 1600 side.

  If the authentication is successful, the system is operated as in the above embodiment. In this case, if the authenticated observer is an authorized user, information that can be browsed only by this observer may be displayed on the display unit of the HMD 108. On the other hand, if the authentication fails, it is determined that the viewer is not an appropriate observer, and for example, a message to that effect is displayed on the display unit of the HMD 108.

[Other Embodiments]
An object of the present invention is to read and execute a program code stored in a recording medium by a camera CPU or MPU from a recording medium (or storage medium) that records a program code of software that realizes the functions of the above-described embodiments. Needless to say, this is achieved. In this case, the program code itself read from the recording medium realizes the functions of the above-described embodiment, and the recording medium on which the program code is recorded constitutes the present invention.

  Further, by executing the program code read by the camera, not only the functions of the above-described embodiments are realized, but also an operating system (OS) operating on the camera based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

  Furthermore, after the program code read from the recording medium is written in a memory provided in a function expansion card inserted into the camera or a function expansion unit connected to the camera, the function is determined based on the instruction of the program code. It goes without saying that the CPU or the like provided in the expansion card or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  When the present invention is applied to the recording medium, program code corresponding to the flowchart (functional configuration) described above is stored in the recording medium.

It is a block diagram which shows the function structure of the system which concerns on the 1st Embodiment of this invention. It is a figure which shows a mode that the observer who mounted | wore the own head 202 with the head mounted display apparatus 108 is observing the pot as a virtual object arrange | positioned on the desk as a real object. 12 is a flowchart of power control processing of the head-mounted display device by <check processing 1> performed by the computer 1600. 10 is a flowchart of power control processing of the head-mounted display device by <check processing 2> performed by the computer 1600. 12 is a flowchart of power control processing of the head-mounted display device by <check processing 3> performed by the computer 1600. It is a block diagram which shows the function structure which concerns on the 2nd Embodiment of this invention. 12 is a flowchart of power control processing of the voice input device 1701 performed by the computer 1600. It is a block diagram which shows the function structure of the system which concerns on the 3rd Embodiment of this invention. It is a figure which shows a mode that the observer who mounted | wore the own head 202 with the head mounted display apparatus 108 is observing the pot as a virtual object arrange | positioned on the desk as a real object. 10 is a flowchart of power control processing of a liquid crystal display device 802 and a head-mounted display device 108 performed by a computer 1600. FIG. 10 is a diagram illustrating a change in a GUI display size in the liquid crystal display device 802. It is a figure which shows the function structure of the system which concerns on the 4th Embodiment of this invention. 10 is a flowchart of processing for changing the size of a GUI displayed on a liquid crystal display device 802 performed by a computer 1600. It is a block diagram which shows the function structure which concerns on the 5th Embodiment of this invention. 12 is a flowchart of input control processing of instruction input from an input device such as a keyboard 1604 and a mouse 1605 performed by a computer 1600. 1 is a block diagram showing a basic configuration of a system according to a first embodiment of the present invention. It is a block diagram which shows the basic composition of the system which concerns on the 2nd Embodiment of this invention. It is a block diagram which shows the basic composition of the system which concerns on the 3rd Embodiment of this invention.

Claims (28)

An input means for inputting a position and orientation of a display device for displaying an image in front of the eyes of the observer;
An information processing apparatus comprising: control means for controlling a power supply of the display device based on a position and / or orientation input by the input means.   When the distance between the position input by the input means and the initial position of the display device is equal to or greater than a predetermined distance, the control means turns on the display device, and the distance is smaller than the predetermined distance. The information processing apparatus according to claim 1, wherein the display apparatus is turned off.   The control means turns off the power of the display device if the posture input by the input means is substantially vertically upward, and turns on the power of the display device if the posture is not substantially vertically upward. The information processing apparatus according to claim 1. A detection unit that is attached to a display device for displaying an image in front of the observer's eyes, and that detects the presence or absence of a line of sight when the observer sees the display screen of the display device;
An information processing apparatus comprising: control means for controlling a power source of the display device based on whether or not the line of sight is detected by the detection means.   The control means turns on the display device when the detection means detects the line of sight, and turns off the display device when the detection means does not detect the line of sight. The information processing apparatus according to claim 4.   The information processing apparatus according to claim 5, wherein the control unit turns on a power supply of a display device different from the display device when the power supply of the display device is turned off.   The information processing apparatus according to claim 5, wherein the control unit turns off the power of a display device different from the display device when the power of the display device is turned on. Input means for inputting the position and orientation of the first display device for displaying an image in front of the eyes of the observer;
Control means for controlling the size of a GUI displayed on a second display device different from the first display device based on the position and / or orientation input by the input means. apparatus. A detection unit that is attached to a first display device for displaying an image in front of the observer's eyes, and that detects the presence or absence of a line of sight when the observer views the display screen of the first display device;
An information processing apparatus comprising: control means for controlling a size of a GUI displayed on a second display device different from the first display device, based on whether or not the line of sight is detected by the detection means. . Position and orientation input means for inputting the position and orientation of a display device for displaying an image in front of the observer's eyes;
Voice input means for inputting a voice indicating a desired instruction;
An information processing apparatus comprising: control means for controlling a power source of the voice input means based on the position and / or attitude input by the position and orientation input means. A detection unit that is attached to a display device for displaying an image in front of the observer's eyes, and that detects the presence or absence of a line of sight when the observer sees the display screen of the display device;
Voice input means for inputting a voice indicating a desired instruction;
An information processing apparatus comprising: a control unit that controls a power source of the voice input unit based on whether or not the line of sight is detected by the detection unit. Position and orientation input means for inputting the position and orientation of a display device for displaying an image in front of the observer's eyes;
An input means for inputting various instructions;
An information processing apparatus comprising: control means for controlling whether or not an instruction can be accepted from the input means based on the position and / or orientation input by the position and orientation input means. A detection unit that is attached to a display device for displaying an image in front of the observer's eyes, and that detects the presence or absence of a line of sight when the observer sees the display screen of the display device;
An input means for inputting various instructions;
An information processing apparatus comprising: control means for controlling whether or not to accept an instruction from the input means based on whether or not the line of sight is detected by the detection means. An input step for inputting the position and orientation of the display device for displaying an image in front of the observer's eyes;
And a control step of controlling the power supply of the display device based on the position and / or orientation input in the input step. Information provided by an information processing apparatus that is attached to a display device for displaying an image in front of the observer's eyes and that has detection means for detecting the presence or absence of a line of sight when the observer views the display screen of the display device A processing method,
An information processing method, comprising: controlling a power source of the display device based on presence or absence of detection of the line of sight by the detection unit. An input step for inputting the position and orientation of the first display device for displaying an image in front of the eyes of the observer;
A control step of controlling a size of a GUI displayed on a second display device different from the first display device based on the position and / or orientation input in the input step. Method. It has attached to the 1st display device for displaying an image in front of an observer's eyes, and has a detection means which detects the existence of a look at the time of the observer seeing the display screen of the 1st display device concerned An information processing method performed by an information processing apparatus,
An information processing method, comprising: controlling a size of a GUI displayed on a second display device different from the first display device based on whether or not the line of sight is detected by the detection unit. An information processing method performed by an information processing apparatus having voice input means for inputting voice indicating a desired instruction,
A position and orientation input step of inputting the position and orientation of the display device for displaying an image in front of the observer's eyes;
And a control step of controlling the power supply of the voice input means based on the position and / or posture input in the position and orientation input step. A detection unit that is attached to a display device for displaying an image in front of the observer's eyes, and that detects the presence or absence of a line of sight when the observer sees the display screen of the display device;
An information processing method performed by an information processing apparatus having voice input means for inputting voice indicating a desired instruction,
An information processing method, comprising: controlling a power source of the voice input unit based on whether or not the line of sight is detected by the detection unit. An information processing method performed by an information processing apparatus having an input unit for inputting various instructions,
A position and orientation input step of inputting the position and orientation of the display device for displaying an image in front of the observer's eyes;
And a control step of controlling whether or not an instruction can be accepted from the input means based on the position and / or orientation input in the position and orientation input step. A detection unit that is attached to a display device for displaying an image in front of the observer's eyes, and that detects the presence or absence of a line of sight when the observer sees the display screen of the display device;
An information processing method performed by an information processing apparatus having an input unit for inputting various instructions,
An information processing method comprising: controlling whether or not an instruction can be received from the input unit based on whether or not the line of sight is detected by the detection unit. A step of detecting presence or absence of a line of sight when the observer sees the display screen of the display device with a sensor attached to the display device for displaying an image in front of the eyes of the observer;
Detecting the observer's pupil position;
Determining whether or not the observer is wearing correctly from the pupil position;
And a step of notifying that when it is determined that the observer is wearing correctly.   The information processing method according to claim 15, further comprising a step of notifying a predetermined message when a time during which the line of sight is continuously detected is a predetermined time or more.   The information processing method according to claim 15, further comprising a step of notifying a predetermined message when the time during which the line of sight is not detected is continuously longer than a predetermined time. Furthermore,
Inputting biological information of an observer who sees a display device for displaying an image in front of the eyes of the observer;
Authenticating the observer based on the biological information;
The information processing method according to claim 14, further comprising: performing display control of an image according to an observer who has succeeded in the authentication. Means for detecting the presence or absence of a line of sight when the observer sees the display screen of the display device attached to a display device for displaying an image in front of the observer's eyes;
Means for detecting an observer's pupil position;
Means for determining whether or not the observer is wearing correctly from the pupil position;
An information processing apparatus comprising: means for notifying that when the observer determines that the user is wearing correctly.   A program causing a computer to execute the information processing method according to any one of claims 14 to 25.   A computer-readable storage medium storing the program according to claim 27.

Images