JP2020038698A - Information processing device, information processing method, and program - Google Patents

Abstract

To allow for appropriately controlling a virtual space using information obtained from an information display device.SOLUTION: An information processing device provided herein is configured to control a screen displayed on an information display device worn on the head of a user, and comprises: eye open/close detection means for detecting opening and closing of eyes of the user wearing the information display device; and operating mode modification means configured to modify objects displayed on the screen or an operating mode of the screen when the eye open/close detection means detects that the user has closed one or both eyes.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing device, an information processing method, and a program.

  2. Description of the Related Art Conventionally, wearable information display devices such as a HMD (Head Mounted Display) and an FMD (Face Mounted Display) have begun to spread. By mounting such an information display device, an image or a video is displayed over the entire field of view by the magnifying optical system, or a field of view in a virtual space is provided by VR (Virtual Reality) technology. Can be.

  In addition, there is a method of simplifying the operation of the user (recognizing the orientation and blinking of the face of the user (wearer) using the information display device) (for example, see Patent Document 1). In Patent Literature 1, images input from a plurality of remote monitoring cameras are received wirelessly or by wire and displayed on an information display device, and switching of the monitoring cameras, control of the direction, and control of the viewpoint are performed according to the direction and blink of the user's face. It is carried out.

  In recent years, the above-described information display device is also provided in a game device or the like to give a user a feeling that he or she is participating in a virtual space provided by a game program. Attempts to improve entertainment are being considered.

JP 2000-333161 A

  However, in the above-mentioned conventional method, there is no proposal on how to detect the face direction and blinking in the information display device in the virtual space, and the information obtained from the information display device is appropriately displayed in the virtual space. Could not be reflected.

  In one aspect, an object is to perform appropriate control on a virtual space using information obtained from an information display device.

  In one proposal, an information processing device that controls a screen displayed on an information display device worn on a user's head, an eye open / closed detecting unit that detects open / closed eyes of a user wearing the information display device, An operation mode changing unit configured to change an operation mode of an object displayed on the screen or the screen when the user detects that the user has closed one or both eyes by the eye open / close detection unit.

  According to one aspect, appropriate control for a virtual space can be performed using information obtained from an information display device.

FIG. 2 is a diagram illustrating an example of a functional configuration of an information processing device. FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device. It is a flowchart which shows an example of a setting process. It is a flowchart which shows an example of an operation mode change process. It is a flowchart which shows an example of a change process. FIG. 11 is a diagram (part 1) for describing a specific example of the operation control process; FIG. 10 is a diagram (part 2) for describing a specific example of the operation control process; FIG. 11 is a diagram (part 3) for describing a specific example of the operation control process; FIG. 10 is a diagram (part 4) for describing a specific example of the operation control process; FIG. 10 is a diagram (No. 5) for describing a specific example of the operation control process;

  Hereinafter, embodiments will be described with reference to the drawings. In the following description, as an aspect of the present embodiment, an example in which a character operated by a user (player) exists in a virtual space provided by a predetermined game program (an example of content) or the like will be described. However, the virtual space is not limited to the one provided by the game program.

<Example of functional configuration of information processing device>
FIG. 1 is a diagram illustrating an example of a functional configuration of the information processing apparatus. The information processing apparatus 10 illustrated in FIG. 1 includes a communication unit 11, a setting unit 12, a storage unit 13, an eye opening / closing detection unit 14, a determination unit 15, an operation mode change unit 16, a screen generation unit 17, Control means 18. Note that the information processing apparatus 10 is, for example, a game device, a PC (Personal Computer), a tablet terminal, or the like, but is not limited thereto.

  The communication unit 11 is connected to an external device by wire or wirelessly, and transmits and receives data. As shown in FIG. 1, the communication unit 11 is connected to an HMD 21 as an example of an information display device (information display unit) and a controller 22 as an example of an operation device (operation unit).

  The HMD 21 is, for example, a display device (wearable information presentation device) shaped like a pair of glasses, goggles, and a helmet that can be worn on the user's head. When mounted on the head, the screens are set one by one in front of the left and right eyes. In addition to simply displaying images, stereoscopic effects can be expressed by displaying slightly different images on the left and right displays. The HMD 21 can provide a view in a virtual space by changing the screen according to the movement of the wearer's head.

  Further, the HMD 21 may detect information about the position of the head, the direction of the face, and the acceleration (including the speed) for each unit time, and may transmit the content to the information processing device 10. Further, the HMD 21 is provided with an inward camera (imaging means) for detecting the position of the eyes, detects a viewpoint (point of gaze) from the position and direction of the user's eyes (black eyes) for each unit time, and determines the content. The information may be transmitted to the information processing device 10.

  Further, the HMD 21 may include a sensor for detecting the amount of sweating of the user, a body temperature sensor for detecting the body temperature, and a heart rate detection sensor for detecting the heart rate. Among the information obtained from these sensors, At least one may be transmitted to the information processing device 10.

  The controller 22 performs setting of an image to be displayed on the HMD 21 and various settings in the operation control processing according to the present embodiment. When the information processing device 10 is a game device, the controller 22 performs start and end of a game, selection of items, operation control during game execution, and the like.

  The communication unit 11 is connected to an external device connected by a communication network represented by, for example, the Internet or a LAN (Local Area Network) in a state where data can be transmitted and received. For example, a game program is downloaded from the external device. And various data relating to the operation control program according to the present embodiment can be received and transmitted.

  The setting means 12 sets a reference time for the eye opening / closing detecting means 14 to detect that the eyes are closed. The setting unit 12 changes the operation mode according to the state in which one or both eyes detected by the eye opening / closing detection unit 14 are closed or the length of time during which the state is continued. Or set. The content (setting information) set by the setting unit 12 is stored in the storage unit 13. The setting unit 12 can register setting information for each user.

  The storage unit 13 stores various data necessary for the operation control processing according to the present embodiment. For example, the storage unit 13 stores information set by the setting unit 12, various game programs, various setting information for executing the game programs, and the like, and information such as a user's eye open / closed state acquired from the HMD 21. The content to be stored is not limited to this, and may be history information indicating the result of opening and closing the eyes, other execution history information (log), and the like.

  The eye opening / closing detection unit 14 analyzes images near the left and right eyes of the user, which are captured by an inward camera (imaging unit) provided in the HMD 21 and detects the opening / closing state of the eyes. For example, the eye opening / closing detection unit 14 determines whether or not an area corresponding to the user's eyeball (white eye and black eye) exists from the image of the camera, and opens the eye when the above area (eyeball area) exists. It is determined that the eyes are closed when no area exists.

  The determination means 15 closes the eyes using a reference time or the like so that the detection of eye open / closed by the eye open / close detection means 14 does not detect a mere “blink” as a closed state of the eyes. Determine the status.

  For example, the judging means 15 counts the time of opening / closing detection of the eyes (one or both eyes) detected at predetermined time intervals, triggered by detecting that the eyes are closed, and counts the elapsed time (counting time). ) Is longer than the reference time set by the setting means 12, it is determined that the eyes are closed. Further, even when the count is equal to or longer than the reference time, the determination unit 15 performs the count until it detects that the eyes are open. As a result, in the present embodiment, the operation mode can be changed to an operation mode corresponding to the above-described count value.

  Note that the eye opening / closing detection unit 14 and the determination unit 15 may detect that the user keeps closing one or both eyes by using, for example, an eye tracking function of the HMD 21. For example, the eye opening / closing detecting means 14 may detect the position of the iris by the eye tracking function, and may detect whether one or both eyes are closed from the detection result. For example, when the eyes are closed, the detection result of the position of the iris is “undefined value” or “last detected value”. Here, human eyes are always moving even if they are staring due to their characteristics. Therefore, the determination unit 15 counts the time during which the position of the iris is completely stopped, and determines that the eyes are closed when the position of the iris is completely stopped for the reference time or more. Good.

  The operation mode changing means 16 determines a player in the game (for example, a character or the like operating in a virtual space) in accordance with a state in which the user keeps one or both eyes closed based on the result of the eye open / close detection by the determination means 15. The operation mode (for example, the internal state or the like) of the image displayed on the screen of the HMD 21 is changed. By changing the operation mode, for example, various effects or effects for the game being executed can be provided to the user.

  The operation mode changing unit 16 includes, for example, a parameter control unit 16-1 and a display control unit 16-2. The parameter control unit 16-1 increases parameter information such as attack power and resilience to a character operating in a virtual space, for example, to twice the preset normal setting, attacks an enemy, and plays a puzzle. Parameter control is performed such as increasing points that can be obtained by performing a predetermined operation such as alignment. That is, the parameter control unit 16-1 performs parameter control that gives a risk return to the game, considering that the view is narrowed as a risk. Further, the parameter control unit 16-1 may perform control to provide the user with an additional bonus, an effect of a charge attack, and the like according to the time during which the eyes are kept closed.

  Further, the display control unit 16-2 performs display control relating to rendering processing such as changing the content displayed on the screen of the HMD 21 or reducing the load in screen generation. For example, when the display control unit 16-2 determines that the one eye is closed by the determination unit 15, the display control unit 16-2 intuitively expresses that the user is squinting (for example, a lock-on mode or the like). Is displayed on the screen. When the display control unit 16-2 determines that both eyes are closed by the determination unit 15, the display control unit 16-2 intuitively expresses that the user is resting or concentrating (for example, “Good night”). Or, a character display such as “concentration enhancement” etc.) is displayed on the screen.

  When one eye is closed, the display control means 16-2 simply copies the image with the eye open and uses it for the one with the eye closed (drawing load is reduced by half). ), A process of drawing an original video at a low resolution and using the original video may be performed.

  The change of the operation mode in the operation mode changing means 16 is not limited to this.

  The screen generation unit 17 generates the content to be displayed on the screen of the HMD 21, for example. For example, the screen generation unit 17 displays a virtual space provided by the game program instructed by the user to execute, and generates a video in which a character operated by the user is synthesized on the virtual space. At this time, the screen generating unit 17 may generate a corresponding screen based on the operation mode changed by the operation mode changing unit 16.

  The control unit 18 controls each component of the information processing apparatus 10. The control means 18 includes, for example, transmission and reception of data with various devices by the communication means 11, setting of various information by the setting means 12, detection of eye open / close by the eye open / close detection means 14, and whether or not the eye is closed by the judgment means 15 In this case, the control of the operation mode change by the operation mode changing means 16 and the screen generation by the screen generating means 17 are controlled, but the control contents are not limited to these.

  For example, the control unit 18 controls the start and end of the execution of the game processing, and controls the processing when an error occurs. In addition, the control unit 18 may perform a process at the time of login authentication for each user, and may execute a game corresponding to the user, an operation control process, and the like when the authentication is successful.

  In the above-described example, the HMD 21 and the information processing device 10 are configured separately from each other. However, the present invention is not limited to this, and the information processing device 10 is configured integrally with each HMD 21. You may. In that case, each HMD 21 corresponds to the information processing device 10. In the present embodiment, a configuration without the controller 22 may be employed.

<Example of hardware configuration of information processing apparatus 10>
Next, an example of a hardware configuration of the information processing apparatus 10 will be described with reference to the drawings. FIG. 2 is a diagram illustrating an example of a hardware configuration of the information processing apparatus. In the example of FIG. 2, the information processing device (computer) 10 includes an input device 31, an output device 32, a drive device 33, an auxiliary storage device 34, a main storage device 35, a CPU (Central Processing Unit) 36, , And a communication control device 37, which are interconnected by a system bus B.

  The input device 31 has, for example, a pointing device such as a keyboard and a mouse operated by a user or the like, and a voice input device such as a microphone, and starts a program execution instruction from the user or the like, various operation information, software, and the like. Input of information and the like is performed. The input device 31 may be an operation device such as the controller 22 described above.

  The output device 32 includes a display for displaying various windows, data, and the like necessary for operating the computer main body (the information processing device 10) for performing the processing in the present embodiment. The output device 32 can display the execution progress and results of the program by the control program of the CPU 36. The output device 32 may be an information display device such as the HMD 21 described above.

  Here, in the present embodiment, for example, the execution program installed in the computer main body is provided by the recording medium 38 or the like. The recording medium 38 can be set in the drive device 33. The execution program stored in the recording medium 38 is installed from the recording medium 38 to the auxiliary storage device 34 via the drive device 33 based on the control signal from the CPU 36.

  The auxiliary storage device 34 is, for example, a storage unit such as a hard disk drive (HDD) or a solid state drive (SSD). The auxiliary storage device 34 stores an execution program (operation control program) according to the present embodiment, a control program provided in a computer, and the like based on a control signal from the CPU 36, and performs input and output as necessary. The auxiliary storage device 34 can read or write necessary information from the stored information based on a control signal or the like from the CPU 36.

  The main storage device 35 stores an execution program and the like read from the auxiliary storage device 34 by the CPU 36. The main storage device 35 is a ROM (Read Only Memory), a RAM (Random Access Memory), or the like.

  Based on a control program such as an OS (Operating System) and an execution program stored in the main storage device 35, the CPU 36 performs overall computer processing such as various calculations and input / output of data with each hardware component. Control to realize each process. Various information and the like necessary during execution of the program can be obtained from the auxiliary storage device 34, and execution results and the like can be stored.

  More specifically, the CPU 36 executes a program installed in the auxiliary storage device 34 based on, for example, an execution instruction of the program obtained from the input device 31 to execute processing corresponding to the program on the main storage device 35. Do. For example, by executing the operation control program, the CPU 36 transmits / receives data to / from various devices by the communication unit 11, sets various information by the setting unit 12, detects opening / closing of the eyes by the eye opening / closing detection unit 14, and executes the operation Processing such as determining whether the eyes are closed or not, changing the operation mode by the operation mode changing means 16, and generating a screen by the screen generating means 17 are performed. The processing content in the CPU 36 is not limited to this. The contents executed by the CPU 36 are stored in the auxiliary storage device 34 or the like as necessary.

  The communication control device 37 performs communication with another external device via the above-described communication network. The communication control device 37 acquires an execution program, software, setting information, and the like from an external device or the like by connecting to a communication network or the like based on a control signal from the CPU 36. Further, the communication control device 37 may provide the execution result obtained by executing the program to an external device or the like, or may provide the execution program itself in the present embodiment to the external device or the like.

  The recording medium 38 is a computer-readable recording medium in which the execution program and the like are stored as described above. The recording medium 38 is, for example, a semiconductor memory such as a flash memory or a portable recording medium such as a CD-ROM or a DVD, but is not limited thereto.

  By installing an execution program (for example, an operation control program, etc.) in the hardware configuration shown in FIG. 2, hardware resources and software cooperate to implement various game processes, operation control processes, and the like in the present embodiment. be able to. Further, by executing the game program installed in the recording medium 38, the game screen can be displayed on the HMD 21 and the game can be executed by a user's operation.

<Operation control processing>
Next, an operation control process according to the present embodiment will be described. The operation control process according to the present embodiment includes, for example, a “setting process” in which an operation mode and the like are set in advance when the user's eyes are opened and closed before execution of the game program, and a setting information obtained by the setting process. Based on this, it is roughly classified into “operation mode change processing” for detecting the opening and closing of the eyes of the user and changing the operation mode after the detection. Therefore, in the following description, the above two processes will be described separately.

<Setting process>
FIG. 3 is a flowchart illustrating an example of the setting process. In the example of FIG. 3, the setting unit 12 sets user information (S01), and sets a reference time for determining whether one eye or both eyes are open or closed (S02). The setting contents of the reference time include, for example, “detection time when one eye is closed: 3 seconds”, “detection time when both eyes are closed: 2 seconds”, and the like, but are not limited thereto. Instead, for example, the same reference time may be set for one eye and both eyes, or different reference times may be set for the right eye and the left eye.

  Next, the setting unit 12 sets an operation mode when it is determined that one eye and both eyes are closed (S03). The content of the operation mode is, for example, the above-described parameter control or display control, but is not limited thereto. Next, the setting unit 12 stores the setting information associated with the user information obtained in S01 to S03 described above in the storage unit 13 and performs registration (S04).

  Note that the above-described setting process may be performed at least once before execution of an operation mode change process described later, and may not be performed each time the operation mode change process is executed. In the setting process of FIG. 3, the setting by the user may be omitted by using a predetermined value. In the setting process, the setting may be changed according to the type of the game to be executed.

<Operation mode change processing>
FIG. 4 is a flowchart illustrating an example of the operation mode change process. In the example of FIG. 4, the eye opening / closing detection unit 14 of the information processing device 10 acquires the setting information set by the above-described setting process and stored in the storage unit 13 (S11).

  Next, the eye opening / closing detecting means 14 acquires an image near the user's eye by using a camera or the like provided in the HMD 21 (S12). Next, the eye opening / closing detecting means 14 detects opening / closing of the eyes (S13). The eye opening / closing detecting means 14 can detect whether the closing operation at the same time is only one eye (the right eye or the left eye) or both eyes by the process of S13.

  Next, the determination means 15 counts the time for the closed eyes (S14), and determines whether the counted time is equal to or longer than the reference time (S15). If the counted value is equal to or longer than the reference time (YES in S15), it is determined that the eyes are closed, and the operation mode changing unit 16 performs a process of changing the operation mode in the game or the like being executed. (S16). A specific example of the change processing in S16 will be described later.

  Further, in the process of S15, when the counted time is not equal to or longer than the reference time (NO in S15), or after the process of S16, the screen generation unit 17 sets the image changed by the operation mode change process or the image set in advance. An image as it is is generated (S17), and the generated image is displayed on the screen of the HMD 21 (S18).

  Next, the information processing apparatus 10 determines whether or not to end the processing (S19), and if not to end the processing (NO in S19), returns to the processing of S12. If the game or the like is to be ended by a user instruction or the end of the game (YES in S19), the operation mode change process ends.

<S16: Change processing>
Next, an example of the change processing in S16 described above will be described using a flowchart. FIG. 5 is a flowchart illustrating an example of the change process.

  In the example of FIG. 5, the operation mode changing unit 16 determines whether the eyes closed by the user are one eye or both eyes. For example, the operation mode changing unit 16 determines whether the user's closed eye is one eye (S21). When the user closes one eye (YES in S21), the operation control unit 16-2 controls the display control by the display control unit 16-2. Do. Further, in the process of S21, if one eye is not closed (NO in S21), since both eyes are closed, parameter control is performed (S23).

  In the example of FIG. 5 described above, since the view is blocked by closing both eyes, the mode is changed by parameter control. In addition, in the example of FIG. 5, since a display different from the normal display can be produced by closing one eye, the mode is changed by the display control.

  Note that the change processing shown in FIG. 5 is merely an example, and other various change processing can be performed. For example, the process of S22 and the process of S23 described above may be interchanged, and control combining display control and parameter control may be performed in each of the processes of S22 and S23.

  In the change processing, for example, when the user has opened both eyes after the processing of S22 and S23, the mode may be changed to the original mode immediately, or it is assumed that both eyes are opened. Alternatively, the display control or parameter control processed in S22 or S23 may be continued for a predetermined time (for example, about 3 to 5 seconds). The above-described control may be set in advance by the setting unit 12, or may be set for each game being executed by the user.

<Specific example of operation control processing>
Next, a specific example of the operation control process according to the present embodiment will be described with reference to the drawings. 6 to 10 are diagrams (parts 1 to 5) for describing a specific example of the operation control processing. In the present embodiment, the user 40 wears, for example, the HMD 21 wirelessly connected to the information processing apparatus 10 on his / her head, and uses the controller 22 wirelessly connected to the information processing apparatus 10 to play a predetermined game. Start, end, and perform operations on characters in the virtual space.

  In the example of FIG. 6, a virtual space 60 provided by executing the game program (content) selected by the user is displayed on the screen of the HMD 21. In the example of FIG. 6, an enemy character 61, a weapon 62 carried by the character 61, a door 63, and the like are displayed on the virtual space 60. The character 61, the weapon 62, and the door 63 described above are examples of an object.

  The user 40 performs an operation such as attacking the enemy character 61 or escaping from the door 63 by operating the character to be operated by giving an operation instruction from the controller 22 to the screen 50 described above.

  Further, in the present embodiment, when it is detected that one or both eyes are kept closed during the game play as described above, the operation control (change of the operation mode) for providing the user with various effects and effects on the game is performed. )I do.

  For example, in a state where one eye is closed, the field of view is narrowed, and the sense of distance in the virtual space cannot be grasped. For example, by closing one eye, as shown in FIG. 7, in the virtual space 60 displayed on the screen 50-1 of the HMD 21, the field of view of the area 70 </ b> A (hatched area) is blocked, and only the area 70 </ b> B can be seen. In such a case, the operation mode changing unit 16 performs parameter control such as doubling the attack power as a risk return in a game or the like in which the field of view of the user 40 is directly connected to the advantage or disadvantage of the game. In order to notify the user 40 that the operation mode has been changed by the above-described parameter control, the screen generation unit 17 generates a message 64-1 indicating this as shown in FIG. 1 may be displayed.

  Examples of parameters controlled by changing the operation mode include, for example, power-up in an FPS (First Person Shoter), intense acceleration in a racing game, increase in score points in a music game, and the like, but are not limited thereto. It is not something to be done.

  In the present embodiment, the parameter may be controlled so as to obtain a higher return according to the length of time for which the eyes are kept closed. For example, by keeping eyes closed for a long time, a powerful reservoir attack can be executed, but the present invention is not limited to this.

  In the present embodiment, a plurality of players can play the same game at the same time, and the opponent user may close one or both eyes as described above. For example, when the user operating the enemy character 61 shown in FIG. 8 has both eyes closed, the screen generation unit 17 outputs information indicating that the operation mode has been changed and information indicating the effect of the change. May be generated and displayed on the screen 50-2.

  Further, in the present embodiment, when detecting the state in which the user 40 has one eye closed, the display control means 16-2 of the operation mode change means 16 changes the mode to a mode in which the state of looking at the partner character is intuitively expressed. .

  For example, as shown in FIG. 9, when the user 40 closes one eye, a parameter display area 80 for displaying parameter information on the character 61 is displayed on the screen 50-3, so that the user can know the opponent's physical strength, attack power, and the like. Can be. Similarly, the display control unit 16-2 may change to a special video mode, such as thermography display or perspective display, or may display a character that is not normally visible. In addition, the display control unit 16-2 may change to a mode in which the display is partially enlarged for use with a sniper rifle.

  In the present embodiment, the operation mode changing means 16 may change the contents of the mode according to which of the left and right eyes is closed. Which mode is to be changed when either the left or right eye is closed may be set in advance by the setting unit 12.

  Further, when detecting that the user 40 has both eyes closed, the display control unit 16-2 may change the operation mode to an operation mode that expresses sharpening or resting. In this case, the display control unit 16-2 may generate a message such as “resting” and display the message on the screen 50. When the parameter control unit 16-1 detects that the user 40 has closed both eyes, the parameter control unit 16-1 may consider that the user has taken a rest and perform parameter control such as giving a recovery bonus such as physical strength. In the present embodiment, as shown in the above-described example, one or both of the display control and the parameter control can be simultaneously performed according to the state in which the user has closed their eyes. That is, in the present embodiment, among a plurality of preset display controls and a plurality of parameter controls, one control or a combination of a plurality of controls can be performed.

  When detecting that the user 40 has closed both eyes, the operation mode changing means 16 may change the mode so as to enhance the sound expression and to hear useful sound information that cannot be normally heard. As an example of the sound expression, for example, the voice of the heart of the character operated by the user (for example, “I get hurt after being attacked”) is output as a voice, or the other character is thinking (for example, “Cute”). Etc.) is output as a voice, but the present invention is not limited to this.

  When detecting that the user 40 has both eyes closed, the operation mode change unit 16 may change the operation mode to an operation mode that expresses a light attack or the like. For example, when the user 40 has both eyes closed, it is possible to defend against a blinding attack by intense light, or to protect against a character that damages by petrifying an opponent who looks like a Medusa in Greek mythology. Etc. can be performed.

  Further, in the present embodiment, upon detecting that the user 40 has closed his / her eyes, the display control unit 16-2 may perform a rendering process to reduce the load in screen generation. For example, when the display control unit 16-2 of the operation mode changing unit 16 detects that the user has closed the right eye or the left eye, the display control unit 16-2 displays a dummy image created with a low load on the side with the eyes closed. Normally, even when a person is closed, the light transmitted through the eyelids by external light is recognized unconsciously. Therefore, it is preferable to display "a somewhat correct image".

  For example, when one eye is closed as a dummy image, the display control unit 16-2 simply copies the image with the opened eye and uses it for the person with the closed eyes. As a result, the drawing load can be reduced by half. Further, the display control means 16-2 may perform control so that the original video is drawn at a low resolution and used.

  For example, the example of FIG. 10 illustrates an example of an image displayed on each of the right and left eyes. FIG. 10A shows a display image 90-1 for the left eye, and FIG. 10B shows a display image 90-2 for the right eye.

  For example, when detecting that the user 40 has closed the left eye, the display control unit 16-2 simply converts the display image 90-2 for the right eye into the image for the left eye as described above with respect to the display image 90-1. Copy and use. Further, the display control unit 16-2 can reduce the drawing load by 5 to 30% by setting the display image 90-2 to a resolution lower than the normal resolution.

  In addition, the display control unit 16-2 may display the image on the side where the eyes are closed in a blurred manner. By using the blurred image, switching when returning to normal processing after opening the eyes can be eased. For example, when the display control unit 16-2 detects that the eyes have been opened from the closed state, the display control unit 16-2 switches the display to “blur + original video”. Further, the display control unit 16-2 gradually returns to the original image of both eyes in about 0.5 to 2 seconds by gradually weakening the blur every time elapses.

  As described above, it is effective to display a “correct image to some extent” even for closed eyes, but the original image is greatly disturbed when light passes through the eyelids, so No effect. Originally, if the human eye closes and opens one eye for a certain period of time, it takes a certain amount of time until the image can be correctly recognized, so there is no problem if it is possible to return to the conventional processing in that time.

  In addition, as described above, when one eye is closed, there is a case where the expression is switched to a high-quality expression that is a factor that raises a rendering load such as a thermographic expression. The load at the time of screen generation can be reduced.

<Summary>
As described above, according to the present invention, it is possible to appropriately control a virtual space using information obtained from an information display device. Therefore, for example, various effects and effects for the game being executed by the user can be provided to the user. The types of games in each of the above-described embodiments can be applied to various games such as a racing game, a shooting game, a fighting game, an airplane simulator, and a love game. The operation control processing according to the present embodiment can be applied to an application (program) that does not belong to the game category.

  Although the preferred embodiments of the present invention have been described in detail, the present invention is not limited to the specific embodiments, and various modifications and changes can be made within the scope of the present invention described in the appended claims. Changes are possible. Moreover, it is also possible to combine some or all of the embodiments described above.

DESCRIPTION OF SYMBOLS 10 Information processing apparatus 11 Communication means 12 Setting means 13 Storage means 14 Eye open / close detection means 15 Judgment means 16 Operation mode change means 17 Screen generation means 18 Control means 21 HMD (an example of information display means)
22 Controller (an example of operation means)
Reference Signs List 31 input device 32 output device 33 drive device 34 auxiliary storage device 35 main storage device 36 CPU
37 Communication control device 38 Recording medium 40 User 50 Screen 60 Virtual space 61-63 Object 64 Message 70 Area 80 Parameter display area 90 Display image

Claims (7)

An information processing device that controls a screen displayed on an information display device worn on a user's head,
Eye opening and closing detection means for detecting opening and closing of the eyes of the user wearing the information display device,
An operation mode changing unit configured to change an operation mode of the object displayed on the screen or the screen when the user detects that the user closes one or both eyes by the eye open / close detection unit. Processing equipment. The operation mode changing means includes:
When the eye opening / closing detection means detects that the user has closed only one eye, the operation mode is changed to an operation mode in which a parameter in a game relating to an enemy character displayed on a screen is displayed in association with the enemy character. Do
The information processing device according to claim 1. The operation mode changing means includes:
When the eye opening / closing detecting means detects that the user has closed both eyes, the operation mode is changed to an operation mode in which at least one of the character operated by the user and the opponent character outputs a sound considered in the game. Do
The information processing apparatus according to claim 1. The operation mode changing means includes:
Mitigating a light attack in a game against a character operated by the user when the eye open / close detection unit detects that the user has closed both eyes;
The information processing device according to claim 1. The operation mode changing means includes:
When the user detects that the user has closed both eyes by the eye open / close detection means, recovers physical strength of the character operated by the user in a game.
The information processing apparatus according to claim 1. An information processing device that controls a screen displayed on an information display device worn on a user's head,
Processing for detecting the opening and closing of the eyes of the user wearing the information display device;
An information processing method for executing, when detecting that the user has closed one or both eyes, a process of changing an object displayed on the screen or an operation mode for the screen. On the computer,
An information processing device that controls a screen displayed on an information display device worn on a user's head,
Processing for detecting the opening and closing of the eyes of the user wearing the information display device;
A process for changing an operation mode of the object displayed on the screen or the screen when the user detects that one or both eyes are closed.

Images