JP2017010183A - Electronic apparatus and control method for the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus controlling a display device and realizing a function of an application program free of being limited by specifications of an operating system, and a control method therefor.SOLUTION: A control unit 10 being a unit being connected to a head-mounted image display section 20 and controlling display of the image display section 20 comprises: a key operation section 111 accepting operation; and a control section 140 executing an application program 122 operating on general-purpose OS150 and OS150. The OS150 has a control function executed when the operation section 111 accepts predetermined operation and includes a key code API123 which can be invoked by a function of the application program 122 and limits execution of the control function.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an electronic device and a method for controlling the electronic device.

  Conventionally, various means for operating a head-mounted display device have been proposed (see, for example, Patent Document 1). The device described in Patent Literature 1 operates in response to inputs such as voice input, hand motion detected by a camera, and user head motion.

Special table 2014-503085 gazette

As described in Patent Document 1, functions executed in response to input include a function executed by the operating system of the apparatus and a function executed by an application program. Normally, an application program uses a service provided by the operating system. Therefore, when the operating system executes a function corresponding to an input, the application program does not execute a different function corresponding to the same input. For this reason, there has been no example where the application program realizes an operation that deviates from the operating system specification.
The present invention has been made in view of the above circumstances, and an object of the present invention is to realize a function of an application program that is not restricted by operating system specifications by controlling a display device.

In order to achieve the above object, the present invention is an electronic device that is connected to a head-mounted display device and controls display of the display device, an operation unit that receives an operation, a general-purpose operating system, A control unit that executes an application program that operates on the operating system, the operating system having a control function that is executed when the operation unit receives a predetermined operation, It includes a program module that can be called by a function and restricts execution of the control function.
According to the present invention, the operation executed by the operating system when a predetermined operation is accepted can be limited by the function of the application program. For this reason, restrictions on operating system specifications regarding the function of the application program can be relaxed.

According to the present invention, the electronic device further includes a display control unit that controls the display device to display an image, and the control unit controls the display control unit during execution of the application program by the control function. A screen for the operating system is displayed.
According to the present invention, an application program can limit the function of displaying an operating system screen in response to a predetermined operation. As a result, it is possible to avoid a situation in which the screen for the operating system is displayed during execution of the application program, and the application program can control the display content of the head-mounted display device.

According to the present invention, in the electronic device, the control unit displays an initial screen of the operating system by the control function.
According to the present invention, the application program can limit the function of displaying the initial screen of the operating system in response to a predetermined operation.

According to the present invention, in the electronic device, the initial screen is a screen displayed by the display control unit after the operating system is started and before the application program is executed.
According to the present invention, the application program can limit the function of displaying the initial screen of the operating system that is displayed before executing the application program in response to a predetermined operation. Thereby, during execution of the application program, the application program can be controlled so that the display content does not return to the screen before the execution of the application program.

According to the present invention, in the electronic device, the operation unit includes an operation area or an operation element for the control function.
According to the present invention, the function executed by the operating system in response to the operation of a specific operation area or operator can be limited by the function of the application program.

According to the present invention, in the electronic device, the control unit executes the control function when the operation unit receives a predetermined operation after the application program is stopped during the execution of the operating system. It is characterized by this.
According to the present invention, it is possible to release the restriction on the function of the operating system by stopping the application program.

In the electronic device, the operation unit may be configured to accept a plurality of operations, and the control unit may execute a plurality of the control functions corresponding to the operation of the operation unit. When executing the program module, the execution of at least one of the plurality of control functions is restricted.
According to the present invention, in a configuration in which an operating system can execute a plurality of functions corresponding to a plurality of operations, a part or all of the functions can be limited by the function of the application program.

In order to achieve the above object, the present invention is an electronic device that is connected to a head-mounted display device and controls the display of the display device, and operates on a general-purpose operating system and the operating system. A control unit that executes an application program, the control unit recognizes the first operation, the second operation, and the third operation, executes a process corresponding to the recognized operation, Corresponding to the first operation, at least one of the all-restricted state in which the second and third operations are disabled and the second and third operations are disabled during the execution of the application program. It is possible to shift to an individual restriction state and a restriction release state that recognizes the second and third operations, respectively.
According to the present invention, it is possible to alleviate restrictions on operating system specifications and appropriately set a response to an operation when an application program is executed.

The present invention further includes a storage unit that stores invalid setting data for setting an invalid operation in the individual restriction state in the electronic device, and the control unit stores in the storage unit in the individual restriction state. In accordance with the invalid setting data, at least one of the second and third operations is invalidated.
According to the present invention, it is possible to set a state in which an operation is invalidated by invalid setting data.

According to the present invention, in the electronic device, the control unit shifts to the restriction release state when the control unit recognizes the first operation in the full restriction state or the individual restriction state.
According to the present invention, a state in which an operation is invalid can be quickly released.

Further, in the electronic device according to the aspect of the invention, when the control unit recognizes the first operation after transitioning from the full restriction state or the individual restriction state to the restriction release state, the full restriction state and It shifts to the state set up beforehand among the individual restriction states, It is characterized by the above-mentioned.
According to the present invention, the state when the restriction is released from the state in which the operation is invalid can be set according to the specification of the application program.

According to the present invention, in the electronic device, the control unit is capable of recognizing the second and third operations by displaying the predetermined home screen after the operating system has finished executing the application program. It is characterized by moving to.
According to the present invention, when the execution of the application program is finished, the function for the operation can be executed by the operating system.

In the electronic apparatus, the storage unit stores home setting data for setting a function to be executed by the control unit in response to an operation recognized in a state where the home screen is displayed. When the first operation is recognized in a state where the home screen is displayed, the unit executes a function set by the home setting data.
According to the present invention, it is possible to set a function to be executed in response to an operation when the execution of an application program is terminated.

In the electronic device, the control unit is set in the home setting data when the controller recognizes one of the second and third operations in a state where the home screen is displayed. Performing the function.
According to the present invention, it is possible to set a function to be executed in response to an operation when the execution of an application program is terminated.

According to the present invention, in the electronic device, a function that is executed when the control unit recognizes any of the first, second, and third operations in a state in which the home screen is displayed is set by default. When the control unit recognizes any of the first, second, and third operations in the state where the home screen is displayed, the control unit is set with the function set by the home setting data and the default. Among the functions, a preselected function is executed.
According to the present invention, when execution of an application program is terminated, a function to be executed in response to an operation can be selected from a default function and a set function.

According to the present invention, the electronic device further includes an operation unit having a first operation element, a second operation element, and a third operation element, and the control unit operates the first operation element. The first operation is recognized, the second operation is recognized when the second operation element is operated, and the third operation is performed when the third operation element is operated. It is characterized by recognizing.
According to the present invention, it is possible to easily switch restrictions on the operations of the second and third operators in response to the operation of the first operator.
Here, the first operation element, the second operation element, and the third operation element included in the operation unit may be an operation element having a movable part, or a movable touch pad or the like that detects a contact operation. It may be an operator having no part, or may be configured to detect an operation by non-contact.

The present invention further includes an operation unit including an operation unit capable of performing an operation corresponding to each of the second operation and the third operation in the electronic apparatus, and the control unit is configured to perform the operation on the operation unit. Recognizing each of the first and second operations.
According to the present invention, different types of operations on one operator can be individually restricted.
Here, the operation element provided in the operation unit may be an operation element having a movable part, or may be an operation element having no movable part such as a touch pad for detecting a contact operation. The structure which detects this may be sufficient.

The present invention also relates to a method for controlling an electronic device that is connected to a head-mounted display device and controls display on the display device, and includes a general-purpose operating system and an application program that operates on the operating system. When the operating unit accepts a predetermined operation, the operating system executes a predetermined control function, and when the predetermined program module is called by the function of the application program, the predetermined control function is executed. It is characterized by restricting execution of functions.
According to the present invention, the operation executed by the operating system when a predetermined operation is accepted can be limited by the function of the application program. For this reason, restrictions on operating system specifications regarding the function of the application program can be relaxed.

The present invention is connected to a head-mounted display device, recognizes the first operation, the second operation, and the third operation, and controls the display device in response to the recognized operation. A method for controlling an electronic device, which executes a general-purpose operating system and an application program that runs on the operating system, and corresponds to the first operation, the second operation and the third operation Recognizing all restricted states in which operations are invalidated, individual restricted states in which at least one of the second and third operations is invalidated during execution of the application program, and the second and third operations, respectively. It shifts to a restriction cancellation | release state, It is characterized by the above-mentioned.
According to the present invention, it is possible to relax the restrictions on the specifications of the operating system and set the response to the operation when the application program is executed.

The present invention is also provided when a computer connected to a head-mounted display device and controlling the display of the display device executes a general-purpose operating system and an application program that operates on the operating system. The computer recognizes the first operation, the second operation, and the third operation, executes a process corresponding to the recognized operation, and corresponds to the first operation. An all-restricted state in which the second and third operations are invalidated, an individual restricted state in which at least one of the second and third operations is invalidated during execution of the application program, and the first It can be realized as a program or program module that functions as a control unit that can be shifted to the restriction release state that recognizes the second and third operations, respectively. That.
According to the present invention, it is possible to relax the restrictions on the specifications of the operating system and set the response to the operation when the application program is executed.
The present invention can also be realized as a recording medium on which the program is recorded.

Explanatory drawing which shows the external appearance structure of the head mounted display apparatus in 1st Embodiment. The functional block diagram of each part which comprises a head mounting | wearing type display apparatus. The figure which shows the example of a setting of a key code. The flowchart which shows operation | movement of the head mounted display apparatus of 1st Embodiment. The functional block diagram of each part which comprises the head mounted display apparatus of 2nd Embodiment. The external view of the control apparatus of 2nd Embodiment. The figure which shows the example of the setting regarding the key code and lock state of 2nd Embodiment. Explanatory drawing which shows the transition of the operation state of the head mounted display apparatus of 2nd Embodiment. The flowchart which shows operation | movement of the head mounted display apparatus of 2nd Embodiment. The flowchart which shows operation | movement of the head mounted display apparatus of 2nd Embodiment.

[First Embodiment]
FIG. 1 is an explanatory diagram showing an external configuration of a head-mounted display device 100 according to the first embodiment to which the present invention is applied.
The head-mounted display device 100 includes an image display unit 20 (display device) that allows a user to visually recognize a virtual image while being mounted on the user's head, and a control device 10 (electronic device) that controls the image display unit 20. ) And. The control device 10 also functions as a controller for the user to operate the head mounted display device 100. In FIG. 1, a side view of the control device 10 is shown together with the front surface of the control device 10.

  The image display unit 20 is a wearing body that is worn on the user's head, and has a glasses shape in the present embodiment. The image display unit 20 includes a right holding unit 21, a right display driving unit 22, a left holding unit 23, a left display driving unit 24, a right optical image display unit 26, a left optical image display unit 28, and a camera 61. And a microphone 63. The right optical image display unit 26 and the left optical image display unit 28 are arranged so as to be positioned in front of the right and left eyes of the user when the user wears the image display unit 20, respectively. One end of the right optical image display unit 26 and one end of the left optical image display unit 28 are connected to each other at a position corresponding to the eyebrow of the user when the user wears the image display unit 20.

  The right holding unit 21 extends from the end ER which is the other end of the right optical image display unit 26 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member. Similarly, the left holding unit 23 extends from the end EL which is the other end of the left optical image display unit 28 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member provided. The right holding unit 21 and the left holding unit 23 hold the image display unit 20 on the user's head like a temple of glasses.

  The right display drive unit 22 and the left display drive unit 24 are disposed on the side facing the user's head when the user wears the image display unit 20. The right display drive unit 22 and the left display drive unit 24 are collectively referred to simply as “display drive unit”, and the right optical image display unit 26 and the left optical image display unit 28 are simply referred to as “optical image display unit”. Also called.

The display driving units 22 and 24 include liquid crystal displays 241 and 242 (Liquid Crystal Display, hereinafter referred to as “LCDs 241 and 242”), projection optical systems 251 and 252, and the like.
The right optical image display unit 26 and the left optical image display unit 28 include light guide plates 261 and 262 (FIG. 2) and a light control plate 20A. The light guide plates 261 and 262 are formed of a light transmissive resin or the like, and guide the image light output from the display driving units 22 and 24 to the user's eyes. The light control plate 20A is a thin plate-like optical element, and is disposed so as to cover the front side of the image display unit 20 which is the side opposite to the user's eye side. As the light control plate 20A, various materials such as a material that has almost no light transmission, a material that is nearly transparent, a material that attenuates the amount of light and transmits light, and a material that attenuates or reflects light of a specific wavelength may be used. it can. By appropriately selecting the optical characteristics (light transmittance, etc.) of the light control plate 20A, the external light amount incident on the right optical image display unit 26 and the left optical image display unit 28 from the outside is adjusted to visually recognize the virtual image. You can adjust the ease. In the present embodiment, a case will be described in which at least a light control plate 20A having such a light transmittance that a user wearing the head-mounted display device 100 can visually recognize an outside scene is used. The light control plate 20A protects the right light guide plate 261 and the left light guide plate 262, and suppresses damage to the right light guide plate 261 and the left light guide plate 262, adhesion of dirt, and the like.
The dimming plate 20A may be detachable from the right optical image display unit 26 and the left optical image display unit 28, or may be mounted by replacing a plurality of types of dimming plates 20A, or may be omitted. .
Then, the head-mounted display device 100 causes the image light of the image to be processed inside and the external light to overlap and enter the user's eyes, and the user can see the outside scene through the dimming plate 20A, An image of image light is visually recognized over the outside scene. Thus, the head-mounted display device 100 functions as a see-through display device.

The camera 61 is disposed at the boundary between the right optical image display unit 26 and the left optical image display unit 28. In a state where the user wears the image display unit 20, the position of the camera 61 is substantially in the middle of both eyes of the user in the horizontal direction and above the eyes of the user in the vertical direction. The camera 61 is a digital camera that includes an imaging element such as a CCD or CMOS, an imaging lens, and the like, and may be a monocular camera or a stereo camera.
The camera 61 images at least a part of the outside view in the front side direction of the head-mounted display device 100, in other words, the user's view direction when the head-mounted display device 100 is mounted. The width of the angle of view of the camera 61 can be set as appropriate, but the imaging range of the camera 61 is a range that includes the outside world visually recognized by the user through the right optical image display unit 26 and the left optical image display unit 28. preferable. Furthermore, it is more preferable that the imaging range of the camera 61 is set so that the entire field of view of the user through the light control plate 20A can be imaged.
The camera 61 executes imaging according to the control of the control unit 140 (FIG. 2), and outputs captured image data to the control unit 140.

  The image display unit 20 is connected to the control device 10 via the connection unit 40. The connection unit 40 includes a main body cord 48, a right cord 42, a left cord 44, and a connecting member 46 that are connected to the control device 10. The right cord 42 and the left cord 44 are codes in which the main body cord 48 is branched into two. The right cord 42 is inserted into the housing of the right holding unit 21 from the distal end AP in the extending direction of the right holding unit 21 and is connected to the right display driving unit 22. Similarly, the left cord 44 is inserted into the housing of the left holding unit 23 from the distal end AP in the extending direction of the left holding unit 23 and connected to the left display driving unit 24.

  The connecting member 46 is provided at a branch point between the main body cord 48, the right cord 42 and the left cord 44, and has a jack for connecting the earphone plug 30. A right earphone 32 and a left earphone 34 extend from the earphone plug 30. A microphone 63 is provided in the vicinity of the earphone plug 30. The earphone plug 30 to the microphone 63 are combined into one cord, and the cord branches from the microphone 63 and is connected to each of the right earphone 32 and the left earphone 34.

  For example, as shown in FIG. 1, the microphone 63 is arranged so that the sound collection unit of the microphone 63 faces the user's line of sight, collects sound, and sends the sound signal to the sound processing unit 187 (FIG. 3). Output. For example, the microphone 63 may be a monaural microphone or a stereo microphone, may be a directional microphone, or may be an omnidirectional microphone.

  The right cord 42, the left cord 44, and the main body cord 48 only need to be capable of transmitting digital data, and can be constituted by, for example, a metal cable or an optical fiber. Further, the right cord 42 and the left cord 44 may be combined into a single cord.

  The image display unit 20 and the control device 10 transmit various signals via the connection unit 40. The end of the main body cord 48 opposite to the connecting member 46 and the control device 10 are provided with connectors (not shown) that fit together. By fitting the connector of the main body cord 48 and the connector of the control device 10 or removing this fitting, the control device 10 and the image display unit 20 can be contacted and separated.

  The control device 10 controls the head-mounted display device 100. The control device 10 has a substantially box-shaped control device main body 11, and the control device main body 11 accommodates each part including the control unit 140 (FIG. 2). A connector 14 for connecting a body cord 48 is provided at the base end portion of the control device body 11.

  A key operation unit 16 (operation unit) having a plurality of key switches is provided on the upper surface 11 a of the control device main body 11. The key operation unit 16 includes a power button 301 for switching on / off the power of the head-mounted display device 100 and a lock button 302 for switching lock / release of some operations of the key operation unit 16. The power button 301 and the lock button 302 are operators related to basic operations of the control device 10.

  The key operation unit 16 includes a volume up key 311 and a volume down key 312 for volume adjustment, three function keys 331, 332, and 333 that can be assigned functions, and a direction key unit 320. The direction key unit 320 includes four direction keys 321, 322, 323, and 324 corresponding to up, down, left, and right, and an enter key 325 arranged in the center. These are mainly operating elements used by the user during execution of an operating system (OS) 150 or an application program to be described later.

  Further, a menu button 341, a home button 342, and a “return” button 343 are arranged side by side on the base end side of the key operation unit 16. These menu button 341, home button 342, and “return” button 343 are operators for executing basic functions of the OS 150.

  Further, a reset button 350 is disposed on the side surface 11 b of the control device main body 11. The reset button 350 is an operator for resetting the operation of the head-mounted display device 100. When the reset button 350 is operated, the process being executed by the control device 10 is forcibly stopped, and the control device 10 returns to the initial state. In this process, the image display unit 20 controlled by the control device 10 is also initialized.

  Each operation element included in the key operation unit 16 may be configured as a hardware switch such as a tactile switch or a push button switch. Moreover, you may comprise with the touch-type switch which combined the detection part (not shown) which detects a touch operation, and the display part (not shown) which displays the position of an operation element. Here, the reset button 350 is preferably a hardware switch in order to prevent erroneous operation. For example, a hole can be provided in the side surface 11b, and a reset button 350 formed of a tactile switch can be arranged at the bottom of the hole, and can be operated only by a pin or the like passing through the hole in the side surface 11b.

  In addition, the control device 10 includes a lighting unit 12. The lighting unit 12 includes a light source such as an LED (Light Emitting Diode), and notifies the operating state (for example, power ON / OFF) of the head-mounted display device 100 according to the lighting state of the light source.

FIG. 2 is a functional block diagram of each part constituting the head-mounted display device 100.
The head-mounted display device 100 includes an interface 125 for connecting various external devices OA that are content supply sources. As the interface 125, for example, an interface corresponding to wired connection such as a USB interface, a micro USB interface, a memory card interface, or the like may be used, and the interface 125 may be configured by a wireless communication interface. The external device OA is an image supply device that supplies an image to the head-mounted display device 100, and a personal computer (PC), a mobile phone terminal, a portable game machine, or the like is used.

The control device 10 includes a control unit 140, an input information acquisition unit 110, a storage unit 120, a transmission unit (Tx) 51, and a transmission unit (Tx) 52.
The input information acquisition unit 110 is connected to the operation unit 111. The operation unit 111 is connected to each operation unit of the key operation unit 16 provided in the control device 10, detects the operation of each operation unit, and sends an operation signal corresponding to the detected operation unit to the input information acquisition unit 110. Output. The input information acquisition unit 110 acquires the input content input by the operation of the control device 10 based on the signal input from the operation unit 111.

The storage unit 120 is a nonvolatile storage device, and stores various computer programs and data related to these programs. The storage unit 120 may store still image data or moving image data to be displayed on the image display unit 20.
The control device 10 includes a power supply unit 130 including a primary battery and a secondary battery, and supplies power from the power supply unit 130 to each unit of the control device 10 and the image display unit 20.

  A three-axis sensor 113, a voice recognition unit 114, a GPS 115, and a communication unit 117 are connected to the control unit 140. The triaxial sensor 113 is a triaxial acceleration sensor, and the control unit 140 acquires the detection value of the triaxial sensor 113. The GPS 115 includes an antenna (not shown), receives a GPS (Global Positioning System) signal, and calculates the current position of the control device 10. The GPS 115 outputs the current position and the current time obtained based on the GPS signal to the control unit 140. The GPS 115 may have a function of acquiring the current time based on information included in the GPS signal and correcting the time counted by the control unit 140.

The communication unit 117 executes wireless data communication conforming to a standard such as a wireless LAN (WiFi (registered trademark)), Miracast (registered trademark), or Bluetooth (registered trademark).
When the external device OA is wirelessly connected to the communication unit 117, the control unit 140 acquires content data from the communication unit 117 and causes the image display unit 20 to display an image. On the other hand, when the external device OA is wired to the interface 125, the control unit 140 acquires content data from the interface 125 and causes the image display unit 20 to display an image. The communication unit 117 and the interface 125 function as a data acquisition unit DA that acquires content data from the external device OA.

The control unit 140 stores a CPU (not shown) for executing a program, a RAM (not shown) for temporarily storing a program and data executed by the CPU, and a basic control program and data executed by the CPU in a nonvolatile manner. ROM (not shown).
The control unit 140 reads out and executes the computer program stored in the storage unit 120, whereby the OS 150, the image processing unit 160, the display control unit 170, the imaging processing unit 181, the image analysis unit 182, the function execution unit 183, and It functions as an audio processing unit 187.

The storage unit 120 stores an operating system 121, an application program 122, and a key code API 123.
The operating system 121 includes an execution file of a program executed by the CPU of the control unit 140, data processed by this program, and the like. The operating system 121 is configured by a file group including a plurality of files such as an execution file and screen display data, for example. The CPU of the control unit 140 reads out and executes the operating system 121 from the storage unit 120 and realizes the function of the OS 150. The operating system 121 is a general-purpose operating system. In this type of operating system, for example, Windows (registered trademark), iOS (registered trademark), Android (registered trademark), Mac OS (registered trademark), Linux (registered trademark), Unix (registered trademark), Tron (registered trademark). ) And the like. These general-purpose operating systems may be partially modified for use in the head-mounted display device 100.

The application program 122 includes an execution file of a program executed by the CPU of the control unit 140, data processed by this program, and the like. For example, it is composed of a file group including a plurality of files such as an execution file and screen display data. The CPU of the control unit 140 reads the application program 122 from the storage unit 120 and executes it, so that the imaging processing unit 181, the image analysis unit 182, the function execution unit 183, the audio processing unit 187, and the like realize the function of the application program. To do.
The application program 122 may include a plurality of program modules that are recognized by the user as a plurality of application programs.

  The key code API 123 is a program module that can be called by the function of the application program while the CPU of the control unit 140 is executing the application program 122. When the CPU of the control unit 140 executes the key code API 123, it is possible to control the assignment of functions to the operators provided in the key operation unit 16 (FIG. 1) and the lock state of the operation of the operators. In the present embodiment, for convenience of understanding, the operating system 121 and the application program 122 are illustrated as different configurations. When the control unit 140 executes the key code API 123, the key code API 123 operates as a part of the OS 150 being executed. In other words, the key code API 123 is included in the OS 150.

The control unit 140 displays the home screen by the function of the OS 150. The home screen is an initial screen during execution of the OS 150, and the OS 150 controls and displays the image processing unit 160 and the display control unit 170. While the home screen is displayed, it is possible to instruct selection of the application program 122, activation (execution) of the application program 122, and termination of the application program 122 by operating the key operation unit 16. In addition, settings related to the application program 122 and the OS 150 can be performed on the home screen.
When the control unit 140 executes the application program 122, the function execution unit 183 executes the function of the application program. The function execution unit 183 controls the image processing unit 160 and the display control unit 170 to display a screen for application programs. The function execution unit 183 executes, for example, AR display by the function of the application program. In this case, the function execution unit 183 controls the camera 61 by the imaging processing unit 181 to execute imaging, analyzes the captured image data by the image analysis unit 182 to recognize the target, and sets the position of the recognized target. In addition, the content text and images are displayed. The screen displayed by the function execution unit 183 is, for example, a screen in which information related to application programs such as content is arranged in the entire displayable area of the image display unit 20. In this case, the visibility of the content can be improved, and the user can feel the immersive feeling peculiar to the head-mounted display device. Further, the screen displayed by the function execution unit 183 can be displayed in the entire displayable area so as to hide a screen related to the function of the OS 150 (for example, a home screen). For this reason, during the execution of the application program 122, the user's awareness can be directed to the operation and operation of the application program 122 without making the user feel the type or presence of the OS 150.

The image processing unit 160 acquires an image signal included in the content. The image processing unit 160 separates synchronization signals such as the vertical synchronization signal VSync and the horizontal synchronization signal HSync from the acquired image signal. Further, the image processing unit 160 generates a clock signal PCLK using a PLL (Phase Locked Loop) circuit or the like (not shown) according to the period of the separated vertical synchronization signal VSync and horizontal synchronization signal HSync. The image processing unit 160 converts the analog image signal from which the synchronization signal is separated into a digital image signal using an A / D conversion circuit or the like (not shown). The image processing unit 160 stores the converted digital image signal in the RAM of the control unit 140 for each frame as image data of the target image (Data in the figure). This image data is, for example, RGB data.
Note that the image processing unit 160 may perform a resolution conversion process for converting the resolution of the image data into a resolution suitable for the right display driving unit 22 and the left display driving unit 24 as necessary. The image processing unit 160 also performs image adjustment processing for adjusting the brightness and saturation of image data, 2D image data is created from 3D image data, or 2D / 3D conversion processing is performed to generate 3D image data from 2D image data. May be executed.

  The image processing unit 160 transmits the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the image data Data stored in the RAM via the transmission units 51 and 52, respectively. The transmission units 51 and 52 function as a transceiver and execute serial transmission between the control device 10 and the image display unit 20. The image data Data transmitted via the transmission unit 51 is referred to as “right eye image data”, and the image data Data transmitted via the transmission unit 52 is referred to as “left eye image data”.

  The display control unit 170 generates a control signal for controlling the right display drive unit 22 and the left display drive unit 24, and generates and generates image light by each of the right display drive unit 22 and the left display drive unit 24 based on the control signal. Control injection. Specifically, the right LCD 241 is controlled to be turned on / off by the right LCD control unit 211, and the right backlight 221 is turned on / off by the right backlight control unit 201. In addition, the display control unit 170 controls the driving of the left LCD 242 by the left LCD control unit 212 and the driving of the left backlight 222 by the left backlight control unit 202.

  The audio processing unit 187 acquires an audio signal included in the content, amplifies the acquired audio signal, and outputs the amplified audio signal to the right earphone 32 and the left earphone 34. In addition, the sound processing unit 187 acquires sound collected by the microphone 63 and converts it into digital sound data. The voice processing unit 187 may perform a preset process on the digital voice data.

  The image display unit 20 includes an interface 25, a right display drive unit 22, a left display drive unit 24, a right light guide plate 261 as a right optical image display unit 26, and a left light guide plate 262 as a left optical image display unit 28. A camera 61, a vibration sensor 65, and a nine-axis sensor 66.

  The vibration sensor 65 is configured using an acceleration sensor, and is built in the vicinity of the end ER of the right optical image display unit 26 in the right holding unit 21 as shown in FIG. When the user performs an operation of hitting the end ER (knock operation), the vibration sensor 65 detects vibration caused by this operation and outputs the detection result to the control unit 140. Based on the detection result of the vibration sensor 65, the control unit 140 detects a knocking operation by the user.

  The 9-axis sensor 66 is a motion sensor that detects acceleration (3 axes), angular velocity (3 axes), and geomagnetism (3 axes). When the image display unit 20 is mounted on the user's head, the control unit 140 can detect the movement of the user's head based on the detection value of the 9-axis sensor 66. For example, the control unit 140 can estimate the magnitude of the tilt and the tilt direction of the image display unit 20 based on the detection value of the 9-axis sensor 66.

The interface 25 includes a connector to which the right cord 42 and the left cord 44 are connected. The interface 25 outputs the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the image data Data transmitted from the transmission unit 51 to the corresponding reception units (Rx) 53 and 54. Further, the interface 25 outputs a control signal transmitted from the display control unit 170 to the corresponding reception units 53 and 54, the right backlight control unit 201, or the left backlight control unit 202.
The interface 25 is an interface for connecting the camera 61, the vibration sensor 65, and the 9-axis sensor 66. The detection result of vibration by the vibration sensor 65 and the detection result of acceleration (three axes), angular velocity (three axes), and geomagnetism (three axes) by the nine-axis sensor 66 are sent to the control unit 140 via the interface 25.

  The right display drive unit 22 includes the right backlight 221, the right LCD 241, and the right projection optical system 251 described above. The right display driving unit 22 includes a receiving unit 53, a right backlight (BL) control unit 201 that controls the right backlight (BL) 221, and a right LCD control unit 211 that drives the right LCD 241.

  The reception unit 53 operates as a receiver corresponding to the transmission unit 51 and executes serial transmission between the control device 10 and the image display unit 20. The right backlight control unit 201 drives the right backlight 221 based on the input control signal. The right LCD control unit 211 drives the right LCD 241 based on the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the right eye image data Data input via the reception unit 53. .

  The left display drive unit 24 has the same configuration as the right display drive unit 22. The left display driving unit 24 includes the left backlight 222, the left LCD 242 and the left projection optical system 252 described above. The left display driving unit 24 includes a receiving unit 54, a left backlight control unit 202 that drives the left backlight 222, and a left LCD control unit 212 that drives the left LCD 242.

  The reception unit 54 operates as a receiver corresponding to the transmission unit 52 and executes serial transmission between the control device 10 and the image display unit 20. The left backlight control unit 202 drives the left backlight 222 based on the input control signal. The left LCD control unit 212 drives the left LCD 242 based on the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the right-eye image data Data input via the reception unit 54. . The right backlight control unit 201, the right LCD control unit 211, the right backlight 221 and the right LCD 241 are collectively referred to as a right “image light generation unit”. Similarly, the left backlight control unit 202, the left LCD control unit 212, the left backlight 222, and the left LCD 242 are collectively referred to as a left “image light generation unit”.

FIG. 3 is a diagram illustrating an example of setting a key code by the key code API 123.
In this example, the lock setting is shown for each of the operators (denoted as “Button” in the figure) included in the key operation unit 16. Specifically, each controller's hardware lock setting (shown in the figure as “lock function (HW)”) and software lock setting (in the figure “lock function (SW)” ) ”).
Locking by hardware corresponds to the operation of the lock button 302. As illustrated in FIG. 3, whether or not each operation element is locked when the lock button 302 is switched to the locked state is set. The lock by software corresponds to the operation of the key code API 123. With the function of the application program 122, when the CPU of the control unit 140 calls the key code API 123, whether or not each operator is locked is set as illustrated in FIG.
Further, in FIG. 3, a function assigned to each operator is also set (denoted as “Description” in the figure). The assignment of the function of the operator may be determined by the operating system 121, or the key code API 123 may change or add the assignment determined by the operating system 121.

For example, the power button 301 (denoted as “Power Button” in the figure) is a press operation of 3 seconds or less (short press), a long press of 3 seconds or more and 8 seconds or less, and a long press of 3 seconds or more. Functions are assigned to street operations. Also, hardware lock and software lock can be set for each of the three operations.
In addition, for example, the lock button 302 (indicated as “Key Lock Button” in the figure) has a function for two kinds of operations of a press operation (short press) of 8 seconds or less and a long press exceeding 8 seconds. Assigned. In addition, hardware lock and software lock can be set for each of the two operations.
In addition, in the example of FIG. 3, it is possible to set whether or not to lock the function of calling the key code API 123 and performing the software lock.

In the example of FIG. 3, when the lock is performed by hardware, that is, when the lock button 302 is operated, the operation of almost all the operators is locked. The operations that are not to be locked are the operation of the lock button 302, the long press operation of the power button 301 for more than 8 seconds, the operation of the home button 342, and the operation of the reset button 350.
Even when the lock is performed by software, that is, when the key code API 123 is called and executed, the operation of almost all the operators is locked. The operations that are not to be locked are the short press operation of the lock button 302, the long press operation of the power button 301 for more than 8 seconds, the operation of the home button 342, and the operation of the reset button 350.

  The OS 150 displays the home screen in response to the operation of the home button 342, and no other operation is assigned. The home button 342 can be set to enable or disable the operation.

When the CPU of the control unit 140 reads and executes the key code API 123, the lock by the software in FIG. 3 becomes “locked state”, the home button 342 is invalidated, and the operations of other operators are also locked. When the execution of the key code API 123 is stopped, the lock by software is released, the home button 342 is enabled, and the locks of the other operators are released.
Further, when the lock button 302 is operated, the lock state and release of the lock by hardware are switched. In the setting shown in FIG. 3, if the software lock (denoted as “Software Lock”) when the lock button 302 is operated is locked, the lock of the key code API 123 is disabled while the lock button 302 is locked. It becomes.

  As described above, in the head-mounted display device 100, it is possible to perform a setting for invalidating or locking the operation of each operation element provided in the key operation unit 16, and the CPU of the control unit 140 executes the key code API 123. Ineffective or locked state can be realized. Specific operations that invalidate the operation of the operation element include operations that do not detect the operation of the operation element, and operations that do not detect the operation even if the operation of the operation element is detected. You can also

FIG. 4 is a flowchart showing the operation of the head-mounted display device 100.
When the power of the head-mounted display device 100 is switched from off to on by operating the power button 301, the CPU of the control unit 140 is activated (step S11). The CPU of the control unit 140 executes a basic control program stored in a ROM (not shown) of the control unit 140, and initializes the control unit 140 and peripheral circuits (step S12). The CPU of the control unit 140 reads out and executes the operating system 121 specified by the basic control program from the storage unit 120, starts the operation of the OS 150, and displays the screen for the OS 150 by the image processing unit 160 and the display control unit 170. (Step S13).
Subsequently, the OS 150 initializes each unit of the head-mounted display device 100 controlled by the OS 150 (step S14), and shifts to a state where the functions of the OS 150 and application programs can be executed.

Here, the control unit 140 detects the operation of the operator of the key operation unit 16 (step S15), and waits until the operation is performed (step S15; NO). When any of the operators of the key operation unit 16 is operated (step S15; YES), the function of the OS 150 corresponding to the operated key is executed (step S16).
Here, the control unit 140 determines whether or not the operation detected in step S15 is an operation instructing execution of the application program 122 (step S17). When the operation is an instruction to execute the application program 122 (step S <b>17; YES), the CPU of the control unit 140 executes the application program 122. The function execution unit 183 executes the function of the application program, and causes the image processing unit 160 and the display control unit 170 to display a screen for the application program (step S18). Furthermore, the key code API 123 set to be called in the application program 122 is read from the storage unit 120 and executed (step S19). In step S <b> 19, the key code API 123 locks the operation of the key operation unit 16.

Thereafter, the control unit 140 detects an operation on the operation element of the key operation unit 16 by the function of the input / output driver included in the OS 150 (step S20), and waits until the operation is performed (step S20; NO). When an operation is detected by the function of the OS 150 (step S20; YES), the control unit 140 refers to the setting state by the key code API 123 and determines whether or not the detected operation is a lock target operation (step S21). . When the detected operation is an operation to be locked (step S21; YES), the control unit 140 returns to step S20. When the detected operation is not the operation to be locked (step S21; NO), the control unit 140 determines whether the detected operation is an operation for instructing the end of the execution of the application program 122 (step S22). ). When the operation is not an instruction to end the execution of the application program 122 (step S22; NO), the control unit 140 executes the function of the application program corresponding to the operated operator (key) in the function execution unit 183 ( Step S23). Thereafter, the control unit 140 returns to step S20.
When the detected operation is an operation for instructing the end of the execution of the application program 122 (step S22; YES), the control unit 140 ends the execution of the application program 122. Here, the control unit 140 releases the key code API 123 called by the application program 122 (step S24). Thereby, the lock of the operation of the key operation unit 16 by the software is released. Thereafter, the control unit 140 returns to step S15.

  If the operation detected in step S15 is not an operation that instructs execution of the application program 122 (step S17; NO), the control unit 140 determines whether or not the operation is an instruction to stop the OS 150 (step S25). If the operation is not an instruction to stop the OS 150 (step S25; NO), the control unit 140 executes the function of the OS 150 corresponding to the operated operator (step S26), and returns to step S15. If the operation is an instruction to stop the OS 150 (step S25; YES), the control unit 140 ends the OS 150 (step S27), shuts down the head-mounted display device 100, and ends this process. .

  In the flowchart of FIG. 4, an example of flow control in which the control unit 140 waits for an operation of the key operation unit 16 (steps S <b> 15 and S <b> 20) and advances the processing after detecting the operation of the key operation unit 16 has been described. The operation of the head-mounted display device 100 is not limited to this. When the key operation unit 16 is operated, the input information acquisition unit 110 interrupts the control unit 140, and the control unit 140 performs interrupt control. May be. In this case, the control unit 140 executes processing after step S16 or processing after step S21 by interrupt control.

  As described above, the control device 10 included in the head-mounted display device 100 according to the embodiment to which the present invention is applied is connected to the head-mounted image display unit 20 and controls the display of the image display unit 20. Device. The control device 10 includes a key operation unit 16 that receives an operation and a control unit 140 that executes a general-purpose OS 150 and an application program that operates on the OS 150. The OS 150 has a control function that is executed when the operation unit receives a predetermined operation, and includes a key code API 123 that can be called by a function of an application program and restricts execution of the control function. Therefore, the operation executed by the OS 150 when a predetermined operation is accepted can be limited by the function of the application program. For this reason, restrictions on the specifications of the OS 150 regarding the functions of the application program can be relaxed. For example, even if the home button 342 is operated during the execution of the application program, the OS 150 can be operated so as not to be displayed.

Further, the control device 10 includes a display control unit 170 that controls the image display unit 20 to display an image. The control unit 140 causes the image display unit 20 to display a screen for the OS 150 during execution of the application program by the control function. In addition, the control unit 140 displays a home screen which is an initial screen of the OS 150 by the control function of the OS 150. This home screen is a screen displayed by the image display unit 20 after the OS 150 is started and before the application program is executed. In this way, the application program can limit the function of the OS 150 displaying the home screen. Thereby, during execution of the application program, the application program can be controlled so that the display content does not return to the screen before the execution of the application program.
The key operation unit 16 includes an operation area or an operator for a control function, and the function executed by the OS 150 in response to this operation can be limited by the function of the application program.

In addition, after the application program is stopped during the execution of the OS 150, the control unit 140 can release the key code API 123 and execute the control function when the key operation unit 16 receives a predetermined operation. For this reason, the function restriction of the OS 150 can be released by stopping the application program.
The key operation unit 16 is configured to accept a plurality of operations, and the control unit 140 can execute a plurality of control functions in response to the operation of the operation unit, and a plurality of control functions can be performed when the key code API 123 is executed. Restrict execution of at least one of For this reason, in a configuration in which the OS 150 can execute a plurality of functions corresponding to a plurality of operations, a part or all of the functions can be limited by the function of the application program.

[Second Embodiment]
Next, a second embodiment to which the present invention is applied will be described.
FIG. 5 is a functional block diagram of each part constituting the head-mounted display device 100A according to the second embodiment of the present invention.
The configuration of the head-mounted display device 100A is the same as that of the head-mounted display device 100 described in the first embodiment except for a configuration that includes a control device 13 (electronic device) instead of the control device 10. is there. In the head-mounted display device 100A, components common to the head-mounted display device 100 are denoted by the same reference numerals, and illustration and description thereof are omitted.

  The control device 13 includes an operation unit 112 instead of the operation unit 111 included in the control device 10 (FIG. 2). The operation unit 112 is connected to each operation unit of the key operation unit 17 provided in the control device 13, detects the operation of each operation unit, and sends an operation signal corresponding to the detected operation unit to the input information acquisition unit 110. Output. Based on a signal input from the operation unit 112, the input information acquisition unit 110 acquires input content input by the user operating the control device 13.

FIG. 6 is an external view of the control device 13.
The control device 13 has a substantially box-shaped control device main body 15, and a key operation unit 17 (operation unit) having a plurality of key switches is provided on an upper surface 15 a of the control device main body 15. The key operation unit 17 includes a power button 361 for switching on / off the power of the head-mounted display device 100 </ b> A, and a lock button 362 for switching lock / release of an operator provided in the key operation unit 17. The power button 361 and the lock button 362 are operators related to the basic operation of the control device 13.

  The key operation unit 17 includes a volume up key 363 and a volume down key 364 for volume adjustment, four function keys 371, 372, 373 and 374 to which functions can be assigned, and a direction key unit 375. . The direction key unit 375 includes four direction keys corresponding to up, down, left, and right, and an enter key 376 arranged in the center. These are mainly operating elements operated by the user during execution of an operating system (OS) 150 or an application program described later.

  Further, a reset button (not shown) may be disposed on the side surface of the control device main body 15. Similar to the reset button 350 described above, the reset button can be an operator that resets the operation of the head-mounted display device 100A. For example, like the reset button 350, the reset button of the control device main body 15 can be a hardware switch in order to prevent erroneous operation. Further, a hole can be provided in the side surface of the control device main body 15 and a reset button composed of a tactile switch can be arranged at the bottom of the hole so that it can be operated by a pin or the like passing through the hole in the side surface.

  Each operation element included in the key operation unit 17 may be configured as a hardware switch such as a tactile switch or a push button switch. Moreover, you may comprise with the touch-type switch which combined the detection part (not shown) which detects a touch operation, and the display part (not shown) which displays the position of an operation element.

In the second embodiment, the lock button 362 is an operator that performs an operation for instructing the all-locked state, the individual locked state, and the unlocked state, as will be described later, and corresponds to the first operator, and the lock button 362. This operation corresponds to the first operation. In addition, the volume up key 363, the volume down key 364, the function keys 371, 372, 373, and 374, the direction key unit 375, and the enter key 376 are an operator, a second operator, and a third key of the present invention. Corresponds to the controls. The operations of these operators correspond to the second operation and the third operation. More specifically, it can be said that the operation of the function keys 371, 372, 373, and 374 that can change the assignment of functions to the operators corresponds to the second operation and the third operation of the present invention.
However, as will be described later, the first operation, the second operation, and the third operation of the present invention are not limited to the operation of the key operation unit 17.

In addition, the control device 13 includes LED indicators 381 and 382 that function as a notification unit that indicates the operation state of the head-mounted display device 100A. The LED indicator 381 corresponds to the power button 361 and is turned on when the head-mounted display device 100A is turned on and turned off when the power is turned off. Further, the LED indicator 381 may blink while the head-mounted display device 100A executes the start sequence and / or the end sequence.
The LED indicator 382 is provided corresponding to the lock button 362, and is turned on when the head-mounted display device 100A is in a locked state, and is turned off when the lock is released (limit release state).

As illustrated in FIG. 5, the control device 13 stores an operating system 121, an application program 122, and a key code API 123 in the storage unit 120. These are the same as the control device 10 of the first embodiment. In addition, the control device 13 stores the key setting file 128 and the mode switching API 129 in the storage unit 120.
The key code API 123 is a program module that executes key setting when the control unit 140 executes the application program 122. The key setting file 128 is data for setting function assignment to keys in an operation state in which the head-mounted display device 100A displays a home screen. The home screen is displayed by the control unit 140 by the function of the operating system 121 or the application program 122. That is, the function of displaying the home screen and selecting and starting the application program 122 in response to a user operation on the home screen is provided by the operating system 121 or the application program 122.
The mode switching API 129 is a program module that executes key setting when the control unit 140 executes the application program 122.

  FIG. 7 is an explanatory diagram showing transition of the operation state of the head-mounted display device 100A. FIG. 7A shows a state where the head-mounted display device 100A displays a home screen, and FIG. 7B shows a state where a screen for the application program 122 is displayed. As described above, the control unit 140 may display the home screen by executing the application program 122 having a function of displaying the home screen.

It can be said that the state in which the home screen is displayed is a basic operation state of the head-mounted display device 100A. For example, after the head-mounted display device 100A is powered on, the home screen is displayed before the execution of the application program 122 is started. When the application program 122 is executed in the display state of the home screen, the head-mounted display device 100A shifts to a state in which a screen for the application program 122 is displayed. When the execution of the application program 122 ends, the head-mounted display device 100A shifts to a state in which a home screen is displayed. When the execution of the application program 122 ends, the process ends according to a user operation, the process ends when a preset condition is satisfied, and an error occurs during execution of the application program 122. Including the case of termination.
In addition, when the startup sequence executed when the head-mounted display device 100A is started includes processing for starting execution of the application program 122, the screen displayed after the head-mounted display device 100A is started is This is a screen for the application program 122.

  In a state in which the home screen is displayed, the head-mounted display device 100A can switch between the user mode ST1 and the default mode ST2. In the default mode ST2, the function assignment to each operation element of the key operation unit 17 is the assignment determined by the initial setting (default setting) of the head-mounted display device 100A. On the other hand, the assignment of the function of each operator in the user mode ST1 can be arbitrarily set. The assignment setting in the user mode ST1 is stored in the key setting file 128. That is, by rewriting the key setting file 128, it is possible to change the assignment of the operator functions in the user mode ST1.

  Further, regarding the key assignment during the execution of the application program 122, the head-mounted display device 100A can switch between the user mode ST3 and the default mode ST4. In the default mode ST4, the function assignment to each operation element of the key operation unit 17 is the assignment determined by the initial setting (default setting) for the application program of the head-mounted display device 100A. On the other hand, the assignment of the function of each operator in the user mode ST3 can be arbitrarily set. The assignment in the user mode ST3 is set by the key code API 123. By changing the setting of the key code API 123, it is possible to change the function assignment of the operator in the user mode ST3.

  The key setting file 128 and the key code API 123 may be edited by the user. Further, for example, a vendor operator who supplies and sells the head-mounted display device 100A or a software vendor that provides the application program 122 may edit the key setting file 128 and / or the key code API 123. In this case, editing of the key setting file 128 and / or the key code API 123 by the user may be restricted.

  Selection of the user mode ST3 and the default mode ST4 when the execution of the application program 122 is started in a state where the home screen is displayed is performed by the mode switching API 129. Corresponding to each of the plurality of application programs 122 stored in the storage unit 120, the mode switching API 129 sets an operation mode to be executed. The control unit 140 selects and executes the user mode ST3 or the default mode ST4 by calling the mode switching API 129 when the application program 122 is executed.

  Further, selection of the user mode ST1 and the default mode ST2 when the home screen is displayed is performed according to the setting of the key setting file 128. The key setting file 128 includes setting of operation modes to be selected when the home screen is displayed, in addition to assignment of each operation element of the key operation unit 17.

FIG. 8 is a diagram illustrating an example of setting related to the key code and the lock state in the head-mounted display device 100A.
In this example, the function assigned to each of the operators (indicated as “Button” in the drawing) included in the key operation unit 17 and the setting related to the lock are shown. These assignments are realized by the key code API 123 and the key setting file 128 as described above.

  In the figure, the power button 361 is expressed as “Power Button”, the lock button 362 is expressed as “Key Lock Button”, the volume up key 363 is expressed as “Volume Up”, and the volume down key 364 is expressed as “Volume Down”. . The function keys 371, 372, 373, and 374 are expressed as “Function 1 key” to “Function 4 key”, the direction key portion 375 is expressed as “Cross-Key”, and the enter key 376 is expressed as “Select key”.

  The key assignment in the default mode ST2 of the home screen can be said to be the initial setting of the operating system 121. On the other hand, for the user mode ST1 on the home screen, for example, the function assigned to the function keys 371, 372, 373, and 374 can be changed. In the example of FIG. 8, a function for starting the application program 122 is assigned to a normal pressing operation of the function key 371. In addition, a function of restarting the head-mounted display device 100A is assigned to the long press operation of the function key 371. In user mode ST1, it is good also as a structure which can change assignment with respect to all the operation elements with which the key operation part 17 is provided, However, If the operation element which can change assignment is limited to some operation elements, the malfunction by an incorrect setting Can be prevented.

  Of the key assignments in the default mode ST4 during execution of the application program 122, the setting of functions assigned to the function keys 371, 372, 373, and 374 (“Function 1 key” to “Function 4 key”) can be changed. Functions assigned to the function keys 371, 372, 373, and 374 can be set by a software vendor that provides the application program 122 in accordance with the specifications of the application program 122.

The user mode ST3 during execution of the application program 122 includes a lock state in which an operation recognized by the operation recognition unit 184 is locked.
That is, in the user mode ST3, an unlocked state in which the operation is not locked (restricted state), an all-locked state in which operations other than some operations are locked (all-restricted state), and operations set to be locked are performed. The individual lock state to be locked (individual restriction state) is switched.

  The operation unit 112 is connected to each operation unit of the key operation unit 17 provided in the control device main body 15, detects the operation of each operation unit, and inputs an operation signal corresponding to the detected operation unit to the input information acquisition unit 110. Output to. The input information acquisition unit 110 acquires the input content input by the user's operation based on the signal input from the operation unit 112, and outputs data indicating the input content to the control unit 140.

The control unit 140 includes an operation recognition unit 184 that recognizes an operation.
The operation recognition unit 184 detects and recognizes an input to the head-mounted display device 100A. The operation recognition unit 184 recognizes an operation on the key operation unit 17 based on data input from the input information acquisition unit 110.

The operation recognition unit 184 may detect and recognize an input based on a captured image of the camera 61. In this case, the operation recognition unit 184 extracts the indicator image from the captured image of the camera 61 and detects the position of the indicator image. The indicator is, for example, a user's hand, a pen-shaped device, or a rod-shaped device. The position to be detected may be the tip of the indicator or a set position, or a change in position may be detected.
In this case, the operation recognition unit 184 detects and recognizes a position input operation or a gesture operation based on the position of the indicator.

In the position input operation, for example, the operation recognition unit 184 causes the display control unit 190 to display an input image on the image display unit 20. This corresponds to a so-called virtual keyboard or software keyboard, but the displayed image is not limited to a keyboard shape, and may be an image that can form a GUI (Graphical User Interface) corresponding to one or a plurality of operations. The operation recognition unit 184 recognizes an input by determining an image corresponding to the position of the indicator. Further, when an indicator is detected from the captured image, a GUI image may be displayed in a pop-up manner.
In the gesture operation, the operation recognizing unit 184 detects a gesture input when it is determined that the position, direction, or movement of the indicator detected from the captured image of the camera 61 corresponds to a preset gesture. If a plurality of gestures are set in advance, a plurality of types of operations are possible.
The operation recognizing unit 184 detects a marker reading input when detecting an input marker image such as a two-dimensional code or a bar code from the captured image of the camera 61. In this case, the operation recognizing unit 184 may acquire data by decoding the marker detected from the captured image, and may recognize the data as an input operation. Further, an operation preset in association with the shape, color, and pattern of the marker may be recognized.

The operation recognizing unit 184 detects and recognizes the input of the voice command when the voice processing unit 187 analyzes the voice collected by the microphone 63 and determines that the voice command is set in advance. .
In addition, the operation recognition unit 184 performs a knock operation on the image display unit 20 when a change in the detection value of the 9-axis sensor 66 included in the image display unit 20 corresponds to a change indicating an operation of knocking the image display unit 20. Detect and recognize.

In this way, the operation recognition unit 184 can detect and recognize an operation on the operation element of the key operation unit 17, and the operation of each operation element of the key operation unit 17 can be performed by the first operation, the second operation, It can be assigned to a third operation.
In addition, the operation recognizing unit 184 can assign the operation detected and recognized based on the captured image of the camera 61 to the first operation, the second operation, and the third operation. In this case, the position input operation, the gesture operation, and the operation by the marker reading input may be a first operation, a second operation, or a third operation, respectively. In a configuration in which a plurality of types of operations can be performed using a GUI image by a position input operation, these multiple types of operations are respectively referred to as a first operation, a second operation, or a third operation. Also good. In a configuration in which a plurality of types of gestures can be detected and recognized as gesture operations, the plurality of types of operations may be a first operation, a second operation, or a third operation, respectively. In a configuration capable of detecting and recognizing a plurality of types of input in accordance with the type of marker read in the marker reading input, the plurality of types of inputs may be the first operation, the second operation, or the third operation, respectively. . In addition, the operation recognition unit 184 may recognize the sound collected by the microphone 63 as the first operation, the second operation, or the third operation, and each of the plurality of voice commands may be changed to the first operation. The operation, the second operation, or the third operation may be used. The knocking operation may be the first operation, the second operation, or the third operation.

  The operations detected by the operation recognizing unit 184 can be broadly classified into key operations on the operation elements of the key operation unit 17 and non-key operations detected and recognized by other than the key operation unit 17. The non-key operation is an operation recognized by the operation recognizing unit 184 based on a captured image of the camera 61, a sound collected by the microphone 63, a motion detected by the 9-axis sensor 66 as a motion sensor, and the like.

As described above, in the present embodiment, the operation recognized by the operation recognition unit 184 corresponds to the first operation, the second operation, and the third operation regardless of whether the operation is a key operation or a non-key operation. It is possible to make it.
In particular, when the first operation that instructs switching (transition) of the all-locked state, the individual locked state, and the unlocked state is associated with the key operation, the state related to the lock of other operations can be switched by the key operation. Therefore, the user can perform an intuitive operation. Further, by associating the operation of a specific operator (for example, the lock button 362) of the key operation unit 17 with the first operation, a more intuitive and simple operation is possible. The key operation includes a touch operation when the key operation unit 17 includes a touch panel, and is not limited to an operation of physically moving the operation element. The following effects can be obtained.

  The function execution unit 183 executes a function corresponding to the operation recognized by the operation recognition unit 184. The function execution unit 183 refers to the key setting file 128 when acquiring the function corresponding to the operation recognized by the operation recognition unit 184, or acquires the setting by the key code API 123 and the mode switching API 129.

Control that invalidates the operation in the all lock state and the individual lock state may be performed by any of the input information acquisition unit 110, the function execution unit 183, and the operation recognition unit 184.
For example, the operation recognition unit 184 may determine whether the recognized operation corresponds to a locked operation in the all-locked state and the individual locked state. In this case, when the operation recognizing unit 184 recognizes an operation that does not correspond to the locked operation, the operation recognizing unit 184 passes the recognized operation data to the function executing unit 183 to execute the function. In addition, when it is determined that the recognized operation is a locked operation, a process of not passing operation data to the function execution unit 183 may be performed. The operation detected by the input information acquisition unit 110 may be configured not to output data to the control unit 140 when the input information acquisition unit 110 detects an operation set to be locked (invalid). Further, the operation unit 112 may be configured not to output an operation signal set to lock (invalid) to the input information acquisition unit 110.
As described above, the specific operation that invalidates the operation includes an operation that does not detect the operation, and an operation that detects that the operation is not detected even if the operation is detected, and can also be referred to as prohibition or restriction of the operation.

Further, the function execution unit 183 may determine whether the operation recognized by the operation recognition unit 184 corresponds to a locked operation in the all lock state and the individual lock state. In this case, the function execution unit 183 determines whether or not this operation corresponds to a locked operation when the operation recognition unit 184 receives data that recognizes the operation. When the function execution unit 183 does not correspond to the locked operation, the function execution unit 183 executes a function corresponding to this operation. If it is determined that the operation is locked, the function corresponding to this operation is not executed.
As described above, the main body of the control for invalidating or validating the operation recognized by the operation recognizing unit 184 according to the setting may be the function executing unit 183 or the operation recognizing unit 184. The unit 110 may be used.
In the second embodiment, the key code API 123 corresponds to invalid setting data, and the key setting file 128 corresponds to home setting data.

  In the example of FIG. 8, the assignment in the unlocked state of the user mode ST3 can change the setting of the function assigned to the function keys 371, 372, 373, and 374, and the other operators are the same as in the default mode ST4. . Functions assigned to the function keys 371, 372, 373, and 374 can be set regardless of the setting of the default mode ST4.

In the all lock state of the user mode ST3, all the controls other than the power button 361 and the lock button 362 are set to the lock (“Lock” in the drawing). In the present embodiment, since the function execution unit 183 or the operation recognition unit 184 locks the operation element by a software function, the lock is synonymous with invalidity.
In the individual lock state, whether or not to individually lock the operation recognized by the operation recognition unit 184 can be set. In the example of FIG. 8, in the individual lock state, the controls other than the power button 361, the lock button 362, and the function keys 371, 372, 373, and 374 are locked, and the function keys 371, 372, 373, and 374 can be set individually. It is. This is merely an example, and it may be configured to set whether other operators are individually locked or not. For example, in a configuration in which the all-locked state, the individual locked state, and the unlocked state can be switched by a non-key operation recognized by the operation recognizing unit 184, whether or not to individually lock all the operations in the key operating unit 17 May be set.

  9 and 10 are flowcharts showing the operation of the head-mounted display device 100A. In the operation of FIG. 9, the same step numbers are assigned to the processes common to the operation of FIG. 4 described in the first embodiment. 9 and 10 can be realized by the CPU of the control unit 140 executing a program stored in the storage unit 120, for example.

When the power of the head-mounted display device 100 is switched from OFF to ON by operating the power button 301, the CPU of the control unit 140 is activated (step S11), and the control unit 140 and peripheral circuits are initialized (step S11). S12). The CPU of the control unit 140 reads out and executes the operating system 121 specified by the basic control program from the storage unit 120, starts the operation of the OS 150, and displays the screen for the OS 150 by the image processing unit 160 and the display control unit 170. (Step S13).
Subsequently, the OS 150 initializes each unit of the head-mounted display device 100 controlled by the OS 150 (step S14), and shifts to a state where the functions of the OS 150 and application programs can be executed.

  The control unit 140 refers to the key setting file 128, and acquires selection of the user mode ST1 and the default mode ST2 and setting of function assignment to the operation elements of the key operation unit 17 (step S31). The control unit 140 selects the user mode ST1 or the default mode ST2, assigns functions to the respective operators according to the key setting file 128, and causes the image display unit 20 to display the home screen (step S32).

  Here, the control unit 140 detects the operation (step S15) and waits until the operation is performed (step S15; NO). Of course, in step S15, not only the operation of the key operation unit 17, but also other operations that can be recognized by the operation recognition unit 184 can be detected. When any one of the operators of the key operation unit 17 or other operation is detected and recognized (step S15; YES), the control unit 140 executes the function of the OS 150 corresponding to the operation (step S16).

The control unit 140 determines whether or not the operation detected in step S15 is an operation that instructs execution of the application program 122 (step S17).
If the operation is an operation to instruct execution of the application program 122 (step S17; YES), the control unit 140 reads out the key code API 123 and the mode switching API 129 that are set to be called in the instructed application program 122. Execute (Step S33). In step S33, the control unit 140 selects the user mode ST3 and the default mode ST4 using the mode switching API 129. In step S <b> 33, the control unit 140 assigns a function to the operator using the key code API 123.

The control unit 140 executes the application program 122 and causes the image display unit 20 to display a screen for the application program 122 (step S18).
Thereafter, the control unit 140 detects an operation by the function of the input / output driver included in the OS 150 (step S20), and waits for the operation (step S20; NO). In step S20, not only the operation of the key operation unit 17, but also other operations that can be recognized by the operation recognition unit 184 can be detected.

  When the operation is recognized (step S20; YES), the control unit 140 refers to the setting state by the key code API 123 and determines whether the recognized operation is an operation to be locked (step S21). If it is determined that the operation is to be locked (step S21; YES), the control unit 140 returns to step S20. If it is determined that the operation is not a lock target (step S21; NO), the control unit 140 determines whether the recognized operation is an operation for instructing the end of the execution of the application program 122 (step S22). . When it is determined that the operation is not an instruction to end the execution of the application program 122 (step S22; NO), the control unit 140 executes the function of the application program corresponding to the operation in the function execution unit 183 (step S23). Thereafter, the control unit 140 returns to step S20.

If it is determined that the recognized operation is an operation for instructing the end of the execution of the application program 122 (step S22; YES), the control unit 140 ends the execution of the application program 122.
The control unit 140 releases the key code API 123 and the mode switching API 129 called by the application program 122 (step S24).
The control unit 140 refers to the key setting file 128 to display the home screen, acquires the selection of the user mode ST1 and the default mode ST2, and the setting of the function assignment to the operation element of the key operation unit 17 ( Step S34) and return to Step S32.

  If the operation detected in step S15 is not an operation that instructs execution of the application program 122 (step S17; NO), the control unit 140 determines whether or not the operation is an instruction to stop the OS 150 (step S25). If the operation is not an instruction to stop the OS 150 (step S25; NO), the control unit 140 executes the function of the OS 150 corresponding to the operated operator (step S26), and returns to step S15. If the operation is an instruction to stop the OS 150 (step S25; YES), the control unit 140 ends the OS 150 (step S27), shuts down the head-mounted display device 100, and ends this process. .

  In the flowchart of FIG. 9, the control unit 140 waits for the key operation unit 17 or another operation (steps S15 and S20), and the flow control example in which the process is performed after detecting and recognizing the operation has been described. The operation of the head-mounted display device 100A is not limited to this. When the operation recognition unit 184 waits for an operation of the key operation unit 17 or other operations and detects an operation, the process corresponding to this operation is interrupted. You may start by control. In this case, the control unit 140 executes processing after step S16 or processing after step S21 by interrupt control.

  In the operation shown in FIG. 9, when the user mode ST3 is selected in step S33, the lock is released in the user mode ST3. Thereafter, when the lock button 362 is operated in a state where the screen for the application program 122 is displayed, the state shifts to the full lock state or the individual lock state, and when the lock button 362 is further operated, the state shifts to the unlock state. To do. The operation of the head-mounted display device 100A corresponding to the operation of the lock button 362 will be described with reference to FIG.

  In the operation of FIG. 10, the control unit 140 waits for the first operation, that is, the operation of the lock button 362 by the function of the OS 150 (step S41). The operation in step S41 is executed after the display of the screen for the application program 122 is started in step S18. When the operation of the lock button 362 is detected, the control unit 140 makes an affirmative determination in step S41 (step S41; YES), and determines in step S20 that there is no key operation (step S20; NO). When an operation of an operator other than the lock button 362 is detected, it is determined that there is an operation (step S20; YES) in step S20, and no operation (step S41; NO) is determined in step S41.

  The control unit 140 waits for an operation while the lock button 362 is not operated (step S41; NO). When the operation of the lock button 362 is detected (step S41; YES), the full lock state or the individual lock state is selected according to the setting of the mode switching API 129 (step S42). The control unit 140 shifts to the lock state selected in step S42 and invalidates the operation of the operator set by the key code API 123 (step S43). As a result, in the operations of steps S20 to S23 (FIG. 9) executed in parallel with the operation of FIG.

  The control unit 140 waits for the operation of the lock button 362 (step S44), and maintains the standby state while there is no operation (step S44; NO). When the operation of the lock button 362 is detected (step S44; YES), the control unit 140 shifts to the unlocked state, and assigns a function to the operator of the key operation unit 17 by the key code API 123 (step S45). ). The control unit 140 determines whether or not an operation for instructing the end of the execution of the application program 122 has been performed (step S46), and when the corresponding operation has been performed (step S46; YES), the process ends. .

In a state where there is no operation for instructing the end of execution of the application program 122 (step S46; NO), the control unit 140 waits for the operation of the lock button 362 (step S47), and while there is no operation (step S47; NO). ), Hold the standby state. When the operation of the lock button 362 is detected (step S47; YES), the control unit 140 selects the all lock state or the individual lock state (step S48).
In step S48, the control unit 140 may select the all lock state and the individual lock state according to the setting of the mode switching API 129. In step S48, the control unit 140 may select the all-locked state and the individual locked state based on the state before the transition to the unlocked state in step S45. For example, the same locked state as that before the transition to the unlocked state in step S45 may be selected.
The control unit 140 shifts to the locked state selected in step S48, invalidates the operation of the operator set by the key code API 123 (step S49), and returns to step S44.

  As described above, in the head-mounted display device 100A, the operation including the key operation unit 17 is detected and recognized by the operation recognition unit 184. In response to an operation assigned to the shift of the lock state, for example, an operation of the lock button 362, the control unit 140 can execute all lock states in which other operations are invalidated. Further, the control unit 140 can execute an individual lock state in which operations other than the operation assigned to the first operation are invalidated while the application program 122 is being executed. Further, it is possible to execute a lock release state in which an operation other than the operation assigned to the first operation is detected. Then, the control unit 140 can switch and shift between the all-locked state, the individual locked state, and the unlocked state in response to the first operation. For this reason, restrictions on the specifications of the OS 150 can be relaxed, and a response to an operation when the application program 122 is executed can be appropriately set.

  In addition, the head-mounted display device 100A stores in the storage unit 120 a key code API 123 that sets an invalid operation in the individual lock state. Since the control unit 140 invalidates operations other than the operation assigned to the first operation according to the key code API 123, the operation invalidated by the control unit 140 can be set using the key code API 123.

In addition, when the head-mounted display device 100A recognizes the operation assigned to the first operation in the fully locked state or the individual locked state, the control unit 140 shifts to the unlocked state. For this reason, another operation can be switched effectively by performing the first operation.
In addition, when the control unit 140 recognizes the operation assigned to the first operation after transitioning from the fully locked state or the individual locked state to the unlocked state, the controller 140 is set in advance among the all locked state and the individual locked state. Transition to the state. Thereby, operation can be locked by simple operation.

  After finishing the execution of the application program 122, the control unit 140 may display a predetermined home screen and shift to a state in which an operation other than the operation assigned to the first operation can be recognized. In this case, the lock can be released by terminating the execution of the application program 122. Thus, the operation lock optimized for the application program 122 can be set without affecting the operability when the home screen is displayed.

  In addition, the storage unit 120 stores a key setting file 128 for setting functions to be executed by the control unit 140 in response to an operation recognized in a state where the home screen is displayed. The control unit 140 executes the function set in the key setting file 128 according to the operation recognized in the state of displaying the home screen. Thereby, the function in a state where the home screen is displayed can be easily set.

  In the state where the home screen is displayed, in the default mode ST2, the function executed by the control unit 140 when an operation is detected is set by default. The control unit 140 executes a function selected in advance among the function of the user mode ST1 and the function of the default mode ST2 set by the key setting file 128. Thereby, when the execution of the application program 122 is finished, a function to be executed in response to the operation can be selected from the default function and the set function.

  Further, in the head-mounted display device 100A, the operation elements included in the key operation unit 17 (operation unit) are defined as the first operation element, the second operation element, and the third operation element. Is recognized, the second operation is recognized when the second operator is operated, and the third operation is recognized when the third operator is operated. May be. In the present embodiment, an example in which the lock button 362 is the first operation is shown. In this case, since one operator is assigned for switching the lock state, the lock state can be switched by an intuitive operation.

  In the head-mounted display device 100A, the key operation unit 17 may be configured to include an operation element that can perform a plurality of types of operations. For example, it is good also as a structure which is equipped with a touch panel and the operation recognition part 184 can distinguish and detect the touch (tap) operation, pinch operation, and wipe operation in a touch panel. In this case, any of a plurality of types of operations on an operator such as a touch panel may be assigned to any of the first operation, the second operation, and the third operation. In this case, locks can be set individually for different types of operations on one operator. Further, if the first operation is assigned, other types of operations can be restricted by a predetermined operation on one operator.

The present invention is not limited to the configurations described in the above embodiments, and can be implemented in various modes without departing from the scope of the invention.
For example, in the above-described embodiment, the configuration in which the control devices 10 and 13 are provided with the key operation units 16 and 17 having the hardware operation elements is illustrated, but instead of the key operation units 16 and 17, In addition to 17, an operation unit using a touch panel may be provided. The operation unit may detect a touch operation on the touch panel as an operation. Alternatively, a display screen may be provided on the touch panel to display a touch operation position, a function corresponding to the touch operation, or the like.

  In the first embodiment, the example in which the function of displaying the home screen according to the operation of the home button 342 is limited by calling and executing the key code API 123 is described. However, the present invention is not limited to this. . The function restricted by the key code API 123 is arbitrary. For example, during execution of the application program 122, all functions that prevent display or visual recognition of a screen displayed in association with the application program 122 may be restricted. Alternatively, the restriction by the key code API 123 may be released when a predetermined condition is satisfied, such as temporarily suspending the operation of the application program 122. In this case, the restriction by the key code API 123 may be resumed when the predetermined condition is released.

  Further, for example, instead of the image display unit 20, another type of image display unit such as an image display unit worn like a hat may be adopted, and an image is displayed corresponding to the left eye of the user. And a display unit that displays an image corresponding to the right eye of the user. The display device of the present invention may be configured as a head mounted display mounted on a vehicle such as an automobile or an airplane. Further, for example, it may be configured as a head-mounted display built in a body protective device such as a helmet. In this case, the part for positioning the position with respect to the user's body and the part positioned with respect to the part can be used as the mounting portion.

Furthermore, although the image display unit 20 and the control devices 10 and 13 are separated and described as an example in the above embodiment, the control devices 10 and 13 and the image display unit are described. 20 can be configured integrally and mounted on the user's head.
As the control devices 10 and 13, a notebook computer, a tablet computer, or a desktop computer may be used. The control device 10 may be a game machine, a portable phone, a portable electronic device including a smartphone or a portable media player, other dedicated devices, or the like. Alternatively, the control device 10 may be configured separately from the image display unit 20, and various signals may be transmitted and received between the control devices 10 and 13 and the image display unit 20 by wireless communication.

  For example, as a configuration for generating image light in the image display unit 20, a configuration including an organic EL (Organic Electro-Luminescence) display and an organic EL control unit may be used. Further, as a configuration for generating image light, LCOS (Liquid crystal on silicon, LCoS is a registered trademark), a digital micromirror device, or the like can be used.

The optical system that guides the image light to the user's eyes may include an optical member that transmits external light that is incident on the apparatus from the outside and that is incident on the user's eyes together with the image light. Moreover, you may use the optical member which is located ahead of a user's eyes and overlaps a part or all of a user's visual field. Further, a scanning optical system that scans a laser beam or the like to obtain image light may be employed. Further, the optical member is not limited to guiding the image light inside the optical member, and may have only a function of guiding the image light by refracting and / or reflecting it toward the user's eyes.
For example, the present invention can also be applied to a laser retinal projection type head mounted display. That is, the light emitting unit includes a laser light source and an optical system that guides the laser light source to the user's eyes, and the laser light is incident on the user's eyes to scan the retina and form an image on the retina. A configuration that allows the user to visually recognize an image may be employed.
Further, the present invention can be applied to a display device that employs a scanning optical system using a MEMS mirror and uses MEMS display technology. That is, a light emitting unit includes a signal light forming unit, a scanning optical system having a MEMS mirror that scans light emitted from the signal light forming unit, and an optical member on which a virtual image is formed by light scanned by the scanning optical system. You may prepare. In this configuration, the light emitted from the signal light forming unit is reflected by the MEMS mirror, enters the optical member, is guided through the optical member, and reaches the virtual image forming surface. When the MEMS mirror scans the light, a virtual image is formed on the virtual image forming surface, and the user recognizes the virtual image with the eyes, thereby recognizing the image. The optical component in this case may be one that guides light through a plurality of reflections, such as the right light guide plate 261 and the left light guide plate 262 of the above embodiment, and may use a half mirror surface. .

  Furthermore, the optical element of the present invention is not limited to the right light guide plate 261 and the left light guide plate 262 having the half mirrors 261A and 262A, and may be any optical component that allows image light to enter the user's eyes. A diffraction grating, a prism, or a holographic display unit may be used.

  In addition, at least a part of the functional blocks shown in FIGS. 2 and 5 may be realized by hardware, or may be realized by cooperation of hardware and software. As described above, the present invention is not limited to a configuration in which independent hardware resources are arranged. Further, the program executed by the control unit 140 may be stored in the storage unit 120 or the storage device in the control device 10, or the program stored in the external device is acquired via the communication unit 117 or the interface 125. It is good also as a structure to execute.

  DESCRIPTION OF SYMBOLS 10, 13 ... Control apparatus (electronic device) 16, 17 ... Key operation part, 20 ... Image display part (display apparatus), 21 ... Right holding part, 22 ... Right display drive part, 23 ... Left holding part, 24 ... Left display drive unit, 25 ... interface, 26 ... right optical image display unit, 28 ... left optical image display unit, 61 ... camera, 63 ... microphone, 100, 100A ... head-mounted display device, 110 ... input information acquisition unit 111, 112 ... operation unit, 120 ... storage unit, 121 ... operating system, 122 ... application program, 123 ... key code API (invalid setting data), 125 ... interface, 128 ... key setting file (home setting data), 129 ... mode switching API, 140 ... control unit, 150 ... operating system, 160 ... image processing unit, 170 ... display control unit, 184 Operation recognition unit, 187 ... voice processing unit, 362 ... lock button (operator, first operator), 363 ... volume up key (operator, second operator, third operator), 364 ... volume Down key (operator, second operator, third operator), 371, 372, 373, 374 ... function keys (operator, second operator, third operator), 375 ... direction keys Parts (operators, second operators, third operators), 376... Enter keys (operators, second operators, third operators).

Claims (19)

An electronic device that is connected to a head-mounted display device and controls display of the display device,
An operation unit for receiving an operation;
A controller that executes a general-purpose operating system and an application program operating on the operating system,
The operating system has a control function that is executed when the operation unit receives a predetermined operation, and includes a program module that can be called by the function of the application program and restricts the execution of the control function;
Electronic equipment characterized by A display control unit for controlling the display device to display an image;
The control unit causes the display control unit to display a screen for the operating system during execution of the application program by the control function;
The electronic device according to claim 1. The controller causes the control function to display an initial screen of the operating system;
The electronic device according to claim 2. The initial screen is a screen displayed by the display control unit after the operating system is started and before the application program is executed;
The electronic device according to claim 3. The operation unit includes an operation area or an operator for the control function;
The electronic device according to claim 1, wherein: The control unit executes the control function when the operation unit receives a predetermined operation after the application program is stopped during execution of the operating system,
The electronic device according to claim 1, wherein: The operation unit is configured to accept a plurality of operations,
The control unit is capable of executing a plurality of the control functions in response to an operation of the operation unit, and restricting execution of at least one of the plurality of control functions when executing the program module;
The electronic device according to claim 1, wherein: An electronic device that is connected to a head-mounted display device and controls display of the display device,
A control unit that executes a general-purpose operating system and an application program operating on the operating system;
The control unit recognizes the first operation, the second operation, and the third operation, and executes a process corresponding to the recognized operation,
Corresponding to the first operation, a total restriction state in which the second and third operations are invalidated, and at least one of the second and third operations is invalidated during execution of the application program. Transition to an individual restriction state to be performed and a restriction release state for recognizing the second and third operations,
Electronic equipment characterized by A storage unit for storing invalid setting data for setting an invalid operation in the individual restriction state;
The control unit invalidates at least one of the second and third operations according to the invalid setting data stored in the storage unit in the individual restriction state;
The electronic device according to claim 8. When the control unit recognizes the first operation in the all restricted state or the individual restricted state, the controller moves to the restricted release state.
The electronic device according to claim 9. When the control unit recognizes the first operation after transitioning from the full restriction state or the individual restriction state to the restriction release state, a state set in advance in the full restriction state and the individual restriction state Moving to
The electronic device according to claim 10. The control unit, after finishing the execution of the application program, the operating system displays a predetermined home screen and shifts to a state where the second and third operations can be recognized;
The electronic device according to claim 9, wherein: The storage unit stores home setting data for setting a function executed by the control unit in response to an operation recognized in a state where the home screen is displayed.
The controller executes the function set in the home setting data when the first operation is recognized in a state where the home screen is displayed;
The electronic device according to claim 12. The control unit executes the function set in the home setting data when recognizing any of the second and third operations in the state of displaying the home screen;
The electronic apparatus according to claim 13. A function to be executed when the control unit recognizes any of the first, second, and third operations in the state of displaying the home screen is set by default,
When the control unit recognizes any of the first, second, and third operations in the state in which the home screen is displayed, the function is set by the home setting data and the default is set. Performing a pre-selected function among the functions;
The electronic apparatus according to claim 14. An operation unit having a first operator, a second operator, and a third operator;
The controller recognizes the first operation when the first operation element is operated, recognizes the second operation when the second operation element is operated, and the third operation element. Recognizing the third operation when the operator is operated;
16. The electronic device according to claim 8, wherein An operation unit having an operation element capable of performing an operation corresponding to each of the second operation and the third operation;
The controller recognizes each of the first and second operations on the operator;
16. The electronic device according to claim 8, wherein A method of controlling an electronic device connected to a head-mounted display device and controlling display of the display device,
Executing a general-purpose operating system and an application program operating on the operating system;
The operating system executes a predetermined control function when the operation unit receives a predetermined operation,
Restricting execution of the predetermined control function when a predetermined program module is called by the function of the application program;
A method for controlling an electronic device. An electronic device control method that is connected to a head-mounted display device, recognizes the first operation, the second operation, and the third operation, and controls the display device in response to the recognized operation. There,
Executing a general-purpose operating system and an application program operating on the operating system;
Corresponding to the first operation, at least one of the all-restricted state in which the second operation and the third operation are invalidated, and the second and third operations during execution of the application program. Transition to an individual restriction state to be invalidated and a restriction release state for recognizing each of the second and third operations;
A method for controlling an electronic device.

Images