JP2011070414A - Portable terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a portable terminal that properly reduces current consumption when a virtual keyboard is used. <P>SOLUTION: The portable terminal includes: an image projection part 16 for projecting an operation image 18 that virtually expresses an operation object; a selection detecting part 15 which detects a position selected on the image 18; a data processing part which performs data processing corresponding the position detected by the operation position detecting part 15; a condition storage part which stores off-conditions for turning off projection of the image 18; and a control part which turns off projection of the image projection part 16 when the off-conditions are satisfied. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a portable terminal that suitably controls an operation target image that virtually represents an operation target operated by a user.

  2. Description of the Related Art Conventionally, a portable terminal that projects an operation target image that virtually represents a computer keyboard and performs an input operation on the virtual keyboard image is known (see, for example, Patent Document 1).

  This portable terminal projects a virtual keyboard on a flat and bright projection surface (such as white paper or a desk). The user performs an input operation by hitting a virtual key of the virtual keyboard projected on the projection surface with a finger or pointing a member such as a pointer with the finger. This input operation is detected by imaging with a camera, a laser sensor, or the like, and is performed as if a key on a physical physical keyboard for a computer was pressed.

JP 2008-123316 A

  Today's portable terminals are required to be small and light. Along with this, the capacity of the mounted battery is limited, so it is a problem how to reduce the current consumption and realize continuous use for a long time.

  The above-described virtual keyboard is a virtual keyboard that represents a large keyboard with excellent operability provided by a computer, compared to a conventional button-type input device that performs input operations by physical pressing. This improved the operability. However, it has been necessary to drive various devices for projecting a virtual keyboard and detecting input operations. As a result, the input operation using the virtual keyboard increases current consumption, which causes a reduction in continuous use time.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a portable terminal that suitably reduces current consumption when using a virtual keyboard.

  In order to solve the above-described problem, the portable terminal according to the present invention detects an operation of an image projection unit for projecting an operation target image that virtually represents the operation target, and a position selected on the operation target image. A selection detection unit that performs data processing corresponding to the position detected by the operation position detection unit, and a condition storage unit that stores an off condition for turning off the projection of the operation target image. And a control unit that turns off the projection of the image projection unit when the off condition is satisfied.

  The portable terminal according to the present invention can suitably reduce current consumption when using the virtual keyboard.

The external appearance block diagram which shows embodiment of the portable terminal which concerns on this invention. 1 is a schematic functional block diagram showing an embodiment of a mobile terminal according to the present invention. The screen transition figure at the time of setting the conditions of a virtual keyboard control process. The flowchart explaining the virtual keyboard off control process performed by the control part of the portable terminal in this embodiment. The flowchart explaining the virtual keyboard ON control process performed by the control part of the portable terminal in this embodiment.

  An embodiment of a portable terminal according to the present invention will be described with reference to the accompanying drawings.

  FIG. 1 is an external configuration diagram showing an embodiment of a mobile terminal according to the present invention.

  The mobile terminal 1 includes a rectangular casing 10 having a certain thickness. One surface of the housing 10 is mostly occupied by the touch panel 12. The touch panel 12 functions as a display unit 13 and an operation unit 14.

  The touch panel 12 as the display unit 13 includes an area for displaying data including characters and images. The display unit 13 includes, for example, an LCD (Liquid Crystal Display), an organic EL (ElectroLuminescence) display, and an inorganic EL display.

  The touch panel 12 as the operation unit 14 is a touch sensor that detects a contact operation on the operation surface as input position information. The touch panel 12 includes a plurality of elements for detecting a contact operation arranged on the upper surface of the display, and a transparent operation surface laminated thereon. As a method for detecting the contact operation on the touch panel 12, a pressure-sensitive method for detecting a change in pressure, an electrostatic method for detecting an electric signal due to static electricity, and other methods can be applied.

  A camera 15 provided on the surface of the housing 10 includes an image pickup device made of a CCD, a CMOS, or the like. The camera 15 photoelectrically converts a subject image by the photographing optical system to generate an image signal. In the present embodiment, a function of imaging a user's hand or the like who performs an input operation on the operation target image projected by the image projection unit 16 is also provided.

  The image projection unit 16 functions as an image projection unit that projects an operation target image that virtually represents a target operated by the user. The image projection unit 16 projects, for example, a keyboard image (hereinafter referred to as a “virtual keyboard image”) 18 in which a QWERTY key is arranged as an operation target image. At the time of projecting the virtual keyboard image 18, the mobile terminal 1 is placed on a desk, for example, with the light exit of the image projection unit 16 facing a desired projection surface, or is set on a charger (stand) for the mobile terminal. Or It is assumed that the image projection unit 16, the camera 15, and a proximity sensor 49 described later are installed according to the use position of the virtual keyboard.

  A transmitting / receiving antenna (antenna 31 in FIG. 2 described later) is provided at a predetermined position inside the mobile terminal 1. The mobile terminal 1 transmits and receives radio waves to and from a base station (not shown) via this built-in antenna.

  A battery pack (not shown) is inserted into the back side of the housing 10. When receiving an instruction to turn on the power, the mobile terminal 1 supplies power to each circuit unit from the battery pack and starts up in an operable state.

  A microphone (microphone 38 in FIG. 2) and a receiver (receiver 36 in FIG. 2) (both not shown) are provided at predetermined positions of the housing 10, respectively. The portable terminal 1 collects the voice of the user during a call with the microphone 38 and outputs the voice of the other party with the receiver 36.

  FIG. 2 is a schematic functional block diagram showing an embodiment of a mobile terminal according to the present invention.

  The mobile terminal 1 can perform voice communication and data using any of the wireless communication methods of W-CDMA, GSM, cdma2000 1x RTT, EVDO, and E-UTRA, which is a wireless access of the 3.9th generation LTE system. Communication is possible. The antenna 31, the radio transmission / reception unit 32, and the signal processing unit 33 correspond to these methods.

  The antenna 31 receives a radio signal transmitted from a base station accommodated in a mobile communication network by various communication processing systems from space. Further, the antenna 31 radiates a radio signal of any access method to the space so that wireless communication can be performed by various communication processing systems.

  The wireless transmission / reception unit 32 performs wireless communication with a base station accommodated in the mobile communication network via the antenna 31 by various communication processing methods. The radio transmission / reception unit 32 generates a radio signal having a carrier frequency instructed from the control unit 39 based on the modulation signal generated by the signal processing unit 33. The radio transmission / reception unit 32 receives a radio signal having a carrier frequency instructed from the control unit 39, mixes it with the local oscillation signal output from the frequency synthesizer, and converts the frequency into an intermediate frequency signal (down-conversion). Then, the radio transmission / reception unit 32 orthogonally demodulates the down-converted intermediate frequency signal and outputs a reception baseband signal. The reception result is output to the signal processing unit 33 and the control unit 39.

  The signal processing unit 33 is configured by a DSP (Digital Signal Processor) or the like, and performs predetermined signal processing on the received baseband signal to obtain received packet data in a predetermined transmission format. The signal processing unit 33 demodulates the audio signal included in the received packet data and decodes the demodulation result to obtain audio data and the like. The audio data obtained by the decoding process is supplied to the PCM codec 34. The PCM codec 34 performs PCM decoding on the audio data and outputs an analog audio data signal after PCM decoding to the reception amplifier 35. The analog audio signal is amplified by the reception amplifier 35 and then output from the receiver 36.

  On the other hand, the voice signal (analog audio signal) of the speaker (user) input to the microphone 38 is amplified to an appropriate level by the transmission amplifier 37 and then PCM encoded by the PCM codec 34. The audio signal after PCM encoding is input to the signal processing unit 33. The signal processing unit 33 encodes the audio signal, generates a modulation signal based on audio data and other data obtained by the encoding, and outputs the generated modulation signal to the radio transmission / reception unit 32.

  The control unit 39 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The CPU executes various processes according to programs stored in the ROM or various application programs and control programs including the operating system (OS) loaded from the storage unit 40 to the RAM. In addition, the CPU generates various control signals and supplies them to each unit to control the mobile terminal 1 in an integrated manner. The control unit 39 functions as a control unit that turns on or off the projection of the virtual keyboard image 18 by the image projection unit 16. In addition, the control unit 39 controls detection of key selection by the key selection detection unit 45. Furthermore, the control unit 39 also functions as a data processing unit that executes predetermined data processing corresponding to the selected key based on the key selection data detected and output by the key selection detection unit 45. This key selection data is data indicating the operation position (key) on the virtual keyboard image 18 projected by the image projection unit 16. Data processing includes, for example, data processing for displaying character data corresponding to a selected key on the touch panel 12, storing it in a memory, and data processing for changing the execution content of an application program such as a game. It is done.

  The RAM appropriately stores data necessary for the CPU to execute various processes.

  The storage unit 40 includes, for example, a flash memory element that is an electrically rewritable and erasable nonvolatile memory, an HDD (Hard Disc Drive), and the like. The storage unit 40 stores various application programs and various data groups executed by the CPU of the control unit 39, control programs and control data of the mobile terminal 1, and identification information uniquely assigned to the mobile terminal 1 or the user. . In addition to this, the storage unit 40 appropriately stores, for example, telephone book data in which contact information is registered, data acquired by data communication, downloaded data, image data captured by the camera 15, and the like. In the present embodiment, the storage unit 40 functions as a condition storage unit that stores an off condition for turning off the projection of the operation target image and an on condition for turning on.

  The power supply circuit 42 generates a predetermined operating power supply voltage Vcc based on the output of the battery 41 and supplies it to each circuit unit. The clock circuit (timer) 43 measures the current time or a certain time.

  The vibration sensor 46 functions as a vibration detection unit that detects vibration given to the mobile terminal 1. In the present embodiment, the vibration sensor 46 is a vibration applied to the mobile terminal 1 based on a user's input operation on the virtual keyboard image 18 and the vibration applied to the projection surface (for example, a desk) of the virtual keyboard image 18. Shall be detected.

  The proximity sensor 49 functions as an object detection unit that detects the presence or absence of an object near the virtual keyboard image 18. Whether the proximity sensor 49 is intended to use the virtual keyboard image 18 such as whether the user is facing the mobile terminal 1 or is waiting for a hand to perform an input operation on the virtual keyboard image 18. It is a sensor for detecting whether or not. Note that the vicinity of the virtual keyboard image 18 is detected by, for example, the body of the user facing the mobile terminal 1 or the hand of a user who is waiting for input without performing an input operation on the virtual keyboard image 18. The range that can be done.

  In the present embodiment, an example in which the proximity sensor 49 is used as the object detection unit will be described. However, the camera 15 may be used as an object detection unit instead of the proximity sensor 49. When the camera 15 is used, an image is acquired by imaging a range within a predetermined range, and by analyzing this image, for example, it can be determined whether or not the user is waiting for a hand.

  The image projection unit 16 includes, for example, a beam light source, an optical scanner, and a drive control unit (none of which is shown) for driving them. As the beam light source, an LD (Laser Diode, semiconductor laser), an LED (Light Emitting Diode, light emitting diode), or the like can be used. The intensity of the beam light emitted from the beam light source is controlled by the drive control unit based on the control data sent from the control unit 39. An optical scanner is an optical device that projects a beam of light emitted from a beam light source onto a projection surface (such as a desk) while scanning two-dimensionally. The scanning of the light beam by the optical scanner is driven and controlled by the drive control unit in the same manner as the beam light source. As this optical scanner, for example, a small galvanometer mirror capable of high-speed scanning can be used.

  The drive control unit has an image memory that stores image data, and stores image data to be projected that is set and registered in advance, and image data to be projected that is sent together with control data from the control unit 39. The beam light source and the optical scanner are driven and controlled based on the image data stored in the image memory.

  Note that the configuration of the image projection unit 16 described above is merely an example, and other configurations conventionally used (for example, see JP-A-2005-242725) may be used.

  The key selection detection unit 45 functions as a selection detection unit that detects the position selected on the virtual keyboard image 18 (operation target image) that is the operation target of the user. The key selection detection unit 45 includes a key input operation detection unit 47 and a key selection data generation unit 48. The key input operation detection unit 47 executes image processing based on a two-dimensional or three-dimensional image from the operation state of the user's hand imaged by the camera 15, and inputs to which key on the virtual keyboard image 18. Detect whether an operation has been performed. The key selection data generation unit 48 generates data of a key selected based on the input operation detected by the key input operation detection unit 47 and supplies the generated data to the control unit 39. Note that the key selection detection unit 45 detects the key selection by measuring the position of the fingertip or the pointer member using not only the operation situation imaged by the camera 15 but also the reflection of laser light or the reflection of ultrasonic waves. You may comprise as follows.

  Next, a virtual keyboard control process executed by the mobile terminal 1 in the present embodiment will be described. First, a method for setting conditions arbitrarily set by the user in order to perform the virtual keyboard control process will be described. This condition is an off condition and an on condition for turning off and on the projection (display) of the virtual keyboard image 18. The off condition and the on condition set by the user are stored in the storage unit 40.

  FIG. 3 is a screen transition diagram when setting conditions for the virtual keyboard control process.

  When receiving an instruction to display the setting menu 51 based on a user operation, the portable terminal 1 displays various selectable conditions in a selectable manner. The selectable conditions include, for example, “no detection detection time”, “operation presence / absence sensor level”, “vibration presence / absence sensor level”, and “determination condition setting”.

  When the “non-detection determination time” is selected for the mobile terminal 1, the input operation on the virtual keyboard image 18, the non-detection time of the proximity sensor 49 and the vibration sensor 46, which are conditions for turning off the display of the virtual keyboard image 18, A no-detection determination time setting screen 52 for setting is displayed. When the non-detection determination time is set (confirmed) by the user, the portable terminal 1 ends the operation and returns the screen to the standby screen.

  When “operating presence / absence sensor level” is selected, the mobile terminal 1 sets the level of a sensor that detects a predetermined operation that is a condition for controlling on / off of the virtual keyboard image 18 of the mobile terminal 1. A level setting screen 53 is displayed. The detection level of the proximity sensor 49 that detects the presence or absence of an object near the virtual keyboard image 18 is set. When the operation presence / absence sensor level is set by the user, the portable terminal 1 ends the operation and returns the screen to the standby screen.

  When “vibration presence / absence sensor level” is selected, the mobile terminal 1 displays a vibration presence / absence sensor level setting screen 54 for setting the level of the vibration sensor 46 that detects the presence / absence of vibration applied to the mobile terminal 1. On the vibration presence / absence sensor level setting screen 54, for example, by detecting whether the user is performing an input operation on the virtual keyboard image 18 using the presence / absence of vibration given to the mobile terminal 1, the user can display the virtual keyboard image 18. The detection level of the vibration sensor 46 that detects whether or not there is an intention to use is set. When the vibration presence / absence sensor level is set by the user, the mobile terminal 1 ends the operation and returns the screen to the standby screen.

  When “determination condition setting” is selected, the mobile terminal 1 sets various conditions used for turning on / off the display of the virtual keyboard image 18. The mobile terminal 1 first displays a display operation selection screen 55 for setting whether to turn off or on the display of the virtual keyboard image 18 under a predetermined condition. When “display OFF determination condition” is selected on the display operation selection screen 55, the mobile terminal 1 selects a display OFF determination condition setting screen for selecting an OFF condition used to turn off the display of the virtual keyboard image 18. 56 is displayed. On the display OFF determination condition setting screen 56, for example, non-detection of an input operation for the virtual keyboard image 18 for a predetermined time by the key selection detection unit 45 as an operation position detection unit (“determination of no input operation”), proximity as an object detection unit Non-detection of an object near the virtual keyboard image 18 for a predetermined time by the sensor 49 ("operation presence / absence determination"), and non-detection of vibration given to the mobile terminal 1 for a predetermined time by the vibration sensor 46 as a vibration detection unit ("vibration" Whether or not the “presence / absence determination” is set as an off condition for the virtual keyboard image 18 is set. When the display OFF determination condition (OFF condition) is set by the user, the portable terminal 1 ends the operation and returns the screen to the standby screen.

  When “display ON determination condition” is selected on the display operation selection screen 55, the mobile terminal 1 displays ON determination for selecting an ON condition used to turn on the display of the virtual keyboard image 18 again from OFF. A condition setting screen 57 is displayed. In the display ON determination condition setting screen 57, for example, the proximity sensor 49 detects an object in the vicinity of the virtual keyboard image 18 ("operation presence / absence determination") or detects vibration applied to the mobile terminal 1 ("vibration presence / absence determination"). Whether or not to turn on the keyboard image 18 is set. When the display ON determination condition (ON condition) is set by the user, the portable terminal 1 ends the operation and returns the screen to the standby screen.

  Next, a process for shifting the virtual keyboard off, which is executed after the conditions for the virtual keyboard control process are set, will be described.

  FIG. 4 is a flowchart illustrating a virtual keyboard off control process executed by the control unit 39 of the mobile terminal 1 in the present embodiment.

  In step S1, the control unit 39 determines whether or not the virtual keyboard image 18 is being displayed (projected). When it is determined that the virtual keyboard image 18 is not displayed, the control unit 39 ends the process.

  On the other hand, if it is determined that the virtual keyboard image 18 is displayed, the control unit 39 selects “no input operation determination” as a condition for turning off the virtual keyboard image 18 on the display OFF determination condition setting screen 56 in step S2. It is determined whether or not If the control unit 39 determines that “no input operation determination” is not selected as a condition for turning off the virtual keyboard image 18, the process proceeds to step S4.

  On the other hand, if the control unit 39 determines that “no input operation determination” is selected as a condition for turning off the virtual keyboard image 18, the time during which the virtual keyboard image 18 is not detected is not detected in step S3. It is determined whether or not the non-detection determination time set on the determination time setting screen 52 has been reached (elapsed). For example, the control unit 39 determines whether or not the no-detection determination time has been reached based on the time measured by the clock circuit 45. If the control unit 39 determines that the non-detection determination time has been reached, the process proceeds to step S9.

  On the other hand, if the control unit 39 determines that the no-detection determination time has not been reached, whether or not “operation presence / absence determination” is selected as a condition for turning off the virtual keyboard image 18 on the display OFF determination condition setting screen 56 in step S4. Determine whether or not. If the control unit 39 determines that “operation presence / absence determination” is not selected as a condition for turning off the virtual keyboard image 18, the process proceeds to step S6.

  When the control unit 39 determines that “operation presence / absence determination” is selected as a condition for turning off the virtual keyboard image 18, in step S <b> 5, the time when the object near the virtual keyboard image 18 is not detected is not detected. It is determined whether or not the non-detection determination time set on the determination time setting screen 52 has been reached (elapsed). If the control unit 39 determines that the non-detection determination time has been reached, the process proceeds to step S9.

  On the other hand, if the control unit 39 determines that the no-detection determination time has not been reached, whether or not “vibration presence / absence determination” is selected as a condition for turning off the virtual keyboard image 18 on the display OFF determination condition setting screen 56 in step S6. Determine whether or not. When it is determined that “vibration presence / absence determination” is not selected as a condition for turning off the virtual keyboard image 18, the control unit 39 proceeds to step S8.

  When the control unit 39 determines that “vibration presence / absence determination” is selected as a condition for turning off the virtual keyboard image 18, in step S 7, a time during which vibration applied to the mobile terminal 1 is not detected is detected. It is determined whether or not the no-detection determination time set on the absence determination time setting screen 52 has been reached (elapsed). If the control unit 39 determines that the non-detection determination time has been reached, the process proceeds to step S9.

  On the other hand, if the control unit 39 determines that the no-detection determination time has not been reached, it determines in step S8 whether or not an operation for turning off the display of the virtual keyboard image 18 has been performed by the user. If the control unit 39 determines that the operation to turn off the display is not performed and the on state is maintained, the process returns to the selection presence / absence determination step S2 until the display of the virtual keyboard image 18 is turned off. Repeat the process.

  When it is determined that an operation for turning off the display of the virtual keyboard image 18 has been performed, or when it is determined that the no-detection determination time has been reached in each of steps S3, S5, and S7, the control unit 39 determines in step S9. The display of the virtual keyboard image 18 is turned off.

  This is the end of the description of the virtual keyboard off control process in FIG.

  Next, a process for turning on the display of the virtual keyboard image 18 turned off in the virtual keyboard off control process of FIG. 4 will be described.

  FIG. 5 is a flowchart illustrating a virtual keyboard on control process executed by the control unit 39 of the mobile terminal 1 in the present embodiment. This virtual keyboard on control processing is performed when, for example, the display (projection) of the virtual keyboard image 18 is turned off because it is determined that the no-detection determination time has been reached in steps S3, S5, and S7 of FIG. It may be applied only to the case, or may be applied to the case where it is turned off by a user operation.

  In step S11, the control unit 39 determines whether or not the display of the virtual keyboard image 18 is temporarily off. When it is determined that the virtual keyboard image 18 is being displayed, the control unit 39 ends the process.

  On the other hand, if the control unit 39 determines that the display of the virtual keyboard image 18 is temporarily off, a condition that “operation presence / absence determination” turns on the virtual keyboard image 18 on the display ON determination condition setting screen 57 in step S12. It is determined whether or not is selected. If the control unit 39 determines that “operation presence / absence determination” is not selected as a condition for turning on the virtual keyboard image 18, the process proceeds to step S 14.

  On the other hand, when the control unit 39 determines that “operation presence / absence determination” is selected as a condition for turning on the virtual keyboard image 18, an object (virtual keyboard image) in the vicinity of the virtual keyboard image 18 is detected by the proximity sensor 49 in step S 13. It is determined whether or not a user's hand facing 18 is detected. If it is determined that the control unit 39 has been detected, the process proceeds to step S17.

  On the other hand, if the control unit 39 determines that it is not detected, whether or not “vibration presence / absence determination” is selected as a condition for turning on the virtual keyboard image 18 on the display ON determination condition setting screen 57 in step S14. Make a decision. When it is determined that “vibration presence / absence determination” is not selected as a condition for turning on the virtual keyboard image 18, the control unit 39 proceeds to step S16.

  When it is determined that “vibration presence / absence determination” is selected as a condition for turning on the virtual keyboard image 18, the control unit 39 determines whether or not vibration applied to the mobile terminal 1 is detected in step S15. Do. If the control unit 39 determines that vibration is detected, the process proceeds to step S17.

  On the other hand, if it is determined that no vibration is detected, the control unit 39 determines in step S16 whether or not an operation for turning on the display of the virtual keyboard image 18 has been performed by the user. If the control unit 39 determines that the operation for turning on the display is not performed and the off state is maintained, the process returns to the selection determination step S12 until the display of the virtual keyboard image 18 is turned on. Repeat the process.

  When it is determined that an operation for turning on the display of the virtual keyboard image 18 has been performed, or when it is determined that there is a detection in each step of Steps S13 and S15, the control unit 39 determines that the virtual keyboard image 18 is displayed in Step S16. Turn on the display.

  Above, description of the virtual keyboard ON control process of FIG. 5 is complete | finished.

  According to the portable terminal 1, even when the input operation is performed using the virtual keyboard image 18, the timing is automatically determined and the display is controlled to appropriately suppress useless current consumption. Can do.

  In addition, the mobile terminal 1 can determine the user's intention more accurately by determining the conditions for controlling the on / off of the display of the virtual keyboard image 18 using a plurality of conditions.

  Furthermore, since the user can arbitrarily set the conditions for controlling the on / off of the display of the virtual keyboard image 18 in the portable terminal 1, the display can be controlled in accordance with the intention of each individual user. .

  In the present embodiment, the example in which the projection (display) of the virtual keyboard image 18 is controlled to be off and on has been described. However, not only the control of the projection of the virtual keyboard image 18 but also the touch panel 12 (the display unit 13 and the operation unit 14) are turned off and on in conjunction with the control of the virtual keyboard image 18, and the camera 15 as the operation position detection unit is turned off. -ON may be controlled.

  In the present embodiment, the image projection unit 16 may project not only a virtual key layout image but also other images. For example, a pointer image, various button images, an image showing an input button on the game, or the like may be projected.

  The portable terminal according to the present invention can be applied to various portable terminals such as a cellular phone, a PDA (Personal Digital Assistant), a personal computer, a portable game machine, a portable music player, and a portable video player.

  In addition, although the series of processes described in the embodiment of the present invention has been illustrated as an example of processing performed in time series in the order described in the flowchart, it is not necessarily performed in time series. This includes processing that is executed individually.

DESCRIPTION OF SYMBOLS 1 Portable terminal 10 Housing | casing 12 Touch panel 13 Display part 14 Operation part 15 Camera 16 Image projection part 18 Virtual keyboard image 39 Control part 43 Clock circuit (timer)
46 Vibration sensor 45 Key selection detection unit 47 Key input operation detection unit 48 Key selection data generation unit

Claims (7)

An image projection unit for projecting an operation target image that virtually represents the operation target;
A selection detecting unit for detecting a position selected on the operation target image;
A data processing unit that executes data processing corresponding to the position detected by the operation position detection unit;
A condition storage unit for storing an off condition for turning off the projection of the operation target image;
A portable terminal comprising: a control unit that turns off the projection of the image projection unit when the off condition is satisfied. The mobile terminal according to claim 1, wherein the off condition is non-detection of the user operation position for a predetermined time by the operation position detection unit. A vibration detection unit for detecting vibration applied to the mobile terminal;
The mobile terminal according to claim 1, wherein the off condition is non-detection of the vibration for a predetermined time by the vibration detection unit. An object detection unit for detecting an object in the vicinity of the operation target image;
The mobile terminal according to claim 1, wherein the off condition is non-detection of the object for a predetermined time by the object detection unit. The condition storage unit further stores an on condition for turning it on again after the projection of the operation screen is turned off, and the control unit turns on the projection of the image projection unit when the on condition is satisfied. The mobile terminal according to claim 1 to be made. A vibration detection unit for detecting vibration applied to the mobile terminal;
The mobile terminal according to claim 5, wherein the ON condition is detection of the vibration by the vibration detection unit. An object detection unit for detecting an object in the vicinity of the operation target image;
The mobile terminal according to claim 5, wherein the ON condition is detection of the object by the object detection unit.

Images