JP2018181351A - Electronic device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic device which facilitates user's operation of the electronic device through a gesture.SOLUTION: An electronic device 1 comprises: a first proximity sensor 18; a second proximity sensor 18; and a controller 11 which selects between first gesture detection on the basis of a value output from the first proximity sensor 18 and second gesture detection on the basis of the value output from the second proximity sensor depending on a situation of the electronic device. When either one of the first proximity sensor 18 or the second proximity sensor 18 satisfies a predetermined condition, the controller 11 may select the gesture detection of the other of the first proximity sensor 18 or the second proximity sensor 18.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an electronic device.

  For example, electronic devices such as smartphones and tablet terminals generally include a touch panel. The user generally controls such an electronic device by touching the touch panel. BACKGROUND In recent years, an electronic device is known that detects a gesture performed by a user away from an electronic device by a proximity sensor such as an infrared sensor, and executes an input operation corresponding to the gesture (for example, Patent Document 1).

Unexamined-Japanese-Patent No. 2015-225493

  In the mobile terminal described in Patent Document 1, the proximity sensor is provided on the front (the surface on which the display is provided, the front). Therefore, when performing the input operation by the gesture, the user needs to make a gesture toward the front of the mobile terminal.

  Here, the portable terminal may be used, for example, with the front facing up (the front facing the ceiling) being placed on the table. In order to execute the input operation by the gesture in this state, the user needs to extend the hand near the front of the portable terminal. Also, the portable terminal is carried, for example, in a pocket. At this time, in the case of performing an input operation by a gesture, the user needs to take out the portable terminal and make a gesture after pointing the front to himself. Thus, when performing input operation by a gesture with a portable terminal given in patent documents 1, a user may operate according to a posture of a portable terminal, and may adjust direction of a portable terminal. Therefore, there is a possibility that the user thinks that the operability of the input operation by the gesture is not good.

  An object of the present invention made in view of such circumstances is to provide an electronic device that improves the operability of the user regarding the gesture.

  An electronic device according to an embodiment of the present invention is a first proximity sensor, a second proximity sensor, and a first based on a value output from the first proximity sensor according to a state of the own device. A controller for selecting a gesture detection and a second gesture detection based on a value output from the second proximity sensor.

  Also, the electronic device according to the embodiment of the present invention switches the first proximity sensor or the second proximity sensor according to the state of the first proximity sensor, the second proximity sensor, and the own device. And a controller.

  According to an embodiment of the present invention, it is possible to provide an electronic device that improves the user's operability regarding a gesture.

It is a schematic block diagram of the electronic device concerning one embodiment. It is a figure which illustrates a mode that a user operates an electronic device by a gesture. It is a schematic block diagram of a proximity sensor. It is a figure which shows transition of the detected value which each infrared photodiode detects. It is a figure which illustrates the situation which operates an electronic device with a gesture. It is a figure which illustrates the case where the attitude | position of an electronic device differs in the condition of FIG. 7 (a) is a top view of the electronic device, FIG. 7 (b) is a left side view of the electronic device, FIG. 7 (c) is a front view of the electronic device, FIG. 7 (d) is a right side view of the electronic device, FIG. 7 (e) is a rear view of the electronic device, and FIG. 7 (f) is a bottom view of the electronic device. It is a figure showing the state where electronic equipment was put into a pocket. It is a figure which shows the state which the electronic device was placed on the table front side up. FIG. 10A and FIG. 10B are diagrams showing how a gesture is performed on the back side of the electronic device. It is a flow chart which illustrates the selection processing of the 1st proximity sensor and the 2nd proximity sensor.

(Configuration of electronic device)
As shown in FIG. 1, the electronic device 1 of one embodiment includes a proximity sensor 18 (a gesture sensor) and a controller 11. The electronic device 1 further includes a timer 12, a camera 13, a display 14, a microphone 15, a storage 16, a communication unit 17, and a speaker 25. In the present embodiment, the electronic device 1 further includes a UV sensor 19, an illuminance sensor 20, an acceleration sensor 21, a geomagnetic sensor 22, an atmospheric pressure sensor 23, and a gyro sensor 24. FIG. 1 is an example. The electronic device 1 may not include all of the components shown in FIG. Also, the electronic device 1 may have components other than those shown in FIG.

  The timer 12 receives an instruction for timer operation from the controller 11, and outputs a signal indicating that to the controller 11 when a predetermined time has elapsed. The timer 12 may be provided independently of the controller 11 as shown in FIG. 1, or may be built in the controller 11.

  The camera 13 captures an object around the electronic device 1. The camera 13 is, for example, an in-camera 13a (see FIG. 7C) provided on the surface (front surface) of the electronic device 1 on which the display 14 is provided. The camera 13 is, for example, an out-camera 13 b (see FIG. 7E) provided on the back surface of the electronic device 1 (surface opposite to the surface on which the display 14 is provided). In the present embodiment, the camera 13 includes an in-camera 13a and an out-camera 13b.

  The display 14 displays a screen. The screen includes, for example, at least one of characters, images, symbols, and figures. The display 14 may be a liquid crystal display. The display 14 may be an organic EL panel (Organic Electro-Luminescence Panel), an inorganic EL panel (Inorganic Electro-Luminescence Panel) or the like. In the present embodiment, the display 14 is a touch panel display (touch screen display). The touch panel display detects a touch of a finger or a stylus pen and identifies the touch position. The display 14 can simultaneously detect a plurality of positions touched by a finger or a stylus pen or the like.

  The microphone 15 detects sounds around the electronic device 1 including human voices.

  The storage 16 stores programs and data as a storage unit. The storage 16 temporarily stores the processing result of the controller 11. The storage 16 may include any storage device such as a semiconductor storage device and a magnetic storage device. The storage 16 may include multiple types of storage devices. The storage 16 may include a combination of a portable storage medium such as a memory card and a reader of the storage medium.

  The programs stored in the storage 16 include an application executed in the foreground or background and a control program for supporting the operation of the application. The application causes the controller 11 to execute, for example, processing corresponding to the gesture. The control program is, for example, an OS (Operating System). The application and control program may be installed in the storage 16 via a communication or storage medium by the communication unit 17.

  The communication unit 17 is an interface for wired or wireless communication. The communication scheme performed by the communication unit 17 of one embodiment is a wireless communication standard. For example, wireless communication standards include those of cellular phones such as 2G, 3G and 4G. For example, communication standards for cellular phones include Long Term Evolution (LTE) and Wideband Code Division Multiple Access (W-CDMA). Also, for example, communication standards for cellular phones include CDMA2000 and PDC (Personal Digital Cellular). Also, for example, communication standards for cellular phones include GSM (registered trademark) (Global System for Mobile communications) and PHS (Personal Handy-phone System). For example, wireless communication standards include Worldwide Interoperability for Microwave Access (WiMAX) and IEEE 802.11, Bluetooth (registered trademark). Also, for example, the wireless communication standard includes IrDA (Infrared Data Association), NFC (Near Field Communication), and the like. Communication unit 17 may support one or more of the communication standards described above.

  The speaker 25 outputs a sound. For example, during a call, the other party's voice is output from the speaker 25. Further, for example, at the time of reading out news, weather forecast or the like, the content is outputted from the speaker 25 as a sound.

  The proximity sensor 18 detects the relative distance between the electronic device 1 and the surrounding object and the moving direction of the object without contact. In the present embodiment, the proximity sensor 18 has one infrared LED (Light Emitting Diode) for light source and four infrared photodiodes. The proximity sensor 18 emits infrared light from the infrared LED for light source toward the object. The proximity sensor 18 uses the reflected light from the object as the incident light of the infrared photodiode. The proximity sensor 18 can then measure the relative distance to the object based on the output current of the infrared photodiode. Further, the proximity sensor 18 detects the moving direction of the object based on the time difference in which the reflected light from the object is incident on the respective infrared photodiodes. Therefore, the proximity sensor 18 can detect an operation using an air gesture (hereinafter, simply referred to as a “gesture”) performed by the user of the electronic device 1 without touching the electronic device 1. Here, the proximity sensor 18 may have a visible light photodiode. Although the details will be described later, in the present embodiment, a plurality of proximity sensors 18 includes a first proximity sensor 18 a and a second proximity sensor 18 b provided on different sides of the electronic device 1 (for example, FIG. reference).

  The controller 11 is a processor such as a central processing unit (CPU), for example. The controller 11 may be an integrated circuit such as a system-on-a-chip (SoC) in which other components are integrated. The controller 11 may be configured by combining a plurality of integrated circuits. The controller 11 comprehensively controls the operation of the electronic device 1 to realize various functions.

  Specifically, the controller 11 refers to the data stored in the storage 16 as necessary. The controller 11 implements various functions by executing instructions included in the program stored in the storage 16 to control other functional units such as the display 14. For example, the controller 11 acquires data of a touch by the user from the touch panel. For example, the controller 11 acquires information on the user's gesture detected by the proximity sensor 18. For example, the controller 11 acquires information such as the remaining time of the countdown (timer time) from the timer 12. Also, for example, the controller 11 grasps the activation status of the application. Further, for example, the controller 11 determines the attitude of the electronic device 1 from the information of the acceleration detected by the acceleration sensor 21.

  The UV sensor 19 can measure the amount of ultraviolet rays contained in sunlight or the like.

  The illuminance sensor 20 detects the illuminance of ambient light incident on the illuminance sensor 20. The illuminance sensor 20 may use, for example, a photodiode or a phototransistor.

  The acceleration sensor 21 detects the direction and magnitude of acceleration acting on the electronic device 1. The value output from the acceleration sensor 21 is information on the detected acceleration. The acceleration sensor 21 is, for example, a three-axis (three-dimensional) type that detects acceleration in the x-axis direction, the y-axis direction, and the z-axis direction. The acceleration sensor 21 may be, for example, a piezoresistive type or an electrostatic capacitance type.

  The geomagnetic sensor 22 detects the direction of geomagnetism, and makes it possible to measure the direction of the electronic device 1.

  The atmospheric pressure sensor 23 detects the atmospheric pressure (atmospheric pressure) outside the electronic device 1.

  The gyro sensor 24 detects the angular velocity of the electronic device 1. The controller 11 can measure the change in the orientation of the electronic device 1 by time-integrating the angular velocity acquired by the gyro sensor 24.

(Operation of electronic device by gesture)
FIG. 2 shows how the user operates the electronic device 1 by a gesture. In FIG. 2, the electronic device 1 is supported by a stand as an example. Alternatively, the electronic device 1 may be hung on a wall or placed on a table. When the proximity sensor 18 detects a user's gesture, the controller 11 performs processing based on the detected gesture. In the example of FIG. 2, the process based on the gesture is scrolling of the screen on which the recipe is displayed. For example, when the user makes a gesture of moving the hand upward in the longitudinal direction of the electronic device 1, the screen scrolls upward in conjunction with the movement of the user's hand. Also, for example, when the user makes a gesture of moving the hand downward in the longitudinal direction of the electronic device 1, the screen scrolls downward in conjunction with the movement of the user's hand.

  The electronic device 1 shown in FIG. 2 is a smartphone. As an alternative example, the electronic device 1 may be, for example, a mobile phone terminal, a Fablet, a tablet PC or a feature phone. Further, the electronic device 1 is not limited to the above, and may be, for example, a PDA, a remote control terminal, a portable music player, a game machine, an electronic book reader, a car navigation, a home appliance or an industrial device (FA device).

(Gesture detection method by proximity sensor)
Here, with reference to FIG. 3 and FIG. 4, a method in which the controller 11 detects a user's gesture based on the output of the proximity sensor 18 will be described. FIG. 3 is a view showing a configuration example of the proximity sensor 18 when the electronic device 1 is viewed from the front. The proximity sensor 18 has a light source infrared LED 180 and four infrared photodiodes SU, SR, SD and SL. Four infrared photodiodes SU, SR, SD and SL detect reflected light from the object to be detected through the lens 181. The four infrared photodiodes SU, SR, SD and SL are arranged symmetrically with respect to the center of the lens 181. Here, it is assumed that the virtual line D1 shown in FIG. 3 is substantially parallel to the longitudinal direction of the electronic device 1. The infrared photodiode SU and the infrared photodiode SD are disposed apart from each other on the virtual line D1 of FIG. Then, in the direction of the imaginary line D1 in FIG. 3, the infrared photodiodes SR and SL are disposed between the infrared photodiode SU and the infrared photodiode SD.

  FIG. 4 shows the transition of the detection value when the detection objects (for example, the user's hand etc.) of the four infrared photodiodes SU, SR, SD and SL move in the direction of the virtual line D1 of FIG. I will illustrate. Here, in the direction of the virtual line D1, the infrared photodiode SU and the infrared photodiode SD are most distant from each other. Therefore, as shown in FIG. 4, the time difference between the change (e.g., increase) of the detected value (broken line) of the infrared photodiode SU and the same change (e.g., increase) of the detected value (thin solid line) of the infrared photodiode SD. Is the largest. The controller 11 can determine the moving direction of the detection object by grasping the time difference of the predetermined change of the detection values of the photodiodes SU, SR, SD and SL.

  The controller 11 obtains the detection values of the photodiodes SU, SR, SD and SL from the proximity sensor 18. Then, the controller 11 integrates a value obtained by subtracting the detection value of the photodiode SU from the detection value of the photodiode SD for a predetermined time, for example, in order to grasp the movement of the detection object in the direction of the virtual line D1. It is also good. In the example of FIG. 4, the integral value becomes a non-zero value in the regions R41 and R42. The controller 11 can grasp the movement of the detection target in the direction of the virtual line D1 from the change in the integral value (for example, the change in the positive value, the zero, and the negative value).

  Further, the controller 11 may integrate a value obtained by subtracting the detection value of the photodiode SR from the detection value of the photodiode SL in a predetermined time. The controller 11 moves the object to be detected in the direction orthogonal to the virtual line D1 (a direction substantially parallel to the lateral direction of the electronic device 1) from the change in the integral value (for example, a change in positive value, zero, or negative value). Can understand

  Alternatively, the controller 11 may perform the operation using all the detected values of the photodiodes SU, SR, SD and SL. That is, the controller 11 may grasp the movement direction of the detection target without separating and calculating the components in the longitudinal direction and the short direction of the electronic device 1.

  The gestures detected by the proximity sensor 18 are, for example, left and right gestures, upper and lower gestures, oblique gestures, gestures of drawing a circle clockwise, and gestures of drawing a circle counterclockwise. For example, the gesture to the left and right is a gesture performed in a direction substantially parallel to the short direction of the electronic device 1. The upper and lower gestures are gestures performed in a direction substantially parallel to the longitudinal direction of the electronic device 1. The oblique gesture is a gesture performed on a plane substantially parallel to the electronic device 1 in a direction not parallel to any of the longitudinal direction and the short direction of the electronic device 1.

(Kitchen mode)
FIG. 5 shows an example of a situation where the user operates the electronic device 1 by a gesture. In the example of FIG. 5, the user is cooking according to the recipe in the kitchen while displaying the recipe of the cooking on the display 14 of the electronic device 1. In the example of FIG. 5, the proximity sensor 18 detects the user's gesture. Then, the controller 11 performs processing based on the gesture detected by the proximity sensor 18. For example, the controller 11 can perform processing of scrolling the recipe in response to a specific gesture (for example, a gesture in which the user moves the hand up and down). During cooking, the user's hands may become dirty or wet. However, the user can scroll the recipe without touching the electronic device 1. Therefore, it is possible to prevent the display 14 from being soiled and the display 14 from being stained on the user's hands while cooking.

  Here, the electronic device 1 has a plurality of modes. The mode means an operation mode (operation state or operation state) in which the overall operation of the electronic device 1 is limited. Only one mode can be selected at a time. In the present embodiment, the mode of the electronic device 1 includes at least a first mode and a second mode. The first mode is, for example, a normal operation mode (normal mode) suitable for use in a room other than the kitchen and at a place to go out. The second mode is an operation mode (kitchen mode) of the electronic device 1 which is most suitable for cooking while displaying a recipe in the kitchen. As described above, in the second mode, an input operation by a gesture is possible.

  In the second mode (kitchen mode), the electronic device 1 performs gesture detection by the proximity sensor 18. Here, it is assumed that the proximity sensor 18 is provided only on the front of the electronic device 1. At this time, it is preferable that the electronic device 1 be supported by, for example, a stand or the like so as to be able to detect the user's gesture and direct the front to the user (see FIG. 5). However, as shown in FIG. 6, the user may use the electronic device 1 while keeping it on the table. In particular, when there is no stand or wall against which the electronic device 1 stands, the user may place the electronic device 1 on the table with the front face up. At this time, it is necessary for the user to extend the hand to the upper side of the electronic device 1 and then to make a gesture. Therefore, the user may think that the operability of the input operation by the gesture is not good.

  The electronic device 1 according to the present embodiment includes a first proximity sensor 18a and a second proximity sensor 18b. Then, the controller 11 selects one of the first proximity sensor 18 a and the second proximity sensor 18 b according to the state of the own device (electronic device 1). Here, the second proximity sensor 18 b is provided on a surface different from the surface (for example, the front) on which the first proximity sensor 18 a is provided. As described later, the electronic device 1 according to the present embodiment appropriately operates the user regarding the gesture by appropriately selecting the first proximity sensor 18 a and the second proximity sensor 18 b according to the state of the electronic device 1. It is possible to improve the quality.

(The side where the proximity sensor is provided)
FIG. 7A is a top (plan) view of the electronic device 1 according to the present embodiment. FIG. 7B is a left side view of the electronic device 1. FIG. 7C is a front view of the electronic device 1. FIG. 7D is a right side view of the electronic device 1. FIG. 7E is a rear view of the electronic device 1. FIG. 7F is a bottom view of the electronic device 1. FIGS. 7A to 7F respectively show one surface (one surface of the housing) on the appearance of the electronic device 1 of the electronic device 1. Here, FIGS. 7A to 7F schematically show the respective surfaces, and do not show all the elements included in the electronic device 1.

  As shown in FIG. 7C, in the present embodiment, the first proximity sensor 18 a is provided on the front of the electronic device 1. The front of the electronic device 1 is a surface on which the display 14 and the in-camera 13a are provided. In the example of FIG. 7 (c), the first proximity sensor 18 a is provided at a position above the display 14. However, the position of the first proximity sensor 18 a is not limited to the upper side of the display 14. For example, the first proximity sensor 18 a may be provided below the display 14.

  As shown in FIG. 7A, in the present embodiment, the second proximity sensor 18 b is provided on the upper surface (plane) of the electronic device 1. In the present embodiment, the second proximity sensor 18 b is positioned slightly to the left of the paper surface in the short direction on the front of the electronic device 1 than the center in the lateral direction, but is not limited to this position. Further, the second proximity sensor 18b is not limited to the upper surface (plane), and can be provided on a surface different from the surface on which the first proximity sensor 18a is provided. The second proximity sensor 18b may be provided, for example, on the bottom surface (FIG. 7 (f)). Also, the second proximity sensor 18b may be provided on the back surface (FIG. 7 (e)), for example, similarly to the out camera 13b.

  FIG. 8 is a view showing the electronic device 1 in a pocket. For example, the electronic device 1 operating in the second mode (kitchen mode) may be moved to another place by putting it in a shirt or apron pocket. At this time, the electronic device 1 is vertically oriented as shown in FIG. 8 (an example of a predetermined posture of the electronic device 1). Here, the longitudinal orientation means a state in which the longitudinal direction in the front of the electronic device 1 is substantially parallel to the gravity direction.

  Here, when the timer 12 counts down and the alarm sounds while moving, it may be desirable to stop the alarm by a gesture (for example, an operation of holding a part of the face such as a hand or a jaw). In addition, when a call is received to the electronic device 1 which is a mobile phone while moving, it is desired to respond by a gesture (for example, an operation of moving a hand in the short direction in the front of the electronic device 1 or an operation of waving a neck) Sometimes. However, the first proximity sensor 18 a provided on the front of the electronic device 1 is covered by the pocket and can not detect the user's gesture.

  The controller 11 performs the first gesture detection and the second gesture detection based on the value output from the first proximity sensor 18a according to whether the electronic device 1 is vertically oriented (an example of the state of the own device). The second gesture detection based on the value output from the proximity sensor 18b is selected. Specifically, the controller 11 selects the second gesture detection when the electronic device 1 is in the predetermined posture (vertical direction), and the first when the electronic device 1 is not in the predetermined posture (vertical direction). Select Gesture Detection. In the example of FIG. 8, the controller 11 detects the user's gesture based on the output (detection signal) of the second proximity sensor 18b.

  The user stops the alarm even while moving the electronic device 1 in the pocket, for example by making a gesture near the upper surface of the electronic device 1 (within the detection distance of the second proximity sensor 18b) Or answer the phone. Therefore, the operability of the user regarding the gesture is improved. In particular, when the electronic device 1 is in the chest pocket, even if both hands are closed, the user holds the jaw near the second proximity sensor 18b or shakes the neck, thereby causing an alarm. You can stop and answer calls.

  The controller 11 determines the state of the own device using, for example, a value output from the acceleration sensor 21. In the present embodiment, the controller 11 acquires information on the acceleration detected by the acceleration sensor 21. Then, the controller 11 determines the posture of the electronic device 1 based on the direction of the gravitational acceleration obtained from the information of the acceleration, and selects the first gesture detection or the second gesture detection.

  Although the case where the electronic device 1 is put in the pocket has been illustrated, for example, even when the electronic device 1 is put in the bag, the controller 11 can improve the operability by the same process.

(Another installation example of the second proximity sensor)
Here, in the electronic device 1 according to the present embodiment, the second proximity sensor 18 b is provided on the upper surface. However, as another example, the second proximity sensor 18b may be provided on the lower surface (FIG. 7 (f)). For example, FIG. 9 is a view showing a state in which the electronic device 1 provided with the second proximity sensor 18b on the lower surface is placed on the table with the front side up.

  For example, as shown in FIG. 9, the electronic device 1 operating in the second mode (kitchen mode) may be placed on the table, and the user may cook while watching the displayed recipe. At this time, for example, in order to scroll the recipe, the user needs to extend his / her hand near the front of the electronic device 1 even while cooking. Therefore, the user may think that the operability is not good for the input operation by the gesture.

  The controller 11 performs processing of selecting one of the first proximity sensor 18a and the second proximity sensor 18b when the one of the first proximity sensor 18a and the second proximity sensor 18b satisfies a predetermined condition, in addition to the processing of selection according to the attitude of the electronic device 1. In the present embodiment, the predetermined condition is that a predetermined time (for example, 30 seconds) elapses without a gesture input operation. Here, the predetermined condition is not limited. For example, the predetermined condition may be that a predetermined time has elapsed regardless of the presence or absence of the gesture input operation. Also, for example, the predetermined condition may be detection of a specific gesture by the user (a gesture of drawing a circle as an example).

  In the example of FIG. 9, the controller 11 first selects the first gesture detection based on the value output from the first proximity sensor 18a because the electronic device 1 is not in the predetermined posture (vertical direction). However, when a predetermined time passes without a gesture input operation, the controller 11 detects the user's gesture based on the output of the second proximity sensor 18b instead of the first proximity sensor 18a.

  Even if the user does not reach for a gesture near the front of the electronic device 1, gesture detection based on the output of the second proximity sensor 18b is performed after a predetermined time has elapsed. The user can perform an input operation by making a gesture near the lower surface of the electronic device 1 (within the range detected by the second proximity sensor 18b). That is, since the user does not need to reach near the front of the electronic device 1, the operability of the user regarding the gesture is improved.

  Here, in the example of FIG. 8 (example of the state in which the electronic device 1 is put in the pocket), the controller 11 changes the selection of the proximity sensor 18 when a predetermined time elapses without a gesture input operation. You may also run For example, in the example of FIG. 8, the first proximity sensor 18a is covered by the pocket and can not detect the user's gesture. Therefore, after a predetermined time has elapsed, the controller 11 selects the output of the second proximity sensor 18 b to detect the user's gesture. Here, "no gesture input operation" means not only when the proximity sensor 18 can not obtain the reflected light from the object but also obtains the reflected light from the object but it is not a gesture (no movement). Including the case. When the first proximity sensor 18a is covered with a pocket as in the example of FIG. 8, the controller 11 determines that there is no gesture input operation because the reflected light from the object is obtained but there is no movement. Do.

  Further, even when the electronic device 1 is placed on the table with the front facing downward in FIG. 9, the controller 11 can appropriately select the output of the second proximity sensor 18b. Also in this case, although the first proximity sensor 18a obtains the reflected light from the object (table), since there is no movement (gesture), the controller 11 determines that there is no gesture input operation.

(Another installation example of the second proximity sensor)
As another example, the second proximity sensor 18b may be provided on the back surface (FIG. 7 (e)). For example, FIGS. 10 (a) and 10 (b) are diagrams illustrating how the user holds the electronic device 1 provided with the second proximity sensor 18b on the back and performs a gesture input operation.

  In the examples of FIGS. 10A and 10B, since the electronic device 1 is in the predetermined posture (vertical direction) in the controller 11, the second based on the value output from the second proximity sensor 18b. Select Gesture Detection. That is, the controller 11 detects the user's gesture based on the output from the second proximity sensor 18 b provided on the back surface of the electronic device 1.

  In the example of FIG. 10A, the second proximity sensor 18 b is at a position close to the upper end on the back surface of the electronic device 1. The user holds the part from the lower end to the vicinity of the center of the electronic device 1 with the left hand. Then, the user can make a gesture with the right hand on the back side of the electronic device 1. At this time, the user does not interrupt the display 14 with his / her gesture operation. Therefore, even when the user makes a gesture, the display 14 never disappears. Here, instead of the user making a gesture on the back side of the electronic device 1, it is also possible for a third party (other than the user) to make a gesture to operate the electronic device 1.

  In the example of FIG. 10 (b), the second proximity sensor 18 b is near the center of the electronic device 1. The user holds the part from the lower end to the center of the electronic device 1 with the right hand. Then, the user can make a gesture on the back side of the electronic device 1 using a finger of the right hand (for example, a forefinger). At this time, the user can operate the electronic device 1 with only one hand, including a gesture operation. Also in the example of FIG. 10 (b), the user does not interrupt the display 14 with his / her gesture operation.

(flowchart)
FIG. 11 is a flowchart illustrating the process of selecting the first proximity sensor 18 a and the second proximity sensor 18 b executed by the electronic device 1. At the start of the process illustrated in FIG. 11, the electronic device 1 operates in the second mode (kitchen mode) in which the input operation by the gesture can be performed.

  The controller 11 acquires information on the acceleration detected by the acceleration sensor 21 (step S1). Then, the controller 11 determines the attitude of the electronic device 1 based on the information of the acceleration.

  When the electronic device 1 is not vertically oriented (No in step S2), the controller 11 detects a gesture based on the value output from the first proximity sensor 18a (step S3).

  The controller 11 proceeds to the process of step S6 when the predetermined time has elapsed without a gesture input operation based on the value output from the first proximity sensor 18a (Yes in step S4). That is, the controller 11 selects the second proximity sensor 18b instead of the first proximity sensor 18a.

  The controller 11 performs a gesture input operation based on the value output from the first proximity sensor 18a within a predetermined time, or when there is no gesture input operation but a predetermined time has not elapsed (step S4). No), the process proceeds to step S5.

  The controller 11 ends the series of switching processing when there is a termination instruction of the gesture input operation by, for example, the release of the second mode by the user (Yes in step S5).

  The controller 11 returns to the process of step S3 when there is no instruction to end the gesture input operation (No in step S5).

  When the electronic device 1 is vertically oriented (Yes in step S2), the controller 11 detects a gesture based on the value output from the second proximity sensor 18b (step S6).

  The controller 11 proceeds to the process of step S3 when the predetermined time has elapsed without a gesture input operation based on the value output from the second proximity sensor 18b (Yes in step S7). That is, the controller 11 selects the first proximity sensor 18a instead of the second proximity sensor 18b.

  The controller 11 performs a gesture input operation based on the value output from the second proximity sensor 18b within a predetermined time, or when there is no gesture input operation but a predetermined time has not elapsed (step S7). No), the process proceeds to step S8.

  The controller 11 ends the series of switching processing when there is an instruction to end the gesture input operation by, for example, canceling the second mode by the user (Yes in step S8).

  The controller 11 returns to the process of step S6 when there is no instruction to end the gesture input operation (No in step S8).

  As described above, the electronic device 1 according to the present embodiment includes the first proximity sensor 18 a and the second proximity sensor 18 b. Further, the electronic device 1 is output from the first gesture detection based on the value output from the first proximity sensor 18a and the second proximity sensor 18b in accordance with the state of the own device (electronic device 1). A controller 11 is provided to select the second gesture detection based on the value. The state of the own device may include, for example, whether or not the own device is in a predetermined posture (for example, vertically oriented). Furthermore, the state of the own device may include, for example, whether or not a predetermined time has elapsed without a gesture input operation. The controller 11 appropriately selects the first proximity sensor 18 a or the second proximity sensor 18 b according to the state of the own device, whereby the user operates according to the posture of the electronic device 1 or It is possible to eliminate the adjustment of the direction. Therefore, the electronic device 1 according to the present embodiment can improve the operability of the user regarding the gesture.

(Other embodiments)
Although the present invention has been described based on the drawings and embodiments, it should be noted that those skilled in the art can easily make various changes and modifications based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present invention. For example, functions etc. included in each means or each step can be rearranged so as not to be logically contradictory, and it is possible to combine or divide a plurality of means or steps into one. .

  In the above embodiment, the controller 11 selects one of the output of the first proximity sensor 18a and the output of the second proximity sensor 18b to perform gesture detection. That is, when the output of one proximity sensor 18 is selected, the other proximity sensor 18 may also be operating. Here, in order to reduce power consumption, the controller 11 may switch the first proximity sensor 18 a or the second proximity sensor 18 b according to the state of the own device. That is, the controller 11 may turn off (may stop) the proximity sensor 18 which does not use the output for gesture detection. For example, when the first proximity sensor 18a is selected in step S3 of FIG. 11, the controller 11 turns on the first proximity sensor 18a and turns off the second proximity sensor 18b. Also, for example, when the second proximity sensor 18b is selected in step S6 of FIG. 11, the controller 11 turns on the second proximity sensor 18b and turns off the first proximity sensor 18a. Here, the controller 11 may determine the state of the own device using a value output from the acceleration sensor 21. In addition, when one of the first proximity sensor 18a and the second proximity sensor 18b satisfies a predetermined condition (for example, predetermined time elapses, etc.), the controller 11 determines whether the first proximity sensor 18a or the second You may switch to the other of proximity sensor 18b.

  In the above embodiment, in the electronic device 1, the first proximity sensor 18 a is provided on the front, and the second proximity sensor 18 b is provided on the upper surface. Also, as another example, the second proximity sensor 18 b is provided not on the top surface but on the bottom surface or the back surface. Here, the first proximity sensor 18a and the second proximity sensor 18b can be provided on any surface as long as they are different from each other. For example, in the electronic device 1, the first proximity sensor 18 a may be provided on the back surface, and the second proximity sensor 18 b may be provided on the side surface. At this time, the controller 11 may select the output of the other proximity sensor 18 when a predetermined time has elapsed without a gesture input operation based on the output from the one proximity sensor 18. That is, the controller 11 may select the other proximity sensor 18 when a predetermined time elapses without the gesture input operation regardless of the attitude of the electronic device 1.

  In the above embodiment, the electronic device 1 was provided with two proximity sensors 18. Here, the electronic device 1 may be configured to include three or more proximity sensors 18. At this time, the electronic device 1 is configured to have at least two or more surfaces on which the proximity sensor 18 is provided. Three or more proximity sensors 18 may be provided on different planes. Also, for example, two proximity sensors 18 may be provided on the front, and one proximity sensor 18 may be provided on the back. In addition, the three or more proximity sensors 18 may be switched according to a predetermined order, for example, when a predetermined time passes without a gesture input operation.

  The outputs of at least a part of the plurality of proximity sensors 18 provided in the electronic device 1 may be used by the controller 11 to determine the attitude of the electronic device 1. For example, in the diagram of FIG. 10B, the third proximity sensor 18c may be provided on the lower portion of the back surface of the electronic device 1 (the portion held by the user with the right hand). The controller 11 recognizes that the third proximity sensor 18c is covered based on the output from the third proximity sensor 18c. That is, the controller 11 can determine that the electronic device 1 is held by the user and used vertically. By using the output of at least a part of the proximity sensor 18 (in this example, the third proximity sensor 18c), the controller 11 can determine the attitude of the electronic device 1 more accurately. Here, when it is determined that the electronic device 1 is held by the user, the controller 11 moves the icon displayed on the display 14 downward (for example, scrolls) and executes the tap operation with one hand. It may be easy.

  The controller 11 may use the output of the gyro sensor 24 to determine the attitude of the electronic device 1. At this time, the controller 11 can also grasp the change in the direction of the electronic device 1. Further, the controller 11 may use the output of the illuminance sensor 20 to determine the state of its own device. For example, the controller 11 determines that the electronic device 1 is in a pocket or bag when it is determined that the illuminance of ambient light is less than a threshold (for example, 50 lux) based on the output of the illuminance sensor 20. You may

  Many aspects of the present disclosure are presented as a sequence of operations performed by a computer system or other hardware capable of executing program instructions. The computer system and other hardware include, for example, a general-purpose computer, a PC (personal computer), a dedicated computer, and a workstation. Computer systems and other hardware also include PCS (Personal Communications System), mobile (cellular) telephones and mobile telephones with data processing capabilities. Also, computer systems and other hardware include RFID receivers, game consoles, electronic notepads and laptop computers. Also, computer systems and other hardware include GPS (Global Positioning System) receivers and other programmable data processing devices. In each embodiment, the various operations or control methods may be implemented, for example, by dedicated circuitry (eg, separate logic gates interconnected to perform a specific function) implemented in program instructions (software). Please keep in mind. Also, it should be noted that in each embodiment, the various operations or control methods may be implemented by, for example, logical blocks and / or program modules executed by one or more processors. The one or more processors executing the logic block and / or the program module etc. include, for example, one or more microprocessors and a CPU (central processing unit). Moreover, such a processor includes, for example, an application specific integrated circuit (ASIC) and a digital signal processor (DSP). Also, such processors include, for example, a programmable logic device (PLD) and a field programmable gate array (FPGA). Also, such processors include controllers, microcontrollers, microprocessors, electronics, and other devices designed to perform the functions described herein. Also, such processors include combinations of the above embodiments. The illustrated embodiments are implemented by, for example, hardware, software, firmware, middleware, microcode, or any combination thereof. The instructions may be program code or code segments to perform the required tasks. The instructions may then be stored on a machine readable non-transitory storage medium or other medium. A code segment may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class or any combination of instructions, data structures or program statements. A code segment sends and / or receives information, data arguments, variables or stored content with other code segments or hardware circuits, thereby connecting the code segments with other code segments or hardware circuits .

  The storage 16 used here can furthermore be configured as a computer readable tangible carrier (media) comprised in the category of solid state memory, magnetic disks and optical disks. Such media may store suitable sets or data structures of computer instructions such as program modules for causing a processor to perform the techniques disclosed herein. Computer readable media include electrical connections with one or more wires, magnetic disk storage media, magnetic cassettes, magnetic tapes, and other magnetic storage devices. In addition, computer readable media include optical storage devices (for example, CD (Compact Disk), laser disk (registered trademark). Computer readable media include DVD (registered trademark) (Digital Versatile). Disc), floppy (registered trademark) disc and Blu-ray disc (registered trademark)). Computer-readable media also include portable computer disks, random access memories (RAMs) and read-only memories (ROMs). The computer readable medium also includes an erasable programmable read-only memory (EPROM). Also, computer readable media include electrically erasable programmable read-only memory (EEPROM). Computer readable media also include rewritable programmable ROM such as flash memory or other tangible storage media capable of storing information or a combination of any of the above embodiments. Memory may be provided internal and / or external to the processor or processing unit. As used herein, the term "memory" means any kind of long-term storage, short-term storage, volatile, non-volatile or other memory. That is, "memory" is not limited to a particular type and / or number. Also, the type of medium on which the storage is stored is not limited.

REFERENCE SIGNS LIST 1 electronic device 11 controller 12 timer 13 camera 13 a in camera 13 b out camera 14 display 15 microphone 16 storage 17 communication unit 18 proximity sensor 18 a first proximity sensor 18 b second proximity sensor 18 c third proximity sensor 19 UV sensor 20 illuminance Sensor 21 Acceleration sensor 22 Geomagnetic sensor 23 Barometric pressure sensor 24 Gyro sensor 25 Speaker 180 Infrared LED for light source
181 Lenses SU, SR, SD, SL Photodiodes

Claims (3)

A first proximity sensor disposed on the first surface;
A second proximity sensor disposed on a second surface perpendicular to the first surface;
According to the orientation of the own device, the first gesture detection not touching the own device based on the value output from the first proximity sensor, and the own device based on the value output from the second proximity sensor An electronic device comprising: a controller that selects a second gesture detection that is not touched; A first proximity sensor disposed on the first surface for detecting a gesture that does not touch the device itself;
A second proximity sensor disposed on a second surface perpendicular to the first surface, for detecting a gesture that does not touch the device itself;
An electronic device comprising: a controller configured to switch the first proximity sensor or the second proximity sensor according to an orientation of the own device. Further equipped with an acceleration sensor,
The controller
The electronic device according to claim 1, wherein the orientation of the own device is determined using a value output from the acceleration sensor.