JP6163274B1 - Electronic device, program, and control method - Google Patents

Abstract

An electronic device, a program, and a control method with improved operability are provided. When a local device is used based on a proximity sensor, a touch panel display (display), a communication unit, and a gesture detected by the proximity sensor, an incoming call is received by the communication unit. A controller 11 that turns off the detection of a gesture by the proximity sensor 18 when the touch panel display (display 14) is touched and responds. [Selection] Figure 1

Description

  The present invention relates to an electronic device, a program, and a control method.

  For example, electronic devices such as smartphones and tablet terminals generally include a touch panel. A user generally controls such an electronic device by touching a touch panel. 2. Description of the Related Art In recent years, an electronic device that detects a gesture performed by a user away from a terminal using a proximity sensor such as an infrared sensor and performs an input operation corresponding to the gesture is known (for example, Patent Document 1).

Japanese Patent Laying-Open No. 2015-225493

  Here, in an electronic device in which an input operation by a gesture is possible, an input by a gesture and an input by touching a touch panel are generally used in combination. If such an electronic device can be provided with an interface that clearly communicates to the user whether or not an input operation by a gesture is possible, the operability can be further improved.

  An object of the present invention made in view of such circumstances is to provide an electronic device, a program, and a control method with improved operability.

  When an electronic device according to an embodiment of the present invention is using its own device based on a proximity sensor, a touch panel display, a communication unit, and a gesture detected by the proximity sensor, A controller that turns off detection of a gesture by the proximity sensor when a response is made by touching the touch panel display when an incoming call is detected.

  The program according to the embodiment of the present invention uses an electronic device including a proximity sensor, a touch panel display, and a communication unit when the device is used based on a gesture detected by the proximity sensor. If the communication unit detects an incoming call and responds by touching the touch panel display, a step of turning off the gesture detection by the proximity sensor is executed.

  A control method according to an embodiment of the present invention is a method for controlling an electronic device including a proximity sensor, a touch panel display, and a communication unit, and uses the device itself based on a gesture detected by the proximity sensor. If the communication unit detects an incoming call by the communication unit and makes a response by touching the touch panel display, turning off the detection of the gesture by the proximity sensor is included.

  According to one embodiment of the present invention, it is possible to provide an electronic device, a program, and a control method with improved operability.

It is a schematic block diagram of the electronic device which concerns on one Embodiment. It is a figure which illustrates a mode that a user operates an electronic device with gesture. It is a schematic block diagram of a proximity sensor. It is a figure which shows transition of the detected value which each infrared photodiode detects. It is a figure which illustrates the condition of operating an electronic device with a gesture. FIG. 6A to FIG. 6F are diagrams illustrating screen displays of electronic devices. FIG. 7A to FIG. 7D are diagrams illustrating changes in screen display of the electronic device due to contact. It is a flowchart which shows an example of the process which the electronic device which concerns on one Embodiment performs.

(Configuration of electronic equipment)
As shown in FIG. 1, an electronic device 1 according to an embodiment includes a timer 12, a camera 13, a display 14, a microphone 15, a storage 16, a communication unit 17, a speaker 25, and a proximity sensor 18 (gesture sensor). ) And a controller 11. The electronic device 1 further includes a UV sensor 19, an illuminance sensor 20, an acceleration sensor 21, a geomagnetic sensor 22, an atmospheric pressure sensor 23, and a gyro sensor 24. FIG. 1 is an illustration. The electronic device 1 may not include all of the components shown in FIG. Further, the electronic device 1 may include components other than those shown in FIG.

  The timer 12 receives a timer operation instruction from the controller 11 and outputs a signal indicating that to the controller 11 when a predetermined time has elapsed. As shown in FIG. 1, the timer 12 may be provided independently of the controller 11, or may be configured to be built in the controller 11.

  The camera 13 images a subject around the electronic device 1. As an example, the camera 13 is an in-camera provided on a surface on which the display 14 of the electronic device 1 is provided.

  The display 14 displays a screen. The screen includes at least one of, for example, a character, an image, a symbol, and a graphic. The display 14 may be a liquid crystal display, an organic EL panel (Organic Electro-Luminescence Panel), an inorganic EL panel (Inorganic Electro-Luminescence Panel), or the like. In the present embodiment, the display 14 is a touch panel display (touch screen display). The touch panel display detects the contact of a finger or a stylus pen and specifies the contact position. The display 14 can simultaneously detect a plurality of positions touched by a finger or a stylus pen.

  The microphone 15 detects sounds around the electronic device 1 including a voice uttered by a person.

  The storage 16 stores programs and data as a storage unit. The storage 16 temporarily stores the processing result of the controller 11. The storage 16 may include any storage device such as a semiconductor storage device and a magnetic storage device. The storage 16 may include a plurality of types of storage devices. The storage 16 may include a combination of a portable storage medium such as a memory card and a storage medium reading device.

  The programs stored in the storage 16 include an application executed in the foreground or the background and a control program that supports the operation of the application. For example, the application causes the controller 11 to execute processing according to the gesture. The control program is, for example, an OS (Operating System). The application and the control program may be installed in the storage 16 via communication by the communication unit 17 or via a storage medium.

  The communication unit 17 is an interface for communicating by wire or wireless. The communication method performed by the communication unit 17 of one embodiment is a wireless communication standard. For example, the wireless communication standards include cellular phone communication standards such as 2G, 3G, and 4G. For example, communication standards for cellular phones include LTE (Long Term Evolution), W-CDMA (Wideband Code Division Multiple Access), CDMA2000, PDC (Personal Digital Cellular), GSM (registered trademark) (Global System for Mobile communications) and PHS (PHS). Personal Handy-phone System). For example, wireless communication standards include WiMAX (Worldwide Interoperability for Microwave Access), IEEE 802.11, Bluetooth (registered trademark), IrDA (Infrared Data Association), NFC (Near Field Communication), and the like. The communication unit 17 can support one or more of the communication standards described above.

  The speaker 25 outputs sound. For example, the other party's voice is output from the speaker 25 during a call. For example, when reading out news or weather forecasts, the content is output from the speaker 25 as sound.

  The proximity sensor 18 detects the relative distance to the objects around the electronic device 1 and the moving direction of the objects in a non-contact manner. In the present embodiment, the proximity sensor 18 includes one light source infrared LED (Light Emitting Diode) and four infrared photodiodes. The proximity sensor 18 irradiates the target with infrared light from the light source infrared LED. The proximity sensor 18 uses reflected light from the object as incident light of an infrared photodiode. The proximity sensor 18 can measure the relative distance to the object based on the output current of the infrared photodiode. Further, the proximity sensor 18 detects the moving direction of the object based on a time difference in which the reflected light from the object enters each infrared photodiode. Therefore, the proximity sensor 18 can detect an operation using an air gesture (hereinafter simply referred to as “gesture”) performed by the user of the electronic device 1 without touching the electronic device 1. Here, the proximity sensor 18 may have a visible light photodiode.

  The controller 11 is a processor such as a CPU (Central Processing Unit). The controller 11 may be an integrated circuit such as an SoC (System-on-a-Chip) in which other components are integrated. The controller 11 may be configured by combining a plurality of integrated circuits. The controller 11 controls various operations of the electronic device 1 to realize various functions.

  Specifically, the controller 11 refers to data stored in the storage 16 as necessary. The controller 11 implements various functions by executing instructions included in the program stored in the storage 16 and controlling other functional units such as the display 14. For example, the controller 11 acquires contact data from the user from the touch panel. For example, the controller 11 acquires information related to the user's gesture detected by the proximity sensor 18. For example, the controller 11 acquires information such as the remaining countdown time (timer time) from the timer 12. For example, the controller 11 grasps the activation status of the application.

  The UV sensor 19 can measure the amount of ultraviolet rays contained in sunlight or the like.

  The illuminance sensor 20 detects the illuminance of ambient light incident on the illuminance sensor 20.

  The acceleration sensor 21 detects the direction and magnitude of acceleration acting on the electronic device 1. The acceleration sensor 21 is, for example, a three-axis (three-dimensional) type that detects acceleration in the x-axis direction, the y-axis direction, and the z-axis direction. The acceleration sensor 21 may be, for example, a piezoresistive type or a capacitance type.

  The geomagnetic sensor 22 detects the direction of geomagnetism and makes it possible to measure the direction of the electronic device 1.

  The atmospheric pressure sensor 23 detects the atmospheric pressure (atmospheric pressure) outside the electronic device 1.

  The gyro sensor 24 detects the angular velocity of the electronic device 1. The controller 11 can measure the change in the orientation of the electronic device 1 by time-integrating the angular velocity acquired by the gyro sensor 24.

(Operating electronic devices using gestures)
FIG. 2 shows a state in which the user operates the electronic device 1 with a gesture. In FIG. 2, the electronic device 1 is supported by a stand as an example. As an alternative example, the electronic device 1 may be leaned against a wall or placed on a table. When the proximity sensor 18 detects a user gesture, the controller 11 performs processing based on the detected gesture. In the example of FIG. 2, the process based on the gesture is scrolling of the screen on which the recipe is displayed. For example, when the user performs a gesture of moving his / her hand upward in the longitudinal direction of the electronic device 1, the screen scrolls upward in conjunction with the movement of the user's hand. Further, for example, when the user performs a gesture of moving the hand downward in the longitudinal direction of the electronic device 1, the screen scrolls downward in conjunction with the movement of the user's hand.

  The electronic device 1 shown in FIG. 2 is a smartphone. As an alternative example, the electronic device 1 may be, for example, a mobile phone terminal, a Fablet, a tablet PC, or a feature phone. Further, the electronic device 1 is not limited to the above, and may be, for example, a PDA, a remote control terminal, a portable music player, a game machine, an electronic book reader, a car navigation, a home appliance, or an industrial device (FA device).

(Method for detecting gestures)
Here, a method in which the controller 11 detects a user gesture based on the output of the proximity sensor 18 will be described with reference to FIGS. 3 and 4. FIG. 3 is a diagram illustrating a configuration example of the proximity sensor 18 when the electronic apparatus 1 is viewed from the front. The proximity sensor 18 includes a light source infrared LED 180 and four infrared photodiodes SU, SR, SD, and SL. The four infrared photodiodes SU, SR, SD, and SL detect reflected light from the detection target via the lens 181. The four infrared photodiodes SU, SR, SD, and SL are arranged symmetrically when viewed from the center of the lens 181. Here, it is assumed that the virtual line D <b> 1 shown in FIG. 3 is substantially parallel to the longitudinal direction of the electronic device 1. On the virtual line D1 in FIG. 3, the infrared photodiode SU and the infrared photodiode SD are arranged apart from each other. In the direction of the imaginary line D1 in FIG. 3, the infrared photodiodes SR and SL are arranged between the infrared photodiode SU and the infrared photodiode SD.

  FIG. 4 shows the transition of the detection value when the detection objects (for example, the user's hand) of the four infrared photodiodes SU, SR, SD, and SL move along the direction of the virtual line D1 in FIG. Illustrate. Here, the infrared photodiode SU is farthest from the infrared photodiode SD in the direction of the virtual line D1. Therefore, as shown in FIG. 4, the time difference between the change (for example, increase) in the detection value (broken line) of the infrared photodiode SU and the same change (for example, increase) in the detection value (thin solid line) of the infrared photodiode SD. Is the largest. The controller 11 can determine the moving direction of the detection object by grasping the time difference of the predetermined change in the detection values of the photodiodes SU, SR, SD, and SL.

  The controller 11 acquires the detection values of the photodiodes SU, SR, SD, and SL from the proximity sensor 18. Then, the controller 11 integrates, for a predetermined time, a value obtained by subtracting the detection value of the photodiode SU from the detection value of the photodiode SD in order to grasp the movement of the detection object in the direction of the virtual line D1, for example. Also good. In the example of FIG. 4, the integral value is a non-zero value in the regions R41 and R42. From the change in the integrated value (for example, change in positive value, zero, and negative value), the controller 11 can grasp the movement of the detection target in the direction of the virtual line D1.

  Further, the controller 11 may integrate a value obtained by subtracting the detection value of the photodiode SR from the detection value of the photodiode SL in a predetermined time. From this change in integral value (for example, a change in positive value, zero, or negative value), the controller 11 moves the detection target in a direction orthogonal to the virtual line D1 (a direction substantially parallel to the short direction of the electronic device 1). Can be grasped.

  As an alternative example, the controller 11 may perform calculation using all detection values of the photodiodes SU, SR, SD, and SL. That is, the controller 11 may grasp the moving direction of the detection target without calculating the components in the longitudinal direction and the short direction of the electronic device 1.

  The detected gestures include, for example, left and right gestures, up and down gestures, diagonal gestures, gestures that draw a circle in a clockwise direction, and gestures that draw a circle in a counterclockwise direction. For example, the right and left gesture is a gesture performed in a direction substantially parallel to the short direction of the electronic device 1. The upper and lower gestures are gestures performed in a direction substantially parallel to the longitudinal direction of the electronic device 1. The oblique gesture is a gesture performed in a direction that is not parallel to either the longitudinal direction or the short direction of the electronic device 1 on a plane substantially parallel to the electronic device 1.

(Kitchen mode)
FIG. 5 shows an example of a situation where the user operates the electronic device 1 with a gesture. In the example of FIG. 5, the user is cooking according to the recipe in the kitchen while displaying the cooking recipe on the display 14 of the electronic device 1. That is, the controller 11 displays a recipe for cooking when the user is using the device (electronic device 1). At this time, the proximity sensor 18 detects a user's gesture. Then, the controller 11 performs processing based on the gesture detected by the proximity sensor 18. For example, the controller 11 can perform a process of scrolling the recipe according to a specific gesture (for example, a gesture in which the user moves the hand up and down). During cooking, the user's hand may become dirty or wet. However, the user can scroll the recipe without touching the electronic device 1. Therefore, it is possible to avoid the display 14 from becoming dirty and the stain of the display 14 from being transferred to the user's hand during cooking.

  Here, the electronic device 1 has a plurality of modes. The mode means an operation mode (an operation state or an operation state) that restricts the overall operation of the electronic device 1. Only one mode can be selected at a time. In the present embodiment, the mode of the electronic device 1 includes a first mode and a second mode. The first mode is a normal operation mode (normal mode) that is suitable for use in a room other than the kitchen and a place where the user is out. The second mode is an operation mode (kitchen mode) of the electronic device 1 that is optimal for cooking while displaying a recipe in the kitchen. As described above, in the second mode, it is preferable that an input operation by a gesture is possible. That is, when the mode of the electronic device 1 is switched to the second mode, it is preferable to operate the proximity sensor 18 in conjunction with the gesture so that the gesture can be detected. As will be described later, the electronic device 1 according to the present embodiment allows the switching to the second mode (kitchen mode) and the operation of the proximity sensor 18 to be linked when the user taps the icon 30.

(Example of screen display)
FIG. 6A to FIG. 6F show examples of screens displayed on the display 14 of the electronic apparatus 1 according to this embodiment. As described above, in addition to the first mode (normal mode), the electronic device 1 has a second mode (kitchen mode) that is optimal for cooking while displaying the recipe in the kitchen. 6A and 6B, the electronic apparatus 1 operates in the first mode (normal mode). In the screen display of FIG. 6C, FIG. 6D, FIG. 6E, and FIG. 6F, the electronic device 1 operates in the second mode (kitchen mode).

  FIG. 6A shows an example of a screen including a selection button 140 and a selection button 141. The user displays the recipe search screen by tapping the selection button 140 or the selection button 141. And the user can display the recipe which is a search result.

  The selection button 140 is selected when a user searches for a recipe using a Web browser and displays a recipe as a search result. That is, when the user selects the selection button 140, the cooking recipe is displayed on the Web browser. The selection button 141 is selected when the user searches for a recipe using a dedicated application and displays a recipe as a search result. That is, when the user selects the selection button 140, the cooking recipe is displayed by a dedicated application related to the cooking recipe. Here, the dedicated application can obtain the recipe data by accessing the server via the Internet, but some recipe data is already stored in the storage 16 of the electronic device 1. For example, even when the user is in an environment where the communication speed is low, by selecting the selection button 141, the user can quickly search and display the recipe stored in the storage 16 using a dedicated application.

  FIG. 6B shows an example of a screen when the user taps the selection button 140 or the selection button 141 to search for a recipe using a Web browser or a dedicated application, and then displays a recipe as a search result. In the screen of FIG. 6B, an icon 30 is displayed over the recipe. The icon 30 has a shape in which two circles are connected so that a part thereof overlaps. One circle of the icon 30 is slightly larger than the other circle. A pot picture is drawn inside the larger circle of the icon 30. When the controller 11 detects that the icon 30 has been tapped by the user, the controller 11 switches between the first mode and the second mode. When the screen of FIG. 6B is displayed, the electronic device 1 is operating in the first mode (normal mode). When the user taps the icon 30, the mode of the electronic device 1 is switched to the second mode (kitchen mode). When the user taps the icon 30 while the electronic device 1 is operating in the second mode, the mode of the electronic device 1 is switched to the first mode.

  FIG. 6C is a screen example when the user taps the icon 30 and the mode of the electronic device 1 is switched to the second mode (kitchen mode). At this time, the electronic device 1 operates the proximity sensor 18 to detect the user's gesture. The icon 30 displayed on the display 14 is an icon that combines detection of a gesture by the kitchen mode and the proximity sensor 18. When the controller 11 detects contact with the icon 30, the controller 11 starts the kitchen mode and starts detecting the gesture by the proximity sensor 18, and changes the mode of the icon 30. In the example of FIG. 6C, the controller 11 changes the color of the icon 30. The inside of the two circles of the icon 30 changes from white to black. In addition, the controller 11 changes the shape of the icon 30. The pot picture of the icon 30 changes from a closed state to an open state.

  When the screen of FIG. 6C is displayed, the controller 11 controls the screen display based on the user's gesture detected by the proximity sensor 18. For example, when the gesture that moves the hand in the vertical direction is detected by the proximity sensor 18, the controller 11 performs an operation of scrolling the screen on which the recipe is displayed. Further, for example, when the gesture of holding the hand for a predetermined time such as 1 second is detected by the proximity sensor 18, the controller 11 switches the display of the recipe to the display of the timer screen. In addition, when the controller 11 detects an incoming call by the communication unit 17 while the cooking recipe is displayed in the second mode (kitchen mode), the gesture detected by the proximity sensor 18 as described below. Respond based on

(Incoming calls and calls in the second mode)
FIG. 6D shows an example of a screen when there is an incoming call. When an incoming call is received, the controller 11 switches from the recipe display screen of FIG. 6C to the incoming screen of FIG. 6D. In the screen example of FIG. 6D, the caller's image, name, and telephone number are displayed on the display 14. In addition, a guide is displayed on the display 14 indicating that the user's hand can respond with a gesture that moves the hand from left to right. The user can answer the call with a gesture that moves the hand from left to right. At this time, the controller 11 operates the microphone 15 and the speaker 25 to enable a hands-free call. Here, the controller 11 returns the screen to the recipe display screen of FIG. 6C when it is determined that a predetermined time (for example, 15 seconds) has passed without the user answering the telephone. Further, the controller 11 cancels the call based on the gesture detected by the proximity sensor 18. For example, when the gesture of holding the hand for a predetermined time (for example, 3 seconds) is detected by the proximity sensor 18, the controller 11 cancels the call and returns the screen to the recipe display screen of FIG. At this time, the controller 11 may activate the message memo and record the other party's message.

  FIG. 6E shows an example of a screen when the user responds to an incoming call. When the proximity sensor 18 detects a gesture for moving the hand from left to right, the controller 11 switches from the incoming call screen in FIG. 6D to the busy screen in FIG. 6E. In the screen example of FIG. 6E, the caller's image, name, phone number, and call time are displayed small on the display 14. In addition, a guide is displayed on the display 14 indicating that the call can be ended (end of call) by a gesture in which the user holds his hand. The controller 11 returns the screen to the recipe display screen of FIG. 6C when the proximity sensor 18 detects a gesture of holding the hand for a predetermined time (for example, 3 seconds).

  FIG. 6F shows an example of a screen when the user adjusts the volume during a call. The controller 11 changes the call volume based on the gesture detected by the proximity sensor 18. For example, when the gesture for moving the hand up and down is detected by the proximity sensor 18, the controller 11 switches from the in-call screen of FIG. 6 (e) to the call volume screen of FIG. 6 (f). In the screen example of FIG. 6 (f), a slide bar indicating the call volume is displayed on the display 14. Further, a guide is displayed on the display 14 indicating that the volume is increased by a gesture in which the user moves the hand from the bottom to the top, and that the volume is decreased by a gesture in which the user moves the hand from the top to the bottom. When the controller 11 determines that a predetermined time (for example, 3 seconds) has elapsed without making a gesture for adjusting the volume, the controller 11 returns the screen to the in-call screen of FIG.

(Stop gesture detection)
Here, FIG. 7A is a diagram for explaining the incoming screen in the second mode (kitchen mode) shown in FIG. 6D in more detail. As shown in FIG. 7A, a switching button 150 for stopping the gesture detection and switching to an input operation by touching the touch panel display (display 14) is provided at the bottom of the incoming call screen in the second mode. ing. The incoming call screen is displayed on the full screen. The full screen is the entire area of the display 14 excluding the notification bar 160. Here, the notification bar 160 is a band-like region indicated by black at the top of the display 14. As shown in FIG. 7A, a hand-shaped pictograph 170 (pictogram) indicating that the proximity sensor 18 can detect a gesture is displayed on the notification bar 160. In addition, the current time is displayed on the notification bar 160. The notification bar 160 may further display, for example, another pictograph indicating a radio wave state, a manner mode, a battery charging state, and the like.

  When the communication unit 17 detects an incoming call when the user is using his / her own device (electronic device 1) based on the gesture detected by the proximity sensor 18, the screen shown in FIG. 7A is displayed. The When the user responds by touching the switching button 150 of the touch panel display (display 14), the controller 11 turns off the gesture detection by the proximity sensor 18.

  The controller 11 turns off the gesture detection by the proximity sensor 18 and switches the input operation method to touching the touch panel. The electronic device 1 operates in the first mode (normal mode). And the controller 11 displays the screen of FIG.7 (b). FIG. 7B shows the incoming screen in the first mode. On the incoming call screen of FIG. 7 (b), a guide is displayed indicating that the user can answer the call by a contact operation (slide operation) from left to right.

  When the detection of the gesture by the proximity sensor 18 is turned on, the controller 11 displays a pict 170 on the notification bar 160 on the touch panel display (display 14). Then, when the detection of the gesture by the proximity sensor 18 is turned off, the controller 11 hides the pictogram 170 on the notification bar 160 on the touch panel display (display 14). In the screen of FIG. 7B, the hand-shaped pictogram 170 (pictogram) is not displayed on the notification bar 160. Since the pictogram 170 is not displayed on the notification bar 160, the user can visually grasp that the detection of the gesture by the proximity sensor 18 is not on (effective).

  FIG.7 (c) is a figure for demonstrating in detail the screen during a call of the 2nd mode (kitchen mode) shown in FIG.6 (e). As shown in FIG. 7C, a switching button 150 for stopping the gesture detection and switching to an input operation by touching the touch panel display (display 14) is provided at the bottom of the second mode call screen. It has been. In addition, the screen during a call is displayed on the full screen (all areas of the display 14 excluding the notification bar 160). As shown in FIG. 7C, the notification bar 160 displays a pictogram 170 and the current time.

  When the user taps the switch button 150 of the touch panel display (display 14) on the screen of FIG. 7C, the controller 11 turns off the detection of the gesture by the proximity sensor 18.

  The controller 11 turns off the gesture detection by the proximity sensor 18 and switches the input operation method to touching the touch panel. The electronic device 1 operates in the first mode (normal mode). And the controller 11 displays the screen of FIG.7 (d). FIG. 7D is a screen during a call in the first mode of the electronic device 1. A notification that the hands-free call has ended and the speaker 25 is turned off is displayed on the in-call screen of FIG. In addition, the in-call screen of FIG. 7D displays that the user can end the call (end call) by an operation (tap operation) for touching the call end icon. Here, other icons such as an icon for displaying a dial key, an icon for turning on the speaker 25 again, and the like may be displayed on the in-call screen of FIG.

  Further, in the screen of FIG. 7D, the notification bar 160 does not display a hand-shaped pictograph 170 (pictogram). Since the pictogram 170 is not displayed on the notification bar 160, the user can visually recognize that the proximity sensor 18 is turned off (invalid). Here, the display or non-display of the pictograph 170 is linked with the ON (valid) or OFF (invalid) detection of the gesture by the proximity sensor 18. When the proximity sensor 18 is operating, but not detecting a gesture, for example, when detecting a relative distance to a surrounding object, the pict 170 is not displayed.

(flowchart)
FIG. 8 is a flowchart illustrating an example of processing (control method) executed by the controller 11 of the electronic apparatus 1 according to the present embodiment. The flowchart of FIG. 8 shows a screen switching process when there is an incoming call when the electronic device 1 is in the second mode (kitchen mode) and displaying a recipe.

  If the communication unit 17 does not detect an incoming call (No in step S1), the controller 11 waits for an incoming call while displaying the recipe on the display 14. When the communication unit 17 detects an incoming call (Yes in Step S1), the controller 11 displays a second mode incoming screen (Step S2). The incoming screen in the second mode is, for example, the screen shown in FIG. At this time, since the gesture detection by the proximity sensor 18 is on (valid), the pictogram 170 is displayed.

  The controller 11 performs the process of step S4, when the contact to the touch panel display (display 14) by a user is not detected (No of step S3). That is, when the proximity sensor 18 detects a gesture associated with the incoming call response (Yes in step S4), the controller 11 displays the second mode call screen (step S5). The screen during a call in the second mode is, for example, the screen of FIG. At this time, since the gesture detection by the proximity sensor 18 is on (valid), the pictogram 170 is displayed. In the present embodiment, the gesture associated with the response is a gesture for moving the user's hand from left to right.

  When the proximity sensor 18 does not detect the gesture associated with the incoming response (No in step S4), the controller 11 returns to the process in step S3.

  After displaying the second mode call screen (step S5), the controller 11 executes the process of step S6. That is, the controller 11 performs the process of step S11, when the contact to the touch panel display (display 14) by a user is detected (Yes of step S6). In the present embodiment, the touch on the touch panel display is a tap on the switching button 150.

  The controller 11 performs the process of step S7, when not detecting the contact to the touch panel display (display 14) by a user (No of step S6). That is, the controller 11 displays the recipe in the second mode when the proximity sensor 18 detects a gesture associated with the end story or detects the other party's end story (Yes in step S7) (step S8). A series of processing ends. Here, the screen for displaying the recipe in the second mode is, for example, the screen of FIG. The gesture associated with the end story is, for example, a gesture of holding the user's hand for a predetermined time (for example, 3 seconds). Further, the controller 11 detects the end of the call partner through the communication unit 17.

  When the proximity sensor 18 does not detect the gesture associated with the end story and does not detect the other party's end story (No in step S7), the controller 11 returns to the process of step S6.

  When the controller 11 detects a touch on the touch panel display (display 14) by the user after displaying the incoming screen in the second mode (step S2) (Yes in step S3), the controller 11 executes the process of step S9. In the present embodiment, the touch on the touch panel display is a tap on the switching button 150.

  The controller 11 displays the incoming screen in the first mode as the process of step S9. The incoming screen in the first mode is, for example, the screen shown in FIG. At this time, since the gesture detection by the proximity sensor 18 is off (invalid), the pictogram 170 is not displayed.

  When the controller 11 detects a contact associated with the incoming call response (Yes in step S10), the controller 11 displays a screen during the call in the first mode (step S11). The screen during a call in the first mode is, for example, the screen of FIG. At this time, since the gesture detection by the proximity sensor 18 is off (invalid), the pictogram 170 is not displayed. In the present embodiment, the contact operation associated with the incoming response is a contact operation (slide operation) from left to right.

  When the controller 11 does not detect the contact associated with the incoming response (No in Step S10), the controller 11 waits until the contact associated with the incoming response is detected.

  After the controller 11 displays the first mode call screen (step S11), the controller 11 executes the process of step S12. That is, the controller 11 displays a recipe in the first mode (step S13) and terminates the series of processes when the contact associated with the end story or the other party's end story is detected (Yes in step S12). . Here, the screen for displaying the recipe in the first mode is, for example, the screen of FIG. The contact operation associated with the end story is, for example, an operation (tap operation) for touching the end story icon.

  Further, when there is no contact associated with the end talk and the other party's end talk is not detected (No in step S12), the controller 11 detects the contact associated with the end talk or the other party's end talk. stand by.

  As described above, the electronic device 1 according to the present embodiment uses its own device based on the proximity sensor 18, the display 14 that is a touch panel display, the communication unit 17, and the gesture detected by the proximity sensor 18. If the communication unit 17 detects an incoming call by the communication unit 17 and responds by touching the touch panel display, the controller 11 turns off the detection of the gesture by the proximity sensor 18. Even if the electronic device 1 uses an input operation based on a gesture, the electronic device 1 turns off gesture detection when the user touches the touch panel display. At this time, since the user's contact with the display 14 is a trigger for switching the input operation, the user can clearly grasp that the detection of the gesture has been turned off. Therefore, the operability of the electronic device 1 according to the present embodiment is improved as compared with the related art.

  In addition, the electronic apparatus 1 according to the present embodiment uses the pictogram 170 that is displayed or hidden in conjunction with the on (valid) or off (invalid) detection of the gesture by the proximity sensor 18. Therefore, the user can visually grasp the state of gesture detection by the proximity sensor 18 by the pictogram 170. Therefore, the operability of the electronic device 1 according to the present embodiment is further improved.

(Other embodiments)
Although the present invention has been described based on the drawings and embodiments, it should be noted that those skilled in the art can easily make various variations and modifications based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present invention. For example, functions included in each means or each step can be rearranged so as not to be logically contradictory, and a plurality of means or steps can be combined into one or divided. .

  Many aspects of the present disclosure are presented as a series of operations performed by a computer system or other hardware capable of executing program instructions. The computer system and other hardware include, for example, a general-purpose computer, a PC (personal computer), a dedicated computer, a workstation, a PCS (Personal Communications System), a mobile (cellular) telephone, and a data processing function. Mobile phones, RFID receivers, game consoles, electronic notepads, laptop computers, GPS (Global Positioning System) receivers or other programmable data processing devices are included. In each embodiment, various operations or control methods are performed by dedicated circuitry (eg, individual logic gates interconnected to perform specific functions) implemented by program instructions (software), one or more processors. Note that it is executed by a logical block and / or a program module. The one or more processors that execute logic blocks and / or program modules include, for example, one or more microprocessors, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), and a PLD. (Programmable Logic Device), FPGA (Field Programmable Gate Array), processor, controller, microcontroller, microprocessor, electronic equipment, other devices designed to perform the functions described herein, and / or any combination thereof Is included. The embodiments shown here are implemented by, for example, hardware, software, firmware, middleware, microcode, or any combination thereof. The instructions may be program code or code segments for performing the necessary tasks. The instructions can then be stored on a machine-readable non-transitory storage medium or other medium. A code segment may represent any combination of procedures, functions, subprograms, programs, routines, subroutines, modules, software packages, classes or instructions, data structures or program statements. A code segment transmits and / or receives information, data arguments, variables or stored contents with other code segments or hardware circuits, thereby connecting the code segments with other code segments or hardware circuits .

  The storage 16 used here can be further configured as a computer-readable tangible carrier (medium) composed of solid state memory, magnetic disk and optical disk. Such a medium stores an appropriate set of computer instructions or a data structure such as a program module for causing a processor to execute the technology disclosed herein. Computer readable media include electrical connections with one or more wires, magnetic disk storage media, magnetic cassettes, magnetic tape, and other magnetic and optical storage devices (eg, CD (Compact Disk), laser disks ( (Registered trademark), DVD (registered trademark) (Digital Versatile Disc), floppy (registered trademark) disk and Blu-ray Disc (registered trademark)), portable computer disk, RAM (Random Access Memory), ROM (Read-Only Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, rewritable and programmable ROM, other tangible storage media capable of storing information, or any combination thereof Is included. The memory can be provided inside and / or outside the processor or processing unit. As used herein, the term “memory” means any kind of long-term storage, short-term storage, volatile, non-volatile or other memory. That is, the “memory” is not limited to a specific type and / or number. Further, the type of medium in which the storage is stored is not limited.

DESCRIPTION OF SYMBOLS 1 Electronic device 11 Controller 12 Timer 13 Camera 14 Display 15 Microphone 16 Storage 17 Communication unit 18 Proximity sensor 19 UV sensor 20 Illuminance sensor 21 Acceleration sensor 22 Geomagnetic sensor 23 Air pressure sensor 24 Gyro sensor 25 Speaker 30 Icon 140, 141 Selection button 150 Switching Button 160 Notification bar 170 Pict 180 Infrared LED for light source
181 Lens SU, SR, SD, SL Photodiode

Claims (7)

A proximity sensor;
A touch panel display,
A communication unit;
When using the device without touching the device based on the gesture detected by the proximity sensor, when the communication unit detects an incoming phone call and responds by touching the touch panel display An electronic device comprising: a controller that turns off detection of a gesture by the proximity sensor. The controller is
The electronic device according to claim 1, wherein a recipe for cooking is displayed when the device is used. The controller is
When gesture detection by the proximity sensor is turned on, a pictograph is displayed on the touch panel display,
The electronic device according to claim 1, wherein when the detection of the gesture by the proximity sensor is turned off, the pictograph is not displayed on the touch panel display.   The electronic device according to claim 3, wherein the pictograph is displayed on a notification bar. In an electronic device comprising a proximity sensor, a touch panel display, and a communication unit,
When using the device without touching the device based on the gesture detected by the proximity sensor, when the communication unit detects an incoming phone call and responds by touching the touch panel display And a step of turning off the detection of gestures by the proximity sensor. A method for controlling an electronic device comprising a proximity sensor, a touch panel display, and a communication unit,
When using the device without touching the device based on the gesture detected by the proximity sensor, when the communication unit detects an incoming phone call and responds by touching the touch panel display And turning off detection of gestures by the proximity sensor. A proximity sensor;
A touch panel display;
A communication unit;
The gesture detected by the proximity sensor among the case of using the own device in contact with the touch panel display and the case of using the own device without touching the own device based on the gesture detected by the proximity sensor. In the case of using the device without touching the device based on the response, if the communication unit detects a call incoming and responds by touching the touch panel display, the proximity sensor detects the gesture. An electronic device comprising a controller for turning off.

Images