JP6152334B2 - Electronic device, control method, and control program - Google Patents

Description

  The present application relates to an electronic device, a control method, and a control program.

  Touch screen devices comprising a touch screen are known. Examples of touch screen devices include, but are not limited to, electronic devices such as mobile phones, smartphones, and tablets. The touch screen device detects a finger, pen, or stylus pen gesture via the touch screen. The touch screen device operates according to the detected gesture. An example of the operation according to the detected gesture is described in Patent Document 1, for example.

  The basic operation of the touch screen device is realized by an OS (Operating System) installed in the device. Examples of the OS installed in the touch screen device include, but are not limited to, Android (registered trademark), BlackBerry (registered trademark) OS, iOS, Symbian (registered trademark) OS, and Windows (registered trademark) Phone.

  In recent years, among the above-mentioned electronic devices, those that change the aspect ratio of the display area to a size different from that of the conventional product are becoming popular.

International Publication No. 2008/086302

  There is a need to improve the convenience of user operations as much as possible according to the development trend of products such as changing the aspect ratio of the display area.

  An electronic device according to one aspect includes a touch screen display including a first area in which a first image is displayed and a second area in which the first image and the second image are superimposed and displayed. And a controller that transmits the second image and displays the first image when a touch operation received in the first region via the touch screen approaches the second region. Have.

  A control method according to one aspect includes a first area in which a first image is displayed and a second area in which the first image and the second image are superimposed and displayed. A step of receiving a touch operation on the first area via the touch screen; and when the touch operation approaches the second area, And displaying the first image through two images.

  A control program according to one aspect includes a first area in which a first image is displayed and a second area in which the first image and the second image are superimposed and displayed. A step of accepting a touch operation on the first area via the touch screen to an electronic device having the above, and transmitting the second image when the touch operation approaches the second area. Displaying the first image.

FIG. 1 is a block diagram illustrating a functional configuration of the smartphone according to the present embodiment. FIG. 2 is a diagram illustrating an example of control of the smartphone according to the present embodiment. FIG. 3 is a diagram illustrating an example of the first image. FIG. 4 is a flowchart showing the flow of processing by the smartphone according to the present embodiment. FIG. 5 is a diagram illustrating another example of the control executed by the smartphone.

  Embodiments for carrying out the present invention will be described in detail with reference to the drawings. Below, a smart phone is demonstrated as an example of the electronic device which concerns on this invention.

(Embodiment)
An example of a functional configuration of the smartphone 1 according to the present embodiment will be described. FIG. 1 is a block diagram illustrating a functional configuration of the smartphone according to the present embodiment. In the following description, the same code | symbol may be attached | subjected to the same component. Furthermore, duplicate descriptions may be omitted.

  As shown in FIG. 1, the smartphone 1 includes a touch screen display 2, a button 3, an illuminance sensor 4, a proximity sensor 5, a communication unit 6, a receiver 7, a microphone 8, a storage 9, and a controller 10. A speaker 11, a camera 12, a posture detection unit 15, and a vibrator 18.

  The touch screen display 2 includes a display 2A and a touch screen 2B. The display 2 </ b> A and the touch screen 2 </ b> B may be arranged, for example, may be arranged side by side, or may be arranged apart from each other. When the display 2A and the touch screen 2B are arranged so as to overlap each other, for example, one or more sides of the display 2A may not be along any side of the touch screen 2B.

  The display 2A includes a liquid crystal display (LCD: Liquid Crystal Display), an organic EL display (OELD: Organic Electro-Luminescence Display), or an inorganic EL display (IELD: Inorganic Electro-Luminescence Display). The display 2A displays characters, images, symbols, graphics, and the like. The screen including characters, images, symbols, graphics, and the like displayed on the display 2A includes a screen called a lock screen, a screen called a home screen, and an application screen displayed during execution of the application. The home screen may be called a desktop, a standby screen, an idle screen, a standard screen, an application list screen, or a launcher screen.

  In the present embodiment, an image such as a home screen is displayed on the display 2A, and an image such as a home screen and an image corresponding to various applications are superimposed and displayed. In the following description, an image such as a home screen is referred to as a first image, an area on the display 2A (touch screen display 2) on which the first image is displayed is referred to as a first area, and corresponds to various applications. An image to be displayed is referred to as a second image, and an area in the display 2A (touch screen display 2) on which the first image and the second image are superimposed and displayed is referred to as a second area.

  The touch screen 2B detects contact of a finger, a pen, a stylus pen, or the like with respect to the touch screen 2B. The touch screen 2B can detect a position where a plurality of fingers, a pen, a stylus pen or the like (hereinafter simply referred to as “finger”) contacts the touch screen 2B. The touch screen 2B notifies the controller 10 of the contact of the finger with the touch screen 2B (touch screen display 2) together with the position on the touch screen display 2 of the touched location. In the first embodiment, the touch screen 2B notifies the controller 10 of the finger contact with the character input screen displayed on the display 2A and the position on the character input screen.

  The detection method of the touch screen 2B may be any method such as a capacitance method, a resistive film method, a surface acoustic wave method (or an ultrasonic method), an infrared method, an electromagnetic induction method, and a load detection method. In the following description, in order to simplify the description, it is assumed that the user uses the finger to touch the touch screen 2B in order to operate the smartphone 1.

  The controller 10 (smart phone 1) has at least one of the contact detected by the touch screen 2B, the position at which the contact is detected, the change in the position at which the contact is detected, the interval at which the contact is detected, and the number of times the contact is detected. The type of gesture is determined based on the one. The gesture is an operation performed on the touch screen 2B (touch screen display 2) using a finger. The gestures that the controller 10 (smart phone 1) determines via the touch screen 2B include, for example, touch, long touch, release, swipe, tap, double tap, long tap, drag, flick, pinch in, and pinch out. However, it is not limited to these.

  The button 3 receives an operation input from the user. The number of buttons 3 may be singular or plural.

  The illuminance sensor 4 detects the illuminance of the ambient light of the smartphone 1. Illuminance indicates light intensity, brightness, or luminance. The illuminance sensor 4 is used for adjusting the luminance of the display 2A, for example.

  The proximity sensor 5 detects the presence of a nearby object without contact. The proximity sensor 5 detects the presence of an object based on a change in a magnetic field or a change in a feedback time of an ultrasonic reflected wave. For example, the proximity sensor 5 detects that the display 2A is brought close to the face. The illuminance sensor 4 and the proximity sensor 5 may be configured as one sensor. The illuminance sensor 4 may be used as a proximity sensor.

  The communication unit 6 communicates wirelessly. The wireless communication standards supported by the communication unit 6 include, for example, cellular phone communication standards such as 2G, 3G, and 4G, and short-range wireless communication standards. Cellular phone communication standards include, for example, LTE (Long Term Evolution), W-CDMA (Wideband Code Division Multiple Access), WiMAX (Worldwide PDA), WiMAX (Worldwide Interoperability Pc), WiMAX (Worldwide PDA). ) (Global System for Mobile Communications), PHS (Personal Handy-phone System), and the like. Examples of short-range wireless communication standards include IEEE 802.11, Bluetooth (registered trademark), IrDA (Infrared Data Association), NFC (Near Field Communication), and WPAN (Wireless Personal Area Network). As a communication standard of WPAN, for example, there is ZigBee (registered trademark). The communication unit 6 may support one or more of the communication standards described above.

  The communication unit 6 receives a radio signal in a predetermined frequency band from a GPS satellite, demodulates the received radio signal, and sends the processed signal to the controller 10. The smartphone 1 may disperse the communication function with the GPS satellite from the communication unit 6 and provide an individual communication unit independent from the communication unit 6.

  The receiver 7 is a sound output unit. The receiver 7 outputs the sound signal transmitted from the controller 10 as sound. The receiver 7 is used, for example, to output the other party's voice during a call. The microphone 8 is a sound input unit. The microphone 8 converts the user's voice or the like into a sound signal and transmits the sound signal to the controller 10.

  The storage 9 stores programs and data. The storage 9 is also used as a work area for temporarily storing the processing result of the controller 10. The storage 9 may include any non-transitory storage medium such as a semiconductor storage medium and a magnetic storage medium. The storage 9 may include a plurality of types of storage media. The storage 9 may include a combination of a portable storage medium such as a memory card, an optical disk, or a magneto-optical disk and a storage medium reader. The storage 9 may include a storage device used as a temporary storage area such as a RAM (Random Access Memory).

  The programs stored in the storage 9 include an application executed in the foreground or the background and a control program that supports the operation of the application. An application executed in the foreground displays a screen on the display 2A, for example. The control program includes an OS, for example. The application and the control program may be installed in the storage 9 via wireless communication by the communication unit 6 or a non-transitory storage medium.

  The storage 9 stores a control program 9A, a call application 9B, a mail application 9C, a browser application 9D, a camera application 9E, a voice input application 9F, a software key application 9G, setting data 9Z, and the like.

  The control program 9A provides functions related to various controls for operating the smartphone 1. For example, when the touch operation received in the first area via the touch screen 2B approaches the second area, the control program 9A transmits the second image and displays the first image. Provide functionality.

  In addition, the control program 9A controls the communication unit 6 and the like, thereby enabling LTE (Long Term Evolution), W-CDMA (Wideband Code Division Multiple Access), WiMAX (Worldwide InterCirability), WiMAX (World Wide Pc). Cellular, GSM (registered trademark) (Global System for Mobile Communications), PHS (Personal Handy-phone System), etc., functions for realizing communication, IEEE802.11, Bluetooth (registered trademark), IrDA (registered trademark) A function for realizing short-range wireless communication using FRED Data Association (NFC), NFC (Near Field Communication), WPAN (Wireless Personal Area Network), and the like, and the communication unit 6 and the microphone 8 are controlled. Provides functions for realizing

  The functions provided by the control program 9A may be used in combination with functions provided by other programs stored in the storage 9, such as the call application 9B or the mail application 9C, when realizing a call. The function provided by the control program 9A may be divided into a plurality of program modules, or may be combined with other programs.

  The call application 9B provides a call function for a call by wireless communication. The mail application 9C provides an email function for creating, sending, receiving, and displaying an email. The browser application 9D provides a WEB browsing function for displaying a WEB page. The camera application 9E provides a function for taking, editing, and managing images and moving images. The voice input application 9F provides a function for recognizing voice input by a microphone and executing processing based on the recognition result. The software key application 9G provides a function for displaying a software key on the display 2A and receiving a character input via the software key. The setting data 9Z includes information related to various settings related to the operation of the smartphone 1. In the present embodiment, the setting data 9Z stores, for example, application settings corresponding to images to be displayed on the home screen. The application stored in the storage 9 is only an example. In addition to those shown in FIG. 1, a calendar application, a memo application, a navigation application, a music player application, a moving image reproduction application, a computer application, a tag application, and the like may be stored.

  The controller 10 is an arithmetic processing device. The arithmetic processing unit includes, for example, a CPU (Central Processing Unit), an SoC (System-on-a-chip), an MCU (Micro Control Unit), and an FPGA (Field-Programmable Gate Array), but is not limited thereto. The controller 10 controls various operations of the smartphone 1 to realize various functions.

  Specifically, the controller 10 executes instructions included in the program stored in the storage 9 while referring to the data stored in the storage 9 as necessary. And the controller 10 controls a function part according to data and a command, and implement | achieves various functions by it. The functional unit includes, for example, the display 2A, the communication unit 6, the microphone 8, and the speaker 11, but is not limited thereto. The controller 10 may change the control according to the detection result of the detection unit. The detection unit includes, for example, the touch screen 2B, the button 3, the illuminance sensor 4, the proximity sensor 5, the microphone 8, the camera 12, and the posture detection unit 15, but is not limited thereto.

  For example, by executing the control program 9A, the controller 10 transmits the second image and transmits the second image when the touch operation received in the first area via the touch screen 2B approaches the second area. Processing for displaying one image is executed.

  The speaker 11 is a sound output unit. The speaker 11 outputs the sound signal transmitted from the controller 10 as sound. The speaker 11 is used for outputting a ring tone and music, for example. One of the receiver 7 and the speaker 11 may also function as the other.

  The camera 12 converts the captured image into an electrical signal. The camera 12 includes, for example, an in-camera that captures an object facing the display 2A, and an out-camera that captures an object facing the opposite surface of the display 2A.

  The posture detection unit 15 detects the posture of the smartphone 1. The posture detection unit 15 includes at least one of an acceleration sensor, a direction sensor, and a gyroscope in order to detect the posture. The posture detection unit 15 detects, for example, the posture of the smartphone 1 based on detection results of an acceleration sensor, a direction sensor, a gyroscope, and the like.

  The vibrator 18 vibrates a part or the whole of the smartphone 1. The vibrator 18 includes, for example, a piezoelectric element or an eccentric motor in order to generate vibration. The vibration by the vibrator 18 is used to notify the user of various events such as incoming calls.

  Next, an example of control executed by the smartphone 1 according to the present embodiment will be described using FIG. FIG. 2 is a diagram illustrating an example of control of the smartphone 1 according to the present embodiment.

  As illustrated in FIG. 2, the smartphone 1 causes the touch screen display 2 to display a home screen including a first image G1 and a second image G2 superimposed and displayed on the first image G1 (step S11). FIG. 3 is a diagram illustrating an example of the first image. As shown in FIG. 3, the first image G1 includes a wallpaper image set for the home screen and a plurality of icon images set for the home screen. The second image is composed of a widget image corresponding to the voice input application 9F, for example.

  Subsequently, when the smartphone 1 detects a touch operation on the first area A1 on the touch screen display 2 on which the first image G1 is displayed via the touch screen 2B, the detected touch operation is the first It is determined whether the image G1 and the second image G2 are close to the second area A2 where the images are superimposed (step S12). The touch operation corresponds to a touch gesture in which a finger does not leave the touch screen display 2, such as a long touch and a drag.

  If the result of determination is that the touch operation has approached the second area A2, the smartphone 1 transmits the second image G2 and displays the first image G1 in the second area A2 (step S13). ). In the example illustrated in FIG. 2, the second image G2 is transmitted, so that the image on the home screen and the icon image arranged on the home screen are displayed in a visible state through the second image G2. .

  When the release is detected, the smartphone 1 returns to the home screen display shown in step S11 again.

  The flow of processing by the smartphone 1 according to this embodiment will be described with reference to FIG. FIG. 4 is a flowchart showing a flow of processing by the smartphone 1 according to the present embodiment. The processing shown in FIG. 4 is realized by the controller 10 executing a control program 9A stored in the storage 9.

  As shown in FIG. 4, the controller 10 displays a home screen including a first image G1 and a second image G2 superimposed on the first image G1 on the touch screen display 2 (step S101).

  Subsequently, the controller 10 determines whether a touch operation is detected in the first area A1 on the touch screen display that displays the first image G1 (step S102).

  When the touch operation is detected in the first area A1 as a result of the determination (step S102, Yes), the controller 10 subsequently detects that the detected touch operation is the second area A2 on the touch screen display 2. Is determined (step S103).

  As a result of the determination, when the touch operation has approached the second area A2 (Yes in step S103), the controller 10 displays the second image G2 displayed in the second area A2 in the second area A2. By transmitting the first image G1, the first image G1 is displayed (step S104).

  Subsequently, the controller 10 determines whether the touch operation has been completed (whether release has been detected) (step S105).

  When the touch operation is completed as a result of the determination (Yes in step S105), the controller 10 redisplays the same home screen as that in step S101 on the touch screen display 2 (step S106), and performs the processing shown in FIG. finish. That is, the controller 10 returns to the display of the home screen that does not transmit the second image G2 superimposed and displayed on the first image G1.

  In step S103, if the result of determination is that the touch operation does not approach the second area A2 (step S103, No), then whether the touch operation has ended (whether release has been detected). Is determined (step S107).

  If the result of determination is that the touch operation has ended (step S107, Yes), the controller 10 ends the processing shown in FIG. On the contrary, if the result of determination is that the touch operation has not ended (No at step S107), the controller 10 returns to the processing procedure at step S103.

  In step S102, if the result of determination is that a touch operation is not detected in the first area A1 (step S102, No), the controller 10 ends the processing shown in FIG.

(Other embodiments)
Another example of the control executed by the smartphone 1 will be described with reference to FIG. FIG. 5 is a diagram illustrating another example of the control executed by the smartphone 1.

  As shown in FIG. 5, the smartphone 1 causes the touch screen display 2 to display a home screen including an object Q1, a first image G3, and a second image G4 superimposed and displayed on the first image G3 ( Step S21). The object Q1 is an object such as an icon corresponding to the application. The first image G3 is, for example, a wallpaper set on the home screen. The second image G4 is an image corresponding to the software key application 9G. In the example illustrated in FIG. 5, the home screen in which the second image G4 is superimposed on the first image G3 is displayed on the touch screen display 2.

  Subsequently, when the smartphone 1 detects a touch and a drag on the object Q1 (step S22 and step S23), the object Q1 is displayed in the second area A2 where the first image G3 and the second image G4 are displayed in a superimposed manner. In contrast, it is determined whether or not the vehicle has approached a predetermined distance. In the example illustrated in FIG. 5, the object Q1 on which the touch and drag operations are performed moves in the first area A1 where only the first image G3 is displayed.

  As a result of the determination, the smartphone 1 starts transmission of the second image G4 when the object Q1 has approached the second area A2 up to a predetermined distance (step S24). Subsequently, the smartphone 1 gradually increases the degree of transmitting the second image as the distance between the object Q1 and the second region A2 becomes shorter, and detects the contact between the object Q1 and the second image G4. Thus, the second image G4 is completely transmitted to display the first image G3 (step S25). In the example shown in FIG. 5, the trash can icon Q2 arranged on the first image G3 is displayed through the transmitted second image.

  When the smartphone 1 detects contact between the object Q1 and the trash can icon Q2 arranged on the first image G3 (step S26), the smartphone 1 deletes the object Q1 from the home screen, and in response to detection of release, The home screen in which the second image G4 that has not been transmitted is superimposed and displayed on the first image G3 is displayed again (step S27).

  In the above embodiment, when the smartphone 1 has the second area in which the first image and the second image are superimposed and displayed on the touch screen display 2, the position of the touch operation of the user is the second. When approaching the area, the second image is transmitted and the first image is displayed. For this reason, according to the above embodiment, even if there is a second area where the first image and the second image are superimposed and displayed on the touch screen display 2, Annoyance can be reduced, and as a result, the convenience of the user's operation can be improved as much as possible.

  In the above embodiment, a smartphone has been described as an example of an apparatus according to the appended claims, but the apparatus according to the appended claims is not limited to a smartphone. The device according to the appended claims may be a device other than a smartphone as long as it is an electronic device such as a mobile phone or a tablet having a touch screen function.

  The characterizing embodiments have been described in order to fully and clearly disclose the technology according to the appended claims. However, the appended claims should not be limited to the above-described embodiments, but all modifications and alternatives that can be created by those skilled in the art within the scope of the basic matters shown in this specification. Should be embodied by a possible configuration.

DESCRIPTION OF SYMBOLS 1 Smart phone 2 Touch screen display 2A Display 2B Touch screen 3 Button 4 Illuminance sensor 5 Proximity sensor 6 Communication unit 7 Receiver 8 Microphone 9 Storage 9A Control program 9B Call application 9C Mail application 9D Browser application 9E Camera application 9F Voice input application 9G Software key Application 9Z Setting data 10 Controller 11 Speaker 12 Camera 15 Attitude detection unit 18 Vibrator

Claims (3)

A touch screen including a first region in which the first image is displayed, and the first image and a second region where the second image is superimposed,
When a touch operation on the first object on the first image received in the first region via the touch screen approaches the second region, the second image is transmitted and the second image is transmitted. When the first image is displayed and a touch operation on the first object on the first image touches the second object on the first image, the first object on the first image is displayed. An electronic device comprising: a controller that performs processing according to the contacted second object . A first region in which the first image is being displayed, the control of the first image and the second image is performed by an electronic device having a touch screen and a second region being superimposed A method,
Receiving a touch operation on a first object on a first image of the first region via the touch screen;
When a touch operation on the first object on the first image approaches the second region, the second image is transmitted to display the first image, and the first image is displayed on the first image. When the touch operation on the first object touches the second object on the first image, the first object on the first image is processed according to the second object touched ; Control method. A first region in which the first image is being displayed, the control of the first image and the second image is performed by an electronic device having a touch screen and a second region being superimposed A method,
Receiving a touch operation on a first object on a first image of the first region via the touch screen;
When a touch operation on the first object on the first image approaches the second region, the second image is transmitted to display the first image, and the first image is displayed on the first image. When the touch operation on the first object touches the second object on the first image, the first object on the first image is processed according to the second object touched ; Control program to execute

Images