JP2015127953A - Portable terminal, and control method and program therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve visibility of information whose visibility is reduced by displaying a software keyboard on a display of a portable terminal and also make it possible for a user to use the software keyboard to easily perform an input operation while browsing information.SOLUTION: If it is detected that an operation part is located at an upper part of a keyboard screen or near the upper part and it is determined that a distance between a user's operation part and a display is a predetermined distance, then the keyboard screen is displayed to be opaque. If it is detected that the operation part is located at an upper part of an area where data is displayed on a display other than the keyboard screen or near the upper part and it is determined that a distance between the user's operation part and the display is a predetermined distance, then the keyboard screen is displayed to be transparent or not displayed.

Description

  The present invention relates to a portable terminal, a control method thereof, and a program, and more particularly to a technique for easily performing an input operation using a software keyboard.

  A mobile terminal (smart device, portable terminal) such as a smartphone is a device that can browse information by an intuitive operation of removing a physical keyboard and touching the touch panel with a finger. By using a touch panel, it is a device that is convenient to carry, but allows information browsing on a screen that takes full advantage of the size of the device.

  In such smart devices, as a main means for inputting characters, a virtual keyboard (software keyboard) by software is presented to the user as an interface. The software keyboard is displayed so as to overlap the application screen, and plays the same role as a conventional physical keyboard. Depending on the software keyboard application, in many cases, the software keyboard occupies about half of the device screen, and the application hides the information displayed on the screen.

  On the other hand, there are often situations where the user enters characters. Enter search keywords even when browsing websites, including creating documents such as email. Whenever the user tries to input a character, the software keyboard hides some of the information on the screen, which may reduce the amount of information displayed.

  Therefore, unless you use a physical keyboard to use smart devices, as a realistic operation when you enter characters while browsing web information or e-mail text, it is possible to switch the character input mode repeatedly. It is done. There is also a method of using a software keyboard that has a small display area or is movable.

  Japanese Patent Application Laid-Open No. H10-228561 proposes switching the keyboard screen to be translucent or opaque according to the input area where the cursor is designated.

JP 2007-183787 A

  As a method of inputting characters while browsing information on a smart device, it is conceivable to operate while switching the display of the software keyboard. In this case, the information on the screen can be easily viewed by hiding the software keyboard. However, the software keyboard must be switched as an operation for inputting characters, and the operation becomes complicated.

  On the other hand, there is a method of referencing information by scrolling the remaining area without switching the display of the software keyboard. This method eliminates the need for switching the software keyboard, but the screen area that can be scrolled is limited and narrows, making it difficult to operate and difficult to refer to information.

  Alternatively, using a software keyboard whose display size can be reduced reduces the amount of information hidden behind the software keyboard. However, it may be difficult to input characters as the keyboard becomes smaller.

  In addition, when a movable software keyboard is used, when the user wants to refer to information hidden under the software keyboard, the information can be referred to by shifting the position of the software keyboard. However, depending on the information you want to browse, the software keyboard can still get in the way. In addition, since the software keyboard is moved in addition to the character input operation and the display area operation, the operation may be complicated.

  Thus, conventionally, the display control of the screen of the software keyboard had to operate the smart device directly.

  In view of this, there is a need for a method of inputting information when using a software keyboard in a smart device, which achieves both information browsing and ease of operation.

  Accordingly, an object of the present invention is to improve the viewability of information whose browsing is restricted by displaying the screen of the software keyboard on the display unit of the mobile terminal, and to perform an input operation using the software keyboard while browsing the information. It is to provide a mechanism that can be easily performed.

  The present invention is a portable terminal including a display unit for displaying data, and includes a keyboard display unit that displays a keyboard screen that can accept a user operation on the display unit, overlaid on the data, and the keyboard display unit. A position detection unit that detects a position of a user operation unit that operates the display unit with respect to the displayed keyboard screen, a user operation unit that operates the display unit, and a distance between the display unit are detected. A distance detection unit; and a determination unit that determines whether or not the distance detected by the distance detection unit is a predetermined distance, and the keyboard display unit includes an upper portion of the keyboard screen, or It is detected that the operation unit is located in the vicinity thereof, and the distance detected by the distance detection unit by the determination unit is a predetermined distance. On the condition that it is determined that the operation is performed, the keyboard screen is opaquely displayed. On the other hand, the operation is performed at or near the upper part of the area where the data is displayed on the display unit other than the keyboard screen by the position detection unit. The keyboard screen is transparently displayed on the condition that the part is located and the determination means determines that the distance detected by the distance detection means is a predetermined distance, or It is characterized by being hidden.

  The present invention is also a method for controlling a mobile terminal including a display unit for displaying data, wherein the keyboard display unit displays a keyboard screen on which the user's operation can be received over the data on the display unit. A keyboard detection step, a position detection step for detecting a position of an operation unit of a user operating the display unit with respect to the keyboard screen displayed by the keyboard display step, and a distance detection unit; A distance detecting step for detecting a distance between the operation unit of the user who operates the display and the display unit, and a determining step for determining whether the distance detected by the distance detecting step is a predetermined distance In the keyboard display step, it is detected by the position detection step that the operation unit is located at or near the upper part of the keyboard screen. And the keyboard screen is displayed opaquely on the condition that the distance detected by the distance detecting step is determined to be a predetermined distance by the determining step, while the position detecting step The distance detected by the distance detection step in the determination step by detecting that the operation unit is located at or near the upper part of the area where data is displayed on the display unit other than the keyboard screen The keyboard screen is transparently displayed or hidden on the condition that is determined to be a predetermined distance.

  In addition, the present invention is a program that can be executed by a mobile terminal including a display unit that displays data, and the mobile terminal is placed on the display unit with a keyboard screen that can accept a user operation over the data. Keyboard displaying means for displaying; position detecting means for detecting a position of a user operating section operating the display section relative to a keyboard screen displayed by the keyboard displaying means; and a user operating section operating the display section; , Functioning as distance detecting means for detecting the distance to the display unit, and determining means for determining whether the distance detected by the distance detecting means is a predetermined distance, wherein the keyboard display means The detection means detects that the operation unit is located at or near the upper part of the keyboard screen, and the determination means On the condition that the distance detected by the distance detection means is determined to be a predetermined distance, the keyboard screen is displayed in an opaque manner, while the position detection means displays data on the display unit other than the keyboard screen. It is detected that the operation unit is located in the upper part of the displayed area or in the vicinity thereof, and the distance detected by the distance detection means is determined to be a predetermined distance by the determination means. On the condition, the keyboard screen is transparently displayed or hidden.

  ADVANTAGE OF THE INVENTION According to this invention, while improving the browsing property of the information with which browsing is restrict | limited by displaying the screen of a software keyboard on the display part of a portable terminal, input operation by a software keyboard is made easy, browsing the said information. It can be carried out.

It is a figure which shows an example of a structure of the system of this invention. It is a block diagram which shows the hardware constitutions of the information processing apparatus applicable to the system 100 shown in FIG. It is a block diagram which shows the function of the system in this invention. It is a flowchart which shows an example of the system in this invention. It is a data block diagram which shows an example of the definition of a data table of a system in this invention, and a setting value. It is a figure which shows an example of the software keyboard opaque display screen in the web browser of the system in this invention. It is a figure which shows an example of the software keyboard opaque display screen in the mail software of the system in this invention. It is a figure which shows an example of the software keyboard transparent display screen in the web browser of the system in this invention. It is a figure which shows an example of the software keyboard transparent display screen in the mail software of the system in this invention. It is a figure which shows an example of the setting screen of the system in this invention. It is a figure which shows an example of the software keyboard display screen in case the display switching means of the system in this invention is manual. It is a flowchart which shows an example of the system in this invention. It is a data block diagram which shows an example of the definition of a data table of a system in this invention, and a setting value. It is a figure which shows an example of the setting screen of the system in this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

<First Embodiment>
Hereinafter, a first embodiment according to the present invention will be described with reference to the drawings.
FIG. 1 is a system configuration diagram showing an example of a system configuration of the present invention.

  FIG. 1 shows a configuration with one smart device 100 (mobile terminal).

  The smart device 100 is a mobile terminal equipped with an operation system having a user interface function that presents information to a user and receives a user's touch operation as an input.

  In the system of the present embodiment, a physical keyboard may not be connected to one smart device 100 having the above-described configuration, or a configuration in which a physical keyboard is connected or not used may be used.

  Hereinafter, the hardware configuration of the information processing apparatus applicable to the system 100 illustrated in FIG. 1 will be described with reference to FIG.

  FIG. 2 is a block diagram illustrating a hardware configuration of an information processing apparatus applicable to the system 100 illustrated in FIG.

  In FIG. 2, reference numeral 201 denotes a CPU that comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 203 or the external memory 212 has a BIOS (Basic Input / Output System), an operating system program (hereinafter referred to as OS), which is a control program of the CPU 201, and a later-described function necessary for realizing functions executed by each smart device. Various programs to be stored are stored.

  A RAM 202 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program or the like necessary for execution of processing from the ROM 203 or the external memory 212 to the RAM 202 and executing the loaded program.

  An input controller 205 controls input from a keyboard (KB) 209, the touch panel 210, or a sensor such as an acceleration sensor (not shown). The keyboard 209 includes a device for external connection. The touch panel 210 includes both a detection-type device that can sense a plurality of touch points on the screen and a detection-type device that can sense the position of a finger that is slightly away from the screen. There is a mutual capacitive touch panel as a technology that can detect a plurality of touch points on the screen. In addition, there is a self-capacitance type touch panel as a technique that can sense the position of a finger that is slightly away from the screen. Alternatively, as a method for detecting the position of a finger that is slightly away from the screen, an analysis of an image on which the screen and the finger are reflected is also possible, so a camera may be configured as the image input device.

  A video controller 206 controls display on a display device such as the display 211. The touch panel 210 is overlaid on the display 211 so as to accept a user's touch operation. The display shown in FIG. 2 is not limited to a liquid crystal display, but may be another display such as an organic EL.

  A memory controller 207 controls access to an external storage device (flash memory (ROM)) 212 that stores a boot program, various applications, font data, user files, editing files, various data, and the like.

  A communication I / F controller 208 connects and communicates with an external device via a network (for example, a communication network such as 3G (not shown) or a wireless LAN), and executes communication control processing in the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the display 211 by, for example, executing outline font rasterization processing on a display information area in the RAM 202. In addition, the CPU 201 enables a user instruction through a user interface (not shown) on the display 211.

  Various programs to be described later for realizing the present invention are recorded in the ROM 203 or the external memory 212, and are executed by the CPU 201 by being loaded into the RAM 202 as necessary. Furthermore, definition files and various information tables used when executing the program are also stored in the ROM 203 or the external memory 212, and detailed descriptions thereof will be described later.

  Next, a functional block diagram of the smart device 100 as the information processing apparatus of the present invention will be described with reference to FIG.

  In addition, the detailed control which each functional block processes is demonstrated with the flowchart mentioned later.

  The software keyboard information acquisition unit 301 acquires the display state of the software keyboard of the system managed by the RAM 202 and the display area on the screen.

  The setting information acquisition unit 302 acquires display switching unit and display method setting information from the storage area of the ROM 203 or the external memory 212.

  The setting information acquisition unit 302 is also called in the initialization process of the setting screen display unit 306.

  The display information acquisition unit 303 acquires characters and images displayed by the application in the display area on the screen acquired by the software keyboard information acquisition unit 301, and analyzes the presence or absence of information.

  The touch information acquisition unit 304 acquires information on whether the touch panel has detected a finger and the coordinates of the detected finger on the screen.

  The software keyboard display unit 305 switches between transparent and opaque display of the software keyboard. Based on the information acquired by the setting information acquisition unit 302, the information acquired by the display information acquisition unit 303, and the information of the touch information acquisition unit 304, the software keyboard is transparently displayed or opaquely displayed (original software keyboard display). To do.

  The setting screen display unit 306 displays a setting screen by pressing the setting button displayed on the software keyboard display unit 305. A setting screen is displayed based on the information acquired by the setting information acquisition unit 302.

  The setting information storage unit 307 acquires information set by the user on the setting screen displayed by the setting screen display unit 306, and stores it in the storage area of the ROM 203 or the external memory 212. When the storage process is completed, the setting information storage unit 307 calls the setting screen display unit 306 and closes the setting screen.

  The overall system flow in this embodiment will be described below.

  When the smart device 100 detects the display of the software keyboard that is displayed when the user inputs characters in scenes such as browsing a website or creating an email, the smart device 100 acquires display area information of the software keyboard. Then, setting information is acquired from the storage area of the ROM 203 or the external memory 212. When the setting information does not exist, the initial value is used based on the data table definition (FIG. 5). If the display switching means is manual, the software keyboard is displayed transparently or opaquely according to the setting of transparent display or opaque display on the display means.

  When the display switching means is automatic, the characters and images displayed in the display area of the software keyboard are acquired to check whether information is included. If it is determined that the information is not included, the software keyboard is displayed opaquely. Alternatively, a mechanism for switching the display method according to the amount of information included in the display area of the software keyboard can be considered.

  When the display information exists, the touch point information is acquired, and if the finger position is within a certain distance from the screen and within the display area of the software keyboard, the software keyboard is displayed opaquely. Even when display information exists, if the position of the finger is not within a certain distance from the screen or is not within the display area of the software keyboard, the software keyboard is transparently displayed.

  Regarding the transparent display of the software keyboard, the outer frame indicating the display area and the setting button for displaying the setting screen are always displayed opaquely, and the other buttons and background of the software keyboard are displayed transparently. However, a mechanism that allows partial transparent display according to the content of the display information may be used. In other words, in consideration of the contents of the display information, it may be possible to leave certain key displays opaque. For the non-transparent display of the outer frame, since the position of the finger with respect to the display area of the software keyboard causes the display to be switched, the display area is clearly indicated. In addition, since the setting button is always displayed, if you do not want to switch the display automatically, or if you want to switch automatically, the user will not be confused even if the software keyboard is transparent. . In addition, since the setting button is displayed, even if the user forgets about the software keyboard being displayed transparently, it is possible to indicate to the user that the character is being input. Note that the setting buttons are displayed differently depending on whether the setting information display switching means is automatic or manual, so whether the software keyboard display is automatically switched or fixed for manual operation. It can be seen at a glance whether it is set (FIG. 11).

  Further, an information setting screen (FIG. 10) is displayed by pressing a setting button on the software keyboard. On the information setting screen, it is specified that the software keyboard display is switched automatically or manually. When manual is designated, it is further designated that the display method is transparent display or non-transparent display.

  Hereinafter, the software keyboard display switching process in the system of the present embodiment will be described with reference to FIG.

  In each step shown in FIG. 4, the CPU of the mobile terminal reads and executes the program from the RAM.

  The portable terminal displays a software keyboard screen (keyboard screen 600) that can accept user operations on the display unit in a superimposed manner on the data displayed on the display unit (keyboard display means).

  FIG. 4 illustrates the software keyboard display switching process. This process is performed by the smart device, and detects a software keyboard displayed when the user inputs characters. When a setting button (for example, 604 in FIG. 6) on the software keyboard is pressed, an information setting screen (FIG. 10) is displayed.

  In step S401, the display state and display area data on the screen are acquired for the detected software keyboard.

The acquired display state and display area data are stored in the RAM 202 and used in the processes of S402, S407, and S412 described later.

  In step S402, if the display state indicated by the data acquired in step S401 is not displayed, the process ends. If the display state is display, the process proceeds to step S403.

  In step S403, setting information is acquired from the storage area of the ROM 203 or the external memory 212. With reference to the setting of the display switching unit 502, an automatic or manual value is acquired. Also, the transparent or opaque value is acquired with reference to the display method setting. When the setting information cannot be acquired from the storage area of the ROM 203 or the external memory 212, the initial value of the data table definition (501 in FIG. 5) is set.

  The acquired display switching means and display method are stored in the RAM 202 and used in the processes of S404 and S405 described later.

  When the setting information acquisition process ends, the process proceeds to step S404.

  In step S404, if the value of the display switching means acquired in S403 is manual, the process proceeds to S405. If the value of the display switching means is automatic, the process proceeds to S407.

  In step S405, if the display method value acquired in S403 is opaque, the process proceeds to S406. If the value of the display method is transparent, the process proceeds to S413.

  In step S406, the display of the software keyboard is displayed opaquely. In other words, return to the original software keyboard display. As an example of non-transparent display, a screen when browsing a website (FIG. 6) and a screen of mail software (FIG. 7) are shown.

  When the opaque display process of the software keyboard is finished, the process returns to step S401.

  In step S407, in the display area acquired in step S401, the image or character information displayed on the back of the display area of the software keyboard by the other application software is acquired. It is also possible to extract character data from an image using a technique such as OCR.

  When the display information acquisition process ends, the process proceeds to step S408.

  In step S408, the display information acquired in step S407 is analyzed.

  If there is an image or character, it is determined that the display information is included, and the process proceeds to S409. Otherwise, it is determined that display information is not included, and the process proceeds to S406 in order to display the software keyboard in an opaque manner. Step 408 is an application example of data determination means for determining whether there is data superimposed on the keyboard screen.

  In step S409, the touch information of the touch panel 210 is acquired from the input controller 205, and it is acquired that the user's finger and the screen are approaching within a certain distance. The touch panel 210 can detect that the finger is approaching within a certain distance by detecting a change in capacitance using, for example, a projection capacitive sensor (self-capacitance method). Alternatively, other proximity sensors can be used. In addition, it may be determined that the camera is approaching within a certain distance by analyzing the pixel pattern and estimating the distance between the finger and the screen using a camera image. The projected capacitive sensor is an application example of a distance detection unit that detects a distance between a user operation unit (such as a finger) and a display unit (display).

  When the touch information acquisition process ends, the process proceeds to S410.

  In step S410, if the finger and the screen are within a certain distance (predetermined distance) from the touch information acquired in step S409, the process proceeds to step S411. If the finger is away from the screen by a certain distance, the process proceeds to step S413 to display the software keyboard transparently. Step 410 is an application example of determination means for determining whether the distance is a predetermined distance.

  In step S411, the touch information of the touch panel 210 is acquired from the input controller 205, and the position (X coordinate and Y coordinate values) of the user's finger on the screen is acquired. As a method of obtaining the coordinates of the user's finger on the screen, there is a method of specifying the position coordinates of the finger from the capacitance change of the projection type capacitive sensor or estimating it from the analysis of the pixel pattern of the camera image. .

  If the position of the finger on the screen is acquired, the process proceeds to S412.

  In step S412, if the finger position coordinates acquired in step S411 are within the display area of the software keyboard acquired in step S401, the process proceeds to step S406 to display the software keyboard in an opaque manner. Otherwise, the process proceeds to step S413 to display the software keyboard transparently. Step 412 is an application example of position detection means for detecting the position of the operation unit of the user who operates the display unit with respect to the keyboard screen (for example, 603 in FIG. 6).

  In step S413, the software keyboard display is transparently displayed. As the transmissive display processing, for example, the transparency may be set to zero and the non-display may be performed.

  As described above, it is detected that the operation unit (such as a finger) is located at or near the upper part of the keyboard screen, and the distance between the finger and the display unit is determined to be a predetermined distance. On the other hand, the keyboard screen is displayed in an opaque manner, and on the other hand, it is determined that there is data superimposed below the keyboard screen, and the upper part of the area where the data is displayed on the display section other than the keyboard screen, or the The keyboard screen is transparently displayed on the condition that the operation unit (such as a finger) is detected in the vicinity and the distance between the finger and the display unit is determined to be a predetermined distance. Or hide. When it is determined that there is no data superimposed on the keyboard screen, the keyboard screen is displayed in an opaque manner.

  Also, not all of the software keyboard is transparently displayed, but the outer frame and setting buttons of the software keyboard are always opaquely displayed. As an example of transparent display, a screen when browsing a website (FIG. 8) and a screen of mail software (FIG. 9) are shown.

When the transparent display process of the software keyboard is finished, the process proceeds to step S414 to display the setting screen (FIG. 10).

  In step S414, if a setting button (for example, 604 in FIG. 6 or 704 in FIG. 7) is pressed, the process proceeds to step S415. Otherwise, the process returns to step S401.

  In step S415, a setting screen (FIG. 10) is displayed. In order to perform initial display of the screen, the process proceeds to step S416.

  In step S416, setting information is acquired from the storage area of the ROM 203 or the external memory 212. The automatic or manual value is acquired with reference to the setting of the display switching means. Also, the transparent or opaque value is acquired with reference to the display method setting. When the setting information cannot be acquired from the storage area of the ROM 203 or the external memory 212, the initial value of the data table definition (FIG. 5) is set as setting information. Initialize the setting screen using the acquired setting information.

When the setting information acquisition process ends, the process proceeds to step S417.

  In step S417, if the cancel button on the setting screen is pressed, the process proceeds to step S420. Otherwise, the process proceeds to step S418.

  In step S418, if the save button on the setting screen is pressed, the process proceeds to step S419. Otherwise, the process returns to step S415.

  In step S419, the setting value received by the user via the setting screen (the setting value changed by the user's operation) is acquired and stored in the storage area of the ROM 203 or the external memory 212.

  When the setting information storage process ends, the process proceeds to step S420.

  In step S420, the setting screen is closed and the process returns to step S401.

  FIG. 5 is a data configuration diagram showing an example of a setting information data table in the system of the present embodiment.

  As indicated by reference numeral 501 in FIG. 5, the setting information data table includes display switching means and information such as a display method. In the display switching means, whether the display switching of the software keyboard is manual or automatic is set. As the display method, non-transparent or transparent is set as a display method when the display switching means is manual. FIG. 5 shows an example (502) of data stored in the setting information.

  FIG. 6 is a diagram showing an example of a software keyboard opaque display on the web browser in the system of the present embodiment.

The web browser content 600 is composed of text and images. When the user taps edit box 601 to input a keyword, software keyboard 603 is displayed so as to cover text 602. A setting button 604 for displaying a setting screen is always displayed opaquely on the software keyboard. This setting button is displayed when the display switching means is set to automatic.

  FIG. 7 is a diagram showing an example of a software keyboard opaque display in the mail software in the system of the present embodiment.

A mail creation screen 700 of the mail software is composed of a destination, a subject (not shown), and a text 702. When the user taps the middle 701 of the text to edit the mail text, a software keyboard 703 is displayed so as to cover the text 702. A setting button 704 for displaying a setting screen is always displayed opaque on the software keyboard. This setting button is displayed when the display switching means is set to automatic.

  FIG. 8 is a diagram illustrating an example of a software keyboard transparent display in a web browser in the system of the present embodiment.

The web browser content 800 is composed of text and images. When the user taps the edit box 801 to input a keyword, the software keyboard 803 is displayed so as to cover the text 802, but the text is transparent except for the outer frame and the setting button 804. Reference to 802 is possible. A setting button 804 for displaying a setting screen is always displayed opaquely on the software keyboard. This setting button is displayed when the display switching means is set to automatic.

  FIG. 9 is a diagram showing an example of software keyboard transparent display in the mail software in the system of the present embodiment.

The mail creation screen 900 of the mail software is composed of a destination, a subject (not shown), and a text 902. When the user taps the middle 901 of the text to edit the mail text, the software keyboard 903 is displayed so as to cover the text 902, but is transparently displayed except for the outer frame and the setting button 904. The text 902 can be referred to. A setting button 904 for displaying a setting screen is always displayed opaque on the software keyboard. This setting button is displayed when the display switching means is set to automatic.

  FIG. 10 is a diagram illustrating an example of a setting screen in the system of the present embodiment. The setting screen is a screen for managing the setting information data table (FIG. 5). The display switching means 1101 (1102), the display method 1103 (1104, 1105), the OK button 1006, the setting information items can be edited. Consists of a cancel button. Note that the display switching unit 1102 can select either manual or automatic. Since the display method 1103 is a setting item that is valid only when the display switching unit 1102 is manually operated, it is better that the setting screen can be edited only when it is manually operated.

  FIG. 11 is a diagram showing an example of a software keyboard display when the display switching means in the system of this embodiment is manual.

Reference numeral 1100 denotes a case where the software keyboard is opaquely displayed, and 1102 is a case where the software keyboard is transparently displayed. In both cases, the setting buttons 1101 and 1103 are displayed in an opaque manner. However, unlike the case where the display switching means is automatic (604, 704, 804, 904), it is indicated that the display switching means is set to manual. ing.
<Second Embodiment>

  The second embodiment according to the present invention will be described below with reference to FIGS.

  In the second embodiment, the following function is added to the flowchart shown in FIG. 4 described in the first embodiment, and only differences from the first embodiment will be described.

  That is, in the second embodiment, (1) the amount of all content (data amount) displayed on the display unit or the content displayed on the back of the display area of the software keyboard (hidden by the keyboard) According to the amount (data amount), the function of automatically switching the numerical value of the display switching means explained in FIG. 5 between 1 (manual switching) or 0 (automatic switching), and (2) scrolling the screen A function to display the keyboard transparently or semi-transparently when the finger approaches it (even if the finger touches the keyboard area while the screen is scrolling, the CPU assumes that the keyboard has been pressed. Is a function for recognizing that the content is touched without being recognized (scroll instruction is possible) in the first embodiment.

  Hereinafter, the same processes as those in the flowchart shown in FIG. 4 are denoted by the same reference numerals, and only new steps are denoted by different reference numerals. The flow shown in FIG. 12 is executed by the CPU of the mobile terminal 100.

  In step S403-1, setting information (operation mode change, mode change threshold, display switching means, display method) is acquired from the storage area of the ROM 203 or the external memory 212.

  The setting information acquired here is a table shown in FIG. The table shown in FIG. 13 is stored in the memory of the mobile terminal.

  The table shown in FIG. 13 is a table in which “dynamic mode change” and “mode change threshold” are added to the table shown in FIG. 5 of the first embodiment.

  A value of 0 or 1 is stored in “dynamic mode change”. 1 indicates that it is effective to change the mode dynamically, and 0 indicates that changing the mode dynamically is invalid. Indicates that

  That is, whether the display switching means 0 (manual switching of transparency / opacity of the software keyboard) or 1 (automatic switching of transparency / opacity of the software keyboard) is automatically switched (dynamic mode change is 1), It is set whether to switch manually (dynamic mode change is 0).

  The “mode change threshold” stores a predetermined number of characters displayed on the back of the area where the software keyboard is displayed as a condition for automatically switching between 0 and 1 of the display switching means.

  13 is input and set from the setting screen 1404 (setting screen displayed on the mobile terminal) shown in FIG.

  Reference numeral 1401 denotes a check box for setting whether to enable the dynamic mode change.

Reference numeral 1402 indicates that 1403 is an input field for inputting a mode change threshold value.
The data input via 1400 is stored in the table shown in FIG.
The setting screen shown in FIG. 14 is displayed instead of the setting screen of FIG.

  And a portable terminal performs the process of step S407 demonstrated in 1st Embodiment.

  In step S407, not only the number of characters (data amount) displayed on the back of the display area of the software keyboard (hidden on the keyboard) but also the number of all characters displayed on the display unit may be acquired.

  Then, the mobile terminal determines whether or not the value of the dynamic mode change acquired in step S403-1 is 1 (valid) (S1201). If it is determined that the number is 1, it is determined whether or not the number of characters acquired in step S407 is equal to or greater than the mode change threshold acquired in step S403-1 (S1202). If it is determined that the number of characters acquired in step S407 is greater than or equal to the mode change threshold acquired in step S403-1, the display switching unit is set to automatic (0) (S1203). On the other hand, if it is determined that the number of characters acquired in step S407 is less than the mode change threshold acquired in step S403-1, the display switching unit is set to manual (1) (S1204).

  If the mobile terminal determines in S1201 that the value of the dynamic mode change acquired in step S403-1 is 0 (invalid), the mobile terminal proceeds to step S404.

  Thereby, according to the amount (data amount) of all contents displayed on the display unit, or the amount (data amount) of content displayed on the back of the display area of the software keyboard (hidden in the keyboard), Whether the numerical value of the display switching means described in FIG. 5 is 1 (manual switching) or 0 (automatic switching) can be automatically switched.

  Next, in step S1205, the mobile terminal acquires the state of the scroll operation of the screen displayed on the display unit.

  In step S1206, the portable terminal determines whether the acquired state is scrolling the screen displayed on the display unit.

  If it is determined that the screen displayed on the display unit is being scrolled (YES), the process proceeds to step S413. On the other hand, if it is determined that the screen is not being scrolled (NO) Then, the process proceeds to step S406.

  Thereby, even when a finger approaches while the screen is scrolling, the keyboard can be displayed transparently or semi-transparently. Therefore, even if the keyboard is touched with a finger while the screen is scrolling, the CPU does not recognize that the keyboard has been pressed but recognizes that the content has been touched, and the user can The user operability is improved.

  As described above, according to the present invention, the software keyboard screen is displayed on the display unit of the mobile terminal, so that the browsing of information whose browsing is restricted is improved and the input operation using the software keyboard is performed while browsing the information. It can be done easily.

  Each means and each step constituting the above-described embodiment of the present invention can be realized by reading a program stored in a RAM or ROM of a computer. This program and a computer-readable recording medium on which the program is recorded are included in the present invention.

  Further, the present invention can be implemented as, for example, a system, apparatus, method, program, or recording medium, and may be applied to an apparatus composed of a single device.

  The present invention supplies a software program for realizing the functions of the above-described embodiments directly or remotely to a system or apparatus. In addition, this includes a case where the system or the computer of the apparatus is also achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention. In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, or the like.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. Furthermore, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can be realized by the processing.

  As another method, a program read from a recording medium is first written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Then, based on the instructions of the program, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are also realized by the processing.

100 Smart devices (mobile terminals)

Claims (5)

A mobile terminal having a display unit for displaying data,
Keyboard display means for displaying a keyboard screen capable of accepting a user operation on the display unit over the data;
Position detecting means for detecting the position of the operation unit of the user who operates the display unit with respect to the keyboard screen displayed by the keyboard display unit;
A distance detecting means for detecting a distance between an operation unit of a user who operates the display unit and the display unit;
Determining means for determining whether the distance detected by the distance detecting means is a predetermined distance;
With
The keyboard display means detects that the operation unit is located at or near the upper part of the keyboard screen by the position detection means, and is detected by the distance detection means by the determination means. On the condition that the distance is determined to be a predetermined distance, the keyboard screen is displayed in an opaque manner, while the position detection unit displays an upper portion of the area where data is displayed on the display unit other than the keyboard screen Or the keyboard screen on the condition that it is detected that the operation unit is positioned in the vicinity thereof, and the determination unit determines that the distance detected by the distance detection unit is a predetermined distance. A mobile terminal characterized by being transparently displayed or hidden. Further comprising data determination means for determining whether there is data superimposed on the keyboard screen displayed by the keyboard display means;
The keyboard display means determines that there is data superimposed on the keyboard screen displayed by the keyboard display means by the data determination means, and the position detection means displays the data on the display unit other than the keyboard screen. It is detected that the operation unit is located above or near the area where data is displayed, and the determination unit determines that the distance detected by the distance detection unit is a predetermined distance. The mobile terminal according to claim 1, wherein the keyboard screen is transparently displayed or hidden on condition that the keyboard is displayed.   The keyboard display means displays the keyboard screen in an opaque manner when the data determination means determines that there is no data superimposed on the keyboard screen displayed by the keyboard display means. Item 3. The mobile terminal according to Item 2. A method for controlling a mobile terminal including a display unit for displaying data,
A keyboard display step in which a keyboard display means displays a keyboard screen capable of accepting a user operation on the display unit over the data; and
A position detection step for detecting a position of an operation unit of a user who operates the display unit with respect to the keyboard screen displayed by the keyboard display step;
A distance detecting step for detecting a distance between an operation unit of a user who operates the display unit and the display unit;
A determination step of determining whether the distance detected by the distance detection step is a predetermined distance;
With
In the keyboard display step, the position detection step detects that the operation unit is located at or near the upper part of the keyboard screen, and the determination step detects the distance detection step. On the condition that the distance is determined to be a predetermined distance, the keyboard screen is displayed in an opaque manner, while the upper part of the area where data is displayed on the display unit other than the keyboard screen by the position detection step, Or the keyboard screen on the condition that it is detected that the operation unit is located in the vicinity thereof, and the distance detected by the distance detection step is determined to be a predetermined distance by the determination step. A control method characterized by displaying or non-displaying transparently. A program that can be executed on a portable terminal having a display unit for displaying data,
The portable terminal;
Keyboard display means for displaying a keyboard screen capable of accepting a user operation on the display unit over the data;
Position detecting means for detecting the position of the operation unit of the user who operates the display unit with respect to the keyboard screen displayed by the keyboard display unit;
A distance detecting means for detecting a distance between an operation unit of a user who operates the display unit and the display unit;
Function as a determination means for determining whether the distance detected by the distance detection means is a predetermined distance;
The keyboard display means detects that the operation unit is located at or near the upper part of the keyboard screen by the position detection means, and is detected by the distance detection means by the determination means. On the condition that the distance is determined to be a predetermined distance, the keyboard screen is displayed in an opaque manner, while the position detection unit displays an upper portion of the area where data is displayed on the display unit other than the keyboard screen Or the keyboard screen on the condition that it is detected that the operation unit is positioned in the vicinity thereof, and the determination unit determines that the distance detected by the distance detection unit is a predetermined distance. A program characterized by displaying or non-displaying transparently.

Images