JP2014191486A - Terminal and operation control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a user to reliably perform an intended operation when browsing display information such as a WEB page.SOLUTION: A portable terminal 10 comprises: a touch panel 11 that has a display screen, and displays display information on the display screen; detection unit 12 that detects regions in the displayed display information which are selected to execute a set function, and detects the number or area of the regions; and an operation panel display unit 13 that displays an operation panel for performing an operation to the display information on the display screen in accordance with the number or area of the regions.

Description

  The present invention relates to a terminal including a display device that displays display information, and an operation control method using the terminal.

  When a WEB page is displayed on a mobile terminal such as a mobile phone equipped with a touch panel and does not fit on the screen, the WEB page is not scrolled and displayed on the screen. Can be displayed. In order to perform scrolling with the touch panel, for example, a so-called drag operation in which a finger is brought into contact with the touch panel and the finger is in contact with the touch panel in a direction in which the user wants to scroll is required (see, for example, Patent Document 1).

JP2013-3718A

  Incidentally, a WEB page may be provided with a link to another WEB page. On the touch panel, the link can be changed to a linked WEB page by touching the location of the link with a finger, so-called tapping.

  Since the display screen is usually small in a portable terminal, that is, a scroll bar or the like for scrolling is not displayed due to the limitation of the screen size. For this reason, the above-described scrolling operation also brings the finger into contact with the location where the WEB page is displayed. For this reason, when browsing a WEB page containing many links, the user (operator) often comes into contact with an unintended link when trying to perform a screen scroll operation. Thereby, it will change to the link place which a user does not intend. That is, there is a problem that the operation is not intended by the user.

  The present invention has been made in view of the above-described problems, and a terminal and an operation control capable of reliably performing an operation intended by a user when browsing display information such as a WEB page. It aims to provide a method.

  In order to achieve the above object, a terminal according to the present invention is a terminal having a display screen and including a display device that displays display information on the display screen, in the display information displayed on the display screen, By selecting, a detection unit that detects a region where a set function is executed and detects the number or area of the region, and display information according to the number or area of the region detected by the detection unit Operation panel display means for displaying an operation panel for performing an operation on the display screen.

  In the terminal according to the present invention, the operation panel is displayed in accordance with the number or area of the areas included in the display information displayed on the display screen in which the function set by selection is executed. The user can reliably perform the intended operation by operating the displayed operation panel. That is, according to the terminal according to the present invention, it is possible to reliably perform an operation intended by the user while browsing display information such as a WEB page.

  The operation panel display means displays an operation panel that performs at least one of scrolling of display information, copying of information included in the display information, and display of other display information by a link included in the display information as an operation. Also good. According to this configuration, at least one of scrolling, copying, and display of other display information can be reliably performed.

  The area may be an area in which a function for displaying other display information is executed. According to this configuration, for example, the operation panel can be displayed when the web page being browsed includes many links. That is, the operation panel can be displayed appropriately.

  The operation panel display means may accept setting input of a time until the operation panel is displayed, and display the operation panel after the time has elapsed after the display information is displayed by the display device. According to this configuration, the time until the operation panel is displayed can be made appropriate, and convenience can be improved.

  The display device may be a touch panel that detects an input to the display screen and receives an input. With this configuration, it is possible to reliably perform an operation intended by the user when the user inputs on the touch panel.

  By the way, the present invention can be described as the invention of the terminal as described above, and can also be described as the invention of the operation control method as follows. This is substantially the same invention only in different categories, and has the same operations and effects.

  That is, the operation control method according to the present invention is an operation control method by a terminal having a display screen and having a display device that displays display information on the display screen, and the selection in the display information displayed on the display screen A detection step for detecting the number or area of areas in which the set function is executed, and an operation panel for performing operations on display information according to the number or area of the areas detected in the detection step. And an operation panel display step to be displayed on the display screen.

  According to the present invention, when the user performs an operation on the displayed operation panel, an operation intended by the user can be reliably performed when viewing display information such as a WEB page.

It is a figure which shows the function structure of the portable terminal which is a terminal which concerns on embodiment of this invention. It is a figure which shows the external appearance of a portable terminal, and the display screen of a touchscreen. It is a figure which shows the example of the transition of a display screen. It is a figure which shows the hardware constitutions of the portable terminal which is a terminal which concerns on embodiment of this invention. It is a flowchart which shows the process (operation control method) performed at the time of prior setting with the portable terminal which is a terminal which concerns on embodiment of this invention. It is a flowchart which shows the process (operation control method) performed at the time of the display and operation of display information with the portable terminal which is a terminal which concerns on embodiment of this invention.

  Hereinafter, embodiments of a terminal and an operation control method according to the present invention will be described in detail with reference to the drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 1 shows a mobile terminal 10 which is a terminal according to the present embodiment. The mobile terminal 10 is a device that is carried (possessed) by a user, and is, for example, a mobile phone such as a smartphone or a tablet-type terminal. The portable terminal 10 includes a display device that has a display screen and displays display information on the display screen. The display device included in the mobile terminal 10 is, for example, a touch panel as described later. The display information displayed on the display device is, for example, a WEB page acquired from a WEB site. The display information may be information displayed by any application executed on the mobile terminal 10 other than the WEB page. The function according to the present invention relates to an operation on display information displayed on the display screen, such as scrolling of display information.

  Subsequently, functions of the mobile terminal 10 according to the present invention will be described. As shown in FIG. 1, the mobile terminal 10 includes a touch panel 11, a detection unit 12, and an operation panel display unit 13. In addition to the above functions, the mobile terminal 10 may normally have functions provided in a device such as a mobile phone.

  The touch panel 11 is a display device that has a display screen (display) and displays display information on the display screen. FIG. 2 shows a display 11 a of the touch panel 11 provided in the mobile terminal 10. FIG. 2 shows a state in which display information is displayed on the display 11a. The touch panel 11 detects a change in capacitance or voltage caused by a user's finger or the like touching the display 11a, and performs input based on these changes. The touch panel 11 detects a position where a user's finger or the like is touched on the display screen, and performs input at the position. The touch panel 11 can have the same configuration as the conventional one.

  Display information displayed on the touch panel 11 is input to the touch panel 11 from an application executed on the mobile terminal 10, for example. For example, when the display information is a WEB page, it is input from a WEB browser. When the display information is of a size that cannot be displayed within the screen of the display 11a, the touch panel 11 displays only the portion of the range that fits on the display 11a. In that case, the touch panel 11 inputs an operation for scrolling the display information from the user, and scrolls the display information according to the input. The operation for scrolling the display information is, for example, a so-called drag operation in which a finger is traced in a direction in which the user wants to scroll while touching the display 11a.

  The display information includes an area where a set function is executed by being selected. The selection is, for example, that the position of the area is designated on the touch panel 11 by a user operation or the like on the display 11a on which the display information is displayed. This designation is performed by, for example, a so-called tapping where the link portion is touched with a user's finger or the like. These areas are shown by being displayed at preset positions in the display information displayed on the display 11a as shown in FIG. As such an area, there is a link 21 for connecting (transitioning) to another display information (for example, another WEB page) and displaying (displaying another display information on the display 11a). Or the area | region (object) 22 etc. for starting applications other than the application which is displaying display information, or guiding download of a file etc. may be sufficient. In other words, the above-described area is an area for inducing different operations that deviate from the screen of the display information being displayed. The above area is previously defined in the display information. For example, if it is a WEB page, it is described in the source code for displaying the WEB page.

  The detection unit 12 is a detection unit that detects a region in which the set function is executed by being selected in the display information displayed on the touch panel 11 and detects the number or area of the region. Moreover, the detection part 12 is good also as detecting both said number or area. Specifically, the detection unit 12 determines whether or not each pixel of the display information displayed on the display 11a is a pixel constituting the region. The detection unit 12 calculates the area by counting the number of pixels (total number of pixels) that are determined as the pixels constituting the region. The number of pixels itself may be a value indicating the area relating to the above-described region (the total area occupied in the size of the display 11a). In addition, information indicating the size and resolution of the display 11a is stored in advance, and the total area (the ratio of the total area to the size of the display 11a) related to the above region is calculated from the counted total number of pixels, size, and resolution. May be calculated. The number of areas and the area may be detected for each type of area such as the link 21 or other object 22. Specifically, the number and area of regions may be detected only for the link 21, or the number and area of regions may be detected only for the object 22 other than the link 21.

  Further, the detection unit 12 determines, based on display information of the display source, what kind of function is specifically performed by the pixels constituting the region. For example, information for specifying the link destination (for example, the URL of the link destination) is acquired from the source code of the WEB page, and the above determination is performed. The detection unit 12 calculates the number of the regions based on the determination. For example, if the above area relates to a link, the total number of link destinations is calculated. In addition, the detection of the number or area of said area | regions can utilize arbitrary methods other than the method demonstrated above.

  The detection unit 12 detects the number or area of the above-described regions, for example, at a timing when the display content of the display 11a becomes new. The detection unit 12 outputs information indicating the number or area of the detected regions to the operation panel display unit 13.

  The operation panel display unit 13 displays, on the display 11a, an operation panel for performing operations on display information displayed on the display 11a according to the number or area of the above-described regions indicated by the information input from the detection unit 12. The operation panel display means. The operation panel is for making the operation on the display information displayed on the display 11a more reliable. The operation panel is used for scrolling display information, copying information included in the display information, and displaying another display information by a link included in the display information (transition to the display information at the link destination) as an operation. Is. FIG. 3 shows an example of the operation panel displayed on the display 11a. 3A and 3D show the display 11a on which the operation panel is not displayed. 3B and 3C show the display 11a on which the operation panel 30 is displayed. The operation panel 30 is displayed as a rectangular area at a preset position on the display 11a so as to overlap the display information. For example, the operation panel 30 may be a semi-transparent display (a display that can also recognize the contents of the superimposed display information) so that the user can also view the display information at the position where the operation panel 30 is superimposed.

  The operation panel display unit 13 may display the operation panel 30 and perform control for prohibiting execution of a function corresponding to the area when the area 11 is selected on the display 11a or when the area is selected. For example, in the case of a link, control is performed to prohibit transition to another display information at the link destination. This is because, for example, when the user wants to scroll the display information, the link area is touched and the display information is not changed to another display information. However, even in this case, in order to enable an operation using an operation panel to be described later, the above-described region (link 21 or object 22) may be selected by a user by a tap. Further, in order to notify the user that the above control is being performed, the display information that is being displayed (viewed by the user) is grayed out as shown by hatching in FIGS. 3B and 3C. It is good as well.

  As shown in FIGS. 3B and 3C, the operation panel 30 includes a scroll area 31, a copy button 32, a connection button 33, and a release button 34. The scroll area 31 is an area for scrolling display information. It is detected that a drag has been performed in the scroll area 31, and the display information is scrolled according to the drag. The copy button 32 is a button for copying information included in the display information. After information such as text (for example, text on a link (corresponding to a link)) included in the above-described area in the display information is selected, the selection is made when the copy button 32 is touched (tapped). Information is copied.

  The connection button 33 is a button for displaying another display information by a link included in the display information (transition to display information at a link destination). After the link area in the display information is selected, when the connection button 33 is touched (tapped), the connection to the link destination is performed, and the display information of the link destination is displayed (the display information to the link destination is displayed). Transition). The cancel button 34 is a button for deleting the operation panel 30. When the release button 34 is touched (tapped), the operation panel 30 is deleted from the display 11a. Note that the touch panel 31 may detect the touch of the scroll area 31, the copy button 32, the connection button 33, and the release button 34, and the above-described operation corresponding to the detection may be executed by the operation panel display unit 13. 10 may be executed by a function unit other than the operation panel display unit 13 in FIG. The operation panel 30 does not necessarily include all the above-described areas or buttons 31 to 34, and includes at least one of the scroll area 31, the copy button 32, and the connection button 33. Just do it.

  Specifically, the operation panel display unit 13 displays the operation panel 30 as follows. The operation panel display unit 13 stores a threshold value (set value) in advance, and determines whether or not to display the operation panel 30 by comparing the threshold value with the number or area of the above regions. Specifically, it is determined that the operation panel 30 is displayed when it is determined that the number or area of the above-described regions is a value equal to or greater than a threshold value. For example, the threshold value may be set according to the case where the number and area of the above-described regions are difficult for the user to perform operations such as scrolling on the normal display 11a. When both the number of areas and the area are used, the operation panel 30 may be displayed when one of the values is equal to or greater than the threshold value, or both are equal to or greater than the threshold value. In this case, the operation panel 30 may be displayed. In the above example, it is determined whether the value is equal to or greater than the threshold value. However, it may be determined whether the value exceeds the threshold value.

  The operation panel display unit 13 can set an elapsed time (operation panel activation time) from when the display information is displayed on the display 11a until the operation panel 30 is displayed. If the operation panel 30 is displayed immediately after the display information is displayed on the display 11a, it becomes difficult for the user to recognize the display information of that portion. Therefore, the operation panel display unit 13 receives the notification of the timing when the display information is displayed from the touch panel 11, and displays the operation panel 30 after a preset time has elapsed from the timing. Note that the above timing includes not only the timing at which the display information is displayed but also the timing at which the display information is scrolled and the display content on the display 11a is changed. The time can be freely set by the user within 10 to 60 seconds, for example.

  Further, on the mobile terminal 10, the display itself of the operation panel 30 (whether or not the operation panel 30 is used) may be set by the user. When the setting is made so that the operation panel 30 is not displayed (when the use setting is “None”), the same display as the conventional display without displaying the operation panel 30 is performed. Further, when the operation panel 30 is set to be displayed (when the usage setting is “present”), the threshold value and the display information are displayed in advance (before the function according to the above-described embodiment is used). From the user or the like, an input of activation conditions for the operation panel 30 such as an elapsed time from when the operation panel 30 is displayed may be accepted. The presence / absence of use of the operation panel 30 and the activation conditions of the operation panel 30 are performed by a setting screen, for example. The functional configuration of the mobile terminal 10 has been described above.

  Subsequently, FIG. 4 shows a hardware configuration of the mobile terminal 10 according to the present embodiment. As shown in FIG. 4, the mobile terminal 10 includes hardware such as a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a ROM (Read Only Memory) 103, a mobile communication module 104, an antenna 105, and the like. ing. In addition, the mobile terminal 10 includes the touch panel 11 as hardware as described above. The functions described above are exhibited when these components are operated by a program or the like. The above is the configuration of the mobile terminal 10.

  Subsequently, an operation control method, which is a process executed by the mobile terminal 10 according to the present embodiment, will be described using the flowcharts of FIGS. 5 and 6. First, processing executed at the time of presetting will be described using the flowchart of FIG. This process is performed, for example, after a setting screen is displayed on the mobile terminal 10 by a user operation. First, the operation panel display unit 13 accepts an input as to whether or not the operation panel 30 is used (S01, operation panel display step). The input is performed by a user operation. Here, when an input indicating that the usage setting is “None” is accepted (NO in S02), the fact is memorized by the operation panel display unit 13 (S04, operation panel display step), and the process ends.

  When an input indicating that the usage setting is “Yes” is accepted in S01 (YES in S02), the operation panel display unit 13 subsequently accepts an input of the activation condition of the operation panel 30 (S03, operation panel display step). ). That is, input of information indicating the elapsed time from when the above threshold value or display information is displayed until the operation panel 30 is displayed is accepted. Subsequently, the operation panel display unit 13 stores information indicating that the input usage setting is “present” and the activation condition (S04, operation panel display step). Based on the information stored in this process, the process described later is executed. The above is the process executed at the time of pre-setting.

  Subsequently, processing executed when displaying and operating display information will be described with reference to the flowchart of FIG. Note that this processing is performed only when the usage setting is “present” in the processing illustrated in FIG. 5. In this process, first, display information is displayed on the touch panel 11 (S11). For example, a WEB page is displayed on the display 11a of the touch panel 11 as shown in FIG. This display is performed based on a user operation on the mobile terminal 10.

  When the display information is displayed, the detection unit 12 detects an area in which the function is executed (for example, a specific area such as a link to another WEB page as described above) from the display information, The number or area of the regions is detected (S12, detection step). Information indicating the detected number or area is output from the detection unit 12 to the operation panel display unit 13.

  Subsequently, the operation panel display unit 13 determines whether or not the number or area of regions indicated by the information input from the detection unit 12 is equal to or greater than a threshold (S13, operation panel display step). If the number or area of the regions is less than the threshold (NO in S13), the process is repeated from the display (S11) on the touch panel 11 again. Note that the processing is repeated not only when new, different display information is displayed, but also when the displayed display information is scrolled or the like and the display content on the display 11a is changed.

  If the number or area of the regions is equal to or greater than the threshold (YES in S13), the operation panel 30 is displayed on the display 11a of the touch panel 11 under the control of the operation panel display unit 13 (S14, operation panel display step). For example, as shown in FIG. 3B, an operation panel is displayed on the display 11a of the touch panel 11 so as to overlap the display of the WEB page. When the elapsed time since the display information is displayed on the display 11a is stored as the activation condition of the operation panel 30, the display on the operation panel 30 is set after the elapsed time is set. Done. If another display information is displayed on the display 11a before the set time has elapsed, the operation panel 30 is not displayed and the process is repeated from the display on the touch panel 11 (S11).

  Subsequently, the operation panel display unit 13 inputs an operation for the display information through the displayed operation panel 30, and an operation corresponding to the operation is executed (S15). This operation is performed by the user. For example, as shown in FIG. 3C, the scroll page 31 of the operation panel 30 is used to scroll the web page. Subsequently, when an erasing operation of the operation panel 30 (tap of the release button 34) is performed by the user's operation, the operation panel display unit 13 inputs the operation and erases the operation panel 30 (S16). Operation panel display step). For example, the operation panel 30 is deleted after the display information is scrolled as shown in FIG. If the user does not want to perform an operation using the operation panel 30, the operation panel 30 may be deleted without performing the operation (S15) using the operation panel such as scrolling. When the operation panel 30 is erased, the processing is repeated from the display (S11) on the touch panel 11 again. The above is the processing executed when displaying and operating the display information.

  As described above, in the present embodiment, according to the number or area of the areas in which the function set by selecting a link or other object included in the display information displayed on the display screen is executed, The operation panel 30 is displayed. Accordingly, the user can operate the displayed operation panel 30 to perform scrolling, copying of information included in the above area, or the like while browsing display information such as a WEB page. it can. In this case, for example, since the user does not intend to display the display information of the link destination, the transition to the display information of the link destination is not performed, and the operation intended by the user is surely performed. Can do. In addition, since the display of the operation panel 30 is performed according to the number or area of the regions as in the present embodiment, for example, when there is a low possibility that the user's operation is hindered, for example, there are few links in the display information. Can prevent the operation panel 30 from being displayed. That is, the operation panel 30 can be displayed only when necessary.

  Further, the operation using the operation panel 30 can be, for example, any one of scrolling, copying, and displaying other display information as in the present embodiment. However, the operation panel 30 for performing other operations may be displayed.

  Further, as in the present embodiment, a region where a function set by selection is executed can be used as a link to other display information. According to this configuration, for example, the operation panel 30 can be displayed when the web page being browsed includes many links. That is, the operation panel 30 can be displayed appropriately. However, it is not necessarily a link, and may be an object other than a link as described above.

  Moreover, you may enable it to set the elapsed time until displaying the operation panel 30 like this embodiment. According to this configuration, the time until the operation panel 30 is displayed can be made appropriate, and convenience can be improved.

  Further, as in the present embodiment, the display device is preferably a touch panel. In the case of a touch panel (particularly in the case of a small screen such as a smartphone), it is difficult for the user to perform input at an accurate operation position on the display screen, so that the effect of the present invention can be further increased. In addition, although the terminal which concerns on this embodiment was the portable terminal 10, it does not necessarily need to be the portable terminal 10, and can apply this invention to arbitrary things provided with a display apparatus.

  DESCRIPTION OF SYMBOLS 10 ... Portable terminal, 11 ... Touch panel, 11a ... Display, 12 ... Detection part, 13 ... Operation panel display part, 101 ... CPU, 102 ... RAM, 103 ... ROM, 104 ... Mobile communication module, 105 ... Antenna.

Claims (6)

A terminal having a display screen and including a display device for displaying display information on the display screen;
Detecting means for detecting a region in which the set function is executed by being selected in the display information displayed on the display screen, and detecting the number or area of the region;
Operation panel display means for displaying an operation panel for performing an operation on the display information on the display screen in accordance with the number or area of the regions detected by the detection means;
A terminal equipped with.   The operation panel display means, as the operation, performs at least one of scrolling of the display information, copying of information included in the display information, and display of other display information by a link included in the display information. The terminal according to claim 1 which displays.   The terminal according to claim 1, wherein the area is an area in which a function of displaying other display information is executed.   The operation panel display unit receives an input for setting a time until the operation panel is displayed, and displays the operation panel after the display information has been displayed by the display device. The terminal as described in any one of -3.   The terminal according to any one of claims 1 to 4, wherein the display device is a touch panel that detects an input to the display screen and receives an input. An operation control method by a terminal having a display screen and including a display device that displays display information on the display screen,
In the display information displayed on the display screen, a detection step of detecting the number or area of the areas where the function set by being selected is executed;
An operation panel display step for displaying an operation panel for performing an operation on the display information on the display screen according to the number or area of the regions detected in the detection step;
Including an operation control method.

Images