JP2013182342A - Input device, method and program of controlling input device, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve convenience for a user to execute a desired function in an input device including a touch panel.SOLUTION: A smartphone 100 includes a contact area identifying unit 14 for identifying a selection area 6a which is contacted by an icon 1a when moving the icon 1a by flick operation 8, and a command identifying unit 15 for identifying a command 9 which is allocated to the selection area 6a by an area arrangement unit 17.

Description

  The present invention relates to an input device capable of inputting information by selecting and operating an icon based on a user operation such as touch or flick.

  An electronic device having a display screen provided with a touch panel has been widely used, and an opportunity for a user to perform a touch operation or a flick operation on the touch panel of the electronic device is increasing. For example, in information terminals such as so-called smartphones and some home-use game machines, an “icon” that expresses a process (application) to be executed by an electronic device or a target (data) of the process with a picture or a symbol. By selecting and operating the user, the user can give an input to the electronic device.

  According to the method of inputting using such a touch panel, the user can give an input intuitively and easily compared to the conventional method in which the user gives an input by operating an input device such as a keyboard. Therefore, electronic devices having a display screen with a touch panel are often designed so that many operations can be performed by selecting and operating icons.

  Against this background, attempts have been widely made to improve the method of allowing the user to select an icon and the operability of the touch panel by flicking.

  For example, Patent Document 1 describes an example of a technology related to an electronic device having a display screen provided with a touch panel.

  The input device with a touch panel described in Patent Document 1 is “a display device, menu display means for displaying a menu including icons for promoting input on the display device, a touch panel used in combination with the display device, The touch position calculation means for calculating the touch position on the touch panel and the touch position calculated by the touch position calculation means when the touch panel is touched are defined as the first touch position, and the touch state is maintained from the first touch position. A movement direction detection means for detecting a movement direction from the first touch position to the second touch position, wherein the touch position calculated by the touch position calculation means is a second touch position; Control means for selecting an icon located on the extension of the moving direction in the menu. Are those, it operates as follows.

  According to the input device with a touch panel, the selection of the icon is determined based on the moving direction of the touch position, not the position where the touch panel is touched. That is, no matter which icon on the display device is selected, the user does not need to change the touch position of the touch panel in accordance with the display position of the icon, and can be operated only by the movement of the finger on the touch panel. .

Japanese Patent Laying-Open No. 2005-321964 (released on November 17, 2005)

  However, with the above-described conventional configuration, the functions of an electronic device are increasing and complicated, and even if a user tries to execute a desired function, the position where the icon for that function is displayed on the display screen is unknown. There is a case. Further, when the function selection menu is hierarchized, a selection operation is required in each hierarchy, and it takes time to select a desired function.

  The present invention has been made in view of the above problems, and an object of the present invention is to easily perform an operation when a user selects desired information in an input device that inputs information by operating an icon. It is to provide an input device or the like that can perform the above.

  In order to solve the above problems, an input device according to the present invention includes an input surface capable of detecting a user operation and a display surface capable of displaying an icon, and the icon is displayed based on an operation on the input surface. An input device capable of inputting input information by operating, wherein one or a plurality of areas respectively assigned with one or a plurality of information associated in advance with a selection icon selected on the display surface are An area placement means for placing on the display surface, an operation detection means for detecting an operation for instructing the movement direction of the selection icon, and when the selection icon is moved along the movement direction detected by the operation detection means, The area specifying means for specifying the selection area touched by the selection icon from the areas arranged by the area arranging means, and the area specifying means specifies And the information allocated by the area placement means to said selected area is characterized in that and an information specifying means for specifying as the input information.

  The input device control method according to the present invention includes an input surface capable of detecting a user operation and a display surface capable of displaying an icon, and operates the icon based on an operation on the input surface. A method of controlling an input device capable of inputting input information, wherein one or a plurality of areas each assigned with one or a plurality of information previously associated with a selection icon selected on the display surface are displayed on the display device An area placement step for placing on the surface, an operation detection step for detecting an operation for instructing a movement direction of the selection icon, and when the selection icon is moved along the movement direction detected in the operation detection step, An area identification step for identifying a selection area that the selection icon touches from the areas arranged in the area arrangement step; The information assigned by the area placement steps for identified the selected area at the area specifying step, is characterized in that it comprises an information specifying step of specifying as the input information.

  With the above-described configuration and method, one or a plurality of areas each allocated with one or a plurality of information previously associated with a selection icon selected on the display surface are arranged on the display surface, and movement instructed by a user operation When the selection icon is moved along the direction, information assigned to the selection area with which the selection icon contacts is specified as input information.

  Therefore, the user can input information to be input only by performing an operation of instructing the moving direction of the icon following the operation of selecting the icon. Therefore, an operation when the user selects desired information can be easily performed.

  In particular, when the input device is applied to an electronic device having a large number of functions, the user can touch the target icon, for example, without searching for a desired function while switching between screens as in the past. It is possible to execute a desired function only with a simple operation of playing.

  Furthermore, the input device according to the present invention further includes icon display means for displaying a plurality of icons on the display surface, and the icon display means is configured to display the icon when one selection icon is selected from the plurality of icons. The selection icon is displayed in a state in which the user can instruct the moving direction only with respect to the selection icon.

  With the above-described configuration, after the selection icon is selected, the selection icon is displayed in a state where the user can instruct the moving direction only for the selection icon. Thereby, the moving direction can be correctly instructed to the selected icon.

  Furthermore, in the input device according to the present invention, when the selection icon is moved along the movement direction detected by the operation detection unit, the selection icon does not touch any area arranged by the area arrangement unit. In this case, the icon display means displays a plurality of icons on the display surface in a state where the selection icon can be selected again.

  With the above configuration, when the operation for instructing the moving direction of the selection icon is an instruction for a direction not touching any area, the selection icon can be selected again. That is, the user confirms the area displayed after selecting the selection icon, and if there is no desired area, the user selects the selection icon by instructing the moving direction of the selection icon so as not to touch any area. The icon selection can be canceled.

  Therefore, the operation for canceling the selection of the selected icon can also be performed by an operation for instructing the moving direction of the selected icon, similarly to the operation for selecting the area. Therefore, since the operation is common, a user interface with excellent operability can be realized.

  Furthermore, the input device according to the present invention is characterized in that the area arranging means arranges the area along the end of the display surface.

  With the above configuration, since the areas are further arranged along the edge of the display surface, a large number of areas can be simultaneously displayed on the display surface. Accordingly, the contact icon can be moved to display a large number of target areas to be contacted, so that the user can select from many options.

  Furthermore, the input device according to the present invention is characterized in that the operation for instructing the moving direction of the selection icon detected by the operation detecting means is a flick operation on the input surface.

  With the above configuration, it is possible to instruct the moving direction of the selected icon by a flick operation on the input surface. Here, the flick operation is an operation that can quickly input the movement of the contact point on the input surface and instruct a desired direction. Therefore, it is optimal as an operation for operating the icon and instructing the moving direction. Therefore, a user interface with excellent operability can be realized.

  The input device may be realized by a computer. In this case, the control program of the input device that causes the input device to be realized by the computer by operating the computer as each of the means, and the program are recorded. Computer-readable recording media are also within the scope of the present invention.

  As described above, the input device according to the present invention is an area in which one or a plurality of areas to which one or a plurality of information previously associated with a selection icon selected on the display surface is assigned are arranged on the display surface. A selection unit that touches the selection icon when the selection icon is moved along the movement direction detected by the operation detection unit; Information for identifying, as the input information, area specifying means for specifying an area from the area arranged by the area arranging means, and information assigned by the area arranging means for the selected area specified by the area specifying means And a specifying means.

  In the input device control method according to the present invention, an area in which one or a plurality of areas each allocated with one or a plurality of information previously associated with a selection icon selected on the display surface is arranged on the display surface. An arrangement step, an operation detection step for detecting an operation for instructing a moving direction of the selection icon, and the selection icon touch when the selection icon is moved along the movement direction detected in the operation detection step. An area specifying step for specifying the selected area from the area arranged in the area arranging step, and information assigned in the area arranging step for the selected area specified in the area specifying step is the input information. And an information specifying step specified as

  Therefore, the user can input information to be input only by performing an operation of instructing the moving direction of the icon following the operation of selecting the icon. Therefore, it is possible to easily perform an operation when the user selects desired information.

It is a functional block diagram which shows the principal part structure of the smart phone which concerns on one embodiment of this invention. It is explanatory drawing which shows the outline | summary of the smart phone shown in FIG. 1, (a) shows the example of a screen display of the state touched with the icon showing a function, (b) is the screen of the state where the icon showing an action was touched A display example is shown. It is a front view which shows the external appearance of the smart phone shown in FIG. It is explanatory drawing which shows the example of the function and action information which the smart phone shown in FIG. 1 uses. It is a flowchart which shows an example of the flow of the process which the smart phone shown in FIG. 1 performs. (A)-(g) is a screen transition figure which shows the transition of the screen displayed by the process which the smart phone shown in FIG. 1 performs. It is a schematic diagram which shows the example of arrangement | positioning of the area previously allocated on the display surface in order for the smart phone shown in FIG. 1 to display a function and an action, (a) is an example in the case of arrange | positioning an area in 1 row, (B) shows an example in which areas are arranged in two rows.

  An embodiment of the present invention will be described in detail with reference to FIGS.

  In the following, in order to clearly indicate that there are a plurality of members, the members may be indicated by further adding a or b to the same member number. For example, “icon 1a”, “icon 1b”, and the like are shown. Moreover, a and b further added to the member number of the member may be omitted, and the member may be generically named. For example, the icon 1a and the icon 1b may be collectively referred to as “icon 1”.

  In the following description and the above drawings, a right-handed user holds the smartphone (input device) 100 according to the present embodiment with the right hand, and the thumb of the right hand is input to the input unit 40 (FIG. 2 (a)). Description will be made assuming that the surface is brought into contact. However, the hand that holds the smartphone 100 may be the right hand or the left hand, and the finger that contacts the input surface may not be the thumb.

  In addition, the user can use an indicator such as a stylus instead of a finger to operate the smartphone 100. That is, in the following description, “user's finger” includes “indicator such as stylus”. However, in order to ensure the simplicity of description, only “user's finger” is described below.

  Furthermore, in the following description and the above drawings, it is described as “the user makes a finger touch the input surface”. However, when the input surface of the input unit 40 is, for example, a touch panel that can detect the proximity of a finger, the smartphone 100 can operate in the same manner as in the case of contact by detecting the proximity of the user's finger to the input surface. It is. That is, in the following description, “contact” includes “proximity”. However, in order to ensure the conciseness of description, only “contact” is described below.

[Outline of smartphone 100]
Based on FIG. 2, the outline | summary of the smart phone 100 is demonstrated. 2A and 2B are explanatory diagrams showing an overview of the smartphone 100, in which FIG. 2A shows a screen display example in a state of being touched with an icon representing a function, and FIG. A display example is shown. 2A and 2B show arrows indicating the direction in which the icon 1a is moved by the flick operation 8 for convenience of explanation. However, the smartphone 100 may not actually display the arrow. The above also applies to other drawings.

  As shown in FIG. 2A, the smartphone (input device) 100 includes an input unit (input surface) 40 that can detect a user operation, and a display unit (display surface) 70 that can display the icon 1. The device is capable of inputting a command (input information) 9 by operating the icon 1 based on an operation on the input unit (input surface) 40. Specifically, the smartphone 100 includes an input surface that can detect a contact position (designated position) 3 (FIG. 1) by a user operation, a plurality of icons 1 (FIG. 6A), and a plurality of functions. A display surface capable of displaying action 2. One icon (selection icon) 1a can be selected based on the contact position 3, and one function / action 2a can be selected based on a flick operation (operation) 8 on the icon 1a. This is a device capable of inputting one command (information) 9 (FIG. 1).

  Here, the “command” refers to a command that instructs the smartphone 100 to execute a predetermined process. For example, it widely includes information given to general electronic devices such as an instruction to start a certain application and an instruction to open a certain file. The user can execute a desired function by inputting a command 9 specified by the icon (touched icon) 1a and the function / action (selected function / action) 2a.

  The smartphone 100 particularly displays one or more functions / actions 2... Associated with the touched icon 1 a in one or more areas 6... Of the screen edge, and performs the flick operation 8 on the icon 1 a. It is characterized in that one function / action 2a is selected by being moved by. Specifically, the smartphone 100 hides the other icons (non-selected icons) 1b when the user touches one icon 1a from the plurality of icons 1 (FIG. 6B), A plurality of functions / actions 2 associated with the touched icon 1a are displayed in the area 6 at the end of the screen (FIG. 6C). As shown in FIG. 2A, when the icon 1a is an icon representing a function, a function / action 2... Representing an action is displayed at the end of the screen. As shown in FIG. 2B, when the icon 1a is an icon representing an action, a function / action 2... Representing a function is displayed at the end of the screen.

  As a result, the user performs the flick operation 8 on the icon 1a in a state where a plurality of functions / actions 2 ... are displayed in the area 6 ... at the edge of the screen, thereby moving the icon 1a along the flick operation. It can be moved in the direction. When the icon 1a touches any area 6, the smartphone 100 considers that the function / action 2a displayed in the area 6 has been selected. When the function / action 2a is selected by the user, the smartphone 100 specifies the command 9 for executing the function / action 2a, and executes the command 9.

  As described above, the smartphone 100 displays the related function / action 2... In the area 6 at the end of the screen in accordance with the touched icon 1 a and causes the flick operation 8 to select the desired function / action 2 a. Can do. Therefore, the user can easily select the command 9. Therefore, the user can execute the command 9 simply by touching and flicking the icon 1a.

  Thereby, the smart phone 100 can implement | achieve a user interface with a high freedom degree. In particular, the smartphone 100 does not need to increase the number of icons by the number of functions or allow the user to select a hierarchical menu after the user selects an icon. Therefore, the smartphone 100 can improve convenience when the user executes a desired function.

[Appearance of smartphone 100]
Based on FIG. 3, the external appearance of the smart phone 100 is demonstrated. FIG. 3 is a front view illustrating an appearance example of the smartphone 100.

  As shown in FIG. 3, the smartphone 100 includes an input unit 40 and a display unit 70. In order to clarify the function of each configuration, FIG. 1 shows the input unit 40 and the display unit 70 separately. For example, when the input unit 40 is realized by a touch panel and the display unit 70 is realized by a liquid crystal display, As shown in FIG. 3, both may be configured as a single unit.

[Configuration of Smartphone 100]
Based on FIG. 1, the structure of the smart phone 100 is demonstrated. FIG. 1 is a functional block diagram illustrating a main configuration of the smartphone 100. In addition, in order to ensure the simplicity of description, the description and illustration of the configuration of parts not directly related to the present embodiment are omitted. However, the smartphone 100 may include the omitted configuration in accordance with the actual situation.

  As shown in FIG. 1, the smartphone 100 includes a control unit 10, a command execution unit 20, a storage unit 30, an input unit 40, a display control unit 60, and a display unit 70. Hereinafter, the input unit 40, the storage unit 30, the control unit 10 (icon / area display processing unit 11, flick detection unit (operation detection unit) 12, icon movement unit 13, contact area identification unit (area identification unit) 14, command identification Unit 15), command execution unit 20, display control unit 60, and display unit 70 will be described in the order of the functions of each component.

  The input unit 40 outputs two-dimensional coordinate information on the input surface of the user's finger that has touched the input surface to the control unit 10 as the contact position 3. That is, the “input surface” is included in the input unit 40. The input unit 40 is not limited to a touch panel as long as the user can input an operation for selecting the icon 1a and an operation for moving the icon 1a toward the function / action 2a.

  The storage unit 30 includes icon information 4 of each icon 1, function / action information 5 of each function / action 2, initial display position information indicating a default display position (area) on the input surface of each function / action 2, function / action Data such as priority position information indicating the priority order of the areas 6... When assigning the action 2 (that is, the priority order of display positions on the input surface) is stored.

  Here, the icon information 4 includes at least the association between each icon 1 and the function / action 2. The function / action information 5 includes at least the number of uses (count) of each function / action 2 and the association with the command 9.

  The storage unit 30 can be configured by a nonvolatile storage device such as a hard disk, a semiconductor memory, or a DVD (Digital Versatile Disk). Moreover, although the memory | storage part 30 demonstrates as an apparatus (FIG. 1) incorporated in the smart phone 100 in this Embodiment, the external storage device connected so that communication was possible outside the smart phone 100 may be sufficient.

  The control unit 10 comprehensively controls various functions of the smartphone 100. Each function of the control unit 10 may be realized by a CPU (Central Processing Unit) executing a program stored in a storage element such as a RAM (Random Access Memory) or a flash memory.

  When the contact position 3 is input from the input unit 40, the control unit 10 determines whether the icon 1 is touched based on the contact position 3. If it is determined that the icon is touched, the icon information 4 of the touched icon 1 a and the function / action information 5 corresponding to the icon 1 a are acquired from the storage unit 30. Further, the control unit 10 determines whether or not the icon 1a has touched the area 6 (function / action 2) by the user's flick operation 8. When it is determined that contact has been made (that is, when it is determined that a function / action has been selected), the control unit 10 identifies the function / action 2a corresponding to the contacted area 6a, and corresponds to the specified function / action 2a. Command 9 to be output to the command execution unit 20.

  Specifically, as shown in FIG. 1, the control unit 10 includes an icon / area display processing unit 11, a flick detection unit 12, an icon moving unit 13, a contact area specifying unit 14, and a command specifying unit (information specifying unit) 15. including.

  The icon / area display processing unit 11 acquires the icon information 4 from the storage unit 30 and displays a plurality of icons 1 on the display unit 70 (FIG. 6A). When the contact position 3 is input from the input unit 40, it is determined whether or not the icon 1 is touched based on the contact position 3. If the touched icon 1a is determined to be touched, the function / action information 5 corresponding to the touched icon 1a is acquired from the storage unit 30, and a plurality of functions / actions 2 ... are displayed at a plurality of areas at the screen edge of the display unit 70 6... (FIG. 6C).

  Specifically, the icon / area display processing unit 11 includes an icon display unit (icon display unit) 16 and an area arrangement unit (area arrangement unit) 17.

  The icon display part 16 acquires the icon information 4 from the memory | storage part 30, and displays the some icon 1 ... on the display part (display surface) 70 (FIG. 6 (a)). When the touched icon 1a is specified based on the contact position 3 input from the input unit 40, all the other icons 1b ... displayed on the display unit 70 are hidden (FIG. 6B). . That is, when one icon (selected icon) 1a is selected from the plurality of icons 1..., The icon display unit 16 is in a state where the user can instruct the moving direction only with respect to the icon 1a. Icon 1a is displayed.

  The icon display unit 16 cancels the selection of the icon 1a when the icon 1a moved by the icon moving unit 13 contacts the screen edge other than the area 6... And displays the icon 1b that has been hidden again. (FIG. 6A). That is, when the icon display unit 16 moves the icon 1a along the movement direction detected by the flick detection unit 12, the icon 1a does not contact any of the areas 6 arranged by the area arrangement unit 17, A plurality of icons 1 are displayed on the display unit (display surface) 70 in a state where the icons 1a can be selected again.

  The icon display unit 16 outputs the icon information 4 and instructs the display control unit 60 on a display form to be displayed on the display unit 70.

  In the present embodiment, the case where all the icons 1b except the touched icon 1a are “hidden” will be described, but the present invention is not limited to this. That is, the display form of at least one of the icon 1a and the other icons 1b may be changed so that the user can identify the touched icon 1a and the other icons 1b. For example, as a display form other than making the icons 1b... Non-displayed, the icons 1b... May be “semi-transparent”, or the icons 1a may be “flashing” or “enhance the outline”.

  When the touched icon 1a is specified based on the contact position 3 input from the input unit 40, the area arranging unit 17 acquires the function / action information 5 corresponding to the touched icon 1a from the storage unit 30. . Then, in accordance with the function / action information 5, a plurality of functions / actions 2 are displayed in a plurality of areas 6 at the end of the screen of the display unit 70 (FIG. 6C). That is, the area arrangement unit 17 displays one or a plurality of areas 6 to which one or a plurality of commands previously associated with the icon (selected icon) 1a selected on the display unit (display surface) 70 is assigned. Arranged along the end of the portion (display surface) 70. The area arrangement unit 17 outputs the function / action information 5 and instructs the display control unit 60 on the display form to be displayed on the display unit 70. Further, the position on the display unit (display surface) 70 where the area arranging unit 17 arranges one or a plurality of areas 6... Is not limited to the end portion, and the icon 1 a contacts the other area 6 in any area 6. If it can be reached without doing, it may be arranged more inside.

  Here, the area arranging unit 17 arranges the areas 6... As close as possible to the vicinity of the position touched by the user, that is, the position of the icon 1a. For example, when it is desired to always perform a flick operation on the icon 1a in the lower right area of the display surface (FIG. 2A), when the user selects the icon 1a, all the icons displayed on the display surface are displayed. The icons 1 may be moved so as to pass through the area, and the user may touch the icon 1a in the area. Further, when the user touches the icon 1a, if the position of the icon 1a is not in the area, the icon 1a may be moved to the area.

  The flick detection unit 12 detects a flick operation 8 for the input unit 40 performed by the user to move the icon 1a in a state where the identified icon 1a and the function / action 2... Are displayed on the display unit 70. (FIG. 6 (e)). That is, the flick detection unit 12 detects the flick operation 8 for the input unit (input surface) 40 as an operation for instructing the moving direction of the icon (selected icon) 1a. In this embodiment, the flick operation on the touch panel is described. However, the present invention is not limited to this as long as it is an input operation for designating a direction in which the icon 1a is moved.

  The icon moving unit 13 moves the icon 1a in the direction along the flick operation 8 detected by the flick detection unit 12 in a state where the specified icon 1a and the function / action 2... Are displayed on the display unit 70. (FIG. 6 (e)). The icon moving unit 13 outputs the position information of the moving icon 1a and instructs the display control unit 60 on the display form to be displayed on the display unit 70. However, whether or not to display the image of the icon 1a moving between the flicked position and the contact area 6a is arbitrary. That is, after the flick detection unit 12 detects, the contact with the areas 6... May be determined immediately, and the subsequent processing may be performed.

  When the icon 1a moved by the icon moving unit 13 contacts the area 6 (FIG. 6 (e)), the contact area specifying unit 14 specifies the function / action 2a corresponding to the area 6 and the function / action information. 5 is output to the command specifying unit 15. That is, when the contact area specifying unit 14 moves the icon (selection icon) 1a along the movement direction detected by the flick detection unit 12, the area arrangement unit 17 arranges the selection area 6a that the icon 1a contacts. Specified from the area 6.

  When the function / action information 5 of the function / action 2 a touched by the icon 1 a is input from the contact area specifying unit 14, the command specifying unit 15 specifies the command 9 according to the function / action information 5. That is, the command specifying unit 15 specifies the command assigned by the area arranging unit 17 to the selected area 6a specified by the contact area specifying unit 14 as the command (input information) 9 that the user wants to input. Then, the command specifying unit 15 outputs the specified command 9 to the command executing unit 20.

  The command execution unit 20 executes the command 9 input from the command specifying unit 15 (FIG. 6 (f)).

  The display control unit 60 converts the content into display data in a format that can be displayed on the display unit 70. Specifically, when displaying the icons 1..., The display control unit 60 receives the icon information 4 as an input from the control unit 10, and displays the icons 1 included in the icon information 4 at a predetermined display position of the display unit 70. The display data generated so that it can be displayed on the display unit 70 is output to the display unit 70. Further, when displaying the function / action 2..., The display control unit 60 receives the function / action information 5 as an input from the control unit 10 and displays the function / action 2 included in the function / action information 5 on the display unit 70. Display data generated so as to be displayed at a predetermined display position (area 6) is output to the display unit 70. The display control unit 60 may generate, for example, a bitmap format image from the icon information 4 and the function / action information 5, and then convert the image into display data. Moreover, the display control part 60 should just contain what can carry out format conversion to the data for a display, for example, a general display adapter may be sufficient.

  The display unit 70 is a device that displays the display data input from the display control unit 60 on the display surface of the display unit 70. That is, the “display surface” is included in the display unit 70. In this embodiment, a liquid crystal display (LCD) is mainly assumed. However, the type of hardware is limited as long as the device has a display function (particularly, a flat panel display). For example, a plasma display panel (PDP) or an organic EL (Electroluminescence) display may be used. Regardless of the display element, the display unit 70 can be configured as a device including the display element and a driver circuit that drives the display element based on display data input from the display control unit 60. .

  As described above, when the input unit 40 is realized by a touch panel and the display unit 70 is realized by a liquid crystal display, the two may be configured as one body (FIG. 3). In other words, the input unit 40 may include an input surface made of a transparent transmissive member such as glass formed in a rectangular plate shape, and may be integrally formed so as to cover the display surface of the display unit 70. Thereby, the contact position 3 of the user's finger with respect to the input surface of the input unit 40 and the display position of the graphic or the like displayed on the display surface by the display unit 70 in accordance with the contact match, so that the user has a natural input feeling. Can be obtained.

[Function / Action Information 5]
Here, the association between the icon 1 and the function / action 2 will be described with reference to FIG. FIG. 4 is an explanatory diagram showing an example of function / action information 5 in which a plurality of functions / actions 2... Are associated with a plurality of icons 1.

  As shown in FIG. 4, for example, “Mailbox”, “Create”, “Receive”, “Search”, “Address Book”, and “Setting” are associated as functions / actions with the “Mail” icon. ing. Similarly, the “pencil” icon is associated with “address book”, “mail”, “memo pad”, “illustration”, “SNS (Social Networking Service)”, and “calendar” as functions and actions. ing. As described above, an icon representing a function such as “mail” is associated with an action such as “mailbox”. An icon representing an action such as “pencil” is associated with a function such as “address book”.

  Further, although not shown in FIG. 4, in the function / action information 5, a character string defining a command for executing the function / action is set as information of each function / action 2. As will be described later, the function / action is selected and the number of times of execution (usage frequency) is stored in the function / action information 5 as information of the function / action 2. That is, in one function / action of the function / action information 5, a character string defining the name of the function / action and a character string defining a command for executing the function / action are set in advance in association with each other. ing. In addition, each function / action of the function / action information 5 is set in association with the number of times (usage frequency) added each time the function / action is selected and executed.

  By referring to such function / action information 5, when the icon 1a is touched, the area arrangement unit 17 determines the name of the function / action from the information of each function / action 2 ... associated with the icon 1a. Can be acquired and arranged and displayed in predetermined areas 6. When the icon 1a contacts the area 6a by the flick operation 8, the command specifying unit 15 defines a command set in the same function / action 2a as the name of the function / action displayed in the area 6a. A character string can be extracted and executed.

  For example, in the example of FIG. 2A, since the icon 1a is “mail”, the name of the function / action such as “mailbox” is acquired from the information of the associated functions / actions 2. Then, it is arranged and displayed in the area 6. When the “mail” icon 1a that has been subjected to the flick operation 8 comes into contact with the area 6a displaying “reception”, the “reception” process of the “mail” application is executed.

[Processes executed by the smartphone 100]
Next, the flow of processing executed by the smartphone 100 will be described with reference to FIGS. FIG. 5 is a flowchart illustrating an example of a flow of processing executed by the smartphone 100. FIG. 6 is a screen transition diagram showing a transition of screens displayed in the process executed by the smartphone 100.

  First, the icon display part 16 acquires the icon information 4 from the memory | storage part 30, and displays the several icons 1 ... on the display part 70 (S10; Fig.6 (a)). Next, when the contact position 3 is input from the input unit 40, the control unit 10 determines whether the icon 1 is touched based on the contact position 3 (S11).

  If the control unit 10 determines that one icon 1a has been touched (YES in S11), the icon display unit 16 hides all the icons 1b except the touched icon 1a (S12; FIG. 6 (b)). At the same time, the area arrangement unit 17 acquires the function / action information 5 corresponding to the touched icon 1 a from the storage unit 30. Then, according to the function / action information 5, a plurality of functions / actions 2 ... are displayed in a plurality of areas 6 ... at the end of the screen of the display unit 70 (S13 (area placement step); FIG. 6 (c)).

  When one icon 1a is not touched (NO in S11), the control unit 10 waits for the icon 1a to be touched while displaying a plurality of icons 1 on the display unit 70.

  Next, when a contact position 3 is input from the input unit 40 in a state where a plurality of functions / actions 2... Are displayed in the area 6 at the edge of the screen, the flick detection unit 12 displays an icon based on the contact position 3. It is determined whether or not 1a is touched again (S14). If it is determined that the touch has been made again (YES in S14), the area placement unit 17 changes the position of the function / action 2 ... placed on the display unit 70 (S15; FIG. 6 (d)).

  Although detailed description will be given later, when the functions / actions 2... Are displayed on the edge of the screen in a single manner, the arrangement is moved clockwise (FIG. 6D). Thereby, the position of the function / action 2 that the user wants to select can be moved from the icon 1a in a direction in which the flick operation 8 is easy to perform. If the function / action 2... Is displayed twice on the screen edge, the inner and outer columns are switched (FIG. 7B). This makes it possible to place the function / action 2... Initially assigned to the outer column in the inner column and bring the icon 1 a into contact with the flick operation 8.

  Next, when it is determined that it has not been touched again (NO in S14), the flick detection unit 12 detects a flick operation 8 for the icon 1a displayed on the input unit 40 (YES in S16 (operation detection step)). The icon moving unit 13 moves the icon 1a in the direction along the detected flick operation 8 (S17; FIG. 6E). Then, the icon moving unit 13 determines whether the icon 1a moved by the flick operation 8 has touched any area 6 (S18).

  It should be noted that after the icon 1a is touched again and the area placement unit 17 changes the position of the function / action 2. If not detected (NO in S16 (operation detection step)), the process returns to the process (S14) in which the flick detection unit 12 determines whether or not the icon 1a has been touched again.

  Next, when the icon moving unit 13 determines that the icon 1a has touched any area 6 (YES in S18; FIG. 6E), the contact area specifying unit 14 corresponds to the contacted area 6a. The function / action 2a is specified (S20 (area specifying step)). Then, the command specifying unit 15 specifies the command 9 according to the function / action information 5 of the function / action 2a (S21 (information specifying step)). Then, the command execution unit 20 executes the command 9 (S22; FIG. 6 (f)). In FIG. 6F, when the icon 1a representing the “mail” function is flicked 8 and the area 6a representing the “creation” action is selected, the mail application creation function is activated. The state where the button B20 is displayed is shown. When the user operates this button B20, a mail application creation function is activated.

  Thereafter, the contact area specifying unit 14 adds the number of times of use (count) of the selected function / action 2a, and stores it as the function / action 2a information in the function / action information 5 of the storage unit 30 (S23). ).

  On the other hand, when the icon moving unit 13 determines that the icon 1a moved by the flick operation 8 has not touched any of the areas 6 ... (NO in S18; FIG. 6 (g)), that is, the icon 1a If the end of the screen is reached without touching the areas 6..., The control unit 10 cancels the selection of the icon 1a by touch (S19). Then, the icon display unit 16 displays the hidden icon 1b again, and returns to the initial state in which the plurality of icons 1 are displayed on the display unit 70 (S10; FIG. 6A).

  As described above, in the smartphone 100, when the user selects the icon 1a and then moves the icon 1a so as not to touch any of the areas 6 ..., it is determined that the user has not selected any of the areas 6 .... To cancel the selection of the icon 1a.

[Area position and size]
Based on FIG. 7, an algorithm for determining how to display the functions / actions 2... (Area position and size) will be described. FIG. 7 is a schematic diagram showing an example of the arrangement of the areas 6... Allocated in advance on the display surface for displaying the functions / actions 2... (B) shows an example in which the areas 6... Are arranged in two rows.

  As described above, the areas 6 are arranged near the position touched by the user, that is, near the position of the icon 1a. 7A and 7B is determined based on the position of the icon 1a in the figure. If the position of the icon 1a is different, the area 6... The arrangement of will also change. The figure shows an arrangement example when the user operates with the right hand. When the user operates with the left hand, the left and right are reversed.

  Further, an area “X” in the figure is a place where the function / action 2 is left without being arranged in order to cancel the selection of the icon 1a. In FIGS. 7A and 7B, broken lines are displayed for convenience of explanation, but the broken lines may not actually be displayed.

  First, as shown in the arrangement example on the left of FIG. 7A, seven areas 6... From area “A” to area “G” are arranged clockwise. Here, it is assumed that the area “A” has the highest priority, and the priority is sequentially decreased to the area “G”. As shown in the drawing, the areas with high priority are arranged so as to gather near the position touched by the user, that is, near the position of the icon 1a.

  Then, when assigning the function / action 2... To the area 6..., The area arrangement unit 17 refers to the function / action information 5 and compares the frequency of use of each function / action 2. The functions and actions 2 are assigned to the area 6 with the highest priority in order. In this way, when the functions / actions 2 are arranged in one row, the area arrangement unit 17 moves the arrangement of the functions / actions 2 clockwise (or counterclockwise) when the icon 1a is touched again. (Example of arrangement on the right side of FIG. 7A). Thereby, the user can change the position of the function / action 2 to be selected from the icon 1a in a direction in which the user can easily flick.

  Next, in the left arrangement example of FIG. 7B, as in the left arrangement example of FIG. 7A, seven areas 6 from the area “A” to the area “G” are arranged clockwise. In addition to the above, seven areas 6... From the area “H” to the area “N” are further arranged in the clockwise direction. Here, it is assumed that the area “A” has the highest priority, and the priority is sequentially decreased to the area “N”. As shown in the drawing, the areas with high priority are arranged so as to gather near the position touched by the user, that is, near the position of the icon 1a.

  Then, when assigning the function / action 2... To the area 6..., The area arrangement unit 17 is an area having a higher priority in order from the function / action 2 having the highest use frequency, as in the arrangement example on the left in FIG. However, when the function / action 2 remains at the time when it is arranged in the inner areas 6... (A to G), it is assigned to the outer areas 6. In this way, when the functions / actions 2... Are arranged in two rows, when the icon 1a is touched again, the area arrangement unit 17 causes the inside functions / actions 2... (A to G) and the outside functions / actions to be touched. 2... (H to N) are replaced (arrangement example on the right in FIG. 7B). Thereby, even if the function / action 2 to be selected is arranged in the outer area, the user can change to the inner area in which the flicked icon 1a can be contacted.

  In the arrangement examples shown in FIGS. 7A and 7B, the arrangement is the same regardless of the size priority of the area 6. However, like the “mailbox” area in FIG. 2A, the area 6 for displaying frequently used functions / actions 2 (that is, the area 6 with high priority) is displayed larger than the other areas 6. May be.

  Further, in the arrangement example shown in FIGS. 7A and 7B, the position on the display surface where the area 6 with high priority is arranged with respect to the position of the icon 1a is set in advance. However, this setting may be determined based on the usage frequency of the area 6 in which the user flicks the icon 1a, that is, the area 6 in which the selected function / action 2 is displayed. This makes it possible to arrange the functions / actions 2... In an arrangement that is easy to use for each user.

[Effects played by the smartphone 100]
According to the smartphone 100, since the user can execute the command 9 only by touching and flicking the icon 1a, a user interface with a high degree of freedom can be realized. Further, since the smartphone 100 displays the related functions / actions 2... In the area 6 at the end of the screen according to the touched icon 1 a, the user can easily select the command 9. Therefore, the smartphone 100 has an effect that it is possible to improve convenience when the user executes a desired function / action.

[Combination of configurations (technical means) included in the embodiment]
Note that the configurations included in the above-described embodiments can be combined as appropriate. That is, the present invention is not limited to the above-described embodiment, and various modifications can be made within the scope shown in the claims. That is, embodiments obtained by combining technical means appropriately modified within the scope of the claims are also included in the technical scope of the present invention.

[Example of software implementation]
Finally, each block of the smartphone 100, particularly each block of the control unit 10, may be configured by hardware logic, or may be realized by software using a CPU as follows.

  In the latter case, the smartphone 100 includes a CPU that executes instructions of a program that realizes each function, a ROM (Read Only Memory) that stores the program, a RAM that expands the program, a memory that stores the program and various data, and the like Storage device (recording medium). An object of the present invention is to provide a recording medium on which a program code (execution format program, intermediate code program, source program) of a control program of the smartphone 100 that is software that realizes the above-described functions is recorded in a computer-readable manner. This can also be achieved by supplying the data to 100 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. IC cards (including memory cards) / optical cards, semiconductor memories such as mask ROM / EPROM / EEPROM / flash ROM, PLD (Programmable logic device), FPGA (Field Programmable Gate Array), etc. Logic circuits can be used.

  Further, the smartphone 100 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited as long as it can transmit the program code. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication network, and the like can be used. The transmission medium constituting the communication network may be any medium that can transmit the program code, and is not limited to a specific configuration or type. For example, even with wired lines such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL (Asymmetric Digital Subscriber Line) line, infrared rays such as IrDA and remote control, Bluetooth (registered trademark), IEEE 802.11 wireless, HDR ( It can also be used by radio such as High Data Rate (NFC), Near Field Communication (NFC), Digital Living Network Alliance (DLNA), mobile phone network, satellite line, and digital terrestrial network. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  As described above, in this specification, the means does not necessarily mean a physical means, and includes the case where the function of each means is realized by software. Further, the function of one means may be realized by two or more physical means, and the function of two or more means may be realized by one physical means.

  The present invention can be applied not only to smartphones but also to tablet terminals, personal computers, and other electronic devices including touch panels and pointing devices.

1 icon 1a icon (selection icon)
6 Area 6a Selection area 8 Flick operation (operation)
9 Command (input information, information)
12 Flick detection unit (operation detection means)
14 Contact area specifying part (area specifying means)
15 Command specifying part (information specifying means)
16 Icon display (icon display means)
17 Area arrangement part (area arrangement means)
40 Input section (input surface)
70 Display section (display surface)
100 Smartphone (input device)
S13 Area arrangement step S16 Operation detection step S20 Area identification step S21 Information identification step

Claims (8)

An input device including an input surface capable of detecting a user operation and a display surface capable of displaying an icon, and capable of inputting input information by operating the icon based on an operation on the input surface. ,
Area arranging means for arranging one or a plurality of areas respectively assigned one or a plurality of information previously associated with the selection icon selected on the display surface on the display surface;
Operation detecting means for detecting an operation for instructing a moving direction of the selected icon;
An area specifying means for specifying a selection area that the selection icon touches from the area arranged by the area arranging means when the selection icon is moved along the movement direction detected by the operation detecting means;
An input device comprising: information specifying means for specifying, as the input information, information assigned by the area arranging means to the selected area specified by the area specifying means. An icon display means for displaying a plurality of icons on the display surface;
The icon display means displays, when one selected icon is selected from the plurality of icons, the selected icon in a state in which the user can instruct a moving direction only with respect to the selected icon. The input device according to claim 1.   When the selection icon is moved along the movement direction detected by the operation detection unit, and the selection icon does not touch any area arranged by the area arrangement unit, the icon display unit displays the selection icon. The input device according to claim 2, wherein a plurality of icons are displayed on the display surface in a state where the icons can be selected again.   The input device according to claim 1, wherein the area arranging unit arranges the area along an end portion of the display surface.   5. The input device according to claim 1, wherein the operation indicating the moving direction of the selection icon detected by the operation detection unit is a flick operation on the input surface. 6. An input device control method comprising an input surface capable of detecting a user operation and a display surface capable of displaying an icon, and capable of inputting input information by operating the icon based on the operation on the input surface Because
An area arrangement step of arranging one or more areas, each assigned with one or more pieces of information previously associated with a selection icon selected on the display surface, on the display surface;
An operation detecting step for detecting an operation for instructing a moving direction of the selected icon;
An area specifying step for specifying a selection area that the selection icon contacts when moving the selection icon along the movement direction detected in the operation detection step from the area arranged in the area arrangement step;
An information specifying step for specifying, as the input information, information assigned in the area arrangement step for the selected area specified in the area specifying step.   A control program for operating the input device according to any one of claims 1 to 5, wherein the control program causes a computer to function as each of the means.   A computer-readable recording medium on which the control program according to claim 7 is recorded.

Images