JP2018032445A - Control program, control method, and control device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent erroneous operation caused by displacement at focus operation in operating a pointing device such as displacement at clicking in a mouse operation.SOLUTION: An operation target information generating part 12 generates operation acceptance region information and operation target information containing an input target item, and stores them in an operation target information storage part 14. Then, in a case where a mouse pointer is in an operation acceptance region on the basis of operation target information stored with the operation target information storage part 14, a focus setting part 16 sets a focus at the input target item.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a control program, a control method, and a control device.

  When operating a computer, a mouse is mainly used as a method of instructing an operation target on a GUI (Graphical User Interface). In the operation with the mouse, the user moves the mouse pointer to a target position and then clicks the mouse button while holding the mouse position.

  For example, when the user moves the mouse pointer to the input field on the GUI and clicks the mouse button, the focus is set to the input field and the keyboard can be input to the input field. Here, the focus being set in the input field means that the input field can be input from the keyboard.

  Further, when the user moves the mouse pointer to a button on the GUI and clicks the mouse button, the focus is set on the button and the button is pressed. When focus is set on a button on the GUI, input from the keyboard becomes possible for the button, and when “space” is input from the keyboard, the button is pressed.

  In addition, as a technique related to the mouse operation, there is a conventional technique in which metadata such as a title and an author is extracted from a document image by a user performing a mouse operation on the document image displayed on the display (for example, (See Patent Document 1).

JP 2005-71349 A

  However, in the case of a disabled person or an elderly person whose grip strength is reduced, there is a problem that the position of the mouse may be shifted when the mouse button is clicked, and a target different from the target target is operated.

  In one aspect, an object of the present invention is to provide a GUI that prevents an erroneous operation caused by a position shift at the time of a focus operation in a pointing device operation such as a position shift at the time of a mouse operation.

  In one aspect, a control program disclosed in the present application causes a computer to execute the following processing. The control program makes a transition to a state in which an input operation to the button or the input field is accepted in response to detection of a pointer entering the area around the button arranged in the screen or the area around the input field. Is executed on the computer.

  According to one embodiment, it is possible to prevent an erroneous operation due to a positional shift during a focus operation in a pointing device operation.

FIG. 1 is a diagram for describing setting of a focus on an operation target item. FIG. 2 is a diagram illustrating a functional configuration of the GUI unit according to the embodiment. FIG. 3A is a diagram for explaining an operation target for which operation target information is created by the operation target information creation unit. FIG. 3B is a diagram illustrating an operation reception area. FIG. 3C is a diagram for explaining the input target items. FIG. 4A is a first diagram illustrating another example of items that can be input items. FIG. 4B is a second diagram illustrating another example of items that can be input items. FIG. 5 is a diagram illustrating an example of the item information storage unit. FIG. 6 is a diagram illustrating an example of the operation target information storage unit. FIG. 7 is a flowchart showing a flow of processing for creating operation target information by the operation target information creation unit. FIG. 8 is a flowchart showing a flow of processing for accepting a user input operation. FIG. 9 is a diagram illustrating a hardware configuration of the PC according to the embodiment.

  Hereinafter, embodiments of a control program, a control method, and a control device disclosed in the present application will be described in detail with reference to the drawings. Note that this embodiment does not limit the disclosed technology.

  First, setting of the focus on the operation target item in the GUI according to the embodiment will be described. Here, the setting of the focus on the operation target item is a state in which input from the keyboard can be performed on GUI parts such as input fields and buttons.

  FIG. 1 is a diagram for explaining setting of a focus on an operation target item in the GUI according to the embodiment. In the GUI according to the embodiment, if the mouse pointer is in the area 4 shaded with halftone dots, the focus is on the input field 2 even if the mouse button is not clicked or the mouse pointer is not in the input field 2. Is set. Further, in the GUI according to the embodiment, if the mouse pointer is in the shaded area 5, the mouse button is not clicked, and even if the mouse pointer is not on the button 3, the focus is on the button 3. Is set.

  Thus, in the GUI according to the embodiment, the user can set the focus on the operation target without clicking the mouse button. Therefore, the GUI according to the embodiment can prevent the user from clicking the button 3 by mistake due to the displacement when the user clicks the input field 2.

  In addition, the user can specify with a mouse pointer an operation range wider than the actual operation target. Therefore, the GUI according to the embodiment can prevent an erroneous operation by the mouse pointer even when the user cannot accurately indicate a small operation target with the mouse pointer.

  Next, a functional configuration of the GUI unit according to the embodiment will be described. Here, the GUI unit is a functional unit that provides a GUI to the display device. The GUI unit is realized by executing a GUI program on a computer.

  FIG. 2 is a functional block diagram illustrating the configuration of the GUI unit according to the embodiment. As shown in FIG. 2, the GUI unit 10 includes a display unit 11, an operation target information creation unit 12, an item information storage unit 13, an operation target information storage unit 14, a position monitoring unit 15, and a focus setting unit 16. And an input receiving unit 17. The GUI unit 10 is activated in response to a request from an application 20 running on a PC (Personal Computer) 1.

  The display unit 11 displays a GUI screen on the display device based on a request from the application 20. Further, the display unit 11 displays a GUI component on the display device based on an instruction from the operation target information creation unit 12.

  The operation target information creation unit 12 creates information about the operation target with the mouse on the GUI screen, and stores the created information in the operation target information storage unit 14. FIG. 3A is a diagram for explaining an operation target for which operation target information is created by the operation target information creation unit 12.

  As shown in FIG. 3A, a group x is created by grouping input items 31a, item titles 32a, and decorative frames 33a, which are GUI components, and the created group x becomes an operation target with the mouse. In addition, the input item 31c, the item title 32c, and the decoration frame 33c, which are GUI parts, are grouped to create a group y, and the created group y becomes an operation target with the mouse. As described above, the operation target information creation unit 12 creates an operation target by grouping GUI parts.

  In addition, the operation target information creation unit 12 defines an operation reception area for the operation target. Here, the operation reception area is an area that the mouse pointer should point to in order to set the focus on the input target item included in the operation target.

  FIG. 3B is a diagram illustrating an operation reception area. In FIG. 3B, the operation reception area 34a is an operation reception area corresponding to the group x shown in FIG. 3A, and the operation reception area 34c is an operation reception area corresponding to the group y shown in FIG. 3A.

  The operation target information creating unit 12 defines an operation reception area for the operation target based on an instruction from the designer of the GUI screen. Alternatively, the operation target information creation unit 12 automatically defines an area on the screen in which all GUI components included in the operation target group are included as an operation reception area.

  For example, the operation target information creation unit 12 includes the upper left coordinates of the GUI part located at the upper left position on the GUI screen among the GUI parts included in the operation target group, and the lower right position of the GUI part located at the lower right position. A rectangle whose coordinates are diagonal lines is defined as an operation reception area. In addition, the operation target information creation unit 12 provides predetermined widths in the upper, lower, left, and right sides of a rectangle whose diagonal lines are the upper left coordinates of the GUI component located at the upper left and the lower right coordinates of the GUI component located at the lower right. It can also be used as an operation reception area.

  The operation target information creation unit 12 determines one input target item included in the operation target. FIG. 3C is a diagram for explaining the input target items. 3C, the operation target information creation unit 12 determines the input item 31a included in the group x illustrated in FIG. 3A as the input target item, and selects the input item 31c included in the group y illustrated in FIG. 3A as the input target item. Determine as.

  Then, the operation target information creation unit 12 stores group information, operation reception area information, and input target item information in the operation target information storage unit 14 as operation target information. As described above, the operation target information creating unit 12 creates the operation target information, so that the GUI unit 10 can set the focus based on the operation target information.

  In addition, although FIG. 3A-FIG. 3C demonstrated the case where the input item which has an input column was made into an input object item, another item can also be made into an input object item. 4A and 4B are diagrams illustrating other example items that can be set as input target items.

  As shown in FIG. 4A, other items that can be input items include a button 3 and a check box 6 on the GUI screen. As shown in FIG. 4B, another item that can be an input target item is a link 7 to a Web page.

  Returning to FIG. 2, the item information storage unit 13 stores item information using GUI parts as items. FIG. 5 is a diagram illustrating an example of the item information storage unit 13. As shown in FIG. 5, the item information storage unit 13 stores an item number, an item type, an upper left coordinate, a lower right coordinate, a data type, an item value, and the like for each item.

  The item number is a number for identifying the item. The item type indicates the type of item. The upper left coordinate is the xy coordinate at the upper left of the item on the GUI screen, and the lower right coordinate is the xy coordinate at the lower right of the item on the GUI screen. The coordinates are, for example, the upper left corner of the screen as the origin, the right direction of the screen as the x axis, and the lower direction of the screen as the y axis.

  Note that the area occupied by the item on the GUI screen is a rectangle. Further, the operation target information creating unit 12 can automatically define an operation reception area using the upper left coordinates and lower right coordinates stored in the item information storage unit 13.

  The data type indicates the type of value received from the keyboard when the item is an input target item. The item value indicates a value related to the item. For example, when the item type is “item title”, the item value indicates a title.

  For example, for the item whose item number is “00003”, the item information storage unit 13 sets “item title” as the item type, (10, 10) as the upper left coordinate, (30, 40) as the lower right coordinate, “Item A” is stored as the item value.

  The operation target information storage unit 14 stores operation target information. FIG. 6 is a diagram illustrating an example of the operation target information storage unit 14. As illustrated in FIG. 6, the operation target information storage unit 14 stores a group name, an upper left coordinate, a lower right coordinate, an item number, an input target item number, and n item numbers for each operation target. Here, n is the maximum number of items included in the operation target.

  The group name is a name for identifying a group corresponding to the operation target. The upper left coordinate is the xy coordinate at the upper left of the operation reception area on the GUI screen, and the lower right coordinate is the xy coordinate at the lower right of the operation reception area on the GUI screen. The number of items is the number of items included in the operation target, that is, the number of GUI components, and the input target item number is a number for identifying only one input target item defined for the operation target. The item number is a number for identifying an item included in the operation target, and there are only the number of items.

  For example, for the operation target corresponding to the group whose group name is “x”, the operation target information storage unit 14 sets (8, 8) as the upper left coordinates and (68, 45) as the lower right coordinates as the number of items. “0001” is stored as “3” as an input target item number. In addition, the operation target information storage unit 14 stores “00003”, “00011”, and the like as item numbers for the operation target corresponding to the group whose group name is “x”.

  The position monitoring unit 15 monitors the position of the mouse pointer and notifies the focus setting unit 16 of the position of the mouse pointer. The focus setting unit 16 specifies an operation target indicated by the mouse pointer based on the position of the mouse pointer, and sets a focus on the specified operation target. Specifically, when the mouse pointer moves into one of the operation reception areas defined by the upper left coordinates and the lower right coordinates stored in the operation target information storage section 14, The corresponding operation target is specified as the operation target indicated by the mouse pointer.

  The input receiving unit 17 receives input from the keyboard for an input target item included in the operation target for which focus is set, and passes the input to the application 20.

  Next, a flow of processing for creating operation target information by the operation target information creating unit 12 will be described. FIG. 7 is a flowchart showing a flow of processing for creating operation target information by the operation target information creating unit 12.

  As illustrated in FIG. 7, the operation target information creation unit 12 creates an operation target by grouping GUI parts (step S <b> 1), and stores information regarding grouping in the operation target information storage unit 14.

  Then, the operation target information creation unit 12 determines an operation reception area for each created operation target (step S2), and stores information regarding the operation reception area in the operation target information storage unit 14. Then, the operation target information creation unit 12 determines an input target item for each created operation target (step S3), and stores information regarding the input target item in the operation target information storage unit 14.

  As described above, the operation target information creation unit 12 defines the operation reception area and the input target item for each operation target, so that the focus setting unit 16 uses the information on the operation reception area and the input target item to input the input target item. You can set the focus to.

  Next, a process flow for accepting a user input operation will be described. FIG. 8 is a flowchart showing a flow of processing for accepting a user input operation. As shown in FIG. 8, the position monitoring unit 15 monitors the position of the mouse pointer on the GUI screen (step S11).

  Then, the focus setting unit 16 determines whether or not the mouse pointer has moved in from the outside of the operation reception area based on the position of the mouse pointer (step S12). Control returns.

  On the other hand, when the mouse pointer moves from outside the operation reception area to the inside, the focus setting unit 16 sets the focus on the input target item corresponding to the operation reception area (step S13). Then, the input receiving unit 17 receives an input from the keyboard and passes it to the application 20 (step S14).

  As described above, in the embodiment, the operation target information creation unit 12 creates the operation target information including the operation reception area information and the input target item and stores it in the operation target information storage unit 14. The focus setting unit 16 sets the focus on the input target item when the mouse pointer is in the operation reception area based on the operation target information stored in the operation target information storage unit 14. Therefore, the user can give an instruction without clicking the mouse, and the GUI unit 10 can prevent an erroneous operation of the user due to a positional shift when the mouse is clicked.

  The operation reception area is wider than the area where the input target item is designated by the mouse pointer. Therefore, even when the user cannot accurately indicate a small operation target with the mouse pointer, the GUI unit 10 can enable an instruction with the mouse pointer.

  In the embodiment, the GUI unit 10 has been described, but the function of the GUI unit 10 is realized by executing a GUI program having the same function on the PC 1. Therefore, a hardware configuration of the PC 1 that executes the GUI program will be described.

  FIG. 9 is a diagram illustrating a hardware configuration of the PC 1 that executes the GUI program. As shown in FIG. 9, the PC 1 includes a main memory 91, a CPU (Central Processing Unit) 92, a LAN (Local Area Network) interface 93, and an HDD (Hard Disk Drive) 94. The PC 1 includes a super IO (Input Output) 95, a DVI (Digital Visual Interface) 96, and an ODD (Optical Disk Drive) 97.

  The main memory 91 is a memory for storing a program and a program execution result. The CPU 92 is a central processing unit that reads a program from the main memory 91 and executes it. The CPU 92 includes a chip set having a memory controller.

  The LAN interface 93 is an interface for connecting the PC 1 to another computer via the LAN. The HDD 94 is a disk device that stores programs and data, and the super IO 95 is an interface for connecting an input device such as a mouse or a keyboard. The DVI 96 is an interface for connecting a liquid crystal display device, and the ODD 97 is a device for reading / writing a DVD.

  The LAN interface 93 is connected to the CPU 92 by PCI Express, and the HDD 94 and ODD 97 are connected to the CPU 92 by SATA (Serial Advanced Technology Attachment). The super IO 95 is connected to the CPU 92 by LPC (Low Pin Count).

  The GUI program executed in the PC 1 is stored in the DVD, read from the DVD by the ODD 97, and installed in the PC 1. Alternatively, the GUI program is stored in a database or the like of another computer system connected via the LAN interface 93, read from these databases, and installed in the PC 1. The installed GUI program is stored in the HDD 94, read into the main memory 91, and executed by the CPU 92.

  In the embodiment, the mouse operation has been described. However, the present invention is not limited to this, and can be similarly applied to an operation of another pointing device that indicates an operation target on the screen.

  The following supplementary notes are further disclosed with respect to the embodiments including the above examples.

(Supplementary note 1) The focus is set on the operation target based on the position information specified by the pointing device instead of the focus operation performed after the user specifies the operation target displayed on the screen by the pointing device,
A control program for causing a computer to execute processing for receiving input from a keyboard for an operation target for which focus has been set.

(Additional remark 2) Let a computer further perform the process which creates the positional information on this operation target based on the positional information on the several GUI components contained in the said operation target,
The control program according to appendix 1, wherein the process of setting the focus sets the focus on the operation target based on the position information of the operation target and the position information specified by a pointing device.

(Supplementary note 3) The plurality of GUI parts include an input item, a button, a check box, and a link to a Web page for receiving character input or numeric input from a keyboard. Control program.

(Supplementary Note 4) The focus is set on the operation target based on the position information specified by the pointing device instead of the click operation performed after the user specifies the operation target displayed on the screen by the pointing device.
A control method characterized in that a computer executes a process of receiving input from a keyboard for an operation target for which focus has been set.

(Supplementary Note 5) A focus setting unit that sets a focus on an operation target based on position information specified by the pointing device instead of a click operation performed after the user specifies the operation target displayed on the screen by the pointing device ,
An input receiving unit that receives an input from the keyboard with respect to the operation target set with the focus by the focus setting unit;
A control device comprising:

(Supplementary Note 6) The focus is set on the operation target based on the position information specified by the pointing device instead of the focus operation performed after the user specifies the operation target displayed on the screen by the pointing device,
A computer-readable storage medium storing a control program for causing a computer to execute processing for receiving input from a keyboard for an operation target for which focus has been set.

(Supplementary note 7) In a control device having a memory and a CPU connected to the memory,
In the CPU,
In place of the focus operation performed after the user designates the operation target displayed on the screen with the pointing device, the focus is set on the operation target based on the position information designated by the pointing device,
A control device that executes processing for receiving input from a keyboard for an operation target for which focus has been set.

(Supplementary note 8) In response to detection of the pointer entering the area around the button arranged in the screen or the area around the input field,
Transition to a state in which an input operation to the button or the input field is accepted,
A control program characterized by that.

1 PC
2 Input field 3 Button 4 Area shaded by halftone dot 5 Area shaded by diagonal line 6 Check box 7 Link to Web page 10 GUI part 11 Display part 12 Operation target information creation part 13 Item information storage part 14 Operation Object information storage unit 15 Position monitoring unit 16 Focus setting unit 17 Input reception unit 20 Application 31a, 31c Input item 32a, 32c Item title 33a, 33c Decoration frame 34a, 34c Operation reception area 91 Main memory 92 CPU
93 LAN interface 94 HDD
95 Super IO
96 DVI
97 ODD

Claims (6)

Transition to a state of accepting an input operation to the button or the input field in response to the detection of the pointer entering the area surrounding the button or the area surrounding the input field arranged in the screen,
A control program for causing a computer to execute processing.   The control program according to claim 1, wherein the surrounding area includes one or more GUI parts.   The control program according to claim 2, wherein the GUI component is an item title or a decoration frame.   The control program according to claim 2 or 3, wherein the surrounding area is set according to position information of the button, position information of the input field, and position information of the one or more GUI parts. . Transition to a state of accepting an input operation to the button or the input field in response to the detection of the pointer entering the area surrounding the button or the area surrounding the input field arranged in the screen,
A control method characterized in that a computer executes a process. A setting unit that transitions to a state of accepting an input operation to the button or the input field in response to detection of a pointer entering the area around the button or the area surrounding the input field arranged in the screen;
A control device comprising:

Images