JP2015166994A - Application program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an application program configured to allow an efficient operation instruction input by use of a general-purpose pointing device.SOLUTION: An information processing apparatus includes: an operation content determination step of determining the content of operation, on the basis of an operation instruction from at least one of a plurality of pointing devices; a device storage step of storing information on a pointing device corresponding to the content of operation; and a registration window display step of displaying a registration window for setting the pointing device. The registration window display step displays a registration window for each of the contents of operation. The device detection step detects information on the pointing device which has performed an operation instruction on the registration window. The device storage step uses an application program for storing the information on the pointing device detected in the device detection step.

Description

  The present invention relates to an application program. In particular, the present invention relates to a method for registering operation instruction reception means in an application program that displays a large image, enlarges an image, and displays a partial image while scrolling.

Conventionally, as a method of displaying a large image, enlarging an image, and displaying a partial image while scrolling, an operation instruction method for efficiently performing operation instructions such as scrolling and zooming has been disclosed. .
For example, Patent Document 1 discloses a method of efficiently performing a scroll operation using a right hand mouse and a left hand mouse.

JP 2001-265532 A

  A pointing device represented by a mouse is provided by various manufacturers, but generally requires a driver adapted to an operating system (hereinafter also referred to as an OS). An operation instruction from the pointing device is notified to the application program via a driver using a general notification method (for example, a message) provided by the OS. For this reason, the application program only needs to be aware of the general-purpose notification mechanism provided by the OS, and can develop the application program without depending on the convenience of the device manufacturer. In addition, even when the user changes the device to be used, the application program can be used without recreating it.

  In recent years, a pointing device is often connected to a PC using a USB (Universal Serial Bus), and a plurality of pointing devices can be connected to a single PC. However, since the pointing device is not identified in the application program as described above, general-purpose operation instruction input such as cursor movement, clicking, and double-clicking can be performed using any pointing device. However, since the use of a general pointing device does not distinguish individual devices, it is difficult to use an easy-to-use application program function for each type of pointing device.

  In particular, when assigning a function to each of a plurality of pointing devices, it is necessary to set the function after identifying each pointing device. Generally, identification of a device connected to a PC can be identified as driver information. However, when connecting using the above-described USB, it is possible to connect a plurality of the same devices, and it is necessary to identify information including the USB port in addition to the information of the device itself. Here, the pointing device main body may not always include information necessary for identification. Further, it is not easy for the user to obtain information for identifying a plurality of USB ports provided in the PC. Therefore, it is difficult for a user to assign a function to each of a plurality of pointing devices according to preferences on an application.

  Here, Patent Document 1 discloses a method of assigning functions in driver settings. When such a method is used, a driver capable of assigning a function needs to be provided by a device manufacturer, and the user may not be able to assign a function to a favorite device.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an application program that enables efficient operation instruction input using a general-purpose pointing device.

The present invention employs the following configuration. That is,
An operation content determination step for determining an operation content based on an operation instruction from at least one of the plurality of pointing devices;
A device storage step of storing information of a pointing device corresponding to the operation content;
A registration window display step for displaying a registration window for setting a pointing device to be stored in the device storage step;
In an application program for causing an information processing apparatus to execute
The registration window display step displays the registration window for each operation content that stores the information of the pointing device,
The device detection step detects information of a pointing device for which an operation instruction for the registration window has been performed,
The device storage step is an application program that stores information on the pointing device detected in the device detection step.

  ADVANTAGE OF THE INVENTION According to this invention, the application program which can perform efficient operation instruction input using a general purpose pointing device can be provided.

Device configuration diagram in the present invention Configuration diagram of computer in the present invention Screen example of image display application in the present invention The figure which shows the operation instruction transmission path | route in this invention Functional block diagram in Embodiment 1 of the present invention The flowchart in Example 1 of this invention The figure which shows the example of the determination method of the scroll movement amount in this invention The figure which shows the other example of the pointing device in this invention Functional block diagram in Embodiment 2 of the present invention Flowchart in Embodiment 2 of the present invention The figure which shows the example of the device registration screen of this invention The figure which shows the other example of the device registration screen of this invention The figure which shows the other example of the device registration screen of this invention

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. However, the dimensions, materials, shapes, and relative arrangements of the components described below should be changed as appropriate according to the configuration of the apparatus to which the invention is applied and various conditions. It is not intended to limit the following description.

<Example 1>
Hereinafter, the gist of the present invention will be described with reference to the drawings.
FIG. 1 shows an apparatus configuration according to the present invention. In FIG. 1, reference numeral 100 denotes a computer, which executes a program of an application that is a subject of the present invention. Reference numeral 101 denotes a display, which displays an application window.

  Reference numeral 102 denotes a mouse, which is one of pointing devices for inputting operation instructions from the user in the present invention. Reference numeral 103 denotes a left button attached to the mouse 102, which is used when selecting an object at a position indicated by a mouse cursor (not shown) displayed on the display 101. Reference numeral 104 denotes a rotatable wheel, which is effective when an operation instruction according to the amount of rotation is given. As an example of using the wheel 104, for example, in an application for displaying an image, it is used when scrolling in the vertical direction or changing the display magnification. Reference numeral 105 denotes a right button attached to the mouse 102, and is used when a usable menu is displayed at the position indicated by the cursor.

  Reference numeral 106 denotes a trackball, which is one of pointing devices that can move the position of the mouse cursor by rotating the ball 107 in the same manner as when the mouse 102 is moved. Reference numeral 108 denotes a left button attached to the trackball 106 and has the same function as the above-described left button 103. Reference numeral 109 denotes a right button, which has the same function as the right button 105 described above. Reference numeral 110 denotes a keyboard, which is used when inputting characters. Note that the left and right sides of the mouse and trackball buttons indicate the direction viewed from the user holding the mouse.

  FIG. 2 shows the internal configuration of the computer 100 that executes the application program of the present invention and the relationship with various devices. Reference numeral 200 denotes a CPU, which performs calculations necessary for processing. Reference numeral 201 denotes a ROM which can read stored programs and data. Reference numeral 202 denotes a RAM which can write or read data necessary for a program or processing. Reference numeral 203 denotes a storage capable of writing or reading programs and image data, and is composed of an HDD, an SSD, or the like. Reference numerals 204 to 207 denote interfaces, which are connected to the display 101, the mouse 102, the trackball 106, and the keyboard 110, respectively. The CPU 200, or a combination of elements necessary for the CPU 200 to operate, or the computer 100 as a whole functions as an information processing apparatus that executes the application program of the present invention.

  Next, an application example of the application program according to the present invention will be described with reference to FIG. FIG. 3A is an example of an application program that displays a medical image, and an application window 300 is displayed on the display 101. A medical image 301 is displayed in the application window 300. Examples of medical images include X-rays, CT, MRI, and the like. More preferable examples include images for pathological diagnosis in which a preparation is magnified using a high-power lens.

In the case of an image that needs to be enlarged and observed in detail along with observation of the entire preparation as a subject, such as an image for pathological diagnosis, scrolling of the image and change of the display magnification are required at the time of observation. If the display magnification is too low, details cannot be observed. Therefore, a display magnification of at least a predetermined value is required for a good diagnosis. When the image size at the predetermined display magnification is larger than the application window, a partial image that is a part of the entire image is displayed in the window, and the display position (the cut partial image) in the image is scrolled. change.

  In addition, an operation such as adding a mark or a comment to the point of interest may be performed. Reference numeral 302 denotes a cursor, which is used when a position on the display 101 is designated. The cursor 302 is moved by giving a movement instruction using a pointing device such as movement of the mouse 102 or rotation of the ball 107 of the trackball 106.

  FIG. 3B is an example of an application program that displays a map, and an application window 303 is displayed on the display 101. In the application window 303, a map image 304 including roads and buildings is displayed. When viewing a map, for example, a route from a predetermined location to a destination is examined, but when the distance between two points is long, it is necessary to view the image while scrolling. In addition, the display magnification may be changed, such as searching for a rough route while performing reduced display, and examining a detailed route while displaying a part enlarged as necessary. In recent years, there is also a map application program with an automatic route search function, and the start point and destination of a route are designated.

  As shown in FIGS. 3A and 3B, when a display that does not fit within one screen is performed, operations such as scrolling, changing display magnification, and specifying a position in the image are performed. There is a case. A general computer uses a mouse 102 and a keyboard 110 as operation instruction input means. In particular, when specifying a predetermined position in an image such as adding a mark or specifying a location on a map, the operability is good when the mouse 102 is used. Further, in the case where the one-dimensional scale is switched as in the case of changing the display magnification, the operability is good when the wheel 104 limited to one-dimensional movement is used. However, it is generally known that the trackball 106 that can move freely in the two-dimensional direction has better operability than the mouse 102 for scrolling large images.

Here, as for the mouse 102 and the trackball 106, products of various shapes are released from various manufacturers, and a user's favorite product is different for each user. However, when a special device or driver is required as in Patent Document 1, if the device or driver does not support it, it is difficult to properly use the function or function as described above.
The present invention makes it possible to use an optimum operation instruction device for each function of an application program without using a special device or driver.

  FIG. 4 is a diagram showing an operation instruction transmission path in the present embodiment. Reference numeral 400 denotes an application program, which is software that operates under the management of an operating system (OS) 401. Reference numeral 402 denotes a driver that receives an input from the mouse 102 and transmits operation instruction contents to the OS 401. Reference numeral 403 denotes a driver that receives an input from the trackball 106 and transmits an operation instruction content to the OS 401. Operation instruction inputs from the drivers 402 and 403 are transmitted to the application program 400 via the OS 401.

Here, a standard operation instruction command for the mouse cursor 302 using the pointing device is defined as an operation instruction command generalized by the OS 401. Therefore, information transmitted from the OS 401 to the application program 400 is transmitted as a generalized operation instruction command 404 without distinguishing the mouse 102, the trackball 103, or the drivers 402 and 403 that are operation input devices. . A typical example of the generalized operation instruction command 404 is a message, for example, the mouse 102.
And a message notifying that the left button 103 has been pressed.

  Further, the normal application program 400 is created so as not to depend on the pointing device by not being aware of the device that has input the operation instruction. However, in the application program of the present invention, the device is specified via the OS 401. Thereby, it is possible to determine the operation of the application program 400 in consideration of the operation instruction command 404 and the information of the device that has input the operation instruction corresponding to the operation instruction command 404 in the application program 400. As a result, it is possible to assign an optimum device for each function of the application program 400 using a plurality of general-purpose pointing devices.

  FIG. 5 is a functional block diagram of the application program 400 in this embodiment. Reference numeral 500 denotes an input terminal for inputting a message indicating an operation instruction command transmitted from the OS 401. Note that the message input from the input terminal 500 is not limited to the above-described pointing device operation instruction. For example, it includes any message that needs to be notified to the application program 400, such as a message indicating that an application menu has been selected.

  Reference numeral 501 denotes a message receiving unit, which includes a message queue for accumulating received messages, determination means for determining whether a message has arrived, and the like. Reference numeral 502 denotes a device detection unit that detects device identification information corresponding to the received message. Reference numeral 503 denotes a device storage unit that stores corresponding device identification information for each function of the application program 400. The device storage unit 503 stores preset identification information. In addition, the device storage unit 503 does not need to store identification information for all functions, and may store information only for functions desired to be handled by a specific device.

  An operation content determination unit 504 determines the operation content of the application program 400 based on the received message, the identification information detected by the device detection unit 502, and the identification information stored in the device storage unit 503. . Reference numeral 505 denotes a scroll control unit, which executes a scroll operation when it is determined by the operation content determination unit 504 that a display image scroll instruction has been issued. Reference numeral 506 denotes a display magnification control unit. When the operation content determination unit 504 determines that an instruction to change the display magnification is made, the display magnification is changed.

  Reference numeral 507 denotes an image reading unit. When the operation content determination unit 504 determines that an instruction to display a new image has been given, the specified image is read and displayed. Reference numeral 508 denotes a termination processing unit, which terminates the application program 400 when it is determined by the operation content determination unit 504 that an instruction to terminate the application program 400 has been given. Reference numeral 509 denotes a cursor display state control unit which performs cursor display control according to the determination content of the operation content determination unit 504.

FIG. 6 is a flowchart showing the operation flow of the application program 400 in this embodiment. When the processing is started, first, in step 600, initialization processing of the application program is performed, and an application window is displayed. In step 601, it is determined whether or not a message indicating an operation instruction command has been received. If it is determined that no message has been received, step 601 is executed again to wait for the message to be received. If it is determined in step 601 that a message has been received, the process proceeds to step 602, and the received message is acquired from the message queue. In step 603, device identification information corresponding to the message is detected.

In step 604, the content of the message is determined. If the content indicates the movement of the cursor, the process proceeds to step 605. In step 605, it is determined whether or not the device identification information used matches the device identification information for scrolling. If it is determined in step 605 that they match, the scroll amount is determined in step 606 and then scrolling is performed in step 607. In step 608, the cursor is set in a non-display state, and then in step 601, message reception is waited again.
If it is determined in step 605 that the identification information does not match the identification information of the scroll device, it is determined that the instruction is a normal mouse cursor movement instruction. Then, after setting the cursor to the display state in step 609, the message reception is waited again in step 601.

  On the other hand, when the content of the message is not the content indicating the movement of the cursor in step 604, the process proceeds to step 610, and it is determined whether or not the content of the message is the content indicating the rotation of the wheel. In step 610, when the content of the message indicates the rotation of the wheel, the process proceeds to step 611, and the display magnification is determined based on the rotation amount and the rotation direction of the wheel. Then, after the display magnification is changed in step 612, message reception is waited again in step 601.

  If it is determined in step 610 that the message content does not indicate wheel rotation, the process proceeds to step 613 to determine whether the message content is for opening a file. In step 613, when the content of the message is the content of opening the file, the process proceeds to step 614, and the designated image file is read, that is, the image is input. In step 615, the read image is displayed, and then in step 601, the message reception is waited again.

  If it is determined in step 613 that the content of the message is not the content for opening the file, the process proceeds to step 616 to determine whether or not the content of the message indicates the end of the application program. In step 616, if the content of the message indicates the end of the application program, the application program is ended. On the other hand, when the content of the message is not the content indicating the end of the application program, in step 601 the message reception is waited again.

In the flow shown in FIG. 6, the device detection process in step 603 may be performed only when necessary after steps 604, 605, 610, 613, etc., which are message content determination processes.
In the flow of FIG. 6, if the message content indicates the rotation of the wheel in step 610 or if the message content is the content for opening a file in step 613, the cursor state is changed. not going. This means that the current cursor display state is maintained, but maintaining the current state is also included in the contents of the cursor display control performed by the cursor display state control unit 509. Note that the present invention is not limited to the flow of FIG. 6, and the processing order of the operation contents and the control of the cursor display state may be switched. Further, when the message content indicates the rotation of the wheel in step 610, or when the message content is the content for opening a file, the cursor display state may be set to a specific state.

FIG. 7 is a diagram showing an example of the scroll method in step 606 and the method for determining the scroll movement amount.
In FIG. 7A, reference numeral 700 indicates an application window. 701
Is a cursor moved to point to a predetermined position in the application window 700 (for example, a position where the cursor can be moved in all directions, for example, the center of the window), and indicates a reference position when determining the scroll movement amount. . Reference numeral 702 denotes a cursor that has been moved by a mouse movement instruction from a scrolling device. When a message indicating a mouse movement instruction is received, a movement amount (X, Y direction) is determined by comparing the cursor positions 701 and 702 and the direction. Further, by forcibly moving the cursor 702 to the cursor position 701 after the movement amount is determined, the cursor is prevented from moving to the edge of the screen and cannot be moved in the same direction any more.

  When the mouse movement instruction that is not the scroll device is changed to the mouse movement instruction of the scroll device, the cursor position is stored and the cursor is not displayed. On the contrary, when the mouse movement instruction of the scroll device is switched to the mouse movement instruction that is not the scroll device, the cursor may be moved to the stored cursor position and the cursor may be displayed. By doing in this way, a cursor that repeats meaningless movement is not displayed on the screen, so that it is possible to display the screen without obstructing image browsing.

  FIG. 7B is a diagram showing another example of the scroll amount determination method in step 606. In FIG. 7B, in addition to the image display area 703, a scroll control area 704 is provided. Reference numeral 705 denotes a reference position, and the amount of movement (X and Y directions) is determined based on the relative relationship between the position with the cursor position 706 and the direction. Here, when the instruction is changed to a mouse movement instruction that is not a scroll device, the cursor position is forcibly moved to the cursor position 707 in the image display area 703 after storing the cursor position. On the other hand, when it is changed to the mouse movement instruction of the scroll device, the cursor position is forcibly moved to 706 after storing the cursor position.

  Note that, when the mouse movement instruction that is not a scroll device is changed, the cursor position 706 may be moved to the position 705 on the assumption that the scroll operation has stopped. In addition, a dead area 708 centered at 705 may be provided in the scroll control area. Then, if the cursor is present in the area 708, it is easier to stop scrolling by not moving the cursor.

  The amount of movement may be proportional to the relative distance between the reference position and the cursor position, but the cursor may change unintentionally due to fine hand movements. In such a case, if the movement amount is simply proportional to the distance, unevenness occurs in the movement speed and movement direction, which may make observation difficult.

  For this reason, a predetermined fixed movement amount may be set. For example, the moving speed is one fixed value, and the moving direction is limited to vertical and horizontal directions. Alternatively, a plurality of fixed values may be provided, and switching may be applied when the relative distance between the reference position and the cursor position exceeds a predetermined threshold. For example, when the relative cursor position is more than a predetermined distance, the scroll movement is likely to be uneven due to the high-speed hand movement. On the other hand, if the relative cursor position is not more than the predetermined distance, the amount of movement is the relative distance between the reference position and the cursor position in order to make fine operations sensuously by slow hand movements. And so on.

In the above embodiment, the message indicating the movement of the cursor is determined when performing the scroll operation, but the present invention is not limited to this. For example, when using a trackball, it is necessary to detect the amount of rotation of the ball. Therefore, the position of the cursor is acquired at predetermined time intervals using a period timer, and the difference from the position acquired in the previous period is determined as the movement amount. A method of determining the scroll direction and the scroll amount based on the movement amount may be used.

  In this case, as described with reference to FIG. 7A, it is preferable to forcibly move the cursor to the cursor position 701 after detecting the movement amount in order to prevent scrolling at the edge of the display. Further, when the cursor is forcibly moved to 701 as described above, there is a possibility that the cursor repeatedly moves violently in the vicinity of 701 to obstruct the display contents. Therefore, in such a case, it is preferable to hide the cursor.

  As described above, the present invention is not limited to the message indicating the cursor movement, but is configured to acquire (detect) the cursor position based on another trigger capable of detecting the cursor movement and reflect the result on the scroll. It does not matter.

  The present invention is not limited to the above-described embodiment, and device determination may be performed other than when the message is a cursor movement. For example, when both of two pointing devices support general wheel operation, the device may be determined when the message is a wheel rotation. A preferable example in this case is an example in which a Z stack image obtained by capturing a plurality of images in the depth direction in the above-described pathological diagnosis image is displayed. In this case, the display magnification may be changed with one pointing device, and the position in the depth direction may be switched with the other pointing device.

  Further, the present invention may be performed for a menu operation such as opening a file. For example, in the above-described pathological diagnosis image, there are a case where a plurality of images are displayed in parallel and observed while being compared, and a case where only one image is displayed. When one of the pointing devices is used as an operation to open a file when one image is already displayed, the displayed image is closed and newly specified. Display only one image. When the other pointing device is used, a display area is divided so that a displayed image and a newly designated image are displayed in parallel.

  The application target of the present invention is not limited to the menu operation, and can be applied to various targets unique to the application 400 such as buttons and list display. For example, it is preferable to switch the operation content corresponding to the button for each used pointing device, or to switch the list of items that can be selected in the combo box for each used pointing device. As described above, it is difficult for the OS 401 and the driver 402 to switch an operation instruction for an application-specific target such as a menu operation or a button for each pointing device. Similarly, when conversion software is inserted between the application 400 and the OS 401, it is difficult to switch the operation instruction for the application-specific target for each pointing device. That is, the present invention makes it possible to switch an operation instruction for an application-specific target for each pointing device.

  Further, the special operation is not limited to the case of the trackball 106. For example, a mark or a comment may be added to the image only when the device used is the mouse 102. In this case, the mouse cursor 302 is moved in the screen by moving the mouse 102, and moved to a position where a mark or comment is to be inserted. Then, it is preferable to assign a suitable device according to the function, such as inserting a comment or a character string using the left button 103, the right button 105, or the keyboard 110.

  In the above description, a mouse and a trackball are cited as pointing devices, but the present invention is not limited to this. FIG. 8 shows an example of another pointing device to which the present invention is applicable. Reference numeral 800 denotes a notebook PC. Reference numeral 801 denotes a touch pad, which is a pointing device for enabling cursor movement and a click instruction even when there is no external device such as a mouse in a notebook PC that is assumed to be carried, and is an application target of the present invention.

  A touch panel 802 is mounted on the display of the notebook PC 800, and a position on the screen can be directly designated by touching the screen with a finger or the like. The touch panel 802 can also specify a position in the same manner as a mouse and the like, and is one of pointing devices to which the present invention is applied because the specified position on the screen can be regarded as the current cursor position.

  In the same manner as described above, for example, an example in which the trackball 106 is allocated for scrolling, the touch pad 801, or the touch panel 802 is allocated for other work can be considered. Although a notebook PC is assumed in FIG. 8, the present invention is not limited to this, and a touch panel mounted on a display 101 for a desktop PC may be used. In recent years, tablet-type terminals that do not have a keyboard and perform normal operations with a touch panel on the screen have become widespread. A pointing device may be connected to such a tablet terminal, and the present invention may be applied to a combination of the pointing device and a touch panel mounted on the tablet terminal.

  In the above example using FIG. 7A, an example has been shown in which the display state of the cursor is switched to non-display or display depending on whether scrolling is performed. Such control is not limited to scrolling, and may be determined in consideration of the necessity of cursor display in the selected function. For example, in the above-described example, when the display image is scrolled, the cursor does not need to be displayed, but rather the displayed cursor interferes with the image observation. In the case of such a function, the cursor may be hidden. In addition, in the case of a function that needs to indicate a position, such as adding a comment or a mark to an image, the cursor needs to be displayed. If the cursor is unnecessary, it may be made difficult to see by making it semi-transparent, reducing the size, or changing the color to bring it closer to the background color in addition to making it completely hidden. .

  Further, in FIG. 7A, when the cursor is unnecessary, the cursor display is performed by setting 701 to a position other than the vicinity of the center position of the window so as not to obstruct the image observation. Also good. As shown in FIGS. 7A and 7B, the cursor display state in the present invention includes various display states such as the color, transparency, size, and position of the cursor. That is, any object may be used as long as the visibility of the cursor on the display image can be changed.

  As a preferred example of the present invention, an example in which only a general-purpose pointing device or driver is used has been given. However, when a special pointing device or driver and a general-purpose pointing device are used in combination, the method described above may be applied to a specific general-purpose pointing device. As an example of a special device to be combined, there is a device such as a game controller that has a large number of buttons and allocates corresponding operation instruction contents by driver setting.

The process of switching for each used device is not limited to the above-described content, and may be performed for various other operation instruction inputs. Similarly, the operation content to be executed is not limited to the above-described content. As a method for connecting a plurality of devices, any method other than the above-described USB connection or computer connection can be adopted, regardless of whether it is wired or wireless.

  As described above, according to the present embodiment, it is possible to assign an optimum device for each function of an application program using a plurality of general-purpose pointing devices. For example, it is possible to easily realize a wide range of screen display that can achieve both a wide-range scrolling process that requires a long distance movement of the cursor and a process of performing accurate pointing. In addition, since the present invention can be realized by the function of the application program and general messages, restrictions on the operating system, driver, middleware, etc. can be reduced, and any device can be used.

<Example 2>
In the above-described first embodiment, the method of operating different functions of an application using a plurality of pointing devices has been described. In the present embodiment, a method for registering the above-described functions for a plurality of pointing devices will be described.

  FIG. 9 is a part of a functional block diagram of the application program 400 in this embodiment, and shows a configuration of a registration unit that registers a pointing device to be used. In addition, the same code | symbol is attached | subjected to the item similar to above-mentioned FIG. 5, and description is abbreviate | omitted.

  Reference numeral 900 denotes a registration operation control unit that determines a function for registering a device and stores the device identification information input from the device detection unit 502 in the device storage unit 503 in association with the function. Reference numeral 901 denotes a screen display content determination unit, which determines screen display content based on information on a function to be registered on the current screen input from the registration operation control unit 900. Reference numeral 902 denotes a window display unit that displays a window based on the screen display content determined by the screen display content determination unit 901.

  FIG. 10 is a flowchart showing an operation flow of the application program 400 in this embodiment, and shows a flow of processing for registering a pointing device to be used. The registration process may be automatically started at the first operation of the application program, or a function for accepting a start instruction at an arbitrary time may be provided. In addition, when a new pointing device is connected, the process may be started as needed.

  When the process is started, the registration process is first initialized in step 1000. Next, in step 1001, the process waits until an instruction to start device registration is given. When an instruction to start device registration is given in step 1001, a start window for notifying that registration is to be started is displayed in step 1002. In step 1003, it waits for a button to be described later to be pressed as an operation instruction for displaying the next screen in the start window, and when this button is pressed, the process proceeds to step 1004.

In step 1004, the function to be registered is determined on the next screen, and then the registration screen is displayed based on the information indicating the function determined in step 1005. In step 1006, the process waits for the pointing device operation instruction to be input in the registration screen. If the operation instruction is input, the process proceeds to step 1007. In step 1007, identification information of the pointing device used when the operation instruction is input on the registration screen is acquired, and in step 1008, the identification information of the device is stored in association with the aforementioned function. In step 1009, it is determined whether or not registration has been completed for all functions to be registered. If there is an unregistered function, the process returns to step 1004 to register the next function. I do. On the other hand, if it is determined in step 1009 that all functions have been registered, the process proceeds to step 1010.

  In step 1010, an end window for notifying that the registration process is completed is displayed. In step 1011, the process waits until the button for closing the end window is pressed. When the button is pressed, the process ends.

  Next, an example of a display screen and an example of a registration method according to the present embodiment will be described with reference to FIG. In FIG. 11A, reference numeral 1100 denotes a device registration start window, which displays to notify the user of the registration method and operation procedure. Reference numeral 1101 indicates a cursor. When the user operates a general-purpose pointing device, an operation instruction input such as movement of the cursor position or click of the cursor position is performed. Reference numeral 1102 denotes a button for ending the display of the start window and shifting to the next display.

  When the button 1102 is pressed using the cursor 1101, a registration window is displayed as shown in FIG. In the example of FIG. 11B, reference numeral 1103 denotes a window for registering a device used when a scroll operation is performed. Then, an operation instruction command is transmitted to the application program 400 via the OS by moving the cursors 1104 and 1105 on the window 1103 using a pointing device used when performing a scroll operation. When receiving the operation instruction command, the application program 400 acquires used device information, and stores the device corresponding to the scroll operation according to the flow of FIG.

  When the corresponding device is registered in the registration window of FIG. 11B, the display of FIG. 11C is performed. In the example of FIG. 11C, reference numeral 1106 denotes a window for registering a device used for a pointing operation used when it is necessary to indicate a position such as insertion of a character or a symbol. Also in FIG. 11C, by moving the cursors 1107 and 1108 on the window 1106 using the pointing device used when performing the pointing operation, the device is stored in correspondence with the pointing operation.

When the corresponding device is registered in the registration window of FIG. 11C, the end window 1109 of FIG. 11D is displayed. In the end window 1109, whether or not the registration is normally completed and the registered contents are displayed in a form in which the function and the device are associated with each other. When the button 1110 is pressed, the end window 1109 is closed to end the process.
Note that the display of the registration start window 1100 and the end window 1300 is not essential, and may be displayed as necessary or displayed in the registration windows 1103 and 1106.

  The windows 1100, 1103, 1106, and 1109 shown in FIG. 11 may switch display contents in the same window. Alternatively, each window may be created individually, and the window may be closed when the next screen is displayed.

Here, in the registration window described with reference to FIGS. 11B and 11C, an example in which a device is registered in response to a cursor movement instruction is shown, but the present invention is not limited to this. For example, FIG. 12 shows another example of the registration window. The registration window 1200 is provided with a button 1202 for accepting an input instruction for changing the procedure. Then, by pressing the button 1202 using the cursor 1201, registration is performed according to the button press notification transmitted to the application program 400. Of course, button 1 in FIG.
Instead of providing 202, it may be detected that a click operation has been performed at an arbitrary location in the registration window 1200.

  Further, in the registration window described with reference to FIGS. 11B, 11C, and 12, one operation instruction device is stored for a function to be registered in one registration window. However, the present invention is not limited to this.

  FIG. 13 is an example of a registration window in which a plurality of operation instruction devices can be registered for one function. The registration window 1300 is provided with a registered device name display area 1302 capable of displaying a plurality of registered device names, and a button 1303 for receiving an input instruction for changing a procedure. Then, by moving the mouse cursor 1301 in the registration window 1300 or performing a click operation in the registration window 1300, all the devices that have been instructed to operate are registered, and the device is displayed in the registered device name display area 1302 Displays the name. When a button 1303 is pressed after an operation by all the devices to be registered is performed, the registration window 1303 is closed, the registration process for the target function is terminated, and the next screen is displayed.

  When a device is registered in association with a function by the method described in this embodiment, there is a possibility that a problem may occur in the execution of the operation depending on the registered contents. For example, there is a case where one device is allocated to both scroll operation and pointing operation as a result of registering one device to a plurality of functions. If such registration is permitted, when the registered device is moved, the cursor will move while scrolling, which may make it difficult to operate the cursor at a desired position. is there. Therefore, it is preferable to previously store a combination of functions that cannot register the same device as an exclusive function. If the same device is to be registered for this exclusive function, processing such as displaying a warning or not executing the device registration processing is performed. This can suppress registration that should not be performed.

  Although the device registration method described in the present embodiment has been described as being executed in the application program 400 described in the first embodiment, the present invention is not limited to this. For example, the application program 400 may be another application program for registering in a file or registry that stores a device used by the application program 400. Even executable files different as application execution formats are included in the scope of the present invention when used in combination.

  As described above, according to the present embodiment, it is possible to assign an optimum device for each function of an application program using a plurality of general-purpose pointing devices.

  100: Computer, 101: Display, 102: Mouse, 106: Trackball, 200: CPU

Claims (6)

An operation instruction input process for inputting operation instructions using a plurality of pointing devices;
A device detection step of detecting information of a used pointing device based on the operation instruction;
An operation content determination step for determining an operation content based on an operation instruction from at least one of the plurality of pointing devices;
A device storage step of storing information of a pointing device corresponding to the operation content;
A registration window display step for displaying a registration window for setting a pointing device to be stored in the device storage step;
In an application program for causing an information processing apparatus to execute
The registration window display step displays the registration window for each operation content that stores the information of the pointing device,
The device detection step detects information of a pointing device for which an operation instruction for the registration window has been performed,
The device storage step stores information on the pointing device detected in the device detection step. The application program is
An image input process for inputting an image;
A display step of displaying at least a part of the image;
Is further executed by the information processing apparatus,
The application program according to claim 1, wherein the operation content determined by the operation content determination step includes at least an operation content related to image display. The application program causes the information processing apparatus to further execute a scrolling process of changing the display position of the image,
3. The application program according to claim 2, wherein the operation content determined by the operation content determination step is scrolling. 4. The application program according to claim 1, wherein the operation instruction for the registration window is an operation instruction related to movement of a cursor. The application program according to any one of claims 1 to 3, wherein the operation instruction for the registration window is a click operation for a position included in the registration window. The application program according to any one of claims 1 to 3, wherein the operation instruction for the registration window is a click operation for a button included in the registration window.

Images