JP2009223494A - Information processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processor allowing improvement of operability of a pointing device even if using a wide screen display area such as multi-display environment. <P>SOLUTION: This information processor having the pointing device for operating one or more displays and information inside screens of the displays, and moving and controlling a pointer displayed inside the screen according to the operation of the pointing device includes: a pointer display means 120 making the mouse pointer be displayed inside the screen display area according to each screen display area obtained by partitioning a screen; and a pointer selection means 150 selecting the proper mouse pointer according to a use situation of a user from the mouse pointers displayed in each screen display area by the pointer display means 120. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an information processing apparatus that receives a user instruction via a pointer in a screen.

  In recent years, due to increasing opportunities to view a large amount of information media and improved graphics performance of computers, computers can be used in a multi-display environment having a virtual wide screen area by simultaneously using multiple displays. Users are increasing.

  In a multi-display environment, since a large screen area can be freely used, a user can view a large amount of information media at a time, but it becomes complicated to operate the wide screen area with a pointing device such as a mouse. For example, once the user forgets the position of the mouse pointer, it is difficult to find the position of the mouse pointer within a wide screen area.

  Therefore, conventionally, in order to improve the operability of moving a mouse between displays in a multi-display environment, this type of computer displays a region where the mouse can be moved between two displays on each display. Since the user is notified of the movable area, the location where the user can move can be identified and the mouse pointer is easily moved between the two screens (for example, Patent Documents). 1).

  In addition, this type of computer has a fixed display that the pen input is interrupted at the edge of the display during the drag operation so that the drag operation across the displays by the pen input can be executed in a multi-display environment where pen input is possible. It is known to record time and determine that the drag operation has been resumed when a pen input is made on an adjacent display within a certain time (see, for example, Patent Document 2).

  Also, this type of computer has a sub-display screen content if the main display and sub-display in a multi-display environment have a difference in performance such as resolution, or if the active window specified by the mouse pointer is not the main display. It is known that the active window can always be used as the main display by exchanging the screen content of the main display with the display on each display device, and the work efficiency of the user is improved (for example, And Patent Document 3).

  Also, with this type of computer, it is difficult to find and search for a mouse pointer on a multi-display or a high-resolution large display. Therefore, when a predetermined operation is performed, the mouse pointer display method, window information on the display, etc. A device that notifies the user of the position of the mouse pointer by changing is known (see, for example, Patent Document 4).

  Further, as this type of computer, in a portable terminal type multi-display system, one that saves power by detecting a user's line of sight and reducing the brightness of a display that is not used by the user is known. (For example, refer to Patent Document 5).

  In addition, this type of computer has a multi-display system environment in which one pointing device is connected to a plurality of personal computers, and the screen control of the display connected to each personal computer can be operated by one pointing device. What is constructed is known (see, for example, Patent Document 6).

Also, this type of computer registers a window identifier using the “Register Window” item in the operation menu displayed when the mouse is right-clicked on the window, and requests switching of the active window from the mouse. When an event is input, the user can switch between the windows corresponding to each of the registered multiple window identifiers by executing the process of switching the active window from the next to the user. However, it is not necessary to repeat the switching operation over and over, and it is known that the target window can be easily switched (see, for example, Patent Document 7).
JP 2006-59251 A JP 2005-346583 A JP 2004-29046 A JP 2002-215284 A Japanese Patent Laid-Open No. 7-146845 JP 2002-55808 A JP 2006-330912 A

  However, in the information processing apparatus described in the above-mentioned patent document, in a multi-display environment, a location where the mouse pointer can be moved between displays can be identified, a drag operation can be performed across the displays, or the mouse pointer can be moved. The display method of the mouse pointer can be changed prominently so as not to lose sight, but the user must move the mouse greatly when moving the mouse pointer from end to end of the wide screen display area. There is a problem that improvement of the operability of the mouse corresponding to the screen display area is not considered.

  Accordingly, an object of the present invention is to provide an information processing apparatus that can improve the operability of a pointing device even when a wide screen display area such as a multi-display environment is used.

An information processing apparatus according to the present invention has one or more displays and a pointing device for operating information in the screen of the display, and moves a pointer displayed in the screen in accordance with the operation of the pointing device In the information processing apparatus to be controlled, a pointer display unit that displays a pointer in the screen display region corresponding to each screen display region that divides the screen, and the pointer display unit displays each screen display region. Among the pointers, there is a configuration including pointer selection means for selecting a pointer that is appropriate according to the usage status of the user.
With this configuration, one pointer is displayed in the screen display area corresponding to each screen display area, and among the pointers displayed for each screen display area, the pointer that is appropriate according to the usage status of the user is displayed. By selecting and operating the selected pointer by the user, the user does not need to move the pointing device greatly when using a large screen display area such as a multi-display environment, and the operability of the pointing device is improved. Can do.

The information processing apparatus of the present invention further includes screen information recognition means for recognizing the display being used, and the pointer display means uses the display screen recognized by the screen information recognition means as the screen display area. The pointer is displayed corresponding to each screen of the display.
With this configuration, since the pointer is displayed corresponding to each recognized screen, the pointer can be easily displayed.

The information processing apparatus of the present invention further comprises user interface area recognition means for recognizing a user interface area including an icon or application window displayed on the display screen, and the pointer selection means is operated by the pointer display means. Of the pointers displayed for each screen display area, a pointer in the user interface area is selected.
With this configuration, since the pointer in the user interface area is selected from the pointers displayed for each screen display area, it is possible to select an appropriate pointer in accordance with the usage status of the user.

Further, the information processing apparatus according to the present invention changes the user interface areas in the screen of the display so as to be different from each other in the screen when the user interface areas are in the same display position in the screen. It has a configuration provided with user interface changing means.
With this configuration, when the user interface area is at the same display position in each screen, the display is changed to be different from each other in the screen, so that the pointer selection accuracy can be improved.

The information processing apparatus according to the present invention further includes a gaze direction measurement unit that measures the gaze direction of the user, and the pointer selection unit refers to the gaze direction information measured by the gaze direction measurement unit. It has a configuration for selecting an appropriate pointer according to the usage situation.
With this configuration, a pointer that is appropriate according to the usage status of the user is selected with reference to the line-of-sight direction information. Therefore, an appropriate pointer can be selected according to the usage status of the user, and the pointer selection accuracy can be improved. Increase the pointer selection time.

Further, in the information processing apparatus according to the present invention, the pointer selecting unit appropriately refers to the gaze direction information measured by the gaze direction measuring unit and the position information of the pointer in the screen according to the use situation of the user. The pointer is selected.
With this configuration, a pointer that is appropriate according to the use situation of the user is selected with reference to the line-of-sight direction information and the position information on the screen of the pointer. A pointer can be selected by position information.

The information processing apparatus of the present invention records an instruction task execution unit that executes task processing when the pointer displayed by the pointer display unit indicates, and task information executed by the instruction task execution unit. Task information recording means; and task rollback means for returning task information of task processing designated by the pointer not selected by the pointer selection means to a state before execution when a pointer is selected by the pointer selection means. It has the composition provided.
With this configuration, the task process designated by the pointer is executed and the executed task information is recorded. When the pointer is selected, the task information of the task process designated by the pointer not selected is returned to the state before the execution. Therefore, the task process designated by the pointer can be executed even before the pointer is selected, and the task process of the selected pointer can be executed quickly.

The information processing apparatus according to the present invention includes a re-request instruction unit that causes the pointer selection unit to select again when receiving an instruction to re-select the pointer selected by the pointer selection unit. .
With this configuration, since the pointer is selected again when an instruction for reselecting the pointer is received, the selection result of the mouse pointer can be changed according to the user's instruction.

In the information processing apparatus of the present invention, the mouse pointer display means distinguishes and displays the pointer selected by the pointer selection means and the pointer not selected when the pointer selection means selects a pointer. Have.
With this configuration, since the selected pointer and the non-selected pointer are displayed separately, the selected mouse pointer can be easily viewed by the user.

The information processing apparatus according to the present invention further includes operation history acquisition means for acquiring operation history information including a history of the user operating the icon or the application window with the pointer, and the pointer selection means includes the user interface. When there are a plurality of pointer selection candidates in the area, the user interface area corresponding to the icon or the application window that has been operated recently with reference to the operation history information is specified, and the pointer in the specified user interface area is It has the structure to choose.
With this configuration, when there are a plurality of pointer selection candidates in the user interface area, the user interface area corresponding to the recently operated icon or application window is identified by referring to the operation history information, and the pointer in the identified user interface area Therefore, it is possible to select an appropriate pointer according to the use situation of the user.

  As described above, the present invention provides an information processing apparatus that can improve the operability of a mouse pointer in a multi-display environment without adding a new device.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a diagram showing a use form of a multi-display according to an embodiment of the present invention. In FIG. 1, three displays 101 are connected to one information processing apparatus 100. As devices for operating information, a keyboard 103 and a mouse 102 are connected to the information processing apparatus 100. The screens of the three displays 101 are virtually recognized as one screen by the information processing apparatus 100, and the screens of all the displays 101 can be operated with one mouse 102. Hereinafter, when the individual displays 101 are distinguished, they are referred to as a display 101A, a display 101B, and a display 101C.

  FIG. 2 is a hardware configuration diagram of the information processing apparatus according to the embodiment of the present invention. The information processing apparatus 100 includes a CPU (Central Processing Unit) 104 that performs various controls and processes, an SDRAM (Synchronous Dynamic Random Access Memory) 105, an HDD (Hard Disk Drive) 106, and a plurality of displays 101. The information processing apparatus 100 includes a display interface (hereinafter abbreviated as “I / F”) 107 such as a video card connected to the computer, and a pointing device such as a mouse 102 for operating the screen of the display 101 and a keyboard 103 used for character input. It is configured by connecting the input I / F 108 to be connected via a bus. In addition, the information processing apparatus 100 includes a RAM and the like.

  The SDRAM 105 is used as a work area for the CPU 104 and a recording area for processing information for executing each step of the information processing method in the present invention and a fixed information recording area for programs such as an OS (operating system). The processing program is temporarily stored in the HDD 106 and then loaded into the SDRAM 105 and executed when necessary.

(First embodiment of the present invention)
FIG. 3 is a functional block diagram of the information processing apparatus according to the first embodiment of the present invention. The information processing apparatus 100 includes a screen information recognition unit 110, a pointer display unit 120, a UI area recognition unit 130, an operation history acquisition unit 140, and a pointer selection unit 150. These means are realized by a program executed by the CPU 104.

  The screen information recognition unit 110 recognizes the number of displays connected to the information processing apparatus 100. For example, when the display 101 is connected, the OS of the information processing apparatus 100 acquires display information related to the connected display 101, and the screen information recognition unit 110 acquires the number of displays 101 by acquiring the display information on the OS side. And information such as the screen size of the display.

  The pointer display unit 120 displays a mouse pointer on the screen of the display 101 for each screen of the display 101 recognized by the screen information recognition unit 110. For example, when the number of displays 101 is three, three mouse pointers are displayed at the same time and moved by operating the mouse 102. A display example of the mouse pointer is shown in FIG.

  In FIG. 4, the mouse pointer 10 is displayed one by one at the same position on each display 101 immediately after the information processing apparatus 100 is activated. Hereinafter, when distinguishing each of the mouse pointers 10, they are referred to as a mouse pointer 10A, a mouse pointer 10B, and a mouse pointer 10C. In FIG. 4, an application window 12 and an icon 11 are displayed on the display 101.

  FIG. 4 shows an example in which the screen size and resolution of the display 101 are the same, but displays with different performances of the display 101 may be used. In order to display the mouse pointer 10 at the same position on displays with different resolutions, the position information of the mouse pointer 10 may be replaced with ratio information with respect to the screen size of the reference display. If there is a display 101 with a large resolution and screen size, one screen of the display 101 with a large resolution and screen size is divided into a plurality of areas, and one mouse pointer 10 is provided for each divided area. You may display.

  The UI area recognition unit 130 recognizes information (hereinafter referred to as screen UI information) of user interface areas (such as the application window 12 and the icon 11) that can be designated with the mouse pointer 10 displayed on the screen of each display 101. The screen UI information is managed on the OS side of the information processing apparatus 100. The UI area recognition unit 130 can recognize whether or not the mouse pointer 10 is in the UI area by acquiring the screen UI information managed on the OS side.

  The operation history acquisition unit 140 acquires operation history information when the user operates the icon 11 or the application window 12 with the mouse 102. The operation history information includes information such as a movement operation, a click operation, and a drag operation of the icon 11 or the application window 12 using the mouse 102. The operation history information is recorded in the RAM of the information processing apparatus 100 or the like.

  The pointer selection unit 150 refers to the screen UI information recognized by the UI area recognition unit 130 and the operation history information recorded by the operation history acquisition unit 140, and a plurality of mouse pointers displayed on the pointer display unit 120. From the above, a mouse pointer that is appropriate according to the usage status of the user is selected.

  As shown in FIG. 5, when the user presses the left click of the mouse 102, the pointer selection unit 150 refers to the screen UI information displayed on each display 101 when the user presses the left click of the mouse 102. It is determined whether the position of the left-clicked mouse pointer 10 is in the user interface area, and the mouse pointer 10 in the user interface area is selected. For example, since the mouse pointer 10C of FIG. 5 is in the application window 12 of the display 101C, the pointer selection unit 150 selects the mouse pointer 10C as a mouse pointer that is appropriate according to the usage status of the user.

  When there are a plurality of mouse pointers in the instructable area, the pointer selection means 150 selects the mouse pointer according to a predetermined priority order. As an example of the priority order, priority is given to the mouse pointer in the icon area for icons and application windows, and the user interface that the user has recently operated is specified from the operation history information, and the user interface corresponding to the specified one A priority is given to the mouse pointer in the area.

  Note that when the pointer selection unit 150 selects a mouse pointer, the pointer display unit 120 may display the mouse pointer selected by the pointer selection unit 150 and the mouse pointer that has not been selected separately. For example, the pointer display unit 120 may notify the user that the mouse pointer has been determined by performing enlarged display or increasing the brightness of the selected mouse pointer. Further, the pointer display unit 120 may notify the user of the selected mouse pointer with the display colors of the selected mouse pointer and the unselected mouse pointer always different.

  FIG. 6 is a flowchart showing the operation of the information processing apparatus according to the first embodiment of the present invention.

  In step S <b> 1, the screen information recognition unit 110 recognizes the number of the plurality of displays 101 connected to the information processing apparatus 100. In the example of FIG. 1, an example of a multi-display environment in which a plurality of displays are connected to one information processing apparatus 100 is shown, but a multi-display in which a plurality of displays are connected to a plurality of information processing apparatuses 100 is shown. The environment may be used.

  In step S2, the pointer display unit 120 displays a mouse pointer corresponding to each of the plurality of displays 101 recognized in step S1. Note that the pointer display unit 120 may be changed to display a plurality of mouse pointers on a single display for a large display.

  In step S <b> 3, the UI area recognition unit 130 acquires position information of a user interface area that can be input with the mouse pointer displayed on each display 101. In step S4, the operation history acquisition unit 140 acquires operation history information operated by the user.

  In step S5, the pointer selection unit 150 selects a mouse in the user interface area from the position information of the user interface area acquired in step S3, and when a plurality of mice correspond, the operation history information is referred to and the user's Select the mouse pointer that is appropriate for your usage.

  In step S6, the pointer display unit 120 distinguishes between the mouse pointer selected in step S5 and the mouse pointer that was not selected (for example, by color or size), and confirms that the user has selected the mouse pointer. Notice.

  As described above, the information processing apparatus according to the first embodiment of the present invention displays a mouse pointer corresponding to the number of screen uses of a display even when a wide screen area such as a multi-display environment is used. By automatically selecting the mouse pointer used by the user, it is possible to easily operate a pointing device in a multi-display environment.

  Here, in addition to mouse click operation information, mouse pointer operation processing may be performed using mouse drag operation information.

  As shown in FIG. 7, at the end of the drag operation of the mouse 102, the pointer selection means 150 determines whether the position of each mouse pointer 10 is in the user interface area, as in the description at the time of the click operation. An appropriate mouse pointer may be selected in accordance with the usage status of the mouse, or the mouse pointer 10C that moves outside the screen area like the mouse pointer 10C with reference to the movement amount information by the drag operation is excluded. May be.

(Second embodiment of the present invention)
FIG. 8 is a functional block diagram of an information processing apparatus according to the second embodiment of the present invention. Of the functional blocks constituting the functional block according to the second embodiment of the present invention, the same reference numerals are given to the same functional blocks constituting the functional block according to the first embodiment of the present invention. A description thereof will be omitted.

  8 is added to the functional block of the information processing apparatus 100 in FIG. 8, and when the pointer selection unit 150 selects a mouse pointer that is contrary to the user's intention, the user's instruction again. A mouse pointer selection process may be executed. When the user presses the scroll button attached to the mouse 102, the rerequest instruction unit 160 informs the pointer selection unit 150 that the selection result is contrary to the user's intention, The pointer selection means 150 selects the mouse pointer again, for example, by dropping the priority at the previous selection.

  As described above, the information processing apparatus according to the second embodiment of the present invention allows the user to press the scroll button attached to the mouse 102 even if the mouse pointer is selected against the user's intention. The mouse pointer can be selected again.

(Third embodiment of the present invention)
FIG. 9 is a functional block diagram of an information processing apparatus according to the third embodiment of the present invention. Of the functional blocks constituting the functional block according to the third embodiment of the present invention, the same functional blocks as those constituting the functional block according to the first embodiment of the present invention are denoted by the same reference numerals. A description thereof will be omitted.

  As shown in FIG. 9, in order to improve the selection processing accuracy of the pointer selection unit 150, a UI area changing unit 170 is added to the functional block of the information processing apparatus 100 of FIG. When the user interface area is at the same display position in the screen of each display, the UI area changing unit 170 changes the position of the user interface area displayed on the screen of each display to a position different from each other. Yes.

  For example, as shown in FIG. 10A, the application window 12 displayed on the display 101B and the application window 12 displayed on the display 101C are displayed at the same position. 10B, referring to the information of the user interface area of each display 101, the positions of the application windows 12 displayed on the screens of the display 101B and the display 101C are changed to different positions. By moving it, the user interface area is prevented from overlapping in the same area between the displays 101.

  As described above, the information processing apparatus according to the third embodiment of the present invention improves the selection processing accuracy of the pointer selection unit 150 so that the user interface areas do not overlap in the same area between the displays 101. Can be made.

(Fourth embodiment of the present invention)
FIG. 11 is a functional block diagram of an information processing apparatus according to the fourth embodiment of the present invention. Of the functional blocks constituting the functional block according to the fourth embodiment of the present invention, the same functional blocks as those constituting the functional block according to the first embodiment of the present invention are designated by the same reference numerals. A description thereof will be omitted.

  The information processing apparatus 100 shown in FIG. 11 simultaneously executes task processing corresponding to an icon or application window indicated by a plurality of mouse pointers while the mouse pointer selection processing is being performed, and selects the mouse pointer. At this point, the task processing that was executed by the mouse pointer that was not selected is returned to the state before execution. In order to realize this function, an instruction task execution unit 180, a task information recording unit 181 and a task rollback unit 182 are added to the functional blocks of the information processing apparatus 100 in FIG.

  The instruction task execution unit 180 is a unit that executes all task processing when a plurality of mouse pointers indicate, and the task information recording unit 181 records task information executed by the instruction task execution unit 180. It is like that.

  When the pointer selection unit 150 selects the mouse pointer by continuously evaluating the operation history information, the task scroll back unit 182 refers to the task information recorded by the task information recording unit 181 and is not selected. The task processing executed by the mouse pointer is rolled back to the state before execution.

  FIG. 12 is a flowchart showing the operation of the information processing apparatus according to the fourth embodiment of the present invention. Steps S1 to S4 and step S6 in FIG. 12 are the same as the processes with the same reference numerals in FIG.

  In step S15, the instruction task execution unit 180 executes all task processing when a plurality of mouse pointers indicate by left click or the like, and the task information recording unit 181 executes the task executed by the instruction task execution unit 180. Record task information.

  In step S16, the pointer selection unit 150 refers to the position information of the user interface area acquired in step S3 and the continuous operation history information acquired in step S4, and the mouse that is appropriate according to the usage situation of the user. The pointer is selected. If the necessary information amount of the operation history information is not accumulated during the mouse pointer selection process, the process returns to step S3. If the information amount is accumulated, the mouse pointer selection process is performed and the process proceeds to step S17.

  In step S17, the task scroll back means 182 refers to the task information recorded in step S15, and returns the task processing executed by the mouse pointer not selected in step S16 to the state before execution.

  As described above, the information processing apparatus according to the fourth embodiment of the present invention can provide an information operation environment in which task processing instructed by the mouse pointer can be executed even before the mouse pointer selection processing.

(Fifth embodiment of the present invention)
FIG. 13 is a diagram showing a usage form of a multi-display according to the fifth embodiment of the present invention. In order to execute selection processing with reference to the user's line-of-sight information when selecting a mouse pointer that is appropriate according to the usage situation of the user from a plurality of mouse pointers, in FIG. An image input unit 109 (USB camera or the like) is installed on the central display 101B. The image input unit 109 acquires information related to the user's line of sight.

  FIG. 14 is a functional block diagram of an information processing apparatus according to the fifth embodiment of the present invention. Of the functional blocks constituting the functional block according to the fifth embodiment of the present invention, the same functional blocks as those constituting the functional block according to the first embodiment of the present invention are designated by the same reference numerals. A description thereof will be omitted.

  14 includes a screen information recognition unit 110, a pointer display unit 120, a line-of-sight direction measurement unit 190, and a pointer selection unit 151. The screen information recognition unit 110 and the pointer display unit 120 are the same as those shown in FIG.

  The line-of-sight measuring means 190 measures which display 101 the user's line-of-sight direction is facing from among the plurality of displays 101. The line-of-sight direction is detected from image information of the user's eyes or face photographed by the image input unit 109 installed on the display 101B.

  As a general gaze detection method, when using eye image information, a method of detecting the gaze direction by tracking the movement of the pupil, or when using face image information, a characteristic image of the face is used. Examples include a method of recognizing a region portion (eyes, mouth, etc.) and detecting a gaze direction based on a change in the position, a method of detecting a gaze direction from face contour information, and the like.

  The pointer selection unit 151 refers to the line-of-sight direction information measured by the line-of-sight direction measurement unit 190, and selects a mouse pointer that is appropriate according to the usage status of the user.

  The pointer selection unit 151 first determines which display the user is browsing from a plurality of displays by referring to the line-of-sight direction information, and selects the mouse pointer of the display being browsed. For example, when the line-of-sight direction information is near the midpoint between the displays and it is difficult to determine the display that the user is browsing, the determination is made by taking into account the position information of the mouse in the display screen. .

  FIG. 15 is a diagram illustrating a selection example of a mouse pointer in consideration of mouse position information. FIG. 15 shows an example in which the user's line-of-sight direction is in the vicinity of an intermediate point between the display 101B and the display 101C. The left half of the screen of the display 101 is determined in advance as a blue area and the right half is determined as a red area, and the pointer selection unit 151 refers to the position information of the mouse pointer. If the position information of the mouse pointer is within the blue area, the display is performed. If the position information of the mouse is within the red area, the display is determined to be 101C.

  Further, when the user is browsing information on the display 101, the line-of-sight direction may move to the left and right within a short period of time. The mouse pointer may be switched when the screen area is fixed for an arbitrary time or longer.

  As described above, the information processing apparatus according to the fifth exemplary embodiment of the present invention refers to the user's line-of-sight direction and selects a mouse pointer that is appropriate for the user's usage situation, so that the mouse The selection accuracy and selection time of the pointer can be accelerated.

The figure which shows the utilization form of the multi-display which concerns on embodiment of this invention Hardware configuration diagram of information processing apparatus according to an embodiment of the present invention Functional block diagram of the information processing apparatus according to the first embodiment of the present invention The figure which shows the example of a display of the mouse pointer in the multi-display environment which concerns on embodiment of this invention The figure which shows the example of selection of a mouse pointer The flowchart showing operation | movement of the information processing apparatus which concerns on the 1st Embodiment of this invention. The figure which shows the example of selection of a mouse pointer Functional block diagram of the information processing apparatus according to the second embodiment of the present invention Functional block diagram of an information processing apparatus according to the third embodiment of the present invention The figure which shows the mode of change of UI area Functional block diagram of an information processing apparatus according to the fourth embodiment of the present invention The flowchart showing operation | movement of the information processing apparatus which concerns on the 4th Embodiment of this invention. The figure which shows the utilization form of the multi-display which concerns on the 5th Embodiment of this invention Functional block diagram of an information processing apparatus according to the fifth embodiment of the present invention The figure which showed the selection example of the mouse pointer which considered the position information of the mouse

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Mouse pointer 11 Icon 12 Application window 100 Information processing apparatus 101 Display 102 Mouse 103 Keyboard 104 CPU
106 HDD
105 SDRAM
107 Display I / F
108 Input I / F
DESCRIPTION OF SYMBOLS 109 Image input part 110 Screen information recognition means 120 Pointer display means 130 UI area recognition means 140 Operation history acquisition means 150, 151 Pointer selection means 160 Rerequest instruction means 170 UI area change means 180 Instruction task execution means 190 Gaze direction measurement means

Claims (13)

In an information processing apparatus that includes one or more displays and a pointing device for operating information in a screen of the display, and controls movement of a pointer displayed in the screen in accordance with the operation of the pointing device.
Pointer display means for displaying a pointer in the screen display area corresponding to each screen display area dividing the screen;
An information processing apparatus comprising: a pointer selection unit that selects a pointer that is appropriate for a user's usage status from among pointers displayed for each screen display area by the pointer display unit. . Screen information recognition means for recognizing the display being used;
2. The pointer display means according to claim 1, wherein the display screen recognized by the screen information recognition means is used as the screen display area, and the pointer is displayed corresponding to each screen of the display. Information processing device. User interface area recognition means for recognizing a user interface area including an icon or an application window displayed in the display screen,
The information processing apparatus according to claim 2, wherein the pointer selection unit selects a pointer in the user interface area from pointers displayed for each of the screen display areas by the pointer display unit.   When each of the user interface areas in the screen of the display is at the same display position in each of the screens, it is provided with user interface changing means for changing to different display positions in the screen. The information processing apparatus according to claim 3. Gaze direction measuring means for measuring the gaze direction of the user,
The information according to claim 2, wherein the pointer selection unit selects a pointer that is appropriate according to the usage status of the user with reference to the gaze direction information measured by the gaze direction measurement unit. Processing equipment.   The pointer selection unit selects a pointer that is appropriate according to the usage status of the user with reference to the line-of-sight direction information measured by the line-of-sight direction measurement unit and the position information of the pointer in the screen. The information processing apparatus according to claim 5. Instruction task execution means for executing task processing when the pointer displayed by the pointer display means indicates;
Task information recording means for recording task information executed by the instruction task execution means;
When a pointer is selected by the pointer selection means, task rollback means for returning task information of task processing designated by the pointer not selected by the pointer selection means to a state before execution is provided. The information processing apparatus according to claim 2.   The information processing apparatus according to claim 2, further comprising: a re-request instruction unit that causes the pointer selection unit to select again when receiving an instruction to re-select the pointer selected by the pointer selection unit.   3. The information according to claim 2, wherein when the pointer selection unit selects a pointer, the mouse pointer display unit distinguishes and displays the pointer selected by the pointer selection unit and the pointer not selected. Processing equipment. Operation history acquisition means for acquiring operation history information including a history of the user operating the icon or the application window with the pointer;
The pointer selection means, when there are a plurality of pointer selection candidates in the user interface area, specifies the user interface area corresponding to the icon or the application window that has been recently operated with reference to the operation history information, and specifies The information processing apparatus according to claim 3, wherein a pointer in the user interface area is selected. An information processing method in which an information processing apparatus has one or more display screens and a pointing device for operating information in the screen, and controls a pointer displayed in the screen in accordance with the operation of the pointing device. ,
A screen information recognition step for recognizing information about the screen of the display in use;
The screen display area is a screen recognized in the screen information recognition step, and a pointer display step for displaying the pointer corresponding to each recognized screen;
A pointer selection step of selecting a pointer that is appropriate according to a use situation of a user among pointers displayed for each of the screen display areas in the pointer display step. . In an information processing program in which an information processing apparatus has one or more display screens and a pointing device for operating information in the screen, and controls a pointer displayed in the screen in accordance with the operation of the pointing device ,
A screen information recognition step for recognizing information about the screen of the display in use;
The screen display area is a screen recognized in the screen information recognition step, and a pointer display step for displaying the pointer corresponding to each recognized screen;
An information processing program comprising: a pointer selection step of selecting a pointer that is appropriate according to a use situation of a user among pointers displayed for each of the screen display areas in the pointer display step. .   A computer-readable recording medium on which the information processing program according to claim 12 is recorded.