JP2018170048A - Information processing apparatus, input method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing apparatus having a touch sensor for detecting a touch operation and a hover operation which allows a user to easily select an icon from a hover state while utilizing detection accuracy of the touch sensor.SOLUTION: An information processing apparatus 1 comprises: a display part 13 which displays an image; a touch sensor 12 which detects a touch operation and a hover operation on a display region of the display part 13; and a control part 10 which performs control so as to display a hover mark at a position on the display region corresponding to the detected position when the hover operation is detected by the touch sensor 12. The control part 10 performs change control so as to change display size of the hover mark in accordance with size of an icon when the hover operation is detected on the icon displayed in the display region.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus and an input method, and more particularly to an information processing apparatus having a touch sensor that detects a touch operation and a hover operation on a display area on a display unit, and an input method in the information processing apparatus.

  Conventionally, information processing apparatuses in which a touch sensor is mounted on a display unit have been distributed. Some of such information processing apparatuses can accept a touch operation by a pen input device called an electronic pen or a digitizer pen in addition to a touch operation by a user's finger or a stylus pen. Various methods have been proposed as touch sensors, and pen input devices corresponding to the respective methods have also been proposed. For example, in a capacitive touch sensor, a signal output from a pen input device is detected by an electromagnetic induction method.

  The digitizer pen is a pen input device that can provide a pen input signal to the operation system (OS) separately from the touch signal. The digitizer pen has an active method that gives a signal of a certain frequency from the digitizer pen side, and a method that generates a magnetic field on the display unit side when the digitizer pen approaches the display unit (screen) (an electromagnetic induction method called an active method, Or passive type). In any method, when the touch sensor detects the digitizer pen, the touch input is excluded, and for example, handwriting input in a touched state is possible.

  Many of such touch sensors in the information processing apparatus can detect not only a touch operation (touch event) but also a hover operation (hover event) as an operation by a pen input device. Here, the hover operation refers to an operation for bringing the display screen into a floating state (hover state) where the pen input device is not in contact. Some touch sensors can detect a hover operation with a finger or a stylus pen.

  In such an information processing device, when a hover operation by a pen input device (or a finger or a stylus pen) is detected, a hover mark is displayed at the position of the display unit corresponding to the detected position, and hover operation is detected. The hover mark can be moved following the position (that is, following the movement of the pen input device or the like). The hover mark is a certain mark for indicating the hover state like a mouse cursor, and the user moves the hover mark on the icon displayed in the display area of the display unit, and then performs the icon selection operation. It is possible to do.

  Japanese Patent Application Laid-Open No. 2004-133867 discloses a technique for discriminating a touch operation and a hover operation by a finger, a stylus pen, a pen input device (indicated as “stylus” in Patent Document 1), and the like based on an amplitude and a gradient pattern of an input signal and processing them separately. Is disclosed.

  Patent Document 2 discloses an information processing apparatus such as a tablet capable of switching between a hovering operation and a normal operation. In this information processing apparatus, if an operation is performed such that a line is drawn on the screen within a predetermined time after tapping the screen once with a pen, the line is drawn as a normal operation. When the time elapses, the hovering operation is executed.

Special table 2009-543246 gazette JP 2000-122808 A

  By the way, with the recent increase in pixel resolution in the display unit, the detection accuracy of the touch sensor for touch operations and hover operations has also improved, and in particular, the pen tip of the pen input device has been reduced in diameter to take advantage of the detection accuracy. Is progressing.

  However, in order to take advantage of high detection accuracy, it is necessary not only to reduce the pen tip diameter, but also to make the hover mark to be displayed small, which makes it very difficult for the user to see the hover mark, resulting in the selection of the icon. Operation becomes difficult. Note that Patent Documents 1 and 2 do not describe changing the size of the hover mark.

  The present invention has been made in view of the above-described actual situation, and an object thereof is to make use of the detection accuracy of the touch sensor in an information processing apparatus having a touch sensor that detects a touch operation and a hover operation. It is to make it easier for the user to select an icon from the hover state.

  In order to solve the above problems, a first technical means of the present invention includes a display unit that displays an image, and a touch sensor that detects a touch operation and a hover operation on the display area of the display unit. An information processing apparatus comprising: a control unit that performs control to display a hover mark at a position on the display area corresponding to the detected position when the hover operation is detected by the touch sensor; When the hover operation is detected on the icon displayed in the display area, the unit performs change control to change the display size of the hover mark according to the size of the icon. It is.

  According to a second technical means of the present invention, in the first technical means, the control unit adjusts the display size of the hover mark to the vertical and / or horizontal length of the icon as the change control. It is characterized by changing to.

  According to a third technical means of the present invention, in the first or second technical means, the control unit detects that the detection position of the hover operation is not on the icon and the detection position and the icon are in a predetermined proximity condition. When the condition is satisfied, movement control for moving the hover mark onto the icon is performed.

  According to a fourth technical means of the present invention, in the third technical means, the predetermined proximity condition includes that at least a part of the icon is displayed in an area of a predetermined range including the detection position. It is a feature.

  According to a fifth technical means of the present invention, in the third or fourth technical means, the predetermined proximity condition includes that the detection position exists in an area of a predetermined range including the icon. Is.

  According to a sixth technical means of the present invention, in any one of the third to fifth technical means, the touch sensor is a pen input device having a button for receiving an operation for releasing the movement control. It has a function of detecting a touch operation and the hover operation.

  According to a seventh technical means of the present invention, in any one of the first to sixth technical means, the touch sensor is formed by a pen input device having a button for receiving an operation for canceling the change control. It has a function of detecting a touch operation and the hover operation.

  An eighth technical means of the present invention is an input method in an information processing apparatus including a display unit that displays an image and a touch sensor that detects a touch operation and a hover operation on the display area of the display unit, A detection step in which the touch sensor detects the hover operation, and a display in which the control unit of the information processing apparatus performs control to display a hover mark at a position on the display area corresponding to the position detected in the detection step. Control step, and when the hover operation is detected on the icon displayed in the display area in the detection step, the display control step sets the display size of the hover mark to the size of the icon. It has the step which changes according to this, It is characterized by the above-mentioned.

  According to the present invention, in an information processing apparatus having a touch sensor that detects a touch operation and a hover operation, the user can easily select an icon from the hover state while taking advantage of the detection accuracy of the touch sensor.

It is a functional block diagram which shows the example of 1 structure of the information processing apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart for demonstrating an example of the pen input method in the information processing apparatus of FIG. It is the schematic for demonstrating an example of the pen input method of FIG. It is the schematic for demonstrating an example of the pen input method of FIG. It is a flowchart for demonstrating the other example of the pen input method in the information processing apparatus of FIG. It is the schematic for demonstrating an example of the pen input method of FIG. It is a flowchart for demonstrating the other example of the pen input method in the information processing apparatus of FIG. It is the schematic for demonstrating an example of the pen input method of FIG. It is the schematic for demonstrating an example of the pen input method of FIG. It is the schematic for demonstrating the other example of the pen input method of FIG. It is the schematic for demonstrating an example of the positional relationship of the recognition area and icon in the pen input method of FIG. It is the schematic for demonstrating the other example of the positional relationship of the recognition area and icon in the pen input method of FIG. It is the schematic for demonstrating the other example of the positional relationship of the recognition area and icon in the pen input method of FIG.

  An information processing apparatus according to the present invention includes a display unit, a touch sensor, and a control unit. The information processing apparatus according to the present invention may be an apparatus configured with one casing, or may be an apparatus in which the display unit and the touch sensor are configured with a main body (control unit side) and a separate casing. Good. Examples of the information processing apparatus according to the present invention include a stationary PC (Personal Computer), a mobile PC, a tablet-type terminal device (hereinafter referred to as a tablet terminal), a mobile phone (including a so-called smartphone), and the like.

(First embodiment)
A first embodiment of the present invention will be described with reference to FIGS. 1 to 3B. FIG. 1 is a block diagram illustrating a configuration example of the information processing apparatus according to the present embodiment. The information processing apparatus 1 according to the present embodiment includes a control unit 10 that controls the entire device, a touch sensor 12, and a display unit 13 that displays an image. The display unit 13 includes a display panel that displays an image. Examples of the display panel include various display panels such as a liquid crystal display and an organic electroluminescence display.

  In addition, the information processing apparatus 1 exemplified here includes a storage unit 11 that stores an image file to be displayed, and a communication unit 14 for acquiring the image file to be displayed from an external device such as a server device. I have. Examples of the communication unit 14 include an interface for communicating with an external device via a wired LAN (Local Area Network) router. Of course, the interface is not limited to this router, and may be an interface that communicates via a base station of a mobile communication system, an access point of a wireless LAN, or the like.

  The information processing apparatus 1 also includes a power key and a hardware key (volume adjustment key, etc.) other than the power key, a keyboard, a pointing device such as a mouse, a joystick, a touch pad, and a trackball in order to accept a user operation. Any one or more of a keyboard and the like may be provided.

  Hereinafter, the control unit 10 and the touch sensor 12 which are main components of the present invention will be described in detail. The control unit 10 operates the control program stored in the program storage area and performs various controls. For example, the control unit 10 includes a central processing unit (CPU) or a micro processing unit (MPU), a RAM (Random Access Memory) as a work area, and a control device such as a storage device. / It can also be mounted as an IC chip set. The storage device stores various control contents including the control program (including a program for executing processing according to the present invention). Examples of the storage device include a flash ROM (Read Only Memory) and an EEPROM (Electrically Erasable and Programmable ROM). Further, the storage unit 11 can be adopted as the storage device.

  The touch sensor 12 is a sensor that detects a touch operation and a hover operation on the display area (all display areas) of the display unit 13, and may be a sensor that supports only a single touch or a sensor that supports multi-touch. Good.

  Here, the hover operation refers to an operation corresponding to an operation for aligning the cursor with a specific element by a pointing device, and an operation to bring the touch sensor 12 into a state before the touch operation (a hover state with the operation subject floating). Point to. The hover state refers to a state where the operating subject is not more than a predetermined distance from the display screen and the operating subject is not in contact with the display screen, that is, a state where the operating subject is brought close.

  As the touch sensor 12, various types of sensors such as a surface type or projection type electrostatic capacity method, an electromagnetic induction method, an infrared method, a surface acoustic wave method, and a resistive film method can be applied. In addition, the detection unit for detecting the hover operation can be provided by a detection method different from the detection method of the touch operation. Note that the touch sensor 12 is often provided as a panel so as to overlap the surface of the display unit (display panel) 13, and is also called a touch panel alone or in combination with the display panel.

  When the touch sensor 12 detects a touch operation or a hover operation, the touch sensor 12 passes information (input coordinate information) specifying the detection position to the control unit 10. Alternatively, the control unit 10 monitors input of a touch operation or a hover operation on the touch sensor 12 by polling processing or the like, and obtains input coordinate information when detected.

  The touch sensor 12 may accept any of a touch operation and a hover operation among a user's finger operation, a stylus pen operation, and a pen input device operation. However, a mode for accepting an operation on the pen input device (referred to as a pen input mode) and a mode for accepting an operation other than that (referred to as a normal touch input mode) are prepared. It is preferable that the mode can be switched based on the configuration, or the proximity of the pen input device is detected and the mode is switched to the pen input mode. Further, the touch operation may be accepted in both modes, but the hover operation may be accepted only in the pen input mode.

  The pen input device will be described with an example in which the touch sensor 12 detects a touch operation or a hover operation (proximity operation) by the pen input device by an electromagnetic induction method. A pen input device 2 illustrated in FIG. 1 includes a pen signal generation unit 21 and a button 22 together with a control unit 20 that controls the whole.

  The pen signal generation unit 21 includes a coil and outputs a predetermined electromagnetic wave as a pen signal based on control from the control unit 20. In general, the control unit 20 performs control such that a pen signal is constantly transmitted. When the pen input device 2 is close to the touch sensor 12 (that is, close to the display unit 13), the coil on the touch sensor 12 side detects the pen signal. When a pen signal is detected, the pen signal generator 21 can detect it.

  The control unit 20 includes a timer, and when there is no proximity to the touch sensor 12 for a certain period (for example, 1 minute), the control unit 20 shifts to the sleep mode and stops the generation of the pen signal. The return from the sleep mode is generally performed by tapping the pen tip of the pen input device 2 or pressing the provided button 22.

  The button 22 is used for assignment of a predetermined operation such as a click operation, for example. When the button 22 is pressed, an electromagnetic wave modulated according to the operation is output from the pen signal generation unit 21. In addition, when the button 22 is pressed, a configuration in which a signal indicating the pressing is transmitted to the information processing apparatus 1 side by a separately provided wireless communication unit or a wired communication unit and a connection cable may be employed.

  Although the description is based on the premise of the active method, a passive method such as a penable technology method can also be adopted. In the case of the passive method, the pen input device 2 side does not require a power source, and power is supplied from the coil on the touch sensor 12 side to the pen signal generation unit 21 by electromagnetic induction, and the coil in the pen signal generation unit 21 receives the power. Outputs the predetermined electromagnetic wave, and the touch sensor 12 detects it.

  When the hover operation is detected by the touch sensor 12 as described above, the control unit 10 performs control to display a hover mark at a position on the display area of the display unit 13 corresponding to the detection position indicated by the input coordinate information. Do. This hover mark is a pointer indicating the position of the hover operation. In addition to displaying a hover mark, other processing such as displaying detailed information of an object included in a circle having a radius of a predetermined distance with the hover coordinate at the center may be executed together.

  In addition, when a touch operation is detected, the control unit 10 selects an image such as an icon at a position on the display area of the display unit 13 corresponding to the detection position indicated by the input coordinate information. Processing according to the display is performed. The icon is arranged, for example, in the image of the basic screen of the OS, and an application or file associated with the icon can be opened by performing an operation of selecting the icon.

  As a main feature of the present embodiment, when a hover operation is detected on the icon displayed in the display area, the control unit 10 changes the display size of the hover mark according to the size of the icon. Change control is performed on the display unit 13. That is, the display unit 13 displays the hover mark in a state where the size is appropriately changed according to the size of the icon at the position. Note that the size of the icon itself is known for each icon, and the selection area of each icon is actually defined by coordinates in order to enable selection of the icon.

  Next, the input method of the present embodiment using the pen input device 2 will be described with reference to FIGS. FIG. 2 is a flowchart for explaining an example of the pen input method in the information processing apparatus 1, and FIGS. 3A and 3B are schematic diagrams for explaining an example of the pen input method of FIG.

  First, the control unit 10 determines whether or not the touch sensor 12 has received a pen signal (step S1), and waits until it is received (until YES). When the pen signal is received, the control unit 10 obtains input coordinate information indicating the detection position of the pen signal, and further displays a hover mark at a display position corresponding to the detection position on the display unit 13. The display unit 13 executes the display (step S2). When the touch sensor 12 detects a touch operation, a touch signal indicating the touch operation is transmitted to the control unit 10, and the control unit 10 performs a process corresponding to the touch signal (a process different from when only the pen signal is received). Will do.

  Next, the control unit 10 determines whether the displayed hover mark is on the icon, the coordinates of the selected area of each icon being displayed and the display coordinates of the hover mark (that is, the coordinates of the detection position indicated by the input coordinate information). ) To determine (step S3). If NO in step S3, the process is terminated as it is.

  On the other hand, in the case of YES in step S3, the control unit 10 detects the size of the icon that overlaps the display of the hover mark by calculating the size from the coordinates of the selected area (step S4). Thereafter, the control unit 10 determines the display size of the hover mark so as to match the size of the icon, and instructs the display unit 13 to make the display size, and the display unit 13 makes such a display change (that is, display). Size correction) is performed (step S5), and the process is terminated.

  As an example, a case will be described in which a file management application window 31 is displayed on the display unit 13 as shown in FIG. 3A, a plurality of icons indicating folders are displayed therein, and one of the icons is hovered.

  First, when the user brings the pen input device 2 close to a certain position in the display area of the display unit 13, a pen signal is detected at that position and the hover mark 30a is displayed as illustrated in FIG. 3A. When detecting the hover operation, the distance (distance in the direction perpendicular to the display screen) between the display screen and the pen tip of the pen input device 2 that is the operation subject may also be detected. The hover mark 30a may be increased as the hover distance) increases.

  When the user moves the pen input device 2 from the state of FIG. 3A and moves the hover mark 30a to the “video” icon display area (icon selection area) 32, the icon selection area 32 as shown in FIG. 3B. Is changed to a hover mark 30b having a display size suitable for. Note that the range of the icon selection area 32 varies depending on the OS and application, and the portion where the icon is displayed is not necessarily the selection area. For example, not only the “video” icon in FIG. A character string such as “system folder” and a space between them may be recognized as an icon selection region.

  Here, an example was given in which the control unit 10 changed the display size of the hover mark 30b to match the vertical and horizontal lengths of the icon (icon selection area 32) as the change control. However, the hover mark 30b does not have to be completely the same in length and width as the icon selection area 32. For example, the display size may be 90% of the icon selection area 32. Furthermore, the hover mark 30b may be matched only with the length in the vertical direction of the icon selection area 32, for example, the display size may be 100% vertical and 70% horizontal, or 90% vertical and the original display size. Similarly, according to only the length in the horizontal direction, for example, the display size may be 70% vertical and 100% horizontal, or 90% horizontal and the original display size in the vertical direction.

  Of course, the control unit 10 determines the display size of the hover mark to match the size of the icon in step S5 without going through the process of step S2, and causes the display unit 13 to display the hover mark at the display size. You may instruct. For example, when the user suddenly performs a hover operation on the icon selection area 32, the hover mark 30b corresponding to the size of the icon selection area 32 may be displayed without displaying the hover mark 30a.

  Moreover, it can be said that it is particularly preferable to make the hover mark semi-transparent by α blending with an icon image as a background because the display size of the hover mark is changed. In addition, when the display size of the hover mark is less than the predetermined size, the hover mark may be displayed as it is, and when the hover mark exceeds the predetermined size, it may be made translucent. Further, not only the display size of the hover mark but also the design may be changed according to the size of the icon (for example, the aspect ratio). Thereby, the display unit 13 can display a hover mark having a design that matches a vertically long icon or a design that matches a horizontally long icon.

  As described above, according to the present embodiment, by changing the display size of the hover mark in this way, the icon is displayed from the hover state to the user after the hover mark is displayed small by taking advantage of the detection accuracy of the touch sensor 12. It becomes easy to select. In addition, when the user selects an icon by a touch operation from such a display change state, the color of the icon selection area may be reversed.

  Although a specific example is given only for the case where the pen input device 2 is used, the above-described change control at the time of hover operation can be applied in the same manner when inputting with the user's finger or stylus pen. However, when the hover operation is accepted in both the pen input mode and the normal touch input mode, the change control as described above may be executed only in the pen input mode. This is because it is assumed that an icon that can be selected with a finger is being selected. At this time, since the detection area of the hover operation with the finger is assumed to be wide, when the hover operation with the finger is detected, a hover mark that matches the detection area may be displayed.

(Second Embodiment)
A second embodiment of the present invention will be described with reference to FIGS. 4 and 5 together. 4 is a flowchart for explaining another example of the pen input method in the information processing apparatus 1, and FIG. 5 is a schematic diagram for explaining an example of the pen input method of FIG. Although the present embodiment will be described with a focus on differences from the first embodiment, various application examples described in the first embodiment can be similarly applied.

  The information processing apparatus 1 according to the present embodiment has a function in which the touch sensor 12 detects a touch operation and a hover operation performed by a pen input device. That is, in this embodiment, a pen input device such as the pen input device 2 illustrated in FIG. 1 is required. However, it is assumed that the pen input device has a button (hereinafter referred to as a first button) that receives an operation (change release operation) for canceling the change control. As the first button, the button 22 can be applied. However, when the pressing of the button 22 is assigned to another operation, the change canceling operation can be accepted by long-pressing the button 22 or continuously pressing the button 22 twice. That's fine.

  The input method of this embodiment is demonstrated along FIG. Also in this input method, the same processing as the processing in steps S1, S2, S3, S4, and S5 in FIG. 2 is performed (steps S11, S12, S13, S15, and S16). It is determined whether or not the first button (change release button) has not been pressed (step S14).

  In the case of NO in step S14, the processing is ended as it is, and as a result, as shown in FIG. 5, the hover mark 50 having the same display size as the hover mark 30a in FIG. 3A is displayed. On the other hand, if YES in step S14, the process proceeds to steps S15 and S16 to correct the hover mark, and as a result, the hover mark 30a in FIG. 3A is changed to the hover mark 30b in FIG. 3B. .

  Moreover, the determination process of step S14 can also be applied after step S16. At that time, the state where the hover mark 30b of FIG. 3B is displayed continues without the first button being pressed, and the state where the hover mark 30b of FIG. 3B is displayed when the first button is pressed is shown in FIG. The mark 50 is changed to the displayed state.

  As described above, in the information processing apparatus 1 according to the present embodiment, in addition to the effects of the first embodiment, the change control can be canceled, so that it is possible to display according to the user's preference.

(Third embodiment)
A third embodiment of the present invention will be described with reference to FIGS. Although the present embodiment will be described with a focus on differences from the first and second embodiments, various application examples described in the first and second embodiments can be similarly applied.

  In the information processing apparatus 1 according to the present embodiment, the control unit 10 performs the following movement control on the display unit 13. The movement control refers to control for moving the hover mark onto the icon when the detection position of the hover operation is not on the icon and the detection position and the icon satisfy a predetermined proximity condition.

  Moreover, it is preferable that the information processing apparatus 1 in this embodiment has a function in which the touch sensor 12 detects a touch operation and a hover operation performed by a pen input device. However, it is assumed that the pen input device has a button (hereinafter referred to as a second button) that receives an operation (movement cancellation operation) for canceling the movement control. In this case, a pen input device such as the pen input device 2 illustrated in FIG. 1 is required. Thereby, since the movement control can also be canceled, a display suitable for the user's preference can be performed.

  As the second button, the button 22 can be applied, but when the pressing of the button 22 is assigned to another operation, the movement canceling operation can be accepted by long-pressing the button 22 or continuously pressing the button 22 twice. That's fine. The second button may also serve as the first button, and the operation thereof may be the same. Of course, the second button may be provided separately from the first button, or the operation method (for example, the former is continuously pressed twice and the latter is long-pressed) may be different. Furthermore, the change canceling operation may be accepted by the first long press, and the movement canceling operation may be accepted by the second long press, or the order of accepting the first time and the second time may be switched.

  Next, the input method of the present embodiment using the pen input device 2 will be described with reference to FIGS. FIG. 6 is a flowchart for explaining another example of the pen input method in the information processing apparatus 1 of FIG. 7A and 7B are schematic diagrams for explaining an example of the pen input method of FIG. 6, and FIG. 7C is a schematic diagram for explaining another example of the pen input method of FIG. FIG. 8A is a schematic diagram for explaining an example of a positional relationship between a recognition area and an icon in the pen input method of FIG.

  First, similarly to steps S1 and S2 of FIG. 2, the control unit 10 waits for reception of a pen signal (step S21), and displays the hover mark 70a as illustrated in FIG. 7A (step S22).

  Next, the control unit 10 determines whether or not an icon exists in the recognition area (area of a predetermined range) 71 of the hover mark 70a based on the coordinates of the icon selection area (step S23). End the process. In step S23, as the predetermined proximity condition, at least a part of the icon is displayed (included) in the area 71 of the predetermined range including the detection position, and it is determined whether or not this condition is satisfied. Yes.

  The region 71 in the predetermined range is a rectangle having a vertical side with a predetermined length centered on the hover mark 70a and a horizontal side with the same or different predetermined length. However, the region of the predetermined range is not limited to this, and may be circular. For example, as shown in FIG. 8A, it may be determined by a distance from the center, for example, a circle 82 having a radius r centering on a hover position (position for displaying a hover mark) 81a is defined as an area of the predetermined range. In the example of FIG. 8A, since there is an area 83a that overlaps the icon selection area 80 in the circle 82, it is determined that the predetermined proximity condition is satisfied.

  In the case of YES in step S23, the control unit 10 determines whether or not there are a plurality of icons (icon selection regions) in the recognition area 71 (step S24). If it does not exist (NO in step S24), it is determined whether or not the second button (movement release button) has not been pressed (step S26).

  In the case of NO in step S26, the processing is ended as it is, and as a result, the hover mark 70a in FIG. 7A remains displayed. On the other hand, if YES in step S26, the hover mark is corrected to the position of the target icon (step S27), and the process ends. As a result of the automatic guidance of the hover mark 70a as in step S27, as shown in FIG. 7B, the position of the icon (preferably the center position of the icon selection area 72) is maintained even though the position of the pen input device 2 does not change. ) Displays a hover mark 70b. 8A, the hover mark 84a is displayed at the position of the icon selection area 80.

  As described above, when at least a part of the icon is included in the recognition area including the position (detection position) where the hover operation is detected (preferably centered on this position), the control unit 10 displays the hover mark as the hover mark. Move control to move over the icon. If an icon is present at the detection position, it may be moved to the center of the icon (for example, the center of gravity or the center ordinate in the vertical direction and the center abscissa in the horizontal direction). Of course, when the hover detection position exists at the center of the icon, the movement is not necessary.

  On the other hand, in the case of YES in step S24, the control unit 10 calculates (detects) the icon of the largest size among the plurality of icons from the coordinates of the icon selection area, and sets it as the target icon (step S25). Instead of step S25, an icon having the largest overlapping area with the recognition area may be detected as a target icon, or automatic guidance on the icon is not performed (that is, no target icon is provided). May be. After the process of step S25, the process proceeds to step S26, and in the case of YES in step S26, the control unit 10 corrects the hover mark to the position of the target icon in step S25 (step S27) and ends the process.

  Moreover, the determination process of step S26 can also be applied after step S27. At this time, if the second button is not pressed, the state where the hover mark 70b of FIG. 7B is displayed continues, and when the second button is pressed, the state returns to the state where the hover mark 70a of FIG. 7A is displayed. . In the present embodiment, the second button is not essential, and when the second button is not provided, the process of step S26 in FIG. 6 may be omitted.

  Of course, the control unit 10 may instruct the display unit 13 to display the hover mark at the position of the icon in step S27 without passing through the process of step S22. For example, when the user suddenly performs a hover operation on the icon selection area 72, the hover mark 70b may be displayed at the position of the icon selection area 72 without displaying the hover mark 70a.

  Next, another example of the positional relationship between the recognition area and the icon will be described with reference to FIGS. 8B and 8C. 8B and 8C are schematic diagrams for explaining another example of the positional relationship between the recognition area and the icon in the pen input method of FIG.

  The predetermined proximity condition may include the presence of the detection position 81 in a predetermined area 85 including an icon (icon selection area 80) as shown in FIG. 8B. The area 85 of the predetermined range indicates an icon proximity area including an icon. The icon proximity area 85 is vertically expanded by a predetermined length h with respect to the height (vertical length) H of the icon selection area 80, and with respect to the width (horizontal length) W of the icon selection area 80. The area is widened to the left and right by the same or different predetermined length w. However, the definition of the icon proximity region is not limited to this.

  Thus, even when a hover operation is detected on the icon proximity area 85, the control unit 10 moves the hover mark above the icon (position of the icon selection area 80) and displays the hover mark 84b. You may be in the state made to do.

  A case will be described in which the case where the predetermined proximity condition includes a case where at least a part of an icon is displayed in a predetermined range including the detection position is also used. In this case, as illustrated in FIG. 8C, if an area 83 c that overlaps the icon proximity area 85 exists in the circle 82, it is determined that the predetermined proximity condition is satisfied, and the hover mark 84 c is placed at the position of the icon selection area 80. Display it.

  As described above, in the information processing apparatus 1 according to the present embodiment, by moving the display position of the hover mark onto the icon in this way, the detection accuracy of the touch sensor 12 is utilized to display the hover mark small. In addition, the user can easily select an icon from the hover state.

  Further, the above movement control at the time of hover operation can be similarly applied when inputting with a user's finger or stylus pen without using a pen input device. However, when the hover operation is accepted in both the pen input mode and the normal touch input mode, the movement control as described above may be executed only in the pen input mode. This is because it is assumed that an icon that can be selected with a finger is being selected. At this time, since the detection area of the hover operation with the finger is assumed to be wide, when the hover operation with the finger is detected, a hover mark that matches the detection area may be displayed.

  In the processing example of FIG. 6, the movement control can also be applied to an information processing apparatus to which the change control is not applied, as was not described for the combination with the first or second embodiment.

The case where this embodiment is combined with the first or second embodiment will be briefly described.
As an example of the combination, after the processing in step S27 in FIG. 6 (after the hover mark 70b has moved to the icon selection area 72), the processing in steps S4 and S5 in FIG. 2 or the processing in steps S14 to 16 in FIG. The hover mark 70c suitable for the icon size as shown in FIG. 7C may be displayed. Thereby, in addition to the effects of the first and second embodiments, the user can more easily select an icon from the hover state.

  As another combination example, prior to the determination in step S23 in FIG. 6, the determination in step S3 in FIG. 2 or step S13 in FIG. 4 is performed, and if YES in step S3 or step S13, the processing in steps S4 and S5 or Steps S14 to S16 may be executed, and then the process may proceed to step S23.

(Other)
The information processing apparatus according to the present invention has been described above. However, as described in the flow of processing, the present invention includes a display unit that displays an image, and a touch operation and a hover operation on the display area of the display unit. An input method in an information processing apparatus including a touch sensor to be detected and a form as a program for causing a computer (information processing apparatus) to execute the input method may be employed.

  As described in the first embodiment, one of the input methods (referred to as a first input method) includes a detection step in which the touch sensor detects the hover operation, and a control unit of the information processing apparatus. A display control step for performing control to display a hover mark at a position on the display area corresponding to the position detected in the detection step. The display control step is a step of changing the display size of the hover mark according to the size of the icon when the hover operation is detected on the icon displayed in the display area in the detection step. Have Other application examples are the same as those described in the first to third embodiments for the information processing apparatus, and a description thereof will be omitted.

  In other words, the program (referred to as a first program) is a program for causing a computer including the display unit and the touch sensor to execute the first input method. That is, the second program causes the computer to display a hover mark at a position on the display area corresponding to the position detected at the detection step and the position detected at the detection step. And a display control step for executing the program. The display control step is a step of changing the display size of the hover mark according to the size of the icon when the hover operation is detected on the icon displayed in the display area in the detection step. Have Other application examples are the same as those described in the first to third embodiments for the information processing apparatus, and a description thereof will be omitted.

  As described in the third embodiment, another input method in the information processing apparatus (referred to as a second input method) includes a detection step in which the touch sensor detects the hover operation, and a control unit of the information processing apparatus. Includes a display control step for performing control to display a hover mark at a position on the display area corresponding to the position detected in the detection step. In the display control step, when the detection position of the hover operation detected in the detection step is not on the icon and the detection position and the icon satisfy a predetermined proximity condition, the hover mark is displayed on the icon. Moving it over. Other application examples are the same as those described for the information processing apparatus, and a description thereof will be omitted.

  In other words, the program (hereinafter referred to as the second program) is a program for causing the computer including the display unit and the touch sensor to execute the second input method. That is, the second program causes the computer to display a hover mark at a position on the display area corresponding to the position detected at the detection step and the position detected at the detection step. And a display control step for executing the program. In the display control step, when the detection position of the hover operation detected in the detection step is not on the icon and the detection position and the icon satisfy a predetermined proximity condition, the hover mark is displayed on the icon. Moving it over. Other application examples are the same as those described in the third embodiment for the information processing apparatus, and a description thereof will be omitted.

  Further, it is possible to easily understand the form as a program recording medium in which the first program and / or the second program is recorded on a non-transitory recording medium readable by a computer. The computer is not limited to a general-purpose PC, and various types of computers such as a microcomputer and a programmable general-purpose integrated circuit / chip set can be applied. In addition, this program is not limited to be distributed via a portable recording medium, but can also be distributed via a network such as the Internet or via a broadcast wave. Receiving via a network refers to receiving a program recorded in a storage device of an external server.

DESCRIPTION OF SYMBOLS 1 ... Information processing apparatus, 2 ... Pen input device, 10 ... Control part of information processing apparatus, 11 ... Memory | storage part, 12 ... Touch sensor, 13 ... Display part, 14 ... Communication part, 20 ... Control part of pen input device, 21 ... Pen signal generator, 22 ... button, 30a, 30b, 50, 70a, 70b, 70c, 84a, 84b, 84c ... hover mark, 31 ... window, 32 ... icon selection area, 71 ... recognition area, 72,80 ... Icon selection area, 81 ... Detection position, 82 ... Circle, 83a, 83c ... Overlapping area, 85 ... Icon proximity area.

The present invention relates to an information processing apparatus , an input method, and a program . More specifically, the information processing apparatus includes a touch sensor that detects a touch operation and a hover operation on the display unit , and the information processing apparatus. The present invention relates to an input method and a program for executing the input method .

  Conventionally, information processing apparatuses in which a touch sensor is mounted on a display unit have been distributed. Some of such information processing apparatuses can accept a touch operation by a pen input device called an electronic pen or a digitizer pen in addition to a touch operation by a user's finger or a stylus pen. Various methods have been proposed as touch sensors, and pen input devices corresponding to the respective methods have also been proposed. For example, in a capacitive touch sensor, a signal output from a pen input device is detected by an electromagnetic induction method.

  The digitizer pen is a pen input device that can provide a pen input signal to the operation system (OS) separately from the touch signal. The digitizer pen has an active method that gives a signal of a certain frequency from the digitizer pen side, and a method that generates a magnetic field on the display unit side when the digitizer pen approaches the display unit (screen) (an electromagnetic induction method called an active method, Or passive type). In any method, when the touch sensor detects the digitizer pen, the touch input is excluded, and for example, handwriting input in a touched state is possible.

  Many of such touch sensors in the information processing apparatus can detect not only a touch operation (touch event) but also a hover operation (hover event) as an operation by a pen input device. Here, the hover operation refers to an operation for bringing the display screen into a floating state (hover state) where the pen input device is not in contact. Some touch sensors can detect a hover operation with a finger or a stylus pen.

  In such an information processing device, when a hover operation by a pen input device (or a finger or a stylus pen) is detected, a hover mark is displayed at the position of the display unit corresponding to the detected position, and hover operation is detected. The hover mark can be moved following the position (that is, following the movement of the pen input device or the like). The hover mark is a certain mark for indicating the hover state like a mouse cursor, and the user moves the hover mark on the icon displayed in the display area of the display unit, and then performs the icon selection operation. It is possible to do.

  Japanese Patent Application Laid-Open No. 2004-133867 discloses a technique for discriminating a touch operation and a hover operation by a finger, a stylus pen, a pen input device (indicated as “stylus” in Patent Document 1), and the like based on an amplitude and a gradient pattern of an input signal and processing them separately. Is disclosed.

  Patent Document 2 discloses an information processing apparatus such as a tablet capable of switching between a hovering operation and a normal operation. In this information processing apparatus, if an operation is performed such that a line is drawn on the screen within a predetermined time after tapping the screen once with a pen, the line is drawn as a normal operation. When the time elapses, the hovering operation is executed.

Special table 2009-543246 gazette JP 2000-122808 A

  By the way, with the recent increase in pixel resolution in the display unit, the detection accuracy of the touch sensor for touch operations and hover operations has also improved, and in particular, the pen tip of the pen input device has been reduced in diameter to take advantage of the detection accuracy. Is progressing.

  However, in order to take advantage of high detection accuracy, it is necessary not only to reduce the pen tip diameter, but also to make the hover mark to be displayed small, which makes it very difficult for the user to see the hover mark, resulting in the selection of the icon. Operation becomes difficult. Note that Patent Documents 1 and 2 do not describe changing the size of the hover mark.

  The present invention has been made in view of the above-described actual situation, and an object thereof is to make use of the detection accuracy of the touch sensor in an information processing apparatus having a touch sensor that detects a touch operation and a hover operation. It is to make it easier for the user to select an icon from the hover state.

In order to solve the above problems, a first technical means of the present invention includes a display unit displaying an image, a touch sensor for detecting a touch operation on the display section, the display unit by the touch sensor before the touch operation to the displayed icon is detected, and a control unit for displaying the hover marks hover operation has been detected position of the display unit, the control unit, the hover operation The display size of the hover mark is controlled based on the size of the detection area at the detected position .

According to a second technical means of the present invention, in the first technical means, a mode execution unit for executing a pen input mode for accepting an operation with a pen input device and a normal touch input mode for accepting an operation with a finger. The control unit changes the display size of the hover mark according to the size of the icon when the hover mark is on the icon displayed on the display unit and the pen input mode is set. It is characterized by doing.

According to a third technical means of the present invention, in the second technical means, the touch sensor detects the detection area larger in the normal touch input mode than in the pen input mode. It is characterized by that.

According to a fourth technical means of the present invention, when the hover operation is detected on the icon displayed on the display unit in the second or third technical means, the display size of the hover mark is changed. A determination unit configured to determine whether or not the state is released, and when the determination unit determines that the change in the display size of the hover mark has not been released, the control unit sets the size of the icon; Accordingly, the display size of the hover mark is changed accordingly .

According to a fifth technical means of the present invention, in any one of the first to fourth technical means, when the control unit includes an object within a predetermined distance of a position where the hover operation is detected, the object The detailed information is displayed on the display unit .

A sixth technical means of the present invention is an input method in an information processing apparatus including a display unit that displays an image and a touch sensor that detects a touch operation on the display unit, wherein the touch sensor is a hover. A detection step of detecting an operation; and a control unit of the information processing device at a position where the hover operation is detected before the touch operation to the icon displayed on the display unit is detected by the touch sensor. A display control step for displaying a hover mark, wherein the display control step controls a display size of the hover mark based on a size of a detection area at a position where the hover operation is detected in the detection step. It is characterized by having the step to do.

A seventh technical means of the present invention is a program for executing the input method of the sixth technical means, and includes a display unit that displays an image, and a touch sensor that detects a touch operation on the display unit. An information processing apparatus including the above-described input method is executed.

  According to the present invention, in an information processing apparatus having a touch sensor that detects a touch operation and a hover operation, the user can easily select an icon from the hover state while taking advantage of the detection accuracy of the touch sensor.

It is a functional block diagram which shows the example of 1 structure of the information processing apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart for demonstrating an example of the pen input method in the information processing apparatus of FIG. It is the schematic for demonstrating an example of the pen input method of FIG. It is the schematic for demonstrating an example of the pen input method of FIG. It is a flowchart for demonstrating the other example of the pen input method in the information processing apparatus of FIG. It is the schematic for demonstrating an example of the pen input method of FIG. It is a flowchart for demonstrating the other example of the pen input method in the information processing apparatus of FIG. It is the schematic for demonstrating an example of the pen input method of FIG. It is the schematic for demonstrating an example of the pen input method of FIG. It is the schematic for demonstrating the other example of the pen input method of FIG. It is the schematic for demonstrating an example of the positional relationship of the recognition area and icon in the pen input method of FIG. It is the schematic for demonstrating the other example of the positional relationship of the recognition area and icon in the pen input method of FIG. It is the schematic for demonstrating the other example of the positional relationship of the recognition area and icon in the pen input method of FIG.

  An information processing apparatus according to the present invention includes a display unit, a touch sensor, and a control unit. The information processing apparatus according to the present invention may be an apparatus configured with one casing, or may be an apparatus in which the display unit and the touch sensor are configured with a main body (control unit side) and a separate casing. Good. Examples of the information processing apparatus according to the present invention include a stationary PC (Personal Computer), a mobile PC, a tablet-type terminal device (hereinafter referred to as a tablet terminal), a mobile phone (including a so-called smartphone), and the like.

(First embodiment)
A first embodiment of the present invention will be described with reference to FIGS. 1 to 3B. FIG. 1 is a block diagram illustrating a configuration example of the information processing apparatus according to the present embodiment. The information processing apparatus 1 according to the present embodiment includes a control unit 10 that controls the entire device, a touch sensor 12, and a display unit 13 that displays an image. The display unit 13 includes a display panel that displays an image. Examples of the display panel include various display panels such as a liquid crystal display and an organic electroluminescence display.

  In addition, the information processing apparatus 1 exemplified here includes a storage unit 11 that stores an image file to be displayed, and a communication unit 14 for acquiring the image file to be displayed from an external device such as a server device. I have. Examples of the communication unit 14 include an interface for communicating with an external device via a wired LAN (Local Area Network) router. Of course, the interface is not limited to this router, and may be an interface that communicates via a base station of a mobile communication system, an access point of a wireless LAN, or the like.

  The information processing apparatus 1 also includes a power key and a hardware key (volume adjustment key, etc.) other than the power key, a keyboard, a pointing device such as a mouse, a joystick, a touch pad, and a trackball in order to accept a user operation. Any one or more of a keyboard and the like may be provided.

  Hereinafter, the control unit 10 and the touch sensor 12 which are main components of the present invention will be described in detail. The control unit 10 operates the control program stored in the program storage area and performs various controls. For example, the control unit 10 includes a central processing unit (CPU) or a micro processing unit (MPU), a RAM (Random Access Memory) as a work area, and a control device such as a storage device. / It can also be mounted as an IC chip set. The storage device stores various control contents including the control program (including a program for executing processing according to the present invention). Examples of the storage device include a flash ROM (Read Only Memory) and an EEPROM (Electrically Erasable and Programmable ROM). Further, the storage unit 11 can be adopted as the storage device.

  The touch sensor 12 is a sensor that detects a touch operation and a hover operation on the display area (all display areas) of the display unit 13, and may be a sensor that supports only a single touch or a sensor that supports multi-touch. Good.

  Here, the hover operation refers to an operation corresponding to an operation for aligning the cursor with a specific element by a pointing device, and an operation to bring the touch sensor 12 into a state before the touch operation (a hover state with the operation subject floating). Point to. The hover state refers to a state where the operating subject is not more than a predetermined distance from the display screen and the operating subject is not in contact with the display screen, that is, a state where the operating subject is brought close.

  As the touch sensor 12, various types of sensors such as a surface type or projection type electrostatic capacity method, an electromagnetic induction method, an infrared method, a surface acoustic wave method, and a resistive film method can be applied. In addition, the detection unit for detecting the hover operation can be provided by a detection method different from the detection method of the touch operation. Note that the touch sensor 12 is often provided as a panel so as to overlap the surface of the display unit (display panel) 13, and is also called a touch panel alone or in combination with the display panel.

  When the touch sensor 12 detects a touch operation or a hover operation, the touch sensor 12 passes information (input coordinate information) specifying the detection position to the control unit 10. Alternatively, the control unit 10 monitors input of a touch operation or a hover operation on the touch sensor 12 by polling processing or the like, and obtains input coordinate information when detected.

  The touch sensor 12 may accept any of a touch operation and a hover operation among a user's finger operation, a stylus pen operation, and a pen input device operation. However, a mode for accepting an operation on the pen input device (referred to as a pen input mode) and a mode for accepting an operation other than that (referred to as a normal touch input mode) are prepared. It is preferable that the mode can be switched based on the configuration, or the proximity of the pen input device is detected and the mode is switched to the pen input mode. Further, the touch operation may be accepted in both modes, but the hover operation may be accepted only in the pen input mode.

  The pen input device will be described with an example in which the touch sensor 12 detects a touch operation or a hover operation (proximity operation) by the pen input device by an electromagnetic induction method. A pen input device 2 illustrated in FIG. 1 includes a pen signal generation unit 21 and a button 22 together with a control unit 20 that controls the whole.

  The pen signal generation unit 21 includes a coil and outputs a predetermined electromagnetic wave as a pen signal based on control from the control unit 20. In general, the control unit 20 performs control such that a pen signal is constantly transmitted. When the pen input device 2 is close to the touch sensor 12 (that is, close to the display unit 13), the coil on the touch sensor 12 side detects the pen signal. When a pen signal is detected, the pen signal generator 21 can detect it.

  The control unit 20 includes a timer, and when there is no proximity to the touch sensor 12 for a certain period (for example, 1 minute), the control unit 20 shifts to the sleep mode and stops the generation of the pen signal. The return from the sleep mode is generally performed by tapping the pen tip of the pen input device 2 or pressing the provided button 22.

  The button 22 is used for assignment of a predetermined operation such as a click operation, for example. When the button 22 is pressed, an electromagnetic wave modulated according to the operation is output from the pen signal generation unit 21. In addition, when the button 22 is pressed, a configuration in which a signal indicating the pressing is transmitted to the information processing apparatus 1 side by a separately provided wireless communication unit or a wired communication unit and a connection cable may be employed.

  Although the description is based on the premise of the active method, a passive method such as a penable technology method can also be adopted. In the case of the passive method, the pen input device 2 side does not require a power source, and power is supplied from the coil on the touch sensor 12 side to the pen signal generation unit 21 by electromagnetic induction, and the coil in the pen signal generation unit 21 receives the power. Outputs the predetermined electromagnetic wave, and the touch sensor 12 detects it.

  When the hover operation is detected by the touch sensor 12 as described above, the control unit 10 performs control to display a hover mark at a position on the display area of the display unit 13 corresponding to the detection position indicated by the input coordinate information. Do. This hover mark is a pointer indicating the position of the hover operation. In addition to displaying a hover mark, other processing such as displaying detailed information of an object included in a circle having a radius of a predetermined distance with the hover coordinate at the center may be executed together.

  In addition, when a touch operation is detected, the control unit 10 selects an image such as an icon at a position on the display area of the display unit 13 corresponding to the detection position indicated by the input coordinate information. Processing according to the display is performed. The icon is arranged, for example, in the image of the basic screen of the OS, and an application or file associated with the icon can be opened by performing an operation of selecting the icon.

  As a main feature of the present embodiment, when a hover operation is detected on the icon displayed in the display area, the control unit 10 changes the display size of the hover mark according to the size of the icon. Change control is performed on the display unit 13. That is, the display unit 13 displays the hover mark in a state where the size is appropriately changed according to the size of the icon at the position. Note that the size of the icon itself is known for each icon, and the selection area of each icon is actually defined by coordinates in order to enable selection of the icon.

  Next, the input method of the present embodiment using the pen input device 2 will be described with reference to FIGS. FIG. 2 is a flowchart for explaining an example of the pen input method in the information processing apparatus 1, and FIGS. 3A and 3B are schematic diagrams for explaining an example of the pen input method of FIG.

  First, the control unit 10 determines whether or not the touch sensor 12 has received a pen signal (step S1), and waits until it is received (until YES). When the pen signal is received, the control unit 10 obtains input coordinate information indicating the detection position of the pen signal, and further displays a hover mark at a display position corresponding to the detection position on the display unit 13. The display unit 13 executes the display (step S2). When the touch sensor 12 detects a touch operation, a touch signal indicating the touch operation is transmitted to the control unit 10, and the control unit 10 performs a process corresponding to the touch signal (a process different from when only the pen signal is received). Will do.

  Next, the control unit 10 determines whether the displayed hover mark is on the icon, the coordinates of the selected area of each icon being displayed and the display coordinates of the hover mark (that is, the coordinates of the detection position indicated by the input coordinate information). ) To determine (step S3). If NO in step S3, the process is terminated as it is.

  On the other hand, in the case of YES in step S3, the control unit 10 detects the size of the icon that overlaps the display of the hover mark by calculating the size from the coordinates of the selected area (step S4). Thereafter, the control unit 10 determines the display size of the hover mark so as to match the size of the icon, and instructs the display unit 13 to make the display size, and the display unit 13 makes such a display change (that is, display). Size correction) is performed (step S5), and the process is terminated.

  As an example, a case will be described in which a file management application window 31 is displayed on the display unit 13 as shown in FIG. 3A, a plurality of icons indicating folders are displayed therein, and one of the icons is hovered.

  First, when the user brings the pen input device 2 close to a certain position in the display area of the display unit 13, a pen signal is detected at that position and the hover mark 30a is displayed as illustrated in FIG. 3A. When detecting the hover operation, the distance (distance in the direction perpendicular to the display screen) between the display screen and the pen tip of the pen input device 2 that is the operation subject may also be detected. The hover mark 30a may be increased as the hover distance) increases.

  When the user moves the pen input device 2 from the state of FIG. 3A and moves the hover mark 30a to the “video” icon display area (icon selection area) 32, the icon selection area 32 as shown in FIG. 3B. Is changed to a hover mark 30b having a display size suitable for. Note that the range of the icon selection area 32 varies depending on the OS and application, and the portion where the icon is displayed is not necessarily the selection area. For example, not only the “video” icon in FIG. A character string such as “system folder” and a space between them may be recognized as an icon selection region.

  Here, an example was given in which the control unit 10 changed the display size of the hover mark 30b to match the vertical and horizontal lengths of the icon (icon selection area 32) as the change control. However, the hover mark 30b does not have to be completely the same in length and width as the icon selection area 32. For example, the display size may be 90% of the icon selection area 32. Furthermore, the hover mark 30b may be matched only with the length in the vertical direction of the icon selection area 32, for example, the display size may be 100% vertical and 70% horizontal, or 90% vertical and the original display size. Similarly, according to only the length in the horizontal direction, for example, the display size may be 70% vertical and 100% horizontal, or 90% horizontal and the original display size in the vertical direction.

  Of course, the control unit 10 determines the display size of the hover mark to match the size of the icon in step S5 without going through the process of step S2, and causes the display unit 13 to display the hover mark at the display size. You may instruct. For example, when the user suddenly performs a hover operation on the icon selection area 32, the hover mark 30b corresponding to the size of the icon selection area 32 may be displayed without displaying the hover mark 30a.

  Moreover, it can be said that it is particularly preferable to make the hover mark semi-transparent by α blending with an icon image as a background because the display size of the hover mark is changed. In addition, when the display size of the hover mark is less than the predetermined size, the hover mark may be displayed as it is, and when the hover mark exceeds the predetermined size, it may be made translucent. Further, not only the display size of the hover mark but also the design may be changed according to the size of the icon (for example, the aspect ratio). Thereby, the display unit 13 can display a hover mark having a design that matches a vertically long icon or a design that matches a horizontally long icon.

  As described above, according to the present embodiment, by changing the display size of the hover mark in this way, the icon is displayed from the hover state to the user after the hover mark is displayed small by taking advantage of the detection accuracy of the touch sensor 12. It becomes easy to select. In addition, when the user selects an icon by a touch operation from such a display change state, the color of the icon selection area may be reversed.

  Although a specific example is given only for the case where the pen input device 2 is used, the above-described change control at the time of hover operation can be applied in the same manner when inputting with the user's finger or stylus pen. However, when the hover operation is accepted in both the pen input mode and the normal touch input mode, the change control as described above may be executed only in the pen input mode. This is because it is assumed that an icon that can be selected with a finger is being selected. At this time, since the detection area of the hover operation with the finger is assumed to be wide, when the hover operation with the finger is detected, a hover mark that matches the detection area may be displayed.

(Second Embodiment)
A second embodiment of the present invention will be described with reference to FIGS. 4 and 5 together. 4 is a flowchart for explaining another example of the pen input method in the information processing apparatus 1, and FIG. 5 is a schematic diagram for explaining an example of the pen input method of FIG. Although the present embodiment will be described with a focus on differences from the first embodiment, various application examples described in the first embodiment can be similarly applied.

  The information processing apparatus 1 according to the present embodiment has a function in which the touch sensor 12 detects a touch operation and a hover operation performed by a pen input device. That is, in this embodiment, a pen input device such as the pen input device 2 illustrated in FIG. 1 is required. However, it is assumed that the pen input device has a button (hereinafter referred to as a first button) that receives an operation (change release operation) for canceling the change control. As the first button, the button 22 can be applied. However, when the pressing of the button 22 is assigned to another operation, the change canceling operation can be accepted by long-pressing the button 22 or continuously pressing the button 22 twice. That's fine.

  The input method of this embodiment is demonstrated along FIG. Also in this input method, the same processing as the processing in steps S1, S2, S3, S4, and S5 in FIG. 2 is performed (steps S11, S12, S13, S15, and S16). It is determined whether or not the first button (change release button) has not been pressed (step S14).

  In the case of NO in step S14, the processing is ended as it is, and as a result, as shown in FIG. 5, the hover mark 50 having the same display size as the hover mark 30a in FIG. 3A is displayed. On the other hand, if YES in step S14, the process proceeds to steps S15 and S16 to correct the hover mark, and as a result, the hover mark 30a in FIG. 3A is changed to the hover mark 30b in FIG. 3B. .

  Moreover, the determination process of step S14 can also be applied after step S16. At that time, the state where the hover mark 30b of FIG. 3B is displayed continues without the first button being pressed, and the state where the hover mark 30b of FIG. 3B is displayed when the first button is pressed is shown in FIG. The mark 50 is changed to the displayed state.

  As described above, in the information processing apparatus 1 according to the present embodiment, in addition to the effects of the first embodiment, the change control can be canceled, so that it is possible to display according to the user's preference.

(Third embodiment)
A third embodiment of the present invention will be described with reference to FIGS. Although the present embodiment will be described with a focus on differences from the first and second embodiments, various application examples described in the first and second embodiments can be similarly applied.

  In the information processing apparatus 1 according to the present embodiment, the control unit 10 performs the following movement control on the display unit 13. The movement control refers to control for moving the hover mark onto the icon when the detection position of the hover operation is not on the icon and the detection position and the icon satisfy a predetermined proximity condition.

  Moreover, it is preferable that the information processing apparatus 1 in this embodiment has a function in which the touch sensor 12 detects a touch operation and a hover operation performed by a pen input device. However, it is assumed that the pen input device has a button (hereinafter referred to as a second button) that receives an operation (movement cancellation operation) for canceling the movement control. In this case, a pen input device such as the pen input device 2 illustrated in FIG. 1 is required. Thereby, since the movement control can also be canceled, a display suitable for the user's preference can be performed.

  As the second button, the button 22 can be applied, but when the pressing of the button 22 is assigned to another operation, the movement canceling operation can be accepted by long-pressing the button 22 or continuously pressing the button 22 twice. That's fine. The second button may also serve as the first button, and the operation thereof may be the same. Of course, the second button may be provided separately from the first button, or the operation method (for example, the former is continuously pressed twice and the latter is long-pressed) may be different. Furthermore, the change canceling operation may be accepted by the first long press, and the movement canceling operation may be accepted by the second long press, or the order of accepting the first time and the second time may be switched.

  Next, the input method of the present embodiment using the pen input device 2 will be described with reference to FIGS. FIG. 6 is a flowchart for explaining another example of the pen input method in the information processing apparatus 1 of FIG. 7A and 7B are schematic diagrams for explaining an example of the pen input method of FIG. 6, and FIG. 7C is a schematic diagram for explaining another example of the pen input method of FIG. FIG. 8A is a schematic diagram for explaining an example of a positional relationship between a recognition area and an icon in the pen input method of FIG.

  First, similarly to steps S1 and S2 of FIG. 2, the control unit 10 waits for reception of a pen signal (step S21), and displays the hover mark 70a as illustrated in FIG. 7A (step S22).

  Next, the control unit 10 determines whether or not an icon exists in the recognition area (area of a predetermined range) 71 of the hover mark 70a based on the coordinates of the icon selection area (step S23). End the process. In step S23, as the predetermined proximity condition, at least a part of the icon is displayed (included) in the area 71 of the predetermined range including the detection position, and it is determined whether or not this condition is satisfied. Yes.

  The region 71 in the predetermined range is a rectangle having a vertical side with a predetermined length centered on the hover mark 70a and a horizontal side with the same or different predetermined length. However, the region of the predetermined range is not limited to this, and may be circular. For example, as shown in FIG. 8A, it may be determined by a distance from the center, for example, a circle 82 having a radius r centering on a hover position (position for displaying a hover mark) 81a is defined as an area of the predetermined range. In the example of FIG. 8A, since there is an area 83a that overlaps the icon selection area 80 in the circle 82, it is determined that the predetermined proximity condition is satisfied.

  In the case of YES in step S23, the control unit 10 determines whether or not there are a plurality of icons (icon selection regions) in the recognition area 71 (step S24). If it does not exist (NO in step S24), it is determined whether or not the second button (movement release button) has not been pressed (step S26).

  In the case of NO in step S26, the processing is ended as it is, and as a result, the hover mark 70a in FIG. 7A remains displayed. On the other hand, if YES in step S26, the hover mark is corrected to the position of the target icon (step S27), and the process ends. As a result of the automatic guidance of the hover mark 70a as in step S27, as shown in FIG. 7B, the position of the icon (preferably the center position of the icon selection area 72) is maintained even though the position of the pen input device 2 does not change. ) Displays a hover mark 70b. 8A, the hover mark 84a is displayed at the position of the icon selection area 80.

  As described above, when at least a part of the icon is included in the recognition area including the position (detection position) where the hover operation is detected (preferably centered on this position), the control unit 10 displays the hover mark as the hover mark. Move control to move over the icon. If an icon is present at the detection position, it may be moved to the center of the icon (for example, the center of gravity or the center ordinate in the vertical direction and the center abscissa in the horizontal direction). Of course, when the hover detection position exists at the center of the icon, the movement is not necessary.

  On the other hand, in the case of YES in step S24, the control unit 10 calculates (detects) the icon of the largest size among the plurality of icons from the coordinates of the icon selection area, and sets it as the target icon (step S25). Instead of step S25, an icon having the largest overlapping area with the recognition area may be detected as a target icon, or automatic guidance on the icon is not performed (that is, no target icon is provided). May be. After the process of step S25, the process proceeds to step S26, and in the case of YES in step S26, the control unit 10 corrects the hover mark to the position of the target icon in step S25 (step S27) and ends the process.

  Moreover, the determination process of step S26 can also be applied after step S27. At this time, if the second button is not pressed, the state where the hover mark 70b of FIG. 7B is displayed continues, and when the second button is pressed, the state returns to the state where the hover mark 70a of FIG. 7A is displayed. . In the present embodiment, the second button is not essential, and when the second button is not provided, the process of step S26 in FIG. 6 may be omitted.

  Of course, the control unit 10 may instruct the display unit 13 to display the hover mark at the position of the icon in step S27 without passing through the process of step S22. For example, when the user suddenly performs a hover operation on the icon selection area 72, the hover mark 70b may be displayed at the position of the icon selection area 72 without displaying the hover mark 70a.

  Next, another example of the positional relationship between the recognition area and the icon will be described with reference to FIGS. 8B and 8C. 8B and 8C are schematic diagrams for explaining another example of the positional relationship between the recognition area and the icon in the pen input method of FIG.

  The predetermined proximity condition may include the presence of the detection position 81 in a predetermined area 85 including an icon (icon selection area 80) as shown in FIG. 8B. The area 85 of the predetermined range indicates an icon proximity area including an icon. The icon proximity area 85 is vertically expanded by a predetermined length h with respect to the height (vertical length) H of the icon selection area 80, and with respect to the width (horizontal length) W of the icon selection area 80. The area is widened to the left and right by the same or different predetermined length w. However, the definition of the icon proximity region is not limited to this.

  Thus, even when a hover operation is detected on the icon proximity area 85, the control unit 10 moves the hover mark above the icon (position of the icon selection area 80) and displays the hover mark 84b. You may be in the state made to do.

  A case will be described in which the case where the predetermined proximity condition includes a case where at least a part of an icon is displayed in a predetermined range including the detection position is also used. In this case, as illustrated in FIG. 8C, if an area 83 c that overlaps the icon proximity area 85 exists in the circle 82, it is determined that the predetermined proximity condition is satisfied, and the hover mark 84 c is placed at the position of the icon selection area 80. Display it.

  As described above, in the information processing apparatus 1 according to the present embodiment, by moving the display position of the hover mark onto the icon in this way, the detection accuracy of the touch sensor 12 is utilized to display the hover mark small. In addition, the user can easily select an icon from the hover state.

  Further, the above movement control at the time of hover operation can be similarly applied when inputting with a user's finger or stylus pen without using a pen input device. However, when the hover operation is accepted in both the pen input mode and the normal touch input mode, the movement control as described above may be executed only in the pen input mode. This is because it is assumed that an icon that can be selected with a finger is being selected. At this time, since the detection area of the hover operation with the finger is assumed to be wide, when the hover operation with the finger is detected, a hover mark that matches the detection area may be displayed.

  In the processing example of FIG. 6, the movement control can also be applied to an information processing apparatus to which the change control is not applied, as was not described for the combination with the first or second embodiment.

The case where this embodiment is combined with the first or second embodiment will be briefly described.
As an example of the combination, after the processing in step S27 in FIG. 6 (after the hover mark 70b has moved to the icon selection area 72), the processing in steps S4 and S5 in FIG. 2 or the processing in steps S14 to 16 in FIG. The hover mark 70c suitable for the icon size as shown in FIG. 7C may be displayed. Thereby, in addition to the effects of the first and second embodiments, the user can more easily select an icon from the hover state.

  As another combination example, prior to the determination in step S23 in FIG. 6, the determination in step S3 in FIG. 2 or step S13 in FIG. 4 is performed, and if YES in step S3 or step S13, the processing in steps S4 and S5 or Steps S14 to S16 may be executed, and then the process may proceed to step S23.

(Other)
The information processing apparatus according to the present invention has been described above. However, as described in the flow of processing, the present invention includes a display unit that displays an image, and a touch operation and a hover operation on the display area of the display unit. An input method in an information processing apparatus including a touch sensor to be detected and a form as a program for causing a computer (information processing apparatus) to execute the input method may be employed.

  As described in the first embodiment, one of the input methods (referred to as a first input method) includes a detection step in which the touch sensor detects the hover operation, and a control unit of the information processing apparatus. A display control step for performing control to display a hover mark at a position on the display area corresponding to the position detected in the detection step. The display control step is a step of changing the display size of the hover mark according to the size of the icon when the hover operation is detected on the icon displayed in the display area in the detection step. Have Other application examples are the same as those described in the first to third embodiments for the information processing apparatus, and a description thereof will be omitted.

In other words, the program (referred to as a first program) is a program for causing a computer including the display unit and the touch sensor to execute the first input method. That is, the first program causes the computer to display a hover mark at a position on the display area corresponding to the position detected at the detection step and the position detected at the detection step. And a display control step for executing the program. The display control step is a step of changing the display size of the hover mark according to the size of the icon when the hover operation is detected on the icon displayed in the display area in the detection step. Have Other application examples are the same as those described in the first to third embodiments for the information processing apparatus, and a description thereof will be omitted.

  As described in the third embodiment, another input method in the information processing apparatus (referred to as a second input method) includes a detection step in which the touch sensor detects the hover operation, and a control unit of the information processing apparatus. Includes a display control step for performing control to display a hover mark at a position on the display area corresponding to the position detected in the detection step. In the display control step, when the detection position of the hover operation detected in the detection step is not on the icon and the detection position and the icon satisfy a predetermined proximity condition, the hover mark is displayed on the icon. Moving it over. Other application examples are the same as those described for the information processing apparatus, and a description thereof will be omitted.

  In other words, the program (hereinafter referred to as the second program) is a program for causing the computer including the display unit and the touch sensor to execute the second input method. That is, the second program causes the computer to display a hover mark at a position on the display area corresponding to the position detected at the detection step and the position detected at the detection step. And a display control step for executing the program. In the display control step, when the detection position of the hover operation detected in the detection step is not on the icon and the detection position and the icon satisfy a predetermined proximity condition, the hover mark is displayed on the icon. Moving it over. Other application examples are the same as those described in the third embodiment for the information processing apparatus, and a description thereof will be omitted.

  Further, it is possible to easily understand the form as a program recording medium in which the first program and / or the second program is recorded on a non-transitory recording medium readable by a computer. The computer is not limited to a general-purpose PC, and various types of computers such as a microcomputer and a programmable general-purpose integrated circuit / chip set can be applied. In addition, this program is not limited to be distributed via a portable recording medium, but can also be distributed via a network such as the Internet or via a broadcast wave. Receiving via a network refers to receiving a program recorded in a storage device of an external server.

DESCRIPTION OF SYMBOLS 1 ... Information processing apparatus, 2 ... Pen input device, 10 ... Control part of information processing apparatus, 11 ... Memory | storage part, 12 ... Touch sensor, 13 ... Display part, 14 ... Communication part, 20 ... Control part of pen input device, 21 ... Pen signal generator, 22 ... button, 30a, 30b, 50, 70a, 70b, 70c, 84a, 84b, 84c ... hover mark, 31 ... window, 32 ... icon selection area, 71 ... recognition area, 72,80 ... Icon selection area, 81 ... Detection position, 82 ... Circle, 83a, 83c ... Overlapping area, 85 ... Icon proximity area.

Claims (8)

An information processing apparatus comprising: a display unit that displays an image; and a touch sensor that detects a touch operation and a hover operation on a display area of the display unit,
A control unit that performs control to display a hover mark at a position on the display area corresponding to the detected position when the hover operation is detected by the touch sensor;
The control unit performs change control to change a display size of the hover mark according to a size of the icon when the hover operation is detected on the icon displayed in the display area. Information processing apparatus.   The information processing apparatus according to claim 1, wherein the control unit changes the display size of the hover mark so as to match the vertical and / or horizontal length of the icon as the change control. .   The control unit performs movement control to move the hover mark onto the icon when the detection position of the hover operation is other than on the icon and the detection position and the icon satisfy a predetermined proximity condition. The information processing apparatus according to claim 1 or 2.   The information processing apparatus according to claim 3, wherein the predetermined proximity condition includes that at least a part of the icon is displayed in an area of a predetermined range including the detection position.   5. The information processing apparatus according to claim 3, wherein the predetermined proximity condition includes the presence of the detection position in an area of a predetermined range including the icon.   The touch sensor has a function of detecting the touch operation and the hover operation performed by a pen input device having a button for receiving an operation for canceling the movement control. The information processing apparatus according to claim 1.   The touch sensor has a function of detecting the touch operation and the hover operation performed by a pen input device having a button for receiving an operation for canceling the change control. The information processing apparatus according to claim 1. An input method in an information processing apparatus including a display unit that displays an image and a touch sensor that detects a touch operation and a hover operation on a display area of the display unit,
A detection step in which the touch sensor detects the hover operation;
A display control step in which a control unit of the information processing apparatus performs control to display a hover mark at a position on the display area corresponding to the position detected in the detection step;
Have
The display control step includes a step of changing a display size of the hover mark according to a size of the icon when the hover operation is detected on the icon displayed in the display area in the detection step. An input method characterized by that.