JP2013206350A - Information processor, and method for correcting input place in the information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processor for enabling an intuitive operation input by making a place designated by an operation body coincide with a place that a user actually wants to designate.SOLUTION: An information processor 10 being a device that can receive an operation input by a finger F to a touch panel 12a includes a contact area extraction part 22 for extracting a contact area TA by the finger F to the touch panel 12a, a shadow area extraction part 24 for extracting an area connecting to the contact area TA extracted by the contact area extraction part 22 and being a shadow area SA formed on the touch panel 12a by the finger F, an extension direction calculation part 26 for calculating an extension direction of the shadow area SA extracted by the shadow area extraction part 24 with the contact area TA extracted by the contact area extraction part 22 as reference, and an input place correction part 28 for correcting an end point AP of the shadow area SA in a direction opposite from the extension direction calculated by the extension direction calculation part 26 as an input place by the finger F.

Description

  The present invention relates to an information processing apparatus and an input location correction method in the information processing apparatus.

  There is known an information processing apparatus in which a touch panel is superimposed on a display and a predetermined operation input can be performed with an operation body such as a finger (for example, Patent Document 1). In such an information processing apparatus, it is possible to perform a predetermined operation input via the touch panel, but the display position on the display and the input position on the touch panel corresponding to the display position may overlap, and visibility may be impaired. there were. Therefore, various techniques that can perform appropriate screen layout by changing and adjusting the display position of the display have been studied (for example, see Patent Document 2).

JP 2010-182071 A JP 09-042992 A

  By the way, the conventional technique is based on the premise that the input process is performed using the position where the operating body such as a finger actually contacts the touch panel as an input location. For this reason, for example, when drawing software or the like is used in such an information processing device, it is necessary to operate the finger with the abdomen (contact part) of the finger as a pen. The location that the user wanted to specify did not always match. In other words, it has been found that when the user usually draws a picture or the like with the above-described device, the fingertip or the tip of the nail is not the belly portion of the finger, but the portion that the user actually wants to input. However, the prior art has not been able to sufficiently meet such a demand. In addition to the drawing software, there is also a problem that when the operation is performed on the abdomen of the finger, the contact point with the touch panel is hidden by the finger, so that the place where characters are input cannot be sufficiently confirmed.

  Therefore, in the present invention, an information processing apparatus capable of intuitive operation input by matching a place designated by the operating body with a place actually designated by the user, and a method of correcting the input place in the information processing apparatus are provided. The purpose is to provide.

  The information processing apparatus according to the present invention is an information processing apparatus that can accept an operation input to a touch panel by an operating tool. The information processing apparatus includes a contact area extracting unit that extracts a contact area on the touch panel by an operating body, and a shadow that is formed on the touch panel by the operating body, the area being connected to the contact area extracted by the contact area extracting unit. A shadow area extracting means for extracting an area; an extension direction calculating means for calculating an extension direction of the shadow area extracted by the shadow area extracting means on the basis of the contact area extracted by the contact area extracting means; It is characterized by comprising an input location by the operating body and an input location correction means for correcting the end of the shadow area in the direction opposite to the extending direction calculated by the direction calculation means.

  The correction method according to the present invention is a method for correcting an input location in an information processing apparatus that can accept an operation input to a touch panel by an operating tool. This correction method includes a contact area extraction step for extracting a contact area to the touch panel by the operating body, and a shadow area formed on the touch panel by the operating body, the area being connected to the contact area extracted in the contact area extracting step. A shadow area extracting step for extracting the shadow area, an extension direction calculating step for calculating the extending direction of the shadow area extracted in the shadow area extracting step based on the contact area extracted in the contact area extracting step, and an extending direction It is characterized by comprising an input location correction step for correcting an input location by an operating body and an end location of a shadow region in a direction opposite to the extending direction calculated in the calculation step.

  According to the information processing apparatus or the correction method, not only the contact area by the operating body but also the shadow area is extracted, and the extension direction of the extracted shadow area is calculated on the basis of the extracted contact area. And the edge part of the shadow area | region in the direction opposite to the calculated extending direction is correct | amended with the input location by an operating body. In this case, for example, if the operating body is a finger, a part corresponding to a part such as a fingertip or a toe that is naturally used when the user points to a part that the user actually wants to specify is corrected as an input part. As a result, the location specified by the operating tool matches the location that the user actually wants to specify, thereby enabling intuitive operation input.

  In the information processing apparatus, it is preferable that the extension direction calculation unit calculates the extension direction of the shadow region extracted by the shadow region extraction unit with reference to the center of the contact region. In the information processing apparatus, the extension direction calculating unit extracts the first and second directions in which the shadow region extracted by the shadow region extracting unit extends and compares the first and second directions, The long direction may be calculated as the extending direction. In these cases, the input location can be more accurately corrected to the location that the user actually wants to specify.

  According to the present invention, there is provided an information processing device capable of intuitive operation input by matching a location designated by an operating tool with a location actually desired by a user, and a method for correcting an input location in the information processing device. Can be provided.

It is a figure which shows the state which the finger is contacting the touch panel, (a) is the top view, (b) is a figure which shows typically the contact area and shadow area | region at that time. It is a block diagram which shows the function structure of the information processing apparatus which concerns on this embodiment. It is a figure which shows the hardware constitutions of the information processing apparatus shown in FIG. It is a flowchart at the time of correct | amending an input location with the information processing apparatus shown in FIG. It is a block diagram which shows the function structure of the modification of the information processing apparatus which concerns on this embodiment. It is a flowchart at the time of correct | amending an input location with the information processing apparatus shown in FIG. It is a figure which shows typically correction | amendment of the input location at the time of raising a finger.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. In the description of the drawings, if possible, the same elements are denoted by the same reference numerals, and redundant description is omitted.

  As illustrated in FIG. 1A, the information processing apparatus 10 according to the present embodiment is an apparatus that can input an operation to the touch panel display 12 using an operation body such as a finger F. Examples of the information processing apparatus 10 include a mobile terminal such as a smartphone and a small personal computer. However, the information processing apparatus 10 is not limited thereto, and the present invention is applied to any information processing apparatus including a touch panel display. It is possible.

  As shown in FIG. 2, the information processing apparatus 10 functionally includes a contact determination unit 20, a contact region extraction unit 22 (contact region extraction unit), a shadow region extraction unit 24 (shadow region extraction unit), and an extension. A direction calculation unit 26 (extension direction calculation unit), an input location correction unit 28 (input location correction unit), and a display unit 30 are provided.

  Here, as shown in FIG. 3, the information processing apparatus 10 physically includes a CPU 10a, a RAM 10b, a ROM 10c, an input device 10d, an output device 10e, a communication device 10f, and a recording device 10g. The hardware is connected to the bus 10h. The CPU 10a loads predetermined computer software (including a computer program for executing processing performed by the information processing apparatus 10 shown in FIGS. 4 and 6) stored in a built-in memory such as the ROM 10c or the recording apparatus 10g into the RAM 10b. In this way, the information processing apparatus 10 is controlled in an integrated manner.

  The input device 10d is an input device including the touch panel 12a and the like provided in the information processing apparatus 10, and outputs data input via the touch panel 12a to the CPU 10a. The touch panel 12a used here is, for example, an optical touch panel (for example, “System liquid crystal with built-in optical sensor” manufactured by Sharp Corporation, August 31, 2007, [March 16, 2012 search], Internet (URL: http: http://news.mynavi.jp/news/2007/08/31/022/index.html) and Japanese Patent Application Laid-Open No. 2010-182071) on the touch panel 12a by the finger as well as the contact position by the finger. The touch panel is also capable of detecting a shadow area SA (see FIG. 1B). The output device 10e is a display screen made up of an LCD, for example, and displays image information and the like output from the CPU 10a. The touch panel 12a of the input device 10d and the display screen of the output device 10e are stacked one above the other so that their input / output points correspond to each other to constitute the touch panel display 12.

  The communication device 10f has an interface for performing data communication via a communication network or the like. The recording device 10g stores computer software executable by the CPU 10a. Each function to be described later is a function realized by the CPU 10a executing computer software stored in the ROM 10c or the recording device 10g and operating each component of the information processing apparatus 10 shown in FIG. Hereinafter, returning to FIG. 2, each functional block of the information processing apparatus 10 will be described.

  The contact determination unit 20 is a part that determines whether or not the finger F has touched the touch panel 12a. When the contact determination unit 20 determines that there is a contact with the finger F, the contact determination unit 20 outputs information indicating that there is a contact to the contact region extraction unit 22.

  The contact area extraction unit 22 is a part that extracts a contact area TA with the finger F to the touch panel 12a. When the information indicating that the finger F has been touched is input from the contact determination unit 20, the contact area extraction unit 22 uses the optical touch panel constituting the input device 10 d to touch the touch panel 12 a. Area TA is extracted (see FIG. 1B). The contact area extraction unit 22 also extracts information about the center TAc from the extracted information about the contact area TA. The extraction of these contact areas is a technique similar to the conventional technique, and details thereof are omitted. The contact area extraction unit 22 inputs the information of the contact area TA (position, area, etc.) and the information of the center TAc of the contact area TA extracted in this way, the shadow area extraction unit 24, the extension direction calculation unit 26, and the input. The data is output to the location correction unit 28.

  The shadow area extraction unit 24 is an area that is continuous with the contact area TA extracted by the contact area extraction unit 22 and extracts a shadow area SA formed on the touch panel 12a by the finger F. When the information on the contact area TA is input from the contact area extraction unit 22, the shadow area extraction unit 24 is an area connected to the contact area TA using the optical touch panel constituting the input device 10d, and the finger F To extract the shadow area SA formed on the touch panel 12a. Since the optical touch panel is used as the touch panel, the shadow area of the finger F formed on the touch panel 12a can be extracted although the finger F is not in contact. In the optical touch panel, since the contact area TA and the shadow area SA have different shades of the acquired image, the information of the two is distinguished using the shade difference data. The shadow area extraction unit 24 outputs information on the extracted shadow area SA to the extension direction calculation unit 26.

  The extension direction calculation unit 26 is a part that calculates the extension direction of the shadow area SA extracted by the shadow area extraction unit 24 based on the center TAc of the contact area TA extracted by the contact area extraction unit 22. When the information on the contact area TA and its center TAc is input from the contact area extraction unit 22 and the information on the shadow area SA is input from the shadow area extraction unit 24, the extending direction calculation unit 26 receives the information on the contact area TA. Using the center TAc as a reference, predetermined image processing is performed on the input image data for the first direction D1 and the second direction D2 in which the shadow region SA extracted by the shadow region extraction unit 24 spreads, calculate. Various conventional techniques can be appropriately used for these image processes.

  When calculating the first and second directions D1 and D2 in which the shadow area SA is widened, the extending direction calculation unit 26 compares the first and second directions D1 and D2 with each other and indicates the direction with the longer length. It is calculated as the extending direction. In the example shown in FIG. 1B, since the first direction D1 is long, the first direction D1 is calculated as the extending direction. The extension direction calculation unit 26 outputs information on the calculated extension direction and the like to the input location correction unit 28.

  The input location correction unit 28 determines the end point AP of the shadow area in the extension direction (first direction D1) calculated by the extension direction calculation unit 26 by 180 degrees and in the opposite direction (second direction D2). This is the portion to be corrected with the input portion by the finger F. The input location correction unit 28 receives information on the extending direction and the first and second directions D1 and D2 where the shadows extend from the extending direction calculating unit 26 and also outputs a contact area TA (center TAc) from the contact area extracting unit 22. When the shadow area SA information is input from the shadow area extraction unit 24, the end point AP of the shadow area SA in the direction opposite to the extending direction (second direction) is used as the shadow of the fingertip or toe. And the portion is corrected to the input position by the finger F. By this correction, the input location on the touch panel 12a is changed from the belly portion of the finger F to a location corresponding to a portion such as a fingertip or a toe. When the end point AP of the shadow area SA and the end point of the contact area TA in the second direction overlap, the end point of the contact area TA is set as a correction location.

  The display unit 30 is a part that displays a predetermined image on a display screen such as an LCD. For example, when drawing software is used, the display unit 30 performs a falsification process when an input is made to the portion where the above-described correction is performed, and predetermined information (a picture is configured in the portion). Display a line to display).

  Next, a method for correcting an input location in the information processing apparatus 10 having the above-described configuration will be described in detail with reference to FIG.

  First, the contact determination unit 20 determines whether or not the finger F has touched the touch panel 12a (step S1). If it is determined in step S1 that the finger F has touched the touch panel 12a, the process proceeds to step S2. On the other hand, when the finger F does not touch the touch panel 12a, the contact determination is repeated at a predetermined time interval.

  Subsequently, when the contact determination unit 20 determines that the finger F has touched, the measurement mode is disclosed (step S2), and the finger F touches the touch panel 12a using the optical touch panel constituting the input device 10d. The area TA is extracted by the contact area extraction unit 22 (step S3: contact area extraction step). In step S3, the contact area extraction unit 22 also extracts information on the center TAc from the extracted information on the contact area TA (contact area extraction step).

  Subsequently, when the contact area TA or the like is extracted by the contact area extraction unit 22, the process proceeds to step S <b> 4, and the area touching the contact area TA using the optical touch panel constituting the input device 10 d The shadow area SA formed on the touch panel 12a by F is extracted by the shadow area extraction unit 24 (shadow area extraction step). In this embodiment, since the optical touch panel is used as the touch panel, the shadow area of the finger F formed on the touch panel 12a can be extracted although the finger F is not in contact.

  Subsequently, when the contact area TA is extracted in step S3 or the shadow area SA is extracted in step S4, the process proceeds to step S5, and the extension direction calculation unit 26 uses the center TAc of the contact area TA as a reference. A first direction D1 and a second direction D2 in which the area SA extends are calculated. Then, when the first and second directions D1 and D2 in which the shadow area SA expands are calculated, the extension direction calculation unit 26 compares the first and second directions D1 and D2 with each other, and the length is calculated. The long direction is calculated as the extension direction of the finger (extension direction calculation step). In the example shown in FIG. 1B, since the first direction D1 is long, the first direction D1 is calculated as the extending direction.

  Subsequently, when the extending direction is calculated in step S5, the end point AP of the shadow area SA in the direction opposite to the extending direction (second direction) is the shadow of the fingertip or toe by the input location correction unit 28. And the portion is corrected as an input portion by the finger F. By this correction, the input location on the touch panel 12a is changed from the belly portion of the finger F to the location AP corresponding to a portion such as a fingertip or a toe (step S6: input location correction step). For example, when drawing software is used, a forgery process is performed in which an input is made at the location where the above-described correction is performed, and the display unit 30 displays predetermined information (picture) Etc.) are displayed.

  As described above, according to the information processing apparatus 10 according to the present embodiment, not only the contact area TA by the finger F but also the shadow area SA is extracted, and the extracted shadow area SA is extended based on the extracted contact area TA. The outgoing direction (first direction) is calculated. Then, the end point AP of the shadow area SA in the direction opposite to the calculated extending direction (second direction) is corrected as an input location by the finger F. For this reason, when the user points to a location that the user actually wants to specify, a portion AP corresponding to a location such as a fingertip or a toe that is naturally used is corrected as an input location. As a result, the location specified by the finger F matches the location that the user actually wants to specify, thereby enabling intuitive operation input.

  In the information processing apparatus 10, the extension direction calculation unit 26 uses the center TAc of the contact area TA as a reference, and the first and second directions D1, D2 in which the shadow area SA extracted by the shadow area extraction unit 24 spreads. And the lengths of the first and second directions D1 and D2 are compared, and the longer direction is calculated as the extending direction (first direction D1). For this reason, it becomes possible to correct | amend an input location more correctly to the location which a user wants to actually designate.

  As mentioned above, although this invention was concretely demonstrated based on the embodiment, this invention is not limited to the said embodiment. For example, as illustrated in FIG. 5, the information processing apparatus according to the above embodiment employs a configuration such as an information processing apparatus 40 that further includes a storage unit 42 that stores a correction value of the input location calculated by the input location correction unit 28. May be. In this case, as shown in FIG. 6, in addition to the various steps in the information processing apparatus 10 (see FIG. 4), the corrected value (changed value of position information) is stored in the storage unit 42 after the correction processing in step S <b> 6. The correction value stored in the storage unit 42 may be used continuously for a predetermined period (for example, 2 seconds). And you may make it repeat the process of step S1-step S7 at a predetermined timing (every 2 seconds) until input operation by a user is complete | finished (step S8). In the example shown in FIG. 1, the finger F is substantially sideways and the area overlapped with the touch panel display 12 is wide. However, as shown in FIG. 7, the finger F is almost standing. Even if it exists, it is possible to correct the input location to the location AP corresponding to the tip of the finger F.

  DESCRIPTION OF SYMBOLS 10 ... Information processing apparatus, 22 ... Contact area extraction part, 24 ... Shadow area extraction part, 26 ... Extension direction calculation part, 28 ... Input location correction part, SA ... Shadow area, TA ... Contact area, TAc ... Center.

Claims (4)

An information processing apparatus that can accept an operation input to a touch panel by an operating body,
Contact area extraction means for extracting a contact area to the touch panel by the operating body;
A shadow area extracting means for extracting a shadow area formed on the touch panel by the operating body, the area being connected to the contact area extracted by the contact area extracting means;
An extension direction calculating means for calculating an extension direction of the shadow area extracted by the shadow area extracting means with reference to the contact area extracted by the contact area extracting means;
An input location correction means for correcting an end portion of the shadow area in a direction opposite to the extension direction calculated by the extension direction calculation means with an input location by the operating body;
An information processing apparatus comprising:   2. The information processing according to claim 1, wherein the extension direction calculation unit calculates the extension direction of the shadow region extracted by the shadow region extraction unit with reference to the center of the contact region. apparatus.   The extension direction calculation means extracts the first and second directions in which the shadow area extracted by the shadow area extraction means expands, compares the first and second directions, and has a longer length. The information processing apparatus according to claim 1, wherein the information is calculated as the extending direction. A method of correcting an input location in an information processing apparatus that can accept an operation input to a touch panel by an operating body,
A contact area extracting step of extracting a contact area to the touch panel by the operating body;
A shadow region extraction step for extracting a shadow region formed on the touch panel by the operating body, the region being connected to the contact region extracted in the contact region extraction step;
An extension direction calculation step for calculating an extension direction of the shadow region extracted in the shadow region extraction step with reference to the contact region extracted in the contact region extraction step;
An input location correction step for correcting an end portion of the shadow region in the direction opposite to the extension direction calculated in the extension direction calculation step with an input location by the operating body;
A method for correcting an input location, comprising:

Images