JP2011034485A - Information terminal apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To align a display point on a display with an operation point detected on an input surface, in consideration of attitude, point of view and the like. <P>SOLUTION: An information terminal apparatus includes: a display 16 for displaying an image specified in a display coordinate system; a tablet 18 for detecting a point of operation on the displayed image in coordinate values specified in a detection coordinate system; a conversion part 122 for converting the detected coordinate values into the display coordinate system via a matrix (A+ΔA); a reference image rendering part 126 for displaying a reference line drawing on the display; a deviation calculation part 128 for calculating deviation of the coordinate values by the conversion part 122 from coordinate values constituting the line drawing when the line drawing is traced on the tablet 18; and a correction parameter updating part 130 for updating the matrix (A+ΔA) according to the calculated deviation. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an information terminal device that displays on a display body a position designated by an electronic pen or the like.

This type of information terminal device has a configuration in which an input surface such as a tablet or a touch panel is placed on a display body such as a liquid crystal display or electronic paper. In such a configuration, when an electronic pen, a finger or the like touches the input surface, coordinates indicating the designated point (operation point) are detected. For this reason, the locus | trajectory when the input surface is traced can be displayed on a display body etc. by lighting up the pixel corresponding to the detected coordinate sequentially.
Incidentally, the input surface and the display body have a certain thickness. In addition, depending on the electronic pen, there is a type in which the coordinates of the operation point differ depending on the inclination. For this reason, when the operation point by an electronic pen etc. is displayed on a display body, the display point may be visually recognized as shifted from the operation point.
Therefore, when an electronic pen or the like touches the touch panel, the position to be corrected is input, and the shift amount at that position is input by the cursor key, thereby calculating a correction parameter corresponding to the shift amount and correcting the correction. A technique for displaying an operating point on a display using a parameter is known (see Patent Document 1).

JP 2001-356879 A (paragraphs 0034-0043)

However, with this technique, after inputting the position to be corrected, the user is given the trouble of inputting the shift amount at the position using a cursor key or the like.
The present invention has been made in view of the above-described circumstances, and one of its purposes is to correct the display point so that it does not deviate from the operation point on the input surface without forcing the user to do so. The object is to provide a possible information terminal device.

  In order to achieve the above object, in the information terminal device according to the present invention, a display body that displays an image defined by a display coordinate system and an operation point on the image displayed by the display body are detected. A detection unit for detecting at coordinates defined in the coordinate system, a conversion unit for converting the coordinates detected by the detection unit into the display coordinate system using correction parameters, and a reference line connecting at least two or more points A deviation calculation for calculating a deviation between the coordinates converted by the conversion unit and the coordinates constituting the reference line when an operation of tracing the reference line is performed. And a correction parameter update unit that updates the correction parameter based on the deviation calculated by the deviation calculation unit. According to the present invention, since the user only needs to perform an operation of tracing the displayed reference line, there is no need to input a position to be corrected, a shift amount, and the like.

It is a figure which shows the hardware constitutions of the information terminal device which concerns on embodiment. It is a figure which shows the arrangement configuration of the display body and tablet in an information terminal device. It is a block diagram which shows the structure at the time of calibration in an information terminal device. It is a flowchart which shows the calibration operation | movement of an information terminal device. It is a figure which shows an example of the reference | standard image in an information terminal device. It is a figure which shows each process in an information terminal device. It is a figure which shows an example of operation and a display in an information terminal device. It is a figure which shows an example of operation and a display in an information terminal device. It is a figure which shows an example of operation and a display in an information terminal device. It is a figure which shows another example of the reference | standard image in an information terminal device. It is a figure which shows another example of the reference | standard image in an information terminal device.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram illustrating a hardware configuration of the information terminal device according to the present embodiment. As illustrated in FIG. 1, the information terminal device 1 includes a terminal body 10 and an electronic pen 50, and the terminal body 10 includes a CPU 12, a storage unit 14, a display body 16, and a tablet 18.
The CPU 12 controls each unit via the bus B. In particular, in the present embodiment, the CPU 12 displays the operation points detected by the tablet 18 and the display body 16 by executing a calibration program described later. A calibration process for aligning the display point is executed.
The storage unit 14 includes a nonvolatile storage area and a volatile storage area, and among these, the nonvolatile storage area includes an operation system, the calibration program, various application programs, correction parameters described later, and a reference image. The volatile storage area temporarily stores data generated when the CPU 12 executes the program.
The display body 16 is a display device such as a liquid crystal display panel or electronic paper, and displays an image by changing the gradation of each pixel. The tablet 18 specifies and outputs the coordinates of the operation point by the electronic pen 50 in the detection coordinate system.

As shown in FIG. 2, the input surface of the tablet 18 (the surface operated by the electronic pen 50) is disposed closer to the operation / observation side than the display surface of the display body 16. For this reason, when an operation of touching the input surface of the tablet 18 with the tip of the electronic pen 50 is performed, the coordinates of the operation point can be converted into the coordinates of the display surface and displayed on the display body 16. When an operation of tracing the surface is performed, the locus can be displayed.
In the present embodiment, the tablet 18 is used for detecting the coordinates of the operation point. However, it is sufficient that the coordinates of the operation point with respect to the display screen can be acquired in some form, and for example, a touch panel may be used. .

The coordinates of the operation point detected by the tablet 18 are defined by the detection coordinate system, and the arrangement of the pixels which are the minimum display unit of the display body 16 is defined by a display coordinate system different from the detection coordinate system. For this reason, in order to display the coordinates of the operation point detected by the tablet 18 on the display body 16, it is necessary to convert the coordinate system.
The coordinate conversion will be described. The coordinates of the operation point P detected by the tablet 18 and defined in the detection coordinate system are represented as (Px, Py), and the display point D corresponding to the operation point P on the display body 16 is represented. When the coordinates are expressed as (Dx, Dy), the coordinates of the two can be linked via the matrix A as shown in the following equation (1).

  For simplification of explanation, the coordinate transformation is limited only to enlargement / reduction and translation. Thereby, the components b and d in the matrix A in the equation (1) can be treated as zero. Of the components of the matrix A, the component a corresponds to the expansion / contraction rate in the x direction of the detection coordinate system as viewed from the display coordinate system, the component u corresponds to the deviation in the x direction, and the component c corresponds to the expansion / contraction in the y direction. The component v corresponds to the deviation in the y direction.

By the way, when the usage form in the terminal body 10 is considered, the visual recognition (operation) direction of the user with respect to the display body 16 (tablet 18) is not constant depending on the posture, the viewpoint position, and the like. For example, as shown in FIG. 2, the user may visually recognize the display surface of the display body 16 from the normal direction (a) and may visually recognize the image from an oblique direction (b).
For this reason, considering the thickness and parallax of the display body 16 and the tablet 18, even if the point P on the input surface of the tablet 18 is specified, the point that should correspond to the point P on the display surface is the normal direction (a). When viewed from the perspective, the point D is obtained, and when viewed from the oblique direction (b), the point De is obtained, which are different from each other. Furthermore, depending on the electronic pen, there is a type in which the coordinates of the detected operation point differ depending on the tilt of the electronic pen even if the operation point is the same.
Therefore, it is necessary to correct each component in the matrix A with each component of the matrix ΔA as shown in the following equation (2) according to the usage pattern of the user.

  As will be described in detail later, in this embodiment, while displaying a line drawing with fixed coordinates on the display body 16, the user maintains a certain posture and uses the electronic pen by tilting the electronic pen at a certain angle. Operate to trace a line drawing. By correcting each component of the matrix ΔA based on the deviation at this time, the positional deviation due to parallax or the like is corrected in the usage pattern.

FIG. 3 is a block diagram including a configuration in which each component of the matrix ΔA is appropriately corrected according to the usage pattern in the present embodiment.
In this figure, a control unit 120, a conversion unit 122, a trajectory image drawing unit 124, a reference image drawing unit 126, a deviation calculation unit 128, and a correction parameter update unit 130 are executed by the CPU 12 in FIG. Is a functional block constructed by The initial parameter storage unit 142, the correction parameter storage unit 144, and the reference image storage unit 146 are storage portions allocated to the nonvolatile storage area in the storage unit 14.

In the figure, the control unit 120 acquires various types of information from the conversion unit 122, the trajectory image drawing unit 124, the reference image drawing unit 126, the deviation calculation unit 128, and the correction parameter update unit 130, and controls each of these units. To do.
When the input surface is operated, the tablet 18 outputs the coordinates (Px, Py) of the operation point P at every sampling interval. The conversion unit 122 uses the matrix (A + ΔA) stored in the correction parameter storage unit 144 for the coordinates (Px, Py) of the operation point P, and the coordinates (Dx, Dy). The trajectory image drawing unit 124 draws a scanning trajectory on the display body 16 by sequentially plotting the converted coordinates (Dx, Dy), performing interpolation processing, or the like.

The reference image storage unit 146 stores image data serving as a reference at the time of calibration. In the present embodiment, as an example of the reference image, as shown in FIGS. 5A and 5B, a 5-line drawing 41 that can be drawn with one stroke is used. Specifically, the line drawing 41 is connected from three line segments 41a that are parallel to each other along the x direction to the left end of the line segment 41a that is positioned obliquely downward from the right end of the line segment 41a that is positioned above. It consists of two lines 41b.
For convenience, the end points of the line drawing 41 are B1 to B6 as shown in the figure, and the coordinate values of these end points in the display coordinate system are as shown in the figure. Moreover, the line drawing 41 is displayed on the upper left of the screen of the display body 16, for example, as shown in FIG. The reference image storage unit 146 stores image data corresponding to the line drawing 41 as, for example, an aggregate of points (pixels) defined by the display coordinate system.
In addition, the size of the line drawing 41 depends on the size and resolution of the display body 16 and the detection capability of the tablet 18, but if the display body size is about A4 size, it is about 2 centimeters (distance between the end points B1 and B2). ).

The reference image drawing unit 126 causes the display body 16 to draw the image data output from the reference image storage unit 146. As a result, the line drawing 41 is actually displayed on the display body 16 as shown in FIG.
Of the display area of the display body 16, an area other than the display area of the line drawing 41 is not particularly illustrated. For example, an electronic document is displayed by another application program, and is viewed and edited by an instruction from the tablet 18. Functions etc. are executed.

The deviation calculation unit 128 includes the coordinates of a specific point described later among the points constituting the line drawing 41 stored in the reference image storage unit 146, and the coordinates (Dx, Dy) converted into the display coordinate system by the conversion unit 122. The x and y components of the deviation are obtained and output according to each processing such as “start point”, “line segment 1”, “end point 1”, “line segment 2”, “end point 2”, etc., which will be described later. is there.
The correction parameter update unit 130 calculates a matrix ΔA from the deviation output from the deviation calculation unit 128, the coordinates of the operation point output from the tablet 18, and the coordinates constituting the line drawing 41 in accordance with each process at the time of calibration. Each component of is calculated and output.
The initial parameter storage unit 142 stores each component of the matrix A that is an initial value.
The correction parameter storage unit 144 stores a matrix (A + ΔA) obtained by correcting each component of the matrix A with each component of the matrix ΔA, and supplies the matrix (A + ΔA) to the conversion unit 122.

Next, a process transition at the time of calibration will be described. FIG. 6 is a diagram showing the transition. As described above, the line drawing 41 is displayed on the display body 16 during calibration. The user operates the electronic pen 50 so that the line drawing 41 is traced with a single stroke in the order of the end points B 1 → B 2 → B 3 (→ B 4 → B 5).
In this operation, the “starting point” process is executed when the electronic pen 50 taps the end point B1. Subsequently, the “line segment 1” process is executed when the electronic pen 50 is operated to trace the line segment 41a from the end point B1 to the end point B2. The processing of “end point 1” is executed when the electronic pen 50 is operated so as to return to the end point B2 and return toward the end point B3. Furthermore, the “segment 2” process is executed when the electronic pen 50 operates to trace the segment 41b from the end point B2 to the end point B3. The processing of “end point 2” is executed when the electronic pen 50 reaches the end point B3.

Next, the calibration operation will be described. FIG. 4 is a flowchart showing an operation when the calibration program is executed.
The calibration program is executed when, for example, an icon corresponding to the calibration program is displayed on the display body 16 in advance and the icon is touched.

First, in step S1, the control unit 120 sets “1” to the variable M and resets the flag N to “0”.
In step S <b> 2, the control unit 120 determines whether or not the coordinates (pen data) of the operation point are output from the tablet 18. The control unit 120 performs this determination at each detection sampling interval in the tablet 18.
If the tip of the electronic pen 50 is away from the input surface of the tablet 18, pen data is not output, and the control unit 120 executes step S <b> 12, which will be described later. On the other hand, if the pen data is output, in step S3, the control unit 120 causes the conversion unit 122 to acquire the pen data and convert it to the display coordinate system.

Next, in step S4, the control unit 120 determines whether or not the flag N is “0”. The flag N is reset to “0” in step S1 immediately after the start of calibration, and is set to “1” in step S6 described later after the processing of “start point”. Therefore, the flag N being “0” means that the “starting point” process has not yet been executed immediately after the start of calibration. Further, in this state, the pen data is output and the determination result in step S4 is “Yes”, which means that the user touches the end point B1 with the tip of the electronic pen 50 in order to trace the line drawing 41. It also means that.
Therefore, if the flag N is “0” and the pen data is output, the control unit 120 executes the “start point” process in step S5.
If the display coordinate system and the detection coordinate system are misaligned due to parallax or the like, as shown in FIG. 7, the display point D1 obtained by converting the operation coordinates of the electronic pen into the display coordinate system is a reference. There is a case where it deviates from the end point B1.

In the process of “starting point” in step S5, the correction component Δu is obtained from the matrix ΔA. Specifically, as shown in FIG. 7, the deviation calculating unit 128 calculates the x component (Dx1) of the display point D1 obtained by converting the pen data into the display coordinate system and the x coordinate (x1) of the end point B1. The deviation in the x direction of the display point D1 with respect to the end point B1 is calculated, and the correction parameter update unit 130 outputs the deviation as the correction component Δu.
Thereby, Δu of ΔA in the matrix (A + ΔA) stored in the correction parameter storage unit 144 is updated in consideration of the deviation in the x direction in step S5. Thereafter, in step S6, the control unit 120 sets the flag N to “1”, and returns the processing procedure to step S2 again.

On the other hand, the fact that the flag N is not “0” in step S4 means that the “start point” process has already been executed. Further, in this state, the variable M is the initial value “1” set in step S1 and the pen data is output. This means that the user moves the tip of the electronic pen 50 from the end point B1 to the end point B2. This means that the user is performing an operation of moving along the line segment 41a.
For this reason, in step S <b> 7, the control unit 120 executes the process of “line segment 1”. In the process of “line segment 1”, when executed at the sampling time t, the correction component Δv (t) corresponding to the time is calculated as shown in the equation (3) of FIG.
That is, the deviation calculating unit 128 uses the x component of the display point D obtained by converting the pen data at the sampling time t into the display coordinate system, and the y coordinate (y1) of the line segment 41a connecting the end points B1 and B2. A deviation Δy (t) in the y direction at the sampling time t is calculated, and the correction parameter update unit 130 calculates Δv (t−1) obtained at the sampling time (t−1) immediately before the sampling time t. A value obtained by subtracting the product obtained by multiplying the deviation Δy (t) by the coefficient α is calculated, and this value is output as the correction component Δv (t). The coefficient α is set to a value between 0 and 1.
Thereby, Δv of ΔA in the matrix (A + ΔA) stored in the correction parameter storage unit 144 is updated every processing of step 7, that is, every detection sampling interval in the tablet 18.

  Thereafter, in step S8, the control unit 120 causes the trajectory image drawing unit 124 to change the coordinate point converted at the current sampling time t from the coordinate point converted at the previous sampling time (t−1), for example. Are connected with a line and displayed on the display body 16 as a trajectory.

Next, in step S9, the control unit 120 determines whether or not the direction of the electronic pen has been reversed. For example, the control unit 120 determines whether or not the increase or decrease direction of the x or y coordinate of the pen data acquired this time has changed from the increase or decrease direction of the x or y coordinate of the pen data acquired last time.
This determination operation includes whether or not scanning of the electronic pen is in a stopped state, and more specifically whether or not the coordinates of the pen data are changed even if pen data is generated.
If the direction of the electronic pen is not reversed (stopped), the control unit 120 returns the processing procedure to step S2.
On the other hand, if there is direction reversal (stop) and the variable M is “1”, which is the initial value, the operation corresponds to the return from the end point B2 to the end point B3 of the line drawing. The process of “end point 1” is executed.
If the expansion / contraction ratio is different between the display coordinate system and the detection coordinate system, as shown in FIG. 8, the display point D2 obtained by converting the coordinates of the folding point by the electronic pen into the display coordinate system is the reference end point. There may be a deviation from B2.

In the process of “end point 1” in step S10, the correction component Δa of the expansion / contraction rate in the x direction of the detection coordinate system viewed from the display coordinate system is calculated according to the equation (4) in FIG. The component Δu is calculated according to the equation (5) in FIG.
Specifically, the correction parameter updating unit 130 determines the deviation Δx1 in the x direction when the tip of the electronic pen 50 is brought into contact with the end point B1, the coordinate value Px1 in the x direction of the pen data at that time, and the end point B2. The correction component Δa is calculated according to the equation (4) using the deviation Δx2 in the x direction when the direction is reversed with the x and the coordinate value Px2 in the x direction of the pen data at that time. The deviation Δx2 is calculated by the deviation calculating unit 128 using the coordinate value Dx2 of the display point D2 and the coordinate value x2 of the end point B2. The deviation Δx1 is as described above.
Further, the correction parameter updating unit 130 uses the coordinate values Px1 and Px2 of the pen data, the deviation in the x direction at the end point B1 (x1−Dx1), and the deviation in the x direction at the end point B2 (x2−Dx2). Then, the correction component Δu is calculated according to the equation (5).
As a result, among the matrix (A + ΔA) stored in the correction parameter storage unit 144, Δa and Δu of ΔA are updated in consideration of the expansion / contraction rate and deviation in the x direction.

  After the process of “end point 1”, in order to execute the process of “line segment 2” corresponding to the return from the end point B2 to the end point B3, the control unit 120 executes the process in step S11. Is incremented by "1". Thereafter, the control unit 120 returns the processing procedure to step S2. When the process returns to step S2, the variable M is “2”. Therefore, if pen data is generated, the process of “line segment 2” with the variable M set to “2” is executed in step S7. In step S10, the process of “end point 2” is executed.

  In the process of “line segment 2”, the correction component Δu (t) corresponding to the sampling time t is calculated according to the equation (6) in FIG. That is, the deviation calculating unit 128 determines that the y coordinate value of the line segment 41b connecting x (t) that is the x coordinate value of the display point D at the sampling time t and the end points B2 and B3 is the y coordinate of the display point D. The deviation Δx (t) from the x-coordinate value of the point matching the value is calculated, and Δu (t−) obtained by the correction parameter update unit 130 at the sampling time (t−1) immediately before the sampling time t. From 1), a value obtained by subtracting the product of the deviation Δx (t) and the coefficient β is calculated, and the calculated value is output as the correction component Δu (t). The coefficient β is set to a value between 0 and 1. Thereby, Δu of ΔA in the matrix (A + ΔA) stored in the correction parameter storage unit 144 is updated at every sampling interval of detection in the tablet 18.

On the other hand, when the reversal of the direction of the electronic pen is detected in step S9 while the process of “line segment 2” is repeatedly performed at every sampling interval, “end point 2” in which variable M is set to “2” in step S10. Is executed. In the process of “line segment 2”, the correction component Δa is calculated again according to the equation (7) in FIG. 9, the correction component Δu is calculated again according to the equation (8) in FIG. The correction component Δv is calculated according to equation (10) in FIG.
Thereby, Δa, Δu, Δu, and Δv of ΔA in the matrix (A + ΔA) stored in the correction parameter storage unit 144 are updated in consideration of the expansion / contraction rate and deviation in the x and y directions.

When it is determined in step S2 that no pen data has been generated, the control unit 120 determines in step S12 whether or not the state in which the pen data is not generated has continued for, for example, 3 seconds.
If the state in which no pen data is generated does not continue for 3 seconds, it is considered that the operation for calibration, that is, the operation for tracing the line drawing 41 is not completed. Is returned to step S2. On the other hand, if the state in which no pen data is generated continues for 3 seconds, it is an indication of the user's action that the user has stopped tracing the line drawing 41, so the control unit 120 ends this calibration operation. To do.
When the calibration operation is completed, updating of each component of the matrix ΔA by the correction parameter updating unit 130 is stopped, but the correction parameter storage unit 144 stores a matrix (A + ΔA) based on the last updated component ΔA, Is supplied to the converter 122. For this reason, the matrix (A + ΔA) based on the last updated component ΔA is used for converting the coordinates of the operation point into the display coordinate system.

In the calibration operation shown in FIG. 4, when the tip of the electronic pen is tapped near the end point B1 of the line drawing 41, the matrix is first processed by the process of the “start point” in step S <b> 5 in the path of steps S <b> 1 to S <b> 6. Δu of ΔA is updated in consideration of the deviation in the x direction.
Next, when an operation of tracing the line segment 41a, which is the first image of the line drawing 41, is performed from the end point B1 toward the end point B2, the variable is set to “1” in the calibration operation. In step S2, “Yes” is determined in step S2, “No” in step S4, and “No” in step S9, respectively. Therefore, in the route of steps S2 to S4 and S7 to S9, the “line” in step S7 is used. The process of “minute 1” is repeatedly executed at every sampling interval. Thereby, Δv of the matrix ΔA is updated one by one in consideration of the deviation in the y direction. Therefore, as shown in FIG. 8, when the electronic pen is traced in the direction from the end point B1 to the end point B2, the difference between the display locus 62 and the line segment 41a is gradually reduced particularly in the y direction. As a result, the display trajectory when the user traces with the electronic pen 50 gradually approaches the line drawing 41, so that the user can operate the electronic pen without feeling uncomfortable.
When the tip of the electronic pen reaches the end point B2 of the line segment 41a, “Yes” is determined in step S9, and therefore the process of “end point 1” in step S10 is executed. Accordingly, Δa and Δv of the matrix ΔA are updated in consideration of the deviation in the x direction and the expansion / contraction.
At this time, since the components Δa, Δu, and Δv of the matrix ΔA are updated so as to correct the deviation in the x and y directions and the expansion / contraction rate in the x direction, the operation points detected by the tablet 18 and the display body 16 are updated. The display points are relatively well aligned.

When the user determines that the state is acceptable and moves the electronic pen 50 away from the input surface of the tablet 18 (for 3 seconds or more), step S2 is determined as “No” and step S12 is determined as “Yes”. Therefore, this calibration operation ends. On the other hand, if the user determines that the alignment is not sufficiently performed in this state, an operation of tracing the line segment 41b toward the end point B3 is performed.
For this reason, when an operation of tracing the line segment 41b which is the second image of the line image 41 is performed, in the calibration operation, the variable is incremented to “2”, “Yes” in step S2, and “ Since “No” and “No” are respectively determined in step S9, the process of “line segment 2” in step S7 is executed repeatedly at every sampling interval, especially in the paths of steps S2 to S4 and S7 to S9. Thereby, Δu of the matrix ΔA is updated one by one in consideration of the deviation in the x direction.
For this reason, as shown in FIG. 9, when the electronic pen is traced in the direction from the end point B2 to the end point B3, the difference between the display locus 63 and the line segment 41b is gradually reduced particularly in the x direction.

  By the way, when an operation of tracing the end point B2 from the end point B1 of the line drawing 41 is performed, the end point of the display trajectory 62 may not match the end point B2 and may shift to the display point D2. At this time, when the tip of the electronic pen 50 reverses toward the end point B3, the correction component Δa of the expansion / contraction ratio in the x direction and the correction component Δu of the deviation in the x direction are updated by the processing of “end point 1”. The Therefore, when an operation that reverses the direction from the end point B2 to the end point B3 of the line drawing is performed, the start point of the display track 63 of the electronic pen is corrected so as to be almost the end point B2. For this reason, in FIG. 9, the display trajectories 62 and 63 are shown discontinuously.

Here, the processing up to “end point 2” has been described. However, when an operation of tracing the line segment 41a from the end point B3 to the end point B4 is further performed, the processing of “line segment 3” is performed at the end point B4. When the direction is reversed, the processing of “end point 3” may be continued. Similarly, when the operation of tracing the line segment 41b from the end point B4 to the end point B5 is performed, the processing of the “line segment 4” is continued, and when the direction of the end point B5 is reversed to the end point B6, the processing of “end point 4” is continued. The process of “line segment 5” may be executed when an operation of tracing the line segment 41a from the end point B5 toward the end point B6 is performed, and the process of “end point 5” may be executed when the end point B6 is reached.
Further, the line drawing 41 is not limited to five strokes, and it is only necessary that each of the x drawing and the y direction spreads like two drawing connecting the end points B1, B2, and B3. Further, for example, a line drawing as shown in FIGS. 10 and 11 may be used.

  In the above-described embodiment, in step S12, it is determined that the pen data has not been generated for 3 seconds or more (or the electronic pen has not moved for 3 seconds or more), and the operation of tracing the line drawing 41 has been completed. Although the calibration operation is ended, the end of the calibration operation is not limited to this. For example, when the deviation obtained by the deviation calculation unit 128, that is, the deviation between the coordinates of the display point D obtained by converting the coordinates of the operation point P and the coordinates of the reference line drawing becomes smaller than a threshold, the influence of parallax or the like The calibration operation may be terminated by determining that the position has been adjusted to such an extent that can be ignored.

  Further, the correction parameter storage unit 144 stores the matrix (A + ΔA) obtained by correcting the matrix A stored in the initial parameter storage unit 142 with the matrix ΔA by the correction parameter update unit 130 in a nonvolatile manner and supplies the matrix to the conversion unit 122. The configuration. However, the present invention is not limited to this, and the correction parameter storage unit 144 may be configured to store the matrix (A + ΔA) in a volatile manner. In this configuration, the correction parameter storage unit 144 sets the matrix A stored in the initial parameter storage unit 142 as an initial value immediately after the power is turned on, and sets the matrix A to the matrix ΔA when the calibration operation is performed. It will be corrected in.

  For example, regarding Δx (t) in FIG. 9, regarding the method of taking the deviation in the embodiment, x (t) that is the x coordinate value of the display point D and the y coordinate value of the line segment 41 b are the values of the display point D. Although the difference from the x-coordinate value of the point that matches the y-coordinate value is used, it may be simply calculated as the distance between the display point D and the line segment 41b.

In the present embodiment, the direct-view type panel in which the display surface of the display body 16 is overlapped with the input surface of the tablet 18 has been described. The present invention is not limited to this. For example, while the display body is a projection type projector, the pointer coordinates specified for the projection image are acquired by, for example, inputting the image using an image sensor and analyzing the image. Applicable.
Further, in the embodiment, for simplicity of explanation, among the components of the matrix A (ΔA), b and d are set to zero. However, these components may be corrected in consideration of rotation and the like. Good.

DESCRIPTION OF SYMBOLS 1 ... Information terminal device, 10 ... Terminal main body, 12 ... CPU, 16 ... Display body, 18 ... Tablet, 50 ... Electronic pen, 120 ... Control part, 122 ... Conversion part, 124 ... Trajectory image drawing part, 126 ... Reference image Drawing unit 128... Deviation calculating unit 130... Correction parameter updating unit 144... Correction parameter storage unit 146.

Claims (5)

A display for displaying an image defined in a display coordinate system;
A detection unit for detecting an operation point on an image displayed by the display body with coordinates defined in a detection coordinate system;
A conversion unit that converts the coordinates detected by the detection unit into the display coordinate system using a correction parameter;
A reference image drawing unit for displaying a reference line connecting at least two or more points on the display body;
A deviation calculating unit that calculates a deviation between the coordinates converted by the conversion unit and the coordinates constituting the reference line when an operation of tracing the reference line is performed;
A correction parameter update unit that updates the correction parameter based on the deviation calculated by the deviation calculation unit;
An information terminal device comprising: The information terminal according to claim 1, further comprising: a trajectory image drawing unit that displays a trajectory based on the coordinates converted by the conversion unit on the display body when an operation of tracing the reference line is performed. apparatus. The information terminal device according to claim 2, wherein when the operation of tracing the reference line is completed, the correction parameter update unit ends the update of the correction parameter. The information terminal device according to claim 2, wherein the correction parameter update unit ends the update of the correction parameter when the deviation becomes smaller than a threshold value. The information terminal device according to claim 3 or 4, wherein when the update of the correction parameter is completed, the correction parameter at the time of update is stored.

Images