JP2013171553A - Display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display handwritten information between a plurality of displays with good appearance in the case of performing handwriting input across a bezel area.SOLUTION: In a display device 10 including a first display 11a and a second display 11b each of which has a function for accepting handwriting input, an input detection part 16a detects handwriting input in the first display 11a, and a correction part 16d corrects information input by handwriting in the second display 11b on the basis of the information of handwriting input detected in the predetermined peripheral area of the bezel of the first display 11a by the input detection part 16a.

Description

  The present invention relates to a display device including a plurality of displays having a function of receiving handwritten input.

  In recent years, a multi-display technique for connecting a plurality of displays having a handwriting input function and expanding a display area has been widely used. Between each display area of the multi-display, there is a bezel area where an image cannot be displayed.

  As a technique related to handwriting input performed across the bezel region, the techniques of Patent Document 1 and Patent Document 2 can be cited. In the prior art of Patent Document 1, when the pen input is continuously performed from the first screen to the next screen across the bezel region, the pen input is performed on the next screen within a predetermined time, or An apparatus is disclosed that accepts a pen input as a continuous pen input between two screens when the position at which the pen input is completed on a first screen is within a specific range.

  Moreover, in the prior art of patent document 2, when a pen becomes non-contact after contacting a tablet, the non-contact time is measured, and when the non-contact time is within a predetermined time, the pen is a tablet. An apparatus for determining that the state of being in contact with the battery continues is disclosed.

Japanese Patent Laid-Open No. 11-73269 JP-A-9-31757

  When handwriting input of a line across the bezel area, the line may be displayed shifted on one side and the other side of the bezel area, or the line may be interrupted near the bezel area, resulting in a poor appearance. is there. However, the above-described prior arts in Patent Documents 1 and 2 do not solve such a problem.

  In view of the above circumstances, an object of the present invention is to provide a display device capable of displaying information input by handwriting between a plurality of displays in a good manner when handwritten input is performed across a bezel region.

  In order to solve the above-described problem, a first technical means of the present invention is a display device including a plurality of displays having a function of accepting handwritten input, an input detection unit for detecting handwritten input on the first display, A correction unit that corrects information input by handwriting on the second display based on information on handwritten input detected in a predetermined peripheral area of the bezel of the first display by the input detection unit. And

  According to a second technical means of the present invention, in the first technical means, the handwritten input detected in the predetermined peripheral area is a first line handwritten input, and the handwritten input to the second display is the second. The line is handwritten input, and the correction unit corrects the information on the second line based on information on an extension line obtained by extending the first line to the area of the second display. Features.

  According to a third technical means of the present invention, in the second technical means, the correction unit changes the correction processing of the information on the second line based on a difference between the extension line and the second line. It is characterized by doing.

  According to a fourth technical means of the present invention, in the third technical means, the correction process of the information of the second line includes a process of changing a position of the second line on the extension line. Features.

  According to a fifth technical means of the present invention, in the third or fourth technical means, the correction processing of the information on the second line is performed on the extension line while maintaining the inclination of the second line. And a process of changing the position of the starting point of the second line.

  According to a sixth technical means of the present invention, in any one of the third to fifth technical means, the second line information correction processing maintains the position of the end point of the second line while maintaining the position of the end point of the second line. It includes a process of changing the position of the starting point of the second line on the extension line.

  According to a seventh technical means of the present invention, in any one of the second to sixth technical means, the extension line is displayed on the second display as a guide line for guiding handwriting input of the second line. A display processing unit is further provided.

  According to an eighth technical means of the present invention, in the first technical means, the handwritten input detected in the predetermined peripheral region is a first line handwritten input, and the handwritten input on the second display is the second. The line is handwritten input, and the correction unit corrects the information of the start point of the second line based on the information of the first line.

  According to the present invention, information input by handwriting on the second display is detected based on information on handwriting input detected in a predetermined peripheral area of the bezel of the first display after detecting handwriting input on the first display. Therefore, when handwritten input is performed across the bezel area, it is possible to display the information input by handwriting in a good-looking manner among a plurality of displays.

It is a figure which shows an example of a structure of the display apparatus which concerns on this invention. It is a figure explaining an example of the 1st display and the 2nd display. It is a figure which shows an example of input event data. It is a figure which shows an example of a locus | trajectory set table. It is a figure which shows an example of a pen down flag. It is a figure which shows an example of a correction flag. It is a flowchart explaining an example of the process sequence of the display process which concerns on embodiment of this invention. It is a figure explaining an example of a line gap correction process. It is a figure explaining an example of a line gap correction process. It is a figure explaining an example of a line gap correction process. It is a figure which shows an example of the locus | trajectory collection table after line | wire deviation correction | amendment. It is a figure explaining an example of a line break correction process. It is a figure which shows an example of the locus | trajectory collection table after line | wire break correction | amendment correction | amendment. It is a flowchart explaining an example of the process sequence of a locus | trajectory set setting process. It is a figure which shows an example of the display of the guide line which guides a user's input. It is a flowchart which shows an example of the process sequence of a regression line determination process. It is a figure which shows the part of the line AB from which the absolute value of the correlation coefficient R becomes more than predetermined value. It is a flowchart which shows an example of the process sequence of a line | wire misalignment correction process. FIG. 10 is a diagram showing an example of line deviation correction when the line CD is composed of a plurality of points.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing an example of the configuration of a display device 10 according to the present invention. The display device 10 includes a first display 11a, a second display 11b, an output control unit 12, a touch panel interface unit 13, an input unit 14, a storage unit 15, and a control unit 16.

  The first display 11a and the second display 11b are display devices such as a liquid crystal display device having a touch panel for accepting handwritten input and a cathode ray tube (CRT). The first display 11a and the second display 11b also include a speaker or the like. Below, the case where a touch panel is touched with a stylus pen is demonstrated. The touch panel may be touched with a user's finger or the like.

  FIG. 2 is a diagram illustrating an example of the first display 11a and the second display 11b. As shown in FIG. 2, the 1st display 11a and the 2nd display 11b are connected, and a display area is expanded. In the example of FIG. 2, the line AB is displayed on the first display 11a, and the line CD is displayed on the second display 11b.

Here, on the first display 11a and the second display 11b, display areas 11a ₁ and 11b ₁ that display images and receive handwritten input from the user, and bezels provided around the display areas 11a ₁ and 11b ₁ There is a region 11c. The bezel region 11c does not display an image and does not accept a handwritten input from the user. The upper left corner of the display areas 11a ₁ and 11b ₁ is set as the origin (0, 0) of the XY coordinate system.

  In the following, as shown in FIG. 2, a multi-display in which two displays, the first display 11a and the second display 11b, are connected will be described, but the same applies to a multi-display in which three or more displays are connected. The present invention can be applied. In the following, the case where the first display 11a and the second display 11b are arranged on the left and right will be described. However, the present invention can be similarly applied to the case where the first display 11a and the second display 11b are arranged vertically.

  Returning to the description of FIG. 1, the output control unit 12 is a processing unit that controls display of images on the first display 11 a and the second display 11 b. Specifically, the output control unit 12 acquires data of an image to be displayed on the first display 11a and the second display 11b from the control unit 16, and generates an image signal using the data. And the output control part 12 controls the display of the image on the 1st display 11a and the 2nd display 11b by outputting the produced | generated image signal to the 1st display 11a and the 2nd display 11b.

  The touch panel interface unit 13 is a processing unit that outputs input information from the user received by the touch panel included in the first display 11 a and the second display 11 b to the control unit 16.

  The input unit 14 is an input device such as a keyboard and a mouse, an image input terminal, or an audio input terminal, and receives various information necessary for processing performed by the display apparatus 10.

  The storage unit 15 is a storage device such as a magnetic disk storage device such as a hard disk device, a magneto-optical disk device, an optical disk device, or a semiconductor memory. The storage unit 15 stores input event data 15a, a locus set table 15b, a pen-down flag 15c, a correction flag 15d, and the like.

  The input event data 15a is data in which an X coordinate and a Y coordinate of a touched portion are stored when an event occurs in which the touch panel is touched with a stylus pen.

  FIG. 3 is a diagram illustrating an example of the input event data 15a. FIG. 3 (A) shows an example in which a location where the X coordinate is 100 and the Y coordinate is 200 is touched. When the user releases the stylus pen from the touch panel, as shown in FIG. 3B, −1 is registered in the X and Y coordinates of the input event data 15a.

  The locus set table 15b is data in which coordinates of the locus of the stylus pen when the user touches the touch panel with the stylus pen are registered.

  FIG. 4 is a diagram illustrating an example of the trajectory set table 15b. As shown in FIG. 4A, the X coordinate and Y coordinate data registered in the input event data 15a are sequentially added to the trajectory set table 15b. Here, the identification number shown in FIG. 4 is a number assigned to a set of X coordinates and Y coordinates.

  FIG. 4B is a diagram illustrating an example of the trajectory set table 15b when a line is input across the first display 11a and the second display 11b. Here, the X and Y coordinates of the identification number “1” are the X and Y coordinates of the point A shown in FIG. 2, and the X and Y coordinates of the identification number “n” are shown in FIG. These are the X and Y coordinates of the indicated point B. The X and Y coordinates of the identification number “n + 2” are the X and Y coordinates of the point C shown in FIG. 2, and the X and Y coordinates of the identification number “m” are shown in FIG. X and Y coordinates of the point D.

  When the input is continuously performed from the point A to the point D across both the first display 11a and the second display 11b, the handwriting input from the user cannot be received in the bezel region 11c, and therefore the point B is input. After that, it is determined that the stylus pen is separated from the touch panel. Therefore, as shown in FIG. 4B, “−1” is registered in the X and Y coordinates corresponding to the identification number “n + 1”.

  The pen down flag 15c is a flag indicating whether or not the touch panel is touched by the stylus pen. FIG. 5 is a diagram illustrating an example of the pen-down flag 15c. As illustrated in FIG. 5, “TRUE” is registered in the pen down flag 15 c when the touch panel is touched with the stylus pen, and “FALSE” is registered when the touch panel is touched with the stylus pen. .

  The correction flag 15d is a flag indicating whether correction of information input by handwriting on the first display 11a or the second display 11b is necessary. FIG. 6 is a diagram illustrating an example of the correction flag 15d. As shown in FIG. 6, “TRUE” is registered in the correction flag 12d when correction of information input by handwriting on the first display 11a or the second display 11b is necessary, and correction of the information is not necessary "FALSE" is registered.

  Returning to the description of FIG. 1, the control unit 16 executes a central processing unit (CPU) that controls the entire display device 10, a ROM (Read Only Memory) that stores a program, and a program. A processing unit including a RAM (Random Access Memory) used as a necessary work area.

  The control unit 16 includes an input detection unit 16a, a locus set processing unit 16b, a timer processing unit 16c, a correction unit 16d, and a guide display processing unit 16e.

  When the user touches the touch panel with a stylus pen, the input detection unit 16a is a processing unit that registers information on the X coordinate and the Y coordinate of the location touched by the user in the input event data 15a.

  Specifically, when the input detection unit 16a acquires information indicating that the user has touched the touch panel with the stylus pen from the first display 11a or the second display 11b via the touch panel interface unit 13, the input detection unit 16a further Information on the X coordinate and the Y coordinate of the touched location is acquired from the first display 11a or the second display 11b, and the information is registered in the input event data 15a.

  The trajectory set processing unit 16b is a processing unit that registers the X coordinate and Y coordinate registered in the storage unit 15 as the input event data 15a in the trajectory set table 15b. When the X and Y coordinates are registered, the trajectory set processing unit 16b assigns identification numbers to the X and Y coordinates as described with reference to FIG.

  The timer processing unit 16c is a processing unit that measures an elapsed time from a certain time point. For example, the timer processing unit 16c calculates the elapsed time from the time when the stylus pen is separated from the touch panel at the point B in FIG. 2 until the time when the stylus pen is touched again at the point C to “minute: second: millisecond”. Measure in the form of

The correction unit 16d is a processing unit that corrects information input by handwriting on the first display 11a or the second display 11b. The correction unit 16d includes a line deviation correction processing unit 16d ₁ and a line break correction unit 16d ₂ .

The line misalignment correction processing unit 16d ₁ applies the line input to the first display 11a and the second display 11b when a line is continuously input across both the first display 11a and the second display 11b. It is a processing unit that corrects a deviation generated between the input line and the input line.

The line break correction unit 16d ₂ has continuously input lines across both the first display 11a and the second display 11b, but is input to the lines input to the first display 11a and the second display 11b. This is a processing unit that corrects the line data so that the lines become one line when it is recognized that there are two lines.

  When a line is input in a predetermined peripheral area of the bezel area 11c of the first display 11a or the second display 11b, the guide display processing unit 16e inputs the user's handwriting on another display in order to guide the user's input. Is a processing unit that displays a guide line that guides the image in a semi-transparent or dotted line.

  Next, the display process performed by the display device 10 will be described in more detail. FIG. 7 is a flowchart illustrating an example of a processing procedure of display processing according to the embodiment of the present invention.

  First, as in the example of FIG. 2, a processing procedure of processing in which the line AB is displayed on the first display 11 a as a result of the line AB being input by handwriting by the user will be described.

  The trajectory set processing unit 16b of the display device 10 registers “FALSE” in the pen-down flag 15c (step S101). In addition, the trajectory set processing unit 16b registers “FALSE” in the correction flag 15d (step S102).

  Then, the input detection unit 16a detects whether or not the input event for the touch panel has changed (step S103). For example, the input detection unit 16a detects that the touch panel is touched by the user with the stylus pen, the touch position of the stylus pen is changed on the touch panel, or the stylus pen is separated from the touch panel as a change in the input event. .

  If there is no change in the input event to the touch panel (NO in step S103), the detection process in step S103 is executed again.

  When there is a change in the input event for the touch panel (YES in step S103), the input detection unit 16a determines whether or not a pen-down event in which the touch panel is touched by the stylus pen has occurred (step S104).

  This pen-down event occurs when the touch panel is newly touched with the stylus pen (for example, when the point A in FIG. 2 is touched), or when the position changes while the stylus pen is touching the touch panel (for example, In the case where the touch position changes from point A to point B in FIG.

  When a pen-down event has occurred (YES in step S104), the trajectory set processing unit 16b refers to the trajectory set table 15b and determines whether the previous event was also pen-down (step S105).

  For example, when there is no previous event (when NO in step S105), such as when the point A in FIG. 2 is first touched, the trajectory set processing unit 16b determines whether the correction flag 15d is “TRUE”. Is determined (step S112).

  If there is no previous event, “FALSE” is registered in the correction flag 15d in step S102, so it is determined that the correction flag 15d is not “TRUE” (NO in step S112).

  Thereafter, the trajectory set processing unit 16b registers “TRUE” in the pen-down flag 15c (step S115), and then proceeds to step S106, where the X-coordinate and Y-coordinate where the touch panel is touched this time are stored in the trajectory set table. In addition to 15b, a trajectory set setting process for displaying a point touched on the touch panel this time is executed (step S106). This trajectory set setting process will be described in detail later. Then, it returns to step S103 and the process after step S103 is continued.

  In step S105, if the previous event was also pen-down (in the case of YES in step S105), the X coordinate and Y coordinate of the location touched on the touch panel this time are added to the trajectory set table 15b, and the previous touch panel is touched. Trajectory set setting processing for displaying a line connecting the detected location and the location where the touch panel is touched this time is executed (step S106).

  Then, the processes of step S103, step S104, step S105, and step S106 are executed until a pen-up event occurs in which the stylus pen leaves the touch panel. Thereby, the line AB shown in FIG. 2 is displayed on the first display 11a.

  After that, returning to step S103, there is a change in the input event in step S103 (YES in step S103), and if a pen-up event occurs instead of a pen-down event in step S104 (NO in step S104), The locus set processing unit 16b registers “FALSE” in the pen-down flag 15c (step S107). In the example of FIG. 2, this pen-up event corresponds to an event in which the stylus pen leaves the touch panel at point B.

  Then, the trajectory set processing unit 16b determines whether or not the correction flag 15d is “TRUE” (step S108). When the correction flag 15d is not “TRUE” (NO in step S108), the trajectory collection processing unit 16b determines whether or not the location where the stylus pen is separated from the touch panel is near the bezel region 11c (step S109).

  Specifically, the trajectory set processing unit 16b determines whether the position specified by the X coordinate and the Y coordinate registered at the end of the trajectory set table 15b is included in a predetermined area around the bezel area 11c. The above determination is made by detecting.

  When the location where the stylus pen is separated from the touch panel is in the vicinity of the bezel region 11c (YES in step S109), the trajectory set processing unit 16b sets the correction flag to “TRUE” (step S110). Thereafter, the timer processing unit 16c starts measuring the elapsed time from that time (step S111).

  Then, the process proceeds to step S106, and a trajectory set setting process for adding a value “−1” indicating that a pen-up event has occurred at the X coordinate and the Y coordinate to the trajectory set table 15b is executed (step S106). ).

  Thereafter, the process returns to step S103, and the processes after step S103 are continued as described below. This process corresponds to a process in which the line CD is displayed on the second display 11b as a result of handwriting input of the line CD by the user in FIG.

  When the user touches the touch panel with a stylus pen, it is determined in step S103 that the input event has changed (YES in step S103), and further, it is determined in step S104 that a pen-down event has occurred (YES in step S104).

  If this pen-down event occurs, the previous event was a pen-up event at point B, and therefore it is determined in step S105 that the previous event was not a pen-down event (NO in step S105).

  In this case, the trajectory set processing unit 16b determines whether or not the correction flag 15d is “TRUE” (step S112). The correction flag 15d is set to “TRUE” because it is determined in step S104 that a pen-up event has occurred (NO in step S104), and the location where the stylus pen is separated from the touch panel in step S109 is near the bezel region 11c. This is the case where it is determined that there is a correction and the correction flag 15d is set to “TRUE” in step S110.

  That is, the correction flag 15d becomes “TRUE” in step S112 when pen-up is detected near the bezel region 11c and then pen-down is detected again.

  When the correction flag 15d is “TRUE” (YES in step S112), the timer processing unit 16c determines whether or not the measurement time started in step S111 is within a predetermined time ( Step S113).

  If the measurement time is not within the predetermined time (NO in step S113), the trajectory set processing unit 16b executes an initialization process (step S116). Specifically, the trajectory set processing unit 16b deletes the registered contents of the trajectory set table 15b and registers “FALSE” in the correction flag 15d.

  If it takes a long time to make an input to one display after making an input to one display, the user cannot think that the user intends to input one line continuously on the two displays. Therefore, the processing as described above is performed.

  In step S113, when the measurement time is within the predetermined time (YES in step S113), the trajectory set processing unit 16b determines whether or not the location where the stylus pen touches the touch panel is near the bezel region 11c. Determination is made (step S114).

  Specifically, the trajectory set processing unit 16b determines whether the position specified by the X coordinate and the Y coordinate registered at the end of the trajectory set table 15b is included in a predetermined area around the bezel area 11c. The above determination is made by detecting.

  When the location where the stylus pen is touching the touch panel is not in the vicinity of the bezel region 11c (NO in step S114), the trajectory set processing unit 16b proceeds to step S116 and executes initialization processing.

  If the location where the stylus pen is touching the touch panel is not in the vicinity of the bezel region 11c, it is not considered that the user intends to input one line continuously on the two displays. Such processing is performed.

  After the process of step S116, the trajectory set processing unit 16b registers “TRUE” in the pen-down flag 15c (step S115), and then proceeds to step S106, where the X-coordinate, Y of the location where the touch panel is touched this time The coordinates are added to the locus set table 15b, and the locus set processing for displaying the point touched on the touch panel this time is executed (step S106). Then, it returns to step S103 and the process after step S103 is continued.

  Also, in step S114, if the location where the stylus pen is touching the touch panel is near the bezel region 11c (YES in step S114), “TRUE” is registered in the pen down flag 15c in step S115, In step S106, the X-coordinate and Y-coordinate of the location where the touch panel is touched this time are added to the trajectory set table 15b, and the trajectory set setting for displaying the point where the touch panel is touched this time (for example, point C in FIG. 2) is displayed. Processing is executed (step S106).

  Thereafter, the processes of step S103, step S104, step S105, and step S106 are executed until a pen-up event occurs in which the stylus pen is separated from the touch panel. Thereby, the line CD shown in FIG. 2 is displayed on the second display 11b.

  Thereafter, returning to step S103, there is a change in the input event in step S103 (YES in step S103), a pen-up event occurs in step S104 instead of a pen-down event (in the case of NO in step S104), and further If the correction flag 15d is “TRUE” in step S108 (YES in step S108), the processes after step S117 are executed.

  That is, the processes after step S117 are processes executed when a pen-up event occurs once (point B in FIG. 2) and then a pen-up event occurs (point D in FIG. 2). In the example of FIG. 2, since the line CD is determined at this stage, the line correction process after step S117 is performed.

First, a line deviation correction processing unit 16d ₁ executes a line deviation correcting process (step S117). 8 to 10 are diagrams illustrating an example of the line deviation correction process. 8 to 10 show a line AB input to the first display 11a by the user and a line CD input to the second display 11b. Further, a line 20 obtained by extending the line AB and a line 21 obtained by extending the line CD are shown.

In the example of FIG. 8, the absolute value of the difference in slope between the line 20 and the line 21 is less than the first predetermined value. In this case, the line shift correction processing unit 16d ₁ changes the position of the line CD on line 20, is corrected to line CD to line C'D ', X coordinate of the line CD in the trajectory set table 15b The Y coordinate is corrected to the X and Y coordinates of the line C′D ′.

In the example of FIG. 9, the absolute value of the difference between the slopes of the line 20 and the line 21 is not less than the first predetermined value and less than the second predetermined value. In such a case, the line shift correction processing unit 16d ₁ changes the position of the start point C of the line CD on the line 20 while maintaining the inclination of the line CD, and corrects the line CD to the line C′D ′. At the same time, processing is performed to correct the X and Y coordinates of the line CD in the trajectory set table 15b to the X and Y coordinates of the line C′D ′.

In the example of FIG. 10, the absolute value of the difference in slope between the line 20 and the line 21 is equal to or greater than the second predetermined value. In such a case, the line shift correction processing unit 16d ₁ changes the position of the start point C of the line CD on the line 20 while maintaining the position of the end point D of the line CD, and changes the line CD to the line C′D. And correcting the X and Y coordinates of the line CD in the trajectory set table 15b to the X and Y coordinates of the line C′D.

  Here, the line correction processing is changed using the absolute value of the difference between the inclinations of the lines 20 and 21, but the angle formed by the lines 20 and 21 is calculated, and the formed angle is the first predetermined value. When the angle is less than the value, the correction process shown in FIG. 8 is performed. When the angle formed is equal to or greater than the first predetermined value and less than the second predetermined value, the correction process illustrated in FIG. The correction processing shown in FIG. 10 may be performed when the predetermined value is equal to or greater than 2.

  FIG. 11 is a diagram illustrating an example of the trajectory set table 15b after line deviation correction. FIG. 11 shows an example when the line deviation correction processing described in FIG. 8 is performed. In this line misalignment correction process, the line C′D ′ is positioned on the line 20, so the values of the Y coordinate for each X coordinate of the line C′D ′ are shown in FIGS. 2 and 4B. 100, which is the same value as the Y coordinate of the line AB. The processing procedure of this line deviation correction process will be described in detail later.

After the line deviation correcting process in step S117, the line break correction processing unit 16d ₂ performs line interruption corrective action (step S118). FIG. 12 is a diagram illustrating an example of the line break correction process. FIG. 12 shows a line AB input to the first display 11a by the user and a line C′D ′ obtained by performing a line shift correction process on the line CD input to the second display 11b. It is shown.

In the state after the line deviation correction process shown in FIG. 8, the line AD ′ is interrupted between the point B and the point C ′. Therefore, the line break correction processing unit 16d ₂ connects the point B and the point C ′ with a line and corrects the line AD ′ to be a single line.

FIG. 13 is a diagram illustrating an example of the trajectory set table 15b after the line break correction. In the trajectory set table 15b shown in FIG. 11, “−1” indicating that a pen-up event has occurred is registered in the X coordinate and Y coordinate corresponding to the identification number “n + 1”. The processing unit 16d ₂ corrects these values to the coordinates of the midpoint of the points B and C ′ in FIG.

  In the example of FIG. 13, since the X coordinate of the point B is 300 and the Y coordinate is 100, the X coordinate of the point C ′ is 350 and the Y coordinate is 100, the X coordinate corresponding to the identification number “n + 1”, Y “325” and “100” are registered in the coordinates, respectively.

  When a line is input across both the first display 11a and the second display 11b, the stylus is once separated from the touch panel due to the step of the bezel region 11c, so the line is input to the screen end of the first display 11a. The line may be interrupted.

  Further, even when an application program that controls display of lines restricts display within a predetermined range from the bezel area 12c, lines are not input to the screen ends of the first display 11a and the second display 11b, and the lines are interrupted. There is a case.

  However, if the line break correction process as described above is executed, even if the display data of the entire screen is saved or the line AD ′ is moved, the line AD ′ and the bezel region 12c are moved. It is possible to prevent a gap from being formed.

  After the line break correction process, the trajectory set processing unit 16b executes an initialization process (step S119). Specifically, the trajectory set processing unit 16b deletes the registered contents of the trajectory set table 15b and registers “FALSE” in the correction flag 15d. Then, it returns to step S103 and the process after step S103 is continued.

  Next, an example of the processing procedure of the trajectory set setting process shown in step S106 of FIG. 7 will be described. FIG. 14 is a flowchart for explaining an example of the processing procedure of the trajectory set setting process.

  The trajectory set processing unit 16b determines whether or not the correction flag 15d is “TRUE” (step S201). When the correction flag 15d is not “TRUE” but “FALSE” (NO in step S201), the trajectory set processing unit 16b uses the X and Y coordinates registered in the input event data 15a as the trajectory set table. In addition to 15b, the trajectory set table 15b is updated (step S205).

  Thereafter, the trajectory set processing unit 16b determines whether or not the pen-down flag 15c is “TRUE” (step S206). When the pen-down flag 15c is “TRUE” (YES in step S206), the trajectory set processing unit 16b displays the point or line input immediately before on the first display 11a or the second display 11b. (Step S206). This trajectory set setting process ends.

  Here, the case where a point is displayed is a case where a pen-down event that the start point of a line is input is detected, and the case where a line is displayed is a case where a pen-down event is detected and then again. This is when a pen-down event is detected.

  On the other hand, in step S206, when the pen-down flag 15c is “FALSE” (in the case of NO in step S206), the trajectory set setting process is ended as it is.

  In step S201, when the correction flag 15d is “TRUE” (YES in step S201), the trajectory set processing unit 16b indicates that the location where the stylus pen touches the touch panel at that time is in the bezel region 11c. It is determined whether it is near (step S202).

  Specifically, the trajectory set processing unit 16b determines whether the position specified by the X coordinate and the Y coordinate registered at the end of the trajectory set table 15b is included in a predetermined area around the bezel area 11c. The above determination is made by detecting.

If locations stylus pen on the touch panel is touched is near the bezel area 11c (YES at step S202), the line shift correction processing unit 16d ₁ is a process of determining a regression line of the input is made linear This is performed (step S203).

  Then, the guide display processing unit 16e guides the regression line to a display (first display 11a or second display 11b) different from the display (first display 11a or second display 11b) on which the line is input. (Step S204). And the process after step S205 is performed.

  In step S202, when the location where the stylus pen is touching the touch panel is not near the bezel region 11c (NO in step S202), the guide line is not displayed. Alternatively, when the guide is displayed, the guide display processing unit 16e deletes the display (step S208). This trajectory set setting process ends.

  FIG. 15 is a diagram illustrating an example of a guide line display for guiding the user's input. FIG. 15A shows a case where the user inputs a line AB to the first display 11a. FIG. 15B shows a guide line 22 that is a regression line of the line AB.

  As shown in FIG. 15B, since the guide line 22 is displayed when the point B is input near the bezel region 11c, the user can reduce the parallax shift caused by the presence of the bezel region 11c. The user can easily input the line CD by hand while tracing the guide line 22.

  Next, the regression line determination process in step S203 shown in FIG. 14 will be described. FIG. 16 is a flowchart showing an example of the processing procedure of the regression line determination process in step S203 shown in FIG.

First, the line deviation correction processing unit 16d ₁ reads out an identification number corresponding to the end point of the line from the trajectory set table 15b, and sets M (M is an integer) to a value {(identification number corresponding to the end point of the line) −1}. Setting is made (step S301). In the example of FIG. 15, the identification number corresponding to the point B is read. Then, a line deviation correction processing unit 16d ₁ reduces the value of M by one (step S302).

Subsequently, the line deviation correction processing unit 16d ₁ determines whether or not the value of M is equal to or greater than the identification number of the starting point of the line (step S303). In the example of FIG. 15, it is determined whether or not M is a value equal to or greater than the identification number of the starting point A of the line AB.

Value of M, (if in step S303 of NO) if not an identification number greater than or equal to the starting point of the line, a line shift correction processing unit 16d ₁ is in the range from the point identification number is M to the end of the line The regression line slope a (a is a floating-point number) and intercept b (b is a floating-point number) with respect to a certain point is calculated by the following formula (step S306), and the regression line determination process ends.

Here, N is the identification number of the end point of the line, X _i is the X coordinate of the identification number i (M ≦ i ≦ N), and Y _i is the Y coordinate of the identification number i (M ≦ i ≦ N). Yes, M _X is the average value of X _i (M ≦ i ≦ N), and M _Y is the average value of Y _i (M ≦ i ≦ N).

In step S303, (YES in step S303) M may be an identification number or value of the starting point of the line, a line shift correction processing unit 16d ₁ are the coordinates of the range from the point identification number is M to the end The correlation coefficient R (Pearson's product moment correlation coefficient) (R is a floating-point number) is calculated by the following equation (step S304).

Then, the line deviation correction processing unit 16d ₁ determines whether or not the absolute value of the correlation coefficient R is greater than or equal to a predetermined value (step S305). When the absolute value of correlation coefficient R is not equal to or greater than the predetermined value (NO in step S305), the process proceeds to step S302, and the subsequent processing is continued.

  When the absolute value of correlation coefficient R is greater than or equal to a predetermined value (YES in step S305), the process of step S306 described above is executed, and the regression line determination process ends.

  FIG. 17 is a diagram illustrating a portion 23 of the line AB where the absolute value of the correlation coefficient R is equal to or greater than a predetermined value. In this case, in step S306 of FIG. 16, the slope and intercept of the regression line are calculated using the X and Y coordinates of the points included in the portion 23.

  Next, an example of a processing procedure of the line deviation correction process shown in step S117 of FIG. 7 will be described. FIG. 18 is a flowchart illustrating an example of a processing procedure of the line misalignment correction processing illustrated in step S117 of FIG.

First, a line deviation correction processing unit 16d _1, as the processing target of the regression line determination processing, it selects a line input by the user earlier in any of the two display (step S401). Then, a line deviation correction processing unit 16d _1, to the selected line, to perform a regression line setting processing described in FIG. 16, and calculates the slope of the regression line (step S402). In the example of FIG. 2, line deviation correction processing unit 16d ₁ calculates the slope of the regression line for the line AB.

Next, a line deviation correction processing unit 16d _1, as the processing target of the regression line determination processing, selecting the line input at different display than the display that previous line is input (step S403). Then, a line deviation correction processing unit 16d _1, to the selected line, to perform a regression line setting processing described in FIG. 16, and calculates the slope of the regression line (step S404). In the example of FIG. 2, line deviation correction processing unit 16d ₁ calculates the slope of the regression line for the line CD.

Thereafter, the line shift correction processing unit 16d ₁ is the absolute value of the difference between the two slopes of the regression line is determined first predetermined value (e.g., 0.35) to or smaller than a (step S405). If the absolute value of the difference between the two slopes of the regression line is less than the first predetermined value (YES in step S405), the line shift correction processing unit 16d ₁ is a line that is input later, previously input It arrange | positions on the extended line of the made line (step S406).

For example, as illustrated in FIG. 8, the line deviation correction processing unit 16d ₁ changes the position of the line CD on the line 20 to correct the line CD to the line C′D ′, and has been described with reference to FIG. As described above, the X and Y coordinates of the line CD in the trajectory set table 15b are corrected to the X and Y coordinates of the line C′D ′. Here, as the line 20, for example, a regression line of the line AB is used. Thereafter, the line misalignment correction process ends.

If the absolute value of the difference between the two slopes of the regression line is not less than the first predetermined value (NO in step S405), the line shift correction processing unit 16d _1, the difference between the two slopes of the regression line is second It is determined whether or not a predetermined value (for example, 0.7) or more (step S407).

Absolute value of the difference between the two slopes of the regression line is less than the second predetermined value (NO in step S407), the line shift correction processing unit 16d ₁ maintained a slope of the line that is input later The starting point of the line input later is placed on the extension line of the line input earlier (step S408).

For example, as shown in FIG. 9, the line deviation correction processing unit 16d ₁ changes the position of the start point C of the line CD on the line 20 while maintaining the inclination of the line CD, and changes the line CD to the line C ′. In addition to correction to D ′, processing for correcting the X and Y coordinates of the line CD in the trajectory set table 15 b to the X and Y coordinates of the line C′D ′ is performed. Thereafter, the line misalignment correction process ends.

In step S407, (YES in step S407) the absolute value of the difference between the two slopes of the regression line is the second case where more than the predetermined value, the linear displacement correction processing section 16d ₁ is a line that is input later While maintaining the position of the end point, the start point of the line input later is placed on the extension line of the line input earlier (step S409).

For example, the line deviation correction processing unit 16d ₁ changes the position of the start point C of the line CD on the line 20 while maintaining the position of the end point D of the line CD, as shown in FIG. Is corrected to the line C′D, and the X and Y coordinates of the line CD in the trajectory set table 15b are corrected to the X and Y coordinates of the line C′D. Thereafter, the line misalignment correction process ends.

  When a line CD is formed by connecting a plurality of points, the corrected line may not be a straight line. FIG. 19 is a diagram showing an example of line deviation correction when the line CD is composed of a plurality of points. In such a case, the portion 24 from the point C to the midpoint of the line CD is corrected, and the midpoint to the point D is adjusted according to the position of the midpoint.

  In the line deviation correction process, the correction method is selected using the absolute value of the difference in the slope of the regression line. Specifically, the degree of correction is made gentler as the absolute value of the difference increases. Thereby, it is possible to prevent the correction from being unnatural. Further, by calculating the slope of the regression line, the correction method can be appropriately selected even when the line AB and the line CD are not perfect straight lines.

  The present invention is not limited to the above-described embodiments, and various modifications and corrections can be made without departing from the scope of the present invention.

10 ... display unit, 11a ... first display, 11b ... second display, _11a 1, 11a 2 _... display area, 11c ... bezel area, 12 ... output control unit, 13 ... touch panel interface unit, 14 ... input unit, 15 ... Storage unit, 15a ... input event data, 15b ... trajectory set table, 15c ... pen down flag, 15d ... correction flag, 16 ... control unit, 16a ... input detection unit, 16b ... track set processing unit, 16c ... timer processing unit, 16d: correction unit, 16e: guide display processing unit, 20, 21 ... line, 22 ... guide line, 23, 24 ... line portion.

Claims (8)

In a display device including a plurality of displays having a function of accepting handwritten input,
An input detection unit for detecting handwritten input in the first display;
A correction unit that corrects information input by handwriting on the second display based on information of handwriting input detected in a predetermined peripheral area of the bezel of the first display by the input detection unit;
A display device comprising:   The handwritten input detected in the predetermined peripheral region is a first line handwritten input, the handwritten input to the second display is a second line handwritten input, and the correction unit The display device according to claim 1, wherein the information on the second line is corrected based on information on an extended line obtained by extending a line to an area of the second display.   The display device according to claim 2, wherein the correction unit changes a correction process of information on the second line based on a difference between the extension line and the second line.   The display device according to claim 3, wherein the correction process of the information on the second line includes a process of changing a position of the second line on the extension line.   The correction process of the information on the second line includes a process of changing the position of the start point of the second line on the extension line while maintaining the inclination of the second line. The display device according to claim 3 or 4.   The correction process of the information of the second line includes a process of changing the position of the start point of the second line on the extension line while maintaining the position of the end point of the second line. The display device according to claim 3, wherein the display device is a display device.   The guide display processing part which displays the said extension line as a guide line which guides the handwritten input of the said 2nd line on the said 2nd display further, The any one of Claims 2-6 characterized by the above-mentioned. The display device described.   The handwritten input detected in the predetermined peripheral area is a first line handwritten input, the handwritten input in the second display is a second line handwritten input, and the correction unit The display device according to claim 1, wherein information on a start point of the second line is corrected based on line information.

Images