JP2013097737A - Display device and display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device and a display program enabling effectively guiding an input position of a handwritten object, and in addition, capable of making the input handwritten object easy to recognize.SOLUTION: In a display device 1, a grid image display part 622 generates a lattice image 94 at a command of a start point 931 of an input operation to an input screen 21 after completion of an input operation to an input screen 21 corresponding to a reference object 92, and displays the generated lattice image 94 on a display surface 31. A grid image non-display part 623 then turns the lattice image 94 displayed on the display surface 31 to a non-display state when standby time timed by a clock part 616 reaches or exceeds a predetermined time.

Description

  The present invention relates to a display device and a display program capable of displaying an object input by handwriting on a touch panel formed integrally with a display panel on the display panel.

  Electronic blackboard systems, personal computers, mobile phone terminals, electronic notebooks, etc., include a display panel such as a liquid crystal display and a touch panel formed integrally with the display panel, and are input by handwriting A display device capable of displaying (characters, figures, etc.) is provided. In the display device, a trajectory based on input coordinate data of the handwriting input is displayed on the display panel by inputting the object by handwriting by an input operation on the touch panel.

  In such a display device, the display panel displays grids (grid-like ruled lines), ruled lines, grids, and the like that serve as a guide for character input positions in order to guide straight-line input of handwritten objects without distortion. Techniques to make it have been proposed.

  For example, Patent Document 1 discloses a technique for displaying ruled lines on the entire surface of a display panel at intervals corresponding to the position of an object input by handwriting and corresponding to the size of the object.

JP-A-8-115379

  However, in the technique disclosed in Patent Document 1, the ruled lines displayed on the entire surface of the display panel are irrelevant to the locus of handwriting input and become visual noise. It becomes difficult.

  Accordingly, an object of the present invention is to provide a display device and a display program that can make it easy to visually recognize an object input by handwriting while enabling the input position of the handwritten object to be effectively guided. is there.

The present invention has an input surface for handwritten input in which orthogonal coordinates with the X axis and Y axis as coordinate axes are set, and outputs coordinate data representing the position of a point designated by an input operation on the input surface. An input section;
A display unit having a display surface facing the input surface, and displaying a locus of handwriting input to the input surface on the display surface based on coordinate data output from the input unit;
An object extraction unit that extracts an object of an arbitrary shape based on coordinate data corresponding to a locus of handwritten input output from the input unit;
A reference object determination unit for determining an object satisfying a predetermined condition as a reference object based on the coordinate data of the object extracted by the object extraction unit;
A plurality of first ruled lines arranged in parallel with the X axis at equal intervals when an input operation start point for the input surface is instructed after the input operation for the input surface corresponding to the reference object is completed, and a Y axis A grid image display unit that generates a grid image in a grid shape that is orthogonal to a plurality of second ruled lines that are parallel to each other and arranged at equal intervals, and displays the generated grid image on the display surface;
It is determined whether or not an input operation is performed on the input surface, and a time measuring unit that counts a period during which the input operation is not performed as a standby time for the input operation;
In a state where the grid image is displayed on the display surface, a grid that hides the grid image displayed on the display surface when the standby time counted by the time measuring unit is equal to or longer than a predetermined time. An image non-display unit.

Further, the display device of the present invention, based on the coordinate data of the reference object, a reference object coordinate value calculation unit that calculates the maximum coordinate value and the minimum coordinate value for the X-axis and Y-axis coordinate axes in the reference object;
A reference object size calculation unit that calculates a size of the reference object in the X-axis direction and the Y-axis direction using a calculation result by the reference object coordinate value calculation unit;
The lattice image display unit is a lattice in which a first interval between the adjacent first ruled lines and a second interval between the adjacent second ruled lines are sizes based on a calculation result by the reference object size calculating unit. An image is generated, and the generated grid image is displayed on the display surface.

  In the display device according to the aspect of the invention, the grid image display unit may be configured such that the first and second intervals are calculated by the reference object size calculation unit, among the sizes in the X-axis direction and the Y-axis direction of the reference object. A grid image that matches the larger size is generated, and the generated grid image is displayed on the display surface so that the first and second ruled lines do not overlap the reference object.

  In the display device of the present invention, the object extraction unit extracts the object based on coordinate data corresponding to a locus input by handwriting within a predetermined time after an input operation is started on the input surface. It is characterized by doing.

  According to another aspect of the present invention, there is provided a display program that causes a computer including an input unit and a display unit to function as the display device.

  According to the present invention, the display device performs handwriting input of an object such as a character or a figure by a user input operation on the input surface of the input unit, whereby the locus of the object based on the coordinate data of the handwritten input is displayed on the display unit. It is a device that displays on a display surface. Furthermore, the display device includes an object extraction unit, a reference object determination unit, a lattice image display unit, a timing unit, and a lattice image non-display unit.

  The object extraction unit extracts an object having an arbitrary shape based on the coordinate data corresponding to the locus of handwriting input output from the input unit. The reference object determination unit determines an object satisfying a predetermined condition as a reference object based on the coordinate data of the object extracted by the object extraction unit. The lattice image display unit generates a lattice image when an input operation start point for the input surface is instructed after the input operation for the input surface corresponding to the reference object is completed. This lattice image is a lattice-like image in which a plurality of first ruled lines parallel to the X axis and arranged at equal intervals and a plurality of second ruled lines arranged at equal intervals in parallel to the Y axis are orthogonal. The grid image display unit displays the generated grid image on the display surface.

  In the display device configured as described above, when the user starts handwriting input of the next object after handwriting the reference object on the input surface, the lattice image is displayed on the display surface. A handwritten input can be made along a ruled line or a second ruled line. In this way, the display device can effectively guide the input position of the handwritten object.

  Further, in the display device of the present invention, the time measuring unit determines whether or not an input operation is performed on the input surface, and measures a period during which the input operation is not performed as a standby time for the input operation. The grid image non-display unit displays the grid image displayed on the display surface when the grid image is displayed on the display surface and the standby time counted by the time measuring unit is equal to or longer than a predetermined time. You want to hide.

  In the display device configured as described above, the lattice image non-display unit hides the lattice image currently displayed on the display surface when an input operation is not performed on the input surface for a predetermined time or longer. Therefore, when the user visually recognizes the object displayed on the display surface, the lattice image can be prevented from becoming visual noise, and the handwritten input object can be easily recognized. .

  According to the invention, the display device further includes a reference object coordinate value calculation unit and a reference object size calculation unit. The reference object coordinate value calculation unit calculates the maximum coordinate value and the minimum coordinate value for the X-axis and Y-axis coordinate axes of the reference object based on the coordinate data of the reference object. The reference object size calculation unit calculates the size of the reference object in the X-axis direction and the Y-axis direction using the calculation result by the reference object coordinate value calculation unit. The lattice image display unit displays a lattice image in which the first interval between the adjacent first ruled lines and the second interval between the adjacent second ruled lines have a size based on the calculation result by the reference object size calculating unit. The generated grid image is displayed on the display surface. In this way, the display device can display a grid image in which the first interval and the second interval are set according to the size of the reference object on the display surface.

  According to the invention, the lattice image display unit generates a lattice image in which the first interval and the second interval coincide with the larger size of the reference object in the X-axis direction and the Y-axis direction. To do. Then, the lattice image display unit displays the generated lattice image on the display surface so that the first ruled line and the second ruled line do not overlap the reference object. In the display device configured as described above, even if the user does not perform an operation for setting the first interval and the second interval in the lattice image to desired values, the first interval and the second interval are the reference object. The grid image set based on the size can be displayed on the display surface so that the first ruled line and the second ruled line do not overlap the reference object.

  According to the invention, the object extraction unit extracts an object based on coordinate data corresponding to a locus input by handwriting within a predetermined time after the input operation is started on the input surface. In this way, the display device can extract an object having an arbitrary shape such as a character or a graphic.

  According to the invention, the display program is a program for causing a computer including an input unit and a display unit to function as the display device. Such a display program makes it possible to effectively guide the input position of a handwritten object, and can control display processing that makes it easier to visually recognize an object input by handwriting by software. .

It is a figure which shows typically the external appearance of the display apparatus 1 which is one Embodiment of this invention. 3 is a block diagram illustrating a configuration of the display device 1. FIG. 3 is a flowchart showing the operation of the display device 1. 4 is a flowchart illustrating a drawing process procedure in the display device 1. 6 is a diagram for explaining the operation of the display device 1. FIG. 6 is a diagram for explaining the operation of the display device 1. FIG. 6 is a diagram for explaining the operation of the display device 1. FIG.

  FIG. 1 is a diagram schematically showing the appearance of a display device 1 according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating a configuration of the display device 1. The display device 1 includes a transparent touch panel 2 as an input unit, a display 3 as a display unit, a touch panel data processing unit 4, a display data processing unit 5, a control unit including an input control unit 61 and a display control unit 62. The CPU 6, the calculation unit 7, and the storage unit 8 are configured. The display device 1 is a device in which a locus based on the coordinate data of the handwritten input is displayed on the display 3 by inputting an object such as a character or a figure by handwriting through an input operation on the touch panel 2.

  The display 3 is configured by a liquid crystal display, for example, and has a display surface 31. The display 3 displays information received from the display control unit 62 described later on the display surface 31.

  The touch panel 2 has an input surface 21 in which orthogonal coordinates having the X axis and the Y axis as coordinate axes are set, and is laminated on the display surface 31 of the display 3 and is formed integrally with the display 3. The display surface 31 of the display 3 faces the input surface 21 of the touch panel 2, and orthogonal coordinates similar to those of the input surface 21 are set. In the present embodiment, the orthogonal coordinates set on the display surface 31 of the display 3 and the input surface 21 of the touch panel 2 have an origin at the upper left vertex toward the display surface 31 and the input surface 21, and the right direction is a positive X-axis. XY Cartesian coordinates with the direction and the downward direction as the positive direction of the Y axis.

  The touch panel data processing unit 4 is realized by a touch panel driver, and the display data processing unit 5 is realized by a display driver.

  The CPU 6 includes an input control unit 61 and a display control unit 62. The input control unit 61 detects an input operation on the input surface 21 of the touch panel 2. The input control unit 61 includes a position detection unit 611, a command detection unit 612, a contact detection unit 613, an object extraction unit 614, a reference object determination unit 615, and a timing unit 616.

  The position detection unit 611 detects a position on the input surface 21 of the touch panel 2 where the touch pen 91 or the like has come into contact. The position detection unit 611 acquires coordinate data representing the position of a point designated by an input operation with the touch pen 91 or the like on the input surface 21 and output from the touch panel 2.

  The command detection unit 612 detects a command corresponding to the command control icon selected by the touch pen 91 or the like from a plurality of command control icons on the operation panel 311 displayed on the display surface 31 of the display 3. In the present embodiment, the operation panel 311 is provided in the region of the left end portion of the display surface 31 in the X-axis direction. On the operation panel 311, a pen icon selected when a function as a “pen” for drawing a character or a graphic object is displayed, an eraser icon selected when a function as an “eraser” is displayed, In addition, command control icons such as a grid setting icon 3111 are arranged. The grid setting icon 3111 is a command control icon that is selected when a lattice image 94 described later is displayed on the display surface 31.

  A sheet list display area 312 is formed at the lower end of the display surface 31 in the Y-axis direction. In the present embodiment, a plurality of images can be switched and displayed in the display area on the display surface 31 of the display 3 corresponding to the drawing area on the input surface 21 of the touch panel 2. A plurality of sheet selection keys 3123 are arranged in the sheet list display area 312, and by operating any sheet selection key 3123, an image corresponding to the sheet selection key 3123 can be switched and displayed. .

  The sheet list display area 312 is provided with an arrow key 3121 and a non-display selection key 3122. By operating the arrow key 3121, the display of the sheet selection key 3123 can be scrolled, and the non-display is performed. By operating the selection key 3122, the sheet list display area 312 can be hidden.

  In addition, a scroll key 313 is disposed at the upper right end toward the display surface 31, and by operating the scroll key 313, an image displayed on the display surface 31 is scrolled in the X-axis direction. be able to.

  The contact detection unit 613 detects whether or not the touch pen 91 or the like is in contact with the touch panel 2, that is, whether or not an input operation is performed on the input surface 21 of the touch panel 2.

  The object extraction unit 614 recognizes an object having an arbitrary shape based on coordinate data corresponding to a locus of handwriting input output from the touch panel 2 by an input operation on the input surface 21 of the touch panel 2, and represents each recognized object. Coordinate data (in this embodiment, all coordinate data corresponding to the locus of the object) is extracted. The object extraction unit 614 recognizes an object based on coordinate data corresponding to a locus input by handwriting within a predetermined time (continuous touch time) after the input operation on the input surface 21 of the touch panel 2 is started. Extract the coordinate data for each recognized object. Note that the coordinate data for each object extracted by the object extraction unit 614 is stored in a touch panel input coordinate storage unit 812 described later.

  The reference object determination unit 615 determines an object satisfying a predetermined condition among the objects extracted by the object extraction unit 614 as a reference object. The reference object determined by the reference object determination unit 615 is an object that is the base point of the basic cell 943 in the lattice image 94 generated by the lattice image display unit 622 described later. Specifically, the reference object determination unit 615 is the first handwritten input to the input surface 21 of the touch panel 2 after the command detection unit 612 detects that the grid setting icon 3111 has been operated by the touch pen 91. The input object is determined as a reference object.

  The timer 616 measures the elapsed time since the input operation on the input surface 21 of the touch panel 2 is started. In addition, the time measuring unit 616 determines whether or not an input operation on the input surface 21 of the touch panel 2 is performed, and measures a period during which the input operation is not performed as a standby time for the input operation.

  The display control unit 62 performs control for displaying information on the display 3. The display control unit 62 includes a trajectory display control unit 621, a lattice image display unit 622, and a lattice image non-display unit 623.

  The trajectory display control unit 621 transmits handwritten input coordinate data input to the input surface 21 of the touch panel 2 to the display 3 and displays a handwritten input trajectory based on the coordinate data on the display surface 31 of the display 3.

  The lattice image display unit 622 generates a lattice image 94 when an input operation start point on the input surface 21 is instructed after the input operation on the input surface 21 corresponding to the reference object determined by the reference object determination unit 615 is completed. To do. The grid image 94 is a grid-like image in which a plurality of first ruled lines 941 parallel to the X axis and arranged at equal intervals and a plurality of second ruled lines 942 arranged at equal intervals in parallel to the Y axis are orthogonal. It is. In other words, in this grid image 94, a plurality of basic cells 943 are aligned with a region surrounded by two adjacent first ruled lines 941 and two adjacent second ruled lines 942 as basic cells 943. It is a grid-like image arranged.

  In the present embodiment, in the lattice image 94 generated by the lattice image display unit 622, the first interval GW1 between the adjacent first ruled lines 941 and the second interval GW2 between the adjacent second ruled lines 942 are set to be the same. That is, the basic cell 943 is formed in a square shape. Then, the grid image display unit 622 displays the generated grid image 94 on the display surface 31.

  In the display device 1 configured as described above, when the user starts handwriting input of the next object after handwriting input of the reference object to the input surface 21, the lattice image 94 is displayed on the display surface 31, and thus the lattice A handwritten input can be made along the first ruled line 941 or the second ruled line 942 of the image 94. In this way, the display device 1 can effectively guide the input position of the handwritten object.

  The grid image non-display unit 623 is displayed on the display surface 31 when the grid image 94 is displayed on the display surface 31 and the standby time counted by the time measuring unit 616 exceeds a predetermined time. The grid image 94 is hidden.

  In the display device 1 configured as described above, the lattice image non-display unit 623 displays the lattice image currently displayed on the display surface 31 when the input operation on the input surface 21 is not performed for a predetermined time or longer. Since 94 is not displayed, it is possible to prevent the lattice image 94 from becoming visual noise when the user visually recognizes the object displayed on the display surface 31. It can make it easy to visually recognize.

  The calculation unit 7 includes a reference object coordinate value calculation unit 71, a reference object size calculation unit 72, and a basic cell base point coordinate calculation unit 73.

  The reference object coordinate value calculation unit 71 calculates the maximum coordinate value and the minimum coordinate value for the X axis and the Y axis in the reference object based on the coordinate data of the reference object determined by the reference object determination unit 615. The calculation result calculated by the reference object coordinate value calculation unit 71 is stored in an object display information storage unit 814 described later.

  The reference object size calculation unit 72 calculates the size of the reference object in the X-axis direction and the Y-axis direction using the calculation result by the reference object coordinate value calculation unit 71. Specifically, the reference object size calculation unit 72 calculates the size (X size) of the reference object in the X-axis direction by taking the difference between the maximum coordinate value and the minimum coordinate value about the X axis of the reference object, The size (Y size) in the Y-axis direction of the reference object is calculated by taking the difference between the maximum coordinate value and the minimum coordinate value about the Y-axis of the reference object. The calculation result calculated by the reference object size calculation unit 72 is stored in an object display information storage unit 814 described later.

  The basic cell base point coordinate calculation unit 73 calculates the coordinates serving as the base point of the basic cell 943 in the lattice image 94 using the calculation result by the reference object coordinate value calculation unit 71 and the calculation result by the reference object size calculation unit 72. Here, it is assumed that the grid image 94 is displayed so that one basic cell 943 constituting the grid image 94 surrounds the reference object determined by the reference object determination unit 615. A vertex (corresponding to the upper left vertex of the basic cell 943) represented by the minimum coordinate values for the X axis and the Y axis in 943 is the base point of the basic cell 943. That is, among the four vertices in the basic cell 943 surrounding the reference object, the reference object reference point represented by the minimum coordinate values for the X and Y axes in the reference object (corresponding to the upper left vertex of the circumscribed rectangle of the reference object) The vertex closest to is the base point of the basic cell 943. A specific coordinate calculation method by the basic cell base coordinate calculation unit 73 will be described later. The calculation result calculated by the basic cell base point coordinate calculation unit 73 is stored in a lattice image information storage unit 815 described later.

  The storage unit 8 includes a storage device such as a semiconductor memory or a hard disk device, and includes a first storage unit 81 and a second storage unit 82.

  The first storage unit 81 has a function as a working memory in the display device 1. The first storage unit 81 includes a display display information storage unit 811, a touch panel input coordinate storage unit 812, an operation panel display information storage unit 813, an object display information storage unit 814, and a lattice image information storage unit 815.

  The display display information storage unit 811 stores display information displayed on the display 3. The touch panel input coordinate storage unit 812 stores the coordinate data of the object input by handwriting on the input surface 21 of the touch panel 2. The operation panel display information storage unit 813 stores information such as operation panel image information representing an image of each command control icon arranged on the operation panel 311 and coordinate information on the display surface 31 of each command control icon.

  The object display information storage unit 814 includes coordinates of an object reference point (corresponding to the upper left vertex of a circumscribed rectangle of each object) represented by the minimum coordinate values for the X axis and the Y axis in the object extracted by the object extraction unit 614, and The information regarding the size in the X-axis direction and the Y-axis direction of the object extracted by the object extraction unit 614 is stored.

  The lattice image information storage unit 815 has a size (a size of one side of the basic cell 943) of the first interval GW1 between the first ruled lines 941 and the second interval GW2 between the second ruled lines 942 in the lattice image 94, and the basic described above. The grid image information related to the coordinates of the base point of the cell 943 is stored.

  The second storage unit 82 includes a software storage unit 821, a driver storage unit 822, and a continuous touch determination time storage unit 823.

  The software storage unit 821 stores software for operating the display device 1. The driver storage unit 822 stores a touch panel driver that implements the touch panel data processing unit 4 and a display driver that implements the display data processing unit 5. The continuous touch determination time storage unit 823 stores the above-described continuous touch time used when the object extraction unit 614 recognizes an object.

  Next, the operation of the display device 1 of the present embodiment will be described. FIG. 3 is a flowchart showing the operation of the display device 1. FIG. 4 is a flowchart illustrating a drawing process procedure in the display device 1. 5A, 5B, and 5C are diagrams for explaining the operation of the display device 1. FIG. In the following description, the Cartesian coordinates set on the input surface 21 of the touch panel 2 and the display surface 31 of the display 3 are based on the upper left vertex toward the input surface 21 and the display surface 31 as the origin, and the right direction is the positive X axis. XY Cartesian coordinates with the direction and the downward direction as the positive direction of the Y axis.

  In step s <b> 1, the contact detection unit 613 detects whether or not a start point instruction indicating the start of an input operation has been input to the input surface 21 of the touch panel 2. When the contact detection unit 613 detects the start of the input operation, the process proceeds to step s2, and when the start of the input operation is not detected, the step s1 is repeated.

  In step s2, the input controller 61 determines that the starting point of the input operation detected by the contact detector 613 is the drawing area on the input surface 21 (the region of the input surface 21 corresponding to the region excluding the operation panel 311 on the display surface 31). It is determined whether or not the operation is an input operation. If the input control unit 61 determines that the input operation is for the drawing area, the process proceeds to step s3. If the input control unit 61 determines that the input operation is not for the drawing area, the process proceeds to step s11.

  In step s3, the CPU 6 determines whether or not lattice image information is stored in the lattice image information storage unit 815.

  In step s2, the CPU 6 determines that the input operation detected by the contact detection unit 613 is an input operation for the drawing area. In step s3, the CPU 6 determines that lattice image information is stored in the lattice image information storage unit 815. If it is determined, the condition for displaying the grid image 94 on the display surface 31 of the display 3 is determined to be satisfied. That is, when the lattice image information is stored in the lattice image information storage unit 815, the CPU 6 sets the first interval GW1 between the first ruled lines 941 and the second interval GW2 between the second ruled lines 942 in the lattice image 94. Information about the reference object 92 (the X size X1, the Y size Y1, and the reference object 92) for calculating the size (size of one side of the basic cell 943) and the grid image information related to the coordinates of the base point 944 of the basic cell 943 It is determined that the coordinates of the reference object reference point 921) have already been acquired and stored in the object display information storage unit 814.

  In such a case, the input operation detected by the contact detection unit 613 in step s1 is performed by operating the grid setting icon 3111 as shown in FIG. 5A (a), and further, as shown in FIG. 5A (b). This is an input operation performed after an input operation on the input surface 21 corresponding to the object 92 is completed and the reference object 92 is displayed on the display surface 31 and an input start point 931 on the input surface 21 is instructed.

  The grid image 94 relates to the size of the first interval GW1 between the first ruled lines 941 and the second interval GW2 between the second ruled lines 942 (the size of one side of the basic cell 943), and the coordinates of the base point 944 of the basic cell 943. A method for generating lattice image information will be described in steps s11 to s23 described later.

  In step s2, the CPU 6 determines that the input operation detected by the contact detection unit 613 is an input operation for the drawing area. In step s3, the grid image information is not stored in the grid image information storage unit 815. If it is determined, it is determined that it is not necessary to display the grid image 94 on the display surface 31 of the display 3. In such a case, the input operation detected by the contact detection unit 613 in step s1 is an input operation in a state where the grid setting icon 3111 is not operated.

  In step s3, if the CPU 6 determines that the lattice image information is stored in the lattice image information storage unit 815, the process proceeds to step s4. If the CPU 6 determines that the lattice image information is not stored, the process proceeds to step s9. move on.

  In step s4, the lattice image display unit 622 extracts the lattice image information stored in the lattice image information storage unit 815. In the next step s5, the lattice image display unit 622 generates a lattice image 94 based on the extracted lattice image information. Specifically, as shown in FIG. 5B (c), the grid image display unit 622 performs a single ruled line 941 passing through the coordinates representing the base point 944 of the basic cell 943 included in the grid image information. A plurality of first ruled lines 941 are arranged in parallel to the X axis and at equal intervals of the first interval GW1 in the Y axis direction, and parallel to the Y axis with respect to one second ruled line 942 passing through the coordinates representing the base point 944. A lattice image 94 is generated in which a plurality of second ruled lines 942 are arranged at equal intervals of the second interval GW2 (= first interval GW1) in the X-axis direction. Then, the grid image display unit 622 displays the generated grid image 94 on the display surface 31.

  In the display device 1 according to the present embodiment, when the input start point 931 for the input surface 21 is instructed after the reference object 92 is displayed (step s2), the lattice image 94 is displayed on the display surface 31. A handwritten input can be made along the first ruled line 941 or the second ruled line 942 of the image 94. In this way, the display device 1 can effectively guide the input position of a new handwritten object with respect to the reference object 92.

  Next, in step s6, as shown in FIG. 5B (d), the object extraction unit 614 displays the input operation trajectory instructed by the input start point 931 on the input surface 21 after the reference object 92 is displayed. A new input object (hereinafter referred to as “new object”) 93 is extracted based on the corresponding coordinate data. Then, the trajectory display control unit 621 transmits the coordinate data of the new object 93 extracted by the object extraction unit 614 to the display 3 and displays the new object 93 on the display surface 31 of the display 3 based on the coordinate data. Details of the object drawing process by the object extraction unit 614 and the trajectory display control unit 621 will be described later.

  Next, in step s7, the object display information storage unit 814 displays the object reference point (the circumscribed rectangle of the new object 93) represented by the minimum coordinate values for the X axis and the Y axis in the new object 93 extracted by the object extraction unit 614. Information corresponding to the coordinates of the upper left vertex of X), the size of the new object 93 in the X-axis direction (X size), and the size in the Y-axis direction (Y size).

  Next, in step s8, when the grid image non-display unit 623 displays the grid image 94 on the display surface 31 and the standby time counted by the time measuring unit 616 is equal to or longer than a predetermined time, FIG. As shown in 5C (e), the grid image 94 displayed on the display surface 31 is hidden. Accordingly, when the input operation on the input surface 21 is not performed for a period longer than a predetermined time, the lattice image non-display unit 623 hides the lattice image 94 currently displayed on the display surface 31. When the user visually recognizes an object displayed on the display surface 31 (in FIG. 5C (e), an object composed of characters “A” and “B”), the lattice image 94 becomes visual noise. Can be prevented, and an object input by handwriting can be easily viewed.

  Note that the grid image 94 displayed on the display surface 31 may be hidden by operating the grid setting icon 3111 again while the grid image 94 is displayed on the display surface 31.

  When the non-display processing of the lattice image 94 is completed in step s8, the process returns to step s1 and waits until the next input operation is performed.

  Further, as described above, in step s3, it is determined that the grid image information is not stored in the grid image information storage unit 815, and the input operation detected by the contact detection unit 613 in step s1 is performed by the grid setting icon 3111. If it is determined that the input operation is not performed, the process proceeds to step s9.

  In step s9, the object extraction unit 614 extracts an object based on the coordinate data corresponding to the locus of the input operation on the input surface 21. Then, the trajectory display control unit 621 transmits the object coordinate data extracted by the object extraction unit 614 to the display 3, and displays the object on the display surface 31 of the display 3 based on the coordinate data. Details of the object drawing process by the object extraction unit 614 and the trajectory display control unit 621 will be described later.

  Next, in step s10, the object display information storage unit 814 displays the coordinates of the object reference point represented by the minimum coordinate values for the X axis and the Y axis in the object extracted by the object extracting unit 614, and the X axis direction of the object. Information on the size (X size) and the size in the Y-axis direction (Y size) is stored.

  When the object display information storage process is completed in step s10, the process returns to step s1 and waits until the next input operation is performed.

  Further, as described above, when it is determined in step s2 that the detection result by the contact detection unit 613 in step s1 is not an input operation for the drawing area of the input surface 21, the process proceeds to step s11.

  In step s11, the input control unit 61 determines whether or not the detection result by the contact detection unit 613 in step s1 indicates an input for operating the grid setting icon 3111 arranged on the operation panel 311. . If the input control unit 61 determines that the input is for operating the grid setting icon 3111, the process proceeds to step s13. If the input control unit 61 determines that the input is not for operating the grid setting icon 3111, the process proceeds to step s12.

  In step s12, the CPU 6 determines that a command control icon other than the grid setting icon 3111 has been operated on the operation panel 311 and executes processing corresponding to the selected command control icon. When the process corresponding to the command control icon is completed in step s12, the process returns to step s1 and waits until the next input operation is performed.

  In step s13 after it is determined that there is an input for operating the grid setting icon 3111 in step s11, the CPU 6 determines whether or not lattice image information is stored in the lattice image information storage unit 815. When the CPU 6 determines that the lattice image information is stored, the process proceeds to step s14, and when the CPU 6 determines that the lattice image information is not stored, the process proceeds to step s15.

  In step s14, the CPU 6 causes the lattice image information storage unit 815 to clear (erase) the currently stored lattice image information.

  Next, in step s15, the object extraction unit 614 extracts an object based on the coordinate data corresponding to the locus of handwriting input output from the touch panel 2. The object extracted by the object extraction unit 614 in step s15 is an object that is first handwritten on the input surface 21 after the grid setting icon 3111 is operated. Therefore, the reference object determination unit 615 determines this input object as the reference object 92. Then, the trajectory display control unit 621 transmits the coordinate data of the object (reference object 92) extracted by the object extraction unit 614 to the display 3, and displays the reference object 92 on the display surface 31 of the display 3 based on the coordinate data. Let Details of the object drawing process by the object extraction unit 614 and the trajectory display control unit 621 will be described later.

  Next, in step s16, the object display information storage unit 814 is extracted by the object extraction unit 614 and is represented by a reference value represented by the minimum coordinate values for the X axis and the Y axis in the reference object 92 determined by the reference object determination unit 615. Information on the coordinates of the object reference point 921, the X size X1 in the X axis direction of the reference object 92, and the Y size Y1 in the Y axis direction (reference object display information) is stored. The coordinates of the reference object reference point 921 stored in the object display information storage unit 814 are those calculated by the reference object coordinate value calculation unit 71. The X size X1 and the Y size Y1 of the reference object 92 are the reference object size. This is calculated by the calculation unit 72.

  Next, in step s17, the basic cell base point coordinate calculation unit 73 reads the reference object display information from the object display information storage unit 814 and determines whether or not the X size X1 is larger than the Y size Y1 in the reference object 92. To do. If the basic cell base point coordinate calculation unit 73 determines that the X size X1 is larger than the Y size Y1, the process proceeds to step s18, where the X size X1 is not larger than the Y size Y1 (the X size X1 is equal to or smaller than the Y size Y1). ), The process proceeds to step s21.

  In step s18, the basic cell base point coordinate calculation unit 73 sets the size of the first interval GW1 between the first ruled lines 941 and the second interval GW2 between the second ruled lines 942 in the lattice image 94 (the size of one side of the basic cell 943). X size X1 is set. The size of one side of the basic cell 943 set by the basic cell base point coordinate calculation unit 73 in this way is stored in the lattice image information storage unit 815.

  Next, in step s19, the basic cell base point coordinate calculation unit 73 uses the X coordinate of the reference object reference point 921 represented by the minimum coordinate values for the X axis and the Y axis in the reference object 92 as the base point 944 in the basic cell 943. Is set as the X coordinate. Thus, the X coordinate of the base point 944 in the basic cell 943 set by the basic cell base point coordinate calculation unit 73 is stored in the lattice image information storage unit 815.

Next, in step s20, the basic cell base point coordinate calculation unit 73 calculates the Y coordinate of the base point 944 in the basic cell 943 using the reference object display information. Specifically, the basic cell base point coordinate calculation unit 73 calculates the Y coordinate (Ya) of the base point 944 based on the following formula (1).
Ya = reference point Yb-{(X size X1) / 2- (Y size Y1) / 2} (1)
[In the formula, the reference point Yb indicates the Y coordinate of the reference object reference point 921. ]

  Thus, the Y coordinate of the base point 944 in the basic cell 943 calculated by the basic cell base point coordinate calculation unit 73 is stored in the lattice image information storage unit 815.

  When the X size X1 of the reference object 92 is larger than the Y size Y1, the basic cell base point coordinate calculation unit 73 obtains the size of one side of the basic cell 943 and the coordinates of the base point 944 in the grid image 94 through steps s18 to s20. Set and calculate the lattice image information to be included.

  In step s20, when the setting and calculation of the lattice image information is completed and the lattice image information is stored in the lattice image information storage unit 815, the process returns to step s1 and waits until the next input operation is performed.

  In step s17, when the basic cell base point coordinate calculation unit 73 determines that the X size X1 of the reference object 92 is equal to or smaller than the Y size Y1, the process proceeds to step s21.

  In this step s21, the basic cell base point coordinate calculation unit 73 has the size of the first interval GW1 between the first ruled lines 941 and the second interval GW2 between the second ruled lines 942 in the lattice image 94 (the size of one side of the basic cell 943). Y size Y1 is set. The size of one side of the basic cell 943 set by the basic cell base point coordinate calculation unit 73 in this way is stored in the lattice image information storage unit 815.

  Next, in step s22, the basic cell base point coordinate calculation unit 73 uses the Y coordinate of the reference object reference point 921 represented by the minimum coordinate values for the X axis and the Y axis in the reference object 92 as the base point 944 in the basic cell 943. Is set as the Y coordinate. Thus, the Y coordinate of the base point 944 in the basic cell 943 set by the basic cell base point coordinate calculation unit 73 is stored in the lattice image information storage unit 815.

Next, in step s23, the basic cell base point coordinate calculation unit 73 calculates the X coordinate of the base point 944 in the basic cell 943 using the reference object display information. Specifically, the basic cell base point coordinate calculation unit 73 calculates the X coordinate (Xa) of the base point 944 based on the following formula (2).
Xa = reference point Xb-{(Y size Y1) / 2- (X size X1) / 2} (2)
[In the formula, the reference point Xb indicates the X coordinate of the reference object reference point 921. ]

  Thus, the X coordinate of the base point 944 in the basic cell 943 calculated by the basic cell base point coordinate calculation unit 73 is stored in the lattice image information storage unit 815.

  When the X size X1 of the reference object 92 is equal to or smaller than the Y size Y1, the basic cell base point coordinate calculation unit 73 goes through step s21 to step s23, the size of one side of the basic cell 943 in the lattice image 94, and the coordinates of the base point 944. Is set and calculated.

  For example, when the coordinates of the reference object reference point 921 are (3, 6), the X size X1 of the reference object 92 is “0.6”, and the Y size Y1 is “0.8”, the basic cell base point coordinate calculation unit 73 Sets the size of one side of the basic cell 943 to “0.8”, sets the Y coordinate of the base point 944 to “6”, and sets the X coordinate of the base point 944 to “2.9” based on the above equation (2). Is calculated.

  In step s23, when the setting and calculation of lattice image information is completed and the lattice image information is stored in the lattice image information storage unit 815, the process returns to step s1 and waits until the next input operation is performed.

  With reference to FIG. 4, the drawing process in steps s6, s9, and s15 described above will be described.

  First, in step a <b> 1, the contact detection unit 613 detects the start of an input operation on the input surface 21 of the touch panel 2. Next, in step a2, the object extraction unit 614 acquires a preset continuous touch time (for example, 3 seconds) from the continuous touch determination time storage unit 823. Next, in step a <b> 3, the time measuring unit 616 measures the elapsed time from the start of the input operation on the input surface 21 of the touch panel 2 by counting down from the continuous touch time.

  Next, in step a4, the object extraction unit 614 determines whether or not the countdown by the timekeeping unit 616 has ended, that is, the time for which the handwritten input locus should be recognized as one object (drawing end time). It is determined whether or not elapses. If the object extraction unit 614 determines that the drawing end time has elapsed, the process proceeds to step a5.

  In step a5, the object extraction unit 614 recognizes the object based on the coordinate data corresponding to the locus input by handwriting within the continuous touch time after the input operation on the input surface 21 of the touch panel 2 is started, and recognizes the object. The coordinate data for each object is extracted. Then, the trajectory display control unit 621 transmits the object coordinate data extracted by the object extraction unit 614 to the display 3, and displays the object on the display surface 31 of the display 3 based on the coordinate data.

  As described above, the object drawing process by the object extracting unit 614 and the trajectory display control unit 621 is completed through the steps a1 to a5.

  As still another embodiment of the present invention, in order to cause a computer to function as the display device 1 described above, at least one of a display program (an execution format program, an intermediate code program, and a source program) to be executed by the computer. It is also possible to provide a computer-readable recording medium on which the display program is recorded.

  As a recording medium for recording the display program, a memory (not shown) such as a CD-ROM (Compact Disc-Read Only Memory) itself is a program medium because processing is performed by a microcomputer. Alternatively, although not shown, a program reading device may be provided as an external storage device, and the program medium may be read by inserting a recording medium therein.

  In any case, the stored display program may be configured to be accessed and executed by a microprocessor, or in any case, the display program is read and the read display program is a microcomputer. The program may be downloaded to a program storage area (not shown) and the display program is executed. It is assumed that this download program is stored in the main device in advance.

  The program medium is a recording medium configured to be separable from the main body, and is a tape system such as a magnetic tape or a cassette tape, a magnetic disk such as a floppy (registered trademark) disk or a hard disk, or a CD-ROM / MO (Magneto Optical disc). ) / MD (Mini Disc) / DVD (Digital Versatile Disc) optical discs, IC (Integrated Circuit) cards (including memory cards) / Optical cards, etc., Mask ROM, EPROM (Erasable Programmable Read) It may be a medium that carries a fixed program including a semiconductor memory such as an only memory), an EEPROM (registered trademark) (electrically erasable programmable read only memory), or a flash ROM.

  Further, it may be a medium that has a system configuration capable of connecting to a communication network including the Internet so that the display program is fluidly carried so as to download the display program from the communication network. When the display program is downloaded from the communication network as described above, the download program may be stored in the main device in advance or installed from another recording medium. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the display program is embodied by electronic transmission.

DESCRIPTION OF SYMBOLS 1 Display apparatus 2 Touch panel 3 Display 4 Touch panel data processing part 5 Display data processing part 6 CPU
7 arithmetic unit 8 storage unit 21 input surface 31 display surface 61 input control unit 62 display control unit 71 reference object coordinate value calculation unit 72 reference object size calculation unit 73 basic cell base point coordinate calculation unit 81 first storage unit 82 second storage unit 611 Position detection unit 612 Command detection unit 613 Contact detection unit 614 Object extraction unit 615 Reference object discrimination unit 616 Timekeeping unit 621 Trajectory display control unit 622 Grid image display unit 623 Grid image non-display unit

Claims (5)

An input unit that has an input surface for handwritten input in which orthogonal coordinates with the X axis and the Y axis as coordinate axes are set, and that outputs coordinate data representing the position of a point designated by an input operation on the input surface;
A display unit having a display surface facing the input surface, and displaying a locus of handwriting input to the input surface on the display surface based on coordinate data output from the input unit;
An object extraction unit that extracts an object of an arbitrary shape based on coordinate data corresponding to a locus of handwritten input output from the input unit;
A reference object determination unit for determining an object satisfying a predetermined condition as a reference object based on the coordinate data of the object extracted by the object extraction unit;
A plurality of first ruled lines arranged in parallel with the X axis at equal intervals when an input operation start point for the input surface is instructed after the input operation for the input surface corresponding to the reference object is completed, and a Y axis A grid image display unit that generates a grid image in a grid shape that is orthogonal to a plurality of second ruled lines that are parallel to each other and arranged at equal intervals, and displays the generated grid image on the display surface;
It is determined whether or not an input operation is performed on the input surface, and a time measuring unit that counts a period during which the input operation is not performed as a standby time for the input operation;
In a state where the grid image is displayed on the display surface, a grid that hides the grid image displayed on the display surface when the standby time counted by the time measuring unit is equal to or longer than a predetermined time. An image non-display unit. A reference object coordinate value calculation unit that calculates a maximum coordinate value and a minimum coordinate value for the coordinate axes of the X axis and the Y axis in the reference object based on the coordinate data of the reference object;
A reference object size calculation unit that calculates a size of the reference object in the X-axis direction and the Y-axis direction using a calculation result by the reference object coordinate value calculation unit;
The lattice image display unit is a lattice in which a first interval between the adjacent first ruled lines and a second interval between the adjacent second ruled lines are sizes based on a calculation result by the reference object size calculating unit. The display device according to claim 1, wherein an image is generated, and the generated grid image is displayed on the display surface.   In the grid image display unit, the first and second intervals are equal to a larger one of the sizes in the X-axis direction and the Y-axis direction of the reference object calculated by the reference object size calculation unit. 3. The display device according to claim 2, wherein a grid image is generated, and the generated grid image is displayed on the display surface so that the first and second ruled lines do not overlap the reference object.   The object extracting unit extracts the object based on coordinate data corresponding to a locus input by handwriting within a predetermined time after an input operation is started on the input surface. The display device according to any one of 1 to 3.   A display program for causing a computer including an input unit and a display unit to function as the display device according to claim 1.