JP5024019B2 - Terminal device and program thereof - Google Patents

Description

  The present invention belongs to the technical field of displaying on a terminal device characters or pictures drawn on dedicated paper with an electronic pen or a scanner.

  In recent years, pen-type input devices called “electronic pens”, “digital pens” and the like have appeared (hereinafter referred to as “electronic pens” in this specification), and a representative example thereof is Anoto (Anoto, Sweden). "Anoto pen" developed by the company is known (see Patent Document 1). This anotopen is used with special paper on which a predetermined dot pattern is printed. In addition to the usual ink-type pen tip, the anotopen has a small camera for reading the dot pattern on the special paper and a data communication unit. It is installed.

  When a user writes characters on the special paper with an annotation pen, or puts a check mark on the image designed on the special paper, the small camera displays the dot pattern printed on the special paper as the pen moves. Entry information such as characters and images detected and written by the user is acquired. This entry information is transmitted from the Anotopen by the data communication unit to a terminal device such as a nearby personal computer or mobile phone.

  The system using this anotopen can be used as an input device in place of the keyboard, and is very easy to use for users who are reluctant to use the personal computer and keyboard described above. Therefore, currently, a system using an electronic pen is becoming widespread as a method for digitizing data entered in various business documents, application forms, contracts, and the like (see, for example, Patent Document 2).

  On the other hand, as a screen scroll method for a stylus, when a user taps on the stylus with an electronic pen after drawing a stroke, the stroke method is used to translate the drawn stroke in parallel to the tapped point with the point closest to the present in time series Alternatively, a stroke method is known in which, when a stroke is drawn, two points on the stylus are tapped with an electronic pen, and the drawn stroke is translated by a vector amount between the two points (for example, Patent Document 3).

Japanese translation of PCT publication No. 2003-511761 JP 2004-153612 A JP-A-6-149464

  When using an electronic pen such as that found in the above Anoto technology, characters and designs are entered on a special paper on which a predetermined dot pattern is printed, and the characters and designs corresponding to the entered information are sent to the terminal device. Can be displayed on the display. However, when the display area of the dedicated paper in the terminal device is narrower than the size of the dedicated paper, there is a problem that the entire written stroke may not be displayed.

  As a method for controlling the display position of such a stroke, for example, Japanese Patent Laid-Open No. 6-149464 (Patent Document 3) discloses a method of translating a stroke by a vector amount between two points tapped with an electronic pen. It is disclosed. However, the method described in this document requires a pen operation different from the entry operation of tapping two points with an electronic pen to move the entered stroke.

  The present invention has been made in view of such problems, and an object of the present invention is to provide dedicated paper for the terminal device when displaying the entry information obtained using the electronic pen or the scanner on the terminal device. When the display area is smaller than the size of the dedicated paper, a terminal device having a function of automatically scrolling and displaying a stroke that has been entered to an optimum position and a program thereof are provided.

The terminal device according to the present invention receives entry information generated and transmitted by the electronic pen or scanner corresponding to the stroke when drawing a character or a picture with the electronic pen or scanner on the dedicated paper on which the coded pattern is printed. A receiving device for receiving entry information, and when displaying a stroke on the display based on the received entry information, the next entered stroke is completely outside the frame of the application window. , Calculate the coordinate value of the circumscribed rectangle that surrounds the stroke, and move the image so that the corner point of the circumscribed rectangle matches the positioning coordinates set inside the application window. And a processing means for displaying on the screen .

According to this configuration, when the user draws a character or a picture on the dedicated paper with the electronic pen or the scanner, the entry information is transmitted to the terminal device by the electronic pen or the scanner, and the terminal device receives the electronic pen or the scanner by the receiving unit. Positioning coordinates in which the circumscribing rectangle coordinates that surround the stroke are calculated by the processing means based on the entry information and the corner points of the circumscribing rectangle are set inside the application window. By moving the image to fit the next stroke , even if the next stroke is completely out of the frame of the application window, the next stroke is automatically moved to a position that is easy to see. Can be displayed.

In addition, the terminal device according to the present invention, when drawing a character or a picture with an electronic pen or a scanner on dedicated paper on which a coded pattern is printed, entry information generated and transmitted by the electronic pen or the scanner corresponding to the stroke. And a receiving means for receiving entry information, and when displaying a stroke on the display based on the received entry information, a coordinate value of a circumscribed rectangle surrounding the entered stroke is calculated, and the circumscribed rectangle is calculated. By moving the image so that the corner points of the corners are aligned with the positioning coordinates set inside the application window, the strokes entered are displayed within the frame of the application window. Coordinate value of circumscribed rectangle that surrounds the stroke when it is out of the frame And a processing means for displaying the stroke within the frame of the application window by calculating and moving the image so that the corner point of the circumscribed rectangle matches the positioning coordinates set inside the application window. And
According to this configuration, when the user draws a character or a picture on the dedicated paper with the electronic pen or the scanner, the entry information is transmitted to the terminal device by the electronic pen or the scanner, and the terminal device receives the electronic pen or the scanner by the receiving unit. Positioning coordinates in which the circumscribing rectangle coordinates that surround the stroke are calculated by the processing means based on the entry information and the corner points of the circumscribing rectangle are set inside the application window. By moving the image so that it fits, the strokes entered are automatically scrolled and displayed efficiently even if the display area of the dedicated paper in the terminal device is smaller than the size of the dedicated paper And the next stroke is completely out of the application window frame. It can be displayed by moving the automatically legible position following strokes entered.

In addition, the terminal device according to the present invention, when drawing a character or a picture with an electronic pen or a scanner on dedicated paper on which a coded pattern is printed, entry information generated and transmitted by the electronic pen or the scanner corresponding to the stroke. , A receiving means for receiving entry information, and when displaying a stroke on the display based on the received entry information, the next entered stroke extends beyond the frame of the application window. Processing means for calculating a coordinate value of a circumscribed rectangle of a portion that cannot be seen from the application window and displaying the stroke in the frame of the application window by moving the stroke in at least one of the vertical direction and the horizontal direction; It is characterized by providing.
According to this configuration, when the user draws a character or a picture on the dedicated paper with the electronic pen or the scanner, the entry information is transmitted to the terminal device by the electronic pen or the scanner, and the terminal device receives the electronic pen or the scanner by the receiving unit. Receives the entry information sent from, calculates the coordinate value of the circumscribed rectangle of the part that cannot be seen from the application window based on the entry information, and moves the stroke in at least one of the vertical and horizontal directions By doing so, even if the next entered stroke extends beyond the frame of the application window and the next entered stroke is not partially visible, the stroke is automatically moved to a position that is easy to see and displayed. it can.

In addition, the terminal device according to the present invention, when drawing a character or a picture with an electronic pen or a scanner on dedicated paper on which a coded pattern is printed, entry information generated and transmitted by the electronic pen or the scanner corresponding to the stroke. And a receiving means for receiving entry information, and when displaying a stroke on the display based on the received entry information, a coordinate value of a circumscribed rectangle surrounding the entered stroke is calculated, and the circumscribed rectangle is calculated. By moving the image so that the corner point of the image matches the positioning coordinates set inside the application window, the stroke you entered is displayed in the frame of the application window. If it is overhanging, it cannot be seen from the application window. It calculates the coordinates of the circumscribed rectangle of the portion, by moving the stroke of the vertical and horizontal directions at least one, characterized in that it comprises processing means for displaying the stroke within the frame of the application window.
According to this configuration, when the user draws a character or a picture on the dedicated paper with the electronic pen or the scanner, the entry information is transmitted to the terminal device by the electronic pen or the scanner, and the terminal device receives the electronic pen or the scanner by the receiving unit. Positioning coordinates in which the circumscribing rectangle coordinates that surround the stroke are calculated by the processing means based on the entry information and the corner points of the circumscribing rectangle are set inside the application window. By moving the image so that it fits, the strokes entered are automatically scrolled and displayed efficiently even if the display area of the dedicated paper in the terminal device is smaller than the size of the dedicated paper it is, then protrude in filled-in stroke across the frame of the application window, its stroke Without min to visible, it can be displayed by moving the stroke automatically legible position.

In addition, the program according to the present invention, when drawing a character or a picture with an electronic pen or a scanner on dedicated paper on which a coded pattern is printed, fills in information that is generated and transmitted by the electronic pen or the scanner corresponding to the stroke. When receiving a stroke on the display based on the received entry information, the receiving means for receiving the entry information in the receiving terminal device, when the next entered stroke is completely out of the frame of the application window, By calculating the coordinate value of the circumscribed rectangle that surrounds the stroke and moving the image so that the corner point of the circumscribed rectangle matches the positioning coordinates set inside the application window, the stroke is displayed within the frame of the application window. It is characterized by functioning as a processing means.

In addition, the program according to the present invention, when drawing a character or a picture with an electronic pen or a scanner on dedicated paper on which a coded pattern is printed, fills in information that is generated and transmitted by the electronic pen or the scanner corresponding to the stroke. When receiving a stroke on the display based on the received entry information, receiving means for receiving the entry information in the receiving terminal device, the coordinate value of the circumscribed rectangle surrounding the entered stroke is calculated, and the corner point of the circumscribed rectangle is calculated. By moving the image so that it matches the positioning coordinates set inside the application window, the entered stroke is displayed in the frame of the application window, and then the entered stroke is completely outside the frame of the application window. The coordinate value of the bounding rectangle that surrounds the stroke By moving the image so that the corner point of the circumscribed rectangle matches the positioning coordinates set inside the application window, the stroke functions as a processing means for displaying the stroke within the frame of the application window. .

In addition, the program according to the present invention, when drawing a character or a picture with an electronic pen or a scanner on dedicated paper on which a coded pattern is printed, fills in information that is generated and transmitted by the electronic pen or the scanner corresponding to the stroke. When receiving a stroke on the display based on the received entry information, receiving means for receiving entry information in the receiving terminal device, and when the next entered stroke extends beyond the frame of the application window, the application The coordinate value of the circumscribed rectangle of the part that cannot be seen from the window is calculated, and the stroke is moved in at least one of the vertical direction and the horizontal direction, thereby functioning as processing means for displaying the stroke in the frame of the application window. Features.

In addition, the program according to the present invention, when drawing a character or a picture with an electronic pen or a scanner on dedicated paper on which a coded pattern is printed, fills in information that is generated and transmitted by the electronic pen or the scanner corresponding to the stroke. When receiving a stroke on the display based on the received entry information, receiving means for receiving the entry information in the receiving terminal device, the coordinate value of the circumscribed rectangle surrounding the entered stroke is calculated, and the corner point of the circumscribed rectangle is calculated. the by moving the image to fit the positioning coordinates set on the inside of the application window to display the strokes to fill in the frame of the application window, then filled-in stroke protrudes across the frame of the application window Invisible from the application window The coordinates of the circumscribed rectangle was calculated by moving the stroke in the vertical direction and the horizontal direction of at least one, characterized in that function as processing means for displaying the stroke within the frame of the application window.

  The terminal device according to the present invention can be configured by these programs.

According to the terminal device and its program according to the present invention, when the display area of the dedicated paper in the terminal device is narrower than the size of the dedicated paper, it is automatically moved and displayed according to the entered stroke information. Therefore, it is possible to determine the optimum position of the written stroke without performing a pen operation for improving the legibility of characters or designs on the terminal device.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows a system configuration diagram of a writing display system using the terminal device of the present embodiment. As shown in FIG. 1, in the writing display system 4, when characters and pictures are drawn on the dedicated paper 2 with the electronic pen 1, the characters and pictures are displayed on the display of the terminal device 3. A dot pattern (coded pattern) is printed on the dedicated paper 2 used here. Further, the electronic pen 1 includes a pen tip portion 6 similar to a normal ink pen. When a user writes a character or a picture on the dedicated paper 2 with the pen tip portion 6 in the same manner as a normal ink pen, the electronic pen 1 is used. 1 reads the dot pattern printed on the dedicated paper 2 locally and continuously along the trajectory (handwriting) of the pen tip 6 and calculates the coordinates of the local position on the dedicated paper 2; The electronic pen identification ID for identifying the electronic pen 1 and the written time information (time stamp) are associated with the coordinate data.

[Special paper]
First, the dedicated paper 2 used in the writing display system 4 will be described. The special paper 2 is a paper in which a dot pattern is printed on paper, and further, designs, items such as ruled lines and entry frames, words, words, illustrations, and the like are printed thereon. The dot pattern is printed with ink containing carbon that absorbs infrared rays. In addition, the design and the like are printed with ordinary ink that does not contain carbon. These dot patterns and designs may be printed on the paper at the same time, or either one may be printed first.

[Dot pattern]
Next, the dot pattern printed on the dedicated paper 2 will be described. The dot pattern read by the electronic pen 1 employs the above-mentioned Anoto technology. FIG. 2 is a diagram illustrating the relationship between the dot position of the dot pattern printed on the dedicated paper 2 and the value to which the dot is converted. As shown in FIG. 2, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on the direction in which the position of the dot is shifted from the reference position of the grid (intersection of vertical and horizontal lines: grid point). The value of each dot is further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The dot pattern is configured such that the position coordinates on the dedicated paper 2 are determined by the combination of information thus associated.

  FIG. 3A shows an arrangement of dot patterns in a certain local portion on the dedicated paper 2. As shown in FIG. 3 (a), 6 × 6 dots are arranged within a range of about 2 mm in length and width so that a unique pattern can be obtained no matter where 6 × 6 dots are taken from any part of the dedicated paper 2. ing. The dot pattern formed by these 36 (= 6 × 6) dots holds the position coordinates (for example, where the dot pattern is located on the dedicated paper 2). FIG. 3B is a diagram in which each dot shown in FIG. 3A is converted into a value associated with the regularity shown in FIG. 2 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

[Electronic pen]
Next, the electronic pen 1 will be described. As shown in FIG. 4, the electronic pen 1 includes a processor 8, a memory 9, a speaker 10, a data communication unit 11, a battery 12, an LED 13, a CMOS camera 14, a clock 15, a pressure sensor 16, and a housing 7. And an ink cartridge 17. The tip of the ink cartridge 17 is a pen tip portion 6, and the user can draw a path, a character, and a pattern while bringing the pen tip portion 6 of the electronic pen 1 into contact with the special paper 2.

  The LED 13 and the CMOS camera 14 are attached in the vicinity of the pen tip portion 6 of the electronic pen 1, and an opening 18 is formed in a portion of the housing 7 facing the LED 13 and the CMOS camera 14. The LED 13 illuminates infrared rays toward the vicinity of the pen tip 6 on the dedicated paper 2 (region 19: see FIG. 1). The region 19 is slightly deviated from the position where the pen tip portion 6 contacts the special paper 2. The CMOS camera 14 captures a dot pattern in the area 19 illuminated by the LED 13 and supplies image data of the dot pattern to the processor 8. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 13 are absorbed by the carbon contained in the dots. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. Therefore, by taking a picture with the CMOS camera 14, by setting a threshold value based on the difference in the amount of reflected infrared light, it is possible to distinguish the dot region containing carbon from the other regions. Therefore, even if a ruled line or a frame is printed in the photographing region, the dot pattern can be recognized because the ink such as the ruled line or the frame does not contain carbon. Note that the shooting area by the CMOS camera 14 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 3A, and the camera 14 is shot 75 times per second.

  The battery 12 is for supplying electric power to each component in the electronic pen 1. For example, the battery 12 is configured to turn on / off the electronic pen 1 itself by removing a cap (not shown) of the electronic pen 1. May be. The pressure sensor 16 detects the pressure applied to the pen tip 6 when the user writes characters or the like on the dedicated paper 2 with the electronic pen 1, that is, the writing pressure, and supplies the detected pressure to the processor 8.

  The processor 8 switches on / off the switches of the LED 13 and the CMOS camera 14 based on the writing pressure data supplied from the pressure sensor 16. That is, when a user writes characters or the like on the special paper 2 with the electronic pen 1, the pen tip portion 6 is applied with a writing pressure, and when the pressure sensor 16 detects a writing pressure exceeding a predetermined value, the processor 8. Determines that the user has started entry and activates the LED 13 and the CMOS camera 14.

  While the user is filling in, the processor 8 uses the dot pattern of the image data supplied by the CMOS camera 14 on the dedicated paper 2 for the stroke (handwriting from pen-down to pen-up) written by the user. The position coordinates of the X and Y coordinates (also simply referred to as “coordinate data”) are continuously calculated. That is, the processor 8 converts the image data of the dot pattern as shown in FIG. 3A supplied by the CMOS camera 14 into the data array shown in FIG. The data is converted into a Y coordinate bit value, and X, Y coordinate data is calculated from the data array by a predetermined calculation method. The processor 8 calculates the dot pattern address set for each page or type of the dedicated paper 2 from the dot pattern arrangement. Then, the processor 8 associates the current time (time stamp) transmitted from the clock 15, the pen pressure data, and the X and Y coordinate data. Since the 6 × 6 dot pattern on the dedicated paper 2 does not overlap within the dedicated paper 2, when the user fills in the necessary items with the electronic pen 1, It can be specified by the coordinate calculation by the processor 8 whether it corresponds to the position.

  An electronic pen identification ID for identifying the electronic pen 1 is stored in the memory 9, and coordinate data calculated by the processor 8 is arranged and stored in time series along with time information (time stamp). Go. The speaker 10 outputs the content instructed by the processor 8 by voice.

  Then, the data communication unit 11 associates the electronic pen identification information, time information (time stamp), writing pressure data, dot pattern address, and X and Y coordinate data, and transmits them to the terminal device 3 as entry information. To do. Transmission by the data communication unit 11 is immediately and sequentially performed toward the terminal device 3 by wireless transmission of Bluetooth (registered trademark).

[Terminal device]
Next, the terminal device 3 will be described with reference to FIG. The terminal device 3 is a personal computer or the like that includes, as hardware, an antenna device capable of data communication with the electronic pen 1, a processor such as a CPU, a memory such as a ROM or RAM, a hard disk, a display, a mouse, or a keyboard. Composed. FIG. 5 is a functional block diagram of the terminal device 3. As shown in the figure, the terminal device 3 functionally includes a receiving means 31, a storage means 32, a processing means 33, a display means 34, and an input means 35 such as a mouse or a keyboard. A clock 36 for transmitting the current time and a transmission means 37 are provided. Then, the terminal device 3 performs a predetermined process by executing a dedicated application using data received from the electronic pen 1.

[Dedicated application]
Next, the dedicated application (program) 40 installed in the terminal device 3 will be described with reference to FIG. FIG. 6 shows a module configuration of the dedicated application 40. As illustrated in FIG. 6, the dedicated application 40 includes a reception module 41, a storage module 42, and a processing module 43.

  The receiving module 41 has a function of causing the receiving unit 31 to receive entry information created by a specific protocol transmitted from each electronic pen 1, and causes the terminal device 3 to configure the receiving unit 31 with an antenna or the like. It is a module.

  The storage module 42 stores window information and various setting information for displaying the handwriting drawn on the dedicated paper 2 on the display means 34 in correspondence with the dot pattern address on the dedicated paper 2 and stores them in the storage means 32. Or a module for storing the entry information acquired from the electronic pen 1 in a predetermined format, and for configuring the storage device 32 in the terminal device 3.

  The processing module 43 has a function of causing the display means 34 to display the contents entered on the dedicated paper 2 in various forms, and has a function of displaying the dedicated paper 2 and the contents entered therein. This is a module that causes the terminal device 3 to constitute the processing means 33 by the processor.

[Display processing function in terminal device]
The process performed by the dedicated application installed in the terminal device 3 is a process of displaying the stroke data of characters and patterns drawn by the user with the electronic pen 1 on the display of the display unit 34 in an easily viewable state. An outline of processing performed by the terminal device 3 by executing this dedicated application will be described with reference to FIGS.

  As shown in FIG. 7A, when a stroke (handwriting from pen-down to pen-up) is written on the dedicated paper 2 with the electronic pen 1, entry information corresponding to the stroke transmitted by the electronic pen 1 is obtained. The terminal device 3 receives it by the receiving means 31. By executing the processing module 43, the processing unit 33 sets the application window W at the maximum size that can be displayed on the display screen of the display unit 34 as shown in FIG. 100%, 110%, 120%, etc.), the stroke S is displayed in the application window W. The stroke S is automatically scrolled to a position that is easy to see in the following procedure. In FIG. 7B to FIG. 13, an area P indicates the positional relationship of the virtual dedicated paper 2 to indicate the area of the dedicated paper 2 displayed in the application window W.

  Here, the coordinate system of the dedicated paper 2 is determined in advance, and the electronic pen 1 calculates the XY coordinates according to this coordinate system. Then, the dedicated application generates image information based on the coordinate data generated by the electronic pen 1 and causes the display unit 34 to display the image information.

  First, the processing means 33 calculates the coordinate value of the circumscribed rectangle F surrounding the entered stroke (the coordinate system is as shown in FIG. 7C). On the other hand, positioning coordinates (X1, Y1) are set inside the application window W, and the processing means 33 uses the calculated upper left point of the circumscribed rectangle F as the positioning coordinates (X1, Y1) on the application window W. 7), the image of the stroke S is automatically scrolled by translating vertically and horizontally as shown in FIG. 7C. At this time, when displaying the entered stroke S, the processing means 33 displays it from the end of the application window W to the inside of the positioning coordinates (X1, Y1). Then, when the edge of the image is displayed at the edge of the application window W, the scroll movement of the image ends.

  The first stroke is processed as described above, but the process for the strokes to be entered after the next differs depending on the position of the dedicated paper 2 (cases 1 to 4).

(Case 1)
The first case is a case where the next written stroke Sn is completely within the frame of the application window W as shown in FIG. In this case, as shown in FIG. 8B, the processing means 33 displays the entered next stroke Sn as it is in the frame of the application window W. As a result, the entered previous stroke and next stroke can be displayed so as to be visible at the same time.

(Case 2)
In the second case, as shown in FIG. 9A, the next written stroke Sn completely protrudes from the frame of the application window W. In this case, the processing means 33 calculates the coordinate value of the circumscribed rectangle G that encloses the next stroke Sn entered, and the upper left corner point of the circumscribed rectangle G is set to the application window W as shown in FIG. The screen is moved in parallel up and down and left and right so as to be aligned with the positioning coordinates (X1, Y1) set inside. As a result, the processing means 33 displays the entered next stroke Sn within the frame of the application window W. At this time, when displaying the image up to the upper end or lower end of the image of the dedicated paper 2 at the upper end or lower end of the application window W, the processing means 33 displays the image at a position where the end portions of the application window W and the image are substantially aligned. End scrolling.

(Case 3)
The third case is a case where the stroke Sn entered next straddles the frame of the application window W and if the scroll is scrolled, the stroke Sn does not extend from the frame of the application window W due to its expansion. There are three cases depending on how to straddle the frame of W.

(Case 3-1)
In the third case, the first case is a case where the next written stroke Sn extends across the frame of the application window W in the vertical direction (Y-axis direction) as shown in FIG. . In this case, the processing means 33 calculates the coordinate values of the circumscribed rectangle G that cannot be seen from the application window W, and as shown in FIG. Of Y-axis direction width + Y1 ". As a result, the processing means 33 displays the portion of the entered stroke Sn that was not visible within the frame of the application window W. At this time, when the processing means 33 displays the upper end or lower end of the application window W up to the upper end or lower end of the image of the dedicated paper 2, End scrolling.

(Case 3-2)
Among the third cases, the second is the case where the next written stroke Sn straddles the frame of the application window W in the horizontal direction (X-axis direction) as shown in FIG. . In this case, the processing means 33 calculates the coordinate value of the circumscribed rectangle F that cannot be seen from the application window W, and as shown in FIG. In the X-axis direction width + X1 ". As a result, the processing means 33 displays the portion of the entered stroke Sn that was not visible within the frame of the application window W. At this time, when the processing unit 33 displays the right end or the left end of the image on the dedicated paper 2 at the right end or the left end of the application window W, the image scrolling is performed at a position where the end portions of the application window W and the image are substantially aligned with each other. End the move.

(Case 3-3)
In the third case, the third case is when the stroke Sn entered next extends over the frame of the application window W in the vertical and horizontal directions (XY directions) as shown in FIG. is there. In this case, the processing means 33 calculates the coordinate value at each vertex of the circumscribed rectangle G that is not visible from the application window W, so that the entire stroke Sn entered next can be seen as shown in FIG. Then, from the coordinates of the vertex farthest from the application window W (point A in the figure), it is translated in the vertical and horizontal directions toward the target point to be moved. The target point to be moved is a point that has moved inward by “X1, Y1” from the apex of the application window W having the closest distance from the circumscribed rectangle G. As a result, the processing means 33 displays the entered stroke Sn within the frame of the application window W. At this time, when the edge of the image of the dedicated paper 2 reaches the edge of the application window W, the processing means 33 ends the scroll movement of the image at a position where the edge of the application window W and the image are almost aligned.

(Case 4)
As shown in FIG. 13A, the fourth case is a case where the stroke Sn entered next straddles the frame of the application window W, and a part of the stroke Sn protrudes from the frame of the application window W when scrolling. Also in this case, as in the case 3, the processing means 33 calculates the coordinate value of the circumscribed rectangle G in the portion of the stroke Sn that cannot be seen from the application window W, and automatically scrolls the stroke Sn in the circumscribed rectangle G. It is displayed within the frame of application window W. At this time, if the stroke Sn is vertically long and protrudes upward, the processing means 33 automatically scrolls the protruding portion of the circumscribed rectangle G gradually in the Y-axis direction over a predetermined time (several seconds). When the receiving means 31 receives the next stroke entry information during scrolling, the automatic scrolling is immediately stopped and the automatic scrolling for the next stroke is started. At this time, when the edge of the image of the dedicated paper 2 reaches the edge of the application window W, the scrolling of the image is finished at a position where the edge of the application window W and the image are almost aligned.

  The terminal device 3 in which such a dedicated application 40 is installed adjusts the position of the stroke displayed on the display of the display means 34 by scrolling. Therefore, when the stroke is displayed on the display based on the position coordinates of the entry information transmitted from the electronic pen 1, the above-described algorithm is performed by the processing means 33.

[Processing flow of display display by writing display system]
Next, the process performed by the writing display system of this embodiment is demonstrated, referring the flowchart of FIG.

  When the user draws a character or a picture on the dedicated paper 2 with the electronic pen 1, the electronic pen 1 generates entry information corresponding to a stroke from pen down to pen up and transmits it to the terminal device 3. That is, when the user touches the pen tip 6 of the electronic pen 1 to the dedicated paper 2 (pen down) to draw a character or a picture, the electronic pen 1 detects a writing pressure exceeding a predetermined value by the pressure sensor 16. As a result, contact with the special paper 2 is detected (step S11), the dot pattern is imaged by the CMOS camera 14 while irradiating infrared rays with the LED 13, and the special paper is obtained from the image data of the imaged dot pattern by the processor 8. 2 calculates the coordinate data and the dot pattern address at the contact position. Then, the processor 8 generates entry information in which the dot pattern address, the coordinate data, the writing pressure data, and the current time display (time stamp) are associated, and transmits the entry information to the terminal device 3 via the data communication unit 11. (Step S12).

  As described above, the electronic pen 1 continues to generate entry information of the stroke and transmit it to the terminal device 3 while the user continues to draw characters and pictures on the dedicated paper 2. When the user removes (pens up) the electronic pen 1 from the dedicated paper 2, the processor 8 recognizes that the writing pressure detected by the pressure sensor 16 is less than a predetermined value (step S13). The transmission to the terminal device 3 is interrupted. When the user continues to touch (pen down) to draw a character or a pattern (step S14; Yes), the process of generating the stroke entry information again and transmitting it to the terminal device 3 is repeated. On the other hand, when the user does not draw a character or a picture with the electronic pen 1, since pen down is not detected (step S14; No), transmission of entry information to the terminal device 3 is stopped as it is. .

  On the other hand, the terminal device 3 activates the dedicated application, reads the window information and various setting information stored in the storage unit 32, and enters a state where the handwriting drawn on the dedicated paper 2 can be displayed on the display unit 34 (step S15). . In this state, when the terminal device 3 receives the entry information transmitted by the electronic pen 1 by the receiving unit 31 (step S16), the processing unit 33 stores the received entry information in the storage unit 32 and the characters. And an automatic scrolling process for moving a stroke entered when drawing a picture to an easily viewable position on the display (display means 34) (step S17).

  FIGS. 15 to 17 are flowcharts showing the algorithm of the automatic scroll process in step S17 in FIG. 14. Next, details of this algorithm will be described.

  First, as shown in FIG. 15, when the data of the first stroke S is input to the processing means 33 for processing of the dedicated application (step S21), the processing means 33 is a circumscribed rectangle surrounding the entered stroke. The coordinate value of F is calculated (step S22), the point of the upper left corner of the circumscribed rectangle F is aligned with the positioning coordinate (X1, Y1) set in the application window W, and the stroke S becomes the positioning coordinate (X1, Y1). The image on the dedicated paper 2 is automatically moved so as to be positioned further inside (step S23; see FIG. 7).

  Subsequently, as shown in FIG. 16, when the data of the next stroke Sn is input for processing of the dedicated application (step S31), the processing means 33 causes the stroke Sn to be within the frame of the application window W. It is determined whether or not it is displayed (step S32). If it is displayed completely within the frame (step S32; yes), it is displayed as it is without scrolling (step S33; reference figure 8), or even part of it. If it is not displayed in the frame (step S32; No), it is determined whether or not it is completely protruded from the frame (step S34).

  Then, when the next stroke Sn protrudes completely from the frame of the application window W (step S34; Yes), the processing means 33 calculates the coordinate position of the circumscribed rectangle G surrounding the entered stroke Sn (step S35). Then, the screen is translated and scrolled so that the upper left corner point of the circumscribed rectangle G matches the positioning coordinates (X1, Y1) set inside the application window W (step S36; see FIG. 9).

  When the next stroke Sn does not completely protrude from the frame of the application window W (step S34; No), that is, when the stroke straddles the frame of the application window W, the processing unit 33 performs processing of the subroutine shown in FIG. To automatically scroll the next stroke Sn.

  In subroutine 3 (FIG. 17), first, the processing means 33 calculates the coordinate value of each vertex in the circumscribed rectangle G of the portion not displayed in the application window W for the next stroke Sn (step S41). Then, the processing unit 33 determines whether or not the circumscribed rectangle G exists in both the X-axis direction and the Y-axis direction with respect to the application window W (step S42). In step S32; Yes), the image is moved closer to the application window direction so as to advance by “X-axis direction width of circumscribed rectangle G + X1” in the X-axis direction and “Y-axis direction width of circumscribed rectangle G + Y1” in the Y-axis direction. It moves diagonally (step S43; reference figure 12). At this time, when the edge of the image of the dedicated paper 2 reaches the edge of the application window W, the processing unit 33 ends the scroll movement of the image at a position where the edge of the application window W and the image are substantially aligned.

  In step S42, when the processing unit 33 determines that the circumscribed rectangle G does not exist in both the X-axis direction and the Y-axis direction with respect to the application window W (step S42; No), the circumscribed rectangle G is the X-axis. It is determined whether or not it exists in the direction (step S44), and if it is determined that the circumscribed rectangle G is in the X-axis direction (step S44; Yes), “X-axis direction width of the circumscribed rectangle G + X1” ”, The image on the special paper 2 is scrolled while being translated in the direction of the application window (step S45; see FIG. 11). At this time, when the processing unit 33 displays the image of the dedicated paper 2 up to the right end or the left end, and overlaps with the right end or the left end of the application window W, the processing unit 33 performs a scroll movement at a position where the ends are substantially aligned. finish.

  If the processing means 33 determines in step S44 that the circumscribed rectangle G is not in the X axis direction with respect to the application window W (step S44; No), the circumscribed rectangle G is in the Y axis direction with respect to the application window W. Therefore, the image is scrolled in the Y-axis direction while being translated in the direction of the application window by “the width of the circumscribed rectangle G in the Y-axis direction + Y1” (step S46; reference diagram 12). At this time, when the edge of the image of the dedicated paper 2 reaches the edge of the application window W, the processing unit 33 ends the scroll movement at a position where the edge of the application window W and the edge of the image are substantially aligned.

[Operational effects of this embodiment]
According to the writing display system 4 using this terminal device, when a user draws a character or a picture on the dedicated paper 2 with the electronic pen 1, the electronic pen 1 moves the position of the stroke corresponding to the drawn character or the picture. Coordinates are calculated at predetermined intervals, entry information including the position coordinates is generated, and the entry information is transmitted to the terminal device 3 immediately and sequentially. And the terminal device 3 acquires entry information from the electronic pen 1, calculates the coordinate value of the circumscribed rectangle surrounding the stroke based on the entry information, and sets the corner point of the circumscribed rectangle inside the application window. By moving the image to match the positioning coordinates, the entered stroke is automatically scrolled and displayed at the optimum position.

  That is, when the display unit 33 of the terminal device 3 draws the first stroke S, the display unit 33 automatically scrolls so that the upper left corner of the circumscribed rectangle F matches the positioning coordinates (X1, Y1) of the application window W, and the stroke S Is displayed in the application window W, the entered stroke S can be automatically scrolled and efficiently displayed even if the display area of the application window W is narrower than the size of the dedicated paper 2. it can. When the next stroke Sn is completely within the frame of the application window W at that time, the stroke Sn is displayed as it is within the frame of the application window W so that the stroke S and the stroke Sn can be seen at the same time. Display.

  On the other hand, when the next written stroke Sn completely protrudes from the frame of the application window W, the display means 33 sets the corner of the circumscribed rectangle G of the protruding stroke portion inside the application window W. The image is moved so as to match the positioning coordinates, and the stroke Sn is displayed in the frame of the application window W. Alternatively, if the next written stroke Sn extends beyond the frame of the application window W, the display means 33 displays the circumscribed rectangle G that cannot be seen from the application window W as the stroke Sn as the vertical and horizontal directions. By moving in at least one of the directions, it is displayed in the frame of the application window W. In this way, the portion of the stroke Sn that was not visible is automatically scrolled and displayed at a position that is easy to see.

  The present invention is not limited to the above embodiment.

  In the above embodiment, the electronic pen 1 is used as a device for drawing characters and patterns on the dedicated paper 2, but a pen-type scanner without an ink cartridge may be used. In the subroutine of the above embodiment, when the image of the dedicated paper 2 is moved so that the circumscribed rectangle G can be seen in the application window W, the other part of the stroke Sn cannot be seen. It is better to slow down the moving speed. Then, it becomes easy to recognize the entire image of the stroke Sn from the display of the application window W.

  The present invention can be applied to various applications that display strokes in real time. Further, the present invention can be applied to an application for displaying an entry on a whiteboard, an application used for collaborative learning, and the like.

It is a system configuration figure of a writing display system concerning an embodiment of the present invention. It is explanatory drawing of the expression method of the information by the dot pattern printed on the exclusive paper. (A) shows a dot pattern typically and (b) is an explanatory view showing an example of information corresponding to it. It is explanatory drawing which shows typically the electronic pen shown in FIG. It is a functional block diagram of the terminal device shown in FIG. It is a module block diagram of the exclusive application in a terminal device. It is explanatory drawing of the display process in the first stroke. It is explanatory drawing of the display process in case 1 of the next stroke. It is explanatory drawing of the display process in case 2 of the next stroke. It is explanatory drawing of the display process in case 3-1 of the next stroke. It is explanatory drawing of the display process in case 3-2 of the next stroke. It is explanatory drawing of the display process in case 3-3 of the next stroke. It is explanatory drawing of the display process in case 4 of the next stroke. It is a flowchart of the display display process performed with the writing display system of embodiment. It is a flowchart which shows a part of algorithm in the automatic scroll process of step S17 shown in FIG. It is a flowchart which shows a part of algorithm in the automatic scroll process of step S17 shown in FIG. It is a flowchart which shows the subroutine of the process in step S37 of FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Electronic pen, 2 ... Exclusive paper, 3 ... Terminal device, 4 ... Writing display system, 6 ... Pen tip part, 7 ... Housing, 8 ... Processor, 9 ... Memory, 10 ... Speaker, 11 ... Data communication unit, DESCRIPTION OF SYMBOLS 12 ... Battery, 13 ... LED, 14 ... CMOS camera, 15 ... Clock, 16 ... Pressure sensor, 17 ... Ink cartridge, 18 ... Opening part, 19 ... Area | region, 31 ... Receiving means, 32 ... Memory | storage means, 33 ... Processing means 34 ... display means, 35 ... input means, 36 ... clock, 37 ... transmission means, 40 ... dedicated application (program), 41 ... reception module, 42 ... storage module, 43 ... processing module, W ... application window, F, G: circumscribed rectangle, S: stroke, Sn: (next) stroke, P: virtual dedicated paper area.

Claims (8)

A terminal device that receives entry information generated and transmitted by an electronic pen or scanner in response to a stroke when drawing a character or a picture with an electronic pen or scanner on dedicated paper on which a coded pattern is printed,
Receiving means for receiving the entry information;
When displaying the stroke on the display based on the received entry information, if the next entered stroke is completely outside the frame of the application window, the coordinate value of the circumscribed rectangle surrounding the stroke is calculated, and the circumscribed rectangle is calculated. A terminal device comprising: processing means for displaying the stroke in a frame of the application window by moving the image so that the corner point of the rectangle matches the positioning coordinates set inside the application window . A terminal device that receives entry information generated and transmitted by an electronic pen or scanner in response to a stroke when drawing a character or a picture with an electronic pen or scanner on dedicated paper on which a coded pattern is printed,
Receiving means for receiving the entry information;
When displaying the stroke on the display based on the received entry information, calculate the coordinate value of the circumscribed rectangle surrounding the entered stroke so that the corner point of the circumscribed rectangle matches the positioning coordinate set inside the application window By moving the image, the entered stroke is displayed within the frame of the application window, and when the next stroke is completely outside the frame of the application window, the coordinate value of the circumscribed rectangle surrounding the stroke is displayed. Processing means for calculating and displaying the stroke within the frame of the application window by moving the image so that the corner point of the circumscribed rectangle matches the positioning coordinates set inside the application window ;
A terminal device comprising: A terminal device that receives entry information generated and transmitted by an electronic pen or scanner in response to a stroke when drawing a character or a picture with an electronic pen or scanner on dedicated paper on which a coded pattern is printed,
Receiving means for receiving the entry information;
When displaying the stroke on the display based on the received entry information, if the next entered stroke extends beyond the frame of the application window, the coordinate value of the circumscribed rectangle of the part not visible from the application window is calculated. Processing means for displaying the stroke in the frame of the application window by moving the stroke in at least one of the vertical direction and the horizontal direction;
A terminal device comprising: A terminal device that receives entry information generated and transmitted by an electronic pen or scanner in response to a stroke when drawing a character or a picture with an electronic pen or scanner on dedicated paper on which a coded pattern is printed,
Receiving means for receiving the entry information;
When displaying the stroke on the display based on the received entry information, calculate the coordinate value of the circumscribed rectangle surrounding the entered stroke so that the corner point of the circumscribed rectangle matches the positioning coordinate set inside the application window By moving the image, the strokes entered are displayed within the frame of the application window, and when the strokes that have been entered extend beyond the frame of the application window, the circumscribing rectangle that cannot be seen from the application window is displayed . Processing means for calculating coordinate values and displaying the stroke in the frame of the application window by moving the stroke in at least one of the vertical direction and the horizontal direction ;
Terminal further comprising a. A terminal device that receives entry information generated and transmitted by an electronic pen or scanner in response to a stroke when drawing a character or a picture with an electronic pen or scanner on dedicated paper on which a coded pattern is printed,
A receiving means for receiving the entry information;
When displaying the stroke on the display based on the received entry information, if the next entered stroke is completely outside the frame of the application window, the coordinate value of the circumscribed rectangle surrounding the stroke is calculated, and the circumscribed rectangle is calculated. A program which functions as a processing means for displaying the stroke in the frame of the application window by moving the image so that the corner point of the rectangle matches the positioning coordinates set inside the application window . A terminal device that receives entry information generated and transmitted by an electronic pen or scanner in response to a stroke when drawing a character or a picture with an electronic pen or scanner on dedicated paper on which a coded pattern is printed,
A receiving means for receiving the entry information;
When displaying the stroke on the display based on the received entry information, calculate the coordinate value of the circumscribed rectangle surrounding the entered stroke so that the corner point of the circumscribed rectangle matches the positioning coordinate set inside the application window By moving the image, the entered stroke is displayed within the frame of the application window, and when the next stroke is completely outside the frame of the application window, the coordinate value of the circumscribed rectangle surrounding the stroke is displayed. Processing means for calculating and displaying the stroke within the frame of the application window by moving the image so that the corner point of the circumscribed rectangle matches the positioning coordinates set inside the application window
A program characterized by functioning as A terminal device that receives entry information generated and transmitted by an electronic pen or scanner in response to a stroke when drawing a character or a picture with an electronic pen or scanner on dedicated paper on which a coded pattern is printed,
A receiving means for receiving the entry information;
When displaying the stroke on the display based on the received entry information, if the next entered stroke extends beyond the frame of the application window, the coordinate value of the circumscribed rectangle of the part not visible from the application window is calculated. Processing means for displaying the stroke in the frame of the application window by moving the stroke in at least one of the vertical direction and the horizontal direction
A program characterized by functioning as A terminal device that receives entry information generated and transmitted by an electronic pen or scanner in response to a stroke when drawing a character or a picture with an electronic pen or scanner on dedicated paper on which a coded pattern is printed,
A receiving means for receiving the entry information;
When displaying the stroke on the display based on the received entry information, calculate the coordinate value of the circumscribed rectangle surrounding the entered stroke so that the corner point of the circumscribed rectangle matches the positioning coordinate set inside the application window by moving the image, to display the strokes to fill in the frame of the application window, then filled-in stroke when protrudes across the frame of the application window, the circumscribed rectangle of the invisible part of the application window Processing means for calculating coordinate values and displaying the stroke in the frame of the application window by moving the stroke in at least one of the vertical and horizontal directions
Program that is characterized in that to function as a.

Images