JP2012063974A - Stroke display system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a stroke display system and a program thereof which enable more handwriting stroke descriptions and are capable of displaying the strokes.SOLUTION: A stroke display system comprises a computer device, an electronic pen, a screen and a projector. The screen has a code pattern printed on a part or a whole surface thereof, and a plurality of stroke windows and a predetermined mark are projected on the screen. At least one stroke window is projected on a code pattern added area of a display surface of the screen. When description information transmitted from the electronic pen indicates an input to the stroke window, the computer device writes the handwriting stroke over a slide image for the display according to the description information, and when the description information indicates an input to the mark, the computer device moves the slide image to another stroke window.

Description

  The present invention relates to a system using a coding pattern readable by an electronic pen.

  In recent years, electronic pens that digitize written information have been developed, and “Anot pen” developed by Swedish company Anoto is known as a representative one. Anotopen is used with dedicated paper on which a predetermined dot pattern is printed. In addition to the usual ink cartridge for writing characters, etc., the anotopen has a small camera for capturing the dot pattern printed on the dedicated paper and the position coordinates on the dedicated paper from the captured dot pattern. A processor for calculating and a data communication unit for transmitting the calculated position coordinates and the like to an external device are mounted. When the user writes characters on the special paper with an anotopen or puts a check mark on the image designed on the special paper, the small camera captures the dot pattern printed on the special paper as the pen moves. The entry information such as characters and images written by the user is recognized from the continuous position coordinates calculated by the processor. Then, this entry information is transmitted from the Anotopen by the data communication unit to a nearby terminal device such as a personal computer or a mobile phone (for example, see Patent Document 1).

  In Patent Document 2, in a presentation system used for conferences and presentations, a stroke written on a part of the screen (lower left) is displayed on the written part and expanded to another part (upper right). A technique for displaying is displayed.

Japanese translation of PCT publication No. 2003-511761 JP 2006-012039 A

  In the stroke display system that prints the coded pattern on the screen and updates the display projected on the screen based on the entry information sent from the electronic pen, if the screen is large, there is a range where the user cannot reach and cannot write It may exist and the entire display surface of the screen may not be effectively utilized. SUMMARY OF THE INVENTION Accordingly, it is a main object of the present invention to provide a stroke display system and a program for enabling the entry of more handwritten strokes and displaying the strokes.

  In one aspect of the present invention, a computer apparatus, an electronic pen that is communicable with the computer apparatus, reads an encoded pattern, and generates entry information related to a handwritten stroke, and the encoded pattern is printed at least in part. A stroke display system comprising: a screen having a display surface; and a projector that projects a display screen of the computer device on the display surface based on an image signal transmitted from the computer device, the computer device including the display On the screen, on each of the plurality of stroke screens, a plain image or a slide image having a predetermined design is displayed, a processing means for displaying a predetermined mark, and a receiving means for receiving the entry information from the electronic pen, The at least one stroke screen comprises the table. Projected onto the area of the surface to which the coding pattern is attached, and the processing means overwrites the handwritten stroke on the slide image based on the entry information when the entry information indicates an input to the stroke screen. When the entry information indicates an input to the mark, the slide image is moved to a stroke screen different from the stroke screen being displayed.

  The stroke display system includes a computer device, an electronic pen, a screen, and a projector. On the screen, a coding pattern is printed partially or entirely, and a plurality of stroke screens and predetermined marks are projected. At least one stroke screen is projected on an area of the screen display surface to which a coded pattern is attached. When the entry information transmitted from the electronic pen indicates an input to the stroke screen, the computer device displays the handwritten stroke over the slide image based on the entry information, and the entry information is input to the mark. In the case of, the slide image is moved to a different stroke screen. In this way, the stroke display system displays a plurality of stroke screens on the display surface of the screen, and moves the slide image displayed on the stroke screen based on the input to the mark, thereby substantially reducing the user writable space. In addition, the written slide image can be continuously displayed on a stroke screen different from the stroke screen on which the newly written slide image is displayed.

  In another aspect of the present invention, a computer device, an electronic pen that is communicable with the computer device, reads an encoded pattern, and generates entry information regarding a handwritten stroke, and the encoded pattern is printed at least in part. A screen having a display surface, an instruction medium on which an encoded pattern and a predetermined mark are printed, and a projector for projecting a display screen of the computer device based on an image signal transmitted from the computer device onto the display surface A stroke display system comprising: the computer device, on the display screen, a processing means for displaying a slide image having a plain or predetermined design on each of a plurality of stroke screens; and the entry information from the electronic pen. Receiving means for receiving, at least one of the struts. The screen is projected onto an area of the display surface to which the coded pattern is attached, and the processing means, when the entry information indicates input to the stroke screen, based on the entry information, Is overwritten on the slide image, and when the entry information indicates an input to the mark, the slide image is moved to a stroke screen different from the currently displayed stroke screen.

  The stroke display system includes a computer device, an electronic pen, a screen, an instruction medium, and a projector. On the screen, a coding pattern is partially or entirely printed, and a plurality of stroke screens are projected. At least one stroke screen is projected onto an area of the screen where a coding pattern is attached. A coded pattern and a predetermined mark are printed on the instruction medium. When the entry information transmitted from the electronic pen indicates an input to the stroke screen, the computer device displays the handwritten stroke over the slide image based on the entry information, and the entry information is input to the mark. In the case of, the slide image is moved to a different stroke screen. In this way, the stroke display system displays a plurality of stroke screens on the display surface of the screen, and moves the slide image displayed on the stroke screen based on the input to the mark, thereby substantially reducing the user writable space. In addition, the written slide image can be continuously displayed on a stroke screen different from the stroke screen on which the newly written slide image is displayed.

  In one aspect of the above-described stroke display system, a screen number of a serial number is assigned to the stroke screen, the mark is classified into a first mark and a second mark, and the processing means includes the input When the information indicates the input to the first mark, the display position of the slide image is slid to the stroke screen where the screen number is increased, and when the input information indicates the input to the second mark, The display position of the slide image is slid and moved to the stroke screen where the screen number becomes smaller. In this aspect, the stroke display system is configured to select either the direction of the stroke screen in which the screen number increases or the direction of the stroke screen in which the screen number decreases based on the input by the electronic pen to the first mark and the second mark. In addition, the slide image display position can be slid.

  In another aspect of the above stroke display system, the processing means may display a slide image on the stroke screen corresponding to the largest screen number when the input information indicates an input to the first mark. In such a case, the slide image is displayed in such a manner that a part of the slide image displayed by sliding on the stroke screen is visible behind the slide image. In this aspect, the stroke display system visually recognizes the presence of these slide images even when a plurality of slide images are arranged on the stroke screen corresponding to the largest screen number when the first mark is selected. Can be made.

  In another aspect of the above stroke display system, when the input information indicates an input to the second mark, a slide image already displayed on the stroke screen corresponding to the smallest screen number is displayed on the stroke screen. The slide image is displayed in such a manner that a part of the slide image displayed by sliding can be visually recognized. In this aspect, the stroke display system visually recognizes the existence of these slide images even when a plurality of slide images are arranged on the stroke screen corresponding to the smallest screen number when the second mark is selected. Can be made.

  In another aspect of the above stroke display system, the slide image is given a page number which is a serial number, and the processing means displays all the slide images in such a manner that the page number is visually recognized. Thereby, the stroke display system can display the page number of all the slide images, and can improve a user's operativity.

  In another aspect of the above stroke display system, the slide image is given a page number which is a serial number, and the processing means is a case where the input information indicates an input to a first mark, and If the page number of the slide image currently displayed on the stroke screen with the smallest screen number is the page number attached last, a slide image with the page number next to the page number is generated and displayed on the stroke screen. Display. Thus, the stroke display system can smoothly generate a new slide image and assign a page number to the slide image.

  In another aspect of the present invention, a computer device, an electronic pen that is communicable with the computer device, reads an encoded pattern, and generates entry information related to a handwritten stroke, and the encoded pattern is printed at least in part. A program mounted and executed on the computer device in a stroke display system, comprising: a screen having a display surface; and a projector that projects a display screen of the computer device on the display surface based on an image signal transmitted from the computer device. In the display screen, a plain image or a slide image having a predetermined design is displayed on each of the plurality of stroke screens, and the entry information is received from the electronic pen. Receiving means, as said computer device The at least one stroke screen is projected onto an area of the display surface to which the coding pattern is attached, and the processing means is configured to input the stroke information when the entry information indicates an input to the stroke screen. Based on the entry information, the handwritten stroke is displayed overwriting the slide image, and when the entry information indicates an input to the mark, the slide image is moved to a stroke screen different from the currently displayed stroke screen.

  In another aspect of the present invention, a computer device, an electronic pen that is communicable with the computer device, reads an encoded pattern, and generates entry information related to a handwritten stroke, and the encoded pattern is printed at least in part. A screen having a display surface, an instruction medium on which an encoded pattern and a predetermined mark are printed, a projector that projects a display screen of the computer device based on an image signal transmitted from the computer device onto the display surface; A program mounted on and executed by the computer device, wherein the display screen displays a slide image having a plain or predetermined design on each of a plurality of stroke screens, and the entry from the electronic pen The computer device functions as receiving means for receiving information At least one of the stroke screens is projected onto an area of the display surface to which the coded pattern is attached, and the processing means is configured to input the entry information when the entry information indicates an input to the stroke screen. If the handwritten stroke is overwritten on the slide image and displayed, and the entry information indicates an input to the mark, the slide image is moved to a stroke screen different from the currently displayed stroke screen.

  In one aspect of the program, a screen number of a serial number is assigned to the stroke screen, the mark is classified into a first mark and a second mark, and the processing means is configured such that the input information is a first number. When the input to the first mark is indicated, the display position of the slide image is slid to the stroke screen where the screen number is increased, and when the input information indicates the input to the second mark, the screen number is The display position of the slide image is slid and moved to a stroke screen that becomes smaller.

  In another aspect of the program, the processing means is a case where the input information indicates an input to the first mark and a slide image has already been displayed on the stroke screen corresponding to the largest screen number The slide image is displayed in such a manner that a part and the back of the slide image displayed by sliding on the stroke screen are visually recognized.

  In another aspect of the program, when the input information indicates an input to the second mark, the processing means displays the slide image already displayed on the stroke screen corresponding to the smallest screen number as the stroke. The slide image displayed by sliding on the screen is displayed behind and partly visible.

  In another aspect of the program, the slide image is given a page number which is a serial number, and the processing means displays all the slide images in such a manner that the page number is visually recognized.

  In another aspect of the program, the slide image is given a page number which is a serial number, and the processing means is the case where the input information indicates an input to the first mark and is the smallest When the page number of the slide image being displayed on the stroke screen of the screen number is the page number attached last, the slide image with the page number next to the page number is generated and displayed on the stroke screen.

  The stroke display system according to the present invention can be configured by installing these programs in a computer device and causing them to function.

  According to the present invention, the stroke display system displays a plurality of stroke screens on the screen, and overwrites the slide image displayed on the stroke screen with the handwritten strokes entered on the stroke screen so that the mark is input. In this case, by moving the slide image displayed on the stroke screen, it is possible to substantially expand the space in which the user can write, and to continuously display the slide image that has been written.

It is a system configuration figure of a stroke display system in a 1st embodiment. It is explanatory drawing which shows the relationship between the arrangement | positioning of the dot in a dot pattern, and the value converted. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is the schematic which shows the structure of an electronic pen. It is an example of the functional block diagram of a computer apparatus. It is the schematic which shows the data structure of coordinate definition information. It is a flowchart which shows the processing flow common to each embodiment. It is a display example in 1st Embodiment. FIG. 9 is a display example when a screen advance mark is tapped from the state shown in FIG. 8. FIG. FIG. 10 is a display example when a screen advance mark is tapped from the state shown in FIG. 9. FIG. It is an example of a display when a screen return mark is tapped from the state shown in FIG. It is the schematic which shows the data structure of the coordinate definition information which concerns on a modification. It is the schematic which shows the data structure of the coordinate definition information which concerns on a modification. It is a system block diagram of the stroke display system in 2nd Embodiment. It is a display example in 2nd Embodiment. It is a display example when the mark which advances a screen from the state shown in FIG. 15 is tapped. It is a display example when the mark which advances a screen from the state shown in FIG. 16 is tapped. It is a display example when the mark which advances a screen from the state shown in FIG. 17 is tapped. It is a display example when the mark which advances a screen from the state shown in FIG. 18 is tapped. It is a display example when the mark which advances a screen from the state shown in FIG. 19 is tapped. It is a system configuration figure of a stroke display system concerning a modification of a 2nd embodiment. It is the schematic which shows the data structure of the coordinate definition information which concerns on the modification of 2nd Embodiment. It is a display example which concerns on the modification of 2nd Embodiment.

  Hereinafter, a first embodiment and a second embodiment, which are embodiments of the present invention, will be described in order with reference to the drawings.

<First Embodiment>
First, a first embodiment according to the present invention will be described.

[Configuration of stroke display system]
FIG. 1 shows a configuration of a stroke display system according to the first embodiment. As shown in FIG. 1, the stroke display system according to the first embodiment includes an electronic pen 1 used by a user, a computer device 2 that receives and processes entry information from the electronic pen 1, and a dot pattern (coding). And a projector 3 that is connected to the computer apparatus 2 and projects the same image as the display screen of the display of the computer apparatus 2 onto the large screen 4. Hereinafter, each main component will be described.

(projector)
The projector 3 is connected to the computer device 2 and projects the same image as the display screen of the display of the computer device 2 onto the projection range 8 of the large screen 4. The area on the large screen 4 onto which the display screen is projected is hereinafter referred to as “projection range 8”. In the present embodiment, a first screen 91, a second screen 92, a screen advance mark 5, and a screen return mark 6 are projected onto the projection range 8.

(Large screen)
The large screen 4 has a dot pattern (coded pattern) printed on the white resin substrate with ink containing infrared rays that can be read by the electronic pen 1 within the dot pattern printing range 7. The pattern has a layer structure protected by, for example, a transparent EB cured resin layer. The dot pattern printing range 7 is set at least in a range where the user's hand can reach the entire surface. In addition, the user adjusts the position and the projection angle of the projector 3 so that at least the first screen 91, the screen advance mark 5, and the screen return mark 6 are projected within the dot pattern printing range 7. The dot pattern printing range 7 may be set on the entire large screen 4.

(Dot pattern)
Next, an Anoto dot pattern (coded pattern) printed in the dot pattern printing range 7 will be described with reference to FIGS. FIG. 2 is a diagram for explaining the relationship between dots of a dot pattern and values to which the dots are converted. As shown in FIG. 2, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the virtual grid (the intersection of the vertical and horizontal lines). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on the large screen 4 are determined by the combination of information thus associated.

  FIG. 3A shows an arrangement of a certain dot pattern. As shown in FIG. 3 (a), 6 × 6 dots within a range of about 2 mm in length and breadth form a unique pattern no matter where 6 × 6 dots are taken from the dot pattern printing range 7 Has been placed. The dot pattern formed by these 36 dots holds position coordinates (for example, where the dot pattern is on the dot pattern printing range 7). FIG. 3B is a diagram in which each dot shown in FIG. 3A is converted into a value associated with the regularity shown in FIG. 2 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

(Electronic pen)
Next, the electronic pen 1 will be described with reference to FIG. FIG. 4 is a schematic diagram showing the structure of the electronic pen 1. As shown in FIG. 4, the electronic pen 1 includes a pen unit 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM and a RAM, A communication unit 111 including a real time clock 110, an antenna, and the like, and a battery 112 are provided. The tip of the pen unit 104 is a pen point unit 103, and the user touches the pen point unit 103 of the electronic pen 1 on the dot pattern printing range 7 and enters a stroke (handwritten stroke). Here, the first contact of the pen tip portion 103 of the electronic pen 1 with the large screen 4 is referred to as pen-down, and the removal of the pen tip portion 103 from the contacted (contacted) state is referred to as pen-up. . A trajectory written between the pen-down and pen-up of the electronic pen 1 is one stroke, and characters, figures, etc. are composed of one or a plurality of strokes.

  The battery 112 is for supplying power to each component in the electronic pen 1, and is configured to turn on / off the power of the electronic pen 1 itself by, for example, detaching a cap (not shown) of the electronic pen 1. You may let them. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied from the pen tip portion 103 through the pen portion 104 when the user writes or taps a character or mark on the dot pattern printing range 7 with the electronic pen 1, that is, the writing pressure. The value is transmitted to the processor 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when the user writes characters or the like in the dot pattern printing range 7 with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and when the pressure sensor 107 detects a writing pressure higher than a predetermined value, the processor 108 Then, it is determined that the user has started entry, and the LED 105 and the CMOS camera 106 are operated. Then, the communication unit 111 associates pen-down information detected by the pressure sensor 107 with identification information (hereinafter referred to as “pen ID”) of the electronic pen 1 described later, and transmits the information to the computer apparatus 2 as entry information. To do. When the user finishes entering one stroke and moves the electronic pen 1 away from the large screen 4, the pressure sensor 107 detects pen-up because no writing pressure exceeding a predetermined value is detected. Then, the communication unit 111 associates the pen-up information detected by the pressure sensor 107 with the pen ID, and transmits it to the computer apparatus 2 as entry information.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 illuminates infrared rays toward the vicinity of the pen tip portion 103 on the large screen 4. The region is slightly shifted from the position where the pen tip 103 contacts the large screen 4. The CMOS camera 106 is provided with an infrared filter that transmits infrared rays and blocks non-infrared rays. The CMOS camera 106 captures a dot pattern in an area illuminated by the LED 105 and processes image data of the dot pattern as a processor. 108. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 105 are absorbed by the carbon contained in the dots. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. By photographing with the CMOS camera 106, a threshold value is provided based on the difference in the amount of reflected infrared light, so that a dot region containing carbon can be distinguished from other regions. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 3A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called.

  While the user performs the entry, the processor 108 determines from the dot pattern of the image data supplied by the CMOS camera 106 the X and Y coordinates in the dot pattern printing range 7 of the stroke (handwriting) to be entered by the user (hereinafter simply “ "Coordinate data" or "coordinate information") is calculated continuously. That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 3A supplied by the CMOS camera 106 into the data array shown in FIG. The data is converted into a Y coordinate bit value, and X and Y coordinate data are calculated from the data array by a predetermined calculation method. Then, the processor 108 associates the current time (time stamp: entered time information) transmitted from the real-time clock 110, writing pressure data, and X and Y coordinate data. Hereinafter, these associated data are collectively referred to as “coordinate attribute information”. Since the 6 × 6 dot pattern in the dot pattern printing range 7 does not overlap within the dot pattern printing range 7, when the user enters characters or the like with the electronic pen 1, the entered position is the dot pattern printing. The position in the range 7 can be identified by coordinate calculation by the processor 108.

  The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. Then, the communication unit 111 associates the pen ID, time information (time stamp), writing pressure data, and X and Y coordinate data, and transmits them to the computer apparatus 2 as entry information. Transmission to the computer apparatus 2 by the communication unit 111 is performed immediately and sequentially by wireless transmission such as Bluetooth (registered trademark). Here, one or a plurality of coordinate attribute information generated between the pen-down and pen-up of the electronic pen 1 and transmitted to the computer device 2 is stored as stroke information by the computer device 2. In other words, one stroke is made up of one or a plurality of X, Y coordinates (coordinate points), and the computer apparatus 2 can use one or a plurality of pieces constituting one stroke based on the pen-down information and the pen-up information. Recognize coordinate attribute information. As described above, a set of coordinate attribute information generated by the electronic pen 1 when the user enters one stroke is referred to as “stroke information”. The pen tip 103 does not have ink and transmits pen pressure to the pressure sensor 107 via the pen unit 104.

(Computer device)
Next, the computer apparatus 2 will be described. The computer device 2 includes, as hardware, an antenna device capable of data communication with the electronic pen 1, a processor such as a CPU, a memory such as ROM and RAM, a display, a personal computer including a mouse and a keyboard, and the like. . FIG. 5 is a functional block diagram of the computer apparatus 2. Functionally, the computer apparatus 2 includes an input unit 21 such as a mouse and a keyboard, a reception unit 22, a processing unit 24, a storage unit 25, a display unit 26, and a transmission unit 27. The computer device 2 performs predetermined processing based on the entry information received from the electronic pen 1. For example, the computer apparatus 2 obtains a calibration processing function for obtaining a coordinate conversion function for converting a coordinate system related to the dot pattern of the large screen 4 into a coordinate system related to the display (display means 26), and the calibration processing. The received coordinate conversion function is used to convert the coordinate system data relating to the dot pattern of the large screen 4 to the coordinate system data relating to the display (display means 26), drawing a stroke, It has a function to perform the process.

  The receiving means 22 is constituted by an antenna receiving circuit or the like, receives entry information from the electronic pen 1 and transmits it to the processing means 24. The display means 26 is constituted by a display or the like, and displays the contents instructed by the processing means 24. The transmission unit 27 transmits an image signal for displaying an image on the display unit 26 to the projector 3 based on the processing command of the processing unit 24, and projects the same image as the image of the display unit 26 onto the large screen 4 in synchronization. Let

  The processing means 24 is constituted by a processor such as a CPU and controls the entire computer apparatus 2. Specifically, the processing unit 24 causes the projector 3 to project the calibration mark on the large screen 4 by displaying at least two calibration marks on the display unit 26, thereby calibrating the calibration mark. The coordinate system related to the dot pattern of the large screen 4 is changed to the coordinate system applied to the display of the display means 26 ("display coordinate system") Also, a coordinate conversion function for conversion into the storage unit 25 is obtained and stored in the storage unit 25 (calibration processing function).

  The processing unit 24 draws a display screen including the first screen 91, the second screen 92, the screen advance mark 5, and the screen return mark 6 and causes the display unit 26 to display the display screen. The projector 3 is adjusted so that the first screen 91, the screen advance mark 5, and the screen return mark 6 are projected within the dot pattern printing range 8 on the large screen 4. The respective areas (areas) of the dot pattern printing range 8 on which the first screen 91, the screen advance mark 5 and the screen return mark 6 are projected are referred to as “input area”, “screen advance area” and “screen return area”. Call it. In addition, the processing unit 24 generates a slide image based on the design template, and displays the generated slide image on the first screen 91. At this time, the processing unit 24 adds page numbers (slide numbers), which are serial numbers, in the order of generation to the slide images. The page number is represented by “PN” (N is a natural number), and the processing means 24 increases the value of N (initial value is 1) by 1 each time a new slide image is generated. Then, the processing unit 24 updates the latest page number stored in the storage unit 25. In the initial state, the processing unit 24 displays a slide image with the page number “P-1” on the first screen 91.

  The first screen 91 is a screen area in which a new slide image generated along with screen movement is displayed, and is a screen having a screen number “1”. The first screen 91 is a screen for inputting information to the computer device 2 using the electronic pen 1, which is projected within the reach of the user's hand on the large screen 4. The second screen 92 is displayed when the slide image being displayed on the first screen 91 is moved when the screen movement is instructed by the electronic pen 1 filling in the screen advance area on which the screen advance mark 5 is projected. This is a screen area to be displayed, and is a screen whose screen number is “2”. In other words, on the second screen 92, the slide image of the page number “P- (N-1)” immediately before the page number “PN” of the slide image displayed on the first screen 91 is displayed. It is a screen. The second screen 92 is set adjacent to the upper stage of the first screen 91. The screen advance mark 5 is associated with the process of moving the screen (forward), and the screen advance area which is a projection area of the screen advance mark 5 on the large screen 4 by the electronic pen 1 when the user instructs the screen move. Is tapped. When the processing unit 24 determines from the entry information received from the electronic pen 1 that the entry is in the area where the screen advances, the processing unit 24 moves the slide image being displayed on the first screen 91 to the second screen 92 and displays it. Then, the slide image having the next page number of the slide image is displayed on the first screen 91. The screen return mark 6 is associated with the screen movement (return) process, and the screen return area, which is a projection area of the screen return mark 6 on the large screen 4 by the electronic pen 1 when the user instructs the screen movement. Is tapped. When the processing unit 24 determines from the entry information received from the electronic pen 1 that the entry is in the area to be returned to the screen, the processing unit 24 slides the slide image being displayed on the second screen 92 and displays the slide image on the first screen 91. The slide image of the page number immediately before the slide image is displayed on the second screen 92. The screen advance mark 5 is an example of the “first mark” in the present invention, and the screen return mark 6 is an example of the “second mark” in the present invention.

  Hereinafter, the screen advance mark 5 and the screen return mark 6 are collectively referred to as “screen movement mark”. The “screen advance area” and “screen return area” are also collectively referred to as “screen movement area”. Further, the first screen 91 and the second screen 92 are collectively referred to as “stroke screen”. The screen having the largest screen number (the second screen 92 in the first embodiment) is also referred to as a “final screen”. Furthermore, an area (area) on the large screen 4 onto which the first screen 91 and the second screen 92 are projected is also referred to as a “screen area”.

  When the computer apparatus 2 receives the entry information from the electronic pen 1, the processing means 24 converts the coordinate data included in the entry information, which is data of the coordinate system applied to the large screen 4, into the coordinate conversion obtained by the calibration process. Use functions to convert to display coordinate system data. In the processing means 24, the position written by the electronic pen 1 based on the converted coordinate data is the dot pattern printing range 7 on the large screen 4 (hereinafter referred to as “entry area”). Recognize When the processing unit 24 recognizes that the recognized position is in the first screen 91 which is an input area for inputting a stroke with the electronic pen, the converted coordinate data is stored in the storage unit 25. In addition, a stroke based on the converted coordinate data or the like is drawn on the slide image. Then, the processing unit 24 stores the rendered slide image in the storage unit 25 by overwriting and saving the slide image data before rendering the same page number, for example. This overwriting may be performed at a predetermined timing such as when the screen is moved or when a storage instruction is detected by the operation of the input means 21. Further, when the recognized position is the screen movement area in the entry area, the processing means 24 moves the slide images being displayed on the first screen 91 and the second screen 92, respectively. At this time, when the screen advance mark 5 is tapped, the processing unit 24 moves the slide image displayed on the first screen 91 to be displayed on the second screen 92, and displays the first screen 91 on the first screen 91. When a slide image having the next page number of the displayed slide image has been generated, the slide image having the next page number is displayed on the first screen 91. On the other hand, if the page number of the slide image currently displayed on the first screen 91 is the largest among the page numbers of the generated slide images, that is, if it matches the latest page number, A slide image is newly generated by assigning a page number larger by 1 than the page number and displayed on the first screen 91. Further, when the screen return mark 6 is tapped, the processing unit 24 sets the slide image displayed on the first screen 91 to the back, and displays the slide image displayed on the second screen 92 on the first screen 91. When the slide image having the page number before the slide image displayed on the second screen 92 is generated, the slide image having the previous page number is displayed on the second screen 92. To. However, when the page number of the slide image currently displayed on the first screen 91 is “P-1”, the slide image displayed after moving to the first screen 91 does not exist, so the screen is moved. do not do. Note that the processing unit 24 directly performs display processing such as movement processing on the display screen of the display unit 26, so that the same image as the display screen of the display unit 26 is projected onto the screen 4 by the projector 3. It becomes. These specific descriptions will be described in detail in the [Processing Flow] section. In addition, when the processing unit 24 detects a storage instruction by operating the input unit 21, the processing unit 24 stores the generated slide image and its position information as a file in a predetermined file format.

  If the processing unit 24 identifies that the pen-down information is included in the entry information received from the electronic pen 1, the processing unit 24 causes the storage unit 25 to set a storage area for storing the latest stroke information. And the processing means 24 received until it detects that the pen-up information is included in the received entry information, or until it detects that the next pen-down information is included in the received entry information. The coordinate attribute information included in the entry information is stored in the storage means 25 as a part of the latest stroke information. When the electronic pen 1 receives a single entry in the same screen movement area, that is, a plurality of pieces of entry information for one stroke, the processing means 24 executes the screen movement process only once. To do.

  The storage unit 25 is configured by a memory such as a ROM or a RAM. The storage unit 25 stores an application program for generating a display screen to be projected on the large screen 4 by the projector 3. In addition, the storage unit 25 stores the entry information received from the electronic pen 1 for each pen ID or the predetermined data generated by the execution of the program according to the processing instruction of the processing unit 24.

  The storage unit 25 stores in advance information on a design template as a template of a slide image, information on a dot pattern printed in the dot pattern printing range 7 of the large screen 4, and a coordinate area (“display area”) of the display coordinate system. The information regarding the display position of the calibration mark, the first screen 91, the second screen 92, and the screen movement mark is also stored. Thus, when the processing unit 24 converts the coordinate data on the large screen 4 included in the entry information received from the electronic pen 1 into the coordinate data of the display coordinate system by the coordinate conversion function, the converted coordinate data is The display range of the first screen 91, the screen advance mark 5, and the screen return mark 6 can be recognized. In other words, the processing means 24 uses the coordinate data after conversion from the coordinate data on the large screen 4, the entry area that is the area where the first screen 91 is projected, the screen advance area that is the area where the screen advance mark 5 is projected, Alternatively, it is possible to recognize in which area of the screen return area, which is the area on which the screen return mark 6 is projected, which has been entered by the electronic pen 1. FIG. 6 shows the objects displayed on the display, such as the first screen 91 and the screen movement mark, stored in the storage means 25, the display area, and the area type of each area that is the projection area on the large screen 4. This is a data structure indicating association information (also referred to as “coordinate definition information”). Compare each display area of the input area, the screen advance mark, and the screen return mark shown in FIG. 6 with the coordinate data on the display in which the coordinates on the large screen 4 generated by the electronic pen 1 are converted by the coordinate conversion function. By doing so, it is possible to identify which area and mark has been entered. Each coordinate range is defined by position coordinates (Xn, Yn), height (H), and width (W) of a rectangular corner.

  The coordinate definition information may be generated by the processing unit 24 according to an instruction of the application itself, or may be generated by the processing unit 24 according to an instruction of a plug-in program added to expand the function of the application. May be.

[Processing flow]
Next, a processing flow by the stroke display system of the first embodiment will be described. The processing flow shown in FIG. 7 is repeatedly executed every time entry information is generated by the electronic pen 1.

  When the user enters or taps characters or the like on the input area with the electronic pen 1, the electronic pen 1 transmits the entry information associated with the pen down information and the pen ID to the computer device 2 at the time of the pen down. In addition, during the entry of the stroke, the electronic pen 1 transmits to the computer device 2 the entry information in which the coordinate attribute information including the coordinate information calculated by imaging the dot pattern along the stroke and the pen ID is associated. . Then, at the time of pen-up, the electronic pen 1 transmits entry information associated with pen-up information and a pen ID to the computer device 2 (step S101).

  In the computer apparatus 2, when the receiving unit 22 receives the entry information transmitted from the electronic pen 1, the processing unit 24 causes the storage unit 25 to store the entry information for each pen ID (step S201). Next, the processing means 24 converts the coordinate information included in the entry information into coordinate information of the display coordinate system using the coordinate conversion function obtained by the calibration process (step S202). Then, the processing means 24 recognizes that an entry has been made in the entry area on the large screen 4 by the electronic pen 1 based on the coordinate information after conversion (step S203).

  Next, the processing unit 24 refers to the coordinate definition information shown in FIG. 6 and determines whether or not the converted coordinate data is a coordinate within an area that advances on the screen (step S204). If it is determined that the entry is in the area where the screen advances (step S204; Yes), the processing unit 24 determines whether the slide image having the latest page number is displayed on the first screen 91 (step S205). . Specifically, the processing unit 24 compares the latest page number stored in the storage unit 25 with the page number assigned to the slide image displayed on the first screen 91 to determine whether or not they match. . When it is determined that the page number matches the latest page number and the slide image having the latest page number is displayed on the first screen 91 (step S205; Yes), that is, the next page of the page number. If there is no slide image corresponding to the number and moving to the first screen 91, the processing unit 24 generates a new slide image and displays it on the first screen 91 (step S206). Specifically, the processing unit 24 generates a new slide image with a page number that is one larger than the latest page number using the design template stored in the storage unit 25 as a template, and creates a new slide image and update. The latest page number is stored in the storage means 25 and displayed on the first screen 91.

  Then, the processing unit 24 moves the slide image in the direction in which the screen number increases, and displays the screen after the screen movement on the display unit 26 (step S207). Specifically, the processing means 24 moves the slide image that was being displayed on the first screen 91 to the second screen 92 and displays it. Further, when the slide image has already been displayed on the second screen 92 (final screen), the processing unit 24 moves the image behind the second screen 92 (final screen). At this time, the processing means 24 shifts the slide image moved to the back by a predetermined width in the vertical direction and the horizontal direction, respectively, outside the second screen 92 with respect to the slide image displayed on the second screen 92. The page number is displayed in a visible manner. This specific display example will be described in detail in [Display Example] to be described later. On the other hand, when it is determined in step S205 that the slide image displayed on the first screen 91 is not the slide image having the latest page number (step S205; No), that is, there is a slide image that moves to the first screen 91. In this case, the processing unit 24 proceeds to the process of step S207, and moves and displays the slide image display in the direction of the stroke screen in which the screen number increases. At this time, the slide image corresponding to the next page number of the slide image displayed on the first screen 91 is displayed on the first screen 91.

  On the other hand, if it is determined in step S204 that the entry is not in the screen advance area (step S204; No), the processing means 24 refers to the coordinate definition information shown in FIG. It is determined whether or not the coordinates are within (step S208). If it is determined by this determination that the entry is in the screen return area (step S208; Yes), the processing unit 24 determines whether or not the slide image of the page number “P-1” is displayed on the first screen 91. Determination is made (step S209). If it is determined that the slide image with the page number “P-1” is not displayed on the first screen 91 (step S209; No), that is, attached to the slide image being displayed on the first screen 91. When a slide image corresponding to the page number one page number before exists and is being displayed on the second screen 92, the processing unit 24 displays the slide image in the direction of the stroke screen in which the screen number decreases. Move (step S210). Specifically, the processing means 24 moves the slide image being displayed on the second screen 92 to the first screen 91 and displays it. Further, the processing unit 24 displays the slide image being displayed on the first screen 91 in such a manner that the page number is visually recognized behind the first screen 91. Further, when there is a slide image corresponding to the previous page number of the slide image being displayed on the second screen 92, the processing means 24 moves the slide image to the second screen 92 and displays it. On the other hand, when it is determined that the slide image of the page number “P-1” is displayed on the first screen 91 (step S209; Yes), that is, the slide image is not displayed on the second screen 92. If there is no slide image that moves to one screen 91, the processing unit 24 ends the process of the flowchart. In this case, the processing means 24 continues to display the slide image with the page number “P-1” on the first screen 91.

  On the other hand, when it is determined in step S208 that it is not an entry in the screen return area (step S208; No), the processing means 24 refers to the coordinate definition information shown in FIG. It is determined whether or not the coordinates are in the input area (step S211). In this determination, when it is determined that the entry is in the input area (step S211; Yes), the processing unit 24 performs a stroke drawing process (step S212). Specifically, the processing means 24 draws the strokes superimposed on the slide image being displayed on the first screen 91 and to be filled in by the electronic pen 1 based on the converted coordinate information. Then, the display by the display means 26 is updated, and the slide image after the drawing is updated and stored in the storage means 25. On the other hand, when it is determined that the entry is not in the input area (step S211; No), that is, when the entry is not in the screen movement area and the input area, the processing unit 24 ends the process of the flowchart.

[Display example]
Next, in the first embodiment, a specific display example of the screen displayed on the display (display unit 26) and projected onto the large screen 4 will be described with reference to the flowchart of FIG. 7 and FIGS. To do.

  FIG. 8 shows an input on the large screen 4 on which the slide image of the page number “P-1” is projected after the slide image of the page number “P-1” is displayed on the first screen 91. A display example of the large screen 4 when arbitrary writing is performed on the area with the electronic pen 1 is shown. Here, the process from the initial state to the state shown in FIG. 8 will be briefly described. First, the processing unit 24 converts the coordinate information included in the entry information received from the electronic pen 1 into coordinate information of the display coordinate system using a coordinate conversion function previously obtained by calibration processing and stored in the storage unit 25. (See step S202). Next, the processing unit 24 refers to the coordinate definition information (see FIG. 6) stored in the storage unit 25 and specifies that the entered area is an input area. Then, the processing means 24 draws the strokes drawn by superimposing the strokes entered on the slide image of the page number “P-1” being displayed on the first screen 91 to be filled in by the electronic pen 1 by the stroke drawing process. The display is updated (see step S212). When the slide image having the page number “P-1” is displayed on the first screen 91, the page number immediately before the page number “P-1” does not exist. Slide images are not displayed.

  FIG. 9 shows a display example of the large screen 4 when the screen advance area (projection area of the screen advance mark 5) from the state shown in FIG. 8 is tapped by the electronic pen 1 and then written in the input area. When the screen advance area is tapped with the electronic pen 1 in the state shown in FIG. 8, the processing means 24 is the area where the recognized entered area is the screen advance area (see step S204; Yes), and the first screen 91 is displayed. Since the page number of the slide image being displayed matches the latest page number “P-1” (see step S205; Yes), a new slide image with the page number “P-2” not yet written is newly generated. The new slide image is stored in the storage means 25 and the latest page number is updated and stored as “P-2” (see step S206). Then, as shown in FIG. 9, the processing unit 24 displays the slide image of the page number “P-1” displayed on the first screen 91 in the direction of the stroke screen in which the screen number increases, The display position is moved from 91 to the second screen 92, a newly generated slide image with the page number “P-2” is arranged on the first screen 91, and the image after the screen is moved is displayed. 26 (see step S207). After that, the processing means 24 performs the stroke drawing process for the writing with the electronic pen 1 to the input area on which the slide image with the page number “P-2” is projected, and the page number “ The entered stroke is superimposed on the slide image “P-2” and drawn, and the display is updated (see step S212).

  FIG. 10 shows a display example of the large screen 4 when writing is made in the input area after the area where the screen advances from the state shown in FIG. 9 is tapped with the electronic pen 1. When the screen advance area is tapped with the electronic pen 1 from the state shown in FIG. 9, the processing means 24 is the area where the recognized entered area is the screen advance area (see step S204; Yes). Since the page number of the slide image being displayed matches the latest page number “P-2” (see step S205; Yes), a new slide image with the page number “P-3” not yet written is newly generated. The new slide image is stored in the storage means 25 and the latest page number is updated and stored (see step S206). Then, as shown in FIG. 10, the processing means 24 moves the slide image being displayed in the direction of the stroke screen in which the screen number increases (see step S207). That is, the processing means 24 moves the slide image of the page number “P-2” being displayed on the first screen 91 from the first screen 91 to the second screen 92, and also moves to the final screen (second screen 92). The slide image with the page number “P-1” being displayed is moved behind the final screen, and a new slide image with the page number “P-3” is arranged on the first screen 91 to move the screen. The subsequent image is displayed on the display means 26. At this time, the processing unit 24 slides the page number “P-2” displayed on the final screen so that the presence of the slide image of the page number “P-1” to be moved behind is visually recognized by the user. Arrange it from the image. Here, the slide image of the page number “P-1” is displayed in a state where the page number can be visually recognized. After that, the processing means 24 performs the stroke drawing process for the writing with the electronic pen 1 to the input area on which the slide image with the page number “P-3” is projected. The entered stroke is superimposed on the slide image “P-3” and drawn, and the display is updated (see step S212).

  When the area where the screen advances further from the state shown in FIG. 10 is tapped with the electronic pen 1, the processing unit 24 displays the slide image with the page number “P-3” from the first screen 91 to the final screen (second screen). The screen 92) is moved and the slide image of the page number “P-2” is moved behind it. In this case, each slide image is arranged so that the smaller the page number, the more rearward the image is displayed. Specifically, the slide image with the page number “P-1” is arranged behind the slide image with the page number “P-2”. The superimposed slide images are displayed while being shifted at predetermined intervals so that the presence of the slide images can be visually recognized by the user. Note that the number of slide images arranged behind the page number can be limited to, for example, three pages, and the number of slide images arranged while the presence of the page number can be visually recognized is, for example, five. You may make it restrict | limit to a page.

  FIG. 11 shows a display example of the large screen 4 after the screen return area (projection area of the screen return mark 6) from the state shown in FIG. In the state shown in FIG. 10, when an input is made to the screen return area with the electronic pen 1, the processing means 24 recognizes the entered area as the screen return area (see step S <b> 208; Yes), and the first screen 91. Since the slide image of the page number “P-1” is not displayed on the screen (see step S209; No), as shown in FIG. 11, the slide image being displayed is displayed in the direction of the stroke screen where the screen number decreases. Move (see step S210). That is, the processing means 24 moves the slide image of the page number “P-2” being displayed on the second screen 92 from the second screen 92 to the first screen 91, and also displays the final screen (second screen 92). The slide image with the page number “P-1” displayed behind is moved to the second screen 92, and the slide image with the page number “P-3” being displayed on the first screen 91 is moved to the first screen 91. The image after moving the screen is displayed on the display means 26. At this time, the processing unit 24 displays the page number “P-2” displayed on the first screen 91 so that the presence of the slide image with the page number “P-3” to be moved behind is visually recognized by the user. The slide image is shifted and placed. Here, the slide image of the page number “P-3” is displayed behind the first screen 91 with the page number visible.

  When the screen return area is further tapped with the electronic pen 1 from the state shown in FIG. 11, the processing unit 24 moves the slide image with the page number “P-1” to the first screen 91 and The slide image with the number “P-2” is moved behind it. In this case, each slide image is arranged so that the larger the page number, the more rearward it is displayed. Specifically, the slide image with the page number “P-3” is arranged behind the slide image with the page number “P-2”. The superimposed slide images are displayed while being shifted at predetermined intervals so that the presence of the slide images can be visually recognized by the user. Note that the number of slide images arranged behind the first screen 91 in a state where the page number can be visually recognized may be limited to, for example, up to three pages, and further, the slide images arranged in a state where the presence can be visually recognized. For example, the number may be limited to 5 pages. Further, the number of display pages may be different between the case behind the final screen and the case behind the first screen 91.

[Operational effects of the stroke display system of the first embodiment]
According to the stroke display system of the first embodiment, the computer device 2 includes the first screen 91 projected on the large screen 4 within the reach of the user's hand and the second screen arranged adjacent thereto. In addition to displaying the two stroke screens 92 and 92, the stroke written in the input area of the large screen 4 by the electronic pen 1 is drawn and displayed in a corresponding position on the first screen 91 in real time. Further, the computer device 2 moves the slide images displayed on the first screen 91 and the second screen 92 based on the tap to the screen movement area on the large screen 4. Therefore, for example, when there is no more space for entering a stroke in the slide image being displayed on the first screen 91, the user displays a new slide image on the first screen 91 and displays the new slide image on the large screen 4. Thus, new writing can be performed within the reach of the user's hand, and the completed slide image can be continuously displayed on the second screen 92 that is not reachable by the user but is easily visible from a distance. Thus, the stroke display system of the first embodiment can effectively utilize the entire surface of the large screen 4. Therefore, the stroke display system is preferably applied to, for example, a large classroom or a conference room.

  In addition, when one or a plurality of slide images are arranged outside the first screen 91 or the final screen (second screen 92), each slide image is displayed with respect to the slide image displayed in front of the slide image. The page numbers are arranged and displayed in such a manner that the page numbers can be visually recognized by being shifted by a predetermined width in the vertical direction and the horizontal direction. In this way, the user can recognize the existence of each slide image that cannot be displayed on the stroke screen, and can improve operability while paying attention not to give an unnecessary screen movement instruction.

[Modification of First Embodiment]
Next, a modification of the first embodiment will be described. The following modifications may be applied in any combination to the first embodiment described above.

(Modification 1)
In the first embodiment, the screen movement mark is projected onto the large screen 4 by the projector 3 as in the first screen 91 and the second screen 92. However, the method to which the present invention is applicable is not limited to this.

  Alternatively, the screen movement mark may be printed on a predetermined sheet so as to overlap the dot pattern. In this case, the paper on which the screen movement mark and the dot pattern are printed (referred to as “instruction paper” (instruction medium)) may be pasted on the large screen 4 or used while being held by the user. Good. FIG. 12 is a data structure showing coordinate definition information stored in the storage means 25 in the first modification. 12A shows coordinate definition information in the display coordinate system of the input area corresponding to the first screen 91 and the first screen 91, and FIGS. 12B and 12C show dot pattern printing on the large screen 4. FIG. Regarding the dot pattern of the range 7 (referred to as “large screen area”), the input area, and the screen movement area (screen advance area and screen return area) corresponding to the area where the screen movement mark of the instruction sheet is printed 12B shows coordinate definition information (referred to as “dot pattern coordinate definition information”), FIG. 12B shows dot pattern coordinate definition information before calibration, and FIG. 12 shows dot pattern coordinate definition information after the coordinate area is specified, as shown in FIGS. Coordinate area, dot pattern address, and area type are associated and stored in the storage unit 25. The coordinate area of the dot pattern associated with the screen advance area and the screen return area is the corner position coordinate (Xn, Yn), height (Y direction), and width (X direction).

  In the calibration process of the first modification, the processing unit 24 inversely transforms the coordinate information of the input area of the display coordinate system shown in FIG. The coordinate area of the input area relating to the dot pattern on the screen 4 is obtained, and the dot pattern coordinate definition information is updated from the content shown in FIG. 12B to the content shown in FIG. 12C and stored in the storage means 25. Moreover, the process flow of the modification 1 and the process flow of 1st Embodiment differ in the timing of coordinate transformation. In the first embodiment, the processing unit 24 recognizes the entered area after converting the coordinate information related to the dot pattern into the coordinate information of the display coordinate system. However, in the first modification, the processing unit 24 uses the coordinate information related to the dot pattern. The entered area is recognized, and coordinate conversion is performed when the entered area is entered. In the processing flow of the first modification, when the processing unit 24 stores the entry information received from the electronic pen 1 in the storage unit 25 (see step S201 in FIG. 7), the processing unit 24 displays the information based on the coordinate information included in the entry information. With reference to the dot pattern coordinate definition information shown in FIG. 12C, the area written by the electronic pen 1 is recognized (see step S203 in FIG. 7). Subsequently, the processing means 24 executes the determination as to whether or not the entered area is a screen advance area or a screen return area, and a process associated therewith as in the first embodiment (see steps S204 to S210 in FIG. 7). ). And when it determines with it not being a screen return area (refer FIG. 7 step S208; No), the process means 24 determines whether it is an input area. If it is determined that it is the input area (see step S211 in FIG. 7; Yes), the processing unit 24 converts the coordinate information from the coordinate system related to the dot pattern to the coordinate information of the display coordinate system using the coordinate conversion function. To do. Subsequently, the processing unit 24 performs a stroke drawing process based on the converted coordinate information (see step S212). On the other hand, if it is determined that it is not the input area, the processing means 24 ends the processing as it is.

(Modification 2)
In the first embodiment, the processing unit 24 converts the coordinate system of all the coordinate information received from the electronic pen 1 using the coordinate conversion function obtained by the calibration process. However, the configuration to which the present invention is applicable is not limited to this. Instead, the processing means 24 may convert the coordinate system of the coordinate information into the display coordinate system only when the coordinate information related to the input area is received from the electronic pen 1. The modified example 2 is also applied to the case where the screen projection range 8, the position of the large screen 4, the position and orientation of the projector 3 are fixed, and the stroke screen and the screen movement mark are always projected on the predetermined position on the large screen 4. it can.

  In the calibration process, the processing unit 24 according to the second modification converts the coordinate information related to the dot pattern on the large screen 4 in the input area, the screen advance area, and the screen return area by reverse conversion in the same manner as in the first modification. Ask. FIG. 13 shows a data structure indicating coordinate definition information stored in the storage means 25 when the above-described inverse transformation is performed in the second modification. 13A shows coordinate definition information in the display coordinate system, FIG. 13B shows coordinate definition information related to the dot pattern before the calibration process, and FIG. 13C shows the coordinate definition information after the calibration process. The coordinate definition information which concerns on the dot pattern updated and memorize | stored is shown. In this case, the processing unit 24 uses the dot pattern coordinate definition information shown in FIG. 13C based on the coordinate information included in the entry information received from the electronic pen 1 as in the processing flow of the first modification. Refer to and recognize the filled area. If the processing unit 24 determines that the entered area is an input area, the processing unit 24 converts the coordinate information related to the dot pattern into the coordinate information of the display coordinate system, and performs the stroke drawing process based on the converted coordinate information. Execute.

(Modification 3)
In the description of the display examples, as shown in FIGS. 10 and 11, when a plurality of slide images are arranged on the first screen 91 or the second screen 92, the processing means 24 selects these slides based on the page numbers. Images were superimposed and displayed at predetermined intervals. Instead of this, the processing means 24 may not display slide images other than the slide images arranged on the first screen 91 and the second screen 92, respectively.

(Modification 4)
If it is determined in step S209 of the flowchart shown in FIG. 7 that the first screen 91 displays the slide image with the page number “P-1”, the processing unit 24 moves the slide image from the first screen 91. It was continuously displayed on the first screen 91. Instead, the processing means 24 moves the slide image to display the page number outside the first screen 91 so that the page number can be visually recognized, and displays a message image indicating that there is no slide image to be displayed on the first screen 91. It may be displayed. In another example, the processing unit 24 does not move the slide image from the first screen 91, and displays a message image indicating that there is no slide image to be displayed on the slide image for a predetermined time (for example, 5 seconds). ) May be displayed.

(Modification 5)
In the first embodiment, the Anoto coding pattern (dot pattern) is used. However, any coding pattern indicating position coordinates may be used, and the Anoto coding is not limited.

Second Embodiment
Next, a second embodiment will be described. FIG. 14 is a system configuration diagram of a stroke display system according to the second embodiment. In the second embodiment, two stroke screens (first screen 91, second screen 94) are displayed in that four stroke screens (first screen 91, second screen 92, third screen 93, fourth screen 94) are displayed. This is different from the first embodiment in which the screen 92) is displayed. Since other points of the second embodiment are the same as those of the first embodiment, description thereof will be omitted as appropriate.

  In the second embodiment, the dot pattern printing range 7 of the large screen 4 is, as in the first embodiment, at least the first screen 91 in the range where the user's hand can reach the entire surface and the area where the screen movement mark is projected. Is set to a range that includes The dot pattern printing range 7 may be set so as to include the entire large screen 4 or the entire screen area. In the four stroke screens, the second screen 92 is arranged adjacent to the upper part of the first screen 91, the third screen 93 is arranged adjacent to the right side of the second screen 92, and the lower part of the third screen 93. A fourth screen 94 is arranged adjacent to the screen. The fourth screen 94 is the final screen.

  The processing unit 24 draws a display screen including the first screen 91, the second screen 92, the third screen 93, the fourth screen 94, the screen advance mark 5 and the screen return mark 6 and causes the display unit 26 to display the display screen. The projector 3 is adjusted so that the first screen 91, the screen advance mark 5, and the screen return mark 6 are projected within the dot pattern printing range 8 on the large screen 4. Further, the processing unit 24 generates a slide image by assigning page numbers as serial numbers in the order of generation, and displays the generated slide image on the first screen 91. Then, the processing unit 24 updates the latest page number stored in the storage unit 25.

  Further, when the screen advance area is tapped, the processing unit 24 displays the slide image being displayed on each screen by moving it clockwise in the direction of the stroke screen in which the screen number increases. That is, when recognizing entry in the screen advance area, the processing unit 24 displays the slide image being displayed on the first screen 91 on the second screen 92 and the slide image being displayed on the second screen 92 is displayed on the third screen. 93, the slide image being displayed on the third screen 93 is displayed on the fourth screen 94 (final screen), and the slide image being displayed on the final screen is displayed behind the final screen. At this time, when the page number of the slide image being displayed on the first screen 91 is the latest page number, the processing unit 24 assigns a page number which is 1 larger than the page number of the slide image being displayed on the first screen 91. Thus, a new slide image is generated and displayed on the first screen 91. On the other hand, when the page number of the slide image currently displayed on the first screen 91 is not the latest page number, the processing unit 24 selects the slide image having the page number next to the slide image currently displayed on the first screen 91 as the first page number. One screen 91 is displayed.

  Further, when the screen return area is tapped, the processing unit 24 displays the slide image being displayed on each stroke screen by moving counterclockwise in the direction of the stroke screen in which the screen number is decreased. That is, when recognizing entry in the screen return area, the processing means 24 causes the final screen (fourth screen 94) to display the slide image having the page number one previous to the slide image being displayed on the final screen. The slide image being displayed on the four screens 94 is displayed on the third screen 93, the slide image being displayed on the third screen 93 is displayed on the second screen 92, and the slide image being displayed on the second screen 92 is displayed on the first screen 93. The slide image displayed on the screen 91 and displayed on the first screen 91 is displayed behind the first screen 91. On the other hand, when the page number of the slide image being displayed on the first screen 91 is “P−1”, the processing unit 24 does not perform screen movement. Since the specific processing procedure is the same as that of the flowchart of FIG. 7 described in the first embodiment, the description thereof is omitted.

[Display example]
Next, in the second embodiment, a specific example of the screen displayed by the display unit 26 and projected on the large screen 4 will be described with reference to the flowchart of FIG. 7 and FIGS. 15 to 20.

  FIG. 15 shows an input on the large screen 4 on which the slide image of the page number “P-1” is projected after the slide image of the page number “P-1” not yet written is displayed on the first screen 91. A display example of the large screen 4 when arbitrary writing is performed on the area with the electronic pen 1 is shown. Here, the process from the initial state to the transition to the state shown in FIG. 15 will be described. First, the processing unit 24 converts the coordinate information included in the received entry information into coordinate information of the display coordinate system using the coordinate conversion function stored in the storage unit 25 (see step S202). Next, the processing unit 24 refers to the coordinate definition information (see FIG. 6) stored in the storage unit 25 and specifies that the entered area is an input area. Then, the processing means 24 draws the strokes drawn by superimposing the strokes entered on the slide image of the page number “P-1” being displayed on the first screen 91 to be filled in by the electronic pen 1 by the stroke drawing process. The display is updated (see step S212). When the slide image with the page number “P-1” is displayed on the first screen 91, there is no page number before the page number “P-1”, so the second screen 92 to the fourth screen 94 are displayed. No slide image is displayed at this point.

  FIG. 16 shows a display example when writing is made in the input area after the area where the screen advances from the state shown in FIG. 15 is tapped with the electronic pen 1. When the screen advance area is tapped with the electronic pen 1 in the state shown in FIG. 15, the processing means 24 is the area where the entered area is the screen advance area (see step S204; Yes) and is being displayed on the first screen 91. Since the page number of the slide image coincides with the latest page number “P-1” (see Step S205; Yes), a slide image in which the page number “P-2” is not yet written is newly generated and stored. The new slide image is stored in the means 25 and the latest page number is updated and stored as “P-2” (see step S206). Then, as shown in FIG. 16, the slide image of the page number “P-1” being displayed on the first screen 91 in the direction of increasing the screen number is changed from the first screen 91 to the second screen 92. The display position is moved, a slide image in which the page number “P-2” is not yet written is arranged on the first screen 91, and the image after the screen movement is displayed on the display means 26 (see step S207). After that, the processing means 24 performs the stroke drawing process for the writing with the electronic pen 1 to the input area on which the slide image with the page number “P-2” is projected, and the page number “ The entered stroke is superimposed on the slide image “P-2” and drawn, and the display is updated (see step S212).

  FIG. 17 shows a display example when writing is made in the input area after the area where the screen advances from the state shown in FIG. 16 is tapped with the electronic pen 1. In the state shown in FIG. 16, when a tap is made on the screen advance area with the electronic pen 1, the processing unit 24 creates a new slide image with the page number “P-3” as in the transition from FIG. 15 to FIG. 16. Is generated (see step S206), and the slide image being displayed is slid in the direction of the stroke screen in which the screen number increases (ie, clockwise) (see step S207). That is, the processing unit 24 moves the slide image of the page number “P-2” being displayed on the first screen 91 from the first screen 91 to the second screen 92, and the page number being displayed on the second screen 92. The slide image of “P-1” is moved from the second screen 92 to the third screen 93, and the slide image with the page number “P-3” not yet written is arranged on the first screen 91. The image after moving the screen is displayed on the display means 26. The latest page number at this time is “P-3”. After that, the processing means 24 performs the stroke drawing process for the writing with the electronic pen 1 to the input area on which the slide image with the page number “P-3” is projected. The entered stroke is superimposed on the slide image “P-3” and drawn, and the display is updated (see step S212).

  FIG. 18 shows a display example when the area that advances from the state shown in FIG. 17 is tapped with the electronic pen 1 and then written in the input area. In the state shown in FIG. 17, when a tap is made on the screen advance area with the electronic pen 1, the processing means 24 displays a new slide image with the page number “P-4” in the same manner as the above two screen transitions. After the generation (see step S206), the slide image being displayed is slid in the direction of the stroke screen in which the screen number increases (ie, clockwise) (see step S207). That is, the processing unit 24 moves the slide image with the page number “P-3” being displayed on the first screen 91 to the second screen 92, and has the page number “P-2” being displayed on the second screen 92. The slide image is moved to the third screen 93, the slide image of the page number “P-1” being displayed on the third screen 93 is moved to the fourth screen 94, and the page number “P-4” is displayed on the first screen 91. ”Are arranged, and these images after moving the screen are displayed on the display means 26. At this time, the latest page number is “P-4”. After that, the processing means 24 performs the stroke drawing process for the writing with the electronic pen 1 to the input area on which the slide image with the page number “P-4” is projected, and the page number “ The entered stroke is superimposed on the slide image “P-4” and drawn, and the display is updated (see step S212).

  FIG. 19 shows a display example when an area that advances further from the state shown in FIG. 18 is tapped with the electronic pen 1 and then written in the input area. In the state shown in FIG. 18, when the electronic pen 1 taps the screen advance area, the processing unit 24 displays the new slide image with the page number “P-5” in the same manner as the above three screen transitions. Then, the slide image being displayed is slid clockwise in the direction of the stroke image in which the screen number increases (see step S206). That is, the processing unit 24 moves the slide image with the page number “P-4” being displayed on the first screen 91 to the second screen 92, and has the page number “P-3” being displayed on the second screen 92. The slide image is moved to the third screen 93, the slide image of the page number “P-2” being displayed on the third screen 93 is moved to the fourth screen 94, and is being displayed on the final screen (fourth screen 94). The slide image with the page number “P-1” is moved to the back of the final screen, and the new slide image with the page number “P-5” is arranged on the first screen 91 to display the images after the screen movement. The information is displayed on the means 26. At this time, the processing unit 24 arranges the slide image with the page number “P-1” to be moved behind and shifted from the slide image with the page number “P-2” displayed on the final screen. Here, the slide image of the page number “P-1” is arranged behind the page number in a displayed state. After that, the processing means 24 performs the stroke drawing process for the writing with the electronic pen 1 to the input area on which the slide image with the page number “P-5” is projected, and the page number “ The entered stroke is superimposed on the slide image of “P-5” and rendered, and the display is updated (see step S212).

  FIG. 20 shows a display example of the computer device 2 when the screen return area from the state shown in FIG. 19 is tapped with the electronic pen 1 and then the input area is written. When the electronic pen 1 taps the screen return area from the state shown in FIG. 19, the processing means 24 indicates that the written area is the screen return area (see step S208; Yes), and the first screen 91 is displayed on the page. Since the slide image of the number “P-1” is not displayed (see step S209; No), as shown in FIG. 20, the screen is being displayed in the direction of the stroke screen in which the screen number becomes smaller, that is, counterclockwise. The slide image is slid (see step S210). That is, the processing unit 24 moves the slide image of the page number “P-2” currently displayed on the fourth screen 94 to the third screen 93, and also displays the page number “P-3” displayed on the third screen 93. ”Is moved to the second screen 92, the slide image of the page number“ P-4 ”being displayed on the second screen 92 is moved to the first screen 91, and is displayed on the first screen 91. The slide image with the page number “P-5” in the middle is moved behind the first screen 91, and the slide with the page number “P-1” displayed behind the final screen (fourth screen 94). The image is moved to the fourth screen 94, and the image after the screen movement is displayed on the display means 26. Here, the slide image of the page number “P-5” is arranged behind the first screen 91 in a state where the page number is displayed.

[Operational effects of the stroke display system of the second embodiment]
According to the stroke display system of the second embodiment, the computer apparatus 2 displays four stroke screens on the large screen 4 so that the screen number increases clockwise from the lower left of the screen area, and the electronic pen 1 The stroke entered in the input area of the large screen 4 is displayed in real time at the corresponding position on the first screen 91. Further, the computer device 2 moves the slide image to be displayed on each stroke screen based on the tap to the screen movement area on the large screen 4. Accordingly, for example, the computer device 2 displays the slide image currently being entered on the first screen 91 and displays the slide images on the remaining three pages 92 to 94 on the remaining three pages. Can do. Thus, the stroke display system of the second embodiment can display more slide images at a time than the stroke display system of the first embodiment. Further, when the projection range 8 on the large screen 4 has the same area, the stroke display system of the second embodiment can be implemented even if the dot pattern printing range 7 is smaller.

  In the second embodiment, as in the first embodiment, the second screen 92 is set adjacent to the upper stage of the first screen 91. In this way, the stroke display system facilitates the user's writing on the entire first screen 91, and arranges the second screen 92 on which the slide image that has been most recently written is displayed at a position that is easy for the user to see. be able to.

[Modification of Second Embodiment]
Next, a modification of the second embodiment will be described. In the second embodiment, the modification example of the first embodiment and the modification examples described below can be applied in any combination.

(Modification)
In the display example of the second embodiment, the first screen 91 to the fourth screen 94 are arranged clockwise from the lower left of the screen area in the order of the screen numbers. Instead, the first screen 91 to the fourth screen 94 may be arranged counterclockwise in the order of screen numbers. FIG. 21 is a system configuration diagram of a stroke display system according to a modification of the second embodiment. In the case of this modification, the second screen 92 is arranged counterclockwise from the first screen 91 arranged at the lower left of the screen area, that is, adjacent to the right side of the first screen 91, A third screen 93 is arranged adjacently, and a fourth screen 94 (final screen) is arranged adjacent to the left side of the third screen 93. Further, the dot pattern printing range 7 is set to a range including at least the first screen 91 and the second screen 92 in a range where the user's hand can reach the entire surface and a region where the screen movement mark is projected. At this time, the screen advance mark 5 and the screen return mark 6 that have been displayed up and down may be displayed on the left and right. FIG. 22 is a data structure showing coordinate definition information in the display coordinate system stored in the storage unit 25 according to this modification. As shown in FIG. 22, the coordinate definition information of the display coordinate system in the present modification includes association information regarding the display area and the area type “input area” regarding the second screen 92 in addition to the first screen 91. It is.

  Other points of the stroke display system in the modification are the same as those in the second embodiment. That is, the direction in which the screen number increases and the direction in which the screen number decreases becomes opposite to that in the second embodiment, but the processing flow of the stroke display system does not change, and the screen advance area is tapped with the electronic pen 1. The slide image is moved in the direction in which the screen number of the stroke screen increases. When the screen return area is tapped by the electronic pen 1, the slide image is moved in the direction in which the screen number of the stroke screen decreases. FIG. 23 shows a display example of the large screen 4 according to this modification corresponding to the display example shown in FIG. In FIG. 23, a slide image of page number “P-1” is displayed behind the final screen (fourth screen 94) arranged at the upper left of the screen area by a predetermined width.

  According to this modification, the user can write not only the slide image currently displayed on the first screen 91 but also the slide image currently displayed on the second screen 92. Therefore, for example, when the user has finished writing on the slide image being displayed on the first screen 91 and moved the slide image to the second screen 92, the user subsequently forgets to write or the like. When it is desired to write the slide image again, the slide image can be written again on the input area onto which the second screen 92 is projected without moving the slide image. Similarly, even if the user moves the slide image to the third screen 93 or the fourth screen 94, the user can move the slide image to the second screen 92 without moving to the first screen 91. The desired slide image can be written again.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 2 ... Computer apparatus 3 ... Projector 4 ... Large screen 5 ... Screen advance mark 6 ... Screen return mark 7 ... Dot pattern printing range 8 ... Projection range 91 ... First screen 92 ... Second screen 93 ... Third screen 94 ... Fourth screen 21 ... Input means 22 ... Receiving means 24 ... Processing means 25 ... Storage means 26 ... Display means 27 ... Transmission means

Claims (14)

A computer device;
An electronic pen that is communicable with the computer device, reads an encoded pattern, and generates entry information relating to a handwritten stroke;
A screen having a display surface at least partially printed with a coding pattern;
A projector that projects a display screen of the computer device on the display surface based on an image signal transmitted from the computer device;
A stroke display system comprising:
The computer device includes:
In the display screen, on each of the plurality of stroke screens, processing means for displaying a plain image or a slide image having a predetermined design and displaying a predetermined mark;
Receiving means for receiving the entry information from the electronic pen,
At least one of the stroke screens is projected onto an area of the display surface to which the coding pattern is attached,
When the entry information indicates an input to the stroke screen, the processing means overwrites and displays a handwritten stroke on the slide image based on the entry information,
When the entry information indicates an input to the mark, the slide image is moved to a stroke screen different from the stroke screen being displayed. A computer device;
An electronic pen that is communicable with the computer device, reads an encoded pattern, and generates entry information relating to a handwritten stroke;
A screen having a display surface at least partially printed with a coding pattern;
An instruction medium on which an encoded pattern and a predetermined mark are printed; and
A projector that projects a display screen of the computer device on the display surface based on an image signal transmitted from the computer device;
A stroke display system comprising:
The computer device includes:
In the display screen, a processing unit that displays a plain image or a slide image having a predetermined design on each of the plurality of stroke screens;
Receiving means for receiving the entry information from the electronic pen,
At least one of the stroke screens is projected onto an area of the display surface to which the coding pattern is attached,
When the entry information indicates an input to the stroke screen, the processing means overwrites and displays a handwritten stroke on the slide image based on the entry information,
When the entry information indicates an input to the mark, the slide image is moved to a stroke screen different from the stroke screen being displayed. A screen number of a serial number is assigned to the stroke screen,
The mark is classified into a first mark and a second mark,
When the input information indicates an input to the first mark, the processing means slides the display position of the slide image to the stroke screen where the screen number is increased, and the input information is moved to the second mark. 3. The stroke display system according to claim 1, wherein the display position of the slide image is slid and moved to a stroke screen in which the screen number becomes smaller when the input of the screen is indicated.   When the input information indicates an input to the first mark and the slide image has already been displayed on the stroke screen corresponding to the largest screen number, the processing means displays the slide image as the stroke screen. The stroke display system according to claim 3, wherein the display is performed in such a manner that a part of the slide image that is displayed by being slid is displayed behind and part of the slide image.   When the input information indicates an input to the second mark, the processing means slides the slide image already displayed on the stroke screen corresponding to the smallest screen number on the stroke screen. The stroke display system according to claim 3 or 4, wherein the display is performed in such a manner that a part of the image is visually recognized behind. The slide image is given a page number which is a serial number,
The stroke display system according to any one of claims 1 to 5, wherein the processing means displays all slide images in such a manner that page numbers are visually recognized. The slide image is given a page number which is a serial number,
The processing means is a case in which the input information indicates an input to the first mark, and the page number of the slide image being displayed on the stroke screen having the smallest screen number is the page number appended most recently. The stroke display system according to any one of claims 3 to 6, wherein if there is, a slide image with a page number next to the page number is generated and displayed on the stroke screen. A computer device, an electronic pen that is communicable with the computer device, reads an encoded pattern, and generates entry information relating to a handwritten stroke; a screen having a display surface at least partially printed with the encoded pattern; A program that is mounted on and executed by the computer device in a stroke display system comprising: a projector that projects a display screen of the computer device on the display surface based on an image signal transmitted from the computer device;
In the display screen, each of the plurality of stroke screens displays a plain image or a slide image having a predetermined design, and processing means for displaying a predetermined mark,
Causing the computer device to function as receiving means for receiving the entry information from the electronic pen;
At least one of the stroke screens is projected onto an area of the display surface to which the coding pattern is attached,
When the entry information indicates an input to the stroke screen, the processing means overwrites and displays a handwritten stroke on the slide image based on the entry information,
When the entry information indicates an input to the mark, the slide image is moved to a stroke screen different from the stroke screen being displayed. A computer device, an electronic pen that is communicable with the computer device, reads an encoded pattern and generates entry information relating to a handwritten stroke, a screen having a display surface at least partially printed with the encoded pattern, and a code And a projector for projecting a display screen of the computer device based on an image signal transmitted from the computer device onto the display surface. A program to be executed,
In the display screen, on each of the plurality of stroke screens, processing means for displaying a plain image or a slide image having a predetermined design,
Causing the computer device to function as receiving means for receiving the entry information from the electronic pen;
At least one of the stroke screens is projected onto an area of the display surface to which the coding pattern is attached,
When the entry information indicates an input to the stroke screen, the processing means overwrites and displays a handwritten stroke on the slide image based on the entry information,
When the entry information indicates an input to the mark, the slide image is moved to a stroke screen different from the stroke screen being displayed. A screen number of a serial number is assigned to the stroke screen,
The mark is classified into a first mark and a second mark,
When the input information indicates an input to the first mark, the processing means slides the display position of the slide image to the stroke screen where the screen number is increased, and the input information is moved to the second mark. 10. The program according to claim 8, wherein the display position of the slide image is slid and moved to a stroke screen in which the screen number is reduced when the input is indicated.   When the input information indicates an input to the first mark and the slide image has already been displayed on the stroke screen corresponding to the largest screen number, the processing means displays the slide image as the stroke screen. The program according to claim 10, wherein the program is displayed in such a manner that a part of the slide image that is displayed by being slid is displayed behind and partly.   When the input information indicates an input to the second mark, the processing means slides the slide image already displayed on the stroke screen corresponding to the smallest screen number on the stroke screen. The program according to claim 10 or 11, wherein the program is displayed in a manner in which a part of the image is visible and partly visible. The slide image is given a page number which is a serial number,
The program according to any one of claims 8 to 12, wherein the processing means displays all slide images in such a manner that page numbers are visually recognized. The slide image is given a page number which is a serial number,
The processing means is a case in which the input information indicates an input to the first mark, and the page number of the slide image being displayed on the stroke screen having the smallest screen number is the page number appended most recently. The program according to any one of claims 10 to 13, wherein if there is, a slide image with a page number next to the page number is generated and displayed on the stroke screen.

Images