JP5353219B2 - Board writing system, computer apparatus and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a computer device distinguishing processing to be executed among operations having the same number of taps. <P>SOLUTION: The computer device 2 receives write information from an electronic pen 1, decides whether or not position coordinates of each tap are within the same recognition range when continuously recognizing the taps from the received write information, and performs different processing depending on whether the position coordinates are within the same recognition range or not. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to a computer device that receives and processes information from an electronic pen.

  In recent years, electronic pens that digitize written information have been developed, and “Anoto pen” developed by Swedish company Anoto is known as a representative example. Anotopen is used with dedicated paper on which a predetermined dot pattern is printed. In addition to the usual ink cartridge for writing characters, etc., the anotopen has a small camera for capturing the dot pattern printed on the dedicated paper and the position coordinates on the dedicated paper from the captured dot pattern. A processor for calculating and a data communication unit for transmitting the calculated position coordinates and the like to an external device are mounted. When the user writes characters on the special paper with an anotopen or puts a check mark on the image designed on the special paper, the small camera captures the dot pattern printed on the special paper as the pen moves. The entry information such as characters and images written by the user is recognized from the continuous position coordinates calculated by the processor. Then, this entry information is transmitted from the Anotopen by the data communication unit to a nearby terminal device such as a personal computer or a mobile phone (for example, see Patent Document 1).

  Patent Document 2 describes a remote controller that optically reads a dot pattern printed on a medium surface and transmits the read information to a personal computer. A whiteboard is used as the medium surface, and a predetermined image is obtained by a projector. An electronic blackboard for projection has been proposed. Patent Document 3 describes a transparent sheet on which a mark that can provide position information for a writing type input device to read an input trajectory indicating handwritten content is printed. There has been proposed a method in which the personal computer is mounted on the front of the display.

  Japanese Patent Application Laid-Open No. 2004-228561 describes a technique for issuing a different command depending on the number of taps to a command area by an electromagnetic pen in a handwriting input device that reflects handwritten information in an electronic document. Patent Document 5 describes a technique in which a character data processing apparatus capable of handwritten character input surrounds a character entered with an input pen and is stored in the icon memory when the icon is clicked. Further, Patent Document 6 describes a technique in which, when a handwriting input is performed on a display device with an input function, when a pen is clicked twice continuously, a certain range from that position becomes an input area. ing.

  Patent Document 7 describes a technique for enclosing and moving a character with a pen in a document processing apparatus having a function of recognizing handwritten information. Patent Document 8 describes a technique for displaying a menu on the opposite side of the dominant hand when displaying a menu by instructing coordinates with a pen-type coordinate pointing device.

Japanese translation of PCT publication No. 2003-511761 JP 2008-155421 A JP 2003-256122 A JP 2005-63029 A JP 10-49289 A Japanese Patent Laid-Open No. 08-272515 Japanese Patent Laid-Open No. 05-233611 Japanese Patent Laid-Open No. 04-205137

  In an apparatus capable of performing an input operation using an electronic pen, there is a demand for further improvement in operability by recognizing a plurality of tapped positions. Therefore, the present invention provides a computer device that can distinguish processing to be executed even if the same number of tap operations are performed by determining whether or not the position coordinates of successive taps are within the same recognition range. provide.

In one aspect of the present invention, a computer device that receives entry information from an electronic pen and processes the entry information displays a stroke from the entry information received by the receiving means and receiving means for receiving the entry information. When taps are continuously recognized in the area, if the position coordinates of each tap are not within the same recognition range, the entry information obtained by filling in the area defined by the tap with the electronic pen The display means displays a conversion conversion menu including a selection button for recognizing and displaying a converted text with a stroke, a selection button for moving, or a selection button for deleting, on the display means . And processing means for performing different processing when the position coordinates of each tap are within the same recognition range. As a result, the user can specify what he / she wants to perform a predetermined process out of the contents entered with the electronic pen, and select the displayed menu to perform the process.

In another aspect of the present invention, a computer device that receives entry information from an electronic pen and processes the entry information displays a stroke from the entry information received by the receiving means and a receiving means that receives the entry information. When taps are continuously recognized in the area, if the position coordinates of each tap are not within the same recognition range, the entry information obtained by filling in the area defined by the tap with the electronic pen In addition, processing for performing predetermined processing is performed, and when the position coordinates of each tap are within the same recognition range, processing for displaying a line type menu for setting the line type of the stroke to be displayed on the display means. And a processing means for performing. Thereby, the user can display and select the menu by operating the electronic pen.

In another aspect of the present invention, a computer device that receives entry information from an electronic pen and processes the entry information displays a stroke from the entry information received by the receiving means and a receiving means that receives the entry information. When taps are continuously recognized in the area, if the position coordinates of each tap are not within the same recognition range, the entry information obtained by filling in the area defined by the tap with the electronic pen And a processing means for performing a process for displaying a processing menu that differs depending on the number of taps when the position coordinates of each tap are within the same recognition range. . Thereby, the menu provided to the user can be distinguished based on the number of taps, and the display of the execution menu can be saved.

In another aspect of the present invention, a computer device that receives an entry information from an electronic pen that reads an encoded pattern, calculates coordinate information, and generates entry information and processes the entry information, receiving means for receiving the entry information A display unit on which a transparent sheet on which a coding pattern related to coordinate information read by the electronic pen is formed is superimposed, and a storage unit that stores user's dominant hand information corresponding to the identification information of the electronic pen When the tap is continuously recognized in the area where the stroke is displayed from the entry information received by the receiving means, if the position coordinates of each tap are not within the same recognition range, the tap is defined. Processing for applying predetermined processing to the entry information obtained by filling in the area with the electronic pen, and the position coordinates of each tap are within the same recognition range. In some cases, and a processing means for performing different processes, the processing means, based on the handedness information stored in the storage means, to determine the location for displaying various menus against tap position, the Various menus are displayed on the display means . As a result, when the user fills in the transparent sheet overlaid on the display means, the menu can be displayed at a position that does not become the shadow of the electronic pen held by the user, and the processing menu is displayed more easily for the user. Can do.

In another aspect of the present invention, a board writing system includes: a computer device that reads a coded pattern, calculates coordinate information, generates entry information, receives entry information from an electronic pen, and processes the entry information; and the computer A projector for receiving a video signal for projecting the same video as the video displayed on the display means of the device on the screen, from the computer device, and a screen on which the video is projected by the projector, the screen includes: A coding pattern related to the coordinate information read by the electronic pen is formed, and the computer device receives receiving information on the hand and user's dominant hand information corresponding to the identification information of the electronic pen. a storage storing means, straw from the entry information received by the receiving means When the tap is recognized continuously in the area where the mark is displayed, if the position coordinates of each tap are not within the same recognition range, the tap is entered with the electronic pen in the area defined by the tap. Processing for performing a predetermined process on the given entry information, and when the position coordinates of each tap are within the same recognition range, a processing means for performing a different process, and the processing means, Based on the dominant hand information stored in the storage means, a position for displaying various menus with respect to the tap position is determined, and the various menus are displayed on the display means . According to this board writing system, when the user fills in the screen using the electronic pen, the computer apparatus displays the entry information received from the electronic pen on the display means, and the video displayed on the display means of the computer apparatus A similar image is projected on a screen by a projector. Thereby, the user can project the entry content according to the handwriting of the electronic pen on the screen by the projector by filling in the screen using the electronic pen. Therefore, this board writing system can be used in place of a white board or blackboard in, for example, a classroom or a conference room.

In another aspect of the present invention, a program executed by a computer device that receives entry information from an electronic pen and processes the entry information includes receiving means for receiving entry information, and the entry information received by the receiving means. When taps are recognized continuously in the area where the stroke is displayed, if the position coordinates of each tap are not within the same recognition range, they are entered with the electronic pen in the area defined by the tap. A display conversion menu including a selection button for recognizing and displaying the converted strokes based on the obtained entry information, a selection button for moving, or a selection button for deleting is displayed on the display means. perform make processing, when the position coordinates of each tap is the same recognition range, processing means for performing different processing said computer as, The functioning of the apparatus. As a result, the user can specify what he / she wants to perform a predetermined process out of the contents entered with the electronic pen, and select the displayed menu to perform the process.

In another aspect of the present invention, a program executed by a computer device that receives entry information from an electronic pen and processes the entry information includes receiving means for receiving entry information, and the entry information received by the receiving means. When taps are continuously recognized in the stroke display area, and the position coordinates of each tap are not within the same recognition range, the tap is entered in the area defined by the tap with the electronic pen. The display means displays a line type menu for setting the line type of the stroke to be displayed when the position coordinates of each tap are within the same recognition range. The computer apparatus is caused to function as processing means for performing processing to be displayed on the computer. Thereby, the user can display and select the menu by operating the electronic pen.

In another aspect of the present invention, a program executed by a computer device that receives entry information from an electronic pen and processes the entry information includes receiving means for receiving entry information, and the entry information received by the receiving means. When taps are continuously recognized in the stroke display area, and the position coordinates of each tap are not within the same recognition range, the tap is entered in the area defined by the tap with the electronic pen. Processing means for performing processing for applying predetermined processing to the entered entry information and, when the position coordinates of each tap are within the same recognition range, processing for displaying a processing menu that varies depending on the number of taps on the display means , The computer apparatus is caused to function. Thereby, the menu provided to the user can be distinguished based on the number of taps, and the display of the execution menu can be saved.

In another aspect of the present invention, a program executed by a computer device that receives an entry information from an electronic pen that reads an encoded pattern, calculates coordinate information, and generates entry information to process the entry information, In response to the identification information of the electronic pen, the storage means for storing the dominant hand information of the user, and the tap is continuously recognized in the area for displaying the stroke from the entry information received by the receiving means. When the position coordinates of each tap are not within the same recognition range, the entry information obtained by filling in the area defined by the tap with the electronic pen is used for performing predetermined processing. It performs the processing, when the position coordinates of each tap is the same recognition range, to function the computer as the processing means for performing different processes, the processing hand , Based on the handedness information stored in the storage means, to determine the location for displaying the processing menu against tap position, to display a processing menu on the display means. As a result, when the user is writing, the menu can be displayed at a position that does not become a shadow of the electronic pen held by the user, and the processing menu can be displayed more easily for the user.

According to the present invention, even when the tap operation is performed the same number of times, the process to be executed can be distinguished depending on whether or not the tapped position coordinates are within the same recognition range.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[System configuration of the board writing system]
As shown in FIG. 1, the board writing system 10 in this embodiment includes an electronic pen 1 used by a user, a computer device 2 that receives and processes entry information from the electronic pen 1, and a display ( (Display means) 24 includes a projector 3 that projects a screen (board) 4 and a screen 4.

[Screen (Board)]
First, the screen (board) 4 will be described. The screen 4 presses a sheet 402 on which a dot pattern, which will be described later, is formed by printing on the front surface of a magnet plate 401 that is hard enough to apply the writing pressure to the electronic pen 1 from above, or glue, adhesive, etc. Is pasted. A wall surface may be used instead of the magnet plate 401. Further, instead of the paper 402, a sheet such as a film on which a dot pattern is printed may be used. When the user writes characters or the like on the screen 4 with the electronic pen 1, the electronic pen 1 reads the dot pattern printed on the paper 402 locally and continuously along the movement locus of the pen tip, and the screen 4 The coordinate of the local position in is calculated, and the electronic data is automatically acquired. On the other hand, an image similar to the image (video) displayed on the display unit 24 of the computer apparatus 2 is projected onto the area 403 of the screen 4 by the projector 3. A mark indicating the corner of the area 403 is printed on the paper 402. The user adjusts the distance between the projector 3 and the screen 4, the elevation angle of the projector 3, etc. so that the projector 3 projects an image in a range substantially equal to the area 403.

[Dot pattern]
Next, the dot pattern (coded pattern) printed on the paper 402 of the screen (board) 4 will be described. FIG. 2 is a diagram illustrating the relationship between the dots of the dot pattern printed on the paper 402 and the values to which the dots are converted. As shown in FIG. 2, each dot of the dot pattern is associated with a predetermined value depending on its position. In other words, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the grid (intersection of the vertical line and horizontal line). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on the screen 4 are determined by the combination of information thus associated.

  FIG. 3A shows an arrangement of a certain dot pattern. As shown in FIG. 3A, 6 × 6 dots are arranged within a range of about 2 mm in length and width so that a unique pattern can be obtained regardless of where 6 × 6 dots are taken on the screen 4. Yes. The dot pattern formed by these 36 dots holds position coordinates (for example, where the dot pattern is located on the screen 4) and a dot pattern address (coded pattern address). FIG. 3B is a diagram in which each dot shown in FIG. 3A is converted into a value associated with the regularity shown in FIG. 3 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

[Electronic pen]
Next, the electronic pen 1 will be described. As shown in FIG. 4, the electronic pen 1 includes a pen unit 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM and a RAM, A communication unit 111 including a real-time clock 110, an antenna, and the like, and a battery 112 are provided. The tip of the pen unit 104 is a pen point unit 103, and the user touches the pen point unit 103 of the electronic pen 1 against the screen 4 to enter characters or tap (screen by the pen point unit 103). 4). Since the electronic pen 1 is used for tapping or writing characters on the screen 4 projected by the projector 3, the pen unit 104 does not have to be filled with ink.

  The battery 112 is for supplying electric power to each component in the electronic pen 1. For example, the battery 112 is configured to turn on / off the electronic pen 1 itself by attaching and detaching a cap (not shown) of the electronic pen 1. May be. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied through the pen unit 104 from the pen tip unit 103 when the user writes or taps a character or mark on the screen 4 with the electronic pen 1, that is, the writing pressure, and the value is detected by the processor. To 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when a user writes a character or the like on the screen 4 with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and when the pressure sensor 107 detects a writing pressure higher than a predetermined value, the processor 108 It is determined that entry has started, and the LED 105 and the CMOS camera 106 are operated.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 illuminates infrared rays toward the vicinity of the pen tip portion 103 on the screen 4. The region is slightly shifted from the position where the pen tip portion 103 contacts the screen 4. The CMOS camera 106 captures a dot pattern in the area illuminated by the LED 105 and supplies image data of the dot pattern to the processor 108. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 105 are absorbed by the carbon contained in the dots. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. By photographing with the CMOS camera 106, a threshold value is provided based on the difference in the amount of reflected infrared light, so that a dot region containing carbon can be distinguished from other regions. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 3A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called.

  The processor 108 performs X and Y coordinates (simply “coordinate data”) on the screen 4 of the stroke (handwriting) to be entered by the user from the dot pattern of the image data supplied by the CMOS camera 106 during the user entry. And a dot pattern address (coded pattern address) unique to the screen 4 are continuously calculated. That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 3A supplied by the CMOS camera 106 into the data array shown in FIG. The data is converted into a Y coordinate bit value, and X, Y coordinate data and dot pattern address are calculated from the data array by a predetermined calculation method. Then, the processor 108 associates the current time (time stamp: entered time information) transmitted from the real-time clock 110, the writing pressure data, the dot pattern address, and the X and Y coordinate data. Since the 6 × 6 dot pattern on the screen 4 does not overlap in the screen 4, when the user enters characters or the like with the electronic pen 1, it indicates which position on the screen 4 the entered position corresponds to. It can be specified by coordinate calculation by the processor 108.

  The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. Then, the communication unit 111 associates a pen ID (electronic pen identification information), time information (time stamp), writing pressure data, dot pattern address, and X, Y coordinate data, and enters computer information as entry information. 2 to send. Transmission to the computer apparatus 2 by the communication unit 111 is performed immediately and sequentially by wireless transmission of Bluetooth (registered trademark).

[Computer device]
Next, the computer apparatus 2 will be described. The computer device 2 is configured by a personal computer or the like, which includes an antenna device capable of data communication with the electronic pen 1, a processor such as a CPU, a memory such as a ROM and a RAM, a display, a mouse, a keyboard, and the like as hardware. The FIG. 5 is a functional block diagram of the computer apparatus 2. Functionally, the computer apparatus 2 includes an input unit 21 such as a mouse and a keyboard, a reception unit 22, a transmission unit 23, a display unit 24, a storage unit 25, and a processing unit 26. Then, the computer device 2 performs a predetermined process based on the entry information received from the electronic pen 1.

  The receiving means 22 is constituted by an antenna or the like, receives the entry information from the electronic pen 1 and transmits it to the processing means 26. The transmission unit 23 transmits a video signal according to an instruction from the processing unit 26 to the projector 3, and a data transmission method to the projector 3 may be a wired type or a wireless type. The display means 24 is constituted by a display or the like, and displays the contents instructed by the processing means 26.

  The storage unit 25 is configured by a memory such as a ROM or a RAM. The storage unit 25 stores, in advance, dominant hand information in which the user's dominant hand is associated with each pen ID of the electronic pen 1 (see FIG. 6). In addition, the storage unit 25 previously stores, for each menu described later, processing menu information that associates the image information of the image of the processing menu with the width M in the X direction, and the relative of each execution menu button included in the processing menu. The information which matched the specific coordinate area | region and the process to perform is memorize | stored (refer Fig.10 (a), FIG.14 and FIG.16). Further, the storage unit 25 stores the entry information received from the electronic pen 1 for each pen ID or temporarily stores the absolute coordinate area of the execution menu button according to the processing instruction of the processing unit 26.

  The processing means 26 is constituted by a processor such as a CPU, and based on the entry information received from the electronic pen 1 by the receiving means 22, displays the entry contents in various forms on the display means 24. A predetermined process such as causing the transmission unit 23 to transmit a video signal for projecting the same image as the image to be displayed to the projector 3 to the projector 3 is executed.

  The projector 3 projects an image similar to the image displayed on the display unit 24 on the area 403 of the screen (board) 4 based on the video signal received from the transmission unit 23 of the computer apparatus 2.

  Next, various display forms processed by the computer device 2 based on the entry information received from the electronic pen 1 will be described.

(Display form 1)
FIG. 7 shows a display form when the user enters characters with the electronic pen 1 in the area 403 of the screen 4. When the user enters “ABC” on the screen 4 with the electronic pen 1A (pen ID “pen01”), the electronic pen 1A uses the stroke information (coordinate data) “ABC”, the pen ID “pen01”, and the like as entry information. It transmits to the computer apparatus 2. In the computer apparatus 2, the received entry information is distinguished for each pen ID and stored in the storage unit 25. The storage means 25 stores in advance information for converting the coordinate information of the dot pattern included in the area 403 of the screen 4 in accordance with the resolution of the display area 201 of the display without changing the aspect ratio. The means 26 refers to the conversion information, converts the stroke information “ABC” included in the entry information received from the electronic pen 1A, and positions corresponding to the screen 4 in the display area 201 of the display (display means 24). Are displayed as an “ABC” image. At the same time, the processing unit 26 causes the transmission unit 23 to transmit a video signal for causing the projector 3 to project the stroke information “ABC” as an image “ABC” onto the screen 4. Then, the projector 3 matches the image similar to the image in the display area 201 with the position of the handwriting “ABC” written with the electronic pen 1 in the area 403 of the screen 4 based on the video signal received from the transmission unit 23. To “ABC”. In FIG. 7, the display state of the area near the area where the “ABC” image is projected in the area 403 of the screen 4 is shown enlarged in a dotted line.

(Display form 2)
FIG. 8 shows a display form when the user taps the electronic pen 1 twice in the same recognition range of the area 403 of the screen 4 continuously. Here, “within the same recognition range” means a case where the second tap enters a circle having a predetermined radius R centered on the position of the first tap. That is, if the length between two taps is within a predetermined range R (several mm), the tap is within the same recognition range. When the user taps twice within the same recognition range of the screen 4 with the electronic pen 1A (pen ID “pen01”), the electronic pen 1A uses the stroke information (tap) and the pen ID “pen01” as entry information to the computer apparatus 2 Send to. In the computer apparatus 2, the processing means 26 determines whether or not the first tap and the second tap are within the same recognition range based on the received entry information. 5 is displayed. At this time, the processing unit 26 refers to the dominant hand information stored in the storage unit 25, reads that the user with the pen ID “pen01” is right-handed, and uses the right-handed hand as a shadow of the electronic pen 1A. The line type menu 5 is displayed on the left side of the second tap position (display reference point) so as not to be hidden. At this time, the processing means 26 refers to the processing menu information, and as the coordinate point (Xn, Yn) of the specific corner of the line type menu 5, the X coordinate is obtained from the X coordinate of the display reference point. The value obtained by subtracting the width M in the X direction of the pattern is temporarily stored in the storage unit 25 as the Y coordinate value, the same value as the Y coordinate of the display reference point. If the coordinate point temporarily stored is (X0, Y0), the display unit 24 displays the picture of the line type menu 5 with the position coordinate of (X0, Y0) as a reference. At the same time, the processing unit 26 causes the transmission unit 23 to transmit a video signal for causing the projector 3 to project the pattern of the line type menu 5 to the projector 3. The projector 3 projects the pattern of the line type menu 5 onto the area 403 of the screen 4.

  Note that the processing unit 26 may determine that the tap is a stroke (point) where the contact between the electronic pen 1 and the screen 4 is not continuous, or a tap if the stroke is shorter than a predetermined length. You may judge.

  FIG. 9 is a display example of the line type menu 5. The line type menu 5 includes execution menu buttons 501, 502, and 503 for changing the line color, execution menu buttons 504, 505, and 506 for changing the line thickness, and an execution menu button 507 for ending the line type menu 5. It consists of. When the user taps one of these execution menu buttons on the screen 4 with the electronic pen 1, the processing means 26 recognizes the execution menu in the coordinate area including the coordinates of the tap position and associates it with the execution menu. Process. Here, as shown in FIG. 10A, the line type menu 5 includes a relative coordinate area and a process to be executed with respect to a coordinate point (Xn, Yn) of a specific corner of the line type menu 5 of each execution menu button. Are stored in the storage means 25 in association with each other. Then, the processing unit 26 displays the line type menu 5 on the display unit 24, calculates the absolute coordinate area of each execution menu button, and temporarily stores it in the storage unit 25. For example, the processing means 26 stores, as the coordinate area of the execution menu button 501, the X coordinate is a value obtained by adding X1 to X0, the Y coordinate is a value obtained by adding Y1 to Y0, and W1 and H1 are stored as they are. The means 25 is temporarily stored. As shown in FIG. 10B, the coordinate area of the execution menu button is defined by a coordinate point (Xn, Yn) of a specific corner, a width Wn in the X direction, and a height Hn in the Y direction. It has been.

  Specifically, the execution menu button 501 is associated with a process of registering the line type ID “L71 (black)” in the pen ID of the electronic pen 1 that has tapped (selected) the execution menu button. That is, when the user taps the execution menu button 501 on the screen 4 with the electronic pen 1, the processing means 26 sets the color of the line to be displayed based on the entry information of the electronic pen 1 to black. When the user taps the execution menu button 502 on the screen 4 with the electronic pen 1, the processing unit 26 sets the color of the line to be displayed to red, and the user taps the execution menu button 503 on the screen 4 with the electronic pen 1. Then, the processing means 26 sets the color of the line to be displayed to blue. Similarly, when the user taps the execution menu button 504 on the screen 4 with the electronic pen 1, the processing unit 26 sets the thickness of the line to be displayed from the entry information of the electronic pen 1 to “thin”. When the user taps the execution menu button 505 on the screen 4 with the electronic pen 1, the processing unit 26 sets the line thickness to be displayed to “medium”, and the user selects the execution menu button on the screen 4 with the electronic pen 1. When tapping 506, the processing means 26 sets the thickness of the line to be displayed to “thick”. Then, when the user taps the execution menu button 507 on the screen 4 with the electronic pen 1, the processing unit 26 ends the line type menu 5 and at a specific corner of the line type menu 5 temporarily stored in the storage unit 25. Coordinate points (X0, Y0) and the coordinate area of each execution menu (absolute coordinate area in the current line type menu 5 display) are deleted from the storage means 25.

  As illustrated in FIG. 11, the storage unit 25 stores a pen ID and a line type (line color and thickness) in association with each other as line type information. For example, when the user taps the execution menu 506 with the electronic pen 1B having the pen ID “pen02”, the line thickness “thick” is registered in the line type corresponding to the pen ID “pen02”. If the line type is not registered, for example, the line color is displayed as black and the line thickness is displayed as “medium” by default.

(Display form 3)
FIG. 12 shows a display form when the user taps the area 403 of the screen 4 three times in succession with the electronic pen 1. When the user taps the screen 4 three times with the electronic pen 1B (pen ID “pen02”), the electronic pen 1B transmits the stroke information (tap) and the pen ID “pen02” to the computer apparatus 2 as entry information. In the computer apparatus 2, the processing means 26 displays the file menu 6 if there are three taps based on the received entry information. At this time, the processing unit 26 refers to the dominant hand information stored in the storage unit 25 (see FIG. 6), reads that the user with the pen ID “pen02” is left-handed, and holds the electronic pen 1 with the left-handed hand. The file menu 6 is displayed on the right side of the third tap position (display reference point) so as not to be hidden by the shadow. At this time, the processing unit 26 temporarily stores the same value as the coordinates of the display reference point in the storage unit 25 as the coordinate point (Xn, Yn) of the specific corner of the file menu 6. Here, the coordinate point temporarily stored is (X0, Y0). The processing unit 26 calculates an absolute coordinate area of each execution menu button and temporarily stores it in the storage unit 25. For example, the processing means 26 stores, as the coordinate area of the execution menu button 601, the X coordinate is a value obtained by adding X8 to X0, the Y coordinate is a value obtained by adding Y8 to Y0, and W8 and H8 are stored as they are. The means 25 is temporarily stored. Then, the picture of the file menu 6 is displayed on the display means 24 with reference to the temporarily stored coordinate point (X0, Y0). At the same time, a video signal for causing the projector 3 to project the image of the file menu 6 is transmitted from the transmission unit 23 to the projector 3. The projector 3 projects the pattern of the file menu 6 onto the area 403 of the screen 4.

  FIG. 13 shows a display example of the file menu 6. The file menu 6 ends the execution menu buttons 601, 602, 603, and 604 for adding or deleting pages, execution menu buttons 605, 606, 607, and 608 for moving pages to be displayed, and the file menu 6. And an execution menu button 609. As shown in FIG. 14, the file menu 6 is a storage means in which a relative coordinate area with respect to a coordinate point (Xn, Yn) of a specific corner of the file menu 6 of each execution menu button is associated with a process to be executed. 25. Specifically, the execution menu button 601 is associated with a process for adding a page. That is, when the user taps the execution menu button 601 on the screen 4, the processing unit 26 adds a new page and displays it on the display unit 24. Similarly, when the user taps the execution menu button 602 on the screen 4, the processing unit 26 deletes the current page, and when the user taps the execution menu button 603 on the screen 4, the processing unit 26 deletes the file. When the processing menu for opening is displayed on the display unit 24 and the user taps the execution menu button 604 on the screen 4, the processing unit 26 stores the current file. When the user taps the execution menu button 605 on the screen 4, the processing unit 26 displays the display content of the first page on the display unit 24, and when the user taps the execution menu button 606 on the screen 4, the processing unit 26 When the display content of the previous page is displayed on the display means 24 and the user taps the execution menu button 607 on the screen 4, the processing means 26 causes the display content of the next page to be displayed on the display means 24, and the user When the execution menu button 608 is tapped, the processing unit 26 causes the display unit 24 to display the display content of the last page. Then, when the user taps the execution menu button 609 on the screen 4, the processing unit 26 ends the file menu 6, and at the same time the coordinate point (X 0, X) of the file menu 6 temporarily stored in the storage unit 25. Y0) and the coordinate area of each execution menu are deleted from the storage means 25.

(Display form 4)
FIG. 15 shows a display form in the case where the user enters characters in the area 403 of the screen 4 with the electronic pen 1 and then taps twice in different recognition ranges. When the user first enters a character string “Aman” on the screen 4 with the electronic pen 1B (pen ID “pen02”), the electronic pen 1B displays the stroke information (coordinate data) “Aman”, the pen ID “pen02”, and the like. It is transmitted to the computer apparatus 2 as entry information. The computer apparatus 2 performs the same processing as in the display mode 1 described above, and causes the display area 201 and the screen 4 to display an image of “That”. Next, when the user taps with the electronic pen 1B so as to surround the character string projected on the screen 4 with a rectangle having two tap points as diagonal vertices, the electronic pen 1B receives stroke information (tap). ) And pen ID “pen02” are transmitted to the computer apparatus 2 as entry information. In the computer apparatus 2, the processing means 26 determines whether or not the first tap and the second tap are within the same recognition range based on the received entry information. A rectangular region having the tap position as a diagonal vertex is recognized, and the entry conversion menu 7 is displayed on the display means 24. At this time, the processing unit 26 refers to the dominant hand information stored in the storage unit 25 (see FIG. 6), reads that the user with the pen ID “pen02” is left-handed, and holds the electronic pen 1 with the left-handed hand. The entry conversion menu 7 is displayed on the right side of the second tap position (display reference point) so as not to be hidden by the shadow. The entry conversion menu 7 includes execution menus 701, 702, and 703 for performing processing on strokes existing in the recognized rectangular area, and an execution menu 704 for ending the entry conversion menu 7. At this time, the processing unit 26 temporarily stores the same value as the coordinates of the display reference point in the storage unit 25 as the coordinate point (Xn, Yn) of the specific corner of the entry conversion menu 7. Here, the coordinate point temporarily stored is (X0, Y0). The processing unit 26 calculates an absolute coordinate area of each execution menu button and temporarily stores it in the storage unit 25. For example, the processing means 26 stores, as the coordinate area of the execution menu button 701, the X coordinate is a value obtained by adding X17 to X17, the Y coordinate is a value obtained by adding Y17 to Y17, and W17 and H17 are stored as they are. The means 25 is temporarily stored. Then, the picture of the entry conversion menu 7 is displayed on the display means 24 with reference to the temporarily stored coordinate point (X0, Y0). At the same time, a video signal for causing the projector 3 to project the picture of the entry conversion menu 7 is transmitted from the transmission unit 23 to the projector 3. The projector 3 projects the pattern of the entry conversion menu 7 on the area 403 of the screen 4.

  As shown in FIG. 16, the entry conversion menu 7 is stored in the storage means 25 in association with the coordinate area relative to the coordinate point of a specific corner of the entry conversion menu 7 of the execution menu button and the process to be executed. ing. Specifically, the execution menu button 701 is associated with a process for converting the entry content into text. That is, when the user taps the execution menu button 701 on the screen 4, the processing means 26 recognizes the character “stroke” in the rectangular area and converts it to text. Further, when the user taps the execution menu button 702 on the screen 4, the processing unit 26 moves the stroke “That” in the rectangular area. As the movement destination, for example, the processing unit 26 may process the position corresponding to the next tap position by the electronic pen 1. When the user taps the execution menu button 703 on the screen 4, the processing unit 26 deletes the stroke information of the stroke “A” in the rectangular area from the storage unit 25 and erases the display area 201 and the display on the screen 4. Then, when the user taps the execution menu 704 button on the screen 4, the processing unit 26 ends the entry conversion menu 7, and at the coordinate point (a specific angle of the entry conversion menu 7 temporarily stored in the storage unit 25 ( Xn, Yn) and the coordinate area of each execution menu are deleted from the storage means 25. It is also possible to determine whether or not there is a stroke in a rectangular area having the tap position as a diagonal vertex. If there is no stroke, the entry conversion menu 7 is not displayed or the processing menu to be displayed may be changed. Good.

  In the above display modes 1 to 4, when the user taps each execution menu button on the screen 4 using the electronic pen 1, the processing unit 26 stores the storage unit in association with each execution menu button. 25, the cursor on the display area 201 of the display (display unit 24) is positioned at each execution menu button using the mouse of the input unit 21. Then, the processing means 26 may execute the processing by clicking.

[Processing flow by board writing system]
Next, a processing flow by the board writing system 10 of this embodiment will be described with reference to FIG. The process flow shown in FIG. 17 is performed every time the user enters a tap or stroke in the area 403 of the screen 4 with the electronic pen 1.

  First, this processing flow will be described. When the user enters characters or the like in the area 403 of the screen 4 with the electronic pen 1, the electronic pen 1 generates entry information by associating the stroke information of the contents entered by the user with the pen ID and the like, and the computer apparatus 2. (Step S101).

  In the computer apparatus 2, when the receiving means 22 receives the entry information transmitted from the electronic pen 1, the processing means 26 stores the entry information including the stroke information and the pen ID in the storage means 25 (step S201). Subsequently, the processing means 26 determines whether or not the selection of the execution menu has been recognized from the entry information (step S202). When the selection of the execution menu is recognized (step S202: Yes), the processing unit 26 executes the selected execution menu (step S211) and ends the process. On the other hand, when the processing unit 26 does not recognize the selection of the execution menu (step S202: No), the processing unit 26 is continuously tapped twice with the same electronic pen 1 based on the stroke information and the pen ID. It is determined whether or not (step S203). When it is determined that the processing unit 26 has not been tapped twice with the same electronic pen 1 (step S203: No), the processing unit 26 refers to the storage unit 25 and displays line type information corresponding to the pen ID (see FIG. 11), the stroke is displayed on the display means 24 in accordance with the line type information (step S210), and the process is terminated. On the other hand, when it is determined that the processing means 26 has been tapped twice with the same electronic pen 1 (step S203: Yes), the processing means 26 has further been tapped three times with the same electronic pen 1. Is determined (step S204).

  When it is determined that the processing unit 26 is not tapped three times with the same electronic pen 1 (step S204: No), the processing unit 26 determines that the coordinates of the first and second tap positions are within the same recognition range (tap. It is determined whether the interval length is within a predetermined length range (step S206). When the processing unit 26 determines that the coordinates of the first and second tap positions are outside the same recognition range (step S206: No), the processing unit 26 sets the positions of the two taps as diagonal vertices. A rectangular area is recognized (step S208). Next, the processing means 26 reads the dominant hand information (see FIG. 6) based on the pen ID with reference to the storage means 25, and fills in the conversion conversion menu on the display means 24 so as not to be hidden by the shadow of the electronic pen 1 held by the dominant hand. 7 is displayed (step S209), and the process is terminated. On the other hand, when the processing unit 26 determines that the coordinates of the first and second tap positions are within the same recognition range (step S206: Yes), the processing unit 26 refers to the storage unit 25 and based on the pen ID. The dominant hand information (see FIG. 6) is read, the line type menu 5 is displayed on the display means 24 so as not to be hidden by the shadow of the electronic pen 1 held by the dominant hand (step S207), and the process is terminated.

  On the other hand, when it is determined that the processing unit 26 has been tapped three times with the same electronic pen 1 (step S204: Yes), the processing unit 26 refers to the storage unit 25 and determines the dominant hand information based on the pen ID (see FIG. 6). ), The file menu 6 is displayed on the display means 24 so as not to be hidden by the shadow of the electronic pen 1 held by the dominant hand (step S205), and the process is terminated.

(Display form 1)
Next, processing when characters are entered as in the display mode 1 shown in FIG. 7 will be described with reference to FIG. When the user enters, for example, “ABC” in the area 403 of the screen 4 with the electronic pen 1, the electronic pen 1 immediately and sequentially fills in information including stroke information (coordinate data) and a pen ID. Is transmitted to the computer apparatus 2 (S101). In the computer apparatus 2, when the entry information is received by the receiving means 22, the processing means 26 distinguishes the entry information for each pen ID and stores it in the storage means 25 (S201). At this time, the processing means 26 does not recognize that the execution menu is selected from the entry information (S202: No), and does not recognize that it has been tapped twice with the same electronic pen 1 (S203: No). The line type information is read with reference to the storage unit 25, and the stroke is displayed on the display area 201 of the display (display unit) 24 in accordance with the line type information. At the same time, the processing unit 26 causes the transmission unit 23 to transmit the video signal to the projector 3. Then, the projector 3 projects an image similar to the image in the display area 201 to the area 403 of the screen 4 as “ABC” in accordance with the position of the handwriting “ABC” entered with the electronic pen 1.

(Display form 2)
Next, processing in the case of tapping twice in the same recognition range in the area 403 on the screen 4 in the display mode 2 in FIG. 8 will be described with reference to FIG. When the user taps the screen 4 with the electronic pen 1 for the first time, the electronic pen 1 transmits entry information including coordinate data and a pen ID at the position of the tap to the computer apparatus 2 (S101). . In the computer apparatus 2, when the entry information is received by the receiving means 22, the processing means 26 distinguishes the entry information for each pen ID and stores it in the storage means 25 (S201). At this time, the processing means 26 recognizes that it is a tap from the entry information, but does not recognize that the execution menu is selected (S202: No), and also recognizes that it has been tapped twice with the same electronic pen 1. Therefore, the line type information is read with reference to the storage unit 25, and the tap is displayed on the display area 201 of the display (display unit) 24 according to the line type information. At the same time, the processing unit 26 causes the transmission unit 23 to transmit the video signal to the projector 3. Then, the projector 3 projects an image similar to the image in the display area 201 on the area 403 of the screen 4 according to the position of the handwriting entered with the electronic pen 1.

  Furthermore, when the user taps the screen 4 with the electronic pen 1 for the second time, the electronic pen 1 transmits the entry information including the coordinate data and the pen ID at the position of the tap to the computer device 2 (S101). ). In the computer apparatus 2, when the entry information is received by the receiving means 22, the processing means 26 distinguishes the entry information for each pen ID and stores it in the storage means 25 (S201). At this time, the processing means 26 recognizes that it is a tap from the entry information, but does not recognize that the execution menu is selected (S202: No), but with the same electronic pen 1 together with the previous tap. Then, it is recognized that the tapping has been performed twice (S203: Yes). However, since the processing unit 26 does not recognize that the same electronic pen 1 has been tapped three times (S204: No), it determines whether the coordinates of the first and second tap positions are within the same recognition range. (S206). At this time, since the processing means 26 determines that the coordinates of the first and second tap positions are within the same recognition range (S206: Yes), the processing menu information and the electronic pen 1 of the electronic pen 1 are referred to the storage means 25. Read the user's dominant hand information (see Fig. 6) and set the line type menu 5 on the specific side (opposite side of the dominant hand) to the second tap position (display reference point) so as not to be hidden by the shadow of the electronic pen 1 held by the dominant hand (S207).

  Here, the transmission means 26 uses the same value as the position coordinate of the display reference point as the coordinate point (Xn, Yn) of the specific corner of the line type menu 5 according to the read dominant hand information, that is, if it is left-handed. If it is right-handed, the value obtained as a result of calculation using the width M in the X direction of the pattern of the line type menu 5 is temporarily stored in the storage means 25. Here, the coordinate point temporarily stored is (X0, Y0). Further, the processing means 26 refers to the line type menu information (refer to FIG. 10) stored in the storage means 25, and the coordinate points of the line type menu 5 of the execution menus 501 to 507 included in the line type menu 5 ( From the coordinate area relative to (X0, Y0), the absolute coordinate area of each execution menu is calculated and temporarily stored in the storage means 25. Then, the processing means 26 causes the display means 24 to display the pattern of the line type menu 5 with reference to the coordinate point (X0, Y0) of the line type menu 5 temporarily stored. Since the processing unit 26 transmits a video signal of the same image as the display unit 24 from the transmission unit 23 to the projector 3, the projector 3 uses the same line type as the image displayed in the display area 201 of the display unit 24. The image of menu 5 is projected onto area 403 of screen 4.

  It is assumed that the user taps a specific execution menu on the screen 4 with the electronic pen 1 in a state where the line type menu 5 is displayed in the area 403 of the screen 4 by the projector 3. The electronic pen 1 transmits the entry information including the coordinate data at the tap position in the execution menu area displayed on the screen 4 and the pen ID to the computer apparatus 2 (S101). In the computer apparatus 2, when the entry information is received by the receiving means 22, the processing means 26 distinguishes the entry information for each pen ID and stores it in the storage means 25 (S201). Then, the processing means 26 recognizes that the coordinate data of the entry information is the coordinate area of the execution menu temporarily stored in the storage means 25, and therefore recognizes that the execution menu is selected (S202: Yes), The execution menu is executed (S211).

(Display form 3)
Next, processing in the case of tapping three times in the area 403 on the screen 4 in the display mode 3 in FIG. 12 will be described with reference to FIG. Up to the second continuous tap, the above-described processing steps are performed. When the user performs the second tap with the electronic pen 1, the electronic pen 1 uses the coordinate data, pen ID, and the like at the tap position. Is sent to the computer apparatus 2 (S101). In the computer apparatus 2, when the entry information is received by the receiving means 22, the processing means 26 distinguishes the entry information for each pen ID, stores it in the storage means 25 (S201), and recognizes that it is a tap from the entry information. Although it is not recognized that the execution menu is selected (S202: No), it is recognized that the execution menu is tapped twice with the same electronic pen 1 (S203: Yes). Since the third tap has not been made yet, the processing unit 26 does not recognize that the third tap has been made with the same electronic pen 1 (S204: No), and the coordinates of the first and second tap positions are the same. Depending on whether or not it is within the range (S206), the process of step S207 or steps S208 and 209 is performed, but if the stroke is not recognized in the rectangular area (S208), the entry change menu 7 is displayed in step S209. Not. Here, the time interval from when the processing means 26 receives the entry information about the second tap until the line type menu 5 or the entry change menu 7 is displayed on the display means 24 is determined by the third tap. If it is set, the line type menu 5 or the entry change menu 7 is set before the third tap is made if the time interval from the second to the third tap is set. It can be prevented from being displayed.

  When the user taps with the electronic pen 1 for the third time, the electronic pen 1 transmits entry information including coordinate data and a pen ID at the position of the tap to the computer device 2 (S101). In the computer apparatus 2, when the entry information is received by the receiving means 22, the processing means 26 distinguishes the entry information for each pen ID, stores it in the storage means 25 (S201), and recognizes that it is a tap from the entry information. The execution menu is not recognized as being selected (S202: No), but is recognized as being tapped twice with the same electronic pen 1 (S203: Yes), and three times in succession with the same electronic pen 1. It recognizes that it was tapped (S204: Yes). Further, the processing means 26 reads the processing menu information and dominant hand information with reference to the storage means 25 (see FIG. 6), and sets the file menu 6 to the third tap position so as not to be hidden by the shadow of the electronic pen 1 held by the dominant hand. Display on a specific side (opposite side of the dominant hand) with respect to (display reference point) (S205). Here, the transmission means 26 performs the same processing as when the line type menu 5 is displayed, and the value of the coordinate point (Xn, Yn) of the specific corner of the file menu 6 and each of the items included in the file menu 6. The absolute coordinate area values of the execution menus 601 to 609 are calculated and temporarily stored in the storage means 25. Then, the processing means 26 displays the design of the file menu 6 on the display means 24 with reference to the coordinate point (X0, Y0) of the specific corner of the file menu 6 temporarily stored. At the same time, the processing unit 26 causes the transmission unit 23 to transmit the video signal to the projector 3. Then, the projector 3 projects the image of the file menu 6 onto the area 403 of the screen 4 in the same manner as the image by the display unit 24.

  It is assumed that the user taps a specific execution menu on the screen 4 with the electronic pen 1 in a state where the file menu 6 is displayed on the area 403 of the screen 4 by the projector 3. The electronic pen 1 transmits the entry information including the coordinate data at the tap position in the execution menu area displayed on the screen 4 and the pen ID to the computer apparatus 2 (S101). In the computer apparatus 2, when the entry information is received by the receiving means 22, the processing means 26 distinguishes the entry information for each pen ID and stores it in the storage means 25 (S201). Then, the processing means 26 recognizes that the coordinate data of the entry information is the coordinate area of the execution menu temporarily stored in the storage means 25, and therefore recognizes that the execution menu is selected (S202: Yes), The execution menu is executed (S211).

(Display form 4)
Next, processing in the case of processing a stroke with two taps to different recognition ranges in the area 403 on the screen 4 in the display form 4 in FIG. 15 will be described with reference to FIG. First, the user uses the electronic pen 1 to enter characters or the like (such as “That”) on the screen 4. Then, the electronic pen 1 immediately and sequentially transmits entry information including stroke information (coordinate data) and a pen ID to the computer device 2 (S101). In the computer apparatus 2, when the entry information is received by the receiving means 22, the processing means 26 distinguishes the entry information for each pen ID and stores it in the storage means 25 (S201). At this time, the processing means 26 does not recognize that the execution menu is selected from the entry information (S202: No), and does not recognize that it has been tapped twice with the same electronic pen 1 (S203: No). The line type information is read with reference to the storage unit 25, and the stroke is displayed on the display area 201 of the display (display unit) 24 in accordance with the line type information. At the same time, the processing unit 26 causes the transmission unit 23 to transmit the video signal to the projector 3. Then, the projector 3 projects an image similar to the image displayed on the display unit 24 onto the area 403 of the screen 4 in accordance with the position of the handwriting entered with the electronic pen 1.

  The user taps the screen 4 with the electronic pen 1 for the first time at the position of one vertex in the virtual rectangle for enclosing the entered character or the like. Then, the electronic pen 1 transmits entry information including the coordinate data at the position of the tap, the pen ID, and the like to the computer device 2 (S101). In the computer apparatus 2, when the entry information is received by the receiving means 22, the processing means 26 distinguishes the entry information for each pen ID and stores it in the storage means 25 (S201). At this time, the processing means 26 recognizes that it is a tap from the entry information, but does not recognize that the execution menu is selected (S202: No), and also recognizes that it has been tapped twice with the same electronic pen 1. Therefore, the line type information is read with reference to the storage unit 25, and the tap is displayed on the display area 201 of the display (display unit) 24 according to the line type information. At the same time, in order to cause the transmission means 23 to transmit a video signal to the projector 3, the projector 3 positions the same image as the display image by the display means 24 in the area 403 of the screen 4 with the electronic pen 1. The image is projected in accordance with the position of the handwriting of the electronic pen 1.

  Further, the user taps the screen 4 with the electronic pen 1 for the second time at the position of the diagonal vertex in the virtual rectangle for enclosing the entered character or the like. That is, the first and second tap positions correspond to diagonal vertices in a virtual rectangle for enclosing the entered character or the like. Then, the electronic pen 1 transmits entry information including the coordinate data and the pen ID at the second tap position to the computer device 2 (S101). In the computer apparatus 2, when the entry information is received by the receiving means 22, the processing means 26 distinguishes the entry information for each pen ID and stores it in the storage means 25 (S201). At this time, the processing means 26 recognizes that it is a tap from the entry information, but does not recognize that the execution menu is selected (S202: No). Further, the processing means 26 recognizes that the same electronic pen 1 has been tapped twice (S203: Yes), but does not recognize that the same electronic pen 1 has been tapped three times (S204: No). Therefore, the processing means 26 determines whether or not the coordinates of the first and second tap positions are within the same recognition range (S206). Here, since the first and second tap positions are separated by a length corresponding to the length of the written character, the processing unit 26 does not have the coordinates of the first and second tap positions within the same recognition range. (S206: No). In addition, the processing means 26 recognizes a rectangular area having the positions of the two taps as diagonal vertices (S208), and refers to the storage means 25 to determine the dominant hand information based on the processing menu information and the pen ID (see FIG. 6). ) And the entry conversion menu 7 is displayed on the display means 24 so as not to be hidden by the shadow of the electronic pen 1 held by the dominant hand (S209).

  Here, the transmission means 26 includes the value of the coordinate point (Xn, Yn) of the specific corner of the entry conversion menu 7 and the entry conversion menu 7 by the same process as when the line type menu 5 is displayed. The absolute coordinate area of each execution menu 701 to 704 is calculated and temporarily stored in the storage means 25. Then, the processing unit 26 causes the display unit 24 to display the picture of the entry conversion menu 7 with reference to the coordinate point (X0, Y0) of the specific corner of the entry conversion menu 7 temporarily stored. At the same time, since the processing unit 26 causes the transmission unit 23 to transmit the video signal to the projector 3, the projector 3 projects the entry conversion menu 7 onto the area 403 of the screen 4 as with the image by the display unit 24. To do.

  It is assumed that the user taps a specific execution menu on the screen 4 with the electronic pen 1 while the entry conversion menu 7 is displayed on the screen 4 by the projector 3. The electronic pen 1 transmits the entry information including the coordinate data at the tap position in the execution menu area displayed on the screen 4 and the pen ID to the computer apparatus 2 (S101). In the computer apparatus 2, when the entry information is received by the receiving means 22, the processing means 26 distinguishes the entry information for each pen ID and stores it in the storage means 25 (S201). Then, the processing means 26 recognizes that the coordinate data of the entry information is the coordinate area of the execution menu temporarily stored in the storage means 25, and therefore recognizes that the execution menu is selected (S202: Yes), The execution menu is executed (S211).

[Operational effects of the board writing system of this embodiment]
According to the board writing system 10, characters or the like entered by the user in the area 403 of the screen (board) 4 with the electronic pen 1 can be projected in accordance with the written position of the screen 4. Thus, the user can fill in the screen 4 in the same manner as a normal ink pen, and can be used in place of a whiteboard or blackboard in a classroom or a conference room. Further, by simultaneously determining the number of taps by the electronic pen 1 and the difference in tap positions, the menu functions provided to the user can be distinguished, and the number of execution menus displayed at a time can be omitted to the minimum. it can. Furthermore, by specifying the user who fills in for each electronic pen 1 and referring to the user's handedness information prepared in advance, the menu can be displayed at a position that does not become a shadow of the electronic pen 1 possessed by the user, which is easy for the user to view. Can be displayed. Thereby, convenience and operability are improved.

[Modification]
In the above embodiment, the board writing system 10 includes the electronic pen 1 used by the user, the computer device 2 that receives and processes the entry information from the electronic pen 1, and the display (display means) 24 of the computer device 2. Although the projector 3 that displays the same image as the image displayed on the display area 201 on the display area 403 of the screen (board) 4 and the screen 4 are configured, as shown in FIG. The transparent sheet 8 on which the dot pattern is printed may be superposed on the display 201 of the computer device 2 by pasting or the like. As a result, the user can fill in the display 201 of the computer apparatus 2 with the electronic pen 1.

  In the above embodiment, when the number of continuous taps with the same electronic pen 1 is 3 in the processing flow by the board writing system 10, the file menu 6 is displayed unconditionally. The application is not limited to this, and it is possible to determine whether the coordinates of the tap position are within the same recognition range, and display the file menu 6 when the coordinates of the tap position are within the same recognition range. . Thereby, it can be identified whether the user has consciously tapped continuously within the same recognition range.

  In the above embodiment, after determining the number of taps in the processing flow by the board writing system 10, it is determined whether or not the coordinates of the tap position are within the same recognition range. The number of taps may be determined after determining whether the coordinates of the tap position are within the same recognition range. Also by this, the same effect as the above-described embodiment can be obtained.

  In the above embodiment, in the processing flow by the board writing system 10, the computer apparatus 2 processes the tap as a kind of stroke, but the application of the present invention is not limited to this, and the tap and the stroke are defined. It is possible to distinguish between the stroke and the tap first, and the process of steps S203 to S209 may be performed only in the case of a tap. Thereby, the processing speed can be increased. Further, the processing unit 26 may not display the tap on the display unit 24.

  Moreover, in the said embodiment, although the object processed with the entry conversion menu 4 in the display form 4 was made into the rectangular area prescribed | regulated by two taps, the polygon which makes three or more tap positions apexes The entry content included in the area may be processed.

It is a system block diagram of a board writing system. It is explanatory drawing which shows the relationship between the arrangement | positioning of the dot in a dot pattern, and the value converted. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is the schematic which shows the structure of an electronic pen. It is a functional block diagram of a computer apparatus. It is a conceptual diagram which shows the data structure of dominant hand information. It is a figure which shows the display form when a user writes in a screen with an electronic pen. It is a figure which shows the display form when a user taps twice within the same recognition range of a screen with an electronic pen. It is an example of a display of a line type menu. (A) is a conceptual diagram which shows the data structure of a line | wire type menu. (B) is a figure explaining the prescription | regulation of a coordinate area | region. It is a conceptual diagram which shows the data structure of line | wire type information. It is a figure which shows the display form when a user taps a screen 3 times continuously with an electronic pen. It is a display example of a file menu. It is a conceptual diagram which shows the data structure of a file menu. It is a figure which shows the display form when a user taps twice outside the same recognition range of a screen with an electronic pen twice. It is a conceptual diagram which shows the data structure of an entry conversion menu. It is a processing flow by a board writing system. It is a block diagram of the computer apparatus in a modification.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 2 ... Computer apparatus 3 ... Projector 4 ... Screen (board)
5 ... Line type menu 6 ... File menu 7 ... Entry conversion menu 8 ... Transparent sheet 21 ... Input means 22 ... Reception means 23 ... Transmission means 24 ... Display means 25 ... Storage means 26 ... Processing means

Claims (9)

A computer device for receiving entry information from an electronic pen and processing the entry information,
Receiving means for receiving the entry information;
The area defined by the tap if the position coordinates of each tap are not within the same recognition range when the tap is continuously recognized in the area displaying the stroke from the entry information received by the receiving means. A selection button for recognizing and displaying a stroke converted based on the entry information obtained by filling in with the electronic pen, a selection button for moving, or a selection button for deleting Processing means for displaying the input conversion menu including the display means, and when the position coordinates of each tap are within the same recognition range, processing means for performing different processing;
A computer apparatus comprising: A computer device for receiving entry information from an electronic pen and processing the entry information,
Receiving means for receiving the entry information;
The area defined by the tap if the position coordinates of each tap are not within the same recognition range when the tap is continuously recognized in the area displaying the stroke from the entry information received by the receiving means. If the position coordinates of each tap are within the same recognition range, the line type of the stroke to be displayed is set. Processing means for performing processing for displaying a line type menu for setting on the display means ;
A computer apparatus comprising: A computer device for receiving entry information from an electronic pen and processing the entry information,
Receiving means for receiving the entry information;
The area defined by the tap if the position coordinates of each tap are not within the same recognition range when the tap is continuously recognized in the area displaying the stroke from the entry information received by the receiving means. If the position coordinates of each tap are within the same recognition range, processing menus that differ depending on the number of taps are displayed. Processing means for performing processing to be displayed on the display means ;
A computer apparatus comprising: A computer device that reads an encoded pattern, calculates coordinate information, generates entry information, receives entry information from an electronic pen, and processes the entry information,
Receiving means for receiving the entry information;
Display means on which a transparent sheet on which a coding pattern related to coordinate information read by the electronic pen is formed is overlaid;
In correspondence with the identification information of the electronic pen, storage means for storing user's dominant hand information;
The area defined by the tap if the position coordinates of each tap are not within the same recognition range when the tap is continuously recognized in the area displaying the stroke from the entry information received by the receiving means. Processing means for performing predetermined processing on the entry information obtained by filling in with the electronic pen, and when the position coordinates of each tap are within the same recognition range, processing means for performing different processing; ,
Equipped with a,
The processing means determines a position for displaying various menus with respect to the tap position based on dominant hand information stored in the storage means, and displays the various menus on the display means. . A board writing system,
A computer device that reads the coded pattern, calculates coordinate information and generates entry information, receives the entry information from the electronic pen, and processes the entry information;
A projector for receiving from the computer device a video signal for projecting the same video as the video displayed on the display means of the computer device on a screen;
A screen on which an image is projected by the projector,
The screen is formed with a coding pattern related to coordinate information read by the electronic pen,
The computer device includes:
Receiving means for receiving the entry information;
In correspondence with the identification information of the electronic pen, storage means for storing user's dominant hand information;
The area defined by the tap if the position coordinates of each tap are not within the same recognition range when the tap is continuously recognized in the area displaying the stroke from the entry information received by the receiving means. Processing means for performing predetermined processing on the entry information obtained by filling in with the electronic pen, and when the position coordinates of each tap are within the same recognition range, processing means for performing different processing; ,
With
The processing unit determines a position for displaying various menus with respect to the tap position based on dominant hand information stored in the storage unit, and displays the various menus on the display unit. system. A program executed by a computer device that receives entry information from an electronic pen and processes the entry information,
A receiving means for receiving the entry information;
The area defined by the tap if the position coordinates of each tap are not within the same recognition range when the tap is continuously recognized in the area displaying the stroke from the entry information received by the receiving means. A selection button for recognizing and displaying a stroke converted based on the entry information obtained by filling in with the electronic pen, a selection button for moving, or a selection button for deleting Processing means for displaying the entry conversion menu including the display means, and when the position coordinates of each tap are within the same recognition range, processing means for performing different processing,
A program for causing the computer device to function as: A program executed by a computer device that receives entry information from an electronic pen and processes the entry information,
A receiving means for receiving the entry information;
The area defined by the tap if the position coordinates of each tap are not within the same recognition range when the tap is continuously recognized in the area displaying the stroke from the entry information received by the receiving means. If the position coordinates of each tap are within the same recognition range, the line type of the stroke to be displayed is set. Processing means for performing processing for displaying a line type menu for setting on the display means;
A program for causing the computer device to function as: A program executed by a computer device that receives entry information from an electronic pen and processes the entry information,
A receiving means for receiving the entry information;
The area defined by the tap if the position coordinates of each tap are not within the same recognition range when the tap is continuously recognized in the area displaying the stroke from the entry information received by the receiving means. If the position coordinates of each tap are within the same recognition range, processing menus that differ depending on the number of taps are displayed. Processing means for performing processing to be displayed on the display means;
A program for causing the computer device to function as: A program that is executed by a computer device that receives an entry information from an electronic pen that reads an encoded pattern, calculates coordinate information, and generates entry information, and processes the entry information,
A receiving means for receiving the entry information;
Storage means for storing user's dominant hand information corresponding to the identification information of the electronic pen;
The area defined by the tap if the position coordinates of each tap are not within the same recognition range when the tap is continuously recognized in the area displaying the stroke from the entry information received by the receiving means. Processing means for performing predetermined processing on the input information obtained by filling in with the electronic pen, and when the position coordinates of each tap are within the same recognition range, processing means for performing different processing,
To function the computer as,
The processing means determines a position for displaying a processing menu with respect to a tap position based on dominant hand information stored in the storage means, and displays the processing menu on the display means .

Images