JP6107396B2 - Computer apparatus, display system, and program - Google Patents

Description

  The present invention relates to a technique using an electronic pen.

  2. Description of the Related Art Conventionally, electronic pens that digitize written information have been developed, and “Anot pen” developed by Swedish company Anoto is known as a representative one. For example, as described in Patent Document 1, the anotopen reads a predetermined dot pattern printed on a sheet, generates entry information, and transmits the entry information to the terminal device.

Japanese Patent No. 3874498

  Arrange the display on which the coding pattern that can be read by the electronic pen is stacked, and display the stroke that reproduces the handwriting of the electronic pen on the display filled in by any electronic pen, or perform predetermined processing In such a system, it is necessary to appropriately associate the electronic pen with the display. Therefore, the main object of the present invention is to provide a computer device, a display system, and a program capable of appropriately executing the association when the electronic pen cannot be directly associated with the display. .

  In one aspect of the present invention, the computer apparatus receives from the electronic pen display control means for displaying a mark for designating a position to be tapped or written with the electronic pen on each of the plurality of displays on which the coded pattern is formed. Based on the entry information including the identification information and the coded value of the electronic pen, the electronic pen indicated by the identification information is associated with the display displaying the mark at the position indicated by the coded value included in the entry information. The display control means displays the mark so that the display position of the mark is a position corresponding to a different coded value for each display.

  The computer apparatus includes display control means and association means. The display control means displays a mark for designating a position to be tapped or written with the electronic pen on each of the plurality of displays on which the coded pattern is formed. At this time, the display control means displays the mark such that the display position of the mark is a position corresponding to a different coded value for each of the plurality of displays. The associating means associates the electronic pen indicated by the identification information included in the entry information with the display displaying the mark at the position indicated by the coded value included in the entry information based on the entry information received from the electronic pen. Add and remember. As described above, the computer device displays the mark so that the mark display position corresponds to a different coded value for each of the plurality of displays, thereby performing the association operation on the plurality of displays at the same time. Even if it is broken, the electronic pen and the display can be appropriately associated with each other.

  In one aspect of the computer apparatus, a touch panel is stacked on each of the plurality of displays, and the display control unit is touched when the touch panel detects that any of the plurality of displays is touched. The mark is displayed on the display. According to this aspect, the computer device can associate any display with the electronic pen at any timing desired by the user.

  In another aspect of the computer apparatus, the computer device further includes association release means for releasing the association between the electronic pen associated with the association unit and the display. As described above, the computer apparatus performs the association between the electronic pen and the display desired by the user as necessary based on the user's operation even when the association between the electronic pen and the display is appropriately canceled. be able to.

  In another aspect of the present invention, the display system includes the computer apparatus and the display described above, and a coding pattern indicating a range of coded values overlapping each other is formed on each of the displays. In this aspect, the coded value ranges of the coded patterns formed on the display overlap with each other, and it is impossible to determine which display is tapped or filled only by the coded value transmitted from the electronic pen. Even in this case, the computer apparatus displays the mark so that the display position of the mark corresponds to a different coded value for each of the plurality of displays, thereby simultaneously associating with the plurality of displays. Even when the operation is performed, the electronic pen and the display can be appropriately associated with each other.

  Preferably, the coding pattern indicates coordinates, and the coded value is a coordinate value.

  According to still another aspect of the present invention, there is provided a computer device that associates a display that displays a mark that designates a position to be tapped or filled in with an electronic pen and an electronic pen formed with an encoded pattern, Each displays the mark at a position corresponding to a different coded value, and the computer device indicates the identification information based on the identification information of the electronic pen received from the electronic pen and the entry information including the coded value. Corresponding means for associating and storing the electronic pen and the display displaying the mark at the position indicated by the coded value included in the entry information. In this aspect, the computer apparatus associates the electronic pen with a display that displays a mark at a position indicated by the coded value included in the entry information, based on the entry information received from the electronic pen. Thereby, the computer apparatus can associate any electronic pen desired by the user with any display.

  The program according to the present invention causes a computer to function as any one of the computer devices described above. The computer apparatus according to the present invention can be configured by installing these programs in a computer and causing them to function.

  According to the present invention, the computer device can appropriately associate the electronic pen and the display even when the association operation is performed on a plurality of displays at the same time.

It is a system configuration figure of a display system concerning this embodiment. The structure of a display is shown. It is a figure explaining the relationship between the dot of a dot pattern, and the value into which the dot is converted. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is the schematic which shows the structure of an electronic pen. It is a schematic block diagram of a server apparatus. The data structure of coordinate definition information is shown. It is a flowchart which shows the procedure of a matching process. (A) shows the example of a display on the display just before execution of step S201. (B) shows the example of a display on the display after execution of step S202.

  Hereinafter, preferred embodiments of a system according to the present invention will be described with reference to the drawings.

[System configuration of display system]
FIG. 1 is a system configuration diagram of the display system 10. A display system 10 shown in FIG. 1 is a system capable of executing processing for associating an arbitrary electronic pen 1 with an arbitrary display 4 (also referred to as “association processing”). A wireless LAN router 3 that performs wireless communication in accordance with the pen 1 and Wi-Fi (registered trademark), a plurality of displays 4 on which dot patterns and a touch panel are stacked, and a server device 7 that performs display control of the display 4 . The server device 7 communicates with the wireless LAN router 3 and the display 4 via the network 6 respectively. The electronic pen 1 is placed side by side in the vicinity of the display 4 so that it can be used for an arbitrary display 4, for example.

(display)
FIG. 2 shows the configuration of the display 4. As shown in FIG. 2, the display 4 has a multilayer structure, and in order from the upper layer, a dot pattern overlayer (dot pattern forming layer) (also simply referred to as “DOL”) 40, a touch panel 44, and a display panel 45. And comprising. The display 4 further includes a processing unit 46 that supplies an electric signal to the display panel 45 to perform display control and the like, and a communication unit 47 for communicating with the server device 7.

  The DOL 40 is disposed on the uppermost layer of the display 4. The DOL 40 is an ink containing a material that reflects infrared rays (titanium oxide, cholesteric liquid crystal, infrared reflective pigment, etc.) that can be read by the electronic pen 1 on a base film 43 that is a transparent resin substrate such as polyethylene terephthalate. Thus, a dot pattern (encoded pattern) 42 is printed, and the layer structure is further protected by a protective layer 41 such as a transparent EB cured resin. Here, the dot pattern 42 is printed with a material that reflects infrared rays. Even when visible light of various colors is radiated from the display panel 45 under the DOL 40, the dot pattern 42 is printed with good contrast by the electronic pen 1. This is because it is desirable to recognize 42. In the present embodiment, dot patterns 42 indicating the same coordinate range are stacked on the DOL 40 of each display 4.

  A touch panel 44 is bonded to the back surface of the DOL 40. The touch panel 44 is a capacitance type touch panel that detects a position by detecting a change in capacitance caused by pressing a finger on the DOL 40. The pen tip portion 103 of the electronic pen 1 is made of a material such as plastic or stainless steel, and the capacitance of the touch panel 44 does not change when the electronic pen 1 is touched or pressed on the DOL 40. Therefore, the touch panel 44 does not detect contact and pressing on the DOL 40 with the electronic pen 1. Then, the touch panel 44 supplies a signal indicating the detection position to the processing unit 46, and the processing unit 46 uses the communication unit 47 to obtain contact position information (also referred to as “touch panel input information”) based on the detection signal. The data is transmitted to the server device 7 via the network 6. The touch panel input information includes identification information of the display 4.

  The processing means 46 is constituted by a processor such as a CPU and controls the entire display 4. For example, the processing unit 46 receives display information related to the display on the display panel 45 from the server device 7 via the communication unit 47, and transmits an electrical signal corresponding to the display information to the display panel 45.

  The configuration of the display 4 to which the present invention can be applied is not limited to the configuration of FIG. Instead, the display 4 is a carbon in which an infrared reflecting layer is provided between the dot pattern 42 and the base film 43 or between the base film 43 and the touch panel 44, and the dot pattern 42 absorbs infrared rays. It may be configured to be printed with ink containing.

(Dot pattern)
Next, an Anoto dot pattern (coded pattern) 42 formed on the DOL 40 will be described with reference to FIGS. FIG. 3 is a diagram for explaining the relationship between the dots of the dot pattern 42 formed on the DOL 40 and the values to which the dots are converted. As shown in FIG. 3, each dot of the dot pattern 42 is associated with a predetermined value depending on its position. In other words, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the grid (intersection of the vertical line and horizontal line). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on the DOL 40 are determined by the combination of the information thus associated. Accordingly, the dot patterns 42 are formed on the DOL 40 so that the coordinate areas do not overlap each other.

  FIG. 4A shows an arrangement of a certain dot pattern. As shown in FIG. 4A, 6 × 6 dots are arranged in a range of about 2 mm in length and width so that a unique pattern can be obtained no matter where 6 × 6 dots are taken from DOL 40. Yes. A dot pattern formed by these 36 dots holds position coordinates (for example, on which position on the DOL 40 the dot pattern is located). FIG. 4B is a diagram in which each dot shown in FIG. 4A is converted into a corresponding value based on the regularity shown in FIG. 3 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

(Electronic pen)
Next, the electronic pen 1 will be described with reference to FIG. FIG. 5 is a schematic view showing the structure of the electronic pen 1. As shown in FIG. 5, the electronic pen 1 includes a pen unit 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM and a RAM, A communication unit 111 including a real-time clock 110, an antenna, and the like, and a battery 112 are provided. The tip of the pen unit 104 is a pen point unit 103, and the user touches the pen point unit 103 of the electronic pen 1 against the DOL 40 on the display 4 and enters a stroke (handwritten stroke). Here, the first contact of the pen tip portion 103 of the electronic pen 1 with the DOL 40 or the like is referred to as pen-down, and the removal of the pen tip portion 103 from the contact (contact) state is referred to as pen-up. A trajectory written between the pen-down and pen-up of the electronic pen 1 is one stroke, and characters, figures, etc. are composed of one or a plurality of strokes.

  The battery 112 is for supplying power to each component in the electronic pen 1, and is configured to turn on / off the power of the electronic pen 1 itself by, for example, detaching a cap (not shown) of the electronic pen 1. You may let them. The real time clock 110 transmits time information indicating the current time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied from the pen tip portion 103 through the pen portion 104 when the user writes or taps a character or mark on the DOL 40 on the display 4 with the electronic pen 1, that is, the writing pressure. The value is transmitted to the processor 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when the user writes a character or the like on the DOL 40 on the display 4 with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and when the pressure sensor 107 detects a writing pressure higher than a predetermined value, the processor 108 Then, it is determined that the user has started entry, and the LED 105 and the CMOS camera 106 are operated. Then, the communication unit 111 associates pen-down information detected by the pressure sensor 107 with identification information (hereinafter referred to as “pen ID”) of the electronic pen 1 described later, and uses the wireless LAN router 3 as entry information. Is transmitted to the server device 7 via. Further, when the user finishes entering one stroke and moves the electronic pen 1 away from the DOL 40 or the like, the pressure sensor 107 detects pen-up because the writing pressure exceeding a predetermined value is not detected. Then, the communication unit 111 associates the pen-up information detected by the pressure sensor 107 with the pen ID, and transmits it as entry information to the server device 7 via the wireless LAN router 3.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 illuminates infrared rays toward the vicinity of the pen tip portion 103 on the DOL 40. The region is slightly shifted from the position where the pen tip 103 contacts the DOL 40 or the like. The CMOS camera 106 is provided with an infrared filter that transmits infrared rays and blocks non-infrared rays. The CMOS camera 106 captures a dot pattern in an area illuminated by the LED 105 and processes image data of the dot pattern as a processor. 108.

  Here, since the ink material of dots formed on the DOL 40 reflects infrared rays, the infrared rays irradiated by the LED 105 are reflected by the dots. Therefore, the dot portion has a relatively large amount of infrared reflection, and the portion other than the dot has a relatively small amount of infrared reflection. By photographing with the CMOS camera 106, a dot area and other areas can be distinguished by providing a threshold value based on the difference in the amount of reflected infrared light. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 4A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called. Further, the CMOS camera 106 has a sufficient depth of field in order to photograph dots clearly.

  The processor 108 uses the dot pattern of the image data supplied by the CMOS camera 106 during the user entry to determine the X and Y coordinates (hereinafter referred to simply as “coordinate data”) of the stroke (handwriting) to be entered by the user in the DOL 40 or the like. Or, it is also called “coordinate information”). That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 4 (a) supplied by the CMOS camera 106 into the data array shown in FIG. 4 (b). The data is converted into a Y coordinate bit value, and X and Y coordinate data are calculated from the data array by a predetermined calculation method. The processor 108 has a rotation correction processing function for correcting the arrangement of dots caused by the inclination of the electronic pen 1 facing the dot pattern. The processor 108 then associates the current time (time stamp: entered time information) transmitted from the real-time clock 110, writing pressure data, and X and Y coordinate data. Hereinafter, these associated data are collectively referred to as “coordinate attribute information”. Since the 6 × 6 dot pattern in the DOL 40 does not overlap in the DOL 40, when the user enters characters or the like with the electronic pen 1, the processor 108 determines which position in the DOL 40 the entered position corresponds to. It can be specified by coordinate calculation.

  The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. Then, the communication unit 111 associates the pen ID, time information (time stamp), writing pressure data, and X and Y coordinate data, and transmits them as entry information to the server device 7 via the wireless LAN router 3. To do. Transmission to the wireless LAN router 3 by the communication unit 111 is immediately and sequentially performed by wireless transmission based on Wi-Fi. After receiving the radio wave (beacon) transmitted from the wireless LAN router 3, the communication unit 111 transmits an ESS-ID and an encryption key to the wireless LAN router 3 and receives authentication from the wireless LAN router 3. 3 and Wi-Fi communication are established. In this case, the communication unit 111 performs communication by designating the communication address of the server device 7 stored in the memory 109 as a transmission destination address based on the control of the processor 108.

  Here, one or a plurality of coordinate attribute information generated between the pen-down and pen-up of the electronic pen 1 and transmitted to the server device 7 is stored as stroke information by the server device 7. In other words, one stroke is composed of one or a plurality of X and Y coordinates (coordinate points), and the server device 7 can determine one or a plurality of pieces constituting one stroke based on the pen-down information and the pen-up information. Recognize coordinate attribute information. As described above, a set of coordinate attribute information generated by the electronic pen 1 when the user enters one stroke is referred to as “stroke information”. The pen tip 103 is made of a material such as plastic or stainless steel. The pen tip portion 103 does not have ink, and transmits pen pressure to the pressure sensor 107 via the pen portion 104.

  The electronic pen 1 may include an ink cartridge filled with ink instead of the pen unit 104. In this case, when the ink output from the pen tip by the tap of the electronic pen 1 adheres to the DOL 40, it may be wiped off with a cloth or the like. The electronic pen 1 transmits entry information to the server device 7 via the wireless LAN router 3 by wireless transmission. However, the electronic pen 1 is not limited to this, and is connected to a communication device such as a router or a hub by wire. The entry information may be transmitted to the device 7.

  Preferably, when the CMOS camera 106 recognizes the dot pattern, the electronic pen 1 determines whether the dot pattern is formed of an infrared reflecting material or an infrared absorbing material, and based on the determination. The dot pattern reading program may be switched. Specifically, the electronic pen 1 first performs a binarization process on the image captured by the CMOS camera 106 using a predetermined threshold, and the infrared reflection region and the infrared absorption from the binarized image. The area is discriminated, and the magnitude relation between the area of the infrared reflection area and the area of the infrared absorption area is compared. The electronic pen 1 performs a negative / positive inversion process on the binarized image when the infrared absorption area is larger than the infrared reflection area, and performs a negative / positive inversion process when the negative / positive inversion process is performed. The dot pattern is recognized based on the obtained image, and when the negative / positive inversion process is not performed, the dot pattern is recognized based on the binarized image. Thereby, it is possible to appropriately recognize both the dot pattern printed with the infrared absorbing ink and the dot pattern printed with the infrared reflective ink.

(Server device)
Next, the server device (computer device) 7 will be described with reference to FIG. The server device 7 includes, as hardware, a communication device capable of data communication via the network 6, a processor such as a CPU, a memory such as a ROM and a RAM, and the like. As shown in FIG. 6, the server device 7 functionally includes a communication unit 72 that performs data communication with the wireless LAN router 3, the display 4, and the like, a storage unit 73, and a processing unit 74.

  The server device 7 converts a coordinate system (also referred to as “DOL coordinate system”) related to the dot pattern 42 formed on the DOL 40 into a coordinate system (also referred to as “display coordinate system”) related to the display panel 45. It has a calibration processing function for obtaining a first coordinate conversion function and a second coordinate conversion function for converting a coordinate system (also referred to as “touch panel coordinate system”) applied to the touch panel 44 into a display coordinate system. . Furthermore, after execution of the association process described later, the server device 7 receives entry information, which is DOL coordinate system data, from the electronic pen 1 by using the first coordinate conversion function obtained by the calibration process. Furthermore, it is data of the touch panel coordinate system using the second coordinate conversion function and the function of converting the data into the display coordinate system and drawing the stroke on the target display 4 or performing a predetermined process. When touch panel input information is received from the display 4, it has a function of converting the data into display coordinate system data and performing predetermined processing such as button (icon) selection.

  The processing means 74 is constituted by a processor such as a CPU, and controls the entire server device 7. The processing unit 74 includes a display control unit 741, an association unit 742, and an association release unit 743.

  When the terminal device 3 receives the touch panel input information from the touch panel 44, the display control unit 741 recognizes the display 4 on which the operation on the touch panel 44 is performed by referring to the identification information of the display 4 included in the touch panel input information. To do. Then, the display control means 741 converts the coordinate data of the touch panel coordinate system included in the touch panel input information into display coordinate system data using the second coordinate conversion function. Then, when a button or the like is displayed in the converted coordinate data, the processing means 74 performs processing such as selection of the button.

  In addition, when the display control unit 741 detects a predetermined touch panel operation on the display 4 to which the electronic pen 1 is not associated, a mark (“adjustment mark” for associating the electronic pen 1 with the display 4 is detected. Is also displayed on the display 4. At this time, the display control means 741 causes the display position of the adjustment mark to be a coordinate position of a DOL coordinate system that differs for each display 4.

  Further, when the server device 7 receives entry information from the electronic pen 1, the display control unit 741 refers to coordinate definition information described later, and recognizes that the coordinate data indicated by the entry information is a coordinate region of the DOL coordinate system. To do. When the electronic pen 1 that has transmitted the entry information is associated with any display 4 by the association process, the display control unit 741 converts the coordinate data included in the received entry information to the first coordinate. Using the conversion function, convert to display coordinate system data. Then, the display control unit 741 displays a stroke based on the converted coordinate data or the like on the display 4 associated with the electronic pen 1 that has transmitted the entry information, or displays a button or the like at a corresponding position of the stroke. If it has been done, processing such as selection of the button is performed.

  The association means 742 indicates that the adjustment mark is tapped by the electronic pen 1 based on the entry information received from the electronic pen 1 by the server device 7 after the display control means 741 displays the adjustment mark on the display 4. Recognize In this case, the association unit 742 associates and stores the pen ID indicated by the received entry information and the identification information of the display 4 that displays the adjustment mark at the position indicated by the coordinate information included in the entry information. To do.

  The association canceling unit 743 deletes information that associates the identification information of the display 4 with the pen ID of the electronic pen 1 when it is determined that the operation on the display 4 has ended.

  The storage unit 73 includes a memory such as a ROM, a RAM, or a hard disk. The storage unit 73 stores the first coordinate conversion function and the second coordinate conversion function. In addition, the storage unit 73 stores the entry information received from the electronic pen 1 for each pen ID or the predetermined data generated by executing the program in accordance with the processing instruction of the processing unit 74.

  The storage unit 73 stores information on the coordinate range indicated by the dot pattern 42 formed on the DOL 40 of each display 4 (also referred to as “coordinate definition information”).

  FIG. 7 is an example of the data structure of the coordinate definition information. In the coordinate definition information shown in FIG. 7, for each identification information of the display 4, the coordinate range of the dot pattern 42 formed on the target display 4, the position of the adjustment mark to be displayed on the target display 4, and the target display 4 is associated with the pen ID of the electronic pen 1. Here, the identification numbers “D01” to “D03” of the display 4 indicate the identification numbers assigned to the respective displays 4 displayed in FIG. Further, since the dot patterns 42 indicating the same coordinate range are stacked on the respective displays 4 with the identification numbers “D01” to “D03”, the coordinate ranges “(X1, Y1), H1 of the same dot pattern are stacked. , W1 ”. In FIG. 7, each coordinate range is defined by corner position coordinates (Xn, Yn), height (Hn), and width (Wn).

  In the example of FIG. 7, the display positions of the adjustment marks are coordinate positions (X11, Y11), (X12, Y12), which are different in the respective displays 4 with the identification numbers “D01” to “D03”, as will be described later. (X13, Y13) is set. In the example of FIG. 7, the display position of the adjustment mark is expressed by the coordinate position of the DOL coordinate system. Furthermore, in the example of FIG. 7, the pen IDs “pen03” and “pen03” of the electronic pen 1 associated by the association process are displayed on the display 4 with the identification numbers “D01” and “D02” after the association process is executed. pen01 "is recorded. On the other hand, the pen ID of the electronic pen 1 is not yet recorded on the display 4 with the identification number “D03” before the execution of the association process.

[Processing flow]
Next, the association processing between the electronic pen 1 and the display 4 will be described with reference to the flowchart of FIG. The process of the flowchart shown in FIG. 8 is executed when the user touches an arbitrary display 4 that has not been associated with the electronic pen 1 with a finger.

  First, when the user touches an arbitrary display 4 that has not been associated with the electronic pen 1 with a finger, the touch panel 44 of the display 4 detects contact with the display 4 (step S201). . In this case, the processing unit 46 of the display 4 transmits touch panel input information corresponding to the detection signal supplied from the touch panel 44 to the server device 7 through the communication unit 47.

  Next, in the server device 7 that has received the touch panel input information, the display control unit 741 designates the display position of the adjustment mark to be displayed on the display 4 (step S301). In this case, first, the display control unit 741 recognizes the target display 4 based on the touch panel input information received by the server device 7, and further matches the identification information of the target display 4 by referring to the coordinate definition information. The displayed position of the adjustment mark is recognized. Here, the display position of the adjustment mark stored in the coordinate definition information corresponds to the coordinate position of the DOL coordinate system that is different for each display 4. Then, the display control unit 741 transmits display information indicating that the adjustment mark should be displayed at the recognized display position to the display 4. The display 4 displays the adjustment mark based on the display information received from the server device 7 (step S202).

  The user who touches the display 4 with his / her finger picks up the arbitrary electronic pen 1 and taps the adjustment mark displayed on the display 4 with the electronic pen 1. In this case, the electronic pen 1 transmits the entry information including the coordinate information indicated by the dot pattern at the tap position and the pen ID to the server device 7 via the wireless LAN router 3 (step S101). Then, the server device 7 receives the entry information transmitted by the electronic pen 1 in step S101.

  Next, when the position indicated by the coordinate information included in the entry information received by the server device 7 overlaps the display position of the adjustment mark specified in step S301, the association unit 742 displays the adjustment mark. 4 is associated with the electronic pen 1 (step S302). Specifically, in this case, the association unit 742 associates the identification information of the display 4 that displays the adjustment mark at the position indicated by the coordinate information included in the entry information and the pen ID included in the entry information. Store in coordinate definition information.

  Here, the server device 7 displays adjustment marks at the coordinate positions of the DOL coordinate system that is different for each display 4. As a result, even when operations related to the association process are simultaneously performed on the plurality of displays 4, the server device 7 taps each display 4 based on the coordinate information indicated by the received entry information. It is possible to accurately identify the associated electronic pen 1 and associate them.

  Then, after executing step S302, the associating unit 742 transmits information indicating that the associating process is completed to the target display 4 (step S303). Thereafter, the display 4 displays a predetermined input screen that can be input by the electronic pen 1 based on the display information received from the server device 7 (step S203). When the server device 7 receives the entry information from the electronic pen 1 associated with the display 4 in step S302, the server device 7 stores the entry information in the storage unit 73 for each pen ID, and the stroke based on the received entry information. Is transmitted to the display 4. As a result, the display 4 immediately displays a stroke that reproduces the handwriting written on the input screen by the electronic pen 1.

  Preferably, the association release unit 743 determines that the operation on the display 4 on which the association unit 742 has performed the association process has been completed in step S302, the electronic pen 1 associated with the display 4 The pen ID information is deleted from the coordinate definition information. For example, when the association cancellation unit 743 detects that a button indicating completion of input displayed on the input screen is selected, or the touch panel input information or entry information corresponding to the display 4 displaying the input screen is predetermined. It is determined that the operation on the display 4 has been completed, for example, when it has not been received for more than the time.

  In addition, when the electronic pen 1 that is the target of the association process is already associated with another display 4 in step S <b> 302, the association release unit 743 associates the other display 4 with the electronic pen 1. May be canceled. That is, in this case, the association release unit 743 deletes the pen ID of the electronic pen 1 associated with the identification information of the other display 4 from the coordinate definition information. Thereby, it is possible to prevent the same electronic pen 1 from being associated with a plurality of displays 4.

[Display example]
Next, a display example of the display 4 in the association process will be described with reference to FIG. FIG. 9A shows a display example on the display 4 immediately before the execution of step S201. FIG. 9B shows a display example on the display 4 after step S202 is executed.

  As shown in FIG. 9A, the display control unit 741 of the server device 7 displays a button 80 indicating that the touch should be performed on the display 4 that is not associated with the electronic pen 1. When the display control means 741 of the server device 7 detects that the button 80 is pressed based on the touch panel input information, the display 4 is switched to the display shown in FIG.

  In FIG. 9B, the display control means 741 of the server device 7 displays the adjustment mark 81 on the display 4 on which the button 80 is pressed, and the adjustment mark 81 should be tapped with the electronic pen 1. Is displayed. At this time, the display control unit 741 of the server device 7 displays the adjustment mark at the coordinate position of the DOL coordinate system that is different for each display 4. Then, when the adjustment mark 81 is tapped with the electronic pen 1, the associating unit 742 of the server device 7 executes the associating process according to step S <b> 302 in FIG. 8 based on the entry information received from the electronic pen 1. To do.

[Effects of this embodiment]
According to the embodiment described above, the display control unit 741 of the server device 7 displays the adjustment mark so that the display position of the adjustment mark becomes a coordinate position of a different DOL coordinate system for each of the plurality of displays 4. Based on the entry information received from the electronic pen 1, the association unit 742 of the server device 7 adjusts the electronic pen 1 indicated by the pen ID included in the entry information and the position indicated by the coordinate information included in the entry information. The display 4 displaying the mark is associated and stored. Accordingly, the server device 7 can appropriately associate the electronic pen and the display 4 even when the association operation is performed on the plurality of displays 4 at the same time.

[Modification of this embodiment]
Next, a modification of this embodiment will be described. The following modifications may be applied in any combination to the above-described embodiment.

(Modification 1)
The display 4 shown in FIG. 1 may have different screen sizes. In this case, the coordinate range indicated by the dot pattern 42 of each display 4 has a range that overlaps each other instead of being completely coincident. Even in this case, the server device 7 displays the adjustment mark at the coordinate position of the DOL coordinate system that is different for each display 4. Thereby, the server apparatus 7 can complete each correlation process exactly even if it is a case where matching operation | movement is performed simultaneously by making the some display 4 into object.

(Modification 2)
In the description of FIGS. 8 and 9, the display 4 performs display based on the control of the server device 7. Instead of this, the display 4 may perform display without being controlled by the server device 7.

  For example, each display 4 stores in advance the display position of the adjustment mark, and when a finger touch is detected in step S201 in FIG. A mark may be displayed. In this case, the server device 7 does not need to execute the process of step S302. In another example, the display 4 may store the display information of the display screen illustrated in FIG. 9A in advance and perform the display illustrated in FIG. 9A based on the display information. Similarly, the display 4 may store in advance display information of the input screen to be displayed in step S203 of FIG. 8 and display the input screen based on the display information.

(Modification 3)
In the description of FIGS. 9A and 9B, the server device 7 displays the adjustment mark 81 on the display 4 when detecting that the button 80 is pressed. Instead of this, the server device 7 may display the adjustment mark 81 on the display 4 when detecting that the person has approached the display 4 within a predetermined distance. In this case, for example, a camera that captures the front of the display 4 is provided, and the server device 7 or the display 4 performs image recognition processing on an image received from the camera, so that a person is within a predetermined distance on the display 4. Detecting that you are approaching.

(Modification 4)
The configuration of the display system 10 illustrated in FIG. 1 is an example, and the configuration of the display system 10 to which the present invention is applicable is not limited to the configuration illustrated in FIG.

  For example, the server device 7 may be electrically connected to the display 4 via a wired or wireless connection without going through the network 6. In another example, the server device 7 may be placed at a position where wireless communication with the electronic pen 1 is possible, and the entry information may be directly received from the electronic pen 1 by wireless communication. In this case, the display system 10 may not have the wireless LAN router 3.

  In yet another example, the display system 10 has one or more electronic pens 1 greater or less than the number of displays 4 instead of having as many electronic pens 1 as the number of displays 4 (three in FIG. 1). You may have the pen 1.

(Modification 5)
In the above-described embodiment, the Anoto method is used for the electronic pen, the dot pattern (coded pattern), and the entry information, but the use of the Anoto method is not limited.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 3 ... Wireless LAN router 4 ... Display 6 ... Network 7 ... Server apparatus

Claims (7)

Display control means for displaying a mark for designating a position to be tapped or written with an electronic pen on each of a plurality of displays on which a coded pattern is formed;
Based on the entry information including the identification information and the coded value of the electronic pen received from the electronic pen, the electronic pen indicated by the identification information and the display displaying the mark at the position indicated by the coded value included in the entry information And association means for associating and storing
The display control means displays the mark so that the display position of the mark corresponds to a different coded value for each display. A touch panel is laminated on each of the plurality of displays,
The computer apparatus according to claim 1, wherein the display control unit displays the mark on the touched display when the touch panel detects that any of the plurality of displays is touched. .   The computer apparatus according to claim 1, further comprising: an association canceling unit that cancels the association between the electronic pen and the display associated by the association unit. A display system comprising the computer device according to any one of claims 1 to 3 and a display,
Each of the displays is formed with a coding pattern indicating a range of coded values overlapping each other.   The display system according to claim 4, wherein the coded pattern indicates coordinates, and the coded value is a coordinate value. A computer device that associates an electronic pen with a display that displays a mark that specifies a position to be tapped or written with an electronic pen, in which a coded pattern is formed,
Each of the displays displays the mark at a position corresponding to a different coded value,
Based on the entry information including the identification information and the coded value of the electronic pen received from the electronic pen, the electronic pen indicated by the identification information and the display displaying the mark at the position indicated by the coded value included in the entry information And a correspondence unit for storing the information in association with each other.   A program that causes a computer to function as the computer device according to claim 1.