JP4913873B2 - Electronic pen system and electronic pen - Google Patents

Description

The present invention relates to an electronic pen system and an electronic pen that display images on a touch surface according to touch operations with a plurality of electronic pens on a touch surface of a touch panel.

  There is known an electronic pen system in which an electronic pen and a touch panel are combined. This type of electronic pen system is widely used in the field of personal computers and personal digital assistants, but can be used in presentations and lectures for a large number of people by combining a touch panel with a large-screen display device. The technique used as what is called an interactive whiteboard (electronic blackboard) is known (refer patent document 1).

  In such a large-sized electronic pen system, a plurality of electronic pens having different attributes (functions) such as a drawing color can be used properly, or a plurality of users can perform drawing using an electronic pen given to each person. When the required operation can be performed, the usability is improved.

In relation to such a request, conventionally, a technique is known in which a user can change an attribute of an electronic pen as needed (see Patent Document 1). Also, a technique is known in which a plurality of electronic pens assigned different attributes can be used simultaneously (see Patent Document 2 ).

JP 2008-118301 A JP 2000-172421 A

  However, in the conventional technique disclosed in Patent Document 1, since the attribute (drawing color) is set by touching an icon on the touch panel with a finger, a general white using a marker filled with ink is used. There is a problem that the usability is poor because the feeling of use is greatly different from that of the board and there is no means for specifying the attribute in the electronic pen itself.

  In the prior art disclosed in Patent Document 2, a specific frequency is assigned to each of the plurality of electronic pens, and the electronic pen is discriminated based on the frequency, and the plurality of electronic pens can be used properly. However, the attributes of each electronic pen cannot be switched and used. That is, a predetermined unique attribute is given to the electronic pen, such as one electronic pen being black and another electronic pen being red, and this attribute cannot be appropriately changed by the user as needed. . For this reason, a large number of electronic pens having different attributes are required, and a plurality of users cannot use the electronic pens that they have as their favorite attributes, which is inconvenient.

  The present invention has been devised to solve such problems of the prior art, and its main purpose is that the user uses each of a plurality of electronic pens by switching attributes as necessary. To provide an electronic pen system configured to be able to

An electronic pen system of the present invention includes a plurality of electronic pens, a touch panel body including a touch surface on which a touch operation is performed by the electronic pen, and a position detection device that detects a touch position of the electronic pen on the touch surface. An electronic pen system comprising: a display device that displays a required image using the touch surface as a display screen; and a control device that causes the display device to display an image according to position detection information acquired from the position detection device. The electronic pen transmits an attribute selection means for selecting an attribute by a user, and pen information transmission for transmitting pen information to which the attribute information selected by the attribute selection means and its identification information are added to the control device. Means and a touch state detection means for detecting a touch state on the touch surface, wherein the touch state detection means detects the touch state. After transmitting the pen information from the pen information transmitting means to the control device according to the then by the position detecting device by conducting the pen tip portion of the electronic pen and allow detection of the touch position, the control device, the When the touch position is received from the position detection device within a predetermined time after receiving the pen information from the electronic pen, it is determined that the touch operation is performed by the electronic pen having the identification information added to the pen information. An image according to the attribute information included in the pen information is configured to be displayed on the display device.

  According to the present invention, the user can use each of the plurality of electronic pens by switching attributes as necessary.

1 is an overall configuration diagram showing an electronic pen system according to the present invention. Schematic block diagram of the electronic pen shown in FIG. The flowchart which shows the procedure of a process of the electronic pen shown in FIG. 1, and a control apparatus. The flowchart which shows the procedure of the pen input process shown in FIG. The figure which shows the drawing palette displayed on a touch surface by the display apparatus shown in FIG. The flowchart which shows the procedure of the finger input process shown in FIG. Schematic block diagram showing another example of the electronic pen shown in FIG. Schematic block diagram showing another example of the electronic pen shown in FIG. Schematic block diagram showing another example of the electronic pen shown in FIG. The schematic diagram which shows the example of the non-contact mode of the electronic pen shown in FIG. Schematic block diagram showing another example of the electronic pen shown in FIG. The figure which shows an example of the handwriting input in the electronic pen system shown in FIG. FIG. 12 is a timing chart showing the transmission status of pen information during handwriting input shown in FIG. FIG. 3 is a timing chart showing a transmission state of pen information at the time of handwriting input in the electronic pen system shown in FIG. FIG. 1 is a timing chart showing simplified operations of the plurality of electronic pens and the control device shown in FIG. 1 is a schematic diagram showing a schematic configuration of a drawing control unit of the control device shown in FIG. Schematic diagram showing the status of collaborative operations for editing a display object by touching multiple indicators (electronic pen and finger) at the same time Schematic diagram showing the status of collaborative operations for editing a display object by touching multiple indicators (electronic pen and finger) at the same time The flowchart which shows the process sequence in the control apparatus shown in FIG. FIG. 19 is a flowchart showing a processing procedure for joint operation of the electronic pen and the finger shown in FIG. The schematic diagram which shows the condition at the time of drawing a line with the some electronic pen shown in FIG. The schematic diagram which shows the condition at the time of drawing a line with the some electronic pen shown in FIG.

A first invention made to solve the above problems is a touch panel body including a plurality of electronic pens, a touch surface on which a touch operation is performed by the electronic pens, and a touch of the electronic pen on the touch surface. A position detection device for detecting a position; a display device for displaying a required image using the touch surface as a display screen; and a control device for causing the display device to display an image according to position detection information acquired from the position detection device; an electronic pen system wherein the electronic pen, the attribute selection means for selecting an attribute by a user, the control pens information added attribute information and its own identification information selected by the attribute selection means includes a pen information transmitting means for transmitting device, and a touch state detection means for detecting a touch state of the touch surface, the touch state detecting means touch From the pen information transmitting means in response to detecting a state after transmitting the pen information to the control device, wherein by conducting the pen tip portion of the electronic pen to allow detection of the touch position by the position detecting device, When the control device receives a touch position from the position detection device within a predetermined time after receiving the pen information from the electronic pen, the control device touches with the electronic pen having identification information added to the pen information. It is determined that the operation is performed, and an image corresponding to the attribute information included in the pen information is displayed on the display device.

  According to this, each of the plurality of electronic pens can be used by appropriately switching the attribute as required by the user.

Further , it is possible to definitely determine which electronic pen is the pointing object that has performed the touch operation.

A second invention made to solve the above problem is that, in the first invention, the control device draws a previous image when a new image is drawn so as to overlap the previously drawn image. A drawing control means for drawing an overlapping portion between the image to be newly drawn and an image to be newly drawn based on a drawing rule designated in advance, and the electronic pen allows the user to designate the drawing rule. The information regarding the drawing rule designated by the drawing rule designating means is transmitted to the control device.

  According to this, the user can specify a drawing rule with the electronic pen.

According to a third aspect of the present invention for solving the above-described problems, in the first or second aspect of the present invention, the drawing rule includes a new overlapping portion between an image drawn before and a newly drawn image. The configuration relates to an overwriting process for drawing according to the drawing conditions of a simple image.

According to a fourth aspect of the present invention for solving the above-described problems, in the first to third aspects of the present invention, the drawing rule includes an overlapping portion between an image drawn before and a newly drawn image. The drawing condition is related to the superimposition processing for drawing with the drawing condition changed by the specified ratio.
According to a fifth aspect of the present invention for solving the above problems, a touch surface on which a touch operation with a plurality of electronic pens is performed is a display screen, and the touch position of the electronic pen on the touch surface and the attributes of the electronic pen An electronic pen that communicates with a control device that displays an image in accordance with the display screen, attribute selecting means for selecting an attribute of the electronic pen by a user, the attribute selected by the attribute selecting means, and the own Pen information transmitting means for transmitting pen information to which identification information is added to the control device, and touch state detecting means for detecting a touch state on the touch surface, wherein the touch state detecting means detects the touch state. In response to the pen information transmission means, the pen information is transmitted to the control device, and then the pen tip portion of the electronic pen is turned on to detect the touch position. A configuration in which the function.
According to this, each of the plurality of electronic pens can be used by appropriately switching the attribute as required by the user.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is an overall configuration diagram showing an electronic pen system according to the present invention. The electronic pen system includes an electronic pen 1, a touch panel body 3 including a touch surface 2 on which a touch operation is performed with the electronic pen 1 and a finger F, and electrostatic according to the approach or contact of a conductor to the touch surface 2. The position detection device 4 that detects the touch position from the change in capacity, the display device 5 that displays a required image using the touch surface 2 as a display screen, the position detection information acquired from the position detection device 4 and the attributes of the electronic pen 1 And a control device 6 for displaying a corresponding image on the display device 5.

  The touch panel body 3 includes a plurality of transmission electrodes (first electrodes) 11 that run parallel to each other and a plurality of reception electrodes (second electrodes) 12 that are insulated from the transmission electrodes 11 and run parallel to each other. ing. The insulating state between the transmission electrode 11 and the reception electrode 12 is achieved by providing a sheet-like support between them, for example.

  The position detection device 4 receives the charge / discharge current signal of the transmission unit 13 that applies a drive signal (pulse signal) to the transmission electrode 11 and the reception electrode 12 that responds to the drive signal applied to the transmission electrode 11. The reception unit 14 that outputs a level signal at each electrode intersection where the transmission electrode 11 and the reception electrode 12 intersect (superimpose in an insulated state), and the touch position is detected based on the level signal output from the reception unit 14 In addition, a position detection control unit 15 that controls operations of the transmission unit 13 and the reception unit 14 is provided.

  The touch panel body 3 is used as a so-called interactive whiteboard that can be used for presentations and lectures by being combined with a display device 5 having a large screen. In particular, here, the display device 5 is a projector, and the touch surface. 2 is a projector screen. In addition, the display device 5 may be configured by a liquid crystal display or a plasma display, and may be disposed on the back side of the touch panel body, the transmission electrode, and the reception electrode, both of which are configured by a transparent material.

  The control device 6 is based on the wireless communication unit 16 that communicates with the electronic pen 1 and the position detection information output from the position detection device 4 in response to a touch operation with the electronic pen 1 or the finger F on the touch surface 2. The drawing control unit 17 that draws images such as characters, lines, and graphics, the display control unit 18 that generates display screen data based on the output of the drawing control unit 17 and outputs the display screen data to the display device 5, and these units are summarized. And a main control unit 19 for controlling automatically.

  The drawing control unit 17 performs a process of drawing an image according to the touch operation in the drawing mode, and erasing the image according to the touch operation in the eraser mode. In addition, the drawing control unit 17 includes an indicator determining unit (indicator indicating whether the position detection information is obtained by the electronic pen 1 or the finger F when the position detection information is acquired from the position detection device 4. And a drawing process is performed based on attributes set for the electronic pen 1 and the finger F, respectively.

  The main control unit 19 executes a process assigned to the operation button displayed on the display screen in the cursor operation mode according to the touch operation. The control device 6 is composed of a personal computer and peripheral devices, and an OS for realizing the main control unit 19 and an application program for realizing the drawing control unit 17 are introduced.

  The transmission electrode 11 and the reception electrode 12 are arranged at the same arrangement pitch (for example, 10 mm), and a capacitor is formed at an electrode intersection where the transmission electrode 11 and the reception electrode 12 intersect, and the user performs a touch operation with an indicator. When this is performed, the presence or absence of a touch operation can be detected by substantially reducing the capacitance at the electrode intersection.

  In particular, here, the mutual capacitance method is adopted, and when a drive signal is applied to the transmission electrode 11, a charge / discharge current flows to the reception electrode 12 in response to this, and at this time, according to the touch operation of the user, When the capacitance changes, the charging / discharging current of the receiving electrode 12 changes. The amount of change of the charging / discharging current is converted into a level signal (digital signal) for each electrode intersection by the receiving unit 14 and output to the position detection control unit 15. Then, the position detection control unit 15 calculates the touch position based on the level signal for each electrode intersection. This mutual capacitance method enables so-called multi-touch (multi-point detection) in which a plurality of touch positions are detected simultaneously.

  The transmission unit 13 selects the transmission electrodes 11 one by one and applies a drive signal in synchronization with the timing signal output from the position detection control unit 15. The receiving unit 14 receives the charging / discharging current of the receiving electrode 12 by selecting the receiving electrodes 12 one by one while applying a drive signal to one transmitting electrode 11. Thereby, the charging / discharging current for every electrode intersection can be taken out.

  The position detection control unit 15 obtains a touch position (center coordinate of the touch area) from the level signal for each electrode intersection output from the reception unit 14 by a predetermined calculation process. In the calculation of the touch position, the level at each of a plurality of (for example, 4 × 4) electrode intersections adjacent to each other in the X-axis direction (extension direction of the transmission electrode 11) and the Y-axis direction (extension direction of the reception electrode 12). The touch position is obtained from the signal using a required interpolation method (for example, the center of gravity method). Thereby, a touch position can be detected with a resolution (for example, 1 mm or less) higher than the arrangement pitch (10 mm) of the transmission electrode 11 and the reception electrode 12.

  FIG. 2 is a schematic configuration diagram of the electronic pen 1 shown in FIG. The electronic pen 1 is a wireless communication that performs communication between a control unit 6 and a pen body 22 that includes a grip 21 that a user holds with a hand, a pen tip 23 that is pressed against the touch surface 2 during a touch operation. A circuit 24; a connection switch 25 for interrupting electrical connection between the pen tip portion 23 and the grip portion 21 provided in a state of being electrically disconnected from each other; and a magnetic sensor for detecting a touch state on the touch surface (touch state) Detection means) 26 and a pen control circuit 27 that controls the operation of each unit in a comprehensive manner. In addition, the power of the battery 29 is supplied to the pen control circuit 27, the wireless communication circuit 24, and the like via a power supply circuit 28 as necessary. In the present embodiment, the grip portion 21 is made of a conductive resin. However, a metal material or a resin coated with a conductive material may be used, and when the user grips the electronic pen 1. The conductive material may be appropriately selected so that at least the pen tip 23 and the human body are electrically connected.

  The pen body 22 is made of a conductive synthetic resin material. The pen tip portion 23 includes a pen tip cover 31 and a pen tip shaft 32. The pen tip cover 31 is made of a conductive felt material, and the pen tip shaft 32 is made of a conductive synthetic resin material. The pen tip 23 is held by the pen body 22 via an insulator 33. The pen tip shaft 32 is supported by a guide member (not shown) so as to be movable in the axial direction. When the pen tip 23 is pressed against the touch surface 2 during a touch operation, the pen tip cover 31 made of a felt material contracts and the pen tip shaft 32 is pushed in.

  The magnetic sensor 26 detects the displacement of the magnet 34 provided on the pen tip shaft 32. When the pen tip shaft 32 is pushed in during a touch operation, the distance between the magnet 34 and the magnetic sensor 26 changes with the movement of the pen tip shaft 32, so that the touch state can be detected.

  The connection switch 25 is an electronic switch (a transistor such as an FET) and is on / off controlled by a pen control circuit (switch control means) 27. The electronic switch preferably has a small inter-terminal parasitic capacitance when it is off. This is because, when the capacitance component is large, even if the connection switch 25 is off, the state is equivalent to that conducted to the human body. From this point of view, the connection switch 25 may be constituted by a contact type relay whose capacitance is almost negligible.

  Here, when the connection switch 25 is off, the pen tip portion 23 is electrically disconnected from the grip portion 21. Since the component capacity of the pen tip 23 is extremely small, the position detection device 4 recognizes the proximity / contact of the electronic pen 1 even when the pen tip 23 is brought close to the touch surface 2 (or in a state where it is lightly touched). There is nothing.

  On the other hand, when the connection switch 25 is turned on, the pen tip portion 23 is electrically connected to the grip portion 21, and the human body is electrically connected to the pen tip portion 23 via the grip portion 21. Since the human body has a relatively large capacitance, when the electronic pen 1 approaches or touches the touch surface 2, the lines of electric force between the transmission electrode 11 and the reception electrode 12 (see FIG. 1) change, and the position detection device 4 can reliably detect the touch state of the electronic pen 1.

  The electronic pen 1 is provided with push type operation switches 41 to 43 and a rotary type operation switch 44. The push-type operation switches 41 to 43 cause the pen control circuit 27 to perform operations assigned to the operation switches 41 to 43 by pressing the operation buttons 45 to 47. For example, the first operation switch 41 has the same function as a mouse button, and the second and third operation switches 42 and 43 have a function of scrolling the display screen in the forward direction and the return direction. .

  The rotary operation switch (attribute selection means) 44 is configured to switch the attribute relating to the function of the electronic pen 1 by rotating the operation knob 48. In particular, here, the operation switches 44 can select black, red, green, and blue drawing colors and an eraser mode in the drawing mode. In addition, it is good also as a structure which can select the attribute regarding this other function.

  The pen control circuit 27 stores unique pen identification information (ID). Further, the pen control circuit 27 determines whether or not the touch state is made based on the output of the magnetic sensor 26 and generates status information. The pen control circuit 27 generates attribute information according to the operation of the operation switch 44. In response to a transmission instruction from 27, pen information including pen identification information, status information, and attribute information is transmitted from the wireless communication circuit 24 (pen information transmission means) to the control device 6. The wireless communication circuit 24 employs, for example, 2.4 GHz band advanced low power data communication.

  FIG. 3 is a flowchart showing a processing procedure of the electronic pen 1 and the control device 6 shown in FIG. The electronic pen 1 is operated from the wireless communication circuit 24 in response to the user performing a touch operation, the pen tip 23 being pressed against the touch surface 2 and the magnetic sensor 26 detecting the touch state (Yes in ST102). After the pen information is transmitted to the control device 6 (ST103), the connection switch 25 is turned on so that the pen input is possible (ST105).

  After receiving the pen information from the electronic pen 1 (Yes in ST202), the control device 6 receives the position detection information from the position detection device 4 (Yes in ST206) and sends the position detection information to the electronic pen 1. The touch operation is determined to proceed to pen input processing (ST208). On the other hand, when the position detection information from the position detection device 4 is received without receiving the pen information from the electronic pen 1, it is determined that the touch operation is performed with the finger F and the process proceeds to the finger input process (ST209).

  In the electronic pen 1, the connection switch 25 is turned on after a predetermined time (for example, 500 ms) has elapsed since the touch state was detected by the magnetic sensor 26 (ST104). This ensures that the timing at which the control device 6 receives the pen information from the electronic pen and the timing at which the pen detection is enabled and the position detection information from the position detection device 4 are reversed are prevented. Can do.

  Further, in the electronic pen 1, when the non-touch state detected by the magnetic sensor 26 continues for a predetermined time (for example, 2 seconds) (Yes in ST107), the connection switch 25 is turned off. Thereby, it is possible to avoid frequent repetition of pen information transmission and connection switch 25 on operation as the user performs a touch operation.

  Further, here, when the electronic pen 1 is activated, pen information including pen identification information is first transmitted to the control device 6 (ST101). The control device 6 can recognize the electronic pen 1 in use by receiving pen information at the time of activation from the electronic pen 1 (ST201).

  Note that, for example, pen information including pen identification information, status information, and attribute information may be transmitted to the control device 6 at an arbitrary timing by pressing the first operation switch 41. In the control device 6, when pen information is received from the electronic pen 1, the display device 5 displays the attribute of the electronic pen 1, for example, the drawing color in the drawing mode, on the touch surface 2. Thereby, the user can recognize the attribute set to the electronic pen 1 appropriately.

  FIG. 4 is a flowchart showing a procedure of the pen input process shown in FIG. First, when the pen information attribute is a marker (Yes in ST301), a process of drawing with a specified color at a coordinate position is performed (ST302). On the other hand, when the attribute of the pen information is an eraser (Yes in ST303), if there is drawing data at the coordinate position (Yes in ST304), processing for deleting the drawing data is performed (ST305).

  FIG. 5 is a diagram showing a drawing palette displayed on the touch surface 2 by the display device 5 shown in FIG. In the finger input, an input attribute is selected by a drawing palette. Here, an arrow (cursor), black, red, blue, and green color markers, erasers, special markers, and special function selection boxes are displayed, and are selected by touching with the finger F. When a special marker or special function is selected, a submenu for selecting a specific function is displayed. Special markers include a fluorescent marker and a function of drawing a line by arranging arbitrary figures. The special functions include a loupe function that partially enlarges the display screen, a spotlight function that leaves a part of the display screen dark, and a shade function that hides a part of the display screen.

  FIG. 6 is a flowchart showing the procedure of the finger input process shown in FIG. First, when an arrow is selected in the drawing palette (Yes in ST401), if there is drawing data at the coordinate position (Yes in ST402), processing for moving the drawing data according to the movement of the finger F is performed. (ST403). If there is no drawing data at the coordinate position (No in ST402), the process proceeds to OS cursor operation processing such as menu selection (ST404). On the other hand, when a marker is selected in the drawing palette (Yes in ST405), a process of drawing with a specified color at the coordinate position is performed (ST406). Also, when an eraser is selected in the drawing palette (Yes in ST407), if there is drawing data at the coordinate position (Yes in ST408), a process of deleting the drawing data is performed (ST409).

  6 shows an example in which the three functions of the arrow, the marker, and the eraser are selected in the drawing palette. However, if there are more options as in the example shown in FIG. More steps.

  FIG. 7 is a schematic configuration diagram illustrating another example of the electronic pen 1 illustrated in FIG. 1, and shows an operation state step by step. Here, a first mechanical switch 71 for detecting a touch state, a second mechanical switch 72 serving as a connection switch for interrupting electrical connection between the pen tip portion 23 and the grip portion 21, and a touch operation time A switch operating mechanism 74 for turning on and off the first and second mechanical switches 71 and 72 in conjunction with the displacement of the pen tip 23 is provided.

  The switch operating mechanism 74 includes a first switch operating unit 75 for turning on / off the first mechanical switch 71, and a second switch operating unit 76 for turning on / off the second mechanical switch 72. The second switch operation portions 75 and 76 are provided on the pen tip shaft 32 while being displaced in the axial direction.

  As a result, the first and second mechanical switches 71 and 72 are sequentially turned on according to the backward displacement of the pen tip portion 23 in response to pressing the pen tip portion 23 against the touch surface 2. That is, from the non-touch state shown in FIG. 7A, when the pen tip portion 23 is pressed against the touch surface 2 and retracts, the first mechanical switch 71 is first turned on as shown in FIG. 7B. Then, as shown in FIG. 7C, the second mechanical switch 72 is turned on.

  With such a mechanical configuration, a timer circuit (not shown) of the pen control circuit 27 and the like can be omitted, and battery consumption associated with these operations can be suppressed. Further, by appropriately determining the arrangement interval of the first and second switch operation units 75 and 76, the timing at which the control device 6 receives pen information from the electronic pen 1 and the position where the pen input is enabled It can be reliably avoided that the timing of receiving the position detection information from the detection device 4 is reversed.

  FIG. 8 is a schematic configuration diagram illustrating another example of the electronic pen 1 illustrated in FIG. 1. Here, there is provided an operation button (operation means) 82 for always turning on a mechanical switch 81 serving as a connection switch for interrupting electrical connection between the pen tip portion 23 and the grip portion 21 by a user operation. The operation button 82 has an alternate structure that holds the mechanical switch 81 in either the on state or the off state, and the mechanical switch 81 is forcibly turned on / off by a user operation. Thereby, the electronic pen 1 can be used as a substitute for the finger F even in a state where there is no remaining battery level. Other configurations are the same as those in the example of FIG. 2, and detailed description thereof is omitted. Note that a compulsory connection switch can be similarly provided for the configuration described with reference to FIG.

  FIG. 9 is a schematic configuration diagram illustrating another example of the electronic pen 1 illustrated in FIG. 1. Here, in order to detect a touch state, a position sensor (displacement amount detection means) 91 that detects a displacement amount of the pen tip portion 23 according to pressing the pen tip portion 23 against the touch surface is provided. The electronic pen 1 transmits pen information to which the displacement amount of the pen tip 23 detected by the position sensor 91 is added to the control device 6, and the control device 6 receives the pen information from the electronic pen 1. Predetermined processing according to the acquired pen tip displacement is performed. As the position sensor 91, a variable resistance potentiometer whose resistance value changes according to the amount of movement, an optical position sensor (PSD: Position Sensitive Detector), or the like is used. Other configurations are the same as those in the example of FIG. 2, and detailed description thereof is omitted.

  If it does in this way, various operation instructions can be performed by a user adjusting the writing pressure which changes the amount of displacement of pen point part 23. FIG. For example, the line thickness in the line drawing mode may be changed according to the writing pressure. Alternatively, the amount of displacement of the pen tip 23 may be leveled in stages, and attribute selection, for example, line type (solid line, broken line, one-point broken line) may be selected according to each level. Further, different processing may be assigned to each level, for example, a display object may be selected at level 2 and an operation may be determined at level 5.

  The pen tip portion 23 is formed by the elasticity of the pen tip cover 31 made of a felt material or the elasticity of a rubber member (not shown) interposed between the pen tip shaft 32 and the pen body 22. It is possible to restore the initial state according to the separation of 23 from the touch surface 2 and to displace the pen tip 23 according to the writing pressure by these elastic forces.

  FIG. 10 is a schematic diagram showing an example of the non-contact mode of the electronic pen 1 shown in FIG. As described above, when the electrostatic capacitance method is employed, the position of the electronic pen 1 can be detected by bringing the electronic pen 1 close to the touch surface 2 without contacting the touch surface 2.

  For this reason, as in the example of FIG. 8 described above, an operation button 82 for forcibly turning on / off a mechanical switch 81 serving as a connection switch for interrupting electrical connection between the pen tip portion 23 and the grip portion 21 is provided. In the configuration in which pen information is transmitted according to the operation of the operation button 82, when the operation button 82 is turned on and the electronic pen 1 is brought close to the touch surface 2, the control device 6 receives the position detection information from the position detection device 4. At the same time, the pen information indicating the non-touch state is received from the electronic pen 1. At this time, since the touch position is detected while the pen information is not touched, it is different from the normal pen input mode.

  Therefore, it is preferable to give a special function to the non-touch state operation as a non-contact mode to perform application operations such as displaying a special menu or drawing in the airbrush mode. In this case, in order to avoid confusion with finger input, it is preferable to set a state in which finger input is prohibited.

  FIG. 11 is a schematic configuration diagram illustrating another example of the electronic pen 1 illustrated in FIG. 1. Here, the pen point portion 23 and the grip portion 21 are connected via the variable resistance element 111, and an operation switch 112 that changes the resistance value of the variable resistance element 111 is provided. Other configurations are the same as those in the example of FIG. 2, and detailed description thereof is omitted. Note that a variable capacitance element can be used instead of the variable resistance element 111.

  When configured in this manner, in the non-contact mode shown in FIG. 10, it is possible to change the value of the level signal output from the position detection device 4 by increasing or decreasing the capacitance change caused by the touch operation. The operation amount of the operation switch 112 is transmitted to the control device 6 and various instructions are given by the operation amount of the operation switch 112. For example, the amount of image processing can be changed. For example, in the airbrush mode, it is possible to configure such that the drawing radius is increased as the sensitivity, that is, the detection level or the detection range is increased.

  FIG. 12 is a diagram illustrating an example of handwriting input in the electronic pen system illustrated in FIG. 1. FIG. 13 is a timing chart showing a transmission state of pen information at the time of handwriting input shown in FIG. When inputting a series of characters by handwriting, the stroke inputs S1 to S11 are repeated at short intervals, but each time the electronic pen 1 enters a touch state at the start point of each stroke input S1 to S11, the electronic pen 1 performs wireless communication of pen information. If this is done, the battery 29 will be consumed quickly.

  Therefore, after the end of one stroke input and the pen tip 23 is separated from the touch surface 2 and the detection result by the magnetic sensor 26 changes from the touch state to the non-touch state, the electronic pen 1 If the touch state is entered again before continuing for a predetermined time (T: for example, 2 seconds), pen information is not transmitted. Thereby, the frequency | count of communication of the electronic pen 1 can be reduced, and consumption of the battery 29 can be suppressed.

  When inputting a single character string with the same indicator (electronic pen 1 or finger F), the stroke input takes a short interval, but when inputting different character strings with different indicators, one instruction The last stroke input of a character string input with an object and the first stroke input of a character string input with another indicator are long intervals, and by appropriately setting a reference time (T: for example 2 sec), Pen information is not transmitted during the input of a character string with one indicator, and after the character string is input with one indicator, the pen information is entered when the input of the character string with another indicator is started. Can be sent.

  In the example shown in the figure, the character string “Ai” and the character string “Kaki” are input separately with different indicators, and the starting point of the first stroke input in the input of each character string “Ai” and “Kaki” The pen information is transmitted only at the timing (that is, the leading timings of S1 and S6 in FIG. 13).

  In this case, the control device 6 does not receive pen information from the electronic pen 1 in the second and subsequent stroke inputs. For this reason, it cannot be determined whether each stroke input is performed by the electronic pen 1 or the finger F based on the presence or absence of the pen information. Further, it is impossible to determine which electronic pen 1 is used for each stroke input by the pen identification information in the pen information.

  Therefore, when the control device 6 detects the start point of a new stroke input after detecting the end point of the stroke input, if the two stroke inputs satisfy a predetermined proximity condition (for example, a range of ± 50 mm), the control device 6 It is determined that the correct stroke input is based on the same indicator as the adjacent stroke input.

  Here, the proximity condition is any one of the elapsed time from the detection of the stroke input end point to the detection of the new stroke input start point, and the separation distance between the stroke input end point and the new stroke input start point. Or it sets about both. When this proximity condition is satisfied, it can be determined that the character string is continuously input with one indicator. On the other hand, when the proximity condition is not satisfied, the indicator is changed. It can be determined that there is a possibility that the character string is input.

  Accordingly, it is possible to accurately determine the instruction for each stroke input without transmitting pen information every time the touch state is entered.

  If there is no previous stroke input that satisfies the predetermined proximity condition, a confirmation screen for allowing the user to specify an instruction is displayed on the touch surface 2 by the display device 5. Alternatively, in order to cause the electronic pen 1 to retransmit the attribute information, a display that prompts the user to move the electronic pen 1 away from the touch surface 2 for a predetermined period (for example, 2 seconds) or longer is performed. Alternatively, an instruction unit (for example, a push switch) for forcibly transmitting attribute information to the electronic pen 1 may be provided. Thereby, it is possible to specify a stroke input indicator and input an appropriate character based on the attribute of the indicator.

  The operation of specifying the indicator according to the predetermined proximity condition and displaying the confirmation screen for allowing the user to specify the indicator when the indicator cannot be specified is performed by handwriting as described above. It is not limited to inputting characters with. The present invention can also be applied in the same manner when an indicator cannot be specified when inputting characters other than characters.

  FIG. 14 is a timing diagram showing a transmission state of pen information during handwriting input in the electronic pen system shown in FIG. When the electronic pen 1 completes one stroke input, the pen tip 23 moves away from the touch surface 2, and the detection result by the magnetic sensor 26 changes from the touch state to the non-touch state, the pen identification information, and Pen information including status information (non-touch state) is transmitted to the control device 6.

  On the other hand, during the stroke input, the control device 6 receives the position detection information that gradually changes from the position detection device 4, but when one stroke input is completed, the pen tip 23 and the finger F of the electronic pen 1 are finished. When an end point of the stroke input is detected, the end point of the stroke input at which the series of position detection information disappears is detected. When the end point of the stroke input is detected, the pen information indicating the non-touch state from the electronic pen 1 is received. If almost the same timing is reached, it is determined that the stroke input is from the electronic pen 1. If the pen information is not received when the end point of the stroke input is detected, it is determined that the stroke input is made by the finger F.

  When the timing of the stroke input start point is the same for the electronic pen 1 and the finger F, only the pen information transmitted from the electronic pen 1 to the control device 6 at the timing of the stroke input start point causes each stroke input to be the electronic pen 1 and finger. However, if pen information is transmitted even at the end of stroke input, it is possible to determine whether each stroke input is from the electronic pen 1 or the finger F.

  In addition, when the timing of the stroke input start point overlaps with the plurality of electronic pens 1, each stroke input can be made to any electronic pen by using only the pen information transmitted from the electronic pen 1 to the control device 6 at the timing of the stroke input start point. However, if the pen information is transmitted even at the end point of the stroke input, it is possible to determine which electronic pen 1 is used for each stroke input.

  Further, if the timings of the start point and the end point of the stroke input overlap, the stroke input instruction cannot be specified by the pen information transmitted from the electronic pen 1 to the control device 6 at the timing of the start point and the end point of the stroke input. This is not a complete situation. Therefore, in such a case, when a plurality of stroke inputs are continuously performed, it is preferable to make an analogy determination from the reference information of stroke inputs that are close in position and close in time. . On the other hand, in the case of a single stroke input, a confirmation window for confirming to the user whether the electronic pen 1 or the finger F is displayed is displayed on the touch surface in the vicinity of the position where the stroke input has been performed. It is recommended to select the stroke input indicator.

  FIG. 15 is a timing chart showing simplified operations of the plurality of electronic pens 1 and the control device 6 shown in FIG. Here, an example in which a plurality of electronic pens 1 are simultaneously touched is shown.

  The electronic pen 1 transmits a communication request signal (REQ (1), REQ (2),... REQ (n)) to the control device 6 when the touch state is detected by pressing the pen tip 23 against the touch surface 2. To do. The control device 6 transmits a response signal (ACK (1), ACK (2),... ACK (n)) to each electronic pen 1 in response to reception of the communication request signal (REQ) from the electronic pen 1. In response to receiving the response signal (ACK) from the control device 6, the electronic pen 1 transmits pen information (DATA) to the control device 6.

  At this time, the electronic pen 1 starts transmission of the pen information (DATA), and after a certain delay time (t1), the connection switch 25 that interrupts the electrical connection between the pen tip portion 23 and the grip portion 21. Turn on. As a result, each electronic pen 1 is in a position-detectable state, and the touch positions (position 1, position 2, position 3) of each electronic pen 1 are sequentially detected.

  Here, in order to avoid communication collision, a known distributed control type contention (CSMA → T1 → independent waiting time (random number) → data transfer → ACK) is used in a wireless LAN or the like. For example, each electronic pen 1 performs CSMA (Carrier Sense Multiple Access) to confirm that a wireless channel is not used. If a collision due to simultaneous communication requests from a plurality of electronic pens occurs, as shown in FIG. 15, different independent waiting times (tw1) for each electronic pen 1 determined by the standby unit time and the generated random number, as shown in FIG. , Tw2, twn), each electronic pen 1 transmits a communication request again to avoid a collision, performs data transfer in response to a response signal ACK from the control device 6, and the control device 6 receives the response from the electronic pen 1. In response to the request, a series of communication operations are performed in which a response signal ACK for confirming data reception is returned each time. Further, although not shown, when the electronic pen 1 cannot receive the response signal ACK from the control device 6 after the data transfer, the data can be reliably transferred by repeating the data re-transfer until the response signal ACK is received. Data is being transferred.

  In this way, since the individual attribute information of the plurality of electronic pens 1 can be reliably transmitted to the control device 6, for example, four users use different electronic pens 1 and use them respectively. The drawing color can be selected arbitrarily (that is, independently). That is, the drawing color of each electronic pen 1 can be made different for each user such as black, red, blue, and green, or all users can select the same drawing color. Of course, the attribute information of the electronic pen 1 is not limited to the drawing color, and may be attribute information related to, for example, a solid line / broken line or line thickness. As described above, the electronic pen 1 of the present embodiment can set the attribute information independently even when a plurality of electronic pens 1 are used at the same time, and there are no restrictions imposed by other electronic pens 1. I do not receive it.

  By the way, as described above, since it is possible to definitely determine which of the electronic pen 1 and the finger F is the touch-operated indicator, different functions are given to the electronic pen 1 and the finger F. Various operations are possible. Here, an example in which a display object is edited (moved, rotated, enlarged, and reduced) by a touch operation of the electronic pen 1 and the finger F will be described.

  FIG. 16 is a schematic diagram illustrating a schematic configuration of the drawing control unit 17 of the control device 6 illustrated in FIG. 1. The drawing control unit 17 of the control device 6 includes an indicator determination unit (indicator determination unit) 171 that determines whether the indicator that has been touched as described above is the electronic pen 1 or the finger F. A first control unit (first control means) 172 that performs a predetermined pen input process in response to a touch operation by the electronic pen 1 and a second control that performs a predetermined finger input process in response to a touch operation of the finger F Unit (second control means) 173, and the pen input process of the first control unit 172 and the finger input process of the second control unit 173 are executed in parallel. Thereby, the electronic pen 1 and the finger F can be assigned functions, and processes according to functions set in advance in the electronic pen 1 and the finger F can be executed simultaneously in parallel.

  As already described, the control device 6 is composed of a personal computer and peripheral devices, and the function of the drawing control unit 17 is provided by executing an application program. Therefore, “execute in parallel” here means parallel processing by so-called multitask processing of the OS.

  The first control unit 172 performs a touch operation with the electronic pen 1 and a drawing process according to the attribute set for the electronic pen 1. The second control unit 173 performs an editing process corresponding to the touch operation of the finger F on the display object. It is possible to give the first and second control units 172 and 173 different functions.

  Further, the drawing control unit 17 of the control device 6 has a finger drawing mode in which a touch operation with the finger F is regarded as being performed with the electronic pen 1 in accordance with a user instruction. In this finger drawing mode, a standard attribute is used. The first control unit 172 is caused to perform a drawing process corresponding to the touch operation with the finger F. Thereby, drawing can be performed by a touch operation with the finger F as a substitute for the electronic pen 1.

  Here, in the finger drawing mode, drawing processing corresponding to the touch operation with the finger F is performed with a standard attribute. As this standard attribute, for example, the drawing color is black. In the finger drawing mode, the second control unit 173 stops operating.

  FIG. 17 and FIG. 18 are schematic diagrams illustrating a situation of joint operation in which a plurality of instructions (electronic pen 1 and finger F) are simultaneously touched to edit a display object. When editing the display object by touching the display object with a plurality of instructions, the drawing control unit 17 of the control device 6 uses the touch position of the first indicator that first touched the display object as the operation starting point. Then, using the touch position of the second indicator touched on the display object as the operation action point, the absolute displacement amount of the operation starting point accompanying the movement of the first indicator and the movement of the second indicator The drawing information of the display object is generated and displayed on the screen according to the relative displacement amount of the operation action point with respect to the accompanying operation starting point.

  Here, the first indicator for setting the operation starting point is the electronic pen 1, and the second indicator for setting the operation action point is the finger F. The second indicator can be another electronic pen 1.

  In the example shown in FIG. 17, in the rotation mode, the display object is translated according to the movement of the electronic pen 1 that sets the operation start point, and the display object is rotated according to the movement of the finger F that sets the operation action point. Yes. Here, the rotation of the display object is performed with the operation starting point, that is, the touch position with the electronic pen 1 as the center point.

  In the example shown in FIG. 18, in the enlargement / reduction mode, the display object is translated according to the movement of the electronic pen 1 that sets the operation start point, and the display object is enlarged according to the movement of the finger F that sets the operation action point. -It has been reduced. Here, when the relative distance between the electronic pen 1 and the finger F increases, the enlargement occurs, and when the relative distance between the electronic pen 1 and the finger F decreases, the reduction occurs.

  In addition, the operation starting point and the operation action point are set in the same manner as described above, and the drawing information of the display object is continuously displayed according to the relative displacement amount of the operation action point with respect to the operation starting point accompanying the movement of the second indicator. When the second indicator is separated from the touch surface, the generation of the display object drawing information may be terminated. Accordingly, the editing status of the display object is sequentially displayed on the screen in accordance with the movement of the second indicator, so that the user can perform an operation while viewing the editing status of the display object.

  FIG. 19 is a flowchart showing a processing procedure in the control device 6 shown in FIG. Here, the finger operation (ST503), the finger handwriting operation (ST504), and the pen operation (ST509) depending on whether the pointing object that has performed the touch operation is the electronic pen 1 or the finger F, and also in the handwriting mode. ) And pen handwriting operation (ST510). The finger handwriting operation is drawn based on handwriting attributes (color, thickness, line type) preset for the finger at the input detection position. The pen handwriting operation is drawn based on handwriting attributes (color, thickness, line type) preset for each of the plurality of electronic pens 1 at the input detection position.

  In the finger operation (ST503) and the pen operation (ST509), when the electronic pen 1 and the finger F are touching the same display object, the process proceeds to the joint operation (ST507, ST513). On the other hand, when the electronic pen 1 and the finger F are not touching the same display object, the process proceeds to independent operations (ST506, ST512).

  In the independent operation, the display object is operated according to the operation mode selected from the menu according to the pen input and the finger input. For example, operations related to application control, such as rotation, movement, enlargement / reduction processing, display object color change, display object selection, menu display, and the like, are targeted.

  FIG. 20 is a flowchart showing a processing procedure of the joint operation of the electronic pen 1 and the finger F shown in FIG. First, when the movement of the electronic pen 1 is detected (ST601), a process of translating the display object is performed (ST602). When the movement of the finger F is detected (ST603), vector calculation is performed according to the movement direction and movement amount of the finger F (ST604), and the display object is rotated based on the vector value with the touch position of the electronic pen 1 as a fulcrum.・ Enlargement / reduction processing is performed (ST605).

  By the way, as described above, since a plurality of electronic pens 1 can be set to different attributes and used properly, when images drawn separately by a plurality of electronic pens 1 overlap, how are overlapping portions of both images? It becomes a problem whether to draw in

  FIG. 21 and FIG. 22 are schematic views showing a situation when a line is drawn with the plurality of electronic pens 1 shown in FIG. The drawing control unit (drawing control means) 17 of the control device 6, when a new image is drawn so as to overlap with the previously drawn image, the overlapping portion of both images is based on a drawing rule designated in advance. draw. The electronic pen 1 includes an operation switch (drawing rule designating unit) 44 that allows the user to designate a drawing rule, and transmits information related to the drawing rule designated by the operation switch to the control device 6.

  Note that the drawing rule may be selected and specified from a menu displayed on the touch surface 2 by the display device 5.

  As shown in FIG. 21, the drawing rule is a drawing condition for a new image, which is an overlapping portion between an image previously drawn under the first drawing condition and an image newly drawn under the second drawing condition. The present invention relates to an overwriting process for drawing according to the second drawing condition. In the illustrated example, the drawing condition is the drawing color.

  When it is designated that overwriting is to be performed, as shown in FIG. 21A, the overlapping portion between the previously drawn image and the newly drawn image is the same as the newly drawn image. Replaced by color. That is, in the first overlapping portion, the original blue color is replaced with yellow, and in the second overlapping portion, the original yellow color is replaced with blue. On the other hand, when it is designated that the overwriting process is not performed, as shown in FIG. 21B, the overlapping portion between the previously drawn image and the newly drawn image is the original color. Left untouched.

  In addition, as shown in FIG. 22, the drawing rule specifies a drawing condition for a portion where an image previously drawn under the first drawing condition and an image newly drawn under the second drawing condition overlap. The present invention relates to a superimposition process for drawing under another drawing condition changed according to the ratio of the above. In the illustrated example, the drawing condition is the drawing color. An example of performing an averaging process for the change by the specified ratio will be described below.

  When it is designated that superimposition processing is to be performed, as shown in FIG. 22A, the overlapping portion between the previously drawn image and the newly drawn image averages the drawing colors of both. It is replaced with the mixed color. On the other hand, when it is specified that the superimposition process is not performed, as shown in FIG. 22B, the color of the newly drawn image is replaced. This is the same as the overwriting process in FIG.

  Further, the color mixing ratio may be set so that an image drawn later is emphasized. That is, a mixed color is calculated by performing a weighted average with a weighting coefficient on the first drawing color of the previously drawn image and the second drawing color of the newly drawn image.

  In the first overlapping portion, the blue line drawn with the blue electronic pen 1 and the yellow line drawn with the yellow electronic pen 1 overlap each other, and the yellow drawn later is emphasized. As shown, the mixture ratio of both colors (yellow: blue) is replaced with yellowish green with 6: 4. In the second overlapping portion, the yellow line drawn with the yellow electronic pen 1 and the blue line drawn with the blue electronic pen 1 overlap each other, and the blue drawn later As emphasized, the mixture ratio of both colors (blue: yellow) is replaced with blue-green with 6: 4.

  Accordingly, the user can easily recognize that two lines are drawn with another electronic pen 1 having different drawing colors. Furthermore, the user can easily recognize which of the two lines intersecting each other is drawn later by changing the color of the overlapping portion in accordance with the temporal relationship.

  The mixing ratio of the two colors may be set in proportion to the ratio of the line thickness. In addition, when another line intersects the part where the two lines intersect and change to the mixed color, the intersected part is changed to a mixed color obtained by mixing the original mixed color and the new color, Such a color change may be performed every time the lines intersect. Furthermore, when the electronic pen 1 is set to the eraser mode, the area drawn later is usually erased, but various erase modes can be designated, for example, by selecting an erase rate, It is also possible to erase partly by the erase pattern by reducing the density of the region drawn later or selecting the erase pattern.

  In addition, when performing image editing of a display object, a special function may be assigned when a plurality of electronic pens 1 simultaneously touch one display object. For example, when the control device 6 detects simultaneous touch with a plurality of electronic pens 1, it performs image processing (highlighting, emphasis, color conversion, etc.) of the display object. Further, when the control device 6 detects simultaneous touches with a plurality of electronic pens 1, the attributes (for example, drawing colors) of the electronic pens 1 are randomly changed. As a result, a change (interaction) unexpected by the user occurs in the display object, and an effect can be obtained that is a hint or trigger for an idea in brainstorming or design consideration.

  The electronic pen system according to the present invention has an effect that the user can use each of the plurality of electronic pens by switching the attributes as needed, so that the plurality of electronic pens can be used separately and used simultaneously. It is useful as an electronic pen system.

DESCRIPTION OF SYMBOLS 1 Electronic pen 2 Touch surface 3 Touch panel body 4 Position detection apparatus 5 Display apparatus 6 Control apparatus 16 Wireless communication part 17 Drawing control part (drawing control means)
18 Display control section 19 Main control section 44 Operation switch (attribute selection means, drawing rule designation means)

Claims (5)

A touch panel body including a plurality of electronic pens, a touch surface on which a touch operation is performed by the electronic pen, a position detection device that detects a touch position of the electronic pen on the touch surface, and a display screen for the touch surface As an electronic pen system comprising: a display device that displays a required image as a control device that causes the display device to display an image according to position detection information acquired from the position detection device;
The electronic pen includes attribute selection means for selecting an attribute by a user, pen information transmission means for transmitting pen information to which the attribute information selected by the attribute selection means and its identification information are added to the control device, Touch state detection means for detecting a touch state on the touch surface, and after the pen information transmission means transmits the pen information to the control device in response to the touch state detection means detecting the touch state, Enabling the detection of the touch position by the position detection device by conducting the pen tip portion of the electronic pen,
When the control device receives a touch position from the position detection device within a predetermined time after receiving the pen information from the electronic pen, the control device touches with the electronic pen having identification information added to the pen information. An electronic pen system characterized in that an operation is determined and an image corresponding to attribute information included in the pen information is displayed on the display device. When a new image is drawn so as to overlap with a previously drawn image, the control device uses a drawing rule designated in advance as an overlapping portion between the previously drawn image and the newly drawn image. A drawing control means for drawing based on
The electronic pen, the drawing rule includes a writing rule specifying means for specifying a user, wherein the information related to the drawing rules specified in this drawing rule specifying means to claim 1, characterized by transmitting to the control unit Electronic pen system. The drawing rules, the overlapping portion of the image to be newly drawn and rendered images previously claim 1 or claims, characterized in that it relates to overwriting process of drawing in accordance with the drawing conditions of a new image Item 5. The electronic pen system according to any one of Items 2 to 3 . The drawing rule relates to a superimposition process for drawing an overlapping portion between a previously drawn image and a newly drawn image under a drawing condition in which both drawing conditions are changed by a specified ratio. The electronic pen system according to any one of claims 1 to 3 . Communicating with a control device for displaying on the display screen an image according to a touch position of the electronic pen on the touch surface and an attribute of the electronic pen, with a touch surface on which touch operations are performed by a plurality of electronic pens being performed An electronic pen that performs
Attribute selecting means for selecting an attribute of the electronic pen by a user, pen information transmitting means for transmitting pen information to which the attribute selected by the attribute selecting means and its identification information are added to the control device, and the touch surface Touch state detecting means for detecting a touch state with respect to the electronic device, the pen information transmitting means transmitting the pen information to the control device in response to the touch state detecting means detecting the touch state, An electronic pen characterized in that a pen tip portion of a pen is conducted to detect a touch position .

Images