JP3169427U - Computer equipment - Google Patents

Abstract

A computer device capable of generating and displaying an icon having the same function as an icon printed on a dot pattern paper by a simple operation using an electronic pen on the computer device side. In a display means 31, a display 311 for displaying an image and a DOL 312 printed with a dot pattern are laminated. The icon processing means 353 recognizes a predetermined icon when the electronic pen 1 is tapped on a predetermined icon of the dot pattern paper 2 on which one or more icons and dot patterns are printed. Thereafter, when the electronic pen 1 is tapped on the DOL 312, the icon processing unit 353 generates an icon having the same function as the predetermined icon and displays the icon on the display 311. [Selection] Figure 1

Description

  The present invention relates to a computer device capable of generating an icon by a simple operation using an electronic pen in a system for drawing a stroke with the electronic pen.

  An electronic pen that digitizes written information has been developed. As a representative example, “Anot pen” developed by Swedish company Anoto is known. Anotopen is used with special paper on which a predetermined dot pattern is printed. In addition to the normal ink cartridge for writing characters, etc., the anotopen has a small camera for imaging the dot pattern printed on the dot pattern paper and the position coordinates on the dedicated paper from the captured dot pattern. And a data communication unit for transmitting the calculated position coordinates and the like to an external device. When the user writes characters on the special paper with an anotopen or puts a check mark on the image designed on the special paper, the small camera captures the dot pattern printed on the special paper as the pen moves. Then, the entry information such as characters and images written by the user is recognized from the continuous position coordinates calculated by the processor. Then, this entry information is transmitted from the Anotopen to a nearby computer device or the like by the data communication unit (see, for example, Patent Document 1).

  Patent Document 2 discloses a technique in which a computer device reads an icon printed on a paper medium, that is, a paper icon with a scanner, and registers an icon to which the function of the paper icon is assigned.

Japanese Patent No. 3874498 Japanese Patent No. 3956026

However, in the technique disclosed in Patent Document 2, the user needs to designate a specific icon on the display for assigning the function of the paper icon in a state where an icon for which the function is not defined is displayed on the display in advance. is there. Therefore, in order to use the technique disclosed in Patent Document 2, it is necessary to previously display an icon for which a function is not defined on the display, which requires a complicated and wasteful operation for the user.
Further, in the technique disclosed in Patent Document 2, since an icon with no function defined is displayed on the display in advance, an icon to which no function is assigned remains on the display. It may continue to be displayed. In such a case, there is a possibility that a useless operation including an erroneous operation may further occur for the user.
For this reason, there is a demand for a method for generating an icon with a simple operation using an electronic pen, but the situation is not met.

  The present invention has been made in view of such a situation, and an object thereof is to generate an icon by a simple operation using an electronic pen.

  A computer apparatus according to the present invention includes a display unit on which a display for displaying an image, a sheet on which a coded pattern is printed, and a writing medium on which one or more icons and a coded pattern are printed. Among these, when an electronic pen is touched to a predetermined icon, the predetermined icon is recognized, and when the electronic pen is touched to the sheet, an icon having the same function as the predetermined icon is generated and displayed on the display. It comprises an icon processing means for displaying.

According to this configuration, the user can recognize the predetermined icon by the computer device only by performing an operation (for example, a tap described later) for bringing the electronic pen into contact with the predetermined icon printed on the writing medium. Thereafter, when the user performs an operation (for example, a tap described later) with which the electronic pen is brought into contact with the sheets stacked on the display, an icon having the same function as a predetermined icon is generated by the computer device and is displayed on the display. Is displayed.
In this way, an icon can be generated and used with a simple operation using the electronic pen.

  In the computer apparatus, a touch panel is further stacked on the display of the display unit, and the icon processing unit recognizes the predetermined icon touched with the electronic pen, and then an object touches the touch panel. Alternatively, it may be configured to generate the icon having the same function as the predetermined icon and display the icon on the display when the icons are brought close to each other.

According to this configuration, the user can recognize the predetermined icon by the computer device only by performing an operation (for example, a tap described later) for bringing the electronic pen into contact with the predetermined icon printed on the writing medium. After that, the user performs the same operation as a predetermined icon by the computer device by performing an operation (a touch operation described later) for bringing an object such as his / her finger into contact with or approaching the touch panel stacked on the display. An icon is generated and displayed on the display.
Therefore, the electronic pen and other objects (for example, one's own finger) can be selectively and freely used to operate the display of the computer device, which is easier for the user. Icons can be generated and used by operation.

  In the computer apparatus, a button for instructing batch generation of the entire one or more icons is further printed on the writing medium, and the icon processing unit is configured to display the electronic pen on the button of the writing medium. The button is recognized and the electronic pen is contacted with the sheet, or when an object touches or comes close to the touch panel when the touch panel is stacked on the display means, Each of the one or more icons having the same function as each of the one or more icons may be collectively generated and displayed on the display.

According to this configuration, the user recognizes the button by the computer device only by performing an operation (for example, a tap described later) for bringing the electronic pen into contact with the button printed on the writing medium. Thereafter, the user performs an operation of bringing the electronic pen into contact with the sheets stacked on the display (for example, a tap described later), or an operation of bringing an object such as his / her finger into contact with or close to the touch panel (described later). ), One or more icons having the same function as each of the one or more icons are collectively generated and displayed on the display.
Accordingly, the user can perform one or more having the same function as the one or more icons only by performing a simple operation such as selecting only one button without performing a complicated operation of selecting each of the one or more icons. It becomes possible to generate each of the icons at once.

  In addition, the computer device according to the present invention includes a predetermined icon among a display unit in which a display for displaying an image and a touch panel are stacked, and a writing medium in which one or more icons and a coding pattern are printed in an overlapping manner. When the electronic pen is touched, the predetermined icon is recognized, and when an object touches or approaches the touch panel, an icon having the same function as the predetermined icon is generated and displayed on the display. And an icon processing means.

According to this configuration, the user can recognize the predetermined icon by the computer device only by performing an operation (for example, a tap described later) for bringing the electronic pen into contact with the predetermined icon printed on the writing medium. After that, the user performs the same operation as a predetermined icon by the computer device by performing an operation (a touch operation described later) for bringing an object such as his / her finger into contact with or approaching the touch panel stacked on the display. An icon is generated and displayed on the display.
Therefore, it is possible to easily generate and use icons by using an electronic pen and other objects (for example, one's own finger) in order to operate the display of the computer device.

  In the computer apparatus, a button for instructing batch generation of the entire one or more icons is further printed on the writing medium, and the icon processing unit is configured to display the electronic pen on the button of the writing medium. When the button is touched, the button is recognized, and when an object touches or comes close to the touch panel, one or more icons having the same function as the one or more icons are collectively generated and displayed on the display. It may be configured as follows.

According to this configuration, the user recognizes the button by the computer device only by performing an operation (for example, a tap described later) for bringing the electronic pen into contact with the button printed on the writing medium. Thereafter, the user performs an operation (a touch operation described later) for bringing an object such as his / her finger into contact with or in proximity to the touch panel, so that one or more having the same function as each of the one or more icons is performed by the computer device. Each icon is generated at once and displayed on the display.
Accordingly, the user can perform one or more having the same function as the one or more icons only by performing a simple operation such as selecting only one button without performing a complicated operation of selecting each of the one or more icons. It becomes possible to generate each of the icons at once.

  According to the present invention, an icon can be generated by a simple operation using an electronic pen.

1 is a system configuration diagram of an icon generation system according to a first embodiment of the present invention. It is a figure which shows the cross section of the display means of the computer apparatus which concerns on 1st Embodiment of this invention. It is explanatory drawing which shows the relationship between the arrangement | positioning of the dot in a dot pattern, and the value converted. (A) schematically shows a dot pattern, and (B) is a diagram showing an example of information corresponding to the dot pattern. It is the schematic which shows the structure of an electronic pen. It is a figure which shows the specific example of the process result of the process means of the computer apparatus which concerns on 1st Embodiment of this invention. It is a figure which shows the specific example of the process result of the process means of the computer apparatus which concerns on 1st Embodiment of this invention. It is a figure which shows the specific example of the process result of the process means of the computer apparatus which concerns on 1st Embodiment of this invention. It is a figure which shows the specific example of the process result of the process means of the computer apparatus which concerns on 1st Embodiment of this invention. It is a flowchart which shows the flow of the display process of the computer apparatus which concerns on 1st Embodiment of this invention. It is a figure which shows the specific example of the process result of the process means of the computer apparatus which concerns on the modification of 1st Embodiment of this invention. It is a figure which shows the specific example of the process result of the process means of the computer apparatus which concerns on the modification of 1st Embodiment of this invention. It is a system configuration figure of the icon generation system concerning a 2nd embodiment of the present invention. It is a figure which shows the cross section of the display means and touch panel of a computer apparatus which concern on 2nd Embodiment of this invention. It is a figure which shows the specific example of the process result of the process means of the computer apparatus concerning 2nd Embodiment of this invention. It is a figure which shows the specific example of the process result of the process means of the computer apparatus concerning 2nd Embodiment of this invention. It is a flowchart which shows the flow of the display process of the computer apparatus which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the flow of the display process of the computer apparatus which concerns on 2nd Embodiment of this invention. It is a figure which shows the specific example of the process result of the process means of the computer apparatus which concerns on the modification of 2nd Embodiment of this invention.

  Hereinafter, embodiments of the icon generation system of the present invention will be described with reference to the drawings.

[Configuration of Icon Generation System of First Embodiment]
FIG. 1 shows a configuration of an icon generation system 10 according to the first embodiment of the present invention. The icon generation system 10 can be used, for example, in chats or conferences where users participate. As shown in FIG. 1, the icon generation system 10 according to the first embodiment includes an electronic pen 1, a dot pattern paper 2 (encoded pattern paper 2), and a computer device 3.

  The user uses the electronic pen 1 to perform dot overlay 312 (a transparent sheet on which a dot pattern is printed, hereinafter referred to as “DOL 312”), which is one component of the display unit 31 of the computer device 3. Tap and drag the icon or enter a handwritten stroke. The entry information from the electronic pen 1 is wirelessly transmitted to the computer apparatus 3 by Bluetooth (registered trademark).

  In addition, the user can enter a handwritten stroke on the dot pattern paper 2 using the electronic pen 1. Specifically, the dot pattern paper 2 is provided with an entry area 21 and an icon area 22, and the user can enter a handwritten stroke in the entry area 21 using the electronic pen 1. . Also in this case, the entry information from the electronic pen 1 is wirelessly transmitted to the computer apparatus 3 by Bluetooth (registered trademark).

  The computer device 3 is configured by a personal computer or the like, and receives information entered from the electronic pen 1 and displays an image indicating the content of the stroke written on the dot pattern paper 2 or DOL 312 on the display 311. Display.

Further, the user taps a predetermined icon among the plurality of icons printed on the icon area 22 of the dot pattern paper 2 with the electronic pen 1 (tap with the pen tip), and then taps the DOL 312 with the electronic pen 1. can do.
In this case, the computer apparatus 3 includes the entry information transmitted from the electronic pen 1 due to the tap on the predetermined icon of the dot pattern paper 2 and the entry transmitted from the electronic pen 1 due to the tap on the DOL 312. When each piece of information is received, an icon having the same function as the predetermined icon is generated and displayed at a tapped position or the like on the DOL 312 of the display 311.

  A functional block diagram of the computer apparatus 3 is shown in the lower part of FIG. 1, and the functional block diagram will be described later.

FIG. 2 is a diagram showing a transverse section of the display means 31 in the computer apparatus 3 according to the first embodiment.
As shown in FIG. 2, the display unit 31 is configured by arranging the display 311 and the DOL 312 in order from below. That is, the DOL 312 is stacked on the display 311 (more precisely, on the display panel).
The DOL 312 has a base film 3121, a dot pattern 3122, and a protective layer 3123 in order from the bottom.
The dot pattern 3122 is printed on a transparent substrate film 3121 such as PET (PolyEthylene Terephthalate) and reflects infrared rays so as to be read by the electronic pen 1 (for example, titanium oxide, cholesteric liquid crystal, infrared rays). Reflective pigments).
In addition, by laminating an infrared reflection layer (not shown) between the dot pattern 3122 and the base film 3121 or between the base film 3121 and the display 311, the dot pattern 3122 is made of a material that absorbs infrared rays. You may make it contain.
A protective layer 3123, which is an EB curable ink layer formed of an EB (Electron Beam) curable resin, is laminated on the base material film 3121 on which the dot pattern 3122 is superimposed and printed. The protective layer 3123 protects the dot pattern 3122 printed on the base film 3121 from friction with the electronic pen 1 and prevents deterioration of the DOL 312 due to aging.

  Although not shown, the dot pattern paper 2 (see FIG. 1) is also printed with the Anoto dot pattern superimposed on the entire surface. However, since the portion other than the dot pattern (paper medium portion) of the dot pattern paper 2 reflects infrared rays, the dot pattern contains a material that absorbs infrared rays (for example, carbon).

[Dot pattern]
Next, an Anoto dot pattern (coded pattern) formed on the DOL 312 or the dot pattern paper 2 will be described.
FIG. 3 is a diagram for explaining the relationship between dots in a dot pattern and values to which the dots are converted.
As shown in FIG. 3, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, and right are shifted from the reference position of the grid (the intersection of the vertical and horizontal lines). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The positional coordinates of the dot pattern paper 2 and the DOL 312 are determined by the combination of the information thus associated.

FIG. 4A shows an arrangement of a certain dot pattern. As shown in FIG. 4 (A), 6 × 6 dots within a range of about 2 mm in length and breadth form a unique pattern no matter which part of dot pattern paper 2 or DOL 312 takes 6 × 6 dots. Has been placed. The dot pattern formed by these 36 dots holds position coordinates (for example, where the dot pattern is located on the dot pattern paper 2 or DOL 312). FIG. 4B is a diagram in which each dot shown in FIG. 4A is converted into a value associated with the regularity shown in FIG. 3 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 1 that captures a dot pattern.
Note that the dot pattern paper 2 and the DOL 312 are printed with dot patterns in different coordinate ranges.

[Electronic pen]
Next, the electronic pen 1 will be described.
As shown in FIG. 5, the electronic pen 1 includes an ink cartridge 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a processor 108 including a CPU, a memory 109 such as a ROM and a RAM, A communication unit 111 including a real time clock 110, an antenna, and the like, and a battery 112 are provided. The tip of the ink cartridge 104 is a pen tip portion 103, and the user touches the pen tip portion 103 of the electronic pen 1 on the dot pattern paper 2 to enter a handwritten stroke such as a character, Tap (tap the dot pattern paper 2 or DOL 312 with the pen tip 103). Here, when the pen tip portion 103 of the electronic pen 1 first comes into contact with the dot pattern paper 2 or the DOL 312 is referred to as pen down, and the pen tip portion 103 of the electronic pen 1 is in contact (contacted). The separation of the pen tip 103 is called pen-up. A trajectory written between the pen-down and pen-up of the electronic pen 1 is one stroke, and characters, figures, etc. are composed of one or a plurality of strokes.
In addition, when the electronic pen 1 is moved down, the trajectory having substantially the same trajectory as the stroke is written on the dot pattern paper 2 by the ink flowing out from the pen tip portion 103 onto the dot pattern paper 2.
The ink in the ink cartridge 104 is preferably an ink that gives the surface of the DOL 312 water repellency and can be repelled by the water repellency or wiped off with a cloth after filling in the DOL 312.

  The battery 112 is for supplying power to each component in the electronic pen 1, and is configured to turn on / off the power of the electronic pen 1 itself by, for example, detaching a cap (not shown) of the electronic pen 1. You may let them. The real-time clock 110 transmits time information indicating the current time (time stamp: written time information) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied through the ink cartridge 104 from the pen tip portion 103 when the user writes or taps characters or marks on the dot pattern paper 2 with the electronic pen 1, that is, the writing pressure. Is transmitted to the processor 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when the user writes characters or the like on the dot pattern paper 2 or DOL 312 with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and when the pressure sensor 107 detects a writing pressure of a predetermined value or more, the processor 108. Determines that the user has started entry, and activates the LED 105 and the CMOS camera 106. Then, the communication unit 111 associates pen down information detected by the pressure sensor 107 with a pen ID, which will be described later, and transmits it to the computer apparatus 3 as entry information. When the user finishes entering one stroke and moves the electronic pen 1 away from the dot pattern paper 2 or DOL 312, the pressure sensor 107 detects pen-up because no writing pressure exceeding a predetermined value is detected. Then, the communication unit 111 associates the pen-up information detected by the pressure sensor 107 with the pen ID, and transmits it as entry information to the computer apparatus 3.

The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 illuminates infrared rays toward the vicinity of the pen tip portion 103 on the dot pattern paper 2. The area is slightly shifted from the position where the pen tip 103 contacts the dot pattern paper 2. The CMOS camera 106 is provided with an infrared transmission filter that transmits infrared rays and blocks non-infrared rays. The CMOS camera 106 captures a dot pattern in an area illuminated by the LED 105, and the image data of the dot pattern is captured. This is supplied to the processor 108.
Here, when the dot pattern contains a material that absorbs infrared rays, the portion of the dots has a relatively small amount of reflected infrared light illuminated from the LED 105, and the portion other than the dots has a corresponding amount of reflected infrared light. Increase. On the other hand, when the dot pattern contains a material that reflects infrared rays, the dot portion has a relatively large amount of infrared light reflected from the LED 105, and the portions other than the dots have the infrared light reflection amount. Is relatively low.
In any case, it is possible to distinguish the dot region from the other regions by providing a threshold value based on the difference in the amount of reflected infrared light by photographing with the CMOS camera 106. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 4A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called.

  While the user performs the entry, the processor 108 determines the X and Y coordinates (simply “position” of the dot pattern paper 2 and DOL 312 of the stroke (handwriting) to be entered from the dot pattern of the image data supplied by the CMOS camera 106. Coordinates "and" coordinate information ") are continuously calculated. That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 4 (A) supplied by the CMOS camera 106 into the data array shown in FIG. 4 (B). The data is converted into a Y coordinate bit value, and X, Y coordinate data is calculated from the data array by a predetermined calculation method. The processor 108 has a rotation correction processing function for correcting the arrangement of dots on the image due to the angle of the electronic pen 1 facing the dot pattern, and is used when calculating position coordinates. Then, the processor 108 associates the current time (time stamp) transmitted from the real-time clock 110, the pen pressure data, and the X and Y coordinate data. Hereinafter, these associated data are collectively referred to as “coordinate attribute information”. The 6 × 6 dot pattern on the dot pattern paper 2 does not overlap in the dot pattern paper 2 or the DOL 312, so when the user enters characters or the like with the electronic pen 1, the entered position is the dot pattern paper. 2 or DOL 312 can be identified by coordinate calculation by the processor 108. Further, the CMOS camera 106 has a sufficient depth of field in order to photograph dots clearly.

  The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. Then, the communication unit 111 associates the pen ID with the coordinate attribute information (time information, writing pressure data, and X, Y coordinate data), and transmits it to the computer apparatus 3 as entry information. Transmission to the computer apparatus 3 by the communication unit 111 is performed instantaneously and sequentially by wireless transmission such as Bluetooth (registered trademark). Here, one or a plurality of entry information (coordinate attribute information) generated between the pen-down and pen-up of the electronic pen 1 and transmitted to the computer device 3 is stored as stroke information by the computer device 3. . In other words, since one stroke is drawn based on one or a plurality of X and Y coordinates (coordinate points), the computer device 3 draws one stroke based on the pen-down information and the pen-up information. Recognize one or a plurality of coordinate attribute information necessary for. As described above, a set of coordinate attribute information generated by the electronic pen 1 when one stroke is entered by the user is referred to as “stroke information”. The pen tip 103 transmits the pen pressure to the pressure sensor 107 via the ink cartridge 104.

[Computer device]
Next, the computer apparatus 3 will be described. The computer device 3 includes, as hardware, an antenna device capable of data communication with the electronic pen 1, a processor such as a CPU, a memory such as a ROM and a RAM, a display, a personal computer including a mouse, a keyboard, and the like. As shown in FIG. 1, the computer device 3 functionally includes a display unit 31, an input unit 32, a storage unit 33, a reception unit 34, and a processing unit 35. Then, the computer device 3 executes a predetermined process based on the entry information received from the electronic pen 1.

  As described with reference to FIG. 2, the display unit 31 is configured to include the display 311 and the DOL 312, and causes the display 311 to display the content instructed by the processing unit 35 as an image.

The input unit 32 is configured with a mouse, a keyboard, and the like, and inputs various types of information according to user operations and supplies the information to the processing unit 35.
The storage means 33 is configured by a memory such as a hard disk, ROM, or RAM. The storage means 33 stores the entry information received from the electronic pen 1 for each pen ID according to the processing instruction of the processing means 35 and also stores various data such as the image data of the generated icon.
The receiving means 34 is composed of an antenna transmission / reception circuit or the like, receives entry information from the electronic pen 1 and transmits it to the processing means 35. Note that various methods can be used for data communication with the electronic pen 1 including wired and wireless communication. In this embodiment, a communication method using Bluetooth (registered trademark) is adopted.

The processing unit 35 performs various types of processing by controlling the display unit 31 to the receiving unit 34 to exchange various types of information. As shown in FIG. 1, the processing unit 35 mainly includes a coordinate conversion unit 351, a stroke drawing unit 352, an icon processing unit 353, and an icon instruction processing execution unit 354.
Hereinafter, the processing means 35 will be described in more detail with reference to the specific examples of FIGS. Each of FIGS. 6 to 9 is a diagram showing specific examples of various processing results of the processing means 35 of the computer apparatus 3.

First, as shown in FIG. 6A, it is assumed that the user has entered an assembly of strokes “What do you want to lunch?” With the electronic pen 1 in the entry area 21 of the dot pattern paper 2.
The entry information is sequentially transmitted from the electronic pen 1 every predetermined time until one stroke is written on the dot pattern paper 2 by the electronic pen 1, that is, from the pen down to the pen up by the electronic pen 1. . Such sequential transmission of entry information from the electronic pen 1 performed every predetermined time is performed for each stroke.
Each time such entry information is transmitted, the receiving means 34 receives the entry information and supplies it to the processing means 35.

The coordinate conversion means 351 of the processing means 35 converts the position coordinates indicated by the coordinate attribute information of the entry information into position coordinates in the coordinate system of the display 311 every time entry information is supplied from the reception means 34.
In addition to the dot pattern paper 2, the user can enter a handwritten stroke on the DOL 312 using the electronic pen 1. Here, the coordinate system of the dot pattern paper 2 or DOL 312 and the coordinate system of the display 311 are different. The dot pattern paper 2 and the DOL 312 are formed with dot patterns in different coordinate ranges, and a unique dot pattern is picked up regardless of the position of the dot pattern paper 2 and the DOL 312 with the electronic pen 1. The
Therefore, when the entry information is supplied, the processing unit 35 first recognizes whether the position coordinates indicated by the entry information are the dot pattern paper 2 or the DOL 312.
Next, the coordinate conversion means 351 of the processing means 35 converts the position coordinates on the dot pattern paper 2 or DOL 312 into the position coordinates in the coordinate system of the display 311 using a function or table prepared in advance.

The stroke drawing unit 352 draws a stroke by using the position coordinates after being converted into the coordinate system of the display 311 by the coordinate conversion unit 351, for example, in units of stroke information. The stroke drawing unit 352 displays the stroke on the display 311 of the display unit 31.
When such a process of the stroke drawing means 352 is executed for each stroke, as shown in FIG. 6B, the entry display area 3111 in the display 311 of the display means 31 has a stroke “What do you want to lunch?” , That is, a set of strokes corresponding to the handwritten one in FIG. 6A is displayed.
Specifically, “What do you want to lunch?” Is displayed in the entry display area 3111 of the display 311. That is, the entry display area 3111 of the display 311 corresponds to the entry area 21 of the dot pattern paper 2, and the contents entered with the electronic pen 1 are displayed in the entry area 21. However, the entry display area 3111 may display an image (an image in which the handwritten state of FIG. 6A is reproduced as it is) represented by a collection of strokes “What do you want to lunch?” Or character recognition A character string “What do you do for lunch?” After being converted into text by processing may be displayed as an image.
The icon display area 3112 of the display 311 in the display unit 31 will be described later.

Here, the icon area 22 provided on the dot pattern paper 2 will be described.
A plurality of types of icons are printed in the icon area 22. In the example of FIG. 6A and the like, in order from the left, “presentation mode”, “enlarge (+)”, “reduce (−)”, “pen (left)”, “marker (right)”, “line” Size (extremely fine, thin, medium, thick, very thick) "," color (red, blue, yellow, black) "," eraser "," previous page (←) "," next page (→) ", and" Icons to which various functions such as “automatic paper feed stop” are assigned are printed. That is, a plurality of so-called paper icons are arranged in the icon area 22.
As shown in FIG. 7A, the user can select a desired icon by tapping the desired icon among the plurality of icons printed in the icon area 22 with the electronic pen 1.
The icon processing unit 353 in FIG. 1 recognizes the icon based on the entry information transmitted from the electronic pen 1 and received by the receiving unit 34 when the icon is tapped.
The icon instruction processing execution means 354 executes processing indicated by the icon recognized by the icon processing means 353. Here, the process designated by the icon refers to a process for exerting a function assigned to the icon.
In the example of FIG. 7A, since the icon to which the function “enlarge (+)” is assigned is tapped with the electronic pen 1, when the icon processing unit 353 recognizes the icon, the icon instruction process is executed. The means 354 executes a process for enlarging and displaying the contents of the entry display area 3111 in the display 311 as the process indicated by the icon. As a result, in the entry display area 3111, the portion “Lunch how to do” shown in FIG. 7B is enlarged and displayed out of the contents “How to have lunch” shown in FIG. 6B.
The corresponding position on the display obtained by the coordinate conversion means 351 is obtained by tapping the “enlarge (+)” icon on the dot pattern paper 2 with the electronic pen 1 and further tapping the DOL 312 on the entry display area 3111. You may make it expand centering on.

Further, after tapping a predetermined icon on the dot pattern paper 2 with the electronic pen 1, the user further taps an arbitrary position in the icon display area 3112 of the display 311 with the electronic pen 1 as shown in FIG. 8. be able to. More precisely, the user can tap with the electronic pen 1 an arbitrary position in the area of the DOL 312 in the upper layer of the icon display area 3112. Thereby, an icon having the same function as the predetermined icon (icon 51 in the example of FIG. 8) is generated in the computer device 3 and displayed in the icon display area 3112 of the display 311 (two points in the figure). A chain line arrow indicates a state in which the pen tip portion 103 of the electronic pen 1 moves).
Specifically, the processing means 35 recognizes that the position coordinates indicated by the entry information supplied when tapped on the DOL 312 are those of the DOL 312.
Next, the coordinate conversion unit 351 of the processing unit 35 converts the position coordinates of the DOL 312 into position coordinates in the coordinate system of the display 311.
When the icon processing means 353 confirms that the position coordinates converted into the coordinate system of the display 311 by the coordinate conversion means 351 belong to the icon display area 3112, the icon having the same function as the icon recognized earlier, the example of FIG. Then, the icon 51 having the function of “enlarge (+)” is generated and displayed in the icon display area 3112 of the display 311.
In this case, the display position of the icon 51 suffices if it is within the icon display area 3112, but as shown in FIG. 8, it is preferable that the position coordinates of the display 311 correspond to the position of the DOL 312 tapped by the electronic pen 1. It is. This is because it appears to the user as if the icon 51 appeared at the position tapped with the electronic pen 1.

Further, after the icon 51 is displayed in the icon display area 3112 of the display 311, the user drags the icon 51 with the electronic pen 1 as shown in FIG. 9 so that the icon 51 is displayed in the icon display area 3112. (The arrow in the two-dot chain line shows how the icon 51 moves).
Specifically, the processing unit 35 recognizes that each position coordinate indicated by the entry information sequentially supplied while being dragged is that of the DOL 312.
Next, the coordinate conversion unit 351 of the processing unit 35 converts each position coordinate of the DOL 312 into each position coordinate in the coordinate system of the display 311.
When the icon processing unit 353 confirms that each position coordinate converted into the coordinate system of the display 311 by the coordinate conversion unit 351 belongs to the icon display area 3112, the icon processing unit 353 displays the previously displayed icon, the icon 51 in the example of FIG. The display contents are updated so as to move within the icon display area 3112 of the display 311.

[Display processing flow of the first embodiment]
The series of processes performed by the processing unit 35 described with reference to the specific examples of FIGS. 6 to 9 is hereinafter referred to as “display process”. Next, with reference to FIG. 10, the flow of display processing by the processing means 35 of the computer apparatus 3 will be described.

  First, when the user enters a handwritten stroke on the dot pattern paper 2 or DOL 312 with the electronic pen 1, the electronic pen 1 transmits the generated entry information to the computer device 3. Specifically, at the time of pen down, the electronic pen 1 generates entry information in which the pen down information and the pen ID are associated, and transmits the generated entry information to the computer device 3. When the contact state of the electronic pen 1 to the dot pattern paper 2 or DOL 312 continues due to stroke entry or the like, the electronic pen 1 obtains coordinate attribute information including coordinate information calculated by imaging the dot pattern, and a pen ID. The associated entry information is continuously generated and sequentially transmitted to the computer apparatus 3. At the time of pen-up, the electronic pen 1 generates entry information in which pen-up information and a pen ID are associated with each other and transmits the entry information to the computer device 3.

In the computer device 3, the first display process is started when the receiving unit 34 is ready to communicate with the electronic pen 1, and thereafter, every time entry information is transmitted from the electronic pen 1. The display process is repeated.
The processing unit 35 causes the receiving unit 34 to receive the entry information transmitted from the electronic pen 1 and stores it in the storage unit 33 (step S1).

Next, the processing means 35 determines whether the position coordinates indicated by the entry information received in the process of step S1 is that of the DOL 312 or that of the dot pattern paper 2 (step S2).
If it is determined that the position coordinates indicated by the entry information are those of DOL 312 (step S2: DOL), the process proceeds to step S8. However, the process after step S8 is mentioned later.
On the other hand, when it is determined that the position coordinates indicated by the entry information are those of the dot pattern paper 2 (step S2: paper), the process proceeds to step S3.

  The processing means 35 determines whether the position coordinates indicated by the entry information received in the process of step S1 are those of the entry area 21 or the icon area 22 of the dot pattern paper 2 or other areas. It is judged whether it is a thing (step S3).

If it is determined that the position coordinates indicated by the entry information received in step S1 are in the entry area 21 of the dot pattern paper 2 (step S3: entry area), the process proceeds to step S4.
The coordinate conversion unit 351 acquires coordinate attribute information from the entry information received in the process of step S1, and uses the position coordinates indicated by the X and Y coordinate data in the coordinate attribute information as the position coordinates in the coordinate system of the display 311. (Step S4). Here, the position coordinates indicated by the entry information received in the process of step S <b> 1 are the position coordinates of the dot pattern paper 2. Therefore, the coordinate conversion executed in step S4 is coordinate conversion from the position coordinates of the dot pattern paper 2 to the position coordinates in the coordinate system of the display 311. Hereinafter, in accordance with the description of FIG. "
The stroke drawing unit 352 draws a stroke based on the position coordinates after the first coordinate conversion in step S4, and displays the stroke on the display 311 of the display unit 31 (step S5).
It should be noted that the stroke drawing process in step S10 and the like, which will be described later, is not limited to step S5, and may be executed every time display processing is executed, that is, every time entry information is supplied. It may be executed only in some of the processes. For example, the stroke drawing process may be prohibited until the stroke information is generated, and may be executed when the stroke information is generated.
When the stroke drawing process in step S5 is executed, the display process ends.

  A series of processing described above, that is, processing after the position coordinate indicated by the entry information received in step S1 is determined to be in the entry area 21 of the dot pattern sheet 2 (step S3: entry area). A specific example of the result is shown in FIG.

On the other hand, when it is determined that the position coordinates indicated by the entry information received in the process of step S1 are in the icon area 22 of the dot pattern paper 2 (step S3: icon area), the process proceeds to step S6. Proceed to
The icon processing unit 353 recognizes the icon based on the entry information received in step S1 (step S6). The icon instruction process execution unit 354 executes a process instructed by the icon recognized in the process of step S6 (step S7). As a result, the display process ends.

A series of processes described above, that is, the process after the position coordinate indicated by the entry information received in the process of step S1 is determined to be in the icon area 22 of the dot pattern paper 2 (step S3: icon area). A specific example of the result is shown in FIG. 7 described above.
If the position coordinates indicated by the entry information received in the process of step S1 are determined to be other items in the dot pattern paper 2 (step S3: other area), the display process is ended. Become.

The series of processes after it has been determined that the position coordinates indicated by the entry information received in step S1 are those of the dot pattern paper 2 (step S2: paper) have been described.
Next, a series of processes after it is determined that the position coordinates indicated by the entry information received in the process of step S1 are those of DOL 312 (step S2: DOL) will be described.

  The coordinate conversion unit 351 acquires coordinate attribute information from the entry information received in the process of step S1, and uses the position coordinates indicated by the X and Y coordinate data in the coordinate attribute information as the position coordinates in the coordinate system of the display 311. (Step S8). Here, the position coordinates indicated by the entry information received in the process of step S <b> 1 are the position coordinates of the DOL 312. Therefore, unlike the first coordinate transformation in step S4, the coordinate transformation executed in step S8 is a coordinate transformation from the position coordinate of the DOL 312 to the position coordinate in the coordinate system of the display 311. Hereinafter, description of FIG. This is referred to as “second coordinate transformation”.

  Next, the processing means 35 indicates that the position coordinates indicated by the entry information received in the process of step S1 (position coordinates after the second coordinate conversion in step S8) is the entry display area 3111 in the display 311. Or the icon display area 3112 (step S9).

When it is determined that the position coordinates indicated by the entry information received in the process of step S1 (position coordinates of the second coordinate transformation in step S8) are in the entry display area 3111 of the display 311 (step S9: entry) ) Proceeds to step S10.
The stroke drawing means 352 draws a stroke based on the position coordinates after the second coordinate conversion in step S8, and displays the stroke on the display 311 (step S10). As a result, the display process ends.

On the other hand, when it is determined that the position coordinates indicated by the entry information received in the process of step S1 (the position coordinates of the second coordinate conversion in step S8) belong to the icon display area 3112 of the display 311. For (Step S9: Icon), the process proceeds to Step S11.
The processing means 35 determines whether or not the position coordinate indicated by the immediately preceding entry information (entrance information of the immediately preceding stroke) with respect to the entry information received in the process of step S1 is that of the icon of the dot pattern sheet 2. Judgment is made (step S11).

When it is determined that the position coordinates indicated by the immediately preceding entry information are those of the icon of the dot pattern paper 2 (step S11: YES), the icon processing means 353 determines whether or not the same icon has already been generated and displayed. (Step S12).
When it is determined that the icon processing unit 353 has already generated and displayed the same icon (step S12: YES), the display process ends.
On the other hand, when the icon processing means 353 determines that the same icon has not yet been generated and displayed (step S12: NO), the icon processing unit 353 generates the icon and displays it in the icon display area 3112 of the display 311 (step S12). S13). A specific example of the result in the processing in this case is shown in FIG. 8, but the icon processing means 353 may display an icon at a position designated by the electronic pen 1 in the icon display area 3112. . Furthermore, when the electronic pen 1 is in a drag state in the icon display area 3112, the icon processing unit 353 may move the icon in accordance with the drag.
When the process of step S13 ends, the display process ends.

On the other hand, when the processing means 35 determines that the position coordinates indicated by the immediately preceding entry information are not for the icon of the dot pattern paper 2 (step S11: NO), the position coordinates indicated by the immediately preceding entry information are those of the DOL 312. It is determined whether or not it is an icon (step S14).
If it is determined that the position coordinates indicated by the immediately preceding entry information are not those of the DOL 312 icon (step S14: NO), the display process ends.
On the other hand, when it is determined that the position coordinates indicated by the immediately preceding entry information are those of the DOL 312 icon (step S14: YES), the icon processing unit 353 recognizes the icon (step S15), The icon is moved and displayed in the icon display area 3112 of the display 311 (step S16). That is, the display position of the icon in the icon display area 3112 is changed from the position coordinate indicated by the previous entry information (position coordinate after the second coordinate conversion) to the position coordinate indicated by the entry information received in the process of step S1 ( The icon is dragged by moving to (position coordinates after the second coordinate conversion). A specific example of the result of the processing in this case is shown in FIG.
When the process of step S16 ends, the display process ends.

  After a desired icon is displayed in the icon display area 3112 by the display process, the computer apparatus 3 is set to a mode in which the icon displayed in the icon display area 3112 can be executed. Thereby, by tapping the icon displayed in the icon display area 3112 with the electronic pen 1, the icon instruction processing execution means 354 of the computer device 3 executes the process specified by the icon.

Specifically, when the user taps an icon displayed in the icon display area 3112 with the electronic pen 1, the electronic pen 1 reads the dot pattern at the tap position of the DOL 312 to generate entry information, and the entry information is stored in the computer device. 3 to send.
In the computer apparatus 3, when the receiving unit 34 receives the entry information, the coordinate conversion unit 351 converts the position coordinates included in the entry information into the position coordinates of the display coordinate system. When the icon instruction processing execution unit 354 recognizes that a specific icon is instructed from the converted position coordinates, the icon instruction processing execution unit 354 executes processing instructed by the icon.
In this manner, the user can cause the computer apparatus 3 to execute processing indicated by the icon by tapping the icon displayed in the icon display area 3112 with the electronic pen 1.

[Effects of First Embodiment]
According to the first embodiment described above, the computer device 3 in the icon generation system 10 includes the display unit 31 and the icon processing unit 353 as shown in FIG.
In the display unit 31, a display 311 for displaying an image and a DOL 312 which is a sheet on which a dot pattern (coded pattern) is printed are stacked.
When the electronic pen 1 is brought into contact with a predetermined icon of the dot pattern paper 2 as a writing medium on which one or more icons and a dot pattern (coded pattern) are printed, the icon processing unit 353 displays the predetermined icon. recognize. Thereafter, when the electronic pen 1 is brought into contact with the DOL 312, the icon processing unit 353 generates an icon having the same function as a predetermined icon and displays the icon on the display 311.
Accordingly, an icon having the same function as the icon printed on the dot pattern paper 2 can be generated and displayed on the computer device 3 side by a simple operation using the electronic pen 1.

[First Modification of First Embodiment]
In the first embodiment, after a desired icon is displayed in the icon display area 3112 by the display process, the computer device 3 is set to a mode in which the icon displayed in the icon display area 3112 can be executed. The icon displayed on 3112 can be specified and executed. Instead, the icon displayed in the icon display area 3112 may be designated and executed in the display process without changing the mode.

In this case, when the processing unit 35 determines in step S9 shown in FIG. 10 that the position coordinates are within the icon display area 3112, it determines whether or not an icon is displayed at the instructed position. To do. When the processing unit 35 determines that the icon is displayed at the instructed position, the processing unit 35 further obtains the time at which the icon is instructed based on the time information of the entry information, and the icon is instructed for a predetermined time or more. If it is determined that the icon has been dragged, the icon processing means 353 moves the icon based on the position information and ends the process. On the other hand, the processing means 35 determines that the icon is tapped when the time that the icon is indicated is less than the predetermined time, and the icon instruction processing execution means 354 executes the process indicated by the icon. To end the process.
If the processing unit 35 determines in step S9 that the position coordinates are within the icon display area 3112 and determines that no icon is displayed at the instructed position, the process proceeds to step S11. It is good to process.

[Modification 2 of the first embodiment]
In the first embodiment, the computer device 3 displays icons having the same function as each of the plurality of icons according to each tap of the electronic pen 1 for each of the plurality of icons printed on the dot pattern paper 2. Each can be generated and displayed on the display 311. However, for the user, the tap operation with the electronic pen 1 must be repeated as many times as the number of icons printed on the dot pattern paper 2, which is cumbersome and troublesome.
Therefore, in order to eliminate such a complicated and time-consuming repeated tap operation, the computer device 3 generates a plurality of icon groups printed on the dot pattern paper 2 and displays them on the display 311. Also good.

FIG. 11 and FIG. 12 are diagrams for specifically explaining processing until the computer apparatus 3 collectively generates a plurality of icon groups and displays them on the display 311.
In order to realize such processing, in addition to a plurality of icon groups, an instruction function for collectively generating the plurality of icon groups is assigned to the icon area 22 of the dot pattern paper 2 as shown in FIG. All the icon generation buttons 22a are further printed.
As shown in FIG. 11, after tapping all the icon generation buttons 22 a of the dot pattern paper 2 with the electronic pen 1, the user further moves to an arbitrary position (more precisely, in the DOL 312 in the icon display area 3112 of the display 311. Tap the corresponding position) with the electronic pen 1. Then, as shown in FIG. 12, a plurality of icon groups 52 having the same function as the plurality of icon groups in the icon area 22 are generated and displayed in the icon display area 3112.

Specifically, when the entry information is transmitted from the electronic pen 1 to the computer device 3 by tapping the all icon generation button 22a, the display process of FIG. 10 is started.
The processing unit 35 causes the receiving unit 34 to receive the entry information transmitted from the electronic pen 1, and stores it in the storage unit 33 (step S1).
Next, the processing means 35 determines that the position coordinates indicated by the entry information received in the processing of step S1 are those of the dot pattern paper 2 (step S2: paper), and further, those of the icon area 22. It is determined that there is an icon (step S3: icon region), and the all icon generation button 22a is recognized as one of the icons (step S6).
The icon instruction process execution unit 354 executes a process instructed by the icon recognized in the process of step S6 (step S7). Here, the process instructed by the icon is a process of generating a plurality of icon groups 52 having the same function as the plurality of icon groups in the icon region 22 originally. Therefore, the plurality of icon groups 52 may be generated by the icon instruction process execution means 354 in the step S7. However, here, for convenience of explanation, it is assumed that the plurality of icon groups 52 are generated in the process of step S13 described later, and the icons indicate various preparations (pre-processing) for generating the plurality of icon groups 52. It is assumed that the process is executed by the icon instruction process execution unit 354 as a process.
When the process in step S7 is completed, the display process ends.

Next, when the user taps an arbitrary position in the icon display area 3112 of the display 311 (more precisely, the corresponding position of the DOL 312) with the electronic pen 1, the display process is started again.
The processing unit 35 causes the receiving unit 34 to receive the entry information transmitted from the electronic pen 1 and stores it in the storage unit 33 (step S1). The position coordinates indicated by the entry information are those of the DOL 312. (Step S2: DOL), the process proceeds to Step S8.

The coordinate conversion means 351 performs second coordinate conversion on the position coordinates of the DOL 312 tapped with the electronic pen 1 (position coordinates specified from the entry information received in the process of step S1) (step S8). Thereby, the position coordinates of the DOL 312 are converted into position coordinates in the coordinate system of the display 311.
Next, in the processing means 35, the position coordinates (position coordinates after the second coordinate conversion) indicated by the entry information received in the process of step S1 are those of the icon display area 3112 of the display 311 (step S9: Icon), the position coordinates indicated by the immediately preceding entry information are determined to be those of the icon of the dot pattern paper 2 (step S11: YES), and the process proceeds to step S12.
The icon processing means 353 determines that the same icon has not yet been generated and displayed (step S12: NO), generates a plurality of icon groups 52, and displays them in the icon display area 3112 of the display 311 as shown in FIG. It is displayed (step S13). As a result, the display process ends.

As described above, according to the modification of the first embodiment, the dot pattern paper 2 is printed with the all icon generation button 22a for instructing batch generation of one or more icons as a whole.
The icon processing means 353 recognizes all the icon generation buttons 22a when all the icon generation buttons 22a are tapped with the electronic pen 1, and then when one is tapped against the DOL 312 with the electronic pen 1, Each of one or more icons having the same function as the icon is generated and displayed on the display 311.
Therefore, the user can perform the same operation as selecting one or more icons by performing a simple operation such as selecting only one all icon generation button 22a without performing a complicated operation such as selecting each of one or more icons. Each of the one or more icons having a function can be generated and displayed on the computer device 3 side.

  After all icons are displayed in the icon display area 3112 by the display process, the computer apparatus 3 is set to a mode in which the icons displayed in the icon display area 3112 can be executed. Thereby, by tapping the icon displayed in the icon display area 3112 with the electronic pen 1, the icon instruction processing execution means 354 of the computer device 3 executes the process specified by the icon.

As described above, in the first embodiment of the icon generation system of the present invention, an operation of bringing the electronic pen 1 into contact with the DOL 312 stacked on the display 311 is employed as an operation of touching or approaching the display 311. .
However, the operation of touching or approaching the display 311 is not particularly limited to the operation using the electronic pen 1 of the first embodiment, and may be any operation.
Therefore, hereinafter, as an operation of contact or proximity to the display 311, in addition to the operation using the electronic pen 1 similar to that of the first embodiment, an operation of allowing an object such as a finger to contact or approach the touch panel is possible. A form is demonstrated as 2nd Embodiment.
In the drawings from FIG. 13 onward according to the second embodiment, the same reference numerals are given to the same components as those in the first embodiment. For this reason, the description of the same reference numerals is omitted as appropriate.

[Configuration of Icon Generation System of Second Embodiment]
FIG. 13 shows a configuration of an icon generation system 11 according to the second embodiment of the present invention. As shown in FIG. 13, the icon generation system 11 according to the second embodiment includes an electronic pen 1, a dot pattern paper 2 (coded pattern paper 2), and a computer device 3 as in the first embodiment. Have.

  The electronic pen 1 and the dot pattern paper 2 are the same as those in the first embodiment, but the computer device 3 is different from the first embodiment in the configuration. Therefore, only the differences from the first embodiment among the configurations of the computer apparatus 3 of the second embodiment will be described below.

  In the computer apparatus 3 according to the second embodiment, as shown in FIG. 13 and FIG. 14, a touch panel 321 that is one component of the input unit 32 is disposed between the display 311 and the DOL 312 that constitute the display unit 31. Is done.

FIG. 14 is a diagram illustrating a cross section of the display unit 31 and the touch panel 321 in the computer apparatus 3 according to the second embodiment.
As shown in FIG. 14, in the computer apparatus 3 of the second embodiment, the display 311 of the display unit 31, the touch panel 321 of the input unit 32, and the DOL 312 of the display unit 31 are sequentially stacked from below. Since the configuration of the DOL 312 is the same as the configuration of FIG. 2 according to the first embodiment, the description thereof is omitted here.
The touch panel 321 is a capacitive touch panel in which elongated capacitive sensors are arranged vertically and horizontally. Although the touch panel 321 is inferior to the DOL 312 in terms of resolution, the touch panel 321 is highly convenient in that an object such as a finger f can be touched or operated (hereinafter referred to as “touch operation”) without using the electronic pen 1. . That is, in the second embodiment, the DOL 312 and the touch panel 321 are used in combination to further improve convenience.

  Returning to FIG. 13, the processing means 35 of the computer apparatus 3 of the second embodiment mainly includes a stroke drawing means 352, an icon processing means 353, and an icon instruction processing execution means 354, as in the first embodiment. Further, the first coordinate conversion unit 355 and the second coordinate conversion unit 356 are included.

Similarly to the coordinate conversion unit 351 of the first embodiment, the first coordinate conversion unit 355 prints the position coordinates, that is, the dot pattern specified by the entry information transmitted from the electronic pen 1 and received by the reception unit 34. The position coordinates of the dot pattern paper 2 or DOL 312 thus converted are converted into position coordinates in the coordinate system of the display 311.
The second coordinate conversion unit 356 converts the position coordinate where the touch operation is performed on the touch panel 321, that is, the position coordinate in the coordinate system of the touch panel 321 into the position coordinate in the coordinate system of the display 311.

  Hereinafter, the processing means 35 will be described in more detail with reference to the specific examples of FIGS. 15 and 16 as appropriate. FIG. 15 and FIG. 16 are diagrams respectively showing specific examples of various processing results of the processing means 35 of the computer apparatus 3.

Before the state shown in FIG. 15 is reached, the user first uses the electronic pen 1 to set a desired icon in the icon area 22 of the dot pattern paper 2 as shown in FIG. The icon can be selected by tapping.
In this case, the icon processing unit 353 in FIG. 13 recognizes the icon based on the entry information transmitted from the electronic pen 1 and received by the receiving unit 34 when the icon is tapped. The icon instruction processing execution means 354 executes processing indicated by the icon recognized by the icon processing means 353, that is, processing for enlarging the display content on the display 311 in the example of FIG.

When the user wants to generate and display an icon tapped with the electronic pen 1 on the dot pattern paper 2 also on the computer device 3 side, the electronic pen 1 is displayed on the DOL 312 on the display 311 as in the first embodiment. You can tap with. In this case, the processing described above with reference to FIG. 8 is executed, and an icon 51 having the same function as the icon tapped with the electronic pen 1 on the dot pattern paper 2 is generated and displayed on the display 311.
Further, in the second embodiment, as shown in FIG. 15, the user can also perform a touch operation on the touch panel 321 using his / her finger f or the like.
In this case, the processing unit 35 recognizes that the touch operation on the touch panel 321 has been performed, and acquires the position coordinates of the touch operation, that is, the position coordinates in the coordinate system of the touch panel 321.
Next, the second coordinate conversion unit 356 of the processing unit 35 converts the position coordinate in the coordinate system of the touch panel 321 into the position coordinate in the coordinate system of the display 311.
When the icon processing means 353 confirms that the position coordinates converted into the coordinate system of the display 311 by the second coordinate conversion means 356 belong to the icon display area 3112, the icon processing means 353 has the same function as the icon recognized earlier, FIG. In this example, an icon 51 having a function of “enlarge (+)” is generated and displayed in the icon display area 3112 of the display 311.
In this case, the display position of the icon 51 suffices as long as it is within the icon display area 3112. However, as shown in FIG. 15, the position coordinates of the display 311 corresponding to the position of the touch panel 321 where the finger f or the like has been touched are provided. It is preferable. This is because it appears to the user as if the icon 51 appeared at the position of the touch operation.

Further, after the icon 51 is displayed in the icon display area 3112 of the display 311, the user drags the icon 51 with his / her finger f or the like as shown in FIG. It can be moved freely within 3112.
Specifically, the processing unit 35 recognizes that each position coordinate sequentially supplied while being dragged is due to a touch operation on the touch panel 321.
Next, the second coordinate conversion unit 356 of the processing unit 35 converts each position coordinate in the coordinate system of the touch panel 321 to each position coordinate in the coordinate system of the display 311.
When the icon processing unit 353 confirms that each position coordinate converted to the coordinate system of the display 311 by the second coordinate conversion unit 356 belongs to the icon display area 3112, the icon processing unit 353 displays the previously displayed icon, “enlarged” in the example of FIG. The display content is updated so that the icon 51 having the function of “(+)” is moved in the icon display area 3112 of the display 311.

[Display Processing Flow of Second Embodiment]
Next, details of the flow of the display process of the computer apparatus 3 in FIG. 13 according to the second embodiment will be described with reference to FIGS. 17 and 18.

In the display process according to the second embodiment, as with the display process according to the first embodiment, when entry information is transmitted from the electronic pen 1, the display process is started.
In this case, the processing unit 35 determines that the entry information transmitted from the electronic pen 1 has been received (step S101: reception of the entry information), and stores the entry information in the storage unit 33, the process proceeds to step S102. Proceed.
Note that the processes in steps S102 to S116 of FIG. 17 according to the second embodiment and the flow thereof are basically the same as the processes and flows of steps S2 to S16 of FIG. 10 according to the first embodiment. The description is omitted here.

In the display process of the second embodiment, the display process is also started when a touch operation on the touch panel 321 is performed.
In this case, the processing means 35 determines that a touch operation has been detected (step S101: touch operation detection), and advances the processing to step S208 in FIG.

  The second coordinate conversion unit 356 converts the position coordinates of the touch operation detected in the process of step S101 into position coordinates in the coordinate system of the display 311 (step S208). Here, the position coordinates of the touch operation detected in the process of step S <b> 101 are position coordinates in the coordinate system of the touch panel 321. Accordingly, the coordinate transformation executed in step S208 includes the first coordinate transformation in step S104 in FIG. 17 (step S4 in FIG. 10) and the second coordinate transformation in step S108 in FIG. 17 (step S8 in FIG. 10). Is different from the coordinate system of the touch panel 321 to the coordinate system of the display 311, and is hereinafter referred to as “third coordinate conversion” in accordance with the description of FIG. 18.

  Next, the processing means 35 uses the entry display area 3111 in the display 311 to display the position coordinates of the touch operation detected in the process of step S101 (position coordinates after the third coordinate conversion in step S208). It is determined whether there is an icon display area 3112 (step S209).

When it is determined that the position coordinates of the touch operation detected in the process of step S101 (position coordinates after the third coordinate conversion of step S208 is performed) are in the entry display area 3111 of the display 311 (step In S209: entry), the process proceeds to step S210.
The stroke drawing unit 352 draws a stroke based on the position coordinates after the third coordinate conversion in step S208 and displays the stroke on the display 311 (step S210). As a result, the display process ends.

In contrast, the position coordinates of the touch operation detected in the process of step S101 (position coordinates after the third coordinate conversion in step S208) is determined to be that of the icon display area 3112 of the display 311. If so (step S209: icon), the process proceeds to step S211.
The processing means 35 determines whether or not the position coordinates indicated by the immediately preceding entry information (entrance information of the immediately preceding stroke) are those of the icon of the dot pattern paper 2 (step S211).

When it is determined that the position coordinates indicated by the immediately preceding entry information are those of the icon of the dot pattern paper 2 (step S211: YES), the icon processing unit 353 determines whether or not the same icon has already been generated and displayed. (Step S212).
When it is determined that the icon processing means 353 has already generated and displayed the same icon (step S212: YES), the display process ends.
On the other hand, when the icon processing means 353 determines that the same icon has not yet been generated and displayed (step S212: NO), the icon processing unit 353 generates the icon and displays it in the icon display area 3112 of the display 311 (step S212). S213). A specific example of the processing result in this case is shown in FIG. As described above, the icon processing unit 353 may display the icon at the position indicated by the finger f in the icon display area 3112. Furthermore, when the finger f is in the drag state in the icon display area 3112, the icon processing unit 353 may move the icon in accordance with the drag. Thereafter, the display process ends.

  On the other hand, when the processing means 35 determines that the position coordinates indicated by the immediately preceding entry information are not those of the icon of the dot pattern paper 2 (step S211: NO), the processing proceeds to step 214. Here, in the previous display processing, when it is determined that a touch operation has been detected (step S101: touch operation detection), that is, when the touch operation on the touch panel 321 is continued. In addition, it is determined as NO in Step S211, and the process proceeds to Step S214.

The processing means 35 determines whether or not the position coordinate of the previous touch operation (position coordinate after the third coordinate conversion) is an icon (its display position) in the icon display area 3112 (step S214).
When it is determined that the position coordinate of the previous touch operation (position coordinate after the third coordinate conversion) is not the icon (the display position) of the icon display area 3112 (step S214: NO), the display process ends. Become.
On the other hand, when it is determined that the position coordinate of the previous touch operation (position coordinate after the third coordinate conversion) is the icon (its display position) of the icon display area 3112 (step S214: YES). The icon processing means 353 recognizes the icon (step S215), and moves and displays the icon on the icon display area 3112 of the display 311 (step S216). That is, the display position of the icon in the icon display area 3112 is determined from the position coordinate (position coordinate after the third coordinate conversion) where the previous touch operation was performed (step coordinate position detected by the process of step S101). The icon is dragged by moving to (position coordinates after the third coordinate conversion). A specific example of the processing result in this case is shown in FIG. As a result, the display process ends.

  After a desired icon is displayed in the icon display area 3112 by the display process, the computer apparatus 3 is set to a mode in which the icon displayed in the icon display area 3112 can be executed. Thereby, by touching the icon displayed in the icon display area 3112 with the finger f, the icon instruction processing execution means 354 of the computer device 3 executes the process indicated by the icon.

Specifically, when the user touches an icon displayed in the icon display area 3112 with the finger f, the position coordinate detected by the touch panel 321 is converted into the position coordinate of the coordinate system of the display 311 by the second coordinate conversion unit 356. Then, when the icon instruction processing execution unit 354 recognizes that a specific icon is instructed from the converted position coordinates, the icon instruction processing execution unit 354 executes processing instructed by the icon.
In this way, the user can cause the computer apparatus 3 to execute processing indicated by the icon by touching the icon displayed in the icon display area 3112 with the finger f.

[Effects of Second Embodiment]
As described above, according to the second embodiment, the computer device 3 in the icon generation system 11 includes the display unit 31 and the icon processing unit 353 as shown in FIG.
In the display unit 31, a display 311 for displaying an image, a touch panel 321 and a DOL 312 which is a sheet on which a dot pattern (coded pattern) is printed are stacked.
The icon processing unit 353 recognizes a predetermined icon when the electronic pen 1 comes into contact with a predetermined icon of the dot pattern paper 2 as a writing medium on which one or more icons and a dot pattern (coded pattern) are printed. To do. Thereafter, when the electronic pen 1 is brought into contact with the DOL 312, the icon processing unit 353 generates an icon having the same function as the predetermined icon and displays the icon on the display 311.
Thus, as in the first embodiment, an icon having the same function as the icon printed on the dot pattern paper 2 can be generated and displayed on the computer device 3 side by a simple operation using the electronic pen 1. It becomes possible.

Furthermore, in the computer apparatus 3 according to the second embodiment, a touch panel 321 is further stacked on the display 311 of the display unit 31.
When the icon processing unit 353 recognizes a predetermined icon touching the electronic pen 1 among the plurality of icons printed on the dot pattern paper 2, when an object such as a finger f comes into contact with or approaches the touch panel 321. (When a touch operation is performed), an icon having the same function as a predetermined icon is further generated and displayed on the display 311.
This allows the user to selectively and freely use the electronic pen 1 and other objects (for example, his / her finger f) in order to operate the display 311 of the computer device 3. Therefore, an icon having the same function as the icon printed on the dot pattern paper 2 can be generated and displayed on the computer device 3 side.

[Modification 1 of the second embodiment]
In the second embodiment, in the display process without changing the mode, the icon displayed in the icon display area 3112 may be designated with the electronic pen 1 so that the process designated by the icon can be executed. In that case, the same processing as that of the first modification of the first embodiment may be performed.

[Modification 2 of the second embodiment]
Similarly, in the display process without changing the mode, the icon displayed in the icon display area 3112 may be designated with the finger f so that the process designated by the icon can be executed.

In this case, when the processing means 35 determines in step S209 shown in FIG. 18 that the position coordinate where the touch operation is performed is in the icon display area 3112, the icon is displayed at the indicated position on the display coordinate system. Whether or not is displayed. When the processing unit 35 determines that the icon is displayed at the instructed position, the processing unit 35 further obtains a touch operation time. If the icon is instructed for a predetermined time or more, the icon is dragged. Based on the position information, the icon processing unit 353 moves the icon and ends the process. On the other hand, if the time that the icon is designated is less than the predetermined time, the processing means 35 determines that the icon has been touched for a short time, and the icon instruction processing execution means 354 indicates that the icon is designated. The processing to be executed is executed and the processing is terminated.
When the processing means 35 determines in step S209 that the touched position coordinates are within the icon display area 3112 and determines that no icon is displayed at the indicated position, It is good to perform the process which progresses to step S211.

[Modification 3 of the second embodiment]
The computer apparatus 3 according to the second embodiment can also generate a plurality of icon groups printed on the dot pattern paper 2 and display them on the display 311 in the same manner as the second modification of the first embodiment. .
As in the first embodiment, the user first taps all the icon generation buttons 22a of the dot pattern paper 2 with the electronic pen 1 (see FIG. 11). Thereafter, the user can tap with the electronic pen 1 an arbitrary position in the area of the DOL 312 corresponding to the icon display area 3112 of the display 311 as in the first embodiment. In this case, a plurality of icon groups 52 having the same function as the plurality of icon groups in the icon area 22 are generated and displayed in the icon display area 3112 (see FIG. 12).
Furthermore, in the second embodiment, as shown in FIG. 19, the user touches an arbitrary position in the area of the touch panel 321 corresponding to the icon display area 3112 of the display 311 with his / her finger f or the like. can do. Also in this case, a plurality of icon groups 52 having the same function as the plurality of icon groups in the icon area 22 are generated and displayed in the icon display area 3112.

Specifically, when the entry information is transmitted from the electronic pen 1 to the computer device 3 by tapping the all icon generation button 22a, the display process of FIG. 17 is started.
The processing unit 35 causes the receiving unit 34 to receive the entry information transmitted from the electronic pen 1, and stores the entry information in the storage unit 33 (step S101: receiving the entry information).
Next, the processing means 35 determines that the position coordinates indicated by the entry information received in the processing of step S101 are those of the dot pattern paper 2 (step S102: paper), and further, those of the icon area 22. It is determined that there is an icon (step S103: icon region), and the all icon generation button 22a is recognized as one of the icons (step S106).
The icon instruction process execution unit 354 executes a process instructed by the icon recognized in the process of step S106 (step S107). Here, the process instructed by the icon is a process of generating a plurality of icon groups 52 having the same function as the plurality of icon groups in the icon region 22 originally. Therefore, the plurality of icon groups 52 may be generated by the icon instruction process execution means 354 at the stage of step S107. However, here, for convenience of explanation, it is assumed that the plurality of icon groups 52 are generated in the process of step S213 described later, and the icons indicate various preparations (pre-processing) for generating the plurality of icon groups 52. It is assumed that the process is executed by the icon instruction process execution unit 354 as a process.
When the process in step S107 is completed, the display process ends.

Next, when the user touches an arbitrary position in the area of the touch panel 321 corresponding to the icon display area 3112 of the display 311 with his / her finger f or the like, the display process is started again.
The processing means 35 detects the touch operation (step S101: touch operation detection), and advances the processing to step S208 in FIG.

The second coordinate conversion means 356 performs a third coordinate conversion on the position coordinates of the touch operation detected in the process of step S1 (step S208). That is, the position coordinate in the coordinate system of the touch panel 321 is converted into the position coordinate in the coordinate system of the display 311.
Next, in the processing means 35, the position coordinates of the touch operation detected in the process of step S101 (position coordinates after the third coordinate conversion in step S208) are those in the icon display area 3112 of the display 311. If it is determined that there is any (step S209: icon), the process proceeds to step S211. Further, the processing unit 35 determines that the position coordinate indicated by the immediately preceding entry information is that of the icon of the dot pattern paper 2 (step S211: YES), and advances the process to step S212.
The icon processing means 353 determines that the same icon has not yet been generated and displayed (step S212: NO), generates a plurality of icon groups 52, and displays them in the icon display area 3112 of the display 311 as shown in FIG. It is displayed (step S213). As a result, the display process ends.

As described above, according to the third modification of the second embodiment, the dot pattern paper 2 is printed with the all icon generation button 22a for instructing batch generation of one or more entire icons.
When the icon processing unit 353 is tapped on the all icon generation button 22 a with the electronic pen 1, the icon processing unit 353 recognizes the all icon generation button 22 a and is tapped on the DOL 312 with the electronic pen 1 or on the touch panel 321. When the touch operation is performed, one or more icons having the same function as the one or more icons are collectively generated and displayed on the display 311.
Accordingly, the user can perform the same operation as selecting one or more icons by performing a simple operation such as selecting only one all-icon generation button 22a without performing a complicated operation such as selecting each of the one or more icons. Each of the one or more icons having a function can be generated and displayed on the computer device 3 side.

  After all icons are displayed in the icon display area 3112 by the display process, the computer apparatus 3 is set to a mode in which the icons displayed in the icon display area 3112 can be executed. Thereby, by tapping or touching the icon displayed in the icon display area 3112 with the electronic pen 1 or the finger f, the icon instruction processing execution means 354 of the computer device 3 executes the process instructed by the icon. To do.

  As mentioned above, although 1st Embodiment and 2nd Embodiment were described as embodiment of the icon production | generation system of this invention, this invention is not restricted to these two embodiment.

For example, as an icon generated by the icon generation system of the present invention, an example of an icon to which functions related to sentence creation and formatting are assigned has been described as an example. Any variety of functions can be employed accordingly.
Further, the icon generated and displayed by the computer device of the icon generation system of the present invention is not particularly limited to an icon used in a computer GUI (graphical user interface). For example, the computer device can generate an arbitrary symbol as an icon as long as it can be displayed on a display, such as a character such as a game, a code, and a decoration, instead of an icon as a GUI.

  The target using the electronic pen 1 is not limited to the dot pattern paper 2 and may be any writing medium on which an Anoto dot pattern is printed. The coding pattern, entry information, and electronic pen printed on the writing medium need not be limited to the Anoto system.

DESCRIPTION OF SYMBOLS 1 ... Electronic pen 2 ... Dot pattern paper 3 ... Computer apparatus 10, 11 ... Icon production system 31 ... Display means 32 ... Input means 33 ... Storage means 34 ... Receiving means 35 ... Processing means 311 ... Display 312 ... DOL
321 ... Touch panel 351 ... Coordinate conversion means 352 ... Stroke drawing means 353 ... Icon processing means 354 ... Icon instruction processing execution means 355 ... First coordinate conversion means 356 ... Second coordinate conversion means

Claims (5)

A display means in which a display for displaying an image and a sheet on which a coding pattern is printed are laminated;
When an electronic pen touches a predetermined icon among writing media on which one or more icons and a coding pattern are overlaid, the predetermined icon is recognized, and the electronic pen touches the sheet And an icon processing means for generating an icon having the same function as the predetermined icon and displaying the icon on a display. The display of the display means is further laminated with a touch panel,
The icon processing means generates the icon having the same function as the predetermined icon when an object touches or comes close to the touch panel after recognizing the predetermined icon touched by the electronic pen. The computer apparatus according to claim 1, wherein the display is displayed on the display. The writing medium is further printed with a button for instructing batch generation of the entire one or more icons.
The icon processing means recognizes the button when the electronic pen is touched to the button of the writing medium, and the electronic pen is touched to the sheet, or a touch panel is stacked on the display means. When one or more icons having the same function as the one or more icons are collectively generated and displayed on the display when an object touches or comes close to the touch panel when the touch panel is touched. The computer apparatus according to 1 or 2. A display means in which a display for displaying an image and a touch panel are stacked;
Among the writing media on which one or more icons and coding patterns are overlaid and printed, when the electronic pen comes into contact with a predetermined icon, the predetermined icon is recognized, and further, an object comes into contact with or comes close to the touch panel. Then, an icon processing means for generating an icon having the same function as the predetermined icon and displaying the icon on the display is provided. The writing medium is further printed with a button for instructing batch generation of the entire one or more icons.
The icon processing means recognizes the button when the electronic pen is touched to the button of the writing medium, and has the same function as the one or more icons when an object touches or approaches the touch panel. The computer apparatus according to claim 4, wherein each of the one or more icons having a symbol is generated and displayed on the display.

Images