JP2008305216A - Electronic processing system, navigation system, and method of instructing processing by use of reading means - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a user to instruct processing by only writing on paper with a reading means such as an electronic pen and to provide convenience of the reading means such as an electronic pen. <P>SOLUTION: An electronic processing system 1 includes: a processing execution means 65 for executing different kinds of processing in accordance with instructions; a reading means 3 having a function of writing in a plurality of colors; a printed matter 2 on which a pattern 12 readable by the reading means 3 is printed; a selection means 62 for selecting a processing command associated with a color written on the printed matter 2 by the reading means 3, from a table 50 associating colors writable by the reading means 3 with different processing commands; and a processing instruction means 64 for instructing processing of the selected processing command, which uses a locus specified on the basis of the pattern 12 read in writing by the reading means 3, to the processing execution means 65. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an electronic processing system, a navigation system, and a processing instruction method using a reading unit.

  Patent Document 1 discloses a writing system using a pen. In this pen writing system, the pen writing is restricted to only the writable area of the sheet based on the position information of the pen detected by the detecting means and the area data read from the storage device, or only in a predetermined color. Or restrict to writing.

Japanese Patent Laying-Open No. 2005-275519 (summary, claims, etc.)

  Incidentally, electronic processing systems generally perform a wide variety of processes. For example, the navigation system executes processing such as destination selection processing, waypoint selection processing, route designation processing, route search processing, and route guidance processing.

  Therefore, it is considered that the trajectory input using the electronic pen and paper of Patent Document 1 is not only used for inputting a trajectory as in Patent Document 1, but also used for instructing processing in the electronic processing system. It is done. Specifically, for example, it is conceivable to provide a command selection field corresponding to each process on the paper and instruct the process based on the trajectory of the command selection field written by the electronic pen.

  However, such an application example replaces the button operation of the electronic processing system with the operation of the electronic pen, and various commands are selected by button operation as in the past, or a command selection field on the paper. It is necessary to provide.

  That is, for example, when the user wants to select a processing command and set its parameter, the user writes a locus in the command selection field with the electronic pen and sets the parameter by another operation (for example, a locus input operation with the electronic pen). Must. For example, when selecting a destination selection command in a navigation system using an electronic pen and a map, the user writes to select the destination selection command and performs an operation of selecting a destination on the map. Must.

  In addition to this, for example, a command selection field for each processing command must be provided on the sheet. Therefore, on the paper surface corresponding to the processing command selection by the electronic pen, the paper surface design is restricted by the command selection column.

  In addition, for example, when processing is instructed using the command selection field, writing on the paper such as a map is performed separately, so the writing on the paper was written for what processing It is difficult to confirm whether it is a thing after an instruction.

  The present invention provides an electronic processing system, a navigation system, and a navigation system that can instruct processing by simply writing on a paper surface using a reading unit such as an electronic pen, and that can provide convenience by a reading unit such as an electronic pen. It is another object of the present invention to provide a processing instruction method using a reading unit.

  The electronic processing system according to the present invention has a process execution means for executing different processes according to instructions. The electronic processing system further supports a reading unit having a writing function with a plurality of colors, a printed matter on which a pattern readable by the reading unit is printed, and a different processing command for each color writable by the reading unit. A selection unit that selects a processing command associated with the color written on the printed matter by the reading unit from the attached table, and a locus that is specified based on the pattern read when writing by the reading unit is used. Processing instruction means for instructing the processing execution means to perform processing according to the selected processing command.

  The electronic processing system according to the present invention has the following features in addition to the above-described configuration of the invention. That is, the reading unit generates a reading coordinate value indicating the position in the surface of the printed material from the imaging unit that images the surface of the printed material to be written and the pattern specified in each captured image captured by the imaging unit. A coordinate value generating means, a color determining means for determining a writing color based on a captured image captured by the imaging means, a time measuring means for measuring time, and a locus of the reading means generated by the coordinate value generating means. Storage means for storing the measurement time by the time measuring means and the color determined by the color determination means in association with each of the plurality of read coordinate values constituting the storage. Then, the processing instruction unit instructs a plurality of read coordinate values that can be associated with the color used by the selection unit for selecting the processing command and the measurement time, as indicating the locus used for processing by the processing command.

  The electronic processing system according to the present invention has the following characteristics in addition to the components of the above-described invention. That is, in the printed matter, the pattern is printed with ink that absorbs or reflects infrared rays. The imaging means also includes an infrared imaging member that periodically captures an infrared image of a pattern printed on a printed material, and a visible light imaging that captures a line written on the printed material by an electronic pen in a cycle synchronized with the infrared imaging member. Member. Further, the coordinate value generating means generates a read coordinate value using an infrared image captured by the infrared imaging member. Furthermore, the color determination means determines the writing color using the visible light image captured by the visible light imaging member.

  The electronic processing system according to the present invention has the following characteristics in addition to the components of the above-described invention. That is, the electronic processing system further includes an imaging unit that captures an image of the surface of the printed matter that is written by the reading unit, a registration unit that newly registers a new writing color of the reading unit captured by the imaging unit in the table, Have

  The navigation system according to the present invention has processing execution means for executing processing for navigation such as destination selection or route search in response to an instruction by a processing command. The navigation system further includes a reading unit having a writing function with a plurality of colors, a printed matter in which a pattern that can be read by the reading unit is printed on a map, and a different process for each color that can be written by the reading unit. A selection unit that selects a processing command associated with the color written on the printed matter by the reading unit from the table associated with the command, and a pattern that is read when writing by the reading unit is specified. A process instructing unit for instructing the process execution unit to perform a process based on the selected process command.

  The navigation system according to the present invention has the following features in addition to the above-described configuration of the invention. That is, the navigation system further generates one point information from the locus specified based on the pattern read at the time of writing by the reading unit when the processing command for the predetermined point is selected by the selecting unit. Alternatively, when a processing command for a predetermined route is selected by the selection unit, there is a parameter generation unit that generates route information from a locus specified based on a pattern read at the time of writing by the reading unit. Then, the process instructing unit instructs the selected process command by adding the spot information or the route information generated by the parameter generating unit.

  The processing instruction method by the reading means according to the present invention is in an electronic processing system that executes different processes according to instructions. The processing instruction method by the reading unit uses the reading unit having a writing function with a plurality of colors, and when writing is performed on a printed matter on which a pattern readable by the reading unit is printed, A step of selecting a processing command associated with the color written on the printed matter by the reading unit from a table in which a different processing command is associated with each possible color, and a pattern read at the time of writing by the reading unit And a step of instructing a process based on the selected process command.

  In the present invention, the processing command is selected based on the color written on the paper surface by the electronic pen. Therefore, according to the present invention, it is possible to instruct processing simply by writing on the paper surface using a reading unit such as an electronic pen, and it is possible to provide high convenience by the reading unit such as an electronic pen.

  Hereinafter, a processing instruction method using an electronic processing system, a navigation system, and a reading unit according to an embodiment of the present invention will be described with reference to the drawings. In the following description, the electronic processing system and the navigation system will be described using a car navigation system as an example. The processing instruction method by the reading means will be described as an example of a method of instructing processing with an electronic pen in a car navigation system.

  FIG. 1 is a system configuration diagram showing a car navigation system 1 according to an embodiment of the present invention. The car navigation system 1 includes a map book 2 on which a map (readable article) is printed, an electronic pen 3 that writes the map book 2 in a plurality of colors, a navigation main body 4 that can communicate with the electronic pen 3, Have Note that the electronic pen 3 and the navigation main body 4 are connected by a communication cable 5, and transmit and receive data and the like via the communication cable 5.

  FIG. 2 is an explanatory diagram showing the print contents of one sheet 11 of the map book 2 in FIG. As shown in FIG. 2A, a map of a predetermined region is printed on the paper surface 11 of the map book 2 as a printed matter. In the map of FIG. 2A, two facilities “A” and “B” existing in this area, one station, and a plurality of roads are printed. The road is printed with a thickness corresponding to the road width.

  Note that the three dotted lines in FIG. 2A are examples of writing with the electronic pen 3 and are not printed on the map book 2. In the writing example of FIG. 2A, the user uses the electronic pen 3 to write a circle with “color 1 (for example, red)” around the facility “A” and “color 2 ( For example, a circle is written in “blue” and a road in front of the station is written in “color 3 (for example, green)” by a broken line.

  Further, as shown in FIG. 2 (B), each paper page 11 of the map book 2 in FIG. 1 has dots as a pattern composed of a plurality of dots over the entire surface of the paper 11 so as to overlap the lower side of the map. A pattern 12 is printed. The dot pattern 12 is printed on the paper surface 11 with, for example, ink that absorbs infrared rays. As a result, it is possible to prevent a map or the like printed in an overlapping manner from being difficult to read visually. The dot pattern 12 may be printed on the paper surface 11 with, for example, ink that reflects infrared rays.

  Further, the dot pattern 12 can be converted into a coordinate value indicating a position in the paper surface 11 by 6 × 6 dots, for example. This coordinate value is, for example, a two-dimensional coordinate value based on (x, y) with the upper right corner of the paper surface 11 in FIG.

  FIG. 3 is a structural diagram of the electronic pen 3 in FIG. FIG. 4 is a block diagram showing an electrical configuration of the electronic pen 3 of FIG. The electronic pen 3 as a reading unit has a pen-shaped housing 20 as shown in FIG. The electronic pen 3 has a plurality of pen shafts 21 having inks of different colors, an infrared LED (Light Emitting Diode) 22, an infrared camera 23, a visible light camera 24, a communication I / F (in the housing 20). Inter Face) 25, a microcomputer 26 to which these are connected, a battery 27 for supplying power to them, and the like.

  The plurality of pen shafts 21 have, for example, red, blue, and green inks. By rotating the selector 28 exposed on the side surface of the housing 20, one of them is set as the pen tip of the electronic pen 3. The The plurality of pen shafts 21 can be detached from the electronic pen 3 and can be replaced when the ink runs out.

  Further, the microcomputer 26 of the electronic pen 3 includes a timer 31 as a time measuring means for measuring time and elapsed time, a memory 32, a CPU (Central Processing Unit) (not shown), and the like. A memory 32 serving as a storage unit stores various data such as read data 33 and read color data 34. The CPU reads and executes a program (not shown) stored in the memory 32. Thereby, functions such as a coordinate generation unit 35, a color determination unit 36, and a transmission unit 37 are realized in the microcomputer 26 of the electronic pen 3.

  The infrared camera 23 functions as a part of the imaging means and an infrared imaging member. For example, the infrared camera 23 is a CCD (Charge Coupled Device) or CMOS (Complementary Metal-Oxide Semiconductor) sensor that receives infrared rays, and receives infrared pattern data. The data is periodically output to the microcomputer 26.

  The visible light camera 24 functions as a part of the imaging means and a visible light imaging member. For example, the visible light camera 24 is a CCD or CMOS sensor that receives visible light, and periodically outputs a visible light image to the microcomputer 26.

  In particular, in the visible light camera 24 of this embodiment, for example, the imaging timing is managed by a reference clock signal common to the infrared camera 23, and a visible light image is captured at the same constant cycle as the infrared camera 23. That is, the visible light camera 24 and the infrared camera 23 capture images in synchronization with each other. As a result, the infrared image captured by the infrared camera 23 and the visible light image captured by the visible light camera 24 are paired for each period corresponding to one cycle, for example, even if their imaging timings do not completely match. Corresponds to 1.

  The infrared LED 22, the infrared camera 23, and the visible light camera 24 are disposed toward the pen tip of the electronic pen 3. Thereby, the infrared camera 23 of the electronic pen 3 receives the reflected light from the paper surface 11 of the infrared map book 2 irradiated by the infrared LED 22 toward the pen tip, and periodically reads the dot pattern 12 near the pen tip. be able to. The visible light camera 24 images substantially the same place as the infrared camera 23.

  A coordinate generation unit 35 as coordinate value generation means analyzes each pattern data periodically supplied from the infrared camera 23 and generates a read coordinate value encoded in each pattern data. The coordinate generation unit 35 stores the generated read coordinate value in the memory 32 in association with the current time measured by the timer 31. As a result, the read data 33 is stored in the memory 32.

  FIG. 5 is an explanatory diagram showing an example of the data structure of the read data 33 stored in the memory 32 of the electronic pen 3. The read data 33 in FIG. 5 has a plurality of read coordinate values. Further, each reading coordinate value is associated with each reading time and a writing pressure value. Note that the read data 33 in FIG. 5 is written to the destination (facility “facility”) by writing from 1:23:00 (hours: minutes: seconds) to 1:23:45 as indicated by three dotted lines in FIG. A ”), select a transit point (facility“ B ”) by writing 1:23:47 to 1:24:47, and then route by writing 1:27:01 to 1:27:15 This is when (road in front of the station) is selected. Each locus (dotted line) of the electronic pen 3 is converted into data as a plurality of read coordinate values.

  The color determination unit 36 in FIG. 4 functions as a color determination unit that determines the read color written by the electronic pen 3, and determines the difference due to the coloring of the two captured images captured by the visible light camera 24. Based on this, the writing color is determined. That is, when the electronic pen 3 writes on the paper surface 11 of the map book 2, the two captured images that are output from the visible light camera 24 before and after are colored on the paper surface before coloring by the writing is performed. The state and the state of the paper surface after coloring by writing are included. Therefore, by detecting the difference between these two images that are temporally changed, it is possible to specify a portion colored by the electronic pen 3. The color determination unit 36 determines the color of the image portion in which the difference occurs in the subsequent captured image as the writing color.

  Thereafter, the color determination unit 36 stores the determined write color in the memory 32 in association with the current time measured by the timer 31. As a result, the read color data 34 is stored in the memory 32. The full-color read color can be expressed by a combination of values from 0 to 255 for each RGB (Red-Green-Blue) color component.

  FIG. 6 is an explanatory diagram showing an example of the data structure of the read color data 34 stored in the memory 32 of the electronic pen 3. The read color data 34 in FIG. 6 has the same number of read times as the read data 33 in FIG. Each reading time is associated with a reading color. The read color data 34 in FIG. 6 is written in color 1 (for example, red) at 1: 23: 0 to 1:23:45, as indicated by three dotted lines in FIG. Writing is performed with color 2 (for example, blue) in 23:47 to 1:24:47, and writing is performed with color 3 (for example, green) in 1:27:01 to 1:27:15. Each color written by the electronic pen 3 is converted into data as a read color.

  The communication I / F 25 of the electronic pen 3 in FIG. 4 is, for example, a USB (Universal Serial Bus) I / F. The USB I / F transmits / receives data to / from a USB I / F (communication I / F 41 of the navigation body 4 in FIG. 1) of another device connected by a USB cable (a type of the communication cable 5). In addition, the communication I / F 25 may be so-called Bluetooth even if it communicates by being connected to another device by a communication cable 5 such as an E / N (Ethernet (registered trademark)) cable. Communicating with other devices by infrared communication, wireless LAN (Local Area Network), or the like.

  The transmission unit 37 manages communication by the communication I / F 25 of the electronic pen 3. The transmission unit 37 supplies the read data 33 and read color data 34 to be stored in the memory 32 to the communication I / F 25 of the electronic pen 3 for transmission. The communication I / F 25 of the electronic pen 3 transmits these transmission data to the USB I / F of another connected device (the communication I / F 41 of the navigation main body 4 in FIG. 1).

  FIG. 7 is a block diagram showing a detailed configuration of the navigation main body 4 of FIG. The navigation body 4 includes a communication I / F 41, a liquid crystal device 42, an input device 43, a GPS receiving device 44 that receives radio waves from a GPS (Global Positioning System) satellite, a storage device 45, a microcomputer 46 to which these are connected, and the like. Have.

  The microcomputer 46 of the navigation body 4 includes a memory 47, a CPU (not shown), and the like. The memory 47 stores various data such as received data 48, a coordinate conversion table 49, a command conversion table 50 as a table in which processing commands are registered, and command data 51. The CPU reads and executes a program (not shown) stored in the memory 47. As a result, the microcomputer 46 of the navigation body 4 includes a receiving unit 61, a command selecting unit 62, a coordinate converting unit 63, a command instruction unit 64, a navigation control unit 65, a current position generating unit 66, and a UI (User Interface) unit 67. Functions such as are realized.

  The storage device 45 is configured by an HDD (Hard Disk Drive) or the like, and stores various data used for navigation such as a landmark DB (Database) 71, navigation data 72, and guide route data 73.

  The program stored in the memory 32 of the electronic pen 3 and the program stored in the memory 47 of the navigation main body 4 described above may be those stored in the memories 32 and 47 before shipment of these devices. It may be stored in the memories 32 and 47 after the shipment of these devices. Moreover, a part of program memorize | stored in the memories 32 and 47 may be memorize | stored after shipment of these apparatuses. As described above, the program stored in the memories 32 and 47 after shipment is an installation of a program stored in a computer-readable recording medium such as a CD-ROM (Compact Disc Read Only Memory) or a semiconductor memory. Alternatively, it may be downloaded from a server device or the like via a transmission medium such as the Internet.

  The program stored in the memory 47 of the navigation main body 4 and the various data described above are partly or entirely stored in the storage device 45 described above or a memory card or CD-ROM that can be attached to and detached from the navigation main body 4. It may be stored. In particular, the coordinate conversion table 49 and the command conversion table 50 are data closely related to the print contents (readable information) of the map book 2, and therefore are stored in a memory card that can be detached from the navigation main body 4 and together with the map book 2. It may be provided to the user. Thereby, the navigation main body 4 can respond | correspond to several map books 2 (printed matter) by replacing | exchanging and mounting | wearing with the memory card corresponding to each map book 2 grade | etc.,.

  The receiving unit 61 manages communication by the communication I / F 41 of the navigation main body 4. When the communication I / F 41 of the navigation body 4 receives data from the communication I / F 25 of the electronic pen 3, the receiving unit 61 stores the data in the memory 47. As a result, the received data 48 is stored in the memory 47. When the communication I / F 41 of the navigation body 4 receives the read data 33 and the read color data 34 from the communication I / F 25 of the electronic pen 3, the memory 47 has the same contents as the read data 33 and the read color data 34. Received data 48 is stored.

  FIG. 8 is an explanatory diagram showing an example of the data structure of the command conversion table 50 in FIG. The command conversion table 50 in FIG. 8 has information on a plurality of registered colors. The plurality of registered colors include colors that can be written by the electronic pen 3 in FIG. 1, such as “Color 1 (for example, red)”, “Color 2 (for example, blue)”, and “Color 3 (for example, green)”. include. Note that the command conversion table 50 may include only colors that can be written by the electronic pen 3 in FIG.

  In the command conversion table 50, each registered color is associated with one processing command. In the example of FIG. 8, the destination color setting command is associated with the registered color “color 1”, the route setting command is associated with the registered color “color 2”, and the route designation is performed for the registered color “color 3”. The command is associated, the registration color “color 4” is associated with the point registration command, and the registration color “color 5” is associated with the departure place setting command.

  As shown in parentheses in FIG. 8, parameters can be set for these processing commands. For example, the destination setting command can set the latitude and longitude values of the destination as parameters, the route setting command can set the latitude and longitude values of the waypoints as parameters, and the point registration command The latitude / longitude value of the registration point can be set as a parameter, and the latitude / longitude value of the departure point can be set as a parameter in the departure place setting command. In the route designation command, a plurality of latitude / longitude values as trajectories of the route through which the route passes can be set as parameters.

  The command selection unit 62 in FIG. 7 functions as a selection unit. When reception data 48 as read color data 34 is stored in the memory 47, the command selection table 62 is referred to and the reception data 48 is received. 48, a processing command corresponding to each reading color is selected. The command selection unit 62 stores the selected processing command in the memory 47. As a result, the command data 51 is stored in the memory 47.

  FIG. 9 is an explanatory diagram showing an example of the data structure of the coordinate conversion table 49 in FIG. The coordinate conversion table 49 in FIG. 9 has a plurality of coordinate values in the map book 2 such as FIG. Each coordinate value is associated with a latitude / longitude value of a point in the map printed over the dot pattern 12 in the map book 2. For example, coordinate values (x111, y111) are associated with latitude and longitude values (E (east longitude) 111 (degrees), N (north latitude) 111 (degrees)). That is, the latitude / longitude value associated with each coordinate value in the coordinate conversion table 49 is a point in the map where the coordinate value overlaps with the encoded dot pattern 12 in the map book 2, and these are consistent. ing.

  When the received data 48 as the read data 33 is stored in the memory 47, the coordinate conversion unit 63 in FIG. 7 refers to the coordinate conversion table 49 and converts a plurality of read coordinate values in the received data 48 to the latitude. Convert to longitude value. The coordinate conversion unit 63 adds the latitude / longitude value obtained by the conversion to the command data 51 stored in the memory 47. As a result, processing commands having parameters are stored in the memory 47 as command data 51.

  The coordinate conversion unit 63 converts each of a plurality of read coordinate values into latitude and longitude values, or one read coordinate value obtained from the plurality of read coordinate values (for example, a read coordinate value such as an average value or a representative value). Is converted into a latitude and longitude value. Specifically, for example, when a processing command that can be set using a latitude / longitude value of one point as a parameter, such as a destination setting command, is selected, the coordinate conversion unit 63 selects one read coordinate value from a plurality of read coordinate values. The one read coordinate value is converted into a latitude / longitude value. In addition to this, for example, when a processing command such as a route designation command that can set latitude and longitude values at a plurality of points as a parameter is selected, the coordinate conversion unit 63 converts each read coordinate value into a latitude and longitude value.

  The command instruction unit 64 as processing instruction means reads the command data 51 from the memory 47 and instructs the navigation control unit 65 to perform processing based on the read command data 51.

  The navigation control unit 65 as a process execution unit controls the operation of the navigation main body 4. The navigation body 4 has functions such as a point selection function for selecting a destination, a route value, etc., a route search function for searching for a route using the selected point, and a route guidance function for executing guidance based on the searched route. The navigation control unit 65 executes processing of each function based on a processing command instructing execution of these functions.

  The landmark DB 71 is used in point selection processing by the navigation control unit 65 and has information on a plurality of landmarks such as facilities. This information includes a latitude / longitude value indicating the location of each landmark, an address, a telephone number, a facility name, a facility opening time, and the like.

  The navigation data 72 is used in route search processing and route guidance processing by the navigation control unit 65, and includes, for example, map display data, a plurality of node data, a plurality of link data, and the like. The map display data is data for displaying a map on the liquid crystal device 42, and is, for example, image data of a map printed on the map book 2. The node data is data of intersections and corner points, and has attribute information such as names of points and latitude / longitude values. The link data is data associated with a road section connecting the intersections, and includes attribute information such as information on a plurality of nodes to which the intersections are connected and road names.

  The guide route data 73 is generated by a route search process by the navigation control unit 65 and is used in the route guide process. .

  The current position generation unit 66 generates a latitude / longitude value of the current position of the vehicle based on the radio wave received by the GPS receiving device 44 and supplies the latitude / longitude value to the navigation control unit 65. The navigation control unit 65 uses the latitude and longitude values of the current position of the vehicle in a route guidance function or the like. When the navigation body 4 has a function of receiving a gyro sensor or a D (Differential) -FM FM (Frequency Modulation) radio wave or the like, the current position generation unit 66 uses a vehicle based on information obtained by these functions. The latitude and longitude values of the current position may be generated, or the latitude and longitude values generated based on the GPS receiving device 44 may be corrected based on these functions.

  The UI unit 67 manages the user interface of the navigation body 4. The navigation main body 4 has user interfaces such as a liquid crystal device 42 and an input device 43. Note that the input device 43 may be a touch panel or the like disposed so as to overlap the liquid crystal device 42, for example. Then, the UI unit 67 selects a processing command, data, and the like based on a user operation on the input device 43 and supplies the selected processing command or data to the navigation control unit 65. The navigation control unit 65 executes various processes based on these process commands and data. The UI unit 67 causes the liquid crystal device 42 to display an image based on the display data supplied from the navigation control unit 65.

  Next, the operation of the car navigation system 1 having the above configuration will be described. In the following description, an example of a route search operation when the user performs writing indicated by the three dotted lines in FIG. 2 using the electronic pen 3 in a state where the electronic pen 3 and the navigation body 4 are connected by the communication cable 5. Explained.

  When the user connects the electronic pen 3 and the navigation main body 4 with the communication cable 5, the communication I / F 25 of the electronic pen 3 and the communication I / F 41 of the navigation main body 4 can communicate with each other.

  Further, when the writing operation indicated by the three dotted lines in FIG. 2 is performed by the electronic pen 3, the infrared camera 23 of the electronic pen 3 receives the infrared light reflected by the sheet, and transmits the infrared pattern data at a predetermined constant cycle. To output. Infrared rays are absorbed by the dot pattern 12 printed on the sheet. The coordinate generation unit 35 analyzes the dot pattern 12 supplied from the infrared camera 23 at a predetermined constant cycle, and generates a read coordinate value. Further, the coordinate generation unit 35 associates the generated read coordinate value with the current time measured by the timer 31 and stores it in the memory 32. As a result, the read data 33 shown in FIG.

  Further, the visible light camera 24 of the electronic pen 3 outputs a visible light image at a constant period synchronized with the infrared camera 23. In the visible light image before writing by the electronic pen 3 and the visible light image after writing by the electronic pen 3, the color of the portion written by the electronic pen 3 changes. The color determination unit 36 compares two adjacent visible light images and determines the color information of the mismatched portion as a read color based on the difference between the two captured images. Further, the color determination unit 36 associates the generated read color with the read time stored in the memory 32 together with the read coordinate value by the coordinate generation unit 35 and stores the color in the memory 32. As a result, the read color data 34 shown in FIG.

  FIG. 10 is an explanatory diagram showing the difference between the read coordinate value storage timing by the coordinate generation unit 35 and the read color storage timing by the color determination unit 36. In FIG. 10, time flows from left to right. FIG. 10A shows the time measured by the timer, and FIG. 10B shows a plurality of infrared images output by the infrared camera 23 at a predetermined constant cycle arranged on the time axis. FIG. 10C shows reading coordinate value storage processing by the coordinate conversion unit 35 arranged on the time axis. FIG. 10D shows reading color storage processing by the color determination unit 36 arranged on the time axis. FIG. 10E shows a plurality of visible light images output by the visible light camera 24 at a predetermined constant period arranged on the time axis.

  Then, as shown in FIGS. 10A to 10C, the coordinate generation unit 35 generates read coordinate values based on the infrared image during the timing T2, based on the infrared image captured at the timing T1, Save in the memory 32. On the other hand, as shown in FIGS. 10D and 10E, the color determination unit 36, after the visible light image captured at the timing T1 and the visible light image captured at the timing T2 are aligned, During timing T 3, the read color based on the two visible light images is determined and stored in the memory 32.

  As described above, the read coordinate value and the read color based on the writing of the electronic pen 3 at the timing T1 are generated at different timings. Therefore, the color determination unit 36 of this embodiment stores the generated reading color in association with the reading time stored in the memory 32 by the coordinate generation unit 35. Through such association processing, each read coordinate value in the read data 33 in FIG. 5 is appropriately associated with each read color in the read color data 34 in FIG. 6 according to the read time.

  When new read data 33 and read color data 34 are stored in the memory 32, the transmission unit 37 of the electronic pen 3 reads these data and supplies them to the communication I / F 25 as transmission data. The communication I / F 25 of the electronic pen 3 transmits the supplied transmission data to the communication I / F 41 of the navigation body 4 via the communication cable 5. The receiving unit 61 of the navigation body 4 acquires the data received by the communication I / F 41 and stores it in the memory 47. As a result, the same data as the read data 33 and the read color data 34 generated by the electronic pen 3 is stored as received data 48 in the memory 47 of the navigation body 4.

  FIG. 11 is a flowchart showing the flow of conversion processing executed when the navigation main body 4 of FIG. 7 receives the read data 33 and the read color data 34. The command selection unit 62 reads the unprocessed head reading color from the reading color data 34 stored in the memory 47 (step ST1). Further, the command selection unit 62 compares the read reading color with the command conversion table 50, and selects a processing command associated with the reading color in the command conversion table 50 (step ST2). For example, in the case of the read color data 34 in FIG. 6, the command selection unit 62 first reads “Color 1”. Therefore, the command selection unit 62 selects a destination setting command based on the command conversion table 50 in FIG. 8 (step ST3). Further, the command selection unit 62 stores the selected processing command in the memory 47 as the command data 51 (step ST4).

  When the selection processing of one processing command by the command selection unit 62 is completed, the coordinate conversion unit 63 performs a plurality of operations corresponding to the time range of the read color read by the command selection unit 62 from the read data 33 stored in the memory 47. Are read (step ST5). Then, the coordinate conversion unit 63 converts the trajectory of the electronic pen 3 based on the read plurality of read coordinate values into point information or route information according to the selected processing command (step ST6).

  Specifically, for example, when a command for a predetermined point is selected by the command selection unit 62 (for example, a destination setting command, a waypoint setting command, a point registration command, a departure point setting command, etc. in FIG. 8). The coordinate conversion unit 63 converts the locus of the electronic pen 3 based on the read plurality of read coordinate values into point information. That is, when writing is made around the facility A in FIG. 2A, the coordinate conversion unit 63 calculates an average value and a representative value of a plurality of read coordinate values read at the time of writing, and further coordinates. With reference to the conversion table 49, one coordinate value is converted into a latitude and longitude value.

  In addition to this, for example, when a processing command for a predetermined route (for example, a route designation command in FIG. 8) is selected by the command selection unit 62, the coordinate conversion unit 63 displays a plurality of read coordinate values. Convert to route information. That is, in FIG. 2A, when writing is performed on the road in front of the station by a broken line, the coordinate conversion unit 63 refers to the coordinate conversion table 49 and sets a plurality of read coordinate values read at the time of writing to 1 Convert to latitude and longitude values one by one.

  When the coordinate conversion unit 63 converts the trajectory of the electronic pen 3 based on a plurality of read coordinate values into point information or route information in accordance with the processing command selected by the command selection unit 62, the coordinate conversion unit 63 stores the information in the memory 47 based on the information. The command data 51 being updated is updated (step ST7). As a result, processing commands having parameters are stored in the memory 47 as command data 51. For example, by writing to the periphery of the facility A in FIG. 2A, the destination setting command having the latitude and longitude values of the facility A as parameters is stored in the memory 47 as the command data 51.

  When the command data 51 is updated by the coordinate conversion unit 63, the command instruction unit 64 reads the command data 51 stored in the memory 47, and instructs the navigation control unit 65 to perform processing based on the read command data 51. (Step ST8). For example, when the destination setting command having the latitude and longitude values of the facility A as parameters is stored in the memory 47, the command instruction unit 64 instructs the navigation control unit 65 to set the point as the destination.

  The navigation control unit 65 executes the processing when the command instruction unit 64 instructs processing by the processing command. For example, when a processing command for setting the facility A as the destination is instructed, the facility A is set as the destination. Subsequently, the navigation control unit 65 searches for a guidance route from the current position to the facility A using the navigation data 72. The navigation control unit 65 stores the guide route generated by the search in the storage device 45. As a result, the guide route data 73 is stored in the storage device 45. In addition, the navigation control unit 65 generates display data for displaying the searched guide route so as to overlap the map, and supplies the generated display data to the UI unit 67. The UI unit 67 displays an image based on the display data on the liquid crystal device 42.

  While the processing based on the processing command is executed by the navigation control unit 65 in this manner, as shown in FIG. 11, after the processing instruction to the navigation control unit 65 is given by the command instruction unit 64, the command selection unit 62 Then, it is determined whether or not unprocessed read color data 34 remains. When the unprocessed read color data 34 does not remain, the command selection unit 62 ends the process.

  On the other hand, when a plurality of read colors are read as in the read color data 34 of FIG. 6, the command selection unit 62 reads the unprocessed head read color from the read color data 34, and this read color. Is selected and stored in the memory 47. Further, the coordinate conversion unit 63 reads a plurality of read coordinate values corresponding to the time range of the read color read by the command selection unit 62 from the read data 33, converts the read coordinate values into point information or route information, and the memory 47. Save to. As a result, new command data 51 is stored in the memory 47. The command instructing unit 64 reads the command data 51 stored in the memory 47 and instructs the navigation control unit 65 to process it. When a new processing command is instructed, the navigation control unit 65 executes the processing.

  In the case of the read color data 34 in FIG. 6, the process command generation process for each read color is repeated three times. After generating three processing commands and instructing the execution thereof, the command selection unit 62 determines that there is no unprocessed data in step ST9 of FIG. 11, and ends the processing.

  Meanwhile, the navigation control unit 65 uses the destination setting command for setting the facility A in FIG. 2A as a destination, the waypoint setting command for setting the facility B as a waypoint, and the road in front of the station as a passing route. The routing command to be set is instructed in order. The navigation control unit 65 updates the guide route searched based on the destination setting command when the route setting command is instructed, and updates based on the route setting command when the route designation command is instructed. Update the guide route. The storage device 45 stores guide route data 73 indicating guide routes searched based on three processing commands.

  12 is a diagram showing an example of a guide route display screen displayed on the liquid crystal device 42 in FIG. In FIG. 12, the guide route is represented by a thick solid line. This guidance route is searched based on the read data 33 in FIG. 5 and the read color data 34 in FIG. 6. From the current position in the lower left of the screen, the facility B in the center of the screen and the street in front of the station on the right end of the screen are displayed. The route is searched as a route to the facility A in the upper right of the screen.

  When the facility B at the center of the screen and the station square at the right end of the screen are not designated as transit points, the guide route is, for example, a route as shown by a thick dotted line in FIG. That is, a route from the current position to the facility A via the main road in the center of the screen is searched.

  As described above, according to this embodiment, the locus written in the map by the electronic pen 3 is converted into a plurality of processing commands different for each writing color. That is, in the car navigation system 1 of this embodiment, the writing locus can be used for a plurality of processes only by writing to the map book 2 with the electronic pen 3.

  The coordinate conversion unit 63 generates parameters such as point information or route information from the writing locus of the electronic pen 3, and the parameters are instructed to the navigation control unit 65 together with the processing command. Therefore, the user can collectively input a predetermined processing command and its parameters only by selecting the writing color of the electronic pen 3 and writing.

  Moreover, the locus for each process is written in different colors on the paper surface 11 of the map book 2 by writing with the electronic pen 3. Therefore, the user can easily confirm after the instruction what processing is instructed by each locus based on the color-coded writing. On the other hand, when writing on the paper surface 11 of the map book 2 in a single color, a plurality of trajectories are distinguished, and what processing is performed on each trajectory remaining on the paper surface 11 of the map book 2. It is difficult to determine whether the instruction is instructed. Therefore, in writing in a single color, it is difficult to confirm the instruction content after the instruction.

  Furthermore, for example, in the car navigation system 1 of this embodiment, the processing command is selected by the color written in the map by the electronic pen 3. Therefore, it is not necessary to provide a command selection field for each processing command on the paper surface 11 of the map book 2. The paper selection of the map book 2 is not restricted by the command selection column.

  As described above, in the car navigation system 1 according to this embodiment, the processing can be instructed simply by writing on the paper surface 11 of the map book 2 with the electronic pen 3, and, for example, a button for inputting a processing command. Convenience that cannot be obtained simply by exchanging the operation with the writing operation using the electronic pen 3 can be provided.

  Unlike this embodiment, for example, a sheet having a command selection field separate from the map book 2 is used to enable selection of processing commands without restricting the paper surface design of the map book 2. Is also possible. However, a sheet separate from the map book 2 is likely to be lost, and it is expected that it will be difficult to read due to repeated writing in the command selection field, or it may become impossible to read. The On the other hand, when processing commands are selected by color coding for writing as in this embodiment, there is a low possibility that such a situation such as loss or reading failure will occur.

  Further, in this embodiment, the dot pattern 12 is printed on the map book 2 by ink that absorbs infrared rays or ink that reflects. Therefore, the dot pattern 12 of the map book 2 can be made inconspicuous in the map book 2 while enabling the image pickup with the electronic pen 3. For example, a map printed on the map book 2 so as to overlap the dot pattern 12 does not become difficult to read. Further, when a predetermined visible color is written on the inconspicuous pattern by the electronic pen 3, the written color can be appropriately determined.

  Moreover, the infrared camera 23 and the visible light camera 24 capture an image with a period synchronized with each other. Therefore, these captured images can be associated with one to one. Further, the same measurement time is associated with the read coordinate value and the determination color generated based on these captured images. Therefore, for example, the timing at which the coordinate generation unit 35 generates each read coordinate value based on each infrared image is different from the timing at which the color determination unit 36 determines a color based on each set of visible light images. Nevertheless, the correspondence between the read coordinate value and the determination color is appropriately maintained depending on the measurement time. As a result, the processing command generated in the navigation body 4 and its parameters are an appropriate combination. For example, when a plurality of processing commands are continuously input while changing the color of the electronic pen 3, the read coordinate value of the first locus is used as belonging to the locus of the second processing command. There is no.

  As a result, even if trajectories for a plurality of processing commands are continuously input with different colors, the trajectories for each color are appropriately distinguished and each trajectory is processed according to each color. Appropriately. The car navigation system 1 supports continuous writing of a plurality of trajectories with the electronic pen 3 and can appropriately generate parameters based on the trajectories of the processing commands.

  In addition, the coordinate conversion unit 63 of this embodiment has a writing locus (a plurality of read coordinates) of the electronic pen 3 when a processing command (for example, a destination setting command) for a predetermined point is selected by the command selection unit 62. 1 point information is generated from the value), and when a processing command (for example, a route setting command) for a predetermined route is selected by the command selection unit 62, the writing locus (a plurality of read coordinate values) of the electronic pen 3 is selected. Generate route information. Then, the point information or the route information is instructed as a parameter of the selected processing command.

  Therefore, the navigation control unit 65 only needs to interpret a predetermined processing command and its parameters and execute the processing. For example, a conventional navigation control unit 65 interprets the processing command and its parameters from the input device 43 and executes the processing. Things can be used almost as they are. The car navigation system 1 of this embodiment can be easily realized by simply adding a processing instruction unit or the like to the conventional navigation system. In order to realize the car navigation system 1 of this embodiment, it is not necessary to recreate the basic part of the navigation function such as the navigation control unit 65 from scratch.

  The above embodiment is an example of a preferred embodiment of the present invention, but the present invention is not limited to this, and various modifications and changes can be made without departing from the scope of the invention. is there.

  In the above embodiment, in the electronic pen 3, each reading coordinate value is associated with a reading time measured by the timer 31. In addition, for example, each read coordinate value may be associated with an identification number that is incremented (or decremented) each time it is generated. In the case of this modification, the coordinate generation unit 35 supplies the identification number associated with the read coordinate value to the color determination unit 36 instead of the reading time, and the color determination unit 36 applies the identification number to each read color. The supplied identification number may be associated.

  In the above embodiment, the color determination unit 36 determines the read color based on the image captured by the visible light camera 24. In addition, for example, the electronic pen 3 is provided with a detection member that detects the rotation position (post-rotation posture) of the selector 28, and the color determination unit 36 determines one read color based on the detection. May be.

  In the above embodiment, in the command conversion table 50, the correspondence between each processing command and the registered color is fixed. In addition, for example, the registered color corresponding to each processing command in the command conversion table 50 may be changeable. In particular, when the pen shaft 21 of the electronic pen 3 is replaced, it is preferable that the registered color corresponding to each processing command can be changed in the command conversion table 50.

  Specifically, for example, when the command selection unit 62 cannot select a registered color that matches the read color from the command conversion table 50, the coordinate conversion unit 63 as a registration unit recognizes characters with respect to the locus of the electronic pen 3. When the processing is executed and a predetermined command character (for example, a character such as “Destination Setting Command”) is recognized, the processing command of the recognized character and the read color may be registered in the command conversion table 50 in association with each other.

  In addition to this, for example, the color determination unit 36 of the electronic pen 3 stores a reading color determination history, and when a new reading color not in the history is determined, the reading color is registered in association with a predetermined command. A registration instruction may be generated, and the coordinate conversion unit 63 as a registration unit may register it in the command conversion table 50.

  In these variations, the user can write in any desired color. Further, even if the user replaces the ink of the electronic pen 3, the user can write in the ink color after the replacement. For example, it is not necessary to use the electronic pen 3 because it is out of ink or to purchase a dedicated ink for the electronic pen 3.

  In the above embodiment, the command instructing unit 64 of the navigation main body 4 instructs the navigation control unit 65 one by one on the processing commands generated in order according to the flowchart of FIG. In addition to this, for example, the command instructing unit 64 may collectively instruct the navigation control unit 65 of a plurality of generated processing commands after the processing in the flowchart of FIG.

  In the above embodiment, the map and the dot pattern 12 are printed on the map book 2. In addition to this, for example, the map and the dot pattern 12 may be printed on a printed material such as a sheet such as a tourist information flyer. The sheet may be formed of, for example, a vinyl resin or a plastic material other than paper. In addition, on the surface of the printed matter, a readable article such as a sightseeing guide or a photograph may be printed on the dot pattern 12 or only the dot pattern 12 may be printed.

  In the above embodiment, the coordinate value indicating the position in the paper surface 11 is encoded in the dot pattern 12. In addition to this, for example, the coordinate value indicating the position in the paper surface 11 may be coded in a pattern such as a QR (Quick Response) code or a barcode. Further, in these patterns that can be read by the electronic pen 3, coordinate values in one coordinate system common to the plurality of paper surfaces 11 may be coded.

  In the above embodiment, the dot pattern 12 printed on the map book 2 is read by the electronic pen 3. In addition to this, for example, the pattern printed on the map book 2 may be read by reading means such as a mobile phone terminal with a camera or a portable information terminal.

  In the above embodiment, the read data 33 and the read color data 34 generated by writing with the electronic pen 3 are used in the navigation body 4 to execute various processes. In addition, for example, the read data 33 and the read color data 34 generated by writing with the electronic pen 3 are a mobile phone terminal, a portable information terminal, a personal computer, an AV (Audio Visual) device, a portable player, a robot device, a card. An electronic device such as a game device may be used to execute various processes. Note that these electronic devices such as a mobile phone terminal, a portable information terminal, and a personal computer may have a navigation function or a function other than navigation.

  For example, a mobile phone terminal has a call function, a content download function, and the like. The personal computer has functions realized by various application programs. AV equipment and portable players have a tuning function, a recording function, and the like depending on the model. Robot equipment has a traveling function, a music playback function, and the like. The card game machine has a function for each card. It is possible to associate a processing command for executing these functions with a reading color and set a parameter of the processing command based on the locus of the electronic pen 3.

  The present invention can be suitably used for instructing processing such as destination setting in a car navigation system or the like.

FIG. 1 is a system configuration diagram showing a car navigation system according to an embodiment of the present invention. FIG. 2 is an explanatory diagram showing the printed contents of the map book in FIG. FIG. 3 is an internal structure diagram of the electronic pen in FIG. FIG. 4 is a block diagram showing an electrical configuration of the electronic pen shown in FIG. FIG. 5 is an explanatory diagram showing an example of the data structure of the read data in FIG. FIG. 6 is an explanatory diagram showing an example of the data structure of the read color data in FIG. FIG. 7 is a block diagram showing a configuration of the navigation main body of FIG. FIG. 8 is an explanatory diagram showing an example of the data structure of the command conversion table in FIG. FIG. 9 is an explanatory diagram showing an example of the data structure of the coordinate conversion table in FIG. FIG. 10 is a timing chart for explaining various data timings in the electronic pen shown in FIG. FIG. 11 is a flowchart showing the flow of conversion processing by the navigation body of FIG. 12 is a diagram showing an example of a guide route display screen displayed on the liquid crystal device in FIG.

Explanation of symbols

1 Car navigation system (electronic processing system, navigation system)
2 Map book (printed matter)
3 Electronic pen (reading means)
12 dot pattern (pattern)
23 Infrared camera (part of imaging means, infrared imaging member)
24 Visible light camera (part of imaging means, visible light imaging member)
31 Timer (clocking means)
32 memory (storage means)
35 Coordinate generator (coordinate value generator)
36 color determination unit (color determination means)
50 Command conversion table (table)
62 Command selection part (selection means)
63 Coordinate converter (registration means)
64 Command instruction section (processing instruction means)
65 Navigation control unit (processing execution means)

Claims (7)

In an electronic processing system having processing execution means for executing different processing according to an instruction,
Reading means having a writing function of a plurality of colors;
A printed matter on which a pattern readable by the reading means is printed;
A selection means for selecting a processing command associated with a color written on the printed matter by the reading means from a table in which a different processing command is associated with each color writable by the reading means;
A process instructing unit for instructing the process execution unit to perform a process according to the selected process command, using a locus specified based on the pattern read at the time of writing by the reading unit;
An electronic processing system comprising: The reading means includes
Imaging means for imaging the surface of the printed matter on which writing is performed;
Coordinate value generating means for generating a read coordinate value indicating a position in the surface of the printed matter from the pattern specified in each captured image captured by the imaging means;
Color determination means for determining a writing color based on a captured image captured by the imaging means;
A time measuring means for measuring time;
Each of a plurality of read coordinate values generated by the coordinate value generating means and constituting a trajectory of the reading means is associated with the time measured by the time measuring means and the color determined by the color determining means. Storage means,
The processing instruction unit instructs a plurality of read coordinate values that can be associated with the color used by the selection unit for selecting a processing command and the measurement time, as indicating a locus used for processing by the processing command. ,
The electronic processing system according to claim 1. In the printed matter, the pattern is printed with ink that absorbs or reflects infrared rays,
The imaging means images an infrared imaging member that periodically captures an infrared image of a pattern printed on the printed material, and a line written on the printed material by the electronic pen at a cycle synchronized with the infrared imaging member. A visible light imaging member,
The coordinate value generating means generates a read coordinate value using an infrared image captured by the infrared imaging member, and
The color determination means determines a writing color using an image of visible light captured by the visible light imaging member;
The electronic processing system according to claim 2. Imaging means for imaging the surface of the printed matter to be written by the reading means;
Registration means for newly registering a new writing color of the reading means imaged by the imaging means in the table;
The electronic processing system according to claim 1, further comprising: In a navigation system having processing execution means for executing processing for navigation such as destination selection or route search according to an instruction by a processing command,
Reading means having a writing function of a plurality of colors;
A printed matter in which a pattern readable by the reading means is printed on a map;
A selection means for selecting a processing command associated with a color written on the printed matter by the reading means from a table in which a different processing command is associated with each color writable by the reading means;
A process instructing unit for instructing the process execution unit to perform a process according to the selected process command, using a locus specified based on the pattern read at the time of writing by the reading unit;
A navigation system comprising: When a processing command for a predetermined point is selected by the selection unit, one point information is generated from a trajectory specified based on the pattern read at the time of writing by the reading unit, or the selection is performed When a processing command for a predetermined route is selected by the means, parameter generating means for generating route information from a locus specified based on the pattern read at the time of writing by the reading means,
The process instruction means adds the point information or the route information generated by the parameter generation means to the selected process command and instructs the process command;
The navigation system according to claim 5. A processing instruction method by a reading means in an electronic processing system that executes different processes according to instructions,
When a reading unit having a writing function with a plurality of colors is used and writing is performed on a printed matter on which a pattern readable by the reading unit is printed, a different processing command is supported for each color writable by the reading unit. Selecting a processing command associated with the color written on the printed matter by the reading means from the attached table;
A process using a locus specified based on the pattern read at the time of writing by the reading means, and instructing a process by the selected processing command;
A method for instructing processing by reading means.

Images