JP6375903B2 - Entry information display device, entry information display method and program - Google Patents

Description

  The present invention relates to an entry information display device for displaying entry information entered in an entry book having a plurality of pages.

Conventionally, the contents of an experiment are entered in an entry book such as an experiment notebook. As the entry book, for example, a dedicated paper dedicated to an electronic pen that digitizes entry information can be used. “Anotopen (Anoto Pen) developed by Swedish company Anoto as a representative electronic pen.
pen) ". As described in Patent Document 1, the anotopen reads a predetermined dot pattern printed on a sheet to generate entry information, and transmits the entry information to a computer.

Japanese Patent No. 3842283

  By the way, in the experiment notebook, it is common to divide and fill in pages for each date on which the experiment was conducted. Therefore, when the entry information entered in the experiment notebook with the electronic pen is displayed on the computer, it is usually sufficient to display the information one page at a time.

  However, when filling a large diagram or the like, it may be written across two pages of spread. In such a case, it is desirable to perform a multi-page display in which a plurality of pages are displayed side by side at the same time.

  The present invention has been made in view of the above-described problems, and its purpose is to provide an entry information display device and the like capable of automatically displaying a plurality of pages as necessary. is there.

  A first invention for achieving the above-mentioned object is an entry information display device for displaying entry information to be entered in an entry book having a plurality of pages, and acquiring the entry time and entry page of the entry information. An entry information display device comprising: means; and display control means for switching between single page display and multiple page display with reference to the entry time point. According to the first invention, a plurality of pages can be automatically displayed as necessary.

  The display control means according to the first aspect of the invention is preferably controlled so as to display the plurality of pages when the entry information including the entry time points included in the same unit period exists on a plurality of pages. As a result, as in the case of an experiment note, although the pages are usually entered separately for each date, even if a large diagram or the like may be entered across two spread pages, an appropriate single page can be used. Switching between display and multi-page display is possible.

  For example, the acquisition means in the first invention acquires the entry time received from the electronic pen used for entering the entry information as the entry time for each entry information. As a result, the entry time can be accurately obtained.

  For example, the acquisition means according to the first aspect of the present invention recognizes at least one date written on each page by a character recognition process, and acquires it as the entry time for each piece of entry information included in the same page. Thus, the present invention can be applied even when an electronic pen without a real time clock is used or when an electronic pen is not used.

  The second invention is an entry information display method in which a computer displays entry information entered in an entry book having a plurality of pages, and the control unit of the computer acquires the entry time and entry page of the entry information. And a display control step of switching between single page display and multi-page display with reference to the entry time point. This makes it possible to automatically display a plurality of pages as necessary.

  A third invention is a program for causing a computer to function as an entry information display device for displaying entry information entered in an entry book having a plurality of pages, the entry point of the entry information and entry of the entry information. This is a program for functioning as acquisition means for acquiring pages and display control means for switching between single page display and multiple page display with reference to the entry time point. The entry information display device of the first invention can be obtained by installing the program of the third invention on a general-purpose computer.

  According to the present invention, it is possible to provide an entry information display device that can automatically display a plurality of pages as necessary.

Diagram showing the outline of the entry information display system The figure which shows the relationship between the dot of the dot pattern and the value which the dot is converted (A) schematically shows a dot pattern, and (b) is a diagram showing an example of information corresponding thereto. Schematic showing the structure of the electronic pen 1 Hardware configuration diagram of entry information display device 3 The figure which shows an example of the data structure of coordinate definition information Flow chart showing the upload process Flow chart showing display control processing Diagram showing an example of single page display Diagram showing an example of multi-page display Figure showing another example of multi-page display

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The present invention is suitable when an entry book described later is used as an experiment notebook, but is not limited thereto. If the present invention is applied to the above-described problems, the same effects as those applied to an experimental notebook can be obtained.

  FIG. 1 is a diagram showing an outline of an entry information display system. As shown in FIG. 1, the entry information display system includes an electronic pen 1, an entry book 2, and an entry information display device 3.

  The entry book 2 has a plurality of pages. A dot pattern (coded pattern) in a different coordinate range is printed on each page of the entry book 2. The dot pattern is printed with ink containing carbon that absorbs infrared rays so that it can be read by the electronic pen 1, and other characters and drawings are printed with ink that does not absorb infrared rays. The electronic data of the entry book 2 is stored by the entry information display device 3. An image showing each page of the entry book 2 is displayed by the entry information display device 3.

  FIG. 2 is a diagram illustrating a relationship between dots of a dot pattern and values to which the dots are converted. FIG. 2 shows an Anoto dot pattern (coding pattern). As shown in FIG. 2, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the virtual grid (the intersection of the vertical and horizontal lines). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on each page of the entry book 2 are determined by the combination of the information thus associated.

  A dot pattern is formed between the pages of the entry book 2 so that the coordinate areas do not overlap. That is, each dot pattern can identify not only the position coordinates within the same page (for example, where the dot pattern is on each page of the entry book 2) but also the page number.

  FIG. 3A schematically illustrates a dot pattern, and FIG. 3B illustrates an example of information corresponding to the dot pattern. As shown in FIG. 3 (a), 6 × 6 dots are arranged in a range of about 2 cm in length and width so that a 6 × 6 dot from any part of the entry book 2 has a unique pattern. Yes. The dot pattern formed by these 36 dots holds information on page numbers and position coordinates in each page. FIG. 3B is a diagram in which values are converted based on the regularity shown in FIG. This conversion is performed by the electronic pen 1 that captures an image of a dot pattern.

  FIG. 4 is a schematic diagram showing the structure of the electronic pen 1. As shown in FIG. 4, the electronic pen 1 includes an ink cartridge 104, an LED 105, a CMOS camera 106, a pressure sensor 107, a CPU (Central Processing Unit), etc. A memory 109 such as a RAM, a real-time clock 110, a communication unit 111 including an antenna and the like, and a battery 112 are provided. The tip of the ink cartridge 104 is a pen tip portion 103, and the user touches each page of the entry book 2 with the pen tip portion 103 of the electronic pen 1 to enter a stroke (handwritten stroke). Here, the first contact of the pen tip portion 103 of the electronic pen 1 with each page or the like of the entry book 2 is referred to as “pen down”, and the pen tip portion 103 moves away from the contact (contact) state. This is called “pen-up”. A trajectory written between the pen-down and pen-up of the electronic pen 1 is one stroke, and characters, figures, etc. are composed of one or a plurality of strokes.

  The battery 112 is for supplying electric power to each component in the electronic pen 1. For example, the power of the electronic pen 1 itself is turned on / off by detaching a cap (not shown) of the electronic pen 1. It may be configured. The real time clock 110 transmits time information indicating the entry time (time stamp) and supplies the time information to the processor 108. The pressure sensor 107 detects the pressure applied through the ink cartridge 104 from the pen tip portion 103 when the user writes characters or marks on each page or the like of the entry book 2 with the electronic pen 1, that is, the writing pressure, and the value is detected by the processor. To 108.

  The processor 108 switches on / off the switches of the LED 105 and the CMOS camera 106 based on the writing pressure data supplied from the pressure sensor 107. That is, when the user writes characters or the like on each page or the like of the entry book 2 with the electronic pen 1, the pen pressure is applied to the pen tip portion 103, and when the pressure sensor 107 detects a writing pressure exceeding a predetermined value, the processor 108 determines that the user has started filling in and activates the LED 105 and the CMOS camera 106. Then, the communication unit 111 associates pen-down information detected by the pressure sensor 107 with identification information (hereinafter referred to as “pen ID”) of the electronic pen 1 described later, and transmits it to the entry information display device 3. . When the user finishes entering one stroke and moves the electronic pen 1 away from each page of the entry book 2 or the like, the pressure sensor 107 detects a pen-up because no writing pressure exceeding a predetermined value is detected. Then, the communication unit 111 associates the pen-up information detected by the pressure sensor 107 with the pen ID and transmits it to the entry information display device 3.

  The LED 105 and the CMOS camera 106 are attached near the pen tip portion 103 of the electronic pen 1, and an opening 102 is formed in a portion of the housing 101 that faces the LED 105 and the CMOS camera 106. The LED 105 illuminates infrared rays toward the vicinity of the pen tip portion 103 on each page of the entry book 2. The area is slightly shifted from the position where the pen tip portion 103 contacts each page of the entry book 2. The CMOS camera 106 is provided with an infrared filter that transmits infrared rays and blocks non-infrared rays. The CMOS camera 106 captures a dot pattern in an area illuminated by the LED 105 and processes image data of the dot pattern as a processor. 108. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 105 are absorbed by the carbon contained in the dots. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. By photographing with the CMOS camera 106, a threshold value is provided based on the difference in the amount of reflected infrared light, so that a dot region containing carbon can be distinguished from other regions. Therefore, even when characters, drawings, or the like are printed on each page of the entry book 2, the printed ink does not absorb in the infrared region, so the processor 108 can recognize the dot pattern. Note that the shooting area by the CMOS camera 106 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 3A, and the shooting by the CMOS camera 106 is performed at regular intervals of about 50 to 100 times per second. Is called. Further, the CMOS camera 106 has a sufficient depth of field in order to photograph dots clearly.

  While the user performs the entry, the processor 108 determines the X and Y coordinates (hereinafter referred to as “X” and “Y” coordinates in each page of the entry 2 of the stroke (handwriting) entered by the user from the dot pattern of the image data supplied by the CMOS camera 106. Simply called "coordinate data"). That is, the processor 108 converts the image data of the dot pattern as shown in FIG. 3A supplied by the CMOS camera 106 into the data array shown in FIG. The Y coordinate bit value is converted, and the coordinate data is calculated from the data array by a predetermined calculation method. Note that the processor 108 has a rotation correction processing function for correcting the arrangement of dots on the image due to the angle of the electronic pen 1 facing the dot pattern, and that function is executed during coordinate calculation. Then, the processor 108 associates entry time (time stamp), writing pressure data, and coordinate data transmitted from the real-time clock 110. Hereinafter, these associated data are collectively referred to as “coordinate attribute information”. Since the 6 × 6 dot pattern on each page of the entry book 2 does not overlap in the entry book 2, when the user enters characters or the like with the electronic pen 1, the entered position is each entry in the entry book 2. The position on the page can be specified by coordinate calculation by the processor 108.

The memory 109 stores property information such as a pen ID such as “pen01” for identifying the electronic pen 1, a pen manufacturer number, and a pen software version. Then, the communication unit 111 associates the pen ID, entry time (time stamp), writing pressure data, and coordinate data, and transmits them to the entry information display device 3. In this case, transmission to the entry information display device 3 by the communication unit 111 is immediately and sequentially performed by wireless transmission such as Bluetooth (registered trademark). Here, one or more coordinate attribute information generated between the pen-down and pen-up of the electronic pen 1 and transmitted to the entry information display device 3 is stored in the entry information display device 3. In other words, one stroke is composed of one or a plurality of X and Y coordinates (coordinate points), and the entry information display device 3 includes one or more composing one stroke based on pen-down information and pen-up information. Recognize pieces of coordinate attribute information.
Hereinafter, one or a plurality of coordinate attribute information generated from the pen down to the pen up of the electronic pen 1 and transmitted to the entry information display device 3 will be referred to as “entry information”.

  The electronic pen 1 may include a pen portion that is not filled with ink instead of the ink cartridge 104.

  FIG. 5 is a hardware configuration diagram of the entry information display device 3. Note that the hardware configuration of FIG. 5 is an example. The entry information display device 3 can take various configurations depending on the application and purpose, and may be any of a desktop PC (Personal Computer), a notebook PC, a tablet PC, a smartphone, and the like.

  As shown in FIG. 5, the entry information display device 3 includes a control unit 31, a storage unit 32, a media input / output unit 33, a communication control unit 34, an input unit 35, a display unit 36, a peripheral device I / F unit 37, and the like. Are connected via a bus 38.

  The control unit 31 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The CPU calls a program stored in the storage unit 32, ROM, recording medium or the like into a work memory area on the RAM, executes it, drives and controls each device connected via the bus 38, and enters the entry information display device 3 The process to be described later is realized. The ROM is a non-volatile memory and permanently holds a computer boot program, a program such as BIOS, data, and the like. The RAM is a volatile memory, and temporarily stores a program, data, and the like loaded from the storage unit 32, ROM, recording medium, and the like, and includes a work area used by the control unit 31 for performing various processes.

  The storage unit 32 is an HDD (Hard Disk Drive) or the like, and stores a program executed by the control unit 31, data necessary for program execution, an OS (Operating System), and the like. As for the program, a control program corresponding to the OS and an application program for causing a computer to execute processing to be described later are stored. Each of these program codes is read by the control unit 31 as necessary, transferred to the RAM, read by the CPU, and executed as various means.

  The media input / output unit 33 (drive device) inputs / outputs data, for example, media such as a CD drive (-ROM, -R, -RW, etc.), DVD drive (-ROM, -R, -RW, etc.) Has input / output devices. The communication control unit 34 includes a communication control device, a communication port, and the like, and is a communication interface that mediates communication between the computer and the network, and performs communication control between other computers via the network. The network may be wired or wireless.

  The input unit 35 inputs data and includes, for example, a keyboard, a pointing device such as a mouse, and an input device such as a numeric keypad. An operation instruction, an operation instruction, data input, and the like can be performed on the computer via the input unit 35. The display unit 36 includes a display device such as a liquid crystal panel, and a logic circuit (video adapter or the like) for realizing a video function of a computer in cooperation with the display device. The input unit 35 and the display unit 36 may be integrated like a touch panel display.

  The peripheral device I / F (Interface) unit 37 is a port or an antenna for transmitting and receiving data between the computer and the peripheral device. The computer transmits and receives data to and from the peripheral device via the peripheral device I / F unit 37. I do. The connection form with the peripheral device may be wired (for example, USB (Universal Serial Bus) or the like) or wireless (for example, Bluetooth (registered trademark) or the like). The bus 38 is a path that mediates transmission / reception of control signals, data signals, and the like between the devices.

  FIG. 6 is a diagram illustrating an example of a data structure of “coordinate definition information” stored in the storage unit 32. The coordinate definition information indicates information on the coordinate range indicated by the dot pattern printed on each page of the entry book 2. In the example of FIG. 6, the coordinate definition information is included in an item indicating an entry ID for identifying the type of entry 2, an item indicating a page number, and a page of entry 2 for each page of entry 2. And an item indicating the coordinate range of the printed dot pattern. Here, the entry ID of entry 2 shown in FIG. 1 is “N01”, and the coordinate range is defined by corner position information (Xn, Yn), height (Y direction), and width (X direction). Has been.

  FIG. 7 is a flowchart showing the upload process. As shown in FIG. 7, when entry information is transmitted from the communication unit 111 of the electronic pen 1, the control unit 31 of the entry information display device 3 receives the entry information via the peripheral device I / F unit 37 ( In step S11), the received entry information is stored in the storage unit 32 for each pen ID (step S12). At this time, the control unit 31 refers to the coordinate definition information of the entry book 2 shown in FIG. 6 and stores the entry information in the storage unit 32 in association with the page number.

  As a modification of step S12, the control unit 31 transmits the entry information received from the electronic pen 1 to a server (not shown) via the communication control unit 34 and the network, and stores it in the storage device of the server. May be. In this case, the control unit 31 acquires entry information from the storage device of the server as necessary.

  When the electronic pen 1 includes a pen unit that is not filled with ink instead of the ink cartridge 104, the control unit 31 may temporarily store entry information in the RAM. In this case, the control unit 31 may display the entry information stored in the RAM on the display unit 36 immediately. And the control part 31 may memorize | store entry information in the memory | storage part 32, or memorize | store it in the memory | storage device of a server according to the request | requirement from a user. Below, control part 31 explains as what memorizes entry information in storage part 32.

  FIG. 8 is a flowchart showing the display control process of the entry information display device 3.

  First, the control unit 31 acquires the entry time and entry page of entry information from the storage unit 32 (step S21). The entry time is information such as date and time when each entry information is entered. The entry page is information on a page in which each entry information is entered. The control unit 31 acquires a page number as an entry page for each entry information from the storage unit 32 and obtains an entry time (time stamp) as an entry point for each entry information.

  As a modification of step S21, the control unit 31 may recognize at least one date entered on each page by character recognition processing and obtain it as the entry time for each entry information included in the same page. In this case, if a date entry rule (for example, the left side of a ruled line entered on each page) and an entry mode (for example, “month / day”) are defined, character recognition processing can be performed with high accuracy. it can.

Normal optical character recognition processing (OCR: Optical Character
Compared with Recognition, the upload process shown in FIG. 7 corresponds to a capture process using an image scanner. Therefore, in the embodiment of the present invention, the control unit 31 performs a pattern matching process (a character pattern stored in advance). It is only necessary to perform a comparison with

  Next, the control unit 31 determines whether or not entry information whose entry point is included in the unit period to be displayed exists on a plurality of pages (step S22). The unit period is, for example, one hour, half day, one day, one week, or the like. When the determination in step S22 is No, the control unit 31 controls to perform single page display (step S23), and when the determination in step S22 is Yes, the control unit 31 performs multiple page display. Control (step S24). In other words, the control unit 31 refers to the entry time and switches between single page display and multiple page display. Multiple page display means that a plurality of pages are displayed side by side on the display unit 36 at the same time.

  FIG. 9 is a diagram illustrating an example of single page display. FIG. 9A is a schematic diagram of the entry book 2a. FIG. 9B is a schematic diagram of the display screen 4 a displayed on the display unit 36. The display screen 4a is divided into a thumbnail area 41 and a main area 42. Thumbnail images 43a to 43c are displayed in the thumbnail area 41, and a detailed image 44a is displayed in the main area 42.

  In the entry book 2a shown in FIG. 9A, entry information is entered on February 2, February 3, and February 7 on the left side of the two spread pages, and on the right page, The entry information is entered on February 12 and February 15.

  Assume that the unit period to be displayed is one day, and the page on the left side of the entry book 2a is displayed. In this case, the control unit 31 determines that the entry information included in the unit period to be displayed does not exist on a plurality of pages, and performs the single page display as shown in FIG. 9B. Control. In FIG. 9B, an image corresponding to the left page of the entry book 2a is displayed as the detailed image 44a.

  In the experiment note, although it is common to divide and fill in pages for each date on which the experiment was conducted, as in the example shown in FIG. Even if is included, the present invention can be applied.

  FIG. 10 is a diagram illustrating an example of a multi-page display. FIG. 10A is a schematic diagram of the entry book 2b. FIG. 10B is a schematic diagram of the display screen 4 b displayed on the display unit 36. In the entry book 2b shown in FIG. 10 (a), entry information (chart) is entered on March 4 over two pages.

  Assume that the unit period to be displayed is one day, and the left (or right) page of the entry 2b is displayed. In this case, the control unit 31 determines that the entry information whose entry point is included in the unit period to be displayed exists on a plurality of pages, and controls to display a plurality of pages as shown in FIG. . In FIG. 10B, an image corresponding to the two spread pages of the entry book 2b is displayed as the detailed image 44b.

  FIG. 11 is a diagram illustrating another example of a multi-page display. FIG. 11A is a schematic diagram of the entry book 2c. FIG. 11B is a schematic diagram of the front screen 4 c displayed on the display unit 36. In the entry book 2c shown in FIG. 11 (a), entry information of February 2, February 3, and February 7 is entered across two pages.

  Assume that the unit period to be displayed is 6 days, and the left (or right) page of the entry 2c is displayed. In this case, the control unit 31 determines that the entry information whose entry point is included in the unit period to be displayed exists on a plurality of pages, and controls to display a plurality of pages as shown in FIG. . In FIG. 11B, an image corresponding to two spread pages of the entry book 2c is displayed as the detailed image 44c.

  In the example shown in FIGS. 10B and 11B, two spread pages are displayed side by side at the same time, but the present invention is not limited to this. For example, two pages other than the spread may be displayed side by side at the same time, or three or more pages may be displayed side by side at the same time. However, if the number of pages is too large, the visibility deteriorates, so an upper limit may be set for the number of pages displayed simultaneously.

  As described above, the entry information display device 3 acquires the entry time and entry page of entry information, refers to the entry time, and switches between single page display and multiple page display. As a result, a plurality of pages can be automatically displayed as necessary.

  Further, the entry information display device 3 controls to display a plurality of pages when the entry information included in the unit period having the same entry time exists on a plurality of pages. As a result, as in the case of an experiment note, although the pages are usually entered separately for each date, even if a large diagram or the like may be entered across two spread pages, an appropriate single page can be used. Switching between display and multi-page display is possible.

  The entry information display device 3 may acquire the entry time received from the electronic pen 1 as the entry time for each entry information. As a result, the entry time can be accurately obtained.

  Further, the entry information display device 3 may recognize at least one date entered on each page by character recognition processing and obtain it as the entry time for each piece of entry information included in the same page. Thus, the present invention can be applied even when the electronic pen 1 that does not have the real-time clock 110 is used or when the electronic pen 1 is not used.

  In the above description, the entry book 2 is a paper medium, but the entry book 2 may be a tablet terminal having a touch panel display instead of the paper medium. When the entry book 2 is a tablet terminal or the like, the electronic pen 1 includes a pen portion that is not filled with ink. A configuration example in this case is described in, for example, Japanese Patent Application Laid-Open No. 2014-219929, and the present invention can be applied similarly to the case where the above-described entry book 2 is a paper medium.

  The preferred embodiments of the entry information display device and the like according to the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to such examples. It will be apparent to those skilled in the art that various changes or modifications can be conceived within the scope of the technical idea disclosed in the present application, and these naturally belong to the technical scope of the present invention. Understood.

DESCRIPTION OF SYMBOLS 1 ......... Electronic pen 2, 2a, 2b, 2c ......... Entry book 3 ......... Entry information display device 31 ...... Control part 32 ......... Storage part 33 ......... Media input / output part 34 ......... Communication control unit 35 ......... Input unit 36 ......... Display unit 37 ......... Peripheral device I / F unit 4a, 4b, 4c ......... Display screen 41 ......... Thumbnail area 42 ......... Main area 43a, 43b 43c, 43d, 43e, 43f, 43g, 43h, 43i ......... Thumbnail images 44a, 44b, 44c ......... Detailed images

Claims (6)

An entry information display device for displaying entry information entered in an entry book having a plurality of pages,
Acquisition means for acquiring the entry time and entry page of the entry information;
Display control means for switching between single page display and multiple page display with reference to the entry time point,
An entry information display device characterized by comprising: 2. The display control means according to claim 1, wherein the plurality of pages are displayed when the entry information included in the same unit period is included in the plurality of pages. A written information display device. The entry information display according to claim 1 or 2, wherein the acquisition means acquires an entry time received from an electronic pen used for entry of the entry information as the entry time for each entry information. apparatus. 2. The acquisition unit according to claim 1, wherein the acquisition unit recognizes at least one date written on each page by character recognition processing, and acquires the date as the entry time for each of the entry information included in the same page. 2. The entry information display device according to 2. An entry information display method in which a computer displays entry information entered in an entry book having a plurality of pages,
A control unit of the computer,
An acquisition step of acquiring the entry time and entry page of the entry information;
A display control step of switching between single page display and multiple page display with reference to the entry time point;
Entry information display method characterized by executing A program for causing a computer to function as an entry information display device for displaying entry information entered in an entry book having a plurality of pages,
The computer,
Acquisition means for acquiring the entry time and entry page of the entry information;
A program for functioning as display control means for switching between single-page display and multi-page display with reference to the entry point.

Images