JP5098733B2 - Information processing apparatus and program - Google Patents

Description

  The present invention relates to an information processing apparatus and a program.

The printed material is electronically read, electronic data of the printed material is input as a comparison source image, and a feature amount of the processing target area including the page image included in the comparison source image is extracted. Using the extracted feature amount, a comparison destination image corresponding to the comparison source image is searched from the storage medium. Patent Document 1 discloses a technique for processing an image as a search result.
Japanese Patent Laid-Open No. 2005-4724

  An information processing apparatus and program capable of emphasizing a part of information recorded on a paper medium are provided.

  The invention according to claim 1 is an information processing apparatus, a communication means for communicating with a recording apparatus in which a medium identifier for identifying a paper medium is associated with at least one area information for specifying an area on the medium, and a paper A selective illumination means having a surface capable of supporting the entire medium and selectively illuminating any of a plurality of predetermined areas on the paper medium; and a medium identifier for identifying the paper medium supported on the surface. A detecting means for detecting, an acquiring means for acquiring area information recorded in the recording device in association with the detected medium identifier, and an area corresponding to the acquired area information are illuminated via the communication means. Control means for controlling such that the control means detects the relative position between the paper medium and the surface based on the contents entered by the user on the paper medium, and illuminates with the detected relative position. Control area It is obtained by the Rukoto.

  A second aspect of the present invention is the information processing apparatus according to the first aspect, wherein the control means is configured to determine whether or not the paper medium is based on the contents entered by the user at a plurality of predetermined positions on the paper medium. The relative position with respect to the surface is detected.

  A third aspect of the present invention is the information processing apparatus according to the first aspect, wherein the control means is configured to add anisotropic entry contents made by a user at a predetermined position on a paper medium. Based on this, the relative position between the paper medium and the surface is detected.

  The invention according to claim 4 is the information processing apparatus according to claim 1, wherein the control means accepts the entry contents made by the user at a predetermined position on the paper medium, and the entry contents A region circumscribing the paper is detected, and the relative position between the paper medium and the surface is detected based on the feature amount of the detected region.

A fifth aspect of the present invention is the information processing apparatus according to the first aspect, wherein a code image capable of detecting an inclination angle is formed on the back surface of the paper medium. An image pickup means for picking up an image of the back surface of the medium placed on the image, and the control means is a back side position corresponding to a position written by a user on a paper medium among images of the back face of the medium picked up by the image pickup means. The relative position between the paper medium and the surface is detected based on the code image .

A sixth aspect of the present invention is the information processing apparatus according to the first aspect, wherein a code image capable of detecting an inclination angle is formed on the paper medium, and the paper image is placed on the surface. Image pickup means for picking up an image of the back side of the recorded medium, and the control means includes a position entered by a user on a paper medium among images on the medium surface side picked up by the image pickup means through the medium, The information processing apparatus according to claim 1, wherein a code image is detected from an area in a predetermined range, and a relative position between the paper medium and the surface is detected based on the detected code image .

  The invention according to claim 7 is the information processing apparatus according to any one of claims 1 to 6, wherein imaging means for imaging the back surface of the medium placed on the surface is provided in the surface, The image pickup means picks up a fiber structure unique to each paper medium, and the medium identifier is detected based on the picked-up fiber structure.

  The invention according to claim 8 is a program, wherein the computer communicates with a recording apparatus that associates a medium identifier for identifying a paper medium with at least one area information for specifying an area on the medium, and A selective illumination unit that controls a selective illumination unit arranged on a surface capable of supporting the entire paper medium and selectively illuminates any of a plurality of predetermined areas on the paper medium, and is supported by the surface Detecting means for detecting a medium identifier for identifying a paper medium; acquisition means for acquiring area information recorded in the recording device in association with the medium identifier detected on the surface; via the communication means; Based on the contents entered by the user above, the relative position between the paper medium and the surface is detected, and control is performed to illuminate the region of the surface corresponding to the acquired region information using the detected relative position. System It is obtained by the function as an means.

  According to the first and eighth aspects of the present invention, a part of information on the paper medium arranged on the surface can be emphasized by illumination.

  According to the second and third aspects of the invention, the relative position of the paper medium placed on the surface can be detected by the user's entry operation.

  According to the fourth aspect of the present invention, the relative position of the paper medium arranged on the surface can be detected according to the contents entered by the user.

  According to the fifth and sixth aspects of the invention, the relative position of the paper medium can be detected by imaging information formed on the paper medium with the elements arranged on the surface side.

  According to the seventh aspect of the invention, the identification information for identifying the paper medium can be detected from the characteristics of the paper fiber of the paper medium.

  Embodiments of the present invention will be described with reference to the drawings. An information processing apparatus 1 according to an embodiment of the present invention is connected to a recording apparatus 2 via a communication line such as a network, as illustrated in FIG.

  Here, the information processing apparatus 1 includes a control unit 11, a storage unit 12, an operation unit 13, a display unit 14, a medium detection unit 15, and a communication unit 16. The control unit 11 is a program control device such as a CPU (Central Processing Unit) and operates according to a program stored in the storage unit 12. The information processing apparatus 1 uses a paper medium P as illustrated in FIG. 2A and its usage in FIG. 2B. Here, the paper medium may be a single sheet or may be a booklet-like material as will be described later. However, for the sake of simplicity, the description will be given assuming that there is only one paper medium P.

  The information processing apparatus 1 has a surface S of a size that can support the entire paper medium P. The surface S functions as the operation unit 13. In other words, the operation unit 13 is, for example, a transparent electrode superimposed on the display unit 14. When a user's pressing operation (writing to the paper medium P) is performed via the paper medium P, the operation unit 13 performs the writing. Detect position.

  Note that the operation unit 13 may use an electromagnetic induction panel in addition to detecting a pressing operation. In this case, the pen used by the user for the writing operation is an electromagnetic pen.

  Furthermore, an optical sensor serving as the operation unit 13 may be disposed in each element corresponding to each pixel of the display device that is the display unit 14. At this time, the user enters characters on the paper medium P using a pen having a light emitting element disposed in the vicinity of the pen tip, and the vicinity of the pen tip transmitted through the paper medium P by the operation unit 13. It is also possible to detect the light of the light emitting element arranged in the light source (for this purpose, the light of the light emitting element may be modulated). That is, the operation unit 13 detects the position of the user's pen based on the detected light position.

  When the display unit 14 virtually divides the paper medium P, which is at least one paper medium, into a plurality of areas (illumination areas), for example, as illustrated by a broken line in FIG. The resolution is such that the paper medium P can be illuminated from below. The number N of illumination areas may be, for example, about N = 30 (when divided into 3 × 10 areas). That is, the display unit 14 may be one in which a light emitting element (LED (Light Emission Diode) or the like) is arranged for each of these illumination regions, and the display unit 14 may be a general liquid crystal display device or an organic EL. (Electro-Luminescence) device etc. may be sufficient. In the case where pixels having a resolution higher than the number of illumination areas are provided, the lighting of the corresponding illumination areas may be performed by controlling lighting / extinction of the pixels. In this case as well, illumination may be performed in units of illumination areas.

  The medium detection unit 15 acquires identification information for identifying the paper medium P supported on the surface S. An example of the medium detection unit 15 will be described later.

  The control unit 11 is a program control device such as a CPU (Central Processing Unit) and operates according to a program stored in the storage unit 12. The control unit 11 acquires identification information for identifying the supported paper medium P placed on the surface S from the medium detection unit 15.

  In addition, the control unit 11 performs processing for detecting a relative position (shift from the assumed position, rotation) of the paper medium P placed on the surface S with respect to the surface S, and writing to the paper medium P. The information generation / recording instruction for specifying the time and the area, and the process of illuminating the area on the paper medium P based on the information recorded in the recording apparatus 2 are executed. The contents of the processing of these control units 11 will be described later.

  The storage unit 12 includes a memory element such as a RAM (Random Access Memory). The storage unit 12 stores a program executed by the control unit 11. This program may be read and copied from a computer-readable recording medium such as a DVD-ROM. Further, the storage unit 12 also operates as a work memory for the control unit 11.

  The storage unit 12 also stores information that defines each area that can be individually illuminated by the display unit 14. This information may be associated with, for example, the identifier of each region and the vertex coordinates of each region (when the region is a rectangular region, the upper left coordinate and the lower right coordinate of the region).

  The communication unit 16 is, for example, a wireless LAN (Local Area Network) interface, and transmits and receives information to and from the recording device 2 according to an instruction from the control unit 11 via a communication line such as a network.

  The recording device 2 is a database server, for example, and holds information according to an instruction received from the information processing device 1. In the example of the present embodiment, the recording device 2 and the information processing device 1 are illustrated as separate devices, but they may be integrated.

[Example of media detection unit]
Here, an example of the medium detection unit 15 will be described. The medium detection unit 15 uses identification information for identifying the paper medium P as a wireless tag (RFID (Radio Frequency IDentification)), information based on a fiber pattern unique to each paper medium, or information recorded on the paper medium ( For example, the identification information of the paper medium supported by the surface S is acquired by pointing or tracing the mark on the paper medium side to the user.

  For example, when a wireless tag in which unique identification information is recorded in advance is attached to each paper medium P, the information processing apparatus 1 according to the present embodiment is attached to the paper medium P placed on the surface S. The identification information is acquired from the wireless tag. That is, the medium detection unit 15 in this case functions as a wireless tag information reading device. Further, there may be a plurality of wireless tag information reading devices as the medium detection unit 15.

  Further, using the fact that the structure of the paper fiber is different for each paper, identification information for identifying the paper medium P is generated based on the structure of the paper fiber in a predetermined portion of the paper medium P. Also good. In this case, the medium detection unit 15 functions as a camera that images the structure of the paper fiber of the predetermined portion.

Further, the medium detection unit 15 may include a plurality of light receiving elements arranged on the same surface as the display unit 14 or the operation unit 13. In this case, when the paper medium P is placed on the surface S, the medium detection unit 15 captures an image of the entire surface on the surface S side of the paper medium P. Therefore, a computer-readable code image (such as a barcode) representing identification information that differs for each paper medium P may be formed in advance on the surface facing the surface S of the paper medium P. At this time, the medium detection unit 15 detects the code image from the surface of the captured paper medium P, and outputs identification information represented by the code image.
In addition, when a mark in which unique identification information is recorded in advance is attached to the paper medium P, the user generates the identification information of the paper medium P by pointing or tracing the mark on the paper medium P with a pen or the like. May be. In this case, the characteristic of the pen movement information generated by pointing or tracing the mark is acquired by the operation unit 13 of the surface S, and is used as the paper medium identification information.
Further, when a mark having unique identification information recorded in advance is not attached to the paper medium P, the user first writes a mark on the paper medium P with a pen or the like, and the identification information is obtained from the written mark. It may be generated. Thereafter, when identifying the paper medium P, the written information may be generated again by pointing or tracing the written mark with a pen or the like. In this case, after the start of recording of the identification information is instructed from the operation unit 13, the identification information is recorded by recording with a pen or the like, and the start of acquisition of the identification information is instructed by the operation unit 13 and traced with the pen or the like. Information acquisition may be started.
Further, by defining a specific area of the paper medium as the identification information area, the identification information may be recorded or acquired by performing an operation of pointing or tracing the area with a pen or the like.

[Detection of misalignment of paper media]
Next, processing for detecting a shift in the relative position between the paper medium P and the surface S by the control unit 11 will be described. In this process,
(1) Pointing or tracing a mark previously formed on the paper medium side to detect misalignment by the operation (2) Character string etc. to the user in a column previously formed on the paper medium side (3) A user's point position and a predetermined pattern for detecting a predetermined positional deviation are formed at positions corresponding to the front and back sides of the paper medium in advance. When the user points to the point position, a predetermined pattern for detecting misalignment formed on the back side is read correspondingly and the misalignment is detected (4) Any one of the processes using the wireless tag may be performed. . Hereinafter, each process will be described.

(1) Example of Marking or Tracing a Mark Here, a mark formed on the paper medium P side is determined in advance on a line segment that is not parallel to the side of the paper medium P, for example, as shown in FIG. It may be an X-shaped mark (or a shape with a known center point such as a cross) formed at a plurality of points (for example, M1 and M2). For example, these marks are centered on the coordinates of (M1x, M1y) and (M2x, M2y), with the lower left vertex of the paper medium P as the origin, the short side direction as the X axis, and the long side direction as the Y axis. Assume that the mark to be represented is predetermined.

  When the user points (fills in) the center with a pen or the like at the plurality of predetermined positions, the control unit 11 positions (M1, M2 on the surface S) where the filling operation is performed. Are detected by the operation unit 13 as entry contents. And the relative position with respect to the surface S of the paper medium P is detected by the detected coordinates. That is, the control unit 11 generates a parameter that associates the point (x, y) on the paper medium P with the point (ξ, η) on the surface S. Specifically, if the positional deviation between the paper medium P and the surface S is a combination of rotation and translation, coordinates M1 (M1x, M1y), M2 (M2x, M2y), μ1 (μ1ξ, μ1η) ), Μ2 (μ2ξ, μ2η), rotation angle θ, and parallel displacement (α, β),

の２式をともに満足するθ，α，βを求めることで、紙媒体Ｐ上の点（ｘ，ｙ）と面Ｓ上の点（ξ，η）とを関連づける変換式、

A transformation equation that associates the point (x, y) on the paper medium P with the point (ξ, η) on the surface S by obtaining θ, α, and β that satisfy both of the following two equations:

を得る。

Get.

  Further, the control unit 11 converts the point (ξ, η) on the surface S into the point (x, y) on the paper medium P using this conversion formula (referred to as a first conversion formula for convenience). Obtain 2 conversion equations.

  When the control unit 11 obtains this conversion formula, and the user performs writing and presses the operation unit 13, any region on the paper medium P is determined from the pressed position of the operation unit 13 using the second conversion formula. Detect if you are writing inside.

Here, it is assumed that a virtual area is set in advance on the paper medium P as shown in FIG. Each region R1, R2,... Is assumed to be rectangular, the upper left coordinate of the region Ri is RiL (RiLx, RiLy), and the lower right coordinate is RiR (RiRx, RiRy). When a press is detected in the operation unit 13, the control unit 11 detects a pressed position until a predetermined time elapses (until the user interrupts the pressing operation) without detecting the next press. Record the minimum value (ξmin, ηmin) and the maximum value (ξmax, ηmax) of (ξ, η). These minimum and maximum values are converted into points LT (xmin, ymin) and RB (xmax, ymax) on the paper medium P using the second conversion formula. An area including the coordinates of LT and RB, that is, RiL <LT ≦ RiR (or RiL ≦ LT <RiR may be satisfied).
RjL <RB ≦ RjR (or RjL ≦ RB <RjR may be used)
Find i, j. As a result, the control unit 11 finds a region Ri including the upper left end of the range written by the user and a region Rj including the lower right end. Further, the control unit 11 reads out and stores the time when the pressing is detected in the operation unit 13 (starting time of pressing detection and ending time when the pressing is detected last) from a clock unit (not shown), and stores these starting times. Instruct the recording apparatus 2 to store the time information including the time and the end time, the information (region information) for specifying the found region Ri and region Rj, and the identification information of the paper medium P in association with each other. Send.

  In addition, here, an example in which the relative position between the paper medium P and the surface S is detected based on the contents of entries made at a plurality of different positions is described. However, as shown in FIG. At a predetermined position M of P, the user may enter an anisotropic figure or the like, and the relative position between the paper medium P and the surface S may be detected based on the entered content.

  Here, an anisotropic figure is a figure that is asymmetric with respect to at least rotation and translation. As an example, FIG. 4B shows a V-shaped example. When the user traces this figure, the control unit 11 detects the orientation and position of the V-segment line S with respect to the input from the operation unit 13. Based on the detection result, a rotation angle and a parallel movement position with respect to the surface S of the paper medium P are obtained by calculation.

  Also in this case, the control unit 11 obtains the first and second conversion formulas, and the control unit 11 uses the conversion formulas for the area Ri including the upper left end of the range written by the user and the right side. A region Rj including the lower end is found. The recording apparatus 2 stores the time information including the start time and the end time, the information (region information) for specifying the found region Ri and the region Rj, and the identification information of the paper medium P in association with each other. Send instructions to it.

(2) An example in which a user enters a character string or the like, and a positional deviation is detected by the operation of the entry. In the present embodiment, the paper medium P has a predetermined area as shown in FIG. You may provide the column W which makes a user fill in. And the control part 11 may detect the relative position of the paper medium P and the surface S based on the content of the entry which the user made in this area | region.

  In other words, in this example, the control unit 11 defines a rectangle circumscribing a character or the like entered in the column W by the user (FIG. 7). The rotation is detected by how much each side of the circumscribed rectangle is inclined with respect to the axis of the surface S. Further, the parallel movement amount is estimated based on the points inside and outside the circumscribed rectangle such as the center of gravity of the circumscribed rectangle. For example, assuming that the center of gravity of the circumscribed rectangle coincides with the center of gravity of the column W, the center of gravity of the column W is estimated to be the center of gravity of the circumscribed rectangle, and is obtained from the center of gravity of the column W (the position of the column W determined in advance). ) And the corresponding coordinates on the surface S, the control unit 11 may obtain the first and second conversion expressions.

  Hereinafter, similarly to the previous example, the control unit 11 uses these conversion formulas to find a region Ri including the upper left end and a region Rj including the lower right end of the range written by the user. The recording apparatus 2 stores the time information including the start time and the end time, the information (region information) for specifying the found region Ri and the region Rj, and the identification information of the paper medium P in association with each other. Send instructions to it.

  Further, when the user enters a character string or the like in this manner, a different character string or the like may be entered for each paper medium. In this case, an image such as a character string to be entered is formed in advance at a predetermined position on the paper medium P. Then, the user is made to enter a character string or the like according to the image.

  On the other hand, for example, in the recording device 2, a table that associates the identification information of the paper medium P and the feature amount such as the entered character string is stored, and the control unit 11 determines the feature amount such as the entered character string. Extraction is performed, and identification information associated with the extracted feature amount is acquired from the recording device 2. Thereby, the identification information of the paper medium P may be acquired from the entered content. In this case, the medium detection unit 15 is not necessarily required.

(3) Example of using pattern formed on paper medium In this case, an optical sensor is used as the operation unit 13. The operation unit 13 images the back side of the paper medium placed on the surface S (the back side of the surface on which the user fills in). Also, a code image such as a barcode capable of detecting the tilt angle is formed at a predetermined position on the back side of the paper medium. An example of such a code image is, for example, a QR code. The control unit 11 detects the position and inclination of the QR code from the image on the back surface of the paper medium P imaged by the operation unit 13. Then, the first and second conversion equations may be obtained based on the detected inclination and position.

  Hereinafter, similarly to the previous example, the control unit 11 uses these conversion formulas to find a region Ri including the upper left end and a region Rj including the lower right end of the range written by the user. The recording apparatus 2 stores the time information including the start time and the end time, the information (region information) for specifying the found region Ri and the region Rj, and the identification information of the paper medium P in association with each other. Send instructions to it.

  When a code image is used as in this example, the code image may be one in which identification information of the paper medium P is recorded. When doing so, the control unit 11 can obtain the identification information by decoding the QR code. Therefore, in such a case, the medium detection unit 15 is not always necessary.

  In addition, when it is difficult to detect the QR code from the entire back surface of the paper medium P, the user may specify the position of the QR code. For example, a mark or the like may be formed at a position on the front side corresponding to the position where the QR code is formed, and the user may perform an entry operation at the position of the mark. The control unit 11 may receive the entry operation and detect the QR code from an area in a predetermined range including the position where the entry operation is performed.

  Further, by using a device that combines a liquid crystal display and an optical sensor as described herein, the user points a plurality of predetermined points on the paper medium P with a pen or the like, and coordinates on the surface S And the first and second conversion equations may be obtained.

  Furthermore, when the image formed on the surface of the paper medium P (the surface opposite to the surface S side) can be recognized through the paper medium P, the optical sensor as the operation unit 13 is placed on the front side of the paper medium P. An image such as a formed QR code may be captured, and the relative position and identification information may be detected from the captured image.

(4) Example of using a wireless tag Further, the inclination and position (relative position) of the paper medium P with respect to the surface S may be detected using a wireless tag. In this example, the wireless tags Q and R are arranged at a plurality of positions on the paper medium P (for example, slightly above and below the center of the paper medium).

  A plurality of wireless tag readers are arranged in a matrix so that when the paper medium P is arranged at the reference position (scheduled position) of the surface S, the wireless tags Q and R are positioned at the center thereof. In each position (A to D and E to H in FIG. 8A). When the paper medium P is placed at the reference position of the surface S, as shown in FIG. 8 (b), the wireless tag Q is positioned at the approximate center of the 2 × 2 matrix formed by the wireless tag readers A to D. The tag R is located approximately at the center of the 2 × 2 matrix formed by the RFID tag readers E to H. Accordingly, the wireless tag readers A to D receive the information from the wireless tag Q with substantially the same intensity (A = B = C = D). The wireless tag readers E to H receive the information from the wireless tag R with substantially the same intensity (E = F = G = H).

  However, when the paper medium P is placed to be inclined with respect to the surface S (FIG. 8C), the intensity of the information received by each wireless tag reader from the wireless tag changes. In the example of FIG. 8C, the signal strength from the wireless tags Q and R decreases in the order of A> B> C> D and F> E> H> G.

  Similarly, when the paper medium P is placed at a position translated from the reference position of the surface S (FIG. 8D), the intensity of information received by each wireless tag reader from the wireless tag also changes. . Therefore, the control unit 11 estimates the inclination and the amount of parallel movement of the paper medium P from the intensity of information received by each wireless tag reader from the wireless tag and information on the arrangement position of the wireless tag reader.

  In this example, the control unit 11 calculates the distance to the wireless tag based on the received signal strength at each wireless tag reader based on the correlation between the signal strength from the wireless tag and the distance from the wireless tag reader. The position of the wireless tag on the paper medium P expressed in the coordinate system of the surface S is acquired by the same principle as that of triangulation, and the position of the wireless tag expressed in the coordinate system of the paper medium P (predetermined The first and second conversion equations may be obtained by comparison with

  Also, the difference between the maximum and minimum received intensities of the RFID tag readers A to D is not within a predetermined threshold value, or the maximum received intensity of the RFID tag readers E to H is the maximum. If the difference between the minimum value and the minimum value is not within the predetermined threshold value, it is determined that the deviation from the reference position is large, and a warning is issued to return the paper medium P to the reference position (sound May be performed). In the latter case, the paper medium P is placed at the reference position for the user, so that no conversion formula is required.

[Detection of writing position on paper media]
Next, write detection processing by the control unit 11 will be described. When a predetermined time ΔT has elapsed from the time point when the detection of the press has been completed in the past, the control unit 11 detects time information Ts at that time from a clock unit (not shown). Acquire and memorize. The control unit 11 also acquires and stores time information Te at the time point when the last press is detected from the clock unit. When a predetermined time ΔT has passed without detecting the pressing (when the user interrupts the pressing operation), the control unit 11 detects the pressing position (ξ,) detected by the operating unit 13 from time Ts to Te. The minimum value (ξmin, ηmin) and maximum value (ξmax, ηmax) of η) are calculated.

  Then, the minimum value (ξmin, ηmin) and the maximum value (ξmax, ηmax) are converted into the coordinate system (x, y) of the paper medium P using the second conversion formula obtained in advance, and the corresponding minimum value (xmin , Ymin), the maximum value (xmax, ymax) is obtained. The control unit 11 detects the identification information of the paper medium P detected in advance, the information Ts of the time when writing is started, the information Te of the time of completion, the minimum values (xmin, ymin) of the coordinates obtained here, and The maximum values (xmax, ymax) (hereinafter referred to as target area information) are associated with each other and transmitted to the recording apparatus 2 to be accumulated (FIG. 9).

[Lighting treatment]
Next, the illumination process by the control unit 11 will be described. When the paper medium P is placed on the surface S and the identification information is obtained, the control unit 11 requests the recording device 2 for target area information associated with the obtained identification information.

  The control unit 11 also detects a relative position with respect to the surface S of the paper medium P and obtains a first conversion formula. The control unit 11 converts the minimum value (xmin, ymin) and the maximum value (xmax, ymax) of the coordinates included in the target area information obtained from the recording device 2 by the first conversion formula, and uses the coordinates on the surface S as the coordinates. The expressed minimum value (ξmin, ηmin) and maximum value (ξmax, ηmax) are obtained.

  Then, the control unit 11 determines the LEDs corresponding to the illumination area of the display unit 14 included in the rectangle represented by the minimum value (ξmin, ηmin) and the maximum value (ξmax, ηmax) represented by the coordinates on the surface S. Light up. Accordingly, a part of the illumination area corresponding to the user's past writing is selectively illuminated from the lower part of the paper medium.

  As shown in FIG. 9, when the information Ts and Te at the time when writing is started or ended is recorded, for example, the target area information obtained from the recording device 2 is arranged using the writing start time Ts as a key. The illumination area corresponding to the i-th (for example, initially “i = 1”) target area information after the rearrangement and rearrangement (the area after being converted into coordinates on the surface S by applying the first conversion formula) ) May be lit. At this time, the operation unit 13 accepts an instruction to decrement or increment i from the user, and the control unit 11 applies an illumination area corresponding to the i-th target area information after decrementing or incrementing (using the first conversion formula). The area after conversion into coordinates on the surface S) may be turned on.

  Further, the user inputs time information via the operation unit 13, and the control unit 11 corresponds to the target area information associated with the time information such that the input time T satisfies Ts ≦ T ≦ Te. The illumination area (the area after the first conversion formula is applied and converted into coordinates on the surface S) may be turned on.

[Operation]
The information processing apparatus 1 according to the present embodiment configured as described above operates as follows. When the user places the paper medium P on the surface S of the information processing apparatus 1 according to the present embodiment, the information processing apparatus 1 detects this (for example, using an optical sensor) or performs a user operation. Thus, the processing shown in FIG. 10 is started.

  The information processing apparatus 1 acquires identification information of the paper medium P (S1). For example, if the RFID tag or QR code is attached to the paper medium P, this identification information may be obtained by reading it or by reading the structure of the paper fiber. Alternatively, the user may enter a symbol or the like on the paper medium P and obtain identification information based on the content of the entered symbol.

  Further, the information processing apparatus 1 detects the relative position between the paper medium P and the surface S (the relative inclination and the amount of parallel movement between the virtual coordinate system on the paper medium P and the coordinate system on the surface S) ( S2). The detection of the relative position may be performed based on the contents of the entry entered by the user on the paper medium P. In addition, when the position of the QR code can be detected, detection may be performed based on the detection result of the position of the QR code.

  The information processing apparatus 1 obtains a conversion formula pair that mutually converts the coordinate system on the paper medium P and the coordinate system of the surface S based on the relative position between the paper medium P and the surface S.

  The information processing apparatus 1 waits until the user performs a writing operation on the paper medium P (S3). When the user performs a writing operation on the paper medium P, the information processing apparatus 1 displays the range in which the writing has been performed. Detection is performed in the coordinate system of S (S4). Then, the coordinate value representing the detected range is converted into a coordinate system on the paper medium P using one conversion formula of the conversion formula pair obtained previously (S5).

  Then, the area information indicating the writing range expressed in the converted coordinate system is transmitted as the target area information to the recording apparatus 2 together with the identification information acquired in the process S1, and the recording apparatus 2 transmits the identification information and the target area information. Accumulate and accumulate (S6). The above process is repeated from the process S3 (or from the process S2 by an instruction or the like) until the paper medium P is removed from the surface S or the user's end instruction is given.

  Further, when the user places the paper medium P on the surface S of the information processing apparatus 1 according to the present embodiment, the information processing apparatus 1 starts the processing illustrated in FIG. 11 according to the user's instruction or the like. The information processing apparatus 1 acquires identification information of the paper medium P (S11). Here, for example, if an RFID tag or QR code is attached to the paper medium P, the identification information may be obtained by reading it, or may be obtained by reading the structure of the paper fiber. Alternatively, the user may enter a symbol or the like on the paper medium P and obtain identification information based on the content of the entered symbol.

  Further, the information processing apparatus 1 detects the relative position between the paper medium P and the surface S (the relative inclination and the amount of parallel movement between the virtual coordinate system on the paper medium P and the coordinate system on the surface S) ( S12). Again, the relative position may be detected based on the contents of the entry entered by the user on the paper medium P. In addition, when the position of the QR code can be detected, detection may be performed based on the detection result of the position of the QR code.

  The information processing apparatus 1 obtains a conversion formula pair that mutually converts the coordinate system on the paper medium P and the coordinate system of the surface S based on the relative position between the paper medium P and the surface S.

  The information processing device 1 requests the recording device 2 for the identification information acquired in step S11 and the target area information associated with the identification information (S13). Then, the target area information transmitted from the recording apparatus 2 in response to the request is received (S14). The information processing apparatus 1 converts the received target area information (expressed in the coordinate system of the paper medium P) into the coordinate system of the surface S by one of the conversion formula pairs (S15).

  And the display part 14 is controlled and the part corresponding to the range of the surface S represented by the said coordinate system converted is illuminated (S16). Thereby, the range of writing performed in the past on the paper medium P is illuminated.

  Here, the illumination range in the display unit 14 does not necessarily have to be accurately made according to the coordinate information represented in the target area information. As described above, the paper medium P may be divided into about 3 × 10 areas (illumination areas), and illumination may be performed by controlling lighting / extinction in units of each illumination area. In this case, the display part 14 should just light up the pixel of the illumination area which overlaps with the rectangular range represented by object area information.

  According to these processes, when writing is performed on the paper medium P in a state of being superimposed on the surface S of the information processing apparatus 1, target area information representing the area where the writing has been performed is recorded in the recording apparatus 2. And later, according to the instruction, the target area information stored in the recording device 2 is acquired, and the illumination area included in the target area information is illuminated. This illuminates the area that was previously written.

[Another example of area information recording]
In the description so far, the example in which the target area information indicating the area where the writing is performed on the paper medium P is recorded and the area where the writing is performed is performed is described. The example is not limited to this.

  For example, when a character string of a material is printed on a paper medium and used as a paper medium, the identification information of the paper medium is detected in advance. Further, an area in which a portion (for example, a URL (Uniform Resource Locators) character string representing a hyperlink) that matches a predetermined condition is detected from a character string to be printed, and a target area representing the detected area is detected. Information may be generated and stored in the recording device 2 in association with the identification information.

  According to this example, when the information processing apparatus 1 requests the recording device 2 for target area information associated with the identification information, the recording apparatus 2 transmits identification information corresponding to a portion such as a printed character string. To do.

  Then, the information processing apparatus 1 that has received the target area information transmitted in response to the request from the recording apparatus 2 converts the received target area information (represented by the coordinate system of the paper medium P) into one of the conversion formula pairs. Is converted into the coordinate system of the surface S. Then, the display unit 14 is controlled to illuminate a portion corresponding to the range of the surface S represented by the converted coordinate system. As a result, it is possible to illuminate a portion desired by the creator of the information recorded on the paper medium P.

[Other examples of lighting]
Note that the illumination method by the display unit 14 is not limited to simply turning on and off, and as an example, the display unit 14 includes a multicolor LED or a color liquid crystal display device, and the paper medium P When there are a plurality of pieces of target area information associated with the identification information, the illumination areas corresponding to the target area information may be lit in different colors. Here, when the time information is further associated with the target area information, the lighting color may be controlled in accordance with the time information (for example, the brighter the earlier time). Moreover, you may vary a lighting mode by a blink pattern.

It is a block diagram showing the example of a structure of the information processing apparatus which concerns on embodiment of this invention, and a connection example. It is explanatory drawing showing the example of an external appearance of the information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing the example of a setting of the illumination area illuminated with the information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing the example of entry operation and entry content which a user performs in the information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing the example of the coordinate setting of the illumination area in the information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing the area | region used as the object of entry operation made a user perform in the information processing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing the example of the process which the information processing apparatus which concerns on embodiment of this invention detects a relative position based on the content of entry operation. It is explanatory drawing showing the example which the information processing apparatus which concerns on embodiment of this invention detects a relative position using a wireless tag. It is explanatory drawing showing the example of the information recorded in a recording device by the information processing apparatus which concerns on embodiment of this invention. It is a flowchart figure showing the example of the recording process by the information processing apparatus which concerns on embodiment of this invention. It is a flowchart figure showing the example of the illumination process by the information processing apparatus which concerns on embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Information processing apparatus, 2 Recording apparatus, 11 Control part, 12 Storage part, 13 Operation part, 14 Display part, 15 Medium detection part, 16 Communication part.

Claims (8)

Communication means for communicating with a recording apparatus in which a medium identifier for identifying a paper medium is associated with at least one area information for specifying an area on the medium;
Selective illumination means having a surface capable of supporting the entire paper medium and selectively illuminating any of a plurality of predetermined areas on the paper medium;
Detecting means for detecting a medium identifier for identifying a paper medium supported on the surface;
Obtaining means for obtaining area information recorded in the recording device in association with the detected medium identifier via the communication means;
Control means for controlling to illuminate an area corresponding to the acquired area information;
Including
The control means detects the relative position between the paper medium and the surface based on the content entered by the user on the paper medium, and controls the area illuminated by the detected relative position. Processing equipment.   2. The control unit according to claim 1, wherein the control unit detects a relative position between the paper medium and the surface on the basis of contents entered by a user at a plurality of predetermined positions on the paper medium. Information processing device.   The control means detects a relative position between the paper medium and the surface based on an anisotropic entry made by a user at a predetermined position on the paper medium. Item 4. The information processing apparatus according to Item 1.   The control means accepts the entry contents made by the user at a predetermined position on the paper medium, detects an area circumscribing the entry contents, and based on the feature amount of the detected area, the paper medium The information processing apparatus according to claim 1, wherein a relative position with respect to the surface is detected. A code image capable of detecting an inclination angle is formed on the back surface of the paper medium,
In the plane, provided with imaging means for imaging the back side of the medium placed on the surface,
The control means includes a paper medium, the surface , based on a code image at a back side position corresponding to a position written by a user on the paper medium among images of the back side of the medium picked up by the image pickup means. The information processing apparatus according to claim 1, wherein the relative position is detected. The paper medium is formed with a code image capable of detecting an inclination angle,
In the plane, provided with imaging means for imaging the back side of the medium placed on the surface,
The control means detects a code image from an area in a predetermined range including a position entered by a user on a paper medium among images on the medium surface side picked up by the imaging means through the medium. The information processing apparatus according to claim 1, wherein a relative position between the paper medium and the surface is detected based on the detected code image . In the plane, provided with imaging means for imaging the back side of the medium placed on the surface,
The fiber identifier unique to each paper medium is imaged by the imaging unit, and the medium identifier is detected based on the captured fiber structure. Information processing device. Computer
Communication means for communicating with a recording apparatus in which a medium identifier for identifying a paper medium is associated with at least one area information for specifying an area on the medium;
Selective illumination means for controlling a selective illumination unit arranged on a surface capable of supporting the entire paper medium and selectively illuminating any of a plurality of predetermined areas on the paper medium;
Detecting means for detecting a medium identifier for identifying a paper medium supported on the surface;
Via the communication means, acquisition means for acquiring area information recorded in the recording device in association with the medium identifier detected on the surface;
Based on the contents entered by the user on the paper medium, the relative position between the paper medium and the surface is detected, and the region of the surface corresponding to the acquired region information is illuminated using the detected relative position. Control means for controlling
A program characterized by functioning as

Images