JP2009143232A - Message writing and reproduction apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily conduct the recording/reproduction of a message to contents recorded corresponding to an arbitrary position of an arbitrary page of a content recording medium by writing no content of a book and a photographic album, etc. directly in the content recording medium of a book, a photographic album, etc. <P>SOLUTION: A message writing and reproduction apparatus has a photographing means, a photographing instructing means for instructing the photographing means to photograph except a content recording medium specified in an arbitrary position or further the page specified in an arbitrary position and a positional information acquiring means having a recognizing means with the discriminating information of the content recording medium from the photographed image of the photographing means, the information of the page specified at an arbitrary position and the positional information relative to the page of the arbitrary position as positional information, a related information input means for inputting the related information of a specified position, and a message information recording means for recording the positional information by making the related information associate with the positional information as message information in a storing device. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a message recording and reproducing apparatus and method, and specifies a predetermined place in the recording medium for various items, particularly content recorded on a physical recording medium such as a book, a notebook, or a newspaper. The present invention relates to a message recording and reproducing apparatus in which when a message is input or related information is designated, the message or related information is automatically reproduced at a predetermined location in the recording medium.

Conventionally, as a way of enjoying content recorded on a recording medium such as a book, a notebook, or a newspaper, or content by television broadcasting or radio broadcasting, most of them are passive ways of enjoying simply receiving it.
Here, as an active way of enjoying content recorded on a physical (hardware) recording medium such as a book, notebook or newspaper, for example, message information or the like is given to a predetermined page of the book. When you read the book again later, when you open the page, the message information that was previously given is played back, or the message information is transmitted to a friend, etc., and the friend opens the same page of the same book It is conceivable that the message information is reproduced or the message information is transmitted through a recording medium.

Conventionally, however, there is no method for transmitting message information via a recording medium by easily giving (recording) or reproducing the message information to the recording medium as described above. There was only something that would write a message.
For example, as a method for writing a message on a photographic print as a physical recording medium, Patent Document 1 discloses a message from a third party when reproducing captured image data as a visible image in order to enhance the entertainment of the photograph. A method and system for reproducing an image with a message to be synthesized is disclosed.
In other words, this creates a reference image to which a message is written from the image data of the captured image to be reproduced, transmits the reference image to a third party to write a message from an acquaintance or friend, writes the message and returns it. A photograph print in which the returned message is combined with the photographed image to be reproduced in a writing style is output.

JP 2001-268342 A

However, when using a medium such as a physical recording medium, not only passively enjoying content etc., but also recording messages not only in one direction, but also easily recording and reproducing messages. Therefore, it is desired to realize communication via a recording medium.
In this regard, the one described in Patent Document 1 transmits an image to which a message is to be written to a third party who has the message written, and outputs an image obtained by synthesizing the third party message to which the message has been written. However, there is a problem in that it does not correspond to sending one's own message and it takes time and effort to send an image to which a message is written to a third party.

In addition, when message information cannot be directly written in a book, notebook, photo album, or the like, the message information is written on other paper or input to a personal computer. In addition, when reading a book or the like, a related item or the like may be checked on an Internet site or the like.
In these cases, when the book or notebook is read again later, if the position (page, etc.) in the book is not associated with the previously written message information, the message information is reproduced, There is a problem that the reference becomes very complicated.

  The present invention has been made in view of the above-described conventional problems, and makes it possible to easily record and reproduce message information on various articles, particularly content recorded on a physical recording medium, It is another object of the present invention to provide a message recording and reproducing apparatus that realizes communication with a third party through content and improves entertainment in content appreciation.

  In order to solve the above problems, a message recording apparatus of the present invention includes a photographing unit that photographs a content recording medium, the content recording medium in which an arbitrary position is designated for the photographing unit, or the content recording medium. Image capturing instruction means for instructing to image other than the specified page of the arbitrary position of the medium, and an image of the content recording medium captured by the image capturing means, receiving the identification information of the content recording medium, the content recording Position information recognition means for recognizing information on a page in which an arbitrary position of the medium is designated and relative position information with respect to the page at the arbitrary position designated in the content display area in the page as position information Position information acquisition means having a function for inputting information related to the designated position. A message recording apparatus comprising: information input means; and message information recording means for recording the information as message information in association with the position information and the access destination of the related information or the related information. provide.

In such a message recording apparatus of the present invention, it is preferable that the message information includes at least one of text data, audio data, handwritten characters, and pictures, and the content recording medium is a book, a notebook, , Newspapers, and photo albums, and the pages other than the page on which the arbitrary position of the content recording medium is designated are preferably covers of the content recording medium.
Further, identification information of the content recording medium is recognized from a photographed image other than the page for which the arbitrary position of the content recording medium is designated, and the page of the content recording medium is designated from the photographed image of the content recording medium for which the arbitrary position is designated. It is preferable to recognize the information and the relative position information with respect to the page, or from the captured image of the content recording medium in which the arbitrary position is designated, the identification information of the content recording medium, the information of the page, and the page It is preferable to recognize relative position information with respect to.

  Further, the message playback device of the present invention is a message playback device for playing back the message information recorded by the message recording device of the present invention, the shooting means for shooting the content recording medium, and the shooting means, The content recording medium in which an arbitrary position is designated, or the photographing instruction means for instructing to photograph a predetermined page other than the page in which the arbitrary position is designated on the content recording medium, and the content photographed by the photographing means Receiving the image of the recording medium, the identification information of the content recording medium, the information of the page of the content recording medium, and the relative position information with respect to the page at the arbitrary position specified in the content display area in the page Position information recognizing means for recognizing position information comprising: the content Search means for searching the storage device for message information corresponding to the position information in the recording medium, and message information corresponding to the position information in the content recording medium when the message information is detected. There is provided a message reproduction device characterized by comprising message information output means for outputting.

In such a message reproducing device of the present invention, the message information to be output preferably includes any one or more of text data, audio data, handwritten characters, and pictures, and the content recording medium is a book. , Notes, newspapers, and photo albums, and the predetermined page is preferably a cover of the content recording medium.
Further, the identification information of the content recording medium is recognized from the photographed image of the predetermined page, and the information of the page and the relative position information with respect to the page are recognized from the photographed image of the content recording medium in which the arbitrary position is designated. Preferably, the identification information of the content recording medium, the information of the page, and the relative position information with respect to the page are preferably recognized from the captured image of the content recording medium in which the arbitrary position is designated.
Further, when outputting the message information as a visible image, it is preferable to synthesize and output the message information to a captured image by the imaging unit, and in this case, a mode for outputting only the message information, It is preferable to set a mode in which message information is combined with a photographed image and output.

According to the present invention having the above-described configuration, it is possible to easily record and reproduce message information on various articles, particularly content recorded on a physical recording medium, and as a result, a common physical Communication with a third party via the content recording medium can be easily realized.
In addition to communication with such third parties, it is very convenient for use by oneself. For example, in the past, books were written directly or marked with a marker pen, but the book looked bad, and there was a problem that it was difficult to correct by writing directly. According to the invention, the previous writing and marker can be synthesized and displayed on the corresponding page of the book on the monitor, and since the writing and the mark can be corrected any number of times, the information can be recorded without damaging the book itself. Playback can be performed.

  Hereinafter, a message recording and reproducing apparatus according to the present invention will be described in detail based on a preferred embodiment shown in the accompanying drawings.

FIG. 1 is a block diagram showing a schematic configuration of a message recording / reproducing system having functions of both a message recording apparatus and a message reproducing apparatus according to the first embodiment of the present invention.
As shown in FIG. 1, this message recording / reproducing system mainly includes an IC tag sensor 14 that detects a book 12 by communicating with a content recording medium 12 having an IC tag 10 (for example, a book 12 hereinafter) IC tag 10. , A photographing means 16 for photographing the book 12 (for example, a digital camera hereinafter simply referred to as a camera 16) and a personal computer 20 having various functions.

The personal computer 20 includes an imaging instruction unit 22, a position information recognition unit 24, a message information recording unit 26, a memory 28, and a search unit 30.
The personal computer 20 is connected to an input means 32 for inputting message information, a monitor 34 for outputting (reproducing) the message information, a speaker 35, a printer 36, and the like. Further, the personal computer 20 is connected to a network 40 such as the Internet. Connected with.

As shown in the figure, when the content recording medium is book 12, IC tag 10 is attached to the back cover, the front cover, the back cover, or the like. Further, when the book 12 is placed on a desk 42 as shown in the figure, for example, the IC tag sensor 14 is installed on the desk 42.
Further, the camera 16 is mounted directly above the book 12 by a lighting fixture such as a ceiling 44 or a fluorescent lamp or a dedicated mounting means as shown in the figure.

  When receiving the detection signal of the book 12 from the IC tag sensor 14, the shooting instruction unit 22 instructs the camera 16 to take a picture of the book 12. As described above, the camera 16 is arranged immediately above the book 12 that is a content recording medium, and captures the entire page of the book 12 that is opened at that time.

The position information recognition unit 24 acquires an image of the book 12 taken by the camera 16, detects, for example, the position on the page of the book 12 pointed by the user of the system from the taken image, and obtains the position information. To create.
In this case, when the user points to a predetermined position on a certain page of the book 12 using a predetermined pointing device at the time of shooting, the pointing device (for example, the tip) is detected from the captured image. This is preferable because the designated position can be easily detected.

The message information recording means 26 is created by the position information recognition means 24 and the related information such as a message corresponding to the position indicated on the book 12 input by the system user from the input means 32 or the access destination of the related information. It is recorded in memory (storage device) 28 as message information in combination with position information. The memory 28 is an internal memory of the personal computer 20 in the figure, but is not limited to this, and may be an external storage device.
In the personal computer 20, the photographing instruction means 22, the position information recognition means 24, the message information recording means 26, and the memory 28 are parts that function as a message recording device.

  The retrieval means 30 uses the position information obtained from the image obtained by photographing the book 12 as described above at the time of message reproduction, and whether the message information corresponding to the position information is recorded in the memory 28 or the If the message information exists, the message information is output (reproduced) to the monitor 34 or the printer 36.

  The input means 32 is for the system user to specify a predetermined position of the book 12 (for example, a line on a page with a book) and to input related information such as a message related to the position. Examples include a keyboard for inputting data, a microphone for inputting audio data, or a scanner for reading and inputting handwritten characters and pictures.

Hereinafter, the operation of the present embodiment will be described with reference to flowcharts for message recording and message reproduction.
FIG. 2 is a flowchart showing the flow of processing when a message is recorded in the message recording / reproducing system of this embodiment.
First, a message recording method will be described with reference to FIG.

When the user of this system places and opens the book (content recording medium) 12 with the IC tag 10 on the desk 42 in step S100 of FIG. 2, the IC tag sensor 14 installed on the desk 42 is opened in step S110. The IC tag 10 attached to the book 12 is communicated to detect (identify) the book 12.
The detection signal is transmitted from the IC tag sensor 14 to the personal computer 20 and input to the imaging instruction means 22 and the position information recognition means 24.

  Next, in step S120, the system user points to a place on a page of the book 12, and the entire book 12 is photographed by the camera 16 installed immediately above the book 12. Photographing is performed when the photographing instruction means 22 that has received the detection signal of the book 12 from the IC tag sensor 14 issues an instruction to the camera 16. This shooting may be performed automatically and continuously at predetermined time intervals when the shooting instruction means 22 receives the detection signal of the book 12, or while the user indicates the position where the book 12 is located, For example, the camera 16 may be instructed through the photographing instruction unit 22 from the input unit 32 or the like. The photographed image data of the book 12 photographed by the camera 16 is sent to the position information recognition means 24.

Next, in step S130, the position information recognition unit 24 identifies the book 12 based on the detection signal of the book 12 sent from the IC tag sensor 14, and recognizes the position pointed to by the user from the captured image data. At this time, the page or the like of the book 12 may be identified by character recognition from the captured image data, or may be input by the user using the input unit 32. For example, the user may input by voice through a microphone.
By these methods, the page of the book 12 and a predetermined position in the page are recognized, and position information indicating the position in the book 12 is created. The created position information is sent to the message information recording means 26.

Next, in step S140, related information for the position in the book 12 specified above is input from the input means 32 by the user. That is, a message that the user wants to give to a position in the book 12 and related information that can be referred to later when the book 12 is read again are input by a keyboard, a microphone, or a scanner. When the user instructs the camera 16 via the shooting instruction unit 22 to perform shooting, the related information may be input from the input unit 32 subsequent to shooting. However, the present invention is not limited to this, and it can be performed at an arbitrary time. In that case, for example, the position information already created and stored in the message information recording means 26 is displayed on the monitor 34 by operating the input means 32, and the position information to which the relevant information is to be added is designated from among them. Then, it is sufficient to input related information for this. In any case, the position information and the related information may be input in correspondence.
The related information is input to the message information recording unit 26.

In addition, the related information is not limited to information input by the user himself / herself. For example, the related information may be supplier-provided information attached to the book 12 provided by the supplier at the time of selling the book, or the portion of the book 12. It is also possible to download information related to the information from the Internet site or the like and use it as related information.
At this time, the related information itself may be held in another storage device or the like, and only the access destination (for example, the access destination of the Internet site) may be input to the message information recording means 28.

Next, in step S150, the message information recording unit 26 creates message information by combining the position information and the related information (or the access destination of the related information), and records this in the memory 28.
In this way, the user can attach related information such as information, impressions, or memorandums as references while reading a book. Further, the content recording medium is not limited to a book, and related information can be attached to various items such as a notebook, a newspaper, or a photo album.

Next, a message reproduction method will be described.
FIG. 3 is a flowchart showing the flow of processing when a message is reproduced in the message recording / reproducing system of this embodiment.

  First, in step S200 of FIG. 3, when the system user places and opens the book 12 with the IC tag 10 on the desk 42, the IC tag sensor 14 installed on the desk 42 is attached to the book 12 in step S210. The book 12 is detected by communicating with the IC tag 10 made. The detection signal is transmitted from the IC tag sensor 14 to the personal computer 20 and input to the imaging instruction means 22 and the position information recognition means 24.

Next, in step S220, the system user points to a place on a certain page of the book 12 and photographs the entire book 12 with the camera 16 installed immediately above. The shooting may be performed by pointing the user to a place where message information is likely to be attached and issuing an instruction to the camera 16 via the shooting instruction unit 22. When the detection signal is received, the photographing may be automatically performed continuously at a predetermined time interval, and the user may point to a predetermined place of the book 12 in accordance with the timing of the photographing.
The photographed image data of the book 12 photographed by the camera 16 is sent to the position information recognition means 24.

Next, in step S230, the position information recognition unit 24 identifies the book 12 based on the detection signal of the book 12 sent from the IC tag sensor 14, and recognizes the position pointed to by the user from the captured image data. Create information.
Next, in step S240, the search means 30 searches the memory 28 for message information corresponding to this position information.

  If message information corresponding to the position information is found, the message information is reproduced in step S250. The method for reproducing the message information is not particularly limited. For example, the message information may be displayed on the monitor 34 and reproduced by sound from the speaker 35, or may be output from the printer 36 to a paper medium, or other reproduction methods. Good.

As described above, according to the present embodiment, while viewing a content recording medium such as a book, a notebook, a newspaper, an album, or the like, related information is given everywhere in the content recording medium, and the content recording medium is again used later. By simply pointing to an appropriate place in the content recording medium when viewing, the related information attached thereto can be automatically reproduced.
In addition, as shown in the example shown above, for example, the related information may be given to a certain page as well as specifying a certain place in a certain page in a book, In some cases, it may be given to the book itself.
When related information is given to a page, when the camera recognizes that the page in the book is open, the related information for the page is automatically played back. . When related information is attached to the book itself, the book is placed on the desk, and when the book is recognized by the IC tag sensor, the related information for the book is automatically reproduced.

Next, a second embodiment of the present invention will be described.
FIG. 4 shows a schematic configuration of a message recording / reproducing system having a message recording / reproducing apparatus according to the second embodiment of the present invention.
In the message recording / reproducing system of this embodiment, the message recording side 100 and the message reproducing side 200 are connected by a network 140.

The recording side 100 of the message recording / reproducing system shown in FIG. 4 includes an IC tag sensor 114 that communicates with an IC tag 110 attached to a content recording medium (book) 112, a camera (digital camera) 116 that shoots the book 112, and shooting instruction means. 122, a position information recognition unit 124, a message information recording unit 126, and a memory 128, and is mainly composed of a personal computer 120 to which an input unit 132, a monitor 134, and the like are connected.
On the other hand, the playback side 200 includes an IC tag sensor 214 that communicates with an IC tag 210 attached to a content recording medium (book) 212, a camera 216 that shoots the book 212, a shooting instruction unit 222, a position information recognition unit 224, and a memory 228. , And a personal computer 220 to which a monitor 234, a speaker 235, a printer 236 and the like are connected as a message reproduction (output) means.

Here, the message recording side 100 shows at least only the components necessary for recording message information, and the message playback side 200 shows at least only the components necessary for playback of message information. For the sake of convenience, the message recording side 100 and the message reproduction side 200 are separated for convenience, and both the message recording side 100 and the message reproduction side 200 have both functions as in the first embodiment. The same device can be used. The functions of the above-described components are the same as those in the first embodiment described above, and the detailed description is omitted with the last two digits being the same reference numerals.
Note that the book 112 and the book 212 may be the same book, and it is not necessary that the book 112 on the message recording side 100 is brought to the message reproduction side 200 and is physically identical.

Next, the operation of this embodiment will be described with reference to the flowchart of FIG.
The message information recording method and the reproducing method are basically the same as those of the first embodiment described above, and this embodiment is different from the first embodiment in that the message information is recorded and reproduced by another apparatus. The message information recorded on the message recording side 100 is transmitted to the message reproduction side 200 and reproduced on the message reproduction side.

  In FIG. 5, steps S300 to S340 are operations on the message recording side 100, and steps S350 to S380 are operations on the message reproduction side 200. On the message recording side 100, in step S300, the predetermined position of the book 112 is designated and the book 112 is photographed by the camera 116. In step S310, the position information is recognized from the photographed image, and the position information is created. In step S320, The related information corresponding to the position information is input, and message information is created and recorded by combining the position information and the related information in step S330. The above operation is the same as the message recording method shown in FIG.

Next, in step S340, the message recording side 100 records the message information and transmits the message information to the reproduction side 200 at the same time. When the message reproduction side 200 receives the message information, it stores it in the memory 228.
The message recording side 100 repeats the above operation as necessary, records all message information for the book 112, transmits the message information to the message reproduction side 200 via the network 140, and stores it in the memory 228 of the message reproduction side 200. accumulate.

Hereinafter, Step S350 to Step S380 are operations of the message playback side 200. The operation of the message playback side 200 is basically the same as the message playback method of FIG.
That is, when a system user on the message playback side 200 reads the same content recording medium as the message recording side 100, for example, the same book 212 as the book 112, the camera 216 points to an appropriate position of the book 212 in step S350. In step S360, the position information on the book 212 is recognized from the photographed image. In step S370, whether the message information corresponding to the position information has been accumulated or not is stored in the memory 230 based on the position information. Search in 228.

If message information corresponding to the position information is detected as a result of the search, the message information is read from the memory 228 and is reproduced from message reproduction (output) means such as the monitor 234, the speaker 235, and the printer 236.
At this time, when the message information has not the related information itself but an access destination of the related information, the search unit 230 accesses the access destination to call up the related information and reproduce it.

As described above, according to the present embodiment, when related information given to a predetermined location of a content recording medium is transmitted to a friend or the like and the friend refers to the same content recording medium, the related information is reproduced. By doing so, communication with a third party using this message recording / reproducing system can be realized.
The above example is a case of a book with the same title. However, in the case of a photographic print, information based on a common photographic scene can be obtained by attaching an IC tag that records identification information common to the reprinted print. Can communicate.

Next, a third embodiment of the present invention will be described.
In the first and second embodiments described above, the captured image by the camera is used to designate and recognize the position on the content recording medium, but this embodiment further simplifies the position recognition. Is.

FIG. 6 shows a schematic configuration of the message recording / reproducing system of the present embodiment.
As shown in FIG. 6, in this embodiment, in order to easily recognize the position on the content recording medium, a sheet 312 on which a special dot pattern is formed is used as the content recording medium. Can be detected by tracing with a detection means such as an electronic pen 314 with a scanner.
In this way, the configuration is the same as that of the above embodiment except that the special sheet 312 and the electronic pen 314 are used to detect the position.

  That is, the position on the content recording medium (sheet 312) detected by the electronic pen 314 is input to the position information recognition means 324 of the personal computer 320. The personal computer 320 includes other message information recording means 326, A memory 328 and search means 330 are provided. The personal computer 320 is connected to input means 332 such as a keyboard, microphone or scanner, message reproduction means such as a monitor 334, a speaker 335, and a printer 336.

Hereinafter, the operation of this embodiment will be described with reference to FIGS.
First, a message recording method will be described with reference to FIG.
In step S400 of FIG. 7, a predetermined position on the content recording medium (for example, a book or notebook using the sheet 312) is designated by the electronic pen (detection means) 314. A special dot pattern is formed on the sheet 312, and the position on the sheet 312 can be specified by tracing this with the electronic pen 314 and reading the special dot pattern. .

In step S410, the specified position is input to the position information recognition unit 324 of the personal computer 320. The position information recognition unit 324 creates position information indicating a predetermined position on the sheet 312 based on the specified position, and sends the position information to the message information recording unit 326 and the search unit 330.
Next, in step S420, related information corresponding to the upper position information is input from the input means 332. As described above, the input of the related information is not necessarily performed immediately after the position is specified, and can be performed at an arbitrary time as long as it corresponds to the position information.
Next, in step S430, the message information recording unit 326 creates message information by combining the position information and the related information, and records the message information in the memory 328.

Next, a message reproduction method will be described with reference to FIG.
In step S500 of FIG. 8, a predetermined position on the sheet 312 as the content recording medium is designated by the electronic pen 314 serving as a detection unit. By specifying with the electronic pen 314, the position on the sheet 312 is specified. A signal from the electronic pen 314 is input to the position information recognition unit 324 of the personal computer 320.

In step S <b> 510, the position information recognition unit 324 creates position information on the sheet 312 from the position specified by the electronic pen 314 and sends the position information to the search unit 330.
Next, in step S520, the search unit 330 searches the memory 328 for message information corresponding to the position information based on the sent position information.

If message information corresponding to the position information is detected as a result of the search, the related information is reproduced by message reproduction means such as the monitor 334 in step S530.
As described above, according to the present embodiment, by using the sheet 312 on which a special dot pattern is formed as the content recording medium, the position can be specified simply by pointing the position on the sheet 312 with the electronic pen 314. It is possible to specify the position much more easily than when the position is recognized by photographing the content recording medium and processing the photographed image for analysis.

Although the message recording and reproducing apparatus of the present invention has been described in detail above, the present invention is not limited to the above embodiment, and various improvements and modifications can be made without departing from the gist of the present invention. Of course you can go.
It should be noted that when outputting to a monitor or a printer, a mode for outputting only relevant information and a mode for synthesizing relevant information at a corresponding position in a photographed image by the camera 16 may be set.

The camera in the above example may be either a fixed camera or a portable camera (such as a digital camera or a camera-equipped mobile phone). Further, in order to recognize a predetermined position on the recording medium, it is not always necessary to indicate the position.
Further, scene identification information for identifying the recording medium or the position on the recording medium may be created only by image recognition without using the IC tag sensor. For example, a cover title may be taken and the title may be converted into text data by character recognition. Alternatively, the captured image itself may be used as scene identification information. In this case, at the time of reproduction, collation processing with the message information is performed by pattern matching with the captured image. At this time, as the photographed image, for example, a three-stage photographed image of a book cover, a page, and a pointing finger may be used. However, the index finger is not always necessary. Alternatively, an image obtained by taking a photographic print may be used.
Alternatively, it can be implemented only with an IC tag system without using a camera. However, in the case of only the IC tag system, page designation and position designation must be performed separately by an input device or the like.

In the case of photographic prints, in reprint printing, a common identification number may be combined with a print margin or a print corner area and printed. As this identification number, for example, the photographer ID, date (date and time, time) and frame number. Etc. are exemplified.
At this time, each print may be recognized by reading the identification number with the camera 16 and recognizing characters.

As another application example of the present invention, as shown in FIG. 9, a person holding an wearable personal computer 54 with an IC tag 52 attached to various articles 50 such as books, photographs or clothes, If it has, the system may be such that the article ID held in the IC tag 52 with the human body as a conductor is transmitted to the wearable personal computer 52 and the article 50 is identified. At this time, for example, when the related information of the article 50 is recorded in the server 56 in advance, the server 56 is searched by the article ID, and the related information of the article is read out. The read information is displayed on the display screen of the wearable personal computer 54, for example.
Alternatively, when the article 50 is identified, new related information may be recorded in the server 56 from the wearable personal computer 54 in association with the article ID.

In addition, when a pressure sensor, an acceleration sensor, a temperature sensor, or the like is attached to the article 50 together with the IC tag 52, and a person has the article 50, an article ID is triggered by a change in detection data of the various sensors. , And the signal may be received by the receiver to identify an article whose data has changed. Alternatively, the sensor data may be transmitted together with the article ID. These signals are transmitted from the IC tag 52 to the receiver side. The receiver may be attached to the wearable personal computer 54 or may be a separate body.
Further, the article 50 may be specified by the above-described method, and information may be written in the IC tag 52 attached to the article 50 by data transmission by a personal computer or voice blowing.
By doing in this way, it becomes possible to record the related information on various articles not limited to the recording medium and to access the related information easily.

It is a block diagram which shows schematic structure of the message recording / reproducing system provided with the function of both the message recording device and message reproducing | regenerating apparatus concerning 1st Embodiment of this invention. It is a flowchart which shows the message recording method in 1st Embodiment of this invention. It is a flowchart which shows the message reproduction | regeneration method in 1st Embodiment of this invention. It is a block diagram which shows schematic structure of the message recording / reproducing system provided with the message recording device and message reproducing | regenerating apparatus concerning 2nd Embodiment of this invention. It is a flowchart which shows the message recording and reproducing method of 2nd Embodiment of this invention. It is a block diagram which shows schematic structure of the message recording / reproducing system provided with the function of both the message recording apparatus and message reproducing apparatus which concern on 3rd Embodiment of this invention. It is a flowchart which shows the message recording method in 3rd Embodiment of this invention. It is a flowchart which shows the message reproduction | regeneration method in 3rd Embodiment of this invention. It is explanatory drawing which shows the other example of application of this invention.

Explanation of symbols

10, 110, 210 IC tags 12, 112, 212 (content recording medium)
14, 114, 214 IC tag sensor 16, 116, 216 Camera (photographing means)
20, 120, 220, 320 Personal computer 22, 122, 222 Shooting instruction means 24, 124, 224, 324 Position information recognition means 26, 126, 326 Message information recording means 28, 128, 228, 328 Memory 30, 230, 330 Search Means 32, 132, 232, 332 Input means 34, 134, 234, 334 Monitor 35, 235, 335 Speaker 36, 236, 336 Printer 40, 140, 340 Network 42 Desk 44 Ceiling 50 Article 52 IC tag 54 Wearable personal computer 56 Server 100 Message recording side 200 Message playback side 312 Sheet (content recording medium)
314 Electronic pen (detection means)

Claims (14)

Shooting means for shooting a content recording medium, the shooting means for shooting the content recording medium in which an arbitrary position is specified, or a page other than the page in which the arbitrary position of the content recording medium is specified A shooting instruction means for instructing, an image of the content recording medium taken by the shooting means, identification information of the content recording medium, information of a page in which an arbitrary position of the content recording medium is designated, and this Position information acquisition means having position information recognition means for recognizing relative position information of the arbitrary position specified in the content display area in the page as the position information;
Related information input means for inputting information related to the designated position;
A message recording apparatus comprising: message information recording means that records the position information in association with the related information or an access destination of the related information as message information in a storage device.   The message recording apparatus according to claim 1, wherein the message information includes one or more of text data, audio data, handwritten characters, and pictures.   The message recording apparatus according to claim 1, wherein the content recording medium is one of a book, a notebook, a newspaper, and a photo album.   The message recording apparatus according to claim 1, wherein a page other than the page in which the arbitrary position of the content recording medium is designated is a cover of the content recording medium.   Recognizing identification information of the content recording medium from a photographed image other than the page for which the arbitrary position of the content recording medium is designated, and information on the page from the photographed image of the content recording medium for which the arbitrary position is designated The message recording apparatus according to claim 1, wherein the message recording apparatus recognizes relative position information with respect to the page.   The identification information of the content recording medium, the information of the page, and the relative position information with respect to the page are recognized from a photographed image of the content recording medium in which the arbitrary position is specified. Message recording device. A message reproducing device for reproducing the message information recorded by the message recording device according to claim 1,
Photographing means for photographing the content recording medium;
Photographing instruction means for instructing the photographing means to photograph the content recording medium in which an arbitrary position is designated or a predetermined page other than the page in which the arbitrary position of the content recording medium is designated;
The image of the content recording medium photographed by the photographing means is received, the identification information of the content recording medium, the information of the page of the content recording medium, and the arbitrary position designated in the content display area in this page Position information recognition means for recognizing position information consisting of relative position information with respect to the page;
Search means for searching the storage device for message information corresponding to the position information in the content recording medium;
Message information output means for outputting message information when message information corresponding to position information in the content recording medium is detected;
A message reproducing apparatus comprising:   The message reproduction device according to claim 7, wherein the message information to be output includes at least one of text data, voice data, handwritten characters, and a picture.   The message reproducing apparatus according to claim 7 or 8, wherein the content recording medium is one of a book, a notebook, a newspaper, and a photo album.   The message reproduction device according to claim 7, wherein the predetermined page is a cover of the content recording medium.   The identification information of the content recording medium is recognized from the photographed image of the predetermined page, and the information of the page and the relative position information with respect to the page are recognized from the photographed image of the content recording medium in which the arbitrary position is specified. The message reproducing device according to any one of 7 to 10.   The identification information of the content recording medium, the information of the page, and the relative position information with respect to the page are recognized from a captured image of the content recording medium in which the arbitrary position is specified. Message playback device.   The message reproduction device according to claim 7, wherein when outputting the message information as a visible image, the message information is combined with the image captured by the imaging unit and output.   The message playback device according to claim 13, wherein a mode for outputting only the message information and a mode for outputting message information by combining with the captured image are set.

Images