JPH11308607A - Display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display book information which are stored electronically, magnetically or optically with ease of reading like a book as a medium by receiving an image of a book on which texture information is projected and projecting selected texture information based on the received image. SOLUTION: A CCD camera 2 photographs the image of a spread book 1, and an image recognition section 3 receives the image and stores it. After recognizing pages by the image recognition section 3, it. After recognizing pages by the image recognition section 3, the section 3 gives the recognized information to an image selection section 4. An image modification section 7 stores the image information of the book 1 fed from the image recognition section 3 in a memory 71 and stores the image information fed from the image selection section 4 in a memory 72. Then the section 7 modifies and maps the image stored in the memory 72 in the form of an area of the book 1, which is stored in a memory 73. A projection display section 8 projects the image stored in the memory 73. Thus, the information corresponding to the spread pages is displayed on the pages of the book 1, and the resulting information is displayed for ease of reading.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a device for displaying information stored electronically, magnetically or optically.

[0002]

2. Description of the Related Art Conventionally, as an apparatus for displaying book information stored electronically, magnetically, or optically, information stored in a database as disclosed in Japanese Patent Application Laid-Open No. 5-257991 is disclosed. When displaying, there are some that are displayed in a format that is similar to the display of a book. Japanese Patent Laid-Open Publication No. 6-290017 discloses a technique for switching the display with a feeling similar to that of paper by attaching a transparent pseudo page on the display unit and detecting the page turning of the pseudo page to switch the display screen. Is described.

[0003]

However, all of the above-mentioned prior arts display information on a display device, and have a problem that they are not as readable as a book using paper as a medium.

[0004] It is an object of the present invention to provide a display device which displays an electronic, magnetic, or optically stored book information in a manner that is easy to read like a book using a medium as a medium.

[0005]

SUMMARY OF THE INVENTION The object of the present invention is to provide a storage device for storing texture information, a camera for capturing an image of a booklet for projecting texture information, and a storage device for storing texture information to be projected from an image captured from the camera. This can be achieved by a selecting unit for selecting and a projecting unit for projecting the texture information selected by the selecting unit based on an image captured from the camera.

[0006]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to FIG. In FIG. 1, reference numeral 1 denotes a blank booklet on which vertical ruled lines are printed at regular intervals with page numbers, 2 denotes a CCD camera,
Is an image recognition unit, 4 is an image selection unit that selects texture information corresponding to the page number recognized by the image recognition unit 3, and 5 is C
A CD-ROM drive for reading information from the D-ROM 6; and an image transformation unit 7 for transforming the texture information read by the CD-ROM drive 5 based on the shape of the open page of the booklet 1 recognized by the image recognition unit 3. Reference numerals 8 denote projection display units which project the image deformed by the image deforming unit onto the open paper surface of the booklet 1.

When an appropriate page of the booklet 1 is opened and the apparatus is operated, first, the CCD camera 2 captures an image of the opened booklet 1, and the image recognition unit 3 inputs the image and inputs the image to the memory 31. Store the image.

The image recognition unit 3 is a so-called image processing device.
The input image data is stored in the memory 31, and the page number of the opened page of the booklet 1 is recognized from the image. Here, there are various recognition methods. For example, an input image is binarized to specify a region of the booklet 1, a page number region is cut out from the specified region of the booklet 1 by position information or the like, and is matched with a numeric template. Recognize by

In this example, the opened page is recognized from the printed page number. In addition, a method for recognizing from a symbol such as a bar code, a method for specifying a page by key input, a method for recognizing a voice, There is a method to specify the. If you identify a page by keystroke or voice,
A method of identifying a subsequent page by recognizing the page turning can be considered.

After recognizing the page, the image recognizing section 3 sends the information to the image selecting section 4.

The image selector 4 comprises a memory 41 for storing page information, a device driver for controlling the CD-ROM drive 5, a memory 42 for storing image data read from the CD-ROM, and the like. The image selecting unit 4 receives the page information from the image recognizing unit 3 (stored in the memory 41), controls the CD-ROM drive 5 based on the page information, and displays an image corresponding to the page recognized by the image recognizing unit 3. The image is read from the CD-ROM 6 and the read image is stored in the memory 42.

The image transforming section 7 has a memory 71 for storing the image information of the booklet 1 sent from the image recognizing section 3, a memory 72 for storing the image information of the CD-ROM sent from the image selecting section 4, The image processing unit includes an image processing unit that generates an image to be projected by the projection display unit 8 from the type of image information, and a memory 73 that stores a projection image generated by the image processing unit.

The image transforming section 7 stores the image information of the booklet 1 sent from the image recognizing section 3 in the memory 71, and stores the image information of the CD-ROM sent from the image selecting section 4 in the memory 72.
To be stored. Then, the image stored in the memory 72 is transformed and mapped in the area of the booklet 1 of the memory 71, and the image is stored in the memory 73.

Here, an example of the mapping method will be described with reference to FIG. The image of the booklet 1 stored in the memory 71 is divided vertically so that each of the vertical ruled lines printed on the booklet 1 becomes a square. On the other hand, the images stored in the memory 72 are equally divided in the vertical direction by the same number as the images in the memory 71. Next, each divided area of the image stored in the memory 72 is enlarged / reduced or trapezoidally deformed by the image processing unit 74 in accordance with the size and shape of the corresponding divided area of the image stored in the memory 71, and is then stored in the memory. 73.

The projection display unit 8 projects an image stored in the memory 73. Here, the calibration is performed by fixing the relative positions of the projection display unit 8 and the CCD camera 2 so that the image stored in the memory 73 is projected onto the opened page of the booklet 1 when projected.

As described above, on the opened page of the booklet 1,
The information corresponding to the page is displayed, and the user can read the electronic information as if reading a book.

In the above example, the medium storing the book information is a CD-ROM, but other media such as a DVD-ROM may be used.

Another embodiment of the present invention will be described with reference to FIG. 1 to 7 in FIG. 3 are the same as in FIG. 1, 9 is a see-through type head mounted display, and 10 is a user.

This example is the same as the previous example until the image is deformed. However, the deformed image is not directly projected on the booklet 1 but is displayed on the see-through type head mounted display 9. Here, the displayed image is booklet 1
To make it appear on the opened page of,
See-through type head mounted display 9 and C
The relative position of the CD camera 2 is fixed in advance.

[0020]

According to the present invention, it is possible to provide an apparatus which displays electronically, magnetically or optically stored book information in a manner easy to read like a book using paper as a medium.

[Brief description of the drawings]

FIG. 1 is a diagram showing an example of a display device of the present invention.

FIG. 2 is a diagram showing a part of the processing of the display device of the present invention.

FIG. 3 is a diagram showing another example of the display device of the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Booklet, 2 ... CCD camera, 3 ... Image recognition part, 4 ... Image selection part, 5 ... CD-ROM drive, 6 ... CD-RO
M, 7: image deformation unit, 8: projection type display unit.

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Toshiaki Nakamura 7-1-1, Omikacho, Hitachi City, Ibaraki Prefecture Within Hitachi Research Laboratory, Hitachi, Ltd. (72) Inventor Tatsuki Inumuka 7 Omikacho, Hitachi City, Ibaraki Prefecture No. 1-1 Inside Hitachi, Ltd.Hitachi Research Laboratory (72) Inventor Shoji Yoshida 7-1-1, Omika-cho, Hitachi City, Ibaraki Prefecture Inside Hitachi, Ltd.Hitachi Research Laboratory (72) Inventor Dai Fujii Hitachi, Hitachi, Ibaraki Prefecture 7-1-1, Omikacho Inside Hitachi Research Laboratory, Hitachi, Ltd.

Claims (4)

[Claims] 1. A storage device for storing texture information, a camera for capturing an image of a booklet onto which texture information is projected, a selection unit for selecting texture information to be projected from the image captured from the camera from the storage device, A display comprising: an image deforming unit that deforms texture information selected by the selection unit based on an image captured from the camera; and a projection unit that projects texture information deformed by the deforming unit. apparatus. 2. The display device according to claim 1, wherein said projection unit displays said texture information on a transparent medium. 3. The display device according to claim 1, wherein said selection unit selects texture information from said storage device based on audio information. 4. The display device according to claim 1, wherein the deforming unit deforms the texture information and the moving image based on an image captured from the camera, and the projecting unit deforms the texture image and the moving image by the deforming unit. A display device for projecting a moving image.