JP2005275326A - Projection display device and projection display system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a projection display device which allows contents written as an indication point additionally to display information displayed on a projection display surface, to be electronized and displays the information to be electronized together with the display information. <P>SOLUTION: The projection display device displays drawing information generated on the basis of display information by a drawing means, on a drawing surface and displays the drawing information on a projection display surface by projection. An indication point is designated on the projection display surface by an indication point designation means, At this time, projection information on the projection display surface is imaged on an imaging surface by an imaging means. A position on the imaging surface corresponding to the designated indication point is measured on the basis of imaging information of the imaging means. Furthermore, a position of an indicated corresponding point corresponding to display information is calculated from measured position information of the indication point, and calculated indicated corresponding point information is stored in an indicated corresponding point information storage means. Drawing information wherein indicated corresponding point information and display information are put one over the other is generated by the drawing means and is displayed on the drawing surface. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a projection display device and a projection display system that project and display digitized display information on an arbitrary projection display surface.

Conventional projection display devices include, for example, devices for expressing display information (hereinafter also referred to as contents) such as text, images, charts, etc., and information processing / projection for projecting video on a remote display surface There have been proposed a small apparatus incorporating a display system or a data display function, and a small information processing apparatus incorporating a projector for projecting data on a remote surface (see, for example, Patent Document 1). ).
Japanese Patent Laid-Open No. 2001-2222067 (first page, FIG. 1)

In the conventional example described in Patent Document 1, since the projector is incorporated in the small information processing apparatus, it can be carried and displayed information stored in the small information processing apparatus when necessary. Can be projected onto an arbitrary projection display surface by the projector, but its use is merely to project and display the display information on a remote screen.
By the way, display information such as digitized documents in the industrial field and social life, for example, is printed and viewed on paper, and additional entries with writing instruments (hereinafter referred to as “red”) are made on the printed surface. Is often performed). In addition, display information is displayed on a computer display device (for example, a display) or a projector, and browsing is performed, and additional information is added to the display information by using a mouse or a keyboard (in red). There is also.

However, printing on paper leads to wasted paper resources and increased costs. Also, it is difficult to digitize the contents that are additionally written (red) on paper with a writing instrument. In addition, when using a display and a mouse / keyboard, the paper-like listability, parallel browsing, and portability are lacking. Furthermore, it is difficult for a display on a projector to browse a document individually for a meeting or the like.
The present invention has been made paying attention to such problems, and displays the digitized display information on a projection display surface such as paper at an actual size or a desired magnification, and further displays the display information. It is an object of the present invention to provide a projection display device and a projection display system that can digitize the contents additionally entered and display them together with display information.

  In order to solve the above problem, a projection display apparatus according to claim 1 includes a display information storage unit that stores display information, and a drawing that generates drawing information based on the display information stored in the display information storage unit. A projection display device having projection means for projecting and displaying the drawing information on the projection display surface, an imaging means for imaging the projection display surface on the imaging surface, and the projection display Based on the imaging information of the imaging means, the specified state determining means for determining whether the designated point designating means that directly designates the designated point on the surface is designated or not designated. An instruction point measuring means for measuring a position on the imaging surface, and an instruction for calculating the position of the instruction corresponding point corresponding to the instruction point in the display information from the position information of the instruction point measured by the instruction point measuring means Corresponding point calculation And instruction corresponding point information storage means for storing the instruction corresponding point information calculated by the instruction corresponding point calculation means, and the drawing means superimposes the image information and the display information based on the instruction corresponding point information. The drawing information is generated.

  The projection display device according to claim 2 is the projection display device according to claim 1, wherein the indication point designating unit is formed with a specific identification mark for indicating a position of the indication point on the projection display surface. The specified state determining means compares the distance of the projection display surface with respect to the specific identification mark of the contact and a predetermined threshold value, and specifies the specified point. It is characterized in that the means determines whether the designated point is designated or not designated.

According to a third aspect of the present invention, there is provided the projection display device according to the first or second aspect, wherein the designated point designating means designates a desired designated point on the projection display surface, and an indication One of the non-designated states in which no points are designated is configured to be selectable.
According to a fourth aspect of the present invention, there is provided the projection display device according to the third aspect, wherein the indication point designating means includes a contact having a specific identification mark for indicating the position of the indication point, and the contact Having an indication display mark for displaying the designated state when the projection touches the projection display surface.

  Moreover, the projection display apparatus which concerns on Claim 5 is a projection display apparatus as described in any one of Claims 1-4. WHEREIN: The said projection display surface is formed in the flexible member, The said projection Displacement determining means for determining whether or not the displacement is a predetermined displacement when the display surface is displaced, and the display information storage means based on the predetermined displacement of the projection display surface determined by the displacement determining means And display information rewriting means for rewriting the current display information stored in the above to another display information.

  According to a sixth aspect of the present invention, there is provided a projection display device comprising: a display information storage means for storing display information; a drawing means for generating drawing information based on the display information stored in the display information storage means; and the drawing information. Projection display means having projection means for projecting and displaying on a projection display surface formed on a flexible member, imaging means for imaging the projection display surface on the imaging surface, and displacement in the projection display surface A displacement determining means for determining whether or not the displacement is a predetermined displacement, and a current information stored in the display information storage means based on the predetermined displacement of the projection display surface determined by the displacement determining means A display information rewriting means for rewriting display information to another display information is provided.

  The projection display device according to claim 7 is the projection display device according to claim 5 or 6, wherein the display information rewriting unit is configured to perform a predetermined display on the projection display surface with the current display information and another display information. A plurality of pieces of division display information divided into predetermined intervals in the rewriting direction, and the respective pieces of division display information are sequentially rewritten in the predetermined rewriting direction at the predetermined intervals.

The projection display device according to claim 8 is the projection display device according to claim 7, wherein the display information rewriting means determines the predetermined interval or rewrite speed of the segment display information by the displacement determination means. It is characterized by changing according to the displacement.
The projection display device according to claim 9 is the projection display device according to any one of claims 5 to 8, wherein the display information rewriting means virtually sets a reference area on the projection display surface, According to the relative relationship between the reference point and the reference area when the inside of the reference area is instructed by the instruction point designating means, the display information corresponding to the relative relation is rewritten.

The projection display device according to claim 10 is the projection display device according to any one of claims 5 to 9, wherein the mark is instructed by a mark instruction means for instructing the mark on the display information currently displayed. Mark display information storage means for storing display information; mark position information storage means for storing mark position information for selecting display information in which the mark display information is set; and the drawing means includes the mark Generating drawing information by superimposing display information and the current display information;
The display information rewriting means rewrites the current display information to display information corresponding to the mark position information when the displayed mark display information is instructed by the pointing point designating means. Yes.

  The projection display device according to claim 11 is the projection display device according to any one of claims 1 to 10, wherein at least three reference points that are not in a straight line are set in the display information, On the projection display surface, a reference reference point corresponding to each of the reference points is designated, and each reference reference point measures the position of the imaging point imaged on the imaging surface, Distance measuring means for measuring a distance between a reference reference point and the imaging surface, and the drawing means is based on distance information and position information of each reference reference point respectively measured by the distance measuring means and the position measuring means. Thus, the drawing information such that each reference reference point and each corresponding reference point match is converted from the display information.

A projection display device according to claim 12 is the projection display device according to any one of claims 1 to 10,
In the display information, at least four reference points that are not on a straight line are set, and on the projection display surface, reference reference points respectively corresponding to the reference points are designated. Position measuring means for measuring a position where a reference point is imaged on the imaging surface; and coefficient calculating means for calculating a coefficient for converting display information from position information measured by the position measuring means, The drawing means draws information such that each reference reference point and each corresponding reference point match based on the position information and coefficient information of each reference reference point obtained by the position measuring means and the coefficient calculating means, respectively. Is converted from display information.

  A projection display device according to claim 13 is the projection display device according to claim 11 or 12, wherein a plurality of representative points designated on the projection display surface, and the imaging surfaces of the plurality of representative points Representative point measuring means for measuring the distance of the representative point, and the drawing means corresponds to each representative point based on the distance information for each representative point measured by the representative point measuring means. The display information is converted for each predetermined area on the projection display surface.

A projection display system according to a fourteenth aspect includes a plurality of projection display devices according to any one of the first to thirteenth aspects, and a display for transmitting display information on one projection display device to another projection display device. It is characterized by having information sharing means.
A projection display system according to claim 15 is the projection display system according to claim 14, wherein the instruction corresponding point information in one projection display device is reflected in the instruction corresponding point information in another projection display device. It is characterized by having point information reflecting means.

  The projection display system according to claim 16 is the projection display system according to claim 15, wherein the instruction corresponding point information reflecting unit acquires instruction corresponding point information from a plurality of projection display devices, respectively, and acquires the instruction corresponding point information. And the drawing means generates drawing information in which the shared information, the image information based on the indication corresponding point information, and the display information are overlapped. .

Further, in the projection display system according to claim 17, in the projection display system according to claim 16, the indication point designating unit is configured to share the indication point among the plurality of projection display devices, and One of the non-sharing indication points that are not shared can be specified,
The indicated corresponding point information reflecting means acquires only the indicated corresponding point information of the shared designated point.

  According to the first aspect of the present invention, display information such as an electronic document is displayed on a projection display surface such as paper, and further, for example, annotations and corrections are written on the paper with a writing instrument (red) In the same way as you do, you can add (correspond) the indication corresponding point information to the display information. That is, there is an effect that the content additionally written (red) to the display information can be digitized and displayed together with the display information. Further, the contents additionally added (red) are stored in the instruction corresponding point information storage means prepared separately from the means for storing the display information, so that the original display information is not changed.

According to the invention described in claims 2 to 4, it is possible to select either the designated state or the non-designated state for the designated point by the designated point designating means. As a result, there is an effect that it is possible to directly and reliably instruct a portion to be red-filled.
According to the invention described in claims 5 to 6, the display information rewriting means converts the current display information to another display information based on the predetermined displacement of the projection display surface determined by the displacement direction detecting means. Can be rewritten. Accordingly, for example, content (display information) that has a large number of pages and is heavy and bulky when printed on paper can be projected and viewed one sheet at a time.

  According to the invention described in claim 7, the display information rewriting means is the divided display information obtained by dividing the current display information and the selected display information into predetermined intervals in a predetermined rewriting direction on the projection display surface. The division display information can be sequentially rewritten in a predetermined rewriting direction at predetermined intervals. Thereby, for example, there is an effect that display information pages can be sent one after another in the same manner as flipping pages of paper books.

  Further, according to the invention described in claim 8, for example, the page turning speed of the content (display information) and the range in the readable page can be adjusted in the same manner as flipping a page of a paper book. it can. According to the ninth aspect of the present invention, it is possible to designate an approximate place where a page of content (display information) starts to be turned. This allows you to quickly get to the page you are looking for.

According to the invention described in claim 10, for example, mark display information (for example, display of a bag) is designated on a specific page of content (display information) in the same manner as using a bag for a paper book, for example. Can do. Then, the page can be easily designated again and displayed quickly.
According to the eleventh aspect of the present invention, the drawing information such that the three reference reference points on the projection display surface and the corresponding reference points in the display information match is converted from the display information. be able to. Thereby, for example, even if the projection display surface is not erected perpendicularly to the front of the projection display device, the display information can be displayed without distortion. Further, even if the same display information is prepared, if a projection display surface larger or smaller than the actual size is prepared, there is an effect that the display information can be enlarged or reduced and displayed.

According to the twelfth aspect of the present invention, it is possible to calculate a coefficient for converting display information from position information of at least four reference reference points and at least four reference points. Thereby, the effect that a projection display apparatus can be comprised by a cheap structure is obtained, without using the distance measuring means which is generally expensive.
Furthermore, according to the invention of claim 13, the drawing means displays drawing information on the projection display surface corresponding to each representative point based on the distance information for each representative point measured by the representative point measuring means. The display information can be converted for each predetermined area. Thereby, even if the projection display surface is not a single plane, display information can be displayed with minimal distortion. Therefore, for example, even when the folded paper is spread and used on the projection display surface, the display information can be browsed without worrying about the distortion of the projection due to the paper crease or the like.

According to the invention of claim 14, display information can be shared among a plurality of projection display devices. Further, according to the invention described in claims 15 to 16, the contents additionally added (red) to the display information on each projection display device can be shared among a plurality of projection display devices.
According to the seventeenth aspect of the present invention, since it is possible to select whether to share or not share redlining, it is possible to distinguish between personal annotations and writing and writing that should be shared by all participants.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
First, the configuration of the first embodiment of the projection display apparatus according to the present invention will be described with reference to FIG.
As shown in the figure, the projection display device 100 has components housed in a housing 10 that is a portable container that can be carried by the projection display device. A control unit 2 and a drawing unit 31 are provided.

  Specifically, the original drawing storage unit 1 is a display information storage unit that stores data (contents of digitized characters, charts, documents, etc. to be displayed) as display information (hereinafter also referred to as an original drawing image). . The original drawing storage unit 1 is composed of, for example, a RAM (Random Access Memory), and content data is stored as a set of points. When the position (x ′, y ′) in the content data is input to the original drawing storage unit 1, the value of the image composing point at that position (x ′, y ′) (color or shading information) Is output.

The drawing control unit 2 is configured to read content data (display information) from the original drawing storage unit 1 and convert it into drawing information for projection (hereinafter also referred to as a drawing image).
The drawing unit 31 includes, for example, a drawing surface 3 that is a transmissive liquid crystal panel, and a driver (not shown) that draws (displays) drawing information output from the drawing control unit 2 on the drawing surface 3. The drawing information can be displayed on the drawing surface 3.

  In addition, a projection unit for projecting and displaying the drawing information displayed on the drawing surface 3 on the projection display surface 20 is provided inside the housing 10. Specifically, the projection means is reflected by the point light source 4 that irradiates the drawing surface 3 from behind, the half mirror 5 that reflects the light beam irradiated from the point light source 4 and transmitted through the drawing surface 3, and the half mirror 5. Condensing lens 6 which condenses the reflected light, and the drawn image drawn on drawing surface 3 is projected onto half mirror 5 by the light from point light source 4 and then reflected by half mirror 5. Further, the light is projected onto the projection display surface 20 via the condenser lens 6 and can be displayed as a projection image on the projection display surface 20.

Furthermore, an imaging unit 71, a distance measurement unit 8, and a mark detection unit 9 are provided inside the housing 10.
Specifically, the imaging unit 71 includes an imaging surface 7 configured as a part of a CCD camera, for example, and a memory. The imaging unit 71 forms an image of the light beam reflected from the projection display surface 20 and transmitted through the half mirror 5 on the imaging surface 7 as projection information on the projection display surface 20, and reads this image formation as a captured image. To store. Then, when the (x, y) position in the imaging surface 7 is input, the imaging unit 71 outputs the value of the point at that position as position information. Here, the position of the point light source 4 with respect to the drawing surface 3, that is, the focal length, and the focal length formed by the light beam imaged on the imaging surface 7 with respect to the imaging surface 7 are set to be equal to the optical distance.

  The mark detection unit 9 scans a captured image in the imaging surface 7 to detect a preset or designated identification mark, for example, a reference reference point, a specific identification mark, an instruction display mark, etc., which will be described later, and these identification marks And the position information (x, y) in the imaging surface 7 are acquired and the position information is output. The mark detection unit 9 includes a mark memory storing a set of identification mark identification codes and dot patterns, and a dot comparator, and sequentially reads and reads dots at (x, y) in the captured image. The dot pattern of the predetermined range and the dot pattern of the identification mark are compared with a dot comparator. When they match, the identification code of the corresponding identification mark and the reference position of the dot pattern in the predetermined range, that is, the position information (x, y) of the identification mark are output. Note that the method of identifying the pattern is not limited to this, and the pattern may be identified by other generally known methods.

  When the position information (x, y) of the identification mark output from the mark detection unit 9 is input to the distance measurement unit 8, the actual point on the projection display surface 20 and the imaging surface being imaged as that point 7 is measured, and the distance D (see FIG. 3 to be described later) of each measured reference standard point is output as distance information. Specifically, the distance measuring unit 8 includes an infrared transmitter, an infrared sensor, and a counter (not shown). The infrared transmitter emits a pulsed infrared ray, the pulsed infrared ray is reflected by the projection display surface 20, and the position of the identification mark (x, The time until returning to y) is counted by a counter. This measurement is performed for each identification mark. Note that the method of measuring the distance D is not limited to the above infrared method, and various methods such as a method using a laser transmission time and a phase difference, and a method using a parallax between two cameras can be adopted. It is. The distance measuring unit 8 corresponds to a distance measuring unit that measures a distance from each reference reference point described later.

Next, the configuration of the drawing control unit will be described in more detail.
The drawing control unit 2 displays each reference reference point on the projection display surface based on distance information and position information of each reference reference point (described later) measured by the distance measurement unit 8 and the mark detection unit 9, respectively. Drawing information such that each corresponding reference point matches (matches) is converted from display information. Specifically, the drawing control unit 2 converts the content data (original drawing image) from the original drawing storage unit 1 into a drawing image, in addition to the content data, the imaging surface 7, the distance measuring unit 8, and the mark detection. The information from the unit 9 is referred to.

  The drawing control unit 2 is composed of, for example, a microprocessing unit (MPU) or the like, and starts a predetermined program stored in a predetermined area of the ROM, and performs display control shown in FIG. 4 to be described later according to the program. Processing is to be executed. The drawing information is stored in a predetermined area of the drawing memory that constitutes the drawing control unit 2.

Here, in describing the display control process in the drawing control unit 2 in detail, first, an example of the projection display surface will be described with reference to FIG.
The projection display surface is, for example, A4 size paper prepared for projecting and displaying an A4 size electronic document. On the projection display surface 20, three reference reference points that are not on a straight line are visibly displayed. That is, as shown in the figure, the first reference standard point 210, the second reference standard point 220, and the third reference standard point 230 are set (designated). Each reference reference point is located at the lower left, lower right, and upper left of the projection display surface 20, respectively, and is indicated by a unique identification mark (for example, ◯, □, Δ).

Next, a coordinate system set to embody the function of the drawing control unit 2 will be described with reference to FIG.
This coordinate system includes a point light source 4, an imaging focus, an original image to be displayed, a drawing surface 3 on which a drawing image is displayed, a projection display surface 20 on which a projection image is displayed, and an imaging surface 7 on which the imaging image is placed. Each is set and defined as shown in the figure. That is, a three-dimensional orthogonal coordinate system XYZ is used with the point light source 4 and the position of the imaging focus as the origin (0, 0, 0). The direction of the point light source 4 and the imaging optical axis is taken as the Z-axis. The drawing surface 3 and the imaging surface 7 are placed so as to be orthogonal to the Z axis at (0, 0, f). Here, f corresponds to the focal length. For convenience, the original image to be displayed is placed with the lower left at the origin and the lower and left sides aligned with the X and Y axes, respectively. In order to simplify the following description, the coordinates of the lower right and upper left of the original image are (1, 0, 0) and (0, 1, 0), respectively.

According to this coordinate system, the magnification of the coordinates is set so that the horizontal width and the vertical width of the content, for example, an A4 size document are in units of the X axis and the Y axis (length = 1), respectively. Note that the magnification of the coordinates can be arbitrarily set by multiplying by a constant, so even if the coordinate unit is set as described above, generality is not lost.
Here, when the original image is displayed as a projected image on the projection display surface 20 in actual size, a point in the projected image corresponding to an arbitrary point (x ′, y ′, z ′) in the original image is (X, Y, Z), the following equation (1) is established. Since the original image is placed on the XY plane, Z = 0 is always set. By utilizing this, the above equation (1) can be simplified as the following equation (2). This relationship is called affine transformation in mathematics.

The values of the nine coefficients (a1, a2, a3, b1, b2, b3, d1, d2, d3) included in the equation (1) are determined as follows. That is, the coordinates of the three reference points set in the original image corresponding to each reference reference point (◯, □, Δ) are as follows.
First reference point (x ′, y ′, z ′) = (0, 0, 0)
Second reference point (x ′, y ′, z ′) = (1, 0, 0)
Third reference point (x ′, y ′, z ′) = (0, 1, 0)

Further, in the projection image on the projection display surface 20, the coordinates of the projection points corresponding to these reference points are set as follows.
Projection point of the first reference point: (X, Y, Z) = (X1, Y1, Z1)
Projection point of second reference point: (X, Y, Z) = (X2, Y2, Z2)
Projection point of third reference point: (X, Y, Z) = (X3, Y3, Z3)
Here, if the coordinates of the projection points (X1, Y1, Z1), (X2, Y2, Z2), (X3, Y3, Z3) of each reference point are given, the coordinates of the coordinates relating to the three reference points and the projection points are given. By substituting the values into equation (2), a nine-element simultaneous equation (equation (3)) is obtained. By solving this, all of the values of the nine coefficients (a1, a2, a3, b1, b2, b3, d1, d2, d3) can be determined as in equation (4).

Further, the coordinates of (X1, Y1, Z1), (X2, Y2, Z2), and (X3, Y3, Z3) relating to the projection points are determined as follows.
That is, when the projection display surface 20 is imaged, a reference reference point placed on the projection display surface 20 and having a unique identification mark is imaged. At this time, the three projection points in the projection image should coincide with the reference reference point on the projection display surface 20. Therefore, by using the mark detection unit 9 to identify a unique identification mark of each reference standard point on the imaging surface 7, the coordinates of the point on the imaging surface 7 corresponding to each reference standard point are obtained. Here, the values of these coordinates are set as follows.
Imaging point of first reference reference point: (x, y, z) = (x1, y1, f)
Imaging point of second reference reference point: (x, y, z) = (x2, y2, f)
Imaging point of third reference reference point: (x, y, z) = (x3, y3, f)

At the same time, the distance measurement unit 8 directly measures the distance D from the three reference reference points to the imaging focus. The distances D to these measured points are measured as follows.
Distance to first reference reference point: D = D1
Distance to second reference point: D = D2
Distance to third reference point: D = D3
Here, when the similar relationship of triangles is used, the relationship shown in the following expression (5) is established between the coordinates of each reference reference point (projection point of the corresponding reference reference point) and the value of the distance D.

  Thus, the values of (X1, Y1, Z1), (× 2, Y2, Z2), (X3, Y3, Z3) are determined. In this way, using the three reference standard points, the values of the nine coefficients (a1, a2, a3, b1, b2, b3, d1, d2, d3) in equation (2) are as in equation (6). To confirm.

As a result, an arbitrary point (x ′, y ′) in the original image is displayed on the projection display surface 20 having the values of the (X, Y, Z) coordinates calculated by the equations (2) and (6). Can be projected to any point.
Next, a drawing image generation method for correctly projecting an original image on the projection display surface 20 will be described.
In order to project the point (X, Y, Z) on the projection display surface 20, if the point to be drawn on the drawing surface 3 is (x, y, f), the following equation (7) is satisfied. A relationship is established. Therefore, in order to correctly project an arbitrary point (x ′, y ′) in the original image on the projection display surface 20, the point (x, y, f) to be drawn on the drawing surface 3 is (2) Using the equation and the following equation (7), the following equation (8) is determined.

In this way, in order to correctly project an arbitrary point in the original image onto the projection display surface 20, all the points to be drawn on the drawing surface 3 are determined by the equations (6) and (8). Can do.
Next, display control processing in the drawing control unit 2 will be described in detail with reference to the flowchart shown in FIG.
As shown in the drawing, in the drawing control unit 2, when the display control process is executed, first, the process proceeds to step S212, and the position information of the reference reference point on the projection display surface 20 on the imaging surface 7 is displayed. (X, y) is read from the mark detector 9, and the process proceeds to step S214. In step S214, the distance information measured by the distance measuring unit 8 in the coordinate system described above, that is, the distance D to each reference reference point is read, and the process proceeds to step S510.

In step S510, the position information (x, y) of each reference reference point and the measured value of the corresponding distance D are substituted into the equation (6), and the above-described nine coefficients (a1, a2, a3, b1, b2, etc.) are substituted. b3, d1, d2, d3) are calculated, and the process proceeds to step S610.
In step S610, it is determined whether or not a predetermined process (steps S710 and S810 below) has been completed for all points (x ′, y ′) of the original image stored in the original image storage unit 1. If it is determined that the process has been completed, the process jumps to step S900. If it is determined that the process has not been completed, the process proceeds to step S710.

  In step S710, the point (x ′, y ′) of the original image is substituted into the above-described equation (8) to calculate the corresponding position (x, y) on the drawing surface, and the process proceeds to step S810. Next, in step S810, the value of the point (x ′, y ′) in the original drawing storage unit 1, for example, color or shade information, is read, and the position (x on the corresponding drawing surface) is read into the drawing memory (drawing RAM). , Y), the value is written, and the process returns to step S610. Note that the two drawing memories have the same specifications, and when one drawing memory is rewriting the contents of the memory, the other drawing memory displays on the drawing surface. Rewriting and display are performed.

  In step S900, the drawing information written in the drawing memory is output to the liquid crystal driver of the drawing surface 700, the drawing information is displayed on the drawing surface 700, and the process proceeds to step S910. In step S910, the process waits for a predetermined time set in advance, and the process returns to step S212. As shown in the figure, this entire process is a loop, and the same process is repeated after a predetermined time. Note that if the “predetermined time” is shortened, it becomes easier to follow the change in the relative position between the projection display device and the projection display surface 20.

  Thereby, the drawing control unit 2 matches each reference reference point and each corresponding reference point based on distance information and position information of each reference reference point respectively measured by the distance measuring unit and the position measuring unit. Such drawing information can be converted from display information. Note that the processing from step S212 to step S810 corresponds to the drawing means.

  Further, as shown in FIG. 1, the projection display device 100 according to the present invention includes a redline storage unit 30 and a redline control unit 31, and indicates an indication of a position to be redlined on the projection display surface 20. If points are specified in the redline instruction section 32, additional entry (redline) can be made to the content in the same way as annotations and corrections are written on paper with writing instruments, and additional entry (redline) is added to the content. The function is to digitize the contents and display them together with the contents.

Specifically, the redline instruction unit 32 is an indication point designating unit that directly designates an indication point that is a position to be redlined on the projection display surface 20. The redline instructing unit 32 has a contact that indicates the position of the indicated point by making contact with the projection display surface. As the contact, for example, a pen-like shape is suitable, and a specific identification mark for indicating the position of the indication point is provided on the pen tip.
Here, the mark detection unit 9 can also identify the specific identification mark at the pen tip of the redline instructing unit 32, as in the detection of the reference reference point described above. That is, the mark detection unit 9 is a position measuring unit that measures the position of the reference reference point described above, and is also an indication point measuring unit that recognizes the specific identification mark as an indication point and measures the designated position. .

  The redline storage unit 30 is an instruction corresponding point information storage unit. The redline storage unit 30 is a storage unit having the same specifications as the original drawing storage unit 1 and is prepared separately from the original drawing storage unit 1. That is, the image composing points (instruction corresponding point information) constituting the redline image stored in the redline storage unit 30 are the same coordinates (x ′, y) as the original image stored in the original image storage unit 1. ′). When the drawing control unit 2 displays the display information as drawing information, the image information based on the instruction corresponding point information stored in the redline storage unit 30 is overlapped with the display information in the original drawing storage unit 1. Drawing information is generated and displayed on the drawing surface 3. Specifically, when the value of the image composing point (instruction corresponding point information) at the coordinates (x ′, y ′) in the redline image is “transparent (no instruction corresponding point)”, for example, the same coordinates in the original image The value of the original image image composing point is used. On the other hand, when the value of the image composing point (instructed corresponding point information) at the coordinates (x ′, y ′) in the vermilion image is “red (with instructed corresponding point)”, the image composing point (indicated corresponding point) Image information is generated using the value of (information). As a result, the original image and the redline image are superimposed on the projection display surface 20 to perform a so-called “layer display”.

The redline control unit 31 determines whether the redline instruction unit 32 is in contact with the projection display surface 20. If it is determined that they are in contact with each other, the red mark storage unit 30 corresponding to the coordinates of the original drawing storage unit 1 corresponding to the position of the specific identification mark measured by the mark detection unit 9 is displayed at “red”. "Value is written.
Here, a method for determining whether or not the redline instructing unit 32 is in contact with the projection display surface 20 will be described in detail.

First, by identifying the specific identification mark attached to the pen tip of the redlining instruction unit 32 on the imaging surface 7 by the mark detection unit 9, the coordinates of the point on the imaging surface 7 corresponding to the redlining instruction unit 32 are obtained. Can be sought. The value of this coordinate is as follows.
Imaging point of specific identification mark: (x, y, z) = (x, y, f)
At the same time, the distance measuring unit 8 directly measures the distance D to the pen specific identification mark. At this time, it is assumed that the specific identification mark is in contact with the projection display surface 20, and the coordinates on the projection display surface 20 are (X, Y, Z). Here, in the equation (2), when x ′ and y ′ are eliminated, the following equation (9) is obtained. That is, the necessary and sufficient condition for the point (X, Y, Z) to be on the projection display surface 20 is Expression (9). However, C1, C2, and C3 are auxiliary variables defined by equation (10).

  On the other hand, when the similar relationship of triangles is used, the relationship shown in the following equation (11) is established. Further, when Expression (11) is substituted into Expression (9), Expression (12) is obtained.

  Since Z is directly measured as the distance D, Z in the equation (12) is replaced with the distance D to obtain the following equation (13). That is, a necessary and sufficient condition for the point (X, Y, Z) to be on the projection display surface 20 is that the measured value (x, y) and the distance D satisfy the expression (13). Further, equation (13) is modified to obtain equation (14).

  If the calculated value of the distance D calculated by substituting the measured values (x, y) into the equation (14) matches the measured value of the actually measured distance D, the specific identification mark (the position of the pen tip) is projected. It can be determined that it is on the display surface 20. Note that it is determined that the specific identification mark is on the projection display surface 20 only when the following equation (15) is satisfied by using a preset allowable error ε (predetermined threshold) in consideration of the measurement error. To do.

  Then, the measurement value (x, y) and distance D relating to the specific identification mark determined to be on the projection display surface 20 are substituted into the equation (11), and the X coordinate and Y coordinate of the specific identification mark are calculated. Is done. Substituting this (X, Y) into the first two equations of equation (2) yields the following equation (16). Further, the following expression (17) is obtained by modifying the expression (16).

In this way, using the obtained (x ′, y ′), the value “red” can be written at the point (x ′, y ′) in the redline storage unit 30.
Next, the redlining process of the redlining control unit will be described in detail with reference to the flowchart shown in FIG.
In this redlining process, first, the process proceeds to step S232, and the position (x, y) on the imaging surface 7 of the specific identification mark that is the indication point of the redlining instruction unit 32 measured by the mark detection unit 9 Is transferred to step S234. In step S234, it is determined whether there is a redline instruction point on the imaging surface 7. If it is determined that there is no redline instruction point (no output), the process returns to step S230, but there is a redline instruction point. If it is determined (with output), the process proceeds to step S236. Next, in step S236, the distance D to the redline instructing point measured by the distance measuring unit 8 in the coordinate system described above is read, and the process proceeds to step S530.

In step S530, a process for substituting the position (x, y) of the redline instruction point and the corresponding measured value of the distance D into the equation (15) is performed, and the process proceeds to step S532.
In step S532, it is determined whether or not the position of the redline instructing point is on the projection display surface 20, and when it is determined that the position is not on the projection display surface 20 (not established), the process returns to step S230. When it is determined that it is present (established) on the display surface 20, the process proceeds to step S730. Next, in step S730, a process of substituting the measured value of the position (x, y) and the distance D of the redline instruction point into the equation (17) is performed, and (x ', y') is calculated, and the process proceeds to step S830. Transition. In step S830, using the obtained (x ′, y ′), the value “red” is written in the redline indication point (x ′, y ′), and the process proceeds to step S930. In step S930, the process waits for a predetermined time set in advance, and the process returns to step S230. This entire process is a loop, and the same process is repeated after a predetermined time.
In this redlining process, the specified state determination means corresponds to steps S530 to S532, and the instruction corresponding point calculation means corresponds to step S730.

Next, the operation | movement of the projection display apparatus in this 1st Embodiment, an effect | action, and an effect are demonstrated. The projection display device is configured to be portable, but here, an example will be described in which the screen on the desk is used as the projection display surface, for example, installed on the ceiling of a conference room.
A normal A4 size paper is used for the projection display surface 20. Three reference reference points are set (designated) in advance on the A4 size paper as described above. In the original drawing storage unit 1, for example, a material used for a conference as necessary content is stored as display information including a reference point corresponding to the reference reference point.

  When the projection display device 100 is powered on, the projection display device 100 first captures the projection information on the projection display surface on the imaging surface 7 by the imaging unit 71 to obtain a captured image. Next, the mark detection unit 9 scans a captured image in the imaging surface 7 to detect a reference reference point, and acquires an identification code of the identification mark and position information (x, y) in the imaging surface 7. . Further, the distance measurement unit 8 reads the position information (x, y) of the identification mark output from the mark detection unit 9, and the projection display surface that is imaged as the point from the position information (x, y) The distance D between the actual point on 20 and the projection display device is measured, and the measured distance D of each reference reference point is acquired as distance information. Next, based on the distance information of each reference reference point measured by the distance measurement unit 8 and the position information measured by the mark detection unit 9, the drawing control unit 2 uses the reference point of display information to be projected on the projection display surface 20. Is converted from the display information for projection so that the display and the reference reference point on the projection display surface 20 match. Then, the drawing information converted by the drawing control unit 2 is drawn on the drawing surface 3. Then, the drawn image drawn on the drawing surface 3 is projected by the light beam from the point light source 4, reflected by the half mirror 5, further projected through the condenser lens 6, and projected onto the projection display surface 20. Can be projected and displayed.

At this time, the drawing control unit 2 displays the display on the projection display surface 20 with the distance information of the three reference reference points measured by the distance measurement unit 8 and the positions of the three reference reference points measured by the mark detection unit 9. Based on the information, the display information is converted into drawing information such that each reference reference point and each corresponding reference point match.
Thereby, according to this projection display apparatus 100, fitting of the display information to a real thing can be performed easily. That is, for example, any digitized content can be displayed in actual size. In particular, even when the projection display surface 20 is inclined or the like, the content can be displayed without distortion even if the projection display surface 20 is not erected vertically to the front of the projection display device 100.

  That is, even when the projection display surface 20 is inclined, the drawing control unit 2 displays the distance information and marks of the three reference reference points measured by the distance measurement unit 8 on the projection display surface 20. Based on the position information of the three reference reference points measured by the detection unit 9, it is possible to convert drawing information that matches each reference reference point and each corresponding reference point from the display information. Therefore, even if the paper surface on the desk is tilted, the display information is displayed in accordance with each reference reference point, and the display information can be displayed without being distorted even if the paper surface is held and held at an angle.

  In the description of the first embodiment, the expression (2) is also established when the size of the projection display surface 20 does not correspond to the actual size of the content to be displayed, that is, the original size. The equations (3) to (8) are similarly established. Therefore, even if the size of the projected image displayed on the projection display surface 20 is not the actual size of the content to be displayed by the processing shown in FIG. It can be displayed by being fitted into the surface 20.

That is, according to the projection display device 100, the display information on the projection display surface 20 can be automatically set to a desired magnification by the drawing control unit 2, so that the contents can be viewed in a more easily viewable form. An effect is obtained. Specifically, enlargement or reduction in accordance with the actual size is possible. Therefore, even if the same content is prepared, if a projection display surface 20 larger or smaller than the actual size is prepared, it can be displayed enlarged or reduced.
In addition, if the projection display surface 20 is a normal paper surface, even a content that has a large number of pages and is heavy and bulky when printed on paper can be projected and viewed one after another on a single sheet of paper.
Furthermore, according to the projection display device 100, it is possible to perform additional entry (redlining) on the currently displayed content.

  That is, the user now holds the redline instructing section 32 having a specific identification mark attached to the pen tip of the shape of a pen, for example, and performs an additional entry (redline) To do. Here, the user is right-handed and operates the redline instructing unit 32 with the right hand, like a normal writing instrument. The projection display device 100 installed on the ceiling projects and displays on the paper surface (projection display surface 20) from the upper left of the user. Therefore, since the specific identification mark attached to the pen tip at the tip of the redline instructing unit 32 has no obstacle between it and the projection display device 100, the image detection state is maintained, and the mark detection unit 9 Position information can be acquired. In this state, the user brings the tip of the redline instructing unit 32 into contact with a desired position of the display information projected and displayed on the paper. At this time, the redline control unit 31 determines that the redline instruction unit 32 is in contact with the projection display surface 20, and the original drawing storage unit 1 corresponding to the position of the specific identification mark measured by the mark detection unit 9. A value of “red” can be written at a corresponding point in the redline storage unit 30 that overlaps the coordinates of.

This allows you to redline in the same way as writing notes and corrections on paper with writing instruments. The reddish contents are digitized. Further, since the contents put in red are saved in the instruction corresponding point information storage means prepared separately from the means for storing the contents, the original contents are not changed.
In the above embodiment, the original drawing storage unit 1 is described as an example of a RAM (Random Access Memory). However, the means for holding the content in the original drawing storage unit is not limited to the RAM. For example, a memory card or wired or wireless reading can be used.

In addition, a plurality of contents are stored in an original drawing storage unit provided inside or outside the projection display device 100, and an identification code placed on the projection display surface 20 is read, so that the corresponding contents can be selected from the plurality of contents. You may make it select the content to perform suitably.
Furthermore, in the above-described embodiment, each reference reference point has been described as an example in which it is visually displayed. However, the present invention is not limited to this, and an identification mark unique to each reference reference point can be detected by the mark detection unit 9 described above. As long as it is not necessarily visible to human eyes. The same applies to the specific identification mark.

Further, the reference reference point does not necessarily have to be fixed on the projection display surface, and the position of each reference reference point is indicated using, for example, a pointer or a laser pointer when performing projection display. It is also possible to configure.
Note that when the projection display device is used upright on the projection display surface, it is possible to easily perform redlining even without the reference reference point.
That is, the point (x ′, y ′) in the original drawing storage unit 1 and the point (x, y) on the drawing surface 3 projecting the point have a simple proportional relationship as follows.
x ′ = a * x
y '= b * y

On the other hand, the coordinates (x, y) of the imaging surface 7 and the drawing surface 3 are matched. At the same time, the coordinates (x ′, y ′) of the original drawing storage unit 1 and the redline storage unit 30 are also matched.
Therefore, the measured value (x, y) of the specific identification mark on the imaging surface is substituted into the proportional relationship to obtain (x ′, y ′), and this (x ′, y ′) is used to It goes without saying that the value “red” can be written at 30 points (x ′, y ′).

  Here, in the first embodiment described above, in order to correctly project an arbitrary point (x ′, y ′) in the original image on the projection display surface 20, the image should be drawn on the drawing surface 3. The point (x, y, f) is calculated using the above-described equation (7). The equation (7) at this time is derived using the equation (2). And (2) Formula is based on the premise that the projection display surface 20 is a plane. That is, if the projection display surface 20 is paper, there are creases, uneven shapes, etc., and if the projection display surface 20 is not formed by a single surface, the expression (6), especially Z An error occurs between the calculated value and the actually measured value. As a result, the projected display image on the projection display surface 20 has a portion that deviates from the actual size.

Then, next, as a second embodiment, a projection display device capable of reducing errors in the projected display image even when the projection display surface 20 is not formed by a single surface in this way. explain.
Z in equation (2) is the distance between the projection display device and the projection display surface. In the first embodiment, the Z is calculated from the equation (2). However, in the second embodiment, a plurality of representative points are set (designated) on the projection display surface 20, and The distances between these representative points and the projection display device are measured and stored, and the value of Z is estimated from the distance between the representative points.

Display control processing in the drawing control unit according to the second embodiment will be described with reference to a flowchart shown in FIG. The difference between the display control process in the second embodiment shown in FIG. 6 and the display control process in the first embodiment shown in FIG. 4 is described in [1], [2] and [3] described below. 4 in place of step S510 in FIG. 4 and from step S520 to step S526 in FIG. 6, and in place of step S710 in FIG. 4, step S720 to step S724 in FIG. Are different from each other.
Specifically, in the second embodiment, “[1] coefficient identification processing” is changed. That is, in step S520 in FIG. 6, among the nine coefficients (a1, a2, a3, b1, b2, b3, d1, d2, d3), six coefficients (a1, a2, b1, b2, d1, Only d2) is calculated by the following equation (18).

Then, after determining the values of the six coefficients (a1, a2, b1, b2, d1, d2) in step S520, the process proceeds to step S522, and “[2] Setting (designation) of representative points” , Adding distance measurements to the process. That is, n representative points {(xi, yi); i = 1, n} are set (designated) on the imaging screen corresponding to the projection display surface 20. Then, the process proceeds to step S524, and the distance Di to the representative point on the projection display surface 20 corresponding to each point (xi, yi) is measured using the distance measuring unit 8. The distance measuring unit 8 also serves as representative point measuring means for measuring distance information of representative points.
Here, the following relationship (19) is established between the representative point (xi, yi) on the imaging screen and the corresponding representative point (Xi, Yi, Zi) on the projection display surface 20. .

Then, the process proceeds to step S526, and the n representative points {(Xi, Yi, Zi); 1 = 1, n} on the projection display surface 20 are stored.
Furthermore, in the second embodiment, “[3] The drawing point calculation process is changed”. That is, in step S720 in FIG. 6, for an arbitrary point (x ′, y ′) in the original drawing image, the X of the corresponding projection point on the projection display surface 20 is calculated using the following equation (20). Calculate coordinates and Y coordinates.

  This (X, Y) is compared with the X and Y coordinates of the above n representative points {(Xi, Yi, Zi); i = 1, n}, and is closest to (X, Y) of the projection point Two representative points (X1, Y1, Z1) and (X2, Y2, Z2) are selected. And the Z coordinate of a projection point is estimated by the following (21) Formula as a weighted average of two representative points. Here, if X1 = X2, the calculation is performed using an equation in which all X in the equation (21) are replaced with Y (step S722 in FIG. 6).

In step S724, (X, Y, Z) calculated as described above is substituted into equation (7) to obtain (x, y) of the drawing point corresponding to this projection point.
Thereby, according to the projection display apparatus of this 2nd Embodiment, the drawing control part 2 converts drawing information from display information for every area | region corresponding to each representative point based on the distance information for every representative point. It becomes possible.

  That is, even if the projection display surface 20 is not flat, errors in the projection display image can be reduced. Therefore, content is displayed with minimal distortion. For this reason, for example, even when folded paper is spread and used for the projection display surface 20, it is possible to display content in such a manner that almost no projection distortion occurs due to compound surfaces, uneven shapes, paper folding, and the like. There is.

Next, as a third embodiment, an example in which the drawing control unit can calculate the distance without referring to the distance measuring unit 8 described above will be described.
In the third embodiment, as shown in FIG. 7, the drawing control unit converts display information from the original drawing storage unit 1 and imaging information from the imaging surface 7 when generating a drawing image by converting the original drawing image. , And only the position information from the mark detection unit 9 is referred to.

The configuration of the projection display surface 21 in the third embodiment is shown in FIG.
As shown in the figure, the projection display surface 21 is different from the configuration of the projection display surface 20 in the first embodiment in that four reference reference points are set (designated). .
Specifically, on this projection display surface 21, four reference reference points that are not on a straight line are set (designated). That is, as shown in the figure, the first reference standard point 210, the second reference standard point 220, the third reference standard point 230, and the fourth reference standard point 240 are set (designated). Each reference reference point is located at the lower left, lower right, upper left, and upper right of the projection display surface 21 and is indicated by a unique identification mark (for example, ◯, □, Δ, ×). As in the first embodiment, the identification mark unique to each reference reference point does not necessarily have to be visible to the human eye as long as it can be detected by the mark detection unit 9. In addition, these reference reference points are not necessarily fixed on the projection display surface. When projecting and displaying, the position of each reference reference point is indicated by using a pointing bar, a laser pointer, or the like. It is also possible to configure.

  The display control processing in the drawing control unit in the third embodiment is shown in the flowchart shown in FIG. Note that the difference between the display control process in the drawing control unit shown in FIG. 4 in the first embodiment and the display control process in the third embodiment shown in FIG. 9 is the difference between step S214 and step S510 in FIG. Instead, step S530 in FIG. 9 is executed. Here, step S530 corresponds to the coefficient calculation means.

Here, the function of the drawing control unit (the process in step S530 in the above-described display control process) in the third embodiment will be described in detail with reference to the coordinate system shown in FIG. In the figure, the upper right coordinate of the original image is (1, 1, 0).
As described in the first embodiment, in order to correctly project an arbitrary point (x ′, y ′) in the original image on the projection display surface, the point (x , Y, f) is determined as shown in the following equation (22).

Corresponding to each reference reference point (◯, □, Δ, ×), the coordinates of the four reference points placed on the original image are as follows.
First reference point (x ′, y ′, z ′) = (0, 0, 0)
Second reference point (x ′, y ′, z ′) = (1, 0, 0)
Third reference point (x ′, y ′, z ′) = (0, 1, 0)
Fourth reference point (x ′, y ′, z ′) = (1, 1, 0)

When the projection display surface is imaged, a reference reference point placed on the projection display surface and having a unique identification mark is imaged. By identifying the identification mark on the imaging surface by the mark detection unit, the coordinates of the imaging point on the imaging surface corresponding to each reference reference point can be obtained. The coordinate values of these imaging points are set as follows.
Imaging point of first reference reference point: (x, y, z) = (x1, y1, f)
Imaging point of second reference reference point: (x, y, z) = (x2, y2, f)
Imaging point of third reference reference point: (x, y, z) = (x3, y3, f)
Image point of fourth reference reference point: (x, y, z) = (x4, y4, f)

On the other hand, in order to correctly project the reference point on the projection display surface, the coordinates of the corresponding drawing point on the drawing surface may be matched with the imaging point, that is, as follows.
Drawing point of first reference point: (x, y, f) = (x1, y1, f)
Drawing point of second reference point: (x, y, f) = (x2, y2, f)
Drawing point of third reference point: (x, y, f) = (x3, y3, f)
Drawing point of fourth reference point: (x, y, f) = (x4, y4, f)
Here, by substituting the coordinates of the four reference points and the drawing points into the equation (22), the eight-way simultaneous equation (23) is obtained.

  However, L1, L2, L3, M1, M2, M3, N1, and N2 are auxiliary variables defined by the following equation (24).

  By solving this, all of the values of the eight coefficients (L1, L2, L3, M1, M2, M3, N1, N2) can be determined as shown in equation (25).

  Then, using these coefficients, rewriting equation (22) yields the following equation (26).

As described above, all the drawing points to be drawn on the drawing surface necessary for correctly projecting an arbitrary point in the original image onto the projection display surface are determined by the equations (26) and (25). It is possible to do.
Next, how to obtain the point (x ′, y ′) in which the value “red” is written in the redline storage unit 30 when the imaging point (x, y, f) of the specific identification mark is obtained will be described. To do.
In the first embodiment described above, (x ′, y ′) is obtained from (x, y) using equation (17). In the third embodiment, when the equation (26) is solved for (x ′, y ′), the following equation (28) is obtained.

Substituting the above measured values (x, y) for the specific identification mark into the equation (28) to obtain (x ′, y ′), and using this (x ′, y ′), A value of “red” can be written at the point (x ′, y ′).
In general, a highly accurate distance measuring unit is expensive. In addition, the measurement error may increase in an inexpensive distance measuring unit, and the coefficient calculated by the equation (6) may be indeterminate. In particular, since the three coefficients {a3, b3, d3} are located in the denominator of the equation (22), the value of (x, y) calculated by the equation (22) becomes unstable, and the projected image There is a risk of distortion. However, according to the projection display device of the third embodiment, it is possible to mathematically calculate a coefficient necessary for drawing conversion by adopting a configuration that does not require the distance measuring unit 8. Accordingly, there is an effect that the content can be displayed on the projection display surface without distortion without using a high-precision distance measuring unit while suppressing cost.

Next, a fourth embodiment of the projection display device according to the present invention will be described.
The fourth embodiment is an example in which the determination process for determining whether the redline instructing unit is on the projection display surface 20 is simplified. In the fourth embodiment, the redline instruction unit is different from the first embodiment described above, and the redline instruction unit designates a desired indication point on the projection display surface with respect to the projection display surface 20. Either a state or a non-designated state in which no indication point is designated is configured to be selectable. Specifically, the “instruction display mark” for easily recognizing that the specified state is in the designated state only when the specific identification mark on the pen tip is in contact with the projection display surface.

  Specifically, as shown in FIG. 10A, the redline instructing portion 32 protrudes from a cylindrical case 39 and an opening 39a formed at one end of the case 39, and is latched at a substantially central portion. A nib 37 having a claw 37a. In the case 39, a nib spring 38 is disposed on the other end side of the tip 37b of the nib 37 having the specific identification mark. Further, in the case 39, a mark holding portion 34 that is a substantially L-shaped link is provided. The mark holding portion 34 has a fulcrum 35 formed at the position of the substantially L-shaped bent portion, and can swing around the fulcrum. Further, the mark holding part 34 has an instruction display mark 33 for determining whether or not a redline instruction point is designated at the one end part 34b having a substantially L shape. Furthermore, the substantially L-shaped other end portion 34 a is engaged with the locking claw 37 a of the pen tip 37 and is pulled by the holding portion spring 36. As a result, the mark holding portion 34 is rotated in the clockwise direction in the drawing with the fulcrum 35 as the center, and the locking claw 37a is held at a position in contact with the lower bottom portion 39b of the case 39. Has been. At this time, the instruction display mark 33 is normally at a position stored in the case 39.

Next, the operation of the redline instructing unit 32 in the fourth embodiment will be described.
As shown in FIG. 10B, when the pen tip 37 touches the projection display surface 20 and further pushes down the case 39 toward the projection display surface 20, the pen tip 37 is moved to the case 39. Then, the lower claw portion 34a is pushed up by the locking claw 37a.
Thereby, the mark holding part 34 rotates counterclockwise around the fulcrum 35. Therefore, the instruction display mark 33 held by the mark holding unit 34 is exposed outside the case 39. Therefore, the mark detection unit 9 can detect the exposed instruction display mark 33.

  When the pen tip 37 is moved away from the projection display surface 20, the pen tip 37 is again moved out of the case 39 by the pressing force of the pen tip spring 38 and returned to the original position. As a result, the mark holding portion 34 is pulled by the holding portion spring 36 and rotates around the fulcrum 35 in the clockwise direction in FIG. Therefore, the instruction display mark 33 is stored in the case 39 again. Therefore, the mark detection unit 9 does not detect the instruction display mark 33.

  If the redline instructing unit 32 as in the fourth embodiment is adopted, it is assumed that the specific identification mark indicates the indication point only when the indication display mark 33 is recognized by the mark detection unit 9. Just do it. Therefore, the redlining process in the redlining control unit 31 can be simplified as shown in FIG. That is, according to this 4th Embodiment, the process of step S530 and step S532 can be abbreviate | omitted with respect to the redlining process in the redlining control part 31 shown in FIG.

  As explained above, the projection display device of the present invention can employ the red ink pen as in the fourth embodiment. Thereby, for example, when the accuracy of the means for measuring the positional relationship between the indication point placed on the projection display surface 20 and the projection display device is low, the indication point is not placed on the projection display surface 20 but erroneously. There is a possibility of reddish, but by adopting this reddish pen, it is possible to directly indicate the portion to be reddish, so that there is an effect that the movement of the indication point can be measured reliably. In addition, although the example which provides the "indication display mark" mechanically was demonstrated here, it is not restricted to this, The electrical method which light-emits a specific lamp when the pen tip of a red-filling instruction | indication part contacts a projection display surface There is also. Apart from this, there is also a method in which the red dot position is indicated by a blinkable laser pointer, and this apparatus picks up the red dot position by imaging the reflection of the laser light from the projection display surface.

Next, a fifth embodiment of the projection display apparatus according to the present invention will be described.
The fifth embodiment is an example assuming a document in which content as display information is composed of a plurality of pages. In this example, it is assumed that the projection display surface is formed on a flexible member. Specifically, for example, an A4 size paper surface can be exemplified as the projection display surface.

FIG. 12 shows the configuration of the projection display device in the fifth embodiment.
As shown in the figure, in the fifth embodiment, a document storage unit 41, a page turning control unit 42, a page counter 43, and an equilibrium distance are added to the configuration shown in FIG. 1 described in the first embodiment. The difference is that a storage unit 44 is added.
Specifically, the document storage unit 41 is a second display information storage unit that stores a plurality of display information, and stores the entire content. Similar to the original drawing storage unit 1, the document storage unit 41 is configured by a RAM, for example, and holds the contents of each page constituting the content. When a page value (number of pages from the top) is input, the contents of the page are output. The output page contents (characters, charts, etc.) are expressed as a set of points and are sent to the original drawing storage unit 1. The document storage unit 41 holds the entire contents, and the original drawing storage unit 1 is different in that it holds only the original drawing image currently projected and displayed. The means for holding the entire content in the document storage unit 41 is not limited to the RAM, and for example, as with the original drawing storage unit 1, insertion of a memory card, reading by wire or wireless, etc. can be adopted. Further, a plurality of contents are held inside or outside the projection display device, and an identification code placed on the projection display surface 20 is read to select the corresponding contents from the plurality of contents. May be.

The page turning control unit 42 appropriately reads each piece of information from the mark detection unit 9, the distance measurement unit 8, the equilibrium distance storage unit 44, and the page counter 43, and calls the display information of the corresponding page from the document storage unit 41. . Then, the page turning control process of updating the page counter 43 and further writing the original drawing image into the original drawing storage unit 1 can be executed.
The page counter 43 is composed of, for example, a RAM, and stores the page value currently being projected and displayed (how many pages from the top) are stored.

  The equilibrium distance storage unit 44 stores posture information (equilibrium posture) that is estimated to be normally taken by the user holding the projection display surface 20. Specifically, the equilibrium distance storage unit 44 measures the equilibrium posture by the distance measurement unit 8 to the first reference standard point 210 (lower left of the page) and the second reference standard point 220 (lower right of the page). Information is read as distances Ds1 and Ds2. Here, the distances Ds1 and Ds2 are set as equilibrium postures normally taken by the user holding the projection display surface 20.

Next, the page turning control process in the page turning control unit 42 will be described in more detail with reference to the flowchart shown in FIG. Here, a left-bound document is assumed, and in a left-bound document, the page value increases when the right edge of the page is turned, and the page value decreases when the left edge of the page is turned.
In the page turning control unit 42, when the page turning control process is executed, the process first proceeds to step S150, the page value of the page counter 43 is set to 1, and the process proceeds to step S152. In step S152, the first page of a plurality of contents is read (selected) from the document storage unit 41, written in the original drawing storage unit 1, and the process proceeds to step S154. In step S154, after waiting for a predetermined time set in advance, the process proceeds to step S252.

  In step S252, the position (x, y) of the imaging point on the imaging surface of the reference reference point set (designated) on the projection display surface is read from the mark detection unit 9, and the process proceeds to step S254. Next, in step S254, the distance Ds to each reference reference point is read, and the process proceeds to step S256. In step S256, distances Ds1 and Ds2 that are distance information to each reference reference point are stored in the equilibrium distance storage unit 44, and the process proceeds to step S258. In step S258, the distance D to the reference reference point set (designated) on the projection display surface 20 is read from the distance measuring unit 8, and the process proceeds to step S350.

In step S350, it is determined whether or not the following expression (28) is satisfied. That is, with respect to the first reference standard point 210 (bottom left of the page) and the second reference standard point 220 (bottom right of the page), measured values (D1 and D2) of distances to the respective reference standard points and their respective equilibrium distances (Ds1). And Ds2), it is determined whether or not the relationship shown in the following equation (28) holds. Here, a threshold value ε2 is set in advance in order to determine whether or not a predetermined displacement has occurred. The saddle value ε2 is set in order to ignore a minute change in distance that does not lead to a predetermined displacement.
Ds1-D1 <ε2 <Ds2-D2 (28)

If it is determined in step S350 that the expression (28) is “not established”, the process jumps to step S450, but if it is determined “established”, the process proceeds to step S351.
Next, in step S351, it is determined whether or not the page value of the page counter 43 has reached the last page. That is, if it is determined that “page value ≧ final page value”, the process jumps to step S450. If it is determined that “page value <final page value”, the process proceeds to step S352. In step S352, “1” is added to the page value of the page counter 43, and the process proceeds to step S353. In step S353, the work counter Wx is set to “1”, and the process proceeds to step S354.

  In step S354, the points {(x, y); 1 / N <x <Wx} in the original drawing storage unit 1 are all shifted to the left by 1 / N, and each {(x−1 / N, y) ; 1 / N <x <Wx} is written (rewritten), and the process proceeds to step S355. In step S355, the page designated by the page counter 43 is called from the document storage unit 41, and only the point {(x, y); Wx-1 / N <x <1} is stored in the original drawing storage unit. 1 is written (rewritten) in {(x, y); Wx−1 / N <x <1} in 1, and the process proceeds to step S356. In step S356, 1 / N is subtracted from the work counter Wx, and the process proceeds to step S357. If it is determined in step S357 that “Wx> 0”, the process returns to step S354. If it is determined that “Wx ≦ 0”, the process proceeds to step S950. In step S950, after waiting for a predetermined time set in advance, the process returns to step S258.

In step S450, it is determined whether or not equation (29) is established. Here, with respect to the first reference reference point 21 (lower left of the page) and the second reference reference point 22 (lower right of the page), measured values (D1 and D2) of distances to the reference reference points and the respective equilibrium distances ( It is determined whether or not the relationship shown in the following equation (29) holds between Ds1 and Ds2).
Ds1-D1>ε2> Ds2-D2 (29)
If it is determined in step S450 that the expression (29) is “not established”, the process jumps to step S950, but if it is determined that “established”, the process proceeds to step S451.

  Next, in step S451, it is determined whether or not the page value of the page counter 43 has reached the first page. That is, when it is determined that “page value ≦ 1”, the process jumps to step S950, but when it is determined that “page value> 1”, the process proceeds to step S452. In step S452, “1” is subtracted from the page value of the page counter 43 and the process proceeds to step S453. In step S453, the work counter Wx is set to “0” and the process proceeds to step S454.

  In step S454, all the points {(x, y); Wx <x <1-1 / N} in the original drawing storage unit 1 are shifted to the right by 1 / N, and each {(x + 1 / N, y) ; Wx <x <1-1 / N} is written (rewritten), and the process proceeds to step S455. In step S455, the page designated by the page counter 43 is called from the document storage unit 41, and only the point {(x, y); 0 <x <Wx + 1 / N} is stored in the original drawing storage unit 1. Write (rewrite) {(x, y); 0 <x <Wx + 1 / N}, and the process proceeds to step S456. In step S456, 1 / N is added to the work counter Wx, and the process proceeds to step S457. If it is determined in step S457 that “Wx <1”, the process returns to step S454. If it is determined that “Wx ≧ 1”, the process proceeds to step S950. In this page turning control process, the process from step S258 to step S950 is a loop, and the same process is repeated after a predetermined time.

  In the page turning control process described above, the display information rewriting means corresponds to step S354 and step S355 in the page turning process, and to step S454 and step S455 in the page return process. Further, the displacement determination means corresponds to step S350 in the page feed process, and corresponds to step S450 in the page return process.

Next, the operation of the projection display device in the fifth embodiment will be described.
First, consider a case where the user holding the projection display surface 20 displaces, that is, lifts, the right end of the projection display surface 20. In this case, the distance to the right side is reduced more than the left side of the projection display surface 20. This posture is the same posture as when raising the right side not bound without moving the binding margin (left side) of the left-bound document to the front, that is, turning the page and increasing the page value (page feed) ( Step S350).

  At this time, if the page turning control unit 42 determines that the relationship of the expression (28) is established, the current display page indicated by the page counter 43 is determined on the projection display surface as shown in FIG. Are sequentially shifted to the left by a predetermined width 1 / N (ratio to the total width of the page), and at the same time, the page one page ahead is read from the document storage unit 41. Reading and writing into the original drawing storage unit 1 while sequentially increasing the width 1 / N from the right end of the page (steps S354 to S355).

  As a result, when the user lifts the right end of the projection display surface 20, the pages currently displayed on the projection display surface 20 are sequentially shifted to the left with an interval of width 1 / N, and the next page is sequentially sequentially thereafter. Page feed is performed in which the image that appears is projected and displayed. When the user returns the projection display surface 20 to the balanced posture, the page feed is stopped and the current page is continuously displayed. Further, while the user lifts the right end of the projection display surface 20, the pages are sequentially shifted to the left with an interval of width 1 / N on the projection display surface 20, and the pages are continuously fed (the page value increases). An image is projected and displayed.

Next, similarly, consider a case where the user holding the projection display surface 20 displaces, that is, lifts, the left end of the projection display surface 20. In this case, the distance to the left side is reduced more than the right side of the projection display surface 20.
At this time, if the page turning control unit 42 determines that the relationship of the expression (29) is established, as shown in FIG. 15, the current display page indicated by the page counter 43 is determined on the projection display surface. Display information divided into predetermined intervals in the rewriting direction, that is, sequentially shifts to the right by a preset width 1 / N, and at the same time, the previous page is read from the document storage unit 41, and the width 1 from the left end of the page The data is written in the original drawing storage unit 1 while increasing in increments of / N (steps S454 to S455).

  As a result, when the user lifts the left end of the projection display surface 20, the pages currently displayed on the projection display surface 20 are sequentially shifted to the right with an interval of width 1 / N, and the previous page is sequentially switched from the rear. The image that appears is projected and displayed. When the user returns the projection display surface 20 to the balanced posture, the page feed is stopped and the current page is continuously displayed. Further, while the user lifts the left end of the projection display surface 20, the projection display surface 20 sequentially shifts pages to the right with an interval of width 1 / N, and continuously returns the page (decreases the page value). An image is projected and displayed.

In addition, when the user holding the projection display surface 20 does not displace the left end and the right end of the projection display surface 20, that is, when the user does not lift, or when the left end and the right end are brought close to or away from each other by the same amount, ( Neither equation 28) nor equation (29) holds. Accordingly, the entire page designated by the page counter 43 is continuously displayed.
Although the left-bound document has been described here, the right-bound document (the number of pages decreases when the right edge of the page is turned and the number of pages increases when the left edge of the page is turned) is as follows. Changed to That is, when the equation (28) is established, the page return is performed, and the “page advance” process in FIG. 13 is changed to the “page return” process. Further, when the expression (29) is established, page turning is performed, and the “page returning” process in FIG. 13 is changed to the “page turning” process. That is, in FIG. 13, step S350 and step S450 are interchanged.

  Furthermore, in a document with top binding (the page value increases when the bottom edge of the page is turned and the page value decreases when the top edge of the page is turned), the first reference reference point 210 (bottom left of the page) and the third reference The reference point 230 (upper left of the page) is used. In addition, since the process of the page turning control part in this case can be easily inferred from the above description, a description thereof will be omitted. It should be noted that the page turning control described above can be set by selecting “left binding”, “right binding”, or “upper binding” at the time of use so that the user can easily refer to the document. is there.

According to the projection display device of the fifth embodiment, it is possible to turn pages of a plurality of display information. In other words, the content pages can be sent one after another in the same manner as flipping paper book pages. This has the effect of quickly finding the page you are looking for.
Here, the displacement determination means described above determines that the displacement (deflection) of the page is larger as the difference between the equilibrium distance Ds2 and the distance measurement value D2 is larger with respect to the second reference reference point 22 at the lower right of the page. It can also be set as the structure to do. With such a configuration, the display information rewriting means changes the page feed width 1 / N in accordance with the bending of the page, for example, in the same manner as flipping a paper book page. You can page naturally.

  Specifically, for example, when the displacement determining means determines that the difference between Ds2 and D2 has doubled, the display information rewriting means multiplies the page feed width 1 / N by √2. Further, when it is determined by the displacement determination means that the difference between Ds2 and D2 has become larger, the display information rewriting means sets the number of pages sent at a time to be rewritten. Further, when it is determined by the displacement determining means that the difference between Ds2 and D2 has become small, the display information rewriting means can be configured to restore the set value of the page feed width. In the above description, the example in which the display information rewriting unit changes the predetermined interval of the segment display information according to the displacement determined by the displacement determination unit has been described, but the rewrite speed of the segment display information is determined by the displacement determination unit. You may comprise so that it may change according to the determined displacement.

Still further, the display information rewriting means described above virtually sets a reference area on the projection display surface 20, and responds to the relative relationship between the reference point indicated by the indication point specifying means within the reference area and the reference area. Thus, the display information corresponding to the relative relationship can be rewritten.
Specifically, the display information rewriting means is configured to read the position of the indication point placed on the projection display surface 20 measured by the mark detection unit 9 when starting “page turning”. The display information rewriting means includes a relative relation calculating means for calculating the ratio of the position of the pointing point placed on the projection display surface 20 with respect to the reference area virtually set in advance for the page size. And Further, the display information rewriting means includes page value storage means for storing a relative relationship corresponding to the ratio in the total number of pages of content (display contents) as “page value”.

  According to the display information rewriting means having such a configuration, for example, display information corresponding to the beginning of turning can be quickly displayed in the same manner as flipping a page of a paper book. In other words, it is assumed that the position of the indication point is, for example, 1/3 from the top with respect to the page size (reference area). When the total number of pages of content (display content) is 100, the display information rewriting means first calculates 100 ÷ 3 = 33 as “page value” by the relative relation calculating means, and then this “page “Value” (page 33) is stored in the page value storage means. Then, referring to the “page value” stored in the page value storage means, the pages are automatically sent one after another from page 33 of the content (display content) according to the direction of displacement (deflection) of the projection display surface. However, it can be configured to draw.

Next, a sixth embodiment of the projection display apparatus according to the present invention will be described.
In the sixth embodiment, for example, mark display information (for example, display of a bag) can be designated on a specific page of content (display information) in the same manner as using a bag for a paper book. In addition, the page can be easily specified later so that it can be displayed quickly.
As shown in FIG. 16, the sixth embodiment includes a mark display information storage unit 51 and a mark position information storage unit 52 with respect to the projection display device according to the fifth embodiment. In addition, the page turning control unit 42 in the sixth embodiment is different in that a process described later is added to the page turning control process executed by the display information rewriting means described above. ing.

  In addition, when the drawing control unit 2 in the sixth embodiment generates the drawing information, the mark display information stored in the mark display information storage unit 51 and the current information stored in the original drawing storage unit 1 are used. The display information is superimposed on the display information. In addition, the process which produces | generates the drawing information which overlapped the mark display information and the current display information performed by the drawing control part 2 in this 6th Embodiment is the above-mentioned instruction corresponding point information and the display information. Is executed in the same manner as the process of generating the drawing information with the above and overlapping, detailed description will be omitted.

The mark display information storage unit 51 is a storage unit that is prepared separately from the original drawing storage unit 1 and has the same size as the original drawing storage unit 1. The mark display information storage means 51 is constituted by a RAM, for example, and can store the mark display information instructed by the mark instruction means 53 for instructing the mark with respect to the display information currently displayed on the projection display surface 20. It has become.
Here, the mark instructing means 53 can employ, for example, the same configuration as the redline instructing unit 32 in the fourth embodiment described above. That is, if a “栞 mark” is set in advance as the specific identification mark in the redline instructing unit 32 in the fourth embodiment, the mark detection unit can detect this as a mark display. Yes.

The mark position information storage means 52 is composed of, for example, a RAM, and the display information of the mark display information stored in the mark display information storage means 51 is set for a plurality of display information constituting the content. The relative relationship can be stored as the mark position information. That is, for example, it is configured to be able to hold a set of coordinates in a page at a position where a bag is pasted with a paper book and a corresponding page value.
The page turning control unit 42 according to the sixth embodiment adds the following processing to the page turning control processing executed by the display information rewriting means described above.

  Specifically, in the page turning control unit 42, the mark detection unit 9 displays an arbitrary position on the projection display surface 20 on which display information (page) to which a mark display (display of haze) is to be pasted by the mark instruction unit 53 is displayed. And a point reading process when a point is designated by the mark instructing means 53. When the indication point is read, the page turning control unit 42 stores the mark display information at the position of the mark display information storage unit 51. Further, the page turning control unit 42 stores the mark position information in the mark position information storage unit 52. Still further, the page turning control unit 42 displays the current display information stored in the display information storage unit corresponding to the mark position information when the mark display information is instructed by the pointing point designating unit. It includes a process for rewriting information.

Next, a method for sticking the eyelids in the projection display device having the configuration of the sixth embodiment will be described.
Now, the user designates the designated point by the landmark designating means 53 at an arbitrary position on the projection display surface where the display information (page) to which the landmark display (display of haze) is to be pasted is displayed. When an indication point as a mark display is designated by the mark instruction means 53, the mark detection unit 9 detects this and outputs the mark display coordinates to the page turning control unit. Next, the page turning control unit 42 stores the mark display coordinate value in the mark position information storage unit 51 together with the page value of the currently displayed page. At this time, the drawing control unit 2 in the sixth embodiment displays a mark (for example, a star shape) at the same position as the position of the indication point placed on the projection display surface 20 stored in the mark display information storage unit 51. Symbol). As a result, the contents of the mark display information storage means 51 can be displayed overlapping the contents of the original drawing storage unit 1.

Next, a method for using the pasted mark display (a mark) will be described.
The user gives a new instruction to the mark display portion displayed on the projection display surface 20 using the indication point specifying means. Thereby, the mark detection unit 9 detects the instruction and outputs the instructed coordinates of the mark display to the page turning control unit 42. Next, the page turning control unit 42 searches the mark position information storage unit 52 for the value. When the corresponding page display coordinate value is found, the page turning control unit 42 retrieves the page value paired with the mark display coordinate value, and calls the display information of the corresponding page from the document storage unit 41. . As a result, the page on which the mark display is pasted is displayed.
As described above, according to the projection display device according to the configuration of the sixth embodiment, for example, mark display information is displayed on a specific page of content (display information) in the same manner as using a book on a paper book. Can be specified. Then, the page can be easily designated again and displayed quickly.

Next, a seventh embodiment of the projection display apparatus according to the present invention will be described.
This seventh embodiment assumes a projection display system in which a plurality of projection display devices according to the present invention are prepared and the display information is mutually used, for example, at a meeting. Specifically, the projection display device according to the present invention is configured so that information can be transmitted and received between a plurality of projection display devices via a server, and content as display information is shared between the plurality of projection display devices. In this example, the above-described information (additional entry) is further shared while browsing at the same time.

The configuration of the projection display system according to the seventh embodiment will be described with reference to FIG. FIG. 17 is a block diagram showing a configuration of a projection display system to which the projection display device of the present invention is applied.
As shown in the figure, this projection display system manages transmission / reception of a plurality of projection display devices 100 and instruction corresponding point information mutually input / output between the plurality of projection display devices 100 via a network 400. PC 300 that is a server to be connected is connected. The projection display system includes a display information sharing unit 61 and an instruction corresponding point information reflecting unit 62 in the PC 300.

  Here, each projection display device 100 includes an instruction corresponding point information terminal (not shown) that inputs / outputs instruction corresponding point information from the PC 300 to the redline storage unit 30 of the projection display device 100 according to the first embodiment. A display information terminal (not shown) for inputting / outputting display information information from / to the PC 300 and a “Read / Write (hereinafter referred to as R / W) trigger” (not shown) for indicating whether information to be exchanged is input or output. The difference is that it has a terminal.

  When the R / W trigger is designated as “R (Read)”, the display information sharing unit 61 reads the contents of the original drawing storage unit 1 to the display information terminal. When the R / W trigger is designated as “W (Write)”, the display information sharing unit 61 writes the display information from the display information terminal to the original drawing storage unit 1. Display information can be input / output to / from the PC 300 via the network 400. Thereby, the display information sharing means 61 can send display information on one projection display device to another projection display device.

  The instruction corresponding point information reflecting means 62 periodically designates “R” for the R / W trigger terminal of each projection display device 100, and indicates the instruction corresponding to the redline content stored in the redline storage unit 30. Point information is acquired sequentially. Then, shared information obtained by superimposing the acquired instruction corresponding point information is generated and stored in a predetermined storage unit (shared information storage unit) in the PC 300. Further, when the indication corresponding point information reflecting means 62 detects a change between the content of the instruction corresponding point information previously read by one projection display device and the content read this time, the sharing corresponding information stored in the shared information storage unit is stored. New shared information is generated by superimposing the indicated corresponding point information that has changed on the information. In addition, the latest shared information is written in the redline storage unit 30 of each projection display device 100 via the network 400 by designating “W” as the R / W trigger terminal for other projection display devices. In this way, the instruction corresponding point information reflecting means 62 is configured to reflect the instruction corresponding point information in one projection display device to the instruction corresponding point information in another projection display device. The PC 300 is configured such that the instruction corresponding point information written in the shared redline storage unit is made into a database and can be used by other application programs on the PC 300.

As described above, according to the configuration of the seventh embodiment, the drawing control unit 2 can generate drawing information obtained by superimposing instruction corresponding point information and the display information and display the drawing information on the drawing surface 3. it can. Therefore, the contents additionally added (red) to the display information on each projection display device 100 can be shared among a plurality of projection display devices.
Next, an eighth embodiment of the projection display apparatus according to the present invention will be described.

  The eighth embodiment is an example in which the indication corresponding point information redlined (additional entry) in each projection display device in the seventh embodiment can be selected to be either shared or non-shared. Note that the eighth embodiment is the same as the configuration in the seventh embodiment described above except that it is divided into sharing instruction corresponding point information that shares redline content and non-shared instruction corresponding point information that is not shared. Other detailed explanations are omitted.

  In the eighth embodiment, for example, two types of the redline instructing unit 32 described above are prepared. The two types of redline instruction units 32 have different specific identification marks, and the specific identification marks are shared instruction corresponding point information sharing the redline contents and non-shared instruction corresponding point information not sharing, respectively. It corresponds, and it is assumed to be stored along with the instruction corresponding point information. Then, the instruction corresponding point information reflecting means 62 periodically designates “R” for the R / W trigger of the instruction corresponding point information terminal of each projection display device 100 and sequentially reads “redline contents”. , It is determined whether or not the specific identification mark attached to the instruction corresponding point information is the instruction corresponding point information to be shared, and only the sharing instruction corresponding point information to be shared is subject to processing in the seventh embodiment. And so on. According to such a configuration, it is possible to select sharing or non-sharing of redlining, so that it is possible to distinguish between personal annotations and writing and writing that should be shared by all participants.

As described above, according to the projection display device of the present invention, an electronic document can be displayed in actual size on a projection display surface such as paper. In addition, content (display information) can be red-filled (additional entry) in the same way that annotations and corrections are written on paper with writing instruments, and the content red-filled for the content is digitized and content There is an effect that it can be displayed together. Further, since the contents put in red are saved in the instruction corresponding point information storage means prepared separately from the means for storing the contents, the original contents are not changed. Furthermore, according to the projection display device of the present invention, page turning can be performed. In other words, the content pages can be sent one after another in the same manner as flipping paper book pages. This has the effect of quickly finding the page you are looking for.
Note that the projection display device according to the present invention is not limited to the above-described exemplary embodiments, and various modifications can be made without departing from the spirit of the present invention.

It is explanatory drawing explaining the structure of 1st Embodiment of the projection display apparatus which concerns on this invention. It is explanatory drawing explaining an example of the projection display surface in 1st Embodiment. It is explanatory drawing of the coordinate system for demonstrating the function of the drawing control part in 1st Embodiment. 5 is a flowchart for explaining display control processing of a drawing control unit in the first embodiment. It is a flowchart explaining the redlining process of the redlining instruction | indication part in 1st Embodiment. It is a flowchart explaining the display control process of the drawing control part in 2nd Embodiment. It is explanatory drawing for demonstrating the structure of the projection display apparatus in 3rd Embodiment. It is explanatory drawing for demonstrating the structure of the projection display surface in 3rd Embodiment. 10 is a flowchart illustrating display control processing of a drawing control unit according to a third embodiment. It is explanatory drawing explaining the structure of the redlining instruction | indication part in 4th Embodiment. It is a flowchart explaining the redlining process in the redlining instruction | indication part in 4th Embodiment. It is explanatory drawing for demonstrating the structure of 5th Embodiment of the projection display apparatus which concerns on this invention. It is a flowchart explaining the page turning control process in 5th Embodiment. It is explanatory drawing explaining the page feed in 5th Embodiment. It is explanatory drawing explaining the page return in 5th Embodiment. It is explanatory drawing explaining the structure of the projection display apparatus in 6th Embodiment. It is explanatory drawing explaining the projection display system in 7th Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Original drawing memory | storage part, 2 ... Drawing control part, 3 ... Drawing surface, 4 ... Point light source, 5 ... Half mirror, 6 ... Condensing lens, 7 ... Imaging surface, 8 ... Distance measuring part, 9 ... Mark detection part, DESCRIPTION OF SYMBOLS 10 ... Housing | casing, 20 ... Projection display surface, 32 ... Redline instruction | indication part, 33 ... Instruction display mark, 34 ... Mark holding part, 35 ... Supporting point, 36 ... Holding part spring, 37 ... Pen tip, 38 ... Pen tip spring 39 ... Case, 41 ... Document storage unit, 42 ... Page turning control unit, 43 ... Page counter, 44 ... Equilibrium distance storage unit, 51 ... Mark display information storage means, 52 ... Mark position information storage means, 53 ... Mark indication Means 61 ... Display information sharing means 62 ... Instruction corresponding point information reflecting means 71 71 Imaging unit 100 ... Projection display device 210 ... First reference reference point 220 ... Second reference reference point 230 ... First Three reference points, 240 ... fourth reference Quasi-point, 300 ... PC (server), 400 ... network

Claims (17)

Projection having display information storage means for storing display information, drawing means for generating drawing information based on display information stored in the display information storage means, and projection means for projecting and displaying the drawing information on a projection display surface A projection display device comprising display means,
An imaging unit that images the projection display surface on an imaging surface, and a designation state determination unit that determines whether the designation point designation unit that directly designates the designation point on the projection display surface is designated or not designated. And, based on the imaging information of the imaging means, the indication point measuring means for measuring the position on the imaging surface corresponding to the indication point, and the position information of the indication point measured by the indication point measuring means, An instruction corresponding point calculating means for calculating the position of the instruction corresponding point corresponding to the indicated point in the display information, and an instruction corresponding point information storing means for storing the instruction corresponding point information calculated by the instruction corresponding point calculating means. Prepared,
The projection display device, wherein the drawing unit generates drawing information obtained by superimposing image information based on the instruction corresponding point information and the display information. The projection display device according to claim 1,
The indication point designating unit has a contact that indicates the position of the indication point by forming a specific identification mark for indicating the location of the indication point and bringing it into contact with the projection display surface.
The designation state determination means compares the distance of the projection display surface with respect to the specific identification mark of the contact and a predetermined threshold value, and determines whether the indication point designation means designates or does not designate the indication point. A projection display device characterized by determining. In the projection display device according to claim 1 or 2,
The designated point designating means is configured to be able to select either a designated state for designating a desired designated point on the projection display surface or a non-designated state in which no designated point is designated. Projection display device. In the projection display device according to claim 3,
The indication point designating unit includes a contact having a specific identification mark for indicating the position of the indication point, and an indication display mark for displaying the designation state when the contact comes in contact with the projection display surface. A projection display device characterized by that. In the projection display apparatus as described in any one of Claims 1-4,
The projection display surface is formed on a flexible member,
Based on the displacement determining means for determining whether or not the displacement is a predetermined displacement when the projection display surface is displaced, and the predetermined displacement of the projection display surface determined by the displacement determining means, the display information A projection display device comprising: display information rewriting means for rewriting current display information stored in a storage means to another display information.   Display information storage means for storing display information, drawing means for generating drawing information based on the display information stored in the display information storage means, and projection display formed on the flexible member for the drawing information Projection display means having projection means for projecting and displaying on a surface; imaging means for imaging the projection display surface on an imaging surface; and whether or not the displacement is a predetermined displacement when the projection display surface is displaced And a display for rewriting the current display information stored in the display information storage means to another display information based on a predetermined displacement of the projection display surface determined by the displacement determination means. A projection display device comprising: information rewriting means; In the projection display apparatus according to claim 5 or 6,
The display information rewriting means uses a plurality of pieces of display information obtained by dividing the current display information and other display information into a plurality of divided display information at a predetermined interval in a predetermined rewrite direction on the projection display surface. A projection display device, wherein rewriting is sequentially performed in the predetermined rewriting direction at every predetermined interval. The projection display device according to claim 7,
The projection display device, wherein the display information rewriting means changes a predetermined interval or a rewriting speed of the section display information according to the displacement determined by the displacement determination means. In the projection display apparatus as described in any one of Claims 5-8,
The display information rewriting means virtually sets a reference area on the projection display surface, and according to the relative relationship between the reference point and the reference area when the reference point specifying means indicates the inside of the reference area, A projection display device characterized by rewriting display information corresponding to a relative relationship. In the projection display apparatus as described in any one of Claims 5-9,
Mark display information storage means for storing the mark display information instructed by the mark instruction means for instructing the mark on the display information currently displayed, and mark position information for selecting the display information in which the mark display information is set Mark position information storage means for storing
The drawing means generates drawing information obtained by superimposing the landmark display information and the current display information,
The display information rewriting means rewrites the current display information to display information corresponding to the mark position information when the displayed mark display information is instructed by the pointing point designating means. Projection display device. In the projection display apparatus as described in any one of Claims 1-10,
In the display information, at least three reference points that are not on a straight line are set, and on the projection display surface, reference reference points respectively corresponding to the reference points are designated,
A position measuring means for measuring the position of the imaging point at which each reference standard point is imaged on the imaging surface; and a distance measuring means for measuring a distance between each reference standard point and the imaging surface,
The drawing means includes drawing information such that each reference reference point and each corresponding reference point match based on distance information and position information of each reference reference point respectively measured by the distance measuring means and the position measuring means. Is converted from display information. In the projection display apparatus as described in any one of Claims 1-10,
In the display information, at least four reference points that are not on a straight line are set, and on the projection display surface, reference reference points respectively corresponding to the reference points are designated,
Position measuring means for measuring positions where the at least four reference reference points are imaged on the imaging surface, and coefficient calculation for calculating a coefficient for converting display information from the position information measured by the position measuring means Means, and
The drawing means draws information such that each reference reference point and each corresponding reference point match based on the position information and coefficient information of each reference reference point obtained by the position measuring means and the coefficient calculating means, respectively. Is converted from display information. The projection display device according to claim 11 or 12,
A plurality of representative points designated on the projection display surface, and representative point measuring means for measuring the distance between the plurality of representative points and the imaging surface,
The drawing means extracts the drawing information from the display information for each predetermined area on the projection display surface corresponding to each representative point based on distance information for each representative point measured by the representative point measuring means. A projection display device characterized by converting. A plurality of projection display devices according to any one of claims 1 to 13,
A projection display system comprising display information sharing means for transmitting display information on one projection display device to another projection display device. The projection display system according to claim 14, wherein
A projection display system comprising: instruction corresponding point information reflecting means for reflecting instruction corresponding point information in one projection display device to instruction corresponding point information in another projection display device. The projection display system according to claim 15,
The instruction corresponding point information reflecting means acquires instruction corresponding point information from a plurality of projection display devices, and generates shared information in which the acquired instruction corresponding point information is superimposed,
The drawing means generates the drawing information in which the shared information, the image information based on the instruction corresponding point information, and the display information are superimposed. The projection display system according to claim 16, wherein
The indicating point designating unit is capable of designating either one of a shared indicating point that is shared by the plurality of projection display devices and a non-shared indicating point that is not shared.
The instruction corresponding point information reflecting means acquires only the instruction corresponding point information of the shared designated point.

Images