JP2008262302A - Projector, imaging device, projection control method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily create a table while freely changing each component, and to project it. <P>SOLUTION: This projector has: a photographing part (2b, 52, 48) for photographing a photographic object image; a control part 46, 47 for recognizing a character string position inside the photographic object image obtained by the photographing, and producing ruled line data constituting the table from a recognition result thereof; and a projection part (34-44, 2a) creating an optical image of the table based on the ruled line data produced in the control part 46, and projecting it toward the photographed photographic object image. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a projection apparatus, an imaging apparatus, a projection control method, and a program suitable for performing a presentation, for example.

  In a conventional projector apparatus, an edited chart created on a paper surface or a computer can be projected on a screen.

As another technique, a projection apparatus for projecting a table held as a template created in advance onto a screen has been considered. (For example, Patent Document 1)
JP 2004-198858 A

  As described above, the conventional projector apparatus including the technique of Patent Document 1 can project a table prepared in advance, but the configuration of the table, specifically the number of rows, the number of columns, The type of ruled lines forming the table and the size of each cell cannot be changed.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a projection apparatus and an imaging apparatus capable of easily creating and projecting a table while freely changing each component. Another object is to provide a projection control method and program.

  According to the first aspect of the present invention, a photographing unit for photographing a subject image and a ruled line data constituting a table from the recognition result of the character string position in the image obtained from the photographing unit obtained by the photographing unit. A table creation unit that creates a table image based on the ruled line data created by the table creation unit and the character string position, and projects the image onto a subject image photographed by the imaging unit. It is characterized by.

  According to a second aspect of the present invention, in the first aspect of the present invention, the table creating means constructs a table with character string positions in the subject image obtained by the photographing means as item name positions of rows and columns. It is characterized by creating ruled line data.

  According to a third aspect of the present invention, in the first aspect of the present invention, the photographing unit may include a character string newly added corresponding to a cell constituting a table projected by the projection unit in the subject image. The table creation means further comprises a judgment means for judging whether or not a character string added to the cell is out of the range of the cell in the subject image obtained by the photographing means. The image of the character string that has been determined to have protruded from the cell range is reduced to create table data that is fitted in the cell, and the projection means creates the character string image in the cell created by the table creation means. An image of a table in which is inserted is created and projected toward a subject image photographed by the imaging means.

  According to a fourth aspect of the present invention, in the first aspect of the present invention, a character string newly added corresponding to a cell constituting a table projected by the projection unit in the subject image by the photographing unit is photographed. First character recognition means for acquiring text data corresponding to the character string by character recognition processing for the character string image added to the cell in the obtained subject image; and the first character recognition The dictionary registration means for registering the text data acquired by the means and the newly added characters corresponding to the cells constituting the table projected by the projection means in the subject image by the photographing means were obtained and obtained. Second character recognition means for obtaining text data corresponding to the character by character recognition processing for the character image added to the cell in the subject image, and the text obtained by the second character recognition means. Text data registered by the dictionary registration means by data, and further comprising predictive conversion means for selecting text data at least partially matching, the table creating means is the text data selected by the predictive conversion means The table is created by fitting the image of the image into the cell, and the projection unit creates the image of the table created by the table creation unit and the image of the text data fitted in the cell. Projecting toward the subject image photographed by the means.

  According to a fifth aspect of the present invention, in the first aspect of the present invention, the photographing control means for photographing the table projected by the projection means as a subject image by the photographing means, and the table photographed by the photographing control means are recorded. And a recording means.

  According to a sixth aspect of the present invention, in the first aspect of the present invention, with respect to the photographing means for photographing the subject image and the subject image obtained by the photographing means, the character string position in the image is recognized and the recognition result is obtained. Table creating means for creating ruled line data constituting the table from the table, storage means for storing the ruled line data created by the table creating means and the table image based on the character string obtained by the photographing means It is characterized by.

  The invention according to claim 7 is a projection provided with a projection unit that forms an optical image corresponding to the image data and projects the light image toward a projection target, and a photographing unit capable of photographing the projection area of the projection unit as a subject image. A projection control method in the apparatus, for a subject image obtained by the imaging unit, a table creation step of recognizing a character string position in the image and creating ruled line data constituting a table from the recognition result; A projection control step of creating a table image based on the ruled line data created in the table creation step and the character string position, and projecting the image on the subject image captured by the imaging unit; And

  The invention described in claim 8 is a projection provided with a projection unit that forms an optical image corresponding to the image data and projects it toward the projection target, and a photographing unit capable of photographing the projection area of the projection unit as a subject image. This is a program executed by a computer incorporated in an apparatus or an external device that can control the projection apparatus, and recognizes the position of a character string in the subject image obtained by the photographing unit and displays it from the recognition result. A table creating step for creating ruled line data constituting the image, a table image based on the ruled line data created in the table creating step and the character string position, and the projection toward the subject image photographed by the imaging unit And a projection control step of causing the computer to execute projection.

  According to the present invention, it is possible to easily create and project a table while freely changing each component.

  An embodiment in which the projection system according to the present invention is applied to a projection system using a personal computer and a data projector apparatus will be described below with reference to the drawings.

(Constitution)
FIG. 1 shows the appearance and connection configuration of the entire system. The personal computer 1 and the data projector device 2 are wirelessly connected according to wireless LAN technology, for example, the IEEE802.11g standard, and the image data of the presentation program reproduced by the personal computer 1 is appropriately sent to the data projector device 2, and the data projector device 2 is projected toward the white board used as the screen SC.

  Here, it is assumed that both the personal computer 1 and the data projector apparatus 2 have a wireless LAN function in advance, and between the personal computers 1 and the data projector apparatus 2 based on the ad hoc mode using various application programs such as a presentation program. It is assumed that direct communication between each other is possible.

  The data projector device 2 forms a light image corresponding to the image data using, for example, a micromirror element based on the image data sent from the personal computer 1, and includes a projection lens unit 2a disposed on the front surface of the housing. Thus, various images are projected and displayed within the projection range PA on the whiteboard used as the screen SC to be projected.

  In addition, on the front surface of the data projector apparatus 2, a photographing lens unit 2b is disposed in the vicinity of the projection lens unit 2a. The photographic lens unit 2b has a zoom function so that the photographic field angle is linked to the projection (zoom) field angle of the projection lens unit 2a, and shoots so as to match the projection optical axis of the projection lens unit 2a. The optical axis is adjusted in advance, and the photographing range is substantially the same as the projection content of the projection lens unit 2a. As a result, the projection content of the projection lens unit 2a can be photographed via the photographing lens unit 2b.

  Next, the configuration of the personal computer 1 will be described with reference to FIG. FIG. 2 shows a hardware configuration of the personal computer 1, and a north bridge 12 is connected to the CPU 11 that controls various processes and a front side bus FSB.

  The north bridge 12 is further connected to the main memory 13 via the memory bus MB and to the graphic controller 14 and the graphic memory 15 via the graphics interface AGP, and is also connected to the south bridge 16 mainly between them. Execute I / O control.

  The south bridge 16 is connected to a PCI bus 17, a keyboard / mouse 18, a video encoder 19, a wireless LAN interface 20, a multi-disk drive 21, and a hard disk device (HDD) 22, and mainly between these peripheral circuits and the north bridge 12. Performs input / output control.

  It should be noted that the individual elements constituting the personal computer 1 are extremely common and well-known techniques, and therefore description thereof is omitted.

  The video encoder 19 generates and outputs an RGB video signal, which is an analog image signal, from a given digital image signal, and displays a color TFT (thin film transistor) liquid crystal display panel (not shown). The display is driven.

  The wireless LAN interface 20 can establish a wireless LAN with other devices via the wireless LAN antenna 23 in accordance with the IEEE 802.11b / 11g standard, and can transmit and receive various data.

Next, the circuit configuration of the data projector device 2 will be described with reference to FIG.
In the figure, image signals of various standards input from the input / output connector unit 31 are unified into image signals of a predetermined format by the image conversion unit 33 via the input / output interface (I / F) 32 and the system bus SB. Is sent to the projection drive unit 34.

  At this time, an OSD (On Screen Display) image or the like is also sent to the projection drive unit 34 in a state of being superimposed on the image signal as necessary.

  The projection drive unit 34 develops and stores the transmitted image signal in the video RAM 35, and then generates a video signal from the stored contents of the video RAM 35. The projection driver 34 multiplies the frame rate of this video signal, for example, 60 [frames / second] by the number of color component divisions and the number of display gradations, thereby performing a spatial light modulator ( For example, the micromirror element 36 that is SOM) is driven to display.

  On the other hand, a light source lamp 38 using, for example, an ultra-high pressure mercury lamp disposed in the reflector 37 emits white light with high luminance. The white light emitted from the light source lamp 38 is colored in the primary colors R (red), G (green), and B (blue) in a time-division manner via the color wheel 39, and is converted into a luminous flux having a uniform luminance distribution by the integrator 40. Later, the light is totally reflected by the mirror 41 and irradiated to the micromirror element 36.

  Thus, an optical image is formed by the reflected light from the micromirror element 36, and the formed optical image is projected and displayed on the screen (not shown) to be projected through the projection lens unit 2a.

  The projection lens unit 2a enlarges and projects the optical image formed by the micromirror element 36 onto a target such as a screen, and can change the focus position and the zoom position (projection angle of view) arbitrarily. .

  However, the focus lens and the zoom lens (not shown) in the projection lens unit 2a are controlled by moving back and forth along the optical axis direction, and each lens is moved by the rotational drive of the stepping motor (M) 42. .

  However, the projection light drive unit 44 executes the lighting drive of the light source lamp 38, the rotation drive of the motor (M) 43 that rotates the color wheel 39, the rotation drive of the stepping motor 42, and the like.

  The projection light driving unit 44 is also attached to the reflector 37 and receives temperature data from a temperature sensor 45 that detects the temperature of the light source lamp 38.

  The controller 46 controls all the operations of the above circuits. The control unit 46 includes a CPU, a work memory, and the like, and executes a control operation using an operation program, various fixed data, and the like that are fixedly stored in a program memory 47 that is a nonvolatile memory such as an EEPROM.

  Further, an A / D / process circuit 48, a large-capacity memory 49, a wireless processing unit 50, and an audio processing unit 51 are connected to the control unit 46 via the system bus SB.

  The A / D / process circuit 48 scans and drives a CCD (Charge Coupled Device) 52, which is an imaging device that captures a projected image range via the photographing lens unit 2b.

  Although not shown in detail here, the projection lens unit 2a has an optical zoom function for changing the shooting angle of view similarly to the projection lens unit 2a, and always projects the projection range in the projection lens unit 2a and the shooting lens unit 2b. It is assumed that the zoom function operates in conjunction with the shooting range at.

  Thus, the A / D / process circuit 48 forms an image by the photographing lens unit 2b, and the analog image signal obtained by the CCD 52 is AGC (automatic gain control), sampled and digitized, and then subjected to gamma correction processing, white By performing process processing such as balance adjustment processing, interpolation processing, matrix conversion, etc., luminance color-difference color image data suitable for recording is acquired and output.

  The large-capacity memory 49 is a large-capacity memory card, for example, GB (gigabyte) order, which is detachably mounted in a memory card slot provided in the projector device 1 and encloses a flash memory, for example. Then, image data photographed via the CCD 52, dictionary data for predictive conversion described later, and the like are stored.

  The wireless processing unit 50 is a wireless LAN standard interface conforming to, for example, the IEEE 802.11b / 11g standard, and wirelessly connects to the personal computer 1 or the like via the wireless LAN antenna 53 to transmit and receive data.

  The sound processing unit 51 includes a sound source circuit such as a PCM sound source, converts the sound data given at the time of projection operation into analog, and drives a speaker 54 provided, for example, on the back surface of the main body casing of the projector device 1 to emit sound, or If necessary, beep sound is generated.

Note that an operation signal corresponding to a user's key operation is directly input to the control unit 46 from the key switch unit 55.
Examples of the key switch unit 55 include a power key, a zoom key, a focus key, an input selection key, a mode key, a cursor (“↑”, “↓”, “←”, “→”) key, an “Enter” key, and a “Cancel” key. Etc.

Next, the operation of the above embodiment will be described.
(First operation example: Table ruled line projection)
FIG. 5 shows a state in which each item name of “April”, “May”, “June”, “product name”, “unit price”, and “number” is written with a marker pen on a white board used as a screen SC. This is just an example.

  At this time, the projection range PA by the projection lens unit 2a is set so as to include the screen SC, and no specific image is projected, so the white light from the light source lamp 38 passes through the color wheel 39 as it is. Then, the light is reflected at full gradation on the entire surface of the micromirror element 36 and is irradiated uniformly over the entire projection range PA via the projection lens unit 2a.

  FIG. 4 shows that the control unit 46 executes based on the operation program stored in the program memory 47 when the “table creation” mode is selected from a plurality of operation modes prepared in advance with the mode key of the key switch unit 55. This is the processing content of the subroutine to be executed.

When the “table creation” mode is designated, in addition to the contents shown in FIG. 5 above, on the lower end side of the projection range PA, for example,
“Please operate the“ Enter ”key to create a table ruled line”
By projecting a guide message like this, the user is prompted to perform a table creation instruction operation.

  Therefore, at the beginning of the process of FIG. 4, by repeatedly determining whether or not the user has actually performed a table ruled line creation instruction operation (step S101), the system waits for the operation.

  When the user performs an instruction to create a table ruled line, this is determined by input from the key switch unit 55, and the projection of the guide message is stopped, and the photographing lens unit 2b, the CCD 52, and the A / D / process circuit are stopped. 48 is driven to take an image of the screen SC at that time (step S102).

  As described above, the photographic lens unit 2b performs a zoom operation in conjunction with the photographic range that substantially matches the projection range PA by the projection lens unit 2a. Therefore, the image in the projection range PA of the projection lens unit 2a is accurately displayed. You can get it.

  In the control unit 46, the image data of the projection range PA, which has been photographed by the CCD 52 and processed through the A / D / process circuit 48, is temporarily held in the internal work memory, and the image data is character-unit-wise. The cut-out process is performed at step S103 to recognize the position of the character portion located in the image in character units (step S103).

  Next, a series of character string portions are extracted from the interval between each extracted character and adjacent characters, thereby recognizing the rows and columns constituting the table (step S104).

  In the image in the projection range PA shown in FIG. 5, “April”, “May”, “June”, “Product name”, “Unit price”, and “Number” are recognized as a series of character strings, respectively. From the mutual XY coordinate range, it is recognized that a 3 × 3 table corresponding to each item name should be created.

  When the row and column are recognized, projection image data of a table ruled line corresponding to the position and interval of each item name is created (step S105), and the image data is developed and stored in the video RAM 35. Thus, the image of the ruled line is projected within the projection range PA by the micromirror element 36 and the projection lens unit 2a (step S106), and the processing based on the subroutine in FIG.

  FIG. 6 exemplifies a table ruled line that is projected along with the contents in FIG. 5 on the screen SC in the projection range PA at this time. As shown in the figure, by automatically creating a table ruled line and projecting it as an image corresponding to the position of the item name entered on the whiteboard that becomes the screen SC by handwriting with a marker pen, the item name is displayed on the screen SC as a result. A table suitable for the above will be displayed.

  Therefore, after that, by inputting necessary data into each blank cell, the table can be easily completed.

  In this way, while freely changing each component, handwritten writing to arrange the required item names at that time, or sticking a piece of paper such as a sticky note with each item name written on the white board which is the screen SC It is possible to easily create and project a table ruled line with a simple effort, such as doing.

  In creating the table ruled line, the arrangement of the row and the column starting from the item name position arranged on the screen SC is determined. Therefore, the table ruled line is appropriately determined by relatively simple position recognition processing. Can be created.

(Second operation example, entry in cell 1)
Next, an operation at the time of filling in each blank cell after projecting a table ruled line as in the first operation example will be described.

  FIG. 7 shows the first operation corresponding to the entry in the cell, which is performed following the creation and projection operations of the table ruled lines shown in FIG. The processing contents of a subroutine to be executed based on the operation program stored in FIG.

  At the beginning of the process, the state of projecting the ruled line created by the process of FIG. 4 is maintained (step S301), and the screen SC of the projection range PA is photographed by the CCD 52 via the photographing lens unit 2b. (Step S302).

  Regarding the image data of the projection range PA thus obtained, whether or not there is an entry (filling with a marker pen by the user) that protrudes from the range corresponding to each cell position in the projected table. (Step S303), and if it is not done, the process of returning to the process of step S302 is repeatedly executed, thereby monitoring the entry that goes out of the cell.

  The processes in steps S302 and S303 are executed at a predetermined cycle, for example, once every 2 seconds.

  Now, consider a case where the user has made a “digital camera” entry with a marker pen that protrudes from the cells corresponding to the item names “May” and “product name” as shown in FIG.

  In this case, at the time when the protrusion from the cell is determined in step S303, the control unit 46 cuts out a series of character string portions “digital camera” that has protruded from the image data photographed in the immediately preceding step S302. After calculating a reduction ratio that fits correctly in the original cell on the basis of the width, the image data of that portion is reduced (step S304).

  Then, after creating and projecting image data in which the reduced image of the character string portion is superimposed on the image of the table ruled line corresponding to the correct cell position (step S305), the processing from step S302 is performed. Return to. At this point, the entry made by the user with the marker pen and the projected image of the reduced character string portion are superimposed.

  In this way, even if the table ruled line to be projected is entered so as to protrude from the cell, it is possible to continue creating the table without wasting the effort required for the entry. it can.

  Therefore, at the time when the projection as in step S305 is performed, the user only has to erase the portion of the character string entered by the marker pen that has protruded from the projection content with the eraser for the whiteboard. The cell has the correct contents, and can move to the next cell entry operation.

  In FIG. 8B, the control unit 46 executes the processing in steps S304 and S305 corresponding to FIG. 8A, and then the user erases the entry portion with the marker pen with the whiteboard eraser. The projection state in the case is shown.

  As shown in the figure, the user can effectively use the contents of the entry without overloading the entry that caused the protrusion, and the eraser erases the original entry that is no longer needed. It is possible to shift to the next cell entry operation only by adding the trouble.

  As for erasing with the above eraser, it is also possible to erase all of the cells that have protruded after completing the entry to a plurality of cells constituting the table. As a result, the table in the middle of creation is somewhat complicated, but the table can be completed more efficiently.

(Third example of operation / entry in cell 2)
Next, another operation at the time of filling in each blank cell after projecting the table ruled line as in the first operation example will be described.

  FIG. 9 shows a second operation corresponding to the entry in the cell, which is performed subsequent to the creation and projection operation of the table ruled lines shown in FIG. The processing contents of a subroutine to be executed based on the operation program stored in FIG.

  At the beginning of the process, the state of projecting the ruled line created by the process of FIG. 4 is maintained (step S501), and the screen 52 of the projection range PA is photographed by the CCD 52 via the photographing lens unit 2b. (Step S502).

  With respect to the image data of the projection range PA obtained in this way, it is determined whether there is a registration instruction operation from the user (step S503) and whether there is a prediction conversion instruction operation (step S504). By repeatedly executing the process of returning to the above process, it waits for any of these instruction operations to be performed.

  The processes in steps S502 to S504 are executed at a predetermined cycle, for example, once every 2 seconds.

  However, if it is determined in step S503 that a registration instruction operation has been performed, the user has entered a character string in one of the cells constituting the table in the image data captured in step S502 immediately before that. Therefore, after selecting the corresponding cell, the image in the cell is subjected to OCR (optical character reading) processing to perform character recognition (step S505).

  Then, the character string obtained as a result of recognition is registered in the large-capacity memory 49 as dictionary data for predictive conversion to be described later (step S506). Further, an image of text data is created from the recognition result, the image data inserted in the cell is projected (step S507), and the process returns to step S502.

  At this time, on the screen SC of the projection range PA, the character string entered by the user with the marker pen at the cell position overlaps with the character string of the text data projected as the character recognition result. Instead of handwritten characters, a character string in a typeface after character recognition is entered in the cells by simply erasing the cell position with a board eraser.

  FIG. 10B illustrates a plurality of character strings registered as dictionary data in the large-capacity memory 49 in accordance with a user registration instruction.

  If it is determined in step S504 that a predictive conversion instruction operation has been performed, the image data captured in step S502 immediately before that includes at least one character by the user in one of the cells constituting the table. Since the entry has been made, the corresponding cell is selected, and the image in the cell is subjected to OCR (optical character reading) processing to perform character recognition (step S508).

  FIG. 10A shows a state in which the user has entered the character “de” with a marker pen in one of the plurality of cells C constituting the table. When the user performs an operation for predictive conversion from this state, character recognition is performed in step S508, and the dictionary data in the large-capacity memory 49 is searched using the resulting character “de” (step S509). It is determined whether or not there is a matching word / phrase at the beginning of the character string (step S510).

  If it is determined that this is not the case, it is determined that the predictive conversion could not be executed, the predictive conversion instruction operation is invalidated, and the process returns to step S502 again.

  Also, as shown in FIG. 10B, if there is a phrase such as “digital camera” with the character “de” at the head in the dictionary data, this is determined in step S510, and the corresponding text An image of the data is created, and the image data inserted in the cell is projected (step S511).

  Thereafter, it is determined whether or not an instruction operation for canceling the newly projected content has been performed within a predetermined time, for example, 2 seconds (step S512). If an operation for instructing cancellation is performed, the prediction conversion is not intended by the user, so the conversion is canceled and the image of the text data created in the cell C is cancelled. Is erased (step S513), and the process returns to the process from step S502.

  In addition, when the operation for instructing cancellation is not performed in step S512, the prediction conversion is assumed to be effective, and the above-described preparation for the next entry is made while maintaining the projection of the text data of the prediction conversion result. The processing returns from step S502.

  At this time, on the screen SC of the projection range PA, the character entered by the user with the marker pen at the position of the cell C and the character string of the text data projected as a result of the prediction conversion are overlapped. Is a time and effort to erase the position of the cell C with a whiteboard eraser, and a longer character string in a typeface after predictive conversion is entered in the cell C instead of a handwritten character. .

  In this way, for character strings that are likely to be used many times in the table to be created, by appropriately registering them as dictionary data for predictive conversion, the dictionary data is effectively used for the second and subsequent times. Can be greatly simplified using the predictive conversion function, so that the table can be efficiently created.

  For the table created on the screen SC by the above-described operation process, for example, by specifying the recording mode by operating the mode key and instructing photographing, the image on the screen SC is taken by the photographing lens unit 2b and the CCD 52. After the image is processed and processed by the A / D / process circuit 48, the image data is compressed by the image conversion unit 33 according to a predetermined data file format, for example, JPEG (Joint Photographic Coding Experts Group). It is good also as what is memorize | stored in the mass memory 49 as a storage medium.

  By recording an image of a table created in a predetermined data file format in the large-capacity memory 49 in this way, the contents can be appropriately read and referenced even after the table is created at a presentation or a meeting.

  In this case, in the present embodiment, the large-capacity memory 49 is constituted by a memory card that can be attached to and detached from the data projector device 2. For example, by setting the memory card in a printer, there is no personal computer. You can use the images of the created table more easily, such as printing out the created table.

  Note that all the above operations are executed by the control unit 46 of the data projector device 2, but the present invention is not limited to this, and the personal computer 1 side wirelessly connected via the data projector device 2 may The same processing may be executed by the installed program.

  In the third operation example described above, text data is uniformly registered as dictionary data created in the large-capacity memory 49. However, character recognition processing is performed on the item name at the beginning of a row or column in which a cell exists. It is also possible to read the genre and create a genre-specific dictionary, for example, a dictionary dedicated to names or a dictionary dedicated to items.

  Furthermore, the dictionary to be created is not limited to characters, and images can also be held, and by writing the image name in characters, the image associated with the image name may be read and pasted into a table cell.

  Although the above embodiment has been described with respect to a case where the present invention is applied to a projection apparatus, the present invention is not limited to this. For example, the image of a character string written with a marker pen on a whiteboard or the like can be captured. An image of a digital camera that can generate a ruled line image corresponding to the character string position in the image, synthesize it in the captured image, and store it as a table image, or a mobile phone terminal having a camera function It can be easily applied to the apparatus.

  As described above, when the present invention is applied to an imaging apparatus, the stored image can be easily distributed and handled, for example, by printing out the stored image or attaching it to an e-mail in the state of electronic data.

  In addition, the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the invention in the implementation stage. In addition, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination according to a plurality of disclosed structural requirements. For example, even if several constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the effect can be obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.

The figure which shows the apparatus structure of the whole projection system which concerns on one Embodiment of this invention. The block diagram which shows the hardware constitutions of the personal computer which concerns on the embodiment. The block diagram which shows the function structure of the electronic circuit of the data projector apparatus which concerns on the same embodiment. The flowchart which shows the processing content performed at the time of a table preparation process in the 1st operation example which concerns on the embodiment. The figure which illustrates the state of the projection range before the table ruled line creation process which concerns on the embodiment. The figure which illustrates the state of the projection range after the table ruled line creation process which concerns on the embodiment. The flowchart which shows the processing content performed at the time of cell entry processing in the 2nd operation example which concerns on the embodiment. The figure which illustrates cell entry operation after table ruled line creation concerning the embodiment. The flowchart which shows the processing content performed at the time of cell entry processing in the 3rd operation example which concerns on the embodiment. The figure which illustrates cell entry operation after table ruled line creation concerning the embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Personal computer, 2 ... Data projector apparatus, 2a ... Projection lens unit, 2b ... Shooting lens unit, 11 ... CPU, 12 ... North bridge, 13 ... Main memory, 14 ... Graphic controller, 15 ... Graphic memory, 16 ... South Bridge, 17 ... PCI bus, 18 ... Keyboard / mouse, 19 ... Video encoder, 20 ... Wireless LAN interface (I / F), 21 ... Multi-disk drive, 22 ... Hard disk device (HDD), 23 ... Wireless LAN antenna, 31 Input / output connector unit 32 Input / output interface (I / F) 33 Image conversion unit 34 Projection drive unit 35 Video RAM 36 Micromirror element 37 Reflector 38 Light source lamp 39 ... color wheel, 40 ... integrate , 41 ... Mirror, 42 ... Stepping motor (M), 43 ... Motor (M), 44 ... Projection light drive unit, 45 ... Temperature sensor, 46 ... Control unit, 47 ... Program memory, 48 ... A / D / process circuit 49 ... Mass memory, 50 ... Wireless processing unit, 51 ... Audio processing unit, 52 ... CCD, 53 ... Wireless LAN antenna, 54 ... Speaker, 55 ... Key switch unit, AGP ... Graphics interface, C ... Cell, FSB ... Front side bus, MB ... memory bus, PA ... projection range, SB ... system bus, SC ... screen.

Claims (8)

Photographing means for photographing a subject image;
Table creation means for recognizing a character string position in the image for the subject image obtained by the photographing means and creating ruled line data constituting the table from the recognition result;
A projection apparatus comprising: projection means for creating an image of a table based on the ruled line data created by the table creation means and the character string position, and projecting the image onto a subject image photographed by the imaging means .   2. The projection apparatus according to claim 1, wherein the table creating means creates ruled line data constituting the table using the character string position in the subject image obtained by the photographing means as the item name position of each row and column. . The photographing means photographs a character string newly added corresponding to a cell constituting a table projected by the projecting means in the subject image,
A judgment means for judging whether or not the character string added to the cell in the subject image obtained by the photographing means exceeds the range of the cell;
The table creating means reduces the image of the character string determined to have protruded the range of the cell by the determining means, and creates the data of the table fitted in the cell,
The projection means creates an image of a table created by the table creation means, in which a character string image is inserted into a cell, and projects the image onto a subject image photographed by the imaging means. The projection apparatus according to 1. The character string added to the cell in the subject image obtained by photographing the newly added character string corresponding to the cell constituting the table projected by the projection means in the subject image by the photographing means. First character recognition means for acquiring text data corresponding to the character string by character recognition processing on the image;
Dictionary registration means for registering the text data acquired by the first character recognition means;
A character newly added corresponding to the cell constituting the table projected by the projection unit in the subject image is photographed by the photographing unit, and the character image added to the cell in the obtained subject image is captured. On the other hand, second character recognition means for acquiring text data corresponding to the character by character recognition processing;
Further comprising: predictive conversion means for searching text data registered by the dictionary registration means from text data acquired by the second character recognition means, and selecting text data at least partially matching;
The table creation means creates data of a table in which an image of text data selected by the prediction conversion means is fitted in the cell,
The projection unit creates an image of a table created by the table creation unit, in which an image of text data is inserted in a cell, and projects the image onto a subject image photographed by the imaging unit. Item 4. The projection device according to Item 1. Photographing control means for photographing the table projected by the projection means as a subject image by the photographing means;
The projection apparatus according to claim 1, further comprising recording means for recording a table photographed by the photographing control means. Photographing means for photographing a subject image;
Table creation means for recognizing a character string position in the image for the subject image obtained by the photographing means and creating ruled line data constituting the table from the recognition result;
An image pickup apparatus comprising: storage means for storing ruled line data created by the table creating means and a table image based on the character string obtained by the photographing means. This is a projection control method in a projection apparatus that includes a projection unit that forms an optical image corresponding to image data and projects it toward a projection target, and a photographing unit that can photograph a projection area in the projection unit as a subject image. And
A table creation step for recognizing the character string position in the image for the subject image obtained by the photographing unit and creating ruled line data constituting the table from the recognition result;
A projection control step of creating a table image based on the ruled line data created in the table creation step and the character string position, and projecting the image onto the subject image captured by the imaging unit; A characteristic projection control method. Can control a projection device or projection device that has a projection unit that forms an optical image corresponding to image data and projects it toward the projection target, and a photographing unit that can shoot the projection area of this projection unit as a subject image A program that is executed by a computer built in an external device,
A table creating step for recognizing the character string position in the image for the subject image obtained by the photographing unit and creating ruled line data constituting the table from the recognition result;
Create a table image based on the ruled line data created in the table creation step and the character string position, and cause the computer to execute a projection control step of projecting by the projection unit toward the subject image captured by the imaging unit A program characterized by that.

Images