JP2010220059A - Apparatus, program, method and system for image processing - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To process images so as to make the direction of an object in an imaged image appropriate without being affected by the type of the object to be imaged or the angle of the object mounted on a base. <P>SOLUTION: The last touch point to a pedestal is stored, and a rotation angle is determined on the basis of an effective area to which the stored touch point belongs and a predetermined reference direction. That is, when a touch point P is stored, an area to which the touch point P belongs is the effective area D. Also, when the predetermined reference direction is "turning the area to which the touch point belongs to the upper right", in order to turn the effective area D to the upper right in the figure, the image has to be rotated for 180° with the center of the pedestal 12 as a rotation center. Thus, the rotation angle "180°" is calculated. Thereafter, image correction processing of rotating a photographed image by the rotation angle is executed. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing apparatus having an imaging function, an image processing program, an image processing method, and an image processing system used therefor.

  2. Description of the Related Art Conventionally, a document camera apparatus is known as an apparatus that captures a document original (for example, catalog, newspaper, magazine cutout) and outputs the image information to an external device or records it as image data on a recording medium. Such a document camera apparatus is provided with a camera unit capable of adjusting a relative position with respect to a document table in a main body including a document table on which a document document to be photographed is placed, and the camera unit is a CCD or MOS type image sensor. The digital camera is provided with an electronic circuit for performing imaging signal processing and image processing. Therefore, by outputting the document document imaged by the camera unit to the projector via the personal computer, the document document can be projected on the screen for presentation.

  At this time, since the direction in which the camera unit takes in the document placed on the document table is fixed, if the document is loaded in the wrong direction, the document is turned upside down from the correct direction or the document is rotated 90 degrees vertically and horizontally. Will be projected. Also, if the original is not placed on the original table at an appropriate angle and is placed at an oblique angle, the camera unit captures the original with the angle shifted as it is, so The document is projected with the angle shifted obliquely. For this reason, in order for the user to correct the document to an appropriate angle, after the document loaded on the document table is taken in via the camera unit, the document image projected via the personal computer and the projector is confirmed, and the orientation is shifted. If it is recognized that the document image data that has been captured must be rotated each time using software on the personal computer, the user is forced to perform complicated operations, which is not convenient. . On the other hand, when there are characters in the original, the character string in the original in the image captured and output by the camera unit is recognized by the personal computer and the image is rotated, and then the projector is corrected. A technique for projecting a character string on a screen in an appropriate direction has been proposed (for example, see Patent Document 1 below).

Japanese Patent Application Laid-Open No. 2004-363636

  However, in the above prior art, character recognition is performed, and correction processing such as rotating an image based on the recognition result is performed. Therefore, when there is no character in the target, for example, when the original is a figure or an article other than the original, the correction process cannot be performed. In addition, even if characters are present in the target, if the target is not able to recognize the character because it is significantly deviated from the appropriate angle on the document table, for example, as a result of placing the document in reverse, the character is also reversed. If it cannot be recognized, the correction process cannot be performed. Therefore, it has not been said that the above-mentioned problems have been sufficiently solved.

  The present invention has been made in view of such a conventional problem, and imaging is not affected by the type of object to be imaged, the angle of the object placed on the table, or the positional relationship with the imaging unit. An object of the present invention is to provide an image processing apparatus, an image processing program, an image processing method, and an image processing system for processing an image so that the orientation of an object in the image is appropriate.

  In order to solve the above-described problem, in the image processing apparatus according to the first aspect of the present invention, a pedestal, imaging means for imaging a subject placed on the pedestal, and a subject placed on the pedestal. And detecting means for detecting a designated position designated for the pedestal or the subject, and imaging by the imaging means so that the designated position detected by the detecting means is in a predetermined direction set in advance. And a calculation means for calculating the rotation angle of the image, and an image processing means for rotating the image at the rotation angle calculated by the calculation means.

  According to a second aspect of the present invention, there is provided an image processing apparatus comprising output means for outputting an image rotated by the image processing means to the outside.

  In the image processing apparatus according to the third aspect of the invention, the detection unit divides the area on the pedestal into a predetermined number, and is designated for the pedestal among the predetermined number of areas. An area to which the designated position belongs is detected, and the calculation means calculates a rotation angle of an image captured by the imaging means so that the area is in the predetermined direction set in advance.

  In the image processing apparatus according to the fourth aspect of the invention, the detection unit divides the area on the subject placed on the pedestal into a predetermined number, and out of the predetermined number of areas. An area to which the designated position designated for the subject belongs is detected, and the calculation means calculates a rotation angle of an image taken by the imaging means so that the area is in the predetermined direction set in advance. It is characterized by that.

  Further, the image processing apparatus according to the invention of claim 5 is provided with a discriminating means for discriminating whether the subject placed on the pedestal is a rectangle or an irregular shape other than a rectangle, When the determination unit determines that the subject is rectangular, the detection unit detects a region to which the designated position belongs, and the calculation unit determines that the region is in the predetermined direction set in advance. The rotation angle is calculated.

  In the image processing apparatus according to the sixth aspect of the present invention, the subject has the region in the predetermined direction set in advance, and the rectangular subject is parallel to a frame constituting the image. The rotation angle is calculated so that

  In the image processing apparatus according to the seventh aspect of the present invention, the detection means detects a designated position designated for the subject placed on the pedestal, and the calculation means comprises the designation The rotation angle of the image captured by the imaging unit is calculated so that the position is in the predetermined direction set in advance.

  Further, the image processing apparatus according to the invention of claim 8 is provided with a discriminating means for discriminating whether the subject placed on the pedestal is a rectangle or an irregular shape other than a rectangle, When the determination unit determines that the subject has an irregular shape other than a rectangle, the detection unit detects the designated position, and the calculation unit causes the designated position to be in the predetermined direction set in advance. Further, the rotation angle is calculated.

  In the image processing apparatus according to the ninth aspect of the invention, the detection unit detects the designated position based on an image captured by the imaging unit.

  In the image processing apparatus according to claim 10, the calculation unit calculates the rotation angle based on a designated position with respect to the pedestal or the object last detected by the detection unit. Features.

  In the image processing apparatus according to an eleventh aspect of the invention, the detection unit detects a touch position on the base or the subject as the designated position.

  The image processing apparatus according to the invention described in claim 12 is characterized in that setting means capable of presetting the predetermined direction is provided.

  In the image processing program according to the thirteenth aspect of the present invention, a computer included in an image processing apparatus that includes a pedestal and an imaging unit that images a subject placed on the pedestal is provided on the pedestal. When a subject is placed, detection means for detecting a designated position designated for the pedestal or the subject, and the designated position detected by the detection means are in a predetermined direction set in advance. A calculation unit that calculates a rotation angle of an image captured by the imaging unit, and an image processing unit that rotates the image at the rotation angle calculated by the calculation unit are provided.

  The image processing method according to the invention of claim 14 is an image processing method in an apparatus comprising a pedestal and an imaging means for imaging a subject placed on the pedestal. A detection step of detecting a designated position designated for the pedestal or the subject when the subject is placed on the object, and the designated position detected by the detection step is in a predetermined direction set in advance. A calculation step of calculating a rotation angle of the image picked up by the image pickup means, and an image processing step of rotating the image at the rotation angle calculated by the calculation step.

  In the image processing system according to the fifteenth aspect of the present invention, an image pickup apparatus comprising: an image pickup unit that picks up an image on a pedestal on which a subject is placed; And monitoring means for monitoring the image sent from the imaging device, and detecting the designated position designated for the pedestal or the subject when the subject is placed on the pedestal based on the monitoring of the image by the monitoring means Detection means for rotating, rotation processing means for rotating the image sent from the imaging apparatus so that the designated position is set in a predetermined direction, and output means for outputting the image subjected to the rotation processing to the projection apparatus. And an image processing apparatus, and a projection apparatus including a projection unit that projects an image sent from the image processing apparatus.

  According to the present invention, the orientation of the target in the captured image is appropriate without being affected by the type of the target to be imaged, the angle of the target placed on the table, or the positional relationship with the imaging unit. Thus, the image can be corrected. Therefore, by using the corrected image, it is possible to project an image in which the target is in an appropriate direction.

1 is a system configuration diagram showing an imaging projection system including a digital camera according to an embodiment of the present invention. It is a block diagram which shows the electric constitution of a digital camera. It is a block diagram which shows the outline of the electrical structure of the projector and PC in the system. It is explanatory drawing which shows the effective area | region of a base. It is a flowchart which shows the process sequence in the 1st Embodiment of this invention. It is a flowchart which shows the process sequence in the 2nd Embodiment of this invention. It is a transition diagram which shows operation | movement of 2nd Embodiment. It is a transition diagram which shows the other operation | movement in 2nd Embodiment.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a configuration diagram of an imaging projection system including a document camera according to an embodiment of the present invention.

  This imaging / projection system includes a document camera 1 for photographing a projection object such as a document or a catalog, a PC (personal computer) 2, and a projector 3. The document camera 1 and the PC 2 are connected by a USB cable 4, and the PC 2 and the projector 3 are connected by an RGB cable 5. The projector 3 is provided with an infrared remote control unit 6 that can be operated from a remote location.

  The document camera 1 includes a camera stand 11 and a digital camera 51 that is detachably attached thereto. The camera stand 11 includes a thin plate-like pedestal 12 on which an arbitrary projection target is placed, a stand main body 13 supported by the pedestal 12, a support arm 14 provided at the upper end portion thereof, and an attachment provided at the tip thereof. Part 15. The digital camera 51 is attached to the attachment portion 15.

  The digital camera 51 has general functions such as AE, AWB, AF, and the like, and can be used alone. When the digital camera 51 is attached to the camera stand 11, the digital camera 51 passes through the camera stand 11. Image data acquired by imaging is output to the PC 2.

  FIG. 2 is a block diagram showing the configuration of the digital camera 51. The lens block 61 includes an optical system such as a zoom lens and a focus lens, and a drive mechanism for driving the optical system. The optical system is moved in the optical axis direction by a motor 62 provided in the drive mechanism. Driven. The motor 62 operates by a drive signal supplied from a motor driver 64 connected via a bus 63 to a CPU 72 that controls the entire digital camera 51, and drives the optical system. A strobe 65 is also connected to the bus 63.

  In addition, a CCD 66 serving as an imaging unit is disposed on the optical axis of the lens included in the lens block 61. The CCD 66 has a rectangular imaging range, and is driven by a vertical and horizontal driver 68 based on a timing signal generated by a timing generator (TG: Timing Generator) 67 in accordance with a command from the CPU 72, and analog according to the optical image of the subject. Are output to the signal processing circuit 69. The signal processing circuit 69 includes a CDS circuit that removes noise included in the output signal of the CCD 66 by correlated double sampling, an A / D converter that converts an imaging signal from which noise has been removed to a digital signal, and the like. The imaging signal converted into is output to the image processing unit 70.

  The image processing unit 70 performs processing such as pedestal clamping on the input imaging signal, converts it into a luminance (Y) signal and a color difference (UV) signal, and performs image processing such as auto white balance, contour enhancement, and pixel interpolation. Perform digital signal processing to improve quality. The YUV data converted by the image processing unit 70 is sequentially stored in the SDRAM 71, and in the REC through mode, every time one frame of data (image data) is accumulated, it is converted into a video signal, and a liquid crystal monitor (LCD). 53 and displayed on the screen as a through image. The image data for one frame temporarily stored in the SDRAM 71 is compressed by the CPU 72 at the time of shooting when the shutter key is pressed, and finally recorded in the external memory 73 as an image file of a predetermined format.

  The external memory 73 is a memory card that is detachable from the camera body connected via a card interface (not shown). The image file recorded in the external memory 73 is read out and expanded by the CPU 72 in accordance with the user's selection operation in the PLAY mode, and expanded on the SDRAM 71 as YUV data, and then displayed on the liquid crystal monitor 53. The flash memory 74 stores various programs for causing the CPU 72 to control the above-described units, for example, various programs such as an AE, AF, AWB control program, and a data communication program.

  A USB interface 75 is connected to the bus 63. The USB interface 75 is provided with a connection connector connected to a USB connector (not shown) provided on the mounting portion 15 of the camera stand 11 described above, whereby the digital camera 51 is connected to the USB interface 75 from the USB interface 75. Output of image data to the PC 2 and data communication with the PC 2 are possible via the camera stand 11. The digital camera 51 has a key input unit 76 including operation keys and switches such as a power switch, a mode selection key, a shutter key, and the like. The operation of each operation key in the key input unit 76 is regularly scanned by the CPU 72, and when any operation key is operated, the CPU 72 executes a process corresponding to the key operation.

  FIG. 3 is a block diagram showing an outline of the electrical configuration of the PC 2 and the projector 3. The PC 2 is a general-purpose notebook personal computer, and includes a CPU 81, a RAM 82, a storage device 83, an input device 84, a video adapter 85, a VRAM 86, and a display device 87.

  The video adapter 85 generates a display video signal (RGB signal) and outputs it to a display device 87 including an LCD and its drive circuit. The VRAM 86 stores the display image data generated by the video adapter 85 as needed. To do. The video adapter 85 is provided with an RBG output terminal 88 to which the RGB cable 5 is connected. The video adapter 85 sends image data for display via the RGB cable 5 in accordance with a command from the CPU 81. Output to 3.

  The CPU 81 is provided with a USB interface 89, and the USB cable 4 connected to the document camera 1 is connected to the USB interface 89. Accordingly, image data sent from the document camera 1 (digital camera 51) is input to the CPU 81 via the USB interface 89, and data communication with the document camera 1 is possible as necessary. Yes. The input device 84 is a plurality of keys provided on the PC 2 main body, a mouse connected to the main body, and the like, and the storage device 83 is a hard disk or the like having a relatively large storage capacity. The storage device 83 stores a communication program for performing data communication with the digital camera 51 and the projector 3.

  The projector 3 includes a CPU 91, ROM 92, RAM 93, image input unit 94, display unit 95, key input unit 96, and infrared signal receiving unit 97. An RBG signal input terminal 98 to which the RGB cable 5 is connected is connected to the image input unit 94, and a display signal for projecting an image is input based on the input image signal (RGB signal) input from the PC 2. It is generated and sent to the display unit 95. The display unit 95 includes a light source such as a krypton lamp, an image conversion element such as a liquid crystal or a micromirror array for converting light of the light source into projection light corresponding to an input display signal, and the image conversion element. A display circuit based on image data sent from the PC 2 includes a drive circuit that drives based on a display signal sent from the optical system, and an optical system such as a projection lens provided in the projection unit 3a (see FIG. 1) of the main body. 7 is projected.

  The CPU 91 operates using the RAM 93 as a working memory according to a program stored in the ROM 92 and controls the projector 3 as a whole. The key input unit 96 is composed of a plurality of operation keys prepared for the user to operate the projector 3, and the infrared signal receiving unit 97 is an infrared signal sent from the infrared remote control unit 6 described above. Is received, and the operation signal encoded therein is decoded and sent to the CPU 91.

  That is, in this imaging / projection system, when the digital camera 51 is set to a predetermined mode for capturing a projection target and transferring the captured image to the PC 2 in accordance with a shooting operation by the user, the PC 2 performs data communication processing. By executing the above, the image of the projection object photographed by the digital camera 51 is sent to the projector 3 via the PC 2 and projected.

(First embodiment)
In the first embodiment of the present invention, an image captured according to the touch position on the pedestal 12 is rotated. Therefore, in order to invalidate the user's unconscious touch on the pedestal 12 and validate only the conscious touch, the pedestal 12 has an effective area in the upper right where the touch is valid as shown in FIG. A, an effective area B at the lower right, an effective area C at the upper left, an effective area D at the lower left, and an invalid area NG, which is another area, is virtually divided.

In the present embodiment having the above-described configuration, the CPU 72 of the digital camera 51 executes processing as shown in the flowchart of FIG. 5 based on the program stored in the flash memory 74. That is, first, a reference direction setting process is executed (step SA1). This reference direction setting process is a process for determining in advance whether the captured image is rotated so that the effective areas A to D touched by the user on the pedestal 12 are in the upper right, lower right, upper left, and lower left directions. It is. In this process, the following options (1) to (4) are displayed on the liquid crystal monitor 53.
(1) The area to which the touch point belongs is set to the upper right.
(2) The area is set to the lower right.
(3) The same area is set to the upper left.
(4) The same area is set to the lower left.

  If any one of these options is selected by key operation, the option is stored in the SDRAM 71. Note that “(1) the area to which the touch point belongs is set to the upper right” is set by default. Therefore, if the user does not perform a selection operation, the option (1) is automatically set.

  Subsequently, the pedestal monitoring operation is started (step SA2). That is, the vertical and horizontal drivers 68 drive the CCD 66 at a frame rate of 30 fps, for example, based on the timing signal generated by the timing generator 67. The CPU 72 monitors the pedestal 12 by referring to images sequentially stored in the SDRAM 71 via the image processing unit 70 at this frame rate.

  Then, by comparing the images before and after sequentially stored in the SDRAM 71 at the frame rate, it is determined whether the subject is placed on the pedestal 12 (step SA3). That is, when a change starts to occur on the pedestal 12 in the image, it is determined that the subject is placed on the pedestal 12.

Subsequently, in order to grasp the user's touch point with respect to the pedestal 12, the images sequentially stored in the SDRAM 71 are monitored as described above. Then, by using a well-known subject recognition technique, an area designated by the user at the end of the image placement operation is identified in the image. That is, the user's fingers in the image are identified, and it is determined whether or not the identified fingers have been slid out from the base 12 (step SA4).
Further, when the user's finger slides out from the image, it is determined whether or not a predetermined time has passed (step SA5). If the predetermined time has elapsed, the user's finger that has been slid out of the image stores the point on the pedestal 12 designated immediately before the slide-out in the SDRAM 71 as the touch point described above (step SA6). Therefore, the user can correct an effective touch point stored in the SDRAM 71 by touching the base 12 again before the predetermined time elapses.

  Next, it is determined whether or not the stored touch points are within the effective areas A to D (step SA7). If this determination is NO and the user touches the invalid area NG, it is estimated that the touch is not a conscious touch but is unconscious and has no intention of rotating the image captured by the user. can do. Therefore, in this case, the process proceeds to the end without executing the processes of steps SA8 to SA12 described later. As a result, the user's unconscious touch on the pedestal 12 can be invalidated, and only the conscious touch can be detected for processing.

  If the determination in step SA7 is YES and the stored touch point is one of the effective areas A to D, the effective areas A to D to which the touch point belongs are determined in advance in step SA1. The rotation angle is determined based on the determined reference direction (step SA8).

  That is, if the user last touches the touch point P shown in FIG. 4A and this is stored in step SA6, the area to which the touch point P belongs is the effective area D. If option (1) is selected and set in step SA1, the predetermined reference direction is “the area to which the touch point belongs is set to the upper right”. In FIG. 4A, in order to make the effective region D right upper, the image must be rotated 180 ° with the center of the base 12 as the center of rotation. Therefore, in step SA8, the rotation angle “180 °” is calculated.

  Subsequently, it is determined whether or not the shutter key has been operated (step SA9). If the shutter key is operated, one frame of image data captured by the CCD 66 at that time is taken into the SDRAM 71 via the image processing unit 70 (step SA10). Further, the image data fetched into the SDRAM 71 is subjected to rotation image processing at the rotation angle calculated in step SA8 (step SA11).

  That is, in this example, the rotation angle “180 °” is calculated in step SA11. A pedestal 12 is present in the image captured in step SA10. Therefore, in step SA11, image data is generated by rotating the image by 180 ° with the center of the pedestal 12 existing in the image as the rotation center.

  Therefore, regardless of the angle at which the subject is placed on the pedestal 12, the image can be corrected so that the part desired by the user is in a desired direction or an appropriate direction. In addition, unlike the prior art described above, since character recognition is not necessary, the direction of the subject in the photographed image can be corrected without depending on the type of the subject to be photographed.

  Thereafter, the rotated image data is recorded in the external memory 73 and output from the USB interface 75 (step SA12). Then, the PC 2 connected to the USB interface 75 operates according to the data communication program, receives the rotated image data, and transmits it to the projector 3. The projector 3 receives this and projects a display image based on the image data sent from the PC 2 onto the screen 7. The display image projected on the screen 7 is based on the rotated image data.

  Therefore, regardless of the angle at which the subject is placed on the pedestal 12, it is possible to project and display an image in which the part desired by the user is in a desired direction or an appropriate direction. In addition, unlike the prior art described above, since character recognition is not necessary, the direction of the projected image can be made appropriate regardless of the type of subject to be projected.

  Further, since the direction of the projected image can be made appropriate by an extremely simple operation such as touch, it does not take time to correct the direction of the projected image. Therefore, even when this projection system is used in a presentation, it is possible to prevent the inconvenience of stopping the presentation flow due to the time required to correct the direction of the projected image. Can do.

Further, since the touch position on the pedestal 12 is detected based on the image captured by the CCD 66, the touch position can be detected without providing a touch sensor or the like. Of course, a touch sensor may be laid on the base 12 and the touch position may be detected by this touch sensor. In any case, it is only necessary that the image rotation process can be performed based on the touch position designated by the user, and the touch position detection method is not particularly limited.
Further, in the present embodiment, as shown in FIG. 4A, the effective area on which the touch on the pedestal 12 is valid is divided into four corners of upper right, lower right, upper left, and lower left, and the above-described step SA1. The rotation processing is performed on the image captured based on the reference direction set in (for example, (1) the area to which the touch point belongs is set to the upper right). However, the present invention is not limited to this. For example, the effective area on the pedestal 12 may be divided as shown in FIG. 4B. In this case, in the above-described step SA1, the area to which the touch point belongs is assigned to the upper, lower, left, and right areas. Set which one to use. Then, if it is set that the area to which the touch point belongs is set to be upward, if the user touches the upper area of the pedestal in the direction in which the user wants to face upward after placing the document, the rotation process is performed so that the area to which the touch point belongs becomes upward It can be performed.

  In the present embodiment, not only the shooting process but also other processes such as data rotation image processing are performed on the digital camera 51 side, but only the shooting process is performed on the digital camera 51 side. The image may be sent to the PC 2 and other processing such as data rotation image processing may be executed on the PC 2 side.

(Second Embodiment)
The second embodiment of the present invention is different from the first embodiment described above, even if the subject (target) is placed obliquely with respect to the base 12, the regular user desires An image captured in the direction can be rotated. In other words, the first embodiment described above rotates the image picked up on the basis of the touch point on the pedestal 12, whereas the second embodiment is placed on the pedestal 12. The image shot according to the touch position with respect to the subject (target) is rotated. The CPU 72 of the digital camera 51 executes processing as shown in the flowchart of FIG. 6 based on the program stored in the flash memory 74.

First, a reference direction setting process is executed (step SB1). In this reference direction setting process, when the user touches a subject placed on the pedestal 12, the captured image is rotated so that the touch position on the subject is in any of the upper right, lower right, upper left, and lower left directions. This is a process for determining in advance. In this process, the following options (1) to (4) are displayed on the liquid crystal monitor 53.
(1) The area or touch point to which the touch point belongs is set to the upper right.
(2) The same area or touch point is set to the lower right.
(3) The same area or touch point is set to the upper left.
(4) The same area or touch point is set to the lower left.

  If any one of these options is selected by key operation, the option is stored in the SDRAM 71. Note that “(1) the area or touch point to which the touch point belongs is set to the upper right” is set by default, and therefore the option (1) is automatically set when the user does not perform the selection operation. .

  Subsequently, the base monitoring operation is started (step SB2). That is, the vertical and horizontal drivers 68 drive the CCD 66 at a frame rate of 30 fps, for example, based on the timing signal generated by the timing generator 67. The CPU 72 monitors the pedestal 12 by referring to images sequentially stored in the SDRAM 71 via the image processing unit 70 at this frame rate.

  Then, by comparing the images before and after sequentially stored in the SDRAM 71 at the frame rate, the operation of placing the subject on the pedestal 12 is determined (step SB3). That is, when a change starts to occur on the pedestal 12 in the image, it is determined that the subject is placed on the pedestal 12.

Subsequently, in order to grasp the user's touch point with respect to the subject placed on the pedestal 12, the images sequentially stored in the SDRAM 71 are monitored as described above. Then, using a known subject recognition technique, a point on the subject designated by the user at the end of the image placement operation is identified in the image. That is, the user's finger in the image is identified, and it is determined whether or not the identified finger has slid out from the base 12 (step SB4).
Further, when the user's finger slides out of the image, it is determined whether or not a predetermined time has passed (step SB5). If the predetermined time has elapsed, the user's finger that has been slid out of the image stores the point on the subject designated immediately before the slide-out in the SDRAM 71 as the user's touch point on the photographic subject described above (step) SB6).

  Subsequently, the shape of the subject placed on the base 12 is acquired based on the image stored in the SDRAM 71 (step SB7). Further, it is determined by detecting a straight line in the image stored in the SDRAM 71, for example, whether the acquired shape of the subject is a rectangle like a document or an indefinite shape other than a rectangle (step SB8). ).

  If the result of this determination is that the shape of the subject is a rectangle such as a document, the subject is divided into predetermined areas by line segments parallel to the periphery based on the shape (step SB9). That is, as shown in FIG. 7A, when a rectangular subject S located in parallel with the frame F exists in the image I consisting of one frame F stored in the SDRAM 71, the image I is included in the image I. The existing subject S is divided into, for example, quadrants by line segments L3 and L4 parallel to the surroundings L1 and L2, thereby dividing the subject S into an upper right area A, a lower right area B, an upper left area C, and a lower left area D.

Further, as shown in FIG. 8A, when an image I consisting of one frame F stored in the SDRAM 71 includes a subject S that is not parallel to the frame F and arranged at an angle, the image The subject S existing in I is divided into, for example, quadrants by line segments L3 and L4 parallel to the surroundings L1 and L2, thereby dividing the subject S into an upper right area A, a lower right area B, an upper left area C, and a lower left area D. .
Then, the rotation angle is adjusted so that the subject is parallel to the frame based on the area to which the touch point stored in step SB6 belongs and the reference direction previously determined in step SB1 among the divided areas A to D. Calculate (step SB10).

  That is, if the user last touches the touch point P shown in FIG. 7A and this is stored in step SB6, the area to which the touch point P belongs is the divided area D. If option (1) is selected and set in step SB1, the predetermined reference direction is “the area to which the touch point belongs or the touch point is set to the upper right”. In addition, as shown in FIG. 7A, in this example, the subject S and the frame F are parallel when placed. Therefore, in FIG. 7A, in order to set the divided region D to the upper right so that the subject S is parallel to the frame F, the image must be rotated 180 ° with the center of the base 12 as the center of rotation. Therefore, in step SB10, the rotation angle “180 °” is calculated.

  Further, if the user last touches the touch point P shown in FIG. 8A and this is stored in step SB6, the area to which the touch point P belongs is a divided area D. If option (1) is selected and set in step SB1, the predetermined reference direction is “the area to which the touch point belongs or the touch point is set to the upper right”. However, as shown in FIG. 8A, in this example, the subject S and the frame F are not parallel when placed, and the subject S is placed with an angle shifted. Therefore, in FIG. 8A, in order to make the divided region D right upper so that the subject S is parallel to the frame F, the image may be rotated by 160 ° with the center of the base 12 as the center of rotation. Therefore, in step SB10, the rotation angle “160 °” is calculated.

  Subsequently, it is determined whether or not the shutter key has been operated. If the shutter key has been operated, the image data for one frame imaged by the CCD 66 at that time is taken into the SDRAM 71 via the image processing unit 70 ( Step SB12). Further, the image data captured in the SDRAM 71 is subjected to a rotation image process at the rotation angle calculated in the step SB10 (step SB13).

  That is, in the example shown in FIG. 7A, the rotation angle “180 °” is calculated in step SB10. Therefore, image data obtained by rotating the image by 180 ° with the center of the subject S as the rotation center is generated. Therefore, as shown in FIG. 7B, even when the subject S, which is a document, is placed on the opposite side, if the subject S is touched at the touch point P with the fingers, As shown, the direction of the subject S in the captured image can be made appropriate.

  In the example shown in FIG. 8A, the rotation angle “160 °” is calculated in step SB10. Therefore, image data obtained by rotating the image by 160 ° with the center of the subject S as the rotation center is generated. Therefore, as shown in FIG. 8B, even when the subject S, which is a document, is placed with an angle shifted, if the subject S is touched at the touch point P with a finger, As shown in c), the orientation of the subject S in the photographed image can be made appropriate.

  Thereafter, the rotated image data is recorded in the external memory 73 and output from the USB interface 75 (step SB14). Then, the PC 2 connected to the USB interface 75 operates according to the data communication program, receives the rotated image data, and transmits it to the projector 3. The projector 3 receives this and projects a display image based on the image data sent from the PC 2 onto the screen 7. The display image projected on the screen 7 is based on the rotated image data.

  Therefore, regardless of the angle at which the subject is placed on the pedestal 12, it is possible to project and display an image in which the part desired by the user is in a desired direction or an appropriate direction. In addition, unlike the prior art described above, character recognition is not necessary, so that the direction of the projected image can be made appropriate regardless of the type of subject to be projected.

  On the other hand, if the result of determination in step SB7 is that the subject has an indeterminate shape other than a rectangle, rotation is performed based on the touch point stored in step SB6 and the reference direction previously determined in step SB1. An angle is calculated (step SB11).

  That is, if the subject is indefinite, and the option (1) “Move touch area or touch point to upper right” is selected in step SB1, this option (1) The rotation angle of the subject whose stored touch point is in the upper right is calculated based on “Set the touch point in the upper right”. Thereafter, the processing from step SB12 onward is executed.

  Therefore, according to the present embodiment, even when a non-rectangular object other than a rectangle, for example, a three-dimensional object such as various articles, is placed on the pedestal 12, the direction in which the user desires the desired direction, Alternatively, an image in an appropriate direction can be projected and displayed. In addition, unlike the prior art described above, character recognition is not necessary, so that the direction of the projected image can be made appropriate regardless of the type of subject to be projected.

  Also in the present embodiment, as described above, only the photographing process is performed on the digital camera 51 side, the photographed image is sent to the PC 2, and other processes such as data rotation image processing are performed on the PC 2 side. It may be.

  In the embodiment, the case of projecting a photographed image has been described. However, the present invention is not limited to this, and the same rotated image processing is performed when the photographed image is displayed on a monitor or printed out. It may be.

2 PC
3 Projector 12 Base 51 Digital Camera 53 LCD Monitor 66 CCD
67 Timing Generator 68 Horizontal Driver 70 Image Processing Unit 71 SDRAM
72 CPU
73 External memory 74 Flash memory P Touch point S Subject

Claims (15)

A pedestal,
Imaging means for imaging a subject placed on the pedestal;
Detecting means for detecting a designated position designated for the pedestal or the subject when the subject is placed on the pedestal;
Calculating means for calculating a rotation angle of an image picked up by the image pickup means so that the designated position detected by the detection means is in a predetermined direction set in advance;
An image processing apparatus comprising: an image processing unit that rotates the image at a rotation angle calculated by the calculation unit. The image processing apparatus according to claim 1, further comprising an output unit that outputs the image rotated by the image processing unit to the outside. The detection means divides an area on the pedestal into a predetermined number, and detects an area to which a designated position designated with respect to the pedestal belongs among the predetermined number of areas,
The image processing apparatus according to claim 1, wherein the calculation unit calculates a rotation angle of an image captured by the imaging unit so that the region is in the predetermined direction set in advance. The detection means divides the area on the subject placed on the pedestal into a predetermined number, and detects an area to which the designated position designated for the subject belongs among the predetermined number of areas,
The image processing apparatus according to claim 1, wherein the calculation unit calculates a rotation angle of an image captured by the imaging unit so that the region is in the predetermined direction set in advance. A discriminating means for discriminating whether the subject placed on the pedestal is a rectangle or an indeterminate shape other than a rectangle;
When it is determined by the determination means that the subject is rectangular,
The detecting means detects a region to which the designated position belongs;
The image processing apparatus according to claim 4, wherein the calculation unit calculates the rotation angle so that the region is in the predetermined direction set in advance. The rotation angle of the subject is calculated so that the region is in the predetermined direction set in advance and the rectangular subject is parallel to a frame constituting the image. 5. The image processing apparatus according to 5. The detecting means detects a designated position designated for a subject placed on the pedestal;
The image processing apparatus according to claim 1, wherein the calculation unit calculates a rotation angle of an image captured by the imaging unit so that the designated position is in the predetermined direction set in advance. . A discriminating means for discriminating whether the subject placed on the pedestal is a rectangle or an indeterminate shape other than a rectangle;
When it is determined by the determining means that the subject has an irregular shape other than a rectangle,
The detecting means detects the designated position;
The image processing apparatus according to claim 1, wherein the calculation unit calculates the rotation angle so that the designated position is in the predetermined direction set in advance. The image processing apparatus according to claim 1, wherein the detection unit detects the designated position based on an image captured by the imaging unit. 10. The image processing apparatus according to claim 1, wherein the calculation unit calculates the rotation angle based on a designated position with respect to the pedestal or the subject detected last by the detection unit. The image processing apparatus according to claim 1, wherein the detection unit detects a touch position with respect to the pedestal or the subject as the designated position. The image processing apparatus according to claim 1, further comprising a setting unit that can set the predetermined direction in advance. A computer included in an image processing apparatus including a pedestal and an imaging unit that images a subject placed on the pedestal,
Detecting means for detecting a designated position designated for the pedestal or the subject when the subject is placed on the pedestal;
Calculating means for calculating a rotation angle of an image picked up by the image pickup means so that the designated position detected by the detection means is in a predetermined direction set in advance;
An image processing program that causes an image processing unit to rotate the image at a rotation angle calculated by the calculating unit. An image processing method in an apparatus comprising a pedestal and an imaging means for imaging a subject placed on the pedestal,
A detection step of detecting a designated position designated for the pedestal or the subject when the subject is placed on the pedestal;
A calculation step of calculating a rotation angle of an image captured by the imaging unit so that the designated position detected by the detection step is in a predetermined direction set in advance;
And an image processing step of rotating the image at the rotation angle calculated in the calculation step. An imaging device comprising: imaging means for imaging the pedestal on which the subject is placed; and transmission means for transmitting the captured image to the information processing device;
Monitoring means for monitoring an image sent from the imaging device, and detection for detecting a designated position designated with respect to the pedestal or the subject when the subject is placed on the pedestal based on image monitoring by the monitoring means Means for rotating the image sent from the imaging device so that the designated position is set in a predetermined direction, and an output means for outputting the rotated image to the projection device. A processing device;
A projection apparatus provided with a projection means for projecting an image sent from the image processing apparatus;
An image processing system comprising:

Images