JP2006245921A - Imaging device and system, mobile telephone, control method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image sensing device which is capable of realizing highly minute photography for obtaining resolution as required even when an image sensing means has a small number of pixels. <P>SOLUTION: A digital camera is equipped with a camera image processing unit 101, a recording/reproducing image processing unit 102, a display unit 103, a file system control unit 104, a media drive unit 105, an image synthesizing/enlarging memory circuit 106, and a CPU 107. The CPU 107 divides a first image obtained by photographing an object through the camera image processing unit 101 into two or more tile regions, and displays an image photoed in a photographing operation together with the enlarged tile images on the display unit 103. The CPU 107 takes a partial photograph where the parts of the object corresponding to the tile regions of the first image are photoed by the camera image processing unit 101, at the same angle of view with the tile image displayed on the display unit 103; and synthesizes the partial photographed images obtained through the partial photography into a second image. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging device, a mobile phone, an imaging system, a control method, and a program applied when generating a high-definition image.

  2. Description of the Related Art Conventionally, a digital camera having a function of recording an image signal obtained by photographing a subject with an imaging element such as a CCD as a digital data on a recording medium such as a memory card is known as an imaging device.

  In recent years, in an imaging apparatus such as the above-described digital camera, it has become possible to capture a high-definition image by using an imaging element having about several million pixels. On the other hand, demands for downsizing, power saving, cost reduction, and the like for imaging devices are becoming strict, and there are imaging devices that cannot be equipped with high-pixel imaging elements as the imaging devices are diversified. An example of this type of imaging device is a camera built in a mobile phone.

As a method for photographing a high-definition image with an imaging device having an imaging element with a small number of pixels as described above, a personal computer (hereinafter abbreviated as a personal computer) or the like after photographing a plurality of images. A method for synthesizing an image by an information processing apparatus has been proposed. This type of shooting function is known as a so-called panoramic mode shooting function (see, for example, Patent Document 1).
JP-A-10-136298

  However, although the above-described panorama mode shooting function is effective for super wide-angle panorama shooting that exceeds the specifications of the shooting lens, such as landscapes, it is inconvenient for shooting for the purpose of obtaining a high-definition image. That is, as a method of using the digital camera, for example, photographing for recording characters written in a conference room or school whiteboard, a timetable at a station, or the like can be considered. In such shooting, since the number of pixels of the image sensor is limited, it is difficult to capture in such a manner that detailed characters and numbers written on a whiteboard, a timetable, and the like can be recognized.

  Therefore, for example, when a photographer approaches a subject such as a whiteboard and sequentially photographs from the end of the subject by the panorama mode photographing function, it is possible to obtain a resolution capable of recognizing detailed characters and numbers. However, in this case, it is necessary to combine a plurality of partial captured images obtained by sequentially capturing from the edge of the subject into one high-definition image, and then to cut out to a desired angle of view (composition). Is very cumbersome.

  Further, the process of combining a plurality of partial captured images into a high-definition image and cutting out to a desired angle of view as described above is generally performed by operating a pointing device such as a mouse using a personal computer. However, when the function for performing the above processing is incorporated as a function of the digital camera, since the digital camera is not equipped with a pointing device such as a mouse, there is a problem that an operation is required when performing the above processing. .

  Furthermore, when shooting with the panorama mode shooting function, the photographer does not set the angle of view of the combined panorama shot image first, and does not imagine the completed form of the combined panorama shot image. Suddenly, images are taken sequentially from the edge of the subject. For this reason, it is often the case that more images than necessary are taken.

  An object of the present invention is to provide an image pickup apparatus, a mobile phone, an image pickup system, a control method, and a program capable of realizing high-definition shooting for obtaining a necessary resolution even when the number of pixels of the image pickup means is small. It is to provide.

  In order to achieve the above-described object, an imaging apparatus according to the present invention includes an imaging unit that captures a subject, a display unit that displays an image, and a plurality of first images obtained by capturing the subject using the imaging unit. A display control means for displaying a captured image being captured by the imaging means on the display means together with an area image divided and enlarged into areas, and the first angle of view with the same angle of view as the area image displayed on the display means. A plurality of partial captured images obtained by partial photographing by the photographing control unit and a photographing control unit that performs partial photographing for photographing each part of a subject corresponding to each of a plurality of regions of the image by the photographing unit; Generating means for generating the image.

  In order to achieve the above-described object, a control method of the present invention is a control method for an imaging apparatus including an imaging unit that captures an image of a subject and a display unit that displays an image. A display control step for displaying the captured image being captured by the imaging unit on the display unit together with a region image obtained by dividing the obtained first image into a plurality of regions and an area image displayed on the display unit A shooting control step for performing partial shooting for shooting each part of the subject corresponding to each of a plurality of areas of the first image with the imaging unit, and a plurality of images obtained by partial shooting in the shooting control step A generating step of combining the partially captured images to generate a second image.

  In order to achieve the above-described object, a program according to the present invention is a program for causing a computer to execute a control method for an imaging apparatus including an imaging unit that captures an object and a display unit that displays an image. A display control module that displays a captured image being captured by the imaging unit on the display unit, together with a region image obtained by dividing the first image obtained by capturing the subject into a plurality of regions and enlarged, and the display unit An imaging control module for performing partial imaging with the imaging means for imaging each part of the subject corresponding to each of the plurality of areas of the first image at the same angle of view as the displayed area image, and partial imaging by the imaging control module And a generation module that generates a second image by synthesizing the plurality of partial captured images obtained in the above.

  According to the present invention, a partial image is taken at the same angle of view as the area image constituting the first image obtained by photographing the subject, and a second image that is a completed image is generated by synthesizing the partially photographed images. Therefore, even when the number of pixels of the image pickup means provided in the image pickup apparatus is small, it is possible to realize high-definition shooting for obtaining a necessary resolution. In addition, the processing for synthesizing the partially photographed images on the personal computer is not required as in the prior art, and it is possible to complete the processing related to high-definition photographing only with an imaging device that is not equipped with a pointing device. Further, by combining the imaging device and the information processing device, it is possible to realize an imaging system capable of high-definition shooting.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram showing a configuration of a digital camera as an imaging apparatus according to the first embodiment of the present invention.

  In FIG. 1, a digital camera includes a camera image processing unit 101, a recording / playback image processing unit 102, a display unit 103, a file system management unit 104, a media drive 105, an image composition / enlargement / memory circuit 106, a CPU 107, an operation unit 108, A bus system circuit unit 109 is provided.

  The camera image processing unit 101 is an imaging unit equipped with an imaging device (CCD), an optical zoom lens, and an imaging signal processing circuit, and outputs an image signal obtained by imaging a subject with the imaging device as digital data. The recording / playback image processing unit 102 performs a compression process on the digital data in order to record the digital data output from the camera image processing unit 101 on the memory card. The display unit 103 is for displaying a recorded image or a reproduced image, or for displaying an operation mode such as operation information or a shooting mode, and is composed of, for example, an LCD (Liquid Crystal Display).

  The file system management unit 104 records the image data (digital data) subjected to the recording compression processing by the recording / playback image processing unit 102 as a data file on a memory card which is a random access medium. The media drive 105 records a data file on the memory card and reproduces the data file from the memory card. The image composition / enlargement / memory circuit 106 holds a plurality of pieces of image data, an image composition unit that performs image data enlargement / composition, TEXT information composition, an image reduction unit that reduces image data, and an image pattern matching unit It has.

  The CPU 107 is a system control circuit that controls the entire digital camera, such as control of image composition processing and image display, and the flowcharts of FIGS. 3 and 4 are based on a program stored in a storage unit (not shown). The process shown is executed. The operation unit 108 includes buttons for setting a desired shooting mode (normal shooting mode, high-definition shooting (high-resolution shooting) mode, etc.), a shutter button, and the like. The bus system circuit unit 109 transfers image data and system control information in the digital camera to each other. In the figure, solid line arrows indicate TEXT information, and broken line arrows indicate the flow of data.

  Next, the flow of image shooting, image recording, and image display in the digital camera of this embodiment will be described with reference to FIG.

  The features of the digital camera of the present embodiment are as follows. First, a single still image (hereinafter referred to as a first image) of a still image that is necessary even if the resolution is insufficient is taken. Since the shooting operation for shooting the first image is the same as the normal shooting operation, a photographer who is concerned about resolution after shooting in the normal shooting mode can move to the shooting operation in the high-definition shooting mode. The point that made it possible is a major feature.

  When the first image is captured by the camera image processing unit 101 during the shooting operation in the normal shooting mode, the first image data is transferred to and stored in the image composition / enlargement / memory circuit 106. The first image data held in the image composition / enlargement / memory circuit 106 is transferred to the display unit 103 and displayed on the entire display area. At the same time, the first image data is compressed by the JPEG (Joint Photographic Experts Group) method by the recording / playback image processing unit 102, and recorded on the memory card by the media drive 105 via the file system management unit 104.

  When there is a concern that the resolution of the first image data recorded on the memory card is insufficient, the photographer performs an operation of shifting the normal shooting mode to the high-definition shooting mode using the operation unit 108. In the high-definition shooting mode, the first image is displayed on the entire display area of the display unit 103 under the control of the CPU 107, and the first image is displayed in a state of being divided into a predetermined number of tiles (for example, four tiles). , An image with a number added to each tile. The display state of the display unit 103 in this case is shown in FIG.

  FIG. 2A is a diagram illustrating a display state in which the first image on the display unit 103 is divided into four tiles, and FIG. 2B is a diagram illustrating a display state when the resolution is confirmed.

  In FIG. 2, when, for example, the whiteboard 200 is photographed as a subject by the digital camera, the first image is displayed on the display unit 103 as shown in FIG. In FIG. 2 (a), the captured first image is divided into four tiles (tile 1, tile 2, tile 3, tile 4) by the image composition / enlargement / memory circuit 106, and the first of them is displayed. An area 201 (tile 1) is in a focused state. Numbers (1 to 4) are sequentially added to the images divided into four tiles. FIG. 2B shows a state in which the first area 201 (tile 1) in the first image divided into four tiles is enlarged and displayed on the entire screen for resolution confirmation. Yes.

  By the operation of the operation unit 108 by the photographer, the focus moves in order of tile 1 → tile 2 → tile 3 → tile 4. As a result, the photographer can check whether the necessary resolution has been obtained over the entire first image. In the case of FIG. 2B, it is difficult to recognize the description on the whiteboard 200 because of insufficient resolution, and it is determined that shooting in the high-definition shooting mode is effective. Here, the high-definition shooting mode includes a resolution check mode for checking the resolution of the first image, and a divided shooting mode (partial shooting mode) for shooting each tile obtained by dividing the first image into four. .

  In this way, the photographer has insufficient resolution from the images of each tile (tile 1 to tile 4) obtained by dividing the first image displayed on the display unit 103 into four by the operation of the operation unit 108. Select the tile image that you have determined. In the resolution check mode, the image of the selected tile is subjected to a predetermined enlargement process in the image composition / enlargement / memory circuit 106 under the control of the CPU 107 and displayed on the display unit 103. The resolution of one image data can be confirmed. If the resolution is insufficient, the photographer further shifts to the divided photographing mode by operating the operation unit 108.

  Next, the operation of the digital camera in the high-definition shooting mode will be described in detail with reference to FIGS.

  3 and 4 are flowcharts showing the processing after the resolution check and the high-definition shooting mode shift.

  3 and 4, in step S301, the CPU 107 of the digital camera starts a shooting operation in the normal shooting mode by the operation of the operation unit 108 by the photographer. In step S302, the CPU 107 captures the first image (normal still image) with the image sensor of the camera image processing unit 101, compresses it with the recording / playback image processing unit 102, passes through the file system management unit 104, and then the media. The drive 105 records the first image data on the memory card.

  In step S303, the CPU 107 displays a screen for allowing the photographer to select whether or not to perform the resolution check on the display unit 103, and prompts the photographer to check the resolution. If the photographer selects not to perform the resolution check from the operation unit 108, the present process is terminated. When the photographer selects from the operation unit 108 to perform the resolution check, the process proceeds to step S304.

  In step S304, the CPU 107 sets the digital camera to the resolution check mode of the high-definition shooting mode, divides the first image into four tiles (tile 1 to tile 4) by the image composition / enlargement / memory circuit 106, First, the image of tile 1 is enlarged and displayed on the display unit 103. In this case, the CPU 107 determines the enlargement ratio of the tile image according to the number of divisions of the first image. Thereby, the photographer can check the resolution finely on the screen of the display unit 103.

  When the photographer determines that there is no problem with the resolution of the image of tile 1, the operation unit 108 is operated to change the display image of the display unit 103 in order of tile 2 → tile 3 → tile 4 and the image of each tile. After confirming the resolution, the display image is returned to the original tile 1. On the other hand, when the photographer determines that the resolution of the image of the tile is insufficient, the photographer shifts to the high-definition shooting mode by operating the operation unit 108.

  In step S <b> 305, the CPU 107 determines whether the photographer has selected shooting in the high-definition shooting mode from the operation unit 108. If the photographer does not select shooting in the high-definition shooting mode from the operation unit 108, the present process is terminated. When the photographer selects photographing in the high-definition photographing mode from the operation unit 108, the process proceeds to step S306.

  In step S306, the CPU 107 sets the digital camera to a high-definition shooting mode divided shooting mode (a shooting mode in which each of the four divided tile images is shot in order), and executes shooting in the divided shooting mode in the camera image processing unit 101. Let That is, the CPU 107 displays an enlarged image of each tile image divided into four on the display unit 103 and simultaneously displays an image (camera captured image) being captured by the camera image processing unit 101 on a part of the display unit 103. At this time, the CPU 107 moves the focal length of the optical zoom lens of the camera image processing unit 101 according to the enlargement ratio of the tile image.

  The CPU 107 displays the tile image and the camera-captured image having the same enlargement ratio in an arrangement that can be aligned on the screen of the display unit 103. Thereby, the photographer can execute partial photographing (photographing each part of the subject corresponding to each tile at the same angle of view as the tile image) while aligning the tile image and the camera captured image. When the camera image processing unit 101 finishes capturing the tile 1, the CPU 107 displays an enlarged image of the tile 2 on the display unit 103. As a result, the camera-captured images can be aligned and shooting corresponding to the tile 2 can be performed.

  The CPU 107 sequentially displays the enlarged images of the tile 3 and the tile 4 on the display unit 103, and the camera image processing unit 101 performs shooting corresponding to the tile 3 and the tile 4, respectively. The CPU 107 records an image obtained by shooting corresponding to each of the tiles 1 to 4 on the memory card in the media drive 105 in the file format by the file system management unit 104.

  In step S307, the CPU 107 determines whether or not the divided shooting in step S306 has been completed without any problem. If the alignment corresponding to each tile image is insufficiently aligned and the imaging area cannot be completely covered, the CPU 107 prompts the photographer to perform imaging again for the display unit 103. And a tile image that cannot completely cover the shooting area is displayed again. As a result, the photographer redoes the photographing. If the divided shooting is completed without any problem, the process proceeds to step S308.

  In step S <b> 308, the CPU 107 performs image composition by the image composition / enlargement / memory circuit 106 based on the captured image file corresponding to each tile image divided into four. The image composition / enlargement / memory circuit 106 uses the image information of the overlapping portion of each tile image (four partial captured images) divided into four to connect the connection portions of the partial captured images while aligning them. The image position adjustment process to be combined is performed.

  In this case, the image composition / enlargement / memory circuit 106 also uses the data file of the first image to align the partial captured image of each tile, By comparing the center position of the tile, the alignment of the partial captured image of each tile and the correction of the enlargement ratio are performed. The image synthesis / enlargement / memory circuit 106 synthesizes the partial captured images of each tile into a single image, and then performs a cutout process to match the angle of view with the first image to generate a high-definition second image To do.

  In step S 309, the CPU 107 records the second image data generated by the image composition / enlargement / image composition by the memory circuit 106 and the clipping process on the memory card in the media drive 105 in the file format by the file system management unit 104. The first image data and the four pieces of divided image data are deleted from the memory card. In step S310, the CPU 107 ends this process.

  Next, an enlarged tile image and the display content of the display unit 103 during divided shooting will be described in detail with reference to FIG.

  5A is a diagram showing a resolution confirmation screen on the display unit 103, FIG. 5B is a diagram showing an enlarged display angle of view at the time of divided shooting, and FIG. 5C is a partial shooting of the tile 1. It is a figure which shows the display state of.

  5A, FIG. 5A shows the image area of the tile 1 when the first image is divided into four tiles, for example, enlarged by 1.6 times by the image composition / enlargement / memory circuit 106. The resolution confirmation screen is shown. Since the first image is divided into four tiles, the display area is doubled vertically and horizontally, but 1.6 times is displayed to secure an overlap area for image composition. .

  Reference numeral 500 denotes a subject whiteboard. Reference numeral 501 denotes a full screen of the display unit 103. Reference numeral 502 denotes a field angle range of the tile 1. Reference numeral 503 denotes an image area of the tile 2 and the tile 4 adjacent to the image area of the tile 1. Reference numeral 504 denotes an area outside the tile 1. When the image area of tile 1 is doubled, the full screen 501 and the angle of view range 502 match, but since the image area of tile 1 is enlarged 1.6 times, the area around tile 1 is also displayed. Has been.

  An area 504 outside the tile 1 is a part for securing an overlap area at the time of divided photographing, and prevents a connection part of the partial photographed image from being disconnected (a joint part image as a “margin” is secured). ), And a position to be aligned at the time of synthesizing the partially photographed images. In step S304 of FIG. 3, the photographer checks whether or not the document information described on the whiteboard 500 as the subject can be read by viewing the enlarged image of the tile 1 displayed on the display unit 103.

  FIG. 5B shows a region used for enlarged display from the first image. Reference numeral 511 corresponds to the full screen 501 of the display unit 103 illustrated in FIG.

  FIG. 5C shows the display content of the display unit 103 in the process of step S306 of FIG. An area 521 displays an image being captured by the camera image processing unit 101. The image outside the area 521 is the same as the display in FIG.

  The image being captured displayed in the area 521 has a focal length of the optical zoom lens of the camera image processing unit 101 in the high-definition shooting mode different from the focal length in the normal shooting mode up to step S305 in FIG. It is what was imaged. That is, the CPU 107 changes the focal length of the optical zoom lens in the process of step S306 of FIG. 4 so that the image looks 1.6 times larger than before.

  Along with the change in the focal length of the optical zoom lens, the captured image in the area 521 and the reproduced enlarged display image outside the area 521 appear to have substantially the same size. When the photographer points the imaging unit of the digital camera toward the portion corresponding to the tile 1 of the subject, an image with an improved resolution can be seen as if in the area 521. The photographer visually observes the screen of the display unit 103, aligns the periphery of the area 521 and the captured image in the area 521, and presses the shutter button of the operation unit 108.

  As a result, the image captured by the camera image processing unit 101 is recorded on the memory card in the media drive 105 by the file system management unit 104 along the signal flow shown in FIG. In this case, not only the captured image displayed in the area 521 but also image data corresponding to the image of the entire imaging area including the captured image corresponding to the area other than the area 521 is recorded in the memory card. .

  As shown in the flowcharts of FIGS. 3 and 4 above, when the first image is divided into four tiles (tile 1 to tile 4) in the digital camera, the angle of view corresponding to the divided image of each tile is changed. By photographing the subject, partial captured images corresponding to each tile can be sequentially recorded on the memory card. For the partial captured images corresponding to each tile, the image combining / enlarging / memory circuit 106 sequentially aligns and combines the connected portions of the partial captured images based on image analysis processing for pattern comparison of overlapping regions. The image composition processing is performed. Since the basic image composition processing is the same as that in the case of conventional panoramic photography, description thereof is omitted.

  Next, a method for generating a final high-definition image (second image) corresponding to the angle of view of the first image from the image data after the image synthesis process will be described in detail with reference to FIG.

  FIG. 6A is a diagram showing the combined image and the central image recognition area, and FIG. 6B is a diagram showing the image recognition area (first image data) at the reference position for clipping.

  In FIG. 6A, FIG. 6A is a composite image obtained by combining four partial captured images using the connection partial images (“margin”) of the overlap areas of the four partial captured images that are divided and captured. Is shown. FIG. 6B shows a first image first shot in the normal shooting mode.

  Reference numeral 600 denotes a subject whiteboard. Reference numeral 601 denotes a partial photographed image 1 photographed corresponding to the divided image of the tile 1. A partial photographed image 2 is photographed corresponding to the divided image of the tile 2. Reference numeral 603 denotes a partial captured image 3 captured corresponding to the divided image of the tile 3. Reference numeral 604 denotes a partial captured image 4 captured corresponding to the divided image of the tile 4. Reference numeral 605 denotes a synthesized image obtained by synthesizing the partially photographed images 601 to 604 and cutting out a portion protruding from the quadrangle.

  Reference numeral 606 denotes an area corresponding to an image photographed as the first image 611 in the area of the composite image 605. Reference numeral 607 denotes an image extraction region having a predetermined size defined in the central portion of the composite image 605. By the image reduction unit provided in the image composition / enlargement / memory circuit 106, the image in the image extraction area 607 is reduced to 1 / 1.6 which is an inverse of 1.6 which is an enlargement ratio at the time of partial photographing.

  On the other hand, an image of the predetermined area 612 is also extracted from the center of the first image 611. The extracted images are images with the same magnification. The image pattern matching unit provided in the image composition / enlargement / memory circuit 106 compares both images (the image in the image extraction area 607 and the image in the predetermined area 612), calculates the shift amount of the center position of both images, The alignment process is performed.

  After that, the area 606 corresponding to the same angle of view as the first image 611 is converted from the enlargement ratio 1.6 and cut out, so that a high-definition image (an image in the area 606 is finally obtained as the second image). ) After the generation of the high-definition image, the file system management unit 104 deletes the first image data and the four pieces of image data that have been divided and photographed from the memory card.

  With the above processing, a high-definition image (second image) with an enlargement ratio of 1.6 times can be taken while having the same angle of view as the first image. The high-definition shooting mode of the present embodiment is an extremely effective shooting mode when confirming the detailed content described on the whiteboard shot as a subject or when printing a shot image. Can do.

  As described above, according to the present embodiment, a partial image is taken at the same angle of view as the tile image constituting the first image obtained by photographing the subject, and the completed image is synthesized by combining the partially photographed images. Therefore, even when the number of pixels of the image sensor provided in the digital camera is small, it is possible to realize high-definition shooting for obtaining a necessary resolution. Further, the processing for combining the partially captured images on the personal computer as in the prior art becomes unnecessary, and the processing related to the high-definition shooting mode can be completed only with the digital camera not equipped with the pointing device.

[Second Embodiment]
The second embodiment of the present invention is different from the first embodiment described above in the following points. Since the other elements of the present embodiment are the same as the corresponding ones of the first embodiment described above, description thereof will be omitted.

  In the first embodiment described above, the digital camera performs image composition and enlargement processing such as the image composition / enlargement / memory circuit 106 (processing for synthesizing a plurality of partial captured images and matching the angle of view with the first image). ) Is given as an example.

  On the other hand, this embodiment does not synthesize and extract partial captured images on the digital camera side, but stores image information (information including a plurality of partial captured images and file names described later) from the digital camera. Are transferred via a wired or wireless communication medium or read via a memory card, and the information processing apparatus performs synthesis and cut-out processing of partially captured images.

  In this case, in step S307 in FIG. 4, the high-definition image shooting as a digital camera is ended together with the end of the divided shooting. The CPU 107 of the digital camera adds a file name that can identify the file relationship to the first image file and the partially captured image file at this time, and communicates the image file and the file name to the information processing apparatus. Transfer through the medium. Alternatively, the information processing apparatus is caused to read the image file and the file name via the memory card. In the information processing apparatus, the combination of files can be determined from the above file names, so that a high-definition image file is generated by performing image synthesis and clipping processing as they are.

  As described above, according to the present embodiment, as in the first embodiment described above, even when the number of pixels of the image sensor provided in the digital camera is small, the necessary resolution can be obtained. High-definition photography can be realized. In addition, by combining a digital camera and an information processing apparatus, an imaging system capable of high-definition shooting can be realized.

[Third Embodiment]
The third embodiment of the present invention is different from the above-described first embodiment in the following points. Since the other elements of the present embodiment are the same as the corresponding ones of the first embodiment described above, description thereof will be omitted.

  In the first embodiment described above, the optical zoom lens is controlled under the control of the CPU 107 when the first image is divided into four tiles in the processing of steps S304 and S306 in FIGS. As an example, the control is performed by moving the focal length of the lens so that a magnified image of 1.6 times can be captured.

  In contrast, the present embodiment, on the contrary, realizes a method of obtaining a desired resolution by enlarging the focal length of the optical zoom lens until a sufficient resolution is obtained by the operation of the zoom lever by the photographer. Is.

  In this case, under the control of the CPU 107, the number of divisions of the first image is changed according to the amount of movement of the zoom position of the optical zoom lens. Therefore, the number of tiles that can cover the entire first image is required, but any image can be enlarged.

  As described above, according to the present embodiment, as in the first embodiment described above, even when the number of pixels of the image sensor provided in the digital camera is small, the necessary resolution can be obtained. High-definition photography can be realized.

[Fourth Embodiment]
The fourth embodiment of the present invention differs from the above-described first embodiment in the following points. Since the other elements of the present embodiment are the same as the corresponding ones of the first embodiment described above, description thereof will be omitted.

  In the first embodiment described above, the optical zoom lens is controlled under the control of the CPU 107 when the first image is divided into four tiles in the processing of steps S304 and S306 in FIGS. As an example, the control is performed by moving the focal length of the lens so that a magnified image of 1.6 times can be captured.

  On the other hand, in this embodiment, the digital camera is not equipped with a zoom lens.

  In this case, in the process of step S304 in FIG. 3, the photographer approaches the subject with the digital camera, and the first image obtained by capturing the subject with the camera image processing unit 101 is formed into predetermined four tiles. When divided, the angle of view is adjusted to 1.6 times corresponding to four divisions.

  As described above, according to the present embodiment, as in the first embodiment described above, even when the number of pixels of the image sensor provided in the digital camera is small, the necessary resolution can be obtained. High-definition photography can be realized.

[Other embodiments]
In the first to fourth embodiments, control for generating a high-definition image in a digital camera has been described as an example. However, the present invention is not limited to this. The present invention can also be applied to control for generating a high-definition image in a camera-equipped mobile phone.

  In the second embodiment, a plurality of partial captured images are transferred from the digital camera to the information processing apparatus via a communication medium or read via a memory card, and the partial captured image is read on the information processing apparatus side. Although the case of performing synthesis and cut-out processing has been described as an example, the present invention is not limited to this. For example, a plurality of partial shot images are transferred from a digital camera via a mobile phone to a device (information processing device, image processing device, etc.) installed in the telephone carrier, and the telephone carrier side synthesizes the partial shot images. It is also possible to perform cutout processing.

  In addition, an object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the embodiments to a system or apparatus, and a computer (or CPU, MPU, etc.) of the system or apparatus as a storage medium. This can also be achieved by reading and executing the stored program code.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the program code and the storage medium storing the program code constitute the present invention.

  Examples of the storage medium for supplying the program code include a floppy (registered trademark) disk, a hard disk, a magneto-optical disk, a CD-ROM, a CD-R, a CD-RW, a DVD-ROM, a DVD-RAM, and a DVD. -RW, DVD + RW, magnetic tape, nonvolatile memory card, ROM, etc. can be used. Alternatively, the program code may be downloaded via a network.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) running on the computer based on the instruction of the program code. A case where part or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing is also included.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. This includes the case where the CPU or the like provided in the board or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

  Further, by executing the program code read out by the computer, not only the functions of the above-described embodiments are realized, but the OS running on the computer based on the instruction of the program code is actually used. Needless to say, the present invention also includes a case where the functions of the above-described embodiments are realized by performing part or all of the processing and the processing.

  In this case, the program is supplied by downloading directly from a storage medium storing the program or from another computer or database (not shown) connected to the Internet, a commercial network, a local area network, or the like.

  The form of the program may be in the form of object code, program code executed by an interpreter, script data supplied to an OS (operating system), and the like.

It is a block diagram which shows the structure of the digital camera as an imaging device which concerns on the 1st Embodiment of this invention. (A) is a figure which shows the display state which divided | segmented the 1st image in a display part into four tiles, (b) is a figure which shows the display state at the time of confirming the resolution. It is a flowchart which shows the process after a resolution check and high-definition imaging mode transfer. FIG. 4 is a continuation of the flowchart of FIG. 3. (A) is a figure which shows the resolution confirmation screen in a display part, (b) is a figure which shows the enlarged display view angle at the time of division | segmentation imaging | photography, (c) is a figure which shows the display state by the partial imaging | photography of the tile 1. FIG. (A) is a figure which shows the image after a synthesis | combination, and the image recognition area | region of a center part, (b) is a figure which shows the image recognition area | region (1st image data) of the reference position for cutting.

Explanation of symbols

101 Camera image processing unit (imaging means)
102 Recording / Reproduction Image Processing Unit 103 Display Unit (Display Unit)
104 File system management section (erasing means)
105 Media drive (recording means)
106 Image composition / enlargement / memory circuit (generation means)
107 CPU (display control means, photographing control means, lens control means)
108 Operation part (operation means)

Claims (14)

Imaging means for photographing a subject;
Display means for displaying an image;
Display control means for displaying a captured image being captured by the imaging means on the display means together with a region image obtained by dividing and enlarging a first image obtained by photographing the subject by the imaging means;
Shooting control means for performing partial shooting, in which each part of the subject corresponding to each of the plurality of areas of the first image is shot by the imaging means at the same angle of view as the area image displayed on the display means;
An image pickup apparatus comprising: a generation unit configured to combine a plurality of partial shot images obtained by partial shooting by the shooting control unit to generate a second image. A zoom lens,
When the region image obtained by dividing the first image into a plurality of regions and the captured image being captured by the imaging unit are simultaneously displayed on the display unit, the focus of the zoom lens according to the magnification rate of the region image The imaging apparatus according to claim 1, further comprising lens control means for changing the distance.   The imaging apparatus according to claim 1, wherein the display control unit determines an enlargement ratio of the region image according to a division number of the first image.   The imaging apparatus according to claim 1, wherein the display control unit changes the number of divisions of the first image according to an amount of movement of a zoom position of the zoom lens.   The display control unit displays a region image obtained by dividing the first image into a plurality of regions and enlarged on the entire display region of the display unit, and displays a captured image being captured by the imaging unit on the display unit. The image pickup apparatus according to claim 1, wherein the image pickup device is displayed in a part of the area.   The generating means combines the plurality of partial captured images by aligning based on the first image, and generates the second image having the same angle of view as the first image. The imaging apparatus according to claim 1. Recording means for recording the first image, the plurality of partial captured images, and the second image;
7. The apparatus according to claim 1, further comprising: an erasing unit that erases the first image and the plurality of partial photographed images from the recording unit after the generation of the second image by the generating unit. The imaging device according to any one of the above.   The operation unit according to any one of claims 1 to 7, further comprising an operation unit for instructing a shift to a mode in which the partial photographing is performed according to a confirmation result of the resolution of the region image displayed on the display unit. The imaging device described. Imaging means for photographing a subject;
Display means for displaying an image;
Display control means for displaying a captured image being captured by the imaging means on the display means together with a region image obtained by dividing and enlarging a first image obtained by photographing the subject by the imaging means;
Photographing control means for performing partial photographing, in which each part of the subject corresponding to each of the plurality of regions of the first image is photographed by the imaging means at the same angle of view as the area image displayed on the display means. An imaging apparatus characterized by the above.   A plurality of partially photographed images obtained by partial photographing by the photographing control means are supplied to an information processing device, and the information processing device combines the plurality of partially photographed images to generate a second image. The imaging device according to claim 9.   A mobile phone comprising the imaging device according to claim 1.   10. An imaging system comprising: the imaging apparatus according to claim 9; and an information processing apparatus that generates a second image by combining a plurality of partial captured images obtained by partial imaging by the imaging apparatus. A control method for an image pickup apparatus comprising an image pickup means for photographing a subject and a display means for displaying an image,
A display control step for displaying a captured image being captured by the imaging unit on the display unit together with a region image obtained by dividing and enlarging a first image obtained by capturing the subject by the imaging unit;
An imaging control step of performing partial imaging in which each part of the subject corresponding to each of the plurality of areas of the first image is imaged by the imaging unit at the same angle of view as the area image displayed on the display unit;
And a generation step of generating a second image by combining a plurality of partial captured images obtained by partial imaging in the imaging control step. A program that causes a computer to execute a control method of an imaging apparatus including an imaging unit that captures a subject and a display unit that displays an image,
A display control module for displaying a captured image being captured by the imaging unit on the display unit together with a region image obtained by dividing and enlarging a first image obtained by capturing the subject with the imaging unit;
A shooting control module for performing partial shooting by shooting each part of a subject corresponding to each of a plurality of areas of the first image with the same angle of view as the area image displayed on the display unit;
A generation module that combines a plurality of partial photographed images obtained by partial photographing by the photographing control module to generate a second image.

Images