JP2006148584A - Device and method for image sensing, and for image processing - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a photographer to reproduce or print important objects quickly and easily with his intention through fewer procedures as they are enlarged in size or they are trimmed when images photographed by the photographer are reproduced or printed through a digital camera, a video camera, or an image reproducing device as they are enlarged, printed, or trimmed. <P>SOLUTION: The image sensing device is equipped with an image sensing means for photographing images, a displaying means for compounding the photographed images and photography auxiliary lines to display them, and a recording means for recording positional information in relation to the object based on photography auxiliary line information and the photographed images of the object. The enlargement position of image data is determined based on the positional information as to the object, and the image is displayed as it is enlarged. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging device, an image processing device, an imaging method, and an image processing method.

  In photographing with a camera, the composition can be easily determined by displaying a photographing auxiliary line on a camera finder or display device. In a conventional film camera, this function is realized by optically recording the auxiliary shooting line on a focusing screen. However, it took a lot of time to replace the shooting auxiliary line, and it was not easy to replace depending on the shooting target, but in recent digital cameras and video cameras, the main body is equipped with a liquid crystal display device, etc. Since it is possible to easily synthesize and display an image being captured and an imaging auxiliary line on a display device, the function of displaying the imaging auxiliary line is employed in many products.

  In addition, since digital cameras and digital video cameras can record and reproduce images electronically, it is easy to display images taken only by the camera body and output them to a printer. In addition, as the number of pixels of the image pickup apparatus increases, enlargement reproduction and trimming printing have become realistic. These enlargement reproduction and trimming printing functions are currently installed in many digital cameras and video cameras (see Patent Document 1).

  With electronic recording of images, not only image information but also information at the time of shooting, for example, shooting date / time, exposure information, focal length information, etc. can be embedded in an image file and recorded simultaneously. As such a standard, EXIF has been established by the Japan Electronics Industry Promotion Association.

JP 2000-132151 A

  When using a digital camera, video camera, image playback device, etc. to enlarge and play back a captured image, or to print by trimming, the playback image is displayed on the display device and the user's intended position. It is necessary to adjust the size to the size by key operation. Since this work must be performed with few switches mounted on a digital camera or the like, the larger the size of the recorded image, the larger the position and size of enlargement / trimming to match the subject intended by the user. It takes a lot of steps and time, making it difficult.

  An object of the present invention is to quickly perform enlargement reproduction and trimming printing of an important subject intended by a photographer when a captured image is enlarged and reproduced by a digital camera, a video camera, or an image reproduction apparatus. It should be easy to do with fewer steps.

The image pickup apparatus of the present invention includes an image pickup means for picking up an image, a display means for combining and displaying the picked-up image and a shooting auxiliary line, and subject position information based on the shooting auxiliary line information and the image pickup. And recording means for recording the image in association with each other.
In addition, the image processing apparatus of the present invention includes a storage unit that stores image data and subject position information in association with each other, and a display that determines and enlarges the enlargement position of the image data based on the subject position information. Means.
In addition, the image processing apparatus of the present invention includes a storage unit that stores image data and subject position information in association with each other, and a display that determines and enlarges the enlargement size of the image data based on the subject position information. Means.
In addition, the image processing apparatus of the present invention includes a storage unit that stores image data and subject position information in association with each other, and a trimming unit that determines and trims the trimming position of the image data based on the subject position information. It is characterized by having.
The image processing apparatus according to the present invention further includes a storage unit that stores image data and subject position information in association with each other, and a trimming unit that determines and trims the trimming size of the image data based on the subject position information. It is characterized by having.
In addition, the imaging method of the present invention includes an imaging step of capturing an image, a display step of combining and displaying the captured image and an imaging auxiliary line, subject position information based on the imaging auxiliary line information, and the And a recording step of recording in association with the captured image.
Further, the image processing method of the present invention includes a determination step of determining an enlargement position of the image data based on the position information of the subject stored in association with the image data, and the image data at the determined enlargement position. And a display step for enlarging the display.
The image processing method of the present invention includes a determination step of determining an enlargement size of the image data based on position information of a subject stored in association with the image data, and the image data with the determined enlargement size. And a display step for enlarging the display.
In addition, the image processing method of the present invention includes a determination step of determining a trimming position of the image data based on position information of a subject stored in association with the image data, and the image data at the determined trimming position. And a trimming step for trimming.
The image processing method according to the present invention includes a determining step of determining a trimming size of the image data based on position information of a subject stored in association with the image data, and the image data with the determined trimming size. And a trimming step for trimming.

  The subject position information recorded at the time of image recording is based on the auxiliary shooting line used by the photographer in determining the composition, and includes the position information of the important subject intended by the photographer. The position information of the subject is recorded in association with the image. By determining the position and size of enlarged display and trimming printing during playback based on the position information of the subject, enlargement playback and trimming printing of important subjects intended by the photographer can be performed quickly and easily with fewer steps. Can be done.

(First embodiment)
FIG. 1 shows a configuration example of an imaging apparatus according to the first embodiment of the present invention. The imaging circuit 101 is an imaging circuit that controls exposure, focus, and the like based on a control signal from the overall control circuit 105 to capture (capture) and output an image of a subject. The image processing circuit 102 generates a shooting auxiliary line image from the shooting auxiliary line data from the overall control circuit 105, combines the output image from the imaging circuit 101, and outputs the combined image to the display control circuit 109. Also, the image processing circuit 102 generates information for performing exposure, focus control, and the like based on the video from the imaging circuit 101 and outputs the information to the overall control circuit 105. The overall control circuit 105 is a circuit that instructs the imaging and recording timing to the imaging circuit 101, the image processing circuit 102, and the recording control circuit 103 based on the input of the release switch 108. Further, the overall control circuit 105 generates subject position data from the photographing auxiliary line data read from the internal storage circuit 106 and outputs it to the recording control circuit 103. The overall control circuit 105 generates control data based on the exposure and focus information from the image processing circuit 102 and outputs the control data to the imaging circuit 101.

  The recording control circuit 103 is a recording control circuit that records the video signal from the image processing circuit 102 and the subject position data from the overall control circuit 105 on the recording medium 104. The recording medium 104 is a recording medium for recording image data and subject position data, and a memory card or the like is used. The display control circuit 109 is a display control circuit that outputs the image output from the image processing circuit 102 to the display panel 110 and the external video output circuit 111. The display panel 110 is a display device that displays the video output from the display control circuit 109, and a liquid crystal panel or the like is used. The external video output circuit 111 is an external video output circuit that converts the video output from the display control circuit 109 into a video output such as a composite video standard and outputs the video output.

  The release switch 108 is a switch for instructing the overall control circuit 105 the timing of shooting. The internal storage circuit 106 is a circuit that stores a plurality of auxiliary shooting line data 201 to 203 in FIG. 2 to be described later, and outputs any of the auxiliary shooting line data 201 to 203 according to an instruction from the overall control circuit 105. The photographing auxiliary line selection switch 107 is a switch for instructing the overall control circuit 105 to select photographing auxiliary line data 201 to 203 from the user.

  FIG. 2 is a more detailed configuration diagram of the internal storage circuit 106. The internal ROM table 204 stores the photographing auxiliary line data 201 to 203. The photographing auxiliary line data 201 to 203 are data for generating a photographing auxiliary line image, and are connected to the switch 205, respectively. Here, in the present embodiment, the number of screen divisions is taken as an example of the auxiliary shooting line data. That is, <X: 2 Y: 2>, which is the content of the shooting assistance line data 201, means that a shooting assistance line that divides the image into two parts in the vertical and horizontal directions is generated. Similarly, <X: 3 Y: 3> of auxiliary shooting line data 202 is divided into three parts in the vertical and horizontal directions, and <X: 4 Y: 3> of auxiliary shooting line data 203 is divided into four parts in the horizontal direction and divided into three parts in the vertical direction. Means an auxiliary shooting line. Further, photographing auxiliary line images 301 to 303 generated by the photographing auxiliary line data 201 to 203 are shown in FIG. The ROM table switch 205 switches to the contacts a to n according to the imaging auxiliary line selection information from the overall control circuit 105, selects any of the imaging auxiliary line data 201 to 203, and outputs it to the overall control circuit 105.

  Next, a description will be given according to the flowchart of FIG. 6 with reference to FIGS. When the operation starts (F101), the photographing auxiliary line selection switch 107 detects an input from the user (F102). When detected, the overall control circuit 105 switches the ROM table switch 205 in the internal storage circuit 106 to one of the contacts a to n (F103). Specifically, every time the photographing auxiliary line selection switch 107 is detected, the ROM table switch 205 is sequentially switched to the contacts a to n. Here, for example, if the ROM table switch 205 is connected to the contact b, the photographing auxiliary line data 202 is read into the overall control circuit 105 and set in the image processing circuit 102 (F104). The image processing circuit 102 generates a shooting auxiliary line image 302 from the read shooting auxiliary line data 202, combines the video signal from the imaging circuit 101 with the generated shooting auxiliary line image 302, and displays it via the display control circuit 109. The data is output to the panel 110 and the external video output circuit 111 and displayed (F105).

  The overall control circuit 105 generates subject position data from the photographing auxiliary line data 202 and outputs the subject position data to the recording control circuit 103 (F106). In the present embodiment, the coordinates of the intersection of the auxiliary shooting line are generated as the subject position. FIG. 3 shows subject positions and subject position data generated when the size of the image to be recorded is 1600 × 1200 pixels. Here, if the selected shooting auxiliary line data is X: 3 Y: 3, the intersection is the position obtained by dividing the image vertically and horizontally into three, so the subject position data is (533,400) (1066,400) (533,800 ) (1066,800).

  Subsequently, when the input of the release switch 108 is detected (F107), the overall control circuit 105 sends a release signal to the imaging circuit 101 and the recording control circuit 103, and the recording control circuit 103 detects the subject position data and the image from the imaging circuit 101. Is recorded on the recording medium 104 as the image file 401 in FIG. 4 (F108), and the series of operations is terminated (F109). Here, in the present embodiment, the recording control circuit 103 records the subject position data and the captured image as EXIF data as in the image file 401 of FIG. 4, but as shown in FIG. You may record on the recording medium 104. At this time, the file name is the same, and the extension of the file is recorded as “.DAT” for the subject position data file 501, for example, “.IMG” for the image file 502, so that it is associated during playback. Record as you can.

  By performing the configuration and operation as described above, a recorded image and subject position data are recorded.

  According to the present embodiment, the means for capturing an image, the recording means for recording the captured image on a recording medium, the display means for the captured image, the image captured on the display means and the photographing auxiliary line are combined and displayed on the display means. An image pickup apparatus having means for generating position information of a subject based on shooting auxiliary line information, and correlating the shot image and the position information of the subject and recording the information on a recording medium. In addition, it is characterized by having a photographing auxiliary line selection means for selecting a plurality of photographing auxiliary lines.

(Second embodiment)
A second embodiment of the present invention will be described. The configuration of the second embodiment is the same as that of FIG. 1, and will be described with reference to the flowchart of FIG. 7 using FIG.

  When the operation is started (F201), the photographing auxiliary line selection switch 107 detects an input from the user (F202). When detected, the recording control circuit 103 identifies the presence or absence of the photographing auxiliary line data 803 to 805 in FIG. 8 in the recording medium 104 (F203). Here, for identification, the directory structure of the recording medium 104 is as shown in FIG. A directory 801 indicates a root directory of the recording medium 104. The directory 802 is a directory for storing photographing auxiliary line data, and its name is FRAME. In this, photographing auxiliary line data 803 to 805 are stored, and the file extension is “.FRM”. A directory 806 is a directory for storing an image file to be recorded. The name is IMAGE, and the image files 807 and 808 are recorded with an extension “.IMG” therein. In this way, the shooting auxiliary line data is set as a FRAME directory different from the image file, and the extension is set as “.FRM” or the like, and is identified as shooting auxiliary line data.

  When it is identified that there is photographing auxiliary line data, each time the photographing auxiliary line selection switch 107 is detected, the recording control circuit 103 sequentially selects and reads the photographing auxiliary line data. Here, assuming that the photographing auxiliary line data 803 is selected, it is read into the overall control circuit 105 and output to the image processing circuit 102 (F204). The image processing circuit 102 generates a shooting auxiliary line image 301 from the read shooting auxiliary line data 803, combines the video signal from the imaging circuit 101 with the generated shooting auxiliary line image 301, and displays it via the display control circuit 109. The data is output to the panel 110 and the external video output circuit 111 and displayed (F205).

  The overall control circuit 105 generates subject position data from the photographing auxiliary line data 803 as in the first embodiment, and outputs the subject position data to the recording control circuit 103 (F206). Subsequently, when the input of the release switch 108 is detected (F207), the overall control circuit 105 sends a release signal to the imaging circuit 101 and the recording control circuit 103, and the recording control circuit 103 detects the subject position data and the image from the imaging circuit 101. Is recorded on the recording medium 104 (F208), and the series of operations is terminated (F209). If there is no auxiliary shooting line data in step F203, the process proceeds to step F207 without performing steps F204 to F206.

  By performing the configuration and operation as described above, a recorded image and subject position data are recorded.

  According to the present embodiment, unlike the first embodiment, the photographing auxiliary line information is read from the recording medium.

(Third embodiment)
FIG. 9 shows a configuration example of an image processing apparatus according to the third embodiment of the present invention. The image processing circuit 901 reads an image file in the recording medium 903 via the recording / playback control circuit 902 and outputs the image to the display control circuit 905. Further, the image processing circuit 901 receives an instruction from the overall control circuit 904, enlarges / trims the read image, and outputs the image to the display control circuit 905. The image processing circuit 901 outputs an image to the printer connection control circuit 914. The overall control circuit 904 reads subject position data from a file read from the recording medium 903 via the recording / playback control circuit 902. The overall control circuit 904 outputs the image enlargement / trimming position and size to the image processing circuit 901.

  The recording / reproducing control circuit 902 is a recording control circuit that reads and records a file on the recording medium 903 and inputs / outputs the image processing circuit 901 and the overall control circuit 904. A recording medium 903 is a recording medium for recording image data, and a memory card or the like is used. A display control circuit 905 is a display control circuit that outputs the video output from the image processing circuit 901 to the display panel 906 and the external video output circuit 907. The display panel 906 is a display device that displays the video output from the display control circuit 905, and a liquid crystal panel or the like is used. The external video output circuit 907 is an external video output circuit that converts the video output from the display control circuit 905 into a video output conforming to the composite video standard and outputs the video output.

  The enlargement / trimming changeover switch 908 is a switch for instructing the overall control circuit 904 to switch between normal reproduction and enlargement / trimming. A subject position selection switch 909 is a switch for instructing the overall control circuit 904 to select a subject position during enlargement / trimming. The size input switch 910 is a switch for instructing the overall control circuit 904 the size at the time of enlargement / trimming. The position fine adjustment input switch 911 is a switch for instructing the overall control circuit 904 to make fine vertical and horizontal positions during enlargement / trimming. The save switch 912 is a switch that instructs the overall control circuit 904 to save the displayed image. The print switch 913 is a switch that instructs the overall control circuit 904 to perform printing.

  Next, a description will be given according to the flowchart of FIG. 10 with reference to the configuration diagram of FIG. 9 and FIGS. 11 to 14.

  When the operation starts (F301), the enlargement / trimming changeover switch 908 detects an input from the user (F302). When normal reproduction is detected by the enlargement / trimming changeover switch 908, the overall control circuit 904 sets the enlargement reproduction release to the image processing circuit 901, and the image processing circuit 901 outputs the normal size image to the display control circuit 905. Then, the display control circuit 905 outputs an image having a normal size to the display panel 906 and the external video output circuit 907 (F303). When enlargement / trimming is detected by the enlargement / trimming changeover switch 908, the overall control circuit 904 reads the subject position data of the image file being reproduced in the recording medium 903 via the recording / reproduction control circuit 902 (F304). .

  The overall control circuit 904 generates an enlargement / trimming size from the read subject position data (F305). Here, if (533,400) (1066,400) (533,800) (1066,800) is read as subject position data at the time of shooting, enlargement / trimming is performed with these positions as the center. Further, the size is 533 × 400 pixels, which is a size in which the origin and the first subject position are diagonal. A range to be enlarged / trimmed when each subject position is selected is indicated by a dotted line in FIG.

  Then, the overall control circuit 904 sets the first subject position (533,400) and size 533 × 400 pixels in the image processing circuit 901 as initial settings (F306). The enlargement and trimming positions and sizes at this time are indicated by solid lines in FIG. Here, when there are a lot of subject position data, the subject position data close to the center may be set as the initial setting instead of the first.

  Next, when the subject position selection switch 909 is detected (F307), the overall control circuit 904 selects the next subject position (1066, 400) from the series of subject position data, and sends it to the image processing circuit 901. Set (F308). At this time, each time the subject position selection switch 909 is detected, the enlargement / trimming positions change as shown in 1301 to 1304 as shown in FIG.

  Subsequently, when the size input switch 910 is detected (F309), the overall control circuit 904 sets an enlargement / trimming size corresponding to the input in the image processing circuit 901 (F310). With this input, the image processing circuit 901 performs fine adjustment of the size when the initial size does not satisfy the user's intention.

  Subsequently, when the position fine adjustment input switch 911 is detected (F311), the overall control circuit 904 sets an enlarged position corresponding to the input in the image processing circuit 901 (F312). With this input, the image processing circuit 901 performs fine adjustment of the position when the subject position does not satisfy the position intended by the user.

  The image processing circuit 901 enlarges / trims the image based on the set position and size, outputs the image to the display control circuit 905, displays it on the display panel 906, and outputs it to the external video output circuit 907 (F313). The image at this time is shown in FIG.

  When the storage switch 912 is detected (F314), the image processing circuit 901 outputs the enlarged / trimmed image to the recording / reproduction control circuit 902, and the recording / reproduction control circuit 902 records the image on the recording medium 903. (F315).

  When the print switch 913 is detected (F316), the image processing circuit 901 outputs an enlarged / trimmed image to the printer connection control circuit 914. If the printer is connected, printing is performed (F317). The operation of is terminated (F318).

  By performing the configuration and operation as described above, it is possible to perform enlarged display / trimming intended by the user more easily.

  According to the present embodiment, in the image processing apparatus having the image recording / reproducing means for recording / reproducing the image data, the display means, the enlarged display means for enlarging and displaying the image, and the means for setting the position at the enlarged display, The enlargement position is determined based on the position information of the subject recorded in association with the data.

  Further, in an image processing apparatus having an image recording / reproducing means for recording and reproducing image data, a display means, an enlarged display means for enlarging and displaying an image, and a means for setting a size (size) at the enlarged display, the image data The size to be enlarged is determined based on the position information of the subject recorded in association with the above.

  In addition, in an image processing apparatus having an image recording / reproducing means for recording / reproducing image data, a display means, a means for trimming an image, and a means for setting a position at the time of trimming, the position of a subject recorded in relation to the image data The trimming position is determined based on the information.

  Further, in an image processing apparatus having an image recording / reproducing means for recording / reproducing image data, a display means, a means for trimming an image, and a means for setting a size at the time of trimming, the position of a subject recorded in relation to the image data The trimming size is determined based on the information.

  As described above, according to the first to third embodiments, when a captured image is enlarged and trimmed and printed by a digital camera, a video camera, an image reproducing device for reproducing a still image or a moving image, and the like. , The captured image and the auxiliary shooting line are combined and displayed at the time of shooting, the position information of the subject is generated based on the used shooting auxiliary line information, and the shot image and the position information of the subject are correlated to the recording medium. Record. Then, based on the position information of the subject recorded in association with the image data, the position and size of enlargement reproduction and trimming are determined, and enlargement reproduction and trimming printing are performed.

  The subject position information recorded at the time of image recording is based on the photographing auxiliary line selected and used by the photographer in determining the composition, and includes the position information of the important subject intended by the photographer. . By deciding the position and size of enlarged display and trimming printing during playback based on the position information of the subject, enlargement playback and trimming printing of important subjects intended by the photographer can be performed quickly and with fewer steps. It can be easily performed.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

1 is a configuration diagram of a first embodiment of the present invention. It is a figure which shows the detail of an internal memory circuit. It is a figure which shows a photography auxiliary line image and the to-be-photographed object position data produced | generated. It is a figure which shows the image file containing to-be-photographed object position data. It is a figure which shows a to-be-photographed object position data file and an image file. 3 is a flowchart of the first embodiment. 10 is a flowchart of the second embodiment. It is a figure which shows the example of a directory structure of a recording medium. FIG. 6 is a configuration diagram of a third embodiment. 10 is a flowchart of the third embodiment. It is a figure which shows the range expanded / trimmed in each subject position data. It is a figure which shows the set range to be expanded / trimmed. It is a figure which shows the change of the expansion / trimming range by subject position selection input. It is a figure which shows the image expanded and trimmed.

Explanation of symbols

101 Imaging circuit
102 Image processing circuit
103 Recording control circuit
104 Recording media
105 Overall control circuit
106 Internal memory circuit
107 Shooting auxiliary line selection switch
108 Release switch
109 Display control circuit
110 Display panel
111 External video output circuit
201 to 203 Shooting auxiliary line data
204 Internal ROM table
205 ROM table switch
301 to 303 Shooting auxiliary line image
304 to 305 Generated subject position
401 Image file containing subject position data
501 Subject position data file
502 image files
801 root directory
802 Auxiliary line data storage directory
803 to 805 Shooting auxiliary line data file
806 Image storage directory
807-808 image file
901 Image processing circuit
902 Recording / playback control circuit
903 recording media
904 Overall control circuit
905 Display control circuit
906 Display panel
907 External video output circuit
908 Enlargement / trimming switch
909 Subject position selection switch
910 size input switch
911 Position fine adjustment input switch
912 Save switch
913 Print switch
914 Printer connection control circuit
1301 to 1304 Range to be enlarged / trimmed by subject position selection input

Claims (13)

An imaging means for capturing an image;
Display means for combining and displaying the captured image and the photographing auxiliary line;
An image pickup apparatus comprising: a recording unit that records subject position information based on the photographing auxiliary line information and the captured image in association with each other. Furthermore, it has a photographing auxiliary line selection means for selecting a photographing auxiliary line,
The imaging apparatus according to claim 1, wherein the display unit synthesizes and displays the selected photographing auxiliary line. The display means reads out the shooting auxiliary line from the recording medium, displays the synthesized auxiliary line, and displays it.
The imaging apparatus according to claim 1, wherein the recording unit records the subject position information and the captured image in association with each other on the recording medium.   The imaging apparatus according to claim 1, wherein the position information of the subject is position information of an intersection of the shooting assistance line. Storage means for associating and storing image data and subject position information;
An image processing apparatus comprising: a display unit that determines an enlargement position of the image data based on the position information of the subject and displays the enlarged image. Storage means for associating and storing image data and subject position information;
An image processing apparatus comprising: display means for determining an enlarged size of the image data based on the position information of the subject and displaying the enlarged image. Storage means for associating and storing image data and subject position information;
An image processing apparatus comprising trimming means for determining and trimming the trimming position of the image data based on the position information of the subject. Storage means for associating and storing image data and subject position information;
An image processing apparatus comprising trimming means for determining and trimming the trimming size of the image data based on the position information of the subject. An imaging step for imaging an image;
A display step of combining and displaying the captured image and the photographing auxiliary line;
An imaging method, comprising: a recording step of recording the positional information of a subject based on the imaging auxiliary line information and the captured image in association with each other. A determination step of determining an enlargement position of the image data based on position information of the subject stored in association with the image data;
A display step of enlarging and displaying the image data at the determined enlargement position. A determination step of determining an enlarged size of the image data based on the position information of the subject stored in association with the image data;
A display step of enlarging and displaying the image data at the determined enlargement size. A determination step for determining a trimming position of the image data based on the position information of the subject stored in association with the image data;
And a trimming step of trimming the image data at the determined trimming position. A determination step of determining a trimming size of the image data based on the position information of the subject stored in association with the image data;
And a trimming step for trimming the image data with the determined trimming size.

Images