JP2011182255A - Imaging apparatus with fish print photographing function - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus with a fish print photographing function, the imaging apparatus obtaining a fish-print-like photograph closer to a real fish print by also considering the thickness of a fish. <P>SOLUTION: White-and-black processing is applied to a fish body image obtained by imaging using an imaging unit, a fish body portion in the fish body image after white-and-black processing is extracted, and an image of the extracted fish body portion is laterally divided to obtain a plurality of divided images. Each of the divided images is longitudinally enlarged to increase the enlargement rate of a divided image corresponding to the periphery of the fish body portion rather than the enlargement rate of a divided image corresponding to the center of the fish body portion, among the divided images, thereby obtaining a fish print image. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging apparatus having a fish photo shooting function for taking a fish photo.

In recent years, an increasing number of digital still cameras and other imaging devices that enable underwater photography. Such an imaging device capable of underwater photography is widely used by anglers and the like.
By the way, at the time of fishing, a fish pioneer is created for the purpose of keeping a record of the fish caught. However, to create a good quality fish pioneering technique is required, and it is costly to ask an expert to make a fish pioneer.

  In view of such circumstances, Patent Document 1 proposes a fish cultivation system that makes it possible to create fish-like images by digital image processing.

Japanese Patent No. 3824348

  Here, Patent Document 1 performs digital image processing on an image obtained by photographing a fish placed on a predetermined sheet on which a mesh is formed from directly above the predetermined sheet. For this reason, the fish reclamation image obtained by the method of Patent Document 1 is created based on a fish projection image. On the other hand, the actual fish pioneer is created by pressing Japanese paper directly against the fish with ink applied. For this reason, in actual fish cultivation, not only the projected portion of the fish, but also the thick portion of the fish is copied onto the Japanese paper.

  The present invention has been made in view of the above circumstances, and provides an imaging device having a fish shoot photography function capable of obtaining a fish shoot-like photograph that feels more like an actual fish shoot by considering the thickness of the fish. For the purpose.

  In order to achieve the above object, an imaging apparatus having a fish pioneer photography function according to the first aspect of the present invention includes an imaging unit that captures a fish to obtain a fish image, and a monochrome processing unit that converts the fish image into black and white An extraction unit that extracts a fish body part from the black and white fish image, a split unit that splits the fish part extracted above to obtain a plurality of split images, and among the plurality of split images, the fish body A pioneering image generation unit that generates a pioneering image by enlarging each divide image by increasing the magnifying rate of the divide image corresponding to the periphery of the fish body part to be larger than the magnifying rate of the divided image corresponding to the center of the part, and the generation And an output unit for outputting the fish culled image.

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device which has the fish-pickup photography function which can obtain the fish-pick-up-like photograph of the feeling close | similar to actual fish-pickup by also considering the thickness of a fish can be provided.

It is a figure which shows the structure of the digital camera as an example of the imaging device which has the fish photo photography function which concerns on one Embodiment of this invention. It is a figure shown about a camera operation part. It is a flowchart which shows the main control operation | movement of the camera which concerns on one Embodiment of this invention. It is a figure which shows the example of the fish body image displayed on a display part at the time of fish cultivation mode. It is a figure which shows the relationship between a frame and image division. It is a figure for demonstrating an example of the calculation method of the full length of a fish. It is a figure for demonstrating the difference between a fish-pilot-like photograph and an actual fish-pilot. It is a figure which shows notionally a cross section when a fish is cut | disconnected along a X direction. It is a flowchart which shows the flow of the specific process of an image deformation process. It is a figure which shows the example of reproduction | regeneration of a fish development image.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram illustrating a configuration of a digital camera (hereinafter simply referred to as a camera) as an example of an imaging apparatus having a fish photo shooting function according to an embodiment of the present invention. A camera 100 shown in FIG. 1 includes a camera control ASIC (application-specific integrated circuit) 101, a camera operation unit 102, a program memory 103, an imaging unit 104, a storage circuit 105, a display drive circuit 106, and a display. Unit 107, clock unit 108, position detection unit 109, and recording medium 110.

The camera control ASIC 101 is a control circuit for performing overall control of the camera 100. The camera control ASIC 101 includes a control circuit 1011 and an image processing circuit 1012.
The control circuit 1011 has a function as an output unit, and controls the operation of each block of the camera 100 such as the imaging unit 104 and the display drive circuit 106 of the camera 100 in response to an operation of the camera operation unit 102 by the user. Further, the control circuit 1011 in the present embodiment also has a function as a full length calculation unit. That is, the control circuit 1011 calculates the total length of the fish that is the main subject of the camera 100 according to the distance from the imaging unit 104 to the subject. Details of the processing as the full length calculation unit will be described later.

  The image processing circuit 1012 performs various image processes on various images such as an image obtained via the imaging unit 104. The image processing includes, for example, color correction processing, gradation correction processing, enlargement / reduction processing, compression processing, and decompression processing on the compressed image for the image obtained in the imaging unit 104. Further, the image processing circuit 1012 in the present embodiment also has functions as an extraction unit, a black and white processing unit, a division unit, and a fish cultivation image generation unit. That is, the image processing circuit 1012 performs a process for black-and-white (grayscale) the image obtained in the imaging unit 104, a process for extracting a fish body portion in the black-and-white image, a process for dividing the extracted fish body image, A process of enlarging the divided image according to a predetermined enlargement ratio to generate a fish reclamation image is performed. Details of these processes will be described later.

  The camera operation unit 102 is various operation members for the user to perform various operations on the camera 100. As shown in FIG. 2, the camera operation unit 102 includes a power button 1021, a release button 1022, a zoom switch 1023, a mode dial 1024, a deformation confirmation switch 1025, a selection button 1026, and the like. A power button 1021 is an operation unit for instructing to turn on or off the power of the camera 100. A release button 1022 is an operation unit for instructing photographing (recording image acquisition) by the camera 100. A zoom switch (consisting of two switches, wide and tele) 1023 is an operation unit for instructing zoom driving of the zoom lens 1041a. A mode dial 1024 is an operation unit for switching the operation mode and shooting mode of the camera 100. Note that the camera 100 in the present embodiment has a fish cultivation mode as one of photographing modes. The fish-pick-up mode is a shooting mode for obtaining a fish-pound-like photograph by shooting a fish as a subject. The deformation confirmation switch 1025 is an operation unit for instructing a confirmation display of a fishery image obtained after image deformation (image enlargement) processing in the fishery mode. The selection button 1026 is an operation unit for performing various selection operations in the camera 100. In addition, the selection button 1026 functions as an operation unit for adjusting the size of the frame displayed on the display unit 107 in the fish cultivation mode. Further, the selection button 1026 functions as an operation unit for instructing the adjustment of the deformation amount of the fish pioneer image after the deformation confirmation switch 1025 is operated by the user.

  The program memory 103 is a memory for storing various programs executed by the control circuit 1011 of the camera control ASIC 101 and various parameters necessary for executing the various programs. The program memory 103 also stores a frame image for displaying a frame on the screen of the display unit 107 in the fish shooting mode described later. Further, the program memory 103 also stores information for identifying the name of the fish that is currently the subject from the fish image obtained by the imaging unit 104. This information is, for example, association information between various fish shape data and fish names.

  The imaging unit 104 includes a lens 1041, an imaging element 1042, and an imaging interface circuit 1043. The lens 1041 is an optical system for forming an image of the light flux from the subject on the photoelectric conversion surface of the image sensor 1042. Here, the lens 1041 in this embodiment includes a zoom lens 1041a and a focus lens 1041b. The zoom lens 1041a is a lens for changing the angle of view of an image acquired by the image sensor 1042. The focus lens 1041b is a lens for adjusting the focal position of the lens 1041. The zoom lens 1041a and the focus lens 1041b are driven according to the control of the control circuit 1011. The image sensor 1042 has a photoelectric conversion surface on which pixels are two-dimensionally arranged. The image sensor 1042 converts a light beam incident through the lens 1041 into an electrical signal (color image signal). The imaging interface circuit 1043 converts an analog color image signal obtained by the imaging element 1042 into a digital color image (hereinafter simply referred to as an image). The imaging unit 104 having such a configuration captures a subject under the control of the control circuit 1011 and acquires an image related to the subject.

The storage circuit 105 is composed of, for example, an SDRAM, and temporarily stores various data such as a color image obtained by the imaging unit 104.
The display driving circuit 106 drives the display unit 107 according to the control of the control circuit 1011. The display unit 107 is a display unit such as a liquid crystal display (LCD) or an organic electroluminescence display (ELD) provided on the back surface of the camera 100, for example. The display unit 107 displays various images such as an image obtained by the imaging unit 104 driven by the display driving circuit 106.

The clock unit 108 measures various times such as shooting date and time. The position detection unit 109 is configured by, for example, a global positioning system (GPS), and detects a shooting location when shooting by the camera 100 is performed.
The recording medium 110 records a recording image obtained by the imaging unit 104 and compressed by the image processing circuit 1012. The recording medium 110 is a memory card that is detachably attached to the camera 100, for example.

Hereinafter, the operation of the camera according to the present embodiment will be described. FIG. 3 is a flowchart showing the main control operation of the camera 100. The operation of FIG. 3 is started when the power of the camera 100 is turned on.
In FIG. 3, the control circuit 1011 of the camera control ASIC 101 determines whether or not the power of the camera 100 is turned off by operating the power button 1021 of the camera operation unit 102 (step S1). When the power is turned off in the determination of step S1, the control circuit 1011 ends the process of FIG. On the other hand, when the power is not turned off in the determination in step S1, the control circuit 1011 determines whether or not the operation mode of the camera 100 is the shooting mode (step S2). The operation mode of the camera 100 is set by the mode dial 1024 of the camera operation unit 102, for example.

  When the operation mode of the camera 100 is the shooting mode in the determination of step S2, the control circuit 1011 determines whether or not the shooting mode of the camera 100 is the fishing mode (step S3). The shooting mode is also set by the mode dial 1024 of the camera operation unit 102, for example.

  If it is determined in step S3 that the shooting mode is not the fishery mode, the control circuit 1011 performs control corresponding to the shooting mode other than the fishery mode. The control corresponding to the photographing modes other than the fish pioneering mode conforms to the conventional control and will be briefly described. In this control, the control circuit 1011 first controls the imaging unit 104 and the display drive circuit 106 to perform normal through image display on the display unit 107 (step S4).

  In normal through image display, the control circuit 1011 causes the image capturing unit 104 to acquire an image at regular timings. Each time an image is acquired by the imaging unit 104, the control circuit 1011 performs image processing (tone correction processing, color correction processing, reduction processing, etc.) by the image processing circuit 1012. Then, the control circuit 1011 controls the display driving circuit 106 to display the processed image on the display unit 107. With such a through image display, the user can observe the subject using the display unit 107.

  After the normal live view display, the control circuit 1011 determines whether or not shooting execution is instructed by the user operating the release button 1022 (step S5). If it is determined in step S5 that execution of shooting has not been instructed, the process returns to step S1. In this case, the control circuit 1011 determines the operation mode of the camera 100 again. On the other hand, when the execution of shooting is instructed in the determination of step S5, the control circuit 1011 executes shooting control (recording image acquisition control) (step S6). In this shooting control, for example, the control circuit 1011 acquires an image by the imaging unit 104 while adjusting the exposure time of the image sensor 1042 or the opening amount of a diaphragm (not shown) according to the exposure amount calculated in advance when displaying a through image. Let it run. The control circuit 1011 performs image processing (tone correction processing, color correction processing, compression processing, etc.) by the image processing circuit 1012. After the completion of such image processing, the control circuit 1011 records the image after image processing on the recording medium 110 (step S7). Thereafter, the process returns to step S1.

  In step S3, when the shooting mode is the fish cultivation mode, the control circuit 1011 performs control corresponding to the fish cultivation mode. Here, in the fish cultivation mode, it is assumed that the user holds the camera 100 so as to face the fish 200 as the subject as shown in FIG. In the fish cultivation mode, it is more desirable to take a picture in a state where the subject fish 200 is placed on an achromatic and uniform luminance surface (for example, a white floor).

  In the fish cultivation mode, the control circuit 1011 first performs black and white through image display. Further, the control circuit 1011 causes the display unit 107 to display a frame 1071 shown in FIG. Further, in parallel with the black and white live view display and the display of the frame 1071, the control circuit 1011 identifies the fish name in the image by recognizing the fish portion of the image acquired by the imaging unit 104 (step S8). .

  In the black and white live view display, the control circuit 1011 causes the image capturing unit 104 to acquire an image at regular intervals. Every time an image is acquired in the imaging unit 104, the control circuit 1011 performs image processing for displaying a black and white live-view image by the image processing circuit 1012. Thereafter, the control circuit 1011 controls the display driving circuit 106 to display the image that has been subjected to image processing on the display unit 107.

  Here, in the present embodiment, monochrome processing is performed in addition to the above-described tone correction processing, reduction processing, and the like as image processing for displaying a monochrome live view image. The black and white processing is processing for black and white of an image by eliminating the color component of the image acquired by the imaging unit 104. As this black and white processing, for example, there is processing for binarizing the pixel value of each pixel of the image obtained by the imaging unit 104 with a predetermined threshold. The black-and-white process is a process for generating a fish image that is fish-like. Basically, it is desirable to make the fish black. For this reason, it is desirable to set the threshold for binarization on the high luminance side. Further, although binarization is used in the above-described example, multi-value conversion more than ternarization may be performed. By performing the black and white live view display, a black fish image is displayed on the display unit 107 as shown in FIG.

  Here, since a color image is acquired by the imaging unit 104, each pixel of the image obtained by the imaging unit 104 is, for example, red, green, and blue (when a primary color filter is pasted on the photoelectric conversion surface). It has a pixel value corresponding to any color component. For this reason, when performing monochrome conversion, monochrome conversion is performed by regarding three pixels having different color components (four pixels of red, green, green, and blue in the case of a Bayer array filter) as one pixel. desirable. In addition, as a black and white processing, a luminance component is calculated from three pixels having different color components (four pixels of red, green, green, and blue in the case of a Bayer array filter) without performing multi-value processing. You may make it display the image which uses a luminance component as a pixel value.

The fish name can be identified by, for example, image matching between the pre-monochrome image obtained by the imaging unit 104 and the fish image stored in the program memory 103.
After the monochrome live view display and the frame 1071 display, the control circuit 1011 determines whether or not a frame operation instruction has been given by the user (step S9). This frame operation instruction is performed by, for example, the selection button 1026. For example, when the user wants to enlarge the frame 1071 in the horizontal direction in FIG. 4, the user presses the right button of the selection button 1026. Further, when the frame 1071 is desired to be reduced in the horizontal direction in FIG. 4, the left button of the selection button 1026 is pressed. Further, when it is desired to enlarge the frame 1071 in the vertical direction of FIG. 4, the upper button of the selection button 1026 is pressed. When the frame 1071 is desired to be reduced in the vertical direction in FIG.

  When a frame operation instruction is given in the determination in step S9, the control circuit 1011 enlarges or reduces the frame 1071 in the image processing circuit 1012 according to the operation content of the frame operation instruction, and then displays the enlarged or reduced frame 1071. The display driving circuit 106 is controlled to display again on the display unit 107 (step S10). Thereafter, the process returns to step S9.

  By such processing in step S10, it is possible to set the frame 1071 according to the size of the fish as shown in FIG. 5A and FIG. 5B. In the following description, as shown in FIG. 5, the vertical direction of the frame 1071 is defined as the X direction and the horizontal direction of the frame 1071 is defined as the Y direction.

  The frame operation instruction using the selection button 1026 described above is an example. For example, a touch panel may be provided as the camera operation unit 102 and a frame operation instruction may be performed on the touch panel. In addition, if the enlargement ratio of the frame 1071 is uniform in the vertical direction and the horizontal direction, the frame 1071 can be enlarged or reduced in conjunction with the operation of an operation unit having other functions such as the zoom switch 1023, for example. .

Furthermore, although the shape of the frame 1071 is rectangular in the examples of FIGS. 4 and 5, a frame 1071 that covers only the head of the fish may be displayed.
If it is determined in step S9 that no frame operation instruction has been given, the control circuit 1011 drives the zoom lens 1041a according to the user's operation of the zoom switch 1023 (step S11). By driving the zoom lens 1041a, the focal length of the lens 1041 is changed. As a result, the angle of view of the image obtained by the imaging unit 104, that is, the angle of view of the image displayed on the display unit 107 is changed. After the zoom control in step S11, the control circuit 1011 performs focus control of the lens 1041. Thereafter, the control circuit 1011 measures the distance from the lens 1041 to the subject (subject distance) based on the focus control result (step S12). During focus control, the control circuit 1011 drives the focus lens 1041b so that the contrast of the image obtained by the imaging unit 104 is maximized. Thereby, the focus state of an image becomes the best. The focus control may be performed using a dedicated sensor.

After the focus control and distance measurement, the control circuit 1011 calculates the total length of the fish 200 that is the subject from the focal length of the lens 1041 and the subject distance, and stores information indicating the calculated total length in the storage circuit 105 (step S13).
FIG. 6 is a diagram for explaining an example of a method for calculating the total length of the fish 200. As shown in FIG. 6, the light beam from the fish 200 having the full length H is imaged on the image sensor 1042 via the lens 1041. A fish image is displayed on the display unit 107 based on the image formed on the image sensor 1042. In this case, the following relationship is established.
Ys / Yc = Yw / Ye (Formula 1)
Here, Ys indicates the Y-direction width of the image of the fish 200 on the image sensor 1042, and Yc indicates the Y-direction width of the entire angle of view of the image sensor 1042. Yw represents the Y-direction width of the image of the fish 200 on the image sensor 1042 (that is, the Y-direction width of the frame 1071), and Ye represents the Y-direction width of the entire view angle of the display unit 107. From (Formula 1), Ys is shown by the following (Formula 2).
Ys = Yc · Yw / Ye (Formula 2)
If the focal length of the lens 1041 is F and the subject distance is L, the following relationship (Equation 3) is established.
H / L = Ys / F (Formula 4)
Therefore, the total length H of the fish 200 is shown by the following (Formula 5).
H = L · Ys / F
= L · Yc · Yw / (Ye · F) (Formula 5)
As described above, when the user gives a frame operation instruction on the display unit 107 so that the size of the fish 200 matches the size of the frame 1071, Yw can be determined. Can be calculated.

After calculating the total length of the fish 200 in step S13, the control circuit 1011 displays information indicating the total length on the display unit 107 (step S14). Thereafter, the control circuit 1011 performs image deformation processing (step S15).
Hereinafter, the image deformation process will be described. As described above, in the fish shoot shooting mode in the present embodiment, the fish 200 is placed on a flat surface such as a floor, and the user holds the camera 100 so as to face the fish 200 for shooting. In this case, the fish body image obtained via the imaging unit 104 is based on an image obtained by planarly projecting the fish 200 as shown in FIG. At this time, when viewed from the body of the fish, only the range indicated by Xp in FIG. 7A is projected.

  On the other hand, when actually creating a fish, the surface of the fish 200 is transferred to the Japanese paper 300 by pressing the Japanese paper 300 against the fish 200 as shown in FIG. For this reason, when viewed from the body of the fish, the range indicated by Xg (> Xp) in FIG. 7B is copied. Such a difference between Xg and Xp occurs because the fish 200 has a large roundness along the X direction.

  As shown in FIG. 7, if a fish reclamation image is created simply by photographing a fish, the stereoscopic effect of the fish reclamation created according to the actual technique is lost. In the present embodiment, considering the roundness of the fish 200, it is possible to generate a fish reclamation image closer to the actual fish reclamation. For this purpose, in consideration of the difference between the widths of Xg and Xp, the fish image obtained by the image capturing unit 104 and enlarged in the image processing circuit 1012 is enlarged to generate a fish pioneer image. The enlarging process will be described below.

  FIG. 8 is a diagram conceptually showing a cross section when the fish is cut along the X direction. Here, coordinate axes X and Z orthogonal to each other in FIG. 8 are set. In order to simplify the description, a cross section when the fish 200 is cut along the X direction is approximated by a circle having a radius r centered on the origin O as shown in FIG. Further, in the following description, only image deformation in the first quadrant (upper right region) in the coordinate space shown in FIG. 8 will be described. The image deformation in the second quadrant (upper left region) can be performed in the same manner as the image deformation in the first quadrant. No image deformation is required for the third and fourth quadrants.

  When the cross-sectional shape of the fish 200 is circularly approximated as shown in FIG. 8, the Japanese paper 300 is pressed along the arc AD at the time of actual production of the fish, and the portion of the arc AD is copied onto the Japanese paper 300. In this case, Xg / 2 is the length of the arc AD. On the other hand, the portion of the arc AD in the fish image obtained through the imaging unit 104 corresponds to the portion OD that projects the arc AD. In this case, Xp / 2 is the length of r (<the length of the arc AD).

  In the present embodiment, as the image deformation process, a process of enlarging the length of the image of the projection part OD of the arc AD so as to be the length of the part of the arc ED is performed. At this time, the fish image is divided into a plurality of images, and an enlargement process is performed for each divided image. FIG. 8 shows an example in which a fish image is divided into three equal parts. In this case, the width of the divided image corresponding to the projection portion OE, the width of the divided image corresponding to the projection portion EF, and the width of the divided image corresponding to the projection portion FD are all r / 3. Although the number of divisions is 3 in this example, the number of divisions is not particularly limited. Further, it is not always necessary to divide equally.

Further, in FIG. 8, a point A (0, r) that is the intersection of the circle 200 and the Z axis, a point B (r cos θ ₂ , r sin θ ₂ ) that is the intersection of the circle 200 and the dividing line, and a point C (r cos θ ₁ , r sin θ). ₁ ), D (0, r), which is the intersection of the circle 200 and the Z axis, is set. When set in this way, the length X1 of the arc CD can be obtained by the following (formula 6).
X1 = rθ ₁ (Formula 6)
Here, as shown in FIG. 8, the X coordinate of the point C can be expressed as 2r / 3. Therefore, the following relationship (Formula 7) is established.
2r / 3 = r cos θ ₁ (Formula 7)
From (Expression 6) and (Expression 7), X1 = r cos ⁻¹ (2/3). Based on the ratio between the length X1 of the arc CD thus obtained and the length of the projection portion FD, the magnification ratio E1 of the divided image corresponding to the projection portion FD is expressed by the following (Equation 8).
E1 = X1 / (r / 3) = 3 cos ⁻¹ (2/3) (Formula 8)
This is about 2.5 times. An image corresponding to the image along the arc CD can be obtained by enlarging the divided image corresponding to the projection portion FD by about 2.5 times according to the magnification rate E1 thus obtained.

Further, the length X2 of the arc BC can be obtained by the following (Equation 9).
X2 = r (θ ₂ −θ ₁ ) (Formula 9)
Here, as shown in FIG. 8, the X coordinate of the point B can also be expressed as (r / 3). Therefore, the following relationship (Equation 10) is established.
r / 3 = r cos θ ₂ (Formula 10)
From (Expression 7), (Expression 9), and (Expression 10), X2 = r (cos ⁻¹ (1/3) −cos ⁻¹ (2/3)). Based on the ratio between the length X2 of the arc BC and the length of the projection portion EF obtained in this way, the magnification ratio E2 of the divided image corresponding to the projection portion EF is defined as (Equation 11) below.
E2 = X2 / (r / 3) = 3 (cos ⁻¹ (1/3) −cos ⁻¹ (2/3))
(Formula 11)
This is about 1.2 times. An image corresponding to the image along the arc BC can be obtained by enlarging the divided image corresponding to the projection portion FD by about 1.2 times in accordance with the magnification E2 thus obtained.

Further, it is understood that the length of the arc AB is substantially equal to the length of the projection portion OE by performing the same calculation as described above. For this reason, the enlargement ratio E3 of the divided image corresponding to the projection part OE is set to 1.
A specific processing flow of the image deformation processing using the above concept will be described. FIG. 9 is a flowchart showing a specific processing flow of the image deformation processing. In FIG. 9, the control circuit 1011 extracts an image in a frame 1071 in an image that has been subjected to image processing such as black and white processing by the image processing circuit 1012 as an image of a fish body portion. Then, the control circuit 1011 divides the image in the frame 1071 into six parts in the X direction by the image processing circuit 1012 (step S31). An example of image division is shown by a one-dot chain line in FIGS. 5 (a) and 5 (b). After the division of the fish image, the control circuit 1011 causes the image processing circuit 1012 to enlarge the divided images X1 (two) in the X direction at an enlargement ratio of E1 = 2.5 (step S32). This enlargement can be performed, for example, by using a process of interpolating a pixel having an average pixel value of these two pixels between two adjacent pixels. After enlarging the divided image X1, the control circuit 1011 causes the image processing circuit 1012 to enlarge the divided image X2 in the X direction at an enlargement ratio of enlargement ratio E2 = 1.2 (step S33). Thereafter, the control circuit 1011 ends the process of FIG.

  As described above, each divided image is enlarged so that the magnification of the divided image corresponding to the periphery of the fish portion is larger than the magnification of the divided image corresponding to the center of the fish portion of the plurality of divided images. By generating a fish pioneering image, it is possible to obtain a pioneering image with a three-dimensional effect in consideration of the roundness of the fish.

  Thereafter, returning to FIG. 2, the description will be continued. After the image deformation process in step S15, the control circuit 1011 determines whether or not a confirmation instruction has been given by the user's operation of the deformation confirmation switch 1025 (step S16). In the determination in step S16, when a confirmation instruction is given, the control circuit 1011 controls the display driving circuit 106 to display the pioneer image obtained by the image deformation process on the display unit 107 as a confirmation image ( Step S17). Thereafter, the control circuit 1011 determines whether or not a deformation amount adjustment instruction has been given by the user (step S18). This deformation amount adjustment instruction is performed by, for example, the selection button 1026. In the determination in step S18, when a deformation amount adjustment instruction is given, the control circuit 1011 controls the image processing circuit 1012 according to the user's deformation amount adjustment instruction, and the divided image X1 or the divided image X2 in the X direction. The width is adjusted (step S19).

  Further, when the confirmation instruction is not given in the determination of step S16, or when the deformation amount adjustment instruction is not given in the determination of step S18, the control circuit 1011 is instructed to execute shooting by the operation of the release button 1022 of the user. It is determined whether or not (step S20). If it is determined in step S20 that execution of shooting has not been instructed, the process returns to step S16. In this case, the control circuit 1011 determines again whether or not a confirmation instruction has been issued. On the other hand, when the execution of shooting is instructed in the determination of step S20, the control circuit 1011 executes shooting control (recording image acquisition control) (step S21). In this shooting control, the control circuit 1011 acquires an image by the imaging unit 104 while adjusting the exposure time of the image sensor 1042 and the opening of a diaphragm (not shown) in accordance with the exposure amount calculated in advance when displaying a black and white live view image, for example. Is executed. The control circuit 1011 performs image processing (gradation correction processing, color correction processing, black and white processing, compression processing, etc.) by the image processing circuit 1012. In the control circuit 1011, the clock unit 108 detects the shooting date and time, and the position detection unit 109 detects the shooting location. Furthermore, photographer information registered in advance is acquired as angler information from the program memory 103, for example. Then, the control circuit 1011 records the fish pioneer image obtained by the image processing on the recording medium 110 in association with the full length information of the fish, shooting date / time information, shooting location information, angler information, and fish name information (step S22). Thereafter, the process returns to step S1.

  In step S2, if the operation mode of the camera 100 is not the shooting mode, the control circuit 1011 determines whether or not the operation mode of the camera 100 is the playback mode (step S23). If it is determined in step S23 that the operation mode of the camera 100 is not the playback mode, the process returns to step S1. On the other hand, when the operation mode of the camera 100 is the playback mode in the determination in step S23, the control circuit 1011 determines whether or not an image selection instruction and a playback instruction have been issued by the user (step S24). The image selection instruction and the reproduction instruction are performed by a selection button 1026, for example. If it is determined in step S24 that no image selection instruction or reproduction instruction has been issued, the process returns to step S1. On the other hand, in the determination in step S24, when an image selection instruction and a reproduction instruction are given, the control circuit 1011 controls the display driving circuit 106 after the image processing circuit 1012 expands the image selected by the user. Then, the image after the expansion process is displayed on the display unit 107 (step S25). Thereafter, the process returns to step S24.

  FIG. 10 is a diagram illustrating a reproduction example of a fish pioneer image. At the time of reproduction of the fish-pickup image, it is preferable to display a display 1072 indicating the total length, shooting date / time, shooting place, and angler in addition to the fish-pick-up image. By performing such a display, it is possible to emphasize the freshness of fish. Furthermore, it is more preferable to display a display 1073 indicating the name of the fish and a display 1074 indicating advice or the like when printing the fish reclamation image on paper.

  As described above, according to the present embodiment, in consideration of the roundness of the fish, each divided image is enlarged so that the enlargement rate of the peripheral portion of the fish image is larger than the enlargement rate of the central portion of the fish image. By generating the fish-pick-up image, it is possible to take a fish-pick-like photograph having the stereoscopic effect of actual fish-pick-up.

Further, by extracting the image in the frame 1071 as the image of the fish body part, it is possible to easily extract the image of the fish body part to be subjected to the calculation of the total fish length and the image deformation process.
Here, as shown in FIG. 5 and the like, the fish is also rounded in the Y direction. Therefore, in practice, Xp and Xg shown in FIG. 7 differ depending on the position of Y. For this reason, during the image deformation process, Xp is detected at each Y position while changing Y by a minute amount, and the above-described enlargement process is performed by dividing Xp detected at each Y position into six parts. It is more preferable to carry out. As a method for detecting Xp in this case, for example, processing for detecting the edge of a fish can be used.

In the above-described image deformation process, the enlargement ratio is obtained by approximating the cross-sectional shape of the fish to a circle. On the other hand, the enlargement ratio can be obtained by approximating the cross-sectional shape of the fish to an ellipse. In the case of an ellipse, the following is changed with respect to FIG.
First, the point A (0, b), point _{B (acosθ 2, bsinθ 2)} , point _{C (acosθ 1, bsinθ 1)} , respectively set (0, a). Here, a is the major radius of the ellipse, and b is the minor radius of the ellipse.

  In this case, the length X1 of the arc CD can be obtained by the following (Equation 12).

なお、（式１２）は例えば数値演算によって求めることができる。また、弧ＣＤを結ぶ線分ＣＤの長さを求めることによって近似的に弧ＣＤの長さを求めるようにしても良い。このような直線近似は上述した円近似の場合に対しても行うことができる。

In addition, (Formula 12) can be calculated | required by numerical calculation, for example. Alternatively, the length of the arc CD may be approximately obtained by obtaining the length of the line segment CD connecting the arc CD. Such linear approximation can also be performed for the above-described circular approximation.

The X coordinate of the point C can also be expressed as 2r / 3. Therefore, the following relationship (Formula 13) is established.
2r / 3 = cos θ ₁ (Formula 13)
From (Equation 13) and (Equation 12), the enlargement ratio E1 of the divided image corresponding to the projection portion FD can be obtained in the same manner as in the case of the circular approximation described above.

  Similarly, the length X2 of the arc BC can be obtained by the following (formula 14).

また、点ＢのＸ座標はｒ/３とも表すことができる。したがって、以下の（式１５）の関係が成立する。
ｒ/３＝ａｃｏｓθ_２ （式１５）
この（式１５）と（式１４）から、上述の円近似の場合と同様にして投影部分ＥＦに対応した分割画像の拡大率Ｅ２を求めることができる。

Further, the X coordinate of the point B can also be expressed as r / 3. Therefore, the following relationship (Formula 15) is established.
r / 3 = cos θ ₂ (Formula 15)
From (Equation 15) and (Equation 14), the enlargement ratio E2 of the divided image corresponding to the projection portion EF can be obtained in the same manner as in the case of the circular approximation described above.

  In the case of elliptical approximation, since only the major axis a can be detected from the width of the frame 1071, it is necessary to obtain the minor axis b from other than the width of the frame 1071. As a method for obtaining the minor axis b, for example, a cross-sectional shape is measured in advance for each type of fish, and the ratio of the major axis a to the minor axis b is stored in the program memory 103 in association with the type of fish. Can be considered. If the ratio between the major axis a and the minor axis b is stored for each type of fish, when the name (type) of the fish is identified in the process of step S8, the ratio of the major axis a and the minor axis b corresponding thereto is determined. It can be read out and used for image deformation processing.

Although the present invention has been described above based on the embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention.
Further, the above-described embodiments include various stages of the invention, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some configuration requirements are deleted from all the configuration requirements shown in the embodiment, the above-described problem can be solved, and this configuration requirement is deleted when the above-described effects can be obtained. The configuration can also be extracted as an invention.

  DESCRIPTION OF SYMBOLS 100 ... Camera, 101 ... Camera control ASIC, 1011 ... Control circuit, 1012 ... Image processing circuit, 102 ... Camera operation part, 1021 ... Power button, 1022 ... Release button, 1023 ... Zoom switch, 1024 ... Mode dial, 1025 ... Deformation confirmation switch, 1026 ... selection button, 103 ... program memory, 104 ... imaging unit, 1041 ... lens, 1041a ... zoom lens, 1041b ... focus lens, 1042 ... imaging element, 1043 ... imaging interface circuit, 105 ... storage circuit, 106 Display drive circuit 107 Display unit 108 Clock unit 109 Position detection unit 110 Recording medium

Claims (7)

An imaging unit that captures fish and obtains a fish image;
A black and white processing unit for converting the fish image into black and white;
An extraction unit for extracting a fish body part in the black and white fish image;
A dividing unit for dividing the fish body part extracted above to obtain a plurality of divided images;
Among the plurality of divided images, the enlarged image of the divided image corresponding to the periphery of the fish body portion is made larger than the enlarged image of the divided image corresponding to the center of the fish body portion, and each divided image is enlarged to obtain the fish development image. A fish pioneering image generator to generate,
An output unit for outputting the generated fish pioneer image;
An image pickup apparatus having a fish shooting photo shooting function. A display unit for displaying a frame image superimposed on the fish image obtained by the imaging unit;
2. The imaging apparatus having a fish photo shooting function according to claim 1, wherein the extraction unit extracts a fish body image portion in a frame image displayed on the display unit as the fish body portion. An operation unit for instructing enlargement or reduction of the frame image;
When the operation unit instructs to enlarge or reduce the frame image, the display unit displays the frame image enlarged or reduced according to the instruction superimposed on the fish image obtained by the imaging unit. An imaging apparatus having a fish shoot photography function according to claim 2. A distance detection unit for detecting a distance from the imaging unit to the fish;
A full length calculation unit for calculating the total length of the fish based on the distance from the imaging unit to the fish;
Comprising
The imaging apparatus according to claim 1, wherein the output unit further outputs information indicating the total length of the fish obtained by the full length calculation unit. A clock unit for measuring the date and time when the fish image was obtained by the imaging unit;
The imaging apparatus according to claim 1, wherein the output unit further outputs information indicating date and time obtained by the clock unit. It further comprises a position detection unit that detects a place where the fish image is obtained by the imaging unit,
The imaging apparatus according to claim 1, wherein the output unit further outputs information indicating a position obtained by the position detection unit.   The imaging apparatus according to claim 1, wherein the output unit outputs the fish pioneer image as a display output or a recording output on a recording medium.

Images