CN107018316A

CN107018316A - Image processing apparatus, image processing method and program

Info

Publication number: CN107018316A
Application number: CN201611033980.0A
Authority: CN
Inventors: 高山喜博
Original assignee: Casio Computer Co Ltd
Current assignee: Casio Computer Co Ltd
Priority date: 2015-12-22
Filing date: 2016-11-15
Publication date: 2017-08-04
Anticipated expiration: 2036-11-15
Also published as: JP2017118472A; JP6723512B2; CN107018316B; KR20170074742A

Abstract

The present invention provides a kind of image processing apparatus, image processing method and program, enables to fish eye images and is provided explicitly to user by the corresponding relation between the given subject that photographed in the fish eye images.Image processing apparatus possesses：Detection unit, to wide angle shot to wide angle picture in the given subject that is included be identified, and image of its body portion shot is detected；Amending unit, the distortion to the image of the body portion shot is modified；And processing unit, implement the processing that the image foundation of the body portion shot after at least one of image of the wide angle picture is corrected with distortion is associated.

Description

Image processing apparatus, image processing method and program

The application is based on the Japanese patent application the 2015-249410th and in March, 2016 submitted on December 22nd, 2015 The Japanese patent application submitted for 16th the 2016-052641st simultaneously claims priority rights and interests according to 35U.S.C.119, above-mentioned Shen The complete disclosure that please include specification, claims, accompanying drawing and summary is introduced into the application in the way of quoting.

Technical field

The present invention relates to image processing apparatus, the image procossing for the processing for implementing the wide angle picture for being arrived with wide angle shot Method and program.

Background technology

Although it is about that the fish eye lens employed in the camera devices such as digital still camera, which can for example carry out visual angle, 180 ° of large-scale photography, but in order to use mode of delivery, the image (fish eye images) photographed with fish eye lens turns into Center portion, which rises, therefrom is more intended to end (periphery) the then bigger image of distortion.Clapped as display using this fish eye lens The technology for the fish eye images taken the photograph, for example, disclosing following skill as No. 3066594 publications of Japanese Utility Model Registration Section No. Image in art, i.e. take the image in given area from fish eye images inscribe, and the region cut to this is implemented to correct distortion Processing by undistorted image (correction map picture) so that be supplied to the technology of user.In addition, as Japanese Unexamined Patent Publication 2015-19162 Publication discloses following technology like that, i.e. when abnormal including the face of each participant of meeting using fish eye lens shooting When becoming circular image (fish eye images), the face of each participant is identified, cut together with the phonation time of each participant Take and show the technology of the image of each participant.

According to the technology of above-mentioned each patent document, although even in what is photographed on a large scale using fish eye lens In the case of, for the image in the region cut from one part, undistorted image is also resulted in, but only If showing the image that is cut, user will be difficult to confirm the personage's that is photographed under which type of scene etc. and flake The corresponding relation of image.

The content of the invention

The problem of the present invention is that it is possible to cause fish eye images and the given subject that was photographed in the fish eye images Corresponding relation is provided explicitly to user.

The form of the present invention is related to a kind of image processing apparatus, it is characterised in that possess：Detection unit, to wide The given subject included in the wide angle picture that angle is photographed is identified, and the image of its body portion shot is examined Survey；Amending unit, the distortion to the image of the body portion shot is modified；And processing unit, implement the wide-angle figure The image of the body portion shot after at least one of image of picture is corrected with distortion sets up the processing that associates.

Another form of the present invention is related to a kind of image processing method, is the image processing method in image processing apparatus Method, it is characterised in that described image processing method includes：To with wide angle shot to wide angle picture in the given quilt that is included Body is taken the photograph to be identified, and the processing detected to image of its body portion shot；To the body portion shot that detects The processing that the distortion of image is modified；With the quilt by least one of image of the wide angle picture and after being corrected The image for taking the photograph body portion sets up the processing of association.

Another form of the present invention is related to a kind of storage medium of embodied on computer readable, has program stored therein, its feature exists In described program is used to implement function such as the computer of image processing apparatus：To in the wide angle picture that is arrived with wide angle shot Comprising given subject be identified, and the function of being detected to image of its body portion shot；To what is detected The function that the distortion of the image of the body portion shot is modified；With by least one of image of the wide angle picture with The image of the body portion shot after being corrected sets up the function of association.

Brief description of the drawings

Brief description of the drawings is herein incorporated, and is constituting the implementation shown in the drawings of the present invention of a part for specification Example, and with it is described above be generally described and being described in detail of embodiment shown below together with to explain the present invention's Principle.

Fig. 1 (1) will constitute the camera device 10 and main body for the digital camera applied as image processing apparatus for expression The outside drawing for the state that device 20 is combined into one, the state that Fig. 1 (2) separates camera device 10 and agent set 20 for expression Outside drawing.

Fig. 2 (1) is represents the block diagram of the composition of camera device 10, and Fig. 2 (2) is the frame for the composition for representing agent set 20 Figure.

Fig. 3 (1), (2) are the figure illustrated for the various postures to the camera device 10 in photography.

Fig. 4 (1), (2) are figure of the expression using the display example of the fish eye lens 16B fish eye images photographed.

The figure that situation when Fig. 5 (1)~(4) are for regeneration fish eye images (preservation finishes image) is illustrated.

Fig. 6 is the figure illustrated for the image management form 23C to the side of agent set 20.

The action of the side of agent set 20 when Fig. 7 is for 360 ° of photographies of implementation be (characteristic of the 1st embodiment Action) flow chart that illustrates.

Action (the 1st embodiment of the side of agent set 20 when Fig. 8 is represents to regenerate fish eye images (preservation finishes image) Characteristic action) flow chart.

Fig. 9 is expression continued access in the flow chart of Fig. 8 action.

Action (the 2nd embodiment party of the side of agent set 20 when Figure 10 is represents to regenerate fish eye images (preservation finishes image) The action of the characteristic of formula) flow chart.

Figure 11 (1)~(5) are for regenerating situation during fish eye images (preservation finishes image) in the 2nd embodiment The figure illustrated.

Action (the 3rd embodiment party of the side of agent set 20 when Figure 12 is represents to regenerate fish eye images (preservation finishes image) The action of the characteristic of formula) flow chart.

Figure 13 (1)~(3) are for regenerating situation during fish eye images (preservation finishes image) in the 3rd embodiment The figure illustrated.

Figure 14 (1)~(3) be in the 3rd embodiment regenerate fish eye images (preservation finishes image) when other The figure that situation is illustrated.

Embodiment

Hereinafter, embodiments of the present invention are illustrated based on accompanying drawing.

(the 1st embodiment)

Hereinafter, 1~Fig. 9 of reference picture illustrates come the 1st embodiment to the present invention.

In the present embodiment, exemplified with the situation that digital camera is applied to as image processing apparatus, the digital phase Machine is that can be separated into point of the camera device 10 described later for possessing image pickup part and the agent set 20 described later for possessing display part Release digital camera.The figure for the state that camera device 10 and agent set 20 are combined into one by Fig. 1 (1) for expression, Fig. 1 (2) To represent the figure for the state for separating camera device 10 and agent set 20.Constitute the camera device 10 of the divergence type digital camera (wireless connection identification) can be matched using available radio communication respectively with agent set 20, and is used as channel radio Believe and use WLAN (Wi-Fi) or Bluetooth (registration mark).In the side of agent set 20, receive and obtain in shooting dress The image taken by 10 sides is put, and the photographs (live view image) is shown.In addition, in present embodiment In, photographs is not limited to preserve the image finished, it is meant that shown image (live view figure on live view picture Picture：Image before preservation).

In Fig. 2 (1), camera device 10 possesses：Control unit 11, power supply unit 12, storage part 13, communication unit 14, operating portion 15th, image pickup part 16 and posture detecting part 17.Control unit 11 is carried out by the power supply from power supply unit (secondary cell) 12 Action, and be controlled according to the various programs in storage part 13 come the molar behavior to the camera device 10, and in the control CPU (not shown) (central operation processing unit), memory etc. are provided with portion 11 processed.Storage part 13 is, for example, with ROM, dodged The composition deposited etc., and preserve for program, various applications for realizing present embodiment etc..Communication unit 14 is to the side of agent set 20 Photographs is sent, or receives operation instruction signal from agent set 20 etc..Operating portion 15 possesses the base of power switch etc. This operated key (hardware keys).

Image pickup part 16, which is constituted, can shoot the camera section of subject in high-precision, in the lens unit of the image pickup part 16 Fish eye lens 16B, photographing element 16C etc. are provided with 16A.In addition, the camera of present embodiment can change common shooting Camera lens (omit diagram) and fish eye lens 16B, it is illustrated that example represent to be mounted with fish eye lens 16B state.The fish eye lens 16B is, for example, be made up of the lens combination of three block structures, circle can carrying out the large-scale photography that visual angle is about 180 ° All fish eye lenses (complete cycle fish eye lens), as the wide angle picture (fish eye images) taken by fish eye lens 16B it is overall into For circular image.In this case, in order to use mode of delivery, the wide angle picture (fish-eye image photographed with fish eye lens 16B Picture) more it is intended to the end then bigger image of distortion as the heart therefrom.

That is, because fish eye lens 16B is can to carry out the circle for the large-scale photography that its visual angle is about 180 ° All fish eye lenses, therefore the entirety of fish eye images turns into circular image, center portion, which rises, therefrom is more intended to end (periphery) Then distortion is bigger, also, due to compared with the central part of fish eye images its periphery turn into reduced image, therefore use Family is intended to carry out in detail the content of the periphery visually confirmation, and the confirmation is also extremely difficult.When by this fish eye lens The shot object image (optical image) that 16B is shot is when photographing element (such as CMOS or CCD) 16C is imaged, by photographing element 16C light Picture signal (signal of the analogue value) after electricity conversion is transformed to data signal by omitting the A/D transformation components of diagram, and And after implementing given image display processing, be sent to the side of agent set 20 and carry out monitor and show.Posture detection Portion 17 is the 3-axis acceleration sensor detected to the acceleration for putting on camera device 10, by according to camera device 10 Posture and the X, Y, each component of acceleration in Z-direction that detect are supplied to control unit 11.

In Fig. 2 (2), agent set 20 has the regeneration work(regenerated to the image photographed using fish eye lens etc. Can, and possess：Control unit 21, power supply unit 22, storage part 23, communication unit 24, operating portion 25, touch display part 26 and posture detection Portion 27.Control unit 21 is acted by the power supply from power supply unit (secondary cell) 22, and according in storage part 23 Various programs be controlled come the molar behavior to the agent set 20, and be provided with the control unit 21 (not shown) CPU (central operation processing unit), memory etc..Storage part 23 is, for example, the composition with ROM, flash memory etc., and with preservation It is used to realize the program storage 23A of the program of present embodiment, various applications etc., is temporarily stored as filling the main body Working storage 23B and image management form 23C described later of various information (for example, mark etc.) for putting 20 actions and needing etc..

The transmission and reception of various data are carried out between communication unit 24 and camera device 10.Operating portion 25 possess power supply by Setting button that button, release button, the photography conditions to exposure or shutter speed etc. are set etc. presses the various of push button Button, the execution of control unit 21 is corresponding with the input operation signal from the operating portion 25 to be handled, or is sent out to camera device 10 Send input operation signal.It is that stacking is configured with touch panel 26B on the display 26A of fine liquid crystal etc. to touch display part 26 Composition, its display picture turns into shows the monitor picture (live view of the image (fish eye images) being photographed in real time Picture), or as to photography finish the regeneration picture that image is regenerated.Posture detecting part 27 is to putting on agent set 20 The 3-axis acceleration sensor that is detected of acceleration, the X that the posture according to agent set 20 is detected, Y, Z-direction On each component of acceleration be supplied to control unit 21.

In the side of agent set 20, when the release button for indicating photography is operated, control unit 21 is implemented for fish eye images Development treatment generates photographs, and after being transformed to normative document form, is remembered implementing image Compression Record is stored in the recording medium of storage part 23.In this case, control unit 21 corrects the distortion of fish eye images by implementation Processing carries out record preservation to set up corresponding mode with fish eye images so as to generate correction map picture to the correction map picture. In this case following technology is utilized, i.e. tangent plane is screen using at the arbitrfary point on imaginary Sphere Measurement Model, by by vacation Think that the point coordinates on Sphere Measurement Model is transformed to the point on flat screen, the technology that thus distortion to fish eye images is modified, But what the processing (flake distortion correcting process) being modified due to the distortion to fish eye images was utilized is one in image procossing As the known technology that uses, therefore eliminate its specific description.

Fig. 3 is the figure illustrated for the posture to camera device 10.

The entirety of camera device 10 turns into the structure that fish eye lens 16B is configured with its front central portion for example in box-shaped Into.Fig. 3 (1) represents the state that fish eye lens 16B optical axis direction and gravity direction are substantially orthogonal, i.e. represent as camera is relative In the substantially vertical such situation (implementing situation about vertically shooting) photographed in ground, moreover, with shown in dotted line in figure Hemisphere represent fish eye lens 16B that visual angle is about 180 ° camera coverage.Fig. 3 (2) represents to make the positive direction (fish of camera Glasses head 16B optical axis direction) towards the state of sky, i.e. represent the optical axis direction such as fish eye lens 16B relative to gravity side The situation (situation that carrying out horizontal is shot) photographed like that to and as substantially opposite direction.

Fig. 4 is the figure exemplified with the wide angle picture (fish eye images) photographed using fish eye lens 16B, is represented in main body dress The state of fish eye images is shown on the regeneration picture for the touch display part 26 for putting 20 sides.

The example of diagram represents the fish eye images photographed by the vertical shooting shown in Fig. 3 (1), and Fig. 4 (1) is by before Fish eye images of 180 ° of side when vertically being shot as camera coverage, Fig. 4 (2) is as camera coverage using 180 ° of rear Fish eye images when vertically shoot.In the case where carrying out 360 ° of photographies in this way, it is divided into the photography of 180 ° of front with after 180 ° of side photographs and photographed twice.In addition, it is illustrated that example for shoot the situation of party is held round dining table in outdoor, and Represent to have photographed one group of mother and daughter in Fig. 4 (1) fish eye images for having carried out the 180 ° of photographies in front, taken the photograph having carried out 180 ° of rear Also the situation of one group of mother and son had been photographed in Fig. 4 (2) of shadow fish eye images.Each fish-eye image of 360 ° of photographies has been carried out in this way As being carried out storage preservation in the lump as one group of fish eye images group.

The control unit 21 of agent set 20, which is received, to be obtained by the fish eye images taken by camera device 10 and is repaiied The just processing of the overall distortion of the image, and simultaneously pin is identified in the given subject included in the correction map picture After the image that the body portion shot is detected to each subject, enter to be about to image and the detection of a part for correction map picture The image of each body portion shot gone out sets up the processing of association.That is, control unit 21 is in the manner described above for progress Each fish eye images of 360 ° of photographies and implement to correct the processing of its distortion and generate its correction map picture, and for each fish eye images Record preservation is carried out to set up corresponding mode with its correction map picture.Moreover, being carried out for each correction map picture to its image Parse and all detect the given subject (face of personage) included in correction map picture.In addition, the face detection Processing is that facial key element is detected or technology detecting etc., typically using in the camera is carried out to the colour of skin, in this implementation Due to what is utilized it is the known technology in mode, therefore omits its specific description.

The result of face detection processing is, when the face for all persons for detecting to be included in correction map picture, control Profile of the portion 21 processed along its personage and cut its body portion (facial parts) shot for each personage and generate face-image, And each face-image and its fish eye images are set up into accordingly progress record preservation.In addition, though face-image refer in order to be able to Personage and the image centered on face are enough determined, but can include the figure including the upper part of the body (head, neck, shoulder) Picture, moreover, being not limited to face, characteristic point can also be detected out of image and the characteristic area based on this feature point is extracted.In addition, Control unit 21 carries out record guarantor after the image procossing for implementing to make each face-image match with given shape and size Deposit.

The figure that situation when Fig. 5 is for regeneration fish eye images (preservation finishes image) is illustrated.

Fig. 5 (1) is represented on the touch display part 26 of the side of agent set 20 to various fish eye images (preservation finishes image) The circle in the list screen that thumbnail is shown, figure is carried out and has represented each fish eye images, and represented rectangular right in 3 × 3 Fish eye images have carried out the state that thumbnail is shown.Here, when the position of arbitrary thumbnail image is touched, control unit 21 Just it is regeneration object by the thumbnail image touched (fish eye images) selection.Fig. 5 (2) represents the fish for being selected as regenerating object Eye pattern picture, is to select fish eye images (reference picture 4 in 360 ° above-mentioned of fish eye images, having carried out the 180 ° of photographies in front (1) situation).

Fig. 5 (3) represents accordingly to record the correction map picture of preservation from the fish eye images foundation with being selected as regeneration object Among image in the given range that cuts.In this case, given range is cut among correction map picture (for example, rectangle Cut frame) in image.This cuts frame (imaginary frame) and correction map as similar, for example, the length of 1/4 size of correction map picture Square box, although and the frame that cuts be set at the initial time point that fish eye images are carried out with selection on correction map picture Initial position (position of central portion) place, but can be operated and any position that be moved on correction map picture by user. In the example shown in the series of figures, represent to have cut with the rectangular image (figure including mother and daughter for cutting inframe shown in dotted line Picture) situation.

Fig. 5 (4) is selected as regenerating the figure of the regeneration picture of the fish eye images of object for expression.In the regeneration picture, As described above, be amplified display to a part of image (image for cutting inframe) of correction map picture, also, pair and fish-eye image As the face-image progress guide look for establishing corresponding each personage is shown.In this case, however it is not limited to by touch operation The face-image of each personage included in the fish eye images (for example, Fig. 4 (1) fish eye images) of selection, with the fish eye images The face-image of each personage included in groups of another fish eye images (for example, Fig. 4 (2) fish eye images) is also carried out in the lump Guide look display.Now, the face-image of each personage is real according to the order according to each putting in order for personage in fish eye images Apply to arrange and carry out guide look and show.In addition, the face-image of each personage is regenerating the lower portion of picture straight as illustrated Arranged on line and carry out guide look and shown.In this case, in figure, the face-image for coming the mother and daughter in left side is Fig. 4 (1) fish The face-image of personage included in eye pattern picture, the face-image for coming the mothers and sons on right side is institute in the fish eye images of Fig. 4 (2) Comprising personage face-image.

In addition, in figure, marking the arrow mark of the dotted line around the image (image for cutting inframe) of amplification display Note represents the moving direction for cutting frame that can be moved by touch operation, and this cuts frame by touching touching on display part 26 Operation (slide) is touched to be moved according to its glide direction, slippage.Thus, it is shown on regeneration picture to cut frame The content of interior image (image of amplification display) changes also according to moving for frame is cut.In addition, cutting the movement of frame Direction is not limited to this four direction up and down, also being capable of adipping movement.Except in this way regeneration picture on Implement outside above-mentioned slide, the percussion operation (double click operation) being carried out continuously twice is also effective touch operation, when When implementing double click operation on any face-image, control unit 21 detects to include the position of the face-image among correction map picture Put, dynamic (redirecting) is frameed shift to the test position by making to cut, so that the image of the amplification display on regeneration picture (is cut Take the image of inframe) in include the face-image.

Image management form 23C is the table for managing fish eye images (preservation finishes image) and associated image Lattice, and have：" fish eye images ID ", " photography classification ", " link ID ", " correction map as ID ", " face-image ID ", " face figure Picture ID " ... projects." fish eye images ID " is to be stored to be managed to fish eye images to its fish eye images file The project for the information (consecutive number etc.) that (omit diagram) is identified, it is illustrated that example represent to store " A0001 ", " A0002 " ... situation." photography classification " represent to be photographed with 180 ° of fish eye images photographed or with 360 ° for storage Fish eye images photography species project, it is illustrated that example represent " fish eye images ID " be " A0002 ", " A0003 " it is each Image is one group of fish eye images group of 360 ° of photographies.

" link ID " is that storage represents groups of another fish eye images in the case where " photography classification " is 360 ° of photographies " fish eye images ID " project, in the example shown in the series of figures, " fish eye images ID " for " A0002 " " link ID " in, be used as table Show another fish eye images " fish eye images ID " and store " A0003 ", at " A0003 " " in link ID ", as representing another One fish eye images " fish eye images ID " and store " A0002 "." correction map as ID " be in order to fish eye images accordingly Manage the correction map that is corrected to its distortion as and store and image file (omitting diagram) is corrected to it be identified The project of information (consecutive number etc.), it is illustrated that example represent to store " B0001 ", " B0002 " ... situation." face-image ID " is to be stored to accordingly manage the face-image of each personage included in the fish eye images with fish eye images pair The project for the information (consecutive number etc.) that its facial image file (omitting diagram) is identified, represents to deposit in the example shown in the series of figures Stored up " C0001 ", " C0002 " ... situation.

Next, the flow chart shown in 7~Fig. 9 of reference picture comes to image processing apparatus (the digital phase in the 1st embodiment Machine) movement concept illustrate.Here, each function described in these flow charts is in the form of the program code that can be read It is saved, and action corresponding with the program code is performed successively.Additionally it is possible to perform and passed via network etc. successively The above-mentioned program code that defeated medium transmission comes is acted accordingly.That is, in addition to recording medium, additionally it is possible to utilize warp Program/the data being externally supplied by transmission medium perform the distinctive action of present embodiment.In addition, Fig. 7~Fig. 9 is table Show the flow chart of the action summary of in the molar behavior of digital camera, the 1st embodiment characteristic, from the Fig. 7~ The main flow (omit and illustrate) of molar behavior will be back to when being exited in Fig. 9 flow.

The action of the side of agent set 20 when Fig. 7 is for 360 ° of photographies of implementation be (characteristic of present embodiment Action) flow chart that illustrates.In addition, 360 ° of photographies are to be grasped from the menu screen for selecting various photograph modes by user The menu item made and be arbitrarily selected, in the case where have selected the menu item of this 360 ° photographies, will start to perform Fig. 7's Action.

First, the control unit 21 of the side of agent set 20 is under the wait state of release operation (step A1), when release operation When being carried out (in step A1："Yes"), carry out development treatment simultaneously for receiving the fish eye images obtained from camera device 10 Photographs is generated, and after implementation image Compression is transformed to the document form of standard (step A2), is remembered Record is stored in the recording medium of storage part 23 (step A3).In this case, two fish eye images of 360 ° of photographies of carry out are made Record preservation as one group of image, and as it is new " fish eye images ID " and for example generate " A0002 ", and in image management Carry out adding registration in form 23C.

Then, control unit 21 will " 360 ° photography " as it is new with this " fish eye images ID " corresponding " photography classification " and step on Remember in image management form 23C, and implement that corresponding " is linked the processing (step A4) that ID " is registered, but be somebody's turn to do " link ID " registration is implemented when photographing for second of 360 ° of photographies.Next, control unit 21 is directed to the fish eye images And implement the processing of amendment distortion and generate its correction map picture (step A5), and correction map picture record is stored in storage part In 23 recording medium, but now, as it is new " correction map for example generates " B0002 " as ID ", and with " fish eye images ID " " A0002 " sets up and is accordingly registered in image management form 23C (step A6).

And then, control unit 21 is parsed by the entirety to the correction map picture and is detected (step to the face of personage Rapid A7).Investigate its result for whether detected the face (step A8) of personage, if can not detect personage face ( In step A8："No"), then step A11 is transferred to, and check whether 360 ° of photographies have terminated.It is current to be photographed due to being 360 ° The situation that photography terminates for the first time is (in step A11："No"), therefore above-mentioned step A1 is returned, until indicating 360 ° of photographies Second photography release be operating as stopping, as wait state.

Currently, in the case where detecting the face of the personage in correction map picture (in step A8："Yes"), for each Personage and sheared along the profile of its personage and generate its face-image (step A9).In this case, can be for amendment The all persons that are included in image and produce its face-image, in the such face of personage of the image position at the periphery of fish eye images Portion's distortion it is excessive so as to even if implement its distortions correction also can not accurately to personage face detect in the case of, If there is the possibility for having personage, then its face-image can also be generated.It will cut in this way for each personage Each face-image cut and generated is adjusted to after given shape and size, it is set up with the fish eye images and is accordingly remembered Record be stored in the recording medium of storage part 23, in this case, as " face-image ID " and generate such as " C0004 ", " C0005 ", and with " fish eye images ID " " A0002 " sets up and is accordingly registered in image management form 23C (step A10). Then, above-mentioned action (step A1~A11) is repeated untill 360 ° of photographies terminate, at the end of being photographed when 360 ° ( In step A11：" it is "), is exited from Fig. 7 flow.

Action (this reality of the side of agent set 20 when Fig. 8 and Fig. 9 is represents to regenerate fish eye images (preservation finishes image) Apply the action of the characteristic of mode) flow chart.

First, when being operated by user and indicate the regeneration of fish eye images (preservation finishes image), control unit 21 is read Go out the multiple fish eye images (preservation finishes image) (step B1) for being recorded and being stored in the recording medium of storage part 23, be transformed to Thumbnail image and be allowed to carry out guide look to show (step B2).In this condition, whether investigation is implemented from the list screen Arbitrary thumbnail image is specified as the touch operation (step B3) of regeneration object, if touch operation is not carried out (in step In B3："No"), then investigate and whether operated (step B4) as the key given key, indicating regeneration ending of operating portion 25. If here, not indicating regeneration ending (in step B4："No"), then above-mentioned step B3 is back to, and indicating regeneration In the case of end (in step B4："Yes"), then exited from Fig. 8 and Fig. 9 flow.

Currently, it is shown as in multiple fish eye images in rectangular by guide look in the state of thumbnail image, when wherein any When the position of thumbnail image is touched (in step B3："Yes"), the selection of its fish eye images is appointed as regeneration by control unit 21 Object (step B5), then, the correction map picture (step B6) that reading is accordingly preserved with the specified image (fish eye images), and from The image (step B7) in rectangular region (cutting frame) is cut in the correction map picture.In this case, due in fish eye images It is the initial position (position of central portion) being set on correction map picture that selected initial time point, which cuts frame, therefore The image of the middle body of correction map picture will be cut.Then, the image cut is enlarged into given size, and is allowed to aobvious Show in the central portion office (step B8) of regeneration picture.

Next, each face-image (step B9) accordingly preserved with above-mentioned specified image (fish eye images) is read, And each face-image guide look is shown in regeneration picture (step B10).In this case, as shown in Fig. 5 (4), by each face Image arrangement at the bottom of regeneration picture is open into a row and carries out guide look and show, it puts in order turns into fish as described above Each personage's in eye pattern picture puts in order.Then, check and the above-mentioned groups of another flake of specified image (fish eye images) Whether image, 360 ° of another fish eye images are not specified (step B11), if remaining unspecified fish eye images (in step In rapid B11："Yes"), then after the unspecified fish eye images to be appointed as to regeneration object (step B12), it is back to above-mentioned Step B9, read each face-image that specified image (fish eye images) new with this is accordingly preserved, and make each face figure As guide look is shown in regeneration picture (step B10).Thus, in the feelings all specified each fish eye images of 360 ° of photographies and terminated Under condition (in step B11："No"), it is transferred to Fig. 9 flow.

In the state of this regeneration picture is shown on touch display part 26, grasped when implementing touch on regeneration picture When making (in step B13："Yes"), it is the double click operation (step of the face-image to guide look display to check the touch operation The slide (step B15) of correction map picture (image for the cutting inframe) vicinity B14), or in amplification shown.Currently, In the case of implementing the double click operation to face-image (in step B14："Yes"), determine to include out of this correction map picture Its facial position, and make to cut frame and be moved to the test position (step B16).For example, as shown in Fig. 5 (4), when in girl Face-image on when implementing double click operation, the face-image of the girl is determined from correction map picture, and make to cut frame and Row movement, the center of frame is cut to cause the face-image to turn into.Then, cut image that this cuts inframe and be allowed to put It is big to be shown in regeneration picture (step B17).Afterwards, it is back to step B13.

If in addition, the touch operation on regeneration picture is in the correction map picture (image for cutting inframe) being displayed magnified The slide of vicinity is (in step B15："Yes"), then (step B18) is detected to its glide direction and slippage, And make to cut in frame repairing positive image according to the glide direction and slippage and move (step B19).Then, from the correction map The image of inframe has been cut as in and amplification is shown in after regeneration picture (step B17), above-mentioned step is back to B13。

On the other hand, be not regenerate picture on touch operation (in step B13："No"), but for example as behaviour Make portion 25 it is given key, indicate to 360 ° photograph another fish eye images switching key operated in the case of (in step In rapid B20："Yes"), another fish eye images are specified from two fish eye images for implementing 360 ° of photographies as regeneration object (step B21 after), the correction map picture (step B22) for specifying image accordingly to preserve with this is read, cuts out and cuts from the correction map picture The image (step B23) of inframe is taken, the image amplification cut out is shown in regeneration picture (step B24).Afterwards, it is back to Step B13.Moreover, for example, in the case where being operated as the key given key, indicating regeneration ending of operating portion 25 (in step B25："Yes"), exited from Fig. 7 and Fig. 8 flow.

As described above, in the 1st embodiment, because the control unit 21 of agent set 20 is implemented the following processing, i.e. right The given subject included in the wide angle picture (fish eye images) photographed by camera device 10 is identified and to the quilt The distortion for taking the photograph the image of body portion is modified, and by the image of a part for wide angle picture and revised body portion shot Image set up the processing of association, therefore, it is possible to cause fish eye images and the given subject that was photographed in the fish eye images Corresponding relation is provided explicitly to user.

Because control unit 21 is implemented the following processing, i.e. to the wide angle picture (fish eye images) photographed by camera device 10 Distortion be modified, and the given subject (face of personage) included in the correction map picture is identified and pin The image (face-image) of its body portion shot is detected to each subject (personage), by the image of a part for correction map picture The processing associated is set up with the image (face-image) of each body portion shot detected, therefore, it is possible to be given with wide angle shot Subject obtained from wide angle picture be transformed to be easily observe that the form of given subject.For example, in display image, Compared with directly displaying the larger wide angle picture of distortion, if built image and the face-image of each personage after the distortion is corrected Vertical accordingly to be shown, then the form that can be transformed to be easy to observe wide angle picture is shown, for user, Easily its personage can be confirmed.

The image in the given range (cutting frame) of correction map picture is amplified display due to control unit 21, and make institute The image (face-image) of each body portion shot of detection carries out guide look and shown, therefore in reproduced picture, with display distortion compared with The entirety of big wide angle picture is compared, if display correction map picture a part, can be easy to observe wide angle picture shape State is shown.That is, for a user, the part of correction map picture arrived with wide angle shot can be reduced into come really Recognize subject, moreover, be able to confirm that with wide angle shot to image in all persons that are included, also repaiied including being not shown in Personage in a part for positive image.

By control unit 21 is when the image (face-image) for each body portion shot for making to be detected carries out guide look display, root According to putting in order for each subject (personage) on wide angle picture, sequentially arranged according to this and carry out guide look and show, therefore only seen The guide look for examining face-image shows and just can easily confirm wherein there be whose etc..

Because control unit 21 by user operates (slide) to make given range (cutting frame) arbitrarily mobile, and make root The image for cutting moving for frame according to this and cutting is amplified display, therefore for a user, can be easily from amendment By the image confirming of required part to its detail section in image.

Due to 21 pairs of control unit using multiple wide angle pictures for changing photography direction and photographing as the wide angle picture group of group in Comprising all given subjects (face of personage) be identified and detect its subject portion for each subject Point image (face-image), even if therefore be for example divided into front 180 ° photography and the photography of 180 ° of rear taken the photograph twice to implement 360 ° Shadow, is also capable of detecting when the face of all persons existing around it.

Because control unit 21 is from the wide angle picture group using multiple wide angle pictures for changing photography direction and photographing as group In specify the wide angle picture of display object in the case of, make the correction map picture of the wide angle picture specified and from wide angle picture group In the image (face of personage) of all body portions shot that detects set up and accordingly shown, therefore for user Speech, can show to observe the plurality of image by the switching of multiple images (correction map picture).

Because control unit 21 will operate any choosing from the wide angle picture group for changing photography direction and photographing by user The wide angle picture selected is appointed as showing object, therefore for a user, can be multiple from what is changed photography direction and photograph Amplification of the image to observe the image needed for any switching laws are appointed as in image (correction map picture) is shown.

Because control unit 21 is in the state of wide angle picture (fish eye images) is shown as thumbnail image by guide look, when logical When crossing user's operation and have selected arbitrary wide angle picture from the thumbnail image, make the correction map of the wide angle picture of the selection As being amplified display, and show image (face-image) the progress guide look of each body portion shot detected, thus it is right For user, required fish eye images can be arbitrarily selected from many fish eye images and are come pair with the form from being easy to The image is confirmed.

The image (face-image) of correction map picture and each body portion shot is set up due to control unit 21 and accordingly remembered Record is preserved, therefore without carrying out the distortion amendment of wide angle picture when implementing image regeneration every time or being cut from correction map picture The processing of face-image.

(variation 1)

Although in the above-described first embodiment, by from the one group of fish eye images group for changing photography direction and photographing Optional fish eye images are operated to be appointed as showing object by user, but it is also possible to every certain timing according to advance rule Fixed order selects each fish eye images and switches over display to its correction map picture successively one by one.Thus, user can be with given Each fish eye images of sequential observation (correction map picture).In such a case it is possible in 360 ° are photographed, to the fish eye images in display The personage included in the face-image and not shown fish eye images (correction map picture) of the personage included in (correction map picture) Face-image be identified and carry out guide look and show.Thereby, it is possible to easily confirm fish eye images (correction map picture) and people Corresponding relation between the face-image of thing.

(variation 2)

Although institute in the one group of fish eye images group in the above-described first embodiment, photographed to change photography direction Comprising all persons face-image carry out guide look show, but it is also possible to specific face-image is identified and shown. For example, it is also possible to determine the personage that a part for the correction map picture in amplification display is included, and only the face of the personage is schemed As display (for example, shown with color differentiation, amplify display) is identified.Thereby, it is possible to the correction map in amplification display The personage that the non-display portion in personage and correction map picture that a part for picture is included is included is identified and shown. This, by amplifying display come in the case of confirming to the personage that non-display portion is included, as long as make to cut frame shift it is dynamic To cut out the personage.

(variation 3)

Although in the above-described first embodiment, as fish eye lens 16B exemplified with circumference fish eye lens (complete cycle fish Glasses head), but it is also possible to use diagonal fish eye lens.In addition, although in the above-described embodiment, using a fish eye lens 16B and be divided into the photography of 180 ° of front and 360 ° of photographies are implemented in the photography of 180 ° of rear twice, but if possessing two fish eye lenses 16B, for example, possess fish eye lens respectively on the surface of camera framework and back side Liang Ge faces, then can be according to 360 ° of fingers photographed Show and photographed for 180 ° with rear while implementing the photography of 180 ° of front.In addition it is also possible to implement repeatedly to take the photograph using bugeye lens Shadow is photographed so as to implement 360 °.

(variation 4)

Although in the above-described first embodiment, the control unit 21 of agent set 20 is received to obtain and clapped by camera device 10 The processing that the fish eye images and implementation taken the photograph are modified to the overall distortion of the image, and wrapped in the correction map picture The given subject contained is identified and is directed to after the image that each subject detects its body portion shot, and implementing will The image of a part for correction map picture sets up the processing associated with the image of each body portion shot detected, but be not restricted to that This, the control unit 21 of agent set 20 can also be when receiving the fish eye images for obtaining and being photographed by camera device 10, not to fish The distortion of eye pattern picture is modified, but every being identified and being directed to given subject included in the fish eye images The individual subject detected after the image of its body portion shot, is implemented the image of a part for fish eye images and is detected The image of each body portion shot sets up the processing of association.

In this case, by the image of each body portion shot detected still remains distortion, thus can to Fixed timing, such as while processing for the foundation association stated on the implementation or the timing before and after it or for everyone Thing and timing while cut body portion shot or before and after it etc., distortion amendment is implemented to the image of each body portion shot.Make Closed for the image of the image of a part for the fish eye images of so direct residual distortion and revised body portion shot is set up The processing of connection, if for example, implement to make the image of a part of fish eye images be shown in regeneration picture, and make revised quilt The image guide look for taking the photograph body portion is shown in the processing of regeneration picture, then identical with above-mentioned embodiment, enables to fish-eye image As with being provided explicitly to user by the corresponding relation between the given subject that photographed in the fish eye images.

(variation 5)

Although in the above-described first embodiment, it is shown that being set up from the fish eye images with being selected as regenerating object The image in given range cut in the correction map picture for accordingly recording preservation, but this is not limited to, quilt can also be shown Select for regenerate object fish eye images in itself.That is, can also make what is remained the fish eye images of distortion and detected The image (face-image) of each body portion shot carries out guide look and shown.In this case, it is also identical with above-mentioned embodiment, energy Enough so that fish eye images and being provided explicitly to use by the corresponding relation between the given subject that photographed in the fish eye images Family.

(variation 6)

Although in the above-described first embodiment, from using multiple wide angle pictures for changing photography direction and photographing as In the case of the wide angle picture for specifying display object being operated in the wide angle picture group of group by user, the wide-angle figure that this is specified Image (face of personage) foundation of all shot body portions of the correction map picture of picture with being detected from wide angle picture group is corresponding Ground is shown, but it is also possible to operating the situation for the wide angle picture for specifying display object by user from wide angle picture group Under, the wide angle picture (image for remaining distortion) that this is specified and all body portions shot detected from wide angle picture group Image (face of personage) set up accordingly shown.For user, multiple wide angle pictures can be passed through Switching shows to observe multiple wide angle pictures.

In addition, though in the above-described first embodiment, employing makes in the given range (cutting frame) of correction map picture Image is amplified display, and the image (face-image) of each body portion shot detected is carried out the structure of guide look display Into but this being not limited to, it is also possible that being recorded to set up corresponding mode with being selected as regenerating the fish eye images of object The image (face-image) of the entirety of the correction map picture of preservation and each body portion shot detected carries out guide look and shown.

Although in the above-described first embodiment, by the face-image foundation pair of fish eye images, correction map picture, each personage Should ground carry out record preservation, but it is also possible to by fish eye images, correction map picture, each personage face-image via such as SD card, USB The detachable movable-type memory (recording medium) or communication unit of memory etc. and export to outside, and set by outside Standby set up correction map picture and the face-image of each personage is accordingly shown.

Although the one of the correction map picture that in the above-described first embodiment, the distortion to fish eye images is corrected Partly (image for cutting inframe) amplifies and is shown in regeneration picture, but it is also possible to which the entirety of correction map picture is shown in into regeneration picture Face.

Although in the above-described first embodiment, being divided into the photography of 180 ° of front and the photography of 180 ° of rear being implemented twice 360 ° are photographed and multiple fish eye images are set into group, but are not limited to using the fish eye lens 16B scopes shot 180 ° of photographies, are arbitrary.Furthermore, it is to be understood that being not limited in 360 ° of photographies, the photographs photographed in the range of 180 ° Also it can apply.

Although in the above-described embodiment, when carrying out double click operation on any face-image, control unit 21 is from amendment Detection includes the position of the face-image in image, and frames shift dynamic (redirecting) to the test position by making to cut, and thus makes again The face-image is included in the image (image for cutting inframe) of amplification display on raw picture, still, in addition, can be with By being operated in the enterprising line slip of any face-image, it is hereby based on its slippage and makes the figure that is shown as any face-image As changing.That is, it would however also be possible to employ following to constitute, i.e. make correction map picture according to its slippage includes this The position movement of meaning face-image, so as to be shown instead of any face-image on the position of its movement target of correction map picture Image.In this case, when replacing any face-image and progress double click operation on shown mobile target image, Control unit 21 detects the position for including the movement target image from correction map picture, and is moved to the detecting position by making to cut frame Put, the movement target image is included in the image for thus making the amplification display on regeneration picture.

(the 2nd embodiment)

Hereinafter, reference picture 10 and Figure 11 illustrate come the 2nd embodiment to the present invention.

In addition, though in the above-described first embodiment, in the feelings regenerated to fish eye images (preservation finishes image) Under condition, it is shown in by multiple fish eye images in the state of thumbnail list screen, when touching any thumbnail figure therefrom During the display location of picture, the image for switching the part that display establishes corresponding correction map picture with the fish eye images (is cut The image of inframe), still, in the 2nd embodiment, when fish eye images (thumbnail image) are touched, it is switched display For the list screen for the face-image that corresponding each personage is established with the fish eye images.

And, although in the 1st embodiment, when with correction map as together with shown in face-image touched when, with such as Under type is controlled, i.e. detection includes the position of the face-image from correction map picture, and is moved to this by making to cut frame Include the face-image in the position detected, the image for thus making to cut inframe, still, in the 2nd embodiment, when from When touching any face-image in the list screen of face-image, switching is shown as and the fish eye images comprising the face-image (fish eye images selected from thumbnail list screen) establish corresponding correction map picture.Here, to two embodiment party Mark identical symbol in essentially identical or title identical part in formula, and the description thereof will be omitted, also, hereinafter, with the 2nd Illustrated centered on the characteristic of embodiment.

Action during photography in the 2nd embodiment is identical with the 1st above-mentioned embodiment, to taken fish Eye pattern picture is carried out in the case that development treatment and being recorded is stored in the recording medium of storage part 23, for the fish eye images And implement the processing of amendment distortion and generate its correction map picture, and the correction map picture is set up accordingly to enter with the fish eye images Row record is preserved.Moreover, the face of each personage to being included in the correction map picture is detected, cut for each personage Its facial parts simultaneously generates face-image (image that amendment is finished), and sets up accordingly progress record guarantor with the fish eye images Deposit.

First, when being operated by user and indicate regeneration fish eye images (preservation finishes image), control unit 21 reads and deposited The multiple fish eye images (preservation finishes image) (step C1) preserved recorded in the recording medium in storage portion 23, by the fish eye images It is transformed to thumbnail image and is allowed to carry out guide look to show (step C2).Figure 11 (1) represents the thumbnail guide look picture of fish eye images Face, in figure, is configured to 3 × 3 rectangular circular thumbnail images for representing fish eye images.Figure 11 (2) is by the thumbnail The figure that a part for list screen is amplified and shown.

In the state of this thumbnail list screen is shown, check whether and the display location of any thumbnail image is entered Given touch operation (for example, double click operation) (step C3) is gone.Currently, if carrying out continuous two not on thumbnail image The double click operation of secondary percussion is (in step C3："No"), then step C9 is transferred to, but ought be double-clicked on thumbnail image During operation (in step C3："Yes"), read each personage that preservation is accordingly recorded with being set up by the fish eye images of double click operation Face-image (image that amendment is finished) (step C4), each face-image be amplified and be allowed to switching be shown in regeneration picture Face (step C5).Figure 11 (3) represents the picture for having carried out having a guide look of display to the face-image of each personage, for example, be cut into rectangle Face-image carries out configuration for example to be put in order with the 1st above-mentioned embodiment identical and shown.

In the state of the list screen of face-image is shown in this way, check whether and any face-image is shown Show the touch operation (for example, double click operation) (step C6) that position is given.Currently, if carried out not on face-image Double click operation is (in step C6："No"), then step C9 is transferred to, but when having carried out double click operation (in step C6： "Yes"), read with (being walked comprising the correction map picture that preservation is accordingly recorded by the fish eye images foundation of the face-image of double click operation Rapid C7), and switch display (whole face is shown) for the correction map picture (step C8).

Although in this case, being determined as the fish eye images comprising the face-image specified by touch in thumbnail one Look on picture the fish eye images selected, and read that to establish corresponding correction map picture with the fish eye images aobvious to switch over Show, still, now, the image cut out from correction map picture centered on the face-image is amplified and display is switched over (whole face is shown) so that the face-image specified by touch is centrally located.Figure 11 (4) is to be illustrated in as shown in Figure 11 (3) In the case of the face-image for having double-clicked girl, corresponding correction map will be established with the fish eye images comprising the face-image A figure when part for picture cuts out and is amplified display, and the enlarged drawing for switching display centered on the face of girl The situation of picture.

Figure 11 (5) is the figure illustrated for pair another display different from Figure 11 (4) display example example.Although in figure In the case of 11 (4), determined as the fish eye images comprising the face-image specified by touch in thumbnail list screen Fish eye images of selection, but in Figure 11 (5), then to determine another fish for including the face-image beyond the fish eye images Eye pattern picture, and cut part thereof of image from corresponding correction map picture is established with the fish eye images and be amplified display Situation.In this case, also the image cut out from correction map picture centered on its face-image is amplified and is allowed to Display (whole face is shown) is switched over, it is centrally located to be touched the face-image specified.

In addition, though as the fish eye images for including the face-image specified by touch, it is preferential to determine in thumbnail guide look The fish eye images selected on picture, but it is also possible to by user operate and preset be preferentially determine the fish eye images or Which fish eye images in another fish eye images comprising the face-image specified by touch beyond person's fish eye images.This Outside, as the fish eye images for including the face-image specified by touch, it can also be switched by user's operation or certain Automatically switch the fish eye images and another fish eye images after time.If moreover, saving multiple another fish eye images, also may be used It is corresponding to determine multiple fish eye images successively by handover operation, and read to establish with the fish eye images that this is determined Correction map picture simultaneously is allowed to switch over display.

In the state of switching in this way shows correction map picture, check whether that implementing return indicates operation (step C9), indicate operation (in step C9 if being not carried out returning："No"), then check whether and implement other instruction operation (steps Rapid C10).Here, implementing in the case that other indicate operation (for example, indicating the operation of picture editting) (in step C10 In："Yes"), the processing corresponding with other instructions is transferred to, and returned implementing in the case that instruction is operated (in step C9 In："Yes"), return to above-mentioned step C3.

As so above, due in the 2nd embodiment, being shown wide angle picture is carried out into guide look as thumbnail image In the state of, when being operated therefrom by user and have selected arbitrary wide angle picture, to what is included in the wide angle picture The image of given body portion shot carries out guide look and shown, even if therefore wide angle picture that image integrally distorts with the shape of former state State carries out thumbnail and shows that user also easily can visually be confirmed to its subject.That is, due to wide-angle figure The overall distortion of the image of picture (fish eye images) is larger, therefore is also difficult to grasp exactly to photograph even if its thumbnail image is observed Who, moreover, being amplified display while by user's operation to specify arbitrary thumbnail image to confirm to photograph one by one Face in the image, both took time and energy, and can bring burden to user again, still, have selected arbitrary thumbnail image (flake Image) in the case of, by the face-image of each personage included in the fish eye images can be shown by guide look, thus for For family, the figure with telepresenc can be watched while the photography overall situation is grasped by the fish eye images that thumbnail is shown Picture, and easily visually can confirm whom is photographed according to the face-image of personage.

It is additionally, since in the state of above-mentioned face-image is by guide look display, is selected therefrom when by user's operation When having selected arbitrary face-image, it is shown that the corrected correction map of the distortion for the wide angle picture that the face-image is included Picture, therefore for a user, undistorted large-scale image can be observed.

In addition, though in the above-described 2nd embodiment, implement what the distortions of the fish eye images to photographing was modified Handle and generate correction map picture, and generate the face-image of each personage cut out from the correction map picture, and and fish-eye image Record preservation accordingly is carried out to correction map picture and the face-image of each personage as setting up, and in the regeneration of each fish eye images When, reading establishes the face-image of corresponding each personage with fish eye images and carries out guide look and shows, still, correction map picture and The face-image of each personage can also be generated in the regeneration of fish eye images.That is, can also fish eye images breviary When figure is shown, after implementing to correct the processing of its distortion for optional fish eye images and generating correction map picture, generation The face-image of each personage cut out from the correction map picture.In addition, being cut after being not limited to generation correction map picture each The situation of the facial parts of personage, can also by cutting the face-image of each personage from fish eye images and correcting its distortion, So as to generate face-image.

Fish eye images are carried out with the situation that thumbnail is shown although in the above-described 2nd embodiment, illustrating, also may be used Shown so that will the fish eye images have modified with the progress thumbnail of the correction map picture after its distortion.Pass through even in this case, working as User operates and when have selected thumbnail image (correction map picture), will also be switched to guide look and show each one that included in the image It is at this point, identical with the 2nd embodiment on the picture of the face-image of thing.

In addition, in the above-described 2nd embodiment, the photography of 180 ° of front can be divided into and the photography of 180 ° of rear comes real twice Apply 360 ° to photograph and the plurality of fish eye images are set into group, 360 ° of photographies are not limited to certainly, can also be applied in 180 ° of models In the photographs that (180 ° of photographies) is photographed in enclosing.

Although in the above-described embodiment, when carrying out double click operation on any face-image, control unit 21 is from repairing Detection includes the position of the face-image in positive image, and frames shift dynamic (redirecting) to the test position by making to cut, and thus makes The face-image is included in the image (image for cutting inframe) for regenerating the amplification display on picture, but in addition, can be with By being operated in the enterprising line slip of any face-image, so as to make what is be shown as any face-image according to its slippage Image changes.That is, it would however also be possible to employ following to constitute, i.e. make correction map picture according to its slippage includes this The position movement of any face-image, so as to be shown instead of any face-image on the position of its movement target of correction map picture Image.In this case, when replacing any face-image and progress double click operation on shown mobile target image, Control unit 21 detects the position that target image is moved comprising its from correction map picture, and is moved to its detecting position by making to cut frame Put, the movement target image is included in the image for thus making the amplification display on regeneration picture.

(the 3rd embodiment)

Hereinafter, 12~Figure 14 of reference picture illustrates come the 3rd embodiment to the present invention.

In the 3rd embodiment, when multiple fish eye images are transformed into thumbnail image and guide look display is carried out, meeting The face-image of each personage of preservation corresponding with the fish eye images is carried out into guide look in the vicinity of each thumbnail image to show. That is, show the face-image of each personage associated with the image in the lump at the periphery of thumbnail image.Here, to two Mark identical symbol in essentially identical or title identical part in individual embodiment, and the description thereof will be omitted, also, below In, illustrated centered on the characteristic of the 3rd embodiment.In addition, in the 3rd embodiment, for example, such as Fig. 4 (1) fish eye images when to 180 ° of front vertically shoot like that shown in and as shown in Fig. 4 (2) to rear 180 ° carry out Fish eye images during vertical shooting, i.e. be divided into the photography of 180 ° of front and the photography of 180 ° of rear is photographed (360 ° of photographies) and obtained twice To two fish eye images also serve as one group of image and carry out record preservation.

First, when being operated by user and indicate regeneration fish eye images, control unit 21 reads and is recorded the multiple of preservation Fish eye images (step D1), and the fish eye images are transformed to thumbnail image and are allowed to carry out guide look to show (step D2).So Afterwards, the face-image (step that each personage for accordingly recording preservation is set up with each fish eye images is read for each fish eye images Rapid D3), and cause each face-image (step corresponding to vicinity (periphery) the configuration display in the fish eye images (thumbnail image) Rapid D4).

Figure 13 (1) in figure, is configured as 3 to represent the figure of an example of the thumbnail list screen of fish eye images × 3 rectangular circular thumbnail images for representing fish eye images, are configured in the periphery of the fish eye images (thumbnail image) The roundlet (ellipse) of the lengthwise at place represents the face-image of each personage corresponding with the fish eye images.Figure 13 (2) is to be exaggerated this The figure of a part for thumbnail list screen, and diagram example represent to be not 360 ° photography situations, i.e. implement 180 ° Fish eye images during photography carry out the face-image one of each personage included in the state that thumbnail is shown, and the fish eye images Look at the periphery for being shown in the thumbnail image.

Figure 14 (1) is the figure of other examples of the thumbnail list screen for representing fish eye images, in figure, fish eye images A Fish eye images when representing vertically to shoot the progress of 180 ° of front as shown in Fig. 4 (1), fish eye images B is represented such as Fig. 4 (2) Shown fish eye images when to 180 ° of rear vertically shoot like that.It is being divided into the photography of 180 ° of front and rear in this way In the case of one group of fish eye images obtained from 180 ° of photographies photography twice (360 ° of photographies), in the week of its each thumbnail image Side, in addition to configuration shows the face-image of personage included in the fish eye images of oneself, also configure show it is groups of The face-image of the personage included in another fish eye images.

Figure 14 (2) is the figure for being amplified a part for the thumbnail list screen to represent, and represents fish eye images A Thumbnail show.In this case, on the periphery of the thumbnail image, except guide look shows what is photographed in fish eye images A Outside the face-image of mother and daughter, also the face of the mothers and sons with being photographed in the groups of another fish eye images B of fish eye images A is schemed Shown as also carrying out guide look in the lump.In addition, situation about being shown to fish eye images B progress thumbnails is also identical, although save Diagram has been omited, but on the periphery of the thumbnail image, except guide look shows the face-image of the mothers and sons photographed in fish eye images B Outside, the face-image of the mother and daughter with being photographed in the groups of another fish eye images A of fish eye images B is still carried out one in the lump Look at display.

In addition, in the case where face-image configuration is shown in into the periphery of thumbnail image, such as Figure 13 (2), Figure 14 (2) It is shown such, adjust the size of each face-image and equally spaced balance and configured excellently.Showing the thumbnail one Look in the state of picture, check whether the display location of the face-image in the list screen is touched (double-click) (step D5). Currently, if not double-clicking the display location of face-image (in step D5："No"), then step D8 is transferred to, and when double-click When (in step D5："Yes"), corresponding fish eye images are determined from the face-image double-clicked, are read and the fish eye images The correction map picture (step D6) for accordingly recording preservation is set up, and correction map picture switching is shown in thumbnail list screen (step D7).In this case, it is also identical with the 2nd above-mentioned embodiment, to the fish selected in thumbnail list screen Another fish eye images comprising the face-image specified by touch beyond eye pattern picture or the fish eye images are determined, and are read Go out and establish corresponding correction map picture with the fish eye images that this is determined and be allowed to switch over display.

Figure 13 (3) is represented when having double-clicked the face-image of child as shown in Figure 13 (2) so that include face figure As situation of the correction map as shown in being amplified.Figure 14 (3) similarly represents to cause the face figure comprising the child double-clicked As situation of the correction map as shown in being amplified, still, in the case of Figure 13 (3), it is shown that being shown by thumbnail The correction map picture of image, and in the case of Figure 14 (3), it is shown that with the groups of image B's of image A that are shown by thumbnail Correction map picture.

In the state of switching in this way shows correction map picture, check whether that implementing return indicates operation (step D8), indicate operation (in step D8 if being not carried out returning："No"), then check whether that implementing other indicates operation (step D9).Here, implementing in the case that other indicate operation (for example, indicating the operation of picture editting) (in step D9： "Yes"), the processing corresponding with other instructions is transferred to, and returned implementing in the case that instruction is operated (in step D8： "Yes"), above-mentioned step D2 is returned to, and show thumbnail list screen.

As so above, due in the 3rd embodiment, wide angle picture being carried out into guide look as thumbnail image and shown, And the image that the body portion shot of generation will be cut from wide angle picture is entered with setting up corresponding mode with the thumbnail image Row display, even if therefore wide angle picture that image integrally distorts thumbnail is carried out with original state and shows that user also can Easily its subject is visually confirmed.

Further, since in wide angle picture group of the multiple wide angle pictures for making to be changed photography direction and photographing for group Any one wide angle picture carry out in the case that thumbnail shows, control unit 21 makes all quilts included in the wide angle picture group The image and thumbnail image for taking the photograph body portion are set up and accordingly shown, therefore for a user, only to wide angle picture group In any one wide angle picture thumbnail display confirmed, it becomes possible to confirm all quilts included in the wide angle picture group Take the photograph the image of body portion.For example, implementing 360 ° of situations about photographing being divided into the photography of 180 ° of front and the photography of 180 ° of rear twice Under, for the thumbnail image (fish eye images) of the 180 ° of photographies in the front, showing the personage's included in the fish eye images While face-image, the face-image of the personage included in the fish eye images of the 180 ° of photographies in rear is also together illustrated, because Even if this thumbnail display not to the fish eye images of the 180 ° of photographies in rear confirms, institute in the fish eye images is also able to confirm that Comprising personage face-image.

In addition, though in the above-described 3rd embodiment, implementing the distortion to taken fish eye images and being modified Processing and generate correction map picture, and generate the face-image of each personage cut from the correction map picture, and and fish-eye image Record preservation accordingly is carried out to correction map picture and the face-image of each personage as setting up, and in the thumbnail of each fish eye images During display, reading establishes the face-image of corresponding each personage with fish eye images and carries out guide look and shows, and from the guide look In the case of specifying arbitrary face-image by user among display, read the correction map picture comprising the face-image and carry out It has been shown that, still, the face-image of correction map picture and each personage can also be generated in the thumbnail display of fish eye images.Also It is to say, processing and generation that the distortion to fish eye images is modified can also be implemented in the thumbnail display of fish eye images Correction map picture, and generate the face-image of each personage cut from the correction map picture.In addition, being not limited to generation amendment The situation of the facial parts of each personage is cut after image from the correction map picture, each personage can also be cut from fish eye images Face-image and correct its distortion, thus generate face-image.

Although in the above-described 3rd embodiment, being divided into the photography of 180 ° of front and rear using a fish eye lens 16B 360 ° of photographies are implemented in 180 ° of photographies twice, still, if possessing two fish eye lens 16B, such as surface in camera framework Possess fish eye lens respectively with back side Liang Ge faces, then can according to 360 ° photography instructions and implement simultaneously front 180 ° photography and The photography of 180 ° of rear.In addition it is also possible to implement repeatedly photography using bugeye lens to implement 360 ° of photographies.

Although in the above-described embodiment, when carrying out double click operation on any face-image, control unit 21 is from amendment Detection includes the position of the face-image in image, and frames shift dynamic (redirecting) to the test position by making to cut, and thus makes again The face-image is included in the image (image for cutting inframe) of amplification display on raw picture, still, in addition, can be with By being operated in the enterprising line slip of any face-image, so as to make the figure for being shown as any face-image based on its slippage As changing.That is, it would however also be possible to employ following to constitute, i.e. make correction map picture according to its slippage includes this The position movement of meaning face-image, so as to be shown instead of any face-image on the position of its movement target of correction map picture Image.In this case, when replacing any face-image and progress double click operation on shown mobile target image, Control unit 21 detects the position for including the movement target image from correction map picture, and is moved to the detecting position by making to cut frame Put, the movement target image is included in the image for thus making the amplification display on regeneration picture.

Although in above-mentioned each embodiment, showing the feelings that digital camera is applied to as image processing apparatus Condition, but this is not limited to, it for example can also be personal computer, PDA (towards personal portable information communication equipment), put down The pocket telephones such as template terminal installation, smart mobile phone, electronic game machine, music player etc..

In addition, " device " or " portion " that is represented in above-mentioned each embodiment, can be separated into many by function difference Individual framework, is not limited to single framework.In addition, each step described in above-mentioned flow chart is not limited to time series On processing, can also the multiple steps of parallel processing, or single independently handled.

In addition, although in above-mentioned each embodiment, fish eye images or wide angle picture are shown as thumbnail image, But such as the image that can also be corrected the distortion to fish eye images, the given range of wide angle picture, with these fishes Eye pattern picture, wide angle picture establish corresponding image as thumbnail image to show.

Although embodiments of the present invention are illustrated above, the present invention is not defined to this, in addition to will Ask described invention and its equivalent scope in the scope of protection.

Claims

1. a kind of image processing apparatus, it is characterised in that possess：

Detection unit, to wide angle shot to wide angle picture in the given subject that is included be identified, and to its quilt The image for taking the photograph body portion is detected；

Amending unit, the distortion to the image of the body portion shot is modified；With

Processing unit, implements the subject portion after being corrected at least one of image of the wide angle picture and distortion The image divided sets up the processing of association.

2. image processing apparatus according to claim 1, it is characterised in that

Distortion of the amending unit also to the wide angle picture is modified,

At least one of image that the processing unit implements the wide angle picture after distortion is corrected is repaiied with distortion The image of the body portion shot after just sets up the processing of association.

3. image processing apparatus according to claim 1, it is characterised in that

The processing unit is implemented after being corrected at least one of image of the wide angle picture with distortion and distortion The body portion shot image set up association processing.

4. image processing apparatus according to claim 1, it is characterised in that

Described image processing unit is also equipped with display unit,

The processing unit will be lost by making at least one of image of the wide angle picture be shown in the display unit It is true be corrected after the image of the body portion shot be shown in the display unit, thus implement the place for setting up association Reason.

5. image processing apparatus according to claim 4, it is characterised in that

The processing unit by the way that at least one of image of the wide angle picture and distortion are corrected after it is described shot The image of body portion is shown in the display unit simultaneously, thus implements the processing for setting up association.

6. image processing apparatus according to claim 4, it is characterised in that

Described image processing unit is also equipped with：Acquiring unit, the image obtained in given range is used as the wide angle picture A part,

It is single that the processing unit is shown in the display by the image in the given range that makes to be got by the acquiring unit Member, and make distortion be corrected after the image of the body portion shot be shown in the display unit, thus implement described build The processing of vertical association.

7. image processing apparatus according to claim 4, it is characterised in that

The detection unit to wide angle shot to wide angle picture in the given subject that is included be identified, and to it The image of body portion shot detected,

The processing unit is shown in the display unit by making at least one of image of the wide angle picture, and make by The image guide look of body portion shot that the detection unit is detected is shown in the display unit, thus implements the foundation The processing of association.

8. image processing apparatus according to claim 7, it is characterised in that

Described image processing unit is also equipped with：Second selecting unit, is shown in by guide look in the image of the body portion shot State in the state of display unit, operate and selected from the body portion shot the image of arbitrary body portion shot according to user,

The processing unit when selecting the image of arbitrary shot body portion by second selecting unit, by will with by At least one of image for the corresponding wide angle picture of the body portion shot that second selecting unit is selected shows Be shown in the display unit, thus come implement it is described set up association processing.

9. image processing apparatus according to claim 8, it is characterised in that

The amending unit is also to described in including the image comprising the body portion shot selected as second selecting unit The distortion of the given range of wide angle picture is modified,

The processing unit is when being selected the image of arbitrary shot body portion by second selecting unit, by will be by institute The correction map picture for stating the wide angle picture of the revised given range of amending unit is shown in the display unit, thus to implement State the processing for setting up association.

10. the image processing apparatus according to any one of claim 7 to 9, it is characterised in that

The processing unit is by switching the display of the display unit so that the image from the body portion shot is aobvious by guide look The state shown is changed into the state that at least one of image of the wide angle picture is shown, and is thus associated to implement described set up Processing.

11. image processing apparatus according to claim 8 or claim 9, it is characterised in that

The processing unit is by switching the display of the display unit so that the image from the body portion shot is aobvious by guide look The state for being shown in the display unit is changed into institute corresponding with the body portion shot selected by second selecting unit At least one of image for stating wide angle picture is shown in the state of the display unit, is thus associated to implement described set up Processing.

12. image processing apparatus according to claim 7, it is characterised in that

The detection unit to wide angle shot to wide angle picture in multiple given subjects for being included be identified, and The image of its body portion shot is detected for each subject,

The processing unit is shown in described aobvious in the image guide look for each body portion shot for making to be detected by the detection unit When showing unit, arranged according to each putting in order for subject on the wide angle picture according to the order aobvious to have a guide look of Show.

13. image processing apparatus according to claim 6, it is characterised in that

Described image processing unit is also equipped with：Mobile indicating member, is operated by user and the given range is arbitrarily moved,

The acquiring unit obtains the image in the given range moved by the mobile indicating member.

14. image processing apparatus according to claim 4, it is characterised in that

Described image processing unit is also equipped with：First choice unit, in the wide angle picture or corresponding with the wide angle picture Correspondence image is had a guide look of as thumbnail image and is shown in the state of the display unit, by user's operation from the breviary Arbitrary wide angle picture or correspondence image are selected in figure image,

The detection unit is given to what is included in the wide angle picture or correspondence image that are gone out by the first choice Unit selection Subject be identified, and image of its body portion shot is detected,

The processing unit, will be by described when going out arbitrary wide angle picture or correspondence image by the first choice Unit selection Detection unit detects and is shown in the display unit by the image guide look of the revised body portion shot of the amending unit.

15. image processing apparatus according to claim 4, it is characterised in that

Described image processing unit is also equipped with：First choice unit, in the wide angle picture or corresponding with the wide angle picture Correspondence image, by the state of guide look display, is operated and the selection times from the thumbnail image as thumbnail image by user The wide angle picture or correspondence image of meaning,

The processing unit by the first choice Unit selection when going out arbitrary wide angle picture or correspondence image, by making this Wide angle picture or corresponding wide angle picture be corrected with distortion after the body portion shot image while being shown in described show Show unit, thus come implement it is described set up association processing.

16. image processing apparatus according to claim 4, it is characterised in that

The detection unit to using multiple wide angle pictures for changing photography direction and photographing by the wide angle picture group of group in wrapped All given subjects contained are identified, and detect its image for being shot body portion for each subject,

Any one wide angle picture of the processing unit in the wide angle picture group has been carried out in the case that thumbnail is shown, By make to be detected by the detection unit and included in the revised wide angle picture group of the amending unit it is all The image of body portion shot is accordingly shown with having been carried out the wide angle picture foundation that thumbnail shows.

17. image processing apparatus according to claim 1, it is characterised in that

The detection unit to using multiple wide angle pictures for changing photography direction and photographing by the wide angle picture group of group in wrapped All given subjects contained are identified, and detect its image for being shot body portion for each subject.

18. image processing apparatus according to claim 17, it is characterised in that

Described image processing unit is also equipped with：Designating unit, from using multiple wide angle pictures for changing photography direction and photographing as A wide angle picture is specified in the wide angle picture group of group,

The processing unit implement the wide angle picture that will be specified out by the designating unit with by the detection unit from wide-angle figure As the image of all body portions shot detected in group sets up the processing of association.

19. image processing apparatus according to claim 1, it is characterised in that

The processing unit implements the figure by the wide angle picture and the body portion shot detected by the detection unit The processing of record preservation is accordingly carried out as setting up.

20. image processing apparatus according to claim 1, it is characterised in that

The wide angle picture is the fish eye images photographed using fish eye lens.

21. a kind of image processing method, is the image processing method in image processing apparatus, it is characterised in that

Described image processing method includes：

To with wide angle shot to wide angle picture in the given subject that is included be identified, and to its body portion shot The processing that image is detected；

The processing that distortion to the image of the body portion shot detected is modified；With

By at least one of image of the wide angle picture be corrected after the body portion shot image set up associate Processing.

22. a kind of storage medium of embodied on computer readable, has program stored therein, it is characterised in that

Described program is used to implement function such as the computer of image processing apparatus：

To with wide angle shot to wide angle picture in the given subject that is included be identified, and to its body portion shot The function that image is detected；

The function that distortion to the image of the body portion shot detected is modified；With

By at least one of image of the wide angle picture be corrected after the body portion shot image set up associate Function.