JP2006101173A - Imaging device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging device and a program, wherein a user is capable of imaging the image of an object easily and surely. <P>SOLUTION: In an imaging system, the planning images and text information (process name etc) of each working process of the construction are stored in the recording unit 27 of a digital camera 20a. When a shutter switch is pushed down to start imaging, the photoed images and the planning images are collated with each other to calculate a concurrence rate. When it is judged that the concurrent rate is higher than a prescribed threshold, the planning images and text information of the working process to image next are displayed, and a guidance is provided on imaging. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a photographing apparatus having a function of collating a reference image stored in advance with a photographed image and assisting photographing based on the collation result, and a program thereof.

  2. Description of the Related Art Conventionally, photographing apparatuses having various photographing auxiliary functions are known.

  For example, when shooting a series of work processes to be photographed, such as taking a construction photograph, the type of each process in the series of work processes is stored in the imaging device in order so that all the work processes to be photographed can be taken. In addition, a technique is known that guides and displays on a character basis the type of work process to be photographed next after photographing (see, for example, Patent Document 1).

In person photography, various techniques have been developed to assist in taking pictures of proper composition and poses easily. For example, a technique for displaying a pose to be taken by a subject on a light-transmitting flat member and supporting it on the optical axis of the finder so that a photographer can see the subject superimposed on the subject (for example, Patent Document 2), and a technique for displaying a guide pattern with an appropriate composition on a display monitor of a liquid crystal finder is known (for example, see Patent Documents 3 and 4).
JP 2004-096438 A JP-A-11-352556 JP 2002-290780 A JP 2002-232753 A

  However, when shooting a series of work processes of construction or shooting scenes in an event in time order, the type of shooting target to be shot next is displayed in text for guidance. However, if the photographer does not know the object to be photographed next, it is necessary to recognize the object to be photographed next, and there is a problem that photographing cannot be performed easily. In addition, when the photographer has mistakenly recognized the shooting target, there is a problem that the target to be shot is not shot.

  Also, in human photography, in the conventional technique, the photographer compares the guide pattern superimposed on the subject image with the subject image by eye, but the subject to be actually photographed and the guide pattern are different. It was difficult to match exactly and it was not easy for the photographer to judge the photo opportunity. In addition, since a human compares the guide pattern with the subject image, it has not been possible to automate shooting when the subject is in a favorable state.

  An object of the present invention is to make it possible to easily and reliably take a photograph intended by a photographer.

In order to solve the above-mentioned problem, the invention described in claim 1
Storage means for storing a reference image as a reference for shooting in order of shooting;
Imaging means for converting an optical image of a subject into an electrical signal to obtain a digital image;
Image collating means for collating the digital image acquired by the imaging means with the reference image according to the photographing order to calculate a matching rate;
A display unit that reads out and guides a reference image serving as a reference for the next shooting from the storage unit when it is determined that the coincidence rate calculated by the image matching unit exceeds a predetermined threshold;
It is characterized by having.

The invention according to claim 4
Storage means for storing a reference image as a reference for photographing;
Imaging means for converting an optical image of a subject into an electrical signal to obtain a digital image;
Image collating means for collating the digital image acquired by the imaging means with the reference image and calculating a matching rate;
Display means for displaying the matching rate calculated by the image matching means;
It is characterized by having.

The invention described in claim 5
Storage means for storing a reference image as a reference for photographing;
Imaging means for converting an optical image of a subject into an electrical signal to obtain a digital image;
Image collating means for collating the digital image acquired by the imaging means with the reference image and calculating a matching rate;
Photographing control means for photographing when it is determined that the matching rate calculated by the image collating means exceeds a predetermined threshold;
It is characterized by having.

The invention according to claim 10 is:
On the computer,
A function of storing a reference image serving as a reference for shooting in a storage unit in the order of shooting;
A function of calculating a coincidence rate by comparing a digital image obtained by converting an optical image of a subject into an electrical signal with the reference image according to the shooting order;
A function of reading a reference image serving as a reference for the next shooting from the storage unit and displaying guidance when it is determined that the calculated matching rate exceeds a predetermined threshold;
It is characterized by being a program for realizing.

The invention according to claim 11
On the computer,
A function for storing a reference image as a reference for shooting;
A function of collating a digital image obtained by converting an optical image of a subject into an electrical signal with the reference image and calculating a matching rate;
A function of displaying the calculated match rate;
It is characterized by being a program for realizing.

The invention according to claim 12
On the computer,
A function for storing a reference image as a reference for shooting;
A function of collating a digital image obtained by converting an optical image of a subject into an electrical signal with the reference image and calculating a matching rate;
A function of shooting when it is determined that the calculated matching rate exceeds a predetermined threshold;
It is characterized by being a program for realizing.

  According to the first and tenth aspects of the present invention, a reference image serving as a reference for shooting is stored in the storage means in the order of shooting, and a digital image obtained by converting an optical image of the subject into an electrical signal is stored in the order of shooting. The matching rate is calculated by collating with the corresponding reference image, and when it is determined that the matching rate exceeds a predetermined threshold value, the reference image serving as a reference for the next photographing is read out from the storage means and displayed as a guide. Accordingly, the reference image for the next shooting is guided and displayed, so that shooting efficiency when the photographer performs shooting can be improved, and the target photo can be easily and reliably shot according to the shooting order. .

  According to the second aspect of the present invention, it is possible to easily and reliably photograph each process in a series of photographing plans in the order of photographing.

  According to the third aspect of the present invention, since the reference image that is the reference for the next shooting is displayed along with the character information related to the reference image, the photographer can easily recognize the shooting target to be shot and more easily. A target image can be reliably captured.

  According to the fourth and eleventh aspects of the present invention, the digital image obtained by converting the optical image of the subject into an electric signal is collated with the reference image, the coincidence rate is calculated, and the calculated coincidence rate is displayed. Therefore, it is possible to show the photographer how close the subject is to the reference image. Therefore, the photographer can easily determine the shutter chance and can easily and reliably capture the target image.

According to the fifth and twelfth aspects of the present invention, the digital image obtained by converting the optical image of the subject into an electrical signal is collated with the reference image to calculate the coincidence rate, and the calculated coincidence rate is predetermined. Since it automatically shoots when it is determined that the threshold is exceeded, it can shoot without missing a photo opportunity when the subject is close to the reference image, and the target image can be easily You will be able to shoot reliably.
An imaging apparatus comprising:

  According to the sixth aspect of the present invention, it is possible to take a picture when the subject is close to the pose to be taken.

  According to the seventh aspect of the present invention, it is possible to select a reference image as a photographing reference from a plurality of reference images.

  According to the invention described in claim 8, when the coincidence rate calculated by comparing the digital image acquired by the imaging means with any one of the plurality of reference images exceeds a predetermined threshold, the image is automatically captured. Therefore, it is possible to easily and efficiently perform shooting according to a plurality of reference images. For example, when the reference image is an image of a pose to be taken by the subject, a plurality of images close to a plurality of predetermined poses can be easily and efficiently captured.

  According to the ninth aspect of the invention, since the digital image obtained by photographing is corrected based on the reference image, it is possible to reliably acquire an image in which the subject is in the same state as the reference image. For example, when the reference image is an image of a pose that the subject should take, an image in which the subject has a desired pose can be reliably acquired.

Embodiment 1
Hereinafter, Embodiment 1 of the present invention will be described in detail with reference to the drawings.
The photographing systems 100 and 200 described in the first embodiment store a planned image as a reference image to be photographed in association with the photographing order in the digital camera 20a, and the digital camera 20a takes the next photograph after photographing. The plan image of the target to be displayed is displayed and guidance for the next shooting is performed.

First, the configuration will be described.
FIG. 1 is a diagram illustrating a system configuration of an imaging system 100 according to Embodiment 1 of the present invention, in which data is transmitted and received between a personal computer 1 that is a data processing device and a digital camera 20a that is an imaging device by wireless communication. Indicates.
FIG. 2 is a diagram showing a system configuration of the imaging system 200 according to the first embodiment of the present invention, in which data is transmitted and received between the personal computer 1 as a data processing apparatus and the digital camera 20a as an imaging apparatus by wired communication. Shows the case.
Since the personal computer 1 and the digital camera 20a used in each of the photographing systems 100 and 200 shown in FIGS. 1 and 2 have a wireless communication function and a wired communication function, it is possible to support both system forms. .

Hereinafter, each apparatus which comprises the imaging | photography systems 100 and 200 is demonstrated.
FIG. 3 is a block diagram showing a functional configuration of the personal computer 1. In FIG. 3, the personal computer 1 includes a CPU 2, an input unit 3, a RAM 4, an external I / F 5, a display unit 6, a recording unit 7, and a communication control unit 8, and each unit is connected by a bus 9.

  A CPU (Central Processing Unit) 2 reads a system program stored in the recording unit 7, develops it in a work area formed in the RAM 4, and controls each unit according to the system program. Further, the CPU 2 reads out various processing programs such as a shooting plan information creation processing program and a transmission target information selection processing program stored in the recording unit 7 and develops them in a work area. Various processes including a transmission target information selection process are executed.

  The input unit 3 includes a keyboard having character / alphanumeric input keys, cursor keys, various function keys, and the like, and a mouse that is a pointing device. An operation signal from the mouse is output to the CPU 2 as an input signal.

  A RAM (Random Access Memory) 4 forms a work area for temporarily storing various programs executed by the CPU 2 and data related to these programs. For example, the RAM 4 forms a transmission target area (not shown) as a work area.

  The external I / F 5 is connected to the external I / F 24 in the digital camera 20a via a communication cable or the like, and transmits / receives data to / from the external I / F 24 in the digital camera 20a under the control of the CPU 2, and receives data from the CPU 2 Has a wired communication function such as

  The display unit 6 is configured by an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube), or the like, and displays various screens according to instructions of a display signal input from the CPU 2.

  The recording unit 7 stores programs, data, and the like in advance, and the recording unit 7 includes a recording medium readable by the CPU 2 such as a magnetic or optical recording medium or a semiconductor memory. This recording medium includes a portable medium such as a CD-ROM (Compact Disc Read Only Memory) and a memory card, and a fixed medium such as a hard disk. Various processing programs including the system program, the shooting plan information creation processing program, and the transmission target information selection processing program stored in the recording medium are partially or entirely transferred from a server or client to a WAN (Wide Area Network). ), And may be configured to receive from the communication control unit 8 via a network such as a LAN (Local Area Network), and the recording medium may be a recording medium of a server or a client built on the network.

  The recording unit 7 includes a type-specific construction process memory 71 shown in FIG. The type-specific construction process memory 71 shown in FIG. 4 stores a plurality of type-specific construction process files in which a construction process including a plurality of work processes is set together with a construction period for each type. “Type B building process file,..., Type N building process file” are stored.

  The type-specific building process file stored in FIG. 4 includes the types of work processes (temporary work, foundation work, building work, roof sheet metal work, etc.) and types (ground rope, (Links, scaffolding, etc.), construction schedule, and schedule images of each process (reference images that serve as the basis for shooting each work process, such as images of images to be completed) A file to remember. FIG. 5 shows a developed view of the contents of the type A building process file so that it can be seen as a schedule. Similar files are set for other type B construction process files and type N construction process files.

  Further, the recording unit 7 has a shooting plan memory 72 shown in FIG. This shooting plan information memory 72 is a construction that corresponds to shooting plan information (planning image file consisting of a plan image of each work process to be shot and its character information) created in shooting plan information creation processing described later. This is a memory that is stored in association with the subject.

  Further, the recording unit 7 has a CAD image data storage memory 73 for storing CAD image data created at the time of designing each work process of the construction for each construction.

  The communication control unit 8 is connected to the antenna 11 and has a wireless communication control function capable of wireless communication with the communication control unit 28 in the digital camera 20a. The communication control unit 8 executes a wireless communication operation under the control of the CPU 2 and is connected to the digital camera 20a. Send and receive data.

  FIG. 7 is a block diagram showing a functional configuration of the digital camera 20a. In FIG. 7, the digital camera 20 a includes a CPU 21, an input unit 22, a RAM 23, an external I / F 24, a display unit 25, an imaging unit 26, a recording unit 27, and a communication control unit 28. Has been.

  The CPU 21 reads a system program stored in the recording unit 27, develops it in a work area formed in the RAM 23, and controls each unit according to the system program. Further, the CPU 21 reads out various processing programs including a photographing processing program stored in the recording unit 27 and develops them in a work area, and executes various kinds of processing such as photographing processing described later.

  The input unit 22 includes a power switch, a shutter switch, a button group (up / down / left / right direction buttons, a determination button, and the like) for performing various settings on the display screen of the display unit 25, and an operation corresponding to each switch operation. The signal is output to the CPU 21.

  The RAM 23 forms a work area for temporarily storing various programs executed by the CPU 21 and data related to these programs. For example, the RAM 23 forms a plan image area, an image area 1, an image area 2, a pointer m area, a pointer n area (none of which are shown) as work areas.

  The external I / F 24 is connected to the external I / F 5 in the personal computer 1 through a communication cable or the like, and performs data transmission / reception with the external I / F 5 in the personal computer 1 under the control of the CPU 21, and the received data is transferred to the CPU 21. Has a wired communication function such as

  The display unit 25 is configured by a monitor such as an LCD, and displays various screens in accordance with display signal instructions input from the CPU 21.

  The imaging unit 26 includes an optical lens made of glass or plastic, an imaging device such as a CCD (Charge Coupled Diode) or CMOS (Complementary Metal Oxide Semiconductor), an A / D converter, and the like, and is input via the optical lens. A digital image (image data) is obtained by converting an optical image of a subject to be converted into an electrical signal by an image sensor and further A / D converting.

  The recording unit 27 includes a non-volatile memory such as a flash memory, and includes a system program corresponding to the digital camera 20a, various processing programs that can be executed on the system program, application programs, data processed by these programs, and the like. Record.

  The recording unit 27 includes a shooting plan information storage memory 271 that stores shooting plan information received from the personal computer 1.

  The recording unit 27 includes a captured image storage memory 272 that stores captured images.

  The communication control unit 28 is connected to the antenna 31 and has a wireless communication control function capable of wireless communication with the communication control unit 8 in the personal computer 1. The communication control unit 28 executes a wireless communication operation under the control of the CPU 21, and Send and receive.

Next, the operation of the present embodiment will be described.
<Photographing plan information creation process>
FIG. 8 is a flowchart showing the shooting plan information creation process executed by the CPU 2 of the personal computer 1. This process is a process realized by software processing in cooperation with the CPU 2 and the shooting plan information creation processing program stored in the recording unit 7 when an instruction to create a shooting plan is given from the input unit 3. Hereinafter, the shooting plan information creation process will be described with reference to FIG.

  First, a list of construction type names corresponding to the type-specific construction process file stored in the type-specific construction process memory 71 is displayed on the display unit 6, and when the construction type name is selected from the list by the input unit 3. (Step S1), a construction process file of a type corresponding to the selected construction type is read from the construction process memory 71 by type, and the contents are displayed on the display screen of the display unit 6 (Step S2). If the input unit 3 does not instruct confirmation of the contents of the displayed construction work process (step S3; NO), and if editing is instructed (step S4; YES), it is based on the input from the input unit 3. Thus, the contents of the read file are edited (step S5), and the process returns to step S3.

  Here, the content of each file of the type-specific building process file is a standard work process of each type of building work, and no specific work schedule is set as shown in FIG. In the actual shooting plan for each construction, specific information on when and in what order each process is shot is required. Therefore, in step S5, the actual construction date (shooting date) and its order are input. Done. In addition, work processes are added, deleted, and the schedule is changed according to the actual contents of each construction. FIG. 9 shows an editing example in step S5.

  In step S3, when the content of the displayed work process of the building work is confirmed (step S3; YES), the work process to which the plan image is not linked (for example, the process added in step S5) is determined. If there is a work process to which the plan image is not linked (step S7; YES), the work process name (here, type) is displayed and the corresponding work is stored in the CAD image data storage memory 73. CAD image data for the process is read and displayed on the display unit 6 (step S8). When a link to the displayed CAD image is instructed from the input unit 3 (step S9; YES), the CAD image is linked to the work process (step S10), and the process returns to step S7.

  On the other hand, if the CAD image link is not instructed in step S9 (step S9; NO) and the input of a new image is instructed (step S11; YES), the input of the new image and the work process of the image are performed. Are linked (step S12), and the process returns to step S7.

  If it is determined in step S7 that images are linked to all work processes (step S7; NO), a construction subject (shooting plan name) input screen is displayed, and a construction subject is entered ( In step S13), a plan image file is created for each work process based on the edited content, and stored in the shooting plan memory 72 of the recording unit 7 in association with the construction subject inputted in step S13 (step S14). This process ends.

  FIG. 10 shows an example of the plan image file. As shown in FIG. 10, the plan image file is composed of a plan image to be photographed in each work process, a photographing order, and character information about the plan image (process name (construction subject name + type), photographing date, etc.). . Shooting plan information for one construction is formed by a plan image file relating to a series of work processes to be photographed in one construction.

<Transmission target information selection process>
FIG. 11 is a flowchart showing a transmission target information selection process executed by the CPU 2 of the personal computer 1. This process is a process for selecting the shooting plan information to be transmitted to the digital camera 20a from the shooting plan information created by the above-described shooting plan information creation process, from the input unit 3 to the digital camera 20a. This is realized by software processing in cooperation with the CPU 2 and the transmission target information selection processing program stored in the recording unit 7 when the selection of the shooting plan information to be transmitted is instructed. Hereinafter, the transmission target information selection process will be described with reference to FIG.

  First, a list of construction subjects corresponding to the photographing plan information stored in the photographing plan memory 72 is displayed on the display unit 6, and a construction subject corresponding to the photographing plan information to be transmitted to the digital camera 20a is selected. Then (step S21), all plan images included in the selected shooting plan information, that is, plan images for all work steps of the construction with the selected construction subject are displayed as thumbnails (step S22). When it is impossible to display images for all processes on one screen of the display unit 6, images for all processes are displayed based on screen scrolling by the input unit 3.

  If the input unit 3 does not input an instruction to confirm the displayed plan images for all the work processes (step S23; NO), and if editing is instructed (step S24; YES), the editing target image is specified and edited. Performed (step S25), the process returns to step S22. Here, the plan images of all the work processes displayed as thumbnails can be reviewed before being transmitted to the digital camera 20a on the basis of actual design drawings and the like, and the images can be edited as necessary.

  When confirmation is instructed in step S23 (step S23; YES), shooting plan information (including the edited image) corresponding to the construction subject selected in step S21 is set as a transmission target to the digital camera 20a. The data is stored in the transmission target area of the RAM 4 (step S26), and this process ends.

  When the personal computer 1 receives a connection request from the digital camera 20a via the communication control unit 8, the shooting plan information stored in the transmission target area of the RAM 4 is read out and transmitted to the digital camera 20a. The data in the transmission target area is cleared. In the digital camera 20 a, the shooting plan information transmitted from the personal computer 1 is received and stored in the shooting plan information storage memory 271 of the recording unit 27.

  As described above, in the imaging systems 100 and 200, it is possible to perform imaging with the digital camera 20a in accordance with the imaging plan information created by the external personal computer 1.

<Shooting process>
FIG. 12 is a flowchart showing a photographing process executed by the CPU 21 of the digital camera 20a. This processing is realized by software processing in cooperation with the CPU 21 and the photographing processing program stored in the recording unit 27 when the power is turned on. Hereinafter, the photographing process will be described with reference to FIG.

  First, an initial screen is displayed on the display unit 25 (step S31), and whether or not to shoot using the shooting plan information is specified from the initial screen (step S32). When it is designated to perform shooting using the shooting plan information (step S33; YES), a planned image selection process is performed (step S34). When it is specified that shooting is not performed using the shooting plan information (step S33; NO), normal shooting processing, that is, guidance of a work process to be shot next is not performed, and the shutter is pressed and shooting is performed. A process of recording the image as it is in the captured image storage memory 272 is executed (step S42).

  FIG. 13 shows a flowchart of the planned image selection process executed in step S34. In this plan image selection process, a plan image of a work process scheduled to be shot on that day is selected as a plan image to be used for shooting guidance for that day. When shooting plan information for a plurality of constructions is stored in the digital camera 20a, it is assumed that there is no duplication of work periods among the plurality of constructions.

  First, 1 is set to the pointer m (step T1). Next, date information is read from the system of the digital camera 20a (step T2), the mth plan image file of the shooting plan information stored in the shooting plan information storage memory 271 is selected, and the shooting date information is read. (Step T3). Next, the date information of the read system and the shooting date information are compared, and if it is determined that they match (step T4; YES), the selected plan image file is stored in the plan image area of the RAM 23 (step T5). The process proceeds to step T6. If it is determined that the date information of the read system and the shooting date information do not match (step T4; NO), the process proceeds to step T6.

  In step T6, it is determined whether or not the pointer m <the number of all plan image files in the photographing plan information storage memory 271. If m <the number of all plan image files (step T6; YES), m is incremented ( Steps T7) and T3 to T6 are executed. When it is determined that m ≧ the total number of plan image files (step T6; NO), the plan image file stored in the plan image area of the RAM 23 is used as an effective plan image file used in various processes thereafter. Selected (step T8) and sorted in the shooting order (step T9), the process proceeds to step S35 in FIG.

  By the plan image selection process, a plan image file planned to be shot on that day is automatically selected, and shooting order guidance is performed using the selected plan image file.

  In step S35 of FIG. 12, 1 is set to the pointer n of the RAM 23 (step S35), and the plan image of the nth file among the plan image files stored in the plan image area of the RAM 23 and its character information (shooting order). , Process name, etc.) are read out and displayed on the display unit 25, and guidance (guidance display) of the work process to be photographed next is performed (step S36). Here, guidance of the character information related to the plan image together with the plan image makes it easier for the photographer to recognize the object to be photographed next. When pressing of the shutter switch is detected (step S37; YES), an image collation process is executed (step S38).

FIG. 14 shows a flowchart of the image matching process executed in step S38.
First, the plan image data of the nth plan image file stored in the plan image area is read into the image area 2 of the RAM 23 (step T11), that is, the digital image acquired by the imaging unit 26 by pressing the shutter, ie, The captured image data is read into the image area 1 of the RAM 23 (step T12). Next, image matching between the image in the image area 1 and the image in the image area 2 is performed, and a matching rate is calculated (step T13).

  The matching rate is calculated according to the similarity of the area of a specific portion (for example, a face area for a person) in both images, the arrangement of the subject, the color scheme, and the like by comparing the plan image and the captured image. When performing image collation, the plan image is enlarged and reduced to collate the two images. The plan image may be a 3D (dimension) image, and collation may be performed by rotating the plan image. The threshold value may be set for each plan image and each shooting plan information.

When it is determined that the calculated coincidence rate is equal to or higher than a preset threshold value (step T14; YES), a photographed image is displayed on the display unit 25, and the work process is photographed as planned. Is guided (step T15).
In addition, a captured flag is added to the nth plan image file (step T16), and the process name and the shooting order of the nth plan image file are added to the data of the shot image stored in the image area 1. By memorize | storing in the picked-up image storage memory 272 of the recording part 27, a picked-up image is matched and memorize | stored with a plan image (step T17), and a process transfers to step S39 of FIG.

  On the other hand, when it is determined that the calculated coincidence rate does not exceed a preset threshold (step T14; NO), guidance for prompting reshooting, the nth plan image, and its process name are displayed on the display unit 25. (Step T18). The process name of the plan image is highlighted (flashed, etc.). When the shutter switch is pressed (step T19), the process returns to step T12, and the processes after step T12 are repeatedly executed. If the shutter switch is not pressed and the input unit 22 instructs to skip shooting of the process (step T20; YES), the process proceeds to step S39 in FIG. Note that the skipped process, that is, an unphotographed image can be read out as appropriate, and the planned image can be displayed on the display unit 25 for photographing.

  In step S39 of FIG. 12, it is determined whether or not n <the number of all plan image files stored in the plan image area, and if n <the number of all plan image files is determined (step S39; YES), n is incremented, and the process returns to step S36. If it is determined that n <the number of all plan image files is not satisfied, i.e., n ≧ the number of all plan image files (step S39; NO), this process ends. If the shutter switch is not pressed in step S37 (step S37; NO) and the mode change is instructed by the input unit 22 (step S41; YES), this process ends.

  As described above, according to the photographing systems 100 and 200 according to the present invention, the plan image of each work process of construction and information thereof (process name, etc.) are stored in the recording unit 27 of the digital camera 20a. When the shutter switch is pressed and shooting is performed, the captured image and the planned image are collated to calculate the coincidence rate. If it is determined that the coincidence rate is equal to or higher than a preset threshold value, the next image should be captured. Character information such as a plan image of the work process and its name is displayed, and shooting guidance is performed.

  Accordingly, since the photographer can confirm the work process to be photographed next with an image, the photographer can easily recognize the process to be photographed next, and when photographing a series of work processes planned for photographing. The shooting efficiency is improved, and it becomes possible to reliably perform shooting in the order planned for shooting.

  In addition, the description content in the said Embodiment 1 is a suitable example of the imaging | photography systems 100 and 200 which concern on this invention, and is not limited to this.

  For example, in the above embodiment, the case where a photograph of each work process at a construction site is taken based on a shooting plan has been described as an example. However, in an event such as a wedding, shooting scenes are determined in order according to progress. The present invention can also be applied to a shooting plan, a shooting plan for inspection work in which the location and order of inspection are determined, and the like.

  In the wedding photography plan, the personal computer 1 includes images of scenes (for example, entrance to the bride and groom, entrance to the bride and groom cake), and images of the bride and groom's face photos. A plan image is synthesized to create a plan image file by adding the shooting order and scene name to each plan image and sending it to the digital camera 20a as shooting plan information for the wedding. In the digital camera 20a, guidance of a scene to be photographed next is performed based on the planned image by the above-described photographing process.

  As a device for taking a picture, the digital camera 20a is used for taking a picture. However, for example, a PHS, a camera-integrated personal computer, a wearable computer, a digital movie, or the like is applicable to any apparatus having a communication function and a photographing function. Is possible.

  In addition, various sightseeing spot guide images may be set in the digital camera 20a in the order of travel dates, and shooting at recommended locations may be guided.

  In addition, the detailed configuration and detailed operation of each apparatus constituting the photographing systems 100 and 200 can be changed as appropriate without departing from the spirit of the present invention.

[Embodiment 2]
Next, Embodiment 2 of the present invention will be described.
The digital camera 20b described in the second embodiment stores pose data as a reference when taking various poses in advance, and captures an image to be photographed input via a lens at the time of photographing, By calculating and displaying the coincidence rate, the photographer is shown how close the subject is to the pose that he / she wants to shoot, and assists the photographer in easily determining the shooting timing.

First, the configuration will be described.
FIG. 15 is a schematic diagram illustrating the back surface of the digital camera 20b according to the second embodiment.
FIG. 16 is a block diagram illustrating a functional configuration of the digital camera 20b according to the second embodiment.
As shown in FIG. 16, the digital camera 20 b has a configuration in which a recording medium connection unit 30 is added to the configuration of the digital camera 20 a described in FIG. 7, and a portable recording medium inserted into the recording medium connection unit 30. The data recorded in M can be read. In the second embodiment, the external I / F 24 and the communication control unit 28 are not essential components.

  The CPU 21 reads a system program stored in the recording unit 27, develops it in a work area formed in the RAM 23, and controls each unit according to the system program. Also, the CPU 21 responds to an instruction from the input unit 22 with a pose data registration processing program, a pose data deletion processing program, a pose data selection processing program, a background image registration processing program, and a pose shooting process stored in the recording unit 27. Various processing programs such as programs are read and expanded in the work area, and various processes such as pose data registration processing, pose data deletion processing, pose data selection processing, background image registration processing, and pose shooting processing described later are executed. To do.

  The input unit 22 includes a button group 22a (up / down / left / right cursor buttons and a determination button), a shutter switch 22b, a power switch (not shown), and the like shown in FIG. 15 and outputs an operation signal corresponding to each switch operation to the CPU 21.

The RAM 23 forms a work area for temporarily storing various programs executed by the CPU 21 and data related to these programs.
For example, the RAM 23 stores a selected pose data storage area 231 for storing pose data selected in a pose selection process described later, a background image storage area 232 for storing a background image registered in the background image registration process, and a pointer N area (see FIG. (Not shown).

  The display unit 25 is composed of the LCD 25a shown in FIG. 15, and displays various screens and images including a menu screen in accordance with instructions of display signals input from the CPU 21.

  The imaging unit 26 includes an optical lens made of glass or plastic, an imaging element such as a CCD or CMOS, an A / D converter, and the like, and an optical image of a subject input via the optical lens is converted into an electrical signal by the imaging element. And A / D conversion to obtain a digital image.

  As shown in FIG. 16, the recording unit 27 has a pause data storage area 273 and a captured image storage area 274.

  The recording medium connection unit 30 includes a slot for inserting a portable recording medium M such as a memory card or an SD card (Secure Digital memory card), and inputs / outputs data to / from the recording medium M inserted in the slot. It is an interface for.

Next, the operation of the second embodiment will be described.
Each process described below is performed by operating the button group 22a on the menu screen 251 (see FIG. 17) displayed on the display unit 25 when the power is turned on or in response to an instruction from the input unit 22. To be executed. The pose data registration process (see FIG. 18) is a process for registering pose data, and the pose data selection process (see FIG. 20) is a process for selecting pose data to be taken by the subject. The image registration process (see FIG. 21) is a process for registering a background image to be actually captured. The pause shooting process (see FIG. 22) is performed based on registration and selection in these processes.

<Pause data registration process>
FIG. 18 is a flowchart showing pause data registration processing executed by the CPU 21 of the digital camera 20b. This processing is realized by software processing in cooperation with the CPU 21 and the pause data registration processing program stored in the recording unit 27.

  Here, the pose data is a reference image that serves as a reference for the pose of the subject at the time of shooting. In the second embodiment, the pose data is described as being taken from the recording medium M. In addition, the pause data can also be taken in from the external I / F 24 or the communication control unit 28.

  First, the insertion of the recording medium M to the recording medium connection unit 30 is waited. When the insertion of the recording medium M is detected (step S101), 1 is set to the pointer N (step S102), and the inserted recording medium is inserted. Of the image data recorded in M, the Nth image is displayed on the display unit 25 (step S103), and the pressing of the button group 22a is awaited. When a button is pressed from the button group 22a, the process branches at the pressed button (step S104).

  When the left cursor button is pressed and "return" is instructed (step S104; return), N-1 is set to the pointer N only when N> 1 (step S105), and the process returns to step S103. When the right cursor button is pressed and “advance” is instructed (step S104; advance), the pointer N is set to N + 1 only when N <the total number of images on the recording medium M (step S106), and the process is as follows. The process returns to step S103. When the determination button is pressed and “selection” is instructed (step S104; selection), the data of the Nth image is taken from the recording medium M via the recording medium connection unit 30 and is stored in the pause data storage area 273. Stored (step S107), the process ends.

<Pause data deletion process>
FIG. 19 is a flowchart showing pause data deletion processing executed by the CPU 21 of the digital camera 20b. This processing is realized by software processing in cooperation with the CPU 21 and the pause data deletion processing program stored in the recording unit 27.

  First, 1 is set to the pointer N (step S111), and among the pose data stored in the pose data storage area, the Nth pose data is displayed on the display unit 25 (step S112), and the button group 22a is pressed. Waits. When a button is pressed from the button group 22a, the process branches at the pressed button (step S113).

  When the left cursor button is pressed and “return” is instructed (step S113; return), N−1 is set to the pointer N only when N> 1 (step S114), and the process returns to step S112. When the right cursor button is pressed and “advance” is instructed (step S113; advance), N + 1 is added to the pointer N only when N <total number of pose data (total number of pose data in the pose data storage area 273). The setting is made (step S115), and the process returns to step S112. When the determination button is pressed to instruct “selection” (step S113; selection), the Nth pose data is deleted from the pose data storage area 273 (step S116), and this process ends.

<Pause data selection process>
FIG. 20 is a flowchart showing pause data selection processing executed by the CPU 21 of the digital camera 20b. This processing is realized by software processing in cooperation with the CPU 21 and the pause data selection processing program stored in the recording unit 27.

  First, 1 is set to the pointer N (step S121), and among the pose data stored in the pose data storage area 273, the Nth pose data is displayed on the display unit 25 (step S122), and the button group 22a is displayed. Pressing waits. When a button is pressed from the button group 22a, the process branches at the pressed button (step S123).

  When the left cursor button is pressed and “return” is instructed (step S123; return), N−1 is set to the pointer N only when N> 1 (step S124), and the process returns to step S122. When the right cursor button is pressed and “advance” is instructed (step S123; advance), N + 1 is added to the pointer N only when N <total number of pose data (total number of pose data in the pose data storage area 273). The setting is made (step S125), and the process returns to step S122. When the determination button is pressed and “select” is instructed (step S123; selection), the Nth pose data is stored in the selected pose data storage area 231 (step S126), and this process ends.

<Background image registration processing>
FIG. 21 is a flowchart showing background image registration processing executed by the CPU 21 of the digital camera 20b. This processing is realized by software processing in cooperation with the CPU 21 and the background image registration processing program stored in the recording unit 27.

  In the imaging unit 26, image data input via the optical lens is captured (step S131) and stored in the background image storage area 232 (step S132).

<Pause shooting process>
FIG. 22 is a flowchart showing a pause shooting process executed by the CPU 21 of the digital camera 20b. This processing is realized by software processing in cooperation with the CPU 21 and the pause shooting processing program stored in the recording unit 27. Prior to this process, the pose data of a pose that is a reference when shooting is selected in the above-described pose selection process, and the background image at the time of shooting is selected in the background image registration process. It shall be registered.

  First, in the imaging unit 26, a digital image input via an optical lens, that is, data of an image to be captured is captured (step S141), and the subject is not pressed if the shutter switch 22b is not pressed (step S142; NO). An extraction process is performed (step S143).

FIG. 23 is a flowchart showing subject extraction processing executed by the CPU 21 in step S143.
First, the difference between the image to be captured captured in step S143 and the background image stored in the background image storage area 232 is calculated (step T101).

  Here, the digital image data captured by the image capturing unit 26 in the digital camera 20b, that is, the above-described background image data, the shooting target image data, and the captured image data captured after the shutter is pressed is represented in a bitmap format. The FIG. 24 is a diagram schematically showing image data in a bitmap format. One square in FIG. 24 indicates data corresponding to one pixel (partially omitted), and one piece of image data is represented by data of a plurality of pixels, for example, 640 × 480 pixels. One pixel is represented by a 3-byte numerical value for a 24-bit color image, and a 1-byte numerical value for an 8-bit gray scale.

  The difference between the photographic target image and the background image can be obtained as a difference by comparing the data representing each pixel of the photographic target image with the data representing the pixel at the corresponding position of the background image, and by comparing the data that does not match the data. It should be noted that pixels within a predetermined range from a pixel at a corresponding position in the background image may also be compared, and pixels of the photographic target image that have no data matching the predetermined range may be used as a difference. The comparison result of the data of each pixel is stored as difference data in the format shown in FIG. That is, 1 bit is assigned to each pixel, and a flag is set for the pixel that is the difference (area indicated by black in FIG. 25).

  Next, it is determined whether or not the number of pixels obtained as the difference is equal to or greater than a predetermined threshold (step T102; YES). If the difference is equal to or greater than the predetermined threshold, it is determined that subject extraction has succeeded. Then, the position of the difference pixel shown in FIG. 25 is set as the subject region, and the process proceeds to step S144 in FIG. If the predetermined threshold value is not exceeded (step T102; NO), it is determined that subject extraction has failed (step T104), and the process proceeds to step S144 in FIG.

  In step S144, it is determined whether or not subject extraction has succeeded in the subject extraction process described above (step S144). If it is determined that subject extraction has failed (step S144; NO), the process returns to step S141. . If it is determined that the subject extraction has been successful (step S144; YES), the image to be photographed and the pose data stored in the selected pose data storage area 231 are collated to calculate the coincidence rate C (step S145). ).

  FIG. 26 is a diagram illustrating an example of pause data. The pose data has the same number of pixels as the image data captured by the imaging unit 26, and 1 bit is assigned to each pixel and a flag corresponding to the subject area is flagged as in the difference data shown in FIG. ing.

  FIG. 27 is a diagram schematically illustrating a result of overlapping corresponding pixels of difference data and pause data. In the figure, the hatched area is a pixel located only in the subject area of the difference data, the area indicated by a dot is a pixel located only in the subject area of the pose data, and the area shown in white is both subjects. A pixel located in the region.

The coincidence rate C obtained in step S145 is the number of pixels located in the subject area of both images Nc (portion indicated by white in FIG. 27), difference data, that is, pixels located only in the subject area of the image to be photographed. The number of pixels is No (the portion indicated by diagonal lines in FIG. 27), and the number of pixels located only in the subject area of the pose data is Np (the portion indicated by dots in FIG. 27).
C = Nc / (Nc + No + Np)
Defined by

When the coincidence rate C is calculated, the coincidence rate is displayed on the display unit 25 (step S146), and the process returns to step S141.
FIG. 28 shows a display example of the matching rate on the display unit 25. FIG. 28A shows a case where the coincidence rate is represented by a numerical value, and FIG. 28B shows a case where the coincidence rate is represented by an indicator.

  Until the shutter switch 22b is pressed, the processes in steps S141 to 146 are repeatedly executed. When the shutter switch 22b is pressed (step S142; YES), the image captured by the imaging unit 26 is used as a captured image. The image is stored in the captured image storage area 274 (step S147), and this process ends.

  As described above, according to the digital camera 20b, when an image to be photographed is captured from the imaging unit 26, a subject region is extracted from the captured image data to be photographed, and the subject region in the pose data stored in advance is stored. And the extracted subject area are compared to calculate a matching rate C, and the calculated matching rate C is displayed on the display unit 25.

  Therefore, it is possible to indicate to the photographer how close the subject is to the pose that he / she wants to shoot, so that the photographer can easily determine the photo opportunity when photographing the posed subject. You can easily take a pose photo.

In addition, the description content in the said Embodiment 2 is a suitable example of the digital camera 20b which concerns on this invention, and is not limited to this.
For example, in the second embodiment, the case where the calculated match rate C is displayed on the display unit 25 has been described as an example. However, in the pause shooting process, when the match rate is equal to or higher than a preset threshold value. It is also possible to automatically shoot and take a picture. This makes it possible to take a picture without missing a photo opportunity when the subject is in a desired pose state. In addition, it is possible to take a picture of itself by fixing the digital camera 20b to a tripod.

  In the pose shooting process, when a plurality of pose data is stored in the pose data storage area 273, the image to be shot is compared with each of the plurality of pose data to calculate a match rate, and any pose data It is also possible to automatically take a picture when the coincidence rate with the threshold value exceeds a preset threshold value. In this way, a plurality of captured images close to a plurality of poses whose subject states are set in advance can be continuously shot without selecting pose data. It is possible to easily and efficiently photograph a plurality of photographed images in a state close to the pose.

  In the above embodiment, the subject is extracted based on the difference between the background image and the shooting target image. However, the method of extracting the subject is not limited to this, and the shooting target image is continuously extracted. And extracting the region of the moving object from each successive image using the inter-frame difference or optical flow technology (for example, Kyoritsu Publishing Co., Ltd., Image Processing Engineering Basics, Applications) ). In addition, if these techniques are used, it is possible to detect that the movement of the subject has stopped. Therefore, if automatic shooting is performed when the movement of the subject stops, the pose data is followed. Although shooting is not possible, many poses can be shot efficiently.

  In addition, for the captured image, the above-described subject region is extracted and image verification is performed with the pose data. The image correcting unit may be provided to match the above. As a result, a photographed image of the target pose can be obtained with certainty.

  In addition, the detailed configuration and detailed operation of each device constituting the digital camera 20b can be changed as appropriate without departing from the spirit of the present invention.

It is a figure which shows the structure at the time of utilizing the radio | wireless communication of the imaging | photography system in Embodiment 1 of this invention. It is a figure which shows the structure at the time of utilizing the wire communication of the imaging | photography system in Embodiment 1 of this invention. It is a block diagram which shows the functional structure of the personal computer 1 of FIG. It is a figure which shows the data storage example of the construction process memory 71 classified by type of the recording part 7 of FIG. It is a figure which shows an example of the content of the construction process file classified by type stored in the construction process memory 71 classified by type of FIG. It is a figure which shows the example of data storage of the imaging | photography plan memory 72 of the recording part 7 of FIG. It is a block diagram which shows the functional structure of the digital camera 20a of FIG. It is a flowchart which shows the imaging plan information creation process performed by CPU2 of FIG. It is a figure which shows the example of an edit of the construction process file classified by type of FIG. FIG. 5 is a configuration example of a plan image file stored in an imaging plan information storage memory 271 in FIG. 4. FIG. It is a flowchart which shows the transmission target information selection process performed by CPU2 of FIG. It is a flowchart which shows the imaging | photography process performed by CPU21 of FIG. It is a flowchart which shows the plan image selection process performed by CPU21 of FIG. It is a flowchart which shows the image collation process performed by CPU21 of FIG. It is a rear view of the digital camera 20b in Embodiment 2 of this invention. It is a block diagram which shows the functional structure of the digital camera 20b of FIG. It is a figure which shows an example of the menu screen 251 displayed on the display part 25 of FIG. It is a flowchart which shows the pause data registration process performed by CPU21 of FIG. It is a flowchart which shows the pause data deletion process performed by CPU21 of FIG. It is a flowchart which shows the pause data selection process performed by CPU21 of FIG. It is a flowchart which shows a background image registration process by CPU21 of FIG. It is a flowchart which shows the pause imaging | photography process performed by CPU21 of FIG. It is a flowchart which shows the to-be-photographed object extraction process performed by CPU21 of FIG. It is a figure which shows typically the image data of a bitmap format. It is a figure which shows typically the difference data which shows the difference of a imaging | photography object image and a background image. It is a figure which shows an example of pause data. It is a figure which shows typically the result of having overlapped the corresponding pixel of the difference data of FIG. 25, and the pose data of FIG. (A) is a figure which shows the example of a display when a coincidence rate is displayed with a numerical value, (b) is a figure which shows the example of a display when a coincidence rate is displayed with an indicator.

Explanation of symbols

100, 200 Shooting system 1 Personal computer 2 CPU
3 Input unit 4 RAM
5 External I / F
6 Display unit 7 Recording unit 71 Architectural process memory 72 by type 72 Shooting plan memory 73 CAD image data storage memory 8 Communication control unit 9 Bus 11 Antenna 20a, 20b Digital camera 21 CPU
22 Input unit 23 RAM
231 Selected pose data storage area 232 Background image storage area 24 External I / F
25 Display section 26 Imaging section 27 Recording section 271 Shooting plan information storage memory 272 Captured image storage memory 273 Pause data storage area 274 Captured image storage area 28 Communication control section 31 Antenna 29 Bus 30 Recording medium connection section

Claims (12)

Storage means for storing a reference image as a reference for shooting in order of shooting;
Imaging means for converting an optical image of a subject into an electrical signal to obtain a digital image;
Image collating means for collating the digital image acquired by the imaging means with the reference image according to the photographing order to calculate a matching rate;
A display unit that reads out and guides a reference image serving as a reference for the next shooting from the storage unit when it is determined that the coincidence rate calculated by the image matching unit exceeds a predetermined threshold;
An imaging apparatus comprising:   The photographing apparatus according to claim 1, wherein the reference image is a plan image corresponding to each step in a series of photographing plans. The storage means stores character information related to the reference image in association with the reference image,
The photographing apparatus according to claim 1, wherein the display unit guides and displays character information corresponding to a reference image that is a reference for the next photographing. Storage means for storing a reference image as a reference for photographing;
Imaging means for converting an optical image of a subject into an electrical signal to obtain a digital image;
Image collating means for collating the digital image acquired by the imaging means with the reference image and calculating a matching rate;
Display means for displaying the matching rate calculated by the image matching means;
An imaging apparatus comprising: Storage means for storing a reference image as a reference for photographing;
Imaging means for converting an optical image of a subject into an electrical signal to obtain a digital image;
Image collating means for collating the digital image acquired by the imaging means with the reference image and calculating a matching rate;
Photographing control means for photographing when it is determined that the matching rate calculated by the image collating means exceeds a predetermined threshold;
An imaging apparatus comprising:   The photographing apparatus according to claim 4, wherein the reference image represents a pose to be taken by a subject. The storage means stores a plurality of reference images,
Selecting means for selecting a reference image as a reference for photographing from the plurality of reference images;
The photographing apparatus according to claim 4, wherein the image collating unit collates the digital image acquired by the imaging unit with the reference image to calculate a matching rate. The storage means stores a plurality of reference images,
The image collating unit collates the digital image acquired by the imaging unit with each of the plurality of reference images to calculate a coincidence rate,
The imaging control unit performs imaging when a coincidence rate calculated by collating the digital image acquired by the imaging unit and any one of the plurality of reference images exceeds a predetermined threshold value. The imaging device according to claim 5.   The photographing apparatus according to claim 4, further comprising an image correcting unit that corrects a digital image obtained by photographing based on a reference image. On the computer,
A function of storing a reference image serving as a reference for shooting in a storage unit in the order of shooting;
A function of comparing the digital image obtained by converting the optical image of the subject into an electrical signal with a reference image according to the shooting order and calculating a matching rate;
A function of reading a reference image serving as a reference for the next shooting from the storage unit and displaying guidance when it is determined that the calculated matching rate exceeds a predetermined threshold;
A program to realize On the computer,
A function for storing a reference image as a reference for shooting;
A function of collating a digital image obtained by converting an optical image of a subject into an electrical signal with the reference image and calculating a matching rate;
A function of displaying the calculated match rate;
A program to realize On the computer,
A function for storing a reference image as a reference for shooting;
A function of collating a digital image obtained by converting an optical image of a subject into an electrical signal with the reference image and calculating a matching rate;
A function of shooting when it is determined that the calculated matching rate exceeds a predetermined threshold;
A program to realize

Images