JP4500212B2 - Imaging device and printing device - Google Patents

Description

  The present invention relates to a photographing apparatus that forms a subject image on an image sensor and generates image data, and a printing apparatus including the photographing apparatus.

  In recent digital cameras, image data is converted into an image file by adding data representing date and time and data representing a place as image data header information together with the image data so that image data can be easily managed after shooting. Many are recorded on recording media. If the information when the image data is captured is recorded in the header in this way, the header can be searched without referring to the content of the image data when searching for the image data that the user wants to see from the recorded image data. It is helpful to refer to only the information, so it is useful for the cruelty. In order to enhance the management function of recorded image data, some photographing devices can input management (search) information by operation and additionally record the input information in the header, Some receivers have a built-in receiver to acquire azimuth data by the GPS receiver during shooting and additionally record the azimuth data in the header (see, for example, Patent Documents 1, 2, and 3).

  By the way, a technique has been proposed in which standard face data is created using face data representing a large number of human faces, and human faces are recognized with high accuracy based on the standard face data ( For example, see Patent Document 4). Normally, when performing image recognition, the amount of calculation becomes enormous, and thus it was necessary to use a relatively large computer. By using the technique of Patent Document 4, a small computer of the microcomputer (microcomputer) class is used. However, the calculation necessary for image recognition can be performed sufficiently.

In this case, the image recognition technology can be installed in a digital camera including a microcomputer as a control unit. In recent digital cameras, as disclosed in Patent Document 5, the time required for focus detection (hereinafter referred to as AF) is shortened and high-speed AF can be performed. When both the image recognition technology and the image recognition technology are combined well, high-speed and high-accuracy image recognition can be performed.
JP 2001-228528 A JP 2002-77805 A JP-A-7-296001 JP-A-7-128031 JP 2002-116369 A

  When high-speed and high-accuracy image recognition can be performed in this way, it becomes a problem how to apply this high-accuracy image recognition technology to the imaging apparatus.

  In view of the above circumstances, the present invention makes it easier to manage recorded image data than before by applying the image recognition technology, and to various systems by making it easier to manage the data. It is an object of the present invention to provide a photographing apparatus that can be easily expanded, and a printing apparatus including the photographing apparatus.

The imaging apparatus of the present invention that achieves the above object is an imaging apparatus that forms an image of a subject on an imaging element by a shooting optical system and generates and records image data for recording according to a shooting operation.
Focusing area recognition means for recognizing a focusing area in an image represented by the image data based on the image data obtained by the shooting operation;
Person counting means for counting the number of person images in the in-focus area recognized by the in-focus area recognition means in the image represented by the image data;
Recording means for recording the number of person images counted by the person counting means in association with the image data obtained by the photographing operation is provided.

  According to the photographing apparatus of the present invention, the number of person images in the in-focus area is counted by the number counting means using the conventional image recognition technology. The number of person images obtained by the number counting means is associated with the image data obtained by the photographing operation, and the recording means records the image data on a recording medium such as a memory card.

  Then, for example, landscape photography and person photography are classified according to whether or not the number of person images is 0, and in the case of person photography, depending on whether one person or two or more people, Shooting and group photography are classified and recorded by the recording means. As described above, when image data represented by a photographed image is classified and recorded on a recording medium or the like according to the number of human images in the photographed image, a large number of image data in the recording medium is classified according to the photographing date and time. They are also classified according to the shooting location, and further according to the content of the captured image (the number of person images in the above). In this way, when image data is classified according to shooting date and time, shooting location, and even the number of people shooting, various filings such as filing by shooting date and time, filing by shooting location, and filing by shooting number of people. Can be performed adaptively, and an efficient filing system can be constructed by combining with a search system.

  In other words, the application of the image recognition technology makes it easier to manage recorded image data than before, and makes it easier to manage the data so that it can be easily expanded to various systems. A device is realized.

  Here, the photographing apparatus further determines the number of prints according to the number of human images in the image in the image data recorded by the recording unit, and records the number of prints in association with the image data. It is preferable that it is an aspect provided with the determination means.

  Some digital cameras have introduced a print reservation system based on a standard called DPOF (Digital print Order Format). When the printing number determination means is provided as in the photographing apparatus of the present invention, it is possible to provide a user with a simpler print reservation system than before by combining the printing number determination means and the DPOF function. become able to.

  In addition, if the user is allowed to make a decision when the print number determining means determines the number of prints, a more flexible service can be provided to the user.

In such a case, the photographing apparatus is provided with an operator for instructing whether or not to cause the print number determining means to perform processing for determining the number of prints.
It is preferable that the operation element is configured to accept an operation before photographing or an operation before recording by the recording unit.

  Then, the user can instruct whether or not to cause the print number determining means to perform processing by an operation before photographing or recording.

  For example, when the user wishes to cause the print number determining means to perform processing, the user instructs the print number determining means by operating the operator to instruct the print number determining means to perform processing. The number of prints can be determined and the determined number of prints can be recorded together with the image data in the recording means. Also, if the user thinks that the number of prints will be larger than his / her own number when the user causes the print number determination means to perform the process, the process is performed by operating the operation element. If an instruction not to be given is given, only the image data can be recorded without being processed by the print number determining means.

The above-described printing apparatus of the present invention that solves the above-described problem includes a photographing apparatus that forms a subject image on an image pickup element by a photographing optical system and generates and records image data for recording according to a photographing operation. In a printing apparatus that prints and outputs an image based on image data generated by the image sensor in response to the photographing operation on an instant film sheet,
A focusing area recognizing means for recognizing a focusing area in an image represented by the image data based on the image data obtained by the shooting operation;
Person counting means for counting the number of person images in the in-focus area recognized by the in-focus area recognition means in the image represented by the image data;
Recording means for associating and recording the number of person images counted by the person counting means and the image data obtained by the photographing operation;
This printing apparatus prints out an image based on the image data for the number of people counted by the number of people counting means.

  According to the printing apparatus of the present invention, the number of person images in the in-focus area recognized by the in-focus area recognition unit included in the imaging apparatus is counted, and an image obtained by the recording operation by the recording unit. After the data is associated and recorded, an image based on the image data is printed out by the printing device for the number of people counted by the number counting means.

  For example, when the printing apparatus is applied to Purikura (registered trademark) or the like, it is possible to print out photographs taken by the photographing apparatus of the printer device for the number of friends when photographing with friends.

  In this case, since the number of photographs are automatically printed out without performing an operation for designating the number of sheets in advance, it is convenient for the user.

  The printing apparatus preferably prints the image on a single instant film sheet for the number of persons and outputs the single instant film sheet.

  If print photos for the number of people are printed out as described above, there may be inconveniences in terms of fees. In such a case, it is preferable to divide and create photographs for the number of people on a single instant film sheet so that a photo print for the number of people can be created later by cutting. Then, the charge when shooting alone and the charge when shooting with a plurality of people can be made the same, and there is no burden on the user.

   As described above, by applying the above-described image recognition technology, it is easier to manage recorded image data than before, and an imaging device that can easily utilize the managed image data Is realized. In addition, a printing apparatus can be realized in which the merits of the photographing apparatus are manifested in utilizing the image data photographed by the photographing apparatus.

  Hereinafter, the configuration of an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is an external perspective view of a digital camera 10 that is an embodiment of a photographing apparatus of the present invention as viewed obliquely from above. FIG. 1A shows a view of the front of the digital camera 10 as viewed from diagonally above, and FIG. 1B shows a view of the back of the digital camera 10 as viewed from diagonally above. Yes.

  In the center of the front surface of the digital camera 10 shown in FIG. 1A, a zoom lens barrel 10_1 having a photographing lens 10_1a, which is an optical zoom lens, is provided. Above the zoom lens barrel 10_1, there is provided a flash light emission window 10_2 for irradiating flash light toward the subject when the field luminance is low. Further, an optical viewfinder objective window 10_3 that is paired with an optical viewfinder eyepiece window (described later) on the back side is provided next to the flash light emission window 10_2. A release button 10_4 is provided on the top surface of the digital camera 10.

  On the other hand, an optical viewfinder eyepiece window 10_5, a viewfinder lamp 10_6 that lights up when shooting preparation is completed or flashes during shooting, and a shooting mode and a playback are displayed on the upper back of the digital camera 10 shown in FIG. There are provided a mode switch 10_7 for switching modes, a zoom button 10_8 for zooming up to the wide-angle side (wide side) when pressed and zooming up to the telephoto side (tele side) when pressed.

  Below the zoom button 10_8, a menu / OK button 10_9, a DISP button 10_10, and a BACK button 10_11 are provided. The menu / OK button 10_9 is a button for displaying various menus at the time of shooting and reproduction and determining a selected menu. The DISP button 10_10 is a button for switching the state of the screen displayed on the liquid crystal monitor 10_301 beside the button. For example, the display of the liquid crystal monitor 10_301 is turned on / off during shooting, and the character display is turned on during reproduction. Or turn it off. The BACK button 10_11 is a button for returning or canceling the operation state by the MENU / OK button 10_9 or the like.

  In addition, the digital camera of this embodiment is provided with a search mode that operates when the mode switch 10_7 is switched to the playback mode side. When this search mode is selected during the playback mode, 0 (landscape shooting), 1 (self-shooting, etc.), 2 (two-shot), 3 or more (group shooting) are selected as selection items on the LCD monitor 10_301. When one of them is designated by the operation of the OK button 10_9 or the like, the number or names of files having image data representing images with a designated number of person images (for example, When 0 people are designated, “landscape shooting” ** file name 1, file name 2, file name 3,..., Etc.) are displayed on the display screen.

  Furthermore, the digital camera of this embodiment is provided with a print auto mode that automatically determines the number of prints by counting the number of human images in the captured image. When this print auto mode is switched to the ON side by operation, the number of persons is recorded in the header of the image file in accordance with the number of person images in the photographed subject, and print reservation is automatically performed. ing. Since there may be no people at this time, an inquiry is made on the auto print setting screen, such as “How many prints should be specified for landscape (0 people)” to the user. The number of sheets is also selected. Here, when the user does not select the number of sheets even when viewing the display on the display screen, 1 (sheet) is selected and set as a default value.

  FIG. 2 is a block diagram showing a circuit configuration of the digital camera 10 shown in FIG.

  FIG. 2 also shows a photographic lens necessary for operating the circuit after the image sensor 10_41. In order to show what the photographic lens is, a zoom which is a main component of the photographic lens is shown. A lens 10_1a1 and a focus lens 10_1a2 are illustrated. The photographing lens 10_1a including these lenses causes subject light to form an image on the subsequent CCD 10_41, and the CCD 10_41 generates an image signal representing the subject light.

The digital camera 10 is centrally controlled by a CPU 10_47, and the CPU 10_47 in this example includes a program memory 10_471.
Hereinafter, it will be described how the CCD 10_41 generates an image signal and how the generated image signal is transmitted to a subsequent circuit.

  First, the flow of an image signal representing a through image displayed on the liquid crystal monitor 10_301 when the power is turned on and the mode switch 10_7 is on the photographing mode side will be described.

  In order to cause the CCD 10_41 to generate an image signal for a through image, the CCD 10_41 is caused to repeatedly supply an exposure start signal and an exposure end signal to the CCD 10_41 at a predetermined cycle by a timing generator (not shown) under the control of the CPU 10_47 described later. Generation of an image signal representing a through image is performed every predetermined period. In response to the exposure end signal from the timing generator (not shown), after the exposure at the CCD 10_41 is ended, an image signal (hereinafter referred to as RGB signal) representing a through image that has been exposed almost simultaneously is output from the CCD 10_41. ing.

  When the RGB signal for the through image is output to the A / D conversion circuit 10_42 in this way, the analog RGB signal is converted into a digital RGB signal by the A / D conversion circuit 10_42. Then, the digital RGB signal is guided to the bus line 10_100 by the image input controller 10_43 in the subsequent stage.

  The digital RGB signal for the through image guided to the bus line 10_100 by the image input controller 10_43 is supplied to the image signal processing circuit 10_44, and the image signal processing circuit 10_44 converts the digital RGB signal to the digital YC signal. Is done. The YC signal converted by the image signal processing circuit 10_44 is supplied to the drive control unit 10_300 of the display unit 10_30, and an image based on the YC signal is displayed on the liquid crystal monitor 10_301 of the display unit 10_30. Since this YC signal is generated by the CCD 10_41 at every predetermined period, an image based on the YC signal is switched and displayed at every predetermined period on the liquid crystal monitor 10_301. In this way, the subject in the direction in which the photographing lens 10_1a is directed is displayed on the liquid crystal monitor 10_301 as a through image as it is.

  That is, even if the liquid crystal monitor 10_301 is viewed in place of the viewfinder without looking through the optical viewfinder, shooting is performed by pressing the release button 10_4 at a photo opportunity.

  Here, when the release button 10_4 is pressed at a photo opportunity while seeing the through image, the photographing process is started. The release button 10_4 of the present embodiment has two operation modes of half-press and full-press. When the release button 10_4 is half-pressed, one switch (hereinafter referred to as a first contact) 10_4A is connected. The CPU 10_47 detects the half-pressed state, and when the CPU 10_47 is fully pressed, the other switch 10_4B (hereinafter referred to as the second contact) is also connected and is detected to be fully pressed by the CPU 10_47.

  The CPU 10_47 causes the AE detection circuit 10_50 and the AF detection circuit 10_51 to perform predetermined processing when half-pressing is detected, and causes the timing generator (not shown) to perform exposure corresponding to the shutter speed when full-pressing is detected. A start signal and an exposure end signal are output to the CCD 10_41.

  The AE detection circuit 10_50 detects the luminance necessary for setting the exposure, and the CPU 1_47 adjusts the aperture diameter of a diaphragm (not shown) or emits flash when fully pressed according to the detection result of the AE detection circuit 10_50. The apparatus 10_120 is caused to emit flash light.

  Further, the AF detection circuit 10_51 instructs the motor driver 10_49 under the control of the CPU 10_47 to move the focus lens 10_1a2 from the nearest point to the farthest point, and subject contrast at a plurality of positions on the way. Thus, processing is performed in which the peak of the subject contrast detected at each position is set as the focal point.

  In this way, after the image signal representing the image formed on the CCD 10_41 when fully pressed is output to the CCD 10_41, the RGB signals converted into digital signals by the A / D conversion circuit 10_42 are bus lines by the image input controller 10_43. 10_100.

  All the RGB signals guided to the bus line 10_100 are temporarily stored in the memory (SDRAM) 10_52, and then read out from the memory 10_52 and supplied to the image signal processing circuit 10_44. The RGB signal is converted into a YC signal by the image signal processing circuit 10_44, and the converted YC signal is supplied to the compression processing circuit 10_44 and JPEG compressed by the compression processing circuit 1_44. Further, the JPEG compressed YC signal is supplied to the recording unit 10_53, and header information such as compression information is added to the image data by the recording unit 10_53 to be recorded on the recording medium 10_54 as an image file (Exif file).

  In this embodiment, the image signal processing circuit 10_44 performs conversion from RGB signals to YC signals at the time of shooting, as well as an image recognition function provided in the image signal processing circuit 10_44 (see Patent Document 4 described above). Is applied), and the number of person images recognized by the counting circuit in the image signal processing circuit 10_44 is counted. When the above-described auto mode is switched to the ON side, the CPU 10_47 is notified of the count result of the number of human images recognized by the image recognition function of the image signal processing circuit 10_44, and the CPU 10_47 that has received the notification records When making the section 10_53 record an Exif file composed of a header and compressed image data, the number of person images is recorded in addition to the shooting date and time and the shooting location as header information.

  When the number of person images is recorded as header information in this way, the search can be performed by the number of person images when the photographing apparatus is set to the reproduction mode and the above-described search mode is selected. . In this way, image data can be managed not only by date, by location, etc., but also by the number of person images. Further, when a print reservation is made using DPOF, until now, the print reservation mode has been entered and the number of prints is input later. Can be automatically booked.

  FIG. 3 is a flowchart showing the procedure of the photographing process performed by the CPU 10_47 during photographing.

  In step S301, it is determined whether or not the number of people and the number of developed images are matched, that is, whether or not the above-described auto print mode is in an ON state.

  If it is determined in this step S301 that it is in the ON state, the process proceeds to No and jumps to step S304 to start photographing. If it is determined in step S301 that it is in the ON state, the process proceeds to the Yes side, and the development flag (flag) is set to 1 in step S302. Further, in the next step S303, selection of the number when the number of people is 0 is performed. Here, it is assumed that no selection is made on the display screen when the auto print mode is selected, and a default value of 1 is set, and shooting is started in the next step S304.

  In step S305, the focused area is extracted, and in step S306, an area for image recognition is set. Then, in the next step S307, the number of person images in the determined area is counted. In the next step S308, the shooting date and time, the shooting location, etc. are recorded as image information in the header part of the Exif file, and the process proceeds to the next step S309. In Step S309, it is determined whether Flag is 1. If it is 1, the process proceeds to Yes. In Step S310, the print reservation number is additionally recorded in the header portion of the Exif file, and the process of this flow is terminated. If it is determined in step S309 that it is not 1, the process proceeds to No and the process of this flow is terminated.

  Here, how the focused area with focus in step S305 is extracted will be described in detail with reference to FIGS.

  FIG. 4 is a diagram illustrating the position of the in-focus area in the shooting screen, and FIG. 5 is a diagram illustrating an example of extracting the in-focus area in the captured image.

  In the digital camera of the present embodiment, as shown in FIG. 4, the entire photographing screen is divided into a plurality of regions (divided into 25 in FIG. 4), and the spatial frequency is detected for each region. AF is performed in which many existing areas are in-focus areas (hatched areas in the figure). In this example, a person image is recognized from images in a slightly larger C area including the in-focus area (hatched portion) so that the number of person images not related to shooting is not counted as much as possible. In addition, the number of persons who intend to shoot can be accurately counted. In this way, since the number of human images that are not related to shooting is not counted, even if a print reservation is made according to the number of human images recorded in the head portion, useless print reservation is not performed.

  FIG. 5 is a diagram for explaining a situation in which only the number of person images in the in-focus area is counted without counting the number of person images not related to shooting.

  In the figure, a portion surrounded by a dotted line is a focusing area and its surrounding area. In this way, only the number of persons intended for shooting is counted, and the number of persons not related to shooting is omitted.

  In this way, when you try to make a print reservation, print reservations will be made for the number of people who intended to shoot, so more photos will be printed out and some photos will be wasted There is no. In addition, when searching for image data using the search mode in the playback mode, the number of persons intended to shoot is searched as a search code. In such a case, a recklessly accurate management system is configured.

  As described above, the application of the image recognition technology makes it easier to manage recorded image data than before, and makes it easier to manage the data. Or a search system) that can be easily expanded.

  Here, an example in which the above-described photographing apparatus of the present invention is applied to, for example, a printing apparatus called a so-called Purikura (registered trademark) will be described.

  FIG. 6 is a diagram illustrating an internal configuration of the printing apparatus, and FIG. 7 is a flowchart illustrating processing performed by the CPU in the printing apparatus. FIG. 8 is a diagram for explaining a design of a printed photograph printed out from the printing apparatus.

  FIG. 6 shows an example in which the recording unit 10_53 and the recording medium 10_54 in FIG. 2 are omitted and a printing unit 10_55 is connected instead. According to the printing apparatus shown in FIG. 6, instead of recording image data on the recording medium 10_54 by the recording unit 10_53 of FIG. 2, the instant film sheet on which an image based on the image data is printed by the printing unit 10_55 is externally released. Printed out.

  In this example, the image signal processing circuit 10_44 shown in FIG. 6 recognizes the person image in the in-focus area extracted based on the detection result of the AF detection circuit 10_51, and further causes the image signal processing circuit 10_44 to recognize. The number of the human images is counted, and further, the size conversion processing of the image data is performed to generate a plurality of image data of the size reduced by the size conversion processing in one frame. Thereafter, the CPU 10_47 receives the size conversion end flag in the image signal processing circuit 10_44, and the CPU 10_47 transfers the generated image data to the printing unit 10_55.

  Then, the CPU 10_47 causes the printing unit 10_55 to start print output and print an image based on the image data.

  FIG. 7 is a flowchart showing a procedure of processing performed by the CPU 10_47 and performed by the CPU 10_47 on each unit.

  In step S701, it is determined whether or not the number of people and the number of developed images are matched, that is, whether or not the above-described auto print mode is in an ON state.

  If it is determined in this step S701 that it is in the ON state, the process proceeds to No and jumps to step S703 to start photographing. If it is determined in this step S701 that it is in the ON state, the process proceeds to the Yes side, the development flag (flag) is set to 1 in step S702, and photographing is started in the next step S703.

  Image recognition is performed in the next step S704, and the number of human images in the determined area is counted in the next step S705. In the next step S706, it is determined whether or not Flag is 1, and if it is 1, the process proceeds to Yes side, development is performed for the number of divisions in step S708, an instant film sheet is output, and the processing of this flow is finished. . If it is determined in step S706 that the flag is not 1, the process proceeds to No, and in step S707, for example, the number of divisions is input by a user operation, and development is performed for the number of divisions in step S708 to output an instant film sheet. The process of this flow is terminated.

  FIG. 8 shows an example of the processing in step S708. In the case of two people, the images based on the same image data are divided into two, and in the case of four people, the images based on the same image data are divided up and down. A pattern on the instant film sheet when the image is divided on the instant film sheet so as to be arranged on the right and left and an image based on the image data is generated and printed out is shown.

  When images for the number of people are generated and printed on one instant film sheet in this way, the user can photograph each person in the photograph by cutting one instant fill sheet or the like. Can be handed over.

  When the photographing apparatus of the present invention is applied to such a printing apparatus, a printing apparatus that is easy to use is realized due to the ease of management of the photographing apparatus.

  In the above embodiment, a configuration is shown in which several identical images are created and output in one instant film sheet, and then the user performs cutting later. It is also possible to print out an instant film sheet for the number of persons formed on the sheet.

It is the external appearance perspective view which looked at the digital camera 10 which is one Embodiment of the imaging device of this invention from diagonally upward. It is a block diagram which shows the circuit structure of the digital camera 10 shown in FIG. It is a flowchart which shows the procedure of the imaging | photography process which CPU10_47 performs. It is the figure which showed the position of the focusing area | region within an imaging | photography screen. It is a figure which shows the example of extraction of the focusing area | region in a picked-up image. 2 is a diagram illustrating an internal configuration of a printing apparatus. FIG. It is a flowchart which shows the procedure of the imaging | photography process which CPU10_47 in a printing apparatus performs. It is a figure explaining the design of the printed photograph printed out from the printing apparatus.

Explanation of symbols

10 digital camera 10_4 release button 10_4A first contact 10_4B second contact 10_47 CPU
10_471 Program memory 10_472 Non-volatile memory 10_50 AE detection circuit 10_51 AF detection circuit 10_53 Recording unit 10_54 Recording medium 10_55 Printing unit

Claims (5)

In a photographing apparatus that forms a subject image on an image pickup element by a photographing optical system and generates and records image data for recording according to a photographing operation.
Focusing area recognition means for recognizing a focusing area in the image represented by the image data based on the image data obtained by the shooting operation;
Person counting means for counting the number of person images in the in-focus area recognized by the in-focus area recognition means in the image represented by the image data;
An imaging apparatus, comprising: a recording unit that records the number of person images counted by the number of people counting unit and image data obtained by a shooting operation in association with each other.   The photographing apparatus further includes a print number determining means for determining the number of prints according to the number of human images in the image in the image data recorded by the recording means and recording the number of prints in association with the image data. The imaging apparatus according to claim 1, further comprising: The photographing apparatus includes an operator for instructing whether or not to cause the print number determining means to perform a process of determining the number of prints.
The photographing apparatus according to claim 1, wherein the operation element receives an operation before photographing or an operation before recording by the recording unit. Image data generated by the image pickup device in response to the shooting operation is provided with a shooting device that forms a subject image on the image pickup device by a shooting optical system and generates and records image data for recording according to the shooting operation. In a printing apparatus that prints and outputs an image based on an instant film sheet,
A focusing area recognition means for recognizing a focusing area in an image represented by the image data based on the image data obtained by the shooting operation;
Person counting means for counting the number of person images in the in-focus area recognized by the in-focus area recognition means in the image represented by the image data;
Recording means for associating and recording the number of person images counted by the person counting means and image data obtained by the photographing operation;
This printing apparatus prints out an image based on the image data for the number of people counted by the number of people counting means. 5. The printing apparatus according to claim 4, wherein the printing apparatus prints the image on a single instant film sheet for a number of persons and outputs the single instant film sheet. .

Images