JP2004348620A - Apparatus and method for specifying time of photographing print image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce print images in which the time of photographing is not clear in batch digitizing services. <P>SOLUTION: In the batch digitizing services, a negative film and photographic print are received in a lot from a customer, and images recorded thereon are digitized by using a film scanner and reflective scanner, respectively. Photographic printing paper is narrow in latitude in comparison with a negative film, so that many images in which the photographing time is not clear are generated in the print images read from the photographic print. An identical image is retrieved by a similar image retrieval system with respect to the print image in which the photographing time is not clear, and the imprinted date extracted from the identical image are specified as a photographing date of the print image. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a method and apparatus for specifying a shooting timing of a print image that specifies shooting timing of print image data read from a photographic print.
[0002]
[Prior art]
Image data recorded on photographic film and photo prints such as negative film is converted into digital data, and this is recorded on storage media such as CD (Compact Disk) media and DVD (Digital Versatile Disk) media. Photo digitizing services provided to customers are known. Photo digitizing services have become popular in recent years because digitalization of photographs has advantages such as preventing deterioration of image quality over time and storing a large number of photographs in a compact form. In addition, the capacity of storage media has been rapidly increasing, and it has become possible to record more than a thousand image data on a single medium. For this reason, a large amount of photo prints and film that have been photographed and stored by customers for many years can be stored together, digitized together, and digitized image data can be recorded together on storage media. Digitizing services are also being started.
[0003]
Photo digitizing is performed using a photo digitizing device (see, for example, Patent Document 1). The photo digitizing device is a film scanner that photoelectrically reads a film image recorded on a photographic film, a reflective original scanner that photoelectrically reads a print image recorded on a photographic print, and image data captured from each of these scanners as a storage medium. Has a media drive to write to. For example, the image data is converted into an image file such as a JPEG format and recorded on a storage medium.
[0004]
In the collective digitizing service, in order to increase the added value, it is considered to add the photographing time of the image to the digitized image data as incidental information. By adding the shooting time to the image data, when the customer plays back and displays the image file recorded on the storage media, the images are sorted and displayed in order of shooting age, or a slide show is executed in order of shooting date So that you can enjoy watching photos. As a method for specifying the shooting time of a photographic print or photographic film, a method of extracting the imprint date imprinted on the print image or film image by character recognition is considered to be the most practical.
[0005]
[Patent Document 1]
JP 2002-354385 A
[0006]
[Problems to be solved by the invention]
However, generally, when the color of the imprint date and the background color are similar colors, the character recognition rate decreases, and therefore the imprint date extraction rate decreases. In particular, photographic paper has a narrow latitude (dynamic range) compared to a negative film, so that in the case of a printed image, the extraction rate is further reduced as compared to a film image. For this reason, there is a problem that a large number of print images with unknown shooting times are generated.
[0007]
An object of the present invention is to reduce print images whose shooting time is unknown in the collective digitizing service.
[0008]
[Means for Solving the Problems]
In order to achieve the above-described object, the print image photographing time specifying device of the present invention photoelectrically reads each of a print image recorded on a photographic print and a film image recorded on a photographic film, and digitized image data. A plurality of film image data digitized from a photographic film, in a print image shooting time specifying device for specifying a shooting time of print image data digitized from a photographic print. Image search means for performing image similarity determination by comparing the print image data, and searching for the same image data in which the image content is estimated to be the same as the print image data from the plurality of film image data; From the same image data retrieved by the image retrieval means A imprint date extracting means for extracting the imprint date imprinted in an image of, and identifies the extracted imprint date as shooting timing of the print image.
[0009]
In addition, as a similarity level of the image similarity determination, a first level that can be estimated as the same image and a second level lower than the first level are set, and there is film image data that has reached the first level. The film image data is determined as the same image data, and when there is no film image data reaching the first level, the film image data reaching the second level is determined as the similar image data. The similar image data is preferably recorded in association with the print image data.
[0010]
In addition, according to the method for specifying the shooting time of a print image of the present invention, each of the print image recorded on the photographic print and the film image recorded on the photographic film is photoelectrically read, and the digitized image data is recorded on the storage medium. In a print image shooting time specifying method that is used in a photo digitizing device and specifies the shooting time of print image data digitized from a photographic print, a plurality of film image data digitized from a photo film, and the print image data, An image search step for comparing and performing image similarity determination to search for the same image data whose image content is estimated to be the same as the print image data from the plurality of film image data, and the image search means Imprint extracted from the same image data Characterized by a step of identifying the urging as an imaging timing of the print image data.
[0011]
In addition, as a similarity level of the image similarity determination, a first level that can be estimated as the same image and a second level lower than the first level are set, and there is film image data that has reached the first level. The film image data is determined as the same image data, and when there is no film image data reaching the first level, the film image data reaching the second level is determined as the similar image data. The similar image data is preferably recorded in association with the print image data.
[0012]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 shows an overview of a photo digitizing service. As shown in FIG. 1, a trader who accepts a service deposits a photographic print 9 or a negative film 10 from a customer, scans each frame image recorded on the photographic print 9 and the negative film 10 with a photo digitizing device 11, and digitizes it. Then, the digitized image data of each frame is recorded on a storage medium, for example, the DVD medium 12.
[0013]
As shown in FIG. 2, an image folder 14 is created on the DVD medium 12 under the root directory 13, and image data is stored in the image folder 14. In addition, image display software 16 for reproducing image data is stored under the root directory 13. The DVD media 12 on which the image data and the image display software 16 are recorded is provided to the customer.
[0014]
The customer who receives the DVD medium 12 reproduces the image data on his / her personal computer 17 or the like and views the photograph. A media drive corresponding to the DVD medium 12 is mounted on the main body of the personal computer 17. In addition, a display and an operation unit including a keyboard and a mouse are connected to the main body. The CPU in the main body executes image display software based on an operation signal from the operation unit, reproduces image data, and displays an image on the display.
[0015]
FIG. 3 shows a schematic configuration of the photo digitizing apparatus 11. The photo digitizing apparatus 11 includes an apparatus main body 31, a film scanner 32, a reflective scanner 33, a monitor 34, and an operation unit 36 connected to the apparatus main body 31. The apparatus main body 31, the film scanner 32, and the reflective scanner 33 are connected by, for example, a SCSI interface, and image data output from the scanners 32 and 33 is transmitted to the apparatus main body 31 via the SCSI interface. At the same time, a control signal output from the apparatus main body 31 is sent to the scanners 32 and 33.
[0016]
The film scanner 32 photoelectrically reads the film image recorded on the negative film 10 by scanning with a CCD sensor. The reflective scanner 33 scans a print image recorded on the photographic print 9 with a CCD sensor and reads it photoelectrically. Analog image pickup signals output from the CCD sensors are digitally converted by an A / D converter, and the converted image data is sent to the apparatus main body 31.
[0017]
The apparatus main body 31 is configured based on a computer main body such as a workstation or a personal computer, and includes a CPU 41, a RAM 42, an image processing unit 43, a storage device 44, and a recording DVD drive 46. The CPU 41 executes various programs stored in the storage device 44 and controls each unit of the apparatus. The RAM 42 is used as a working memory when the CPU 41 executes a program. The image processing unit 43 executes various types of image processing on the image data captured from the film scanner 32 and the reflective scanner 33. The processed image data is stored in the storage device 44. The recordable DVD drive 46 writes the image data and image display software 16 stored in the storage device 44 to the DVD medium 12.
[0018]
As the storage device 44, for example, a hard disk drive is used. The storage device 44 is provided with a system folder 44a, a film image folder 44b, and a print image folder 44c. The system folder 44 a stores various programs such as driver software for controlling the film scanner 32 and the reflective scanner 33 in addition to the operating system and the photo digitizing program 48.
[0019]
The photo digitizing program 48 includes various programs such as a data capturing program 48a, a photographing time specifying program 48b, and a writing program 48c. The writing program 48 c reads the captured image data from the storage device 44, and causes the CPU 41 to execute a writing process for writing the read image data to the DVD medium 12 using the recordable DVD drive 46. The data capturing program 48 a captures data from the scanners 32 and 33, performs various image processing on the captured image data using the image processing unit 43, and accumulates processed image data in the storage device 44. CPU41 is made to perform the process to perform.
[0020]
A folder for storing the captured image data is determined according to the reading source. That is, the film image data captured from the film scanner 32 using the negative film 10 as a reading source is stored in the film image folder 44b. On the other hand, print image data captured from the reflection original scanner 33 with the photographic print 9 as a reading source is stored in the print image folder 44c.
[0021]
The captured image data is converted into, for example, an image file 51 having the format shown in FIG. The image file 51 is provided with an image data storage area 51a in which image data is stored and an incidental information storage area 51b in which incidental information is stored. The image data is stored after being compressed by, for example, the JPEG method. The incidental information includes shooting date such as the shooting date and shooting date when the image was shot, reading source information indicating whether the image was read from the photo print or the photo film. The read source information is stored in each image file 51 at the time of data capture, for example.
[0022]
The shooting time specifying program 48b causes the CPU 41 to execute a shooting time specifying process for specifying the shooting time of the captured image data. In many cases, the shooting date is imprinted on each frame (film image) recorded on the negative film 10 or the print image of the photo print 9. The shooting time is specified primarily by extracting the imprinting date imprinted on the film image or the print image. For example, when a film image is read from the negative film 10, the film image data is analyzed, the imprint date in the image is extracted, and converted into text data by character recognition processing. The extracted imprinting date is specified as the photographing date of the image. Similarly, when a print image is read from the photographic print 9, the print image data is analyzed and the imprint date is extracted. The extracted imprinting date is stored in the incidental information storage area 51b of the image file 51.
[0023]
However, due to the difference in latitude between the negative film 10 and the photographic paper, the extraction rate of the imprint date from the printed image is lower than that of the film image. For this reason, in the primary process, the secondary process is performed for a print image in which the imprint date cannot be extracted (the photographing time is uncertain). In the secondary processing, a film image having the same image as the print image is searched, and if there is a film image having the same image, the imprint date is extracted from the data, and the extracted imprint date is used to capture the print image. Specify as a time. This makes it possible to specify the shooting time even for a print image for which the imprint date could not be extracted in the primary processing.
[0024]
Of course, even when the imprint date is read from the film image, the date extraction rate is lowered if the imprint date and the background are imprinted in the same color as the print image. However, unlike a print image, a film image can be read for each color by using R, G, and B transmitted light properly, so it is high if there is a slight color difference between the background and the date. The date can be extracted with probability.
[0025]
The CPU 41 compares the print image data and the film image data to check the similarity of the images. The reference level of the similarity that can be estimated as the same image is set in advance. The reference level data is stored in the storage device 44, for example. The reference level is a level that is almost 100% consistent with respect to the image structure. Regarding the color, since the degree of progress of color fading between the print and the negative is different, there is a slight difference due to the color fading even in the same image. In addition, due to dust or dust adhesion, the density of each pixel may be different even in the same image. Therefore, as an allowable range of the color difference, a margin is set to such an extent that the degree of color fading and the density difference due to the adhesion of dust and dirt can be allowed. Images that have reached this pass level are presumed to be the same image.
[0026]
The operation of the above configuration will be described below with reference to the flowcharts shown in FIGS. The operator of the photo digitizing apparatus 11 uses the film scanner 32 and the reflective scanner 33 to capture a film image and a print image from the negative film 10 and the photographic print 9. The captured film image data is stored in the film image folder 44b, and the print image data is stored in the print image folder 44c.
[0027]
After the data capture is completed, when the operator gives an imaging time specifying instruction from the operation unit 36, the imaging time specifying process is started. As shown in the flowchart of FIG. 5, the CPU 41 that executes the shooting time specifying program 48b reads out image files from the film image folder 44b and the print image folder 44c, performs data analysis, and extracts the imprint date. Then, it is converted to text data by character recognition processing. Then, this imprinting date (text data) is stored in the incidental information storage area 51b. The read-out image file is overwritten and updated by the image file storing the imprint date. If the imprint date cannot be extracted, the image file is not changed and is not updated. Such extraction processing is sequentially executed for all image files in each of the film image folder 44b and the print image folder 44c.
[0028]
If there is a print image for which the imprint date cannot be extracted by this extraction process, a secondary process is performed in which the same image is searched from the film image and the shooting time of the print image is specified. As shown in the flowchart of FIG. 6, the CPU 41 reads one image file from the print image folder 44c, which does not store the imprint date in the incidental information storage area 51a one by one, and reads the same image as this print image. Search from the image files in the image folder 44b.
[0029]
The CPU 41 reads out image files one by one from the film image folder 44b, analyzes the film image data and the target print image data, compares them, and checks the image similarity. Then, it is determined whether or not the similarity has reached the reference level. If the similarity has not reached the reference level, a comparison is made with the next film image. On the other hand, if the reference level has been reached, the compared film images are determined to be the same image. The imprint date is extracted from the same image, and this is specified as the shooting time of the print image and stored in the print image file. In a similar procedure, the imprint date extraction process from the film image is performed for all print images whose shooting times are uncertain. As a result, the number of print images whose shooting times are uncertain can be reduced.
[0030]
In the above-described embodiment, in the photographing time specifying process, a print image in which the same image whose similarity has reached the reference level is not found is terminated without performing any process. However, if the images that do not reach the reference level include similar images with different main subjects but the same background (for example, the background of the same mountain, There are cases where the number is different). Since images with the same background are considered to have the same shooting location, there is a high possibility that the images were shot at the same time. Therefore, even when there is no identical image, it is conceivable to search for such a similar image and use the imprint date of the similar image for specifying the shooting time of the print image.
[0031]
In this case, for example, the reference level of the similarity level is set in advance as a first level that can be estimated as the same image, and a second level that is lower than the first level and can be estimated as a similar image. Set by level. The first level is a similarity level corresponding to the reference level of the first embodiment, and images that have reached the first level are determined to be the same image. The second level is a similar level to the extent that the main subject is different in the image structure, but the background is the same, and an image that has reached this second level is determined as a similar image.
[0032]
In the image search, first, the same image is searched in light of the first level. This search is performed according to the flowchart of FIG. If there is the same image, the date of imprinting the same image is specified as the shooting time of the print image, and the date of imprinting is stored in the file of the print image, as in the first embodiment. If there is no identical image as a result of this processing, a similar image is searched in light of the second level.
[0033]
FIG. 7 is a flowchart showing a procedure for searching for similar images. Print images whose shooting times are uncertain are sequentially read from the print image folder. The print image and the film image are compared, and an image similarity check is performed. If the similarity level of the compared film images has reached the second level, the film image is determined to be a similar image. This similar image is recorded in association with the print image. As the association method, for example, a method of storing the file name of a film image determined to be a similar image in a print image file is used.
[0034]
When the same image is found, the date of imprinting the same image is specified as the shooting time of the print image, and stored in the print image file. Since it is not, it is better to leave it to the customer for the final decision as to whether or not the date of imprinting will be the shooting time of the print image. For this reason, the processing performed by the photo digitizer is not performed until the similar image imprint date is specified as the print image imprint date, but only until the similar image and the print image are recorded in association with each other. . A plurality of similar images may be found because the degree of similarity is lower than that of the same image. If a plurality of similar images are found, all the similar images are recorded in association with the print image. Such a similar image search process is performed for all print images for which the photographing time has not yet been determined.
[0035]
FIG. 8 shows an example of storing similar image file names in a print image file. For example, assume that film images 62 and 63 with file names “902.jpg” and “991.jpg” are found as similar images of the print image 61 with the file name “003.jpg”. In this case, the file names “902.jpg” and “991.jpg” of the similar images are stored in the incidental information storage area of the image file of the print image 61.
[0036]
In this way, it is convenient for the customer to determine the shooting time of a print image whose shooting time is not yet determined after receiving the DVD medium 12. That is, when there is a print image whose shooting time is uncertain, the customer confirms the similar image associated with the print image, and if the customer determines that it is the same time, sets the date of imprinting the similar image. It can be determined as the imprint date of the print image.
[0037]
In this case, for example, the image display software 16 may be provided with a shooting time determination function. FIG. 9 is an example of the shooting time confirmation screen 71. On the shooting time determination screen 71, a print image 61 whose shooting time is not fixed and film images 62 and 63 which are similar images are displayed. The image display software 16 reads the file name of the similar image from the file of the print image 61 and searches for the film images 62 and 63 that match the file name. When the user selects one of these film images 62 and 63, the shooting date of the selected film image is stored in the image file of the print image 61 and is determined as the shooting time.
[0038]
In the second embodiment, the similarity level for searching for a similar image has been described as an example of one level (second level). However, the similarity level for searching for a similar image is divided in more detail according to different similarities. Alternatively, similar images may be searched for each rank, and the file names of the similar images searched may be stored in the print image file for each rank. If the similarity level is lowered, the number of hit similar images also increases. Increasing the number of similar images may help the customer reinstate memory at the time of shooting.
[0039]
In the second embodiment, as a method of associating a similar image with a print image, a method of storing the file name of the similar image in the print image file is used. As another method of association, In addition to the image file, a method of creating a correspondence file in which the correspondence between the print image and its similar image is described may be used.
[0040]
In the above embodiment, a film image folder and a print image folder are provided in the storage device, and the captured image data is sorted and stored in each folder according to the reading source. Such sorting is performed. Instead, they may be stored in one image folder. Even in this case, the film image and the print image can be identified based on the reading source information in the image file.
[0041]
Further, in the above embodiment, among the captured print image data, the same image is searched from the film image data by the similar image search for those for which the imprint date cannot be extracted, but the imprint date cannot be extracted. However, the same image may be searched by performing a similar image search for all of the captured print image data. This is because in the batch digitizing service, the negative film and the photo prints printed from this negative film are stored together, so the digitized image data contains two image data with different reading sources (read from the negative film). In many cases, the obtained image data and image data read from a photographic print printed from the negative film) overlap. For this reason, if duplication information between the print image and the film image is recorded in the digitized image file, it is very convenient for the customer to rearrange the data later.
[0042]
Specifically, the duplicate information records the image file name of the corresponding same image. This duplicate information is stored in the incidental information storage area in the image file. For example, the image file whose source is a photo film stores the file name of the image file whose source is a photo print. On the other hand, the file name of the image file from which the photo film is read is stored in the image file from which the photo print is read. Based on this duplication information, the customer can check the presence or absence of the same image corresponding to a certain image file.
[0043]
In the above embodiment, a negative film is described as an example of a photographic film, but a reversal film in which an image is recorded as a positive image on the film may be used.
[0044]
【The invention's effect】
As described in detail above, the present invention is a photo digitizing method that photoelectrically reads each of a print image recorded on a photographic print and a film image recorded on a photographic film, and records the digitized image data on a storage medium. When specifying the shooting time of print image data digitized from a photo print used in the apparatus, a plurality of film image data digitized from a photo film is compared with the print image data to make an image similarity determination. The same image data whose image content is estimated to be the same as the print image data is searched from the plurality of film image data, and the imprint date extracted from the searched same image data is used as the print image shooting time. Since it was specified, in the collective digitizing service Shadow time it is possible to reduce the unknown print image.
[Brief description of the drawings]
FIG. 1 is a schematic explanatory diagram of a photo digitizing service.
FIG. 2 is an explanatory diagram showing a data storage structure in a DVD medium.
FIG. 3 is a configuration diagram of a photo digitizing apparatus.
FIG. 4 is an explanatory diagram showing a format of an image file.
FIG. 5 is an overall flowchart of an imaging time specifying procedure.
FIG. 6 is a flowchart illustrating a processing procedure for a print image with an indeterminate shooting time.
FIG. 7 is a flowchart showing a similar image search procedure.
FIG. 8 is an explanatory diagram showing a storage location of file names of similar images.
FIG. 9 is an explanatory diagram illustrating an example of a shooting time determination screen of the image display software.
[Explanation of symbols]
10 Negative film
11 Photo digitizing device
12 DVD media
17 Personal computer
31 Main unit
32 film scanner
33 Reflective scanner
41 CPU
44 storage devices
44a System folder
44b Film image folder
44c Print image folder
46 Recordable DVD drive
48 Photo digitizing program
48a Data acquisition program
48b Shooting time specific program
48c writing program

Claims (4)

A print digitized from a photographic print that is used in a photo digitizing device that photoelectrically reads a print image recorded on a photographic print and a film image recorded on a photographic film and records the digitized image data on a storage medium. In the print image shooting time specifying device for specifying the shooting time of image data,
A plurality of film image data digitized from a photographic film is compared with the print image data to determine an image similarity, and from the plurality of film image data, the print image data and the image content are estimated to be the same. Image search means for searching for the same image data,
Imprint date extraction means for extracting the imprint date imprinted in the image from the same image data retrieved by the image retrieval means,
An apparatus for specifying a shooting time of a print image, wherein the extracted imprinting date is specified as a shooting time of the print image. As the similarity level of the image similarity determination, a first level that can be estimated as the same image and a second level that is lower than the first level are set, and there is film image data that has reached the first level. The film image data is determined to be the same image data, and when there is no film image data reaching the first level, the film image data reaching the second level is determined to be similar image data. 2. The apparatus of claim 1, wherein similar image data is recorded in association with the print image data. A print digitized from a photographic print that is used in a photo digitizing device that photoelectrically reads a print image recorded on a photographic print and a film image recorded on a photographic film and records the digitized image data on a storage medium. In the print image shooting time specifying method for specifying the shooting time of image data,
A plurality of film image data digitized from a photographic film is compared with the print image data to determine an image similarity, and from the plurality of film image data, the print image data and the image content are estimated to be the same. An image search step for searching for the same image data;
And a step of specifying a print date extracted from the same image data searched by the image search means as a print time of the print image data. As the similarity level of the image similarity determination, a first level that can be estimated as the same image and a second level that is lower than the first level are set, and there is film image data that has reached the first level. The film image data is determined to be the same image data, and when there is no film image data reaching the first level, the film image data reaching the second level is determined to be similar image data. 4. A method for specifying a print image photographing time according to claim 3, wherein similar image data is recorded in association with the print image data.

Images