JP2020065159A - Film scanner device and film scanning method - Google Patents

Abstract

To provide a film scanner device and method for storing as digital data by scanning an image film such as a deformed and regressed movie film with a simple and inexpensive structure.SOLUTION: A sensor unit 1 using an area sensor scans a film 200 continuously run by a transport unit 5 and a guide unit 4. At that time, a scan range is set diagonally, and a sensor width is adjusted to a film width by adjusting an angle without using a zoom lens. Image processing is performed on the acquired image to obtain one frame of film. When the sensor is set diagonally, since the obtained data is in a state with an oblique angle, the scan angle is recorded and corrected on the basis of it to obtain a correct image. Further, content of the image on the film 200 and a damage state are acquired at once according to a difference in a type of a light source of a light source unit 3. As a result, it is possible to understand where and what kind of damage has occurred in a movie film and to use it in a plan for storage and restoration.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a film scanner device and a film scanning method, and more particularly to a film scanner device and a film scanning method for digitizing an image film such as a motion picture film in an arbitrary format.

Devices for converting motion picture film into electrical video signals have historically been developed primarily for conversion into television signals. Such a device is called a telecine device and is premised on transmission by television radio waves, and thus the output video has a band limitation. Also, the output signal of the device is premised on real-time video output so that it can be transmitted as it is by radio waves or connected to a video device for recording.
In the early 1990s, Eastman Kodak Co., Ltd. put into practical use a system and device (Cineon) for acquiring images as digital data. Since the acquired image is supposed to be handled by a computer, it was not bound by the TV standard, and there was no limit on the scanning time.
Initially, the telecine device and the film scanner device were clearly distinguished as having different design concepts and uses. Roughly speaking, the one that converts captured frames in real time into a video signal is called a telecine device, and the one that converts digital data into a digital data is called a film scanner device. ing.

The conventional film scanner device (and telecine device) has an intermittent running (scraping) system that combines the same mechanism as a movie camera or a projector, a flying spot scanner (FSS) system that continuously runs the film, a laser system, There are line sensor system, high-speed shutter system, rotating prism system and so on.
What is common to many is that it is difficult to deal with films of different widths (formats) and films that have been deformed or regressed due to deterioration over time. For example, optical scanning (changing the distance between the film and the lens, using a zoom lens, etc.) is required when scanning both the 35 mm film and the 16 mm film at 4K resolution.

1. Intermittent driving method In this method, the film is stopped frame by frame using a mechanism similar to that of movie cameras and projectors, and a digital camera is used for shooting.
It is also used in high-end machines such as ARRISCAN manufactured by ARRI of Germany, but it is used in many inexpensive devices because it is possible to modify and produce existing projectors.
The disadvantage is that the machine parts require high accuracy and sufficient maintenance, and are disadvantageous in terms of speed compared to continuous running, resulting in higher operating costs. In an inexpensive device that directly uses the mechanism of the projector, the stress applied to the film is strong and there is a possibility of breakage. With the exception of high-end machines equipped with a special mechanism, it is difficult to handle films that have been deformed or regressed over time. Further, in order to obtain the same or similar resolution for films having different widths, it is necessary to devise an optical device.

2. FSS system In this system, a cathode ray tube is used as a light source. A raster image of a cathode ray tube scanned by an electron beam (same brightness over the entire surface) is formed on the film. The transmitted light is received by the photoelectric conversion device to obtain a video signal. As a mechanism for tracking a raster image on a continuously running film, there are a vibrating mirror type (Thomson Co., France), a jump scan type (UK Sintel), a digiscan type (UK Sintel).
Since the obtained resolution depends on the resolution of the raster image formed on the film, an optical device is required to obtain the same or similar resolution for films having different widths.

3. Laser system In this system, instead of the raster image of the cathode ray tube in the FSS system, the film is directly scanned with laser light and the light is received by a photoelectric conversion device to obtain a video signal.
It is expected that adjustment and operation will be difficult due to the use of laser light.

4. Line sensor system In this system, a line sensor is used to continuously run a film to obtain an image. Some high-end machines use a plurality of line sensors to obtain high resolution.
Optical contrivance is required to obtain the same or similar resolution for films having different widths.

5. High-speed shutter system This system uses an area sensor camera. A surface light source is used for the background of the film. The film is run continuously. The camera shoots when one frame on the film enters the shooting range of the camera. A sensor installed separately from the camera to match the timing detects the running state of the film. You can obtain an image without motion blur by increasing the shutter speed of the camera or flashing the surface light source at high speed.
Optical contrivance is required to obtain the same or similar resolution for films having different widths.

6. Rotating Prism Method In this method, one frame is optically stopped by rotating the prism in accordance with the continuously running film, and the image is taken. A similar mechanism using a prism is also used in Steinbeck of a film editor.
It is expected that it will be very difficult to deal with multiple film formats and films that have been deformed or regressed over time.

Further, conventionally, various film scanners have been developed for scanning an image film and storing it as digital data.
For example, Patent Document 1 describes "a film scanner device capable of eliminating a color shift caused by a difference in transmission characteristics of light components of respective colors of an image film" (abstract).
Japanese Patent Application Laid-Open No. 2004-242242 discloses, "A scanner that generates a color component signal, which has an illuminating device for illuminating or transmitting an image, a plurality of monochromatic light sources, and a plurality of scanning elements, and In a scanner of the type that converts light obtained from the image that is illuminated or transilluminated into color component signals, the illumination device is configured such that the plurality of monochromatic light sources illuminate different positions of a film frame. However, the sensors are each arranged to be illuminated by the corresponding light source "(see summary).
Further, in Patent Document 3, "" is a system for filing motion picture film material, and since technical means possible during display or processing in a subsequent stage can be used, The image information and at least another information provided on the film are optically scanned to make the information available as digitized data, the scanned information is not converted to the original information content and the storage device The display device stores the data obtained as digital data from the film scanner, and the display device separates the data reproduced by the storage device according to the original position of the original film on the film, and separates the data. Film scanner, which can be used as a data signal "(abstract).
Patent Document 4 describes a film scanner device and a film scanning method for scanning a plurality of types of image films such as movie films and storing them as digital data with a simple and inexpensive structure "(abstract). .

Japanese Unexamined Patent Publication No. 8-204904 Japanese Unexamined Patent Application Publication No. 11-317958 JP, 11-168663, A JP, 2017-188720, A

Generally, there are various standards for the width of motion picture film, and as a typical example, a film width of 70 mm to 8 mm is used (eg, 8 mm, 9.5 mm, 16 mm, 35 mm, 65 mm, 70 mm). etc). There are also various standards for resolution, such as 2K, 4K, and 8K video formats. The number of pixels is, for example, 2048 × 1080 pixels in 2K, 4096 × 2160 pixels in 4K, and 7680 × 4320 pixels in 8K video format.
There are various standard films for motion pictures, for example, as described above, and there is a demand for film scanners to digitize films having different widths with the same or similar resolution. For that purpose, for example, a zoom mechanism may be attached to a lens attached to the image sensor. However, such a zoom mechanism complicates the optical system and is expensive.
On the other hand, as a simple method for obtaining high resolution in a sensor that scans a film, for example, the size of the sensor may be increased. However, increasing the size of the sensor complicates the sensor and the optical system and increases the cost.

Further, in each of the above-described conventional methods, (1) correspondence to a deformed / regressed film and (2) correspondence to a film having a different width are as follows. It should be noted that, in the following, "it is possible if it is a film feed mechanism that does not use a sprocket", but in reality it is assumed that the acquired image will be unstable unless a mechanical stabilizing mechanism such as a sprocket is installed. To be done.

Intermittent driving method (1) Compatible with some ultra high-end machines. Other than that (2) Some super high-end machines can handle this. Otherwise impossible

FSS system (1) Any film feed mechanism that does not use sprockets is possible.
(2) It is not impossible, but requires considerable devise in terms of electro-optics.

Laser method (1) Any film feed mechanism that does not use sprockets is possible.
(2) It is not impossible, but requires considerable devise in terms of electro-optics.

Line sensor method (1) Any film feed mechanism that does not use sprockets is possible.
(2) Optical devise is required.

High-speed shutter system (1) Any film feed mechanism that does not use sprockets is possible.
(2) Optical devise is required.

Rotating prism method (1) Normally impossible because the rotating prism and sprocket are integrated.
(2) It is not impossible, but requires considerable optical ingenuity.

In view of the above points, the present invention provides a film scanner device and a film scanning method with a simple and inexpensive structure for scanning an image film such as a deformed / regressed movie film and storing it as digital data. With the goal.

According to the first solution of the present invention,
A film scanner device,
A first light source for acquiring a content image with a surface light source or a light source that has passed through a diffusion plate; a second light source for acquiring a damage image with a point light source, a parallel light source, or an infrared light source; and the first light source. And a switching unit for switching the irradiation by the light source or the second light source, and the switching unit switches the first light source or the second light source in the same irradiation area in a time-division manner to convey an image film. A light source for irradiating,
A sensor unit for scanning the image film by detecting transmitted light or reflected light of the conveyed image film,
A guide unit for sending an image film between the optical positions of the light source unit and the sensor unit,
An image film along the guide unit, a transport unit that continuously feeds at a constant speed or a predetermined speed pattern,
Storage part,
A processing unit,
Equipped with
The processing unit is
The first and second light sources are irradiated in a time-division manner, and four times or four times (n is an even number of 4 or more) are alternately detected by the sensor unit for one frame of the image film. Further, an n-fold image is detected in a time division manner, and two or (n / 2) content images detected by the first light source and two or (n / 2) content images detected by the second light source are detected. Input the damage situation image from the sensor part,
Based on two or (n / 2) content images for one frame and two or (n / 2) damage status images, one frame image is composed from a plurality of images alignment processing. By executing the reconstruction process, a content image of one frame and a damage status image of one frame are formed, and output digital image data in which the content image of one frame and the damage status image of one frame are associated with each other in the storage unit. Remember,
A film scanner device is provided.

According to a second solution of the invention,
A film scanner device,
A first light source for obtaining a content image by a surface light source or a light source that has passed through a diffusion plate, and a second light source for obtaining a damaged image by a point light source, a parallel light source, or an infrared light source, A first light source and the second light source, which are arranged by space division in the transport direction of the image film, and which illuminate the transported image film;
A sensor unit for detecting transmitted light or reflected light of the conveyed image film, scanning the image film, and detecting the irradiation area of the first light source and the irradiation area of the second light source by space division.
A guide unit for sending an image film between the optical positions of the light source unit and the sensor unit,
An image film along the guide unit, a transport unit that continuously feeds at a constant speed or a predetermined speed pattern,
Storage part,
A processing unit,
Equipped with
The processing unit is
With respect to one frame of film, the sensor unit that detects at a speed of a plurality of sheets detects the plurality of content images by the first light source, which is detected by space division in the transport direction of the image film, and the second image. Input multiple damage situation images from the light source of
Based on a plurality of content images and a plurality of damage situation images for one frame, the alignment process of the plurality of images and the reconstruction process of constructing one frame image from the plurality of images are executed, whereby the content image of one frame And a damage condition image of one frame is formed, and output digital image data in which the content image of one frame and the damage condition image of one frame are associated with each other are stored in the storage unit.
A film scanner device is provided.

According to a third solution of the invention,
A film scanner device,
A light source section,
A sensor unit using an area sensor for scanning the image film by detecting transmitted light or reflected light of the conveyed image film,
A guide unit for sending an image film between the optical positions of the light source unit and the sensor unit,
An image film along the guide unit, a transport unit that continuously feeds at a constant speed or a predetermined speed pattern,
An angle setting unit for manually or automatically setting and setting the angle of the sensor unit by making an angle or rotation with respect to the film running direction on a plane parallel to the film surface and outputting the set angle information. When,
Storage part,
A processing unit,
Equipped with
The processing unit is
The angle setting unit adjusts the scan range or width to the film width of the image film so that the scan range or width of the sensor unit covers the perforations on both sides of the image film or the area including only one perforation. Input the angle information of the sensor unit set by turning or rotating to the angle setting unit,
By setting the transport speed of the image film by the transport unit and the detection speed by the sensor unit, one frame on the image film continuously transported by the sensor unit is detected a plurality of times, and the image detected by the sensor unit is digital. A plurality of input digital image data is input from the sensor unit for one frame that has been digitized,
Based on a plurality of input digital image data for one frame, a tilt correction process for returning the tilt of the image to the original according to the angle information is executed, the alignment process of the plurality of images and the reconstruction of one frame image from the plurality of images. By executing the configuration process, each one frame of output digital image data is formed and stored in the storage unit.
A film scanning device is provided.

According to a fourth solution of the present invention,
A film scanner method in a film scanner device, comprising:
The film scanner device is
A first light source for acquiring a content image with a surface light source or a light source that has passed through a diffusion plate; a second light source for acquiring a damage image with a point light source, a parallel light source, or an infrared light source; and the first light source. And a switching unit for switching the irradiation by the light source or the second light source, and the switching unit switches the first light source or the second light source in the same irradiation area in a time-division manner to convey an image film. A light source for irradiating,
A sensor unit for scanning the image film by detecting transmitted light or reflected light of the conveyed image film,
A guide unit for sending an image film between the optical positions of the light source unit and the sensor unit,
An image film along the guide unit, a transport unit that continuously feeds at a constant speed or a predetermined speed pattern,
Storage part,
A processing unit,
Equipped with
The processing unit is
The first and second light sources are irradiated in a time-division manner, and four times or four times (n is an even number of 4 or more) are alternately detected by the sensor unit for one frame of the image film. Further, an n-fold image is detected in a time division manner, and two or (n / 2) content images detected by the first light source and two or (n / 2) content images detected by the second light source are detected. Input the damage situation image from the sensor part,
Based on two or (n / 2) content images for one frame and two or (n / 2) damage status images, one frame image is composed from a plurality of images alignment processing. By executing the reconstruction process, a content image of one frame and a damage status image of one frame are formed, and output digital image data in which the content image of one frame and the damage status image of one frame are associated with each other in the storage unit. Remember,
A film scanner method is provided.

According to a fifth solution of the present invention,
A film scanner method in a film scanner device, comprising:
The film scanner device is
A first light source for obtaining a content image by a surface light source or a light source that has passed through a diffusion plate, and a second light source for obtaining a damaged image by a point light source, a parallel light source, or an infrared light source, A first light source and the second light source, which are arranged by space division in the transport direction of the image film, and which illuminate the transported image film;
A sensor unit for detecting transmitted light or reflected light of the conveyed image film, scanning the image film, and detecting the irradiation area of the first light source and the irradiation area of the second light source by space division.
A guide unit for sending an image film between the optical positions of the light source unit and the sensor unit,
An image film along the guide unit, a transport unit that continuously feeds at a constant speed or a predetermined speed pattern,
Storage part,
A processing unit,
Equipped with
The processing unit is
With respect to one frame of film, the sensor unit that detects at a speed of a plurality of sheets detects the plurality of content images by the first light source, which is detected by space division in the transport direction of the image film, and the second image. Input multiple damage situation images from the light source of
Based on a plurality of content images and a plurality of damage situation images for one frame, the alignment process of the plurality of images and the reconstruction process of constructing one frame image from the plurality of images are executed, whereby the content image of one frame And a damage condition image of one frame is formed, and output digital image data in which the content image of one frame and the damage condition image of one frame are associated with each other are stored in the storage unit.
A film scanner method is provided.

According to a sixth solution of the present invention,
A film scanner method in a film scanner device, comprising:
The film scanner device is
A light source section,
A sensor unit for scanning the image film by detecting transmitted light or reflected light of the conveyed image film,
A guide unit for sending an image film between the optical positions of the light source unit and the sensor unit,
An image film along the guide unit, a transport unit that continuously feeds at a constant speed or a predetermined speed pattern,
An angle setting unit for manually or automatically setting and setting the angle of the sensor unit by making an angle or rotation with respect to the film running direction on a plane parallel to the film surface and outputting the set angle information. When,
Storage part,
A processing unit,
Equipped with
The processing unit is
The angle setting unit adjusts the scan range or width to the film width of the image film so that the scan range or width of the sensor unit covers the perforations on both sides of the image film or the area including only one perforation. Input the angle information of the sensor unit set by turning or rotating to the angle setting unit,
By setting the transport speed of the image film by the transport unit and the detection speed by the sensor unit, one frame on the image film continuously transported by the sensor unit is detected a plurality of times, and the image detected by the sensor unit is digital. A plurality of input digital image data is input from the sensor unit for one frame that has been digitized,
Based on a plurality of input digital image data for one frame, a tilt correction process for returning the tilt of the image to the original according to the angle information is executed, the alignment process of the plurality of images and the reconstruction of one frame image from the plurality of images. By executing the configuration process, each one frame of output digital image data is formed and stored in the storage unit.
A film scanning method is provided.

According to the present invention, it is possible to provide a film scanner device and a film scanning method for scanning an image film such as a deformed / regressed movie film and storing it as digital data with a simple and inexpensive structure.

The block diagram of the film scanner of 1st Embodiment. The block diagram of a cleaning part. The block diagram of the sensor part which used the area sensor. Explanatory drawing about the angle setting of the image film using an area sensor. The block diagram about the system which changes the position by one camera. The block diagram about the time difference system by one camera. Explanatory drawing about image processing (1) when an area sensor is used. Explanatory drawing about image processing (1) of a content image and a damage situation image when an area sensor is used. Explanatory drawing about image processing (2) when an area sensor is used. Explanatory drawing about image processing (2) of a content image and a damage situation image when an area sensor is used. The block diagram of the control part of 1st Embodiment. 6 is a flowchart of image processing performed by the processing unit of the film scanner. Explanatory drawing of the format of an output image file. Explanatory drawing (1) about output digital image data with respect to various image films. Explanatory drawing (2) about output digital image data with respect to various image films. The block diagram of the film scanner of 2nd Embodiment. The block diagram of the control part of 2nd Embodiment. The block diagram about the system which changes the position by two cameras.

A. Overview

In one of the embodiments, for example, an area sensor is used to scan a film that has been continuously run. At that time, the scan range or width is set obliquely, and the sensor width is adjusted to the film width by adjusting the angle without using the zoom lens. With this method, it is not necessary to care about the size of the sensor, and it is possible to prevent the optical system from becoming complicated. In addition, the obtained image is processed to obtain one frame of film. For example, when the sensor is set diagonally, the obtained data is in a state with an oblique angle, so the scan angle is recorded as metadata (additional data) and corrected based on that to obtain a correct image. To get This allows a motion picture film to be scanned at an arbitrary resolution with a simple device without changing the shooting distance or using a zoom lens.

Further, according to one of the embodiments, for example, a frame is specified by image processing, and therefore, a film deformed due to deterioration can be dealt with.

Further, in one of the present embodiments, for example, the content of the image on the film and the damage status are acquired at once depending on the type of the light source. As a result, it is possible to understand where and what kind of damage has occurred in the motion picture film and to use it in a plan for storage and restoration.

One of the present embodiments is basically related to an inexpensive film scanner, but it is also aimed at omitting the trouble of the entire scanning work, rather than simply producing inexpensive parts similar to a high-grade machine. There is. Usually, it is necessary to confirm the condition of the film before passing the film through the scanner device. This is a labor-consuming and time-consuming process of manually rewinding the film and visually confirming it. One of the embodiments can have not only a function as a "scanning device" but also a function that "a deterioration state of the film can be determined to some extent". Conventionally, an experienced person having know-how was required to judge the state of the film, but in the case of one of the present embodiments, the person who handles the apparatus may not have abundant experience regarding the film. Absent. It also has the advantage of being able to scan even things whose state is unknown.

Furthermore, in one of the present embodiments, for example, by providing a cleaning unit, it is possible to remove adhering substances (dust, dust, dust, etc.) on the film before scanning the film.

B. Configuration of film scanner (first embodiment)

FIG. 1 shows a block diagram of the film scanner of the first embodiment.
The film scanner 100-1 includes a sensor unit 1, a control unit 2, a light source unit 3, a guide unit 4, a conveyance unit 5, and a cleaning unit 6, and scans the image film 200 to acquire digital image data. The cleaning unit 6 may be omitted.
The image film 200 includes, for example, an image film such as a shooting film and a projection film, and other image films. Further, as the image film 200, a movie film having various film widths, lengths, thicknesses, materials, and the like, or a film other than a movie can be used. As the image film 200, various screen ratios (4: 3, 16: 9 (wide), further wide, etc.) and aspect ratios can be used. Further, as the image film 200, an image film having perforations on one side, an image film having perforations on both sides, or an image film having no perforations can be used.
The guide unit 4 is a mechanism for feeding the image film 200 between the light source unit 3 and the sensor unit 1 (an optical position). The guide unit 4 is configured to make the deformed / degenerated film somewhat flat and photograph it. For example, the shooting part is stabilized by a roller that rotates freely.
The transport unit 5 is a mechanism that continuously feeds the image film 200 along the guide unit 4. In this figure, a reel type is shown as an example, but the present invention is not limited to this, and a drum type or a conveying device having an appropriate structure can be used. By the guide portion 4, for example, the image film 200 can be suppressed flat or distortion can be suppressed.
The light source unit 3 irradiates the image film 200 conveyed through the guide unit 4 with light. In the drawing, the sensor unit 1 is provided on the upper side of the image film 200 and the light source unit 3 is provided on the lower side, but conversely, the sensor unit 1 is provided on the lower side of the image film 200 and the light source unit 3 is provided on the upper side. You may do it.

FIG. 2 shows a configuration diagram of the cleaning unit.
The cleaning unit 6 is installed in front of the image acquisition area (mainly the sensor unit 1, the light source unit 3, and the guide unit 4). This removes dust and dirt on the film surface. The cleaning unit 6 is replaceable, and a combination of an adhesive roller, a chemical and an adsorbent is selected according to the condition of the film.

FIG. 3 shows a block diagram of a sensor unit using an area sensor.
The sensor unit 1 includes a sensor 1a, an angle setting unit 1b, an optical system (not shown), and a signal processing unit (not shown).
The sensor 1a includes an area sensor. The sensor 1a scans the film which is continuously run using a part thereof. At that time, the scan range or width is set to a right angle or an angle according to the film width. Image processing is performed on the acquired image to obtain one frame of film. The image sensor includes CMOS, CCD, and the like depending on the configuration of the internal circuit, and there are various types such as color / monochrome and the number of pixels, but the type is not limited when used in the apparatus of this system.
The angle setting unit 1b can fix the sensor 1a at an angle with respect to the film traveling direction at a plane parallel to the film surface or by rotating the sensor 1a. The angle fixing portion 1b is fixed to the main body of the film scanner 100-1 by a supporting portion 1b-1, and the rotating portion 1b-2 provided with the sensor 1a is rotated or angled and fixed by the supporting portion 1b-1. It has a mechanism. The angle setting unit 1b may have a configuration in which the angle can be discretely set by a fixing means such as a notch or a fixing screw, or can be continuously variable. Alternatively, one end of the sensor 1a may be used as a rotation axis and the other end may rotate around it.
The sensor 1 a detects the light transmitted by the irradiation of the light source unit 3 through the image film 200 conveyed through the guide unit 4. At that time, the sensor 1a scans the image film 200 at a predetermined scanning cycle by the transportation of the image film 200 by the transport unit 5. The sensor 1a may have, for example, a width that can cover a predetermined maximum film width (or a scan target in advance) of a plurality of types of image films 200 for scanning. Further, as the resolution of the sensor 1a, it is possible to use one having a predetermined number of pixels corresponding to a desired predetermined resolution. As an example, assuming that the film width is 70 mm at maximum and the resolution is 4K (4096 pixels by 2016 pixels), the sensor 1a should have a scan range or width of 70 mm in width and 4096 pixels, for example. You can

FIG. 4 shows an explanatory view of the angle setting of the image film using the area sensor.
For example, as shown in FIGS. 4A and 4B, when scanning a 35 mm film, a 16 mm film or the like having a narrower width, the angle setting unit 1b rotates the width of the same sensor 1a according to the film width. Fixed and set.
The detection signal of the sensor 1a is A / D converted by the signal processing unit inside the sensor unit 1, and the sensor unit 1 outputs digital image data. The signal processing circuit may be appropriately provided outside the sensor unit 1, inside the control unit 2, or the like.
The sensor unit 1 may be configured to detect black and white or gray digital image data, or may be configured to detect color digital image data. The configuration of the sensor unit 1, the light source unit 3, and the like when detecting color digital image data is, for example, as described in Patent Document 1 or 2, an optical system such as a color filter, a spectral mirror, a lens, and the like. It can be configured using a detector or the like.
Further, as the sensor 1a, a plurality of types having a desired condition such as a scan range, a length, a width, a number of pixels, a black / white / gray or color detection element are prepared and are configured to be replaceable. Good.
Further, as the optical system of the light source section 3 and / or the sensor section 1, for example, an object side telecentric, an image side telecentric, a double side telecentric, etc. may be adopted.
In the above example, the sensor section and the light source section 3 have been described as having a configuration of scanning the transmitted light of the image film 200, but the configuration is not limited to this, and the configuration of scanning the reflected light of the image film 200 may be used.

It should be noted that the operation image of the area sensor can be thought of as having many line sensors arranged side by side. The area sensor may be disadvantageous in terms of shooting speed when compared to the line sensor, but if you cover the area and shoot at a sufficiently high shutter speed and frame rate, one frame on the film will be multiple. It can be photographed once. For example, when shooting an image with a size that covers the full width of the shooting range of the area sensor, if the angle is set, the edge will be cut off, so it is advisable to set the area slightly inside.

Further, for example, in FIG. 4 (A), the case where the area covered by the 35 mm image film is about 1.5 frames instead of 2 frames is shown, but this is only an example. You may make it cover two or more frames. Even if it covers about 1.5 frames, a complete one frame can be obtained by connecting a plurality of sheets as shown in, for example, FIG. 9A or 9B described later. As described above, as long as the film width of the image film 200 can be covered, for example, the filming range in the transport direction may not be completely covered by one frame (or may be one frame or less). Also, one or more frames may be covered.

C. Acquisition of film content image and damage situation image

In one of the present embodiments, the content image and the damage situation image can be acquired by the specific light source unit 3 and the image processing. The content image is, for example, an image showing the content / content of each frame of the image film, and the damage status image is, for example, an image showing damage such as a scratch on each frame of the image film.
It is assumed that relatively shallow scratches are also displayed in the damage status image. The purpose of visualizing scratches that cannot be seen in the content image is to search for deep scratches. Deep scratches also affect the content image. There is software that automatically repairs scratched images to some extent, but it is not always perfect. For example, there seems to be a laughing story that the snow falling in the snow scene was judged to be dust and was all erased. Therefore, it is possible to find deep scratches by assuming that there may have been some kind of physical accident in the area with serious damage and that shallow scratches are also increasing at the same time compared to others. Then, look for shallow scratches that do not appear in the content image.

In one of the present embodiments, a content image representing the content of the film and a damage status image representing the status of damage can be acquired at once or in a series of processes depending on the type of light source.
The light source for acquiring the content image is, for example, a surface light source (diffusion plate and LED, organic EL, or the like). This makes it difficult to see relatively shallow scratches. On the other hand, the light source for acquiring the damaged image is, for example, a point light source or a parallel light source. This makes it possible to clearly see elements other than the photographic image, such as scratches, dust, and mold. Further, when photographing a damage situation image, for example, in the case of a color film, if infrared rays are used, the transmittance of the content image becomes high, so that the situation such as a scratch becomes easier to understand.

Regarding the shooting of the content image and the damage status image, there are the following methods regarding the proper use of the light source.

(1) Configuration to change position (space division)
FIG. 5 shows a configuration diagram of a method of changing the position by one camera.
In FIG. 5, the case where the film is scanned with two light sources and one camera will be described.
The light source unit 3 has a diffusion plate and a light source such as an LED or an organic EL, and has a light source 3b that is a surface light source for acquiring a content image and a light source such as an LED or an organic EL to obtain a damaged image. A point light source or a parallel light source 3a is provided.
When shooting is performed by the sensor unit 1 having one camera, an area sensor camera is used, and the scanning range is set to be larger than one frame or two or more frames, and the range larger than one frame or Shoot in two frames with different light sources in the background. The image acquisition method in this case is basically the same as the method using the area sensor shown in FIG. 7 described later. For example, it can be considered that two area sensors are closely arranged side by side.

FIG. 17 shows a configuration diagram of a system in which the positions of two cameras are changed.
In FIG. 5, the sensor unit 1 has one camera, but FIG. 12 shows this modification, and the sensor unit 1 has two cameras 1a and 1b. When shooting, the scanning range of each of the cameras 1a and 1b is set to be a range larger than one frame of the film or two or more frames, the camera 1a shoots with the light source 3a as the background, and the camera 1b with the light source 3b as the background. To shoot as. The image acquisition method in this case is the same as the method using the area sensor shown in FIG.

(2) Configuration that changes with time (time sharing)
FIG. 6 shows a block diagram of a time difference method using one camera.
Light from the light sources 3a and 3b is applied to the same place / area on the film via a switching unit (for example, a mirror) 3c. The processing unit switches the light source in a shorter time than when the continuously running film passes through the scanning range. When using an area sensor camera (sensor unit 1), set a sufficiently high shutter speed and the number of frames per second to capture images, and capture images from different types of light sources for the same frame on film. To do.

In the method as shown in FIG. 6, the method using the area sensor has the following merits, for example.
First, the area sensor has a richer product lineup than the line sensor, and especially the color sensor is cheaper. In addition, when trying to obtain a higher number of pixels, either method can reduce the traveling speed of the film to make the sampling finer, but with a line sensor, it is always the number of pixels of the line sensor itself in the vertical or horizontal direction of the image. Is the maximum value. The area sensor may be inferior to the line sensor in pixel density, but the maximum value is not limited. You can increase the number of pixels by taking a shallow angle and increasing the number of shots (though increasing the number of pixels does not mean that the resolution capability will increase indefinitely).
As for the illumination method, it is considered that the method of FIG. 6 can probably make the apparatus more compact than the method of FIG.

D. Image processing for each frame

How and how to deal with the deformed / regressed film will be described below.
In general, the standard for movie films is defined in addition to the width of the film itself, the size of perforations, the distance between perforations, the vertical and horizontal sizes of images, and the like. Even if it is deformed / regressed due to deterioration over time, it can be thought that it was originally such a size, so even if it is deformed at the time of shooting, it should be restored to the standard size by image processing. Is the basic idea. The problem at this time is that the sprocket (gear) and pins (claws that feed and stop the film) of the film feeding device used in other devices are designed according to the standard size, so they deteriorate and form. It may be difficult to deal with something that has changed. For example, the teeth or pins of the sprocket may touch the non-perforated portion, causing scratches or tears. In the existing device, so-called gears and pins are used to determine the frame before the image is acquired, whereas in this device, the image is first acquired and then the frame is determined on the image. Therefore, neither sprockets nor pins are used.
In the case of the system using the area sensor, it is possible to flexibly cope with a change in traveling speed. Even if the actual film is severely deformed, it can be scanned at least if it can be wound and the frame can be seen by human eyes.

The area sensor acquires images diagonally or at right angles. 7 and 8 shown below, the motion picture film 200 to be scanned in both flows from left to right. The actual motion picture film 200 is not a square as shown in the figure, but a strip-shaped extremely long rectangle, but here, for convenience of explanation, it is assumed that square film regions A to I on the film are noted. You can think of it as one frame of a movie film. In each figure, the upper figure shows the case where the sensor is orthogonal to the film, and the lower figure shows the case where the sensor is obliquely angled with respect to the film. Note that, for simplification of description, the oblique angle is about 45 degrees as an example.

FIG. 7 is an explanatory diagram of the image processing (1) when the area sensor is used.
In the upper diagram of FIG. 7, as shown in the table on the right side, sensors for detecting the film regions A to I of the motion picture film 200-1 (for example, 70 mm width) at each time (n, n + 1, n + 2) Areas 1 to 9 are shown. In the table, for example, at time n, the film areas C, F, and I are detected by the sensor areas 1, 4, and 7, respectively. At time n + 1, the film areas A to I are detected by the sensor areas 1 to 9, respectively. Also, at time n + 2, the film areas A, D, and G are detected by the sensor areas 3, 6, and 9, respectively. In this way, all data of each film area A to I of the film 200 is acquired.
In the lower diagram of FIG. 7, the film regions A to I of the motion picture film 200-2 (for example, 35 mm width, 16 mm width, etc.) at each time (n, n + 1, n + 2) are detected as shown in the table on the right side. The sensor areas 1 to 9 are shown. If the sensor area (or scan range or width) is detected at right angles to the film as shown in the upper diagram of FIG. 7, only a part of the sensor area is detected and the resolution is degraded. Is assumed. Therefore, in this embodiment, as shown in the lower diagram of FIG. 7, the sensor region is set obliquely with respect to the traveling direction of the film. In the table, for example, at time n, the film area F is detected by the sensor area 7. The parentheses indicate that the film areas C and I are detected by the sensor areas 4 and 7, and 7 and 8, respectively. At time n + 1, the film areas C, E, and I are detected by the sensor areas 4, 7, and 8, respectively. It should be noted that the film areas B, F and H are detected by the sensor areas 4 and 7, 4 and 5, 7 and 8, 7 and 8, respectively. At time n + 2, the film areas A, C, E, G, and I are detected by the sensor areas 4, 2, 5, 8, and 6, respectively. The film areas B, D, F and H are detected in the sensor areas 1 and 2, 4 and 5, 4, 5 and 7 and 8, 2 and 3, 5 and 6, 5 and 6 and 8 and 9, respectively. It means to be done. In this way, all the data of each film area A to I of the film 200-2 is detected by the entire (or almost the entire) sensor area (or scan range or width), and the image of the film 200-2 is high. It is acquired at the resolution (for example, the same or similar resolution as the upper diagram of FIG. 7).

FIG. 8 is an explanatory diagram of the image processing (1) of the content image and the damage status image when the area sensor is used.
This figure is an explanatory diagram in the case where the configuration “(1) configuration for changing position” of FIG. 5 is adopted.
The area sensor photographs the range of the sensor area 1c (it may be considered that an image of the motion picture film 200 is formed on the sensor area 1c of the area sensor). While the motion picture film 200 is passing through the field of view (or while the image of the motion picture film 200 is passing over the sensor), the sensor takes many pictures at high speed. By connecting them by image processing (for example, a digital camera panoramic picture), searching for perforations in the film in the image, and finding one frame based on that, the entire one frame is taken at the time of shooting. Even if you don't catch it, you can get a complete frame later.
In FIG. 8, the light source for shooting the film is a light source 3a for the damage situation image on the left side and a light source 3b for the content image on the right side, which are different types. The character "a" is shown in the area of the area sensor where the movie film 200 is imaged by the light source 3a, and the character "b" is shown in the direction of the light source 3b).
In the top view of FIG. 8, the sensor is not angled. Therefore, the area a and the area b are divided into two right and left in the center of the sensor. When the sensor is rotated to make an angle, it is divided into a and b by diagonally crossing the sensor as shown in the lower left figure. In the lower diagram of FIG. 8, the sensor is angled.
When the film is moved, the damage status image can be acquired by the sensor in the area a and the content image can be acquired by the sensor in the area b.

FIG. 9A is an explanatory diagram of the image processing (2) when the area sensor is used.
FIG. 9B is an explanatory diagram of the image processing (2) of the content image and the damage status image when the area sensor is used. FIG. 9B is an explanatory diagram when the configuration “(3) configuration that changes in time” of FIG. 6 is adopted.
Hereinafter, as an example, description will be made assuming that the traveling speed of the motion picture film is 24 frames per second (24 FPS), which is the same as that at the time of screening. In addition, as an example, the image sensor (area sensor) is set to 96 FPS, which is four times as large as the image capturing.
In this case, the relationship between the traveling speed of the film and the driving speed of the sensor is expressed by the following equation.
Film traveling speed (FPS) × number of light sources (type of image to be acquired) × 2 = sensor drive speed (FPS)

In FIG. 9A, it is assumed that there is one type of light source, but it is also possible to sequentially switch three types of RGB light sources and obtain a color image with a monochrome sensor. The switching frequency of the light source depends on the sensor driving speed. With the settings assumed this time, one type of light source switches every 1/96 second. FIG. 9A shows a state in which four images are acquired by a sensor that is driven at a speed four times higher than one frame of film. One to four images are taken for each frame of film. Since the film runs continuously, only one frame of the film is partially captured in the acquired image (raw), so that one complete frame and the acquired image (completed) are obtained by connecting them by image processing. At that time, a content image of one frame and a damage situation image of one frame are formed by executing a positioning process of a plurality of images and a reconstruction process of forming an image of one frame from the plurality of images.

  Further, in FIG. 9B, it is assumed that there are two types of light sources (content confirmation and damage confirmation), but it is also possible to sequentially switch three types of RGB light sources and obtain a color image with a monochrome sensor. . The switching frequency of the light source depends on the sensor driving speed. With the settings assumed this time, the two types of light sources, light source (A) and light source (B), switch every 1/96 second. FIG. 9B shows a state in which four images are acquired by a sensor driven at a speed four times higher than that of one frame of film. The first and third images are taken by the light source (A), and the second and fourth images are taken by the light source (B). Since the film runs continuously, one frame of the film is only partially captured in the acquired image (raw), so that one complete frame, the acquired image (completed) is obtained by joining the films by image processing. At that time, a content image of one frame and a damage status image of one frame are formed by executing a positioning process of a plurality of images and a reconstructing process of forming an image of one frame from the plurality of images.

At this time, for example, a person can judge and manually determine which frame is suitable as the first frame. Alternatively, the processing unit may automatically determine which frame is the first image by recognizing a frame in which an image is not captured and / or a frame in which an image is captured. If the selection of the first frame is inappropriate, it is assumed that the acquired image (completed) obtained by combining the images by image processing will be at a position displaced from the targeted frame of the film. Once the first frame is determined, the acquired images can be processed as "a set of four images".
The acquired images (raw images) may be organized by, for example, file names “cap_000” to “cap_003” of the serial number images, or “TC00” in the case of a format corresponding to the time code (TC) such as DPX. "00: 00: 00: 00" to "TC 00: 00: 00: 03", or may be set as appropriate. (Although TC has affinity with video editing software, it is assumed that it is simpler to process files with serial file names.)
The acquired image (completed) is saved by giving an alias to the acquired image (raw) (for example, cap_000, cap_002 to dst_a_000 are generated, and cap_001 and cap_003 to dst_b_000 are generated and saved).
As described above, when the traveling speed is set to 24 FPS, the film image for 1 second is scanned for 1 second. When it is desired to increase the number of samplings for super-resolution over time, it means that the traveling speed of the film is reduced and the speed ratio of the film and the sensor is increased.

As a technique related to the present invention and / or the embodiment, there is a pixel shift and a method of measuring a resolution (MTF) called an oblique edge method (for example, regarding pixel shift, https://jp.misumi-ec.com/ vona2 / detail / 221004932283 /, and regarding the diagonal edge method, see https://www.clg.niigata-u.ac.jp/~medimg/practice_medical_imaging/mtf/3edge/index.htm, etc.).
Further, as a technique for improving the resolution from the obtained multiple images, the same technique as the existing super-resolution technique can be adopted (eg, https://www.jstage.jst.go.jp/article). / Itej / 62/3 / 62_3_337 / _pdf).
That is, in the present embodiment, by using a plurality of captured images, the processing unit can configure the image of the film frame by performing the alignment process and the reconstruction process of each image. Any suitable technique can be adopted. A technique for obtaining one high resolution image from a plurality of low resolution images is also called a super resolution technique. For the alignment process, a well-known or publicly known appropriate technique such as a region-based matching process or a process of extracting feature points and making them correspond can be employed. For the reconstruction process, a well-known technique or a known technique such as the MAP method (Maximum A Projection method) can be adopted.

(Frame identification data)
Next, an example of associating each data of the content image and the damage situation image will be described below.
In FIG. 5, it is the adjacent image. That is, if the frame identification data (hereinafter referred to as ID) of the content image is ID = n, the ID of the damage status image is ID = n + 1.
In FIG. 6, for example, a half mirror is used, and the lighting to be turned on is switched at high speed, and while one of the lighting is turned on, the other is turned off.
In the case of the area sensor, the switching speed (lighting time) is determined from the frame rate on the sensor side.
(Lighting time = 1 / frame rate x 2)
If you shoot at a sufficiently high shutter speed and frame rate, you can shoot one frame on a continuously running film multiple times.
As a result, two types of images with different illumination can be obtained.
In addition, inside the apparatus, there is a counter for counting the number of frames (and length, usually 16 frames = 1 foot for 35 mm film, 40 frames = 1 foot for 16 mm film) of the acquired film. Based on this, the frame image data can be obtained by associating the data of the content image with the data of the damage situation image.

(Output storage method)
As a method of assigning a unique ID (frame identification data) to the acquired frames, the case of saving each still image as a still image will be described first.
Method 1: A still image file name is used as a serial number and is identified by a prefix or suffix.
Example:
image_00000. ． ． image_00001. ． ． image_00002. ． ． image_00003. ． ．
damage — 00000. ． ． damage — 00001. ． ． damage_00002. ． ． damage_00003. ． ．
Method 2: Record the time code as the metadata of the still image file

Next, a case of saving as a moving image will be described.
Method 3: Recording is performed in two moving image files of the moving image file “image” and the moving image file “damage”, and the same time code is recorded in both of them.
By overlapping two files when playing a movie, you can check the scratches on a frame.

E. Configuration of the control unit of the first embodiment

FIG. 10 shows a block diagram of the control unit of the first embodiment.
The control unit 2 includes a processing unit 21, an input unit 22, an interface (I / F) unit 23, and a storage unit 24. The storage unit 24 includes an input image file 24a and an output image file 24b. The control unit 2 is connected to the sensor unit 1, the light source unit 3, the transport unit 5, and the like by the I / F unit 23, and can control each unit. Further, the control unit 2 exchanges data with the sensor unit 1, the input unit 22, and / or the display unit / output unit via the I / F unit 23, and executes the following processing such as image processing. can do.
The processing unit 21 inputs, via the I / F unit 23, angle information in which the sensor 1a is obliquely set from the angle setting unit 1b of the sensor unit 1. Further, the processing unit 21 inputs the input digital image data (contents image and damage status image) by the detection signal scanned by the sensor 1a and stores the input digital image data in the input image file 24a of the storage unit 22. Next, the processing unit 21 executes image processing as described below and stores output digital image data (content image and damage status image, corrected image processed so as to remove the influence of the damaged image from the content image). It is stored in the output image file 24b of the unit 24. Further, the processing unit 21 displays data such as each digital image data (content image and damage status image, corrected image) stored in the input image file 24 a and / or the output image file 24 b via the I / F unit 23. It can be displayed on a unit and / or output to an external device.

F. Flow chart for image processing

FIG. 11 shows a flowchart of image processing by the processing unit of the film scanner.
The detailed procedure of the image processing of the processing unit 21 will be described below. Here, as an example, as the sensor 1a, a 70 mm film having a film width of 70 mm or less, a 35 mm film, a 16 mm film or the like is a scan target of the image film 200, and a resolution (film width) is digital image data having 4096 pixels. However, the present invention is not limited to this.
As a preparatory step, the user sets the image film 200 on the film scanner 100-1 in which the sensor 1a having a predetermined scan range (or width) and resolution is set by the transport section 5, the guide section 4, and the like. (S101). Next, the angle setting unit 1b of the sensor unit 1 sets the angle of the sensor 1a with respect to the image film 200 (S103). Here, as an example, the user can manually set the angle. The processing unit 21 may automatically set the angle by the drive unit. Regarding the fixing and setting of the angle, for example, as described above with reference to FIGS. 3 and 4, the scanning range (or width) of the sensor 1a is adjusted (matched or matched) to the film width of the image film 200 to be scanned. As described above, the sensor unit 1a is fixed or set by rotating or angling at a right angle or at an angle to the film running direction. The sensor unit 1 sends the set angle information to the processing unit 21.
The present embodiment can be applied to an image film having one side and an image film having both sides having perforations. The detection width of the sensor 1a may cover an area including perforations on both sides, an area including only one perforation, or an area excluding the perforations. May be.

The processing unit 21 identifies or inputs the angle information representing the angle set by the angle setting unit 1b in the sensor unit 1 in the sensor unit 1 as metadata or the like, and records it in the storage unit 24 or an appropriate internal memory (S105).
The user instructs the scan start through the input unit 22 or the like such that the execution is started by an appropriate switch or the like, or the processing unit 21 automatically operates the film scanner 100-1 at an appropriate timing. By starting the operation, scanning of the image film 200 is executed (S107). When the processing unit 21 executes the scan, the processing unit 21 controls the transport unit 5 to continuously transport the image film 200 at a constant speed or a predetermined speed pattern while inputting a digital image of a detection signal scanned by the sensor 1a. The data is acquired and stored in the input image file 24a (S109). The processing unit 21 may add the frame identification data and / or the angle information to the input digital image data and store it in the input image file 24a. At this time, the frame identification data may be predetermined by the user through the input unit 22 or may be provided by the processing unit 21.
Since the width of the sensor 1a and the film width are matched in step S103, the resolution of the short side (direction of the film width) of the obtained digital image data is the pixel of the area sensor regardless of the film width. Digital image data is obtained as (for example, 4096 pixels of the sensor 1a).
It should be noted that the user may instruct the scan stop by the input unit 22 or the like by instructing the execution stop by an appropriate switch or the like, or the processing unit 21 may automatically stop the scan at an appropriate timing or time. You may

Next, the processing unit 21 performs an image creating process of the output digital image data (S111). Here, the processing unit 21 can use the input digital image data as it is when the sensor unit 1 is perpendicular to the image film. On the other hand, when the sensor unit 1 is in an angled state (inclined state) with respect to the image film, the processing unit 21 performs the inclination correction process on the input digital image data.
The obtained input digital image data is in a state in which the image has an angle (tilt image) when the line scanner 1a is set obliquely by the angle setting unit 1b of the sensor unit 1 in step S103. The processing unit 21 reads the input digital image data from the input image file 24a, and with respect to such a tilt image, as described above in the lower diagrams of FIG. 7, the lower diagram of FIG. Inclination correction processing is performed to restore the inclination based on the angle information recorded in, and the original state (for example, a rectangular or square state without inclination) is returned to form digital image data without inclination. . Note that such a tilt correction process can use a generally known or well-known image conversion process.
The processing unit 21 performs the image registration process and the reconstruction process on the digital image data having no inclination, as described in FIG. 9. The processing unit 21 can form an image of a frame of a film by using a plurality of captured digital image data having no tilt and performing alignment processing and reconstruction processing of each image. For these processes, well-known or known appropriate techniques can be adopted. A technique for obtaining one high resolution image from a plurality of low resolution images is also called a super resolution technique. For the alignment process, a well-known or publicly known appropriate technique such as a region-based matching process or a process of extracting feature points and making them correspond can be employed. For the reconstruction process, a well-known technique or a known technique such as the MAP method (Maximum A Projection method) can be adopted.

  The processing unit 21 stores the output digital image data representing the original image (without inclination) in the output image file 24b of the storage unit 1 (S113). Note that the processing unit 21 may appropriately add frame identification data and / or angle information and / or additional information to the output digital image data and store it in the output image file 24b. At this time, the frame identification data may be predetermined by the user through the input unit 22 or may be provided by the processing unit 21.

FIG. 12 shows an explanatory diagram of the format of the output image file.
In this example, the output image file 24b includes angle information 242, output digital image data 243 (including a content image, a damage status image, a correction image, etc.) and additional information 244 for each frame identification data 241. The frame identification data 241, the angle information 242, the additional information 244, etc. may be omitted as appropriate. This format is an example, and an appropriate format can be used.
As the additional information 244, for example, information input or designated by the user from the input unit or the like (for example, film number, title, shooting date / time, data storage date / time, other date / time, etc.), and processed from the acquired input digital image data You may make it include appropriate information, such as the information which the part 21 recognized. The input digital image data and the output digital image data may include scanned data such as character information written on the image film 200 and edge numbers.

13 and 14 are explanatory views (1) and (2) of output digital image data for various image films.
FIG. 13 shows an example of a 35 mm film and FIG. 14 shows an example of a 16 mm film for image films of various film widths. The present embodiment can be applied to other various films such as a 70 mm film. As shown, the output digital image data scanned and corrected and stored for each film width are all the same or similar at the film width resolution of the sensor 1a (the number of pixels is 4096 pixels in the above example). The resolution is stored in the storage unit 24. Further, the processing unit 21 can appropriately read the output digital image data from the output image file 24b, display it on the display unit, and / or output it to the output unit.

Next, the processing unit 21 can read the output image file 24b of the storage unit 24 and perform post-processing (particularly, output processing and output) (S115). The processing unit 21 can perform display processing / storage processing in the following variations, for example.
(1) The content image and the damage situation image can be displayed side by side on one screen for comparison.
(2) The effect of the damage status image is removed from the content image to make the content image clearer, form a corrected image, and display the corrected image. The processing unit 21 can perform a process of forming a corrected image, for example, a process of subtracting a damaged image from a content image, a process of appropriately subtracting a weighted image, a process of appropriate noise removal, and the like. The processing unit 21 can appropriately select the content image, the damage status image, and the corrected image and display them on the display unit. Further, the content image and the damage situation image can be displayed side by side on one screen for comparison. Furthermore, the correction image can be displayed side by side on one screen together with the content image and the damage status image for comparison.

(Processing by the number of appearances)
In many cases, motion picture film damage occurs in a continuous area that spans multiple frames. Moreover, it is considered that the serious damage does not appear as a single body, but is accompanied by innumerable small damages around it. Furthermore, the occurrence of mold, fusion, transfer, etc., which occurs in the rolled state, has a periodic appearance frequency. By collecting and organizing data based on these characteristics, it is possible to understand where and what kind of damage has occurred in the motion picture film, and it can be useful for the plan of preservation / restoration.
Here, a supplementary description will be given below regarding how to grasp the above-mentioned “having a periodicity in appearance frequency” and how to execute a process applied to grasp the damage. It is expected that the film left for a long period of time will have mold, fusion, etc., but they will occur in the rolled state. It spreads as a "certain area" on the film that has been rolled into a columnar shape. Although the film has a spiral shape, the thickness is so thin that it is considered that there is almost no difference between the upper and lower outer circumferences and the inner circumference. For example, with a 16 mm film, even if it is large, the reel on which the film is wound has a diameter of less than 40 cm. Therefore, if similar damage appears within 125 cm for the second time, the probability that the third time will come at almost the same interval is high, and if the third time actually occurs, the fourth time is considered to be almost certain. . The device counts the number of frames with an internal counter. In the case of 16 mm film, the correspondence between the number of frames and the length, such as 40 frames = 1 foot, is defined for each format. By catching the characteristic point of damage and finding similar ones in the front and back frames, the length between the damages can be measured. The diameter gradually decreases due to the thickness of the film, and the smaller the diameter, the greater the change in diameter. However, the processing unit 21 can predict the “next damage appearance position” by measurement and calculation. Information information such as a flag can be stored in the additional information 244 of the output image file. As a result, it is possible to assist the judgment as to "whether it is a damage or a characteristic of the original image" as described above, or to use it as basic information at the time of restoration work.
For example, the processing unit 21 determines, based on a plurality of damage situation images, whether the appearance frequency of damages equal to or greater than a predetermined threshold value has a periodicity. A flag can be added to the image data and stored in the storage unit 24.

G. Configuration of film scanner (second embodiment)

Hereinafter, a configuration for automatically setting the angle adjustment of the sensor unit will be described.
FIG. 15 shows a block diagram of the film scanner of the second embodiment. Further, FIG. 16 shows a configuration diagram of the control unit of the second embodiment.
The film scanner 100-2 according to the second embodiment includes an angle adjusting unit 7, a film width detecting unit 8, in addition to a sensor unit 1, a control unit 2, a light source unit 3, a guide unit 4, a conveying unit 5, and a cleaning unit 6. Equipped with.
The control unit 2 includes a processing unit 21, an input unit 22, an interface (I / F) unit 23, and a storage unit 24. The storage unit 24 includes an input image file 24a and an output image file 24b, and further includes an angle file 24c in which a tilt angle for setting the sensor unit 1 with respect to the film width is predetermined and stored. The control unit 2 is connected to the sensor unit 1, the light source unit 3, the transport unit 5, and the like by the I / F unit 23, and is further connected to the film width detection unit 8 and the angle adjustment unit 7 to control each unit. it can. Further, the control unit 2 exchanges data with the film width detection unit 8 and the angle adjustment unit 7 in addition to the sensor unit 1, the input unit 22 and / or the display unit / output unit via the I / F unit 23. Then, the following image processing and the like can be executed.
The same reference numerals as those in the first embodiment are the same as those described in the first embodiment.
In addition, in the second embodiment, the processing unit 21 executes image processing, similarly to the flowchart of the first embodiment shown in FIG. However, in the first embodiment, the angle of the sensor 1a is manually set by the angle setting unit 1b in step S103, whereas in the second embodiment, the processing unit 21 sets the film width as follows. The main difference is that the detection unit 8 and the angle adjustment unit 7 automatically perform the operations.

The film width detection unit 8 detects the width of the image film 200 and sends the film width information to the processing unit 21. The processing unit 21 refers to the angle file 24c and, according to the film width information, obtains angle information representing the inclination of the sensor 1a with respect to the film traveling direction on a plane parallel to the film plane.
The angle adjusting unit 7 drives and controls the angle setting unit 1b according to the angle information obtained by the processing unit 21 to set the sensor 1a diagonally.
Alternatively, the angle file 24c is saved, and the processing unit 21 uses the film width information detected by the film width detection unit 8 and the predetermined scanning range (or width) of the sensor 1a (or the scanning range of the sensor 1a). , Width) may be set to calculate the angle at which the film width matches or matches the film width.
Note that the film width detection unit 8 and / or the angle adjustment unit 7 may be integrated with the sensor unit 1, and the angle adjustment unit 7 does not depend on the processing unit 21 and follows the information from the film width detection unit 8. The angle information may be directly obtained. Further, the angle setting unit 1b may be capable of discretely setting the set angle by the angle adjusting unit 7, or may be configured to be continuously variable.

H. Effects of the embodiment

According to this embodiment, the following special effects are further exhibited.
According to one of the embodiments of the present invention, a film scanner device having a simple and inexpensive structure for scanning image films such as movie films having deformed / regressed and different widths and storing them as digital data, and A film scanning method can be provided.
According to another embodiment of the present invention, a simple and inexpensive configuration scans an image film such as a movie film that has been deformed / regressed, acquires the deterioration state of the image film, and stores it as digital data. It is possible to provide a film scanner device and a film scanning method for doing so.
According to one of the embodiments, the scan range of the area sensor is set obliquely with respect to the image film according to the film width, so that the same or similar resolution can be obtained for image films of different widths without using a zoom lens. -Image data with a desired resolution can be obtained. Further, an arbitrary resolution can be obtained by adjusting the number of pixels and / or the angle of the area sensor.
According to one of the embodiments, in scanning, the image film can be captured as a continuous long image including the perforation portion, not as an image or moving image in frame units, and the position of the frame can be specified later. . This saves the trouble of adjusting the frame position and rewinding the image during scanning.
-Also, for example, 35 mm film has 4 perforations widely used, but there are also 8 perforations, 3 perforations, 2 perforations and the like. According to the present embodiment, it is not necessary to distinguish between them at the time of scanning to operate the settings of the film scanner.・
According to the present embodiment, it is possible to scan and store the letters, numbers, logos and marks written on the image film, the edge number written on the edge of the image film, and the like.
-According to one of the present embodiments, it is possible to support optical soundtracks of all types.
-According to another one of the present embodiments, it is possible to have not only a function as a "scanning device" but also a function that "a deterioration state of a film can be determined to some extent". In addition, the person who handles the apparatus does not need to have abundant experience with the film, and has the advantage of being able to scan even those whose state is unknown.
-According to still another one of the present embodiments, for example, by providing a cleaning unit, it is possible to remove adhered substances (dust, dust, dust, etc.) on the film before scanning the film.

I. Note

In the above-described embodiment, the configuration and operation for setting the angle can be omitted. In that case, in the configuration diagram of the film scanner, for example, the angle setting unit 1b, the angle adjusting unit 7, the film width detecting unit 8, the angle file 24c, the angle information 242, and the like can be appropriately omitted. In addition, in the flowchart, for example, steps S103, S105, and the like, and inclination correction processing and the like can be appropriately omitted.

Further, in the above-described embodiment, the configuration and processing for acquiring the damage status image may be omitted. In that case, in the configuration diagram of the film scanner, for example, the light source 3a, the mirror 3c, and the like can be appropriately omitted. Further, in the flowchart, for example, the processing regarding the damage status image, the format of the output image file of the damage status image, and the like can be appropriately omitted.

Further, the above-mentioned respective numerical values are merely examples, and the present invention is not limited to these. Appropriate ones can be used for the conveying speed of the image film, the scanning period, and the like.
Further, although the embodiment in which the area sensor is used as the sensor unit 1 has been described, a line sensor or another appropriate sensor may be used.

  A film scanning method or a film scanner device / system according to the present invention includes a film scanner program for causing a computer to execute each procedure, a computer-readable recording medium recording the film scanner program, and an internal memory of the computer including the film scanner program. Can be provided by a program product that can be loaded into a computer, a computer such as a server that includes the program, and the like.

100 film scanner 200 image film 1 sensor section 2 control section 3 light source section 4 guide section 5 transport section 6 cleaning section 7 angle adjusting section 8 film width detecting section

Claims (16)

A film scanner device,
A first light source for acquiring a content image with a surface light source or a light source that has passed through a diffusion plate; a second light source for acquiring a damage image with a point light source, a parallel light source, or an infrared light source; and the first light source. And a switching unit for switching the irradiation by the light source or the second light source, and the switching unit switches the first light source or the second light source in the same irradiation area in a time-division manner to convey an image film. A light source for irradiating,
A sensor unit for scanning the image film by detecting transmitted light or reflected light of the conveyed image film,
A guide unit for sending an image film between the optical positions of the light source unit and the sensor unit,
An image film along the guide unit, a transport unit that continuously feeds at a constant speed or a predetermined speed pattern,
Storage part,
A processing unit,
Equipped with
The processing unit is
The first and second light sources are irradiated in a time-division manner, and four times or four times (n is an even number of 4 or more) are alternately detected by the sensor unit for one frame of the image film. Further, an n-fold image is detected in a time division manner, and two or (n / 2) content images detected by the first light source and two or (n / 2) content images detected by the second light source are detected. Input the damage situation image from the sensor part,
Based on two or (n / 2) content images for one frame and two or (n / 2) damage status images, one frame image is composed from a plurality of images alignment processing. By executing the reconstruction process, a content image of one frame and a damage status image of one frame are formed, and output digital image data in which the content image of one frame and the damage status image of one frame are associated with each other in the storage unit. Remember,
Film scanner device.
A film scanner device,
A first light source for obtaining a content image by a surface light source or a light source that has passed through a diffusion plate, and a second light source for obtaining a damaged image by a point light source, a parallel light source, or an infrared light source, A first light source and the second light source, which are arranged by space division in the transport direction of the image film, and which illuminate the transported image film;
A sensor unit for detecting transmitted light or reflected light of the conveyed image film, scanning the image film, and detecting the irradiation area of the first light source and the irradiation area of the second light source by space division.
A guide unit for sending an image film between the optical positions of the light source unit and the sensor unit,
An image film along the guide unit, a transport unit that continuously feeds at a constant speed or a predetermined speed pattern,
Storage part,
A processing unit,
Equipped with
The processing unit is
With respect to one frame of film, the sensor unit that detects at a speed of a plurality of sheets detects the plurality of content images by the first light source, which is detected by space division in the transport direction of the image film, and the second image. Input multiple damage situation images from the light source of
Based on a plurality of content images and a plurality of damage situation images for one frame, the alignment process of the plurality of images and the reconstruction process of constructing one frame image from the plurality of images are executed, whereby the content image of one frame And a damage condition image of one frame is formed, and output digital image data in which the content image of one frame and the damage condition image of one frame are associated with each other are stored in the storage unit.
Film scanner device.
The film scanner device according to claim 2,
The film scanner device, wherein the sensor section includes one area sensor, and the area sensor detects the irradiation areas of the first light source and the second light source by space division.
The film scanner device according to claim 2,
In the sensor unit, first and second area sensors are arranged in a space division in a transport direction of the image film, and the first area sensor and the second area sensor respectively provide the first light source and the light source. A film scanner device, wherein an irradiation area of a second light source is detected by space division.
The film scanner device according to any one of claims 1 to 4,
An angle setting unit for manually or automatically setting and setting the angle of the sensor unit by making an angle or rotation with respect to the film running direction on a plane parallel to the film surface and outputting the set angle information. When,
Further equipped with,
The processing unit is
The angle setting unit adjusts the scan range or width to the film width of the image film so that the scan range or width of the sensor unit covers the perforations on both sides of the image film or the area including only one perforation. Input the angle information of the sensor unit set by turning or rotating to the angle setting unit,
Based on the plurality of content images and the plurality of damage situation images for one frame stored in the storage unit, a tilt correction process for returning the tilt of the image to the original according to the angle information is executed, and the alignment process and By executing the reconstruction processing, a content image of one frame and a damage status image of one frame are formed.
A film scanner device characterized by the above.
The film scanner device according to any one of claims 1 to 5,
Based on a plurality of damage situation images, the processing unit determines whether or not the appearance frequency of damage equal to or greater than a predetermined threshold has a periodicity. A film scanner device, wherein a flag is added to the storage unit and stored in the storage unit.
The film scanner device according to any one of claims 1 to 6,
The processing unit is
Display the content image and the damage status image side by side on the display unit in one screen, and / or
A film scanner device, which displays a corrected image obtained by subtracting a damage status image from a content image on a display unit.
A film scanner device,
A light source section,
A sensor unit using an area sensor for scanning the image film by detecting transmitted light or reflected light of the conveyed image film,
A guide unit for sending an image film between the optical positions of the light source unit and the sensor unit,
An image film along the guide unit, a transport unit that continuously feeds at a constant speed or a predetermined speed pattern,
An angle setting unit for manually or automatically setting and setting the angle of the sensor unit by making an angle or rotation with respect to the film running direction on a plane parallel to the film surface and outputting the set angle information. When,
Storage part,
A processing unit,
Equipped with
The processing unit is
The angle setting unit adjusts the scan range or width to the film width of the image film so that the scan range or width of the sensor unit covers the perforations on both sides of the image film or the area including only one perforation. Input the angle information of the sensor unit set by turning or rotating to the angle setting unit,
By setting the transport speed of the image film by the transport unit and the detection speed by the sensor unit, one frame on the image film continuously transported by the sensor unit is detected a plurality of times, and the image detected by the sensor unit is digital. A plurality of input digital image data is input from the sensor unit for one frame that has been digitized,
Based on a plurality of input digital image data for one frame, a tilt correction process for returning the tilt of the image to the original according to the angle information is executed, the alignment process of the plurality of images and the reconstruction of one frame image from the plurality of images. By executing the configuration process, each one frame of output digital image data is formed and stored in the storage unit.
Film scanning device.
The film scanner device according to any one of claims 1 to 8,
A film scanner device further comprising a cleaning unit which is provided in front of the image acquisition area by the sensor unit and which removes adhered matter on the surface of the image film.
The film scanner device according to claim 5 or 8,
The angle setting unit,
When scanning an image film having a predetermined film width, the sensor unit is set so as to be orthogonal to the film running direction on a plane parallel to the film surface,
When scanning an image film having a width narrower than the preset film width, an angle or rotation is fixed so that the scanning range or width of the sensor unit on the plane parallel to the film surface matches or matches the film width. Set to
A film scanner device having a configuration.
The film scanner device according to claim 5, 8 or 10,
A film width detection unit that detects film width information indicating the film width of the image film,
According to the angle information representing the inclination for setting the sensor unit obtained based on the film width information, the angle adjusting unit for driving and controlling the angle setting unit to set the sensor unit diagonally,
A film scanner device further comprising:
The film scanner device according to claim 11,
The storage unit further includes an angle file in which angle information according to the film width is predetermined and stored,
The processing unit refers to the angle file to set angle information,
A film scanner device characterized by the above.
The film scanner device according to claim 11,
The processing unit may calculate angle information based on the film width information and the scan range or width of the sensor unit so that the scan range or width of the sensor unit matches or matches the film width. Film scanner device.
A film scanner method in a film scanner device, comprising:
The film scanner device is
A first light source for acquiring a content image with a surface light source or a light source that has passed through a diffusion plate; a second light source for acquiring a damage image with a point light source, a parallel light source, or an infrared light source; and the first light source. And a switching unit for switching the irradiation by the light source or the second light source, and the switching unit switches the first light source or the second light source in the same irradiation area in a time-division manner to convey an image film. A light source for irradiating,
A sensor unit for scanning the image film by detecting transmitted light or reflected light of the conveyed image film,
A guide unit for sending an image film between the optical positions of the light source unit and the sensor unit,
An image film along the guide unit, a transport unit that continuously feeds at a constant speed or a predetermined speed pattern,
Storage part,
A processing unit,
Equipped with
The processing unit is
The first and second light sources are irradiated in a time-division manner, and four times or four times (n is an even number of 4 or more) are alternately detected by the sensor unit for one frame of the image film. Further, an n-fold image is detected in a time division manner, and two or (n / 2) content images detected by the first light source and two or (n / 2) content images detected by the second light source are detected. Input the damage situation image from the sensor part,
Based on two or (n / 2) content images for one frame and two or (n / 2) damage status images, one frame image is composed from a plurality of images alignment processing. By executing the reconstruction process, a content image of one frame and a damage status image of one frame are formed, and output digital image data in which the content image of one frame and the damage status image of one frame are associated with each other in the storage unit. Remember,
Film scanner method.
A film scanner method in a film scanner device, comprising:
The film scanner device is
A first light source for obtaining a content image by a surface light source or a light source that has passed through a diffusion plate, and a second light source for obtaining a damaged image by a point light source, a parallel light source, or an infrared light source, A first light source and the second light source, which are arranged by space division in the transport direction of the image film, and which illuminate the transported image film;
A sensor unit for detecting transmitted light or reflected light of the conveyed image film, scanning the image film, and detecting the irradiation area of the first light source and the irradiation area of the second light source by space division.
A guide unit for sending an image film between the optical positions of the light source unit and the sensor unit,
An image film along the guide unit, a transport unit that continuously feeds at a constant speed or a predetermined speed pattern,
Storage part,
A processing unit,
Equipped with
The processing unit is
With respect to one frame of film, the sensor unit that detects at a speed of a plurality of sheets detects the plurality of content images by the first light source, which is detected by space division in the transport direction of the image film, and the second image. Input multiple damage situation images from the light source of
Based on a plurality of content images and a plurality of damage situation images for one frame, the alignment process of the plurality of images and the reconstruction process of constructing one frame image from the plurality of images are executed, whereby the content image of one frame And a damage condition image of one frame is formed, and output digital image data in which the content image of one frame and the damage condition image of one frame are associated with each other are stored in the storage unit.
Film scanner method.
A film scanner method in a film scanner device, comprising:
The film scanner device is
A light source section,
A sensor unit for scanning the image film by detecting transmitted light or reflected light of the conveyed image film,
A guide unit for sending an image film between the optical positions of the light source unit and the sensor unit,
An image film along the guide unit, a transport unit that continuously feeds at a constant speed or a predetermined speed pattern,
An angle setting unit for manually or automatically setting and setting the angle of the sensor unit by making an angle or rotation with respect to the film running direction on a plane parallel to the film surface and outputting the set angle information. When,
Storage part,
A processing unit,
Equipped with
The processing unit is
The angle setting unit adjusts the scan range or width to the film width of the image film so that the scan range or width of the sensor unit covers the perforations on both sides of the image film or the area including only one perforation. Input the angle information of the sensor unit set by turning or rotating to the angle setting unit,
By setting the transport speed of the image film by the transport unit and the detection speed by the sensor unit, one frame on the image film continuously transported by the sensor unit is detected a plurality of times, and the image detected by the sensor unit is digital. A plurality of input digital image data is input from the sensor unit for one frame that has been digitized,
Based on a plurality of input digital image data for one frame, a tilt correction process for returning the tilt of the image to the original according to the angle information is executed, the alignment process of the plurality of images and the reconstruction of one frame image from the plurality of images. By executing the configuration process, each one frame of output digital image data is formed and stored in the storage unit.
Film scanning method.