WO2023234035A1

WO2023234035A1 - Control device, energy measurement device, control method, energy measurement method, control program, and energy measurement program

Info

Publication number: WO2023234035A1
Application number: PCT/JP2023/018472
Authority: WO
Inventors: 善朗山崎
Original assignee: 富士フイルム株式会社
Priority date: 2022-06-03
Filing date: 2023-05-17
Publication date: 2023-12-07

Abstract

A control device comprising at least one processor, wherein the processor performs control to cause an imaging light to be shined from an illumination device, said imaging light being for suppressing the influence of imaging environment light when an imaging device is used to image a coloring member that colors in a darkness distribution corresponding to the quantity of applied energy.

Description

Control device, energy measurement device, control method, energy measurement method, control program, and energy measurement program

The present disclosure relates to a control device, an energy measurement device, a control method, an energy measurement method, a control program, and an energy measurement program.

Conventionally, there is a known technique for measuring the amount of energy using a coloring member that develops color depending on energy such as applied pressure, heat, and ultraviolet rays. As such a coloring member, there is, for example, Prescale (registered trademark) (manufactured by Fuji Film Co., Ltd.), which can obtain a coloring density depending on the applied pressure.

For example, in International Publication No. 2021/235364, pressure measurement is performed based on an image representing a colored member included in a photographed image obtained by placing a pressure measurement sheet (for example, prescale) on a calibration sheet. Techniques are described for converting sheet density values into pressure values.

Photographed images of colored members may be affected by the photographing environment, such as the lighting environment in which the photograph is taken, the characteristics of the photographing device, the photographing angle, and the photographing distance. Therefore, in order to improve measurement accuracy, it is necessary to It is desired to suppress the impact of

The present disclosure provides a control device, an energy measurement device, a control method, an energy measurement method, a control program, and a control device, an energy measurement device, a control method, an energy measurement method, a control program, and an energy measurement device that can obtain a captured image in which the influence of shooting environment light is suppressed when photographing a color-forming member for measuring energy. and energy measurement programs.

A control device according to a first aspect of the present disclosure includes at least one processor, and when a coloring member that develops color with a density distribution according to an applied energy amount is photographed by a photographing device, the processor controls the amount of photographing environment light. Control is performed to irradiate photographing light from the irradiation device to suppress the influence.

In a second aspect of the present disclosure, in the first aspect, the processor may control the irradiation device to emit photographing light regardless of the amount of photographing light.

In a third aspect of the present disclosure, in the first aspect, the amount of photographing light emitted by the irradiation device may be larger than the amount of photographing environment light.

A fourth aspect of the present disclosure is that in the first aspect, when the illuminance due to the photographing environment light is X lux, the luminous flux of the photographing light is 0.1×X lumens or more and 0.5×X lumens or less. Good too.

In a fifth aspect of the present disclosure, in the first aspect, the processor controls the irradiation device to emit photographing light when photographing the color-forming member, and controls the photographing environment light when photographing the color-forming member. Control may be performed to irradiate photographing light from the irradiation device depending on the situation.

A sixth aspect of the present disclosure is that in the first aspect, when the processor receives an irradiation prohibition instruction that prohibits the irradiation of photographing light from the irradiation device, the processor controls the irradiation of the photographing light instead of controlling the irradiation device to irradiate the photographing light. Control may be performed to prohibit light irradiation.

An energy measuring device according to a seventh aspect of the present disclosure includes at least one processor, and when a coloring member that develops a color with a density distribution according to the applied energy amount is photographed by a photographing device, A control device that controls the irradiation of photographing light from the irradiation device in order to suppress the effects of coloring acquires a color-forming member image representing the color-forming member photographed with the photographing light irradiated from the irradiation device onto the color-forming member. Then, the amount of energy applied to the coloring member is derived based on the color of the coloring member image using data in which the relationship between the amount of energy applied to the coloring member and the color of the coloring member image is determined in advance.

A control method according to an eighth aspect of the present disclosure provides a method for irradiating photographing light for suppressing the influence of photographing environment light when photographing a coloring member that develops color with a density distribution according to the amount of applied energy using a photographing device. This is a method in which a computer executes the process of controlling the irradiation from the device.

An energy measuring method according to a ninth aspect of the present disclosure is such that when a coloring member that develops color with a density distribution according to the amount of applied energy is photographed using a photographing device, photographing light is used to suppress the influence of photographing environment light. A control device that controls the irradiation from the irradiation device acquires a coloring member image representing the coloring member photographed while the coloring member is irradiated with photographic light from the irradiation device, and calculates the amount of energy applied to the coloring member. In this method, a computer executes a process of deriving the amount of energy applied to the coloring member based on the color of the coloring member image, using data in which the relationship between the color of the coloring member image and the color of the coloring member image is determined in advance.

A control program according to a tenth aspect of the present disclosure irradiates photographing light for suppressing the influence of photographing environment light when photographing a coloring member that develops color with a density distribution according to the amount of applied energy using a photographing device. The computer executes the process of controlling the irradiation from the device.

An energy measurement program according to an eleventh aspect of the present disclosure provides a method for controlling photographing light for suppressing the influence of photographing environment light when photographing a coloring member that develops color with a density distribution according to the amount of applied energy using a photographing device. A control device that controls the irradiation from the irradiation device acquires a coloring member image representing the coloring member photographed while the coloring member is irradiated with photographic light from the irradiation device, and calculates the amount of energy applied to the coloring member. A computer is caused to perform a process of deriving the amount of energy applied to the coloring member based on the color of the coloring member image using data in which a relationship between the coloring member image and the color of the coloring member image is determined in advance.

According to the above aspects, the control device, the energy measurement device, the control method, the energy measurement method, the control program, and the energy measurement program according to the present disclosure are configured to be able to detect the influence of the photographing environment light in photographing a color-forming member for measuring energy. It is possible to obtain a photographed image in which the effects are suppressed.

FIG. 1 is a configuration diagram schematically showing an example of the overall configuration of an energy measurement system according to an exemplary embodiment. FIG. 3 is a schematic diagram showing how a photographed image is photographed. It is a figure showing an example of a calibration member. FIG. 2 is a block diagram showing an example of the hardware configuration of a smartphone. FIG. 2 is a block diagram showing an example of a functional configuration of a smartphone. 3 is a flowchart illustrating an example of irradiation control processing. FIG. 3 is a diagram for explaining an example of a screen displayed on a display. It is a flowchart which shows an example of measurement processing.

Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the drawings. Note that this exemplary embodiment does not limit the technology of the present disclosure.

First, an example of the overall configuration of the energy measurement system of this exemplary embodiment will be described. FIG. 1 shows a configuration diagram showing an example of the overall configuration of an energy measurement system 1 according to the present exemplary embodiment. As shown in FIG. 1, the energy measurement system 1 of this exemplary embodiment includes a server 4, a database 6, and a smartphone 10. The server 4 and the smartphone 10 are connected to each other via a wired or wireless network so that they can communicate with each other.

The energy measurement system 1 of this exemplary embodiment measures the amount of energy using a coloring member 30 that develops color with a density distribution depending on the amount of applied energy when energy such as pressure, heat, and ultraviolet rays is applied. It is a system for Specifically, with the flash 12 of the smartphone 10 turned on and the photographing light F irradiated, the coloring member 30 to which energy has been applied is photographed by the camera 11, and from the photographed image 8 obtained by photographing. The amount of energy applied to the coloring member 30 is derived. The camera 11 of the smartphone 10 of this exemplary embodiment is an example of the photographing device of the present disclosure, and the flash 12 is an example of the irradiation device. Furthermore, the smartphone 10 of the present disclosure is an example of the control device and energy measurement device of the present disclosure.

As the coloring member 30, for example, Prescale (registered trademark) (manufactured by Fujifilm Corporation), which develops color with a density distribution depending on the amount of applied pressure, can be used. Prescale is a sheet-like support coated with a coloring agent containing microcapsules containing a colorless dye and a color developer. When pressure is applied to the prescale, the microcapsules are destroyed and the colorless dye is adsorbed to the developer, producing color. Furthermore, since the coloring agent contains multiple types of microcapsules having different sizes and strengths, the amount of microcapsules destroyed varies depending on the applied pressure, and the coloring density also varies. Therefore, by observing the color density, the magnitude and pressure distribution of the pressure applied to the prescale can be measured.

For example, the coloring member 30 may include Thermoscale (trade name) (manufactured by Fujifilm Corporation), which develops color with a density distribution depending on the amount of heat applied, and a thermoscale, which develops color with a density distribution depending on the amount of ultraviolet light applied. UV scale (trade name) (manufactured by Fuji Film Corporation) or the like may be applied.

The server 4 of this exemplary embodiment is a general-purpose computer in which a software program that provides the functionality of a database management system (DBMS) is installed. The server 4 acquires the captured image 8 and the amount of energy derived from the captured image 8 from the smartphone 10 and stores it in the database 6. Note that the connection form between the server 4 and the database 6 is not particularly limited; for example, they may be connected via a data bus, or may be connected via a network such as NAS (Network Attached Storage) or SAN (Storage Area Network). It may also be in the form of

In the energy measurement system 1 of this exemplary embodiment, as shown in FIG. 2, the coloring member 30 placed on the calibration member 20 is irradiated with the photographing light F from the flash 12 of the smartphone 10. Then, a photograph is taken using the camera 11 of the smartphone 10. Thereby, the smartphone 10 acquires a photographed image 8 including the calibration member 20 and the coloring member 30. When the user U takes a picture in this way, the photographed image 8 may be affected by the lighting environment in which the picture is taken, the characteristics of the camera 11, the photographing angle, the photographing distance, and the like. The calibration member 20 is for correcting these influences on the photographed image 8.

With reference to FIG. 3, the calibration member 20 of this exemplary embodiment will be described in detail. The calibration member 20 is, for example, a support made of paper, resin, etc., and formed into a sheet or plate shape. Note that FIG. 3 shows a state in which the coloring member 30 is placed on the calibration member 20, and the surface of the calibration member 20 that is photographed with the coloring member 30 placed thereon (hereinafter referred to as (referred to as "imaging surface 20S") is shown.

As shown in FIG. 3, the imaging surface 20S includes a first area 20A where the coloring member 30 is placed and a second area 20B where a plurality of patches 25 are placed. As an example, the first area 20A in this exemplary embodiment is a central area of the imaging surface 20S, and is surrounded by a frame 21. Further, the second area 20B is an area around the first area 20A on the imaging surface 20S. In other words, the second area 20B is an area outside the frame 21 on the imaging surface 20S.

The smartphone 10 of the energy measurement system 1 of this exemplary embodiment corrects the distortion, tilt, and size of the captured image 8 using the frame 21 shown on the imaging surface 20S of the calibration member 20 (details will be described later). . In particular, if the frame 21 (that is, the first area 20A) is rectangular, the accuracy of correcting the distortion, tilt, and size of the photographed image 8 can be improved, so it is preferable that the frame 21 is rectangular.

Furthermore, the photographing surface 20S includes a plurality of patches 25 extending along each side of the rectangular frame 21. As shown in FIG. 3, as an example, in the second region 20B of this exemplary embodiment, a pair of first patch groups 22A and 22B are arranged at opposing positions with the first region 20A interposed therebetween. At least one of the first patch groups 22A and 22B includes a plurality of patches 25 of different colors. For example, at least one of the first patch groups 22A and 22B may include a plurality of patches 25 having the same hue and different density. In other words, the colors of the plurality of patches 25 included in at least one of the first patch groups 22A and 22B may be different from each other.

The color and number of patches 25 included in the first patch group 22A may be the same as or different from the color and number of patches 25 included in the first patch group 22B. As an example, in the calibration member 20 of this exemplary embodiment, as shown in FIG. Although the numbers are the same, the arrangement of the patches 25 of each color is different. Further, as shown in FIG. 3, in the calibration member 20 of this exemplary embodiment, the first patch groups 22A and 22B include a plurality of patches 25 arranged in the X direction and the Y direction. Note that it is preferable that the number of patches 25 arranged in the X direction (16 in the example of FIG. 3) is greater than the number of patches 25 arranged in the Y direction (2 in the example of FIG. 3).

Further, as shown in FIG. 3, as an example, in the second region 20B of this exemplary embodiment, a pair of second patch groups 24A and 24B are arranged at opposing positions with the first region 20A interposed therebetween. . At least one of the second patch groups 24A and 24B includes a plurality of patches 25 of different colors. For example, at least one of the second patch groups 24A and 24B may include a plurality of patches 25 having the same hue and different density. In other words, the colors of the plurality of patches 25 included in at least one of the second patch groups 24A and 24B may be different from each other.

The color and number of patches 25 included in the second patch group 24A may be the same as or different from the color and number of patches 25 included in the second patch group 24B. As an example, in the calibration member 20 of this exemplary embodiment, as shown in FIG. Although the numbers are the same, the arrangement of the patches 25 of each color is different. Further, in the calibration member 20 of this exemplary embodiment shown in FIG. 3, the second patch groups 24A and 24B include a plurality of patches 25 arranged in the X direction and the Y direction. Note that it is preferable that the number of patches 25 arranged in the Y direction (24 in the example of FIG. 3) is greater than the number of patches 25 arranged in the X direction (2 in the example of FIG. 3).

The number of patches 25 included in each of the first patch groups 22A and 22B and the number of patches 25 included in each of the second patch groups 24A and 24B may be the same or different. In FIG. 3, the number of patches 25 included in each of the first patch groups 22A and 22B is 32, and the number of patches 25 included in each of the second patch groups 24A and 24B is 48.

The color of at least one patch 25 included in at least one of the first patch groups 22A and 22B may be the same as the color of at least one patch 25 included in at least one of the second patch groups 24A and 24B. In other words, a patch 25 having the same color as a patch 25 included in at least one of the first patch groups 22A and 22B may be included in at least one of the second patch groups 24A and 24B. By including patches 25 of the same color in at least one of the first patch groups 22A and 22B and at least one of the second patch groups 24A and 24B, the accuracy of calibration of the captured image 8 by the smartphone 10 is improved. (Details will be explained later).

The plurality of patches 25 included in each of the first patch groups 22A and 22B and the second patch groups 24A and 24B may have the same size, shape, and angle, respectively. In this exemplary embodiment, as shown in FIG. 3, the plurality of patches 25 included in each of the first patch groups 22A and 22B and the second patch groups 24A and 24B have the same size and angle. It has a rectangular shape.

The imaging surface 20S also includes a first patch group and a second patch group included in at least one combination of the first patch group and second patch group that are adjacent to each other in the circumferential direction of the first area 20A. Preferably, it includes a blank area located in between. "A combination of a first patch group and a second patch group that are adjacent to each other in the circumferential direction of the first region 20A" specifically refers to a combination of the first patch group 22A and the second patch group 24A, the first patch group 22A and the second patch group 24B, a combination of the first patch group 22B and the second patch group 24A, and a combination of the first patch group 22B and the second patch group 24B. In FIG. 3, the imaging surface 20S includes four blank areas arranged between each of the first patch group and the second patch group (i.e., all of the four combinations described above) that are adjacent to each other in the circumferential direction of the first area 20A. Contains 26.

Furthermore, it is preferable that the photographing surface 20S includes a figure 27 arranged in a blank area 26 arranged between the first patch group and the second patch group. This graphic 27 is used to indicate the range that should be included in the angle of view when the user photographs the calibration member 20 and the coloring member 30. Therefore, in order to make it easy to understand the range to be included in the angle of view, it is preferable that the photographing surface 20S includes four figures 27 arranged in each of the four blank areas 26, as shown in FIG. In the example shown in FIG. 3, the four figures 27 placed in each of the four blank areas 26 are similar to each other. If the photographed image 8 is photographed by the camera 11 at a photographing position where the four figures 27 placed in each of the blank areas 26 fit within the angle of view, the first patch group 22A and 22B and the second patch group 24A and 24B are formed. , and the coloring member 30 placed in the first area 20A can be photographed so as to fit within the angle of view.

The image representing the coloring member 30 included in the photographed image 8 (hereinafter referred to as the "coloring member image") is affected by the photographing environment such as the lighting environment in which the photographing is performed, the characteristics of the camera 11, the photographing angle, and the photographing distance. . In particular, the light irradiated onto the coloring member 30 has a large influence on the color tone of the coloring member image included in the photographed image 8. Specifically, when the same coloring member 30 is photographed, the amount and wavelength of the light that is applied to the coloring member 30 during photographing is different depending on the photographing environment (hereinafter referred to as "photographing environment light"). Even in this case, the coloring member images included in the photographed image 8 may have different hues. In other words, the color tone of the coloring member image included in the photographed image 8 is affected by the photographing environment light.

Therefore, when photographing the coloring member 30 with the camera 11, the smartphone 10 of this exemplary embodiment performs control to emit photographing light F from the flash 12 to suppress the influence of photographing environment light. The influence of environmental light on the color tone of a coloring member image included in a photographed image 8 is reduced. In this exemplary embodiment, the light emitted from the flash 12 and used for photographing the coloring member 30 is referred to as "photographing light" (photographing light F), and light emitted from natural light or workplace lighting, etc. Light based on the environment and not caused by the flash 12 is referred to as "photography environment light."

As the photographing light F for suppressing the influence of the photographing environment light, for example, light having a larger amount of light than the photographing environment light can be mentioned. Further, when the illuminance of the photographing environment light is X lux, if the illuminance of the photographing light F is less than X lux, the influence of the photographing environment light becomes relatively large.

Furthermore, if the illuminance of the photographing light F exceeds 5X lux, there is a concern that so-called overexposure may occur in the photographed image 8. Therefore, it is preferable that the illuminance of the photographing light F in the coloring member 30 is not less than X lux and not more than 5X lux. Therefore, the luminous flux Y lumens of the photographing light F to illuminate approximately 0.1 square meter (area A square meter) with X lux or more and 5X lux or less is 0.1X lumen or more and 0.5X lumen from the following formula (1). The following are preferred.

Y=X×A...(1)

For the illuminance of the photographing environment light, an actual value measured at the place where the coloring member 30 is photographed may be used, or an estimated value may be used, for example, based on the illuminance according to the illuminance standards specified by JIS etc. . For example, according to the general lighting standards of the JIS Z9110 standard, for example, 2000 lux is required for instrument panels and control panels in control rooms, precision instruments, manufacturing of electronic parts, and extremely detailed work in printing factories; , 1000 lux for detailed visual work such as drafting room, sorting and inspection in a textile factory, typesetting and proofreading in a printing factory, and analysis in a chemical factory, and normal visual work in general manufacturing processes, etc. In this case, 500 lux is set as the illuminance standard.

Therefore, when the illuminance of the photographing environment light is 2000 lux, the luminous flux of the photographing light F is preferably 200 lumens or more and 1000 lumens or less. Further, when the illuminance of the photographing environment light is 1000 lux, the luminous flux of the photographing light F is preferably 100 lumens or more and 500 lumens or less. Further, when the illuminance of the photographing environment light is 500 lux, the luminous flux of the photographing light F is preferably 50 lumens or more and 250 lumens or less.

Next, the smartphone 10 of this exemplary embodiment will be described in detail. First, an example of the hardware configuration of the smartphone 10 will be described with reference to FIG. 4. As shown in FIG. 4, the smartphone 10 includes a CPU (Central Processing Unit) 80, a nonvolatile storage section 82, and a memory 81 as a temporary storage area. The smartphone 10 also includes a display 84 such as a liquid crystal display, an input section 88, a network I/F (Interface) 86, a camera 11, and a flash 12. The CPU 80, storage unit 82, memory 81, display 84, input unit 88, network I/F 86, camera 11, and flash 12 are connected to each other via a bus 89 such as a system bus and a control bus so that they can exchange various information. has been done.

The storage unit 82 is realized by, for example, a storage medium such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), and a flash memory. The storage unit 82 stores an irradiation control program 83A and a measurement program 83B. The CPU 80 reads the irradiation control program 83A from the storage unit 82, loads it into the memory 81, and executes the loaded irradiation control program 83A. Further, the CPU 80 reads the measurement program 83B from the storage unit 82, expands it into the memory 81, and executes the expanded measurement program 83B. The CPU 80 is an example of the processor of the control device of the present disclosure, and is also an example of the processor of the energy measurement device of the present disclosure. Further, the irradiation control program 83A of the present exemplary embodiment is an example of the control program of the present disclosure, and the measurement program 83B is an example of the energy measurement program of the present disclosure.

The input unit 88 is for receiving user operations, and is, for example, a touch panel, buttons, keyboard, mouse, etc. As an example, the camera 11 of this exemplary embodiment employs a touch panel display in which the display 84 and the input section 88 are integrated. The network I/F 86 performs wired or wireless communication with the server 4 and other external devices (not shown). The camera 11 has a plurality of sensors having different spectral sensitivities, and under the control of the CPU 80, the sensor photographs a subject and outputs an image signal of the photographed image 8.

Next, with reference to FIG. 5, an example of a functional configuration regarding control of irradiation of photographing light F during photographing with the smartphone 10 will be described. As shown in FIG. 5, the smartphone 10 includes an irradiation control section 90. The CPU 80 functions as the irradiation control section 90 by executing the irradiation control program 83A.

The irradiation control unit 90 has a function of controlling irradiation of the flash 12 with the photographing light F for suppressing the influence of photographing environment light when photographing the coloring member 30 with the camera 11.

With reference to FIG. 6, the operation related to illumination control of the flash 12 in the smartphone 10 according to the present exemplary embodiment will be described. In this exemplary embodiment, the camera 11 has at least two modes for photographing: a coloring member photographing mode in which the coloring member 30 is photographed, and a normal photographing mode in which normal photographing is performed. In the coloring member photographing mode, the flash 12 is controlled by the irradiation control section 90. In other words, in the coloring member photographing mode, the irradiation control section 90 controls the irradiation of the photographing light F by the flash 12. On the other hand, in the normal photographing mode, the irradiation control unit 90 controls the irradiation of the photographing light F by the flash 12 in accordance with a user's instruction. Note that in this exemplary embodiment, there are at least two light emission modes, a forced light emission mode and a normal light emission mode, as modes related to irradiation of the photographing light F by the flash 12. The forced light emission mode is a light emission mode in which the flash 12 is turned on to irradiate the photographic subject with the photographic light F regardless of the photographing environment light. The normal light emission mode is a light emission mode in which the flash 12 is turned on according to the shooting environment light and the shooting light F is emitted onto the shooting subject.If the light intensity of the shooting environment light is sufficient, the flash 12 is not turned on. , the photographing light F is not irradiated onto the photographing subject. As an example, in this exemplary embodiment, when the normal shooting mode is set, either the forced flash mode or the normal flash mode is set by the user, and the irradiation control unit 90 performs the shooting according to the set flash mode. Controls irradiation/non-irradiation of light F.

As an example, in this exemplary embodiment, the user uses the input unit 88 to instruct the activation of the camera 11 and the shooting mode. Upon receiving the instruction to start the camera 11, the smartphone 10 starts the camera 11. Moreover, upon receiving the instruction of the shooting mode, the smartphone 10 sets the received shooting mode.

In the smartphone 10, the irradiation control process shown in FIG. 6 is executed by the CPU 80 executing the irradiation control program 83A. The irradiation control process is executed, for example, in response to activation of the camera 11.

In step S10, the irradiation control unit 90 determines whether the photographing mode is a coloring member photographing mode in which photographing of the coloring member 30 is executed. If the set photographing mode is not the coloring member photographing mode, for example, if the normal photographing mode is set, the determination in step S10 becomes a negative determination, and the irradiation control process shown in FIG. 6 ends. In this case, since it is the normal photographing mode, the flash 12 is turned on in a light emission mode according to the user's instruction, and the photographing light F is emitted. On the other hand, if the set photographing mode is the coloring member photographing mode, the determination in step S10 is affirmative, and the process moves to step S12.

In step S12, the irradiation control unit 90 sets the forced light emission mode as the light emission mode of the flash 12. When the forced flash mode is set in this way, as described above, when photographing is performed using the camera 11, the flash 12 is turned on and the photographing light F is irradiated onto the photographic subject. Therefore, a photographed image 8 is obtained in which the coloring member 30 is irradiated with the photographing light F. When the process of step S12 ends, the irradiation control process shown in FIG. 6 ends.

Next, with reference to FIG. 5, an example of a functional configuration regarding energy measurement by the smartphone 10 will be described. As shown in FIG. 5, the smartphone 10 includes an acquisition section 92, a correction section 94, a derivation section 96, and a measurement control section 98. When the CPU 80 executes the measurement program 83B, the CPU 80 functions as the acquisition section 92, the correction section 94, the derivation section 96, and the measurement control section 98.

The acquisition unit 92 acquires a photographed image 8 including an image representing the calibration member 20 (hereinafter referred to as a “calibration member image”) and a coloring member image of the coloring member 30, taken by the camera 11.

The correction unit 94 extracts an image representing the frame 21 (hereinafter referred to as a "frame image") from the captured image 8, and corrects distortion, tilt, and size of the captured image 8 based on the shape of the extracted frame image. Correct at least one. As a method for extracting a frame image, a known method using edge extraction processing in an image or the like can be applied as appropriate. Specifically, when the frame 21 is rectangular, the frame image is also rectangular, and the correction unit 94 performs projective transformation, affine transformation, etc. so that the four corners of the frame image extracted from the photographed image 8 are each 90 degrees. to correct the distortion, tilt, and size of the photographed image 8.

Furthermore, the correction unit 94 performs calibration on the captured image 8 acquired by the acquisition unit 92 using an image representing the patch 25 included in the captured image 8 (hereinafter referred to as a “patch image”). Specifically, the correction unit 94 corrects the captured image 8 based on the color of the patch image of the patch 25 included in the first patch group 22A and 22B and the second patch group 24A and 24 included in the captured image 8. The color (for example, at least one of hue and density) of the included coloring member image is calibrated. As a calibration method, any known method can be applied as appropriate. For example, a reference color is stored in advance in the storage unit 82 for each patch 25 included in the calibration member 20, and the correction unit 94 adjusts the color of the photographed image 8 to adjust the color of the plurality of patches included in the photographed image 8. Match the color of each image to its respective reference color.

Furthermore, as described above, each of the first patch groups 22A and 22B and the second patch groups 24A and 24B may include patches 25 of the same color. In this case, the patches 25 that are originally formed in the same color may appear to have different colors on the photographed image 8 due to the influence of the photographing environment such as the lighting environment in which the photograph is taken, the characteristics of the camera 11, the photographing angle, and the photographing distance. It may be expressed in Therefore, for example, the correction unit 94 may adjust the color of the photographed image 8 so that the average color of the patch images corresponding to the patches 25 formed of the same color matches the reference color. For example, the correction unit 94 may adjust the color of the photographed image 8 so that the color of the patch image closest to the reference color among the patches 25 formed with the same color matches the reference color. good.

Note that the correction unit 94 may perform calibration using some of the patch images of the plurality of patches 25 included in each of the first patch groups 22A and 22B and the second patch groups 24A and 24B. .

For example, the correction unit 94 may change the patch 25 used for calibration depending on the type of coloring member 30. For example, prescales as an example of the coloring member 30 are manufactured in a plurality of types with different measurable pressure ranges, such as those for low pressure, medium pressure, and high pressure. For example, as described above, as the coloring member 30, a thermoscale, a UV scale, etc. can also be used in addition to the prescale.

Therefore, the correction unit 94 adjusts the type of the coloring member 30 according to the coloring member image among the patch images of the plurality of patches 25 included in the first patch group 22A and 22B and the second patch group 24A and 24B. Calibration may be performed using patch images of some of the patches 25 determined in advance. The correspondence between the type of coloring member 30 and the patch 25 used for calibration may be stored in the storage unit 82 in advance, for example. The type of the photographed coloring member 30 may be inputted by the user via the input unit 88, or an identification code indicating the type of the coloring member 30 may be attached to the coloring member 30, and the correction unit 94 may input the type of the coloring member 30 photographed. It may be specified by reading the identification code from the image 8.

In this way, the correction unit 94 corrects the distortion, tilt, size, and color of the photographed image 8, thereby adjusting the lighting environment in which the photograph is performed, the characteristics of the camera 11, etc. that may occur when the user performs photographing. It is possible to correct the influence of the photographing environment, such as the photographing angle and photographing distance.

Note that in this exemplary embodiment, as described above, the influence of the photographing environment light is suppressed by performing photographing with the camera 11 while the coloring member 30 is irradiated with the photographing light F by the flash 12. As a result, in this exemplary embodiment, the captured image 8 captured by the camera 11 becomes an image in which the influence of the above-mentioned shooting environment, particularly the shooting environment light, is reduced. Therefore, according to the present exemplary embodiment, it is possible to appropriately reduce or eliminate the process of correcting the coloring member image described above, and the processing load related to the correction process can be reduced.

The deriving unit 96 derives the amount of energy applied to the coloring member 30 based on the color of the coloring member image after calibration by the correction unit 94. Specifically, data in which the relationship between the amount of energy applied to the coloring member 30 and the color of the coloring member 30 is predetermined is stored in advance in the storage unit 82, and the deriving unit 96 uses the data. , the color of the coloring member image included in the photographed image 8 may be converted into an amount of energy. Note that data in which the relationship between the amount of energy applied to the coloring member 30 and the color of the coloring member 30 is determined in advance may be prepared in advance for each type of coloring member 30 and stored in the storage unit 82.

Additionally, the derivation unit 96 may derive various indicators regarding the amount of energy applied to the coloring member 30. Various indicators include, for example, the energy distribution obtained by deriving the amount of energy for each pixel of the colored image corresponding to the colored area of the colored member 30 (hereinafter referred to as "colored area"), and the energy amount of the colored area. These are representative values such as the maximum value, minimum value, average value, and median value. In addition, for example, the area of the coloring region, the proportion of the area of the coloring region whose energy amount is within a predetermined range, the uniformity of the energy amount of the coloring region, and the load of the coloring region (area of the coloring region and energy product of the average values of quantities), etc. Another example is the degree of agreement or deviation from the standard when a standard is predetermined regarding the degree of coloring (ie, energy amount and energy distribution) of the coloring member 30.

The measurement control unit 98 controls the display 84 to display the photographed image 8 whose distortion, inclination, size, and color have been corrected by the correction unit 94 and various indicators related to the energy amount derived by the derivation unit 96. conduct. FIG. 7 shows an example of a screen D displayed on the display 84 by the measurement control unit 98. On the screen D, the coloring member image 31 in the photographed image 8 and various indicators related to the amount of energy derived from the coloring member image 31 are displayed.

As shown in screen D, the measurement control unit 98 may extract the coloring member image 31 from the photographed image 8 and control the image to be displayed on the display 84. Note that the "pressure area" on screen D shown in FIG. 7 means the area of the above-mentioned coloring region. "Average pressure" means the average value of the energy amount in the above coloring region. "Load" means the product of pressurized area and average pressure. "Uniformity of pressure values" means uniformity of pressure values in the coloring region.

Additionally, the measurement control unit 98 may receive input of supplementary information regarding the photographed image 8. Screen D displays the type of coloring member 30, pressure type, room temperature, and humidity as an example of additional information regarding the photographed image 8, and displays a pull-down menu P for accepting input thereof. In addition, "pressure types" include instantaneous pressure, which indicates the magnitude of the pressure instantaneously applied to the prescale, and continuous pressure, which indicates the time integral of the magnitude of the pressure continuously applied to the prescale, etc. There is. For example, additional information includes identification information of the calibration member 20, the coloring member 30, the user who applied energy to the coloring member 30, the user who photographed the coloring member 30, and the user's evaluation result regarding the amount of energy. , and various test conditions.

Further, the measurement control unit 98 transmits at least one of the photographed image 8 before correction by the correction unit 94, the photographed image 8 after correction, the coloring member image 31, and the coloring member image 31 after correction to the network I/F 86. to the server 4 via. Furthermore, the measurement control unit 98 transmits to the server 4 various indicators related to the amount of energy derived by the derivation unit 96 and the incidental information inputted. The server 4 stores information received from the smartphone 10 (measurement control unit 98) in the database 6 in association with the captured image 8.

Next, with reference to FIG. 8, the operation of the smartphone 10 according to the present exemplary embodiment will be described. In the smartphone 10, the measurement process shown in FIG. 8 is executed by the CPU 80 executing the measurement program 83B. The measurement process is executed, for example, when the user issues an instruction to start execution via the input unit 88.

In step S100, the acquisition unit 92 acquires the photographed image 8, which is photographed by the camera 11 and includes the calibration member image of the calibration member 20 and the coloring member image 31 of the coloring member 30. In the next step S102, the correction unit 94 extracts the frame image of the frame 21 from the captured image 8 acquired in step S100, and corrects the distortion, inclination, and tilt of the captured image 8 based on the shape of the extracted frame image. Correct at least one of the sizes. In the next step S104, the correction unit 94 calibrates the color of the photographed image 8 (particularly the coloring member image 31 included in the photographed image 8) using the patch image included in the photographed image 8 corrected in step S102. I do.

In the next step S106, the derivation unit 96 derives the amount of energy applied to the coloring member 30 based on the color of the coloring member image 31 calibrated in step S104 above. In the next step S108, the measurement control unit 98 controls the display 84 to display the coloring member image 31 calibrated in the above step S104 and the energy amount derived in the above step S106. Through this control, screen D shown in FIG. 7 is displayed on the display 84. When the process of step S108 ends, the information processing shown in FIG. 8 ends.

As described above, the irradiation control unit 90 of the smartphone 10 of the above embodiment suppresses the influence of the photographing environment light when the camera 11 photographs the coloring member 30 that develops color with a density distribution according to the amount of applied energy. Control is performed to irradiate photographing light F from the flash 12 for the purpose of photographing.

As described above, according to the smartphone 10 of the above embodiment, when photographing the coloring member 30, the flash 12 irradiates the photographing light F onto the coloring member 30, so that the influence of the photographing environment light can be suppressed. . Therefore, according to the smartphone 10 of the above embodiment, when photographing a coloring member for measuring energy, it is possible to obtain a photographed image in which the influence of the photographing environment light is reduced.

Note that, as described above, by using the smartphone 10 of the above configuration, the influence of the photographing environment light can be suppressed, so even if the coloring member 30 is photographed by the camera 11 without using the calibration member 20. good.

In addition, in the above embodiment, in the coloring member photographing mode, by setting the forced light emission mode, the photographing light F is forcedly, that is, always irradiated from the flash 12 onto the photographing target (coloring member 30) during photographing by the camera 11. It was. However, the invention is not limited to this embodiment, and even in the color-forming member photographing mode, if the user inputs an instruction to prohibit the irradiation of the photographing light F through the input unit 88, the irradiation control unit 90 controls the irradiation of the photographing light F from the flash 12. Control may be performed to prohibit irradiation.

Moreover, although the embodiment in which the camera 11 provided in the smartphone 10 is applied as an example of the photographing device of the present disclosure has been described above, the photographing device is not limited to the camera 11 provided in the smartphone 10. For example, a digital camera or the like provided separately from the smartphone 10 may be used as the photographing device. In addition, although the above description has been made regarding the form in which the photographing device and the energy measuring device of the present disclosure are integrated as the smartphone 10, the photographing device and the energy measuring device may be separate bodies. Moreover, although the embodiment in which the flash 12 provided in the smartphone 10 is applied as an example of the irradiation device of the present disclosure has been described above, the irradiation device is not limited to the flash 12 provided in the smartphone 10. For example, a light provided separately from the smartphone 10 may be used as the irradiation device. Moreover, although the embodiment in which the smartphone 10 is applied as an example of the control device and energy measurement device of the present disclosure has been described above, each of the control device and the energy measurement device is not limited to the smartphone 10. For example, a tablet terminal, a wearable terminal, a personal computer, etc. may be applied as each of the control device and the energy measurement device. Moreover, although the control device of this indication and the energy measurement device were integrated as the smart phone 10 above, the control device and the energy measurement device of this indication may be separate bodies.

In addition, in the above exemplary embodiment, for example, the hardware of processing units such as the irradiation control unit 90, the acquisition unit 92, the correction unit 94, the derivation unit 96, and the measurement control unit 98, As a structure, the following various processors can be used. As mentioned above, the various processors mentioned above include the CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as circuits that are manufactured after manufacturing, such as FPGA (Field Programmable Gate Array). A programmable logic device (PLD), which is a processor whose configuration can be changed, and a dedicated electrical device, which is a processor with a circuit configuration specifically designed to execute a specific process, such as an ASIC (Application Specific Integrated Circuit) Includes circuits, etc.

One processing unit may be composed of one of these various processors, or a combination of two or more processors of the same type or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). combination). Further, the plurality of processing units may be configured with one processor.

As an example of configuring multiple processing units with one processor, firstly, one processor is configured with a combination of one or more CPUs and software, as typified by computers such as a client and a server. There is a form in which a processor functions as multiple processing units. Second, there are processors that use a single IC (Integrated Circuit) chip, such as System On Chip (SoC), which implements the functions of an entire system including multiple processing units. be. In this way, various processing units are configured using one or more of the various processors described above as a hardware structure.

Furthermore, as the hardware structure of these various processors, more specifically, an electric circuit (circuitry) that is a combination of circuit elements such as semiconductor elements can be used.

Further, in each of the exemplary embodiments described above, a mode has been described in which the irradiation control program 83A and the measurement program 83B are stored (installed) in the storage unit 82 in advance, but the present invention is not limited to this. Each of the irradiation control program 83A and the measurement program 83B is recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), and a USB (Universal Serial Bus) memory. It may also be provided in a different format. Further, each of the irradiation control program 83A and the measurement program 83B may be downloaded from an external device via a network. That is, the program (program product) described in this exemplary embodiment may be provided in a recording medium or may be distributed from an external computer.

The disclosure of Japanese Patent Application No. 2022-091061 dated June 3, 2022 is incorporated herein by reference in its entirety.

All documents, patent applications, and technical standards mentioned herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard was specifically and individually indicated to be incorporated by reference. Incorporated herein by reference.

1 Energy measurement system 4 Server 6 Database 8 Captured image 10 Smartphone 11 Camera 12 Flash 20 Calibration member, 20A First area, 20B Second area, 20S Photographing surface 21 Frame 22A, 22B First patch group 24A, 24B Second patch Group 25 Patch 26 Blank area 27 Figure 30 Coloring member 31 Coloring member image 40 Control device 80 CPU
81 Memory 82 Storage section 83A Irradiation control program, 83B Measurement program 84 Display 86 Network I/F
88 Input section 89 Bus 90 Irradiation control section 92 Acquisition section 94 Correction section 96 Derivation section 98 Control section D Screen F Photographing light P Pull-down menu U User

Claims

comprising at least one processor;
The processor includes:
A control device that performs control to irradiate photographing light from an irradiation device to suppress the influence of photographing environment light when photographing a coloring member that develops color with a density distribution according to the amount of applied energy using a photographing device.
The processor includes:
The control device according to claim 1, wherein the irradiation device performs control to irradiate the photographing light regardless of the amount of the photographing light.
The control device according to claim 1, wherein the amount of the photographing light emitted by the irradiation device is larger than the amount of the photographing environment light.
When the illuminance due to the photographing environment light is X lux,
The control device according to claim 1, wherein the luminous flux of the photographing light is greater than or equal to 0.1×X lumens and less than or equal to 0.5×X lumens.
The processor includes:
When photographing the coloring member, control is performed to irradiate the photographing light from the irradiation device,
The control device according to claim 1, wherein when photographing a part other than the coloring member, control is performed to irradiate the photographing light from the irradiation device according to the photographing environment light.
The processor includes:
When receiving an irradiation prohibition instruction to prohibit irradiation of the photographing light from the irradiation device,
The control device according to claim 1, wherein instead of the control to cause the irradiation device to emit the photography light, control is performed to prohibit the irradiation of the photography light.
comprising at least one processor;
The processor includes:
When a color-forming member that develops color with a density distribution according to the applied energy amount is photographed by a photographing device, the control device controls the irradiation device to emit photographing light to suppress the influence of photographing environment light. Obtaining a color-forming member image representing the color-forming member photographed while the color-forming member is irradiated with the photographing light from an irradiation device;
Deriving the amount of energy applied to the coloring member based on the color of the coloring member image using data in which a relationship between the amount of energy applied to the coloring member and the color of the coloring member image is determined in advance. Energy measuring device.
A computer executes a process that controls the irradiation device to emit photographing light to suppress the influence of photographing environment light when photographing a coloring member that develops color with a density distribution according to the amount of energy applied using a photographing device. control method.
When a color-forming member that develops color with a density distribution according to the applied energy amount is photographed by a photographing device, the control device controls the irradiation device to emit photographing light to suppress the influence of photographing environment light. Obtaining a color-forming member image representing the color-forming member photographed while the color-forming member is irradiated with the photographing light from an irradiation device;
Deriving the amount of energy applied to the coloring member based on the color of the coloring member image using data in which a relationship between the amount of energy applied to the coloring member and the color of the coloring member image is determined in advance. An energy measurement method in which processing is performed by a computer.
When a coloring member that develops color with a density distribution according to the amount of energy applied is photographed using a photographing device, a computer executes a process that controls the irradiation device to emit photographing light to suppress the influence of the photographing environment light. control program to do this.
When a color-forming member that develops color with a density distribution according to the applied energy amount is photographed by a photographing device, the control device controls the irradiation device to emit photographing light to suppress the influence of photographing environment light. Obtaining a color-forming member image representing the color-forming member photographed while the color-forming member is irradiated with the photographing light from an irradiation device;
Deriving the amount of energy applied to the coloring member based on the color of the coloring member image using data in which a relationship between the amount of energy applied to the coloring member and the color of the coloring member image is determined in advance. An energy measurement program that allows a computer to perform processing.