Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/46—Colour picture communication systems
  • H04N1/48—Picture signal generators
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
  • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
  • G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
  • G01J3/52—Measurement of colour; Colour measuring devices, e.g. colorimeters using colour charts
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01L—MEASURING FORCE, STRESS, TORQUE, WORK, MECHANICAL POWER, MECHANICAL EFFICIENCY, OR FLUID PRESSURE
  • G01L1/00—Measuring force or stress, in general
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01L—MEASURING FORCE, STRESS, TORQUE, WORK, MECHANICAL POWER, MECHANICAL EFFICIENCY, OR FLUID PRESSURE
  • G01L1/00—Measuring force or stress, in general
  • G01L1/24—Measuring force or stress, in general by measuring variations of optical properties of material when it is stressed, e.g. by photoelastic stress analysis using infrared, visible light, ultraviolet
  • G01L1/247—Measuring force or stress, in general by measuring variations of optical properties of material when it is stressed, e.g. by photoelastic stress analysis using infrared, visible light, ultraviolet using distributed sensing elements, e.g. microcapsules
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V10/00—Arrangements for image or video recognition or understanding
  • G06V10/10—Image acquisition
  • G06V10/17—Image acquisition using hand-held instruments
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V10/00—Arrangements for image or video recognition or understanding
  • G06V10/20—Image preprocessing
  • G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
  • G06V10/225—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition based on a marking or identifier characterising the area
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V10/00—Arrangements for image or video recognition or understanding
  • G06V10/40—Extraction of image or video features
  • G06V10/56—Extraction of image or video features relating to colour
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V10/00—Arrangements for image or video recognition or understanding
  • G06V10/98—Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/46—Colour picture communication systems
  • H04N1/56—Processing of colour picture signals
  • H04N1/60—Colour correction or control
  • H04N1/603—Colour correction or control controlled by characteristics of the picture signal generator or the picture reproducer
  • H04N1/6052—Matching two or more picture signal generators or two or more picture reproducers
  • H04N1/6055—Matching two or more picture signal generators or two or more picture reproducers using test pattern analysis
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01L—MEASURING FORCE, STRESS, TORQUE, WORK, MECHANICAL POWER, MECHANICAL EFFICIENCY, OR FLUID PRESSURE
  • G01L1/00—Measuring force or stress, in general
  • G01L1/24—Measuring force or stress, in general by measuring variations of optical properties of material when it is stressed, e.g. by photoelastic stress analysis using infrared, visible light, ultraviolet
• • G—PHYSICS
  • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
  • G03G—ELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY
  • G03G15/00—Apparatus for electrographic processes using a charge pattern
  • G03G15/50—Machine control of apparatus for electrographic processes using a charge pattern, e.g. regulating differents parts of the machine, multimode copiers, microprocessor control
  • G03G15/5062—Machine control of apparatus for electrographic processes using a charge pattern, e.g. regulating differents parts of the machine, multimode copiers, microprocessor control by measuring the characteristics of an image on the copy material
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
  • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
  • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
  • G06K7/10544—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum
  • G06K7/10821—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum further details of bar or optical code scanning devices
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
  • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
  • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
  • G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
  • G06K7/1404—Methods for optical code recognition
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V10/00—Arrangements for image or video recognition or understanding
  • G06V10/20—Image preprocessing
  • G06V10/24—Aligning, centring, orientation detection or correction of the image
  • G06V10/247—Aligning, centring, orientation detection or correction of the image by affine transforms, e.g. correction due to perspective effects; Quadrilaterals, e.g. trapezoids
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/46—Colour picture communication systems
  • H04N1/52—Circuits or arrangements for halftone screening
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/46—Colour picture communication systems
  • H04N1/56—Processing of colour picture signals
  • H04N1/60—Colour correction or control
  • H04N1/603—Colour correction or control controlled by characteristics of the picture signal generator or the picture reproducer
  • H04N1/6033—Colour correction or control controlled by characteristics of the picture signal generator or the picture reproducer using test pattern analysis

Definitions

• the present disclosure relates to an information processing device, an information processing method, and an information processing program.
• a coloring member that develops a color depending on the amount of energy when energy (for example, pressure, heat, ultraviolet rays, etc.) is applied.
• energy for example, pressure, heat, ultraviolet rays, etc.
• a coloring member there is, for example, Prescale (registered trademark) (manufactured by Fuji Film Co., Ltd.), which can obtain a coloring density depending on the applied pressure.
• a pressure measurement sheet (for example, prescale) is placed on a calibration sheet, and the density, size, etc. of the photographed image are determined based on the calibration sheet included in the photographed image. It is disclosed that distortion and shape are corrected and density values of a pressure measurement sheet included in the corrected image are converted into pressure values.
• a measurement sheet colored to a density corresponding to the amount of external energy is imaged by a sensor having multiple spectral sensitivities (for example, R sensitivity, G sensitivity, and B sensitivity). It is disclosed that an image signal of a captured image is acquired, and a surface distribution of the amount of external energy applied to a measurement sheet is derived based on the ratio of signals for each spectral sensitivity.
• images related to the color-forming member such as images containing identifiers (e.g. barcodes, two-dimensional codes, etc.) indicating identification information of the color-forming member, and photographs of the photographing environment of the color-forming member, etc. It is desired to be able to take and record other images as well.
• identifiers e.g. barcodes, two-dimensional codes, etc.
• an analysis process or the like for the identifier. Therefore, conventionally, a user inputs image attributes, and a processor executes processing according to the input attributes.
• a technology that can further improve convenience when it is possible to capture images including color-forming members and other images.
• the present disclosure provides an information processing device, an information processing method, and an information processing program that can improve usability.
• a first aspect of the present disclosure is an information processing device that includes at least one processor, and the processor includes a color-forming member image obtained by photographing a color-forming member that develops color with a density distribution according to the amount of applied energy; Then, at least one of the accompanying images related to the coloring member image is acquired, and it is determined whether the acquired image is the coloring member image or the accompanying image.
• the processor may execute predetermined processing according to the determination result of the acquired image.
• a third aspect of the present disclosure is that in the second aspect, when the processor determines that the acquired image is a coloring member image, the processor determines the amount of energy applied to the coloring member and the amount of energy of the coloring member included in the coloring member image.
• the amount of energy applied to the coloring member may be derived based on the coloring member image using characteristic data whose relationship with color is determined in advance.
• a fourth aspect of the present disclosure is that in the third aspect, the processor may evaluate the derived energy amount based on predetermined reference information.
• the processor determines that the acquired image is an incidental image, the incidental image includes at least a character string and an identifier. It may be determined whether one of the two is included.
• a sixth aspect of the present disclosure is that in the fifth aspect, when the processor determines that the acquired image is an incidental image that includes at least one of a character string and an identifier, the processor determines that the character string and the identifier included in the incidental image are At least one of them may be analyzed.
• a seventh aspect of the present disclosure is an information processing method, which includes a coloring member image obtained by photographing a coloring member that develops color with a density distribution according to the amount of applied energy, and an incidental image related to the coloring member image.
• the method includes a process of acquiring at least one image of the image and determining whether the acquired image is a coloring member image or an incidental image.
• An eighth aspect of the present disclosure is an information processing program that includes a coloring member image obtained by photographing a coloring member that develops color with a density distribution according to an applied energy amount, and an incidental image related to the coloring member image. This is for causing a computer to execute a process of acquiring at least one image of the image and determining whether the acquired image is a coloring member image or an incidental image.
• the information processing device, information processing method, and information processing program of the present disclosure can improve usability.
• FIG. 1 is a diagram illustrating an example of a schematic configuration of an information processing system.
• FIG. 2 is a schematic diagram showing how a coloring member image is photographed. It is a figure showing an example of a color development member and a calibration member. It is a figure showing an example of a photographing order.
• FIG. 2 is a block diagram showing an example of the hardware configuration of a terminal device and a server device.
• FIG. 3 is a diagram showing an example of characteristic data.
• FIG. 2 is a block diagram showing an example of a functional configuration of a terminal device and a server device.
• FIG. 3 is a diagram showing an example of a screen displayed on a display.
• FIG. 3 is a diagram showing an example of a screen displayed on a display. It is a flowchart which shows an example of information processing of a terminal device. It is a flowchart which shows an example of information processing of a server apparatus.
• FIG. 3 is a diagram for explaining a combined image.
• FIG. 1 is a diagram showing a schematic configuration of an information processing system 1.
• the information processing system 1 includes a terminal device 10, a server device 12, and a database 6.
• the terminal device 10 and the server device 12 are connected to be able to communicate with each other via a wired or wireless network.
• the terminal device 10 is an example of the information processing device and the first information processing device of the present disclosure
• the server device 12 is an example of the second information processing device and the external device of the present disclosure.
• the information processing system 1 is a system for measuring the amount of energy using a coloring member 90 that, when energy (for example, pressure, heat, ultraviolet rays, etc.) is applied, develops a color with a concentration distribution according to the amount of applied energy. be.
• the terminal device 10 acquires an image taken of the coloring member 90 after energy has been applied, and derives the amount of energy applied to the coloring member 90 from the image.
• the images acquired by the terminal device 10 are transmitted to the server device 12 and stored in the database 6 by the server device 12.
• the connection form between the server device 12 and the database 6 is not particularly limited; for example, they may be connected via a data bus, or may be connected via a network such as NAS (Network Attached Storage) and SAN (Storage Area Network). It may also be connected.
• NAS Network Attached Storage
• SAN Storage Area Network
• Prescale registered trademark (manufactured by Fujifilm Corporation), which can obtain a coloring density depending on the applied pressure
• Prescale is a sheet-like support coated with a coloring agent containing microcapsules containing a colorless dye and a color developer.
• the coloring agent contains multiple types of microcapsules having different sizes and strengths, the amount of microcapsules destroyed varies depending on the applied pressure, and the coloring density also varies. Therefore, by observing the color density, the magnitude and pressure distribution of the pressure applied to the prescale can be measured.
• Thermoscale (trade name) (manufactured by Fujifilm Corporation) which develops color according to the amount of heat
• UV Scale trade name (manufactured by Fujifilm Corporation) which develops color according to the amount of ultraviolet light
• the user takes a picture using the camera 40 (see FIG. 5) of the terminal device 10 with the coloring member 90 placed on the calibration member 80. conduct. Thereby, the terminal device 10 acquires the coloring member image 50 including the calibration member 80 and the coloring member 90.
• the coloring member image 50 may be affected by the characteristics of the camera 40, the lighting conditions (for example, illumination and color temperature) in the environment where the picture is taken, the shooting angle, the shooting distance, etc. . That is, the coloring member image 50 may have variations in distortion, tilt, size, shading, color, and the like.
• the calibration member 80 is for correcting these influences on the coloring member image 50.
• FIG. 3 shows the photographed surface 80S of the calibration member 80 on which the coloring member 90 is placed.
• the calibration member 80 is a support made of paper, resin, etc., and formed into a sheet or plate shape.
• the photographed surface 80S includes a plurality of patches 83, four figures 86A to 86D, a central region 88, and a frame 89 surrounding the outer edge of the central region 88.
• the colors of the plurality of patches 83 may be different from each other, or there may be two or more patches 83 of the same color.
• the plurality of patches 83 are for calibrating the color of the coloring member 90 in the coloring member image 50.
• the four figures 86A to 86D are for indicating the range that should be included in the angle of view when the user photographs the calibration member 80 and the coloring member 90.
• the frame 89 is for correcting the shape of the coloring member image 50, such as distortion, inclination, and size.
• imaging is performed according to the imaging order. Specifically, an imaging order is created in at least one of the terminal device 10 and the server device 12, and the imaging order is shared between the terminal device 10 and the server device 12. The user confirms the imaging order displayed on the display 24A of the terminal device 10, and photographs the coloring member 90 according to the imaging order (see FIG. 8).
• the imaging order includes items related to supplementary information regarding the coloring member image 50.
• the incidental information includes, for example, the object to be inspected using the coloring member 90, the type of the coloring member 90, the type of energy applied to the coloring member 90, the photographing environment of the coloring member 90, the photographer of the coloring member 90, etc.
• the information may include information regarding at least one of the following.
• the types of coloring member 90 include, for example, types according to measurable energy types such as prescale, thermoscale, and UV scale, as well as types of prescale for low pressure, medium pressure, and high pressure.
• Types of energy include, for example, types such as pressure, heat, and ultraviolet rays, as well as instantaneous pressure (amount of pressure applied instantaneously) and continuous pressure (amount of pressure applied continuously). time integral), etc.
• the photographing environment is, for example, the room temperature, humidity, light source (illuminance, color temperature, etc.) in the environment in which the coloring member 90 is photographed.
• the supplementary information may include information regarding at least one of the amount of energy applied to the coloring member 90 derived based on the coloring member image 50 and the evaluation of the amount of energy.
• various indicators such as a maximum value, an average value, and an area of a coloring region are derived regarding the amount of energy applied to the coloring member 90 (details will be described later). Therefore, the imaging order may include an item of an index regarding the amount of energy to be stored in the database 6.
• an evaluation is performed based on predetermined reference information regarding the amount of energy (details will be described later). Therefore, the imaging order may include reference information used for evaluation.
• FIG. 4 shows an example of an imaging order.
• the imaging order shown in FIG. 4 is derived based on the object to be inspected using the coloring member 90, the type of the coloring member 90, the type of energy applied to the coloring member 90 (“pressure type”), and the coloring member image 50. This includes items related to indicators related to the amount of energy used ( ⁇ inspection item 1'') and standard information ( ⁇ standard values'') used for evaluation of the indicators.
• the terminal device 10 includes a CPU (Central Processing Unit) 21A, a nonvolatile storage section 22A, and a memory 23A as a temporary storage area.
• the terminal device 10 also includes a display 24A such as a liquid crystal display, an input section 25A, a network I/F (Interface) 26A, and a camera 40.
• the CPU 21A, the storage section 22A, the memory 23A, the display 24A, the input section 25A, the network I/F 26A, and the camera 40 are connected to each other via a bus 28A such as a system bus and a control bus so that they can exchange various information with each other. .
• the storage unit 22A is realized by, for example, a storage medium such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), and a flash memory.
• the storage unit 22A stores an information processing program 27A for the terminal device 10 and characteristic data 18.
• the CPU 21A reads the information processing program 27A from the storage unit 22A, expands it into the memory 23A, and executes the expanded information processing program 27A.
• the CPU 21A is an example of the first processor and processor of the present disclosure.
• the input unit 25A is for receiving user operations, and is, for example, a touch panel, buttons, keyboard, mouse, etc.
• the network I/F 26A performs wired or wireless communication with the server device 12 and other external devices (not shown).
• the camera 40 has a plurality of sensors having different spectral sensitivities, and under the control of the CPU 21A, the sensor photographs a subject and outputs the image signal.
• the terminal device 10 for example, a smartphone with a camera function, a tablet terminal, a wearable terminal, a personal computer, etc. can be used as appropriate.
• the server device 12 includes a CPU 21B, a nonvolatile storage section 22B, and a memory 23B as a temporary storage area.
• the server device 12 also includes a display 24B such as a liquid crystal display, an input section 25B, and a network I/F 26B.
• the CPU 21B, the storage section 22B, the memory 23B, the display 24B, the input section 25B, and the network I/F 26B are connected to each other via a bus 28B such as a system bus and a control bus so that they can exchange various information with each other.
• the storage unit 22B is realized by, for example, a storage medium such as an HDD, an SSD, and a flash memory.
• An information processing program 27B for the server device 12 is stored in the storage unit 22B.
• the CPU 21B reads the information processing program 27B from the storage unit 22B, expands it into the memory 23B, and executes the expanded information processing program 27B.
• the CPU 21B is an example of the second processor of the present disclosure.
• the input unit 25B is for receiving user operations, and is, for example, a touch panel, buttons, keyboard, mouse, etc.
• the network I/F 26B performs wired or wireless communication with the terminal device 10, the database 6, and other external devices (not shown).
• the server device 12 for example, a general-purpose computer in which a software program that provides functions of a database management system (DBMS) is installed can be used as appropriate.
• DBMS database management system
• FIG. 6 shows an example of the characteristic data 18.
• the characteristic data 18 is data in which the relationship between the amount of energy applied to the coloring member 90 and the color of the coloring member 90 included in the coloring member image 50 is determined in advance.
• pressure is shown as an example of the amount of energy.
• values representing the color of the coloring member 90 in the coloring member image 50 R (red) values, G (green) values, and B (blue) values in the RGB color system are shown.
• the terminal device 10 includes an acquisition section 30, a discrimination section 31, a correction section 32, a derivation section 33, an evaluation section 34, and a control section 35.
• the CPU 21A executes the information processing program 27A, the CPU 21A functions as the acquisition section 30, the discrimination section 31, the correction section 32, the derivation section 33, the evaluation section 34, and the control section 35.
• FIG. 8 shows an example of the screen D1 displayed on the display 24A by the control unit 35 when starting to photograph the coloring member 90.
• the control unit 35 displays the imaging order on the screen D1.
• the user selects the "start continuous imaging” button 94.
• the control unit 35 starts the camera 40, and the user starts shooting the coloring member 90 with the camera 40 according to the shooting order.
• the acquisition unit 30 acquires a plurality of coloring member images 50 obtained by photographing the coloring member 90 with the camera 40.
• the coloring member image 50 may include the calibration member 80 including the patch 83 for calibrating the color of the coloring member 90.
• At least one of the plurality of coloring member images 50 may include a patch 83 for calibrating the color of the coloring member 90, and some of the plurality of coloring member images 50 may include a patch 83 for calibrating the color of the coloring member 90. may not include patch 83. This is because, for a plurality of coloring member images 50 with the same imaging device and shooting environment, the patch 83 included in at least one coloring member image 50 may be used for other coloring member images 50. . That is, the user photographs at least one coloring member 90 together with the calibration member 80 among the plurality of coloring members 90 specified in the imaging order, and photographs the other coloring members 90 without including the calibration member 80. The coloring member 90 may be photographed alone.
• the acquisition unit 30 may acquire ancillary images related to the coloring member image 50.
• the accompanying image may be, for example, an image that includes at least one of a character string and an identifier (for example, a bar code and a two-dimensional code) related to the inspection of the coloring member 90.
• the acquisition unit 30 may generate two images showing the identification information, type and test item of the coloring member 90, the identification information and type of the object to be tested using the coloring member 90, the identification information of the examiner, etc. An image including the dimensional code may be obtained.
• the incidental image may be an image incidental to the inspection and photography of the coloring member 90, such as a photograph of the object to be inspected, a photograph of the photographing environment of the coloring member image 50, and a photograph of the examiner's face. .
• the determining unit 31 determines whether the image acquired by the acquiring unit 30 is the coloring member image 50 or the accompanying image. Furthermore, when the determination unit 31 determines that the image acquired by the acquisition unit 30 is an incidental image, it further determines whether the incidental image includes at least one of a character string and an identifier. That is, the determining unit 31 determines whether it is the coloring member image 50, an auxiliary image that includes various information such as identification information, or an auxiliary image that does not include various information. Specifically, as shown in screen D1 in FIG. 8, the determining unit 31 receives a selection of the type of image to be photographed, and determines which of the selected types of images the image acquired by the acquiring unit 30 corresponds to. You may decide whether it applies to you. As a method for determining the type of image, a known method such as pattern matching can be appropriately applied.
• Each functional unit executes a predetermined process according to the determination result by the determination unit 31.
• the determination unit 31 may analyze at least one of the character string and the identifier included in the associated image.
• the determination unit 31 may obtain the identification information of the coloring member 90 by analyzing the two-dimensional code.
• the determination unit 31 may analyze the character string using a known optical character recognition technology to obtain text data. Information analyzed from these supplementary images may be used as supplementary information of the coloring member image 50.
• the acquisition unit 30 acquires the characteristic data 18 stored in the storage unit 22A (see FIG. 6).
• the correction unit 32 corrects at least one of the distortion, tilt, size, shading, and color of the coloring member image 50. This corrects the effects of the characteristics of the camera 40, the lighting conditions (for example, illuminance and color temperature) in the environment in which the image is taken, the shooting angle, the shooting distance, etc. that may occur in the coloring member image 50 when the user takes a photo. Ru.
• the correction unit 32 may extract the frame 89 from the coloring member image 50 and correct the distortion, inclination, and size of the coloring member image 50 based on the shape of the extracted frame 89.
• a method for extracting the frame 89 a known method using edge extraction processing in an image or the like can be applied as appropriate. For example, when the frame 89 is rectangular as shown in FIG. 3, the correction unit 32 performs projective transformation, affine transformation, etc. so that the four corners of the frame 89 extracted from the coloring member image 50 are each 90 degrees. Then, the shape of the coloring member image 50, such as distortion, inclination, size, etc., is corrected.
• the correction unit 32 may perform shading correction on the coloring member image 50.
• Shading is a variation in brightness that occurs on the coloring member image 50 due to a decrease in the amount of peripheral light caused by the optical system of the camera 40 and variations in illuminance distribution in the lighting environment in which photography is performed.
• the shading correction method any known method can be applied as appropriate.
• the correction unit 32 may calibrate the color of the coloring member 90 included in the coloring member image 50 using the patch 83 included in the coloring member image 50. This is because the color of the coloring member 90 is affected by the characteristics of the camera 40 and the lighting conditions in the environment in which photography is performed.
• a calibration method any known method can be applied as appropriate.
• the reference color for each patch 83 included in the calibration member 80 is stored in advance in the storage unit 22A, and the correction unit 32 adjusts the color of each patch 83 included in the coloring member image 50 to the respective reference color.
• the color of the coloring member image 50 may be adjusted to match.
• the correction unit 32 may use the patch 83 included in at least one coloring member image 50 to calibrate the color of the coloring member 90 included in each of the plurality of coloring member images 50. Specifically, when the patch 83 is included in the color-forming member image 50, the correction unit 32 calibrates the color of the color-forming member 90 using the patch 83, and when the patch 83 is included in the color-forming member image 50. If not, it is preferable to calibrate the color of the coloring member 90 using the patch 83 included in another coloring member image 50.
• the correction unit 32 may perform the same calibration on the coloring member image 50 that does not include the patch 83 as it does on the coloring member image 50 that includes the patch 83.
• the coloring member image 50 including the patch 83 it is preferable to perform calibration by preferentially using the patch 83 included in the image rather than other images.
• the calibration member 80 may include two or more patches 83 of the same color.
• two or more patches 83 that are originally formed in the same color may differ from each other on the colored member image 50 due to the characteristics of the camera 40, the lighting conditions in the environment in which the image is taken, the shooting angle, the shooting distance, etc. May be expressed in color. Therefore, for example, the correction unit 32 may adjust the color of the coloring member image 50 so that the average color in the coloring member image 50 of the patches 83 formed of the same color matches the reference color.
• the correction unit 32 adjusts the color of the coloring member image 50 so that among the patches 83 formed with the same color, the color in the coloring member image 50 that is closest to the reference color matches the reference color. You may.
• the correction unit 32 may perform calibration using some of the patches 83 among the plurality of patches 83 included in the coloring member image 50.
• the correction unit 32 may change the patch 83 used for calibration depending on the type of coloring member 90.
• a plurality of types of prescales which are an example of the coloring member 90, are manufactured with different measurable pressure ranges, such as those for low pressure, medium pressure, and high pressure.
• a thermoscale, a UV scale, etc. can also be used in addition to the prescale.
• the correction unit 32 performs calibration using some of the patches 83, which are predetermined according to the type of the coloring member 90 included in the coloring member image 50, among the plurality of patches 83 included in the coloring member image 50. You may do so.
• the correspondence between the type of coloring member 90 and the patch 83 used for calibration may be stored in the storage unit 22A in advance, for example.
• the type of the coloring member 90 included in the coloring member image 50 may be input by the user via the input unit 25A (see FIG. 9), or the user may input an identification code indicating the type of the coloring member 90 to the coloring member 90.
• the correction unit 32 may identify the identification code by reading the identification code.
• the derivation unit 33 uses the characteristic data 18 acquired by the acquisition unit 30 to derive the amount of energy applied to the coloring member 90 based on each of the plurality of coloring member images 50. Specifically, the derivation unit 33 derives the energy amount based on the coloring member image 50 after the correction unit 32 corrects at least one of distortion, tilt, size, shading, and color.
• the characteristic data 18 may be prepared in advance for each type of coloring member 90 (for example, low pressure, medium pressure, high pressure, etc.) and stored in the storage unit 22A. In this case, the deriving unit 33 may derive the energy amount using the characteristic data 18 according to the type of the coloring member 90 included in the coloring member image 50.
• the derivation unit 33 may derive various indicators related to the amount of energy applied to the coloring member 90.
• Various indicators include, for example, the energy distribution obtained by deriving the amount of energy for each pixel in the colored region of the coloring member 90 (hereinafter referred to as the "coloring region"), and the maximum and minimum values of the energy amount in the coloring region. These are representative values such as values, average values, and median values.
• the area of the coloring region the proportion of the area of the coloring region whose energy amount is within a predetermined range, the uniformity of the energy amount of the coloring region, and the load of the coloring region (area of the coloring region and energy product of the average values of quantities), etc.
• a standard is predetermined regarding the degree of coloring (that is, energy amount and energy distribution) of the coloring member 90, it is the degree of coincidence and the degree of deviation from the standard.
• the evaluation unit 34 evaluates the energy amount derived by the derivation unit 33 based on predetermined reference information.
• the standard information includes, for example, threshold values regarding the degree of coincidence and deviation from a predetermined limit sample regarding the degree of color development (energy amount and energy distribution) of the color development member 90, and upper and lower limit values of various indicators regarding the amount of energy. etc.
• the evaluation unit 34 may evaluate pass/fail depending on whether the energy amount derived by the derivation unit 33 satisfies the standard. Furthermore, the evaluation unit 34 may receive designation of a part of the area of the coloring member 90 in the coloring member image 50 to be evaluated, and may evaluate the part of the area.
• the reference information may be included in the imaging order, for example, or may be stored in advance in the storage unit 22A.
• the evaluation unit 34 may perform a comprehensive evaluation based on the results of evaluating each of the energy amounts derived by the derivation unit 33. For example, the evaluation unit 34 evaluates the overall pass/fail based on whether or not the proportion of images rated as acceptable among the plurality of coloring member images 50 acquired according to the imaging order exceeds a predetermined threshold. You may.
• each process is performed on two or more coloring member images 50 at once. (so-called batch processing).
• the process of evaluating based on the reference information provided for each predetermined number of processing units For example, after acquiring (photographing) five coloring member images 50, it is preferable to move to the energy amount derivation process for all five images.
• the control unit 35 performs control to display the coloring member image 50, the energy amount derived by the derivation unit 33, and the evaluation result by the evaluation unit 34 on the display 24A.
• FIG. 9 shows an example of the screen D2 displayed on the display 24A by the control unit 35. On the screen D2, an image of the coloring member 90 in the coloring member image 50, various indicators regarding the amount of energy derived from the coloring member 90, and evaluation results are displayed.
• the control unit 35 may control the extraction of the coloring member 90 from the coloring member image 50 and displaying it on the display 24A. Further, the control unit 35 may use, as the coloring member image 50 to be displayed on the display 24A, an image after at least one of distortion, tilt, size, shading, and color has been corrected by the correction unit 32.
• the "pressure area” on the screen D2 means the area of the above-mentioned coloring region.
• Average pressure means the average value of the energy amount in the above coloring region.
• “Load” means the product of pressurized area and average pressure.
• Uniformity of pressure values means uniformity of pressure values in the coloring region.
• control unit 35 may receive input of supplementary information regarding the coloring member image 50.
• the type of coloring member 90, pressure type, room temperature, humidity, and light source are displayed as an example of supplementary information regarding the coloring member image 50, and a pull-down menu 92 for accepting input thereof is displayed.
• the pressure types include, for example, instantaneous pressure indicating the magnitude of the pressure instantaneously applied to the prescale, and continuous pressure indicating the time integral of the magnitude of the pressure continuously applied to the prescale.
• the light source is, for example, the standard illuminant D65 and the auxiliary illuminants D50, D55, and D75 defined in JIS Z 8720:2012.
• additional information may include identification information of the calibration member 80, the coloring member 90, the user who applied energy to the coloring member 90, the user who photographed the coloring member 90, etc., the user's evaluation results regarding the amount of energy, and , various test conditions, etc. may be used.
• control unit 35 transmits the colored member image 50 to the server device 12 via the network I/F 26A. Specifically, the control unit 35 controls at least one of the coloring member image 50 before correction by the correction unit 32, the coloring member image 50 after correction, and the image of the coloring member 90 portion extracted from the coloring member image 50. is transmitted to the server device 12.
• the control unit 35 may transmit additional information of the coloring member image 50 to the server device 12.
• the incidental information includes the amount of energy derived by the derivation unit 33, the result of the evaluation by the evaluation unit 34, the incidental image acquired by the acquisition unit 30, the character string included in the incidental image by the determination unit 31, and This includes information analyzed from identifiers, etc., and information received as input.
• the control unit 35 may transmit information about items specified in the imaging order among these supplementary information. In other words, the control unit 35 may exclude items of the accompanying information that are not specified in the imaging order from being transmitted to the server device 12.
• the control unit 35 transmits the minimum value of the energy amount to the server device 12. You don't have to.
• the server device 12 includes a control section 60 and a determination section 62.
• the CPU 21B executes the information processing program 27B, the CPU 21B functions as each functional unit of the control unit 60 and the determination unit 62.
• the control unit 60 stores the coloring member image 50 and accompanying information received from the terminal device 10 via the network I/F 26B in the database 6. Further, the control unit 35 stores the plurality of coloring member images 50 and accompanying information included in one imaging order in the database 6 as a set of data. That is, the control unit 60 stores the energy amount derived based on each of the plurality of coloring member images 50 in the database 6 as a set of data.
• the determination unit 62 determines whether or not the coloring member image 50 stored in the database 6 satisfies predetermined conditions. Specifically, the determination unit 62 may determine whether or not the coloring member images 50 stored in the database 6 comply with a predetermined imaging order.
• the determination unit 62 may determine whether the number of coloring member images 50 specified in the imaging order and the number of coloring member images 50 stored in the database 6 match. For example, if the imaging order includes 30 orders, the determination unit 62 may determine whether the database 6 stores 30 coloring member images 50.
• the determining unit 62 may determine whether or not the item regarding the supplementary information specified in the imaging order and the supplementary information of the coloring member image 50 stored in the database 6 match. For example, in the imaging order shown in FIG. It is assumed that "pressure roller A" No. 1 is inspected using the coloring member 90 for "high pressure” but is mistakenly tested using the coloring member 90 for "low pressure” and is also stored in the database 6 as such. In this case, the determination unit 62 may determine that the imaging order and the supplementary information stored in the database 6 do not match. For example, in the imaging order shown in FIG.
• the determination unit 62 may determine that the imaging order and the supplementary information stored in the database 6 do not match.
• the control unit 60 causes the terminal device 10 to transmit the coloring member image 50 to the terminal device 10. You may also request retransmission.
• the control unit 35 of the terminal device 10 receives a retransmission request from the server device 12, it may retransmit the coloring member image 50 to the server device 12.
• the control unit 60 notifies the terminal device 10 to that effect. You may.
• the control unit 35 of the terminal device 10 receives a notification from the server device 12 indicating that the coloring member image 50 stored in the database 6 does not meet predetermined conditions, the control unit 35 of the terminal device 10 notifies the user of this fact. You may notify.
• the means of notification is not particularly limited, and for example, the notification may be displayed on the display 24A or may be notified by sound.
• the control unit 60 when the determination unit 62 determines that the coloring member image 50 stored in the database 6 satisfies predetermined conditions, the control unit 60 also notifies the terminal device 10 of this fact. You may notify. After transmitting the coloring member image 50 to the server device 12, the control unit 35 of the terminal device 10 stores the coloring member image 50 in the storage unit 22A in preparation for a retransmission request until a predetermined period (for example, one month) has elapsed. The coloring member image 50 may be stored. On the other hand, if a notification is received from the server device 12 that the coloring member image 50 stored in the database 6 satisfies a predetermined condition, the notification may be received even before the predetermined period has elapsed. The coloring member image 50 may be deleted from the storage section 22A.
• the first information processing shown in FIG. 10 is executed by the CPU 21A executing the information processing program 27A.
• the first information processing is executed, for example, when the user issues an instruction to start execution via the input unit 25A.
• step S10 the control unit 35 displays the imaging order on the display 24A.
• step S12 the acquisition unit 30 acquires an image photographed by the camera 40.
• candidates for images to be acquired by the acquisition unit 30 include the coloring member image 50 photographed according to the imaging order displayed in step S10 and accompanying images related to the coloring member image 50.
• the accompanying images there are those that include a character string and/or an identifier indicating accompanying information, and those that do not.
• step S14 the determining unit 31 determines whether the image acquired in step S12 is the coloring member image 50 or the accompanying image.
• step S16 the acquisition unit 30 acquires the characteristic data 18 from the storage unit 22A.
• step S18 the correction unit 32 corrects at least one of the distortion, tilt, size, shading, and color of the coloring member image 50 acquired in step S12.
• step S20 the derivation unit 33 uses the characteristic data 18 acquired in step S16 to derive the amount of energy applied to the coloring member 90 based on the coloring member image 50 corrected in step S18.
• step S22 the evaluation unit 34 evaluates the energy amount derived in step S20 based on predetermined reference information.
• step S14 determines whether the image is not the coloring member image 50 but the incidental image (N in step S14). If it is determined in step S14 that the image is not the coloring member image 50 but the incidental image (N in step S14), the process moves to step S30.
• step S30 the determining unit 31 determines whether the accompanying image acquired in step S12 includes at least one of a character string and an identifier. If it is determined that the accompanying image includes at least one of a character string and an identifier (Y in step S30), the process moves to step S32, and the determining unit 31 analyzes at least one of the character string and the identifier included in the accompanying image.
• step S40 the control unit 35 controls the display 24A to display the coloring member image 50 corrected in step S18 and the accompanying information of the coloring member image 50.
• the incidental information includes at least one of the energy amount derived in step S20, the result of the evaluation in step S22, an incidental image, and at least one of a character string and an identifier included in the incidental image analyzed in step S32. Including one.
• step S42 the control unit 35 transmits the coloring member image 50 and the accompanying information to the server device 12, and ends the first information processing.
• the second information processing shown in FIG. 11 is executed by the CPU 21B executing the information processing program 27B.
• the second information processing is started, for example, when a coloring member image is received from the terminal device 10.
• step S50 the control unit 60 stores the coloring member image 50 and supplementary information received from the terminal device 10 in the database 6.
• step S52 the control unit 35 and the determination unit 62 determine whether or not the coloring member image 50 and the accompanying information stored in the database 6 in step S10 satisfy a predetermined condition. If it is determined that the conditions are met, this second information processing is ended.
• step S52 if it is determined in step S52 that the condition is not satisfied, the process moves to step S54.
• the control unit 60 may request the terminal device 10 to retransmit the coloring member image 50 and the supplementary information. Further, the control unit 60 may notify the terminal device 10 that the coloring member image 50 and the accompanying information stored in the database 6 do not satisfy a predetermined condition.
• step S54 the second information processing ends.
• the information processing system 1 includes a first information processing device (terminal device 10) including at least one first processor, and a second information processing device (terminal device 10) including at least one second processor.
• a processing device server device 12).
• the first processor acquires a coloring member image 50 obtained by photographing a coloring member 90 that develops color with a density distribution according to the amount of applied energy, and transmits the coloring member image 50 to the second information processing device. do.
• the second processor stores the coloring member image 50 received from the first information processing device in the database 6.
• the first processor or the second processor determines whether or not the coloring member image 50 stored in the database 6 satisfies a predetermined condition.
• the information processing system 1 when various data such as the coloring member image 50 taken by the terminal device 10 is aggregated in the server device 12, the data to be aggregated in the server device 12 is appropriately It can be determined whether the data is aggregated or not. Therefore, various data acquired by the terminal device 10 can be appropriately aggregated in the server device 12, and usability can be improved.
• the information processing device includes at least one processor, and the processor photographs the coloring member 90 that develops color with a density distribution according to the applied energy amount.
• a plurality of coloring member images 50 are acquired, and a plurality of coloring members Based on each member image 50, the amount of energy applied to the coloring member 90 is derived.
• the energy amount can be derived for each of the plurality of coloring member images 50. Therefore, when performing a plurality of tests in succession, imaging and derivation of the energy amount can proceed smoothly, and usability can be improved.
• the information processing device includes at least one processor, and the processor photographs the coloring member 90 that develops color with a density distribution according to the applied energy amount. At least one of the coloring member image 50 and the accompanying image related to the coloring member image 50 is acquired, and it is determined whether the acquired image is the coloring member image 50 or the accompanying image.
• the information processing device terminal device 10
• the image type can be determined later without distinguishing between the coloring member image 50 and the accompanying image at the time of photographing. Therefore, usability can be improved.
• the server device 12 may have some of the functions that the terminal device 10 has.
• the server device 12 may perform the function of the deriving unit 33 (deriving the amount of energy based on the coloring member image 50).
• the terminal device 10 may have some of the functions that the server device 12 has.
• the terminal device 10 may execute the function of the determining unit 62 (determining whether the coloring member image 50 stored in the database 6 satisfies predetermined conditions). good.
• the terminal device 10 acquires a plurality of coloring member images 50 according to the imaging order in FIG. 4, but the present invention is not limited to this.
• the technique according to this exemplary embodiment can also be applied to a form in which at least one coloring member image 50 is acquired.
• FIG. 12 shows one coloring member 90 divided into four regions 90A to 90D.
• An example of a situation in which it is appropriate to divide in this way is a case where the coloring member 90 is so large that it is difficult to photograph it at once with the camera 40 of the terminal device 10 (smartphone).
• the acquisition unit 30 may combine a plurality of coloring member images 50 obtained by photographing a plurality of regions 90A to 90D to generate one combined image. Further, the derivation unit 33 may derive the amount of energy applied to the coloring member 90 based on this combined image. In this case, the derivation unit 33 may derive the distribution of the amount of energy applied to the coloring member 90 based on this combined image, and generate a two-dimensional graph (for example, a heat map) representing the distribution of the amount of energy. good. Furthermore, the evaluation unit 34 may evaluate the amount of energy derived based on this combined image based on predetermined reference information.
• the correction unit 32 performs shading correction on the coloring member image 50, and the derivation unit 33 derives the energy amount based on the coloring member image 50 after the shading correction.
• International Publication No. 2022/059342 discloses that by using the ratio of signals for each spectral sensitivity of an image, unevenness in the surface distribution of density values in an image can be eliminated without performing shading correction.
• the deriving unit 33 may derive the ratio of signals for each spectral sensitivity of the coloring member image 50 using the technique described in International Publication No. 2022/059342, and may derive the energy amount based on the ratio. In this case, the correction unit 32 does not need to perform shading correction on the coloring member image 50.
• the camera 40 included in the terminal device 10 is used as the photographing device for the coloring member image 50, but the present invention is not limited to this.
• a digital camera, a scanner, etc. external to the terminal device 10 may be used as the photographing device.
• the terminal device 10 does not need to include the camera 40.
• the calibration member 80 is photographed together with the coloring member 90.
• the calibration member 80 may not be photographed, but only the coloring member 90 may be photographed. Further, in this case, the function of the correction section 32 may be omitted.
• various processes such as the acquisition unit 30, the discrimination unit 31, the correction unit 32, the derivation unit 33, the evaluation unit 34 and the control unit 35, and the control unit 60 and the determination unit 62 are executed.
• the various processors mentioned above include the CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as circuits that are manufactured after manufacturing, such as FPGA (Field Programmable Gate Array).
• Programmable logic devices PLDs
• ASICs Application Specific Integrated Circuits
• One processing unit may be composed of one of these various processors, or a combination of two or more processors of the same type or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). combination). Further, the plurality of processing units may be configured with one processor.
• one processor is configured with a combination of one or more CPUs and software, as typified by computers such as a client and a server.
• a processor functions as multiple processing units.
• processors that use a single IC (Integrated Circuit) chip, such as System on Chip (SoC), which implements the functions of an entire system that includes multiple processing units. be.
• SoC System on Chip
• various processing units are configured using one or more of the various processors described above as a hardware structure.
• circuitry that is a combination of circuit elements such as semiconductor elements can be used.
• the information processing program 27A is stored (installed) in advance in the storage unit 22A, and the information processing program 27B is stored in advance in the storage unit 22B, but the present invention is not limited to this.
• the information processing program 27A and/or 27B is recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory. may be provided.
• the information processing programs 2727A and/or 27B may be downloaded from an external device via a network.
• the technology of the present disclosure extends not only to the information processing program but also to a storage medium that non-temporarily stores the information processing program.
• the technology of the present disclosure can also be combined as appropriate with the above exemplary embodiments and examples.
• the descriptions and illustrations described above are detailed explanations of portions related to the technology of the present disclosure, and are merely examples of the technology of the present disclosure.
• the above description regarding the configuration, function, operation, and effect is an example of the configuration, function, operation, and effect of the part related to the technology of the present disclosure. Therefore, unnecessary parts may be deleted, new elements may be added, or replacements may be made to the written and illustrated contents described above without departing from the gist of the technology of the present disclosure. Needless to say.

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• Multimedia (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Signal Processing (AREA)
• Spectroscopy & Molecular Physics (AREA)
• Quality & Reliability (AREA)
• Spectrometry And Color Measurement (AREA)
• Image Processing (AREA)
• Apparatus For Radiation Diagnosis (AREA)

Priority Applications (4)

Applications Claiming Priority (2)

Related Child Applications (1)

Publications (1)

Family

ID=89118310

Family Applications (1)

Country Status (6)

Citations (5)

• 2023
  • 2023-06-01 JP JP2024526417A patent/JPWO2023238778A1/ja active Pending
  • 2023-06-01 CN CN202380045257.6A patent/CN119816711A/zh active Pending
  • 2023-06-01 EP EP23819758.6A patent/EP4538664A4/en active Pending
  • 2023-06-01 WO PCT/JP2023/020543 patent/WO2023238778A1/ja not_active Ceased
  • 2023-06-06 TW TW112121109A patent/TW202413906A/zh unknown
• 2024
  • 2024-11-27 US US18/961,480 patent/US20250088601A1/en active Pending

Patent Citations (5)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events