KR20220039560A - Apparatus for inspecting meat, system for inspecting meat including the same, refrigerator including the same, and method of inspecting meat - Google Patents

Abstract

A meat inspection device comprises: a light irradiator irradiating each of a plurality of inspection lights to a plurality of areas of meat; a light detector measuring multiple fluorescence emitted from the plurality of areas to generate a plurality of emission spectrum signals; and a processor receiving the plurality of emission spectrum signals from the light detector, generating a full hyperspectral image of the meat based on the plurality of the emission spectrum signals, and distinguishing a state of the meat based on the full hyperspectral image. The processor distinguishes the state of the meat with respect to a plurality of sub-areas inside the plurality of areas.

Description

Meat inspection device, meat inspection system including same, refrigerator including same, and meat inspection method

The present disclosure relates to a meat inspection apparatus, a meat inspection system, a refrigerator, and a meat inspection method.

Maintaining the freshness of meat after it is slaughtered until it is supplied to general consumers is one of the important issues in the meat distribution process. Furthermore, the freshness of meat is one of the important factors that determine the quality of meat.

Various indicators can be used to evaluate the quality characteristics of meat. Thiobarbituric acid to measure the concentration of malonaldehyde, a secondary product of fatty acid oxidation that is generated when fat and oil goes rancid. (TBA), the VBN method that measures the increase in volatile basic nitrogen (VBN) such as ammonia, trimethylamine (TMA), and dimethylamine (DMA) in the muscles of fish, and the sensory evaluation according to the test method presented in the Food Standards Code. there is.

The conventional method for evaluating quality characteristics of meat is a method used in slaughterhouses or large distribution companies, and it is an expert-level indexing method that is not accessible to general consumers. Furthermore, the conventional method for evaluating the quality characteristics of meat is a method of destruction or a method that may involve subjective opinions. Therefore, an easy indicator that can be used in the state of meat used in the general consumer stage is required.

An object to be solved is to provide a meat inspection device for determining the state of meat.

An object to be solved is to provide a meat inspection system including a meat inspection device for determining the state of meat.

An object to be solved is to provide a refrigerator including a meat inspection device for determining the state of meat.

The problem to be solved is to provide a meat inspection method for determining the state of meat.

However, the problem to be solved is not limited to the above disclosure.

In one aspect, there is provided a light irradiator for irradiating a plurality of inspection lights to a plurality of areas of the meat, respectively; a photo detector measuring a plurality of fluorescence emitted from the plurality of regions to generate a plurality of emission spectrum signals; and receiving the plurality of emission spectrum signals from the photodetector, generating a full hyperspectral image of the meat based on the plurality of emission spectrum signals, and determining the state of the meat based on the entire hyperspectral image A meat inspection apparatus may be provided, including: a processor for determining; the processor for determining the state of the meat for a plurality of sub-regions in the plurality of regions.

The light irradiator may irradiate the plurality of inspection lights so that adjacent regions among the plurality of regions partially overlap.

The processor generates a plurality of sub-hyperspectral images for the plurality of regions, and generates the entire hyperspectral image by merging the plurality of sub-hyperspectral images, but when the plurality of sub-hyperspectral images are merged , a hyperspectral image of a region in which the adjacent regions overlap each other may be deleted from the remainder except for any one of the sub hyperspectral images of the adjacent regions.

The light irradiator may irradiate the plurality of inspection lights to the plurality of areas at this time.

The light irradiator may be disposed at a plurality of positions facing the plurality of regions to respectively irradiate the plurality of inspection lights to the plurality of regions facing the plurality of arranged positions.

The light irradiator includes a plurality of sub-light irradiators for irradiating the plurality of inspection lights to the plurality of regions, and the photo detector includes a plurality of sub-lights for measuring the plurality of fluorescence emitted from the plurality of regions detectors, wherein the processor is capable of receiving the plurality of emission spectrum signals from the plurality of sub-photodetectors.

The state includes freshness, wherein the processor extracts a porphyrin content in the meat based on the entire hyperspectral image, and determines the freshness of the meat based on the porphyrin content. can

The state includes freshness, wherein the processor extracts at least one of a collagen content, an NADH content, and a flavin content in the meat based on the entire hyperspectral image, and ) content, the NADH content, and the flavin content, or the ratio thereof may determine the freshness of the meat.

The state includes a fat content, and the processor extracts a fatty acid content in the meat based on the hyperspectral image, and determines the fat content of the meat based on the fatty acid content. there is.

The meat may include a plurality of individual meats, and the processor may distinguish the plurality of individual meats using hyperspectral images of the plurality of individual meats, and determine states of the plurality of individual meats, respectively.

The light irradiator may include a first light source array including a plurality of light sources arranged in a first direction.

The light irradiator may further include a transmission window, wherein the plurality of fluorescence emitted from the plurality of regions may pass through the transmission window to reach the light detector.

The light irradiator further includes a second light source array spaced apart from the first light source array in a second direction crossing the first direction with the transmission window interposed therebetween, wherein the second light source array includes the first light source array It may include a plurality of light sources arranged along the direction.

The center wavelengths of the plurality of inspection lights may be selected from 335 nanometers (nm) to 370 nanometers (nm).

In one aspect, the meat inspection device; and a display device, wherein the meat testing device is any one of the meat testing devices of claims 1 to 14, wherein the display device receives the meat status information from the meat testing device, A meat inspection system that outputs status information may be provided.

The display device may be connected to the meat inspection device by wire or wirelessly to receive the state information of the meat.

In one aspect, the body having a plurality of storage spaces; a door opening and closing the plurality of storage spaces; and a meat inspection device provided in at least one of the plurality of storage spaces, wherein the meat inspection device may include a refrigerator which is the meat inspection device of any one of claims 1 to 14.

The display device may further include a display device disposed on the door, wherein the display device may receive the meat status information from the meat inspection device and output the meat status information.

A communication interface for communicating with an external device; further comprising, the communication interface may transmit the state information of the meat to the external device.

In one aspect, there is provided a method comprising: irradiating a plurality of inspection lights to a plurality of areas of meat; sensing a plurality of fluorescence emitted from the plurality of regions to generate a plurality of emission spectrum signals; generating a full hyperspectral image of the meat based on the plurality of emission spectral signals; and determining the state of the meat based on the entire hyperspectral image, wherein determining the state of the meat is performed for each of a plurality of sub-regions of the plurality of regions can be provided.

The irradiating of the plurality of inspection lights may include irradiating the plurality of inspection lights so that adjacent regions of the plurality of regions partially overlap each other.

Generating the full hyperspectral image may include: generating a plurality of sub-hyperspectral images for the plurality of regions; deleting the hyperspectral image of the area where the adjacent areas overlap each other from the rest except for any one of the sub-hyperspectral images of the adjacent areas; and merging the plurality of sub hyperspectral images.

Irradiating the plurality of inspection lights to the plurality of regions of the meat may be performed at this time.

Irradiating the plurality of inspection lights to the plurality of areas of the meat may be performed simultaneously.

Determining the state may include extracting a porphyrin content in the meat based on the entire hyperspectral image, and determining the freshness of the meat based on the porphyrin content.

To determine the state, extract at least one of a collagen content, an NADH content, and a flavin content in the meat based on the entire hyperspectral image, and the collagen content, the NADH content , and determining the freshness of the meat based on at least one or a ratio thereof among the flavin content.

Determining the state may include extracting a fatty acid content in the meat based on the hyperspectral image, and determining the fatness of the meat based on the fatty acid content.

The center wavelengths of the plurality of inspection lights may be selected from 340 nanometers (nm) to 370 nanometers (nm).

The meat includes a plurality of individual meats, and the determining the state includes distinguishing the plurality of individual meats using hyperspectral images of the plurality of individual meats, and determining the states of the plurality of individual meats, respectively may include

The present disclosure may provide a meat inspection apparatus that extracts a content distribution of an indicator substance related to a state of meat by using a hyperspectral image of meat. The meat inspection device may determine the state of the meat through the content distribution of the indicator substance.

The present disclosure may provide a meat inspection system and a refrigerator including a meat inspection device for determining the state of meat.

The present disclosure may provide a meat inspection method for extracting a content distribution of an indicator substance related to a meat state by using a hyperspectral image of the meat. The meat inspection method can determine the state of meat through the content distribution of indicator substances.

However, the effect of the invention is not limited to the above disclosure.

1 is a block diagram of a meat inspection apparatus according to an exemplary embodiment.
Fig. 2 is a conceptual diagram of a meat inspection apparatus according to an exemplary embodiment.
3 is an exemplary conceptual diagram of the light irradiator of FIG. 2 .
4 is a conceptual diagram illustrating an example of the photodetector of FIG. 2 .
5 is a conceptual diagram illustrating an example of the photodetector of FIG. 2 .
6 is a flowchart illustrating a meat inspection method according to an exemplary embodiment.
7 to 10 are conceptual views for explaining the meat inspection method of FIG.
11 is a flowchart of a meat inspection method according to an exemplary embodiment.
12 and 13 are conceptual views for explaining the meat inspection method of FIG. 11 .
Fig. 14 is a schematic block diagram of a meat inspection system according to an exemplary embodiment.
15 is a perspective view of a refrigerator according to an exemplary embodiment.
16 is a view illustrating a state in which the door of the refrigerator of FIG. 15 is opened.
Fig. 17 is a conceptual diagram of a meat inspection system according to an exemplary embodiment.
Fig. 18 is a conceptual diagram of a meat inspection apparatus according to an exemplary embodiment.
19 is an exemplary conceptual diagram of the light irradiator of FIG. 18 .

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. The described embodiments are merely exemplary, and various modifications are possible from these embodiments. In the following drawings, the same reference numerals refer to the same components, and the size of each component in the drawings may be exaggerated for clarity and convenience of description.

Hereinafter, what is described as "upper" or "upper" may include not only directly on in contact but also on non-contacting.

The singular expression includes the plural expression unless the context clearly dictates otherwise. Also, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated.

1 is a block diagram of a meat inspection apparatus according to an exemplary embodiment.

Referring to FIG. 1 , a meat inspection apparatus 1 including a light irradiation unit 1a , a light detection unit 1b , and a processor 1c may be provided. The light irradiation unit 1a may emit inspection light. The light irradiation unit 1a may irradiate the meat with inspection light. For example, the light irradiation unit 1a may emit inspection light having a wavelength of about 335 nanometers (nm) to about 370 nanometers (nm). For example, the light irradiation unit 1a may include an LED.

The photodetector 1b may detect light incident on the photodetector 1b. For example, the light detection unit 1b may detect fluorescence emitted from meat. Fluorescence may be that various indicator substances in meat absorb and emit light provided from the light irradiation unit 1a. For example, the indicator material may include at least one of porphyrin, collagen, NADH, and flavin, and fatty acid (Fatty Acid). The photodetector 1b may detect fluorescence by spectroscopy. Accordingly, the photodetector 1b may generate an emission spectrum signal. The emission spectrum signal may refer to a spectrum signal of fluorescence detected by the light detector 1b.

The processor 1c may receive an emission spectrum signal from the photodetector 1b. The processor 1c may acquire a hyperspectral image of the meat based on the received emission spectrum signal. The hyperspectral image of the meat may be a combination of a spectral distribution for each location of the meat. The processor 1c may measure the distribution of the content of the indicator substance in the meat using the hyperspectral image. The processor 1c may determine the state of the meat based on the distribution of the content of the indicator substance in the meat.

The present disclosure may provide a meat inspection apparatus 1 that determines the state of meat based on a hyperspectral image of the meat.

Fig. 2 is a conceptual diagram of a meat inspection apparatus according to an exemplary embodiment. 3 is an exemplary conceptual diagram of the light irradiator of FIG. 2 . 4 is a conceptual diagram illustrating an example of the photodetector of FIG. 2 . 5 is a conceptual diagram illustrating an example of the photodetector of FIG. 2 .

2 to 5 , a meat inspection apparatus 10 including a light irradiator 100 , a light detector 200 , and a processor 300 may be provided. The meat OBJ may be placed on the support SP. Meat (OBJ) may include meat of mammals such as cattle, pigs, sheep, and horses, meat of birds such as chickens, ducks, and pheasants, or meat of fish such as tuna, mackerel, and salmon. However, meat (OBJ) is not limited to the above example.

The light irradiator 100 may face the meat OBJ. The light irradiator 100 may irradiate the inspection lights ILa and ILb to the meat OBJ. 3 , the light irradiator 100 may include a first light source array 110a, a second light source array 110b, and a transmission window 120 . The first light source array 110a and the second light source array 110b may be spaced apart from each other with the transmission window 120 interposed therebetween. Each of the first light source array 110a and the second light source array 110b may include a plurality of light sources 110 arranged in one direction. For example, the plurality of light sources 110 may be arranged along the transmission window 120 . Each of the plurality of light sources 110 of the first light source array 110a and the second light source array 110b is illustrated as forming two rows, but this is not limited thereto. For example, the plurality of light sources 110 may include an LED.

Meat OBJ exposed to inspection light ILa, ILb may emit fluorescence OL. Fluorescence OL may pass through the transmission window 120 to be provided inside the meat inspection device 10 . The transmission window 120 may include a transparent material. For example, the transmissive window 120 may be transparent plastic or glass. In one example, the transmission window 120 may include a material having high resistance to low temperature. Fluorescence OL may be provided to the photo detector 200 . For example, the optical path of the fluorescence OL may be adjusted by the optical path control element 20 such that the fluorescence OL is provided to the optical detector 200 . The photo detector 200 may include a hyperspectral camera.

In one example, the photo detector 200 may include a dispersive element 230 as shown in FIG. 4 . The light detector 200a ( 200 ) may include a slit element 210 , a collimating lens 220 , a dispersive element 230 , a collecting lens 240 , and an image sensor 250 . The slit element 210 may be used to extract a desired portion of the fluorescence (OL). In one example, the fluorescence OL that has passed through the slit element 210 may diverge. The collimating lens 220 may adjust the size of the fluorescence OL so that the fluorescence OL becomes parallel light or converged light. For example, the collimating lens 220 may include a convex lens. The dispersing element 230 may diffuse the fluorescence OL provided from the collimating lens 220 . Although the dispersive element 230 is shown to be a grating, this is not limiting. In another exemplary embodiment, the dispersing element 230 may be a prism. The spectral fluorescence OL may pass through the condensing lens 240 and be provided to the image sensor 250 . For example, the condensing lens 240 may include a convex lens. The spectral fluorescence OL may be provided to different positions of the image sensor 250 according to wavelengths. The image sensor 250 may measure the spectral fluorescence OL provided from the dispersion element 230 . The image sensor 250 may generate a spectral signal of fluorescence (OL). The spectral signal of fluorescence (OL) may be referred to as an emission spectral signal. The image sensor 250 may provide an emission spectrum signal to the processor 300 .

In one example, as shown in FIG. 5 , a photodetector 200b ( 200 ) including a spectral filter 232 may be provided. The light detector 200b ( 200 ) may include a slit element 210 , a collimating lens 220 , a spectral filter 232 , a condensing lens 240 , and an image sensor 250 . The slit element 210 , the collimating lens 220 , the collecting lens 240 , and the image sensor 250 may be substantially the same as described with reference to FIG. 4 . The spectral filter 232 may be a set of filters that pass light of different wavelength bands, respectively. The spectral filter 232 may filter the fluorescence OL provided from the collimating lens 220 to have spatially different wavelengths. That is, portions of fluorescence passing through different regions of the spectral filter 232 may have different wavelengths. The fluorescence OL that is scattered by the spectral filter 232 may pass through a condensing lens and be provided to the image sensor 250 . The image sensor 250 may generate an emission spectrum signal for fluorescence (OL). The image sensor 250 may provide an emission spectrum signal to the processor 300 .

The processor 300 may generate a hyperspectral image of the meat OBJ based on the emission spectrum signal. The hyperspectral image of the meat OBJ may be generated by merging spectral distribution information for each location of the meat OBJ. In other words, the hyperspectral image of the meat OBJ may be a set of spectral distributions for each location of the meat OBJ.

The processor 300 may determine the state of each position of the meat OBJ based on the hyperspectral image of the meat OBJ. For example, the state of the meat OBJ may be the freshness of the meat OBJ or the fatness of the meat OBJ.

For example, the freshness of meat may be determined based on at least one of a Porphyrin content, a Collagen content, an NADH content, and a Flavin content in the meat, or a content ratio thereof. The processor 300 may measure the content of porphyrin based on a spectrum distribution for a wavelength band of about 570 nanometers (nm) to about 630 nanometers (nm). The processor 300 may measure the content of collagen based on a spectrum distribution for a wavelength band of about 360 nanometers (nm) to about 420 nanometers (nm). The processor 300 may measure the content of NADH based on a spectrum distribution for a wavelength band of about 430 nanometers (nm) to about 550 nanometers (nm). The processor 300 may measure the content of flavin based on a spectrum distribution in a wavelength band of about 500 nanometers (nm) to about 550 nanometers (nm).

For example, the fat content of meat can be measured by the content of fatty acids (Fatty Acid) in the meat. The processor 300 may measure the content of fatty acids based on a spectrum distribution for a wavelength band of about 430 nanometers (nm) to about 500 nanometers (nm).

The present disclosure may provide a meat inspection apparatus 10 capable of determining the state of the meat OBJ using a hyperspectral image of the meat OBJ.

6 is a flowchart illustrating a meat inspection method according to an exemplary embodiment. 7 to 10 are conceptual views for explaining the meat inspection method of FIG. For brevity of description, the contents described with reference to FIGS. 2 to 5 may not be described.

6 and 7 , the first inspection lights ILa and ILb may be irradiated to the first region R1 of the meat OBJ ( S110 ). It may be emitted from the irradiator 100 . The center wavelength of the first inspection lights ILa and ILb may be selected from about 335 nanometers (nm) to about 370 nanometers (nm). The light irradiator 100 may be disposed at a position facing the first region R1 to emit the first inspection lights ILa and ILb.

6 and 8 , the first region R1 of the meat OBJ may be exposed to the first inspection lights ILa and ILb to emit the first fluorescence OL. The first fluorescence OL may be light emitted after the indicator material in the first region R1 absorbs the first inspection lights ILa and ILb. For example, the indicator material may include at least one of Porphyrin, collagen, NADH, Flavin, and Fatty Acid.

The first fluorescence OL may pass through the transmission window 120 to be provided in the meat inspection device 10 . The optical path of the first fluorescence OL may be adjusted by the optical path adjusting element 20 in the meat inspection device 10 so that the first fluorescence OL is provided to the photodetector 200 .

The photodetector 200 may detect the first fluorescence OL and generate a first emission spectrum signal ( S120 ). The first emission spectrum signal may include information on a spectrum distribution of the first fluorescence OL. there is. The photo detector 200 may be substantially the same as the photo detectors 200 , 200a , 200b described with reference to FIGS. 2 , 4 , and 5 . The spectralized first fluorescence OL may be detected by an image sensor. The image sensor may include a plurality of pixels. In one example, each of the plurality of pixels may correspond to a plurality of different sub-regions in the first region R1 . That is, the first region R1 is a partial region of the meat to which the first inspection lights ILa and ILb are irradiated, and the plurality of sub regions are regions within the first region R1 corresponding to the plurality of pixels of the image sensor. can take In one example, each of the plurality of pixels may include a plurality of sub-pixels respectively corresponding to a plurality of wavelength bands. For example, the first sub-pixel may measure light of a first wavelength band, and the second sub-pixel may measure light of a second wavelength band different from the first wavelength band. Accordingly, the image sensor may generate a first emission spectrum signal of the first fluorescence OL emitted from the first region R1 . The photo detector 200 may provide the first emission spectrum signal to the processor 300 .

The processor 300 may generate a first sub hyperspectral image of the first region based on the first emission spectrum signal ( S130 ). 1 It may include spectral distribution information of fluorescence (OL).

6 and 9 , the second inspection lights ILa and ILb may be irradiated to the second region R2 of the meat OBJ ( S140 ). The meat inspection apparatus 10 includes the light irradiator 100 . ) may be moved to be disposed at a position facing the second region R2. The light irradiator 100 may irradiate the second inspection lights ILa and ILb toward the meat OBJ at a position facing the second region R2 . The center wavelength of the second inspection lights ILa and ILb may be selected from about 335 nanometers (nm) to about 370 nanometers (nm).

6 and 10 , the second region R2 of the meat OBJ may be exposed to the second inspection lights ILa and ILb to emit a second fluorescence OL. The second fluorescence OL may reach the photodetector 200 in substantially the same process as the first fluorescence OL.

The photodetector 200 may detect the second fluorescence OL to generate a second emission spectrum signal (S150). The second emission spectrum signal may include information on a spectrum distribution of the second fluorescence OL. there is. Generating the second emission spectrum signal may be performed by substantially the same method as generating the first emission spectrum signal. The photo detector 200 may provide the second emission spectrum signal to the processor 300 .

The processor 300 may generate a second sub hyperspectral image of the second region based on the second emission spectrum signal ( S160 ). 2 It may include spectral distribution information of fluorescence (OL).

The first region R1 and the second region R2 may partially overlap each other. A region where the first region R1 and the second region R2 overlap may be referred to as an overlapping region. The processor 300 may generate an entire hyperspectral image by merging the first sub-hyperspectral image and the second sub-hyperspectral image. (S170) When the first sub-hyperspectral image and the second sub-hyperspectral image are merged , the processor 300 may delete the hyperspectral image for the overlapping region from any one of the first sub-hyperspectral image and the second sub-hyperspectral image. Accordingly, it is possible to prevent the hyperspectral image of the overlapping region from being repeatedly reflected in the entire hyperspectral image.

The processor 300 may measure the content distribution of the index material in the first region R1 and the second region R2 from the entire hyperspectral image (S180). For example, the processor may measure about 570 nanometers (nm). A content distribution of Porphyrin may be measured based on a spectrum distribution for a wavelength band of to about 630 nanometers (nm). For example, the processor may measure a content distribution of collagen based on a spectrum distribution for a wavelength band of about 360 nanometers (nm) to about 420 nanometers (nm). For example, the processor may measure the content distribution of NADH based on the spectrum distribution for a wavelength band of about 430 nanometers (nm) to about 550 nanometers (nm). The processor may measure a content distribution of flavin based on a spectrum distribution for a wavelength band of about 500 nanometers (nm) to about 550 nanometers (nm). For example, the processor may measure the content distribution of fatty acids based on the spectrum distribution for a wavelength band of about 430 nanometers (nm) to about 500 nanometers (nm).

The processor 300 may determine the state of each position of the meat OBJ based on the entire distribution of the content of the indicator substances. (S190) Porphyrin, collagen, NADH, and flavin may be an indicator substance related to the freshness of meat. The processor 300 may determine the freshness for each location of the meat (OBJ) based on the content distribution of at least one of Porphyrin, collagen, NADH, and Flavin or their content ratio. there is. Fatty acid may be an indicator material related to fatness of meat. The processor 300 may determine the fat degree for each location of the meat OBJ based on the content distribution of fatty acid.

The present disclosure may provide a meat inspection method capable of determining the state of the meat OBJ by location using a hyperspectral image of the meat OBJ.

In another embodiment, a plurality of meat inspection devices 10 may be provided. The plurality of meat inspection apparatuses 10 may determine states of a plurality of regions of the meat OBJ. For example, a pair of meat inspection devices 10 may be provided to determine the states of the first region R1 and the second region R2 . The plurality of meat inspection apparatuses 10 may simultaneously or simultaneously perform inspection on a plurality of regions.

11 is a flowchart of a meat inspection method according to an exemplary embodiment. 12 and 13 are conceptual views for explaining the meat inspection method of FIG. 11 . For brevity of description, contents substantially the same as those described with reference to FIGS. 2, 4, and 5 and those described with reference to FIGS. 6 to 10 may not be described.

11 and 12 , the entire inspection lights ILa and ILb may be irradiated to the meat OBJ. ( S210 ) The entire inspection lights ILa and ILb may be emitted from the light irradiator 102 . . The center wavelength of the total inspection lights ILa and ILb may be selected between about 335 nanometers (nm) and about 370 nanometers (nm).

11 and 13 , the meat OBJ may be exposed to the total inspection lights ILa and ILb to emit total fluorescence OL. The total fluorescence OL may be light emitted after the indicator material in the meat OBJ absorbs the total inspection lights ILa and ILb. For example, the indicator material may include at least one of Porphyrin, collagen, NADH, Flavin, and Fatty Acid.

Total fluorescence OL may be provided to the photo detector 200 . Total fluorescence (OL) may pass through the transmission window 122 to reach the light detector 202 . A process in which the total fluorescence OL reaches the photodetector 202 may be substantially the same as a process in which the first fluorescence OL reaches the photodetector 200 described with reference to FIGS. 6 and 8 .

The photodetector 202 may receive the total fluorescence OL to generate a total emission spectrum signal (S220). The total emission spectrum signal may include spectral information of the total fluorescence OL. The photo detector 202 may be substantially the same as the photo detectors 200 , 200a , 200b described with reference to FIGS. 2 , 4 , and 5 . The spectral fluorescence (OL) may be detected by an image sensor.

The image sensor may include a plurality of pixels. Each of the plurality of pixels may correspond to a plurality of different sub-regions of the meat OBJ. Each of the plurality of pixels may include sub-pixels respectively corresponding to a plurality of wavelengths. Accordingly, the image sensor can generate a full emission spectral signal for the total fluorescence (OL) of the meat (OBJ).

The photo detector 202 may provide a full emission spectrum signal to the processor 300 . The processor 300 may generate an entire hyperspectral image of the meat OBJ based on the entire emission spectrum signal ( S230 ). It may include spectral distribution information.

The processor 300 may measure the content distribution of the indicator substance in the meat OBJ ( S240 ). For example, the indicator substance may include Porphyrin, collagen, NADH, flavin, and It may be at least one of fatty acids (Fatty Acid). A method for the processor 300 to measure the content distribution of the indicator substance may be substantially the same as the method for measuring the content distribution of the indicator substance described with reference to FIGS. 6 and 10 . Unlike described with reference to FIGS. 6 and 10 , the entire hyperspectral image may be performed by irradiating the inspection lights ILa and ILb once.

The processor 300 may determine the state of each location of the meat OBJ based on the distribution of the total content of the indicator substance. (S250) The processor 300 may include Porphyrin, collagen, NADH, and The freshness of each position of the meat OBJ may be determined based on a content distribution of at least one of flavins or a content ratio thereof. The processor 300 may determine the fat degree for each location of the meat OBJ based on the content distribution of fatty acid.

The present disclosure may provide a meat inspection method capable of determining the state of the meat OBJ by location using a hyperspectral image of the meat OBJ.

Fig. 14 is a schematic block diagram of a meat inspection system according to an exemplary embodiment. For brevity of description, contents substantially the same as those described with reference to FIGS. 1 to 5 may not be described.

Referring to FIG. 14 , a meat inspection system 1000 including a meat inspection apparatus 1200 and a display apparatus 1100 may be provided. The meat inspection apparatus 1200 may include a light irradiator 100 , a light detector 200 , a processor 300 , and a communication unit 400 . The light irradiator 100 , the light detector 200 , and the processor 300 are substantially the same as the light irradiator 100 , the light detector 200 , and the processor 300 described with reference to FIGS. 1 to 5 , respectively. can do. The display device 1100 may include a display element 1102 , a processor 1104 , and a communication unit 1106 .

The communication unit 400 of the meat inspection apparatus 1200 may communicate with the communication unit 1106 of the display apparatus 1100 by wire or wirelessly. The communication unit 400 of the meat inspection apparatus 1200 may receive meat state information from the processor 300 . For example, the meat state information may include the freshness of the meat and the fatness of the meat. The communication unit 400 of the meat inspection apparatus 1200 may provide meat state information to the communication unit 1106 of the display apparatus 1100 .

The communication unit 1106 of the display apparatus 1100 may provide the meat state information received from the communication unit 400 of the meat inspection apparatus 1200 to the processor 300 of the display apparatus 1100 . The processor 300 of the display apparatus 1100 may generate a state output signal based on the state information of the meat. The processor 300 of the display device 1100 may provide a status output signal to the display element 1102 .

The display element 1102 may output an image or audio including meat state information according to the state output signal.

The present disclosure may provide a meat inspection system 1000 that determines the state of meat and outputs the state of meat.

15 is a perspective view of a refrigerator according to an exemplary embodiment. 16 is a view illustrating a state in which the door of the refrigerator of FIG. 15 is opened. For brevity of description, contents substantially the same as those described with reference to FIG. 14 may not be described.

15 and 16 , a refrigerator 1000a including a main body 1010 , doors 1021 , 1022 , 1023 , 1024 , a display device 1100 , and a meat inspection device 1200a may be provided. . The main body 1010 includes an inner case (not shown) forming the storage compartment 1030, an outer case (not shown) forming the exterior of the main body 1010, and an insulating material for maintaining a temperature difference between the inner case and the outer case ( not shown) may be included. The heat insulating material may prevent cold air inside the storage compartment 1030 from leaking out and external warm air from flowing into the storage compartment.

The body 1010 may include a cold air supply unit that supplies cold air to the storage compartment. The cold air supply unit may include a compressor for compressing the refrigerant, a condenser, an expansion valve, an evaporator, and a pipe.

The storage room 1030 may be divided into partitions. The storage compartment may be divided into a freezing storage compartment and a cold storage compartment. The freezer compartment can be set to sub-zero temperatures. The cold storage compartment can be set to the temperature of the image. For example, water, beverages, ingredients, and refrigerated or frozen foods may be stored in the storage compartment.

A meat inspection device 1200a may be provided in the storage compartment 1030 . The meat inspection device 1200a may be substantially the same as that described with reference to FIGS. 1 to 5 .

Doors 1021, 1022, 1023, 1024 are a first door 1021 that opens and closes one side of the cold storage compartment 1030, a second door 1022 that opens and closes the other side of the cold storage compartment 1030, and a freezer storage compartment 1030. It may include a third door 1023 for opening and closing one side of the , and a fourth door 1024 for opening and closing the other side of the freezing storage compartment 1030 . However, the number of doors is not limited to four.

The display device 1100 may be provided on the front side of the second door 1022 . Although the display apparatus 1100 is illustrated as outputting an image, as described with reference to FIG. 14 , the display apparatus 1100 may include an element outputting an audio. The display apparatus 1100 may provide state information of meat to the user.

The present disclosure may provide a refrigerator 1000a that inspects meat state information and provides it to a user.

Fig. 17 is a conceptual diagram of a meat inspection system according to an exemplary embodiment. For brevity of description, contents substantially the same as those described with reference to FIGS. 15 and 16 may not be described.

Referring to FIG. 17 , a meat inspection system including a refrigerator 1000a , a server device 2000 , and a mobile terminal 3000 may be provided. The refrigerator 1000a may be substantially the same as the refrigerator 1000a described with reference to FIGS. 15 and 16 .

Unlike described with reference to FIGS. 15 and 16 , the refrigerator 1000a may include a communication interface for communicating with an external device. The refrigerator 1000a may communicate with the server device 2000 and/or the mobile terminal 3000 through a communication interface. The communication interface may include a short-range communication unit, a mobile communication unit, and the like. Short-range wireless communication interface, Bluetooth communication unit, BLE (Bluetooth Low Energy) communication unit, near field communication interface (Near Field Communication interface), WLAN (Wi-Fi) communication unit, Zigbee communication unit, infrared (IrDA, infrared) Data Association) communication unit, WFD (Wi-Fi Direct) communication unit, UWB (ultra wideband) communication unit, and may include an Ant+ communication unit, but is not limited thereto.

According to an embodiment, the server device 2000 may include an AI processor. The AI processor can train an artificial neural network to create an artificial intelligence model to measure the state of meat. “Learning” an artificial neural network can mean creating a mathematical model that allows optimal decision-making by connecting neurons that make up an artificial neural network while changing weights appropriately based on data.

According to an embodiment, the server device 2000 may include a communication interface for performing communication with an external device. According to an embodiment, the server device 2000 may communicate with the refrigerator 1000 or the mobile terminal 3000 through a communication interface. According to an embodiment, the refrigerator 1000 transmits identification information of the refrigerator 1000 or user identification information (login information) to the server device 2000 , and identification information of the refrigerator 1000 or user identification information By authenticating (login information) from the server device 2000 , the server device 2000 can be accessed.

The mobile terminal 3000 may be a device connected with the same account information as the refrigerator 1000 . The mobile terminal 3000 may be directly connected to the refrigerator 1000 through a short-range communication link, or may be indirectly connected to the refrigerator 1000 through the server device 2000 .

According to an embodiment, the mobile terminal 3000 may be implemented in various forms. For example, the mobile terminal 3000 includes a digital camera, a smart phone, a laptop computer, a tablet PC, an electronic book terminal, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP). ), a navigation system, an MP3 player, and the like, but is not limited thereto. For example, the mobile terminal 3000 may be a wearable device that can be worn by a user. A wearable device is an accessory-type device (e.g., watch, ring, bracelet, anklet, necklace, eyewear, contact lens), a head-mounted-device (HMD), a textile or garment-integrated device (e.g., electronic garment). ), a body attachable device (eg, a skin pad), or a bioimplantable device (eg, an implantable circuit).

Fig. 18 is a conceptual diagram of a meat inspection apparatus according to an exemplary embodiment. 19 is an exemplary conceptual diagram of the light irradiator of FIG. 18 . For brevity of description, contents substantially the same as those described with reference to FIGS. 2 to 5 may not be described.

18 and 19 , a meat inspection device 14 may be provided. The meat inspection device 14 may include a light irradiator 104 , a light detector 200 , and a processor 300 . The photodetector 200 and the processor 300 may be substantially the same as the photodetector 200 and the processor 300 described with reference to FIGS. 2 to 5 .

Unlike the light irradiator 100 illustrated in FIG. 3 , the light irradiator 104 may include an opening 124 instead of the transmission window 120 . The light irradiator 100 may irradiate the inspection lights ILa and ILb to the meat OBJ. For example, the light irradiator 104 may face the meat OBJ.

Meat OBJ exposed to inspection light ILa, ILb may emit fluorescence OL. Fluorescence OL may pass through opening 124 and be provided inside meat inspection device 14 . Fluorescence OL may be provided to the photo detector 200 . For example, the optical path of the fluorescence OL may be adjusted by the optical path control element 20 such that the fluorescence OL is provided to the optical detector 200 .

The image sensor 250 in the photodetector 200 may generate an emission spectrum signal for fluorescence (OL). The image sensor 250 may provide an emission spectrum signal to the processor 300 .

The processor 300 may generate a hyperspectral image of the meat OBJ based on the emission spectrum signal, and determine the state of each position of the meat OBJ based on the hyperspectral image of the meat OBJ. For example, the state of the meat OBJ may be the freshness of the meat OBJ or the fatness of the meat OBJ.

The present disclosure may provide a meat inspection apparatus 14 capable of determining the state of the meat OBJ using a hyperspectral image of the meat OBJ.

In another example, the light irradiator 102 of the meat inspection device 12 described with reference to FIGS. 12 and 13 may also include an opening 124 instead of the transmissive window 122 .

The above description of embodiments of the technical idea of the present disclosure provides an example for the description of the technical idea of the present disclosure. Therefore, the technical spirit of the present disclosure is not limited to the above embodiments, and within the technical spirit of the present disclosure, a person skilled in the art may perform various modifications and changes such as combining the above embodiments. It is clear that this is possible.

10, 12, 14: meat inspection device 100, 102, 104: light irradiator
200, 202: photodetector 300: processor
1000: meat inspection system 1000a: refrigerator
2000: server device 3000: mobile terminal

Claims (29)

a light irradiator for irradiating a plurality of inspection lights to a plurality of areas of the meat, respectively;
a photo detector measuring a plurality of fluorescence emitted from the plurality of regions to generate a plurality of emission spectrum signals; and
receiving the plurality of emission spectrum signals from the photodetector, generating a full hyperspectral image of the meat based on the plurality of emission spectrum signals, and determining the state of the meat based on the entire hyperspectral image including a processor;
The processor is configured to determine the state of the meat for a plurality of sub-areas within the plurality of areas. The method of claim 1,
The light irradiator irradiates the plurality of inspection lights so that adjacent regions of the plurality of regions partially overlap each other. 3. The method of claim 2,
The processor generates a plurality of sub-hyperspectral images for the plurality of regions, and generates the entire hyperspectral image by merging the plurality of sub-hyperspectral images, but when merging the plurality of sub-hyperspectral images , a meat inspection apparatus for deleting a hyperspectral image of a region in which the adjacent regions overlap each other except for any one of the sub-hyperspectral images of the adjacent regions. The method of claim 1,
The light irradiator is a meat inspection device for irradiating the plurality of inspection lights to the plurality of regions at the same time. 5. The method of claim 4,
The light irradiator is disposed at a plurality of positions facing the plurality of regions, and respectively irradiates the plurality of inspection lights to the plurality of regions facing the arranged positions. The method of claim 1,
The light irradiator includes a plurality of sub-light irradiators for irradiating the plurality of inspection lights to the plurality of areas,
wherein the photo detector includes a plurality of sub photo detectors for measuring the plurality of fluorescence emitted from the plurality of regions;
wherein the processor receives the plurality of emission spectrum signals from the plurality of sub-photodetectors. The method of claim 1,
The state includes freshness,
The processor extracts a porphyrin content in the meat based on the entire hyperspectral image, and determines the freshness of the meat based on the porphyrin content. The method of claim 1,
The state includes freshness,
The processor extracts at least one of a collagen content, an NADH content, and a flavin content in the meat based on the entire hyperspectral image, and the collagen content, the NADH content, and A meat inspection apparatus for determining the freshness of the meat based on at least one of the flavin content or a ratio thereof. The method of claim 1,
The condition includes a fat degree,
The processor extracts a fatty acid content in the meat based on the hyperspectral image, and determines the fatness of the meat based on the fatty acid content. The method of claim 1,
wherein the meat comprises a plurality of individual meats;
The processor distinguishes the plurality of individual meats by using hyperspectral images of the plurality of individual meats, and determines the states of the plurality of individual meats, respectively. The method of claim 1,
The light irradiator includes a first light source array including a plurality of light sources arranged in a first direction. 12. The method of claim 11,
The light irradiator is:
Transmissive window; further comprising,
The plurality of fluorescence emitted from the plurality of regions passes through the transmission window to reach the photodetector. 13. The method of claim 12,
The light irradiator is:
Further comprising a second light source array spaced apart from the first light source array in a second direction intersecting the first direction with the transmission window interposed therebetween,
The second light source array includes a plurality of light sources arranged along the first direction. The method of claim 1,
Central wavelengths of the plurality of inspection lights are selected from among 335 nanometers (nm) to 370 nanometers (nm). meat inspection device; and
Display device; including,
The meat inspection device is any one of the meat inspection devices of claims 1 to 14,
The display device receives the meat status information from the meat testing device, and outputs the meat status information. 16. The method of claim 15,
The display device is connected to the meat inspection device by wire or wirelessly, and the meat inspection system receives the state information of the meat. a body having a plurality of storage spaces;
a door opening and closing the plurality of storage spaces; and
A meat inspection device provided in at least one of the plurality of storage spaces; including,
The meat inspection device is the refrigerator according to any one of claims 1 to 14. 18. The method of claim 17,
Further comprising; a display device disposed on the door;
The display device receives the meat status information from the meat inspection device, and outputs the meat status information. 19. The method of claim 18,
A communication interface for communicating with an external device; further comprising,
The communication interface is a refrigerator for transmitting the state information of the meat to the external device. irradiating a plurality of inspection lights to a plurality of areas of the meat;
sensing a plurality of fluorescence emitted from the plurality of regions to generate a plurality of emission spectrum signals;
generating a full hyperspectral image of the meat based on the plurality of emission spectral signals; and
Determining the state of the meat based on the entire hyperspectral image; Including,
and determining the state of the meat is performed for each of a plurality of sub-regions of the plurality of regions. 21. The method of claim 20,
Irradiating the plurality of inspection lights includes:
and irradiating the plurality of inspection lights so that adjacent regions of the plurality of regions partially overlap each other. 22. The method of claim 21,
Generating the full hyperspectral image comprises:
generating a plurality of sub-hyperspectral images for the plurality of regions;
deleting the hyperspectral image of the region where the adjacent regions overlap each other from the rest except for any one of the sub hyperspectral images of the adjacent regions; and
A meat inspection method comprising; merging the plurality of sub-hyperspectral images. 21. The method of claim 20,
The method of irradiating the plurality of inspection lights to the plurality of regions of the meat is performed at this time. 21. The method of claim 20,
and irradiating the plurality of inspection lights to the plurality of regions of the meat is performed simultaneously. 21. The method of claim 20,
Determining the state includes extracting a Porphyrin content in the meat based on the entire hyperspectral image, and determining the freshness of the meat based on the Porphyrin content. . 21. The method of claim 20,
To determine the state, extract at least one of a collagen content, an NADH content, and a flavin content in the meat based on the entire hyperspectral image, and the collagen content, the NADH content and determining the freshness of the meat based on at least one of the flavin content or a ratio thereof. 21. The method of claim 20,
Determining the state includes extracting a fatty acid content in the meat based on the hyperspectral image, and determining the fatness of the meat based on the fatty acid content. 21. The method of claim 20,
Center wavelengths of the plurality of inspection lights are selected from among 340 nanometers (nm) to 370 nanometers (nm). 21. The method of claim 20,
wherein the meat comprises a plurality of individual meats;
The determining of the state includes discriminating the plurality of individual meats using hyperspectral images of the plurality of individual meats, and determining the states of the plurality of individual meats, respectively.

Images