CN116559081A

CN116559081A - Filter plate determining method, color sensing device and detection system

Info

Publication number: CN116559081A
Application number: CN202310552300.XA
Authority: CN
Inventors: 鲍捷; 淮丙鑫; 请求不公布姓名; 刘啸虎
Original assignee: Quantaeye Beijing Technology Co ltd; Tsinghua University
Current assignee: Quantaeye Beijing Technology Co ltd; Tsinghua University
Priority date: 2023-05-16
Filing date: 2023-05-16
Publication date: 2023-08-08

Abstract

The disclosure relates to a filter determining method, a color sensing device and a detection system, wherein the method comprises the following steps: selecting the minimum number of filter plates from detection results corresponding to the detection results reaching a first preset detection result in detection results corresponding to filter plate assemblies with different numbers of filter plates, wherein the minimum number is used as the number of filter plates of the filter plate assemblies, and the filter plate assemblies are used for encoding incident light into imaging information; selecting a combination mode of filter plate combinations corresponding to a second preset detection result from detection results corresponding to different filter plate combinations with the same number of filter plates as the combination mode of the filter plates in the filter plate assembly; each filter combination comprises the minimum number of filters, the types and/or arrangement modes of the filters in each filter combination are different, the filter array can be optimized according to specific applications, cost and integration complexity are reduced, and measurement accuracy is improved.

Description

Filter plate determining method, color sensing device and detection system

Technical Field

The disclosure relates to the technical field of detection, and in particular relates to a filter determining method, a color sensing device and a detection system.

Background

Color sensing is a method for determining the composition and content of an object to be measured according to color change caused by physical and chemical reactions, and has wide application in the fields of medicine, environmental monitoring and the like. The existing color sensing scheme has the problems of large volume, low precision, complex structure, high cost and the like.

Disclosure of Invention

According to an aspect of the present disclosure, there is provided a filter determining method of a color sensing device, the method including:

selecting the minimum number of filter plates from detection results corresponding to filter plate assemblies with different numbers of filter plates from detection results corresponding to the first preset detection results, wherein the minimum number is used as the number of filter plates of the filter plate assemblies, the filter plate assemblies are used for encoding incident light into imaging information, the imaging information comprises light intensity values of the incident light, the filter plate assemblies comprise a plurality of different types of filter plates, and the different filter plates can encode the incident light to obtain imaging information;

selecting a combination mode of filter plate combinations corresponding to a second preset detection result from detection results corresponding to different filter plate combinations with the same number of filter plates as the combination mode of the filter plates in the filter plate assembly; each filter combination comprises the minimum number of filters, and the types and/or arrangement modes of the filters in each filter combination are different.

In one possible embodiment, the method further comprises:

and inputting the imaging information into a detection model, and obtaining the detection result by using the output result of the detection model, wherein the detection model has a mapping relation between the imaging information and the detection result.

In one possible embodiment, the method further comprises:

and detecting the imaging information to obtain a rectangular gray scale image array.

In one possible implementation manner, the detection result includes components of the object to be detected or components of the object to be detected and contents of the components, and the detection model is obtained based on at least one of a least square method, a neural network, a support vector machine, naive bayes classification, a decision tree, a k-nearest neighbor algorithm, linear discriminant analysis, linear regression, logistic regression, classification and regression trees, learning vector quantization, a bagging method and random forest.

In one possible implementation manner, the rectangular gray image array includes a plurality of rectangular areas, each filter corresponds to one rectangular area, the plurality of rectangular areas corresponds to a plurality of gray values, and each rectangular area includes a plurality of pixels;

the types of the filter plates comprise at least one type of super-surface filter plate type, photonic crystal filter plate type, perovskite quantum dot filter plate type and colloid quantum dot filter plate type, and each filter plate type comprises a plurality of different types.

In a possible implementation manner, in the filter combination, the filters are colloid quantum dot filters, each colloid quantum dot filter has a different spectral transmission relationship, the filters encode incident light together based on the spectral transmission relationship and a spectral sensitivity relationship of a detection component corresponding to each filter, so as to obtain imaging information of the incident light, and the spectral sensitivity relationship represents a relationship between light responsivity and light wavelength.

In one possible embodiment, the method comprises:

providing a plurality of filter assemblies having different numbers of filters, comprising: selecting a plurality of different numbers of filters from N filters to form a plurality of filter components, wherein each filter in the N filters has different spectral transmission relations, the N filters can encode colors in a target wavelength range, and N is a positive integer;

providing a plurality of filter assemblies having different filter combinations, comprising: the combination mode of the minimum number of continuous distribution or jump distribution is determined from N filter plates.

According to an aspect of the present disclosure, there is provided a color sensing device, the device comprising:

The filter assembly obtained by the filter determining method of the color sensing device is used for encoding incident light into imaging information, the imaging information comprises light intensity values of the incident light, the filter assembly comprises a plurality of different types of filter plates, and the different filter plates can encode the incident light to obtain the imaging information.

In one possible embodiment, the apparatus further comprises:

the detection component is used for detecting the imaging information, the imaging information is used for being input into a detection model, so that a detection result is obtained by using the output result of the detection model, and the detection model has a mapping relation between the imaging information and the detection result.

In one possible embodiment, the detection assembly includes at least one of a complementary metal oxide semiconductor element, a charge coupled element, an ultraviolet detection element, an indium gallium arsenide near infrared detection element.

According to an aspect of the present disclosure, there is provided a detection system including:

the color sensing device;

the light source is used for emitting detection light;

the color reaction component is used for obtaining one or more of the following after being irradiated by the detection light: transmitting light, reflecting light or fluorescence, and making the light obtained after irradiation incident on the filter assembly;

And the data processing component is used for obtaining a detection result according to the detection image or imaging information generated by the color sensing device.

In a possible implementation, the data processing component is further configured to:

acquiring a first detection image and a second detection image which are output by the color sensing device, wherein the first detection image is a detection image output by the color sensing device when the color reaction component is not added with an object to be detected, and the second detection image is a detection image output by the color sensing device when the color reaction component is added with the object to be detected;

subtracting the intensities of the corresponding pixels of the second detection image and the first detection image to obtain a third detection image;

and inputting the third detection image into a detection model, and obtaining the detection result of the components of the object to be detected or the components of the object to be detected and the content of each component by using the output result of the detection model, wherein the detection model has the mapping relation between the detection image or the imaging information and the detection result.

In one possible implementation manner, the color reaction component comprises a reflective component, a transmissive component and a fluorescent component, wherein the incident light is any one of reflected light generated by the reflective component according to the detection light, transmitted light generated by the detection light penetrating through the transmissive component and fluorescent light generated by the fluorescent component irradiated by the incident light.

In one possible embodiment, the filter assembly in the color sensing device is capable of encoding 380nm to 750nm of incident light.

According to an aspect of the present disclosure, there is provided a urine detection system comprising the color sensor or the detection system.

According to the embodiment of the disclosure, the minimum number of the filter plates is selected from the detection results corresponding to the filter plate assemblies with different numbers of the filter plates from the detection results corresponding to the detection results reaching the first preset detection results, the minimum number is used as the filter plate number of the filter plate assemblies, the combination mode of the filter plate combinations corresponding to the second preset detection results in the detection results is selected from the detection results corresponding to the filter plate combinations with the same filter plate number and different types of the filter plate combinations, the filter plate array can be optimized according to specific applications, the cost, the volume and the integration complexity are reduced on the premise that the accuracy of the color sensing device is ensured, and the measurement accuracy is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the technical aspects of the disclosure.

Fig. 1 shows a flowchart of a filter determining method of a color sensing device according to an embodiment of the present disclosure.

Fig. 2 shows a flowchart of a filter determination method of a color sensing device according to an embodiment of the present disclosure.

Fig. 3 shows a schematic diagram of transmission spectra of various colloidal quantum dot filters according to an embodiment of the disclosure.

FIG. 4 shows a schematic diagram of determining a detection model and performing concentration detection according to an embodiment of the present disclosure.

Fig. 5 shows a schematic diagram of a filter determination method of a color sensing device according to an embodiment of the present disclosure.

Fig. 6 shows a schematic diagram of a color sensing device according to an embodiment of the present disclosure.

Fig. 7 shows a schematic diagram of a color sensing device according to an embodiment of the present disclosure.

Fig. 8 shows a schematic diagram of a detection image formed by a detection assembly according to imaging information of a filter assembly according to an embodiment of the present disclosure.

Fig. 9 shows a block diagram of a detection system according to an embodiment of the present disclosure.

Fig. 10 shows a block diagram of an electronic device according to an embodiment of the disclosure.

Detailed Description

Various exemplary embodiments, features and aspects of the disclosure will be described in detail below with reference to the drawings. In the drawings, like reference numbers indicate identical or functionally similar elements. Although various aspects of the embodiments are illustrated in the accompanying drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

In the description of the present disclosure, it should be understood that the terms "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like indicate orientations or positional relationships based on the orientation or positional relationships shown in the drawings, merely to facilitate description of the present disclosure and simplify the description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be configured and operated in a particular orientation, and thus should not be construed as limiting the present disclosure.

Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present disclosure, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.

In the present disclosure, unless explicitly specified and limited otherwise, the terms "mounted," "connected," "secured," and the like are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally formed; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communicated with the inside of two elements or the interaction relationship of the two elements. The specific meaning of the terms in this disclosure will be understood by those of ordinary skill in the art as the case may be.

The word "exemplary" is used herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

The term "and/or" is herein merely an association relationship describing an associated object, meaning that there may be three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.

Furthermore, numerous specific details are set forth in the following detailed description in order to provide a better understanding of the present disclosure. It will be understood by those skilled in the art that the present disclosure may be practiced without some of these specific details. In some instances, methods, means, elements, and circuits well known to those skilled in the art have not been described in detail in order not to obscure the present disclosure.

Color sensing in the related art mainly includes a visual inspection method, an RGB image method, and a spectroscopic analysis method. The spectrum analysis method depends on an expensive and large-size spectrometer, and is not suitable for portable and low-cost application scenes such as clinical detection. Visual inspection and RGB image methods have limited ability to perceive color, affecting the results of the assay. The visual inspection method relies on subjective judgment of human eyes, is especially applied to clinical medicine, and mainly depends on experience judgment of doctors, and cannot be quantitatively detected.

Therefore, the color sensing scheme of the related art cannot achieve the advantages of volume reduction, precision improvement, structure reduction, cost reduction and the like.

The embodiment of the disclosure provides a filter determining method of a color sensing device, which selects the minimum number of filter plates from detection results corresponding to filter plate assemblies with different numbers of filter plates from detection results corresponding to a first preset detection result, uses the minimum number as the filter plate number of the filter plate assemblies, selects a combination mode of the filter plates corresponding to a second preset detection result from detection results corresponding to the same filter plate number and different filter plate combinations from detection results corresponding to the detection results, optimizes a filter plate array according to specific application, reduces cost, volume and integration complexity on the premise of ensuring the accuracy of the color sensing device, and improves measurement accuracy.

In one possible implementation, the filter determining method of the color sensing device set forth in the embodiments of the present disclosure may be performed by a processing component, including but not limited to a separate processor, or a discrete component, or a combination of a processor and a discrete component. The processor may include a controller in an electronic device having the functionality to execute instructions, and may be implemented in any suitable manner, for example, by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements. Within the processor, the executable instructions may be executed by hardware circuits such as logic gates, switches, application specific integrated circuits (Application Specific Integrated Circuit, ASIC), programmable logic controllers, and embedded microcontrollers.

In a possible implementation manner, the filter determining method of the color sensing device provided by the embodiment of the disclosure may be performed by an electronic device, where the electronic device may include a terminal device or a server or other processing devices. The terminal device may be a User Equipment (UE), a mobile device, a User terminal, a handheld device, a computing device, or a vehicle-mounted device, and examples of some terminals are: a Mobile Phone, a tablet, a notebook, a palm, a Mobile internet device (Mobile Internetdevice, MID), a wearable device, a Virtual Reality (VR) device, an Augmented Reality (AR) device, a wireless terminal in industrial control (Industrial Control), a wireless terminal in unmanned driving (Selfdriving), a wireless terminal in teleoperation (Remote medical Surgery), a wireless terminal in Smart Grid (Smart Grid), a wireless terminal in transportation security (Transportation Safety), a wireless terminal in Smart City (Smart City), a wireless terminal in Smart Home (Smart Home), a wireless terminal in the internet of vehicles, and the like. For example, the server may be a local server or a cloud server.

Referring to fig. 1, fig. 1 shows a flowchart of a filter determining method of a color sensing device according to an embodiment of the present disclosure.

As shown in fig. 1, the method includes:

step S11, selecting the minimum number of filter plates from detection results corresponding to filter plate assemblies with different numbers of filter plates from detection results corresponding to the first preset detection results, wherein the minimum number is used as the number of the filter plates of the filter plate assemblies, the filter plate assemblies are used for encoding incident light into imaging information, the imaging information comprises light intensity values of the incident light, the filter plate assemblies comprise a plurality of different types of filter plates, and the different filter plates can encode the incident light to obtain imaging information;

step S12, selecting a combination mode of filter plate combinations corresponding to a second preset detection result from detection results corresponding to different filter plate combinations with the same number of filter plates as the combination mode of the filter plates in the filter plate assembly; each filter combination comprises the minimum number of filters, and the types and/or arrangement modes of the filters in each filter combination are different.

The embodiment of the disclosure does not limit the specific number, types and arrangement modes of the filter plates in the filter plate assembly, and a person skilled in the art can adaptively determine the number, types and arrangement modes of the filter plates according to actual application scenes and the method required to be sampled, so that the volume, cost and integration complexity of the filter plate assembly are reduced, and the detection accuracy is improved.

In general, the greater the number of filter types of the filter assembly, the more fully sampled the color. However, two points are considered in practical application, namely, the more the types of filter sheets are, the higher the cost of the color sensor is, the more complex the preparation process is, and the higher the difficulty is; and secondly, redundancy probably exists in the filter sensing channels, random errors are introduced into the redundant filter sensing channels, and further the subsequent qualitative classification and quantitative fitting results are affected, so that the volume, cost and integration complexity of the filter assembly can be reduced, the detection accuracy is improved, and the balance of the volume, cost, integration complexity and detection accuracy of the filter assembly is considered through adaptively determining the number and the types of the filters.

In one possible implementation manner, the types of the filter may include at least one type of a plurality of material filter types, such as a super surface filter type, a photonic crystal filter type, a perovskite quantum dot filter type, a colloid quantum dot filter type, and the like, and each filter type includes a plurality of different types, and by way of example, the filter assembly of the embodiment of the disclosure may be formed by integrating different materials into the same substrate material, that is, one filter assembly may be made of a plurality of materials, such as integrating perovskite quantum dots, colloid quantum dots, and the like on the same substrate; of course, it may also be made of one material (e.g., the filter elements are each made of colloidal quantum dot filters).

The filter assembly may be composed of multiple (e.g., several, tens or hundreds) filters, and the colloid quantum dot filter is preferred in the embodiments of the present disclosure, because the colloid quantum dot preparation method is mature, the preparation process is simple, the cost is low, and the preparation is easy, and multiple colloid quantum dots can be integrated into a filter array (filter assembly) on the same substrate by using an ink printing technology, for example, one colloid quantum dot can obtain one filter, after the types of colloid quantum dots are selected, multiple colloid quantum dots can be printed on the same substrate, thereby forming the filter assembly (e.g., a filter array including multiple filters), and in addition, the colloid quantum dot filter is not affected by the angle of incident light, and is particularly suitable for a detection system for reflection measurement, compared with other filter arrays, the advantages are obvious.

By way of example, the embodiment of the disclosure prepares colloidal quantum dot filters with different particle sizes by changing reaction conditions and component proportions in the synthesis process of the colloidal quantum dots, and the different colloidal quantum dot filters have different spectral transmission functions. The colloid quantum dot filter is simple in preparation and low in cost, is easy to integrate in a liquid phase printing mode (such as ink printing), and is easy to customize for specific applications, so that the detection system of the embodiment of the disclosure can flexibly customize color sensing schemes of different applications, and the device is small in size and low in cost.

By way of example, since each filter on the filter component has different spectral transmission functions, incident light can be fully sampled and encoded, so that information of each wave band of the incident light is converted into light intensity information through the filter component, the embodiment of the disclosure can sample the light intensity information (i.e., image information) obtained by encoding the filter component to form a detection image (such as a rectangular gray-scale image array or other forms of images), and each incident light forms a different detection image, and the detection image contains the spectrum information of the incident light.

In a possible implementation manner, by adaptively determining the number and the combination manner of the filter plates, the embodiment of the disclosure may enable the number of the filter plates in the filter plate assembly to be the minimum number of the detection results, which reach the first preset detection results, in the detection results corresponding to the filter plate assemblies with different numbers of filter plates; and the combination mode of the filter plates in the filter plate assembly is a combination mode that the detection result reaches a second preset detection result in the detection results corresponding to the filter plate combinations with the same number of filter plates and different types of filter plates, wherein the combination mode comprises the types and arrangement modes of the filter plates, each filter plate combination comprises the minimum number of filter plates, and the types and/or arrangement modes of the filter plates in each filter plate combination are different.

The specific form and size of the first preset detection result and the second preset detection result are not limited, and can be set according to actual situations and needs by a person skilled in the art, and exemplary first preset detection results and second preset detection results can be related to the accuracy of color sensing, so that the accuracy, volume, cost and the like of color sensing can be considered in the embodiment of the disclosure, and exemplary first preset detection results and second preset detection results can be amounts corresponding to detection results corresponding to the filter assembly, for example, for the detection results are contents of components, the first preset detection results can be preset contents, also can be preset mean square errors, root mean square errors and the like, and if the detection results are classification results, the first preset detection results can be preset classification accuracy and the like. In an exemplary embodiment, the second preset detection result may be a preset boundary of a preferred detection result, when the detection result reaches the second preset detection result, it may be determined that the corresponding filter component has the preferred detection result, and in an exemplary embodiment, there may be a plurality of values reaching the second preset detection result, in this case, in order to reduce the detection threshold, the embodiment of the present disclosure may select a filter component corresponding to a smaller value in the plurality of detection results reaching the second preset detection result, and of course, the second preset detection result may also be reasonably set, so that the screened filter component has the preferred detection result.

The specific method for preparing the filter assembly according to the embodiments of the present disclosure is not limited to a specific manner of constructing the color sensing device and the detection system by using the filter assembly, and may be set by a person skilled in the art according to actual situations and needs, and exemplary descriptions are provided below.

Referring to fig. 2, fig. 2 shows a flowchart of a filter determining method of a color sensing device according to an embodiment of the present disclosure.

In one possible embodiment, as shown in fig. 2, the method may include:

step S31, providing a plurality of filter assemblies having different numbers of filters, including: selecting a plurality of different numbers of filters from N filters to form a plurality of filter components, wherein each filter in the N filters has different spectral transmission relations, the N filters can encode colors in a target wavelength range, and N is a positive integer;

step S32, providing a plurality of filter assemblies with different filter combination modes, including: the combination mode of the minimum number of continuous distribution or jump distribution is determined from N filter plates.

The specific size of the target wavelength range is not limited in the embodiments of the present disclosure, and can be determined by those skilled in the art according to actual situations and needs.

For example, the spectral transmittance relationship may represent a correspondence relationship of spectral transmittance of the filter to a wavelength of light.

For example, after preparing a plurality of filter assemblies with different numbers of filter plates, the embodiment of the disclosure may perform detection of an object to be detected by using each filter assembly to obtain a plurality of detection results, and select, from detection results corresponding to filter assemblies with different numbers of filter plates, a minimum number of filter plates from detection results corresponding to the detection results reaching a first preset detection result, where the minimum number is used as the number of filter plates of the filter assembly.

For example, after determining the number of filter segments of the filter segment assembly, the embodiments of the present disclosure may determine, from N filter segments, a combination manner of the minimum number of continuous distributions or skip distributions multiple times, so as to provide a plurality of filter segment assemblies having different filter segment combination manners, and select, from detection results corresponding to different filter segment combinations of the same filter segment number, a combination manner of filter segment combinations corresponding to a second preset detection result in the detection results, as a combination manner of filter segments in the filter segment assemblies.

The embodiment of the present disclosure is not limited to the specific implementation manner of obtaining each detection result, and those skilled in the art may obtain the detection result according to actual situations and needs, and the following is exemplary description.

In one possible embodiment, as shown in fig. 2, the method may further include:

and S21, inputting the imaging information into a detection model, and obtaining the detection result by using the output result of the detection model, wherein the detection model has a mapping relation between the imaging information and the detection result.

For example, the embodiment of the disclosure may encode incident light by using filter assemblies after preparing a plurality of filter assemblies having different numbers of filters, obtain corresponding imaging information according to the incident light by each filter assembly, input the imaging information to a detection model, and obtain the detection result by using an output result of the detection model. The embodiment of the disclosure does not limit the source of the incident light, and the incident light may be one or more of the following after the color reaction component is irradiated by the probe light emitted by the light source: transmitted light, reflected light, or fluorescent light.

For example, the embodiment of the disclosure may encode the incident light by using the filter assemblies, obtain corresponding imaging information according to the incident light by using each filter assembly, input the imaging information into a detection model, and obtain the detection result by using the output result of the detection model.

In one possible embodiment, as shown in fig. 2, the method may further include:

and S22, detecting the imaging information to obtain a rectangular gray-scale image array.

The detection model of the embodiment of the present disclosure is not limited to obtaining a detection result according to imaging information, and in some possible implementations, the embodiment of the present disclosure may obtain a detection image (such as a rectangular gray image array) according to imaging information through a suitable technical means, input the rectangular gray image array into a detection model, and obtain the detection result by using an output result of the detection model, where the detection model has a mapping relationship between the detection image (such as the rectangular gray image array) and the detection result.

The embodiment of the disclosure does not limit the specific type of the object to be detected, does not limit the type of the detection result, does not limit the specific implementation mode of the detection model, and can determine the object to be detected according to actual conditions and needs by a person skilled in the art, and selects corresponding detection parameters and detection models. For example, in one possible embodiment, the test object may be in a liquid state, and the test result includes components and contents of the components, for example, the test object may be a pesticide, blood, urine, or other liquid test objects, and the test result may be a component of the test object, a content of the components, or other classification results. In one possible implementation manner, the detection result may include components of the to-be-detected object or components of the to-be-detected object and contents of the components, and the detection model is obtained based on at least one of a least square method, a neural network, a support vector machine, naive bayes classification, a decision tree, a k-nearest neighbor algorithm, linear discriminant analysis, linear regression, logistic regression, classification and regression trees, learning vector quantization, a bagging method, a random forest, and the like, and a specific manner of establishing and training the detection model is not limited, so that a person skilled in the art can adopt a suitable means according to actual situations and needs.

In one possible implementation manner, the rectangular gray image array may include a plurality of rectangular areas, each filter corresponds to one rectangular area, the plurality of rectangular areas corresponds to a plurality of gray values, and each rectangular area includes a plurality of pixels; the gray values of the rectangular areas of the rectangular gray image array are different, and of course, the specific shape of the rectangular gray image array is not limited in this disclosure, the rectangular gray image array may be any shape formed by a plurality of different gray value areas, each gray value area corresponds to a filter, and the rectangular gray image array may include an array form in which a plurality of rectangular areas form T rows and P columns, T, P may be integers greater than 0, and the size of each rectangular area may be the same or different.

In one possible embodiment, the types of filters include at least one type of super surface filter type, photonic crystal filter type, perovskite quantum dot filter type, colloidal quantum dot filter type, and the like, and each filter type includes a plurality of different types.

In one possible implementation manner, in the filter combination, the filter may be a colloidal quantum dot filter, each colloidal quantum dot filter has a different spectral transmission relationship, and the filter encodes incident light together based on the spectral transmission relationship and a spectral sensitivity relationship of a detection component corresponding to each filter, so as to obtain imaging information of the incident light, where the spectral sensitivity relationship represents a relationship between light responsivity and light wavelength.

The following description of possible implementations of determining the number and combination of filters is given by way of specific examples, and it should be understood that the following examples should not be construed as limiting the embodiments of the disclosure.

Illustratively, let N be the total number of filters, which may be colloidal quantum dot type, super surface structure type, photonic crystal structure type, perovskite quantum dot type, etc. The total number of filters N varies from a few tens to thousands, for example. Taking a colloid quantum dot filter as an example, the embodiment of the disclosure can synthesize hundreds of colloid quantum dots through a chemical synthesis process, and determine the types and the number N of the colloid quantum dots in a target wave band according to the target wave band of sensing application. For example: the spectrum range of the color change is 380nm-750nm, and the embodiment of the disclosure can synthesize 240 colloidal quantum dots with the transmission rising peak of 380nm-750 nm.

Illustratively, at the target wavelength band (e.g., 380nm-750 nm) for sensing applications, the filter can be arranged from short wavelength to long wavelength with the transmission peak position of the filter up to N filters. For example, according to the arrangement sequence, 10, 15, 20, 25, 30, … …, N-1 (or other numbers) filter sheets can be selected to form a plurality of filter sheet assemblies, imaging information or detection images (such as rectangular gray image arrays) corresponding to color changes of the object to be detected under the filter sheet assemblies with different filter sheet numbers can be obtained, imaging information or rectangular gray image arrays corresponding to the filter sheet assemblies with different filter sheet numbers can be classified or fitted by adopting a detection model (such as a neural network model), detection results can be obtained, and classification or fitting effects of the neural network model can be quantified by adopting related evaluation indexes. Illustratively, the evaluation index may be a mean square error, a root mean square error, a classification accuracy, or the like.

For example, assuming that the color change wavelength range of the object to be detected is 380nm-750nm, the types of the quantum dot filter sheets positioned in the interval are 240, and the quantum dot filter sheets can be ordered from small to large according to the ascending wavelength of the transmission curve; according to the arrangement sequence, uniformly selecting 10, 20, 30, 40, 60, 80 and 120 quantum dot filter plates to form filter plate components, wherein different numbers of filter plate components are used for measuring the color of an object to be measured, obtaining imaging information or a rectangular gray image array of different components and the content of the object to be measured (assumed to be liquid), quantitatively fitting by adopting a detection model neural network model, and evaluating by adopting evaluation indexes such as mean square error. The detection model (such as a neural network model) can realize mapping from imaging information or a rectangular gray image array to a substance component, and content or kind thereof, and for specific parameters and training process of the detection model (such as the neural network model), those skilled in the art can determine according to actual situations and needs, and the embodiments of the disclosure will not be repeated.

For example, the embodiment of the disclosure may select the corresponding first preset detection result to determine the minimum number of filter plates of the filter plate assembly, e.g., determine the minimum number M of filter plates required according to the application precision requirement. For example, after obtaining fitting/classifying results of neural network models under different numbers of uniformly distributed filter assemblies, a threshold (a first preset detection result) may be set according to the accuracy requirement of a specific color sensing application, and the first preset detection result may include a classification accuracy, a detection limit, and the like, and the required minimum filter number greater than the set threshold is determined to be M. For example, the fitting result of each neural network under the filter components with the number of 10, 20, 30, 40, 60, 80 and 120 which are uniformly distributed can be obtained, the mean square error is adopted as an evaluation standard, the mean square error threshold e (the first preset detection result) is set according to specific application, the minimum number of the filters with the mean square error greater than the threshold e is selected, and the minimum number of the filters in the filter components is assumed to be m=30.

For example, after determining the minimum number of filters in the filter assembly, the number M of filters may be selected from the total filters (N) by traversing, so as to determine a combination manner of filters in the filter assembly, for example, may be a combination manner that the detection result reaches a second preset detection result in detection results corresponding to combinations of filters of the same number of filters and different types of filters.

In one example, M filters may be selected from the total filter N by traversing, that is, determining a plurality of combination manners, and forming corresponding filter assemblies, and performing experiments for a plurality of times, to obtain a plurality of evaluation indexes under each combination manner, where the step of selecting M filters by uniformly distributing is a first step of screening, and the step of traversing screening is a second step of accurate screening, because M filters uniformly distributed are not necessarily optimal results, and include other conditions of concentrated continuous distribution, skip distribution, and the like. The traversal screening calculation amount is large, in order to reduce the calculation amount, centralized continuous distribution and uniform distribution can be adopted for comparison screening, the workload is reduced, and of course, the weight can be given to the filter according to the main wave band of the color change of the object to be detected, and the type of the filter is selected according to the weight. For example, assuming that the minimum number of filters m=30 is obtained from 240 quantum dot filters (n=240) in the 380nm-750nm band, the traversal screening requiresThe number of operations is 210, and 210 conditions (such as 1-30, 2-31, 3) of continuous centralized distribution are obtained (such as 1-30, 2-31, 3 #) 32. …, 210 to 239), and comparing the neural network fitting results (i.e., the detection results of the detection model) with the evaluation indexes, comparing the 210 neural network fitting results with the second preset detection results, and selecting a combination mode for selecting the case where the evaluation indexes are the best as the final optimization scheme.

After selecting the M filters and the arrangement manner thereof, the embodiment of the disclosure may guide the preparation of the filter assembly and the color sensor by using the combination manner, for example, after selecting the M filters, the color sensor for the color sensing application is produced in batch in the following process only by integrating the optimized M filters, without integrating the N filters, thereby greatly reducing the number of filters, saving the cost, and not reducing the detection precision.

Of course, for a specific description of the number of filters and the combination mode for adaptively determining, please refer to the previous description of the detection system, and the description thereof will not be repeated here.

Referring to fig. 3, fig. 3 shows a schematic diagram of transmission spectra of various colloidal quantum dot filters according to an embodiment of the disclosure.

The wavelength band range of the 120 colloidal quantum dot filters shown in fig. 3 covers 380nm to 750nm, by way of example. 120 colloid quantum dot filters, each with different spectral transmission functions, can encode the color within 380 nm-750 nm, each colloid quantum dot filter encodes the incident light into an intensity value I _i 。

In a possible embodiment, the filter is preferably a colloidal quantum dot filter, each colloidal quantum dot filter having a different spectral transmission relationship, the spectral transmission relationship representing the spectral transmittance of the filter in relation to the wavelength of light,

the filter plates encode incident light together based on the spectral transmission relation and the spectral sensitivity relation of the detection component corresponding to each filter plate to obtain imaging information of the incident light, and the spectral sensitivity relation represents the relation between spectral responsivity and light wavelength.

In one possible implementation manner, the filter plate encodes incident light together based on the spectral transmission relationship and the spectral sensitivity relationship of the detection component corresponding to each filter plate, so as to obtain imaging information of the incident light, and the method includes:

the filter sheet encodes incident light based on the following formula 1 to obtain imaging information of the incident light:

wherein, the liquid crystal display device comprises a liquid crystal display device,represents the spectral transmission relation of the ith filter plate, theta _i (lambda) represents the spectral sensitivity relationship of the ith detection element corresponding to each filter, x (lambda) represents the spectrum of the incident light, I _i The light intensity value corresponding to the ith filter is represented, λ represents the wavelength of light, λ1 represents the minimum wavelength of the optical band, and λ2 represents the maximum wavelength of the optical band.

Illustratively, for micro-spectrometer technology,is determined by complex and costly scaling operations, since the spectral reconstruction procedure requires +.>Is a piece of information of (a). But for the detection scheme proposed in the presently disclosed embodiments, < >>Without determining through calibration operation, the embodiment of the disclosure does not need to know the value of the detection image or imaging information, does not need to perform spectrum reconstruction, only needs to know that different colloid quantum dot filters realize different coding results, and can obtain detection results according to the detection image or imaging information, for example, a rectangular gray-scale image array or the imaging is establishedThe mapping relation between the image information and the substance components and contents can be used for obtaining a detection result according to the detection image or the imaging information.

Referring to fig. 4, fig. 4 shows a schematic diagram of determining a detection model and performing concentration detection according to an embodiment of the present disclosure.

Exemplary, as shown in fig. 4, in the embodiment of the present disclosure, the light intensity value of each sensing channel is obtained by encoding the incident light into imaging information by using the filter assembly, and a rectangular gray image array is obtained according to the imaging information, so that mapping from the rectangular gray image array or the imaging information to the substance component and the content thereof is directly implemented, and qualitative and quantitative detection is implemented.

When detecting substances with different concentrations, the paper base and the film are caused to present different color changes, and the detection system adopting the embodiment of the disclosure can acquire rectangular gray scale image arrays corresponding to the substances with different concentrations and then detect the substances by adopting algorithms such as image processing technology and the like.

For example, as shown in fig. 4, to build a detection model, in the embodiment of the disclosure, an average intensity value of each filter region of a rectangular gray image array may be obtained as a light intensity value under a sensing channel of the filter, and then combined into a rectangular gray image array high-dimensional vector, different concentration substances correspond to different high-dimensional vectors, and the concentration of the substances may be fitted through algorithms such as a least square method, a neural network, various machine learning algorithms, and the like, a fitting curve is drawn, and a detection Limit (LOD) thereof is calculated, thereby obtaining the detection model. After the detection model is established, the unknown concentration can be judged by using the detection image obtained by the detection component.

Compared with the RGB image method, the method for realizing detection by utilizing the filter assembly obtained by the embodiment of the disclosure has the advantages that the fitting effect is obviously improved, the detection limit is reduced, the color sensing capability of the embodiment of the disclosure is stronger, and the method has higher accuracy in detecting the components and the content of the solution by utilizing the embodiment of the disclosure, as shown in fig. 4.

An exemplary description of a filter determination method of the color sensing device will be given below taking as an example a filter assembly for determining a color sensing device for detecting urine.

Referring to fig. 5, fig. 5 is a schematic diagram illustrating a filter determining method of a color sensing apparatus according to an embodiment of the disclosure.

Illustratively, the glucose content of urine is an important marker for measuring diabetes and the degree of diabetes, and it is of interest to prepare a low-cost, portable urine glucose detection sensor.

A urine glucose detection filter optimization flow chart is shown in fig. 5 (1). Illustratively, the disclosed embodiments employ a colloidal quantum dot filter array for a urine glucose detection color sensor, for example, employing 120 filters (n=120) of colloidal quantum dots having transmission peak rising positions in the 380nm-750nm spectral range. When the urine glucose color sensor is manufactured, 120 colloid quantum dot filter plates cannot be simply adopted, and because redundancy exists in the filter plate sensing channels, random errors are introduced into the redundant filter plate sensing channels, and the detection result of a detection model formed by a neural network and other pattern recognition methods on glucose is affected. Therefore, in the embodiment of the disclosure, a plurality of different numbers of filters may be selected from N filters to form a plurality of filter assemblies, so as to provide a plurality of filter assemblies with different numbers of filters, in the detection results corresponding to the filter assemblies with different numbers of filters, a minimum number of filters is selected from the detection results corresponding to the detection results reaching the first preset detection results, the minimum number is used as the number of filters of the filter assemblies, for example, 120 filters may be ordered from small to large according to the ascending peaks, 20, 30, 40, 60, 90, 120 uniformly distributed quantum dot filters may be selected to form 7 filter arrays, 7 corresponding color sensors are further prepared, the image sensors adopted are all of the same type of complementary metal oxide semiconductors, the detection model is formed by adopting the same type of neural network architecture or other pattern recognition methods, the three layers of fully connected neural networks are adopted in this example, mean square error is adopted as an evaluation index (normalization), and the evaluation indexes of the 7 color sensors are shown in (2) of fig. 5. The color sensor formed by 120 quantum dot filters is not an optimal result because for glucose sensing 120 quantum dot filters are redundant, and the redundant filters introduce random errors, such as detector noise, which affect the fit. Compared with a sensor composed of 120 filters, the sensor composed of 20 uniformly distributed filters (quantum dot filters with the serial numbers of 1, 7, 13, 19, 25, 31, 37, 43, 49, 55, 61, 67, 73, 79, 85, 91, 97, 103, 109 and 115; the arrangement from short wavelength to long wavelength according to the absorption rising peak position of the transmission spectrum of the filters) has the optimal evaluation index, and the evaluation index is reduced by nearly one order of magnitude compared with the sensor composed of 120 filters. By adopting the first step of the filter optimization method provided by the embodiment of the disclosure, the number of quantum dot filters is reduced from 120 to 20, the detection performance is improved (the evaluation index is reduced by nearly one order of magnitude), and the cost is reduced (the cost is reduced to one sixth). So for urine glucose sensing 20 filters are used to make up the color sensor.

By way of example, further, since 20 uniformly distributed filters are not necessarily the optimal result in the case of the overall distribution of 20 filters, embodiments of the present disclosure may determine the optimal distribution type of 20 filters. For example, the combination mode of the minimum number of continuous distributions or jump distributions may be determined from N filter segments multiple times, so as to provide a plurality of filter segment assemblies with different filter segment combination modes, and in the detection results corresponding to the filter segment combinations of the same filter segment number and different filter segment combinations, the combination mode of the filter segment combination corresponding to the second preset detection result in the detection results is selected as the combination mode of the filter segments in the filter segment assemblies. Illustratively, 20 common filter types are selected from 120 filter typesThe selection method can select 20 kinds of filter sheets (1-20, 11-30, … …,101-120, 11 kinds of arrangement modes in total) which are continuously distributed to form a corresponding filter sheet array, and further constructs a corresponding color sensor, and 11 kinds of color sensors in total. For example, detection may be constructed using algorithms such as neural networksThe model fits the detection results of the 11 color sensors, respectively, and adopts the mean square error as an evaluation index (normalization), as shown in (3) of fig. 5. The evaluation indexes of the 11 kinds of filter color sensors which are continuously distributed are larger than the evaluation indexes corresponding to the color sensors which are uniformly distributed, so that when 20 kinds of filter types are determined in the second step, the embodiment of the disclosure selects 20 kinds of filter types which are uniformly distributed, thereby reducing the detection Limit (LOD). Of course, for different applications, different optimization results may occur in the second step, such as for a urine nitrite sensor, in one example, the color sensor composed of 71-90 quantum dot filters distributed continuously may be obtained to have the best performance and the smallest evaluation index. Finally, the color sensor is further prepared according to the selected 20 kinds of filter (quantum dot filter serial numbers 1, 7, 13, 19, 25, 31, 37, 43, 49, 55, 61, 67, 73, 79, 85, 91, 97, 103, 109, 115) which are uniformly distributed to form an array.

Referring to fig. 6, fig. 6 shows a schematic diagram of a color sensing device according to an embodiment of the disclosure.

As shown in fig. 6, the apparatus includes:

the filter assembly 30 obtained by the filter determining method of the color sensing device is used for encoding incident light into imaging information, the imaging information comprises light intensity values of the incident light, the filter assembly 30 comprises a plurality of different types of filter plates, and the different filter plates can encode the incident light to obtain the imaging information. The imaging information may be light intensity information, and the detection component (such as a CCD) may be used to detect the imaging information (light intensity information) to obtain a rectangular gray scale image array, where the imaging process is a process of detecting the imaging information (light intensity information) with the detection component (such as a CCD) to obtain a rectangular gray scale image array.

According to the filter determining method of the color sensing device, the minimum number of the filter plates is selected from detection results corresponding to filter plate assemblies with different numbers of filter plates from detection results corresponding to the first preset detection results, the minimum number is used as the number of the filter plates of the filter plate assemblies, the combination mode of the filter plates corresponding to the second preset detection results in the detection results is selected from detection results corresponding to the same number of different types of filter plate combinations of the filter plate assemblies, the filter plate array is optimized according to specific application, cost, volume and integration complexity are reduced on the premise of ensuring the accuracy of the color sensing device, and measurement accuracy is improved, so that the color sensing device realized by the filter plate assemblies can be reduced in size, accuracy, structure and cost.

It should be noted that, the specific description of the filter determining method of the color sensing device is referred to the previous description, and will not be repeated here.

Referring to fig. 7, fig. 7 shows a schematic diagram of a color sensing device according to an embodiment of the disclosure.

In one possible embodiment, as shown in fig. 7, the apparatus may further include:

and a detection component 40, configured to detect the imaging information, where the imaging information is used to be input into a detection model, so as to obtain a detection result by using an output result of the detection model, and the detection model has a mapping relationship between the imaging information and the detection result.

In one possible embodiment, the detection component may include at least one of a complementary metal oxide semiconductor element, a charge coupled element, an ultraviolet detection element, an indium gallium arsenide near infrared detection element, and for visible light band color sensing applications, the detection component may be a complementary metal oxide semiconductor or a charge coupled element, as examples; for ultraviolet band color sensing applications, the detection component is an ultraviolet detection component; for near infrared band color sensing applications, the detection component is an InGaAs near infrared detection component. In this way, the detection system of the embodiment of the disclosure does not need an imaging optical lens, and the volume and cost of the instrument are further reduced.

The detection component acquires image information of the filter component under different colors, wherein the image information can be hyperspectral image information or gray level images, the gray level images are similar to the distribution of bar codes, and the embodiment of the disclosure directly adopts a rectangular gray level image array and a pattern recognition algorithm to carry out qualitative classification and quantitative detection of substances.

Referring to fig. 8, fig. 8 is a schematic diagram of a detection image formed by a detection assembly according to imaging information of a filter assembly according to an embodiment of the present disclosure.

For example, each colloidal quantum dot filter may cover a rectangular area on the detection assembly, each rectangular area consisting of approximately hundred pixels. The adoption of the colloid quantum dot has the advantages that the projection function is not influenced by the angle of incident light, the application scene is wider, and the method is also suitable for reflection type oblique incidence scenes. The rectangular gray scale image array technique does not require an imaging lens, and its cost and volume are further compressed, unlike other imaging techniques.

According to the embodiment of the disclosure, the filter assembly and the detection assembly are used for acquiring the detection image such as the rectangular gray image array data instead of the spectrum image data, so that the calibration and spectrum reconstruction process is not required, the processing complexity and cost are reduced, the detection flow is simplified, and the measurement accuracy can be improved.

The embodiment of the disclosure does not limit the combination mode of the filter assembly and the detection assembly, each filter on the filter assembly has different spectral transmission functions, and can fully sample and encode incident light, so that information of each wave band of the incident light is converted into light intensity information through the filter assembly, and then the light intensity information is sampled through the detection assembly to form a detection image (such as a rectangular gray image array). Illustratively, each incident light forms a different imaging message that includes spectral information of the incident light that is spectrally efficient in representing color variations. Compared with the traditional large-scale spectrometer, the design of the filter assembly avoids a light splitting system with complex structure and large volume, and the volume of the color sensor is greatly reduced.

Referring to fig. 9, fig. 9 shows a block diagram of a detection system according to an embodiment of the present disclosure.

As shown in fig. 9, the detection system may include:

the color sensing device comprises a filter assembly 30 and a detection assembly 40;

a light source 10 for emitting detection light;

a color reaction component 20, wherein the color reaction component 20 is used for obtaining one or more of the following after being irradiated by the detection light: transmitting light, reflecting light or fluorescence, and making the light obtained after irradiation incident on the filter assembly;

And the data processing component 50 is used for obtaining a detection result according to the detection image or imaging information generated by the color sensing device.

Compared with a visual inspection method, an RGB method and the like in the related technologies, the detection system of the embodiment of the disclosure can realize more accurate sensing of colors, and in a specific color information acquisition process, the detection system can realize the effect without the calibration and spectrum reconstruction process by acquiring detection images (such as rectangular gray image arrays) instead of spectrum image data, so that the test flow and requirements are simplified.

The embodiment of the disclosure emits the detection light to illuminate the color reaction component through the light source 10, and the light emitted by the light source 10 passes through the color reaction component 20 to obtain one or more of the following components: the transmitted light, reflected light or fluorescence light is incident to the filter assembly 30, the incident light is encoded into imaging information through the filter assembly, the imaging information comprises the light intensity value of the incident light, the filter assembly 30 comprises a plurality of different types of filter plates, and the different filter plates can encode the incident light to obtain different imaging information; detecting the imaging information by a detection assembly 40 and generating a detection image (e.g., a rectangular gray scale image array); the data processing component 50 obtains a detection result according to the detection image or the imaging information, so that accurate color sensing can be realized, and the system has the advantages of low cost and small volume, can optimize a filter array according to specific application, reduces cost and integration complexity, and improves measurement accuracy.

The specific implementation manners of the light source 10, the color reaction component 20, the filter component 30, the detection component 40, and the data processing component 50 in the embodiments of the present disclosure are not limited, and those skilled in the art can implement the foregoing exemplary description by adopting appropriate technical means according to actual situations and needs.

For example, the light source 10 may be custom selected according to a specific application, such as selecting an LED light source 10, a halogen lamp light source 10, etc. for a visible light band application, natural light, and other forms of light sources may be used.

Illustratively, the color reaction component 20 may interact with the analyte to produce a detectable color change, and the color-related information of the color reaction component 20 may be obtained when the probe light irradiates the color reaction component 20. Illustratively, the color reaction assembly 20 may be filled or loaded with reagents that interact with the analyte to produce a color change, the materials of the reagents including: one or more of quantum dot materials, chemical dyes, fluorescent luminescent materials, and the like. In one embodiment, the color reaction assembly 20 may be obtained by loading or filling the above-mentioned reagents on a carrier, which may be set according to actual needs, for example, optional carrier materials include: one or more of Polytetrafluoroethylene (PTFE), polyvinylidene fluoride (PVDF), polyethylene terephthalate (PET), nylon, non-woven fabrics, MCE, PP and the like.

For example, the color reaction assembly 20 may be a customized placement tank, in which the reagent may be placed, or in one embodiment, a carrier such as a paper base, a film, etc. is placed in the placement tank, and the reagent is loaded on the carrier, etc. those skilled in the art may implement maximum optical efficiency or obtain target optical information by reasonably adjusting the positional relationship between the color reaction assembly 20 and the light source 10, the detection assembly 40, and of course, the specific positional relationship between the color reaction assembly 20 and the light source 10, the detection assembly 40 is not limited in this disclosure.

In one possible embodiment, the types of the filter include at least one of a super surface filter type, a photonic crystal filter type, a perovskite quantum dot filter type, and a colloid quantum dot filter type, and each filter type includes a plurality of different types.

In one possible implementation manner, the filter is a colloidal quantum dot filter, each colloidal quantum dot filter has a different spectral transmission relationship, and the spectral transmission relationship represents the corresponding relationship between the spectral transmittance of the filter and the wavelength of light,

The filter plate encodes incident light based on the spectral transmission relation, the spectral sensitivity relation of the detection assembly corresponding to each filter plate and the spectrum of the incident light to obtain imaging information of the incident light, and the spectral sensitivity relation represents the relation between spectral responsivity and light wavelength.

in one embodiment, the filter encodes the incident light to obtain imaging information of the incident light based on the following formula:

wherein (1)>Represents the spectral transmission relation of the ith filter plate, theta _i (lambda) represents the spectral sensitivity relationship of the ith detection element corresponding to each filter, x (lambda) represents the spectrum of the incident light, I _i The light intensity value corresponding to the ith filter is represented, λ represents the wavelength of light, λ1 represents the minimum wavelength of the optical band, and λ2 represents the maximum wavelength of the optical band.

In a possible implementation manner, the detection image is a rectangular gray scale image array, and the detection image comprises a plurality of rectangles Each of the filters corresponds to a rectangular region, and the plurality of rectangular regions corresponds to a plurality of gray values, each rectangular region including a plurality of pixels, and, illustratively, in the above formula,may be 1, and the corresponding detection image is a rectangular gray scale image array.

In one possible implementation, the data processing component 50 includes, but is not limited to, a separate processor, or a discrete component, or a combination of a processor and a discrete component. The processor may include a controller in an electronic device having the functionality to execute instructions, and may be implemented in any suitable manner, for example, by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements. Within the processor, the executable instructions may be executed by hardware circuits such as logic gates, switches, application specific integrated circuits (Application Specific Integrated Circuit, ASIC), programmable logic controllers, and embedded microcontrollers.

In one possible implementation, the data processing component 50 may include a terminal device or a server or other processing device. The terminal device may be a User Equipment (UE), a mobile device, a User terminal, a handheld device, a computing device, or a vehicle-mounted device, and examples of some terminals are: a Mobile Phone, a tablet, a notebook, a palm, a Mobile internet device (Mobile Internetdevice, MID), a wearable device, a Virtual Reality (VR) device, an Augmented Reality (AR) device, a wireless terminal in industrial control (Industrial Control), a wireless terminal in unmanned driving (Selfdriving), a wireless terminal in teleoperation (Remote medical Surgery), a wireless terminal in Smart Grid (Smart Grid), a wireless terminal in transportation security (Transportation Safety), a wireless terminal in Smart City (Smart City), a wireless terminal in Smart Home (Smart Home), a wireless terminal in the internet of vehicles, and the like. For example, the server may be a local server or a cloud server.

The specific implementation manner of the data processing unit 50 to obtain the detection result according to the detected image or the imaging information is not limited in the embodiments of the present disclosure, and those skilled in the art may adopt suitable technical means according to actual situations and needs.

In a possible implementation manner, the obtaining a detection result according to the detected image or the imaging information may include:

and inputting the detection image or the imaging information into a detection model, and obtaining the detection result by using the output result of the detection model, wherein the detection model has a mapping relation between the detection image or the imaging information and the detection result.

For example, for transmission color measurement, embodiments of the present disclosure may first measure a rectangular gray scale image array without solution; then obtaining a rectangular gray image array when the solution exists; and subtracting the front and rear rectangular gray image arrays to obtain a rectangular gray image array absorbed by the solution.

The filter assembly of the embodiment of the disclosure may be integrated with a terminal device such as a smart phone, and the natural light is used as the light source 10 or a flashlight of the smart phone is used as the light source 10, or a camera of the terminal device is used as a detection assembly to realize a portable color sensing scheme, and the data processing assembly 50 may be manufactured in a software form of the terminal device, so that the operation is more convenient and simple; meanwhile, by means of Bluetooth and network communication functions of the terminal equipment, data sharing among multiple devices can be achieved. For example, any smart phone, together with the filter component and the data processing component 50, can be changed into a color sensor, so as to realize a portable, low-cost and small-volume color sensing scheme and meet the requirements of multiple fields such as clinical medicine, environmental monitoring and the like.

The detection system of the embodiment of the disclosure can accurately sense the color change to qualitatively and quantitatively identify the components and the content of the substances. Each part of the detection system can be customized and designed according to specific application, for example, a rectangular gray image array of absorption colors in a liquid phase form can be obtained according to pesticide detection; aiming at urine component identification, a rectangular gray image array of the reflection color of the paper-based colorimetric array is obtained. Specifically, each color corresponds to a rectangular gray image array, and the rectangular gray image array can be directly combined with a pattern recognition algorithm to realize qualitative and quantitative identification of color change so as to identify the composition and content of substances. Compared with the micro spectrometer technology, the calibration process of the micro spectrometer technology depends on expensive instruments and complex experimental procedures, the rectangular gray image array technology realized by the filter assembly and the detection assembly in the embodiment of the disclosure does not need to carry out experimental calibration on the filter assembly and the detection assembly, the rectangular gray image array technology has lower cost, and the corresponding detection system has low cost and is simple to prepare.

In one possible implementation, the data processing component may be further configured to:

The embodiment of the disclosure does not limit the specific type of the object to be detected, does not limit the type of the detection result, does not limit the specific implementation mode of the detection model, and can determine the object to be detected according to actual conditions and needs by a person skilled in the art, and selects corresponding detection parameters and detection models. In one possible embodiment, the test object is in a liquid state, and the test result includes components and contents of the components, for example, the test object may be a pesticide, blood, urine or other liquid test objects, and the test result may be a component of the test object, the contents of the components, or other classification results. In a possible implementation manner, the detection model may be obtained based on at least one of a least square method, a neural network, a support vector machine, etc., and the specific manner of establishing and training the detection model in the embodiment of the present disclosure is not limited, and a person skilled in the art may adopt a suitable means according to actual situations and needs.

Compared with a visual inspection method, an RGB method and the like in the related technologies, the detection system of the embodiment of the disclosure can realize more accurate sensing of colors, and in a specific color information acquisition process, the detection system can realize the effect without the calibration and spectrum reconstruction process by acquiring detection images (such as rectangular gray image arrays) instead of spectrum image data, thereby simplifying the test flow and requirements.

It will be appreciated that the above-mentioned method embodiments of the present disclosure may be combined with each other to form a combined embodiment without departing from the principle logic, and are limited to the description of the present disclosure. It will be appreciated by those skilled in the art that in the above-described methods of the embodiments, the particular order of execution of the steps should be determined by their function and possible inherent logic.

The detection method corresponds to the detection system described above, and the specific description of the detection system is referred to the description of the detection system before, and is not repeated here.

The disclosed embodiments also provide a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the above-described method. The computer readable storage medium may be a non-volatile computer readable storage medium.

The embodiment of the disclosure also provides an electronic device, which comprises: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to perform the above method.

Embodiments of the present disclosure also provide a computer program product comprising computer readable code, or a non-transitory computer readable storage medium carrying computer readable code, which when run in a processor of an electronic device, performs the above method.

The electronic device may be provided as a terminal, server or other form of device.

Referring to fig. 10, fig. 10 shows a block diagram of an electronic device according to an embodiment of the disclosure.

For example, electronic device 800 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, exercise device, personal digital assistant, or the like.

Referring to fig. 10, an electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and a communication component 816.

The processing component 802 generally controls overall operation of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interactions between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations at the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The power supply component 806 provides power to the various components of the electronic device 800. The power components 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 800.

The multimedia component 808 includes a screen between the electronic device 800 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 is in an operational mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 further includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.

The sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of the electronic device 800. For example, the sensor assembly 814 may detect an on/off state of the electronic device 800, a relative positioning of the components, such as a display and keypad of the electronic device 800, the sensor assembly 814 may also detect a change in position of the electronic device 800 or a component of the electronic device 800, the presence or absence of a user's contact with the electronic device 800, an orientation or acceleration/deceleration of the electronic device 800, and a change in temperature of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a photosensor, such as a Complementary Metal Oxide Semiconductor (CMOS) or Charge Coupled Device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate communication between the electronic device 800 and other devices, either wired or wireless. The electronic device 800 may access a wireless network based on a communication standard, such as a wireless network (WiFi), a second generation mobile communication technology (2G) or a third generation mobile communication technology (3G), or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.

In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 804 including computer program instructions executable by processor 820 of electronic device 800 to perform the above-described methods.

Referring to fig. 6, fig. 6 shows a block diagram of an electronic device according to an embodiment of the disclosure.

For example, electronic device 1900 may be provided as a server. Referring to FIG. 6, electronic device 1900 includes a processing component 1922 that further includes one or more processors and memory resources represented by memory 1932 for storing instructions, such as application programs, that can be executed by processing component 1922. The application programs stored in memory 1932 may include one or more modules each corresponding to a set of instructions. Further, processing component 1922 is configured to execute instructions to perform the methods described above.

The electronic device 1900 may also include a power component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input/output (I/O) interface 1958. Electronic device 1900 may operate an operating system based on memory 1932, such as the Microsoft Server operating system (Windows Server) ^TM ) Apple Inc. developed graphical user interface based operating System (Mac OS X ^TM ) Multi-user multi-process computer operating system (Unix) ^TM ) Unix-like operating system (Linux) of free and open source code ^TM ) Unix-like operating system (FreeBSD) with open source code ^TM ) Or the like.

In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 1932, including computer program instructions executable by processing component 1922 of electronic device 1900 to perform the methods described above.

The foregoing description of the embodiments of the present disclosure has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the various embodiments described. The terminology used herein was chosen in order to best explain the principles of the embodiments, the practical application, or the improvement of technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A method of determining a filter of a color sensing device, the method comprising:

2. The method according to claim 1, wherein the method further comprises:

3. The method according to claim 1 or 2, characterized in that the method further comprises:

4. The method of claim 3, wherein the detection result comprises a component of the test object or a component of the test object and a content of each component, and the detection model is obtained based on at least one of a least squares method, a neural network, a support vector machine, naive bayes classification, a decision tree, a k-nearest neighbor algorithm, linear discriminant analysis, linear regression, logistic regression, classification and regression trees, learning vector quantization, a bagging method, and random forests.

5. A method according to claim 3, wherein the rectangular gray scale image array comprises a plurality of rectangular areas, one for each filter, the plurality of rectangular areas corresponding to a plurality of gray scale values, each rectangular area comprising a plurality of pixels;

6. The method of claim 1, wherein in the filter combination, the filter is a colloidal quantum dot filter, each colloidal quantum dot filter has a different spectral transmission relationship, the filter encodes incident light together based on the spectral transmission relationship and a spectral sensitivity relationship of a detection component corresponding to each filter, so as to obtain imaging information of the incident light, and the spectral sensitivity relationship represents a relationship between light responsivity and light wavelength.

7. The method according to claim 1, characterized in that the method comprises:

8. A color sensing device, the device comprising:

a filter assembly obtained by the filter determining method of the color sensing device according to any one of claims 1 to 7, wherein the filter assembly is used for encoding incident light into imaging information, the imaging information comprises a light intensity value of the incident light, the filter assembly comprises a plurality of different kinds of filter plates, and different filter plates can encode the incident light to obtain imaging information.

9. The apparatus of claim 8, wherein the apparatus further comprises:

10. The apparatus of claim 9, wherein the detection assembly comprises at least one of a complementary metal oxide semiconductor element, a charge coupled element, an ultraviolet detection element, an indium gallium arsenic near infrared detection element.

11. A detection system, the detection system comprising:

a colour sensing device according to any one of claims 8 to 10;

the light source is used for emitting detection light;

12. The system of claim 11, wherein the data processing component is further configured to:

13. The system of claim 11, wherein the color reaction component comprises a reflective component, a transmissive component, and a fluorescent component, wherein the incident light is any one of reflected light generated by the reflective component according to the probe light, transmitted light generated by the probe light penetrating the transmissive component, and fluorescent light generated by the fluorescent component irradiated by the incident light.

14. The system of claim 11, wherein the filter assembly in the color sensing device is capable of encoding 380nm-750nm incident light.

15. A urine detection system comprising the colour sensor of any one of claims 8 to 10 or the detection system of any one of claims 11 to 14.