CN115147287B

CN115147287B - Spectrum recovery method and device of spectrum chip and electronic equipment

Info

Publication number: CN115147287B
Application number: CN202110351061.2A
Authority: CN
Inventors: 张鸿; 黄志雷; 王宇
Original assignee: Shanghai Yuguangcai Core Technology Co ltd
Current assignee: Shanghai Yuguangcai Core Technology Co ltd
Priority date: 2021-03-31
Filing date: 2021-03-31
Publication date: 2024-02-27
Anticipated expiration: 2041-03-31
Also published as: CN115147287A

Abstract

The application relates to a spectrum recovery method, a spectrum recovery device and electronic equipment of a spectrum chip. The spectrum recovery method of the spectrum chip comprises the following steps: determining a predetermined pixel point on the spectrum chip based on a predetermined condition; and performing spectrum recovery by using the preset pixel point on the spectrum chip. Thus, the spectrum recovery effect can be improved.

Description

Spectrum recovery method and device of spectrum chip and electronic equipment

Technical Field

The present disclosure relates to the field of spectrum restoration technologies, and in particular, to a spectrum restoration method of a spectrum chip, a spectrum restoration device, and an electronic device.

Background

The current spectral imaging technology is mainly realized based on a spectrometer and a mechanical scanning structure, and the trade-off between the precision control of mechanical scanning and the scanning step length required by the scheme can bring about the rise of cost and the reduction of time dimension resolution. Besides, the spectrometer realized by the optical filter and the light detection array can directly realize spectrum imaging through the array of the spectrometer because of the natural two-dimensional photosensitive structure advantages, and the scheme has irreplaceable advantages in cost, time resolution and integration level.

However, spectral imaging based on optical filters and light detection array spectrometer array implementation has several problems.

First, there is a certain requirement for uniformity of light intensity distribution. The scheme needs to restore the spectrum and meanwhile needs to ensure that the light intensity distribution in the spectrum pixels is as uniform as possible, but in practical application, the large change of the light intensity in space is difficult to avoid, and the avoidance needs to be carried out by a corresponding method.

Secondly, for spectral imaging application, a plurality of light modulation units form a spectrum pixel, so that the spectrum pixel has a spectrum measurement function, and as one spectrum pixel occupies a plurality of physical pixels (pixel points), the spatial resolution of an image is reduced, and the spatial resolution needs to be improved while the spectral resolution is ensured by a corresponding method.

Third, for spectral imaging applications, the light at the edges of the imaged object is changed and the signal-to-noise ratio is low. Resulting in poor spectral recovery at the edges.

Fourth, for different application scenarios, the requirements of spectral resolution and spatial resolution are different, and the requirements cannot be met by using a fixed wavelength sampling interval.

It is therefore desirable to provide an improved spectral recovery scheme for a spectral chip.

Disclosure of Invention

The present application has been made in order to solve the above technical problems. The embodiment of the application provides a spectrum recovery method, a spectrum recovery device and electronic equipment of a spectrum chip, which can carry out spectrum recovery by flexibly adjusting the number and the spatial distribution of physical pixel points corresponding to each spectrum pixel, thereby improving the spectrum recovery effect.

According to an aspect of the present application, there is provided a spectrum recovery method of a spectrum chip, including: determining a predetermined pixel point on the spectrum chip based on a predetermined condition; and performing spectrum recovery by using the preset pixel point on the spectrum chip.

In the spectrum recovery method of the spectrum chip, the determining of the predetermined pixel point on the spectrum chip comprises the following steps: a predetermined pixel point on the spectral chip is determined based on the luminance distribution and at least one of a spectral resolution requirement, a spatial resolution requirement.

In the above-mentioned spectrum restoration method of a spectrum chip, determining a predetermined pixel point on the spectrum chip based on at least one of a brightness distribution, a spectrum resolution requirement, and a spatial resolution requirement includes: acquiring image data output by an image sensor of the spectrum chip; performing edge detection on the image data; and determining a predetermined pixel point on the spectrum chip based on an edge detection result of the image data.

In the spectrum recovery method of the spectrum chip, performing edge detection on the image data includes: equalizing the image data; noise reduction is carried out on the equalized image data; and performing edge detection on the image data after noise reduction.

In the spectrum recovery method of the spectrum chip, the noise reduction of the equalized image data includes: and selecting a filter with a preset size according to the image resolution and/or the characteristic of a filter structure corresponding to the image sensor, and checking the equalized image data for filtering.

In the spectrum recovery method of the spectrum chip, performing edge detection on the image data after noise reduction includes: detecting an edge region in the noise-reduced image data by using an edge detection operator; and performing an expansion operation on the edge region.

In the above spectrum recovery method of a spectrum chip, determining a predetermined pixel point on the spectrum chip based on an edge detection result of the image data includes: based on the edge detection result of the image data, predetermined pixel points on the spectrum chip with light intensity consistency higher than a predetermined threshold value are determined, wherein the predetermined pixel points are a predetermined number of pixel points which are adjacent and communicated based on pixel center points.

In the above spectrum recovery method of a spectrum chip, determining a predetermined pixel point on the spectrum chip based on an edge detection result of the image data includes: based on the edge detection result of the image data, a plurality of groups of preset pixel points with different numbers on the spectrum chip are determined.

In the spectrum recovery method of the spectrum chip, the plurality of groups of predetermined pixel points with different numbers comprise 2×2,3×3, 5×5 and 10×10 physical pixel arrays.

In the spectrum recovery method of the spectrum chip, the predetermined pixel points are a plurality of physical pixels with a predetermined shape on the image sensor.

In the above-mentioned spectrum restoration method of a spectrum chip, determining a predetermined pixel point on the spectrum chip based on at least one of a brightness distribution, a spectrum resolution requirement, and a spatial resolution requirement includes: determining that the predetermined number of pixels is greater than a first predetermined number in response to the spectral resolution requirement being greater than a first predetermined threshold; and/or determining that less than a second predetermined number of the predetermined pixels in response to the spatial resolution requirement being greater than a second predetermined threshold.

In the above spectrum recovery method of a spectrum chip, performing spectrum recovery using the predetermined pixel point on the spectrum chip includes: and performing spectrum recovery by using the preset pixel points on the spectrum chip with a dynamically adjusted recovery step length.

In the above spectrum recovery method of a spectrum chip, performing spectrum recovery using the predetermined pixel point on the spectrum chip includes: and dynamically adjusting a wavelength sampling interval for spectrum recovery based on the application condition of the spectrum to be recovered.

In the above spectrum recovery method of a spectrum chip, determining a predetermined pixel point on the spectrum chip based on an edge detection result of the image data includes: the number of predetermined pixel points on the spectral chip is determined based on the wavelength sampling interval.

In the above-described spectrum recovery method of a spectrum chip, the spectrum chip is a spectrum chip for calculating light of a wavelength band of 350 to 1000 nm received by a spectrometer.

According to another aspect of the present application, there is provided a spectrum recovery apparatus of a spectrum chip, including: a pixel determining unit for determining a predetermined pixel point on the spectrum chip based on a predetermined condition; and a spectrum recovery unit, configured to perform spectrum recovery using the predetermined pixel point on the spectrum chip.

According to still another aspect of the present application, there is provided an electronic apparatus including: a processor; and a memory in which computer program instructions are stored which, when executed by the processor, cause the processor to perform a spectrum restoration method of a spectrum chip as described above.

According to a further aspect of the present application, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by a computing device, are operable to perform a spectrum recovery method of a spectrum chip as described above.

According to the spectrum recovery method, the spectrum recovery device and the electronic equipment of the spectrum chip, the number and the spatial distribution of the physical pixel points corresponding to each spectrum pixel can be flexibly adjusted according to the image data output by the image sensor, and therefore recovery errors caused by the non-uniformity of the spatial light intensity are reduced.

In addition, the spectrum recovery method, the spectrum recovery device and the electronic equipment of the spectrum chip can improve the spatial resolution of spectrum imaging by adjusting the number and the spatial distribution of the physical pixel points corresponding to each spectrum pixel.

In addition, the spectrum recovery method, the spectrum recovery device and the electronic equipment of the spectrum chip improve the edge signal-to-noise ratio of the spectrum image by carrying out edge detection on the image data, and can be favorably applied to edge detection and substance identification based on the spectrum image.

Drawings

Various other advantages and benefits of the present application will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. It is apparent that the drawings described below are only some embodiments of the present application and that other drawings may be obtained from these drawings by those of ordinary skill in the art without inventive effort. Also, like reference numerals are used to designate like parts throughout the figures.

FIG. 1 illustrates a flow chart of a method of spectrum restoration of a spectrum chip according to an embodiment of the present application;

FIG. 2 illustrates an exemplary configuration diagram of a computing spectroscopy apparatus according to embodiments of the present application;

FIG. 3 illustrates an example of selecting a pixel point for recovering a spectrum in a spectrum recovery method of a spectrum chip according to an embodiment of the present application;

FIG. 4 illustrates an example of a reconfigurable way in a spectral restoration method of a spectral chip according to an embodiment of the present application;

FIG. 5 illustrates a schematic diagram of the variation of images before and after image equalization in a spectral restoration method of a spectral chip according to an embodiment of the present application;

FIG. 6 illustrates a schematic diagram of an image after noise reduction processing in a spectral restoration method of a spectral chip according to an embodiment of the present application;

FIG. 7 illustrates edge detection results using a Canny edge detection algorithm in a spectral restoration method of a spectral chip according to an embodiment of the present application;

fig. 8 illustrates an example of selecting a pixel point for recovering a spectrum using edge information in a spectrum recovery method of a spectrum chip according to an embodiment of the present application;

fig. 9A to 9C illustrate examples of differently shaped pixel points for recovering a spectrum selected using edge information in the example shown in fig. 8;

FIG. 10 illustrates an example of spectrum restoration using a step size of 3 in a spectrum restoration method of a spectrum chip according to an embodiment of the present application;

FIG. 11 illustrates an example of spectrum restoration using a step size of 1 in a spectrum restoration method of a spectrum chip according to an embodiment of the present application;

FIG. 12 illustrates a block diagram of a spectral restoration device of a spectral chip according to an embodiment of the present application;

fig. 13 illustrates a block diagram of an electronic device according to an embodiment of the present application.

Detailed Description

Hereinafter, example embodiments according to the present application will be described in detail with reference to the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application and not all of the embodiments of the present application, and it should be understood that the present application is not limited by the example embodiments described herein.

Exemplary method

Fig. 1 illustrates a flowchart of a spectrum restoration method of a spectrum chip according to an embodiment of the present application.

As shown in fig. 1, the spectrum recovery method of the spectrum chip according to the embodiment of the application includes the following steps:

step S110, determining a preset pixel point on the spectrum chip based on a preset condition.

Here, the spectrum chip according to the embodiment of the present application is generally a spectrum chip applied to a calculation spectrum device. The calculating spectrometer device can be a spectrometer or a spectrum imaging device, taking a spectrometer as an example, and the most remarkable difference between the calculating spectrometer and the traditional spectrometer is the difference of filtering. In a conventional spectrometer, the filter used for wavelength selection is a bandpass filter. The higher the spectral resolution, the narrower and more filters of the passband must be used, which increases the volume and complexity of the overall system. Meanwhile, when the spectral response curve is narrowed, the luminous flux is decreased, resulting in a decrease in signal-to-noise ratio.

For a specific calculation spectrometer, each filter generally adopts a wide-spectrum filter, which makes the raw data detected by the calculation spectrometer system and the raw spectrum greatly different. However, by applying a computational reconstruction algorithm, the original spectrum can be restored by computation. Since broadband filters pass more light than narrowband filters, i.e. less energy is lost to the light, such computational spectrometers can detect spectra from darker scenes. Furthermore, according to the compressed sensing theory, the spectral curve of the filter can be appropriately designed to recover the sparse spectrum with high probability, and the number of filters is much smaller than the desired number of spectral channels (recovering higher-dimensional vectors from lower-dimensional vectors), which is certainly very advantageous for miniaturization. On the other hand, by using a greater number of filters, the regularization algorithm (obtaining a lower-dimensional vector after noise reduction from a higher-dimensional vector) can be used to reduce noise, which increases the signal-to-noise ratio and makes the overall system more robust.

In contrast, when designing a conventional spectrometer, a filter needs to be designed according to a required wavelength, so that light with a specific wavelength can be transmitted (generally, the design is designed to enhance the projection of incident light with the specific wavelength, but not the incident light with the specific wavelength band cannot be projected, the resonance condition can be controlled by changing the period and the diameter of structures such as a nano-disc, and the central wavelength of the incident light which can be enhanced by changing the structure, thereby realizing the filtering characteristic). That is, the conventional spectrometer needs to control the size and position accuracy of the light modulation structure with emphasis in the design process, and needs to improve the transmittance of a specific wavelength. Whereas for a computational spectrometer, light in a wide range of wavelength bands (e.g., 350nm to 1100nm, and even 900nm to 2500 nm) may be received.

Fig. 2 illustrates an exemplary configuration diagram of a computing spectroscopy apparatus according to an embodiment of the present application. As shown in fig. 2, in the optical spectrum calculating device according to the embodiment of the present application, the optical system is optional, which may be an optical system such as a lens assembly, a dodging assembly, or the like. The filtering structure is a broadband filtering structure in the frequency domain or the wavelength domain. The passband spectra of different wavelengths of the filter structure are not identical. The filter structure may be a structure or a material having a filter property such as a super surface, a photonic crystal, a nano-pillar, a multilayer film, a dye, a quantum dot, a MEMS (micro electro mechanical system), an FP etalon, a cavity layer, a waveguiding layer, a diffraction element, or the like. In the present embodiment, for example, the light filtering structure may be a light modulating layer in chinese patent CN201921223201.2,

With continued reference to fig. 2, the image sensor (i.e., photodetector array) may be a CMOS Image Sensor (CIS), CCD, array photodetector, etc., and the material may be a silicon detector, or a detector of InGaAs or other materials. In addition, the optional data processing unit may be a processing unit such as MCU, CPU, GPU, FPGA, NPU, ASIC, which may export data generated by the image sensor to the outside for processing.

In addition, the spectrum calculating device according to the embodiment of the application can also use a modulating unit and the like to form a filtering structure, and each point of the light detector array has different spectral responses. Furthermore, the schemes such as quantum dots, nanowires and the like can be directly adopted.

In the embodiment of the present application, the spectrum chip modulates the incident light by using the modulation unit of the light modulation layer to obtain a modulated spectrum; receiving the modulated spectrum with an image sensor and providing a difference to the modulated spectrumResponding; and reconstructing the differential response by using a signal processing circuit layer to obtain an original spectrum. The working principle is understood to be that the signal of the incident light is vector x= [ X ] ₁ ,X ₂ ,……X _N ] ^T The signal received by the sensing unit is a vector y= [ Y ] ₁ ,Y ₂ ,……Y _M ] ^T Where y=dx+w, where matrix D is determined by the light modulation layer, the matrix D is an mxn matrix, and vector W is noise. In general, in an actual product, the product needs to be calibrated first to obtain the matrix D, then the object to be measured is measured, and the known matrix D and the vector Y obtained by the sensing unit are used to obtain the spectrum signal X of the object to be measured. For example, matrix D may be expressed as:

in the field of spectrum chips, it is common to distinguish between physical pixels, structural units and spectral pixels. Here, the physical pixel refers to the smallest photosensitive element on the image sensor (detector array). The structural unit refers to that since the spectrum chip needs to filter light by adopting a light filtering structure on the image sensor, the minimum unit of the light filtering structure can be called as a structural unit, and one or more physical pixels can be covered under one structural unit. In the following description of the embodiment of the present application, one structural unit corresponds to one physical pixel as an example.

Therefore, it will be understood by those skilled in the art that in the embodiment of the present application, the predetermined pixel point is used for recovering the spectrum, and thus should correspond to the structural unit as described above, but in the case that physical pixels are in one-to-one correspondence with the structural unit, may also correspond to the physical pixels as described above.

Furthermore, a spectral pixel refers to the dynamic adjustment of physical pixels (preset pixels) that the data detected under several structural elements can be used to recover a set of spectral data, and these structural elements, or their coverage (correspondence) to recover the spectral pixel, are referred to as being reconfigurable.

In the embodiment of the present application, reconfigurable refers to dynamically adjusting preset pixels of each point according to specific requirements or predetermined conditions. In the embodiment of the present application, the specific and required or predetermined conditions may include: the need for spectral resolution, the brightness uniformity requirements that are extended to improve spectral recovery accuracy, and the need for a spectral pixel total brightness threshold.

That is, in the spectrum restoration method of the spectrum chip according to the embodiment of the present application, determining the predetermined pixel point on the spectrum chip includes: a predetermined pixel point on the spectral chip is determined based on the luminance distribution and at least one of a spectral resolution requirement, a spatial resolution requirement.

In particular, there may be a correlation between the spectral resolution requirement and the spatial resolution requirement, i.e. the higher the spectral resolution the lower the corresponding spatial resolution. In the embodiments of the present application, the spectral resolution requirement refers to the spectral accuracy that is desired to be obtained from the standpoint of the requirement, such as 10nm accuracy, or 1nm accuracy. The number of predetermined pixel points contained in each spectral pixel can be adjusted according to this accuracy requirement. In addition, as described above, this requirement and the spatial resolution requirement may be mutually influenced, and thus may also be extended to a spatial resolution requirement, i.e. reducing the spectral resolution is equivalent to increasing the spatial resolution, and vice versa.

That is, in the spectrum restoration method of the spectrum chip according to the embodiment of the application, determining the predetermined pixel point on the spectrum chip based on the brightness distribution and at least one of the spectrum resolution requirement and the spatial resolution requirement includes: determining that the predetermined number of pixels is greater than a first predetermined number in response to the spectral resolution requirement being greater than a first predetermined threshold; and/or determining that less than a second predetermined number of the predetermined pixels in response to the spatial resolution requirement being greater than a second predetermined threshold.

The brightness uniformity requirement means that for each spectrum pixel, when the brightness uniformity of the contained pixel point is relatively good, the spectrum recovery effect is relatively good; to meet this requirement, edge detection may be performed according to image information, and then a physical pixel group with better brightness uniformity of the communication may be selected to recover a spectral pixel, which will be described in further detail below with reference to specific embodiment one and embodiment two.

The total brightness threshold requirement of the spectrum pixel refers to that when the scene brightness is low, the spectrum pixel can be recovered by increasing the number of the preset pixel points so as to improve the spectrum accuracy of the corresponding spectrum pixel.

And step S120, performing spectrum recovery by using the preset pixel points on the spectrum chip.

That is, after a certain number of predetermined pixels are selected, spectrum recovery is performed using a spectrum recovery algorithm, which may be, for example, a compressed sensing algorithm. Here, the compressed sensing algorithm relies on a dictionary for projection features. A dictionary learning algorithm may be used to train a suitable dictionary for spectrum recovery using the spectra of materials commonly found in the known nature. By selecting a proper measuring base and dictionary, the high-precision spectrum data can be calculated by using only a small amount of light intensity data measured by the image sensor by using a compressed sensing algorithm.

Hereinafter, each specific embodiment of the spectrum restoration method of the spectrum chip according to the embodiment of the present application will be described in detail.

Example 1

As described above, the reconfigurability of the predetermined pixel point can be performed based on the luminance distribution, that is, the light intensity distribution. And, in performing the reconfigurability based on the luminance distribution, the luminance of each pixel in the image is first determined, and then a predetermined pixel point is determined based on the luminance of the pixel.

As described above, in the embodiment of the present application, one physical pixel may correspond to one group of structural units, but a plurality of physical pixels may also be one group corresponding to one group of structural units. Thus, unlike physical pixels, in the spectrum restoration method of the spectrum chip according to the embodiment of the present application, structural units corresponding to one or more groups are referred to as "spectrum pixels" to restore one group of spectrum information. Further, aspects of embodiments of the present application may use at least one spectral pixel to restore an image. Here, the predetermined pixel point as described above refers to a physical pixel of the image sensor corresponding to a set of structural units.

In addition, in the embodiment of the present application, on the basis that one physical pixel point corresponds to a group of structural units, how many physical pixel points are selected as a group of data to perform recovery of one spectrum pixel, and in other embodiments, how many structural units are selected as a group of data to perform recovery of one spectrum pixel may be implemented, that is, the value of the number of structural units affects the spatial resolution, the image signal-to-noise ratio, and the spectrum precision of the sensor. In the embodiment of the application, the number of the structural units can be dynamically adjusted according to the environmental conditions under different conditions by adopting a reconfigurable mode so as to obtain the optimal image effect.

For example, in the actual use process, the number of physical pixels of 2×2,3×3,5×5, 10×10, etc. scale may be used as a set of data to be processed as needed, so as to generate one spectrum pixel. It should be noted that, in this embodiment of the present application, a one-to-one relationship between a physical pixel and a structural unit is taken as an example, in practice, a plurality of physical pixels may also correspond to a group of structural units, and when a plurality of physical pixels corresponds to a group of structural units, it may be understood that the plurality of physical pixels are reconfigurable by the structural unit, that is, the plurality of physical pixels is determined by the structural unit, for example, 2×2 may be understood as that 4 structural units form a group of the plurality of physical pixels of a spectral pixel.

Fig. 3 illustrates an example of selecting a pixel point for recovering a spectrum in a spectrum recovery method of a spectrum chip according to an embodiment of the present application. As shown in fig. 6, which shows the use of a 5 x 5 square matrix for spectral recovery for a total of 25 pixels. Further, a specific number may be selected using a reconfigurable spectrum recovery algorithm, for example, 10×10 total of 100 pixels or 15×15 total of 225 pixels may be selected for spectrum recovery. The size of the pixel matrix for recovering the spectrum is dynamically adjusted according to the local light intensity change condition of the image, namely, under the condition of smaller light intensity, the size of the pixel matrix can be increased to obtain higher spectrum recovery precision, and conversely, the size of the pixel matrix can be optionally reduced. And the compressed sensing algorithm is used, so that the aim of dynamically adjusting the spectrum frequency resolution can be achieved by dynamically selecting the number of pixels used for recovering the spectrum and selecting a proper dictionary for compressed sensing recovery on the premise that the consistency of the spatial light intensity of the pixels is satisfied. For example, fig. 4 illustrates an example of a reconfigurable way in a spectrum restoration method of a spectrum chip according to an embodiment of the present application. As shown in fig. 4, the outermost layer region may be understood as recovering with 10×10 pixels as one spectrum pixel, the middle region may be understood as recovering with 5×5 pixels, and the innermost layer region recovers with 3×3 pixels, that is, in this embodiment, the pixels corresponding to the spectrum pixels are dynamically selected according to different application requirements.

Therefore, in the spectrum restoration method of the spectrum chip according to the embodiment of the application, determining the predetermined pixel point on the spectrum chip based on the luminance distribution includes: and dynamically adjusting the size of a pixel matrix formed by the preset pixel points based on the light intensity change condition of the local image acquired by the image sensor.

Example two

In the second embodiment, the luminance distribution of the pixel points on the spectrum chip can be further finely determined by performing edge detection on the image data output from the image sensor. That is, in order to determine a predetermined pixel point on the spectrum chip based on the luminance distribution, image data output from an image sensor of the spectrum chip is first acquired, then edge detection is performed on the image data, and the predetermined pixel point on the spectrum chip is determined based on the edge detection result of the image data.

Therefore, in the spectrum restoration method of the spectrum chip according to the embodiment of the application, determining the predetermined pixel point on the spectrum chip based on the brightness distribution and at least one of the spectrum resolution requirement and the spatial resolution requirement includes: acquiring image data output by an image sensor of the spectrum chip; performing edge detection on the image data; and determining a predetermined pixel point on the spectrum chip based on an edge detection result of the image data.

Next, each of the above steps will be specifically described.

First, image data output by an image sensor of the spectrum chip is acquired. That is, as described above, the image sensor of the spectrum chip acquires a differential response to the modulated spectrum after receiving the modulated spectrum, and processes the differential response into image data using the signal processing circuit layer.

And then, performing edge detection on the image data. Here, alternatively, the image data may be first preprocessed before edge detection is performed.

Specifically, in the spectrum recovery method of the spectrum chip according to the embodiment of the application, preprocessing the image data includes image equalization and image noise reduction. Because the optical filtering structure is added on the optical detector array, the image data output by the optical detector array contains noise caused by the optical filtering structure and is dark overall, and therefore, the image is optionally subjected to advanced equalization and noise reduction before further graphic processing.

The equalization algorithm can be global histogram equalization or local self-adaptive histogram equalization, and because the filtering structure makes the image dark on the whole, the global histogram equalization can be generally directly adopted for carrying out equalization processing on the image. Fig. 5 illustrates a schematic diagram of the change of images before and after image equalization in the spectrum restoration method of the spectrum chip according to the embodiment of the present application. As shown in fig. 5, the brightness of the image after the equalization processing is increased as a whole, the contrast is increased, and the details are highlighted.

And, after the image equalization, the image is noise reduced by adopting a specific filtering algorithm. For example, the equalized image is gaussian filtered, and a filter kernel of a suitable size, such as 5×5, 9×9, 11×11, etc., may be selected for filtering, depending on the resolution of the image and the characteristics of the optical filtering structure on the sensor. The image may also be median filtered taking into account characteristics of the filtering structure itself, such as periodicity, etc. Also, the size of the filter kernel may be selected according to the actual situation. Fig. 6 illustrates a schematic diagram of an image after noise reduction processing in a spectrum restoration method of a spectrum chip according to an embodiment of the present application. As shown in fig. 6, this is a result obtained by performing gaussian filtering using a 9×9 filter kernel and median filtering using a 5×5 filter kernel. Here, the purpose of filtering and noise reduction is to blur noise caused by the filtering structure on the image and reduce the influence on edge detection.

Therefore, in the spectrum restoration method of the spectrum chip according to the embodiment of the application, performing edge detection on the image data includes: equalizing the image data; noise reduction is carried out on the equalized image data; and performing edge detection on the image data after noise reduction.

After preprocessing the image, edge detection is performed, and an edge detection operator may be Sobel, laplacian, scharr, canny or the like, which is used for detecting an edge region in the image. Optionally, after edge detection, the edge may be subjected to an appropriate dilation operation to enlarge the area occupied by the edge. Fig. 5 illustrates edge detection results obtained using a Canny edge detection algorithm in a spectrum restoration method of a spectrum chip according to an embodiment of the present application.

Therefore, in the spectrum restoration method of the spectrum chip according to the embodiment of the application, performing edge detection on the image data after noise reduction includes: detecting an edge region in the noise-reduced image data by using an edge detection operator; and performing an expansion operation on the edge region.

As described above, when spectrum recovery is performed, since the spectrum recovery algorithm requires that the light intensity of the selected pixels (measured values) have a certain consistency, the accuracy of spectrum recovery is affected by the number of the selected pixels and the consistency of the light intensity, too many pixel points will result in a decrease in the uniformity of the light intensity, and too little pixel points will result in an excessively underdetermined amount of data required for recovery. The detected edges and the neighborhood thereof are the areas with larger image gradient, namely the areas with poor light intensity consistency, and should be avoided when the spectrum recovery is carried out at the selected points. For example, the following steps may be adopted in the point selection: first, a center point for recovering a spectral region is selected, and then, based on the center point, one or a combination of "connected", "nearest", "specific number" points may be selected to calculate a spectrum. Wherein "connected" means that the selected point forms a connected region in the image, the connectivity can be four-neighborhood connection or eight-neighborhood connection, and the selected point needs to avoid the edge region. "nearest neighbor" means that the average distance of the selected point from the center point is the smallest, and the distance may be the Euclidean distance. "a specific number" refers to selecting a specified number of points for spectral recovery, such as 25, 100, etc., the number of points selected affecting the accuracy and frequency resolution of the spectral recovery. To achieve higher computational efficiency, a greedy algorithm and breadth-first search algorithm may be employed to quickly select the desired number of points during the selection of points. The final purpose of the selection is to ensure consistency of the light intensity of the pixels used to restore the spectrum.

Therefore, in the spectrum restoration method of the spectrum chip according to the embodiment of the application, determining the predetermined pixel point on the spectrum chip based on the edge detection result of the image data includes: based on the edge detection result of the image data, predetermined pixel points on the spectrum chip with light intensity consistency higher than a predetermined threshold value are determined, wherein the predetermined pixel points are a predetermined number of pixel points which are adjacent and communicated based on pixel center points.

Also, in the spectrum restoration method of the spectrum chip according to the embodiment of the application, determining the predetermined pixel point on the spectrum chip based on the edge detection result of the image data includes: based on the edge detection result of the image data, a plurality of groups of preset pixel points with different numbers on the spectrum chip are determined.

In the spectrum recovery method of the spectrum chip, the plurality of groups of predetermined pixel points with different numbers comprise 3×3, 5×5 and 10×10 physical pixel arrays.

In addition, in the second embodiment, by preprocessing the image data of the spectrum chip, the edge of the light detector level sensitivity in the image data of the spectrum chip is judged, and the restoration filter set is dynamically adjusted on the edge portion. And (3) carrying out edge detection on the image by utilizing an edge detection operator, avoiding a region with larger pixel gradient in the image, and ensuring the consistency of the pixel light intensity for recovering the spectrum. When the pixel points are selected for spectrum recovery, the edge area in the image is avoided, and the nearest and communicated pixel points with a specific number are selected for spectrum recovery. The spectrum recovery reconfigurable algorithm has the significance that the positions of the pixel points used for recovering the spectrum can be dynamically selected, and the final purpose is to ensure the consistency of the light intensity of the selected pixel points, improve the accuracy of spectrum recovery and ensure that the spectrum is not distorted at the edge. Fig. 8 illustrates an example of selecting a pixel point for recovering a spectrum using edge information in a spectrum recovery method of a spectrum chip according to an embodiment of the present application. Fig. 9A to 9C illustrate examples of differently shaped pixel points for recovering a spectrum selected using edge information in the example shown in fig. 8.

Therefore, in the spectrum recovery method of the spectrum chip according to the embodiment of the application, the predetermined pixel points are a plurality of physical pixels with a predetermined shape on the image sensor.

Of course, it will be appreciated by those skilled in the art that the relationship between the first and second embodiments above is juxtaposed and that they may also be used in combination.

Example III

In the third embodiment, in the spectrum restoration method of the spectrum chip according to the embodiment of the present application, the purpose is for the spectrum restoration algorithm to obtain a spectrum image. The reconfigurability of the spectrum recovery algorithm is also that the step size in recovering the spectrum can be dynamically adjusted. For example, if the spectral recovery is performed using a 3×3 pixel matrix, and the step size at the time of recovery is also 3, the 9×9 pixel data can be finally recovered to obtain a spectral image with a spatial resolution of 3×3. Fig. 10 illustrates an example of spectrum restoration using a step size of 3 in a spectrum restoration method of a spectrum chip according to an embodiment of the present application.

To increase the spatial resolution of the spectral image, the step size in recovering the spectrum can be dynamically adjusted, for example to 1. In this case, if the 3×3 pixel matrix is used for spectrum restoration, the shift is performed with the step length of 1, then the spectrum restoration is performed with 3×3 pixels, and the 9×9 pixel data can be restored to obtain a spectral image with the spatial resolution of 7×7. The characteristic that the step length of the spectrum restoration algorithm is reconfigurable is used, the spatial resolution of the spectrum image can be dynamically adjusted and restored, and the effect of local amplification of the spectrum image can be achieved by improving the spatial resolution of the image local. Fig. 11 illustrates an example of spectrum restoration using a step size of 1 in a spectrum restoration method of a spectrum chip according to an embodiment of the present application.

Therefore, in the spectrum recovery method of the spectrum chip according to the embodiment of the application, performing spectrum recovery using the predetermined pixel point on the spectrum chip includes: and performing spectrum recovery by using the preset pixel points on the spectrum chip with a dynamically adjusted recovery step length.

Example IV

In the fourth embodiment, for the spectrum reconstruction algorithm, the reconstruction is also implemented on the recovered spectrum, and for different application scenarios, the wavelength sampling interval can be dynamically adjusted. For a scene with lower spectral resolution requirements, the wavelength sampling interval can be larger, for example, 5nm is the sampling interval, and the total of 450-750 nm is 61 wavelength sampling points, so that fewer units can be used for spectral reconstruction, for example, 10 units. For a scene with a high spectrum resolution requirement, the wavelength sampling interval can be smaller, for example, 0.5nm is the sampling interval, and the total of 450nm to 750nm is 301 wavelength sampling points, so that more units can be used for spectrum reconstruction, for example, 50 units. Therefore, the wavelength sampling interval can be dynamically adjusted according to the application scene, so that the balance of the spatial resolution and the spectral resolution is achieved at the same time. Specifically, it can be understood that the number of the vectors Y is adjusted according to the application scenario, and the number of the vectors Y is also increased when the spectrum resolution requirement is high.

Therefore, in the spectrum recovery method of the spectrum chip according to the embodiment of the application, performing spectrum recovery using the predetermined pixel point on the spectrum chip includes: and dynamically adjusting a wavelength sampling interval for spectrum recovery based on the application condition of the spectrum to be recovered.

And, in the spectrum restoration method of the spectrum chip, determining the predetermined pixel point on the spectrum chip based on the edge detection result of the image data includes: the number of predetermined pixel points on the spectral chip is determined based on the wavelength sampling interval.

That is, similar to the above, the determination of the number of predetermined pixels may be affected by two factors, namely, the uniformity of brightness, in general, the spectrum recovery is more accurate when the uniformity of brightness of the predetermined pixels is better, otherwise, the error is larger, which needs to be satisfied first, the above-mentioned edge detection is also for this purpose, the brightness needs to reach the threshold value in association with the above-mentioned edge detection, and the number of predetermined pixels can be adjusted to reach the threshold value when the brightness is generally lower; secondly, the spectral resolution is determined by the requirement, and in general, the higher the predetermined number of pixels, the higher the spectral resolution and the lower the spatial resolution, so that the spectral resolution (and the spatial resolution) can be adjusted by adjusting the number.

In summary, according to the spectrum recovery method of the spectrum chip in the embodiment of the application, by not fixing the structure selected for recovering the spectrum, effective identification and dynamic adjustment can be performed according to the information of the image imaged by the image sensor of the spectrum chip.

In this way, the spectrum recovery method of the spectrum chip according to the embodiment of the application can flexibly adjust the number and the spatial distribution of the physical pixel points corresponding to each spectrum pixel according to the image data output by the image sensor, so that recovery errors caused by the non-uniformity of the spatial light intensity are reduced.

In addition, according to the spectrum recovery method of the spectrum chip, the spatial resolution of spectrum imaging can be improved by adjusting the number and the spatial distribution of the physical pixel points corresponding to each spectrum pixel, and the effect is improved to the theoretical limit based on the optical filter and the optical detection array scheme.

Furthermore, the spectrum restoration method of the spectrum chip, which is provided by the embodiment of the application, improves the edge signal-to-noise ratio of the spectrum image by carrying out edge detection on the image data, and can be favorably applied to edge detection and substance identification based on the spectrum image.

Example five

As described above, the reconfigurability of the predetermined pixel point can be performed with a spectral resolution or a spatial resolution requirement.

For example, in the actual use process, the number of physical pixels with the scale of 2×2,3×3,5×5, 10×10, etc. may be adopted as a set of data to be processed according to the spectrum resolution or the spatial resolution, so as to generate one spectrum pixel. It should be noted that, in this embodiment of the present application, a one-to-one relationship between a physical pixel and a structural unit is taken as an example, in practice, a plurality of physical pixels may also correspond to a group of structural units, and when a plurality of physical pixels corresponds to a group of structural units, it may be understood that the plurality of physical pixels are reconfigurable by the structural unit, that is, the plurality of physical pixels is determined by the structural unit, for example, 2×2 may be understood as that 4 structural units form a group of the plurality of physical pixels of a spectral pixel.

Fig. 4 illustrates an example of a reconfigurable way in a spectrum restoration method of a spectrum chip according to an embodiment of the present application. As shown in fig. 4, which shows the use of a 5 x 5 square matrix, a total of 25 pixels for spectral recovery. And, with the reconfigurable spectrum recovery algorithm, a specific number can be selected, for example, 10×10 total 100 pixels can be selected for multispectral imaging or 15×15 total 225 pixels can be used for hyperspectral imaging according to the spectrum resolution requirement.

That is, in the present embodiment, the reconfigurability of the spectral pixels can be performed based on only the spectral resolution or the spatial resolution requirement, regardless of the brightness.

Exemplary apparatus

Fig. 12 illustrates a block diagram of a spectrum restoration device of a spectrum chip according to an embodiment of the present application.

As shown in fig. 12, a spectrum recovery apparatus 200 of a spectrum chip according to an embodiment of the present application includes: a pixel determining unit 210 for determining a predetermined pixel point on the spectrum chip based on a predetermined condition; and a spectrum recovery unit 220, configured to perform spectrum recovery using the predetermined pixel point on the spectrum chip.

In one example, in the spectrum recovery apparatus 200 of the above spectrum chip, the pixel determining unit 210 is configured to: a predetermined pixel point on the spectral chip is determined based on the luminance distribution and at least one of a spectral resolution requirement, a spatial resolution requirement.

In one example, in the spectrum recovery apparatus 200 of the above-mentioned spectrum chip, the determining unit 210 determines the predetermined pixel point on the spectrum chip based on the brightness distribution and at least one of the spectrum resolution requirement and the spatial resolution requirement includes: acquiring image data output by an image sensor of the spectrum chip; performing edge detection on the image data; and determining a predetermined pixel point on the spectrum chip based on an edge detection result of the image data.

In one example, in the spectrum recovery apparatus 200 of the above spectrum chip, the pixel determining unit 210 performs edge detection on the image data, including: equalizing the image data; noise reduction is carried out on the equalized image data; and performing edge detection on the image data after noise reduction.

In one example, in the spectrum recovery device 200 of the above spectrum chip, the pixel determining unit 210 performs noise reduction on the equalized image data, including: and selecting a filter with a preset size according to the image resolution and/or the characteristic of a filter structure corresponding to the image sensor, and checking the equalized image data for filtering.

In one example, in the spectrum recovery device 200 of the above spectrum chip, the pixel determining unit 210 performs edge detection on the image data after noise reduction, including: detecting an edge region in the noise-reduced image data by using an edge detection operator; and performing an expansion operation on the edge region.

In one example, in the spectrum recovery apparatus 200 of the above-described spectrum chip, the pixel determining unit 210 determines a predetermined pixel point on the spectrum chip based on an edge detection result of the image data, including: based on the edge detection result of the image data, predetermined pixel points on the spectrum chip with light intensity consistency higher than a predetermined threshold value are determined, wherein the predetermined pixel points are a predetermined number of pixel points which are adjacent and communicated based on pixel center points.

In one example, in the spectrum recovery apparatus 200 of the above-described spectrum chip, the pixel determining unit 210 determines a predetermined pixel point on the spectrum chip based on an edge detection result of the image data, including: based on the edge detection result of the image data, a plurality of groups of preset pixel points with different numbers on the spectrum chip are determined.

In one example, in the spectrum recovery apparatus 200 of the above-mentioned spectrum chip, the plurality of sets of predetermined pixel points having different numbers include 3×3, 5×5, 10×10 physical pixel arrays.

In one example, in the spectrum recovery device 200 of the spectrum chip, the predetermined pixel points are a plurality of physical pixels of a predetermined shape on the image sensor.

In one example, in the spectrum recovery apparatus 200 of the above-mentioned spectrum chip, the determining unit 210 determines the predetermined pixel point on the spectrum chip based on the brightness distribution and at least one of the spectrum resolution requirement and the spatial resolution requirement includes: determining that the predetermined number of pixels is greater than a first predetermined number in response to the spectral resolution requirement being greater than a first predetermined threshold; and/or determining that less than a second predetermined number of the predetermined pixels in response to the spatial resolution requirement being greater than a second predetermined threshold.

In one example, in the spectrum recovery apparatus 200 of the spectrum chip, the spectrum recovery unit 220 is configured to: and performing spectrum recovery by using the preset pixel points on the spectrum chip with a dynamically adjusted recovery step length.

In one example, in the spectrum recovery apparatus 200 of the spectrum chip, the spectrum recovery unit 220 is configured to: and dynamically adjusting a wavelength sampling interval for spectrum recovery based on the application condition of the spectrum to be recovered.

In one example, in the spectrum recovery apparatus 200 of the above spectrum chip, the pixel determining unit 210 is configured to: the number of predetermined pixel points on the spectral chip is determined based on the wavelength sampling interval.

In one example, in the spectrum recovery apparatus 200 of the above-mentioned spectrum chip, the spectrum chip is a spectrum chip for calculating light of a wavelength band of 350 to 1000 nm of a spectrometer

Here, it will be understood by those skilled in the art that the specific functions and operations of the respective units and modules in the spectrum restoration apparatus 200 of the above-described spectrum chip have been described in detail in the spectrum restoration method of the spectrum chip described above with reference to fig. 1 to 11, and thus, repetitive descriptions thereof will be omitted.

As described above, the spectrum restoration apparatus 200 of the spectrum chip according to the embodiment of the present application may be implemented in various terminal devices, such as a spectrometer, or a server disposed in the cloud. In one example, the spectrum restoration apparatus 200 of the spectrum chip according to the embodiment of the present application may be integrated into the terminal device as one software module and/or hardware module. For example, the spectrum restoration apparatus 200 of the spectrum chip may be a software module in the operating system of the terminal device, or may be an application program developed for the terminal device; of course, the spectrum recovering apparatus 200 of the spectrum chip may also be one of a plurality of hardware modules of the terminal device.

Alternatively, in another example, the spectrum recovering apparatus 200 of the spectrum chip and the terminal device may be separate devices, and the spectrum recovering apparatus 200 of the spectrum chip may be connected to the terminal device through a wired and/or wireless network and transmit the interactive information in a agreed data format.

Exemplary electronic device

Next, an electronic device according to an embodiment of the present application is described with reference to fig. 13.

As shown in fig. 13, the electronic device 10 includes one or more processors 11 and a memory 12.

The processor 11 may be a Central Processing Unit (CPU) or other form of processing unit having data processing and/or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.

Memory 12 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random Access Memory (RAM) and/or cache memory (cache), and the like. The non-volatile memory may include, for example, read Only Memory (ROM), hard disk, flash memory, and the like. One or more computer program instructions may be stored on the computer readable storage medium that can be executed by the processor 11 to implement the spectral restoration method and/or other desired functions of the spectral chip of the various embodiments of the present application described above. Various contents such as image data may also be stored in the computer-readable storage medium.

In one example, the electronic device 10 may further include: an input device 13 and an output device 14, which are interconnected by a bus system and/or other forms of connection mechanisms (not shown).

The input means 13 may be, for example, a keyboard, a mouse, etc.

The output device 14 can output various information such as a spectrum restoration result to the outside. The output device 14 may include, for example, a display, speakers, a printer, and a communication network and remote output devices connected thereto, etc.

Of course, only some of the components of the electronic device 10 that are relevant to the present application are shown in fig. 13 for simplicity, components such as buses, input/output interfaces, and the like being omitted. In addition, the electronic device 10 may include any other suitable components depending on the particular application.

Exemplary computer program product and computer readable storage Medium

In addition to the methods and apparatus described above, embodiments of the present application may also be a computer program product comprising computer program instructions which, when executed by a processor, cause the processor to perform the steps in a spectral recovery method of a spectral chip according to various embodiments of the present application described in the "exemplary methods" section of the present specification.

The computer program product may write program code for performing the operations of embodiments of the present application in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server.

Furthermore, embodiments of the present application may also be a computer-readable storage medium, having stored thereon computer program instructions, which when executed by a processor, cause the processor to perform the steps in a spectral restoration method according to a spectral chip of the various embodiments of the present application described in the above "exemplary method" section of the present specification.

The computer readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The basic principles of the present application have been described above in connection with specific embodiments, however, it should be noted that the advantages, benefits, effects, etc. mentioned in the present application are merely examples and not limiting, and these advantages, benefits, effects, etc. are not to be considered as necessarily possessed by the various embodiments of the present application. Furthermore, the specific details disclosed herein are for purposes of illustration and understanding only, and are not intended to be limiting, as the application is not intended to be limited to the details disclosed herein as such.

The block diagrams of the devices, apparatuses, devices, systems referred to in this application are only illustrative examples and are not intended to require or imply that the connections, arrangements, configurations must be made in the manner shown in the block diagrams. As will be appreciated by one of skill in the art, the devices, apparatuses, devices, systems may be connected, arranged, configured in any manner. Words such as "including," "comprising," "having," and the like are words of openness and mean "including but not limited to," and are used interchangeably therewith. The terms "or" and "as used herein refer to and are used interchangeably with the term" and/or "unless the context clearly indicates otherwise. The term "such as" as used herein refers to, and is used interchangeably with, the phrase "such as, but not limited to.

It is also noted that in the apparatus, devices and methods of the present application, the components or steps may be disassembled and/or assembled. Such decomposition and/or recombination should be considered as equivalent to the present application.

The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the application. Thus, the present application is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of the application to the form disclosed herein. Although a number of example aspects and embodiments have been discussed above, a person of ordinary skill in the art will recognize certain variations, modifications, alterations, additions, and subcombinations thereof.

Claims

1. A method for recovering a spectrum of a spectrum chip, comprising:

determining a predetermined pixel point on the spectrum chip based on a predetermined condition; and

Performing spectrum recovery by using the preset pixel points on the spectrum chip;

wherein determining the predetermined pixel point on the spectrum chip based on the predetermined condition comprises:

determining a predetermined pixel point on the spectral chip based on the brightness distribution and at least one of a spectral resolution requirement and a spatial resolution requirement, comprising:

acquiring image data output by an image sensor of the spectrum chip;

performing edge detection on the image data; and

and determining a preset pixel point on the spectrum chip based on the edge detection result of the image data.

2. The spectrum restoration method of a spectrum chip as claimed in claim 1, wherein performing edge detection on the image data comprises:

equalizing the image data;

noise reduction is carried out on the equalized image data; and

and carrying out edge detection on the image data after noise reduction.

3. The spectrum recovery method of a spectrum chip as claimed in claim 2, wherein noise reduction of the equalized image data comprises:

and selecting a filter with a preset size according to the image resolution and/or the characteristic of a filter structure corresponding to the image sensor, and checking the equalized image data for filtering.

4. The spectrum recovery method of a spectrum chip as claimed in claim 2, wherein performing edge detection on the image data after noise reduction comprises:

detecting an edge region in the noise-reduced image data by using an edge detection operator; and

and performing expansion operation on the edge area.

5. The spectrum recovery method of claim 1, wherein determining a predetermined pixel point on the spectrum chip based on an edge detection result of the image data comprises:

based on the edge detection result of the image data, predetermined pixel points on the spectrum chip with light intensity consistency higher than a predetermined threshold value are determined, wherein the predetermined pixel points are a predetermined number of pixel points which are adjacent and communicated based on pixel center points.

6. The spectrum recovery method of claim 5, wherein determining a predetermined pixel point on the spectrum chip based on an edge detection result of the image data comprises:

based on the edge detection result of the image data, a plurality of groups of preset pixel points with different numbers on the spectrum chip are determined.

7. The method of spectrum restoration of a spectrum chip as claimed in claim 6, wherein said plurality of sets of predetermined pixel points having different numbers includes a physical pixel array of 2 x 2,3 x 3, 5 x 5, 10 x 10.

8. The method of spectrum restoration of a spectrum chip as recited in claim 5, wherein said predetermined pixel points are a plurality of physical pixels of a predetermined shape on said image sensor.

9. The method of spectrum restoration of a spectrum chip as recited in claim 1, wherein determining predetermined pixel points on the spectrum chip based on a brightness distribution and at least one of a spectral resolution requirement and a spatial resolution requirement comprises:

determining that the predetermined number of pixels is greater than a first predetermined number in response to the spectral resolution requirement being greater than a first predetermined threshold; and/or

Determining that less than a second predetermined number of the predetermined pixel points is determined in response to the spatial resolution requirement being greater than a second predetermined threshold.

10. The spectrum recovery method of a spectrum chip as claimed in claim 1, wherein performing spectrum recovery using the predetermined pixel point on the spectrum chip comprises:

and performing spectrum recovery by using the preset pixel points on the spectrum chip with a dynamically adjusted recovery step length.

11. The spectrum recovery method of a spectrum chip as claimed in claim 1, wherein performing spectrum recovery using the predetermined pixel point on the spectrum chip comprises:

And dynamically adjusting a wavelength sampling interval for spectrum recovery based on the application condition of the spectrum to be recovered.

12. The spectrum recovery method of claim 11, wherein determining a predetermined pixel point on the spectrum chip based on an edge detection result of the image data comprises:

the number of predetermined pixel points on the spectral chip is determined based on the wavelength sampling interval.

13. The spectrum restoration method of a spectrum chip as recited in any one of claims 1 to 12, wherein said spectrum chip is a spectrum chip for calculating light of a wavelength band of 350 to 1000 nm of a spectrometer.

14. A spectrum recovery device of a spectrum chip, comprising:

a pixel determining unit for determining a predetermined pixel point on the spectrum chip based on a predetermined condition; and

the spectrum recovery unit is used for performing spectrum recovery by using the preset pixel points on the spectrum chip;

Acquiring image data output by an image sensor of the spectrum chip;

performing edge detection on the image data; the method comprises the steps of,

15. An electronic device, comprising:

a processor; and

a memory in which a computer program is stored which, when run by the processor, causes the processor to perform the spectrum restoration method of the spectrum chip as defined in any one of claims 1-13.

16. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program, which when executed by a computing device is operable to perform a method of spectral restoration of a spectral chip according to any of claims 1-13.