CN111866318A

CN111866318A - Multispectral imaging method, multispectral imaging device, mobile terminal and storage medium

Info

Publication number: CN111866318A
Application number: CN201910354875.4A
Authority: CN
Inventors: 黄浩; 吴义涵
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2019-04-29
Filing date: 2019-04-29
Publication date: 2020-10-30

Abstract

The present disclosure provides a multispectral imaging method, a multispectral imaging device, a mobile terminal, and a storage medium. The multispectral imaging method comprises the following steps: the method comprises the steps of obtaining a spectral image group of an object to be shot through a plurality of narrow-band single-channel imaging devices arranged on the mobile terminal, obtaining a spectral curve according to the spectral image group, wherein the spectral image group comprises spectral images of the object to be shot, the spectral images are obtained by each narrow-band single-channel imaging device, the spectral curve is used for reflecting the spectral reflectance of the object to be shot, the image data after color synthesis is obtained according to the spectral curve and a color conversion standard, and the image data is coded and output, so that the high standard restoration of the color of the object to be shot is realized, the chromatic aberration is reduced, the imaging quality is improved, and the user satisfaction is improved.

Description

Multispectral imaging method, multispectral imaging device, mobile terminal and storage medium

Technical Field

The present disclosure relates to the field of imaging of intelligent terminals, and in particular, to a multispectral imaging method, a multispectral imaging apparatus, a mobile terminal, and a storage medium.

Background

With the rapid development of diversification of mobile terminals, users increasingly use mobile terminals such as mobile phones, tablets and wearable devices to take pictures in life and work, and therefore, higher and higher requirements are provided for the imaging capability and imaging quality of an imaging system provided by the mobile terminal, including the accuracy of image color reproduction and the like.

In the prior art, a mobile terminal generally adopts a three-primary-color camera, and with the continuous development of mobile phone imaging, a user and an image evaluation mechanism have higher requirements on the color fidelity of an image, and the existing three-primary-color camera cannot restore the colors in a shot scene to a higher standard due to the influence of factors such as metamerism and the like, so that chromatic aberration is caused, the imaging quality is influenced to a great extent, and the higher requirements of the user on the imaging effect of the mobile terminal cannot be met.

Disclosure of Invention

To overcome the problems in the related art, the present disclosure provides a multispectral imaging method, a multispectral imaging device, a mobile terminal, and a storage medium.

According to a first aspect of the embodiments of the present disclosure, there is provided a multispectral imaging method applied to a mobile terminal, including:

Acquiring a spectral image group of an object to be shot through a plurality of narrow-band single-channel imaging devices arranged on the mobile terminal, wherein the spectral image group comprises spectral images of the object to be shot acquired by each narrow-band single-channel imaging device;

acquiring a spectrum curve according to the spectrum image group, wherein the spectrum curve is used for reflecting the spectrum reflectance of the object to be shot;

acquiring image data after color synthesis according to the spectral curve and the color conversion standard;

and encoding and outputting the image data.

In the scheme provided by the embodiment of the disclosure, a plurality of spectral images of an object to be shot are acquired through a plurality of narrow-band single-channel imaging devices arranged on a mobile terminal to form a spectral image group, a spectral curve is acquired according to the spectral image group, image data after color synthesis is obtained through conversion according to the spectral curve and a color conversion standard, and the image data is encoded and output, so that high-standard restoration of the shot object is realized, and imaging quality is improved.

In a specific implementation manner, the acquiring a spectral curve according to the spectral image group includes:

converting the spectrum image in the spectrum image group into spectrum data;

And calculating to obtain the spectrum curve by adopting an interpolation algorithm according to the spectrum data and the channel interpolation.

In the scheme provided by the embodiment of the disclosure, the spectral images in the spectral image group are converted into spectral data, and the spectral curve is calculated by adopting an interpolation algorithm according to the spectral data and the channel interpolation, so that the spectral data acquired by each narrow-band single-channel device is integrated for subsequent color synthesis processing.

Optionally, the interpolation algorithm includes: lagrange interpolation algorithm, newton interpolation algorithm, spline interpolation algorithm, hermitian interpolation algorithm.

In a specific implementation manner, the acquiring the image data after color synthesis according to the spectral curve and the color conversion standard includes:

obtaining process image data according to the spectral curve and the color standard of an XYZ chromaticity space;

and obtaining the image data after color synthesis according to the process image data and the color standard of the RGB color space.

In the scheme provided by the embodiment of the disclosure, the acquired spectral curve is subjected to color conversion according to the color conversion standard of the XYZ chromaticity space to obtain process image data, and the obtained process image data is subjected to color conversion according to the color conversion standard of the RGB color space to obtain image data after color synthesis, thereby realizing color synthesis of a plurality of spectral images.

Further, before the encoding and outputting the image data, the method further comprises:

performing image processing operations on the image data, the image processing operations comprising: at least one of noise reduction and contrast enhancement.

Preferably, the number of the narrow-band single-channel imaging devices is eight, and correspondingly, the spectral image group comprises eight spectral images.

According to a second aspect of embodiments of the present disclosure, there is provided a multispectral imaging device comprising:

the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a spectral image group of an object to be shot through a plurality of narrow-band single-channel imaging devices arranged on a mobile terminal, and the spectral image group comprises spectral images of the object to be shot acquired by each narrow-band single-channel imaging device;

the second acquisition module is used for acquiring a spectral curve according to the spectral image group, wherein the spectral curve is used for reflecting the spectral reflectance of the object to be shot;

the third acquisition module is used for acquiring image data after color synthesis according to the spectral curve and the color conversion standard;

and the output module is used for coding and outputting the image data.

In a specific implementation manner, the second obtaining module includes:

The first processing submodule is used for converting the spectral images in the spectral image group into spectral data;

and the second processing submodule is used for calculating to obtain the spectrum curve by adopting an interpolation algorithm according to the spectrum data and the channel interpolation.

In a specific implementation manner, the third obtaining module includes:

the third processing submodule is used for obtaining process image data according to the spectral curve and the color standard of an XYZ chromaticity space;

and the fourth processing submodule is used for obtaining the image data after color synthesis according to the process image data and the color standard of the RGB color space.

Further, the apparatus further comprises:

a processing module configured to perform image processing operations on the image data, the image processing operations including: at least one of noise reduction and contrast enhancement.

According to a third aspect of the embodiments of the present disclosure, there is provided a mobile terminal including: a housing, a plurality of narrow band single channel imaging devices, a processor, and a memory; the housing comprises a rear shell;

The memory and the processor are disposed inside the housing;

the plurality of narrowband single channel imaging devices are disposed on the back shell, each narrowband single channel imaging device comprising: the narrow-band filter is arranged on one side, facing the outside of the rear shell, of the optical lens;

the wavelengths of the filter plates in each narrow-band single-channel imaging device are different, so that spectral data with different wavelengths can be obtained.

Optionally, the arrangement of the plurality of narrow-band single-channel devices on the rear housing includes circular distribution, horizontal double-row distribution, or longitudinal double-row distribution.

Preferably, the number of narrow band single channel imaging devices is eight.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a mobile terminal including: a plurality of narrow band single channel imaging devices, a processor, and a memory;

the memory is used for storing programs and data;

the processor invokes the memory-stored program to perform the multispectral imaging method of any one of the first aspects.

According to a fifth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon a computer program for performing the method of multispectral imaging of any one of the first aspects when executed by a processor.

According to the multispectral imaging method, the multispectral imaging device, the mobile terminal and the storage medium, the plurality of spectral images of the object to be shot are obtained through the plurality of narrow-band single-channel imaging devices arranged on the mobile terminal, the spectral image group is formed, the spectral curve is obtained according to the spectral image group, the image data after color synthesis is obtained through conversion according to the spectral curve and the color conversion standard, the image data is coded and output, high-standard restoration of the shot object is achieved, and imaging quality is improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

Fig. 1a, 1b and 1c are schematic structural views of a mobile terminal shown according to an exemplary embodiment.

Fig. 2 is a flowchart illustrating a first embodiment of a method of multispectral imaging according to an exemplary embodiment.

Fig. 3 is a schematic flow diagram illustrating a second embodiment of a method of multispectral imaging, according to an exemplary embodiment.

Fig. 4 is a schematic flow diagram illustrating a third embodiment of a method of multispectral imaging, according to an exemplary embodiment.

Fig. 5 is a flowchart illustrating a fourth embodiment of a method of multispectral imaging according to an exemplary embodiment.

Fig. 6 is a schematic structural diagram illustrating a first embodiment of a multispectral imaging device according to an exemplary embodiment.

Fig. 7 is a schematic structural diagram of a second embodiment of the multispectral imaging device according to an exemplary embodiment.

Fig. 8 is a schematic structural diagram of a third embodiment of the multispectral imaging device according to an exemplary embodiment.

Fig. 9 is a schematic structural diagram illustrating a fourth embodiment of the multispectral imaging device according to an exemplary embodiment.

Fig. 10 is a block diagram illustrating a mobile terminal entity according to an example embodiment.

Fig. 11 is a block diagram illustrating a mobile terminal 1200 according to an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.

With the continuous development of mobile phone imaging, users and image evaluation mechanisms put forward higher requirements on the color fidelity of images, the existing three-primary-color cameras cannot restore the colors in the shot scene to a higher standard due to the influence of factors such as metamerism, and the like, so that chromatic aberration is caused, if the original spectrum in the shooting environment can be captured through a multispectral imaging system, and then color restoration is carried out, the accuracy of color restoration can be greatly improved, and the occurrence of metamerism of the colors is effectively avoided.

With the increasing number of mobile phone cameras, the simultaneous image acquisition and processing of a plurality of cameras becomes the mainstream of mobile phone imaging at present, and a possibility is provided for loading a multispectral imaging system on a mobile phone.

Fig. 1a, 1b and 1c are schematic structural views of a mobile terminal shown according to an exemplary embodiment. As shown in fig. 1, the mobile terminal 10 includes: a housing 11, a plurality of narrow band single channel imaging devices 12, a processor and memory (not shown), and a flash 13.

Wherein the housing 11 comprises a back shell, optionally the housing 11 further comprises a bezel and/or a front shell, the memory and the processor being arranged inside the housing.

A plurality of narrowband single channel imaging devices are disposed on the backshell, and each narrowband single channel imaging device includes: the narrow-band filter is arranged on one side, facing the outside of the rear shell, of the optical lens, the wavelengths of the filter plates arranged in the narrow-band single-channel imaging devices are different, and the wavelength and the bandwidth of each filter plate can be selected through optimization algorithms based on binary differential evolution algorithm and the like. In practical application, the more the optical filters and the eigenvectors are, the better the spectrum reconstruction effect is, and for the selection of the number of the optical filters in the mobile terminal, the preferred scheme provided by the scheme is eight, that is, the number of the narrow-band single-channel imaging devices is eight.

As shown in fig. 1a, 1b and 1c, the arrangement of the plurality of narrow-band single-channel imaging devices on the rear housing includes circular distribution, horizontal double-row distribution or vertical double-row distribution, and the flash 13 may be disposed at the center of the plurality of narrow-band single-channel imaging devices or at a position close to one side of the plurality of narrow-band single-channel imaging devices.

The mobile terminal provided by the embodiment comprises: the device comprises a shell, a plurality of narrow-band single-channel imaging devices, a processor and a memory, wherein each narrow-band single-channel imaging device comprises a narrow-band filter, an optical lens and a sensor, a plurality of spectral images of an object to be shot are acquired through the narrow-band single-channel imaging devices arranged on the shell, the processor arranged in the shell calls a computer program stored in the memory, the spectral images are processed to obtain image data after color synthesis, and high-standard reduction of the shot object is realized.

On the basis of the above-mentioned mobile terminal embodiments, a multispectral imaging method applied to the mobile terminal is described below through several embodiments.

Fig. 2 is a flowchart illustrating a first embodiment of a method of multispectral imaging according to an exemplary embodiment. As shown in fig. 2, the multispectral imaging method includes:

s101: the method comprises the steps of obtaining a spectral image group of an object to be shot through a plurality of narrow-band single-channel imaging devices arranged on a mobile terminal.

In the step, the spectral image of the corresponding object to be photographed is acquired according to the wavelength and the bandwidth of the optical filter arranged in each narrow-band single-channel imaging device, and each spectral image acquired by each narrow-band single-channel imaging device forms a spectral image group. Namely, the spectral image group comprises spectral images of the object to be shot acquired by each narrow-band single-channel imaging device.

In a specific implementation manner, the spectral images acquired by the sensors in each narrow-band single-channel imaging device have a certain degree of relative translation, distortion in different proportions, and the like, and the multiple spectral images can be registered by a point mapping method, a bolete model, a wavelet transformation method, or the like, so as to obtain a registered spectral image group, so as to facilitate subsequent spectral analysis and color synthesis.

S102: and acquiring a spectral curve according to the spectral image group.

According to the spectrum images in the spectrum image group, namely according to the channel response value, an initial spectrum curve can be obtained, the initial spectrum curve is a section of broken line, and the initial spectrum curve is calculated through an interpolation algorithm to obtain a smooth continuous spectrum curve. The spectral curve is used for reflecting the spectral reflectance of the object to be shot.

S103: and acquiring image data after color synthesis according to the spectral curve and the color conversion standard.

In this step, the color is converted into XYZ chromaticity space according to the acquired spectral curve and the color standard of the international commission on illumination (CIE) de L' Eclairage, and is converted into RGB color space according to each color standard, and image data after color synthesis is obtained.

S104: and encoding and outputting the image data.

The image data is encoded and output, and the output image data can be stored in a memory, or sent to a display device for display, or sent to other equipment for use, which is not required by the scheme.

In the multispectral imaging method provided by this embodiment, a plurality of narrow-band single-channel imaging devices arranged on a mobile terminal are used to acquire a spectral image group of an object to be photographed, a spectral curve is acquired according to the spectral image group, image data after color synthesis is acquired according to the spectral curve and a color conversion standard, the image data is encoded and output, corresponding spectral images are acquired by the narrow-band single-channel imaging devices, and the spectral images are subjected to color synthesis to obtain final image data.

On the basis of the above embodiments, fig. 3 is a flowchart illustrating a second embodiment of the multispectral imaging method according to an exemplary embodiment. As shown in fig. 3, acquiring a spectral curve from a spectral image in the set of spectral images includes:

S201: and converting the spectral images in the spectral image group into spectral data.

The spectral image is converted into spectral data by a sensor in a narrow-band single-channel imaging device, wherein the sensor arranged in the narrow-band single-channel imaging device can be a monochromatic sensor, and can be a CCD sensor or a CMOS sensor.

S202: and calculating to obtain a spectral curve by adopting an interpolation algorithm according to the spectral data and the channel interpolation.

Obtaining an initial spectrum curve according to the spectrum data, wherein the initial spectrum curve is a section of broken line, the initial spectrum curve cannot reflect the real spectrum reflection characteristic of the object to be shot, in order to facilitate spectrum analysis and color synthesis, an interpolation algorithm can be adopted and a proper channel is selected for interpolation, interpolation calculation is carried out on the spectrum data to obtain a section of smooth curve, and the optional interpolation algorithm comprises the following steps: the method comprises the steps of determining a specific interpolation algorithm and channel interpolation according to band selection and bandwidth among spectral channels in practical application by adopting a Lagrange interpolation algorithm, a Newton interpolation algorithm, a spline interpolation algorithm and an Hermite interpolation algorithm.

It should be understood that this embodiment further includes steps S101, S103, and S104 in the embodiment shown in fig. 2, and the specific implementation manner thereof is the same, and is not described herein again.

According to the multispectral imaging method provided by the embodiment, the spectral images in the spectral image group are converted into spectral data, an interpolation algorithm is adopted to calculate to obtain a spectral curve according to the spectral data and channel interpolation, and a smooth spectral curve capable of reflecting the real spectral reflection characteristics of the object to be shot is obtained by performing interpolation calculation on the initial spectral curve, so that the multispectral imaging method plays an important role in the color accuracy of the imaging effect.

Fig. 4 is a schematic flow diagram illustrating a third embodiment of a method of multispectral imaging, according to an exemplary embodiment. As shown in fig. 4, acquiring the image data after color synthesis according to the spectral curve and the color conversion standard includes the following steps:

s301: and obtaining process image data according to the spectral curve and the color standard of the XYZ chromaticity space.

Converting the color into an XYZ chromaticity space according to the obtained spectral curve and the CIE color standard to obtain process image data, where the process image data includes color coordinates converted into the XYZ chromaticity space, and the process image data may be specifically implemented by the following formula:

where k is a normalization coefficient for limiting the maximum value of Y to 100,

is an expression for the spectral curve of a light,

The color standard for the XYZ chromaticity space specified by the CIE.

The normalization coefficient k can be obtained through experiments, specifically:

where S (λ) is the relative spectral power distribution of the illumination source.

In practical application, when the object to be photographed is a self-luminous body,

the spectral curve represented is the relative spectral power distribution of the radiation of the luminescent object, i.e.

When the object to be shot is a non-self-luminous body, the color stimulation function of the transparent body or the opaque body is as follows:

wherein τ (λ), β (λ), ρ (λ) are the spectral transmittance of the object to be photographed, the spectral radiance factor of the object to be photographed, and the spectral reflectance of the object to be photographed, respectively; s (λ) is the relative spectral power distribution of the illumination source.

S302: and obtaining image data after color synthesis according to the process image data and the color standard of the RGB color space.

And performing data conversion according to the process image data and the color standard of the RGB color space specified by the CIE to obtain image data after color synthesis, namely completing color synthesis.

It should be understood that this embodiment further includes steps S101, S102, and S104 in the embodiment shown in fig. 2, and the specific implementation manner thereof is the same, and is not described herein again.

In this embodiment, the color data is converted into an XYZ chromaticity space according to the spectral curve, and then converted into an RGB color space according to the color definition, so that color synthesis of a plurality of monochromatic spectral images is realized, and accurate reduction of the color of the object to be photographed is realized.

In a specific implementation manner, the image processing operation needs to be performed on the image data after color synthesis, which specifically includes: at least one of Image Signal Processing (ISP) operations such as noise reduction, contrast enhancement, and restoration.

On the basis of the above embodiments, fig. 5 is a flowchart illustrating a fourth embodiment of the multispectral imaging method according to an exemplary embodiment. As shown in fig. 5, taking the number of the narrow-band single-channel imaging devices as eight as an example, the multispectral imaging method provided by the present scheme includes the following specific steps:

the eight optical lenses provided with the optical filters with different wavelengths simultaneously acquire images of an object to be shot, acquired spectral images can be stored in a register file system of the mobile phone within a short time, and data output through the sensors are subjected to registration, spectral analysis, color synthesis and ISP operation and then are output. The spectral analysis process is a process for acquiring a smooth spectral curve and comprises interpolation calculation according to channel interpolation; the color synthesis process is a process of converting colors into XYZ chromaticity space according to a spectral curve and further converting the colors into RGB color space; the ISP operation specifically includes at least one of noise reduction, contrast enhancement, restoration, and the like.

Fig. 6 is a schematic structural diagram illustrating a first embodiment of the multispectral imaging device 100, as shown in fig. 6, according to an exemplary embodiment, comprising:

the first acquisition module 101: the system comprises a mobile terminal and a plurality of narrow-band single-channel imaging devices, wherein the mobile terminal is used for acquiring a spectral image group of an object to be shot through the narrow-band single-channel imaging devices arranged on the mobile terminal, and the spectral image group comprises a spectral image of the object to be shot acquired by each narrow-band single-channel imaging device;

the second obtaining module 102: the spectral curve is used for reflecting the spectral reflectance of the object to be shot;

the third obtaining module 103: the system is used for acquiring image data after color synthesis according to the spectral curve and the color conversion standard;

the output module 104: used for encoding and outputting the image data.

The multispectral imaging device provided by the embodiment of the disclosure comprises a first acquisition module, a second acquisition module, a third acquisition module and an output module, wherein a plurality of narrow-band single-channel imaging devices arranged on a mobile terminal are used for acquiring a spectral image group of an object to be shot, a spectral curve is acquired according to the spectral image group, image data after color synthesis is acquired according to the spectral curve and a color conversion standard, the image data is encoded and output, corresponding spectral images are acquired through the narrow-band single-channel imaging devices, the spectral images are subjected to color synthesis to obtain final image data, the high standard of the color of the shot object is restored, the color difference is reduced, the imaging quality is improved, and the user satisfaction is improved.

Based on the embodiment shown in fig. 6, fig. 7 is a schematic structural diagram of a second embodiment of the multispectral imaging device according to an exemplary embodiment, and as shown in fig. 7, the second obtaining module 102 includes:

the first processing sub-module 1021: the system is used for converting the spectral images in the spectral image group into spectral data;

the second processing sub-module 1022: and the spectrum curve is obtained by adopting an interpolation algorithm according to the spectrum data and the channel interpolation.

In the present embodiment, the multispectral imaging device further includes a first acquiring module 101, a third acquiring module 103 and an output module 104 as shown in fig. 6.

In a specific implementation, the interpolation algorithm includes: lagrange interpolation algorithm, newton interpolation algorithm, spline interpolation algorithm, hermitian interpolation algorithm.

Based on the embodiments shown in fig. 6 and fig. 7, fig. 8 is a schematic structural diagram of a third embodiment of the multispectral imaging device according to an exemplary embodiment, and as shown in fig. 8, the third acquiring module 103 includes:

third processing sub-module 1031: the color standard of XYZ chromaticity space is used for obtaining process image data according to the spectral curve;

Fourth processing submodule 1032: and the image data after color synthesis is obtained according to the process image data and the color standard of the RGB color space.

In the present embodiment, the multispectral imaging device further includes a first acquisition module 101, a second acquisition module 102, and an output module 104 as shown in fig. 6, and a first processing sub-module 1021 and a second processing sub-module 1022 as shown in fig. 7.

Fig. 9 is a schematic structural diagram illustrating a fourth embodiment of the multispectral imaging device according to an exemplary embodiment, where, as shown in fig. 9, the multispectral imaging device 100 further includes:

the processing module 105: for performing image processing operations on the image data, the image processing operations comprising: at least one of noise reduction and contrast enhancement.

In one specific implementation, the number of narrow-band single-channel imaging devices is eight, and accordingly, the spectral image group includes eight spectral images.

With respect to the multispectral imaging device in the above embodiments, the specific manner in which the modules perform the operations has been described in detail in the embodiments of the method, and will not be described in detail here.

Fig. 10 is a block diagram illustrating a mobile terminal entity according to an example embodiment. Referring to fig. 10, a mobile terminal 60 provided in an embodiment of the present disclosure includes: a plurality of narrowband single channel imaging devices 601, a processor 602, and a memory 603.

Wherein the content of the first and second substances,

a memory 603 for storing computer-executable instructions;

a processor 602 for executing the computer executable instructions stored in the memory to implement the steps performed by the multispectral imaging device in the above embodiments. Reference may be made in particular to the description relating to the method embodiments described above.

Alternatively, the memory 603 may be separate or integrated with the processor 602.

When the memory 603 is separately provided, the intelligent switch further comprises a bus 604 for connecting the memory 603 and the processor 602.

In the above embodiments of the mobile terminal, it should be understood that the Processor may be a Central Processing Unit (CPU), other general-purpose processors, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. The general-purpose processor may be a microprocessor or a processor, or any conventional processor, and the aforementioned memory may be a read-only memory (ROM), a Random Access Memory (RAM), a flash memory, a hard disk, or a solid state disk. The steps of a method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor.

The present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the technical solution of any of the foregoing methods for providing power adjustment.

Referring to fig. 11, fig. 11 is a block diagram illustrating a mobile terminal 1200 according to an example embodiment. For example, the mobile terminal may be a mobile phone, a tablet, a computer, a notebook, a smart wearable, and the like.

Referring to fig. 11, mobile terminal 1200 may include one or more of the following components: processing component 1202, memory 1204, power component 1206, multimedia component 1208, audio component 1210, input/output (I/O) interface 1212, sensor component 1214, and communications component 1216.

The processing component 1202 generally controls overall operations of the smart device 1200, such as operations associated with display, data communication, multimedia operations, and recording operations. The processing components 1202 may include one or more processors 1220 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 1202 can include one or more modules that facilitate interaction between the processing component 1202 and other components. For example, the processing component 1202 can include a multimedia module to facilitate interaction between the multimedia component 1208 and the processing component 1202.

The memory 1204 is configured to store various types of data to support operation of the mobile terminal 1200. Examples of such data include instructions for any application or method operating on mobile terminal 1200, various types of data, messages, pictures, videos, and so forth. The memory 1204 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Power supply components 1206 provide power to the various components of mobile terminal 1200. Power components 1206 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for mobile terminal 1200.

The multimedia component 1208 includes a screen that provides an output interface between the mobile terminal 1200 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

Audio component 1210 is configured to output and/or input audio signals. For example, the audio component 1210 includes a Microphone (MIC) configured to receive external audio signals when the mobile terminal 1200 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 1204 or transmitted via the communication component 1216. In some embodiments, audio assembly 1210 further includes a speaker for outputting audio signals.

The I/O interface 1212 provides an interface between the processing component 1202 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc.

The sensor assembly 1214 includes one or more sensors for providing various aspects of state assessment for the mobile terminal 1200. For example, sensor assembly 1214 may detect an open/closed state of mobile terminal 1200, the relative positioning of components, such as a display and keypad of mobile terminal 1200, sensor assembly 1214 may also detect a change in position of mobile terminal 1200 or a component of mobile terminal 1200, the presence or absence of user contact with mobile terminal 1200, orientation or acceleration/deceleration of mobile terminal 1200, and a change in temperature of mobile terminal 1200. The sensor assembly 1214 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 1214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1214 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

A communications component 1216 is configured to facilitate communications between mobile terminal 1200 and other devices, either wired or wireless. The mobile terminal 1200 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1216 receives the broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 1216 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the mobile terminal 1200 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components. A method for performing multi-spectral imaging, comprising:

and encoding and outputting the image data.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as memory 1204 comprising instructions, executable by processor 1220 of mobile terminal 1200 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims

1. A multispectral imaging method is applied to a mobile terminal and comprises the following steps:

and encoding and outputting the image data.

2. The method of claim 1, wherein said obtaining a spectral curve from said set of spectral images comprises:

converting the spectrum image in the spectrum image group into spectrum data;

3. The method of claim 2, wherein the interpolation algorithm comprises: lagrange interpolation algorithm, newton interpolation algorithm, spline interpolation algorithm, hermitian interpolation algorithm.

4. The method of claims 1 to 3, wherein the obtaining color synthesized image data according to the spectral curve and a color conversion standard comprises:

5. The method according to claim 4, wherein before said encoding and outputting the image data, further comprising:

6. The method of claim 1, wherein the number of narrow band single channel imaging devices is eight, and accordingly, the set of spectral images comprises eight spectral images.

7. A multispectral imaging device for a mobile terminal, comprising:

and the output module is used for coding and outputting the image data.

8. The apparatus of claim 7, wherein the second obtaining module comprises:

9. The apparatus of claim 8, wherein the interpolation algorithm comprises: lagrange interpolation algorithm, newton interpolation algorithm, spline interpolation algorithm, hermitian interpolation algorithm.

10. The apparatus of claims 7 to 9, wherein the third obtaining module comprises:

11. The apparatus of claim 7, further comprising:

12. The apparatus of claim 7 wherein the number of narrow band single channel imaging devices is eight, and correspondingly, the set of spectral images comprises eight spectral images.

13. A mobile terminal, comprising: a housing, a plurality of narrow band single channel imaging devices, a processor, and a memory; the housing comprises a rear shell;

the memory and the processor are disposed inside the housing;

14. The mobile terminal of claim 13, wherein the plurality of narrowband single channel devices are arranged on the rear housing in a manner comprising a circular distribution, a horizontal double row distribution, or a vertical double row distribution.

15. The mobile terminal of claim 13 or 14, wherein the number of narrowband single-channel imaging devices is eight.

16. A mobile terminal, comprising: a plurality of narrow band single channel imaging devices, a processor, and a memory;

the memory is used for storing programs and data;

the processor invokes the memory-stored program to perform the steps in the multispectral imaging method of any one of claims 1 to 6.

17. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which, when being executed by a processor, is adapted to carry out the steps of the multispectral imaging method according to any one of claims 1 to 6.