JP2005148018A - Portable communication terminal and spectral analysis system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a portable communication terminal that reduces the size and weight so as to enhance portable convenience, can serve as a spectroscope, even at a place where the commercial power supply is not available, such as at the outdoors, and moreover, can easily transmit measured results to others. <P>SOLUTION: Color images photographed by a camera part 17 deal with conversion into digital signals, and a spectrum is obtained by operation computing, based on the spectral characteristics of a color light filter of the camera part 17, the optical spectrum characteristics of the sensitivity of the camera part 17, and the RGB numerical values of the color images of the object. The spectrum of the object is reconstructed by correcting this spectrum, on the basis of the spectrum obtained, when a white section is photographed by the camera part 17. Moreover, the data of the obtained optical spectrum of the object is transmitted outside via a communications department 12. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a mobile communication terminal such as a so-called mobile phone having a spectroscopic function, and also relates to a spectroscopic analysis system constructed using such a mobile communication terminal.

  Conventionally, when specifying the material of a substance, determining the health condition based on the color of urine or skin, or determining the water quality by adding a reagent, the spectrum of these objects is measured or the measured spectrum Further, chromaticity is obtained based on the spectrum.

  The spectral spectra of these objects are measured by irradiating these objects with white light whose spectral spectrum is calibrated, and spectroscopically measuring the reflected light from the white light object. And the measurement of such a spectral spectrum is performed using a spectroscope.

  The spectroscope includes a light source that emits white light, an outward optical fiber that guides white light emitted from the light source to an object, a return optical fiber that guides reflected light of the white light from the object to the spectroscopic unit, and the return light. And a spectroscopic unit that divides the reflected light from the object guided by the fiber.

  In this spectroscope, the spectral reflectance of the target is calculated based on the spectral spectrum obtained by splitting the reflected light from the target, and the chromaticity of the target is obtained.

  By comparing the spectral reflectance or chromaticity with the spectral reflectance or chromaticity that has been measured and specified in advance and the relationship between the material, health condition, or water quality, the material of these substances can be identified. can do.

JP 2000-292259 A

  By the way, when using a spectroscope as described above, it is necessary to use a light source that emits white light with a spectral spectrum calibrated in advance. Therefore, when carrying this spectrometer, it is necessary to carry such a light source. A spectroscope including such a light source becomes quite large as an apparatus, which is inconvenient to carry.

  In addition, since such a light source consumes a large amount of power, it cannot be lit by a dry battery or the like, and an external power source such as a commercial power source must be used. Therefore, the spectrometer may not be used in places where it is difficult to use a commercial power source such as outdoors.

  Furthermore, when such a spectroscope measurement is performed outdoors or in a remote place, it is inconvenient to transmit the measurement result of the spectroscope to another person. That is, since the data of the measurement result by such a spectroscope becomes enormous as the amount of data, for example, a storage device such as a hard disk built in a personal computer device can be stored and taken back. Need to use. Therefore, in such a case, not only a spectroscope including a light source but also a personal computer device must be carried, which is extremely inconvenient.

  Therefore, the present invention has been proposed in view of the above-described circumstances, and is compact and lightweight, convenient for carrying, and can be used as a spectrometer even in places where commercial power sources such as outdoors cannot be used. In addition, it is intended to provide a portable communication terminal that can be used, and to easily transmit measurement results to others, and to provide a spectroscopic analysis system using such a portable communication terminal. is there.

  In order to solve the above-described problems, a mobile communication terminal according to the present invention includes a camera unit that performs color imaging of an object, and a digital image of a color image captured by the camera unit, and RGB values of the object in the color image. The spectrum is obtained by calculation based on the spectral characteristics of the color filter included in the camera unit and the spectral spectral characteristic of the sensitivity of the camera unit, and this spectrum is corrected with reference to the spectrum obtained when the white part is photographed by the camera unit. It is characterized by comprising a calculation unit for reconstructing the spectral spectrum of the object and a communication unit for transmitting the spectral spectrum data of the target obtained by the calculation unit to the outside.

  According to the present invention, in the above-described mobile communication terminal, a determination unit that determines the property of the object based on the spectral spectrum of the object obtained by the calculation unit is provided, and the communication unit displays the determination result in the determination unit. The data to be shown is transmitted to the outside.

  The spectral analysis system according to the present invention receives the spectral spectrum data of the object transmitted from the mobile communication terminal described above, and collates the received data with a database relating the spectral spectrum and the property of the substance. Thus, the property of the object is discriminated.

  In the mobile communication terminal according to the present invention, the arithmetic unit converts the color image captured by the camera unit into a digital signal, the RGB numerical value of the object in the color image, the spectral characteristics of the color filter provided in the camera unit, and the sensitivity of the camera unit The spectrum of the object is reconstructed by obtaining the spectrum by calculation based on the spectral spectrum characteristics of the image and correcting this spectrum with the spectrum obtained when the white part is photographed by the camera unit as a reference. It can be configured and used as a spectroscope even in places where commercial power cannot be used, such as outdoors.

  In this mobile communication terminal, the communication unit transmits the spectral data of the object obtained by the calculation unit to the outside, so that the measurement result can be easily transmitted to others.

  Further, in the mobile communication terminal according to the present invention, a determination unit for determining the property of the object based on the spectral spectrum of the object obtained by the calculation unit is provided, and the communication unit is data indicating the determination result in the determination unit Can be transmitted to the outside, the amount of data transmitted by the communication unit can be reduced.

  In the spectroscopic analysis system according to the present invention, the spectral spectrum data of the object transmitted from the mobile communication terminal described above is received, and the received data is collated with a database relating the spectral spectrum and the property of the substance. And since the property of a target object is discriminate | determined, even if it is a case where spectroscopic measurement is performed outdoors or in a remote place, the determination based on the result of this spectroscopic measurement can be performed immediately.

  Embodiments of the present invention will be described below with reference to the drawings.

[Configuration of mobile communication terminal]
As shown in FIG. 1, the mobile communication terminal according to the present invention is configured to have a first casing portion 1 and a second casing portion 2. Each of the first and second casing portions 1 and 2 is configured as a thin casing whose main surface portions are substantially the same rectangular shape, and in an initial state, the first and second casing portions 1 and 2 are overlapped with each other. Yes.

  The second casing 2 is supported at one end of the first casing 1 so that the one end can be rotated with respect to the first casing 1. As shown in FIG. 1, the first and second housing parts 1 and 2 are rotated with respect to the first housing part 1 so that the first housing part 1 and the second housing part 1 and 2 are rotated with respect to each other. It is made into the state opened substantially linearly via the support part.

  The first housing unit 1 incorporates a control unit that controls the operation of the mobile communication terminal, and includes an operation unit 3 on one main surface. The operation unit 3 includes a plurality of operation keys connected to the control unit. When the operation key constituting the operation unit 3 is pressed, a signal corresponding to the operated operation key is input to the control unit. Ten operation keys of the plurality of operation keys of the operation unit 3 are ten keys corresponding to numbers 0 to 9.

  A display screen portion 4 is provided on the main surface portion on the side facing the first housing portion 1 in the initial state of the second housing portion 2. The display screen unit 4 is configured by, for example, a liquid crystal display device, and is connected to a control unit in the first housing unit 1 and performs a predetermined display according to the control of the control unit.

  The first casing unit 1 is provided with a microphone unit (sending unit) 5 at the other end portion. A speaker unit (receiver unit) 6 is provided at the other end portion of the second housing unit 2. The microphone unit 5 and the speaker unit 6 are connected to a control unit, respectively, and serve as a transmission unit and a reception unit as a telephone.

  In addition, a camera unit 17 is built in either the first or second casing unit 1 or 2. The camera unit 17 includes an imaging lens and a solid-state imaging device (CCD) that captures an image formed by the imaging lens, and performs color imaging of an object.

  In this mobile communication terminal, the control unit 10 is connected to a control line 11 as shown in FIG. The control line 11 is connected to a communication circuit 12 serving as a communication unit, a display screen unit 4, an operation unit 3, an imaging control unit 13, a memory 14, and a calculation unit 15. Each block connected to the control line 11 is controlled and operated by the control unit 10.

  The communication circuit 12 performs wireless data communication with another communication terminal connected to the telephone line via the antenna 16. The imaging control unit 13 is connected to the camera unit 17, controls the camera unit 17, and receives imaging data output from the camera unit 17.

  The communication circuit 12, the display screen unit 4, the imaging control unit 13, and the memory 14 are connected to the data line 18. Further, the microphone unit 5 and the speaker unit 6 are connected to the data line 18. Each block connected to the data line 18 can exchange data with each other.

[Telephone function]
In this mobile communication terminal, the control unit 10 controls the communication circuit 12 in response to an input operation on the operation unit 3, and makes a call or responds to an incoming call. In addition, the control unit 10 causes the audio data input from the microphone unit 5 to be transmitted to the communication circuit 12 for transmission, and causes the audio data received by the communication circuit 12 to be output from the speaker unit 6.

[Mail function]
And in this portable communication terminal, the control part 10 controls the communication circuit 12 according to input operation with respect to the operation part 3, and performs transmission of a mail (character data), or reception of a mail. That is, in this mail mode, the character data input from the operation unit 3 is stored in the memory 14, sent to the communication circuit 12 and transmitted, and the character data received by the communication circuit 12 is stored in the memory 14. And displayed on the display screen unit 4.

  In executing this mail function, the image data and other data stored in the memory 14 can be attached together with the character data and transmitted by the communication circuit 12, and the character data is attached by the communication circuit 12. When the received image data and other data are received, these data are stored in the memory 14 and displayed on the display screen unit 4.

[Camera function]
In this mobile communication terminal, the control unit 10 controls the camera unit 17 via the image control unit 19 in response to an input operation on the operation unit 3, and the image data captured by the camera unit 17 is transferred to the memory 14. Are stored, read out of the stored image data, and displayed on the display screen unit 4.

(Spectral function)
This portable terminal device has a spectral function. That is, when executing this spectral function, the control unit 10 controls the calculation unit 15 to perform predetermined signal processing on the image data output from the camera unit 17, so that the spectral spectrum and / or Calculate chromaticity.

  That is, as shown in the flowchart of FIG. 3, the arithmetic unit 15 converts the color image data photographed by the camera unit 17 into a digital signal in step st1, and proceeds to step st2. In step st2, the calculation unit 15 performs RGB (red, green, blue) numerical values of measurement points on the object in the color image data converted into digital signals, and the color filter of the camera unit 17 as shown in FIG. The spectral spectrum is obtained by calculation based on the spectral characteristics and the spectral spectral characteristics of the sensitivity of the camera unit 17 and stored in the memory 14. The spectral characteristics of the color filter of the camera unit 17 and the spectral characteristics of the sensitivity of the camera unit 17 are stored in advance in the memory 14 as predetermined data.

  Here, the measurement points on the object are, as shown in FIG. 5, a sufficiently small region (a narrow field angle) in the captured image I. This is because if the range of the measurement point is wide, various colors may be mixed in the measurement point, and there is a possibility that data meaningful for determination regarding the object cannot be obtained.

  In the next step st3, the calculation unit 15 corrects the spectral spectrum obtained in step st2 with reference to the spectrum obtained when the camera unit 17 captures the white part serving as a reference, as a spectral spectrum of the object. Reconfigure.

  This correction is an operation called white balance correction, and may be performed based on the spectrum obtained when the reference white portion is imaged as described above, and the light source (illumination) at that location is directly imaged. The spectrum obtained as described above may be used as a reference.

  Since the white object used as a reference must be prepared and brought in advance, it is slightly inconvenient, but there is no such inconvenience if the light source (illumination) is directly photographed. On the other hand, when the light source (illumination) is directly photographed, when the light source is a strong light source such as direct sunlight, there is a possibility that the white balance cannot be corrected satisfactorily. In such a case, the amount of light incident on the camera unit 17 may be reduced by using a filter having a uniform spectral transmittance such as an ND filter (Neutral Density Filter).

  In this manner, in this portable terminal device, as shown in FIGS. 6a to 8c, the spectral spectrum of the object can be reproduced with a measurement error of about 50 nm.

  In FIG. 6a, the spectrum of the substantially red object obtained by the portable communication terminal and the spectrum obtained for the same object by a conventional spectrometer are shown by solid lines. Moreover, the spectral spectrum about the same target object obtained by the method similar to the above using what is called a digital still camera is shown with the dotted line.

  In FIG. 6b, the spectrum of the substantially white object obtained by the portable communication terminal and the spectrum obtained for the same object by a conventional spectroscope are shown by solid lines. Moreover, the spectral spectrum about the same target object obtained by the method similar to the above using what is called a digital still camera is shown with the dotted line.

  In FIG. 6c, the solid line shows the spectrum obtained by correcting the spectral spectrum of the substantially red object obtained by the mobile communication terminal based on the spectral spectrum of the approximately white object. In addition, the spectral spectrum of the same object obtained by correcting in the same manner using a so-called digital still camera is indicated by a dotted line.

  In FIG. 7a, the spectrum of the substantially green object obtained by the portable communication terminal and the spectrum obtained for the same object by a conventional spectroscope are shown by solid lines. Moreover, the spectral spectrum about the same target object obtained by the method similar to the above using what is called a digital still camera is shown with the dotted line.

  In FIG. 7b, the spectrum of the substantially white object obtained by the portable communication terminal and the spectrum obtained for the same object by a conventional spectroscope are shown by solid lines. Moreover, the spectral spectrum about the same target object obtained by the method similar to the above using what is called a digital still camera is shown with the dotted line.

  In FIG. 7c, the solid line shows the spectrum obtained by correcting the spectral spectrum of the substantially green object obtained by the portable communication terminal based on the spectral spectrum of the approximately white object. In addition, the spectral spectrum of the same object obtained by correcting in the same manner using a so-called digital still camera is indicated by a dotted line.

  In FIG. 8a, the spectrum of the substantially yellow object obtained by the portable communication terminal and the spectrum obtained for the same object by a conventional spectrometer are shown by solid lines. Moreover, the spectral spectrum about the same target object obtained by the method similar to the above using what is called a digital still camera is shown with the dotted line.

  In FIG. 8b, the spectral spectrum of the substantially white object obtained by the portable communication terminal and the spectrum obtained for the same object by the conventional spectroscope are shown by solid lines. Moreover, the spectral spectrum about the same target object obtained by the method similar to the above using what is called a digital still camera is shown with the dotted line.

  In FIG. 8c, the spectrum obtained by correcting the spectral spectrum of the substantially yellow object obtained by the mobile communication terminal based on the spectral spectrum of the approximately white object is indicated by a solid line. In addition, the spectral spectrum of the same object obtained by correcting in the same manner using a so-called digital still camera is indicated by a dotted line.

  In this portable terminal device, the white balance correction is applied to the type of light source such as “sunlight (clear)”, “sunlight (cloudy)”, “incandescent light”, “fluorescent light”, etc. A stepwise setting corresponding to this may be determined in advance, and the user may determine and select the type of light source from these settings.

  In the next step st4, the calculation unit 15 calculates the chromaticity of the object based on the spectral spectrum corrected in step st3.

  In this portable terminal device, the spectral spectrum data and / or data indicating the chromaticity of the object obtained as described above is sent as an e-mail or as an attached file to a so-called e-mail by the communication circuit 12. Sent to the outside. At this time, the mail function described above is used.

  In addition, the mobile terminal device may include a determination unit that determines the property of the target based on the spectral spectrum of the target obtained by the calculation unit 15. The determination unit collates the spectral spectrum data of the object obtained by the calculation unit 15 with an information database relating to the properties (materials and states) of the substances stored in the memory 14 in advance, and the material and state of the objects. Determine the properties such as. As for the determination of the properties of such an object, when the object is urine or skin, the health condition is determined, or when the object is water with or without the addition of a reagent, It can be applied as a judgment.

  In this case, the communication unit 12 can also transmit data indicating the determination result in the determination unit to the outside.

[Spectral analysis system]
By using the portable terminal device according to the present invention as described above, a spectroscopic analysis system can be constructed. That is, as shown in FIG. 9, the spectroscopic analysis system includes the above-described portable communication terminal 20, a receiving device 21 that receives spectral spectrum data of an object transmitted from the portable terminal device, and the receiving device 21. And a discriminating device 23 for discriminating the properties of the object by collating the data received by the database 22 that associates the spectral spectrum with the properties of the substance.

  In this spectroscopic analysis system, the discriminating device 23 can discriminate properties such as the material and state of the object based on the data received from the portable terminal device by the receiving device 21, Water quality can be determined.

  In this spectroscopic analysis system, a database having a large amount of data that cannot be stored in the memory of the mobile terminal device can be used. In addition, the database 22 in the spectroscopic analysis system can add new data on various new materials, environment and health management fields that are not currently measured, and change the functions of the mobile terminal device. Even without this, new data such as new materials can be handled.

It is a perspective view which shows the structure of the portable communication terminal which concerns on this invention. It is a block diagram which shows the circuit structure of the said mobile communication terminal. It is a flowchart which shows operation | movement of the said mobile communication terminal. It is a graph which shows the spectral transmission characteristic of the color filter with which the camera part of the said portable terminal device is provided. It is a front view which shows the relationship between the image imaged in the said mobile communication terminal, and a measurement point. It is a graph which shows the spectral spectrum of the substantially red target obtained with the said mobile communication terminal. It is a graph which shows the spectral spectrum of the substantially white target object obtained with the said mobile communication terminal. It is a graph which shows the spectrum which correct | amended the spectral spectrum of the substantially red target obtained by the said mobile communication terminal based on the spectral spectrum of the substantially white target. It is a graph which shows the spectral spectrum of the substantially green target object obtained with the said mobile communication terminal. It is a graph which shows the spectral spectrum of the substantially white target object obtained with the said mobile communication terminal. It is a graph which shows the spectrum which correct | amended the spectral spectrum of the substantially green target obtained with the said mobile communication terminal based on the spectral spectrum of the substantially white target. It is a graph which shows the spectral spectrum of the substantially yellow target obtained with the said mobile communication terminal. It is a graph which shows the spectral spectrum of the substantially white target object obtained with the said mobile communication terminal. It is a graph which shows the spectrum which correct | amended the spectral spectrum of the substantially yellow target obtained by the said mobile communication terminal based on the spectral spectrum of the substantially white target. 1 is a block diagram showing a configuration of a spectral analysis system according to the present invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 1st housing | casing part 2 2nd housing | casing part 3 Operation part 4 Display screen part 10 Control part 12 Communication circuit part 14 Memory 15 Calculation part 17 Camera part 20 Portable terminal device 21 Receiving device 22 Database 23 Discriminating device

Claims (3)

A camera unit for color shooting of an object;
The color image photographed by the camera unit is converted into a digital signal, and the spectrum is calculated by calculation based on the RGB numerical value of the object in the color image, the spectral characteristic of the color filter provided in the camera unit, and the spectral spectral characteristic of the sensitivity of the camera unit. And calculating the spectrum by correcting the spectrum obtained when the white part is photographed by the camera unit as a reference, and reconstructing the spectral spectrum of the object,
A mobile communication terminal, comprising: a communication unit that transmits spectral spectrum data of the object obtained by the calculation unit to the outside. Based on the spectral spectrum of the object obtained by the arithmetic unit, a determination unit for determining the property of the object,
The mobile communication terminal according to claim 1, wherein the communication unit transmits data indicating a determination result in the determination unit to the outside. The spectrum data of the object transmitted from the mobile communication terminal according to claim 1 is received, and the received data is collated with a database relating the spectrum and the property of the substance, Spectral analysis system characterized by distinguishing properties.

Images