JP2012147878A - Data recorder, data recording method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a data recorder and associated technologies thereof, in which measurement results with a variety of measurement equipment used by users can be managed in an integrated fashion.SOLUTION: In the data recorder, a terminal 1 includes: a display part; and a camera part for taking a picture of the measurement equipment 3 used by the users. The terminal 1 executes image analysis of images taken by the camera part so as to acquire the data of the measurement results. The terminal 1 stores the images and the data of the measurement results which are associated with each other. The terminal 1 decides whether or not the image analysis succeeds. If the image analysis is decided to be failed, the terminal 1 indicates the image on the display part, and accepts correction from the user operating the input part.

Description

  The present invention relates to a data recording apparatus for recording and utilizing a measurement result of a measuring device and related technology.

  There are various measuring devices for measuring information serving as an index of a person's health condition such as a physical condition and an amount of exercise. For example, a height meter, a weight meter, a body fat meter, a blood pressure meter, a pedometer, and the like. However, in many cases, the conventional measuring device only displays the measurement result and does not have a means for storing or outputting the measurement result externally. For this reason, a system that easily records and uses various measurement results together is desired.

  Cited Document 1 discloses a data input device that photographs a measurement device and acquires a measurement result from an image by image recognition. If such an apparatus is used, the user can save and output the measurement result as data simply by taking a picture of the display unit of the measurement apparatus.

JP 2001-224557 A

  If image recognition is used as in Cited Document 1, measurement result data can be collected regardless of the type of measurement device. However, image recognition processing may fail and measurement result data may not be acquired, or incorrect measurement result data may be recorded. In addition, when the display method of the measuring device is unknown, the data recording apparatus may not be able to perform image recognition processing. Further, there is a possibility that the user fails to shoot and can only acquire an unclear image, and the data recording apparatus may fail in the image recognition process.

  An object of the present invention is to provide a data recording apparatus and related technology that solves the above-described problems and enables a user to manage measurement results in a centralized manner using various measuring devices. is there.

  According to the first aspect of the present invention, the data recording apparatus performs image analysis on a display unit, an imaging unit that images a measurement device used by a user, and an image acquired by the imaging unit. Data acquisition means for acquiring measurement result data; first storage means for storing the image and the measurement result data in association; determination means for determining success or failure of the image analysis; and Correction means for presenting the image and accepting the correction when it is determined as failure.

  According to this configuration, the user only records the result display unit of the measuring device, and the measurement result data is automatically recorded by image recognition. Even if image recognition fails, data can be corrected by looking at the image later.

  In addition to the image and the measurement result data, date and time information may be stored in association with the storage means.

  According to this configuration, images and measurement result data can be organized using date / time information.

In this case, if the image data and the measurement result data of the same date exist, any one of the data may be left and the other data may be deleted. For example, data having a later time may be left among a plurality of data. A plurality of data may be presented to the user to select which data to leave.
In this case, the image may be erased from the storage means when a predetermined date and time has passed since the date.
The image may be erased from the storage means when the correction is completed.

According to this configuration, unnecessary data can be erased and a large amount of measurement result data can be stored. In this case, the user may be prompted for confirmation before erasing the data.

  In the above data recording apparatus, the image analysis fails even when the determination unit sets an expected change amount and the difference between the previous measurement result data and the current measurement result data exceeds the expected change amount. You may make it judge that there exists.

  According to this configuration, it is possible to prevent as much as possible erroneous measurement result data from being stored due to erroneous image recognition.

There are measurement objects whose measurement results do not vary much in a short period. For example, height and weight. If the difference between the previous measurement result and the current measurement result is too large, there is a high possibility that the image recognition has failed.
On the other hand, there are measurement objects whose measurement results are not constant every day, such as the amount of exercise such as the number of steps.

For this reason, you may make it change the setting method of the said expected variation | change_quantity for every measuring object.
Further, the expected change amount may not be set depending on the measurement target.
Further, the expected change amount may be set based on past measurement results such as an average of measurement results and a standard deviation.
If comprised in this way, it can prevent that an incorrect measurement result is memorize | stored with higher precision.

  In the above data recording apparatus, the data acquisition device further includes model identification means for identifying a model of the measuring instrument, and second storage means for storing auxiliary information for assisting image analysis for each model. A means may perform the image analysis using the auxiliary information.

  According to this configuration, it is possible to perform image recognition with high accuracy for many measuring devices having different measurement targets and display methods.

  The second storage means does not need to be physically different from the first storage means, and includes a state in which different storage areas on the same storage means are used.

  The data recording apparatus may further include a means for creating a request message when the measuring device used by the user is not stored in the model identification means or the second storage means.

According to this configuration, it is possible to send a request message to a data recording device or a provider that provides a service using the data recording device and request to update the information.
For example, the data recording apparatus displays an input form for arbitrarily inputting a model name, a manufacturer name, an image obtained by photographing the measuring device, and the like to the user. Then, the data recording apparatus collects the input information and transmits it as a request message to the above trader. The trader can create and distribute update data for the data recording device by looking at the request message.
As a result, many users' data recording apparatuses can perform image recognition with higher accuracy.

  In the above data recording apparatus, when the user executes the shooting, the shooting unit displays the image currently being shot and a sample image from which the measurement result can be read side by side on the display unit. May be.

According to this configuration, the user can execute shooting while looking at the sample image and keeping in mind that the data recording apparatus can easily recognize the image. For this reason, it becomes easy to memorize | store the image which a data acquisition means tends to perform image recognition. As a result, the accuracy of image recognition can be improved.
When the data recording apparatus includes model identification means, the sample image may be prepared in advance for each model of the measuring device.

In the data recording apparatus, all components may be mounted on one terminal.
On the other hand, in the above data recording device, each component may be shared by a plurality of devices. In this case, a communication means is required between the devices. In this case, it is not necessary for the user to possess and operate all devices. For example, the data recording device may be configured by a combination of a terminal used by a user and a server operated by a data recording device or a service provider that uses the data recording device.

  According to a second aspect of the present invention, a data recording method includes a photographing step of photographing a measuring device used by a user, an image analysis is performed on an image acquired by the photographing unit, and measurement result data Presenting the image when the image analysis is determined to be unsuccessful in the determination, the step of determining the success or failure of the image analysis, and the step of determining whether the image analysis is successful And receiving a correction.

  In the step of storing the image and the measurement result data in association with each other, date information may be stored in association with the image in addition to the measurement result data.

In this case, if the image data and the measurement result data of the same date exist, any one of the data may be left and the other data may be deleted. For example, data having a later time may be left among a plurality of data. A plurality of data may be presented to the user to select which data to leave.
In this case, the image may be deleted when a predetermined date and time has passed since the date.
The image may be erased when the correction is completed.

  In the determination of the data recording method described above, an expected change amount is set, and the image analysis fails even when the difference between the previous measurement result data and the current measurement result data exceeds the expected change amount. You may make it judge.

In this case, you may make it change the setting method of the said expected variation | change_quantity for every measuring object.
Further, the expected change amount may not be set depending on the measurement target.
Further, the expected change amount may be set based on past measurement results such as an average of measurement results and a standard deviation.

  In the above data recording method, further comprising the step of identifying the model of the measuring instrument and the step of storing auxiliary information for assisting image analysis for each model, and acquiring the measurement result The image analysis may be executed using the auxiliary information.

  If the measuring device used by the user is not stored in the data recording method, a step of creating a request message may be further included.

  In the data recording method described above, when performing the shooting, an image currently being shot and a sample image from which a measurement result can be read may be displayed side by side.

  Further, when the data recording method includes the step of identifying the model, the sample image may be prepared in advance for each model of the measuring device.

In the above data recording method, one terminal may execute all the processes.
On the other hand, in the data recording method described above, each process may be shared and executed by a plurality of devices. In this case, a step for performing communication between the devices is required. In this case, it is not necessary for the user to possess and operate all devices. For example, the data recording device may be configured by a combination of a terminal used by a user and a server operated by a data recording device or a service provider that uses the data recording device.

  As described above, according to the data recording method of the second aspect of the present invention, the same effects as those of the data recording apparatus according to the first aspect of the present invention are exhibited.

  According to a third aspect of the present invention, the program is a program that causes a computer to execute the data recording method according to the second aspect of the present invention. According to this configuration, the same effects as those of the data recording apparatus according to the first aspect of the present invention can be obtained.

  According to a fourth aspect of the present invention, the recording medium is a recording medium storing the above program. According to this configuration, the same effects as those of the data recording apparatus according to the first aspect of the present invention can be obtained.

  The novel features of the invention are set forth in the appended claims. However, the invention itself and other features and advantages can be readily understood by reading the detailed description of specific embodiments with reference to the accompanying drawings.

FIG. 1 is a diagram showing an overall configuration of a data recording system according to the first embodiment. FIG. 2 is a block diagram showing the configuration of the terminal 1 and the server 5 of FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals, and the description thereof is incorporated.

FIG. 1 is a diagram showing an overall configuration of a data recording system according to the first embodiment.
With reference to FIG. 1, the data recording system includes a terminal 1, a measuring device 3, and a server 5.

The terminal 1 is a terminal owned by each user. The terminal 1 is a so-called smartphone, has a camera as a photographing unit, and can directly communicate with the server 5 through the network 7.
The network 7 may be an open network such as the Internet or a closed network such as an intranet.
An application for using the data recording system is installed in the terminal 1 in advance. An application for linking with the application of the terminal 1 is also installed in the server 5. Hereinafter, the application installed in the terminal 1 and the server 5 will be described as a “measurement application”.

The measuring device 3 includes a plurality of measuring devices. The user described in this embodiment uses three types of measuring devices, a weight scale, a sphygmomanometer, and a pedometer. The user can add a measuring device later.
Although not shown, there are as many terminals 1 as there are users. In addition, the number and type of measuring devices vary depending on the user. The types of measurement devices handled by the measurement application are not limited to the three types shown in the measurement device 3. In addition, by updating the measurement application, it is theoretically possible to support any measuring device having a display unit.

  The measurement application stores the types and models of measurement devices that can be handled by the measurement application at the present time. Each user operates the measurement application, and registers in advance the type or model of the measurement device used by the user in the terminal 1 and the server 5. Note that the type of measuring device means a classification according to a measurement target (for example, a height meter, a weight meter, a body fat meter, a blood pressure meter, a grip strength meter, a pedometer, etc.). The model of the measuring device means a classification for each same model made by each manufacturer.

  Registration of the model of the measuring device is optional. When the user also registers the model, the terminal 1 can use auxiliary information for improving the accuracy of image recognition prepared in advance for each model when executing image recognition described later.

  The user first selects the type of the measuring device 3 when performing measurement using each measuring device 3. And the result display part of each measuring device 3 is image | photographed with the camera of the terminal 1. FIG. The terminal 1 performs an image recognition process on the image acquired by shooting, and acquires measurement result data. The measurement result data includes a measurement object, a unit, a model of a measurement device, and a numerical value of the measurement result. The terminal 1 stores the captured image, the measurement result data, and the shooting date and time in association with each other.

  The server 5 is managed by a service provider. The server 5 is accessed from the terminal 1 of each user. The server 5 receives and records measurement result data from the terminal 1. The server 5 generates display data to be displayed in a form that is easy for the user to see, such as a graph, based on the daily measurement result data. The display data is transmitted to each terminal in response to a request from each terminal 1. The terminal 1 generates and displays a display screen based on the received display data.

  Moreover, the server 5 can also provide a user's measurement result to external servers, such as a hospital. However, the provision of information to the external server is performed only when there is an agreement between the user and the service provider in advance.

As described above, the user who uses the data recording system of FIG. 1 can record the daily measurement result only by photographing the result display unit of the measuring device 3 with the camera of the terminal 1.
In addition, the user can browse his / her past measurement results through the terminal 1 in an easy-to-view and edited form.
In addition, the user can utilize the measurement result by, for example, disclosing the measurement result data to an external organization such as a hospital through the server 5 and using it for a medical examination or the like.

FIG. 2 is a block diagram showing the configuration of the terminal 1 and the server 3 of FIG.
Referring to FIG. 2, terminal 1 includes a CPU (Central Processing Unit) 101, a memory unit 103, an input unit 105, a display unit 107, a camera unit 109, a communication unit 111, a clock unit 113, and a bus 115.
The server 5 includes a CPU 501, a memory unit 503, an input unit 505, a display unit 507, a communication unit 511, and a bus 515.

The CPU 101 executes various programs stored in the memory unit 103 and controls each component of the other terminal 1.
The memory unit 103 includes a plurality of memories selected according to applications, such as a ROM, a RAM, and a hard disk. The memory unit 103 stores a program including a measurement application. The memory unit 103 is used as a working memory for various processes of the CPU 101.
The input unit 105 is an input interface operated by a user. The input unit 105 includes a touch panel and buttons. The configuration included in the input unit 105 differs depending on the model of the terminal 1. The input unit 105 generates input information in response to a user operation and transmits the input information to the CPU 101 that executes the program.
The display unit 107 displays a screen generated by the CPU 101 according to the program.
The camera unit 109 executes shooting processing and acquires image data. This image data includes moving images.
The communication unit 111 controls communication with an external device. The communication unit 111 is used for calling with other terminals, exchanging electronic mail, connecting to the Internet, and communicating with the server 5.
The clock unit 113 acquires date information.
The memory unit 103, the input unit 105, the display unit 107, the camera unit 109, the communication unit 111, and the clock unit 113 are controlled by the CPU 101 via the bus 115.
Hereinafter, the process of the CPU 101 based on the program may be simply described as the process of the terminal 1.

The CPU 501 executes various programs stored in the memory unit 503 and controls each component of the other server 5.
The memory unit 503 includes a plurality of memories selected according to applications, such as a ROM, a RAM, and a hard disk. The memory unit 503 stores a program including a measurement application. The memory unit 503 is also used as a working memory for various processes of the CPU 501.
The input unit 505 is an input interface for an administrator of the server 5 to input to the server 5. The input unit 505 includes a keyboard, a mouse, and the like. The input unit 505 generates input information according to the operation of the administrator, and transmits it to the CPU 501 that executes the program.
The display unit 507 displays a screen generated by the CPU 501 according to the program.
The communication unit 511 controls communication with an external device. The communication unit 511 executes communication with each terminal 1 and an external server.
The clock unit 513 acquires date information.
The memory unit 503, the input unit 505, the display unit 507, the communication unit 511, and the clock unit 513 are controlled by the CPU 501 via the bus 515.
Hereinafter, the process of the CPU 501 based on the program may be described as the process of the server 5.

  Next, processing of the measurement application executed by the terminal 1 and the server 5 will be described.

(Measuring device registration)
The user performs registration processing of the measuring device 3 through the terminal 1 when the use of the measuring application is started or when the measuring devices 3 increase.
First, the terminal 1 specifies the type of measuring device. The terminal 1 displays a list of types of measurement devices recorded in the measurement application on the display unit 107. Then, the terminal 1 specifies the type of measuring device selected by the user in accordance with the signal from the input unit 105.

  Next, the terminal 1 causes the user to register the model of the measuring device. There are two types of model registration processing.

One is a method in which the user selects from a list. In this case, the terminal 1 displays a list of models prepared in advance in the measurement application for each type of measurement device on the display unit 107. Then, the terminal 1 specifies the model selected by the user according to the signal from the input unit 105. At this time, the models can be further narrowed down by information such as manufacturer input by the user.
The other is a method in which the server 5 determines from the image of the measuring device 3.
In this case, the terminal 1 photographs the measurement device. Then, the terminal 1 transmits the captured image to the server 5. The server 5 performs pattern matching between the captured image and an image for each model prepared in advance. When the image includes a barcode such as a JAN code of the model, the server 5 further performs a barcode decoding process and searches for the model based on information indicated by the barcode.

If there is a corresponding model, the server 5 sends model information to the terminal 1. The terminal 1 allows the user to select whether the model is correct, Yes or No.
In the case of Yes, the terminal 1 registers the model as the model of the user's measuring device. In the case of No, the terminal 1 displays an input form and arbitrarily inputs information useful for specifying the model such as the model name, model number, manufacturer, barcode image or number. The terminal 1 also sends information acquired from the input form to the server 5. The server 5 stores the image and information of the measurement device. The administrator of the server 5 can check the model based on the image and information, and can add a model list when updating the measurement application.

(Recording of measurement results)
When the user performs measurement, the user records the measurement result. This process is a process of photographing the result display unit of the measuring device 3 being measured by the camera unit 109 of the terminal 1 and acquiring the measurement result as data by image recognition.

  Note that the image recognition method employed by the measurement application may be a known image recognition method. For example, an image recognition method as disclosed in the cited document 1 may be used. The service provider can appropriately select an image recognition method and update the measurement application.

  First, the terminal 1 displays a list of the measuring devices 3 registered by the user on the display unit 107. The user selects a measuring device 3 to be used for measurement from the list. When the user's selection is completed, the terminal 1 activates the camera unit 109 and starts photographing processing. During the shooting process, the terminal 1 displays on the display unit 107 a shooting image shown in the camera unit 109 and a sample image prepared in advance for each model. This sample image is an example of an image that the terminal 1 can easily recognize. The user presses a predetermined button on the input unit 105 of the terminal 1 when the captured image and the sample image have substantially the same composition. When the button is pressed, the terminal 1 stores the image.

  Next, the terminal 1 performs image recognition processing on the stored image. At this time, the terminal 1 uses auxiliary information prepared in advance for each model in the measurement application. The auxiliary information is information for improving the accuracy of the image recognition process. The auxiliary information includes information such as the display method and display position of a certain model.

  The terminal 1 acquires measurement result data by image recognition. The measurement result data includes the numerical value read by the terminal 1 and the measurement target and unit specified by the model of the measurement device. The terminal 1 stores the stored image of the measuring device 3, measurement result data, and date / time data acquired by the clock unit 113 in the memory unit 103. The terminal 1 transmits the measurement result data with the newest date / time to the server 5 once a day. The server 5 records the date data and measurement result data for each terminal 1.

  In addition, when there is no communication from the terminal 1 for a predetermined period, for example, five days or more, the server 5 transmits a mail to the terminal 1 and asks the state of the user.

  When the terminal 1 cannot recognize an image or when the user selects the manual input mode, the terminal 1 displays an input form prepared for each type of measuring device. The user operates the input unit 105 in accordance with the input form and inputs a numerical value of the measurement result. The terminal 1 adds units of measurement results according to the type of the selected measuring device 3, adds date and time information, and handles values input by the user as measurement result data.

(Correction process)
If the terminal 1 determines that the image recognition has failed, the terminal 1 executes correction processing. In this case, the terminal 1 displays an image that could not be recognized on the display unit 107. The user views the displayed image and operates the input unit 105 to input a numerical value of the measurement result. The terminal 1 adds a unit to the value input from the input unit 105 and overwrites the measurement result data.

If the terminal 1 fails to read the value as a result of the image recognition, the terminal 1 determines that it has failed.
Also, the terminal 1 determines that the change has failed even when the change amount of the measurement result data exceeds the following expected change amount data.

  The terminal 1 generates predicted change amount data based on daily measurement data for a specific measurement target. Next, the terminal 1 acquires the difference between the previous measurement result data and the current measurement result data. When the difference is larger than the value of the expected change amount data, the terminal 1 determines that the image recognition has failed.

  For example, the terminal 1 records 5% of the previous measurement result as the expected change amount data regarding the weight. The method of setting expected change data differs for each measurement target. For a measurement target such as height and weight that hardly fluctuates in a short period of time, the expected change amount data is set to be small. For a measurement target that can change greatly depending on the day, such as the number of steps and the amount of exercise, the expected change amount is set large. Depending on the measurement target, the expected change amount data may not be set. The expected change amount is, for example, a predetermined multiple of the average value of past measurement result data. The expected change amount may be set based on other parameters such as a standard deviation obtained from past measurement results.

  The expected change amount data can also be used for image recognition. For example, if the terminal 1 has two candidates for the numerical value of the measurement result as a result of image recognition, and one is within the range of the expected change, and the other is out of the range, the value that is within the range of the expected change To do.

  If the user views the measurement result data and determines that the image recognition of the terminal 1 is wrong, the user can operate the input unit 105 to cause the terminal 1 to execute correction processing.

  When the correction process is performed, the terminal 1 communicates with the server 5 and requests overwriting of the measurement result data. When the correction process is completed, the terminal 1 deletes the image and leaves only the date data and measurement result data. Based on the date / time data, the terminal 1 similarly deletes the image and leaves only the date / time data and the measurement result data even when a predetermined date / time has elapsed from the shooting date.

  As described above, according to the first embodiment, the user simply records the result display unit of the measuring device 3 and the measurement result data is automatically recorded by the image recognition. Even if image recognition fails, the measurement result data can be corrected by looking at the image later.

  Images and measurement result data can be organized using date and time information.

  Since unnecessary images that have become unnecessary after correction processing are deleted, a large amount of measurement result data can be stored. In this case, the user may be prompted for confirmation before erasing the data.

  It is possible to prevent as much as possible wrong measurement result data from being stored due to wrong image recognition.

  Further, by determining the success or failure of the image recognition using the predicted change amount data, it is possible to prevent an erroneous measurement result from being stored with higher accuracy.

  When the model of the measuring device 3 can be specified, the terminal 1 can use auxiliary information that assists image recognition in advance for each model of the measuring device. For this reason, the terminal 1 can perform image recognition with high accuracy with respect to many measuring devices having different measurement targets and display methods.

Even when the model of the measuring device 3 cannot be specified, it is possible to request the service provider to update the information by transmitting a request message for adding the model of the measuring device 3 to the measuring application.
As a result, many users' terminals 1 can perform image recognition with higher accuracy.

  By displaying the image being photographed and the sample image side by side at the time of photographing, the user can perform photographing while looking at the sample image and keeping in mind that the data recording apparatus can easily recognize the image. For this reason, it is easy to store an image in which the terminal 1 can easily perform image recognition. As a result, the terminal 1 can improve the accuracy of image recognition.

(Modification)
The present invention is not limited to the above-described embodiment, and can be implemented in various modes without departing from the gist thereof. For example, the following modifications are possible.

  (1) In the first embodiment, the processing is shared between the terminal 1 and the server 5, but all processing may be executed only by the terminal 1. In this case, there is no need to communicate with the server 5. Further, the processing to be shared between the terminal 1 and the server 5 may be changed. A trader who implements the present invention may provide a device corresponding to the terminal 1, the server 5, and the measurement application alone. Moreover, you may provide only a measurement application as a recording medium which recorded the program or the program.

  (2) In Embodiment 1, the terminal 1 gave the example of a smart phone, and the example of the terminal with which all the components of FIG. 2 were mounted in one housing | casing was given. However, you may use the terminal in which each component was provided separately. For example, a general-purpose personal computer is used as a terminal, and an external camera (camera unit), a mouse and keyboard (input unit), a display (display unit), a modem (communication unit), and a clock (clock unit) are wired or wirelessly connected. A connected configuration may be used. In this case, it is desirable that the external camera be portable by the user.

  DESCRIPTION OF SYMBOLS 1 ... Terminal, 3 ... Measuring device, 5 ... Network, 7 ... Server

Claims (10)

Display means;
Photographing means for photographing the measuring device used by the user;
Data acquisition means for performing image analysis on the image acquired by the imaging means and acquiring measurement result data;
First storage means for storing the image and the measurement result data in association with each other;
Determining means for determining success or failure of the image analysis;
A data recording apparatus comprising: correction means for displaying the image on the display means and accepting correction when the determination means determines that the image analysis has failed.   The determination unit sets an expected change amount, and determines that the image analysis is failed even when the difference between the previous measurement result data and the current measurement result data exceeds the expected change amount. The data recording apparatus according to claim 1. A model identifying means for identifying the model of the measuring instrument;
Second storage means for storing auxiliary information for assisting image analysis for each model,
The data recording apparatus according to claim 1, wherein the data acquisition unit performs the image analysis using the auxiliary information.   The image capturing unit displays, when the user performs the image capturing, an image currently being captured and a sample image from which a measurement result can be read side by side on the display unit. 4. The data recording device according to any one of items 1 to 3. Photographing the measuring device used by the user;
Performing image analysis on an image acquired by the imaging and acquiring measurement result data; and
Storing the image and the measurement result data in association with each other;
A data recording method comprising: determining whether the image analysis is successful; and displaying the image on the display means and accepting correction when the image analysis is determined to be unsuccessful.   In the step of determining success or failure of the image analysis, an expected change amount is set, and the image analysis fails even when the difference between the previous measurement result data and the current measurement result data exceeds the expected change amount. The data recording method according to claim 5, wherein the data recording method is determined. Identifying a model of the measuring instrument;
Storing auxiliary information for assisting image analysis for each model, and
7. The data recording method according to claim 5, wherein in the step of obtaining the measurement result data, the image analysis is executed using the auxiliary information.   8. The step of photographing the measuring device includes displaying an image currently being photographed and a sample image from which a measurement result can be read side by side on the display means. Data recording method.   The program which makes a computer perform the process of Claims 5-8.   A recording medium on which the program according to claim 9 is recorded.

Images